-- Logs begin at Sat 2022-08-27 04:08:43 UTC, end at Sat 2022-08-27 06:48:23 UTC. -- Aug 27 04:40:54.363739 n-d-820368-35 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 04:40:54.373686 n-d-820368-35 devstack@n-api.service[112692]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 04:40:54.375730 n-d-820368-35 devstack@n-api.service[112692]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 04:40:54 2022] *** Aug 27 04:40:54.375730 n-d-820368-35 devstack@n-api.service[112692]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 04:40:54.375730 n-d-820368-35 devstack@n-api.service[112692]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 04:40:54.375730 n-d-820368-35 devstack@n-api.service[112692]: nodename: n-d-820368-35 Aug 27 04:40:54.375730 n-d-820368-35 devstack@n-api.service[112692]: machine: x86_64 Aug 27 04:40:54.375730 n-d-820368-35 devstack@n-api.service[112692]: clock source: unix Aug 27 04:40:54.375730 n-d-820368-35 devstack@n-api.service[112692]: pcre jit disabled Aug 27 04:40:54.375730 n-d-820368-35 devstack@n-api.service[112692]: detected number of CPU cores: 4 Aug 27 04:40:54.375730 n-d-820368-35 devstack@n-api.service[112692]: current working directory: / Aug 27 04:40:54.375730 n-d-820368-35 devstack@n-api.service[112692]: detected binary path: /usr/bin/uwsgi-core Aug 27 04:40:54.375730 n-d-820368-35 devstack@n-api.service[112692]: your processes number limit is 47680 Aug 27 04:40:54.376388 n-d-820368-35 devstack@n-api.service[112692]: your memory page size is 4096 bytes Aug 27 04:40:54.376388 n-d-820368-35 devstack@n-api.service[112692]: detected max file descriptor number: 2048 Aug 27 04:40:54.376388 n-d-820368-35 devstack@n-api.service[112692]: lock engine: pthread robust mutexes Aug 27 04:40:54.376388 n-d-820368-35 devstack@n-api.service[112692]: thunder lock: enabled Aug 27 04:40:54.376388 n-d-820368-35 devstack@n-api.service[112692]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 04:40:54.376388 n-d-820368-35 devstack@n-api.service[112692]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 04:40:54.415589 n-d-820368-35 devstack@n-api.service[112692]: Python main interpreter initialized at 0x55e870e319c0 Aug 27 04:40:54.415589 n-d-820368-35 devstack@n-api.service[112692]: python threads support enabled Aug 27 04:40:54.415589 n-d-820368-35 devstack@n-api.service[112692]: your server socket listen backlog is limited to 100 connections Aug 27 04:40:54.415589 n-d-820368-35 devstack@n-api.service[112692]: your mercy for graceful operations on workers is 90 seconds Aug 27 04:40:54.416023 n-d-820368-35 devstack@n-api.service[112692]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 04:40:54.416023 n-d-820368-35 devstack@n-api.service[112692]: *** Operational MODE: preforking *** Aug 27 04:40:54.416301 n-d-820368-35 devstack@n-api.service[112692]: *** uWSGI is running in multiple interpreter mode *** Aug 27 04:40:54.416301 n-d-820368-35 devstack@n-api.service[112692]: spawned uWSGI master process (pid: 112692) Aug 27 04:40:54.416509 n-d-820368-35 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 04:40:54.417859 n-d-820368-35 devstack@n-api.service[112692]: spawned uWSGI worker 1 (pid: 112693, cores: 1) Aug 27 04:40:54.417859 n-d-820368-35 devstack@n-api.service[112692]: spawned uWSGI worker 2 (pid: 112694, cores: 1) Aug 27 04:40:54.417859 n-d-820368-35 devstack@n-api.service[112692]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 04:40:55.096414 n-d-820368-35 devstack@n-api.service[112693]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 04:40:55.096997 n-d-820368-35 devstack@n-api.service[112694]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 04:40:56.209807 n-d-820368-35 devstack@n-api.service[112694]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:40:56.209807 n-d-820368-35 devstack@n-api.service[112694]: from cryptography.utils import int_from_bytes Aug 27 04:40:56.210500 n-d-820368-35 devstack@n-api.service[112694]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:40:56.210500 n-d-820368-35 devstack@n-api.service[112694]: from cryptography.utils import int_from_bytes Aug 27 04:40:56.210671 n-d-820368-35 devstack@n-api.service[112693]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:40:56.210671 n-d-820368-35 devstack@n-api.service[112693]: from cryptography.utils import int_from_bytes Aug 27 04:40:56.211066 n-d-820368-35 devstack@n-api.service[112693]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:40:56.211066 n-d-820368-35 devstack@n-api.service[112693]: from cryptography.utils import int_from_bytes Aug 27 04:40:58.737809 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:40:58.738577 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:40:58.738670 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:40:58.738962 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:40:58.739244 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:40:58.739640 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.739971 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.740295 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.740614 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.740956 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.741269 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.741594 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.741919 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.742229 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:40:58.742621 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.742621 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.742780 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:40:58.742865 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.743027 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:40:58.743164 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-820368-35 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.743421 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:40:58.743508 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.743682 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:40:58.743775 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.744040 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.744132 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.744363 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.744452 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.744670 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.744762 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.744997 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.745096 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.745306 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.745397 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.745635 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.745825 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.745957 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.746284 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.746415 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.746593 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.746698 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.746866 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.746958 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.747198 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.747822 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.748093 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-820368-35 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.748208 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.748424 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.748650 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.748928 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.749213 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.749504 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.749807 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.750060 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.750213 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.750335 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.750489 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.750489 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.751040 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-820368-35 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.751241 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.751391 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.751391 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.751625 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.751787 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.751972 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.752148 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.752331 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.752554 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.752704 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.752858 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.752988 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.753156 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.753285 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.753452 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.753591 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.753713 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.753845 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.753967 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.754094 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.754265 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.754394 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.754523 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.754665 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.754795 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.754923 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-820368-35 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.755050 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.755215 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.755346 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.755499 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.755629 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.755761 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.755883 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.755883 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.756207 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.756343 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.756471 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.756604 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.756732 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.756872 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.756995 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.757116 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.757250 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.757383 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.757510 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.757644 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.757770 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.757898 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.758028 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.758215 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.758353 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.758483 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.758604 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.758734 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.758871 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.759003 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.759184 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.759318 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.759496 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.759633 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.759811 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.759945 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.760121 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.760245 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.760427 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.760549 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.760683 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.760814 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.760974 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.761100 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.761302 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.761432 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.761627 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.761764 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.761951 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.762075 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.762198 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.762326 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.762474 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.762628 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.762794 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.763689 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.763858 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.763985 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.764127 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.764258 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.764381 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.764508 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.764631 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.765050 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.765188 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.765367 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.765502 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.765691 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.765823 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.766015 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.766148 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.766326 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.766460 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.766637 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.766770 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.766945 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.767073 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.767314 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.767480 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.767644 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.767770 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.767904 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.768036 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.768160 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.768318 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.768445 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.768572 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.768754 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.768894 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.769075 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.769203 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.769382 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.769517 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.769687 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.769814 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.769999 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.770131 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.770303 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.770444 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.770609 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.770735 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.770915 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.771041 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.771257 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.771401 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.771564 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.771697 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.771868 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.772025 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.772175 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.772336 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.772470 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.772591 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.772776 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.772913 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.773083 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.773215 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.773388 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.773520 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.773709 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.773836 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.774030 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.774156 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.774337 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.774464 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.774646 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.774785 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.774952 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.775077 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.775283 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.775409 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.775594 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.775754 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.775893 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.776027 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.776195 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.776321 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.776500 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.776625 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.776808 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.776935 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.777112 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.777231 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.777419 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.777545 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.777725 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.777857 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.778033 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.778159 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.778352 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.778478 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.778713 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.778891 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.779123 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.779305 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.779478 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.779668 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.779855 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.780031 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.780259 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.780445 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.781158 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.781344 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.781523 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.781694 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.781857 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.782025 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.782186 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.782360 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.782534 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.782701 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.782861 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.783021 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.783234 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.783412 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.783577 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.783753 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.783919 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.784104 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.784287 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.784593 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.784788 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.784971 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.785147 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.785324 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.785513 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.785700 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.785881 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.786062 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.786238 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.786415 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.786616 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.786804 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.786983 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.786983 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.787360 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.787541 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.787753 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.787935 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.788119 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.788305 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.788487 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.788670 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.788863 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.789070 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.789300 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.789498 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.789681 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.789877 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.790075 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.790259 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:40:58.790454 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.790605 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.790769 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.790937 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.791135 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.791293 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.791467 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.791613 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.791762 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.791920 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.792069 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.792224 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.792382 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.792531 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.792703 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.792882 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.793056 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.793240 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.793419 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.793589 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.793748 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.793917 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.794070 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.794252 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.794418 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.794586 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.794747 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.794927 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.795115 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.795279 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.795444 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.795624 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.795797 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.795957 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.796143 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.796340 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.796542 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.796731 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.796951 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.797662 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.797843 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.798010 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.798171 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.798332 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.798504 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.798668 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.798831 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.798991 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.799284 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.799467 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.799649 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.799813 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.799974 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.800135 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.800315 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.800499 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.800681 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.800882 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.801063 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.801245 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.801426 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.801620 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.801822 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.802005 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.802197 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.802377 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.802554 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.802746 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.802939 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.803153 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.804139 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.804334 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.804517 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.804709 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.804865 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.804865 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.805137 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.805137 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.805391 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.805516 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.805637 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.805759 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.805890 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.806028 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.806151 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.806281 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.806413 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.806544 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.806674 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.806810 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.806934 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.807055 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.807185 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.807318 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.807442 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.807572 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.807695 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.807816 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.807946 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.808068 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.808198 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.808332 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.808455 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.808583 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.808711 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.808832 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.808938 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.809072 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.809196 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.809318 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.809439 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.809560 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.809762 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.810385 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.810515 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.810627 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.810746 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.810867 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.810996 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.811196 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.811323 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.811444 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.811573 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.811695 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.811825 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.811949 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.812070 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.812192 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.812313 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.812435 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.812565 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.812687 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.812808 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.812937 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.813060 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.813190 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.813313 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.813433 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.813554 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.813675 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.813796 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.813925 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.814047 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.814175 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.814298 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.814418 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.814546 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.814683 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.814806 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.814935 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.815066 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.815213 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.815351 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.815474 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.815596 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.815716 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.815850 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.815973 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.816102 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.816225 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.816347 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.816476 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.816607 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.816738 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.816869 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.816991 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.817112 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.817234 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.817355 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.817484 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.817614 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.817736 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.817857 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.817979 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.818100 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.818234 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.818356 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.818478 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.818606 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.818729 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.818849 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.818979 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.819118 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.819228 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.819333 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.819438 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.819543 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.819666 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.819773 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.819877 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.819982 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.820085 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.820189 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.820306 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.820418 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.820523 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.820626 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.820739 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.820853 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.820958 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.821062 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.821165 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.821269 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.821380 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.821493 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.821599 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.821703 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.821808 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.821918 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822022 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822136 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822229 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822317 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822402 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822487 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822565 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822661 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822740 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822818 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822896 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.822980 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.823066 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.823187 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.823279 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.823366 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.823497 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.823674 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.823811 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.823986 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.824127 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.824305 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.824442 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.824653 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.824748 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.824994 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.825087 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.825327 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.825457 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.826212 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.826322 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.826533 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.826647 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.826848 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.826940 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.827187 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.827292 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.827507 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.827595 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.827822 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.827916 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.828136 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.828223 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.828457 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.828543 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.828771 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.828856 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.829090 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.829177 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.829403 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.829495 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.829730 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.829815 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.830048 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.830135 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.830362 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.830449 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.830668 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.830753 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.830980 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.831066 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.831317 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.831404 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.831642 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.831736 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.831958 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.832046 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.832270 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.832356 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.832582 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.832676 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.832897 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.832992 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.833208 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.833293 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.833520 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.833619 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.833827 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.833919 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.834138 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.834278 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.834453 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.834597 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.834769 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.834896 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.835112 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.835246 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.835419 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.835685 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.835827 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.835969 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.836110 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.836251 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.836414 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.836555 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.836688 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.836818 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.836936 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.837019 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.837210 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.837308 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.837532 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.837623 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.837842 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.837923 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.838158 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.838272 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.838467 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.838561 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.838779 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.838874 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.839078 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.839266 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.839413 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.839498 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.839720 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.839821 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.840028 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.840114 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.840334 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.840419 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.840645 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.840741 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.841033 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.841163 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.841317 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.841404 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.841623 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.841727 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.841938 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.842031 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.842247 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.842343 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.842560 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.842655 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.842879 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.842975 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.843234 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.843344 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.843553 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.843641 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.843861 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.843964 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.844184 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.844276 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.844497 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.844590 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.844802 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.844896 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.845114 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.845199 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.845426 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.845513 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.845737 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.845823 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.846055 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.846141 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.846365 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.846458 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.846673 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.846764 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.846983 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.847077 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.847316 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.847402 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.847630 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.847715 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.847941 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.848034 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.848255 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.848528 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.848630 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.848861 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.848948 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.849178 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.849266 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.849487 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.849571 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.849798 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.849884 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.850110 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.850215 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.850418 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.850505 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.850729 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.850814 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.851047 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.851179 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.851397 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.851645 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.851732 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.851985 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.852071 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.852298 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.852384 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.852612 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.852698 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.852919 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.853013 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.853226 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.853324 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.853534 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.853621 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.853888 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.853987 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.854154 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.854232 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.854460 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.854536 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.854766 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.854849 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.855074 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.855172 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.855414 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.855511 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.855721 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.855856 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.856034 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.856174 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.856446 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.857266 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.857342 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.857409 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.857501 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.857631 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.857799 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.857940 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.858106 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.858255 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.858419 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.858566 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.858743 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.858872 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.859049 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.859253 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.859559 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.859697 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.859877 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.860174 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.860300 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.860509 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.860805 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.860943 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.861108 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.861232 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.861408 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.861550 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.861717 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.861856 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.862050 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.862184 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.862351 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.862511 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.862696 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.862885 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.863061 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.863322 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.863539 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.863737 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.863914 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.864103 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.864282 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.864475 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.864669 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.864856 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.865036 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.865217 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.865402 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.865609 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.865817 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.866003 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.866198 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.866396 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.866582 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.866779 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.866962 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.867156 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.867331 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.867502 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.867685 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.867887 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.868079 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.868267 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.868446 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.868620 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.868786 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.868973 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.869150 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.869346 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.869536 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.869725 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.869922 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.870122 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.870303 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.870488 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.870670 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.870850 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.871050 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.871349 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.871547 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.871739 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.871938 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.872136 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.872411 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.873110 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.873308 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.873496 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.873689 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.873875 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.874078 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.874266 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.874444 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.874626 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.874797 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.874934 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.875077 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.875221 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.875356 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.875480 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.875603 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.875734 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.875864 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.875986 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.876109 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.876231 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.876369 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.876499 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.876623 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.876744 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.876865 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.876994 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.877124 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.877256 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.877386 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.877506 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.877611 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.877739 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.877861 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.877995 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.878118 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.878241 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.878362 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.878482 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.878612 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.878742 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.878856 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.878975 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.879134 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.879260 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.879396 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.879520 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.879650 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.879772 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.879893 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.880014 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.880143 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.880266 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.880396 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.880527 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.880656 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.880785 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.880916 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.881039 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.881039 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.881277 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.881401 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.881531 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.881653 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.881783 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.881905 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.882026 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.882146 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.882276 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.882400 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.882512 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.882631 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.882753 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.882882 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.883018 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.883018 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.883270 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.883400 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.883524 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.883653 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.883783 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.883905 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.884033 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.884155 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.884283 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.884413 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.884549 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.884670 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.884791 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.884913 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.885033 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.885163 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.885285 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.885413 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.885535 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.885655 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.885788 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.885923 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.886045 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.886182 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.886304 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.886425 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.886553 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.886686 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.886808 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.886929 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.887050 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.887215 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.887337 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.887471 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.887604 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.887714 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.887837 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.888017 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.888155 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.888329 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.888455 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.888643 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.888771 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.888955 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.889166 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.889337 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.889462 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.889592 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.889714 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.890124 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.890260 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.890511 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.890649 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.890946 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.891188 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.891403 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.891621 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.891747 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.891871 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.891992 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.892122 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.892253 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.892383 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.892504 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.892617 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.892617 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.892845 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.892976 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.893099 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.893221 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.893350 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.893479 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.893606 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.893785 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.893920 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.894093 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.894218 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.894406 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.894531 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.894717 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.894850 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.895075 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.895265 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.895482 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.895616 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.895796 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.895932 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.896105 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.896230 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.896418 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.896552 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.896725 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.896848 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.897054 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.897192 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.897347 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.897481 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.897701 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.897838 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.898034 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.898225 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.898428 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.898567 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.898681 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.898882 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.899006 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.899203 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.899334 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.899414 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905077 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905185 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905185 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905185 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905390 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905484 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905566 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905650 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905730 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905806 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905898 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.905978 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906062 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906141 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906219 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906303 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906390 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906476 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906554 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906631 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906708 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906810 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906897 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.906977 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907063 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907161 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907241 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907318 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907396 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907485 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907566 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907644 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907721 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907721 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907851 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.907942 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908022 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908022 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908153 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908228 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908294 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908378 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908458 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908535 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908613 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908697 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908771 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908848 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.908927 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909004 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909081 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909158 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909248 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909327 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909407 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909473 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909550 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909626 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909715 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909857 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.909944 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.910168 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.910262 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.910485 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.910580 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.910813 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.910909 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.911167 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.911257 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.911483 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.911578 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.911794 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.911870 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.912109 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.912192 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.912418 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.912497 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.912726 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.912802 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.913052 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.913127 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.913523 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.913620 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.913701 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.913780 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.913976 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.914062 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.914290 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.914378 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.914602 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.914689 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.914911 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.914998 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.915266 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.915365 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.915573 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.915682 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.915881 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.915995 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.916192 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.916279 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.916501 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.916597 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.916834 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.916933 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.917145 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.917231 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.917467 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.917559 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.917778 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.917872 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.918089 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.918177 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.918398 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.918496 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.918704 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.918804 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.919070 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.919755 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.919963 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.920133 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.920303 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.920449 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.920595 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.920741 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.920887 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.921029 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.921188 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.921336 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.921482 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.921626 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.921770 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.921920 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.922080 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.922223 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.922384 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.922529 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.922673 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.922797 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.922954 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.923080 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.923286 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.923435 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.923595 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.923717 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.923961 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.924047 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.924224 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.924309 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.924552 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.924648 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.924866 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.924949 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.925175 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.925262 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.925484 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.925580 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.925790 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.925877 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.926115 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.926208 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.926435 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.926539 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.926767 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.926854 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.927080 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.927211 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.927413 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.927502 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.927725 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.927812 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.928033 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.928128 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.928349 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.928446 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.928669 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.928767 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.928986 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.929087 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.929300 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.929397 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.929613 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.929700 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.929925 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.930012 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.930243 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.930331 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.930561 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.930657 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.930872 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.930967 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.931221 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.931481 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.931567 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.931816 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.931902 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.932138 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.932216 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.932457 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.932533 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.932776 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.932872 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.933093 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.933180 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.933409 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.933660 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.933758 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.934002 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.934106 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.934324 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.934418 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.934634 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.934721 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.935547 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.935647 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.935873 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.935971 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.936196 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.936283 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.936518 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.936606 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.936836 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.936932 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.937159 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.937254 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.937473 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.937559 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.937788 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.937875 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.938122 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.938282 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.938456 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.938540 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.938768 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.938864 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.939105 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.939197 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.939428 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.939539 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.939744 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.939885 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.940062 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.940200 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.940378 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.940505 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.940696 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.940822 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.941019 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.941162 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.941333 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.941459 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.941647 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.941782 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.941963 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.942096 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.942279 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.942403 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.942595 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.942727 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.942915 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.943041 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.943258 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.943386 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.943586 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.943728 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.943889 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.944015 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.944206 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.944338 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.944521 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.944767 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.944893 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.945090 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.945216 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.945430 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.945633 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.945758 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.945879 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.946080 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.946206 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.946398 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.946533 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.946715 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.946955 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.947081 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.947308 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.947435 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.947652 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.947779 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.947971 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.948095 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.948283 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.948418 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.948592 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.948711 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.948922 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.949049 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.949216 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.949353 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.949570 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.949704 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.949828 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.949950 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.950130 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.950263 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.950468 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.950711 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.950847 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.951066 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.951317 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.951442 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.951565 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.951717 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.951843 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.952043 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.952179 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.952355 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.952483 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.952664 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.952894 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.953022 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.953246 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.953374 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.953569 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.953698 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.953889 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.954014 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.954203 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.954339 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.954510 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.954646 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.954818 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.954955 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.955154 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.955296 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.955468 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.955607 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.955775 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.955911 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.956087 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.956222 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.956392 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.956526 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.956719 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.956856 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.957029 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.957156 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.957340 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.957482 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.957648 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.957784 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.957962 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.958089 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.958270 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.958397 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.958577 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.958705 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.958885 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.959024 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.959216 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.959344 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.959532 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.959669 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.959837 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.959965 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.960148 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.960275 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.960456 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.960582 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.960768 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.960906 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.961072 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.961197 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.961378 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.961513 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.961695 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.961822 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.962003 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.962140 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.962316 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.962455 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.962621 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.962747 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.962933 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.963067 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.963257 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.963379 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.963618 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.963746 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.963930 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.964072 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.964253 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.964386 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.964561 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.964687 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.964870 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.965006 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.965222 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.965510 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.965649 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.965783 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.965921 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.966147 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.966341 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.966459 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.966690 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.966800 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.967140 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.967271 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.967472 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.967711 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.967875 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.968689 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.969007 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.969241 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.972666 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.972814 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.972948 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.972948 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.973209 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.973339 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.973473 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.973604 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.973728 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.973860 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.973984 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.974114 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.974237 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.974359 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.974482 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.974613 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.974738 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.974860 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.974982 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.975130 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.975256 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.975392 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.975524 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.975659 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.975784 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.975913 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.976044 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.976167 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.976289 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.976411 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.976532 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.976654 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.976789 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.976913 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.977035 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.977157 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.977278 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.977409 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.977540 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.977663 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.977785 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.977908 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.978029 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.978232 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.978358 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.978481 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.978610 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.978732 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.978855 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.978990 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.979175 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.979301 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.979425 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.979558 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.979681 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.979811 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.979927 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.979927 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.980172 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.980295 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.980416 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.980550 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.980658 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.980658 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.980887 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.981020 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.981151 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.981151 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.981381 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.981381 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.981618 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.982321 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.982492 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.982666 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.982833 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.982992 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.983165 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.983336 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.983504 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.983674 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.984065 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.984196 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.984320 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.984452 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.984575 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.984706 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.984837 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.984961 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.985083 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.985217 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.985340 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.985463 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.985585 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.985715 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.985837 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.985968 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.985968 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.986200 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.986331 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.986461 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.986596 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.986719 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.986841 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.986841 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.987078 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.987237 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.987380 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.987512 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.987635 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.987764 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.987994 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.988135 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.988268 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.988394 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.988528 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.988652 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.988774 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.988895 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.989025 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.989148 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.989262 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.989441 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.989566 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.989697 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.989820 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.989941 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.990053 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.990180 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.990302 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.990433 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.990556 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.990678 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.990792 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.990921 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.991044 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.991189 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.991314 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.991436 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.991558 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.991687 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.991809 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.991939 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.992069 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.992197 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.992320 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.992442 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.992572 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.992695 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.992823 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.992945 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.993074 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.993195 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.993328 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.993452 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.993581 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.993710 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.993832 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.993953 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.994083 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.994205 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.994327 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.994448 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.994571 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.994692 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.994822 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.994952 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.995081 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.995251 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.995382 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.995514 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.995644 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.995833 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.995962 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.996163 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.996290 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.996473 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.996602 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.996803 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.996930 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.997124 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.997251 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.997998 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.998136 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.998316 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.998443 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.998628 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.998766 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.998960 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.999116 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.999296 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.999434 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.999612 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.999748 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:58.999925 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.000052 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.000241 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.000367 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.000553 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.000689 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.000870 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.000996 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.001178 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.001314 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.001497 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.001633 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.001809 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.001936 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.002122 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.002260 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.002434 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.002568 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.002749 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.002876 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.003063 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.003211 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.003413 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.003541 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.003726 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.003852 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.004039 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.004175 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.004380 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.004505 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.004729 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.004856 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.005064 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.005267 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.005400 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.005522 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.005683 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.005810 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.005991 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.006127 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.006272 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:40:59.006408 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.006758 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.007076 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.007451 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.007789 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.008116 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.008428 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.008738 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:40:59.008988 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:40:59.161337 n-d-820368-35 devstack@n-api.service[112693]: INFO dbcounter [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Registered counter for database nova_api Aug 27 04:40:59.171373 n-d-820368-35 devstack@n-api.service[112694]: INFO dbcounter [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Registered counter for database nova_api Aug 27 04:40:59.182000 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_db.sqlalchemy.engines [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:40:59.189844 n-d-820368-35 devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writer thread running {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:40:59.192334 n-d-820368-35 devstack@n-api.service[112694]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:40:59.199233 n-d-820368-35 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writer thread running {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:40:59.252711 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.context [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) {{(pid=112693) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:40:59.256570 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:59.257055 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:59.258199 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.context [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) {{(pid=112694) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:40:59.258632 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:59.259414 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:59.259919 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:59.262029 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:59.262256 n-d-820368-35 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:59.262763 n-d-820368-35 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:59.264136 n-d-820368-35 devstack@n-api.service[112693]: INFO dbcounter [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Registered counter for database nova_cell0 Aug 27 04:40:59.264421 n-d-820368-35 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:59.265446 n-d-820368-35 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:59.265947 n-d-820368-35 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:59.268115 n-d-820368-35 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:59.268573 n-d-820368-35 devstack@n-api.service[112693]: INFO dbcounter [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Registered counter for database nova_cell1 Aug 27 04:40:59.270145 n-d-820368-35 devstack@n-api.service[112694]: INFO dbcounter [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Registered counter for database nova_cell0 Aug 27 04:40:59.274333 n-d-820368-35 devstack@n-api.service[112694]: INFO dbcounter [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Registered counter for database nova_cell1 Aug 27 04:40:59.277457 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_db.sqlalchemy.engines [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:40:59.278405 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_db.sqlalchemy.engines [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:40:59.284043 n-d-820368-35 devstack@n-api.service[112694]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:40:59.285295 n-d-820368-35 devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writer thread running {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:40:59.287964 n-d-820368-35 devstack@n-api.service[112694]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:40:59.289516 n-d-820368-35 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writer thread running {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:40:59.290635 n-d-820368-35 devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writer thread running {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:40:59.438038 n-d-820368-35 devstack@n-api.service[112693]: INFO dbcounter [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Registered counter for database nova_cell0 Aug 27 04:40:59.446571 n-d-820368-35 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writer thread running {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:40:59.447064 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_db.sqlalchemy.engines [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:40:59.452753 n-d-820368-35 devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writer thread running {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:40:59.456499 n-d-820368-35 devstack@n-api.service[112694]: INFO dbcounter [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Registered counter for database nova_cell0 Aug 27 04:40:59.463860 n-d-820368-35 devstack@n-api.service[112694]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:40:59.477721 n-d-820368-35 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writer thread running {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:40:59.798818 n-d-820368-35 devstack@n-api.service[112694]: WARNING keystonemiddleware.auth_token [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:40:59.800645 n-d-820368-35 devstack@n-api.service[112693]: WARNING keystonemiddleware.auth_token [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:40:59.806275 n-d-820368-35 devstack@n-api.service[112694]: WARNING keystonemiddleware.auth_token [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:40:59.807978 n-d-820368-35 devstack@n-api.service[112693]: WARNING keystonemiddleware.auth_token [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:41:00.151845 n-d-820368-35 devstack@n-api.service[112694]: WARNING keystonemiddleware.auth_token [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:41:00.155896 n-d-820368-35 devstack@n-api.service[112693]: WARNING keystonemiddleware.auth_token [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:41:00.158023 n-d-820368-35 devstack@n-api.service[112694]: WARNING keystonemiddleware.auth_token [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:41:00.162110 n-d-820368-35 devstack@n-api.service[112693]: WARNING keystonemiddleware.auth_token [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:41:00.164326 n-d-820368-35 devstack@n-api.service[112694]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e870e319c0 pid: 112694 (default app) Aug 27 04:41:00.166754 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:00.167426 n-d-820368-35 devstack@n-api.service[112693]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e870e319c0 pid: 112693 (default app) Aug 27 04:41:00.167987 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-1f6cabb7-b8c0-45a8-bffa-08e14e996808 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001855 Aug 27 04:41:00.168397 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Sat Aug 27 04:41:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:19.201693 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:19.202853 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 Aug 27 04:42:19.203341 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:19.219629 n-d-820368-35 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_api:SELECT=3 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:19.221124 n-d-820368-35 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_cell0:SELECT=3 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:19.222332 n-d-820368-35 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_cell1:SELECT=3 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:19.223260 n-d-820368-35 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_cell0:SELECT=3 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:20.149968 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-f29b3d03-0bb6-4d8f-8c24-691a83d85500 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:20.184083 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-f29b3d03-0bb6-4d8f-8c24-691a83d85500 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.974325 Aug 27 04:42:20.185002 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1292 bytes} [Sat Aug 27 04:42:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:22.576805 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:22.577839 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-bc2691ff-b3d7-4385-8191-73f771237c63 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 27 04:42:22.578975 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 2/4] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:23.024737 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-6d2fbbfc-cb9d-4155-acf1-7a9546126b39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "ram": 256}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:23.079754 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-6d2fbbfc-cb9d-4155-acf1-7a9546126b39 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495008 Aug 27 04:42:23.083399 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 3/5] 10.222.0.58 () {64 vars in 1283 bytes} [Sat Aug 27 04:42:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:23.094807 n-d-820368-35 devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_api:SELECT=3 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:23.095755 n-d-820368-35 devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_cell0:SELECT=3 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:23.096957 n-d-820368-35 devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_cell1:SELECT=3 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:23.098010 n-d-820368-35 devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:23.311843 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-ae76ef5a-156f-4dc8-941a-95fd5730d684 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:23.385330 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-ae76ef5a-156f-4dc8-941a-95fd5730d684 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295244 Aug 27 04:42:23.386671 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 3/6] 10.222.0.58 () {64 vars in 1336 bytes} [Sat Aug 27 04:42:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:26.044559 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-6d2fbbfc-cb9d-4155-acf1-7a9546126b39 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:26.047023 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-6d2fbbfc-cb9d-4155-acf1-7a9546126b39 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003309 Aug 27 04:42:26.050129 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 4/7] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:26.846208 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-0da1c5c4-9651-439c-af3b-430795ecbdeb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "swap": 0, "id": "d1"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:26.898708 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-0da1c5c4-9651-439c-af3b-430795ecbdeb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.841548 Aug 27 04:42:26.900737 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 4/8] 10.222.0.58 () {64 vars in 1283 bytes} [Sat Aug 27 04:42:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:26.918376 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-d00c24be-95ed-4285-b71f-564fe5ae7bb5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:26.967602 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-d00c24be-95ed-4285-b71f-564fe5ae7bb5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053960 Aug 27 04:42:26.968868 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 5/9] 10.222.0.58 () {64 vars in 1336 bytes} [Sat Aug 27 04:42:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:29.653573 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-0da1c5c4-9651-439c-af3b-430795ecbdeb admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:29.654595 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-0da1c5c4-9651-439c-af3b-430795ecbdeb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 27 04:42:29.655343 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:30.156209 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-087517ce-4b1a-494c-95ca-d0d34912dac6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:30.192967 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-087517ce-4b1a-494c-95ca-d0d34912dac6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531577 Aug 27 04:42:30.193812 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 6/11] 10.222.0.58 () {64 vars in 1283 bytes} [Sat Aug 27 04:42:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:42:30.207825 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-6899671b-4b76-457d-ac59-bd91b05ce59b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:30.245301 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-6899671b-4b76-457d-ac59-bd91b05ce59b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041298 Aug 27 04:42:30.246710 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 6/12] 10.222.0.58 () {64 vars in 1336 bytes} [Sat Aug 27 04:42:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:32.952451 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-087517ce-4b1a-494c-95ca-d0d34912dac6 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:32.953057 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-087517ce-4b1a-494c-95ca-d0d34912dac6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 27 04:42:32.954210 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 7/13] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:33.507147 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-b00ccedf-aadf-4972-9075-1bc8869f3ccc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "id": "d3"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:33.527837 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-b00ccedf-aadf-4972-9075-1bc8869f3ccc admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.567562 Aug 27 04:42:33.528631 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 7/14] 10.222.0.58 () {64 vars in 1283 bytes} [Sat Aug 27 04:42:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:33.540711 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-5a3183aa-0067-4e3c-b6d0-116659e90f00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:33.567649 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-5a3183aa-0067-4e3c-b6d0-116659e90f00 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030637 Aug 27 04:42:33.568284 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 8/15] 10.222.0.58 () {64 vars in 1336 bytes} [Sat Aug 27 04:42:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:36.009637 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-b00ccedf-aadf-4972-9075-1bc8869f3ccc admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:36.010579 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-b00ccedf-aadf-4972-9075-1bc8869f3ccc admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Aug 27 04:42:36.023417 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 8/16] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:36 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:36.531017 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-06f40972-877d-48ef-b2ab-1794a30e925e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:36.561590 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-06f40972-877d-48ef-b2ab-1794a30e925e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.542127 Aug 27 04:42:36.562626 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 9/17] 10.222.0.58 () {64 vars in 1283 bytes} [Sat Aug 27 04:42:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:36.586332 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-e9d37ff1-f0d9-431c-8556-729e3ef0de4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:36.633452 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-e9d37ff1-f0d9-431c-8556-729e3ef0de4f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054253 Aug 27 04:42:36.639772 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 9/18] 10.222.0.58 () {64 vars in 1336 bytes} [Sat Aug 27 04:42:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:39.168822 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-06f40972-877d-48ef-b2ab-1794a30e925e admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:39.169826 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-06f40972-877d-48ef-b2ab-1794a30e925e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 27 04:42:39.170223 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 10/19] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:42:39.667352 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-33572b6a-4e55-4e48-acad-a701d93d2887 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:39.692912 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-33572b6a-4e55-4e48-acad-a701d93d2887 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.512839 Aug 27 04:42:39.693451 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1292 bytes} [Sat Aug 27 04:42:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:42.197689 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-06f40972-877d-48ef-b2ab-1794a30e925e admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:42.198801 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-06f40972-877d-48ef-b2ab-1794a30e925e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 27 04:42:42.199245 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 11/21] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:42:42.659771 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-63675c4c-a0e8-42c9-ba8d-f596b4c9c7e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:42.683314 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-63675c4c-a0e8-42c9-ba8d-f596b4c9c7e4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.477498 Aug 27 04:42:42.683898 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 11/22] 10.222.0.58 () {64 vars in 1283 bytes} [Sat Aug 27 04:42:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:42.696470 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-d987ffdf-e5be-484a-ab65-162bfb778b5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:42.725547 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-d987ffdf-e5be-484a-ab65-162bfb778b5c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032653 Aug 27 04:42:42.726290 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 12/23] 10.222.0.58 () {64 vars in 1333 bytes} [Sat Aug 27 04:42:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:45.178931 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-63675c4c-a0e8-42c9-ba8d-f596b4c9c7e4 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:45.180130 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-63675c4c-a0e8-42c9-ba8d-f596b4c9c7e4 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 Aug 27 04:42:45.180565 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 12/24] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:45.686661 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-5b93b76b-d42f-4e7a-bda9-7d8029a68e82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:45.707453 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-5b93b76b-d42f-4e7a-bda9-7d8029a68e82 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.520321 Aug 27 04:42:45.707937 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 13/25] 10.222.0.58 () {64 vars in 1283 bytes} [Sat Aug 27 04:42:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:45.720441 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-a2161f0f-90b4-4aa1-98dc-95fa541c71bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:45.748926 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-a2161f0f-90b4-4aa1-98dc-95fa541c71bc admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032220 Aug 27 04:42:45.749601 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 13/26] 10.222.0.58 () {64 vars in 1333 bytes} [Sat Aug 27 04:42:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:48.188679 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-5b93b76b-d42f-4e7a-bda9-7d8029a68e82 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:48.189700 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-5b93b76b-d42f-4e7a-bda9-7d8029a68e82 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 27 04:42:48.190105 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:48.605833 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-62337ff9-c07c-4f09-a5a6-f647b4b73d59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:48.624133 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-62337ff9-c07c-4f09-a5a6-f647b4b73d59 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.427407 Aug 27 04:42:48.624875 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 14/28] 10.222.0.58 () {64 vars in 1283 bytes} [Sat Aug 27 04:42:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:42:48.637437 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-137d8e81-b9fa-415a-8498-a701dd3c884e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:48.660535 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-137d8e81-b9fa-415a-8498-a701dd3c884e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027355 Aug 27 04:42:48.661274 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 15/29] 10.222.0.58 () {64 vars in 1333 bytes} [Sat Aug 27 04:42:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:51.006246 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-62337ff9-c07c-4f09-a5a6-f647b4b73d59 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:51.007971 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-62337ff9-c07c-4f09-a5a6-f647b4b73d59 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Aug 27 04:42:51.014327 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 15/30] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:51.533894 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-19e394b2-97d1-4d82-a11c-dc6be85782e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:51.542668 n-d-820368-35 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:51.556814 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-19e394b2-97d1-4d82-a11c-dc6be85782e8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.541276 Aug 27 04:42:51.557379 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 16/31] 10.222.0.58 () {64 vars in 1283 bytes} [Sat Aug 27 04:42:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:51.570031 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-93fda984-3814-4039-a77e-5dcb8b9d4e4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:51.595608 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-93fda984-3814-4039-a77e-5dcb8b9d4e4b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029182 Aug 27 04:42:51.596811 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 16/32] 10.222.0.58 () {64 vars in 1333 bytes} [Sat Aug 27 04:42:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:54.001078 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-19e394b2-97d1-4d82-a11c-dc6be85782e8 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:54.002088 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-19e394b2-97d1-4d82-a11c-dc6be85782e8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 27 04:42:54.002637 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 17/33] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:54.486318 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-a56806a2-ddf3-468b-91c1-f6d88545570f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "name": "m1.xlarge"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:54.493909 n-d-820368-35 devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:54.508681 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-a56806a2-ddf3-468b-91c1-f6d88545570f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.499754 Aug 27 04:42:54.509251 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 17/34] 10.222.0.58 () {64 vars in 1283 bytes} [Sat Aug 27 04:42:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:54.521978 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-a27ecbc4-b6d5-40a6-ab16-67bef3c50d15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:54.553261 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-a27ecbc4-b6d5-40a6-ab16-67bef3c50d15 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035059 Aug 27 04:42:54.565601 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 18/35] 10.222.0.58 () {64 vars in 1333 bytes} [Sat Aug 27 04:42:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:17.064673 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-a56806a2-ddf3-468b-91c1-f6d88545570f admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:17.065685 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-a56806a2-ddf3-468b-91c1-f6d88545570f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 27 04:43:17.066141 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 18/36] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:43:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:17.076907 n-d-820368-35 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:17.456277 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-bf6bcdd0-4437-42c5-95fd-2964872d21da admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:17.474701 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-bf6bcdd0-4437-42c5-95fd-2964872d21da admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402338 Aug 27 04:43:17.475348 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 19/37] 10.222.0.58 () {60 vars in 1292 bytes} [Sat Aug 27 04:43:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:18.530131 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-a56806a2-ddf3-468b-91c1-f6d88545570f admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:18.531182 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-a56806a2-ddf3-468b-91c1-f6d88545570f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 27 04:43:18.531617 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 19/38] 10.222.0.58 () {56 vars in 1074 bytes} [Sat Aug 27 04:43:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:19.062099 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-112ad064-e7c3-493e-a193-8692eda6fec8 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:19.067641 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.wsgi [None req-112ad064-e7c3-493e-a193-8692eda6fec8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-112ad064-e7c3-493e-a193-8692eda6fec8 admin admin] Request method failure captured: Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: Accept: application/json Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: Accept-Encoding: gzip, deflate Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: Connection: keep-alive Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: Content-Length: 0 Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: Host: 10.222.0.58 Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: Openstack-Api-Version: compute 2.90 Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: Openstack-System-Scope: None Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: User-Agent: python-novaclient Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Auth-Token: gAAAAABjCaDmlqApC2EEO-xf6z75JqSwxbCRib7miIdaScKmQsqOVVwBBYH2bKXlh7Vjnjp0M2w0FuPb1jwrXi5cRGjCww97reRsh4yT34tyUIDZ0kgxIKZxrNTJcE9MKvMaXfeoR68TdybY9Sy3tkfP_FLldxQ_b9TzqZxaReFh3g8AYjuxZzg Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Domain-Id: None Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Domain-Name: None Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Identity-Status: Confirmed Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Is-Admin-Project: True Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Domain-Id: default Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Domain-Name: Default Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Name: admin Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Role: member,reader,admin Aug 27 04:43:19.071541 n-d-820368-35 devstack@n-api.service[112694]: X-Roles: member,reader,admin Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7560b2bb7a04b97a52e0c0dc3bbb3c7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: X-Tenant: admin Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: X-Tenant-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: X-Tenant-Name: admin Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: X-User: admin Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: X-User-Domain-Id: default Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: X-User-Domain-Name: Default Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: X-User-Id: 2e5e680ee51c4c81ad40e646ed1929eb Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: X-User-Name: admin Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: method: > Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: exception: Flavor 42 could not be found. Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: action_args: {'id': '42'} Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:19.073218 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:19.074117 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:19.075407 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-112ad064-e7c3-493e-a193-8692eda6fec8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:19.076705 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-112ad064-e7c3-493e-a193-8692eda6fec8 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387828 Aug 27 04:43:19.076705 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 20/39] 10.222.0.58 () {60 vars in 1190 bytes} [Sat Aug 27 04:43:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:19.082622 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-cbe6d4d7-474a-451e-a06d-27cbe8e2265e admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:19.106797 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-cbe6d4d7-474a-451e-a06d-27cbe8e2265e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027657 Aug 27 04:43:19.107421 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 20/40] 10.222.0.58 () {60 vars in 1210 bytes} [Sat Aug 27 04:43:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:19.118242 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-ce4c23ba-d3ad-4b40-8b58-4265be2768bf admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:19.141627 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-ce4c23ba-d3ad-4b40-8b58-4265be2768bf admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027685 Aug 27 04:43:19.142156 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1210 bytes} [Sat Aug 27 04:43:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:19.151428 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-b9656fda-8bce-4fa7-a395-88452b655c54 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:19.157062 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.wsgi [None req-b9656fda-8bce-4fa7-a395-88452b655c54 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-b9656fda-8bce-4fa7-a395-88452b655c54 admin admin] Request method failure captured: Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: Accept: application/json Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: Accept-Encoding: gzip, deflate Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: Connection: keep-alive Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: Content-Length: 0 Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: Host: 10.222.0.58 Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: Openstack-Api-Version: compute 2.90 Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: Openstack-System-Scope: None Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: User-Agent: python-novaclient Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Auth-Token: gAAAAABjCaDmlqApC2EEO-xf6z75JqSwxbCRib7miIdaScKmQsqOVVwBBYH2bKXlh7Vjnjp0M2w0FuPb1jwrXi5cRGjCww97reRsh4yT34tyUIDZ0kgxIKZxrNTJcE9MKvMaXfeoR68TdybY9Sy3tkfP_FLldxQ_b9TzqZxaReFh3g8AYjuxZzg Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Domain-Id: None Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Domain-Name: None Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Identity-Status: Confirmed Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Is-Admin-Project: True Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Domain-Id: default Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Domain-Name: Default Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Name: admin Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Role: member,reader,admin Aug 27 04:43:19.160278 n-d-820368-35 devstack@n-api.service[112693]: X-Roles: member,reader,admin Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7560b2bb7a04b97a52e0c0dc3bbb3c7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: X-Tenant: admin Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: X-Tenant-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: X-Tenant-Name: admin Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: X-User: admin Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: X-User-Domain-Id: default Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: X-User-Domain-Name: Default Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: X-User-Id: 2e5e680ee51c4c81ad40e646ed1929eb Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: X-User-Name: admin Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: method: > Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: exception: Flavor 42 could not be found. Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: action_args: {'id': '42'} Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:19.161835 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:19.163513 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:19.164796 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-b9656fda-8bce-4fa7-a395-88452b655c54 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:19.166075 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-b9656fda-8bce-4fa7-a395-88452b655c54 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013812 Aug 27 04:43:19.166075 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 21/42] 10.222.0.58 () {60 vars in 1190 bytes} [Sat Aug 27 04:43:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 04:43:20.117403 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-ce4c23ba-d3ad-4b40-8b58-4265be2768bf admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:20.118424 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-ce4c23ba-d3ad-4b40-8b58-4265be2768bf admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 27 04:43:20.118817 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 22/43] 10.222.0.58 () {56 vars in 1074 bytes} [Sat Aug 27 04:43:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:20.641076 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-6a6bfbdd-79f8-493f-a58f-edff538815b8 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:20.646500 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.wsgi [None req-6a6bfbdd-79f8-493f-a58f-edff538815b8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-6a6bfbdd-79f8-493f-a58f-edff538815b8 admin admin] Request method failure captured: Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: Accept: application/json Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: Accept-Encoding: gzip, deflate Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: Connection: keep-alive Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: Content-Length: 0 Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: Host: 10.222.0.58 Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: Openstack-Api-Version: compute 2.90 Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: Openstack-System-Scope: None Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: User-Agent: python-novaclient Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Auth-Token: gAAAAABjCaDoIKpWAozkLV1TA9nbi7CB3hpssP1b4zD56e5qBOePrp-COGvU0KLbmmut-ggxXGTXtBDT3tW1CKfUv-UzxMosVUH_UU2CXUyR0-1c4w7flogrdRYbeB0yu9Gl07KWvB18ygxg0TbyoeyDUj8uKAHXhXn5o9WLyGGJhbsXGsusy80 Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Domain-Id: None Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Domain-Name: None Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Identity-Status: Confirmed Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Is-Admin-Project: True Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Domain-Id: default Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Domain-Name: Default Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Name: admin Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Role: member,reader,admin Aug 27 04:43:20.648669 n-d-820368-35 devstack@n-api.service[112693]: X-Roles: member,reader,admin Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7560b2bb7a04b97a52e0c0dc3bbb3c7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: X-Tenant: admin Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: X-Tenant-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: X-Tenant-Name: admin Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: X-User: admin Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: X-User-Domain-Id: default Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: X-User-Domain-Name: Default Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: X-User-Id: 2e5e680ee51c4c81ad40e646ed1929eb Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: X-User-Name: admin Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: method: > Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: exception: Flavor 84 could not be found. Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: action_args: {'id': '84'} Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:20.650098 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:20.651009 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:20.652435 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-6a6bfbdd-79f8-493f-a58f-edff538815b8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:20.653752 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-6a6bfbdd-79f8-493f-a58f-edff538815b8 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391360 Aug 27 04:43:20.653752 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1190 bytes} [Sat Aug 27 04:43:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:20.660019 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-73081538-946d-461c-a915-b8d79fe00848 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:20.674912 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-73081538-946d-461c-a915-b8d79fe00848 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018498 Aug 27 04:43:20.675520 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 23/45] 10.222.0.58 () {60 vars in 1210 bytes} [Sat Aug 27 04:43:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:43:20.685665 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-c1fff4d7-f03c-4adc-86ee-99fe41e2c0c8 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:20.701070 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-c1fff4d7-f03c-4adc-86ee-99fe41e2c0c8 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019344 Aug 27 04:43:20.701590 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1210 bytes} [Sat Aug 27 04:43:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:20.711612 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-ed1eef58-5169-445e-8216-1851df81cfb1 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:20.716952 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.wsgi [None req-ed1eef58-5169-445e-8216-1851df81cfb1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-ed1eef58-5169-445e-8216-1851df81cfb1 admin admin] Request method failure captured: Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: Accept: application/json Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: Accept-Encoding: gzip, deflate Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: Connection: keep-alive Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: Content-Length: 0 Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: Host: 10.222.0.58 Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: Openstack-Api-Version: compute 2.90 Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: Openstack-System-Scope: None Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: User-Agent: python-novaclient Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Auth-Token: gAAAAABjCaDoIKpWAozkLV1TA9nbi7CB3hpssP1b4zD56e5qBOePrp-COGvU0KLbmmut-ggxXGTXtBDT3tW1CKfUv-UzxMosVUH_UU2CXUyR0-1c4w7flogrdRYbeB0yu9Gl07KWvB18ygxg0TbyoeyDUj8uKAHXhXn5o9WLyGGJhbsXGsusy80 Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Domain-Id: None Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Domain-Name: None Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Identity-Status: Confirmed Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Is-Admin-Project: True Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Domain-Id: default Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Domain-Name: Default Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Name: admin Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Role: member,reader,admin Aug 27 04:43:20.718440 n-d-820368-35 devstack@n-api.service[112694]: X-Roles: member,reader,admin Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7560b2bb7a04b97a52e0c0dc3bbb3c7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: X-Tenant: admin Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: X-Tenant-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: X-Tenant-Name: admin Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: X-User: admin Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: X-User-Domain-Id: default Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: X-User-Domain-Name: Default Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: X-User-Id: 2e5e680ee51c4c81ad40e646ed1929eb Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: X-User-Name: admin Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: method: > Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: exception: Flavor 84 could not be found. Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: action_args: {'id': '84'} Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:20.719957 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:20.720775 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:20.721860 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-ed1eef58-5169-445e-8216-1851df81cfb1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:20.722891 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-ed1eef58-5169-445e-8216-1851df81cfb1 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012434 Aug 27 04:43:20.722891 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 24/47] 10.222.0.58 () {60 vars in 1190 bytes} [Sat Aug 27 04:43:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:21.691132 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-c1fff4d7-f03c-4adc-86ee-99fe41e2c0c8 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:21.692160 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-c1fff4d7-f03c-4adc-86ee-99fe41e2c0c8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 27 04:43:21.692549 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 24/48] 10.222.0.58 () {56 vars in 1074 bytes} [Sat Aug 27 04:43:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:22.227683 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-bc635064-d2d0-4927-8048-4f9bf0382cd2 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:22.233388 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.wsgi [None req-bc635064-d2d0-4927-8048-4f9bf0382cd2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-bc635064-d2d0-4927-8048-4f9bf0382cd2 admin admin] Request method failure captured: Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: Accept: application/json Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: Accept-Encoding: gzip, deflate Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: Connection: keep-alive Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: Content-Length: 0 Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: Host: 10.222.0.58 Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: Openstack-Api-Version: compute 2.90 Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: Openstack-System-Scope: None Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: User-Agent: python-novaclient Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Auth-Token: gAAAAABjCaDp9tEjw-gt3z3toY9y8ovp-HsciXHu1HHO33Mhct_QTsss40kg8aLlfGIEGrCcJDkJx7AD0xTHfnKNBH6_XLefntE6pbG3qz8RI5v8rjCrYrAl3cpp53Adu2omDDo1f2JXDh2WT7g400hdsflkpTIqEKOeJTUuOs9YOYB0lbjAv0c Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Domain-Id: None Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Domain-Name: None Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Identity-Status: Confirmed Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Is-Admin-Project: True Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Domain-Id: default Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Domain-Name: Default Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Project-Name: admin Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Role: member,reader,admin Aug 27 04:43:22.234881 n-d-820368-35 devstack@n-api.service[112694]: X-Roles: member,reader,admin Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7560b2bb7a04b97a52e0c0dc3bbb3c7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: X-Tenant: admin Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: X-Tenant-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: X-Tenant-Name: admin Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: X-User: admin Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: X-User-Domain-Id: default Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: X-User-Domain-Name: Default Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: X-User-Id: 2e5e680ee51c4c81ad40e646ed1929eb Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: X-User-Name: admin Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: method: > Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: exception: Flavor 451 could not be found. Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: action_args: {'id': '451'} Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:22.236485 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:22.237456 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Aug 27 04:43:22.238745 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-bc635064-d2d0-4927-8048-4f9bf0382cd2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:22.240156 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-bc635064-d2d0-4927-8048-4f9bf0382cd2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393334 Aug 27 04:43:22.240156 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 25/49] 10.222.0.58 () {60 vars in 1193 bytes} [Sat Aug 27 04:43:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:22.245769 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-06330331-be8c-4eba-92a0-3d4bd030074f admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:22.260805 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-06330331-be8c-4eba-92a0-3d4bd030074f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018582 Aug 27 04:43:22.261329 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 25/50] 10.222.0.58 () {60 vars in 1210 bytes} [Sat Aug 27 04:43:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:22.270690 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:22.286111 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018858 Aug 27 04:43:22.286636 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 26/51] 10.222.0.58 () {60 vars in 1210 bytes} [Sat Aug 27 04:43:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:22.295767 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-78bbd772-dc9a-4bae-ac92-2b613f444ce0 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:22.301049 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.wsgi [None req-78bbd772-dc9a-4bae-ac92-2b613f444ce0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-78bbd772-dc9a-4bae-ac92-2b613f444ce0 admin admin] Request method failure captured: Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: Accept: application/json Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: Accept-Encoding: gzip, deflate Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: Connection: keep-alive Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: Content-Length: 0 Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: Host: 10.222.0.58 Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: Openstack-Api-Version: compute 2.90 Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: Openstack-System-Scope: None Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: User-Agent: python-novaclient Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Auth-Token: gAAAAABjCaDp9tEjw-gt3z3toY9y8ovp-HsciXHu1HHO33Mhct_QTsss40kg8aLlfGIEGrCcJDkJx7AD0xTHfnKNBH6_XLefntE6pbG3qz8RI5v8rjCrYrAl3cpp53Adu2omDDo1f2JXDh2WT7g400hdsflkpTIqEKOeJTUuOs9YOYB0lbjAv0c Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Domain-Id: None Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Domain-Name: None Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Identity-Status: Confirmed Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Is-Admin-Project: True Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Domain-Id: default Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Domain-Name: Default Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Project-Name: admin Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Role: member,reader,admin Aug 27 04:43:22.302537 n-d-820368-35 devstack@n-api.service[112693]: X-Roles: member,reader,admin Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7560b2bb7a04b97a52e0c0dc3bbb3c7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7560b2bb7a04b97a52e0c0dc3bbb3c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: X-Tenant: admin Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: X-Tenant-Id: a7560b2bb7a04b97a52e0c0dc3bbb3c7 Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: X-Tenant-Name: admin Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: X-User: admin Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: X-User-Domain-Id: default Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: X-User-Domain-Name: Default Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: X-User-Id: 2e5e680ee51c4c81ad40e646ed1929eb Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: X-User-Name: admin Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: method: > Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: exception: Flavor 451 could not be found. Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: action_args: {'id': '451'} Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:22.304142 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:22.305126 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 27 04:43:22.306414 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-78bbd772-dc9a-4bae-ac92-2b613f444ce0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:22.307692 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-78bbd772-dc9a-4bae-ac92-2b613f444ce0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012781 Aug 27 04:43:22.307788 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 26/52] 10.222.0.58 () {60 vars in 1193 bytes} [Sat Aug 27 04:43:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 04:43:23.269089 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:23.270129 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 27 04:43:23.270523 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 27/53] 10.222.0.58 () {56 vars in 1074 bytes} [Sat Aug 27 04:43:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:23.797476 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-3fa5208f-7df1-4667-a0e2-e481b9c5766a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:23.816837 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-3fa5208f-7df1-4667-a0e2-e481b9c5766a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.408095 Aug 27 04:43:23.817392 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 27/54] 10.222.0.58 () {64 vars in 1235 bytes} [Sat Aug 27 04:43:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:43:24.790855 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:24.791972 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 27 04:43:24.792369 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 28/55] 10.222.0.58 () {56 vars in 1074 bytes} [Sat Aug 27 04:43:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:25.312812 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-cbfe6d7d-93a3-4379-9688-48110c5f8b88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:25.331676 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-cbfe6d7d-93a3-4379-9688-48110c5f8b88 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.399766 Aug 27 04:43:25.332210 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 28/56] 10.222.0.58 () {64 vars in 1235 bytes} [Sat Aug 27 04:43:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:43:26.319229 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:26.320265 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 27 04:43:26.320654 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 29/57] 10.222.0.58 () {56 vars in 1074 bytes} [Sat Aug 27 04:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:26.969208 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-18119024-817e-4602-a746-e8ef5ef6c2fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:26.987482 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-18119024-817e-4602-a746-e8ef5ef6c2fc admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.524626 Aug 27 04:43:26.987957 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 29/58] 10.222.0.58 () {64 vars in 1235 bytes} [Sat Aug 27 04:43:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:43:27.951749 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:27.952756 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 27 04:43:27.953145 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 30/59] 10.222.0.58 () {56 vars in 1074 bytes} [Sat Aug 27 04:43:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:28.473987 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-64ba7863-4376-42bb-bc6d-988b62ad4089 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:28.492839 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-64ba7863-4376-42bb-bc6d-988b62ad4089 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403378 Aug 27 04:43:28.493411 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 30/60] 10.222.0.58 () {64 vars in 1235 bytes} [Sat Aug 27 04:43:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:43:29.463878 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:29.464999 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001821 Aug 27 04:43:29.465392 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 31/61] 10.222.0.58 () {56 vars in 1074 bytes} [Sat Aug 27 04:43:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:29.991907 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-dbc0ae72-08bc-46f5-9fa9-a4204c40d069 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:30.011940 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-dbc0ae72-08bc-46f5-9fa9-a4204c40d069 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403727 Aug 27 04:43:30.012468 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 31/62] 10.222.0.58 () {60 vars in 1202 bytes} [Sat Aug 27 04:43:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:23.243912 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:23.244935 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-d281aec9-bcab-4dc7-8b6d-7db833f55478 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 27 04:44:23.245333 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 32/63] 10.222.0.58 () {54 vars in 931 bytes} [Sat Aug 27 04:44:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:23.255853 n-d-820368-35 devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:23.634808 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-3fcc3dd5-29dd-460c-8422-3df971992732 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:23.655259 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-3fcc3dd5-29dd-460c-8422-3df971992732 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403907 Aug 27 04:44:23.655793 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 32/64] 10.222.0.58 () {60 vars in 1292 bytes} [Sat Aug 27 04:44:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:23.677585 n-d-820368-35 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_api:SELECT=14 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:23.681621 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-99a13bf4-7866-4f71-9c70-8ae02751cce2 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:23.689517 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-99a13bf4-7866-4f71-9c70-8ae02751cce2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014079 Aug 27 04:44:23.690160 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 33/65] 10.222.0.58 () {60 vars in 1283 bytes} [Sat Aug 27 04:44:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:23.701814 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-e1a1cf6d-9e67-454a-a7b3-ce9e9988a754 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:23.709652 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-e1a1cf6d-9e67-454a-a7b3-ce9e9988a754 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011466 Aug 27 04:44:23.710167 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 33/66] 10.222.0.58 () {60 vars in 1286 bytes} [Sat Aug 27 04:44:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:44:23.722906 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-a6ee4b2e-baad-429a-b710-6d983451058b admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:23.730658 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-a6ee4b2e-baad-429a-b710-6d983451058b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012796 Aug 27 04:44:23.731267 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 34/67] 10.222.0.58 () {60 vars in 1286 bytes} [Sat Aug 27 04:44:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:23.743483 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-f2870277-acb7-4b9c-8261-6c94972c2c62 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:23.750969 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-f2870277-acb7-4b9c-8261-6c94972c2c62 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011037 Aug 27 04:44:23.751533 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 34/68] 10.222.0.58 () {60 vars in 1283 bytes} [Sat Aug 27 04:44:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:52.235938 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-a6ee4b2e-baad-429a-b710-6d983451058b admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:52.236945 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-a6ee4b2e-baad-429a-b710-6d983451058b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 27 04:49:52.237359 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 35/69] 10.222.0.58 () {56 vars in 1074 bytes} [Sat Aug 27 04:49:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:52.379481 n-d-820368-35 devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_api:SELECT=6 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:52.519461 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-eeeeee36-59f9-4884-824c-227372d075c1 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:52.522869 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-eeeeee36-59f9-4884-824c-227372d075c1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:52.523371 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-eeeeee36-59f9-4884-824c-227372d075c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:52.523806 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-eeeeee36-59f9-4884-824c-227372d075c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:52.524524 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-eeeeee36-59f9-4884-824c-227372d075c1 admin admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:52.524974 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-eeeeee36-59f9-4884-824c-227372d075c1 admin admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:52.525390 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-eeeeee36-59f9-4884-824c-227372d075c1 admin admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:52.566191 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-eeeeee36-59f9-4884-824c-227372d075c1 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.188676 Aug 27 04:49:52.566750 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 35/70] 10.222.0.58 () {60 vars in 1193 bytes} [Sat Aug 27 04:49:52 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:49:53.402021 n-d-820368-35 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-a6ee4b2e-baad-429a-b710-6d983451058b admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:53.403004 n-d-820368-35 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-a6ee4b2e-baad-429a-b710-6d983451058b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 27 04:49:53.403424 n-d-820368-35 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1074 bytes} [Sat Aug 27 04:49:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:53.591769 n-d-820368-35 devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-71a34690-724d-4051-a7d5-c733321ee9ab admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:53.595288 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-71a34690-724d-4051-a7d5-c733321ee9ab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:53.595768 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-71a34690-724d-4051-a7d5-c733321ee9ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:53.596202 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-71a34690-724d-4051-a7d5-c733321ee9ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:53.596921 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-71a34690-724d-4051-a7d5-c733321ee9ab admin admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:53.597373 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-71a34690-724d-4051-a7d5-c733321ee9ab admin admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:53.597790 n-d-820368-35 devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-71a34690-724d-4051-a7d5-c733321ee9ab admin admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:53.620862 n-d-820368-35 devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-71a34690-724d-4051-a7d5-c733321ee9ab admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.080021 Aug 27 04:49:53.621356 n-d-820368-35 devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 36/72] 10.222.0.58 () {60 vars in 1193 bytes} [Sat Aug 27 04:49:53 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:50:39.372977 n-d-820368-35 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 04:50:39.373555 n-d-820368-35 devstack@n-api.service[112692]: Sat Aug 27 04:50:39 2022 - graceful shutdown triggered... Aug 27 04:50:39.374007 n-d-820368-35 devstack@n-api.service[112694]: Gracefully killing worker 2 (pid: 112694)... Aug 27 04:50:39.377091 n-d-820368-35 devstack@n-api.service[112693]: Gracefully killing worker 1 (pid: 112693)... Aug 27 04:50:40.374236 n-d-820368-35 devstack@n-api.service[112692]: worker 1 buried after 1 seconds Aug 27 04:50:40.374236 n-d-820368-35 devstack@n-api.service[112692]: worker 2 buried after 1 seconds Aug 27 04:50:40.374236 n-d-820368-35 devstack@n-api.service[112692]: goodbye to uWSGI. Aug 27 04:50:40.375829 n-d-820368-35 systemd[1]: devstack@n-api.service: Succeeded. Aug 27 04:50:40.376384 n-d-820368-35 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 04:50:40.379226 n-d-820368-35 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 04:50:40.394414 n-d-820368-35 devstack@n-api.service[128535]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 04:50:40.416854 n-d-820368-35 devstack@n-api.service[128535]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 04:50:40 2022] *** Aug 27 04:50:40.416854 n-d-820368-35 devstack@n-api.service[128535]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 04:50:40.416854 n-d-820368-35 devstack@n-api.service[128535]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 04:50:40.416854 n-d-820368-35 devstack@n-api.service[128535]: nodename: n-d-820368-35 Aug 27 04:50:40.416854 n-d-820368-35 devstack@n-api.service[128535]: machine: x86_64 Aug 27 04:50:40.416854 n-d-820368-35 devstack@n-api.service[128535]: clock source: unix Aug 27 04:50:40.416854 n-d-820368-35 devstack@n-api.service[128535]: pcre jit disabled Aug 27 04:50:40.416854 n-d-820368-35 devstack@n-api.service[128535]: detected number of CPU cores: 4 Aug 27 04:50:40.416854 n-d-820368-35 devstack@n-api.service[128535]: current working directory: / Aug 27 04:50:40.416854 n-d-820368-35 devstack@n-api.service[128535]: detected binary path: /usr/bin/uwsgi-core Aug 27 04:50:40.416854 n-d-820368-35 devstack@n-api.service[128535]: your processes number limit is 47680 Aug 27 04:50:40.417707 n-d-820368-35 devstack@n-api.service[128535]: your memory page size is 4096 bytes Aug 27 04:50:40.417707 n-d-820368-35 devstack@n-api.service[128535]: detected max file descriptor number: 2048 Aug 27 04:50:40.417707 n-d-820368-35 devstack@n-api.service[128535]: lock engine: pthread robust mutexes Aug 27 04:50:40.417707 n-d-820368-35 devstack@n-api.service[128535]: thunder lock: enabled Aug 27 04:50:40.417707 n-d-820368-35 devstack@n-api.service[128535]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 04:50:40.417707 n-d-820368-35 devstack@n-api.service[128535]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 04:50:40.456781 n-d-820368-35 devstack@n-api.service[128535]: Python main interpreter initialized at 0x55691fede9c0 Aug 27 04:50:40.456781 n-d-820368-35 devstack@n-api.service[128535]: python threads support enabled Aug 27 04:50:40.456781 n-d-820368-35 devstack@n-api.service[128535]: your server socket listen backlog is limited to 100 connections Aug 27 04:50:40.456781 n-d-820368-35 devstack@n-api.service[128535]: your mercy for graceful operations on workers is 90 seconds Aug 27 04:50:40.457197 n-d-820368-35 devstack@n-api.service[128535]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 04:50:40.457197 n-d-820368-35 devstack@n-api.service[128535]: *** Operational MODE: preforking *** Aug 27 04:50:40.457403 n-d-820368-35 devstack@n-api.service[128535]: *** uWSGI is running in multiple interpreter mode *** Aug 27 04:50:40.457403 n-d-820368-35 devstack@n-api.service[128535]: spawned uWSGI master process (pid: 128535) Aug 27 04:50:40.457631 n-d-820368-35 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 04:50:40.458148 n-d-820368-35 devstack@n-api.service[128535]: spawned uWSGI worker 1 (pid: 128547, cores: 1) Aug 27 04:50:40.458651 n-d-820368-35 devstack@n-api.service[128535]: spawned uWSGI worker 2 (pid: 128548, cores: 1) Aug 27 04:50:40.458918 n-d-820368-35 devstack@n-api.service[128535]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 04:50:41.120168 n-d-820368-35 devstack@n-api.service[128548]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 04:50:41.127102 n-d-820368-35 devstack@n-api.service[128547]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 04:50:42.312610 n-d-820368-35 devstack@n-api.service[128547]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:50:42.312610 n-d-820368-35 devstack@n-api.service[128547]: from cryptography.utils import int_from_bytes Aug 27 04:50:42.313366 n-d-820368-35 devstack@n-api.service[128548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:50:42.313366 n-d-820368-35 devstack@n-api.service[128548]: from cryptography.utils import int_from_bytes Aug 27 04:50:42.313766 n-d-820368-35 devstack@n-api.service[128547]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:50:42.313766 n-d-820368-35 devstack@n-api.service[128547]: from cryptography.utils import int_from_bytes Aug 27 04:50:42.313911 n-d-820368-35 devstack@n-api.service[128548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:50:42.313911 n-d-820368-35 devstack@n-api.service[128548]: from cryptography.utils import int_from_bytes Aug 27 04:50:44.723761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:50:44.724312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:50:44.724649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:50:44.724840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:50:44.725104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:50:44.725535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.725867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.726197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.726522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.727013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.727361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.727695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.728024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.728373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.728631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.728952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.729283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-820368-35 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.729614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.729932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.730249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.730574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.730889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.731246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.731562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.733959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.733959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.733959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.733959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.733959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.733959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.734508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.734508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.734655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.734988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.735341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.735751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-820368-35 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.736065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.736387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.736703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.737109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.737428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.737765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.738070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.738411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.738725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.738838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:50:44.739315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:50:44.739400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.739400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.739550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:50:44.739752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.739879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:50:44.740090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.740211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:50:44.740387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.740562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.740695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.741454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.741761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.741978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.742222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.742462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.742650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.742844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.743031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.743149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.743149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.743293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.743507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.743670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.743849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.743999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.744225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.744389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.744543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.744698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.744860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.745063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.745213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.745374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-820368-35 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.745534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.745682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.745853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.746002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.746164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.746320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.746480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.746633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.746805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.746969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.747184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.747337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.747516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.747670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.747887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.747887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.748189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.748366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.748513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.748657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.748846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.749000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.749145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.749299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.749445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.749590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.749735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.749735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.750023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.750188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.750341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.751282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.751451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.751610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.751763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.751961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.752117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.752117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.752410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-820368-35 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.752570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.752724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.752876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.753037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.753230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.753385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.753543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.753709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.753864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.754018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.754171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.754332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.754488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.754634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.754786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.754940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.755105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.755267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.755683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.755851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.756006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.756160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.756312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.756468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.757214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.757363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.757544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.757723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.757926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.758105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.758261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.758412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.758570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.758729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.758885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.759136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.759290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.759447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.759602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.759748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.760105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.760268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.760423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.760594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.761802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.761902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.761995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.762970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.763054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.763188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.763284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.763379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.763379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.763538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.763630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.763721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.763812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.763896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.763986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.764076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.764159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.764249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.764340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.764432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.764515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.764604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.764696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.764795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.764886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.764977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.765066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.765150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.765241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.765241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.765442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.765442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.765615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.765615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.765790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.765882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.765972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.766127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.766304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.766470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.766630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.766786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.766933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.767110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.767275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.767423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.767583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.767730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.767875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.768092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.768361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.768521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.768688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.768843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.768998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.769158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.769317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.769317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.769753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.769927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.770211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.770398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.771765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.771940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.772090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.772258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.772405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.772557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.772712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.772867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.773013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.773165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.773312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.773467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.773668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.774220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.774370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.774526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.774726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.774884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.775041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.775211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.775370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.775525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.775670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.775815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.775969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.776122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.776279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.776425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.776587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.776733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.776892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.777045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.777231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.777394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.777540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.777694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.777850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.777996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.778189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.778378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.778575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.778741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.778887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.779040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.779040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.779428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.779575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.779728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.779880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.780025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.780178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.780330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.780475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.780620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.780788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.780969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.780969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.781934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.782090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.782237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.782390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.782551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.782709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.782862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.783015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.783182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.783182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.783487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.783640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.783787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.783940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.784144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.784388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.784550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.784946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.785100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.785246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.785408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.785567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.785732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.785962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.786116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.786270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.786422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.786575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.786728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.786888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.787042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.787299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.787458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.794844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.795024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.795256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.795414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.795582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.795742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.795897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:50:44.796045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.796200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.796348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.796493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.796647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.796800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.796956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.797109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.797272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.797419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.797567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.797712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.797871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.798024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.798169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.798322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.798475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.798621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.798775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.798920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.799082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.799260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.799422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.799569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.799728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.799881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.800033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.800223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.800373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.800534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.800694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.800848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.801001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.801158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.801306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.801469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.801624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.802442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.802608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.802766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.802925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.803110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.803264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.804062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.804220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.804367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.804525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.804706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.804951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.805103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.805257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.805410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.805572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.805720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.805876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.806031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.806177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.806177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.806477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.806642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.806789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.812862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.813623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.813815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.814247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.814418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.814578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.814734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.814882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.815179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.815361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.815518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.815665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.815665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.815969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.816116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.816296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.816445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.816591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.816736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.816900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.817583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.817755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.817914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.818069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.820175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.820371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.820538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.820707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.820864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.821011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.821166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.821312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.821467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.821642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.821797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.822004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.822156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.823073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.823263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.823428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.823577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.823723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.823875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.824028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.824188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.824344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.824503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.824649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.824869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.825039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.825347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.825519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.825676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.825823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.825969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.826122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.826326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.826480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.826626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.826792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.826939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.827112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.827281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.827430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.827583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.827737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.827894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.828049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.828205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.828352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.828498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.828643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.828800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.828959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.829107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.829272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.829601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.829763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.829919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.830087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.830238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.830384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.830539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.830685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.830837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.831012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.831212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.831593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.831749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.831925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.832116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.832283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.832449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.833329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.833487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.833636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.833804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.833804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.834156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.834316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.834471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.834643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.834882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.835038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.835210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.835634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.835796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.835950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.836112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.836267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.836424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.836578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.836723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.836868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.837023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.837178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.837332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.837478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.837623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.837768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.837922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.838067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.838213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.838369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.838522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.838681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.838826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.838976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.839150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.839304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.839450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.839605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.839757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.839917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.840075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.840229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.840386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.840541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.840686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.840839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.840985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.841138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.841292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.841454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.841606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.841759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.841913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.842059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.842316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.842478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.842627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.843180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.843368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.843532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.843689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.843843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.844002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.844162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.844307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.844460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.844620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.844779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.844925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.845077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.845222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.845368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.845522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.845775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.845934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.846088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.846241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.846397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.846543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.846689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.846848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.846993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.847192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.847362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.847517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.847671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.847825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.847970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.848114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.848296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.848457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.848610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.848758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.848914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.849074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.849234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.849380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.849380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.849663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.849825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.849825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.850133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.850802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.850953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.851123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.851275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.851443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.851598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.851752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.851898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.852043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.852194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.852395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.852553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.852699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.852870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.853190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.853411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.853584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.853732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.853732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.854015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.854159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.854311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.854471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.854619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.854772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.854917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.855071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.855296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.855444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.855607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.855772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.856021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.856181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.856341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.856495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.856693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.856693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.856989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.857135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.857291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.857448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.857594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.857758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.857904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.859216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.859336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.859336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.859490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.859577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.859681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.859770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.859770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.859927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.860933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.861989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.862988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.863071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.863228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.863311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.863401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.863518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.863595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.863692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.863765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.863843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.863915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.864993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.865077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.865167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.865259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.865349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.865451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.865537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.865628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.865712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.865796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.865924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.866011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.866601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.866675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.866752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.866830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.866922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.867898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.868995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.869947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.870921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.871013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.871953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.872964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.873128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.873219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.873312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.873404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.873489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.873580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.873665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.873756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.873854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.873949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.874034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.874124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.874217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.874309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.874474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.874562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.874652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.874737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.874816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.874912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.874912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.875073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.875296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.875393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.875489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.875587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.875673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.875763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.875848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.875932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.876016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.876111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.876203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.876287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.876371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.876461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.876553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.876677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.876771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.876855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.876946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.877956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.878047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.878144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.878235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.878326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.878423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.878523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.878615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.878615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.878615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.878615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.878615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.879999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.880160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.880246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.880627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.880721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.880805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.880896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.881057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.881143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.881227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.881310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.881393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.881506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.881621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.882141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.882244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.882338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.882423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.882515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.882599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.882671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.882760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.882851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.882935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.883027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.883177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.883274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.883359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.883442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.883532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.883630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.883722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.883814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.883906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.883997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.884080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.884175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.884260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.884349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.884432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.884515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.884611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.884696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.884786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.884871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.884953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.885039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.885139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.885231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.885317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.885407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.885491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.885573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.885731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.885812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.885812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.885940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.886984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.887069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.887198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.887291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.887382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.887474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.887564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.887648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.887739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.887830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.887903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.887995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.888155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.888298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.888450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.888597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.888742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.888836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.888929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.889024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.889117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.889209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.889294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.889378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.889461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.889556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.889648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.889733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.889824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.889916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.890952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.891048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.891243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.891342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.891442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.891537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.891621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.891712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.892222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.892329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.892415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.892500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.892591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.892685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.892759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.892848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.892939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.893030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.893114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.893209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.893314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.893405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.893496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.893587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.893683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.893769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.893852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.893935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.894018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.894110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.894202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.894293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.894384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.894475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.894568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.894654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.894750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.894845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.894936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.895027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.895744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.895845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.895951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.896038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.896122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.896214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.896307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.896405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.896499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.896584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.896675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.896759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.896852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.896937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.897958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.898034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.898113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.898192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.898275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.898366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.898448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.899788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.900685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.900685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.901228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.901308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.901387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.901459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.901617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.901699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.901798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.901874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.902530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.902627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.902709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.902789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.902861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.902943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.903952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.904105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.904182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.904254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.904345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.905889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.905996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.906992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.907075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.907183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.907287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.907379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.907453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.907538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.907637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.907723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.907815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.907902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.908277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.908391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.908467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.908555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.908689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.908801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.909067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.909223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.909312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.909390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.909666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.909778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.910049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.910184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.910267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.910364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.910538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.910655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.910851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.910951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.911190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.911295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.911503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.911612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.911902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.912005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.912621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.913271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.913350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.913422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.913508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.913590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.913669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.913789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.913947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.914120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.914940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.915046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.915159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.915249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.915334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.915428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.915521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.915609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.915694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.915786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.915908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.916091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.916193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.916405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.916521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.916755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.917082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.917244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.917422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.917567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.917742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.917884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.918368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.918503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.918616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.918716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.918803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.918895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.919027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.919302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.919392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.919478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.919626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.919720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.919945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.920127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.920269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.920365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.920579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.920670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.920894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.920993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.921203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.921307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.921513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.921615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.921824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.921918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.922138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.922244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.922452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.922600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.922795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.922895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.923062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.923245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.923412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.923515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.923723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.923817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.924052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.924191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.924365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.924459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.924672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.924764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.924995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.925098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.925282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.925378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.925615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.925714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.925922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.926013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.926243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.926336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.926553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.926643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.926873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.927001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.927234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.927334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.927535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.927646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.927854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.927961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.928173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.928288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.928550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.929129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.929365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.929466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.929688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.929787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.929997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.930217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.930316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.930531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.930622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.930867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.930960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.931237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.931512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.931615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.931846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.931947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.932165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.932265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.932497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.932747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.932839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.932923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.933106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.933217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.933425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.933560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.933731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.933824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.934042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.934141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.934354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.934456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.934678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.934823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.934990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.935183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.935342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.935515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.935656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.935848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.936189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.936290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.936514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.936615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.936834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.936935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.937154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.937260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.937475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.937574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.937835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.937937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.938153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.938313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.938466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.938558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.938782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.938883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.939123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.939221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.939445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.939540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.939761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.939863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.940074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.940166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.964003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.964198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.964198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.964345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.964345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.964462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.964517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.964569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.964621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.964671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.965492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.965656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.965802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.965802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.966081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.966255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.966453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.966626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.966771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.966912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.967045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.967223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.967354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.967542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.967839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.968137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.968137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.969213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.969371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.969544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.969709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.969860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.969996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.970128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.970260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.970418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.970592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.970777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.970954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.971202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.971387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.971550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.971550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.971860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.972026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.972186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.972343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.972489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.972632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.972770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.973107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.973281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.973446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.973733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.973983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.974146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.974311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.974467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.974467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.974467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.974467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.974467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.974467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.976001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.976188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.976466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.976645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.976645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.976645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.977100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.977182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.977326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.977406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.977406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.977670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.977796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.977931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.978055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.978055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.978275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.978456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.978630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.978790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.978935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.979011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.979070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.979213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.979213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.979463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.979523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.979616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.979722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.979817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.979889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.979947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.980946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.981987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.982824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.983920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.984836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.985935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.986865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.987934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.988837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.989987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.990988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.991655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.991833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.991918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.992155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.992242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.992477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.992555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.992843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.992948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.993119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.993314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.993634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.993765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.993993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.994137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.994285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.994458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.994599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.994745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.994868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.994999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.995186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.995265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.995337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.995493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.995675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.995832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.996031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.996157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.996352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.996493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.996705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.996856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.997041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.997151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.997363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.997524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.997684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.997932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.998010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.998234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:50:44.998311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.998578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.998895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.999242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.999562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:44.999895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.000222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.000786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.000880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.001157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.001471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.001788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.002103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.002419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.002738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.003054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.003395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.003710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.004041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.004334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.004647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.004967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.005281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.005853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.006168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.006506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.006824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.007193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.007540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.007869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.008207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.008529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.008865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.009186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.009520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.009852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.010189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.010510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.010856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.011275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.011602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.011923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.012244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.012569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.012885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.013286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.013559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.013867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.014205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.014543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.014862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.015211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.015534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.015873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.016193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.016514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.016834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.017154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.017475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.017799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.018116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.018434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.018756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.019080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.019443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.019778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.020101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.020439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.020775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.021133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.021456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.021811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.022181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.022507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.022830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.023169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:50:45.023421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:50:45.059963 n-d-820368-35 devstack@n-api.service[128547]: INFO dbcounter [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Registered counter for database nova_api Aug 27 04:50:45.080153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_db.sqlalchemy.engines [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:50:45.085893 n-d-820368-35 devstack@n-api.service[128548]: INFO dbcounter [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Registered counter for database nova_api Aug 27 04:50:45.086686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writer thread running {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:50:45.106711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_db.sqlalchemy.engines [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:50:45.113379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writer thread running {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:50:45.143121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.context [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) {{(pid=128547) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:50:45.147730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:45.148210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:45.149781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:45.150505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:45.150956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:45.152966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:45.154963 n-d-820368-35 devstack@n-api.service[128547]: INFO dbcounter [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Registered counter for database nova_cell0 Aug 27 04:50:45.158945 n-d-820368-35 devstack@n-api.service[128547]: INFO dbcounter [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Registered counter for database nova_cell1 Aug 27 04:50:45.167589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_db.sqlalchemy.engines [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:50:45.168690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_db.sqlalchemy.engines [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:50:45.170664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.context [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) {{(pid=128548) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:50:45.174336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writer thread running {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:50:45.174820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:45.175386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:45.176965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:45.177296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writer thread running {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:50:45.177699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:45.178516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:45.180559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:45.182578 n-d-820368-35 devstack@n-api.service[128548]: INFO dbcounter [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Registered counter for database nova_cell0 Aug 27 04:50:45.186627 n-d-820368-35 devstack@n-api.service[128548]: INFO dbcounter [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Registered counter for database nova_cell1 Aug 27 04:50:45.194264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_db.sqlalchemy.engines [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:50:45.196041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_db.sqlalchemy.engines [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:50:45.202066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writer thread running {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:50:45.204434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writer thread running {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:50:45.325540 n-d-820368-35 devstack@n-api.service[128547]: INFO dbcounter [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Registered counter for database nova_cell0 Aug 27 04:50:45.335562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_db.sqlalchemy.engines [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:50:45.346154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writer thread running {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:50:45.359608 n-d-820368-35 devstack@n-api.service[128548]: INFO dbcounter [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Registered counter for database nova_cell0 Aug 27 04:50:45.366332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_db.sqlalchemy.engines [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:50:45.371071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writer thread running {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:50:45.666548 n-d-820368-35 devstack@n-api.service[128547]: WARNING keystonemiddleware.auth_token [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:50:45.674398 n-d-820368-35 devstack@n-api.service[128547]: WARNING keystonemiddleware.auth_token [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:50:45.710857 n-d-820368-35 devstack@n-api.service[128548]: WARNING keystonemiddleware.auth_token [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:50:45.718428 n-d-820368-35 devstack@n-api.service[128548]: WARNING keystonemiddleware.auth_token [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:50:46.017880 n-d-820368-35 devstack@n-api.service[128547]: WARNING keystonemiddleware.auth_token [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:50:46.024393 n-d-820368-35 devstack@n-api.service[128547]: WARNING keystonemiddleware.auth_token [None req-70cf58a6-b7ca-44c1-a78f-231dd2a6edea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:50:46.029801 n-d-820368-35 devstack@n-api.service[128547]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55691fede9c0 pid: 128547 (default app) Aug 27 04:50:46.065521 n-d-820368-35 devstack@n-api.service[128548]: WARNING keystonemiddleware.auth_token [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:50:46.071612 n-d-820368-35 devstack@n-api.service[128548]: WARNING keystonemiddleware.auth_token [None req-948f4586-75f8-4c77-82dc-07c2ae75d8c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:50:46.077007 n-d-820368-35 devstack@n-api.service[128548]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55691fede9c0 pid: 128548 (default app) Aug 27 04:51:27.506069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:27.506997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:27.507920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:27.509045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:27.616344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:27.617539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:27.618353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:27.619548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:28.430812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dcfdb4f6-78c5-4762-96ae-a5aae8b42642 tempest-FlavorsV255TestJSON-1316469863 tempest-FlavorsV255TestJSON-1316469863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1952180825", "id": 1168336575, "os-flavor-access:is_public": "True"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:28.443900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Calling method '.version_select at 0x7fb566e4c3a0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:28.450813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) {{(pid=128548) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 04:51:28.451652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.452186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.452712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.480219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.480716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.481153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.482357 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dcfdb4f6-78c5-4762-96ae-a5aae8b42642 tempest-FlavorsV255TestJSON-1316469863 tempest-FlavorsV255TestJSON-1316469863-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.986649 Aug 27 04:51:28.483279 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1/1] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 04:51:27 2022] POST /compute/v2.1/flavors => generated 449 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:51:28.494899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.495401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.495843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.504454 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a510352d-914e-4977-95f2-0e6525afc2c8 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.897314 Aug 27 04:51:28.505500 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1/2] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:28.680486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bc7b5c75-f366-4684-a11b-be8ff573ba64 tempest-FlavorMetadataValidation-456406631 tempest-FlavorMetadataValidation-456406631-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1670135763", "id": 1236152216, "os-flavor-access:is_public": "True"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:28.722943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ebe42455-e0f2-40c7-bd83-010e5505c497 tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:28.725366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe42455-e0f2-40c7-bd83-010e5505c497 tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.725849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe42455-e0f2-40c7-bd83-010e5505c497 tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.726287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe42455-e0f2-40c7-bd83-010e5505c497 tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.727360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe42455-e0f2-40c7-bd83-010e5505c497 tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.727984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe42455-e0f2-40c7-bd83-010e5505c497 tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.728549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe42455-e0f2-40c7-bd83-010e5505c497 tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.740699 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bc7b5c75-f366-4684-a11b-be8ff573ba64 tempest-FlavorMetadataValidation-456406631 tempest-FlavorMetadataValidation-456406631-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.233601 Aug 27 04:51:28.742111 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2/3] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 04:51:28 2022] POST /compute/v2.1/flavors => generated 471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:51:28.777701 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ebe42455-e0f2-40c7-bd83-010e5505c497 tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.293164 Aug 27 04:51:28.778747 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1164 bytes} [Sat Aug 27 04:51:28 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:51:28.883012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a228625b-a05d-4e2e-9b74-9388f11dfcdd tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Calling method '.version_select at 0x7fb566e4c820>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:28.887048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a228625b-a05d-4e2e-9b74-9388f11dfcdd tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.887640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a228625b-a05d-4e2e-9b74-9388f11dfcdd tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.888160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a228625b-a05d-4e2e-9b74-9388f11dfcdd tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.902899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '.version_select at 0x7fb566cb8f70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:28.905947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a228625b-a05d-4e2e-9b74-9388f11dfcdd tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.906423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a228625b-a05d-4e2e-9b74-9388f11dfcdd tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.907288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a228625b-a05d-4e2e-9b74-9388f11dfcdd tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.911920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) {{(pid=128547) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 04:51:28.913063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.913849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.915025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.919230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a228625b-a05d-4e2e-9b74-9388f11dfcdd tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.919709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a228625b-a05d-4e2e-9b74-9388f11dfcdd tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.920299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a228625b-a05d-4e2e-9b74-9388f11dfcdd tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.926639 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a228625b-a05d-4e2e-9b74-9388f11dfcdd tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.183429 Aug 27 04:51:28.927229 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3/5] 10.222.0.58 () {60 vars in 1208 bytes} [Sat Aug 27 04:51:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:28.949526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.950014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.950803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.964462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.964964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.965382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.971664 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8e4bbe8-2f49-44f2-929f-738b1b87c0ad tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.191486 Aug 27 04:51:28.972294 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3/6] 10.222.0.58 () {58 vars in 1167 bytes} [Sat Aug 27 04:51:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:29.040157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5f2356e-5062-4ab3-bc4e-d80e54cf0e78 tempest-AZAdminNegativeTestJSON-1121082298 tempest-AZAdminNegativeTestJSON-1121082298-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.042350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c5f2356e-5062-4ab3-bc4e-d80e54cf0e78 tempest-AZAdminNegativeTestJSON-1121082298 tempest-AZAdminNegativeTestJSON-1121082298-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '0e67a35ddade4fc3a9fcf28dc70c12d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175c301b4d154733b422a82c42d471d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5f2356e-5062-4ab3-bc4e-d80e54cf0e78 tempest-AZAdminNegativeTestJSON-1121082298 tempest-AZAdminNegativeTestJSON-1121082298-project] Request method failure captured: Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLNFXcwr7XP3_M93foZCat94mhv-QL322QNCTD6zXbOra9hZU4vBdMMUc66wX-fUOErZpUE63y7jvuu8YKVM15E_yR7nJMdx4nprJZ3fK204joEeewVPM1u5AbAcHJZzgrGuY-xR1u4S9-RtfaWJq6Re1LKRg2qQPHHN9mjTnsyGTU Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 175c301b4d154733b422a82c42d471d9 Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1121082298 Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:51:29.046486 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_175c301b4d154733b422a82c42d471d9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/175c301b4d154733b422a82c42d471d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/175c301b4d154733b422a82c42d471d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/175c301b4d154733b422a82c42d471d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AZAdminNegativeTestJSON-1121082298 Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 175c301b4d154733b422a82c42d471d9 Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1121082298 Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AZAdminNegativeTestJSON-1121082298-project Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 0e67a35ddade4fc3a9fcf28dc70c12d7 Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AZAdminNegativeTestJSON-1121082298-project Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 04:51:29.047591 n-d-820368-35 devstack@n-api.service[128548]: action_args: {} Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:29.048261 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 04:51:29.049144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:29.050905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5f2356e-5062-4ab3-bc4e-d80e54cf0e78 tempest-AZAdminNegativeTestJSON-1121082298 tempest-AZAdminNegativeTestJSON-1121082298-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:29.052413 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5f2356e-5062-4ab3-bc4e-d80e54cf0e78 tempest-AZAdminNegativeTestJSON-1121082298 tempest-AZAdminNegativeTestJSON-1121082298-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.123250 Aug 27 04:51:29.052941 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1185 bytes} [Sat Aug 27 04:51:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 125 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:29.057730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7eeda5f9-8ffb-48b8-8620-61f75393ba05 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Calling method '.version_select at 0x7fb566cad820>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.059652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7eeda5f9-8ffb-48b8-8620-61f75393ba05 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.060125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7eeda5f9-8ffb-48b8-8620-61f75393ba05 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.060697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7eeda5f9-8ffb-48b8-8620-61f75393ba05 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.080087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7eeda5f9-8ffb-48b8-8620-61f75393ba05 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.080782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7eeda5f9-8ffb-48b8-8620-61f75393ba05 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.081218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7eeda5f9-8ffb-48b8-8620-61f75393ba05 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.120375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7eeda5f9-8ffb-48b8-8620-61f75393ba05 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.120917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7eeda5f9-8ffb-48b8-8620-61f75393ba05 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.121272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7eeda5f9-8ffb-48b8-8620-61f75393ba05 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.127196 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7eeda5f9-8ffb-48b8-8620-61f75393ba05 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h2-820368-35/servers" status: 200 len: 105 microversion: 2.1 time: 0.073133 Aug 27 04:51:29.127744 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 5/8] 10.222.0.58 () {58 vars in 1215 bytes} [Sat Aug 27 04:51:29 2022] GET /compute/v2.1/os-hypervisors/n-h2-820368-35/servers => generated 105 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:29.133016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa972eba-2939-4755-85cf-061224db3d14 tempest-FlavorMetadataValidation-456406631 tempest-FlavorMetadataValidation-456406631-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:29.164742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-99fc92ff-9a30-4467-9d76-c95869a2d013 tempest-FlavorsV255TestJSON-1410197531 tempest-FlavorsV255TestJSON-1410197531-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.185419 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-99fc92ff-9a30-4467-9d76-c95869a2d013 tempest-FlavorsV255TestJSON-1410197531 tempest-FlavorsV255TestJSON-1410197531-project] 10.222.0.58 "GET /compute/v2.1/flavors/1168336575" status: 200 len: 449 microversion: 2.55 time: 0.212013 Aug 27 04:51:29.186000 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4/9] 10.222.0.58 () {60 vars in 1199 bytes} [Sat Aug 27 04:51:28 2022] GET /compute/v2.1/flavors/1168336575 => generated 449 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:51:29.193826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d6a468d7-29ba-4acf-a561-55d68e8a01ef tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.196204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6a468d7-29ba-4acf-a561-55d68e8a01ef tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.197635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6a468d7-29ba-4acf-a561-55d68e8a01ef tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.198528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6a468d7-29ba-4acf-a561-55d68e8a01ef tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.199485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6a468d7-29ba-4acf-a561-55d68e8a01ef tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.200166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6a468d7-29ba-4acf-a561-55d68e8a01ef tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.201041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6a468d7-29ba-4acf-a561-55d68e8a01ef tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.228181 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d6a468d7-29ba-4acf-a561-55d68e8a01ef tempest-AZAdminV2TestJSON-94740988 tempest-AZAdminV2TestJSON-94740988-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.039415 Aug 27 04:51:29.229292 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 5/10] 10.222.0.58 () {58 vars in 1185 bytes} [Sat Aug 27 04:51:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:29.235266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-42fe8bcc-e08c-400f-b6bd-c7d216b1abff tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-79343239"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:29.239013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.aggregate [None req-42fe8bcc-e08c-400f-b6bd-c7d216b1abff tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Generated uuid 4aad9cf4-73bc-4f9b-9749-798695863261 for aggregate {{(pid=128547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:51:29.321144 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-42fe8bcc-e08c-400f-b6bd-c7d216b1abff tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.41 time: 0.090441 Aug 27 04:51:29.321918 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 6/11] 10.222.0.58 () {62 vars in 1205 bytes} [Sat Aug 27 04:51:29 2022] POST /compute/v2.1/os-aggregates => generated 244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:51:29.327935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d95b9451-f0dd-4ac1-aaf9-5f2f6e254a18 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Calling method '.version_select at 0x7fb566c64160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.329731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d95b9451-f0dd-4ac1-aaf9-5f2f6e254a18 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.330311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d95b9451-f0dd-4ac1-aaf9-5f2f6e254a18 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.330755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d95b9451-f0dd-4ac1-aaf9-5f2f6e254a18 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.347287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d95b9451-f0dd-4ac1-aaf9-5f2f6e254a18 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.347871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d95b9451-f0dd-4ac1-aaf9-5f2f6e254a18 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.348576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d95b9451-f0dd-4ac1-aaf9-5f2f6e254a18 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.361963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d95b9451-f0dd-4ac1-aaf9-5f2f6e254a18 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.361963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d95b9451-f0dd-4ac1-aaf9-5f2f6e254a18 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.361963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d95b9451-f0dd-4ac1-aaf9-5f2f6e254a18 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.368819 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d95b9451-f0dd-4ac1-aaf9-5f2f6e254a18 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.045641 Aug 27 04:51:29.369448 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 7/12] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:29 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:29.374119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6094690f-274c-4981-b4fc-8637022ebb7a tempest-FlavorsV255TestJSON-1316469863 tempest-FlavorsV255TestJSON-1316469863-project-admin] Action: 'update', calling method: .version_select at 0x7fb56720a9d0>, body: {"flavor": {"description": "new"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:29.376381 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aa972eba-2939-4755-85cf-061224db3d14 tempest-FlavorMetadataValidation-456406631 tempest-FlavorMetadataValidation-456406631-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1236152216/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.247426 Aug 27 04:51:29.377112 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 6/13] 10.222.0.58 () {62 vars in 1265 bytes} [Sat Aug 27 04:51:29 2022] POST /compute/v2.1/flavors/1236152216/os-extra_specs => generated 62 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:29.392595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b12495c-381c-4c2a-8558-05c4e1de6118 tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1836160919"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:29.431981 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6094690f-274c-4981-b4fc-8637022ebb7a tempest-FlavorsV255TestJSON-1316469863 tempest-FlavorsV255TestJSON-1316469863-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/1168336575" status: 200 len: 450 microversion: 2.55 time: 0.061471 Aug 27 04:51:29.432848 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 8/14] 10.222.0.58 () {62 vars in 1219 bytes} [Sat Aug 27 04:51:29 2022] PUT /compute/v2.1/flavors/1168336575 => generated 450 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:51:29.445589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8065db4c-32c1-4c36-829e-7502c3eedb88 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Calling method '.version_select at 0x7fb566c64820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.447661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8065db4c-32c1-4c36-829e-7502c3eedb88 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.448577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8065db4c-32c1-4c36-829e-7502c3eedb88 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.449230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8065db4c-32c1-4c36-829e-7502c3eedb88 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.470340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8065db4c-32c1-4c36-829e-7502c3eedb88 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.470997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8065db4c-32c1-4c36-829e-7502c3eedb88 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.471730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8065db4c-32c1-4c36-829e-7502c3eedb88 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.477675 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8065db4c-32c1-4c36-829e-7502c3eedb88 tempest-HypervisorAdminUnderV252Test-1912093087 tempest-HypervisorAdminUnderV252Test-1912093087-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h2-820368-35/search" status: 200 len: 105 microversion: 2.1 time: 0.036342 Aug 27 04:51:29.478563 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 9/15] 10.222.0.58 () {58 vars in 1212 bytes} [Sat Aug 27 04:51:29 2022] GET /compute/v2.1/os-hypervisors/n-h2-820368-35/search => generated 105 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:29.488076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-175ed57e-52ab-40c8-b7a2-cf9d8be08097 tempest-FlavorMetadataValidation-456406631 tempest-FlavorMetadataValidation-456406631-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.522291 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-175ed57e-52ab-40c8-b7a2-cf9d8be08097 tempest-FlavorMetadataValidation-456406631 tempest-FlavorMetadataValidation-456406631-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1236152216" status: 202 len: 0 microversion: 2.86 time: 0.042666 Aug 27 04:51:29.524531 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 10/16] 10.222.0.58 () {60 vars in 1202 bytes} [Sat Aug 27 04:51:29 2022] DELETE /compute/v2.1/flavors/1236152216 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:51:29.585120 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b12495c-381c-4c2a-8558-05c4e1de6118 tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.200124 Aug 27 04:51:29.587255 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 7/17] 10.222.0.58 () {62 vars in 1210 bytes} [Sat Aug 27 04:51:29 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:51:29.591921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2c6939d7-3436-49ad-bb01-badbbf46cf31 tempest-FlavorsV255TestJSON-1410197531 tempest-FlavorsV255TestJSON-1410197531-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.623738 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2c6939d7-3436-49ad-bb01-badbbf46cf31 tempest-FlavorsV255TestJSON-1410197531 tempest-FlavorsV255TestJSON-1410197531-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.035408 Aug 27 04:51:29.624477 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 8/18] 10.222.0.58 () {60 vars in 1187 bytes} [Sat Aug 27 04:51:29 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:29.628969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eabe6167-52de-46d5-945b-894a7ce28821 tempest-FlavorMetadataValidation-456406631 tempest-FlavorMetadataValidation-456406631-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.659804 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eabe6167-52de-46d5-945b-894a7ce28821 tempest-FlavorMetadataValidation-456406631 tempest-FlavorMetadataValidation-456406631-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.86 time: 0.034248 Aug 27 04:51:29.660375 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 9/19] 10.222.0.58 () {60 vars in 1187 bytes} [Sat Aug 27 04:51:29 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:29.665004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-50a71b42-addb-4e05-9ea0-0dd07b1a9100 tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.672388 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-50a71b42-addb-4e05-9ea0-0dd07b1a9100 tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.010718 Aug 27 04:51:29.672866 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1190 bytes} [Sat Aug 27 04:51:29 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:51:29.682890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a2200a8e-f5e0-4edb-b7ff-10920d4f0293 tempest-FlavorsV255TestJSON-1410197531 tempest-FlavorsV255TestJSON-1410197531-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.711559 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a2200a8e-f5e0-4edb-b7ff-10920d4f0293 tempest-FlavorsV255TestJSON-1410197531 tempest-FlavorsV255TestJSON-1410197531-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.037424 Aug 27 04:51:29.712800 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 11/21] 10.222.0.58 () {60 vars in 1166 bytes} [Sat Aug 27 04:51:29 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:29.717898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e8fc513-4cf3-433f-8e74-a85cee9880d5 tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:29.730202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e8fc513-4cf3-433f-8e74-a85cee9880d5 tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.730977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e8fc513-4cf3-433f-8e74-a85cee9880d5 tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.731609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e8fc513-4cf3-433f-8e74-a85cee9880d5 tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.865972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53fab3bf-ffc5-42d1-bc88-f5f5d02752bc tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Calling method '.version_select at 0x7fb566c64c10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.869787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53fab3bf-ffc5-42d1-bc88-f5f5d02752bc tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.871191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53fab3bf-ffc5-42d1-bc88-f5f5d02752bc tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.873085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53fab3bf-ffc5-42d1-bc88-f5f5d02752bc tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.893202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53fab3bf-ffc5-42d1-bc88-f5f5d02752bc tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.894485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53fab3bf-ffc5-42d1-bc88-f5f5d02752bc tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.895250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53fab3bf-ffc5-42d1-bc88-f5f5d02752bc tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.936037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53fab3bf-ffc5-42d1-bc88-f5f5d02752bc tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.936460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53fab3bf-ffc5-42d1-bc88-f5f5d02752bc tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.936910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53fab3bf-ffc5-42d1-bc88-f5f5d02752bc tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.946428 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-53fab3bf-ffc5-42d1-bc88-f5f5d02752bc tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.420063 Aug 27 04:51:29.947072 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 11/22] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:29 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:29.959797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-147e7253-a4fe-4b68-b39b-8743fb7f04ab tempest-FlavorsV255TestJSON-1316469863 tempest-FlavorsV255TestJSON-1316469863-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.979233 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-147e7253-a4fe-4b68-b39b-8743fb7f04ab tempest-FlavorsV255TestJSON-1316469863 tempest-FlavorsV255TestJSON-1316469863-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1168336575" status: 202 len: 0 microversion: 2.55 time: 0.023599 Aug 27 04:51:29.980018 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 12/23] 10.222.0.58 () {60 vars in 1202 bytes} [Sat Aug 27 04:51:29 2022] DELETE /compute/v2.1/flavors/1168336575 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:51:30.361255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a787f686-10cb-4b04-9fa9-8aefc6e989d0 tempest-HypervisorAdminNegativeUnderV252Test-1652529552 tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project] Calling method '.version_select at 0x7fb566435f70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:30.363436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a787f686-10cb-4b04-9fa9-8aefc6e989d0 tempest-HypervisorAdminNegativeUnderV252Test-1652529552 tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '51ef15416cd34fab97e7cfc2e1748563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd7092e24504323b18a2a0423249c0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a787f686-10cb-4b04-9fa9-8aefc6e989d0 tempest-HypervisorAdminNegativeUnderV252Test-1652529552 tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project] Request method failure captured: Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hypervisors/n-h2-820368-35/search HTTP/1.1 Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLQMo6HZZhKviJX1-0Kdm8O0zQ7X1XUcMW4iwzz4F44uPxRw6PccF-9oUZW57gC4BcyxSMCGTm697FegonZLMMvPTb6kE_RdzfTHm8k1qen3VW26O8nkYRUgd507Qy4PbNeJ0hm4pUZyfb_V7yXqwtD3JzE2DQtq8T0-RTS4eLurNo Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 6dd7092e24504323b18a2a0423249c0e Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1652529552 Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:51:30.367168 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6dd7092e24504323b18a2a0423249c0e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6dd7092e24504323b18a2a0423249c0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6dd7092e24504323b18a2a0423249c0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6dd7092e24504323b18a2a0423249c0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1652529552 Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 6dd7092e24504323b18a2a0423249c0e Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1652529552 Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 51ef15416cd34fab97e7cfc2e1748563 Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 04:51:30.368204 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'n-h2-820368-35'} Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:30.368806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 04:51:30.369743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.373032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a787f686-10cb-4b04-9fa9-8aefc6e989d0 tempest-HypervisorAdminNegativeUnderV252Test-1652529552 tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:30.373032 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a787f686-10cb-4b04-9fa9-8aefc6e989d0 tempest-HypervisorAdminNegativeUnderV252Test-1652529552 tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h2-820368-35/search" status: 403 len: 117 microversion: 2.1 time: 0.387784 Aug 27 04:51:30.373032 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 13/24] 10.222.0.58 () {58 vars in 1212 bytes} [Sat Aug 27 04:51:29 2022] GET /compute/v2.1/os-hypervisors/n-h2-820368-35/search => generated 117 bytes in 389 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:30.386246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db4f0e1a-8b60-47d1-9641-6270245611a3 tempest-FlavorsV255TestJSON-1316469863 tempest-FlavorsV255TestJSON-1316469863-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:30.464448 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db4f0e1a-8b60-47d1-9641-6270245611a3 tempest-FlavorsV255TestJSON-1316469863 tempest-FlavorsV255TestJSON-1316469863-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.093563 Aug 27 04:51:30.464987 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 14/25] 10.222.0.58 () {60 vars in 1187 bytes} [Sat Aug 27 04:51:30 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:30.475258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc5c1a6a-2d16-432b-8279-da34d4059bf2 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Calling method '.version_select at 0x7fb566435ca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:30.475258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc5c1a6a-2d16-432b-8279-da34d4059bf2 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:30.475258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc5c1a6a-2d16-432b-8279-da34d4059bf2 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:30.475258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc5c1a6a-2d16-432b-8279-da34d4059bf2 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:30.488731 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-dc5c1a6a-2d16-432b-8279-da34d4059bf2 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc5c1a6a-2d16-432b-8279-da34d4059bf2 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Request method failure captured: Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLR966GVWYi_HEcu3iRx4wQYhOABDhSbmIS2lPGweiHuV_iLIwgqWEqbA69Pxc7TE0K4Wqw94ooz_FPM-OZq1eDnd4ttpE1LdT5dvpOeeUKVA4EsPZKqaSeeXCZP9m2nTQSKa2UCjLSUJekRURGLuKyqKMO4-bJii3ue9kLaaDLzSQ Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: f2d4ecf21d6b4758b3bdf4aacf267052 Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-72237651 Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:51:30.491441 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f2d4ecf21d6b4758b3bdf4aacf267052", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f2d4ecf21d6b4758b3bdf4aacf267052"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f2d4ecf21d6b4758b3bdf4aacf267052"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f2d4ecf21d6b4758b3bdf4aacf267052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-72237651 Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: f2d4ecf21d6b4758b3bdf4aacf267052 Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-72237651 Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 8790b5217e1141948bcd519347c31a63 Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 04:51:30.492520 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:30.493109 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:30.494031 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:30.494031 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:30.494031 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:30.494031 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 04:51:30.494031 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.494031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc5c1a6a-2d16-432b-8279-da34d4059bf2 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:30.494031 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dc5c1a6a-2d16-432b-8279-da34d4059bf2 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.026542 Aug 27 04:51:30.494398 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 15/26] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 04:51:30 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:30.506118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2de17229-00f3-47ac-a2bf-4bf0a5576182 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Calling method '.version_select at 0x7fb56638e700>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:30.508629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de17229-00f3-47ac-a2bf-4bf0a5576182 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:30.509396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de17229-00f3-47ac-a2bf-4bf0a5576182 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:30.510201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de17229-00f3-47ac-a2bf-4bf0a5576182 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:30.528365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de17229-00f3-47ac-a2bf-4bf0a5576182 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:30.528896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de17229-00f3-47ac-a2bf-4bf0a5576182 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:30.529305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de17229-00f3-47ac-a2bf-4bf0a5576182 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:30.554377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de17229-00f3-47ac-a2bf-4bf0a5576182 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:30.555149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de17229-00f3-47ac-a2bf-4bf0a5576182 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:30.555595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de17229-00f3-47ac-a2bf-4bf0a5576182 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:30.570278 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2de17229-00f3-47ac-a2bf-4bf0a5576182 tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.069022 Aug 27 04:51:30.571186 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 16/27] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:30.587978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8dc5690e-7b95-426e-80c3-35067ddc4546 tempest-HypervisorAdminNegativeUnderV252Test-1652529552 tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project] Calling method '.version_select at 0x7fb56638e3a0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:30.589824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8dc5690e-7b95-426e-80c3-35067ddc4546 tempest-HypervisorAdminNegativeUnderV252Test-1652529552 tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '51ef15416cd34fab97e7cfc2e1748563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd7092e24504323b18a2a0423249c0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8dc5690e-7b95-426e-80c3-35067ddc4546 tempest-HypervisorAdminNegativeUnderV252Test-1652529552 tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project] Request method failure captured: Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLQMo6HZZhKviJX1-0Kdm8O0zQ7X1XUcMW4iwzz4F44uPxRw6PccF-9oUZW57gC4BcyxSMCGTm697FegonZLMMvPTb6kE_RdzfTHm8k1qen3VW26O8nkYRUgd507Qy4PbNeJ0hm4pUZyfb_V7yXqwtD3JzE2DQtq8T0-RTS4eLurNo Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 6dd7092e24504323b18a2a0423249c0e Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1652529552 Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:51:30.591658 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6dd7092e24504323b18a2a0423249c0e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6dd7092e24504323b18a2a0423249c0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6dd7092e24504323b18a2a0423249c0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6dd7092e24504323b18a2a0423249c0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1652529552 Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 6dd7092e24504323b18a2a0423249c0e Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1652529552 Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 51ef15416cd34fab97e7cfc2e1748563 Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 04:51:30.592977 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '1'} Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:30.593718 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 04:51:30.594823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.597010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8dc5690e-7b95-426e-80c3-35067ddc4546 tempest-HypervisorAdminNegativeUnderV252Test-1652529552 tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:30.598568 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8dc5690e-7b95-426e-80c3-35067ddc4546 tempest-HypervisorAdminNegativeUnderV252Test-1652529552 tempest-HypervisorAdminNegativeUnderV252Test-1652529552-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.016422 Aug 27 04:51:30.599670 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 17/28] 10.222.0.58 () {58 vars in 1176 bytes} [Sat Aug 27 04:51:30 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:30.609524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e29d95d5-5f9b-4c41-99ec-6c07f502875d tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Calling method '.version_select at 0x7fb56633d280>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:30.611852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e29d95d5-5f9b-4c41-99ec-6c07f502875d tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:30.612773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e29d95d5-5f9b-4c41-99ec-6c07f502875d tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:30.613594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e29d95d5-5f9b-4c41-99ec-6c07f502875d tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:30.622943 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e29d95d5-5f9b-4c41-99ec-6c07f502875d tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] HTTP exception thrown: No hypervisor matching 'c8d26e1f-845c-4aa9-87c1-41b276c58b1b' could be found. Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e29d95d5-5f9b-4c41-99ec-6c07f502875d tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Request method failure captured: Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hypervisors/c8d26e1f-845c-4aa9-87c1-41b276c58b1b/servers HTTP/1.1 Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLR966GVWYi_HEcu3iRx4wQYhOABDhSbmIS2lPGweiHuV_iLIwgqWEqbA69Pxc7TE0K4Wqw94ooz_FPM-OZq1eDnd4ttpE1LdT5dvpOeeUKVA4EsPZKqaSeeXCZP9m2nTQSKa2UCjLSUJekRURGLuKyqKMO4-bJii3ue9kLaaDLzSQ Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: f2d4ecf21d6b4758b3bdf4aacf267052 Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-72237651 Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:51:30.624536 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f2d4ecf21d6b4758b3bdf4aacf267052", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f2d4ecf21d6b4758b3bdf4aacf267052"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f2d4ecf21d6b4758b3bdf4aacf267052"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f2d4ecf21d6b4758b3bdf4aacf267052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-72237651 Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: f2d4ecf21d6b4758b3bdf4aacf267052 Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-72237651 Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 8790b5217e1141948bcd519347c31a63 Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: exception: No hypervisor matching 'c8d26e1f-845c-4aa9-87c1-41b276c58b1b' could be found. Aug 27 04:51:30.625662 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'c8d26e1f-845c-4aa9-87c1-41b276c58b1b'} Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'c8d26e1f-845c-4aa9-87c1-41b276c58b1b' could be found. Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.626246 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:30.627532 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:30.627532 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:30.627532 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:30.627532 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:30.627532 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'c8d26e1f-845c-4aa9-87c1-41b276c58b1b' could be found. Aug 27 04:51:30.627532 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:30.628770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e29d95d5-5f9b-4c41-99ec-6c07f502875d tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] Returning 404 to user: No hypervisor matching 'c8d26e1f-845c-4aa9-87c1-41b276c58b1b' could be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:30.630831 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e29d95d5-5f9b-4c41-99ec-6c07f502875d tempest-HypervisorAdminNegativeUnderV252Test-72237651 tempest-HypervisorAdminNegativeUnderV252Test-72237651-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/c8d26e1f-845c-4aa9-87c1-41b276c58b1b/servers" status: 404 len: 123 microversion: 2.1 time: 0.025624 Aug 27 04:51:30.635304 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 18/29] 10.222.0.58 () {58 vars in 1281 bytes} [Sat Aug 27 04:51:30 2022] GET /compute/v2.1/os-hypervisors/c8d26e1f-845c-4aa9-87c1-41b276c58b1b/servers => generated 123 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:30.685121 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e8fc513-4cf3-433f-8e74-a85cee9880d5 tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 0.970617 Aug 27 04:51:30.685722 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 12/30] 10.222.0.58 () {62 vars in 1232 bytes} [Sat Aug 27 04:51:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:51:30.706473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0495a82-deeb-4de5-b7de-79cfdc807e4a tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-820368-35"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:30.728150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0495a82-deeb-4de5-b7de-79cfdc807e4a tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:30.728805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0495a82-deeb-4de5-b7de-79cfdc807e4a tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:30.729262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0495a82-deeb-4de5-b7de-79cfdc807e4a tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:32.195751 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e0495a82-deeb-4de5-b7de-79cfdc807e4a tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 1.499955 Aug 27 04:51:32.198858 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 19/31] 10.222.0.58 () {62 vars in 1232 bytes} [Sat Aug 27 04:51:30 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:51:32.213995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ba0566fa-eae4-4958-8037-fb78c92b2b71 tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:32.248502 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ba0566fa-eae4-4958-8037-fb78c92b2b71 tempest-AggregatesAdminTestV241-1564185533 tempest-AggregatesAdminTestV241-1564185533-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.042264 Aug 27 04:51:32.249829 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 13/32] 10.222.0.58 () {60 vars in 1193 bytes} [Sat Aug 27 04:51:32 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:32.355978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f2c4a8f-b00e-4b2f-ae38-4818e186e567 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2033665212", "name": "tempest-test_aggregate-1484835051"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:32.383712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.aggregate [None req-0f2c4a8f-b00e-4b2f-ae38-4818e186e567 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Generated uuid 57e4df4a-8fd0-43a9-aac8-5e4a204709cf for aggregate {{(pid=128547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:51:32.422983 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f2c4a8f-b00e-4b2f-ae38-4818e186e567 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.077698 Aug 27 04:51:32.424145 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 20/33] 10.222.0.58 () {60 vars in 1165 bytes} [Sat Aug 27 04:51:32 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:32.437442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8915913c-a20b-42d8-89a4-5d81db498b0c tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:32.458200 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8915913c-a20b-42d8-89a4-5d81db498b0c tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.025529 Aug 27 04:51:32.459046 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 14/34] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 04:51:32 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:32.474981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-337875f3-7f3e-4771-8c37-275d74915759 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-820368-35"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:32.490843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-337875f3-7f3e-4771-8c37-275d74915759 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:32.493059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-337875f3-7f3e-4771-8c37-275d74915759 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:32.493660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-337875f3-7f3e-4771-8c37-275d74915759 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:32.714292 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-337875f3-7f3e-4771-8c37-275d74915759 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 316 microversion: 2.1 time: 0.244461 Aug 27 04:51:32.728223 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 21/35] 10.222.0.58 () {60 vars in 1191 bytes} [Sat Aug 27 04:51:32 2022] POST /compute/v2.1/os-aggregates/2/action => generated 316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:33.564704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1566685035", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "availability_zone": "tempest-test_az-2033665212"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:33.593428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:33.594216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:33.594779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:33.595692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:33.596408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:33.596969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:34.618971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:51:35.107538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:51:35.107961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:51:35.108433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:51:35.109060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:51:35.109651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:51:35.124924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:35.125924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:35.126558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:35.127520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:35.128176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:35.128660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:35.165812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Getting quotas for project a3022e36374f4afb9675d52829bdae29. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:51:35.173925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Getting quotas for user 267f37b81d5c47b9adc31fc11f9b74d8 and project a3022e36374f4afb9675d52829bdae29. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:51:35.188128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:51:35.192376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:51:35.250234 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b59db655-2145-4b23-8d05-92daaa2ac7ac tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.137423 Aug 27 04:51:35.251046 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 15/36] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:51:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:51:35.267200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb5ee8b7-8461-47e6-a319-0773ff775365 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:35.269894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb5ee8b7-8461-47e6-a319-0773ff775365 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:36.465780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb5ee8b7-8461-47e6-a319-0773ff775365 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:36.487216 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb5ee8b7-8461-47e6-a319-0773ff775365 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1243 microversion: 2.1 time: 1.224453 Aug 27 04:51:36.487216 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 22/37] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:35 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1243 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:37.509600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b5e4c59-3564-4ab3-9320-7b6574e83395 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:37.510332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b5e4c59-3564-4ab3-9320-7b6574e83395 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:37.534195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b5e4c59-3564-4ab3-9320-7b6574e83395 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:37.536401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b5e4c59-3564-4ab3-9320-7b6574e83395 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:37.537443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b5e4c59-3564-4ab3-9320-7b6574e83395 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:37.538489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b5e4c59-3564-4ab3-9320-7b6574e83395 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:37.540287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b5e4c59-3564-4ab3-9320-7b6574e83395 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:37.542348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b5e4c59-3564-4ab3-9320-7b6574e83395 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:37.758089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4b5e4c59-3564-4ab3-9320-7b6574e83395 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:37.776981 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b5e4c59-3564-4ab3-9320-7b6574e83395 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1309 microversion: 2.1 time: 0.272468 Aug 27 04:51:37.778209 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 16/38] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:37 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:38.747813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b1fd0608-5161-4c3c-8610-ec522bb681fa tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Calling method '.version_select at 0x7fb56638ea60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:38.749622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b1fd0608-5161-4c3c-8610-ec522bb681fa tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'feb62e323733444e9bf4586fc3de569a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe27e509f81b4a16b62d3cee89635ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b1fd0608-5161-4c3c-8610-ec522bb681fa tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Request method failure captured: Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLXU0z-ccGnmd7JLMuwqcLtfUOsgxMGQliz--sAzPptNZdJjzWxIl0-I3SGi1qKIrndPe4Z1nfoGWIDl-5Wr2Wixa-s-60Y_GvI5pyolK8IY7J8c2laddFNJvZb8PGzUrgZgYucM4aKfSB3RYQbJb4KbTj_KpQhO56PeQmz0h3euog Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: fe27e509f81b4a16b62d3cee89635ea8 Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:51:38.751352 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe27e509f81b4a16b62d3cee89635ea8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: fe27e509f81b4a16b62d3cee89635ea8 Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HypervisorAdminNegativeTestJSON-2035658850-project Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: feb62e323733444e9bf4586fc3de569a Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850-project Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: action_args: {} Aug 27 04:51:38.752466 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:38.753214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 04:51:38.755016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:38.758177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b1fd0608-5161-4c3c-8610-ec522bb681fa tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:38.758177 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b1fd0608-5161-4c3c-8610-ec522bb681fa tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.666141 Aug 27 04:51:38.758177 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 23/39] 10.222.0.58 () {58 vars in 1167 bytes} [Sat Aug 27 04:51:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 667 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:38.764104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6fb2deb9-13dd-4bf3-b6b7-62b893c28592 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Calling method '.version_select at 0x7fb566213d30>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:38.765624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6fb2deb9-13dd-4bf3-b6b7-62b893c28592 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'feb62e323733444e9bf4586fc3de569a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe27e509f81b4a16b62d3cee89635ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6fb2deb9-13dd-4bf3-b6b7-62b893c28592 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Request method failure captured: Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLXU0z-ccGnmd7JLMuwqcLtfUOsgxMGQliz--sAzPptNZdJjzWxIl0-I3SGi1qKIrndPe4Z1nfoGWIDl-5Wr2Wixa-s-60Y_GvI5pyolK8IY7J8c2laddFNJvZb8PGzUrgZgYucM4aKfSB3RYQbJb4KbTj_KpQhO56PeQmz0h3euog Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: fe27e509f81b4a16b62d3cee89635ea8 Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:51:38.767693 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe27e509f81b4a16b62d3cee89635ea8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: fe27e509f81b4a16b62d3cee89635ea8 Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-HypervisorAdminNegativeTestJSON-2035658850-project Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: feb62e323733444e9bf4586fc3de569a Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850-project Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: action_args: {} Aug 27 04:51:38.770988 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:38.772958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 04:51:38.776928 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:38.780275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6fb2deb9-13dd-4bf3-b6b7-62b893c28592 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:38.780275 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6fb2deb9-13dd-4bf3-b6b7-62b893c28592 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009136 Aug 27 04:51:38.783308 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 17/40] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:38 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:38.795261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1a6d0012-9940-44bd-9be1-6355fb989f01 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Calling method '.version_select at 0x7fb5662ce550>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:38.798281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1a6d0012-9940-44bd-9be1-6355fb989f01 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'feb62e323733444e9bf4586fc3de569a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe27e509f81b4a16b62d3cee89635ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1a6d0012-9940-44bd-9be1-6355fb989f01 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Request method failure captured: Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLXU0z-ccGnmd7JLMuwqcLtfUOsgxMGQliz--sAzPptNZdJjzWxIl0-I3SGi1qKIrndPe4Z1nfoGWIDl-5Wr2Wixa-s-60Y_GvI5pyolK8IY7J8c2laddFNJvZb8PGzUrgZgYucM4aKfSB3RYQbJb4KbTj_KpQhO56PeQmz0h3euog Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: fe27e509f81b4a16b62d3cee89635ea8 Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:51:38.800642 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe27e509f81b4a16b62d3cee89635ea8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: fe27e509f81b4a16b62d3cee89635ea8 Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HypervisorAdminNegativeTestJSON-2035658850-project Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: feb62e323733444e9bf4586fc3de569a Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850-project Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: action_args: {} Aug 27 04:51:38.802588 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:38.803290 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 04:51:38.804189 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:38.804987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1a6d0012-9940-44bd-9be1-6355fb989f01 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:38.806900 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1a6d0012-9940-44bd-9be1-6355fb989f01 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.020649 Aug 27 04:51:38.807400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ca0483b-953b-4d7a-90bf-45f993deff2a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:38.808145 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 24/41] 10.222.0.58 () {58 vars in 1179 bytes} [Sat Aug 27 04:51:38 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:51:38.809224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5ca0483b-953b-4d7a-90bf-45f993deff2a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:38.822570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca0483b-953b-4d7a-90bf-45f993deff2a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:38.823530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca0483b-953b-4d7a-90bf-45f993deff2a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:38.833104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca0483b-953b-4d7a-90bf-45f993deff2a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:38.834673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca0483b-953b-4d7a-90bf-45f993deff2a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:38.836482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca0483b-953b-4d7a-90bf-45f993deff2a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:38.838574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca0483b-953b-4d7a-90bf-45f993deff2a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:39.094165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5ca0483b-953b-4d7a-90bf-45f993deff2a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:39.104167 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5ca0483b-953b-4d7a-90bf-45f993deff2a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.310336 Aug 27 04:51:39.105061 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 18/42] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:38 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:39.211450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:39.748114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d0b00d2-03d6-4654-a400-c2af9966acef tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Calling method '.version_select at 0x7fb5663039d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:39.750888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d0b00d2-03d6-4654-a400-c2af9966acef tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:39.751718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d0b00d2-03d6-4654-a400-c2af9966acef tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:39.752829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d0b00d2-03d6-4654-a400-c2af9966acef tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:39.783108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d0b00d2-03d6-4654-a400-c2af9966acef tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:39.785991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d0b00d2-03d6-4654-a400-c2af9966acef tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:39.786510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d0b00d2-03d6-4654-a400-c2af9966acef tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:39.813726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d0b00d2-03d6-4654-a400-c2af9966acef tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:39.816333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d0b00d2-03d6-4654-a400-c2af9966acef tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:39.817023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d0b00d2-03d6-4654-a400-c2af9966acef tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:39.830294 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d0b00d2-03d6-4654-a400-c2af9966acef tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.004305 Aug 27 04:51:39.832598 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 25/43] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:39.846577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5aef32ec-fb8b-4592-aec1-7a140a80b8c1 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Calling method '.version_select at 0x7fb5662df040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:39.856323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5aef32ec-fb8b-4592-aec1-7a140a80b8c1 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'feb62e323733444e9bf4586fc3de569a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe27e509f81b4a16b62d3cee89635ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5aef32ec-fb8b-4592-aec1-7a140a80b8c1 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Request method failure captured: Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLXU0z-ccGnmd7JLMuwqcLtfUOsgxMGQliz--sAzPptNZdJjzWxIl0-I3SGi1qKIrndPe4Z1nfoGWIDl-5Wr2Wixa-s-60Y_GvI5pyolK8IY7J8c2laddFNJvZb8PGzUrgZgYucM4aKfSB3RYQbJb4KbTj_KpQhO56PeQmz0h3euog Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: fe27e509f81b4a16b62d3cee89635ea8 Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:51:39.864794 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe27e509f81b4a16b62d3cee89635ea8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: fe27e509f81b4a16b62d3cee89635ea8 Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HypervisorAdminNegativeTestJSON-2035658850-project Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: feb62e323733444e9bf4586fc3de569a Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850-project Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '1'} Aug 27 04:51:39.866411 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:39.867712 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 04:51:39.869119 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.871915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5aef32ec-fb8b-4592-aec1-7a140a80b8c1 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:39.873567 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5aef32ec-fb8b-4592-aec1-7a140a80b8c1 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.032417 Aug 27 04:51:39.874584 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 26/44] 10.222.0.58 () {58 vars in 1173 bytes} [Sat Aug 27 04:51:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:39.910910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b7e8b94-e255-4cbe-af4c-a8178ee306df tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Calling method '.version_select at 0x7fb566cb8dc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:39.916787 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-9b7e8b94-e255-4cbe-af4c-a8178ee306df tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] HTTP exception thrown: Hypervisor with ID '705d3ab3-e21b-4c3b-a11a-711c1f048c58' could not be found. Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b7e8b94-e255-4cbe-af4c-a8178ee306df tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Request method failure captured: Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hypervisors/705d3ab3-e21b-4c3b-a11a-711c1f048c58/uptime HTTP/1.1 Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLZFZYsUPOTfp73L_8j-6-AZctRdYUngOwIMxqh7dNdlQBfWhXBvp4kDU4wP0sJ2hVmLgyGjSLlThkqqoin6Z--CiBbKkvF6eRJKzRRhycVQjmSKWDn7qsRqyiVVR247mP6-nkKfKgHYK_Mf921wo2nKWfT_MpJ8oTQq7eqPjdgKq8 Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: be371329ea774c89a0f30e0e834d23f9 Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-699998805 Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:51:39.927115 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be371329ea774c89a0f30e0e834d23f9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be371329ea774c89a0f30e0e834d23f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be371329ea774c89a0f30e0e834d23f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be371329ea774c89a0f30e0e834d23f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-699998805 Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: be371329ea774c89a0f30e0e834d23f9 Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-699998805 Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: fc02026e65f64256bb1eb0892b4617de Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: exception: Hypervisor with ID '705d3ab3-e21b-4c3b-a11a-711c1f048c58' could not be found. Aug 27 04:51:39.928617 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '705d3ab3-e21b-4c3b-a11a-711c1f048c58'} Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '705d3ab3-e21b-4c3b-a11a-711c1f048c58' Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 04:51:39.929589 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '705d3ab3-e21b-4c3b-a11a-711c1f048c58' could not be found. Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:39.931371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.932845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:39.932845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:39.932845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:39.932845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:39.932845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:39.932845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '705d3ab3-e21b-4c3b-a11a-711c1f048c58' could not be found. Aug 27 04:51:39.932845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:39.937023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b7e8b94-e255-4cbe-af4c-a8178ee306df tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Returning 404 to user: Hypervisor with ID '705d3ab3-e21b-4c3b-a11a-711c1f048c58' could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:39.939994 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9b7e8b94-e255-4cbe-af4c-a8178ee306df tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/705d3ab3-e21b-4c3b-a11a-711c1f048c58/uptime" status: 404 len: 123 microversion: 2.1 time: 0.047617 Aug 27 04:51:39.944746 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 27/45] 10.222.0.58 () {58 vars in 1278 bytes} [Sat Aug 27 04:51:39 2022] GET /compute/v2.1/os-hypervisors/705d3ab3-e21b-4c3b-a11a-711c1f048c58/uptime => generated 123 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:40.186738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab791825-7807-471c-bc6c-d7d3051cd946 tempest-InstanceUsageAuditLogTestJSON-1930327998 tempest-InstanceUsageAuditLogTestJSON-1930327998-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:40.257627 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ab791825-7807-471c-bc6c-d7d3051cd946 tempest-InstanceUsageAuditLogTestJSON-1930327998 tempest-InstanceUsageAuditLogTestJSON-1930327998-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 04:51:39" status: 200 len: 318 microversion: 2.1 time: 0.720434 Aug 27 04:51:40.259278 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 19/46] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 04:51:39 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2004%3A51%3A39 => generated 318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:40.280955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e46e5b1b-d912-42bd-820a-b2424642e372 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Calling method '.version_select at 0x7fb566213d30>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:40.288140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e46e5b1b-d912-42bd-820a-b2424642e372 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:40.289138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e46e5b1b-d912-42bd-820a-b2424642e372 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:40.292391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e46e5b1b-d912-42bd-820a-b2424642e372 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:40.315878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e46e5b1b-d912-42bd-820a-b2424642e372 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:40.323978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e46e5b1b-d912-42bd-820a-b2424642e372 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:40.325513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e46e5b1b-d912-42bd-820a-b2424642e372 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:40.331344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-42ee7f5b-a919-4147-b6dc-f7bc6b41cc51 tempest-QuotaClassesAdminTestJSON-1220483941 tempest-QuotaClassesAdminTestJSON-1220483941-project-admin] Calling method '.version_select at 0x7fb5662bdee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:40.355531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e46e5b1b-d912-42bd-820a-b2424642e372 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:40.356795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e46e5b1b-d912-42bd-820a-b2424642e372 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:40.359054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e46e5b1b-d912-42bd-820a-b2424642e372 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:40.376502 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e46e5b1b-d912-42bd-820a-b2424642e372 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.105160 Aug 27 04:51:40.379029 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 20/47] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:40.391406 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-42ee7f5b-a919-4147-b6dc-f7bc6b41cc51 tempest-QuotaClassesAdminTestJSON-1220483941 tempest-QuotaClassesAdminTestJSON-1220483941-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.427843 Aug 27 04:51:40.392164 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 28/48] 10.222.0.58 () {58 vars in 1185 bytes} [Sat Aug 27 04:51:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:40.404305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8cbad590-68da-4a1f-94df-89c0b4cdc167 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:40.404805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8cbad590-68da-4a1f-94df-89c0b4cdc167 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:40.429138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cbad590-68da-4a1f-94df-89c0b4cdc167 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:40.431494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cbad590-68da-4a1f-94df-89c0b4cdc167 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:40.432214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cbad590-68da-4a1f-94df-89c0b4cdc167 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:40.434069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cbad590-68da-4a1f-94df-89c0b4cdc167 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:40.434546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cbad590-68da-4a1f-94df-89c0b4cdc167 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:40.435203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cbad590-68da-4a1f-94df-89c0b4cdc167 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:41.009357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e054db4d-7c7d-4aef-a7c9-a0c577783ec4 tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087 tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:41.013903 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e054db4d-7c7d-4aef-a7c9-a0c577783ec4 tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087 tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e054db4d-7c7d-4aef-a7c9-a0c577783ec4 tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087 tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087-project-admin] Request method failure captured: Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLc5wJkHyMxQuyubrDHYABFBzNZQK2yOE4OVP_BO0QoRYdk0IK6t3GjJJ0C4KJ70YkX-vMzeE702ElM0tK8Ekfo29-99DNuNongDrApQy0JgIZIn-LV-v5B_rSlAWAyAr3sQ_wLl42bOtsiPpSwllbtYrjzFytm_x7-utSawyOI7u0 Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: dc413609317d4067ab4b6dfc480e2f21 Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087 Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:51:41.024247 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:51:41.025542 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc413609317d4067ab4b6dfc480e2f21", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc413609317d4067ab4b6dfc480e2f21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc413609317d4067ab4b6dfc480e2f21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc413609317d4067ab4b6dfc480e2f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:41.025542 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087 Aug 27 04:51:41.025542 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: dc413609317d4067ab4b6dfc480e2f21 Aug 27 04:51:41.025542 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087 Aug 27 04:51:41.025542 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087-project-admin Aug 27 04:51:41.025542 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:41.025542 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:41.025542 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 249a9b1042c04df9b723200bf5b6fb79 Aug 27 04:51:41.025542 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087-project-admin Aug 27 04:51:41.025542 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:51:41.025542 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid timestamp for date invalid_time Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'invalid_time'} Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:41.026187 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 27 04:51:41.027240 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:41.029256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e054db4d-7c7d-4aef-a7c9-a0c577783ec4 tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087 tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:41.030212 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e054db4d-7c7d-4aef-a7c9-a0c577783ec4 tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087 tempest-InstanceUsageAuditLogNegativeTestJSON-1664391087-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.637025 Aug 27 04:51:41.034914 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 29/49] 10.222.0.58 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:40 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 638 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:41.045263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-67111d74-3472-4216-a61f-3900b3031ff0 tempest-InstanceUsageAuditLogTestJSON-1930327998 tempest-InstanceUsageAuditLogTestJSON-1930327998-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:41.140411 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-67111d74-3472-4216-a61f-3900b3031ff0 tempest-InstanceUsageAuditLogTestJSON-1930327998 tempest-InstanceUsageAuditLogTestJSON-1930327998-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.108441 Aug 27 04:51:41.152778 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 30/50] 10.222.0.58 () {58 vars in 1185 bytes} [Sat Aug 27 04:51:41 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:41.158909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4c073f8e-1e0e-4df3-b3e2-eed49760b875 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Calling method '.version_select at 0x7fb5662a65e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:41.166482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4c073f8e-1e0e-4df3-b3e2-eed49760b875 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'feb62e323733444e9bf4586fc3de569a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe27e509f81b4a16b62d3cee89635ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4c073f8e-1e0e-4df3-b3e2-eed49760b875 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Request method failure captured: Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLXU0z-ccGnmd7JLMuwqcLtfUOsgxMGQliz--sAzPptNZdJjzWxIl0-I3SGi1qKIrndPe4Z1nfoGWIDl-5Wr2Wixa-s-60Y_GvI5pyolK8IY7J8c2laddFNJvZb8PGzUrgZgYucM4aKfSB3RYQbJb4KbTj_KpQhO56PeQmz0h3euog Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: fe27e509f81b4a16b62d3cee89635ea8 Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:51:41.171746 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe27e509f81b4a16b62d3cee89635ea8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe27e509f81b4a16b62d3cee89635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: fe27e509f81b4a16b62d3cee89635ea8 Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850 Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HypervisorAdminNegativeTestJSON-2035658850-project Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: feb62e323733444e9bf4586fc3de569a Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2035658850-project Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '1'} Aug 27 04:51:41.173634 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:41.174533 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 04:51:41.176044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:41.179722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4c073f8e-1e0e-4df3-b3e2-eed49760b875 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:41.180793 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4c073f8e-1e0e-4df3-b3e2-eed49760b875 tempest-HypervisorAdminNegativeTestJSON-2035658850 tempest-HypervisorAdminNegativeTestJSON-2035658850-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.026577 Aug 27 04:51:41.181523 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 31/51] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:51:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:41.190211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6cb1492f-3438-453d-b7b4-d064b49e3822 tempest-QuotaClassesAdminTestJSON-1220483941 tempest-QuotaClassesAdminTestJSON-1220483941-project-admin] Action: 'update', calling method: .version_select at 0x7fb5662df430>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:41.204307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:41.330695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8cbad590-68da-4a1f-94df-89c0b4cdc167 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:41.355125 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8cbad590-68da-4a1f-94df-89c0b4cdc167 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.972592 Aug 27 04:51:41.374839 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 21/52] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:40 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:41.692927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aee58e29-1a43-49b2-b673-5debfe91ac6c tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-725588248", "id": 1422158526, "os-flavor-access:is_public": "False"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:41.754926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aee58e29-1a43-49b2-b673-5debfe91ac6c tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.377159 Aug 27 04:51:41.756232 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 22/53] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:51:41 2022] POST /compute/v2.1/flavors => generated 438 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:41.980276 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6cb1492f-3438-453d-b7b4-d064b49e3822 tempest-QuotaClassesAdminTestJSON-1220483941 tempest-QuotaClassesAdminTestJSON-1220483941-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.796818 Aug 27 04:51:41.983167 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 32/54] 10.222.0.58 () {60 vars in 1206 bytes} [Sat Aug 27 04:51:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:41.988299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd31fc1a-ec55-499a-92ed-ce69fd1a99f1 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Calling method '.version_select at 0x7fb5662a6ee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:42.002568 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-cd31fc1a-ec55-499a-92ed-ce69fd1a99f1 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] HTTP exception thrown: Hypervisor with ID '47b44d25-a54c-4f06-bbaf-04773b547f97' could not be found. Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd31fc1a-ec55-499a-92ed-ce69fd1a99f1 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Request method failure captured: Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hypervisors/47b44d25-a54c-4f06-bbaf-04773b547f97 HTTP/1.1 Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLZFZYsUPOTfp73L_8j-6-AZctRdYUngOwIMxqh7dNdlQBfWhXBvp4kDU4wP0sJ2hVmLgyGjSLlThkqqoin6Z--CiBbKkvF6eRJKzRRhycVQjmSKWDn7qsRqyiVVR247mP6-nkKfKgHYK_Mf921wo2nKWfT_MpJ8oTQq7eqPjdgKq8 Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: be371329ea774c89a0f30e0e834d23f9 Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-699998805 Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:51:42.008692 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be371329ea774c89a0f30e0e834d23f9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be371329ea774c89a0f30e0e834d23f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be371329ea774c89a0f30e0e834d23f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be371329ea774c89a0f30e0e834d23f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-699998805 Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: be371329ea774c89a0f30e0e834d23f9 Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-699998805 Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: fc02026e65f64256bb1eb0892b4617de Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: exception: Hypervisor with ID '47b44d25-a54c-4f06-bbaf-04773b547f97' could not be found. Aug 27 04:51:42.010719 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '47b44d25-a54c-4f06-bbaf-04773b547f97'} Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '47b44d25-a54c-4f06-bbaf-04773b547f97' Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 04:51:42.011549 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:51:42.012991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '47b44d25-a54c-4f06-bbaf-04773b547f97' could not be found. Aug 27 04:51:42.016020 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.016020 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:42.016020 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.016020 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:42.016020 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:42.016020 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:42.016020 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:42.016020 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:42.016020 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '47b44d25-a54c-4f06-bbaf-04773b547f97' could not be found. Aug 27 04:51:42.016020 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.032874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd31fc1a-ec55-499a-92ed-ce69fd1a99f1 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] Returning 404 to user: Hypervisor with ID '47b44d25-a54c-4f06-bbaf-04773b547f97' could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:42.034185 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cd31fc1a-ec55-499a-92ed-ce69fd1a99f1 tempest-HypervisorAdminNegativeTestJSON-699998805 tempest-HypervisorAdminNegativeTestJSON-699998805-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/47b44d25-a54c-4f06-bbaf-04773b547f97" status: 404 len: 123 microversion: 2.1 time: 0.049796 Aug 27 04:51:42.040563 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 33/55] 10.222.0.58 () {58 vars in 1257 bytes} [Sat Aug 27 04:51:41 2022] GET /compute/v2.1/os-hypervisors/47b44d25-a54c-4f06-bbaf-04773b547f97 => generated 123 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:42.055929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a379859b-5ad6-4bc7-85be-b3c21e7c7972 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b2a78be0fc84481cb5878df33b78a41f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:42.359706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01e1a0b1-1acd-45e5-96e0-78fc4ef2547b tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:42.362120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-01e1a0b1-1acd-45e5-96e0-78fc4ef2547b tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '8f364b3a0dc24f7dbf51fa9da8ee529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c4517ec9994290b9ff8fc7210a5f19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01e1a0b1-1acd-45e5-96e0-78fc4ef2547b tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project] Request method failure captured: Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLY_MpoGwEiZBIxcORAA9oaEyPyundkuZGvyvmNdhljWdpPj250PVfnOBgOP8yJry0thZzT9HK--ChjibA9OMnpjs_9rlFb1XF6gg5bjQ2_I7R6vuuf8H8ajmESoCKGnLSwz1BOqzh8QTRoFo-HavAvFoFpcKA5d30yBHKHkvODVGQ Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 30c4517ec9994290b9ff8fc7210a5f19 Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:51:42.365121 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:51:42.366485 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_30c4517ec9994290b9ff8fc7210a5f19", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/30c4517ec9994290b9ff8fc7210a5f19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/30c4517ec9994290b9ff8fc7210a5f19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/30c4517ec9994290b9ff8fc7210a5f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:42.366485 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 Aug 27 04:51:42.366485 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 30c4517ec9994290b9ff8fc7210a5f19 Aug 27 04:51:42.366485 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 Aug 27 04:51:42.366485 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project Aug 27 04:51:42.366485 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:51:42.366485 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:51:42.366485 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 8f364b3a0dc24f7dbf51fa9da8ee529c Aug 27 04:51:42.366485 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project Aug 27 04:51:42.366485 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: action_args: {} Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:42.367212 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 04:51:42.368629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:42.375605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01e1a0b1-1acd-45e5-96e0-78fc4ef2547b tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:42.379194 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01e1a0b1-1acd-45e5-96e0-78fc4ef2547b tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.619531 Aug 27 04:51:42.383294 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 23/56] 10.222.0.58 () {58 vars in 1185 bytes} [Sat Aug 27 04:51:41 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 626 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:42.395724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f40cb44d-3468-402a-87c0-f958d649e91b tempest-QuotaClassesAdminTestJSON-1220483941 tempest-QuotaClassesAdminTestJSON-1220483941-project-admin] Calling method '.version_select at 0x7fb5661fb820>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:42.453260 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f40cb44d-3468-402a-87c0-f958d649e91b tempest-QuotaClassesAdminTestJSON-1220483941 tempest-QuotaClassesAdminTestJSON-1220483941-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.064323 Aug 27 04:51:42.464337 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 24/57] 10.222.0.58 () {58 vars in 1185 bytes} [Sat Aug 27 04:51:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:42.476037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bee08cbe-174d-42d8-ba45-7abf72f2624c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:42.476978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bee08cbe-174d-42d8-ba45-7abf72f2624c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:42.490040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee08cbe-174d-42d8-ba45-7abf72f2624c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:42.492443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee08cbe-174d-42d8-ba45-7abf72f2624c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:42.493695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee08cbe-174d-42d8-ba45-7abf72f2624c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:42.499793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee08cbe-174d-42d8-ba45-7abf72f2624c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:42.501766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee08cbe-174d-42d8-ba45-7abf72f2624c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:42.502422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee08cbe-174d-42d8-ba45-7abf72f2624c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:43.087995 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a379859b-5ad6-4bc7-85be-b3c21e7c7972 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1422158526/action" status: 200 len: 97 microversion: 2.1 time: 1.045695 Aug 27 04:51:43.095285 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 34/58] 10.222.0.58 () {60 vars in 1200 bytes} [Sat Aug 27 04:51:42 2022] POST /compute/v2.1/flavors/1422158526/action => generated 97 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:51:43.112514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc4b0a49-0989-4f8a-a9a3-dabdba04ddde tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:43.125780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dc4b0a49-0989-4f8a-a9a3-dabdba04ddde tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '8f364b3a0dc24f7dbf51fa9da8ee529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c4517ec9994290b9ff8fc7210a5f19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc4b0a49-0989-4f8a-a9a3-dabdba04ddde tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project] Request method failure captured: Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2004:51:42 HTTP/1.1 Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLY_MpoGwEiZBIxcORAA9oaEyPyundkuZGvyvmNdhljWdpPj250PVfnOBgOP8yJry0thZzT9HK--ChjibA9OMnpjs_9rlFb1XF6gg5bjQ2_I7R6vuuf8H8ajmESoCKGnLSwz1BOqzh8QTRoFo-HavAvFoFpcKA5d30yBHKHkvODVGQ Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 30c4517ec9994290b9ff8fc7210a5f19 Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:51:43.133181 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:51:43.135071 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_30c4517ec9994290b9ff8fc7210a5f19", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/30c4517ec9994290b9ff8fc7210a5f19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/30c4517ec9994290b9ff8fc7210a5f19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/30c4517ec9994290b9ff8fc7210a5f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:43.135071 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 Aug 27 04:51:43.135071 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 30c4517ec9994290b9ff8fc7210a5f19 Aug 27 04:51:43.135071 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 Aug 27 04:51:43.135071 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project Aug 27 04:51:43.135071 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:43.135071 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:43.135071 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 8f364b3a0dc24f7dbf51fa9da8ee529c Aug 27 04:51:43.135071 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project Aug 27 04:51:43.135071 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '2022-08-27 04:51:42'} Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:43.135707 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 04:51:43.136945 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:43.141001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc4b0a49-0989-4f8a-a9a3-dabdba04ddde tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:43.143021 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dc4b0a49-0989-4f8a-a9a3-dabdba04ddde tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364 tempest-InstanceUsageAuditLogNegativeTestJSON-1276120364-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 04:51:42" status: 403 len: 128 microversion: 2.1 time: 0.044674 Aug 27 04:51:43.151380 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 35/59] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 04:51:43 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2004%3A51%3A42 => generated 128 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:43.157538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fb2dc5d1-9b96-499a-be63-61237337212b tempest-QuotaClassesAdminTestJSON-1220483941 tempest-QuotaClassesAdminTestJSON-1220483941-project-admin] Action: 'update', calling method: .version_select at 0x7fb566258b80>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:43.325387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bee08cbe-174d-42d8-ba45-7abf72f2624c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:43.338244 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bee08cbe-174d-42d8-ba45-7abf72f2624c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.872220 Aug 27 04:51:43.339750 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 25/60] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:42 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:43.404718 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fb2dc5d1-9b96-499a-be63-61237337212b tempest-QuotaClassesAdminTestJSON-1220483941 tempest-QuotaClassesAdminTestJSON-1220483941-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.250966 Aug 27 04:51:43.406292 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 36/61] 10.222.0.58 () {60 vars in 1206 bytes} [Sat Aug 27 04:51:43 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:43.413240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9e66c78a-3214-489b-8337-c68b920084f8 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b2a78be0fc84481cb5878df33b78a41f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:43.504269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-af9250ff-3e2a-4faf-b633-f3d4b42f0856 req-cc0606c7-f724-471b-893d-c5dee040732d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2655c565-885b-4871-bdef-e28e07fb44aa", "tag": "9d9cd12c-5570-4b60-8cfb-e7a05c1d10f2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:43.542155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-af9250ff-3e2a-4faf-b633-f3d4b42f0856 req-cc0606c7-f724-471b-893d-c5dee040732d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:43.543337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-af9250ff-3e2a-4faf-b633-f3d4b42f0856 req-cc0606c7-f724-471b-893d-c5dee040732d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:43.546246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-af9250ff-3e2a-4faf-b633-f3d4b42f0856 req-cc0606c7-f724-471b-893d-c5dee040732d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:43.624207 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-af9250ff-3e2a-4faf-b633-f3d4b42f0856 req-cc0606c7-f724-471b-893d-c5dee040732d service nova] Creating event network-changed:9d9cd12c-5570-4b60-8cfb-e7a05c1d10f2 for instance 2655c565-885b-4871-bdef-e28e07fb44aa on n-h2-820368-35 Aug 27 04:51:43.626290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-af9250ff-3e2a-4faf-b633-f3d4b42f0856 req-cc0606c7-f724-471b-893d-c5dee040732d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:51:43.631896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-af9250ff-3e2a-4faf-b633-f3d4b42f0856 req-cc0606c7-f724-471b-893d-c5dee040732d service nova] Acquired lock "compute-rpcapi-router" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:51:43.634977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2091eb69-d794-4b02-941b-1360ae83fa0d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:43.637407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2091eb69-d794-4b02-941b-1360ae83fa0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:43.637943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2091eb69-d794-4b02-941b-1360ae83fa0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:43.640647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2091eb69-d794-4b02-941b-1360ae83fa0d None None] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:43.641148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2091eb69-d794-4b02-941b-1360ae83fa0d None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:43.641569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2091eb69-d794-4b02-941b-1360ae83fa0d None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:43.676717 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.compute.rpcapi [None req-2091eb69-d794-4b02-941b-1360ae83fa0d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Aug 27 04:51:43.742512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2091eb69-d794-4b02-941b-1360ae83fa0d None None] Releasing lock "compute-rpcapi-router" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:51:43.823122 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2091eb69-d794-4b02-941b-1360ae83fa0d None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.479847 Aug 27 04:51:43.826427 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 26/62] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:44.372595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-20bf0fe1-7994-4bcb-b505-32e7a0ad09af tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:44.373619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-20bf0fe1-7994-4bcb-b505-32e7a0ad09af tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:44.390346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:44.402436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20bf0fe1-7994-4bcb-b505-32e7a0ad09af tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:44.407783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20bf0fe1-7994-4bcb-b505-32e7a0ad09af tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:44.410994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20bf0fe1-7994-4bcb-b505-32e7a0ad09af tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:44.412985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20bf0fe1-7994-4bcb-b505-32e7a0ad09af tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:44.415224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20bf0fe1-7994-4bcb-b505-32e7a0ad09af tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:44.416713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20bf0fe1-7994-4bcb-b505-32e7a0ad09af tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:44.605051 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-9e66c78a-3214-489b-8337-c68b920084f8 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project b2a78be0fc84481cb5878df33b78a41f combination. Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9e66c78a-3214-489b-8337-c68b920084f8 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Request method failure captured: Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/flavors/1422158526/action HTTP/1.1 Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 67 Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLZrYuaHj_sciJZMtmclMmH9ICVecbDEa2X1Y_4ZNSJ0qg1VLRM7V7619hPxhfPCCAORuu3wwiSEGFpj8ASotbbplApoMoUyeixcOeEUwJd3GGy4T69XsNms-EujjXkG9oN1qpr8tscZxF5VJcCl55fQQifB_3n48XTPVO-kcnPoLI Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 8d38266b1c024c0b98bb7f17b24dde59 Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-724689262 Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:51:44.651067 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8d38266b1c024c0b98bb7f17b24dde59", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8d38266b1c024c0b98bb7f17b24dde59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8d38266b1c024c0b98bb7f17b24dde59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8d38266b1c024c0b98bb7f17b24dde59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-724689262 Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 8d38266b1c024c0b98bb7f17b24dde59 Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-724689262 Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 1a08bb703f8e47caaadbb9587ee4a36f Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: {"addTenantAccess": {"tenant": "b2a78be0fc84481cb5878df33b78a41f"}} Aug 27 04:51:44.652460 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: exception: Flavor access already exists for flavor 17 and project b2a78be0fc84481cb5878df33b78a41f combination. Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '1422158526', 'body': {'addTenantAccess': {'tenant': 'b2a78be0fc84481cb5878df33b78a41f'}}} Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result.read() Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:51:44.653262 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-b2a78be0fc84481cb5878df33b78a41f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 04:51:44.654488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 04:51:44.657933 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:51:44.659234 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result.read() Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-b2a78be0fc84481cb5878df33b78a41f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 4, 51, 44, 590133), 'updated_at': None, 'flavor_id': 17, 'project_id': 'b2a78be0fc84481cb5878df33b78a41f'}] Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:44.660611 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project b2a78be0fc84481cb5878df33b78a41f combination. Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:44.661772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project b2a78be0fc84481cb5878df33b78a41f combination. Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:44.664927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:44.667477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project b2a78be0fc84481cb5878df33b78a41f combination. Aug 27 04:51:44.667477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:44.671610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9e66c78a-3214-489b-8337-c68b920084f8 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project b2a78be0fc84481cb5878df33b78a41f combination. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:44.674131 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9e66c78a-3214-489b-8337-c68b920084f8 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1422158526/action" status: 409 len: 152 microversion: 2.1 time: 1.265304 Aug 27 04:51:44.677084 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 37/63] 10.222.0.58 () {60 vars in 1200 bytes} [Sat Aug 27 04:51:43 2022] POST /compute/v2.1/flavors/1422158526/action => generated 152 bytes in 1270 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:51:44.701048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4a9b371f-c634-4abf-af8f-a4151fe6bf51 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b2a78be0fc84481cb5878df33b78a41f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:46.110465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-20bf0fe1-7994-4bcb-b505-32e7a0ad09af tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:46.121119 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-20bf0fe1-7994-4bcb-b505-32e7a0ad09af tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 1.760748 Aug 27 04:51:46.125663 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 27/64] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:44 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:51:46.666253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=14,nova_api:UPDATE=23,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:46.710773 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4a9b371f-c634-4abf-af8f-a4151fe6bf51 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1422158526/action" status: 200 len: 21 microversion: 2.1 time: 2.027546 Aug 27 04:51:46.717509 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 38/65] 10.222.0.58 () {60 vars in 1200 bytes} [Sat Aug 27 04:51:44 2022] POST /compute/v2.1/flavors/1422158526/action => generated 21 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:51:46.743489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-244feaed-4c5c-421d-b5eb-cf9ecd2804cc tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:46.806689 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-244feaed-4c5c-421d-b5eb-cf9ecd2804cc tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1422158526" status: 202 len: 0 microversion: 2.1 time: 0.080653 Aug 27 04:51:46.809043 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 39/66] 10.222.0.58 () {58 vars in 1161 bytes} [Sat Aug 27 04:51:46 2022] DELETE /compute/v2.1/flavors/1422158526 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:51:46.819483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2f0a04c-9747-4665-b4cd-ca1dd92a6620 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:46.885886 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2f0a04c-9747-4665-b4cd-ca1dd92a6620 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062295 Aug 27 04:51:46.886949 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 40/67] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:46.911919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ad903f7-66c2-479f-80c7-50524effca67 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1977939085", "id": 530875576, "os-flavor-access:is_public": "True"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:46.960001 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3ad903f7-66c2-479f-80c7-50524effca67 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.051593 Aug 27 04:51:46.962493 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 41/68] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:51:46 2022] POST /compute/v2.1/flavors => generated 435 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:51:46.989018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0d0c0b85-a75e-4b95-ab3f-f2a402e0dcd3 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:47.012875 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-0d0c0b85-a75e-4b95-ab3f-f2a402e0dcd3 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0d0c0b85-a75e-4b95-ab3f-f2a402e0dcd3 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Request method failure captured: Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/flavors/530875576/os-flavor-access HTTP/1.1 Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLZrYuaHj_sciJZMtmclMmH9ICVecbDEa2X1Y_4ZNSJ0qg1VLRM7V7619hPxhfPCCAORuu3wwiSEGFpj8ASotbbplApoMoUyeixcOeEUwJd3GGy4T69XsNms-EujjXkG9oN1qpr8tscZxF5VJcCl55fQQifB_3n48XTPVO-kcnPoLI Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 8d38266b1c024c0b98bb7f17b24dde59 Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-724689262 Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:51:47.021373 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8d38266b1c024c0b98bb7f17b24dde59", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8d38266b1c024c0b98bb7f17b24dde59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8d38266b1c024c0b98bb7f17b24dde59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8d38266b1c024c0b98bb7f17b24dde59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-724689262 Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 8d38266b1c024c0b98bb7f17b24dde59 Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-724689262 Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 1a08bb703f8e47caaadbb9587ee4a36f Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: exception: Access list not available for public flavors. Aug 27 04:51:47.022906 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'flavor_id': '530875576'} Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 27 04:51:47.023631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:47.027548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0d0c0b85-a75e-4b95-ab3f-f2a402e0dcd3 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:47.028816 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0d0c0b85-a75e-4b95-ab3f-f2a402e0dcd3 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/530875576/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.058110 Aug 27 04:51:47.031544 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 42/69] 10.222.0.58 () {58 vars in 1206 bytes} [Sat Aug 27 04:51:46 2022] GET /compute/v2.1/flavors/530875576/os-flavor-access => generated 91 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:51:47.048448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46b3fd97-8b5e-4d8f-baa4-64b52203a8bd tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:47.094887 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-46b3fd97-8b5e-4d8f-baa4-64b52203a8bd tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/530875576" status: 202 len: 0 microversion: 2.1 time: 0.058103 Aug 27 04:51:47.096014 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 43/70] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:51:47 2022] DELETE /compute/v2.1/flavors/530875576 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:51:47.113114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-faed8673-f467-4c60-828c-fddd380474fe tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:47.186952 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-faed8673-f467-4c60-828c-fddd380474fe tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086625 Aug 27 04:51:47.210508 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 44/71] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:47.216507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9e73f242-089d-480f-b832-544749c6fb98 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:47.222893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-63d45c18-985d-4f11-953c-440b06d6e1ac tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Calling method '.version_select at 0x7fb56611eaf0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:47.224444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9e73f242-089d-480f-b832-544749c6fb98 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:47.233291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e73f242-089d-480f-b832-544749c6fb98 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:47.233579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e73f242-089d-480f-b832-544749c6fb98 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:47.233995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e73f242-089d-480f-b832-544749c6fb98 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:47.244144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e73f242-089d-480f-b832-544749c6fb98 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:47.244883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e73f242-089d-480f-b832-544749c6fb98 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:47.245314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e73f242-089d-480f-b832-544749c6fb98 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:47.709881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9e73f242-089d-480f-b832-544749c6fb98 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:47.732283 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9e73f242-089d-480f-b832-544749c6fb98 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.520365 Aug 27 04:51:47.735237 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 45/72] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:47 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:47.746181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b7fff47-10b2-478b-89aa-2d7348c3ab6f tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1599276049", "id": 202162832, "os-flavor-access:is_public": "False"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:47.792578 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b7fff47-10b2-478b-89aa-2d7348c3ab6f tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.056222 Aug 27 04:51:47.793776 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 46/73] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:51:47 2022] POST /compute/v2.1/flavors => generated 436 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:47.945034 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-63d45c18-985d-4f11-953c-440b06d6e1ac tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/9da09e1ac07f49d392b879a06c552a8c" status: 200 len: 371 microversion: 2.1 time: 1.817950 Aug 27 04:51:47.948338 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 28/74] 10.222.0.58 () {58 vars in 1242 bytes} [Sat Aug 27 04:51:46 2022] GET /compute/v2.1/os-quota-sets/9da09e1ac07f49d392b879a06c552a8c => generated 371 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:47.961015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9833aac8-e158-4370-aa7e-11d9fef022e3 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Action: 'update', calling method: .version_select at 0x7fb56618f4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:48.933967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-30aa3748-446b-4665-b616-bad0b108a772 tempest-FlavorsAccessNegativeTestJSON-1222346946 tempest-FlavorsAccessNegativeTestJSON-1222346946-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b2a78be0fc84481cb5878df33b78a41f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:48.942151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-30aa3748-446b-4665-b616-bad0b108a772 tempest-FlavorsAccessNegativeTestJSON-1222346946 tempest-FlavorsAccessNegativeTestJSON-1222346946-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '2884f4ff5271461ba449d02c3710db12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a78be0fc84481cb5878df33b78a41f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-30aa3748-446b-4665-b616-bad0b108a772 tempest-FlavorsAccessNegativeTestJSON-1222346946 tempest-FlavorsAccessNegativeTestJSON-1222346946-project] Request method failure captured: Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/flavors/202162832/action HTTP/1.1 Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 67 Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLXKx_JawiDja7dBOGjfHDaPJqHB-gflJMlkf1QykPVJkJC8kXpY5w7SdGruHiPHUlVV8SjYlsHDI8WgJ93HOUuc9Uv4UYTSJVa6ynG_H-krV7xO6tP3g3rF9TsNz4g9g_rSEkdfiekoVXCPPYtid7tqamW79bHQp6_7I28GfgFhR8 Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: b2a78be0fc84481cb5878df33b78a41f Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1222346946 Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:51:48.944045 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b2a78be0fc84481cb5878df33b78a41f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b2a78be0fc84481cb5878df33b78a41f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2a78be0fc84481cb5878df33b78a41f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2a78be0fc84481cb5878df33b78a41f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1222346946 Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: b2a78be0fc84481cb5878df33b78a41f Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1222346946 Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FlavorsAccessNegativeTestJSON-1222346946-project Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 2884f4ff5271461ba449d02c3710db12 Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1222346946-project Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: {"addTenantAccess": {"tenant": "b2a78be0fc84481cb5878df33b78a41f"}} Aug 27 04:51:48.945444 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '202162832', 'body': {'addTenantAccess': {'tenant': 'b2a78be0fc84481cb5878df33b78a41f'}}} Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:48.946348 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 04:51:48.947635 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:48.948860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-30aa3748-446b-4665-b616-bad0b108a772 tempest-FlavorsAccessNegativeTestJSON-1222346946 tempest-FlavorsAccessNegativeTestJSON-1222346946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:48.954413 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-30aa3748-446b-4665-b616-bad0b108a772 tempest-FlavorsAccessNegativeTestJSON-1222346946 tempest-FlavorsAccessNegativeTestJSON-1222346946-project] 10.222.0.58 "POST /compute/v2.1/flavors/202162832/action" status: 403 len: 130 microversion: 2.1 time: 1.150309 Aug 27 04:51:48.959055 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 47/75] 10.222.0.58 () {60 vars in 1197 bytes} [Sat Aug 27 04:51:47 2022] POST /compute/v2.1/flavors/202162832/action => generated 130 bytes in 1157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:48.966414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-098285e7-4526-4f7f-92e2-668117ee29e5 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:48.967618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-098285e7-4526-4f7f-92e2-668117ee29e5 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:48.983321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-098285e7-4526-4f7f-92e2-668117ee29e5 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:48.984837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-098285e7-4526-4f7f-92e2-668117ee29e5 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:48.985876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-098285e7-4526-4f7f-92e2-668117ee29e5 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:48.988026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-098285e7-4526-4f7f-92e2-668117ee29e5 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:48.989280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-098285e7-4526-4f7f-92e2-668117ee29e5 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:48.989923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-098285e7-4526-4f7f-92e2-668117ee29e5 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:49.706382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9833aac8-e158-4370-aa7e-11d9fef022e3 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:49.708009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9833aac8-e158-4370-aa7e-11d9fef022e3 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:49.708647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9833aac8-e158-4370-aa7e-11d9fef022e3 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:49.709945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9833aac8-e158-4370-aa7e-11d9fef022e3 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:49.710756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9833aac8-e158-4370-aa7e-11d9fef022e3 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:49.711428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9833aac8-e158-4370-aa7e-11d9fef022e3 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:49.821846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-098285e7-4526-4f7f-92e2-668117ee29e5 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:49.841648 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-098285e7-4526-4f7f-92e2-668117ee29e5 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.877862 Aug 27 04:51:49.844286 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 48/76] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:48 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:49.856964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f1ce7037-5baa-4213-a515-9ebffd69bb54 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:49.863372 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9833aac8-e158-4370-aa7e-11d9fef022e3 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/9da09e1ac07f49d392b879a06c552a8c" status: 200 len: 328 microversion: 2.1 time: 1.906793 Aug 27 04:51:49.879513 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 29/77] 10.222.0.58 () {60 vars in 1262 bytes} [Sat Aug 27 04:51:47 2022] PUT /compute/v2.1/os-quota-sets/9da09e1ac07f49d392b879a06c552a8c => generated 328 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:49.886985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9ba881a9-6062-4461-a27b-fe4012725a03 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:49.903212 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9ba881a9-6062-4461-a27b-fe4012725a03 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-quota-sets/9da09e1ac07f49d392b879a06c552a8c" status: 202 len: 0 microversion: 2.1 time: 0.021739 Aug 27 04:51:49.908117 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 30/78] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 04:51:49 2022] DELETE /compute/v2.1/os-quota-sets/9da09e1ac07f49d392b879a06c552a8c => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:51:49.921264 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f1ce7037-5baa-4213-a515-9ebffd69bb54 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/202162832" status: 202 len: 0 microversion: 2.1 time: 0.075626 Aug 27 04:51:49.921977 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 49/79] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:51:49 2022] DELETE /compute/v2.1/flavors/202162832 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:51:49.923870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8550a425-8896-48bb-91e2-1458f1b68e08 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Calling method '.version_select at 0x7fb56611eb80>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:49.939716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-42ff7a79-6655-4e8c-be13-326f4e7f5fab tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:49.977584 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-42ff7a79-6655-4e8c-be13-326f4e7f5fab tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041458 Aug 27 04:51:49.978948 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 50/80] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:50.001993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4cf9327c-56c0-4c47-bcbb-248c302b2feb tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-457782277", "id": 451982608, "os-flavor-access:is_public": "False"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:50.055977 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4cf9327c-56c0-4c47-bcbb-248c302b2feb tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.057866 Aug 27 04:51:50.058556 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 51/81] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:51:49 2022] POST /compute/v2.1/flavors => generated 435 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:50.072936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf6acc45-5172-4633-a777-eaa7550bb638 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b2a78be0fc84481cb5878df33b78a41f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:50.887786 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8550a425-8896-48bb-91e2-1458f1b68e08 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/9da09e1ac07f49d392b879a06c552a8c" status: 200 len: 371 microversion: 2.1 time: 0.976284 Aug 27 04:51:50.889034 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 31/82] 10.222.0.58 () {58 vars in 1242 bytes} [Sat Aug 27 04:51:49 2022] GET /compute/v2.1/os-quota-sets/9da09e1ac07f49d392b879a06c552a8c => generated 371 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:50.901632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6b2eb73c-cb04-4115-8662-52d59e8a7929 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:50.919436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6b2eb73c-cb04-4115-8662-52d59e8a7929 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:50.928696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b2eb73c-cb04-4115-8662-52d59e8a7929 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:50.929199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b2eb73c-cb04-4115-8662-52d59e8a7929 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:50.929640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b2eb73c-cb04-4115-8662-52d59e8a7929 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:50.930339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b2eb73c-cb04-4115-8662-52d59e8a7929 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:50.935905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b2eb73c-cb04-4115-8662-52d59e8a7929 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:50.936710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b2eb73c-cb04-4115-8662-52d59e8a7929 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:51.262543 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf6acc45-5172-4633-a777-eaa7550bb638 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/451982608/action" status: 200 len: 96 microversion: 2.1 time: 1.196088 Aug 27 04:51:51.266563 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 52/83] 10.222.0.58 () {60 vars in 1197 bytes} [Sat Aug 27 04:51:50 2022] POST /compute/v2.1/flavors/451982608/action => generated 96 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:51:51.281168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c346e19e-bd00-4d00-9dfc-f9f94ca2bb44 tempest-FlavorsAccessNegativeTestJSON-1222346946 tempest-FlavorsAccessNegativeTestJSON-1222346946-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b2a78be0fc84481cb5878df33b78a41f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:51.289750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c346e19e-bd00-4d00-9dfc-f9f94ca2bb44 tempest-FlavorsAccessNegativeTestJSON-1222346946 tempest-FlavorsAccessNegativeTestJSON-1222346946-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '2884f4ff5271461ba449d02c3710db12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a78be0fc84481cb5878df33b78a41f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:51.295728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6b2eb73c-cb04-4115-8662-52d59e8a7929 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c346e19e-bd00-4d00-9dfc-f9f94ca2bb44 tempest-FlavorsAccessNegativeTestJSON-1222346946 tempest-FlavorsAccessNegativeTestJSON-1222346946-project] Request method failure captured: Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/flavors/451982608/action HTTP/1.1 Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 70 Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLXKx_JawiDja7dBOGjfHDaPJqHB-gflJMlkf1QykPVJkJC8kXpY5w7SdGruHiPHUlVV8SjYlsHDI8WgJ93HOUuc9Uv4UYTSJVa6ynG_H-krV7xO6tP3g3rF9TsNz4g9g_rSEkdfiekoVXCPPYtid7tqamW79bHQp6_7I28GfgFhR8 Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: b2a78be0fc84481cb5878df33b78a41f Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1222346946 Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:51:51.308742 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b2a78be0fc84481cb5878df33b78a41f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b2a78be0fc84481cb5878df33b78a41f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2a78be0fc84481cb5878df33b78a41f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2a78be0fc84481cb5878df33b78a41f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1222346946 Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: b2a78be0fc84481cb5878df33b78a41f Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1222346946 Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FlavorsAccessNegativeTestJSON-1222346946-project Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 2884f4ff5271461ba449d02c3710db12 Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1222346946-project Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: {"removeTenantAccess": {"tenant": "b2a78be0fc84481cb5878df33b78a41f"}} Aug 27 04:51:51.309999 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '451982608', 'body': {'removeTenantAccess': {'tenant': 'b2a78be0fc84481cb5878df33b78a41f'}}} Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can( Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:51:51.310890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 04:51:51.312127 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:51:51.314184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c346e19e-bd00-4d00-9dfc-f9f94ca2bb44 tempest-FlavorsAccessNegativeTestJSON-1222346946 tempest-FlavorsAccessNegativeTestJSON-1222346946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:51.314329 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6b2eb73c-cb04-4115-8662-52d59e8a7929 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.421820 Aug 27 04:51:51.315063 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 32/84] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:50 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:51.315665 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c346e19e-bd00-4d00-9dfc-f9f94ca2bb44 tempest-FlavorsAccessNegativeTestJSON-1222346946 tempest-FlavorsAccessNegativeTestJSON-1222346946-project] 10.222.0.58 "POST /compute/v2.1/flavors/451982608/action" status: 403 len: 133 microversion: 2.1 time: 0.038144 Aug 27 04:51:51.319961 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 53/85] 10.222.0.58 () {60 vars in 1197 bytes} [Sat Aug 27 04:51:51 2022] POST /compute/v2.1/flavors/451982608/action => generated 133 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:51.333500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2baa6d58-ab52-4ea1-8136-bb41bc946bd7 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b2a78be0fc84481cb5878df33b78a41f"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:51.470885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-24be7c09-5608-415a-b1e3-90bae32fddc8 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Calling method '.version_select at 0x7fb566258d30>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:52.135119 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-24be7c09-5608-415a-b1e3-90bae32fddc8 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/c7b588a0b2ca4b70bb35a80d4557f457/defaults" status: 200 len: 371 microversion: 2.1 time: 0.669531 Aug 27 04:51:52.135909 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 54/86] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 04:51:51 2022] GET /compute/v2.1/os-quota-sets/c7b588a0b2ca4b70bb35a80d4557f457/defaults => generated 371 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:51:52.172023 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2baa6d58-ab52-4ea1-8136-bb41bc946bd7 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/451982608/action" status: 200 len: 21 microversion: 2.1 time: 0.842976 Aug 27 04:51:52.173638 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 33/87] 10.222.0.58 () {60 vars in 1197 bytes} [Sat Aug 27 04:51:51 2022] POST /compute/v2.1/flavors/451982608/action => generated 21 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:51:52.183867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f3037d52-f6e0-4bcd-b6fd-3476dd45f7f3 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:52.205716 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f3037d52-f6e0-4bcd-b6fd-3476dd45f7f3 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/451982608" status: 202 len: 0 microversion: 2.1 time: 0.025705 Aug 27 04:51:52.207505 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 55/88] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:51:52 2022] DELETE /compute/v2.1/flavors/451982608 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:51:52.220759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-05dd44e2-411b-4807-ad05-daf731e7163d tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:52.247323 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-05dd44e2-411b-4807-ad05-daf731e7163d tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034289 Aug 27 04:51:52.248944 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 34/89] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:52.272535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5a4c3d37-4bb3-4db1-95fb-258028a75911 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1749432964", "id": 1286955835, "os-flavor-access:is_public": "False"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:52.295921 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5a4c3d37-4bb3-4db1-95fb-258028a75911 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.026891 Aug 27 04:51:52.295921 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 56/90] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:51:52 2022] POST /compute/v2.1/flavors => generated 439 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:52.308310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ceed7770-09da-4ea2-9bfb-95178aba1cff tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b2aa0de2be0c4b3e8da80672a4d7462b"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:52.336214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82c3f2fb-9d81-4f5c-825b-da9279d62c96 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:52.337544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-82c3f2fb-9d81-4f5c-825b-da9279d62c96 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:52.364082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82c3f2fb-9d81-4f5c-825b-da9279d62c96 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:52.364891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82c3f2fb-9d81-4f5c-825b-da9279d62c96 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:52.365567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82c3f2fb-9d81-4f5c-825b-da9279d62c96 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:52.367286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82c3f2fb-9d81-4f5c-825b-da9279d62c96 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:52.368126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82c3f2fb-9d81-4f5c-825b-da9279d62c96 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:52.370108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82c3f2fb-9d81-4f5c-825b-da9279d62c96 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:52.575858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-82c3f2fb-9d81-4f5c-825b-da9279d62c96 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:52.584815 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-82c3f2fb-9d81-4f5c-825b-da9279d62c96 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.252367 Aug 27 04:51:52.586803 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 57/91] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:52 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:53.219308 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-ceed7770-09da-4ea2-9bfb-95178aba1cff tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] HTTP exception thrown: Flavor access not found for 21 / b2aa0de2be0c4b3e8da80672a4d7462b combination. Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ceed7770-09da-4ea2-9bfb-95178aba1cff tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Request method failure captured: Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/flavors/1286955835/action HTTP/1.1 Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 70 Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLZrYuaHj_sciJZMtmclMmH9ICVecbDEa2X1Y_4ZNSJ0qg1VLRM7V7619hPxhfPCCAORuu3wwiSEGFpj8ASotbbplApoMoUyeixcOeEUwJd3GGy4T69XsNms-EujjXkG9oN1qpr8tscZxF5VJcCl55fQQifB_3n48XTPVO-kcnPoLI Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 8d38266b1c024c0b98bb7f17b24dde59 Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-724689262 Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:51:53.223337 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8d38266b1c024c0b98bb7f17b24dde59", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8d38266b1c024c0b98bb7f17b24dde59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8d38266b1c024c0b98bb7f17b24dde59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8d38266b1c024c0b98bb7f17b24dde59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-724689262 Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 8d38266b1c024c0b98bb7f17b24dde59 Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-724689262 Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 1a08bb703f8e47caaadbb9587ee4a36f Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: {"removeTenantAccess": {"tenant": "b2aa0de2be0c4b3e8da80672a4d7462b"}} Aug 27 04:51:53.224539 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: exception: Flavor access not found for 21 / b2aa0de2be0c4b3e8da80672a4d7462b combination. Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '1286955835', 'body': {'removeTenantAccess': {'tenant': 'b2aa0de2be0c4b3e8da80672a4d7462b'}}} Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 27 04:51:53.225225 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / b2aa0de2be0c4b3e8da80672a4d7462b combination. Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / b2aa0de2be0c4b3e8da80672a4d7462b combination. Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:53.226835 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:53.227901 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:53.227901 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:53.227901 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:53.227901 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:53.227901 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / b2aa0de2be0c4b3e8da80672a4d7462b combination. Aug 27 04:51:53.227901 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:51:53.227901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ceed7770-09da-4ea2-9bfb-95178aba1cff tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Returning 404 to user: Flavor access not found for 21 / b2aa0de2be0c4b3e8da80672a4d7462b combination. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:53.227901 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ceed7770-09da-4ea2-9bfb-95178aba1cff tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1286955835/action" status: 404 len: 124 microversion: 2.1 time: 0.922742 Aug 27 04:51:53.227901 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 35/92] 10.222.0.58 () {60 vars in 1200 bytes} [Sat Aug 27 04:51:52 2022] POST /compute/v2.1/flavors/1286955835/action => generated 124 bytes in 924 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:53.233972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d912125-07bb-4e6a-bbc0-24b0ddfc1f25 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:53.274518 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d912125-07bb-4e6a-bbc0-24b0ddfc1f25 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1286955835" status: 202 len: 0 microversion: 2.1 time: 0.044238 Aug 27 04:51:53.275389 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 58/93] 10.222.0.58 () {58 vars in 1161 bytes} [Sat Aug 27 04:51:53 2022] DELETE /compute/v2.1/flavors/1286955835 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:51:53.286277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-27f1beec-1353-458f-9a8c-937208564d43 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:53.321580 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-27f1beec-1353-458f-9a8c-937208564d43 tempest-FlavorsAccessNegativeTestJSON-724689262 tempest-FlavorsAccessNegativeTestJSON-724689262-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041233 Aug 27 04:51:53.324839 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 36/94] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:53.510527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-040545df-e2b7-4f2b-9b41-7157fd28413e tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Action: 'update', calling method: .version_select at 0x7fb5662a6f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:53.524799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=48,nova_cell0:UPDATE=12 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:53.606473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-86cca17d-6f7d-4394-b93c-f2cd9074c815 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:53.607208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-86cca17d-6f7d-4394-b93c-f2cd9074c815 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:53.617497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86cca17d-6f7d-4394-b93c-f2cd9074c815 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:53.618001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86cca17d-6f7d-4394-b93c-f2cd9074c815 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:53.619401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86cca17d-6f7d-4394-b93c-f2cd9074c815 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:53.620132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86cca17d-6f7d-4394-b93c-f2cd9074c815 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:53.620589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86cca17d-6f7d-4394-b93c-f2cd9074c815 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:53.621130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86cca17d-6f7d-4394-b93c-f2cd9074c815 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:53.844292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-86cca17d-6f7d-4394-b93c-f2cd9074c815 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:53.860262 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-86cca17d-6f7d-4394-b93c-f2cd9074c815 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.257217 Aug 27 04:51:53.862238 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 37/95] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:53 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:54.521984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040545df-e2b7-4f2b-9b41-7157fd28413e tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:54.526976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040545df-e2b7-4f2b-9b41-7157fd28413e tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:54.535410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040545df-e2b7-4f2b-9b41-7157fd28413e tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:54.536464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040545df-e2b7-4f2b-9b41-7157fd28413e tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:54.538524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040545df-e2b7-4f2b-9b41-7157fd28413e tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:54.539433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040545df-e2b7-4f2b-9b41-7157fd28413e tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:54.700554 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-040545df-e2b7-4f2b-9b41-7157fd28413e tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/249f939a98a54250900ebcbb6fcb1ae3" status: 200 len: 328 microversion: 2.1 time: 1.194583 Aug 27 04:51:54.705760 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 59/96] 10.222.0.58 () {60 vars in 1262 bytes} [Sat Aug 27 04:51:53 2022] PUT /compute/v2.1/os-quota-sets/249f939a98a54250900ebcbb6fcb1ae3 => generated 328 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:54.716861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ca183e54-fc35-409e-acff-ab341051a758 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Calling method '.version_select at 0x7fb5660afaf0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:54.884589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f5c6846e-24ca-4107-a37c-259d7db75d90 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:54.892407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f5c6846e-24ca-4107-a37c-259d7db75d90 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:54.907426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c6846e-24ca-4107-a37c-259d7db75d90 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:54.908386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c6846e-24ca-4107-a37c-259d7db75d90 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:54.909814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c6846e-24ca-4107-a37c-259d7db75d90 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:54.911323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c6846e-24ca-4107-a37c-259d7db75d90 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:54.912390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c6846e-24ca-4107-a37c-259d7db75d90 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:54.913040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c6846e-24ca-4107-a37c-259d7db75d90 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:55.292776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f5c6846e-24ca-4107-a37c-259d7db75d90 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:55.304620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f5c6846e-24ca-4107-a37c-259d7db75d90 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.425197 Aug 27 04:51:55.307647 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 60/97] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:54 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:51:55.392915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca183e54-fc35-409e-acff-ab341051a758 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:55.396483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca183e54-fc35-409e-acff-ab341051a758 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:55.397925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca183e54-fc35-409e-acff-ab341051a758 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:55.399360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca183e54-fc35-409e-acff-ab341051a758 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:55.402053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca183e54-fc35-409e-acff-ab341051a758 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:55.402831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca183e54-fc35-409e-acff-ab341051a758 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:55.466685 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ca183e54-fc35-409e-acff-ab341051a758 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/249f939a98a54250900ebcbb6fcb1ae3/detail" status: 200 len: 916 microversion: 2.1 time: 0.753546 Aug 27 04:51:55.467960 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 38/98] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 04:51:54 2022] GET /compute/v2.1/os-quota-sets/249f939a98a54250900ebcbb6fcb1ae3/detail => generated 916 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:55.865532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1843498802", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:56.003362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:51:56.560182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5d3905d-0833-4ace-9cd7-1d5ab2d10e5f tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Calling method '.version_select at 0x7fb56607e4c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:56.730401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:51:56.734751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:51:56.735528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:51:56.736136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:51:56.736745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:51:56.752294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:56.753656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:56.754566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:56.755697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:56.756355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:56.756977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:56.769606 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5d3905d-0833-4ace-9cd7-1d5ab2d10e5f tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1" status: 200 len: 371 microversion: 2.1 time: 0.656710 Aug 27 04:51:56.770209 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 39/99] 10.222.0.58 () {58 vars in 1242 bytes} [Sat Aug 27 04:51:56 2022] GET /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1 => generated 371 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:51:56.776631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7f4b142e-4bb8-40db-bf25-bcaa9a2275db tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:56.779189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7f4b142e-4bb8-40db-bf25-bcaa9a2275db tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:56.792319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Getting quotas for project 7bd33a6d6264429c8997e804427630a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:51:56.792450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4b142e-4bb8-40db-bf25-bcaa9a2275db tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:56.792830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4b142e-4bb8-40db-bf25-bcaa9a2275db tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:56.793847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4b142e-4bb8-40db-bf25-bcaa9a2275db tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:56.794728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4b142e-4bb8-40db-bf25-bcaa9a2275db tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:56.795389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4b142e-4bb8-40db-bf25-bcaa9a2275db tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:56.795961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4b142e-4bb8-40db-bf25-bcaa9a2275db tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:56.803921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Getting quotas for user 73b2b5fa38f64dda97a76ab4a7559cbc and project 7bd33a6d6264429c8997e804427630a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:51:56.813470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=15,nova_api:INSERT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:56.827068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:51:56.831515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:51:56.905581 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5ef2a507-2718-4b27-ae77-46d4c70424ff tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466153 Aug 27 04:51:56.907459 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 61/100] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:51:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:51:56.913466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Action: 'update', calling method: .version_select at 0x7fb565ec20d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:57.172582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:57.177410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:57.178326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:57.181393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:57.181966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:57.184154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:57.261370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:57.262013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:57.262670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:57.263792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:57.264852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:57.265895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:57.454460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7f4b142e-4bb8-40db-bf25-bcaa9a2275db tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:57.472335 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7f4b142e-4bb8-40db-bf25-bcaa9a2275db tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.700323 Aug 27 04:51:57.481592 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 40/101] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:56 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:57.509379 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-87c60559-445e-4e9a-a8b7-8bee9c9a1409 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/249f939a98a54250900ebcbb6fcb1ae3?user_id=6c5e94562e7c47009c69027c571ab44d" status: 200 len: 328 microversion: 2.1 time: 0.599984 Aug 27 04:51:57.511419 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 62/102] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:51:56 2022] PUT /compute/v2.1/os-quota-sets/249f939a98a54250900ebcbb6fcb1ae3?user_id=6c5e94562e7c47009c69027c571ab44d => generated 328 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:57.514260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a99f5fe7-5d7c-4197-b338-6a6d746e6917 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Action: 'update', calling method: .version_select at 0x7fb56611eb80>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:57.535478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-138ba612-d76d-4785-ac66-71e1e6fc039c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:57.540328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-138ba612-d76d-4785-ac66-71e1e6fc039c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:57.726158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-138ba612-d76d-4785-ac66-71e1e6fc039c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:57.734959 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-138ba612-d76d-4785-ac66-71e1e6fc039c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1223 microversion: 2.1 time: 0.222447 Aug 27 04:51:57.740744 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 63/103] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:57 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1223 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:57.753139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8bd3127-efeb-48a1-a0e3-4395c99e58fa tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Calling method '.version_select at 0x7fb565ec25e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:58.067559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=29 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:58.074955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a99f5fe7-5d7c-4197-b338-6a6d746e6917 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:58.074955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a99f5fe7-5d7c-4197-b338-6a6d746e6917 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:58.078641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a99f5fe7-5d7c-4197-b338-6a6d746e6917 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:58.081391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a99f5fe7-5d7c-4197-b338-6a6d746e6917 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:58.082044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a99f5fe7-5d7c-4197-b338-6a6d746e6917 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:58.086921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a99f5fe7-5d7c-4197-b338-6a6d746e6917 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:58.116921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=11 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:58.120617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=89 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:58.149308 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e8bd3127-efeb-48a1-a0e3-4395c99e58fa tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/249f939a98a54250900ebcbb6fcb1ae3?user_id=6c5e94562e7c47009c69027c571ab44d" status: 200 len: 370 microversion: 2.1 time: 0.407211 Aug 27 04:51:58.150026 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 64/104] 10.222.0.58 () {58 vars in 1323 bytes} [Sat Aug 27 04:51:57 2022] GET /compute/v2.1/os-quota-sets/249f939a98a54250900ebcbb6fcb1ae3?user_id=6c5e94562e7c47009c69027c571ab44d => generated 370 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:58.263403 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a99f5fe7-5d7c-4197-b338-6a6d746e6917 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1" status: 200 len: 328 microversion: 2.1 time: 0.774534 Aug 27 04:51:58.264074 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 41/105] 10.222.0.58 () {60 vars in 1262 bytes} [Sat Aug 27 04:51:57 2022] PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1 => generated 328 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:58.501695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8951ba3-5fcb-42ad-a949-99832eff1fe0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:58.502401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e8951ba3-5fcb-42ad-a949-99832eff1fe0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:58.522147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8951ba3-5fcb-42ad-a949-99832eff1fe0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:58.522643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8951ba3-5fcb-42ad-a949-99832eff1fe0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:58.528764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8951ba3-5fcb-42ad-a949-99832eff1fe0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:58.529537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8951ba3-5fcb-42ad-a949-99832eff1fe0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:58.530000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8951ba3-5fcb-42ad-a949-99832eff1fe0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:58.535051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8951ba3-5fcb-42ad-a949-99832eff1fe0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:58.655512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=84 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:58.768301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aee3319a-b02f-497a-a7ae-43cab3f3740e tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:58.769397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aee3319a-b02f-497a-a7ae-43cab3f3740e tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:58.776597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aee3319a-b02f-497a-a7ae-43cab3f3740e tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:58.780476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aee3319a-b02f-497a-a7ae-43cab3f3740e tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:58.785906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aee3319a-b02f-497a-a7ae-43cab3f3740e tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:58.786672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aee3319a-b02f-497a-a7ae-43cab3f3740e tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:58.793357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aee3319a-b02f-497a-a7ae-43cab3f3740e tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:58.793917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aee3319a-b02f-497a-a7ae-43cab3f3740e tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:59.014137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aee3319a-b02f-497a-a7ae-43cab3f3740e tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:59.022606 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aee3319a-b02f-497a-a7ae-43cab3f3740e tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1227 microversion: 2.1 time: 0.258434 Aug 27 04:51:59.023429 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 42/106] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:58 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1227 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:51:59.092960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e8951ba3-5fcb-42ad-a949-99832eff1fe0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:59.106450 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e8951ba3-5fcb-42ad-a949-99832eff1fe0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.608552 Aug 27 04:51:59.108567 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 65/107] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:58 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:59.174270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fac65038-898d-4ac9-9496-48b0d33cd8ae tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Calling method '.version_select at 0x7fb565f85670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:59.582823 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fac65038-898d-4ac9-9496-48b0d33cd8ae tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/c7b588a0b2ca4b70bb35a80d4557f457/defaults" status: 200 len: 371 microversion: 2.1 time: 0.412199 Aug 27 04:51:59.583441 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 66/108] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 04:51:59 2022] GET /compute/v2.1/os-quota-sets/c7b588a0b2ca4b70bb35a80d4557f457/defaults => generated 371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:51:59.595510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fe72b67d-e2e8-42c7-b385-a2bb36063d95 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Action: 'update', calling method: .version_select at 0x7fb565f22af0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:59.653343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1179186471", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:59.750731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:51:59.792166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe72b67d-e2e8-42c7-b385-a2bb36063d95 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:59.792883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe72b67d-e2e8-42c7-b385-a2bb36063d95 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:59.793531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe72b67d-e2e8-42c7-b385-a2bb36063d95 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:59.794480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe72b67d-e2e8-42c7-b385-a2bb36063d95 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:59.795153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe72b67d-e2e8-42c7-b385-a2bb36063d95 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:59.795792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe72b67d-e2e8-42c7-b385-a2bb36063d95 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:00.256443 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fe72b67d-e2e8-42c7-b385-a2bb36063d95 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/c7b588a0b2ca4b70bb35a80d4557f457" status: 200 len: 329 microversion: 2.1 time: 0.664785 Aug 27 04:52:00.257099 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 67/109] 10.222.0.58 () {60 vars in 1263 bytes} [Sat Aug 27 04:51:59 2022] PUT /compute/v2.1/os-quota-sets/c7b588a0b2ca4b70bb35a80d4557f457 => generated 329 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:52:00.276693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d2fc2b67-dd2e-49d6-9309-6121fd689708 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:00.277447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d2fc2b67-dd2e-49d6-9309-6121fd689708 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:00.292493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2fc2b67-dd2e-49d6-9309-6121fd689708 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:00.294043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2fc2b67-dd2e-49d6-9309-6121fd689708 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:00.294830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2fc2b67-dd2e-49d6-9309-6121fd689708 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:00.296277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2fc2b67-dd2e-49d6-9309-6121fd689708 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:00.297036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2fc2b67-dd2e-49d6-9309-6121fd689708 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:00.297640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2fc2b67-dd2e-49d6-9309-6121fd689708 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:00.878677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d2fc2b67-dd2e-49d6-9309-6121fd689708 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:00.888422 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d2fc2b67-dd2e-49d6-9309-6121fd689708 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1281 microversion: 2.1 time: 0.626367 Aug 27 04:52:00.904182 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 68/110] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:00 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1281 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:00.908348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d254357f-151a-40fd-8917-79e7d64a4348 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:00.909537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d254357f-151a-40fd-8917-79e7d64a4348 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:00.931185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d254357f-151a-40fd-8917-79e7d64a4348 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:00.931563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d254357f-151a-40fd-8917-79e7d64a4348 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:00.931997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d254357f-151a-40fd-8917-79e7d64a4348 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:00.932719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d254357f-151a-40fd-8917-79e7d64a4348 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:00.933172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d254357f-151a-40fd-8917-79e7d64a4348 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:00.933602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d254357f-151a-40fd-8917-79e7d64a4348 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:01.029127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:01.033109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:01.033764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:01.034844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:01.035283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:01.081609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:01.084516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:01.088089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:01.089266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:01.090374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:01.090963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:01.146745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Getting quotas for project f5a19403d3f8481b8ffe1d0ad81654b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:01.165417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Getting quotas for user ec1e2ab56d544cc6a8cbb265ba824e91 and project f5a19403d3f8481b8ffe1d0ad81654b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:01.210730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.utils [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] cores quota exceeded for f5a19403d3f8481b8ffe1d0ad81654b1, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128548) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 04:52:01.211713 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Request method failure captured: Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 145 Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLpXpR35AAzpnYpno2X9RhK3bgVufmuDKKgXekmB4gB9JIrGWGGcWeMcg5OORUNZlAXAwUYrEGNGpEA_yUAj-O8INpMH4ntlUr-EXVEO0DdzQun4Rvja6Kc1MQdzoEuTr2Si_oenUIp65ZTqtA26b-uoFcRHnj2s2wCb1-kdHKdOEM Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: f5a19403d3f8481b8ffe1d0ad81654b1 Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:01.230782 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5a19403d3f8481b8ffe1d0ad81654b1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: f5a19403d3f8481b8ffe1d0ad81654b1 Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-QuotasAdminNegativeTest-2000743948-project Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ec1e2ab56d544cc6a8cbb265ba824e91 Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-QuotasAdminNegativeTest-2000743948-project Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1179186471", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} Aug 27 04:52:01.232240 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1179186471', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452'}}} Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 04:52:01.233135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:01.234398 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:01.236090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:01.239340 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:01.239340 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:01.239340 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:01.239340 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:01.239340 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 04:52:01.239340 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:01.258026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:01.260287 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90f99880-d97d-4aac-9f8d-dc2dcc01d134 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.236037 Aug 27 04:52:01.263723 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 43/111] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:51:59 2022] POST /compute/v2.1/servers => generated 111 bytes in 2239 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:01.289971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-020f9b0e-c686-4b0e-bf2e-035060da8912 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Action: 'update', calling method: .version_select at 0x7fb565ebb280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:01.465933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d254357f-151a-40fd-8917-79e7d64a4348 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:01.476767 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d254357f-151a-40fd-8917-79e7d64a4348 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.573658 Aug 27 04:52:01.480503 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 69/112] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:00 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:01.492678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-67988f2d-3230-46ad-b16a-363328232d8c tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Action: 'update', calling method: .version_select at 0x7fb565ea4280>, body: {"quota_set": {"cores": 20}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:01.873905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-020f9b0e-c686-4b0e-bf2e-035060da8912 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:01.875826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-020f9b0e-c686-4b0e-bf2e-035060da8912 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:01.876444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-020f9b0e-c686-4b0e-bf2e-035060da8912 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:01.887694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-020f9b0e-c686-4b0e-bf2e-035060da8912 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:01.888618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-020f9b0e-c686-4b0e-bf2e-035060da8912 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:01.889379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-020f9b0e-c686-4b0e-bf2e-035060da8912 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:02.078510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:02.514553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67988f2d-3230-46ad-b16a-363328232d8c tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:02.516321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67988f2d-3230-46ad-b16a-363328232d8c tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:02.517476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67988f2d-3230-46ad-b16a-363328232d8c tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:02.518341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67988f2d-3230-46ad-b16a-363328232d8c tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:02.520931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67988f2d-3230-46ad-b16a-363328232d8c tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:02.521421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67988f2d-3230-46ad-b16a-363328232d8c tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:02.635854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=19,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:02.639546 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-020f9b0e-c686-4b0e-bf2e-035060da8912 tempest-QuotasAdminTestJSON-303004556 tempest-QuotasAdminTestJSON-303004556-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/c7b588a0b2ca4b70bb35a80d4557f457" status: 200 len: 329 microversion: 2.1 time: 1.373970 Aug 27 04:52:02.653325 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 44/113] 10.222.0.58 () {60 vars in 1263 bytes} [Sat Aug 27 04:52:01 2022] PUT /compute/v2.1/os-quota-sets/c7b588a0b2ca4b70bb35a80d4557f457 => generated 329 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:02.676980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-34e9477b-02cf-4604-a297-d76e042a38e6 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:02.677675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-34e9477b-02cf-4604-a297-d76e042a38e6 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:02.699837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e9477b-02cf-4604-a297-d76e042a38e6 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:02.701081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e9477b-02cf-4604-a297-d76e042a38e6 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:02.702896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e9477b-02cf-4604-a297-d76e042a38e6 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:02.705397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e9477b-02cf-4604-a297-d76e042a38e6 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:02.707140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e9477b-02cf-4604-a297-d76e042a38e6 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:02.709532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e9477b-02cf-4604-a297-d76e042a38e6 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:02.729580 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-67988f2d-3230-46ad-b16a-363328232d8c tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1" status: 200 len: 329 microversion: 2.1 time: 1.243999 Aug 27 04:52:02.730707 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 70/114] 10.222.0.58 () {60 vars in 1262 bytes} [Sat Aug 27 04:52:01 2022] PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1 => generated 329 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:02.750632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a4a1420d-a70f-4102-a7d1-6e53c65d3362 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:02.751822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a4a1420d-a70f-4102-a7d1-6e53c65d3362 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:02.777343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4a1420d-a70f-4102-a7d1-6e53c65d3362 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:02.786734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4a1420d-a70f-4102-a7d1-6e53c65d3362 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:02.788111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4a1420d-a70f-4102-a7d1-6e53c65d3362 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:02.793617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4a1420d-a70f-4102-a7d1-6e53c65d3362 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:02.795192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4a1420d-a70f-4102-a7d1-6e53c65d3362 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:02.796187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4a1420d-a70f-4102-a7d1-6e53c65d3362 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:03.373359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-34e9477b-02cf-4604-a297-d76e042a38e6 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:03.388212 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-34e9477b-02cf-4604-a297-d76e042a38e6 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.733734 Aug 27 04:52:03.389986 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 45/115] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:02 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:03.419964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1af9971a-8de4-42ee-bdd9-96027d07ceec tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Calling method '.version_select at 0x7fb565ed6790>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:03.554390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a4a1420d-a70f-4102-a7d1-6e53c65d3362 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:03.562817 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a4a1420d-a70f-4102-a7d1-6e53c65d3362 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.827878 Aug 27 04:52:03.572595 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 71/116] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:02 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:04.131872 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1af9971a-8de4-42ee-bdd9-96027d07ceec tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1" status: 200 len: 371 microversion: 2.1 time: 0.724645 Aug 27 04:52:04.133075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aa1aac8a-e6e6-48ad-a1ec-ba3a5335a776 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1907757461", "ram": 512, "vcpus": 1, "disk": 10, "id": 2074608029, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:04.133605 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 46/117] 10.222.0.58 () {58 vars in 1242 bytes} [Sat Aug 27 04:52:03 2022] GET /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1 => generated 371 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:04.175373 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aa1aac8a-e6e6-48ad-a1ec-ba3a5335a776 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.597476 Aug 27 04:52:04.192318 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 72/118] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:03 2022] POST /compute/v2.1/flavors => generated 416 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:04.204778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-42041815-8e29-4de4-86cd-587335149a01 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Action: 'update', calling method: .version_select at 0x7fb565ea48b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:04.235605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70a6716b-9087-4544-8d35-9ff1ec05138d tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Action: 'update', calling method: .version_select at 0x7fb565ed6820>, body: {"quota_set": {"ram": "5120"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:04.356537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42041815-8e29-4de4-86cd-587335149a01 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:04.357040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42041815-8e29-4de4-86cd-587335149a01 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:04.357478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42041815-8e29-4de4-86cd-587335149a01 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:04.358384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42041815-8e29-4de4-86cd-587335149a01 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:04.358849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42041815-8e29-4de4-86cd-587335149a01 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:04.359380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42041815-8e29-4de4-86cd-587335149a01 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:04.385941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a6716b-9087-4544-8d35-9ff1ec05138d tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:04.387078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a6716b-9087-4544-8d35-9ff1ec05138d tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:04.387688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a6716b-9087-4544-8d35-9ff1ec05138d tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:04.391232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a6716b-9087-4544-8d35-9ff1ec05138d tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:04.391232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a6716b-9087-4544-8d35-9ff1ec05138d tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:04.391232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a6716b-9087-4544-8d35-9ff1ec05138d tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:04.466392 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-42041815-8e29-4de4-86cd-587335149a01 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1" status: 200 len: 328 microversion: 2.1 time: 0.272717 Aug 27 04:52:04.470714 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 73/119] 10.222.0.58 () {60 vars in 1262 bytes} [Sat Aug 27 04:52:04 2022] PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1 => generated 328 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:04.494219 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70a6716b-9087-4544-8d35-9ff1ec05138d tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/de1d08d708184aa7a03610d975b862a1" status: 200 len: 240 microversion: 2.36 time: 0.359030 Aug 27 04:52:04.496800 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 47/120] 10.222.0.58 () {62 vars in 1303 bytes} [Sat Aug 27 04:52:04 2022] PUT /compute/v2.1/os-quota-sets/de1d08d708184aa7a03610d975b862a1 => generated 240 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:52:04.734422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6732429e-293c-41c3-9422-1324190d998e req-617a913a-ba13-4612-b65f-05a6439c6b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2655c565-885b-4871-bdef-e28e07fb44aa", "name": "network-vif-plugged", "status": "completed", "tag": "9d9cd12c-5570-4b60-8cfb-e7a05c1d10f2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:04.735063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e2b4d09-c683-4acd-be24-13bf2a6805f9 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:04.767835 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-8e2b4d09-c683-4acd-be24-13bf2a6805f9 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] HTTP exception thrown: Flavor 2074608029 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:52:04.774260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6732429e-293c-41c3-9422-1324190d998e req-617a913a-ba13-4612-b65f-05a6439c6b1f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e2b4d09-c683-4acd-be24-13bf2a6805f9 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Request method failure captured: Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/flavors/2074608029/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLxGZoq59LTltTfD_DXA9HTL0qUlkbEr0Xzc0Q6Gs5yXUZ6kHmlkGgeB6oZGrU-jVaY8F36WvmsB2pcolJyzdDiEGOa3TcKPSd9u-WiyUa8c3Ug2DE1hUFq8biFa1tdWRM3NtQGHrLdAvr5z5NVobbiAHsQdAoUbcTg_74mBmTdiG0 Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 4bec11de8ccb4012b95dae6683dbdbca Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:52:04.775810 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:52:04.776991 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4bec11de8ccb4012b95dae6683dbdbca", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:04.776991 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:04.776991 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 4bec11de8ccb4012b95dae6683dbdbca Aug 27 04:52:04.776991 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:04.776991 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project Aug 27 04:52:04.776991 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:04.776991 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:04.776991 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 3288eea375f0407bbd4ac27843d463b7 Aug 27 04:52:04.776991 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project Aug 27 04:52:04.776991 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:52:04.776991 n-d-820368-35 devstack@n-api.service[128547]: exception: Flavor 2074608029 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'flavor_id': '2074608029', 'id': 'hw:cpu_thread_policy'} Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2074608029 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:04.777634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:04.778751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:04.778751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:04.778751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:04.778751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:04.778751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:04.778751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2074608029 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:52:04.778751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:04.791006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e2b4d09-c683-4acd-be24-13bf2a6805f9 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Returning 404 to user: Flavor 2074608029 has no extra specs with key hw:cpu_thread_policy. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:04.793957 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e2b4d09-c683-4acd-be24-13bf2a6805f9 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] 10.222.0.58 "GET /compute/v2.1/flavors/2074608029/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.321619 Aug 27 04:52:04.794826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6732429e-293c-41c3-9422-1324190d998e req-617a913a-ba13-4612-b65f-05a6439c6b1f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:04.795609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6732429e-293c-41c3-9422-1324190d998e req-617a913a-ba13-4612-b65f-05a6439c6b1f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:04.806115 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 74/121] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 04:52:04 2022] GET /compute/v2.1/flavors/2074608029/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 335 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:04.815900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-13c19e9c-4aaa-4375-a5d5-07da7017491d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:04.827403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-13c19e9c-4aaa-4375-a5d5-07da7017491d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:04.842296 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6732429e-293c-41c3-9422-1324190d998e req-617a913a-ba13-4612-b65f-05a6439c6b1f service nova] Creating event network-vif-plugged:9d9cd12c-5570-4b60-8cfb-e7a05c1d10f2 for instance 2655c565-885b-4871-bdef-e28e07fb44aa on n-h2-820368-35 Aug 27 04:52:04.848332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13c19e9c-4aaa-4375-a5d5-07da7017491d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:04.849131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13c19e9c-4aaa-4375-a5d5-07da7017491d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:04.849741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13c19e9c-4aaa-4375-a5d5-07da7017491d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:04.851555 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6732429e-293c-41c3-9422-1324190d998e req-617a913a-ba13-4612-b65f-05a6439c6b1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.352692 Aug 27 04:52:04.852154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13c19e9c-4aaa-4375-a5d5-07da7017491d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:04.852621 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 48/122] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:04.853315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13c19e9c-4aaa-4375-a5d5-07da7017491d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:04.857587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13c19e9c-4aaa-4375-a5d5-07da7017491d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:04.871393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-39752416-d3f0-478c-9dbb-30f3032871fd tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Calling method '.version_select at 0x7fb565ebbc10>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:05.171243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-13c19e9c-4aaa-4375-a5d5-07da7017491d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:05.182155 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-13c19e9c-4aaa-4375-a5d5-07da7017491d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.370643 Aug 27 04:52:05.185424 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 75/123] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:04 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:05.201865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3fa0d40-2300-40bc-9fe9-0d454d988cc0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:05.202493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e3fa0d40-2300-40bc-9fe9-0d454d988cc0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:05.219535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3fa0d40-2300-40bc-9fe9-0d454d988cc0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:05.220254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3fa0d40-2300-40bc-9fe9-0d454d988cc0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:05.220713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3fa0d40-2300-40bc-9fe9-0d454d988cc0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:05.222086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3fa0d40-2300-40bc-9fe9-0d454d988cc0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:05.222715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3fa0d40-2300-40bc-9fe9-0d454d988cc0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:05.223340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3fa0d40-2300-40bc-9fe9-0d454d988cc0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:05.563673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e3fa0d40-2300-40bc-9fe9-0d454d988cc0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:05.571963 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e3fa0d40-2300-40bc-9fe9-0d454d988cc0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.385282 Aug 27 04:52:05.572545 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 76/124] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:05 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:05.594136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1170779805", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:05.711860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:52:05.839191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39752416-d3f0-478c-9dbb-30f3032871fd tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:05.840351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39752416-d3f0-478c-9dbb-30f3032871fd tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:05.840941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39752416-d3f0-478c-9dbb-30f3032871fd tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:05.842725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39752416-d3f0-478c-9dbb-30f3032871fd tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:05.843418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39752416-d3f0-478c-9dbb-30f3032871fd tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:05.844043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39752416-d3f0-478c-9dbb-30f3032871fd tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:05.878537 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-39752416-d3f0-478c-9dbb-30f3032871fd tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/de1d08d708184aa7a03610d975b862a1/detail" status: 200 len: 672 microversion: 2.36 time: 1.023408 Aug 27 04:52:05.881151 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 49/125] 10.222.0.58 () {60 vars in 1304 bytes} [Sat Aug 27 04:52:04 2022] GET /compute/v2.1/os-quota-sets/de1d08d708184aa7a03610d975b862a1/detail => generated 672 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:52:05.892486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d43a248-b1d9-43d1-9042-83ed91f06b83 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:05.906902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d43a248-b1d9-43d1-9042-83ed91f06b83 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '3288eea375f0407bbd4ac27843d463b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bec11de8ccb4012b95dae6683dbdbca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d43a248-b1d9-43d1-9042-83ed91f06b83 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Request method failure captured: Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/flavors/2074608029/os-extra_specs HTTP/1.1 Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 66 Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLxGZoq59LTltTfD_DXA9HTL0qUlkbEr0Xzc0Q6Gs5yXUZ6kHmlkGgeB6oZGrU-jVaY8F36WvmsB2pcolJyzdDiEGOa3TcKPSd9u-WiyUa8c3Ug2DE1hUFq8biFa1tdWRM3NtQGHrLdAvr5z5NVobbiAHsQdAoUbcTg_74mBmTdiG0 Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 4bec11de8ccb4012b95dae6683dbdbca Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:05.912828 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4bec11de8ccb4012b95dae6683dbdbca", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 4bec11de8ccb4012b95dae6683dbdbca Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 3288eea375f0407bbd4ac27843d463b7 Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 27 04:52:05.914296 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'flavor_id': '2074608029', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:05.915034 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 04:52:05.916303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:05.917678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d43a248-b1d9-43d1-9042-83ed91f06b83 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:05.917678 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d43a248-b1d9-43d1-9042-83ed91f06b83 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] 10.222.0.58 "POST /compute/v2.1/flavors/2074608029/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.034200 Aug 27 04:52:05.917678 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 50/126] 10.222.0.58 () {60 vars in 1224 bytes} [Sat Aug 27 04:52:05 2022] POST /compute/v2.1/flavors/2074608029/os-extra_specs => generated 124 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:05.929985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e95d7b3f-cc0d-4a8d-969c-390ad344648c tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:05.995592 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e95d7b3f-cc0d-4a8d-969c-390ad344648c tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/2074608029/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.073155 Aug 27 04:52:05.996509 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 51/127] 10.222.0.58 () {60 vars in 1224 bytes} [Sat Aug 27 04:52:05 2022] POST /compute/v2.1/flavors/2074608029/os-extra_specs => generated 66 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:52:06.007390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2bfed7b1-8067-414f-b0b0-b1bbe74f9a55 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:06.011159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2bfed7b1-8067-414f-b0b0-b1bbe74f9a55 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '3288eea375f0407bbd4ac27843d463b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bec11de8ccb4012b95dae6683dbdbca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2bfed7b1-8067-414f-b0b0-b1bbe74f9a55 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Request method failure captured: Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLxGZoq59LTltTfD_DXA9HTL0qUlkbEr0Xzc0Q6Gs5yXUZ6kHmlkGgeB6oZGrU-jVaY8F36WvmsB2pcolJyzdDiEGOa3TcKPSd9u-WiyUa8c3Ug2DE1hUFq8biFa1tdWRM3NtQGHrLdAvr5z5NVobbiAHsQdAoUbcTg_74mBmTdiG0 Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 4bec11de8ccb4012b95dae6683dbdbca Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:06.016904 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:06.018063 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4bec11de8ccb4012b95dae6683dbdbca", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:06.018063 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:06.018063 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 4bec11de8ccb4012b95dae6683dbdbca Aug 27 04:52:06.018063 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:06.018063 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project Aug 27 04:52:06.018063 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:06.018063 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:06.018063 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 3288eea375f0407bbd4ac27843d463b7 Aug 27 04:52:06.018063 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project Aug 27 04:52:06.018063 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:06.018063 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'flavor_id': '2074608029', 'id': 'hw:numa_nodes'} Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:06.018693 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.019854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2bfed7b1-8067-414f-b0b0-b1bbe74f9a55 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:06.020726 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2bfed7b1-8067-414f-b0b0-b1bbe74f9a55 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] 10.222.0.58 "DELETE /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016061 Aug 27 04:52:06.020726 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 52/128] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 04:52:06 2022] DELETE /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:52:06.029134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4db2fb48-a94d-4668-b46e-05f0a75f9987 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:06.073588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:INSERT=15,nova_api:SELECT=65,nova_api:UPDATE=12,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:06.090997 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4db2fb48-a94d-4668-b46e-05f0a75f9987 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/2074608029/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066198 Aug 27 04:52:06.092382 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 53/129] 10.222.0.58 () {60 vars in 1224 bytes} [Sat Aug 27 04:52:06 2022] POST /compute/v2.1/flavors/2074608029/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:52:06.104111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-57656caa-5d83-4f22-afca-6738d56719ea tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:06.108584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-57656caa-5d83-4f22-afca-6738d56719ea tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '3288eea375f0407bbd4ac27843d463b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bec11de8ccb4012b95dae6683dbdbca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-57656caa-5d83-4f22-afca-6738d56719ea tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Request method failure captured: Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: request: PUT /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 22 Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLxGZoq59LTltTfD_DXA9HTL0qUlkbEr0Xzc0Q6Gs5yXUZ6kHmlkGgeB6oZGrU-jVaY8F36WvmsB2pcolJyzdDiEGOa3TcKPSd9u-WiyUa8c3Ug2DE1hUFq8biFa1tdWRM3NtQGHrLdAvr5z5NVobbiAHsQdAoUbcTg_74mBmTdiG0 Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 4bec11de8ccb4012b95dae6683dbdbca Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:06.116339 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4bec11de8ccb4012b95dae6683dbdbca", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4bec11de8ccb4012b95dae6683dbdbca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 4bec11de8ccb4012b95dae6683dbdbca Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 3288eea375f0407bbd4ac27843d463b7 Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: {"hw:numa_nodes": "1"} Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:06.117783 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'flavor_id': '2074608029', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:06.118631 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 04:52:06.119845 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.122099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-57656caa-5d83-4f22-afca-6738d56719ea tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:06.123621 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-57656caa-5d83-4f22-afca-6738d56719ea tempest-FlavorsExtraSpecsNegativeTestJSON-976579893 tempest-FlavorsExtraSpecsNegativeTestJSON-976579893-project] 10.222.0.58 "PUT /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024659 Aug 27 04:52:06.124418 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 54/130] 10.222.0.58 () {60 vars in 1265 bytes} [Sat Aug 27 04:52:06 2022] PUT /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:52:06.165021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f1be9bad-1a5e-43f5-ad65-6ebc3588deca tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:06.189581 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f1be9bad-1a5e-43f5-ad65-6ebc3588deca tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] HTTP exception thrown: Flavor 2074608029 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f1be9bad-1a5e-43f5-ad65-6ebc3588deca tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Request method failure captured: Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/flavors/2074608029/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLzg0iNdxTQPJMZ2e-2pmglYF-6yNaPGhvJ2Bm3wTaKjbx85RH3tJIbGNnXk6a8W390ZWrzeFv7LhNvdOD4BBQqLeJQaPJo5iDMi-qHDu1ogoWMjxT1dAHqmIGZRVGM7kEAIsXQ2isdix1W6QUUmzx8aG5sbFOmGxuvvoDJLKmkuUc Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: b619aab9c7214c8f989ca7d6f0f22823 Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:06.193388 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:06.194709 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b619aab9c7214c8f989ca7d6f0f22823", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b619aab9c7214c8f989ca7d6f0f22823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b619aab9c7214c8f989ca7d6f0f22823"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b619aab9c7214c8f989ca7d6f0f22823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:06.194709 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 Aug 27 04:52:06.194709 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: b619aab9c7214c8f989ca7d6f0f22823 Aug 27 04:52:06.194709 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 Aug 27 04:52:06.194709 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin Aug 27 04:52:06.194709 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:06.194709 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:06.194709 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9101ea8324714b0aaf54d5d43419e9ff Aug 27 04:52:06.194709 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin Aug 27 04:52:06.194709 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:06.194709 n-d-820368-35 devstack@n-api.service[128548]: exception: Flavor 2074608029 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'flavor_id': '2074608029', 'id': 'hw:cpu_thread_policy'} Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2074608029 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:06.195555 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.196909 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.196909 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:06.196909 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:06.196909 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:06.196909 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:06.196909 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2074608029 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:52:06.196909 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.196909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f1be9bad-1a5e-43f5-ad65-6ebc3588deca tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Returning 404 to user: Flavor 2074608029 has no extra specs with key hw:cpu_thread_policy. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:06.197448 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f1be9bad-1a5e-43f5-ad65-6ebc3588deca tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/2074608029/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.066510 Aug 27 04:52:06.207250 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 55/131] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 04:52:06 2022] DELETE /compute/v2.1/flavors/2074608029/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:06.218662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-deed1f46-1ff0-4146-89dd-af072d2e24d1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:06.219911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-deed1f46-1ff0-4146-89dd-af072d2e24d1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:06.241622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-deed1f46-1ff0-4146-89dd-af072d2e24d1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:06.243352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-deed1f46-1ff0-4146-89dd-af072d2e24d1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:06.244278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-deed1f46-1ff0-4146-89dd-af072d2e24d1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:06.246895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-deed1f46-1ff0-4146-89dd-af072d2e24d1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:06.248488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-deed1f46-1ff0-4146-89dd-af072d2e24d1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:06.248941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-deed1f46-1ff0-4146-89dd-af072d2e24d1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:06.650582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:06.651050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:06.651521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:06.651934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:06.652513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:06.667787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:06.668497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:06.669091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:06.670138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:06.670892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:06.671511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:06.713258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Getting quotas for project f5a19403d3f8481b8ffe1d0ad81654b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:06.722180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Getting quotas for user ec1e2ab56d544cc6a8cbb265ba824e91 and project f5a19403d3f8481b8ffe1d0ad81654b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:06.738714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.utils [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] instances quota exceeded for f5a19403d3f8481b8ffe1d0ad81654b1, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128547) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 04:52:06.739931 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Request method failure captured: Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 145 Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLpXpR35AAzpnYpno2X9RhK3bgVufmuDKKgXekmB4gB9JIrGWGGcWeMcg5OORUNZlAXAwUYrEGNGpEA_yUAj-O8INpMH4ntlUr-EXVEO0DdzQun4Rvja6Kc1MQdzoEuTr2Si_oenUIp65ZTqtA26b-uoFcRHnj2s2wCb1-kdHKdOEM Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: f5a19403d3f8481b8ffe1d0ad81654b1 Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:52:06.752772 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5a19403d3f8481b8ffe1d0ad81654b1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: f5a19403d3f8481b8ffe1d0ad81654b1 Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-QuotasAdminNegativeTest-2000743948-project Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ec1e2ab56d544cc6a8cbb265ba824e91 Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-QuotasAdminNegativeTest-2000743948-project Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1170779805", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} Aug 27 04:52:06.754280 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1170779805', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452'}}} Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 04:52:06.755220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:06.756357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.757747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.759154 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:06.759154 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:06.759154 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:06.759154 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:06.759154 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 04:52:06.759154 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.760922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:06.763237 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f346240f-3bc3-4056-9600-b3d2ac999b7d tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.179616 Aug 27 04:52:06.764683 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 77/132] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:05 2022] POST /compute/v2.1/servers => generated 119 bytes in 1183 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:06.772290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2e1fbd3-18dd-40e9-8398-b3e397cf1691 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:06.776461 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a2e1fbd3-18dd-40e9-8398-b3e397cf1691 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2e1fbd3-18dd-40e9-8398-b3e397cf1691 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Request method failure captured: Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: request: PUT /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 27 Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLzg0iNdxTQPJMZ2e-2pmglYF-6yNaPGhvJ2Bm3wTaKjbx85RH3tJIbGNnXk6a8W390ZWrzeFv7LhNvdOD4BBQqLeJQaPJo5iDMi-qHDu1ogoWMjxT1dAHqmIGZRVGM7kEAIsXQ2isdix1W6QUUmzx8aG5sbFOmGxuvvoDJLKmkuUc Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: b619aab9c7214c8f989ca7d6f0f22823 Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:52:06.777561 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b619aab9c7214c8f989ca7d6f0f22823", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b619aab9c7214c8f989ca7d6f0f22823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b619aab9c7214c8f989ca7d6f0f22823"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b619aab9c7214c8f989ca7d6f0f22823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: b619aab9c7214c8f989ca7d6f0f22823 Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 9101ea8324714b0aaf54d5d43419e9ff Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: {"hw:cpu_policy": "shared"} Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:52:06.778738 n-d-820368-35 devstack@n-api.service[128547]: exception: Request body and URI mismatch Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'flavor_id': '2074608029', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:06.779458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:06.782212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:06.782212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:06.782212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 27 04:52:06.782212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:06.782212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2e1fbd3-18dd-40e9-8398-b3e397cf1691 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:06.782212 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2e1fbd3-18dd-40e9-8398-b3e397cf1691 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.013010 Aug 27 04:52:06.782212 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 78/133] 10.222.0.58 () {60 vars in 1265 bytes} [Sat Aug 27 04:52:06 2022] PUT /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes => generated 73 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:06.790439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Action: 'update', calling method: .version_select at 0x7fb565cf9280>, body: {"quota_set": {"ram": "2048"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:06.900097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-deed1f46-1ff0-4146-89dd-af072d2e24d1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:06.923008 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-deed1f46-1ff0-4146-89dd-af072d2e24d1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.712345 Aug 27 04:52:06.927437 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 56/134] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:06 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:06.949899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-600259ca-038a-49d8-82ef-89da382acefa tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:06.951529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-600259ca-038a-49d8-82ef-89da382acefa tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:06.981782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600259ca-038a-49d8-82ef-89da382acefa tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:06.982313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600259ca-038a-49d8-82ef-89da382acefa tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:06.982771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600259ca-038a-49d8-82ef-89da382acefa tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:06.989135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600259ca-038a-49d8-82ef-89da382acefa tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:06.993747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600259ca-038a-49d8-82ef-89da382acefa tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:06.994272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600259ca-038a-49d8-82ef-89da382acefa tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:07.076055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:07.076539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:07.077161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:07.078031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:07.078613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:07.079741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:07.187764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:07.188341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:07.188833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:07.190343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:07.191546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:07.199752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:07.351763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-600259ca-038a-49d8-82ef-89da382acefa tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:07.361210 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-600259ca-038a-49d8-82ef-89da382acefa tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1339 microversion: 2.1 time: 0.428519 Aug 27 04:52:07.361834 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 57/135] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:06 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1339 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:07.368687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-76d221f1-a66b-43c7-b7a7-5b201542e837 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Action: 'update', calling method: .version_select at 0x7fb565ed6310>, body: {"quota_set": {"instances": 10}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:07.376494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:07.411027 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa532770-c1d7-44f6-b9d5-78ae2e25b2b7 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/de1d08d708184aa7a03610d975b862a1?user_id=df1c529a7f0a4c7db328c3007f0940a0" status: 200 len: 240 microversion: 2.36 time: 0.629489 Aug 27 04:52:07.414121 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 79/136] 10.222.0.58 () {62 vars in 1384 bytes} [Sat Aug 27 04:52:06 2022] PUT /compute/v2.1/os-quota-sets/de1d08d708184aa7a03610d975b862a1?user_id=df1c529a7f0a4c7db328c3007f0940a0 => generated 240 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:52:07.431968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cff9f8c1-c348-4746-94ab-c555d6b7a908 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cff9f8c1-c348-4746-94ab-c555d6b7a908 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Request method failure captured: Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: request: PUT /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 49 Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLzg0iNdxTQPJMZ2e-2pmglYF-6yNaPGhvJ2Bm3wTaKjbx85RH3tJIbGNnXk6a8W390ZWrzeFv7LhNvdOD4BBQqLeJQaPJo5iDMi-qHDu1ogoWMjxT1dAHqmIGZRVGM7kEAIsXQ2isdix1W6QUUmzx8aG5sbFOmGxuvvoDJLKmkuUc Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: b619aab9c7214c8f989ca7d6f0f22823 Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:52:07.462445 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b619aab9c7214c8f989ca7d6f0f22823", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b619aab9c7214c8f989ca7d6f0f22823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b619aab9c7214c8f989ca7d6f0f22823"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b619aab9c7214c8f989ca7d6f0f22823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: b619aab9c7214c8f989ca7d6f0f22823 Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 9101ea8324714b0aaf54d5d43419e9ff Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 27 04:52:07.463837 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'flavor_id': '2074608029', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance: Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 27 04:52:07.464478 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:07.465698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:07.478987 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:07.478987 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:07.478987 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:52:07.478987 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:52:07.478987 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 04:52:07.478987 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:07.478987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cff9f8c1-c348-4746-94ab-c555d6b7a908 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:07.478987 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cff9f8c1-c348-4746-94ab-c555d6b7a908 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.048965 Aug 27 04:52:07.478987 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 80/137] 10.222.0.58 () {60 vars in 1265 bytes} [Sat Aug 27 04:52:07 2022] PUT /compute/v2.1/flavors/2074608029/os-extra_specs/hw:numa_nodes => generated 117 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:52:07.500613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-99f1931d-997c-4213-81cc-428a62582fc9 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] Calling method '.version_select at 0x7fb565ea59d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:07.900207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76d221f1-a66b-43c7-b7a7-5b201542e837 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:07.901273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76d221f1-a66b-43c7-b7a7-5b201542e837 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:07.901723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76d221f1-a66b-43c7-b7a7-5b201542e837 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:07.906836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76d221f1-a66b-43c7-b7a7-5b201542e837 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:07.908639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76d221f1-a66b-43c7-b7a7-5b201542e837 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:07.909147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76d221f1-a66b-43c7-b7a7-5b201542e837 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:08.011021 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-99f1931d-997c-4213-81cc-428a62582fc9 tempest-QuotasAdminTestV236-40536851 tempest-QuotasAdminTestV236-40536851-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/de1d08d708184aa7a03610d975b862a1?user_id=df1c529a7f0a4c7db328c3007f0940a0" status: 200 len: 282 microversion: 2.36 time: 0.544221 Aug 27 04:52:08.021837 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 81/138] 10.222.0.58 () {60 vars in 1364 bytes} [Sat Aug 27 04:52:07 2022] GET /compute/v2.1/os-quota-sets/de1d08d708184aa7a03610d975b862a1?user_id=df1c529a7f0a4c7db328c3007f0940a0 => generated 282 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:52:08.040998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d5c46a97-73ad-48f9-bef2-1d22a474ae76 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:08.048735 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-76d221f1-a66b-43c7-b7a7-5b201542e837 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1" status: 200 len: 329 microversion: 2.1 time: 0.683479 Aug 27 04:52:08.050793 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 58/139] 10.222.0.58 () {60 vars in 1262 bytes} [Sat Aug 27 04:52:07 2022] PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1 => generated 329 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:08.088047 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d5c46a97-73ad-48f9-bef2-1d22a474ae76 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/2074608029" status: 202 len: 0 microversion: 2.1 time: 0.058045 Aug 27 04:52:08.090697 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 82/140] 10.222.0.58 () {58 vars in 1161 bytes} [Sat Aug 27 04:52:08 2022] DELETE /compute/v2.1/flavors/2074608029 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:52:08.097677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-503f3b21-0a77-48dd-a8f9-59d4fba28f06 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:08.098301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-503f3b21-0a77-48dd-a8f9-59d4fba28f06 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:08.112356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503f3b21-0a77-48dd-a8f9-59d4fba28f06 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:08.113121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503f3b21-0a77-48dd-a8f9-59d4fba28f06 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:08.113714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503f3b21-0a77-48dd-a8f9-59d4fba28f06 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:08.114617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503f3b21-0a77-48dd-a8f9-59d4fba28f06 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:08.115378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503f3b21-0a77-48dd-a8f9-59d4fba28f06 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:08.116362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503f3b21-0a77-48dd-a8f9-59d4fba28f06 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:08.426884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-503f3b21-0a77-48dd-a8f9-59d4fba28f06 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:08.435982 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-503f3b21-0a77-48dd-a8f9-59d4fba28f06 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.342630 Aug 27 04:52:08.440958 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 83/141] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:08 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:08.446901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f218dced-7d9d-4190-a8a8-ffb665f39794 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Calling method '.version_select at 0x7fb565cf9a60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:08.698535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-106b68c8-bd11-44c2-9da2-e148ca4ea873 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:08.730283 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-106b68c8-bd11-44c2-9da2-e148ca4ea873 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.677225 Aug 27 04:52:08.731897 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 59/142] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 04:52:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:08.749351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-77483096-557f-43be-b64a-16e3fe810c39 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:08.848009 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-77483096-557f-43be-b64a-16e3fe810c39 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263 tempest-FlavorsExtraSpecsNegativeTestJSON-857369263-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.114820 Aug 27 04:52:08.848813 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 60/143] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:52:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:08.857066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8f74164-3687-4ebc-8ce2-37340314bd0f tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:08.859619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8f74164-3687-4ebc-8ce2-37340314bd0f tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:08.870629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8f74164-3687-4ebc-8ce2-37340314bd0f tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:08.871247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8f74164-3687-4ebc-8ce2-37340314bd0f tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:08.871839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8f74164-3687-4ebc-8ce2-37340314bd0f tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:08.873081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8f74164-3687-4ebc-8ce2-37340314bd0f tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:08.873601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8f74164-3687-4ebc-8ce2-37340314bd0f tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:08.874086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8f74164-3687-4ebc-8ce2-37340314bd0f tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:09.318018 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f218dced-7d9d-4190-a8a8-ffb665f39794 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1" status: 200 len: 371 microversion: 2.1 time: 0.859261 Aug 27 04:52:09.320349 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 84/144] 10.222.0.58 () {58 vars in 1242 bytes} [Sat Aug 27 04:52:08 2022] GET /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1 => generated 371 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:09.513613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8f74164-3687-4ebc-8ce2-37340314bd0f tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:09.527135 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8f74164-3687-4ebc-8ce2-37340314bd0f tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1489 microversion: 2.1 time: 0.676374 Aug 27 04:52:09.528068 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 61/145] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:08 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1489 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:09.535406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-acad5ab8-b953-4340-bd80-9d99ad9341e7 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Action: 'update', calling method: .version_select at 0x7fb565ed6f70>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:10.172937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-10cbe5b4-faee-4adc-b0f7-f5b7df48b6a6 tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1163725230", "id": 354078131, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:10.219521 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-10cbe5b4-faee-4adc-b0f7-f5b7df48b6a6 tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.897868 Aug 27 04:52:10.230449 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 85/146] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:09 2022] POST /compute/v2.1/flavors => generated 422 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:10.243004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1a637953-9b1b-4dca-8d99-2e6f6a4ee6f0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:10.244035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1a637953-9b1b-4dca-8d99-2e6f6a4ee6f0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:10.262785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a637953-9b1b-4dca-8d99-2e6f6a4ee6f0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:10.264112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a637953-9b1b-4dca-8d99-2e6f6a4ee6f0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:10.264721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a637953-9b1b-4dca-8d99-2e6f6a4ee6f0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:10.266191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a637953-9b1b-4dca-8d99-2e6f6a4ee6f0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:10.266864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a637953-9b1b-4dca-8d99-2e6f6a4ee6f0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:10.268191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a637953-9b1b-4dca-8d99-2e6f6a4ee6f0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:10.477858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acad5ab8-b953-4340-bd80-9d99ad9341e7 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:10.481020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acad5ab8-b953-4340-bd80-9d99ad9341e7 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:10.483621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acad5ab8-b953-4340-bd80-9d99ad9341e7 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:10.484640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acad5ab8-b953-4340-bd80-9d99ad9341e7 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:10.485445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acad5ab8-b953-4340-bd80-9d99ad9341e7 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:10.495146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acad5ab8-b953-4340-bd80-9d99ad9341e7 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:10.624363 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-acad5ab8-b953-4340-bd80-9d99ad9341e7 tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1" status: 200 len: 325 microversion: 2.1 time: 1.095318 Aug 27 04:52:10.626002 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 62/147] 10.222.0.58 () {60 vars in 1262 bytes} [Sat Aug 27 04:52:09 2022] PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1 => generated 325 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:10.632774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e8ace6a-b602-4f40-8c31-7044da6a2d33 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:10.633771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e8ace6a-b602-4f40-8c31-7044da6a2d33 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:10.642144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e8ace6a-b602-4f40-8c31-7044da6a2d33 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:10.643816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e8ace6a-b602-4f40-8c31-7044da6a2d33 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:10.644699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e8ace6a-b602-4f40-8c31-7044da6a2d33 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:10.645630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e8ace6a-b602-4f40-8c31-7044da6a2d33 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:10.646310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e8ace6a-b602-4f40-8c31-7044da6a2d33 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:10.646935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e8ace6a-b602-4f40-8c31-7044da6a2d33 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:10.665411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1a637953-9b1b-4dca-8d99-2e6f6a4ee6f0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:10.680099 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1a637953-9b1b-4dca-8d99-2e6f6a4ee6f0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.446516 Aug 27 04:52:10.682955 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 86/148] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:10 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:10.827773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4f656b2b-b34b-49d4-8c91-d0d9d9309845 tempest-FlavorsV2NegativeTest-583036413 tempest-FlavorsV2NegativeTest-583036413-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:10.853171 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4f656b2b-b34b-49d4-8c91-d0d9d9309845 tempest-FlavorsV2NegativeTest-583036413 tempest-FlavorsV2NegativeTest-583036413-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.162208 Aug 27 04:52:10.855715 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 87/149] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 04:52:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:10.892458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40054600-5532-4cde-92c8-1101efda2fde tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:10.905597 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40054600-5532-4cde-92c8-1101efda2fde tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035456 Aug 27 04:52:10.920282 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 88/150] 10.222.0.58 () {58 vars in 1182 bytes} [Sat Aug 27 04:52:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:52:10.935441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1105696367", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:11.107480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:52:11.824229 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e8ace6a-b602-4f40-8c31-7044da6a2d33 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1642 microversion: 2.1 time: 1.196890 Aug 27 04:52:11.839010 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 63/151] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:10 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1642 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:11.844169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c95c83e5-0a5d-4519-aaf5-50b3f026845a tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-115432199", "id": 620994732, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:11.865162 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c95c83e5-0a5d-4519-aaf5-50b3f026845a tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.024475 Aug 27 04:52:11.872908 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 64/152] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:11 2022] POST /compute/v2.1/flavors => generated 421 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:11.880515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-239446eb-ebbc-44ac-af1a-fa7d82d7c762 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:11.881486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-239446eb-ebbc-44ac-af1a-fa7d82d7c762 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:11.898554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239446eb-ebbc-44ac-af1a-fa7d82d7c762 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:11.899271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239446eb-ebbc-44ac-af1a-fa7d82d7c762 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:11.901625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239446eb-ebbc-44ac-af1a-fa7d82d7c762 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:11.903250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239446eb-ebbc-44ac-af1a-fa7d82d7c762 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:11.904603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239446eb-ebbc-44ac-af1a-fa7d82d7c762 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:11.906731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239446eb-ebbc-44ac-af1a-fa7d82d7c762 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:11.914181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:11.914707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:11.917382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:11.917813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:11.921021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:11.944787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:11.945274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:11.945720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:11.946431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:11.946879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:11.947328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:11.975761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:11.990997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Getting quotas for project f5a19403d3f8481b8ffe1d0ad81654b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:12.006159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Getting quotas for user ec1e2ab56d544cc6a8cbb265ba824e91 and project f5a19403d3f8481b8ffe1d0ad81654b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:12.050245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.utils [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] ram quota exceeded for f5a19403d3f8481b8ffe1d0ad81654b1, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128547) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 04:52:12.051134 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Request method failure captured: Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 145 Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLpXpR35AAzpnYpno2X9RhK3bgVufmuDKKgXekmB4gB9JIrGWGGcWeMcg5OORUNZlAXAwUYrEGNGpEA_yUAj-O8INpMH4ntlUr-EXVEO0DdzQun4Rvja6Kc1MQdzoEuTr2Si_oenUIp65ZTqtA26b-uoFcRHnj2s2wCb1-kdHKdOEM Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: f5a19403d3f8481b8ffe1d0ad81654b1 Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:52:12.053911 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5a19403d3f8481b8ffe1d0ad81654b1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: f5a19403d3f8481b8ffe1d0ad81654b1 Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-QuotasAdminNegativeTest-2000743948-project Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ec1e2ab56d544cc6a8cbb265ba824e91 Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-QuotasAdminNegativeTest-2000743948-project Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1105696367", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} Aug 27 04:52:12.055059 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1105696367', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452'}}} Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 04:52:12.055941 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:12.056934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:12.057995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:12.059063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:12.059063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:12.059063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:12.059063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:12.059063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 04:52:12.059063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:12.060693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:12.061708 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-372eb36c-58bf-49a1-b5c0-3896d36afe71 tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.138886 Aug 27 04:52:12.062837 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 89/153] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 1142 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:12.228570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-239446eb-ebbc-44ac-af1a-fa7d82d7c762 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:12.247044 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-239446eb-ebbc-44ac-af1a-fa7d82d7c762 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.371566 Aug 27 04:52:12.258252 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 65/154] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:11 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:12.290573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-26be5d43-0899-4280-b388-e33a7e896ad9 tempest-FlavorsV2NegativeTest-583036413 tempest-FlavorsV2NegativeTest-583036413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1359518438", "imageRef": "5ab863d1-fbe9-4fb6-ac31-4b054a783ee5", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:12.460675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-26be5d43-0899-4280-b388-e33a7e896ad9 tempest-FlavorsV2NegativeTest-583036413 tempest-FlavorsV2NegativeTest-583036413-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:52:12.793131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4614b418-3785-435e-a5f0-155b9d768d93 req-e06933e9-047e-4010-8ba0-85453ccd1dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76b1f89-4300-4c14-9299-51c6671a77bc", "tag": "ab278b97-18fc-43fb-b561-b8c7d0b85e66"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:12.819781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4614b418-3785-435e-a5f0-155b9d768d93 req-e06933e9-047e-4010-8ba0-85453ccd1dc2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:12.821332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4614b418-3785-435e-a5f0-155b9d768d93 req-e06933e9-047e-4010-8ba0-85453ccd1dc2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:12.821977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4614b418-3785-435e-a5f0-155b9d768d93 req-e06933e9-047e-4010-8ba0-85453ccd1dc2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:12.847402 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4614b418-3785-435e-a5f0-155b9d768d93 req-e06933e9-047e-4010-8ba0-85453ccd1dc2 service nova] Creating event network-changed:ab278b97-18fc-43fb-b561-b8c7d0b85e66 for instance f76b1f89-4300-4c14-9299-51c6671a77bc on n-h1-820368-35 Aug 27 04:52:12.848469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4614b418-3785-435e-a5f0-155b9d768d93 req-e06933e9-047e-4010-8ba0-85453ccd1dc2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:52:12.849195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4614b418-3785-435e-a5f0-155b9d768d93 req-e06933e9-047e-4010-8ba0-85453ccd1dc2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:52:12.850567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f50ec3d-e912-42e4-9e7d-38ca8e32b956 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:12.851267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f50ec3d-e912-42e4-9e7d-38ca8e32b956 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:12.851962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f50ec3d-e912-42e4-9e7d-38ca8e32b956 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:12.852889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f50ec3d-e912-42e4-9e7d-38ca8e32b956 None None] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:12.857001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f50ec3d-e912-42e4-9e7d-38ca8e32b956 None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:12.857673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f50ec3d-e912-42e4-9e7d-38ca8e32b956 None None] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:12.870705 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.compute.rpcapi [None req-7f50ec3d-e912-42e4-9e7d-38ca8e32b956 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Aug 27 04:52:12.872068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f50ec3d-e912-42e4-9e7d-38ca8e32b956 None None] Releasing lock "compute-rpcapi-router" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:52:12.898240 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7f50ec3d-e912-42e4-9e7d-38ca8e32b956 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.833837 Aug 27 04:52:12.899668 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 90/155] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:12.910400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b688743b-eae0-4651-bb4f-6cc65d42eb33 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:12.911581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b688743b-eae0-4651-bb4f-6cc65d42eb33 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:12.920906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b688743b-eae0-4651-bb4f-6cc65d42eb33 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:12.922485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b688743b-eae0-4651-bb4f-6cc65d42eb33 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:12.923562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b688743b-eae0-4651-bb4f-6cc65d42eb33 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:12.925846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b688743b-eae0-4651-bb4f-6cc65d42eb33 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:12.926498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b688743b-eae0-4651-bb4f-6cc65d42eb33 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:12.928005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b688743b-eae0-4651-bb4f-6cc65d42eb33 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:12.985842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b688743b-eae0-4651-bb4f-6cc65d42eb33 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:52:13.296786 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b688743b-eae0-4651-bb4f-6cc65d42eb33 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 204 len: 0 microversion: 2.1 time: 0.392457 Aug 27 04:52:13.297439 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 91/156] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:52:12 2022] DELETE /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:13.305784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5c699a49-cbdb-46e8-999c-2fd4cdf7f3cc tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:13.318123 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5c699a49-cbdb-46e8-999c-2fd4cdf7f3cc tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019219 Aug 27 04:52:13.318702 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 92/157] 10.222.0.58 () {58 vars in 1182 bytes} [Sat Aug 27 04:52:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:52:13.334871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5fc2da6e-85f6-46cc-861d-3cc94beaf83b tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Action: 'update', calling method: .version_select at 0x7fb565d1c670>, body: {"quota_set": {"ram": 51200}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:13.456891 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-26be5d43-0899-4280-b388-e33a7e896ad9 tempest-FlavorsV2NegativeTest-583036413 tempest-FlavorsV2NegativeTest-583036413-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-26be5d43-0899-4280-b388-e33a7e896ad9 tempest-FlavorsV2NegativeTest-583036413 tempest-FlavorsV2NegativeTest-583036413-project] Request method failure captured: Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 143 Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaL5f33FARCxvdQD6NomLO3mH1sl49Sk7BnG9SzQqkUW5d3UMo95PAb0L_vnPkLOuPskoWCyzYfl7qq01q5T77U759PdD4pBCW57F9lfnhdBT681F96AImFQMP3D_CPYUcwhc26Y4Q0piWq3HFzkBHNZ2hQdCK0B_Xl1UpeqXW8bE7w Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 40dd0a38efd94676bc66449f1676551b Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FlavorsV2NegativeTest-583036413 Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:13.458606 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_40dd0a38efd94676bc66449f1676551b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/40dd0a38efd94676bc66449f1676551b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/40dd0a38efd94676bc66449f1676551b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/40dd0a38efd94676bc66449f1676551b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FlavorsV2NegativeTest-583036413 Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 40dd0a38efd94676bc66449f1676551b Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-583036413 Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FlavorsV2NegativeTest-583036413-project Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 04bebb3b07bf4de4b053b9c0e49263c6 Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FlavorsV2NegativeTest-583036413-project Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1359518438", "imageRef": "5ab863d1-fbe9-4fb6-ac31-4b054a783ee5", "flavorRef": "452"}} Aug 27 04:52:13.460198 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: exception: Flavor's memory is too small for requested image. Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1359518438', 'imageRef': '5ab863d1-fbe9-4fb6-ac31-4b054a783ee5', 'flavorRef': '452'}}} Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:13.461053 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:13.462158 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:13.463411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:13.463411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:13.463411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:13.463411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:13.463411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 27 04:52:13.463411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:13.463411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-26be5d43-0899-4280-b388-e33a7e896ad9 tempest-FlavorsV2NegativeTest-583036413 tempest-FlavorsV2NegativeTest-583036413-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:13.463411 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-26be5d43-0899-4280-b388-e33a7e896ad9 tempest-FlavorsV2NegativeTest-583036413 tempest-FlavorsV2NegativeTest-583036413-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.200901 Aug 27 04:52:13.463411 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 66/158] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:12 2022] POST /compute/v2.1/servers => generated 93 bytes in 1202 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:13.466678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-847b8daf-074a-43cb-bc95-c166938273dc tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:13.467325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-847b8daf-074a-43cb-bc95-c166938273dc tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:13.494146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847b8daf-074a-43cb-bc95-c166938273dc tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:13.494647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847b8daf-074a-43cb-bc95-c166938273dc tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:13.495082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847b8daf-074a-43cb-bc95-c166938273dc tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:13.495822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847b8daf-074a-43cb-bc95-c166938273dc tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:13.496280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847b8daf-074a-43cb-bc95-c166938273dc tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:13.496819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847b8daf-074a-43cb-bc95-c166938273dc tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:13.854891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fc2da6e-85f6-46cc-861d-3cc94beaf83b tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:13.855574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fc2da6e-85f6-46cc-861d-3cc94beaf83b tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:13.856092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fc2da6e-85f6-46cc-861d-3cc94beaf83b tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:13.856987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fc2da6e-85f6-46cc-861d-3cc94beaf83b tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:13.859268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fc2da6e-85f6-46cc-861d-3cc94beaf83b tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:13.859989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fc2da6e-85f6-46cc-861d-3cc94beaf83b tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:13.946536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-847b8daf-074a-43cb-bc95-c166938273dc tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:13.962009 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-847b8daf-074a-43cb-bc95-c166938273dc tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.497597 Aug 27 04:52:13.975362 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 67/159] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:13 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:13.975362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9135ef0a-c33f-4c81-b72a-7ab7b2c2b80c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:13.975362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9135ef0a-c33f-4c81-b72a-7ab7b2c2b80c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:13.985482 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5fc2da6e-85f6-46cc-861d-3cc94beaf83b tempest-QuotasAdminNegativeTest-1614612013 tempest-QuotasAdminNegativeTest-1614612013-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1" status: 200 len: 329 microversion: 2.1 time: 0.659608 Aug 27 04:52:13.986606 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 93/160] 10.222.0.58 () {60 vars in 1262 bytes} [Sat Aug 27 04:52:13 2022] PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1 => generated 329 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:13.989457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9135ef0a-c33f-4c81-b72a-7ab7b2c2b80c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:13.991529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9135ef0a-c33f-4c81-b72a-7ab7b2c2b80c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:13.994086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9135ef0a-c33f-4c81-b72a-7ab7b2c2b80c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:13.997406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8db65820-4015-4d13-a89c-d815cb882760 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Action: 'create', calling method: .version_select at 0x7fb565cf9f70>, body: {"keypair": {"name": "tempest-keypair-1341876475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLEG4CnqNsctvyM8bXi/Y0frcn7OqjsnKrTYHRyf0+XELirxqIiQ6gFMOizQmf+o7y1qOnwiytFdZL3PfSA/BacPGAzi9pQNBANvYY7Hw9AXEPFVszdGiCykwRObIW5tQ=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:14.010984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9135ef0a-c33f-4c81-b72a-7ab7b2c2b80c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:14.011632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9135ef0a-c33f-4c81-b72a-7ab7b2c2b80c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:14.012631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9135ef0a-c33f-4c81-b72a-7ab7b2c2b80c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:14.053681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-8db65820-4015-4d13-a89c-d815cb882760 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Getting quotas for project c83a0d500b9c445ea02dc63360a3c4cf. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:14.065545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-8db65820-4015-4d13-a89c-d815cb882760 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Getting quotas for user ddc99cf572d545be8638aaeb6f59749d and project c83a0d500b9c445ea02dc63360a3c4cf. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:14.131493 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8db65820-4015-4d13-a89c-d815cb882760 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143003 Aug 27 04:52:14.135137 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 94/161] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 04:52:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:14.137026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd822949-7a90-4622-b1b7-793322d36b4a tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Action: 'update', calling method: .version_select at 0x7fb565cf9ee0>, body: {"quota_set": {"ram": 0}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:14.144179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cd822949-7a90-4622-b1b7-793322d36b4a tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'ec1e2ab56d544cc6a8cbb265ba824e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a19403d3f8481b8ffe1d0ad81654b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd822949-7a90-4622-b1b7-793322d36b4a tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Request method failure captured: Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: request: PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1 HTTP/1.1 Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 25 Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLpXpR35AAzpnYpno2X9RhK3bgVufmuDKKgXekmB4gB9JIrGWGGcWeMcg5OORUNZlAXAwUYrEGNGpEA_yUAj-O8INpMH4ntlUr-EXVEO0DdzQun4Rvja6Kc1MQdzoEuTr2Si_oenUIp65ZTqtA26b-uoFcRHnj2s2wCb1-kdHKdOEM Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: f5a19403d3f8481b8ffe1d0ad81654b1 Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:52:14.152282 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5a19403d3f8481b8ffe1d0ad81654b1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5a19403d3f8481b8ffe1d0ad81654b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: f5a19403d3f8481b8ffe1d0ad81654b1 Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2000743948 Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-QuotasAdminNegativeTest-2000743948-project Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ec1e2ab56d544cc6a8cbb265ba824e91 Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-QuotasAdminNegativeTest-2000743948-project Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: {"quota_set": {"ram": 0}} Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 04:52:14.153704 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'f5a19403d3f8481b8ffe1d0ad81654b1', 'body': {'quota_set': {'ram': 0}}} Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:14.154636 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:14.155892 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:14.157163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:14.157163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:14.157163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:14.157163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:14.157163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 04:52:14.157163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:14.157163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd822949-7a90-4622-b1b7-793322d36b4a tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:14.157163 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cd822949-7a90-4622-b1b7-793322d36b4a tempest-QuotasAdminNegativeTest-2000743948 tempest-QuotasAdminNegativeTest-2000743948-project] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1" status: 403 len: 116 microversion: 2.1 time: 0.020378 Aug 27 04:52:14.157163 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 95/162] 10.222.0.58 () {60 vars in 1262 bytes} [Sat Aug 27 04:52:14 2022] PUT /compute/v2.1/os-quota-sets/f5a19403d3f8481b8ffe1d0ad81654b1 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:14.334225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9135ef0a-c33f-4c81-b72a-7ab7b2c2b80c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:14.342242 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9135ef0a-c33f-4c81-b72a-7ab7b2c2b80c tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1495 microversion: 2.1 time: 0.377386 Aug 27 04:52:14.342849 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 68/163] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:13 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1495 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:14.986533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1fe0862-9b18-4a9f-8bc6-5adb652a722f tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:14.987558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1fe0862-9b18-4a9f-8bc6-5adb652a722f tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:15.004545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1fe0862-9b18-4a9f-8bc6-5adb652a722f tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:15.005593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1fe0862-9b18-4a9f-8bc6-5adb652a722f tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:15.006305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1fe0862-9b18-4a9f-8bc6-5adb652a722f tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:15.008095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1fe0862-9b18-4a9f-8bc6-5adb652a722f tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:15.008798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1fe0862-9b18-4a9f-8bc6-5adb652a722f tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:15.009534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1fe0862-9b18-4a9f-8bc6-5adb652a722f tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:15.364995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af1e5ba4-eb51-43d3-8e20-0a067d01a7ff tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:15.365618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-af1e5ba4-eb51-43d3-8e20-0a067d01a7ff tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:15.378334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e5ba4-eb51-43d3-8e20-0a067d01a7ff tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:15.381317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e5ba4-eb51-43d3-8e20-0a067d01a7ff tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:15.382109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e5ba4-eb51-43d3-8e20-0a067d01a7ff tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:15.383119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e5ba4-eb51-43d3-8e20-0a067d01a7ff tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:15.385593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e5ba4-eb51-43d3-8e20-0a067d01a7ff tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:15.386210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e5ba4-eb51-43d3-8e20-0a067d01a7ff tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:15.971743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1fe0862-9b18-4a9f-8bc6-5adb652a722f tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:15.981602 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1fe0862-9b18-4a9f-8bc6-5adb652a722f tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.998942 Aug 27 04:52:15.985245 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 96/164] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:14 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:16.297419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af1e5ba4-eb51-43d3-8e20-0a067d01a7ff tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:16.321861 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af1e5ba4-eb51-43d3-8e20-0a067d01a7ff tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1495 microversion: 2.1 time: 0.960791 Aug 27 04:52:16.326160 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 69/165] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:15 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1495 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:17.006066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a5471be-2128-4149-bb26-41ad6131e1d0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:17.006690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a5471be-2128-4149-bb26-41ad6131e1d0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:17.020184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a5471be-2128-4149-bb26-41ad6131e1d0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:17.023059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a5471be-2128-4149-bb26-41ad6131e1d0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:17.023547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a5471be-2128-4149-bb26-41ad6131e1d0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:17.026538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a5471be-2128-4149-bb26-41ad6131e1d0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:17.027070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a5471be-2128-4149-bb26-41ad6131e1d0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:17.027643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a5471be-2128-4149-bb26-41ad6131e1d0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:17.349107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3575e7cd-ec7c-4319-9a69-d7c1d676c69b tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:17.350479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3575e7cd-ec7c-4319-9a69-d7c1d676c69b tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:17.360152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3575e7cd-ec7c-4319-9a69-d7c1d676c69b tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:17.360645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3575e7cd-ec7c-4319-9a69-d7c1d676c69b tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:17.361628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3575e7cd-ec7c-4319-9a69-d7c1d676c69b tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:17.362334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3575e7cd-ec7c-4319-9a69-d7c1d676c69b tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:17.362782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3575e7cd-ec7c-4319-9a69-d7c1d676c69b tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:17.366314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3575e7cd-ec7c-4319-9a69-d7c1d676c69b tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:17.637934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3575e7cd-ec7c-4319-9a69-d7c1d676c69b tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267f37b81d5c47b9adc31fc11f9b74d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3022e36374f4afb9675d52829bdae29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:17.652493 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3575e7cd-ec7c-4319-9a69-d7c1d676c69b tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 200 len: 1453 microversion: 2.1 time: 0.309976 Aug 27 04:52:17.669812 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 70/166] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:17 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 1453 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:17.692108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-3dd85947-b947-46af-9f14-397cb8f63937 req-fceefd17-98d4-4c6f-94ad-9a0be5d45e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2655c565-885b-4871-bdef-e28e07fb44aa", "name": "network-vif-deleted", "tag": "9d9cd12c-5570-4b60-8cfb-e7a05c1d10f2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:17.711877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3dd85947-b947-46af-9f14-397cb8f63937 req-fceefd17-98d4-4c6f-94ad-9a0be5d45e3e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:17.712753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3dd85947-b947-46af-9f14-397cb8f63937 req-fceefd17-98d4-4c6f-94ad-9a0be5d45e3e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:17.714665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3dd85947-b947-46af-9f14-397cb8f63937 req-fceefd17-98d4-4c6f-94ad-9a0be5d45e3e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:17.738462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a5471be-2128-4149-bb26-41ad6131e1d0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:17.740027 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-3dd85947-b947-46af-9f14-397cb8f63937 req-fceefd17-98d4-4c6f-94ad-9a0be5d45e3e service nova] Creating event network-vif-deleted:9d9cd12c-5570-4b60-8cfb-e7a05c1d10f2 for instance 2655c565-885b-4871-bdef-e28e07fb44aa on n-h2-820368-35 Aug 27 04:52:17.746787 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-3dd85947-b947-46af-9f14-397cb8f63937 req-fceefd17-98d4-4c6f-94ad-9a0be5d45e3e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059052 Aug 27 04:52:17.751393 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a5471be-2128-4149-bb26-41ad6131e1d0 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.746152 Aug 27 04:52:17.754019 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 71/167] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:52:17.763859 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 97/168] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:16 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:18.467961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a8cec654-7aa1-46e2-8efd-9ece2346e8c5 tempest-FlavorsV261TestJSON-453565756 tempest-FlavorsV261TestJSON-453565756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-456738566", "id": 877825984, "os-flavor-access:is_public": "True"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:18.506830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a8cec654-7aa1-46e2-8efd-9ece2346e8c5 tempest-FlavorsV261TestJSON-453565756 tempest-FlavorsV261TestJSON-453565756-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.524296 Aug 27 04:52:18.507768 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 72/169] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 04:52:17 2022] POST /compute/v2.1/flavors => generated 464 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:52:18.519393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1873436874", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "620994732", "adminPass": "***", "networks": [{"uuid": "d7928017-ad01-4c58-b5a0-c8dfbe169b07"}], "security_groups": [{"name": "tempest-securitygroup--141916901"}], "key_name": "tempest-keypair-1341876475", "user_data": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:18.673292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1827008981", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": "none"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:18.700694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] validate_networks() for [('d7928017-ad01-4c58-b5a0-c8dfbe169b07', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:52:18.758578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:18.759280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:18.760414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:18.760992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:18.762042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:18.784084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:18.785020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:18.793008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:18.794002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:18.795107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:18.796419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:18.837587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Getting quotas for project c2acba01e0a94222a710cc9d02258b79. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:18.843179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Getting quotas for user 1b28f7bfa194488f92f834e9fd6a2425 and project c2acba01e0a94222a710cc9d02258b79. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:18.885227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:52:18.894651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:52:19.002186 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5a1d50b0-ea75-4867-8537-750fc63288a2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.886423 Aug 27 04:52:19.004818 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 98/170] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 04:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:52:19.364951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-834f519b-67ab-4617-9b3e-5922ccdbd690 tempest-FlavorsV261TestJSON-1123684534 tempest-FlavorsV261TestJSON-1123684534-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:19.383888 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-834f519b-67ab-4617-9b3e-5922ccdbd690 tempest-FlavorsV261TestJSON-1123684534 tempest-FlavorsV261TestJSON-1123684534-project] 10.222.0.58 "GET /compute/v2.1/flavors/877825984" status: 200 len: 464 microversion: 2.61 time: 0.373260 Aug 27 04:52:19.388632 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 99/171] 10.222.0.58 () {60 vars in 1196 bytes} [Sat Aug 27 04:52:19 2022] GET /compute/v2.1/flavors/877825984 => generated 464 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:52:19.394309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:19.395432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:19.402875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:19.403788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:19.404811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:19.405987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:19.407124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:19.408036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:19.423219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:19.424975 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] HTTP exception thrown: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Request method failure captured: Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa HTTP/1.1 Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLN69wXEKTYUzSbq2hKgkcY6SQrHPhih7ffzIQPEAM-rC1gQ8bsytppP12fPpVysqY3qnyDiUO4AtesXhHiKcYavmsEbKCyxKqXVOBLq6HlTrZ9kVl8H0ILdBqiIYw6h_KQMEfmGLK1hq3TYKXeJskO-KGfyCO9SlbZ6AV02AbAnVU Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: a3022e36374f4afb9675d52829bdae29 Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AggregatesAdminTestJSON-1606145396 Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:52:19.427305 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a3022e36374f4afb9675d52829bdae29", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a3022e36374f4afb9675d52829bdae29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a3022e36374f4afb9675d52829bdae29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a3022e36374f4afb9675d52829bdae29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AggregatesAdminTestJSON-1606145396 Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: a3022e36374f4afb9675d52829bdae29 Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1606145396 Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AggregatesAdminTestJSON-1606145396-project Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 267f37b81d5c47b9adc31fc11f9b74d8 Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AggregatesAdminTestJSON-1606145396-project Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:19.428478 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '2655c565-885b-4871-bdef-e28e07fb44aa'} Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:19.429212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:19.430306 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:19.431287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Returning 404 to user: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:19.431287 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-acd00b60-e827-4060-825e-b50c0abc658a tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 404 len: 111 microversion: 2.1 time: 0.038899 Aug 27 04:52:19.431287 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 100/172] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:19 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:19.644181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1762825892", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "051dccae-a303-46a8-a77e-49031a700014"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:19.757596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] validate_networks() for [('051dccae-a303-46a8-a77e-49031a700014', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:52:19.919895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:19.920707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:19.921858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:19.922368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:19.922781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:19.934757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:19.935549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:19.936141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:19.937095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:19.938508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:19.939191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:19.975847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Getting quotas for project c83a0d500b9c445ea02dc63360a3c4cf. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:19.986520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Getting quotas for user ddc99cf572d545be8638aaeb6f59749d and project c83a0d500b9c445ea02dc63360a3c4cf. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:20.006025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:52:20.008909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:52:20.139790 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3baa6183-3e81-4a49-8471-9e88a584b9e5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.630521 Aug 27 04:52:20.147286 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 73/173] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:52:20.156241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d036073b-827c-426e-9316-00f34bbb1e10 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:20.157042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d036073b-827c-426e-9316-00f34bbb1e10 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:20.171507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d036073b-827c-426e-9316-00f34bbb1e10 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:20.173482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d036073b-827c-426e-9316-00f34bbb1e10 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:20.173482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d036073b-827c-426e-9316-00f34bbb1e10 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:20.173909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d036073b-827c-426e-9316-00f34bbb1e10 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:20.174361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d036073b-827c-426e-9316-00f34bbb1e10 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:20.174784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d036073b-827c-426e-9316-00f34bbb1e10 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:20.356226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d036073b-827c-426e-9316-00f34bbb1e10 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:20.368356 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d036073b-827c-426e-9316-00f34bbb1e10 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.224342 Aug 27 04:52:20.368944 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 74/174] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:20 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:20.382789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:20.388824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:20.406906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:20.407428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:20.408579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:20.409352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:20.409900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:20.410243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.046213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:21.068893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:21.076763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:21.146173 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-29e20f20-098f-43db-9a17-bade41ec9b28 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "PUT /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1433 microversion: 2.75 time: 0.773706 Aug 27 04:52:21.169275 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 75/175] 10.222.0.58 () {62 vars in 1297 bytes} [Sat Aug 27 04:52:20 2022] PUT /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1433 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:21.169275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b238ca2c-d7bb-4458-bdf2-bd2048b1274a tempest-FlavorsV261TestJSON-453565756 tempest-FlavorsV261TestJSON-453565756-project-admin] Action: 'update', calling method: .version_select at 0x7fb56720a9d0>, body: {"flavor": {"description": "new"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:21.205304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:21.206214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:21.206871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:21.208099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:21.208527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:21.240493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.243791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.244517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.257359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.258151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.270092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.289544 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b238ca2c-d7bb-4458-bdf2-bd2048b1274a tempest-FlavorsV261TestJSON-453565756 tempest-FlavorsV261TestJSON-453565756-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/877825984" status: 200 len: 465 microversion: 2.61 time: 0.137986 Aug 27 04:52:21.290683 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 76/176] 10.222.0.58 () {62 vars in 1216 bytes} [Sat Aug 27 04:52:21 2022] PUT /compute/v2.1/flavors/877825984 => generated 465 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:52:21.295558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-23884ce5-e117-43ad-8f53-bb08fb6cf1ef tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:21.305285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=31 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:21.313692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:21.325670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23884ce5-e117-43ad-8f53-bb08fb6cf1ef tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.326774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23884ce5-e117-43ad-8f53-bb08fb6cf1ef tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.327429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23884ce5-e117-43ad-8f53-bb08fb6cf1ef tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.358497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:21.367175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Getting quotas for project f5c7422cdaca490aaffc4004f77d830c. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:21.379695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Getting quotas for user b7d4fe4aaf864bb58c162620c9948d89 and project f5c7422cdaca490aaffc4004f77d830c. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:21.450599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:52:21.453356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:52:21.614606 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-23884ce5-e117-43ad-8f53-bb08fb6cf1ef tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 300 microversion: 2.1 time: 0.318622 Aug 27 04:52:21.623656 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 77/177] 10.222.0.58 () {60 vars in 1191 bytes} [Sat Aug 27 04:52:21 2022] POST /compute/v2.1/os-aggregates/2/action => generated 300 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:21.631375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f2ea615-09da-4ba1-9f4c-df0af054c91c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:21.632755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f2ea615-09da-4ba1-9f4c-df0af054c91c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:21.640419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f2ea615-09da-4ba1-9f4c-df0af054c91c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.641223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f2ea615-09da-4ba1-9f4c-df0af054c91c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.641974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f2ea615-09da-4ba1-9f4c-df0af054c91c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.643484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f2ea615-09da-4ba1-9f4c-df0af054c91c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.644201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f2ea615-09da-4ba1-9f4c-df0af054c91c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.644833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f2ea615-09da-4ba1-9f4c-df0af054c91c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.654012 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0b9c95fe-6486-4f89-9669-e5c8802cfa98 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.223307 Aug 27 04:52:21.654673 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 101/178] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 04:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:52:21.666801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-723fb8a2-69cd-4aa3-8ca6-d3430e13d36c req-6a7f01e4-2dc8-40fe-ab68-76198fe5b0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76b1f89-4300-4c14-9299-51c6671a77bc", "name": "network-vif-plugged", "status": "completed", "tag": "ab278b97-18fc-43fb-b561-b8c7d0b85e66"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:21.705490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-723fb8a2-69cd-4aa3-8ca6-d3430e13d36c req-6a7f01e4-2dc8-40fe-ab68-76198fe5b0bb service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.708633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-723fb8a2-69cd-4aa3-8ca6-d3430e13d36c req-6a7f01e4-2dc8-40fe-ab68-76198fe5b0bb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.709325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-723fb8a2-69cd-4aa3-8ca6-d3430e13d36c req-6a7f01e4-2dc8-40fe-ab68-76198fe5b0bb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.729325 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-723fb8a2-69cd-4aa3-8ca6-d3430e13d36c req-6a7f01e4-2dc8-40fe-ab68-76198fe5b0bb service nova] Creating event network-vif-plugged:ab278b97-18fc-43fb-b561-b8c7d0b85e66 for instance f76b1f89-4300-4c14-9299-51c6671a77bc on n-h1-820368-35 Aug 27 04:52:21.736613 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-723fb8a2-69cd-4aa3-8ca6-d3430e13d36c req-6a7f01e4-2dc8-40fe-ab68-76198fe5b0bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073630 Aug 27 04:52:21.737478 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 102/179] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:21.743857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:21.744771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:21.759321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.759824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.760266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.760985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.770185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.770659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.822310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f2ea615-09da-4ba1-9f4c-df0af054c91c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:21.836575 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f2ea615-09da-4ba1-9f4c-df0af054c91c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1315 microversion: 2.1 time: 0.209732 Aug 27 04:52:21.838398 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 78/180] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:21 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:21.844245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a5919cb6-4878-4965-a874-22d1ee28c953 tempest-FlavorsV261TestJSON-1123684534 tempest-FlavorsV261TestJSON-1123684534-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:21.879973 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a5919cb6-4878-4965-a874-22d1ee28c953 tempest-FlavorsV261TestJSON-1123684534 tempest-FlavorsV261TestJSON-1123684534-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 7149 microversion: 2.61 time: 0.040125 Aug 27 04:52:21.881222 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 79/181] 10.222.0.58 () {60 vars in 1187 bytes} [Sat Aug 27 04:52:21 2022] GET /compute/v2.1/flavors/detail => generated 7149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:21.886201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b9fca809-118a-4992-bfbf-5d4f5013d00d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:21.887209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b9fca809-118a-4992-bfbf-5d4f5013d00d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:21.896915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9fca809-118a-4992-bfbf-5d4f5013d00d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.898401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9fca809-118a-4992-bfbf-5d4f5013d00d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.899514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9fca809-118a-4992-bfbf-5d4f5013d00d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.900729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9fca809-118a-4992-bfbf-5d4f5013d00d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.901706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9fca809-118a-4992-bfbf-5d4f5013d00d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.902340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9fca809-118a-4992-bfbf-5d4f5013d00d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:22.174771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b9fca809-118a-4992-bfbf-5d4f5013d00d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:22.187835 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b9fca809-118a-4992-bfbf-5d4f5013d00d tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.305286 Aug 27 04:52:22.188769 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 80/182] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:21 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:22.193504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-effe305d-77ac-4371-ace9-2272cadb5235 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:22.245970 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-effe305d-77ac-4371-ace9-2272cadb5235 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.055509 Aug 27 04:52:22.258585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:22.264459 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 81/183] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:22 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:22.277419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:22.278876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:22.280780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3998ab92-12cd-4ffa-88dd-5bd645ed82b3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:22.281399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3998ab92-12cd-4ffa-88dd-5bd645ed82b3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:22.295223 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2819b90f-110f-4e8c-bccf-89240046e4ec tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1417 microversion: 2.75 time: 0.555124 Aug 27 04:52:22.297412 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 103/184] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:21 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1417 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:22.315025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-92270d14-efbf-4a51-8dd9-d64d6d8ce2b6 tempest-FlavorsV261TestJSON-1123684534 tempest-FlavorsV261TestJSON-1123684534-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:22.386139 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-92270d14-efbf-4a51-8dd9-d64d6d8ce2b6 tempest-FlavorsV261TestJSON-1123684534 tempest-FlavorsV261TestJSON-1123684534-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3676 microversion: 2.61 time: 0.086787 Aug 27 04:52:22.387458 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 104/185] 10.222.0.58 () {60 vars in 1166 bytes} [Sat Aug 27 04:52:22 2022] GET /compute/v2.1/flavors => generated 3676 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:22.429668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3998ab92-12cd-4ffa-88dd-5bd645ed82b3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:22.446952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3998ab92-12cd-4ffa-88dd-5bd645ed82b3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:22.452408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3998ab92-12cd-4ffa-88dd-5bd645ed82b3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:22.456360 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3998ab92-12cd-4ffa-88dd-5bd645ed82b3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1262 microversion: 2.25 time: 0.189008 Aug 27 04:52:22.457814 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 82/186] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:22 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1262 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:22.464039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7f56f6ec-f2d5-4f08-9211-9b866bc15284 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-602673189"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:22.468531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-7f56f6ec-f2d5-4f08-9211-9b866bc15284 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Generated uuid e1ad30d6-83e4-436c-9386-91a69ff995e9 for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:22.502659 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7f56f6ec-f2d5-4f08-9211-9b866bc15284 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.043009 Aug 27 04:52:22.504168 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 83/187] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:22 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:22.509618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-92c3dc9c-ced5-46d4-a1c6-7fc1a83db339 tempest-FlavorsV261TestJSON-453565756 tempest-FlavorsV261TestJSON-453565756-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:22.704003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c49c5c8f-dd96-4063-817c-2bf26f4301b4 tempest-SecurityGroupsTestAdminJSON-1357535249 tempest-SecurityGroupsTestAdminJSON-1357535249-project] Action: 'create', calling method: .version_select at 0x7fb565cf9940>, body: {"security_group": {"name": "tempest-securitygroup-1784793002", "description": "tempest-description-1622682266"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:22.729768 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-92c3dc9c-ced5-46d4-a1c6-7fc1a83db339 tempest-FlavorsV261TestJSON-453565756 tempest-FlavorsV261TestJSON-453565756-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/877825984" status: 202 len: 0 microversion: 2.61 time: 0.222747 Aug 27 04:52:22.731274 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 84/188] 10.222.0.58 () {60 vars in 1199 bytes} [Sat Aug 27 04:52:22 2022] DELETE /compute/v2.1/flavors/877825984 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:22.745923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-417389fb-b36d-47e8-aaab-b52ce7a1b85a tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:22.769837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-417389fb-b36d-47e8-aaab-b52ce7a1b85a tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:22.770913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-417389fb-b36d-47e8-aaab-b52ce7a1b85a tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:22.771755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-417389fb-b36d-47e8-aaab-b52ce7a1b85a tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:22.981820 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-417389fb-b36d-47e8-aaab-b52ce7a1b85a tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.246435 Aug 27 04:52:22.982322 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 85/189] 10.222.0.58 () {60 vars in 1191 bytes} [Sat Aug 27 04:52:22 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:22.993442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ae4486c-2b25-4885-845e-c8960558ad0a tempest-FlavorsV261TestJSON-453565756 tempest-FlavorsV261TestJSON-453565756-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:23.022327 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ae4486c-2b25-4885-845e-c8960558ad0a tempest-FlavorsV261TestJSON-453565756 tempest-FlavorsV261TestJSON-453565756-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.038903 Aug 27 04:52:23.035135 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 86/190] 10.222.0.58 () {60 vars in 1187 bytes} [Sat Aug 27 04:52:22 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:23.035135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2486dc5e-583a-42f1-aff8-2afc2c687de6 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:23.035135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2486dc5e-583a-42f1-aff8-2afc2c687de6 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:23.036118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486dc5e-583a-42f1-aff8-2afc2c687de6 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.036625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486dc5e-583a-42f1-aff8-2afc2c687de6 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.037060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486dc5e-583a-42f1-aff8-2afc2c687de6 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.041605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486dc5e-583a-42f1-aff8-2afc2c687de6 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.041605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486dc5e-583a-42f1-aff8-2afc2c687de6 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.041605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486dc5e-583a-42f1-aff8-2afc2c687de6 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.123264 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c49c5c8f-dd96-4063-817c-2bf26f4301b4 tempest-SecurityGroupsTestAdminJSON-1357535249 tempest-SecurityGroupsTestAdminJSON-1357535249-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.734350 Aug 27 04:52:23.123727 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 105/191] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 04:52:22 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:23.128247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7fbb863-a4b8-4a7d-baf3-e5b427bfafe1 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:23.143439 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7fbb863-a4b8-4a7d-baf3-e5b427bfafe1 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.018576 Aug 27 04:52:23.154306 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 106/192] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 04:52:23 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:23.165631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9494144c-74ce-451b-9039-2854dde3551c tempest-SecurityGroupsTestAdminJSON-1357535249 tempest-SecurityGroupsTestAdminJSON-1357535249-project] Action: 'create', calling method: .version_select at 0x7fb565c3a940>, body: {"security_group": {"name": "tempest-securitygroup-872019760", "description": "tempest-description-971512712"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:23.280460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2486dc5e-583a-42f1-aff8-2afc2c687de6 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:23.302858 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2486dc5e-583a-42f1-aff8-2afc2c687de6 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1315 microversion: 2.1 time: 0.276582 Aug 27 04:52:23.319184 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 87/193] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:23 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:23.330408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3217b68a-91af-4696-b574-3b2992660f24 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:23.353701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3217b68a-91af-4696-b574-3b2992660f24 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.356275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3217b68a-91af-4696-b574-3b2992660f24 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.360367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3217b68a-91af-4696-b574-3b2992660f24 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.594327 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3217b68a-91af-4696-b574-3b2992660f24 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.274345 Aug 27 04:52:23.598710 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 88/194] 10.222.0.58 () {60 vars in 1191 bytes} [Sat Aug 27 04:52:23 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:23.611241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0caa5b43-ab52-4f1b-8cf0-b46e1ff43f8a tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:23.615900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0caa5b43-ab52-4f1b-8cf0-b46e1ff43f8a tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:23.633870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0caa5b43-ab52-4f1b-8cf0-b46e1ff43f8a tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.635509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0caa5b43-ab52-4f1b-8cf0-b46e1ff43f8a tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.639986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0caa5b43-ab52-4f1b-8cf0-b46e1ff43f8a tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.640904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0caa5b43-ab52-4f1b-8cf0-b46e1ff43f8a tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.641599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0caa5b43-ab52-4f1b-8cf0-b46e1ff43f8a tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.642238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0caa5b43-ab52-4f1b-8cf0-b46e1ff43f8a tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.765991 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9494144c-74ce-451b-9039-2854dde3551c tempest-SecurityGroupsTestAdminJSON-1357535249 tempest-SecurityGroupsTestAdminJSON-1357535249-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.616540 Aug 27 04:52:23.767870 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 107/195] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 04:52:23 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:23.772808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:23.773639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:23.777706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:23.788729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.789217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.789649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.790349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.790797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.791255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.873152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0caa5b43-ab52-4f1b-8cf0-b46e1ff43f8a tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:23.885200 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0caa5b43-ab52-4f1b-8cf0-b46e1ff43f8a tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1323 microversion: 2.1 time: 0.285176 Aug 27 04:52:23.885814 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 89/196] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:23 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1323 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:23.892566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:23.893477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:23.894705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:23.907140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:23.909239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:23.916053 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-28879f45-0d39-4520-8785-46a291c5dd58 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1417 microversion: 2.75 time: 0.146750 Aug 27 04:52:23.917096 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 108/197] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:23 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1417 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:23.918917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.922531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.924675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d7cba59-6854-40e3-8b54-63d1fff41e8b tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:23.928633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.935558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.936236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.936777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.968358 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d7cba59-6854-40e3-8b54-63d1fff41e8b tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.049879 Aug 27 04:52:23.969199 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 109/198] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:23 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:24.067206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:24.079206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:24.082216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:24.083999 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a62215d1-82a1-42e5-9a47-fb4a0d6bf99f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1314 microversion: 2.25 time: 0.196804 Aug 27 04:52:24.098601 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 90/199] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:23 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:24.106235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd355244-7412-483f-881e-21b75cd3917d tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1810111233"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:24.111349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-dd355244-7412-483f-881e-21b75cd3917d tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Generated uuid aad3379f-c611-4673-84df-72131cf299c6 for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:24.158566 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd355244-7412-483f-881e-21b75cd3917d tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058110 Aug 27 04:52:24.165367 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 91/200] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:24.174422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-56f67cdd-5837-4b48-9aa5-3bd0d6c36457 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:24.187937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56f67cdd-5837-4b48-9aa5-3bd0d6c36457 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:24.189420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56f67cdd-5837-4b48-9aa5-3bd0d6c36457 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:24.190210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56f67cdd-5837-4b48-9aa5-3bd0d6c36457 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:24.274487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ca5edff3-0922-4caa-b71a-dd12fcca62ef tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] Action: 'create', calling method: .version_select at 0x7fb565cf9940>, body: {"security_group": {"name": "tempest-securitygroup-963795680", "description": "tempest-description-1608502184"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:24.416533 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-56f67cdd-5837-4b48-9aa5-3bd0d6c36457 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.249068 Aug 27 04:52:24.417286 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 92/201] 10.222.0.58 () {60 vars in 1191 bytes} [Sat Aug 27 04:52:24 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:24.422208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-76b213cd-e206-4b51-8b69-ba0736841912 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:24.422817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-76b213cd-e206-4b51-8b69-ba0736841912 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:24.448120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76b213cd-e206-4b51-8b69-ba0736841912 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:24.448619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76b213cd-e206-4b51-8b69-ba0736841912 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:24.449045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76b213cd-e206-4b51-8b69-ba0736841912 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:24.449761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76b213cd-e206-4b51-8b69-ba0736841912 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:24.450212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76b213cd-e206-4b51-8b69-ba0736841912 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:24.450634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76b213cd-e206-4b51-8b69-ba0736841912 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:24.596381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-76b213cd-e206-4b51-8b69-ba0736841912 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:24.608518 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-76b213cd-e206-4b51-8b69-ba0736841912 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1333 microversion: 2.1 time: 0.190122 Aug 27 04:52:24.610153 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 93/202] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:24 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1333 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:24.632180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f4a34004-eb84-477b-8b51-2dbb876a2fe3 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:24.642077 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f4a34004-eb84-477b-8b51-2dbb876a2fe3 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.014375 Aug 27 04:52:24.643326 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 94/203] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 04:52:24 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:24.673792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2cb2ab75-3e2f-47c9-8fce-172d21b2d445 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:24.686710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cb2ab75-3e2f-47c9-8fce-172d21b2d445 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:24.687389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cb2ab75-3e2f-47c9-8fce-172d21b2d445 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:24.687823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cb2ab75-3e2f-47c9-8fce-172d21b2d445 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:24.904304 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2cb2ab75-3e2f-47c9-8fce-172d21b2d445 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.250086 Aug 27 04:52:24.907055 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 95/204] 10.222.0.58 () {60 vars in 1191 bytes} [Sat Aug 27 04:52:24 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:24.919820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1018284b-42b8-4ab2-b206-1c02ba02b2a3 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:24.921542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1018284b-42b8-4ab2-b206-1c02ba02b2a3 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:24.935775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1018284b-42b8-4ab2-b206-1c02ba02b2a3 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:24.936593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1018284b-42b8-4ab2-b206-1c02ba02b2a3 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:24.937895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1018284b-42b8-4ab2-b206-1c02ba02b2a3 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:24.949756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1018284b-42b8-4ab2-b206-1c02ba02b2a3 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:24.951706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1018284b-42b8-4ab2-b206-1c02ba02b2a3 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:24.953041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1018284b-42b8-4ab2-b206-1c02ba02b2a3 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.003241 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ca5edff3-0922-4caa-b71a-dd12fcca62ef tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.032477 Aug 27 04:52:25.004316 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 110/205] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 04:52:23 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:25.008507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68ae9c19-d0c7-4d76-99e2-2220582744da tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:25.054429 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68ae9c19-d0c7-4d76-99e2-2220582744da tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.049147 Aug 27 04:52:25.061098 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 111/206] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:25 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:25.066967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:25.072241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:25.083015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:25.088201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:25.088854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.089771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:25.090410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:25.091936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.326226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.337601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.346306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.362666 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b1650823-3869-47f0-9a60-8ab9c9431f27 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1417 microversion: 2.75 time: 0.297159 Aug 27 04:52:25.365687 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 112/207] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:25 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1417 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:25.383188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5243f8a3-3459-4d22-93e9-b5996354c98f tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] Action: 'create', calling method: .version_select at 0x7fb565c803a0>, body: {"security_group": {"name": "tempest-securitygroup-2014490679", "description": "tempest-description-1688151138"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:25.505663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1018284b-42b8-4ab2-b206-1c02ba02b2a3 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.521703 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1018284b-42b8-4ab2-b206-1c02ba02b2a3 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1472 microversion: 2.1 time: 0.608826 Aug 27 04:52:25.522406 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 96/208] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:24 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1472 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:25.541520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-de4f9c9b-e6fb-4542-832b-5e6dc56f13d7 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-61152204"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:25.550645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-de4f9c9b-e6fb-4542-832b-5e6dc56f13d7 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Generated uuid aa09dd5f-78c4-4b61-b679-60aa5cd88d6b for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:25.601540 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-de4f9c9b-e6fb-4542-832b-5e6dc56f13d7 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.077889 Aug 27 04:52:25.603529 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 97/209] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:25 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:25.615879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:25.617232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:25.631994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:25.637637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:25.638298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.639280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:25.639891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:25.640481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.774938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.795337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.807971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.810406 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f4d6e8b-3bc5-440b-baf5-024c43b60fa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1320 microversion: 2.25 time: 0.204354 Aug 27 04:52:25.816152 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 98/210] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:25 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1320 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:25.822405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:25.822923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:25.836475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:25.837000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:25.837440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.839257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:25.843703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:25.844163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.920705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Request method failure captured: Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc/diagnostics HTTP/1.1 Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLo0YQao8jpWyMCbOlAVg6fW9EA9sbLWpGFaAwfp_D0_AQcEqn8Rqe0DgfbTZOkt3GhF48y6AuR1x_t8QFA4I_OM_lwIadLQnl9-2DvVYdUKeitUfGjNUHp46UpYEWdmbJ2iOlR12pDR5XbbLfbHFCEopCl3akN148cOxWuR3vuUrA Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7bd33a6d6264429c8997e804427630a9 Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1634387975 Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:25.923163 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:25.924592 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7bd33a6d6264429c8997e804427630a9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7bd33a6d6264429c8997e804427630a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7bd33a6d6264429c8997e804427630a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7bd33a6d6264429c8997e804427630a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:25.924592 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1634387975 Aug 27 04:52:25.924592 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7bd33a6d6264429c8997e804427630a9 Aug 27 04:52:25.924592 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1634387975 Aug 27 04:52:25.924592 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerDiagnosticsNegativeTest-1634387975-project Aug 27 04:52:25.924592 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:25.924592 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:25.924592 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 73b2b5fa38f64dda97a76ab4a7559cbc Aug 27 04:52:25.924592 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1634387975-project Aug 27 04:52:25.924592 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:25.924592 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'server_id': 'f76b1f89-4300-4c14-9299-51c6671a77bc'} Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:25.925215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:25.926413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:25.927670 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-97c2122b-1bf3-47c0-9076-f537a64516a8 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.107896 Aug 27 04:52:25.927670 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 99/211] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 04:52:25 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc/diagnostics => generated 117 bytes in 109 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:25.932425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-83883263-e823-42b5-b2f2-d317cd8e0bd8 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:25.945492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83883263-e823-42b5-b2f2-d317cd8e0bd8 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:25.946227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83883263-e823-42b5-b2f2-d317cd8e0bd8 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:25.946826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83883263-e823-42b5-b2f2-d317cd8e0bd8 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.957006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:INSERT=5 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:26.119803 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-83883263-e823-42b5-b2f2-d317cd8e0bd8 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.192599 Aug 27 04:52:26.120453 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 100/212] 10.222.0.58 () {60 vars in 1191 bytes} [Sat Aug 27 04:52:25 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:26.126981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ea766ec2-ffdb-4823-8d00-7ff678291b12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:26.127414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ea766ec2-ffdb-4823-8d00-7ff678291b12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:26.134275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea766ec2-ffdb-4823-8d00-7ff678291b12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:26.135752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea766ec2-ffdb-4823-8d00-7ff678291b12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:26.136227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea766ec2-ffdb-4823-8d00-7ff678291b12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:26.136965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea766ec2-ffdb-4823-8d00-7ff678291b12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:26.137430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea766ec2-ffdb-4823-8d00-7ff678291b12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:26.137839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea766ec2-ffdb-4823-8d00-7ff678291b12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:26.158054 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5243f8a3-3459-4d22-93e9-b5996354c98f tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.791245 Aug 27 04:52:26.168524 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 113/213] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 04:52:25 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:26.173574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8aafe664-be1f-4e84-b123-ad21cee806e7 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:26.174297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8aafe664-be1f-4e84-b123-ad21cee806e7 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:26.189076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aafe664-be1f-4e84-b123-ad21cee806e7 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:26.196580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aafe664-be1f-4e84-b123-ad21cee806e7 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:26.197328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aafe664-be1f-4e84-b123-ad21cee806e7 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:26.198494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aafe664-be1f-4e84-b123-ad21cee806e7 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:26.199778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aafe664-be1f-4e84-b123-ad21cee806e7 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:26.200384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aafe664-be1f-4e84-b123-ad21cee806e7 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:26.231628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8aafe664-be1f-4e84-b123-ad21cee806e7 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:52:26.328106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ea766ec2-ffdb-4823-8d00-7ff678291b12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:26.342048 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ea766ec2-ffdb-4823-8d00-7ff678291b12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1321 microversion: 2.1 time: 0.220537 Aug 27 04:52:26.343346 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 101/214] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:26 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:26.370246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b5e75923-4f12-4978-bc05-f07c3cffb3ec tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:26.372367 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8aafe664-be1f-4e84-b123-ad21cee806e7 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 204 len: 0 microversion: 2.1 time: 0.202343 Aug 27 04:52:26.375637 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 114/215] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:52:26 2022] DELETE /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:26.387500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c7e1939c-71d7-49fd-b516-a90321c7c893 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] Calling method '.version_select at 0x7fb5672ffa60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:26.394116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5e75923-4f12-4978-bc05-f07c3cffb3ec tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:26.394985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5e75923-4f12-4978-bc05-f07c3cffb3ec tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:26.395119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5e75923-4f12-4978-bc05-f07c3cffb3ec tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:26.653137 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b5e75923-4f12-4978-bc05-f07c3cffb3ec tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 225 microversion: 2.1 time: 0.296053 Aug 27 04:52:26.654595 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 102/216] 10.222.0.58 () {60 vars in 1191 bytes} [Sat Aug 27 04:52:26 2022] POST /compute/v2.1/os-aggregates/5/action => generated 225 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:26.679457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c3c39a59-5ef4-46a5-b23e-699acb23b19c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:26.680431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c3c39a59-5ef4-46a5-b23e-699acb23b19c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:26.698726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3c39a59-5ef4-46a5-b23e-699acb23b19c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:26.702811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3c39a59-5ef4-46a5-b23e-699acb23b19c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:26.704621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3c39a59-5ef4-46a5-b23e-699acb23b19c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:26.708922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3c39a59-5ef4-46a5-b23e-699acb23b19c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:26.709416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3c39a59-5ef4-46a5-b23e-699acb23b19c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:26.709859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3c39a59-5ef4-46a5-b23e-699acb23b19c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:27.390198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c3c39a59-5ef4-46a5-b23e-699acb23b19c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:27.401143 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c3c39a59-5ef4-46a5-b23e-699acb23b19c tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1478 microversion: 2.1 time: 0.736529 Aug 27 04:52:27.402488 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 103/217] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:26 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1478 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:27.409800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:27.411669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:27.420117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:27.421101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:27.421716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:27.422598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:27.423300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:27.424164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:27.595967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:27.605224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:27.609567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:27.634084 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad43dbc7-2685-4da2-a87b-44947c6e7a44 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1438 microversion: 2.75 time: 0.230172 Aug 27 04:52:27.635212 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 104/218] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:27 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1438 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:27.642965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-66732391-7444-4c34-a179-d139f0f7c548 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:27.702625 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-66732391-7444-4c34-a179-d139f0f7c548 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.066128 Aug 27 04:52:27.704758 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 105/219] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:27 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:27.712469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:27.715101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:27.730372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:27.734720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:27.735927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:27.736852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:27.738364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:27.738956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:28.139434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:28.143194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:28.153876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:28.155346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:28.156503 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ff4444d-0743-4a63-ad5d-cc15c4c9e13d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1362 microversion: 2.25 time: 0.450660 Aug 27 04:52:28.157075 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 106/220] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:27 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1362 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:28.169239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-73a5424a-48d0-4f2c-a777-f60c99392e3e tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:28.170230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-73a5424a-48d0-4f2c-a777-f60c99392e3e tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:28.208050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73a5424a-48d0-4f2c-a777-f60c99392e3e tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:28.209177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73a5424a-48d0-4f2c-a777-f60c99392e3e tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:28.217851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73a5424a-48d0-4f2c-a777-f60c99392e3e tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:28.236911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73a5424a-48d0-4f2c-a777-f60c99392e3e tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:28.239925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73a5424a-48d0-4f2c-a777-f60c99392e3e tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:28.240695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73a5424a-48d0-4f2c-a777-f60c99392e3e tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:28.602578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-73a5424a-48d0-4f2c-a777-f60c99392e3e tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:28.617901 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-73a5424a-48d0-4f2c-a777-f60c99392e3e tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1388 microversion: 2.1 time: 0.459663 Aug 27 04:52:28.618624 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 107/221] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:28 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1388 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:28.630411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:28.633567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:28.652032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:28.652788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:28.653426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:28.654337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:28.655004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:28.655684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:28.812691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:28.814213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:28.815043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:28.815714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:28.816291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:28.925327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:28.931922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:28.932429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:28.932845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:28.933554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:28.934007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:28.934433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:29.204016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:29.248649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:29.255859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:29.281755 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cc38b829-cc41-4cc9-be76-175b72a6bfc8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "POST /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949/action" status: 202 len: 1495 microversion: 2.75 time: 0.661791 Aug 27 04:52:29.283501 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 108/222] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 04:52:28 2022] POST /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949/action => generated 1495 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 04:52:29.290443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bb1580a0-2710-4bdd-a96f-a304bb663af5 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1850151554"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:29.295014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-bb1580a0-2710-4bdd-a96f-a304bb663af5 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Generated uuid 7ee7a4ac-e2fa-4a47-8694-85de6bc37b20 for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:29.344109 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bb1580a0-2710-4bdd-a96f-a304bb663af5 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058759 Aug 27 04:52:29.346326 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 109/223] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:29.353806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-abfc37b1-0f6b-42df-9eb3-aa1515ef4e80 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:29.354647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-abfc37b1-0f6b-42df-9eb3-aa1515ef4e80 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:29.369111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abfc37b1-0f6b-42df-9eb3-aa1515ef4e80 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:29.370053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abfc37b1-0f6b-42df-9eb3-aa1515ef4e80 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:29.370800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abfc37b1-0f6b-42df-9eb3-aa1515ef4e80 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:29.372839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abfc37b1-0f6b-42df-9eb3-aa1515ef4e80 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:29.373603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abfc37b1-0f6b-42df-9eb3-aa1515ef4e80 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:29.374226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abfc37b1-0f6b-42df-9eb3-aa1515ef4e80 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:29.642776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-abfc37b1-0f6b-42df-9eb3-aa1515ef4e80 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:29.651983 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-abfc37b1-0f6b-42df-9eb3-aa1515ef4e80 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1478 microversion: 2.1 time: 0.304086 Aug 27 04:52:29.652572 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 110/224] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:29 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1478 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:29.657140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-a6d10d7c-4588-4bdb-92ff-ba8ed84e1dcf req-793c839e-7911-40d7-809b-ce3a25ec221f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8582438a-00e8-41b1-8aeb-662d153b4983", "tag": "efa2644d-7860-4145-ae82-550f59ddc80c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:29.666555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a6d10d7c-4588-4bdb-92ff-ba8ed84e1dcf req-793c839e-7911-40d7-809b-ce3a25ec221f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:29.667030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a6d10d7c-4588-4bdb-92ff-ba8ed84e1dcf req-793c839e-7911-40d7-809b-ce3a25ec221f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:29.667487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a6d10d7c-4588-4bdb-92ff-ba8ed84e1dcf req-793c839e-7911-40d7-809b-ce3a25ec221f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:29.680446 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-a6d10d7c-4588-4bdb-92ff-ba8ed84e1dcf req-793c839e-7911-40d7-809b-ce3a25ec221f service nova] Creating event network-changed:efa2644d-7860-4145-ae82-550f59ddc80c for instance 8582438a-00e8-41b1-8aeb-662d153b4983 on n-h2-820368-35 Aug 27 04:52:29.687117 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-a6d10d7c-4588-4bdb-92ff-ba8ed84e1dcf req-793c839e-7911-40d7-809b-ce3a25ec221f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032873 Aug 27 04:52:29.688104 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 111/225] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:29.690050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-a6d10d7c-4588-4bdb-92ff-ba8ed84e1dcf req-793c839e-7911-40d7-809b-ce3a25ec221f service nova] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:29.690994 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-a6d10d7c-4588-4bdb-92ff-ba8ed84e1dcf req-793c839e-7911-40d7-809b-ce3a25ec221f service nova] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001292 Aug 27 04:52:29.691607 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 112/226] 10.222.0.58 () {56 vars in 886 bytes} [Sat Aug 27 04:52:29 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 04:52:29.697048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:29.698191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:29.722036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:29.722577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:29.723020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:29.724066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:29.724781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:29.725356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:29.955437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=15 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:30.026583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:30.038831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:30.041207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:30.042932 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8ab3bd6c-ce72-44db-80fc-6b3602cd72c8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1362 microversion: 2.25 time: 0.349948 Aug 27 04:52:30.043802 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 113/227] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:29 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:30.051601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:30.052595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:30.062466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.063496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.064177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.065107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.066239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.067023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.231027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:30.254693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:30.260546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:30.278913 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0b93dddf-129c-4aa3-aa89-f52c334c58b7 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.233168 Aug 27 04:52:30.279987 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 114/228] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:30 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:30.289488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c6cf702-1e5d-443c-9f4b-94a683b04dde tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:30.333520 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c6cf702-1e5d-443c-9f4b-94a683b04dde tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.052509 Aug 27 04:52:30.334617 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 115/229] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:30 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:30.342318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f0820af-f903-4a85-9d2c-0a7d202949d5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:30.343000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f0820af-f903-4a85-9d2c-0a7d202949d5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:30.353006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f0820af-f903-4a85-9d2c-0a7d202949d5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.353573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f0820af-f903-4a85-9d2c-0a7d202949d5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.354240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f0820af-f903-4a85-9d2c-0a7d202949d5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.355063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f0820af-f903-4a85-9d2c-0a7d202949d5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.355542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f0820af-f903-4a85-9d2c-0a7d202949d5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.355964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f0820af-f903-4a85-9d2c-0a7d202949d5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.653498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9f0820af-f903-4a85-9d2c-0a7d202949d5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:30.663193 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f0820af-f903-4a85-9d2c-0a7d202949d5 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1388 microversion: 2.1 time: 0.326652 Aug 27 04:52:30.664096 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 116/230] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:30 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1388 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:30.672530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-34e3c2ac-6c53-4068-afe1-2ad9bd158bfe req-15a0d372-27e5-49f2-ba34-14c91ee3156f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76b1f89-4300-4c14-9299-51c6671a77bc", "name": "network-vif-deleted", "tag": "ab278b97-18fc-43fb-b561-b8c7d0b85e66"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:30.684951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-34e3c2ac-6c53-4068-afe1-2ad9bd158bfe req-15a0d372-27e5-49f2-ba34-14c91ee3156f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.685585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-34e3c2ac-6c53-4068-afe1-2ad9bd158bfe req-15a0d372-27e5-49f2-ba34-14c91ee3156f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.686026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-34e3c2ac-6c53-4068-afe1-2ad9bd158bfe req-15a0d372-27e5-49f2-ba34-14c91ee3156f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.703018 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-34e3c2ac-6c53-4068-afe1-2ad9bd158bfe req-15a0d372-27e5-49f2-ba34-14c91ee3156f service nova] Creating event network-vif-deleted:ab278b97-18fc-43fb-b561-b8c7d0b85e66 for instance f76b1f89-4300-4c14-9299-51c6671a77bc on n-h1-820368-35 Aug 27 04:52:30.711043 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-34e3c2ac-6c53-4068-afe1-2ad9bd158bfe req-15a0d372-27e5-49f2-ba34-14c91ee3156f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045606 Aug 27 04:52:30.712141 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 117/231] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:30.717821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89828423-731c-40c8-a9cc-0fd3ab8dc3c7 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:30.725200 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-89828423-731c-40c8-a9cc-0fd3ab8dc3c7 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89828423-731c-40c8-a9cc-0fd3ab8dc3c7 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Request method failure captured: Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLQP6S0hSPTUW7tMzcxy9PmxHRI7W_vRJQrRRCial2oZL4lncl1NI7pKJdbAj_ox1y6CF_i9ZzcxycoL3hq3vmo8_0TYZQjkdowEWJXPhfw9KxBMZgigoR5mPHNglCmSL7zb6pAghwz9CcYu7qElfSuLvG6-wJvMmrWr8LltUWg2oA Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 0c92628786b84bf7be8ed18265f81786 Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:30.728045 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0c92628786b84bf7be8ed18265f81786", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 0c92628786b84bf7be8ed18265f81786 Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminTestJSON-416108208-project-admin Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 60be69980cb848489ebec510f8df85ce Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminTestJSON-416108208-project-admin Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: exception: Aggregate 6 could not be found. Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '6'} Aug 27 04:52:30.729247 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:30.730038 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 27 04:52:30.731036 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:30.733868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89828423-731c-40c8-a9cc-0fd3ab8dc3c7 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:30.735015 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89828423-731c-40c8-a9cc-0fd3ab8dc3c7 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.021731 Aug 27 04:52:30.735892 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 118/232] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 04:52:30 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:52:30.741000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:30.742045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:30.749982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.750755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.751973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.752971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.754042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.754698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.796157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.796785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.797325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.797937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lazy-loading 'fault' on Instance uuid f76b1f89-4300-4c14-9299-51c6671a77bc {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:52:30.876748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b2b5fa38f64dda97a76ab4a7559cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd33a6d6264429c8997e804427630a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:30.885871 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b2d6bbd7-901b-454f-96ae-ef218317c1d5 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 200 len: 1313 microversion: 2.1 time: 0.148317 Aug 27 04:52:30.901082 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 119/233] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:30 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:30.915273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-587c899e-3cd2-41cf-bb8e-a8edfe758a9d tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:30.936408 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-587c899e-3cd2-41cf-bb8e-a8edfe758a9d tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-587c899e-3cd2-41cf-bb8e-a8edfe758a9d tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Request method failure captured: Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLQP6S0hSPTUW7tMzcxy9PmxHRI7W_vRJQrRRCial2oZL4lncl1NI7pKJdbAj_ox1y6CF_i9ZzcxycoL3hq3vmo8_0TYZQjkdowEWJXPhfw9KxBMZgigoR5mPHNglCmSL7zb6pAghwz9CcYu7qElfSuLvG6-wJvMmrWr8LltUWg2oA Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 0c92628786b84bf7be8ed18265f81786 Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:30.939062 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0c92628786b84bf7be8ed18265f81786", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 0c92628786b84bf7be8ed18265f81786 Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminTestJSON-416108208-project-admin Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 60be69980cb848489ebec510f8df85ce Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminTestJSON-416108208-project-admin Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: exception: Aggregate 6 could not be found. Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '6'} Aug 27 04:52:30.940247 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:52:30.940925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:30.942164 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:30.943442 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:30.943442 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:30.943442 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:30.943442 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 27 04:52:30.943442 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:30.943442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-587c899e-3cd2-41cf-bb8e-a8edfe758a9d tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:30.943442 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-587c899e-3cd2-41cf-bb8e-a8edfe758a9d tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.038548 Aug 27 04:52:30.943442 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 120/234] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:30 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:52:30.953622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-535a2eee-7ce5-4a88-bca3-e29e22d3b175 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1284490727", "name": "tempest-test_aggregate-1496738790"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:30.956416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-c7e1939c-71d7-49fd-b516-a90321c7c893 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d4f00aca-5863-4f8f-971c-44e8245e822d does not exist", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:52:30.957028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.security_group_api [None req-c7e1939c-71d7-49fd-b516-a90321c7c893 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] Neutron security group d4f00aca-5863-4f8f-971c-44e8245e822d not found {{(pid=128547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:52:30.957556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.compute.security_groups [None req-c7e1939c-71d7-49fd-b516-a90321c7c893 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] Security Group ID d4f00aca-5863-4f8f-971c-44e8245e822d does not exist {{(pid=128547) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 27 04:52:30.983766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-535a2eee-7ce5-4a88-bca3-e29e22d3b175 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Generated uuid 40d8442a-768b-4c2d-a510-477d8ba82be8 for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:30.990033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-c7e1939c-71d7-49fd-b516-a90321c7c893 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d4f00aca-5863-4f8f-971c-44e8245e822d does not exist", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:52:30.995235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.security_group_api [None req-c7e1939c-71d7-49fd-b516-a90321c7c893 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] Neutron security group d4f00aca-5863-4f8f-971c-44e8245e822d not found {{(pid=128547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:52:30.996271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.compute.security_groups [None req-c7e1939c-71d7-49fd-b516-a90321c7c893 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] Security Group ID d4f00aca-5863-4f8f-971c-44e8245e822d does not exist {{(pid=128547) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 27 04:52:31.042355 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-535a2eee-7ce5-4a88-bca3-e29e22d3b175 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.093106 Aug 27 04:52:31.049335 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 121/235] 10.222.0.58 () {60 vars in 1165 bytes} [Sat Aug 27 04:52:30 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:31.055273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8fb0f3ec-4c64-45a7-b4fc-9bf10d5072a6 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:31.097839 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8fb0f3ec-4c64-45a7-b4fc-9bf10d5072a6 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.046860 Aug 27 04:52:31.098718 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 122/236] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:31 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 04:52:31.119252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:31.120461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:31.130378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:31.130981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:31.131521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:31.132441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:31.133572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:31.134084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:31.194592 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c7e1939c-71d7-49fd-b516-a90321c7c893 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10539 microversion: 2.1 time: 4.815853 Aug 27 04:52:31.195803 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 115/237] 10.222.0.58 () {58 vars in 1191 bytes} [Sat Aug 27 04:52:26 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10539 bytes in 4819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:52:31.200562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a128b028-8506-4b8a-995a-85a5bebb65c1 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:31.208549 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a128b028-8506-4b8a-995a-85a5bebb65c1 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a128b028-8506-4b8a-995a-85a5bebb65c1 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Request method failure captured: Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLQP6S0hSPTUW7tMzcxy9PmxHRI7W_vRJQrRRCial2oZL4lncl1NI7pKJdbAj_ox1y6CF_i9ZzcxycoL3hq3vmo8_0TYZQjkdowEWJXPhfw9KxBMZgigoR5mPHNglCmSL7zb6pAghwz9CcYu7qElfSuLvG6-wJvMmrWr8LltUWg2oA Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 0c92628786b84bf7be8ed18265f81786 Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:52:31.211338 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0c92628786b84bf7be8ed18265f81786", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 0c92628786b84bf7be8ed18265f81786 Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AggregatesAdminTestJSON-416108208-project-admin Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 60be69980cb848489ebec510f8df85ce Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AggregatesAdminTestJSON-416108208-project-admin Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: exception: Aggregate 7 could not be found. Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '7'} Aug 27 04:52:31.212634 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:31.213449 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 27 04:52:31.214468 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:31.217931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a128b028-8506-4b8a-995a-85a5bebb65c1 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:31.219239 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a128b028-8506-4b8a-995a-85a5bebb65c1 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.021899 Aug 27 04:52:31.220351 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 116/238] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 04:52:31 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:52:31.225346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e7d412da-8b2d-4213-9db5-ef34640e962b tempest-SecurityGroupsTestAdminJSON-1357535249 tempest-SecurityGroupsTestAdminJSON-1357535249-project] Calling method '.version_select at 0x7fb565cf9dc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:31.317276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:31.411491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:31.431947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:31.434270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:31.435933 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-63cce438-8b57-406b-a375-5866150ed237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1362 microversion: 2.25 time: 0.335689 Aug 27 04:52:31.437715 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 123/239] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:31 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:31.439212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=36 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:31.445297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2dc7383d-9e63-45bf-9bb2-9d7276528adf tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:31.461315 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-2dc7383d-9e63-45bf-9bb2-9d7276528adf tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2dc7383d-9e63-45bf-9bb2-9d7276528adf tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Request method failure captured: Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLQP6S0hSPTUW7tMzcxy9PmxHRI7W_vRJQrRRCial2oZL4lncl1NI7pKJdbAj_ox1y6CF_i9ZzcxycoL3hq3vmo8_0TYZQjkdowEWJXPhfw9KxBMZgigoR5mPHNglCmSL7zb6pAghwz9CcYu7qElfSuLvG6-wJvMmrWr8LltUWg2oA Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 0c92628786b84bf7be8ed18265f81786 Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:31.463447 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0c92628786b84bf7be8ed18265f81786", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0c92628786b84bf7be8ed18265f81786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 0c92628786b84bf7be8ed18265f81786 Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-416108208 Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminTestJSON-416108208-project-admin Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 60be69980cb848489ebec510f8df85ce Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminTestJSON-416108208-project-admin Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: exception: Aggregate 7 could not be found. Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '7'} Aug 27 04:52:31.464966 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:52:31.465854 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:31.466930 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:31.468811 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:31.468811 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:31.468811 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:31.468811 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 27 04:52:31.468811 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:31.470343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2dc7383d-9e63-45bf-9bb2-9d7276528adf tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:31.472995 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2dc7383d-9e63-45bf-9bb2-9d7276528adf tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.030712 Aug 27 04:52:31.475520 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 124/240] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:31 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:52:31.495163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:31.495835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:31.507652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:31.508401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:31.508854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:31.509721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:31.510176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:31.510763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:31.594421 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e7d412da-8b2d-4213-9db5-ef34640e962b tempest-SecurityGroupsTestAdminJSON-1357535249 tempest-SecurityGroupsTestAdminJSON-1357535249-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.372695 Aug 27 04:52:31.595051 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 117/241] 10.222.0.58 () {58 vars in 1191 bytes} [Sat Aug 27 04:52:31 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:31.609926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-02159dba-5fd7-4155-b0ea-83dcf2027ada tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-607535691"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:31.614146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.aggregate [None req-02159dba-5fd7-4155-b0ea-83dcf2027ada tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Generated uuid 2169a10a-9a6e-4dc0-8245-ce66a6c3f133 for aggregate {{(pid=128547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:31.647082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:31.656575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:31.658498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:31.659422 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-02159dba-5fd7-4155-b0ea-83dcf2027ada tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.063105 Aug 27 04:52:31.662973 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 118/242] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:31 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:31.663898 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cd1cd00b-1388-40fb-b175-2e402d144239 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.182293 Aug 27 04:52:31.664457 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 125/243] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:31 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:31.679440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3f48f7db-722c-4b21-84df-1ef274f72ad6 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] Calling method '.version_select at 0x7fb565c809d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:31.684578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e333c276-d571-4e6b-861d-3fa8672e8cb8 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:31.697917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:31.702886 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e333c276-d571-4e6b-861d-3fa8672e8cb8 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.029992 Aug 27 04:52:31.708119 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 126/244] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 04:52:31 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:31.714527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e0335303-2282-4fea-953a-6115bb02d14b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:31.715663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e0335303-2282-4fea-953a-6115bb02d14b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:31.728482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0335303-2282-4fea-953a-6115bb02d14b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:31.729858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0335303-2282-4fea-953a-6115bb02d14b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:31.730912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0335303-2282-4fea-953a-6115bb02d14b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:31.732490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0335303-2282-4fea-953a-6115bb02d14b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:31.733163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0335303-2282-4fea-953a-6115bb02d14b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:31.737501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0335303-2282-4fea-953a-6115bb02d14b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:32.101764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e0335303-2282-4fea-953a-6115bb02d14b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:32.117792 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e0335303-2282-4fea-953a-6115bb02d14b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1388 microversion: 2.1 time: 0.408191 Aug 27 04:52:32.118783 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 127/245] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:31 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1388 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:32.125467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-64224038-9b4b-469c-8e51-2953f89b4b17 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:32.164549 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-64224038-9b4b-469c-8e51-2953f89b4b17 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.043956 Aug 27 04:52:32.165975 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 128/246] 10.222.0.58 () {60 vars in 1191 bytes} [Sat Aug 27 04:52:32 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:32.188820 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3f48f7db-722c-4b21-84df-1ef274f72ad6 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/495b1dde-f957-403b-8390-09ecd97ab4f5" status: 202 len: 0 microversion: 2.1 time: 0.524483 Aug 27 04:52:32.190343 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 119/247] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 04:52:31 2022] DELETE /compute/v2.1/os-security-groups/495b1dde-f957-403b-8390-09ecd97ab4f5 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:52:32.197154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:32.198472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] [instance: f76b1f89-4300-4c14-9299-51c6671a77bc] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:32.213805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:32.215217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:32.215935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:32.218462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:32.220086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:32.221457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:32.254649 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] HTTP exception thrown: Instance f76b1f89-4300-4c14-9299-51c6671a77bc could not be found. Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Request method failure captured: Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc HTTP/1.1 Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLo0YQao8jpWyMCbOlAVg6fW9EA9sbLWpGFaAwfp_D0_AQcEqn8Rqe0DgfbTZOkt3GhF48y6AuR1x_t8QFA4I_OM_lwIadLQnl9-2DvVYdUKeitUfGjNUHp46UpYEWdmbJ2iOlR12pDR5XbbLfbHFCEopCl3akN148cOxWuR3vuUrA Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7bd33a6d6264429c8997e804427630a9 Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1634387975 Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:52:32.256696 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7bd33a6d6264429c8997e804427630a9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7bd33a6d6264429c8997e804427630a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7bd33a6d6264429c8997e804427630a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7bd33a6d6264429c8997e804427630a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1634387975 Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7bd33a6d6264429c8997e804427630a9 Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1634387975 Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerDiagnosticsNegativeTest-1634387975-project Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 73b2b5fa38f64dda97a76ab4a7559cbc Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1634387975-project Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance f76b1f89-4300-4c14-9299-51c6671a77bc could not be found. Aug 27 04:52:32.257911 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'f76b1f89-4300-4c14-9299-51c6671a77bc'} Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f76b1f89-4300-4c14-9299-51c6671a77bc could not be found. Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:32.258659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f76b1f89-4300-4c14-9299-51c6671a77bc could not be found. Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f76b1f89-4300-4c14-9299-51c6671a77bc could not be found. Aug 27 04:52:32.259749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:32.261051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] Returning 404 to user: Instance f76b1f89-4300-4c14-9299-51c6671a77bc could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:32.261051 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c3019671-10d7-444b-81f8-f59be1959be1 tempest-ServerDiagnosticsNegativeTest-1634387975 tempest-ServerDiagnosticsNegativeTest-1634387975-project] 10.222.0.58 "GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc" status: 404 len: 111 microversion: 2.1 time: 0.065578 Aug 27 04:52:32.261051 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 120/248] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:32 2022] GET /compute/v2.1/servers/f76b1f89-4300-4c14-9299-51c6671a77bc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:32.267326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e17cabec-9273-44e1-8e82-61e72e2c3821 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:32.277478 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e17cabec-9273-44e1-8e82-61e72e2c3821 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.016054 Aug 27 04:52:32.278381 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 121/249] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 04:52:32 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:32.288622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2b7e4e3-a196-49f2-9509-93f8d28f67c4 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] Calling method '.version_select at 0x7fb5662a6f70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:32.439379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=83 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:32.472218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1429233069", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "71a3611e-27fd-46d0-9b26-df83ee6c57af"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:32.527406 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b2b7e4e3-a196-49f2-9509-93f8d28f67c4 tempest-SecurityGroupsTestAdminJSON-1011694660 tempest-SecurityGroupsTestAdminJSON-1011694660-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/017004c0-4f60-46e9-8c12-2b68f0f12776" status: 202 len: 0 microversion: 2.1 time: 0.247599 Aug 27 04:52:32.532973 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 122/250] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 04:52:32 2022] DELETE /compute/v2.1/os-security-groups/017004c0-4f60-46e9-8c12-2b68f0f12776 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:52:32.541162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-47170c99-b160-463c-8569-18a07e27e308 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:32.587461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] validate_networks() for [('71a3611e-27fd-46d0-9b26-df83ee6c57af', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:52:32.614668 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-47170c99-b160-463c-8569-18a07e27e308 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.080075 Aug 27 04:52:32.615918 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 123/251] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:32 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:32.623276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:32.624108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:32.631166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:32.632329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:32.633209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:32.634507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:32.635127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:32.635696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:33.011763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:33.023424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:33.029630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:33.033883 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-63234fef-f8f3-4b4d-aacc-98875e61aa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1362 microversion: 2.25 time: 0.415153 Aug 27 04:52:33.034467 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 124/252] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:32 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1362 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:33.044147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bddd7ebc-ecb0-4f46-934d-b21bd3e75e35 tempest-SecurityGroupsTestAdminJSON-1357535249 tempest-SecurityGroupsTestAdminJSON-1357535249-project] Calling method '.version_select at 0x7fb565be5e50>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:33.760987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:33.762863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:33.763961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:33.764522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:33.765665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:33.780989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:33.781146 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bddd7ebc-ecb0-4f46-934d-b21bd3e75e35 tempest-SecurityGroupsTestAdminJSON-1357535249 tempest-SecurityGroupsTestAdminJSON-1357535249-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/b4f1b29a-f442-4e9d-85a4-ec41ef65aad7" status: 202 len: 0 microversion: 2.1 time: 0.745117 Aug 27 04:52:33.782255 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 125/253] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 04:52:33 2022] DELETE /compute/v2.1/os-security-groups/b4f1b29a-f442-4e9d-85a4-ec41ef65aad7 => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:52:33.786150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:33.786947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:33.787693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5220fa5a-c346-440c-a832-31834389b5cc tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1702548472", "availability_zone": "tempest-test_az-438004400"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:33.788411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:33.789032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:33.789664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:33.794795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.aggregate [None req-5220fa5a-c346-440c-a832-31834389b5cc tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Generated uuid 1429d983-77c7-49c3-8374-97ebfb99812b for aggregate {{(pid=128547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:33.845359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Getting quotas for project 0088fd72e34f43fa97050fd334f61ea6. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:33.852677 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5220fa5a-c346-440c-a832-31834389b5cc tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.067221 Aug 27 04:52:33.855859 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 126/254] 10.222.0.58 () {60 vars in 1165 bytes} [Sat Aug 27 04:52:33 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:33.863166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Getting quotas for user ce1a0cee656e407a98b414918319c246 and project 0088fd72e34f43fa97050fd334f61ea6. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:33.867498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:33.868304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:33.876707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:33.877484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:33.878819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:33.880025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:33.880644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:33.881218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:33.896755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:52:33.901765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:52:34.012388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:34.021197 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a06444c1-52cc-4da4-a707-a1cd03b2a42d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.853746 Aug 27 04:52:34.025668 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 129/255] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:52:34.026254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:34.027960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:34.035206 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-771fd54d-7135-4171-bfb7-4a2abbe5bb4d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.177959 Aug 27 04:52:34.048477 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 127/256] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:33 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:34.049204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-2d8ebca2-6b67-44c3-a7dd-873c08106bc9 req-328db5f9-402b-4e45-802d-d29b2415a03a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57a38fc-e317-4555-bba4-f2cedd73562d", "tag": "5f3f4146-89cf-410e-80ce-9aa915641be8"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:34.065256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2d8ebca2-6b67-44c3-a7dd-873c08106bc9 req-328db5f9-402b-4e45-802d-d29b2415a03a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.067568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2d8ebca2-6b67-44c3-a7dd-873c08106bc9 req-328db5f9-402b-4e45-802d-d29b2415a03a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.068254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2d8ebca2-6b67-44c3-a7dd-873c08106bc9 req-328db5f9-402b-4e45-802d-d29b2415a03a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:34.072887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68ad24af-99a1-4cf7-9b10-d741872c2832 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:34.079744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68ad24af-99a1-4cf7-9b10-d741872c2832 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:34.090464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ad24af-99a1-4cf7-9b10-d741872c2832 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.092834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ad24af-99a1-4cf7-9b10-d741872c2832 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.093631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ad24af-99a1-4cf7-9b10-d741872c2832 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:34.097576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ad24af-99a1-4cf7-9b10-d741872c2832 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.098143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ad24af-99a1-4cf7-9b10-d741872c2832 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.099872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ad24af-99a1-4cf7-9b10-d741872c2832 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:34.105901 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-2d8ebca2-6b67-44c3-a7dd-873c08106bc9 req-328db5f9-402b-4e45-802d-d29b2415a03a service nova] Creating event network-changed:5f3f4146-89cf-410e-80ce-9aa915641be8 for instance b57a38fc-e317-4555-bba4-f2cedd73562d on n-h1-820368-35 Aug 27 04:52:34.140826 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-2d8ebca2-6b67-44c3-a7dd-873c08106bc9 req-328db5f9-402b-4e45-802d-d29b2415a03a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112671 Aug 27 04:52:34.143990 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 130/257] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:34.156793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-975b3414-e95a-4b15-8029-02a767ede33d tempest-SecurityGroupsTestAdminJSON-1357535249 tempest-SecurityGroupsTestAdminJSON-1357535249-project] Calling method '.version_select at 0x7fb565cc6040>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:34.496710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68ad24af-99a1-4cf7-9b10-d741872c2832 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:34.509080 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68ad24af-99a1-4cf7-9b10-d741872c2832 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1388 microversion: 2.1 time: 0.459308 Aug 27 04:52:34.509903 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 128/258] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:34 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1388 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:34.515627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7305358f-8c63-4e25-a40b-bc118deecfcd tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1702548472_new", "availability_zone": "tempest-test_az-438004400_new"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:34.729474 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-975b3414-e95a-4b15-8029-02a767ede33d tempest-SecurityGroupsTestAdminJSON-1357535249 tempest-SecurityGroupsTestAdminJSON-1357535249-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5ce11825-49b1-48d1-adaa-02b85027ffc2" status: 202 len: 0 microversion: 2.1 time: 0.583873 Aug 27 04:52:34.730715 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 131/259] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 04:52:34 2022] DELETE /compute/v2.1/os-security-groups/5ce11825-49b1-48d1-adaa-02b85027ffc2 => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:52:34.740827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7305358f-8c63-4e25-a40b-bc118deecfcd tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.742719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7305358f-8c63-4e25-a40b-bc118deecfcd tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.744094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7305358f-8c63-4e25-a40b-bc118deecfcd tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:34.751793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1c606f6-9a9b-4459-817d-b884822e8653 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:34.753938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a1c606f6-9a9b-4459-817d-b884822e8653 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:34.828455 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7305358f-8c63-4e25-a40b-bc118deecfcd tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.316744 Aug 27 04:52:34.829559 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 129/260] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 04:52:34 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:34.839918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:34.841167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:34.861147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.864003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.864592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:34.866950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.867524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.868214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:34.983794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a1c606f6-9a9b-4459-817d-b884822e8653 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.011595 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a1c606f6-9a9b-4459-817d-b884822e8653 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1224 microversion: 2.1 time: 0.276707 Aug 27 04:52:35.012241 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 132/261] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:34 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1224 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:35.240922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.251901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.254716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.256205 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-21efdd28-c8a5-438b-8a14-e443b9d0a869 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1362 microversion: 2.25 time: 0.425369 Aug 27 04:52:35.257232 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 130/262] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:34 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1362 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:35.261976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-840b7f60-78d6-4aae-bd27-fc967725a6fc tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:35.288330 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-840b7f60-78d6-4aae-bd27-fc967725a6fc tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.028468 Aug 27 04:52:35.290118 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 131/263] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 04:52:35 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:35.309038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:35.317046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:35.337841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.338187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.338637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.344810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.345320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.345765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.467424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.484228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.485743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.495662 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0ed279a6-b60d-4161-8e38-9e51b738ca8d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.193553 Aug 27 04:52:35.501602 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 132/264] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:35 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:35.506307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Calling method '.version_select at 0x7fb566f08310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:35.514734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.518205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-faee93bd-a7b5-4ccd-b967-8ff1b22a6185 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:35.521062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.521517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.566990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.569596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.571344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.580682 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-faee93bd-a7b5-4ccd-b967-8ff1b22a6185 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.072168 Aug 27 04:52:35.580682 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 133/265] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:35 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:35.588529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7cf3f93e-43cd-4729-a6e2-cecb75cce7fd tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:35.589151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7cf3f93e-43cd-4729-a6e2-cecb75cce7fd tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:35.606188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cf3f93e-43cd-4729-a6e2-cecb75cce7fd tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.606692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cf3f93e-43cd-4729-a6e2-cecb75cce7fd tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.607143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cf3f93e-43cd-4729-a6e2-cecb75cce7fd tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.607867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cf3f93e-43cd-4729-a6e2-cecb75cce7fd tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.608385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cf3f93e-43cd-4729-a6e2-cecb75cce7fd tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.608841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cf3f93e-43cd-4729-a6e2-cecb75cce7fd tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.633911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.634681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.638045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.654378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.654882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.655356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.687638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.688846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.689466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.698335 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f280a85d-251f-4b4f-b836-28f64fd6210f tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1919 microversion: 2.53 time: 0.684693 Aug 27 04:52:35.717910 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 133/266] 10.222.0.58 () {60 vars in 1243 bytes} [Sat Aug 27 04:52:35 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1919 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:35.731393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e7cbf56-c1f5-414f-9eee-deed889cf92a tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-697756348"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:35.739309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-9e7cbf56-c1f5-414f-9eee-deed889cf92a tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Generated uuid 231e6276-ade0-48ad-a392-f31955fedd54 for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:35.772373 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9e7cbf56-c1f5-414f-9eee-deed889cf92a tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052967 Aug 27 04:52:35.789761 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 134/267] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:35.810299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Calling method '.version_select at 0x7fb565d744c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:35.818224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.819391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.819839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.840187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:35.864851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.865381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.865838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.898155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.898843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.900574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.902691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7cf3f93e-43cd-4729-a6e2-cecb75cce7fd tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.915719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.916694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.917428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.920692 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7cf3f93e-43cd-4729-a6e2-cecb75cce7fd tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1388 microversion: 2.1 time: 0.336938 Aug 27 04:52:35.927317 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 134/268] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:35 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1388 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:35.931922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e22bcd2e-4405-45ba-8b8b-bb90da752540 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:35.940555 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e22bcd2e-4405-45ba-8b8b-bb90da752540 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.012046 Aug 27 04:52:35.940989 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 135/269] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 04:52:35 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:35.948713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.949215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.949655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.952765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab5c934d-c0da-4aa5-9c78-5f80e7099fd6 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:35.958732 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ee2e1fa-19a6-47f3-bdbd-dbdbf5247648 tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 609 microversion: 2.53 time: 0.166817 Aug 27 04:52:35.959748 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 135/270] 10.222.0.58 () {60 vars in 1222 bytes} [Sat Aug 27 04:52:35 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 609 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:52:35.974406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-411477b9-47b4-4a12-b2bd-cac5c8d8ad3c tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Calling method '.version_select at 0x7fb565d74310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:35.978751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411477b9-47b4-4a12-b2bd-cac5c8d8ad3c tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.979560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411477b9-47b4-4a12-b2bd-cac5c8d8ad3c tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.980011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411477b9-47b4-4a12-b2bd-cac5c8d8ad3c tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.998386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411477b9-47b4-4a12-b2bd-cac5c8d8ad3c tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.999036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411477b9-47b4-4a12-b2bd-cac5c8d8ad3c tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.999313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411477b9-47b4-4a12-b2bd-cac5c8d8ad3c tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.007395 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-411477b9-47b4-4a12-b2bd-cac5c8d8ad3c tempest-HypervisorAdminV253TestBase-560189969 tempest-HypervisorAdminV253TestBase-560189969-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/08749300-0aab-4511-969e-aefb7a0e4b61" status: 200 len: 794 microversion: 2.53 time: 0.038435 Aug 27 04:52:36.007950 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 136/271] 10.222.0.58 () {60 vars in 1298 bytes} [Sat Aug 27 04:52:35 2022] GET /compute/v2.1/os-hypervisors/08749300-0aab-4511-969e-aefb7a0e4b61 => generated 794 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:52:36.017872 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ab5c934d-c0da-4aa5-9c78-5f80e7099fd6 tempest-AggregatesAdminTestJSON-416108208 tempest-AggregatesAdminTestJSON-416108208-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.068023 Aug 27 04:52:36.018842 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 136/272] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:52:35 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 04:52:36.028293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:36.028805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:36.037593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.038088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.038526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.042523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3472e304-dcad-4ee4-a0ea-35a80c2bbb63 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:36.043611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3472e304-dcad-4ee4-a0ea-35a80c2bbb63 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:36.044294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.044829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.045279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.060037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3472e304-dcad-4ee4-a0ea-35a80c2bbb63 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.060783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3472e304-dcad-4ee4-a0ea-35a80c2bbb63 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.061498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3472e304-dcad-4ee4-a0ea-35a80c2bbb63 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.062599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3472e304-dcad-4ee4-a0ea-35a80c2bbb63 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.063477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3472e304-dcad-4ee4-a0ea-35a80c2bbb63 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.064300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3472e304-dcad-4ee4-a0ea-35a80c2bbb63 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.076830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] HTTP exception thrown: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Request method failure captured: Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa HTTP/1.1 Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLN69wXEKTYUzSbq2hKgkcY6SQrHPhih7ffzIQPEAM-rC1gQ8bsytppP12fPpVysqY3qnyDiUO4AtesXhHiKcYavmsEbKCyxKqXVOBLq6HlTrZ9kVl8H0ILdBqiIYw6h_KQMEfmGLK1hq3TYKXeJskO-KGfyCO9SlbZ6AV02AbAnVU Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: a3022e36374f4afb9675d52829bdae29 Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminTestJSON-1606145396 Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:36.079490 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a3022e36374f4afb9675d52829bdae29", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a3022e36374f4afb9675d52829bdae29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a3022e36374f4afb9675d52829bdae29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a3022e36374f4afb9675d52829bdae29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminTestJSON-1606145396 Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: a3022e36374f4afb9675d52829bdae29 Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1606145396 Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminTestJSON-1606145396-project Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 267f37b81d5c47b9adc31fc11f9b74d8 Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminTestJSON-1606145396-project Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:36.080727 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2655c565-885b-4871-bdef-e28e07fb44aa'} Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:36.081506 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:36.082561 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:36.083826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Returning 404 to user: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:36.083826 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5b2c171-729a-4c35-94b0-0ab11be190b0 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 404 len: 111 microversion: 2.1 time: 0.056646 Aug 27 04:52:36.083826 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 137/273] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:52:36 2022] DELETE /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:36.093882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:36.095129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] [instance: 2655c565-885b-4871-bdef-e28e07fb44aa] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:36.111286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.112147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.112797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.113751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.121357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.121933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.148932 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] HTTP exception thrown: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Request method failure captured: Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa HTTP/1.1 Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLN69wXEKTYUzSbq2hKgkcY6SQrHPhih7ffzIQPEAM-rC1gQ8bsytppP12fPpVysqY3qnyDiUO4AtesXhHiKcYavmsEbKCyxKqXVOBLq6HlTrZ9kVl8H0ILdBqiIYw6h_KQMEfmGLK1hq3TYKXeJskO-KGfyCO9SlbZ6AV02AbAnVU Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: a3022e36374f4afb9675d52829bdae29 Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminTestJSON-1606145396 Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:36.150498 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a3022e36374f4afb9675d52829bdae29", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a3022e36374f4afb9675d52829bdae29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a3022e36374f4afb9675d52829bdae29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a3022e36374f4afb9675d52829bdae29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminTestJSON-1606145396 Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: a3022e36374f4afb9675d52829bdae29 Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1606145396 Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminTestJSON-1606145396-project Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 267f37b81d5c47b9adc31fc11f9b74d8 Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminTestJSON-1606145396-project Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:36.152262 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2655c565-885b-4871-bdef-e28e07fb44aa'} Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:36.152999 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. Aug 27 04:52:36.154014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:36.154966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] Returning 404 to user: Instance 2655c565-885b-4871-bdef-e28e07fb44aa could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:36.154966 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a00576e-e241-41d7-b3e2-c9d0ffc02cb7 tempest-AggregatesAdminTestJSON-1606145396 tempest-AggregatesAdminTestJSON-1606145396-project] 10.222.0.58 "GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa" status: 404 len: 111 microversion: 2.1 time: 0.062129 Aug 27 04:52:36.154966 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 138/274] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:36 2022] GET /compute/v2.1/servers/2655c565-885b-4871-bdef-e28e07fb44aa => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:36.200604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3472e304-dcad-4ee4-a0ea-35a80c2bbb63 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:36.210627 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3472e304-dcad-4ee4-a0ea-35a80c2bbb63 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1276 microversion: 2.1 time: 0.179168 Aug 27 04:52:36.225013 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 137/275] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:36 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:36.280705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:36.281575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:36.294455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.295018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.298112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.299813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.300984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.302710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.521652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:36.522582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:36.525285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=10,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:36.549793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.552248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.554671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.556935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.558803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.560521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.624013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:36.642225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:36.643724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:36.657817 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c53eb290-2c02-48f6-86c5-fc3b0c458587 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1362 microversion: 2.25 time: 0.380947 Aug 27 04:52:36.660518 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 139/276] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:36 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:36.739996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:36.750337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:36.754449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:36.770309 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5091b6dd-a0ab-4cec-b345-6514277acb14 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.253658 Aug 27 04:52:36.772234 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 138/277] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:36 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:36.945748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-800eedcd-8c15-4738-8a10-8e3d2d8935b7 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:36.946454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-800eedcd-8c15-4738-8a10-8e3d2d8935b7 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:36.954903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-800eedcd-8c15-4738-8a10-8e3d2d8935b7 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.955656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-800eedcd-8c15-4738-8a10-8e3d2d8935b7 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.956436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-800eedcd-8c15-4738-8a10-8e3d2d8935b7 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.957545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-800eedcd-8c15-4738-8a10-8e3d2d8935b7 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.958332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-800eedcd-8c15-4738-8a10-8e3d2d8935b7 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.958953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-800eedcd-8c15-4738-8a10-8e3d2d8935b7 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:37.233813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1faa80b-4a7b-4a68-8b04-ac75f025e420 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:37.234433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1faa80b-4a7b-4a68-8b04-ac75f025e420 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:37.248791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1faa80b-4a7b-4a68-8b04-ac75f025e420 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:37.249415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1faa80b-4a7b-4a68-8b04-ac75f025e420 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:37.249872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1faa80b-4a7b-4a68-8b04-ac75f025e420 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:37.257286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1faa80b-4a7b-4a68-8b04-ac75f025e420 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:37.259731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1faa80b-4a7b-4a68-8b04-ac75f025e420 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:37.261115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1faa80b-4a7b-4a68-8b04-ac75f025e420 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:37.353455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-800eedcd-8c15-4738-8a10-8e3d2d8935b7 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:37.375824 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-800eedcd-8c15-4738-8a10-8e3d2d8935b7 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1388 microversion: 2.1 time: 0.435758 Aug 27 04:52:37.377269 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 140/278] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:36 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1388 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:37.630638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f77169f7-2013-407a-a8f2-0797e71716a2 req-cfcb3a41-de61-4fd4-a7d3-32cfc26e54a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8582438a-00e8-41b1-8aeb-662d153b4983", "name": "network-vif-plugged", "status": "completed", "tag": "efa2644d-7860-4145-ae82-550f59ddc80c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:37.653473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f77169f7-2013-407a-a8f2-0797e71716a2 req-cfcb3a41-de61-4fd4-a7d3-32cfc26e54a6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:37.654542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f77169f7-2013-407a-a8f2-0797e71716a2 req-cfcb3a41-de61-4fd4-a7d3-32cfc26e54a6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:37.658190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f77169f7-2013-407a-a8f2-0797e71716a2 req-cfcb3a41-de61-4fd4-a7d3-32cfc26e54a6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:37.681462 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f77169f7-2013-407a-a8f2-0797e71716a2 req-cfcb3a41-de61-4fd4-a7d3-32cfc26e54a6 service nova] Creating event network-vif-plugged:efa2644d-7860-4145-ae82-550f59ddc80c for instance 8582438a-00e8-41b1-8aeb-662d153b4983 on n-h2-820368-35 Aug 27 04:52:37.688231 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f77169f7-2013-407a-a8f2-0797e71716a2 req-cfcb3a41-de61-4fd4-a7d3-32cfc26e54a6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062689 Aug 27 04:52:37.689670 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 141/279] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:37.697691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:37.699380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:37.706781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:37.707842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:37.708568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:37.709966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:37.710650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:37.711561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:37.838194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1faa80b-4a7b-4a68-8b04-ac75f025e420 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:37.853347 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1faa80b-4a7b-4a68-8b04-ac75f025e420 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1324 microversion: 2.1 time: 0.623780 Aug 27 04:52:37.854696 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 139/280] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:37 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1324 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:37.860208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:37.861695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:37.870886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:37.871886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:37.872876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:37.873886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:37.874361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:37.874795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:37.906630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:38.032193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:38.050047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:38.061881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:38.087533 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-626afa79-1581-4f75-8b0e-c19d19f1f0b0 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.231424 Aug 27 04:52:38.089039 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 140/281] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:37 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:38.279505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:38.295939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:38.297538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:38.298699 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f613437a-56d3-4dd0-b907-5389f4cd29f5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1362 microversion: 2.25 time: 0.607725 Aug 27 04:52:38.299608 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 142/282] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:37 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:38.400777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c91963da-7c94-49f0-b490-4ff9397be24f tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:38.402268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c91963da-7c94-49f0-b490-4ff9397be24f tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:38.414240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c91963da-7c94-49f0-b490-4ff9397be24f tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.415213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c91963da-7c94-49f0-b490-4ff9397be24f tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.415979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c91963da-7c94-49f0-b490-4ff9397be24f tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.420024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c91963da-7c94-49f0-b490-4ff9397be24f tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.420739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c91963da-7c94-49f0-b490-4ff9397be24f tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.421370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c91963da-7c94-49f0-b490-4ff9397be24f tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.670345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c91963da-7c94-49f0-b490-4ff9397be24f tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:38.683112 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c91963da-7c94-49f0-b490-4ff9397be24f tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1388 microversion: 2.1 time: 0.285966 Aug 27 04:52:38.683971 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 143/283] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:38 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1388 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:38.693206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-51bf3db2-f466-40d1-81ef-6c150acc2d49 req-58782ed4-16e0-40cc-8463-69e9c211e5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb98f2a-181a-4dd0-b454-8adec268f65f", "tag": "d2ef900d-23fd-47bd-9461-d82bd76c45a0"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:38.706993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-51bf3db2-f466-40d1-81ef-6c150acc2d49 req-58782ed4-16e0-40cc-8463-69e9c211e5ca service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.707730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-51bf3db2-f466-40d1-81ef-6c150acc2d49 req-58782ed4-16e0-40cc-8463-69e9c211e5ca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.708760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-51bf3db2-f466-40d1-81ef-6c150acc2d49 req-58782ed4-16e0-40cc-8463-69e9c211e5ca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.733880 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-51bf3db2-f466-40d1-81ef-6c150acc2d49 req-58782ed4-16e0-40cc-8463-69e9c211e5ca service nova] Creating event network-changed:d2ef900d-23fd-47bd-9461-d82bd76c45a0 for instance 3cb98f2a-181a-4dd0-b454-8adec268f65f on n-h1-820368-35 Aug 27 04:52:38.739552 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-51bf3db2-f466-40d1-81ef-6c150acc2d49 req-58782ed4-16e0-40cc-8463-69e9c211e5ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054203 Aug 27 04:52:38.740972 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 144/284] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:38.788329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9531c363-d787-4d65-b742-4f57c4795f46 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Action: 'update', calling method: .version_select at 0x7fb565c80b80>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:38.792758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9531c363-d787-4d65-b742-4f57c4795f46 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.802008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9531c363-d787-4d65-b742-4f57c4795f46 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.802675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9531c363-d787-4d65-b742-4f57c4795f46 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.812767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9531c363-d787-4d65-b742-4f57c4795f46 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.817276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9531c363-d787-4d65-b742-4f57c4795f46 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.818042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9531c363-d787-4d65-b742-4f57c4795f46 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.838998 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-9531c363-d787-4d65-b742-4f57c4795f46 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] HTTP exception thrown: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9531c363-d787-4d65-b742-4f57c4795f46 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Request method failure captured: Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: request: PUT /compute/v2.1/os-services/8b1674b7-88ce-40e6-85d3-f5377162629d HTTP/1.1 Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 56 Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMWvxiBWXwp22JwhsFpEdBw3lFPi_ZeQaVJ0MaRowtcxZQgcMxF8wO1pfUF9gm9uNnkJ0VjfGtR5_kwoykh-lzPx6hTSvics0nvMt4_D7Dp3zLXvvHSi6Cgq-8ss7BT7oUCkpoMLTtRakOW88RhmNLbsoviuF3HtRHpNRAfmCOUQIo Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 3be533b57f6047aeaaac20cb00c5a446 Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1928018456 Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:52:38.841276 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3be533b57f6047aeaaac20cb00c5a446", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3be533b57f6047aeaaac20cb00c5a446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3be533b57f6047aeaaac20cb00c5a446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3be533b57f6047aeaaac20cb00c5a446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1928018456 Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 3be533b57f6047aeaaac20cb00c5a446 Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1928018456 Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: e41aa5b257294b869f925f2e2c30680f Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:52:38.842566 n-d-820368-35 devstack@n-api.service[128547]: exception: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '8b1674b7-88ce-40e6-85d3-f5377162629d', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.843825 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:38.845319 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:38.846488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:38.846488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:38.846488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.846488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9531c363-d787-4d65-b742-4f57c4795f46 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Returning 404 to user: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:38.846488 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9531c363-d787-4d65-b742-4f57c4795f46 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/8b1674b7-88ce-40e6-85d3-f5377162629d" status: 404 len: 110 microversion: 2.53 time: 0.586588 Aug 27 04:52:38.855277 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 141/285] 10.222.0.58 () {62 vars in 1309 bytes} [Sat Aug 27 04:52:38 2022] PUT /compute/v2.1/os-services/8b1674b7-88ce-40e6-85d3-f5377162629d => generated 110 bytes in 589 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:52:38.855449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9ff4e87-0990-45d9-8969-c5e082cd23a1 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Action: 'update', calling method: .version_select at 0x7fb566f08310>, body: {"status": "disabled"} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:38.859837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ff4e87-0990-45d9-8969-c5e082cd23a1 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.865080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ff4e87-0990-45d9-8969-c5e082cd23a1 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.866474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ff4e87-0990-45d9-8969-c5e082cd23a1 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.874658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec513315-1b64-41bb-97b8-edfa1f912063 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:38.875337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec513315-1b64-41bb-97b8-edfa1f912063 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:38.894026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec513315-1b64-41bb-97b8-edfa1f912063 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.894510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec513315-1b64-41bb-97b8-edfa1f912063 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.895158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec513315-1b64-41bb-97b8-edfa1f912063 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.896294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec513315-1b64-41bb-97b8-edfa1f912063 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.896761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec513315-1b64-41bb-97b8-edfa1f912063 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.897200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec513315-1b64-41bb-97b8-edfa1f912063 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.900114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ff4e87-0990-45d9-8969-c5e082cd23a1 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.901150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ff4e87-0990-45d9-8969-c5e082cd23a1 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.910276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ff4e87-0990-45d9-8969-c5e082cd23a1 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.934398 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f9ff4e87-0990-45d9-8969-c5e082cd23a1 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] HTTP exception thrown: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9ff4e87-0990-45d9-8969-c5e082cd23a1 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Request method failure captured: Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: request: PUT /compute/v2.1/os-services/8b1674b7-88ce-40e6-85d3-f5377162629d HTTP/1.1 Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 22 Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMWvxiBWXwp22JwhsFpEdBw3lFPi_ZeQaVJ0MaRowtcxZQgcMxF8wO1pfUF9gm9uNnkJ0VjfGtR5_kwoykh-lzPx6hTSvics0nvMt4_D7Dp3zLXvvHSi6Cgq-8ss7BT7oUCkpoMLTtRakOW88RhmNLbsoviuF3HtRHpNRAfmCOUQIo Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 3be533b57f6047aeaaac20cb00c5a446 Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1928018456 Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:38.946273 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3be533b57f6047aeaaac20cb00c5a446", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3be533b57f6047aeaaac20cb00c5a446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3be533b57f6047aeaaac20cb00c5a446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3be533b57f6047aeaaac20cb00c5a446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1928018456 Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 3be533b57f6047aeaaac20cb00c5a446 Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1928018456 Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: e41aa5b257294b869f925f2e2c30680f Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: {"status": "disabled"} Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: exception: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:38.947902 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '8b1674b7-88ce-40e6-85d3-f5377162629d', 'body': {'status': 'disabled'}} Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:38.948818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:38.950170 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:38.951566 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:38.951566 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:38.967762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9ff4e87-0990-45d9-8969-c5e082cd23a1 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Returning 404 to user: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:38.968918 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9ff4e87-0990-45d9-8969-c5e082cd23a1 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/8b1674b7-88ce-40e6-85d3-f5377162629d" status: 404 len: 110 microversion: 2.53 time: 0.118777 Aug 27 04:52:38.979767 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 145/286] 10.222.0.58 () {62 vars in 1309 bytes} [Sat Aug 27 04:52:38 2022] PUT /compute/v2.1/os-services/8b1674b7-88ce-40e6-85d3-f5377162629d => generated 110 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:52:38.992696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d0a96418-486b-4084-af92-5c4504182d8e tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Action: 'update', calling method: .version_select at 0x7fb565ce3a60>, body: {"status": "enabled"} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:39.005051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0a96418-486b-4084-af92-5c4504182d8e tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.008228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0a96418-486b-4084-af92-5c4504182d8e tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.008838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0a96418-486b-4084-af92-5c4504182d8e tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.022456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0a96418-486b-4084-af92-5c4504182d8e tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.025457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0a96418-486b-4084-af92-5c4504182d8e tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.026223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0a96418-486b-4084-af92-5c4504182d8e tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.042756 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d0a96418-486b-4084-af92-5c4504182d8e tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] HTTP exception thrown: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d0a96418-486b-4084-af92-5c4504182d8e tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Request method failure captured: Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: request: PUT /compute/v2.1/os-services/8b1674b7-88ce-40e6-85d3-f5377162629d HTTP/1.1 Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 21 Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMWvxiBWXwp22JwhsFpEdBw3lFPi_ZeQaVJ0MaRowtcxZQgcMxF8wO1pfUF9gm9uNnkJ0VjfGtR5_kwoykh-lzPx6hTSvics0nvMt4_D7Dp3zLXvvHSi6Cgq-8ss7BT7oUCkpoMLTtRakOW88RhmNLbsoviuF3HtRHpNRAfmCOUQIo Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 3be533b57f6047aeaaac20cb00c5a446 Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1928018456 Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:39.047547 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3be533b57f6047aeaaac20cb00c5a446", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3be533b57f6047aeaaac20cb00c5a446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3be533b57f6047aeaaac20cb00c5a446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3be533b57f6047aeaaac20cb00c5a446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1928018456 Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 3be533b57f6047aeaaac20cb00c5a446 Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1928018456 Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: e41aa5b257294b869f925f2e2c30680f Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: {"status": "enabled"} Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: exception: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:39.048987 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '8b1674b7-88ce-40e6-85d3-f5377162629d', 'body': {'status': 'enabled'}} Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:39.049958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:39.051359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:39.052661 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. Aug 27 04:52:39.052661 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:39.055338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d0a96418-486b-4084-af92-5c4504182d8e tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Returning 404 to user: Service 8b1674b7-88ce-40e6-85d3-f5377162629d could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:39.056397 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d0a96418-486b-4084-af92-5c4504182d8e tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/8b1674b7-88ce-40e6-85d3-f5377162629d" status: 404 len: 110 microversion: 2.53 time: 0.075452 Aug 27 04:52:39.066819 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 146/287] 10.222.0.58 () {62 vars in 1309 bytes} [Sat Aug 27 04:52:38 2022] PUT /compute/v2.1/os-services/8b1674b7-88ce-40e6-85d3-f5377162629d => generated 110 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:52:39.076194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c230fec-2dfc-4055-88c2-0d6e40e91418 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.092833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c230fec-2dfc-4055-88c2-0d6e40e91418 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.093804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c230fec-2dfc-4055-88c2-0d6e40e91418 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.094659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c230fec-2dfc-4055-88c2-0d6e40e91418 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.095757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c230fec-2dfc-4055-88c2-0d6e40e91418 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.096963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c230fec-2dfc-4055-88c2-0d6e40e91418 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.098997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c230fec-2dfc-4055-88c2-0d6e40e91418 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.159177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ec513315-1b64-41bb-97b8-edfa1f912063 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.169507 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec513315-1b64-41bb-97b8-edfa1f912063 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1324 microversion: 2.1 time: 0.299279 Aug 27 04:52:39.170697 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 142/288] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:38 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:39.171405 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c230fec-2dfc-4055-88c2-0d6e40e91418 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.103031 Aug 27 04:52:39.172002 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 147/289] 10.222.0.58 () {60 vars in 1178 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:39.184081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ea7111b-b3c7-47cd-a922-bd558d3ba24d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.188899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea7111b-b3c7-47cd-a922-bd558d3ba24d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.189593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea7111b-b3c7-47cd-a922-bd558d3ba24d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.190187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea7111b-b3c7-47cd-a922-bd558d3ba24d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.191119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea7111b-b3c7-47cd-a922-bd558d3ba24d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.191748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea7111b-b3c7-47cd-a922-bd558d3ba24d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.192164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea7111b-b3c7-47cd-a922-bd558d3ba24d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.193035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.195920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:39.217230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.217733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.218171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.220266 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ea7111b-b3c7-47cd-a922-bd558d3ba24d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.039625 Aug 27 04:52:39.221635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.223713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.224461 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 148/290] 10.222.0.58 () {60 vars in 1211 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:39.226366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.234420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-462fd047-ba45-46ae-a648-6e4193513fa8 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.240163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-462fd047-ba45-46ae-a648-6e4193513fa8 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.240924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-462fd047-ba45-46ae-a648-6e4193513fa8 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.241815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-462fd047-ba45-46ae-a648-6e4193513fa8 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.242766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-462fd047-ba45-46ae-a648-6e4193513fa8 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.243475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-462fd047-ba45-46ae-a648-6e4193513fa8 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.244221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-462fd047-ba45-46ae-a648-6e4193513fa8 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.274738 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-462fd047-ba45-46ae-a648-6e4193513fa8 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.044255 Aug 27 04:52:39.282992 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 149/291] 10.222.0.58 () {60 vars in 1178 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:39.288528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f918635b-8812-4a86-b3fd-c90eaebc9f21 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.293066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f918635b-8812-4a86-b3fd-c90eaebc9f21 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.293880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f918635b-8812-4a86-b3fd-c90eaebc9f21 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.294669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f918635b-8812-4a86-b3fd-c90eaebc9f21 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.295695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f918635b-8812-4a86-b3fd-c90eaebc9f21 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.296411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f918635b-8812-4a86-b3fd-c90eaebc9f21 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.297065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f918635b-8812-4a86-b3fd-c90eaebc9f21 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.325255 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f918635b-8812-4a86-b3fd-c90eaebc9f21 tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-820368-35&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.040663 Aug 27 04:52:39.326591 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 150/292] 10.222.0.58 () {60 vars in 1237 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/os-services?host=n-d-820368-35&binary=xxx => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:39.333322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.334314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:39.343377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.344247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.344973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.346032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.346705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.347465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.374042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.388139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.400059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.415424 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-caa9daf6-dbba-43a1-bf50-d8d26d279a85 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.243444 Aug 27 04:52:39.416451 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 143/293] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:39.425736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d267cdcd-4774-43b3-b205-c9fe264b8a1a tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.437059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d267cdcd-4774-43b3-b205-c9fe264b8a1a tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.440027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d267cdcd-4774-43b3-b205-c9fe264b8a1a tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.441608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d267cdcd-4774-43b3-b205-c9fe264b8a1a tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.443072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d267cdcd-4774-43b3-b205-c9fe264b8a1a tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.448168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d267cdcd-4774-43b3-b205-c9fe264b8a1a tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.448168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d267cdcd-4774-43b3-b205-c9fe264b8a1a tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.500059 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d267cdcd-4774-43b3-b205-c9fe264b8a1a tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.082055 Aug 27 04:52:39.501703 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 144/294] 10.222.0.58 () {60 vars in 1178 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:39.515735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b5898c1-a643-44db-b232-99935871393d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.520551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b5898c1-a643-44db-b232-99935871393d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.522643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b5898c1-a643-44db-b232-99935871393d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.523712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b5898c1-a643-44db-b232-99935871393d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.524978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b5898c1-a643-44db-b232-99935871393d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.526002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b5898c1-a643-44db-b232-99935871393d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.526577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b5898c1-a643-44db-b232-99935871393d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.595489 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b5898c1-a643-44db-b232-99935871393d tempest-ServicesAdminNegativeV253TestJSON-1928018456 tempest-ServicesAdminNegativeV253TestJSON-1928018456-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.082602 Aug 27 04:52:39.603792 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 145/295] 10.222.0.58 () {60 vars in 1239 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:39.655467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.669419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.671178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.673640 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d3c84a87-37ab-4a47-bdca-79ae8d050bc3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1362 microversion: 2.25 time: 0.345874 Aug 27 04:52:39.675281 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 151/296] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:39.710657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7dcdad9f-8950-4689-892a-ca150a1c35c9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.713766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7dcdad9f-8950-4689-892a-ca150a1c35c9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:39.727157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dcdad9f-8950-4689-892a-ca150a1c35c9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.727861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dcdad9f-8950-4689-892a-ca150a1c35c9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.728451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dcdad9f-8950-4689-892a-ca150a1c35c9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.730188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dcdad9f-8950-4689-892a-ca150a1c35c9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.730849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dcdad9f-8950-4689-892a-ca150a1c35c9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.731519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dcdad9f-8950-4689-892a-ca150a1c35c9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.877677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a964621-565e-45f7-92ce-dad9aa89146b tempest-ServicesAdminNegativeV253TestJSON-2041416407 tempest-ServicesAdminNegativeV253TestJSON-2041416407-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.883182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2a964621-565e-45f7-92ce-dad9aa89146b tempest-ServicesAdminNegativeV253TestJSON-2041416407 tempest-ServicesAdminNegativeV253TestJSON-2041416407-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c4b92f1813b640d7b87af4272487b753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043179bedd804d578ab76af6aa17b3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a964621-565e-45f7-92ce-dad9aa89146b tempest-ServicesAdminNegativeV253TestJSON-2041416407 tempest-ServicesAdminNegativeV253TestJSON-2041416407-project] Request method failure captured: Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMUyT56D81YLamH0cLd-8YVKz65_25_Ik8NNEl8u2i1ot0Jdv3MQSmSujtA5Q0jrrFS2KR6gqMtywZ_qmJbWeKYxVxjfiCG-U1UZiKM_9p-0b1Z0v36UMHT1gRXa8DFn0MegZR-DBjPR3YLH_bkPPyikoERTiMuH-bwhiLzG9DfLOc Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 043179bedd804d578ab76af6aa17b3ae Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2041416407 Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:52:39.886028 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_043179bedd804d578ab76af6aa17b3ae", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/043179bedd804d578ab76af6aa17b3ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/043179bedd804d578ab76af6aa17b3ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/043179bedd804d578ab76af6aa17b3ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2041416407 Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 043179bedd804d578ab76af6aa17b3ae Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2041416407 Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2041416407-project Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c4b92f1813b640d7b87af4272487b753 Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2041416407-project Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 04:52:39.887508 n-d-820368-35 devstack@n-api.service[128547]: action_args: {} Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:39.888330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 04:52:39.889591 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:39.892268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a964621-565e-45f7-92ce-dad9aa89146b tempest-ServicesAdminNegativeV253TestJSON-2041416407 tempest-ServicesAdminNegativeV253TestJSON-2041416407-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:39.893367 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a964621-565e-45f7-92ce-dad9aa89146b tempest-ServicesAdminNegativeV253TestJSON-2041416407 tempest-ServicesAdminNegativeV253TestJSON-2041416407-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.287955 Aug 27 04:52:39.894308 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 146/297] 10.222.0.58 () {60 vars in 1178 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/os-services => generated 112 bytes in 290 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:52:39.900985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c46adb9d-e531-4322-80ad-70e4b315ac3d req-ba6a9850-e02a-4306-98c4-8e2947bae7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57a38fc-e317-4555-bba4-f2cedd73562d", "name": "network-vif-plugged", "status": "completed", "tag": "5f3f4146-89cf-410e-80ce-9aa915641be8"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:39.913598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c46adb9d-e531-4322-80ad-70e4b315ac3d req-ba6a9850-e02a-4306-98c4-8e2947bae7ef service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.914338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c46adb9d-e531-4322-80ad-70e4b315ac3d req-ba6a9850-e02a-4306-98c4-8e2947bae7ef service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.914919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c46adb9d-e531-4322-80ad-70e4b315ac3d req-ba6a9850-e02a-4306-98c4-8e2947bae7ef service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.929978 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c46adb9d-e531-4322-80ad-70e4b315ac3d req-ba6a9850-e02a-4306-98c4-8e2947bae7ef service nova] Creating event network-vif-plugged:5f3f4146-89cf-410e-80ce-9aa915641be8 for instance b57a38fc-e317-4555-bba4-f2cedd73562d on n-h1-820368-35 Aug 27 04:52:39.936944 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c46adb9d-e531-4322-80ad-70e4b315ac3d req-ba6a9850-e02a-4306-98c4-8e2947bae7ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041322 Aug 27 04:52:39.938495 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 147/298] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:39.965672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7dcdad9f-8950-4689-892a-ca150a1c35c9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.975935 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7dcdad9f-8950-4689-892a-ca150a1c35c9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1587 microversion: 2.1 time: 0.275024 Aug 27 04:52:39.985677 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 152/299] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1587 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:39.999017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-503ca907-ec06-4245-b065-3b8cbb824b67 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:40.000146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-503ca907-ec06-4245-b065-3b8cbb824b67 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:40.007317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503ca907-ec06-4245-b065-3b8cbb824b67 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.008007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503ca907-ec06-4245-b065-3b8cbb824b67 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.008908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503ca907-ec06-4245-b065-3b8cbb824b67 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.009819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503ca907-ec06-4245-b065-3b8cbb824b67 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.010481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503ca907-ec06-4245-b065-3b8cbb824b67 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.011596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-503ca907-ec06-4245-b065-3b8cbb824b67 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.118350 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-503ca907-ec06-4245-b065-3b8cbb824b67 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123749 Aug 27 04:52:40.118937 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 148/300] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:40.196068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a30de1cb-f48d-4010-8c9f-4bae5ba5a2dd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:40.197078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a30de1cb-f48d-4010-8c9f-4bae5ba5a2dd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:40.204955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a30de1cb-f48d-4010-8c9f-4bae5ba5a2dd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.206099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a30de1cb-f48d-4010-8c9f-4bae5ba5a2dd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.207829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a30de1cb-f48d-4010-8c9f-4bae5ba5a2dd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.210353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a30de1cb-f48d-4010-8c9f-4bae5ba5a2dd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.211924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a30de1cb-f48d-4010-8c9f-4bae5ba5a2dd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.212918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a30de1cb-f48d-4010-8c9f-4bae5ba5a2dd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.445525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:40.446975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:40.454071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.454552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.455282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.456318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.457101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.457830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.570431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:40.579517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:40.580992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:40.601016 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0290d638-39d2-4b2a-abce-037d5a486dfd tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.159556 Aug 27 04:52:40.611554 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 149/301] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:40 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:40.703048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:40.704521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:40.717422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.718061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.718457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.721387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.722412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.722849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.728241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a30de1cb-f48d-4010-8c9f-4bae5ba5a2dd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:40.739535 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a30de1cb-f48d-4010-8c9f-4bae5ba5a2dd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1324 microversion: 2.1 time: 0.551912 Aug 27 04:52:40.740423 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 153/302] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:40 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1324 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:41.160082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:41.175154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:41.177166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:41.179122 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de837341-44cd-4c6e-8f4b-ac3b9061ba32 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1362 microversion: 2.25 time: 0.481848 Aug 27 04:52:41.179722 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 150/303] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:40 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1362 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:41.628638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:41.628793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:41.634105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:41.638272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:41.639573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:41.640171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:41.641574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:41.642490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:41.643066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:41.761946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3f11792a-9b32-45df-97a8-4202ec596c67 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:41.762562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3f11792a-9b32-45df-97a8-4202ec596c67 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:41.772787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f11792a-9b32-45df-97a8-4202ec596c67 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:41.774831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f11792a-9b32-45df-97a8-4202ec596c67 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:41.775500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f11792a-9b32-45df-97a8-4202ec596c67 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:41.776326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:41.777525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f11792a-9b32-45df-97a8-4202ec596c67 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:41.779602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f11792a-9b32-45df-97a8-4202ec596c67 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:41.780774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f11792a-9b32-45df-97a8-4202ec596c67 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:41.804906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:41.807037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:41.817573 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f60bfd56-b96c-484c-aabf-1c0a626320b3 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.195380 Aug 27 04:52:41.818016 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 154/304] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:41 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:41.960582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ccde0e8-98a4-4baf-9c0c-431bf76c523c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:41.961279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ccde0e8-98a4-4baf-9c0c-431bf76c523c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:41.970803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ccde0e8-98a4-4baf-9c0c-431bf76c523c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:41.971720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ccde0e8-98a4-4baf-9c0c-431bf76c523c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:41.973298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ccde0e8-98a4-4baf-9c0c-431bf76c523c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:41.975500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ccde0e8-98a4-4baf-9c0c-431bf76c523c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:41.976789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ccde0e8-98a4-4baf-9c0c-431bf76c523c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:41.978034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ccde0e8-98a4-4baf-9c0c-431bf76c523c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:42.087788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f11792a-9b32-45df-97a8-4202ec596c67 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:42.100298 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3f11792a-9b32-45df-97a8-4202ec596c67 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1324 microversion: 2.1 time: 0.341027 Aug 27 04:52:42.118727 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 151/305] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:41 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1324 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:42.146628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5c404665-688e-421a-9062-6f6d123a4be9 req-48da7a01-b093-428a-813d-9f44c10c6ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8582438a-00e8-41b1-8aeb-662d153b4983", "tag": "efa2644d-7860-4145-ae82-550f59ddc80c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:42.192671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5c404665-688e-421a-9062-6f6d123a4be9 req-48da7a01-b093-428a-813d-9f44c10c6ee5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:42.193399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5c404665-688e-421a-9062-6f6d123a4be9 req-48da7a01-b093-428a-813d-9f44c10c6ee5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:42.193616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5c404665-688e-421a-9062-6f6d123a4be9 req-48da7a01-b093-428a-813d-9f44c10c6ee5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:42.228376 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5c404665-688e-421a-9062-6f6d123a4be9 req-48da7a01-b093-428a-813d-9f44c10c6ee5 service nova] Creating event network-changed:efa2644d-7860-4145-ae82-550f59ddc80c for instance 8582438a-00e8-41b1-8aeb-662d153b4983 on n-h2-820368-35 Aug 27 04:52:42.241093 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5c404665-688e-421a-9062-6f6d123a4be9 req-48da7a01-b093-428a-813d-9f44c10c6ee5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120431 Aug 27 04:52:42.243432 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 152/306] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:42.255210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:42.256158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:42.264033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:42.264813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:42.265414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:42.267661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:42.268282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:42.268966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:42.348435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ccde0e8-98a4-4baf-9c0c-431bf76c523c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:42.359279 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ccde0e8-98a4-4baf-9c0c-431bf76c523c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 200 len: 1587 microversion: 2.1 time: 0.400436 Aug 27 04:52:42.371110 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 155/307] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:41 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 1587 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:42.644754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:42.659271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:42.661342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:42.662897 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-944439e7-7ee4-4153-8958-306abc855fe3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1362 microversion: 2.25 time: 0.416804 Aug 27 04:52:42.666229 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 153/308] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:42 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:42.851971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:42.852864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:42.868140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:42.871827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:42.872437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:42.873913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:42.875374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:42.875956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:42.901522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-392833896", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:43.005188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:52:43.283353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:43.297399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:43.300203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:43.313254 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ae669e3e-7d1a-493c-b905-1f6f84f28c38 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.466251 Aug 27 04:52:43.322073 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 154/309] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:42 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:43.332585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2d962d36-d6cd-4b75-954c-cf9f9739393d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:43.334743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2d962d36-d6cd-4b75-954c-cf9f9739393d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:43.344368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d962d36-d6cd-4b75-954c-cf9f9739393d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:43.348126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d962d36-d6cd-4b75-954c-cf9f9739393d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:43.348581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d962d36-d6cd-4b75-954c-cf9f9739393d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:43.349310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d962d36-d6cd-4b75-954c-cf9f9739393d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:43.349776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d962d36-d6cd-4b75-954c-cf9f9739393d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:43.350232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d962d36-d6cd-4b75-954c-cf9f9739393d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:43.921017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2d962d36-d6cd-4b75-954c-cf9f9739393d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:43.930248 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2d962d36-d6cd-4b75-954c-cf9f9739393d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1324 microversion: 2.1 time: 0.606316 Aug 27 04:52:43.944048 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 155/310] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:43 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1324 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:43.975542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:43.976605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:43.977373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:43.977795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:43.978538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:43.989957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:43.991330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:43.992112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:43.993129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:43.993733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:44.006536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:44.055571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:44.066834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:44.100734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:52:44.103665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:52:44.166186 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10528265-d728-4a42-b137-a87434665bbd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603309 Aug 27 04:52:44.168088 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 156/311] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:52:44.182941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:44.183610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:44.217910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:44.219650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:44.220111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:44.220894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:44.223987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:44.225663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:44.354756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cc60e6d1-da71-4feb-b2be-779c0ff3dccd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:44.376797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc60e6d1-da71-4feb-b2be-779c0ff3dccd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:44.377824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc60e6d1-da71-4feb-b2be-779c0ff3dccd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:44.379526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc60e6d1-da71-4feb-b2be-779c0ff3dccd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:44.380552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc60e6d1-da71-4feb-b2be-779c0ff3dccd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:44.381546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc60e6d1-da71-4feb-b2be-779c0ff3dccd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:44.382713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc60e6d1-da71-4feb-b2be-779c0ff3dccd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:44.472514 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cc60e6d1-da71-4feb-b2be-779c0ff3dccd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.526446 Aug 27 04:52:44.474393 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 156/312] 10.222.0.58 () {58 vars in 1176 bytes} [Sat Aug 27 04:52:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:44.488101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9006d7cf-40ba-4cf3-8eeb-d22a2242d2f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:44.490723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9006d7cf-40ba-4cf3-8eeb-d22a2242d2f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:44.601742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9006d7cf-40ba-4cf3-8eeb-d22a2242d2f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:44.612800 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9006d7cf-40ba-4cf3-8eeb-d22a2242d2f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1216 microversion: 2.1 time: 0.135545 Aug 27 04:52:44.614617 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 157/313] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:44 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:44.621036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:44.621935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:44.623828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:44.629584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:44.630391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:44.631057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:44.632587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:44.633181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:44.633793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:44.635660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:44.637116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:44.638463 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89e33ec1-3874-4c8f-9bcb-06b957d60410 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1559 microversion: 2.25 time: 0.466865 Aug 27 04:52:44.639596 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 157/314] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:44 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1559 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:44.644895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ffde1253-23e6-4584-898e-1eac6d5db3c1 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-294510072"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:44.648837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-ffde1253-23e6-4584-898e-1eac6d5db3c1 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Generated uuid fd6800bb-d468-4c8a-8f87-bd950310770e for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:44.695815 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ffde1253-23e6-4584-898e-1eac6d5db3c1 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054852 Aug 27 04:52:44.698240 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 158/315] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:44.816130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:44.834447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:44.836104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:44.847908 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb596aa6-cabe-4b7c-b634-1d2a762f4cdc tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.231856 Aug 27 04:52:44.851709 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 158/316] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:44 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:44.865061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f9ca98f-d985-4267-9ec9-73b86c43d233 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-820368-35"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:44.910692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f9ca98f-d985-4267-9ec9-73b86c43d233 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:44.911220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f9ca98f-d985-4267-9ec9-73b86c43d233 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:44.911926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f9ca98f-d985-4267-9ec9-73b86c43d233 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:44.982742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-231c87ba-9d9e-431d-9955-f96cbc20e84b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:44.984950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-231c87ba-9d9e-431d-9955-f96cbc20e84b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:45.005759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-231c87ba-9d9e-431d-9955-f96cbc20e84b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.008808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-231c87ba-9d9e-431d-9955-f96cbc20e84b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.012271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-231c87ba-9d9e-431d-9955-f96cbc20e84b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.015059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-231c87ba-9d9e-431d-9955-f96cbc20e84b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.017852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-231c87ba-9d9e-431d-9955-f96cbc20e84b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.018337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-231c87ba-9d9e-431d-9955-f96cbc20e84b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.044200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:45.115982 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f9ca98f-d985-4267-9ec9-73b86c43d233 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.262859 Aug 27 04:52:45.116662 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 159/317] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 04:52:44 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:45.122140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-658f52da-8602-4c8b-b80e-f935e45302ac tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:45.127296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-658f52da-8602-4c8b-b80e-f935e45302ac tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:45.144913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-658f52da-8602-4c8b-b80e-f935e45302ac tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.146117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-658f52da-8602-4c8b-b80e-f935e45302ac tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.148308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-658f52da-8602-4c8b-b80e-f935e45302ac tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.150849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-658f52da-8602-4c8b-b80e-f935e45302ac tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.151885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-658f52da-8602-4c8b-b80e-f935e45302ac tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.152464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-658f52da-8602-4c8b-b80e-f935e45302ac tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.317256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-231c87ba-9d9e-431d-9955-f96cbc20e84b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid b57a38fc-e317-4555-bba4-f2cedd73562d {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:52:45.416014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-658f52da-8602-4c8b-b80e-f935e45302ac tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:45.424318 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-231c87ba-9d9e-431d-9955-f96cbc20e84b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 2054 microversion: 2.25 time: 0.722617 Aug 27 04:52:45.424904 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 159/318] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:44 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 2054 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:45.427350 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-658f52da-8602-4c8b-b80e-f935e45302ac tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1324 microversion: 2.1 time: 0.307148 Aug 27 04:52:45.427350 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 160/319] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:45 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:45.441990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-efda48cb-2644-49ca-bb07-f2a79864db6a req-590cb550-9e9b-4411-b2b8-ec28f0c12884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb98f2a-181a-4dd0-b454-8adec268f65f", "name": "network-vif-plugged", "status": "completed", "tag": "d2ef900d-23fd-47bd-9461-d82bd76c45a0"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:45.455264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2db9d26a-7a78-47c1-8692-28516aa4c890 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:45.465925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-efda48cb-2644-49ca-bb07-f2a79864db6a req-590cb550-9e9b-4411-b2b8-ec28f0c12884 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.466493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-efda48cb-2644-49ca-bb07-f2a79864db6a req-590cb550-9e9b-4411-b2b8-ec28f0c12884 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.470892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-efda48cb-2644-49ca-bb07-f2a79864db6a req-590cb550-9e9b-4411-b2b8-ec28f0c12884 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.474753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2db9d26a-7a78-47c1-8692-28516aa4c890 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.488189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2db9d26a-7a78-47c1-8692-28516aa4c890 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.488834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2db9d26a-7a78-47c1-8692-28516aa4c890 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.501217 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-efda48cb-2644-49ca-bb07-f2a79864db6a req-590cb550-9e9b-4411-b2b8-ec28f0c12884 service nova] Creating event network-vif-plugged:d2ef900d-23fd-47bd-9461-d82bd76c45a0 for instance 3cb98f2a-181a-4dd0-b454-8adec268f65f on n-h1-820368-35 Aug 27 04:52:45.511496 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-efda48cb-2644-49ca-bb07-f2a79864db6a req-590cb550-9e9b-4411-b2b8-ec28f0c12884 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082814 Aug 27 04:52:45.512840 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 161/320] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:45.520398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e1b5764-e479-4b9e-a86c-4b8375f431ea tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:45.521807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1e1b5764-e479-4b9e-a86c-4b8375f431ea tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:45.531783 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-2db9d26a-7a78-47c1-8692-28516aa4c890 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-820368-35. Aug 27 04:52:45.532692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e1b5764-e479-4b9e-a86c-4b8375f431ea tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.533387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e1b5764-e479-4b9e-a86c-4b8375f431ea tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.533978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e1b5764-e479-4b9e-a86c-4b8375f431ea tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.534916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e1b5764-e479-4b9e-a86c-4b8375f431ea tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.535537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e1b5764-e479-4b9e-a86c-4b8375f431ea tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.536106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e1b5764-e479-4b9e-a86c-4b8375f431ea tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2db9d26a-7a78-47c1-8692-28516aa4c890 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Request method failure captured: Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 40 Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMbGOQoslN-cY1P8DANhOiuI9AGyA4kvo6EapHJXn6usJC3CACYTxNEBCp4dqRrevwQ7S0VtEJXmCe8gRyfqwK8fdePo9-yo8dMu1A7eUS0t-SVteQLxRZYDL_HAaaI4QsY4SY19wc8xkz3BVvG6T66mGo5TfIp2FNU1yQAhr7v8cI Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:45.546327 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c040c4b53497405dab7a07c96ad3e0ef", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9437dbdb71fc4fee9b3481887c8cc500 Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: {"add_host": {"host": "n-h2-820368-35"}} Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:45.548614 n-d-820368-35 devstack@n-api.service[128548]: exception: Aggregate 11 already has host n-h2-820368-35. Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-820368-35'}}} Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result.read() Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:52:45.549612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-820368-35-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 04:52:45.551433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 04:52:45.553717 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:52:45.555297 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result.read() Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-820368-35-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 4, 52, 45, 514019), 'updated_at': None, 'host': 'n-h2-820368-35', 'aggregate_id': 11}] Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:45.556454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-820368-35. Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:45.557683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-820368-35. Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:45.559249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:45.560972 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-820368-35. Aug 27 04:52:45.560972 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:45.564738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2db9d26a-7a78-47c1-8692-28516aa4c890 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-820368-35. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:45.564738 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2db9d26a-7a78-47c1-8692-28516aa4c890 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.137511 Aug 27 04:52:45.570509 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 160/321] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 04:52:45 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 27 04:52:45.581494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ce6e375-b711-4861-b7b6-30879e391fcd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:45.603252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ce6e375-b711-4861-b7b6-30879e391fcd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.603252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ce6e375-b711-4861-b7b6-30879e391fcd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.607583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ce6e375-b711-4861-b7b6-30879e391fcd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.780550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-1e1b5764-e479-4b9e-a86c-4b8375f431ea tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid b57a38fc-e317-4555-bba4-f2cedd73562d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:52:45.783622 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6ce6e375-b711-4861-b7b6-30879e391fcd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.211544 Aug 27 04:52:45.784541 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 161/322] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 04:52:45 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:45.846264 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e1b5764-e479-4b9e-a86c-4b8375f431ea tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 2054 microversion: 2.25 time: 0.332098 Aug 27 04:52:45.847367 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 162/323] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:45 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 2054 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:45.852183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-065a43db-9480-42e9-b56d-6bafbec1a7cd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:45.852963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-065a43db-9480-42e9-b56d-6bafbec1a7cd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:45.860519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a43db-9480-42e9-b56d-6bafbec1a7cd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.861659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a43db-9480-42e9-b56d-6bafbec1a7cd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.862256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a43db-9480-42e9-b56d-6bafbec1a7cd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.864424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a43db-9480-42e9-b56d-6bafbec1a7cd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.865071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a43db-9480-42e9-b56d-6bafbec1a7cd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.865826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a43db-9480-42e9-b56d-6bafbec1a7cd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.938462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-065a43db-9480-42e9-b56d-6bafbec1a7cd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:45.946719 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-065a43db-9480-42e9-b56d-6bafbec1a7cd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1268 microversion: 2.1 time: 0.098068 Aug 27 04:52:45.947541 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 163/324] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:45 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1268 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:45.952503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-682c235b-79cf-4022-9fdb-df8b3510ce80 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:45.979049 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-682c235b-79cf-4022-9fdb-df8b3510ce80 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.030090 Aug 27 04:52:45.980099 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 164/325] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:52:45 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:45.992142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-066432a0-efa0-413c-8ece-f23f07882d2b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:45.996306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-066432a0-efa0-413c-8ece-f23f07882d2b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.997092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-066432a0-efa0-413c-8ece-f23f07882d2b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.997691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-066432a0-efa0-413c-8ece-f23f07882d2b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.998698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-066432a0-efa0-413c-8ece-f23f07882d2b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.999334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-066432a0-efa0-413c-8ece-f23f07882d2b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:46.000566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-066432a0-efa0-413c-8ece-f23f07882d2b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:46.008168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1345953056", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:46.012649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:46.032713 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-066432a0-efa0-413c-8ece-f23f07882d2b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.047386 Aug 27 04:52:46.041761 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 165/326] 10.222.0.58 () {60 vars in 1217 bytes} [Sat Aug 27 04:52:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:52:46.047768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:46.048598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:46.056185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:46.056903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:46.058862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:46.060384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:46.061820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:46.062426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:46.135457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:52:46.157081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:46.178382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:46.180132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:46.188330 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a6e7028-6c84-462c-b42d-735e791e854e tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.145242 Aug 27 04:52:46.193231 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 166/327] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:46 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:46.201426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dbe62123-f37e-47ff-b589-edec2c53226c tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-232523891"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:46.206018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.aggregate [None req-dbe62123-f37e-47ff-b589-edec2c53226c tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Generated uuid dd26062e-2462-4e53-8a46-9104ce0ed5d7 for aggregate {{(pid=128547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:46.244363 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dbe62123-f37e-47ff-b589-edec2c53226c tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048072 Aug 27 04:52:46.246311 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 167/328] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:46.257735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-01fba6b6-36e1-486d-9084-74e0843107f2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-820368-35", "block_migration": "auto"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:46.260760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-01fba6b6-36e1-486d-9084-74e0843107f2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:46.272596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01fba6b6-36e1-486d-9084-74e0843107f2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:46.273444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01fba6b6-36e1-486d-9084-74e0843107f2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:46.273893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01fba6b6-36e1-486d-9084-74e0843107f2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:46.274898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01fba6b6-36e1-486d-9084-74e0843107f2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:46.275456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01fba6b6-36e1-486d-9084-74e0843107f2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:46.276287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01fba6b6-36e1-486d-9084-74e0843107f2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:46.394361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-01fba6b6-36e1-486d-9084-74e0843107f2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'flavor' on Instance uuid b57a38fc-e317-4555-bba4-f2cedd73562d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:52:46.434047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:46.434569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:46.435316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:46.435798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:46.436285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:46.447871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:46.448635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:46.450983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:46.451565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-01fba6b6-36e1-486d-9084-74e0843107f2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Going to try to live migrate instance to n-h2-820368-35 {{(pid=128547) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:52:46.452024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:46.452222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:46.452648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:46.479074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Getting quotas for project 2009e731b78d429f9a702e5638135166. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:46.487957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Getting quotas for user 1db11a523d564978a1225898267909d8 and project 2009e731b78d429f9a702e5638135166. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:46.507615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:52:46.512462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:52:46.619021 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2e58a944-86af-45bf-801f-f9ff67332009 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833297 Aug 27 04:52:46.620041 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 162/329] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:52:46.885421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bafb28f4-696f-4d84-89f8-1b3b6d75f6ac tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:46.896461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bafb28f4-696f-4d84-89f8-1b3b6d75f6ac tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '0eb086b594b84aa1a8aa1b7fc2d28563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cdcc6289b347c5b7456b85e1cbda31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bafb28f4-696f-4d84-89f8-1b3b6d75f6ac tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Request method failure captured: Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 40 Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMZDJSXNwdy0QCM-7gJQpeOVnYaazgRGt1-CcUyYMLkCscklHTlLp2USKFrLK1en1Bwrh5SmSedbcygyWIGQOv4BqpDKUIatdzd00Ny1vVfWkUG--zwzIGEZGWej0ESMAVXutCjAaJ2hnIu1_FuDogm1Hhi-meJ6SQ01pSE9SJvF_w Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:46.898073 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10cdcc6289b347c5b7456b85e1cbda31", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 0eb086b594b84aa1a8aa1b7fc2d28563 Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: {"add_host": {"host": "n-h2-820368-35"}} Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:46.899642 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-820368-35'}}} Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:46.900614 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 04:52:46.902033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:46.903335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bafb28f4-696f-4d84-89f8-1b3b6d75f6ac tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:46.903335 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bafb28f4-696f-4d84-89f8-1b3b6d75f6ac tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.279198 Aug 27 04:52:46.906903 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 163/330] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 04:52:46 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 286 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:46.913553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cfcc298c-9f1c-4b8e-9451-9709d8ed49b2 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:46.914244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cfcc298c-9f1c-4b8e-9451-9709d8ed49b2 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:46.928334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfcc298c-9f1c-4b8e-9451-9709d8ed49b2 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:46.929461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfcc298c-9f1c-4b8e-9451-9709d8ed49b2 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:46.930774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfcc298c-9f1c-4b8e-9451-9709d8ed49b2 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:46.934370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfcc298c-9f1c-4b8e-9451-9709d8ed49b2 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:46.934853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfcc298c-9f1c-4b8e-9451-9709d8ed49b2 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:46.935325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfcc298c-9f1c-4b8e-9451-9709d8ed49b2 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:47.163497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cfcc298c-9f1c-4b8e-9451-9709d8ed49b2 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:47.174116 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cfcc298c-9f1c-4b8e-9451-9709d8ed49b2 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1324 microversion: 2.1 time: 0.265173 Aug 27 04:52:47.187359 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 164/331] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:46 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1324 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:47.194018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a6891b8c-6805-4e86-b84b-3c6009c44a43 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:47.194876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a6891b8c-6805-4e86-b84b-3c6009c44a43 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:47.263891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a6891b8c-6805-4e86-b84b-3c6009c44a43 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:47.275344 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a6891b8c-6805-4e86-b84b-3c6009c44a43 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1214 microversion: 2.1 time: 0.085871 Aug 27 04:52:47.283779 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 165/332] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:47 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:47.293203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-da91bda0-fd27-42cd-af44-3ee24f5cd09e tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:47.332153 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-da91bda0-fd27-42cd-af44-3ee24f5cd09e tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.047124 Aug 27 04:52:47.333523 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 166/333] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:52:47 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:47.340071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f10f5a6-4474-4be2-a76d-8c687b4165b8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:47.341029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f10f5a6-4474-4be2-a76d-8c687b4165b8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:47.351812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f10f5a6-4474-4be2-a76d-8c687b4165b8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:47.352530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f10f5a6-4474-4be2-a76d-8c687b4165b8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:47.353356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f10f5a6-4474-4be2-a76d-8c687b4165b8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:47.354332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f10f5a6-4474-4be2-a76d-8c687b4165b8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:47.355045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f10f5a6-4474-4be2-a76d-8c687b4165b8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:47.355711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f10f5a6-4474-4be2-a76d-8c687b4165b8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:47.444860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f10f5a6-4474-4be2-a76d-8c687b4165b8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:47.456276 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f10f5a6-4474-4be2-a76d-8c687b4165b8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1274 microversion: 2.1 time: 0.121381 Aug 27 04:52:47.457796 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 167/334] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:47 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:47.476827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:47.477536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:47.490560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:47.493254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:47.494501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:47.496766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:47.497929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:47.500675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:47.620163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:47.629954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:47.631900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:47.638627 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-58333374-844b-4637-8b91-f26ca0b8a930 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.179199 Aug 27 04:52:47.640119 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 168/335] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:47 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:47.647886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4765ac39-6a90-47db-9080-429782eb2d35 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1434039444"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:47.652212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-4765ac39-6a90-47db-9080-429782eb2d35 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Generated uuid d8681016-1066-402c-a17f-ed0284b61b6a for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:47.683908 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4765ac39-6a90-47db-9080-429782eb2d35 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040608 Aug 27 04:52:47.694451 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 169/336] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:47.700772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-92ae86b0-7aee-45d5-914a-35fe8b305d42 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-254321010"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:47.717868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92ae86b0-7aee-45d5-914a-35fe8b305d42 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:47.718873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92ae86b0-7aee-45d5-914a-35fe8b305d42 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:47.719641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92ae86b0-7aee-45d5-914a-35fe8b305d42 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:47.731001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92ae86b0-7aee-45d5-914a-35fe8b305d42 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:47.732094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92ae86b0-7aee-45d5-914a-35fe8b305d42 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:47.732812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92ae86b0-7aee-45d5-914a-35fe8b305d42 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:47.744662 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-92ae86b0-7aee-45d5-914a-35fe8b305d42 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-254321010 could not be found. Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-92ae86b0-7aee-45d5-914a-35fe8b305d42 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Request method failure captured: Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 57 Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMbGOQoslN-cY1P8DANhOiuI9AGyA4kvo6EapHJXn6usJC3CACYTxNEBCp4dqRrevwQ7S0VtEJXmCe8gRyfqwK8fdePo9-yo8dMu1A7eUS0t-SVteQLxRZYDL_HAaaI4QsY4SY19wc8xkz3BVvG6T66mGo5TfIp2FNU1yQAhr7v8cI Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:47.747586 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c040c4b53497405dab7a07c96ad3e0ef", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9437dbdb71fc4fee9b3481887c8cc500 Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: {"add_host": {"host": "tempest-nonexist_host-254321010"}} Aug 27 04:52:47.748809 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: exception: Compute host tempest-nonexist_host-254321010 could not be found. Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-254321010'}}} Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-254321010' is not mapped to any cell Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.749489 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 27 04:52:47.751178 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-254321010 could not be found. Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-254321010 could not be found. Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:47.752240 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.753683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.753683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:47.753683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:47.753683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:47.753683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:47.753683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-254321010 could not be found. Aug 27 04:52:47.753683 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.760789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-92ae86b0-7aee-45d5-914a-35fe8b305d42 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-254321010 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:47.764482 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-92ae86b0-7aee-45d5-914a-35fe8b305d42 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.068463 Aug 27 04:52:47.766351 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 170/337] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 04:52:47 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:47.775258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-98efadd6-09e3-40d8-a276-fd37777dd518 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:47.805695 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-98efadd6-09e3-40d8-a276-fd37777dd518 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.036012 Aug 27 04:52:47.806278 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 171/338] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:52:47 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 04:52:47.816551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b72e858d-f2e7-4ab2-b045-ac70bd8b8bf1 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b72e858d-f2e7-4ab2-b045-ac70bd8b8bf1 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Request method failure captured: Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 283 Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMbGOQoslN-cY1P8DANhOiuI9AGyA4kvo6EapHJXn6usJC3CACYTxNEBCp4dqRrevwQ7S0VtEJXmCe8gRyfqwK8fdePo9-yo8dMu1A7eUS0t-SVteQLxRZYDL_HAaaI4QsY4SY19wc8xkz3BVvG6T66mGo5TfIp2FNU1yQAhr7v8cI Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:47.822196 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:47.823674 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c040c4b53497405dab7a07c96ad3e0ef", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:47.823674 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.823674 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:47.823674 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.823674 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:47.823674 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:47.823674 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:47.823674 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9437dbdb71fc4fee9b3481887c8cc500 Aug 27 04:52:47.823674 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:47.823674 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:47.824328 n-d-820368-35 devstack@n-api.service[128548]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 04:52:47.824328 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:47.824328 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:52:47.824328 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 04:52:47.824328 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:47.824328 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.824328 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:52:47.824328 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:52:47.824328 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:52:47.824328 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:47.824916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:47.825882 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:47.826681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:52:47.826681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:52:47.826681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:52:47.826681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.826681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b72e858d-f2e7-4ab2-b045-ac70bd8b8bf1 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:47.828625 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b72e858d-f2e7-4ab2-b045-ac70bd8b8bf1 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.013163 Aug 27 04:52:47.828754 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 172/339] 10.222.0.58 () {60 vars in 1165 bytes} [Sat Aug 27 04:52:47 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:52:47.836486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-673a48f0-0224-4298-bb63-523bba4d3ef2 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-673a48f0-0224-4298-bb63-523bba4d3ef2 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Request method failure captured: Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 27 Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMbGOQoslN-cY1P8DANhOiuI9AGyA4kvo6EapHJXn6usJC3CACYTxNEBCp4dqRrevwQ7S0VtEJXmCe8gRyfqwK8fdePo9-yo8dMu1A7eUS0t-SVteQLxRZYDL_HAaaI4QsY4SY19wc8xkz3BVvG6T66mGo5TfIp2FNU1yQAhr7v8cI Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:47.842435 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c040c4b53497405dab7a07c96ad3e0ef", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9437dbdb71fc4fee9b3481887c8cc500 Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: {"aggregate": {"name": ""}} Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:47.844559 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi '' Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:47.845274 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:52:47.846474 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.847549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-673a48f0-0224-4298-bb63-523bba4d3ef2 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:47.847549 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-673a48f0-0224-4298-bb63-523bba4d3ef2 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.012157 Aug 27 04:52:47.847549 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 173/340] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:47 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:52:47.864903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d2e4fd8-a8f1-444c-9758-410fb3e76b0f tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1932774147"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:47.868728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7d2e4fd8-a8f1-444c-9758-410fb3e76b0f tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '0eb086b594b84aa1a8aa1b7fc2d28563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cdcc6289b347c5b7456b85e1cbda31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d2e4fd8-a8f1-444c-9758-410fb3e76b0f tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Request method failure captured: Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 60 Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMZDJSXNwdy0QCM-7gJQpeOVnYaazgRGt1-CcUyYMLkCscklHTlLp2USKFrLK1en1Bwrh5SmSedbcygyWIGQOv4BqpDKUIatdzd00Ny1vVfWkUG--zwzIGEZGWej0ESMAVXutCjAaJ2hnIu1_FuDogm1Hhi-meJ6SQ01pSE9SJvF_w Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:47.871853 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10cdcc6289b347c5b7456b85e1cbda31", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 0eb086b594b84aa1a8aa1b7fc2d28563 Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: {"aggregate": {"name": "tempest-test_aggregate-1932774147"}} Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:47.873141 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1932774147'}}} Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:47.874013 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:47.875537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 04:52:47.878255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.878255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d2e4fd8-a8f1-444c-9758-410fb3e76b0f tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:47.878255 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d2e4fd8-a8f1-444c-9758-410fb3e76b0f tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.022835 Aug 27 04:52:47.878255 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 174/341] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:47 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:47.886577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3896a30f-e4c9-401d-aaa7-0ffa7c0a86d0 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1516742184"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:47.891469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-3896a30f-e4c9-401d-aaa7-0ffa7c0a86d0 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Generated uuid 481f8ab9-f8ea-4176-9d8a-624dcdd9815f for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:47.917397 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3896a30f-e4c9-401d-aaa7-0ffa7c0a86d0 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.035886 Aug 27 04:52:47.918443 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 175/342] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:47.931654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5bbfe33d-55e2-4286-a4df-f598afbe8d59 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1516742184"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:47.936694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-5bbfe33d-55e2-4286-a4df-f598afbe8d59 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Generated uuid a3e8201b-1174-44f3-ae46-34a2d8557de8 for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:47.947546 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-5bbfe33d-55e2-4286-a4df-f598afbe8d59 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1516742184 already exists. Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5bbfe33d-55e2-4286-a4df-f598afbe8d59 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Request method failure captured: Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 60 Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMbGOQoslN-cY1P8DANhOiuI9AGyA4kvo6EapHJXn6usJC3CACYTxNEBCp4dqRrevwQ7S0VtEJXmCe8gRyfqwK8fdePo9-yo8dMu1A7eUS0t-SVteQLxRZYDL_HAaaI4QsY4SY19wc8xkz3BVvG6T66mGo5TfIp2FNU1yQAhr7v8cI Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:47.950004 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c040c4b53497405dab7a07c96ad3e0ef", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9437dbdb71fc4fee9b3481887c8cc500 Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: {"aggregate": {"name": "tempest-test_aggregate-1516742184"}} Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:47.951488 n-d-820368-35 devstack@n-api.service[128548]: exception: Aggregate tempest-test_aggregate-1516742184 already exists. Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1516742184'}}} Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 27 04:52:47.952224 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1516742184 already exists. Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:47.953235 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1516742184 already exists. Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1516742184 already exists. Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5bbfe33d-55e2-4286-a4df-f598afbe8d59 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1516742184 already exists. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:47.954288 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5bbfe33d-55e2-4286-a4df-f598afbe8d59 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.026136 Aug 27 04:52:47.957495 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 176/343] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:47 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 31 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:52:47.963351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ce7e363-5510-4873-9d63-2f70be3618dd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:47.974964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10,nova_api:DELETE=5 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:47.990623 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ce7e363-5510-4873-9d63-2f70be3618dd tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.031955 Aug 27 04:52:47.991639 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 177/344] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:52:47 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:48.002462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-970dd04e-f9a9-4171-9b58-25d5706ce568 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1646936189"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:48.008528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-970dd04e-f9a9-4171-9b58-25d5706ce568 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Generated uuid 98005c15-c569-4eed-b239-2d61f29bc269 for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:48.039415 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-970dd04e-f9a9-4171-9b58-25d5706ce568 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041880 Aug 27 04:52:48.048415 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 178/345] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:48.053662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f3565eb-e020-4c1c-8d43-179d980a94ee tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:48.055547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1f3565eb-e020-4c1c-8d43-179d980a94ee tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '0eb086b594b84aa1a8aa1b7fc2d28563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cdcc6289b347c5b7456b85e1cbda31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f3565eb-e020-4c1c-8d43-179d980a94ee tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Request method failure captured: Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMZDJSXNwdy0QCM-7gJQpeOVnYaazgRGt1-CcUyYMLkCscklHTlLp2USKFrLK1en1Bwrh5SmSedbcygyWIGQOv4BqpDKUIatdzd00Ny1vVfWkUG--zwzIGEZGWej0ESMAVXutCjAaJ2hnIu1_FuDogm1Hhi-meJ6SQ01pSE9SJvF_w Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:48.057885 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10cdcc6289b347c5b7456b85e1cbda31", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 0eb086b594b84aa1a8aa1b7fc2d28563 Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 04:52:48.059198 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '15'} Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:48.059880 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:48.063060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f3565eb-e020-4c1c-8d43-179d980a94ee tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:48.066520 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1f3565eb-e020-4c1c-8d43-179d980a94ee tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.010005 Aug 27 04:52:48.066520 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 179/346] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:52:48 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:48.069822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-935ef336-8f61-46d2-95ee-9b0e0eb1baea tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:48.097510 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-935ef336-8f61-46d2-95ee-9b0e0eb1baea tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.032299 Aug 27 04:52:48.098175 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 180/347] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:52:48 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:48.108200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b9157c9-d1e9-425b-8521-21d90a2bfc7e tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:48.122510 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3b9157c9-d1e9-425b-8521-21d90a2bfc7e tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b9157c9-d1e9-425b-8521-21d90a2bfc7e tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Request method failure captured: Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMbGOQoslN-cY1P8DANhOiuI9AGyA4kvo6EapHJXn6usJC3CACYTxNEBCp4dqRrevwQ7S0VtEJXmCe8gRyfqwK8fdePo9-yo8dMu1A7eUS0t-SVteQLxRZYDL_HAaaI4QsY4SY19wc8xkz3BVvG6T66mGo5TfIp2FNU1yQAhr7v8cI Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:48.126146 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c040c4b53497405dab7a07c96ad3e0ef", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9437dbdb71fc4fee9b3481887c8cc500 Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: exception: Aggregate -1 could not be found. Aug 27 04:52:48.127706 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '-1'} Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:52:48.128810 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:48.131061 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:48.134271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:48.134271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:48.134271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:48.134271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:48.134271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 04:52:48.134271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:48.136653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b9157c9-d1e9-425b-8521-21d90a2bfc7e tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:48.137755 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3b9157c9-d1e9-425b-8521-21d90a2bfc7e tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.033586 Aug 27 04:52:48.138617 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 181/348] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:52:48 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:52:48.151678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bb4dcfef-4096-4721-ab39-34e55fc03e82 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-469825763"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:48.159760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-bb4dcfef-4096-4721-ab39-34e55fc03e82 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Generated uuid 9e381301-ce68-4907-930c-96a645fd626c for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:48.184383 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bb4dcfef-4096-4721-ab39-34e55fc03e82 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036914 Aug 27 04:52:48.186432 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 182/349] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:52:48.210678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-085a2800-ace2-44c7-ab43-2d6d1f69fed1 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:48.213323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-085a2800-ace2-44c7-ab43-2d6d1f69fed1 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:48.223588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085a2800-ace2-44c7-ab43-2d6d1f69fed1 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:48.224589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085a2800-ace2-44c7-ab43-2d6d1f69fed1 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:48.225517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085a2800-ace2-44c7-ab43-2d6d1f69fed1 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:48.226473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085a2800-ace2-44c7-ab43-2d6d1f69fed1 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:48.227584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085a2800-ace2-44c7-ab43-2d6d1f69fed1 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:48.228544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085a2800-ace2-44c7-ab43-2d6d1f69fed1 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:48.426316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-085a2800-ace2-44c7-ab43-2d6d1f69fed1 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:48.435697 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-085a2800-ace2-44c7-ab43-2d6d1f69fed1 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1519 microversion: 2.1 time: 0.232932 Aug 27 04:52:48.438524 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 183/350] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:48 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:48.443839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1564f8c6-c595-4aab-bebc-c33bd75c55ca tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:48.445524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1564f8c6-c595-4aab-bebc-c33bd75c55ca tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '0eb086b594b84aa1a8aa1b7fc2d28563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cdcc6289b347c5b7456b85e1cbda31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1564f8c6-c595-4aab-bebc-c33bd75c55ca tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Request method failure captured: Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMZDJSXNwdy0QCM-7gJQpeOVnYaazgRGt1-CcUyYMLkCscklHTlLp2USKFrLK1en1Bwrh5SmSedbcygyWIGQOv4BqpDKUIatdzd00Ny1vVfWkUG--zwzIGEZGWej0ESMAVXutCjAaJ2hnIu1_FuDogm1Hhi-meJ6SQ01pSE9SJvF_w Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:48.447340 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10cdcc6289b347c5b7456b85e1cbda31", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 0eb086b594b84aa1a8aa1b7fc2d28563 Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 04:52:48.448658 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '16'} Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:48.449342 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 04:52:48.450335 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:48.452660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1564f8c6-c595-4aab-bebc-c33bd75c55ca tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:48.454069 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1564f8c6-c595-4aab-bebc-c33bd75c55ca tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.014223 Aug 27 04:52:48.455056 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 184/351] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:48 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:48.464479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5a2953b4-4d17-49d4-98a8-d8f4b8fe910d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:48.465466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5a2953b4-4d17-49d4-98a8-d8f4b8fe910d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:48.472780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2953b4-4d17-49d4-98a8-d8f4b8fe910d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:48.473594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2953b4-4d17-49d4-98a8-d8f4b8fe910d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:48.474306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2953b4-4d17-49d4-98a8-d8f4b8fe910d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:48.475339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2953b4-4d17-49d4-98a8-d8f4b8fe910d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:48.476036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2953b4-4d17-49d4-98a8-d8f4b8fe910d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:48.476666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2953b4-4d17-49d4-98a8-d8f4b8fe910d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:48.593377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5a2953b4-4d17-49d4-98a8-d8f4b8fe910d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:48.601697 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5a2953b4-4d17-49d4-98a8-d8f4b8fe910d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1266 microversion: 2.1 time: 0.145424 Aug 27 04:52:48.602902 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 185/352] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:48 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:48.609238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-44fcf813-588c-4524-b88f-04b3bf033f01 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:48.647887 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-44fcf813-588c-4524-b88f-04b3bf033f01 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.043532 Aug 27 04:52:48.649249 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 186/353] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:52:48 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:48.654347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d479b02-54d8-45f3-aedd-44730fb064ad tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Action: 'create', calling method: .version_select at 0x7fb565a6f820>, body: {"pool": null} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:50.181614 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-01fba6b6-36e1-486d-9084-74e0843107f2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d/action" status: 202 len: 0 microversion: 2.25 time: 3.929141 Aug 27 04:52:50.185798 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 168/354] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 04:52:46 2022] POST /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d/action => generated 0 bytes in 3934 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:50.191731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5a2f9746-a8d6-4b7b-945b-ccc280a52e51 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:50.192274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5a2f9746-a8d6-4b7b-945b-ccc280a52e51 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:50.210172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2f9746-a8d6-4b7b-945b-ccc280a52e51 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:50.211255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2f9746-a8d6-4b7b-945b-ccc280a52e51 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:50.211928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2f9746-a8d6-4b7b-945b-ccc280a52e51 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:50.212836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2f9746-a8d6-4b7b-945b-ccc280a52e51 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:50.213471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2f9746-a8d6-4b7b-945b-ccc280a52e51 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:50.214943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2f9746-a8d6-4b7b-945b-ccc280a52e51 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:50.709538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5a2f9746-a8d6-4b7b-945b-ccc280a52e51 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:50.720967 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5a2f9746-a8d6-4b7b-945b-ccc280a52e51 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1316 microversion: 2.1 time: 0.533695 Aug 27 04:52:50.721617 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 169/355] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:50 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1316 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:50.726603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2997847f-b984-4b46-8fd7-da3cd4f66701 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:50.740129 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-2997847f-b984-4b46-8fd7-da3cd4f66701 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2997847f-b984-4b46-8fd7-da3cd4f66701 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Request method failure captured: Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMbGOQoslN-cY1P8DANhOiuI9AGyA4kvo6EapHJXn6usJC3CACYTxNEBCp4dqRrevwQ7S0VtEJXmCe8gRyfqwK8fdePo9-yo8dMu1A7eUS0t-SVteQLxRZYDL_HAaaI4QsY4SY19wc8xkz3BVvG6T66mGo5TfIp2FNU1yQAhr7v8cI Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:52:50.742163 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c040c4b53497405dab7a07c96ad3e0ef", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 9437dbdb71fc4fee9b3481887c8cc500 Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: exception: Aggregate -1 could not be found. Aug 27 04:52:50.743779 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '-1'} Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:50.744469 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 04:52:50.745649 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:50.748306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2997847f-b984-4b46-8fd7-da3cd4f66701 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:50.749433 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2997847f-b984-4b46-8fd7-da3cd4f66701 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026649 Aug 27 04:52:50.750764 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 170/356] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:52:50 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:52:50.763503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:50.764497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:50.772445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:50.775854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:50.776520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:50.777194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:50.778181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:50.779855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:50.780543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:50.956626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:50.978391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:50.979880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:50.985880 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b3912bd1-155b-412b-9d36-1d2f46b02b1a tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.233695 Aug 27 04:52:50.986462 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 171/357] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:50 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:50.994747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-141b0edc-66cd-49f3-b9cc-da6cdab2ab21 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:50.995393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-141b0edc-66cd-49f3-b9cc-da6cdab2ab21 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:51.015413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141b0edc-66cd-49f3-b9cc-da6cdab2ab21 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.019266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141b0edc-66cd-49f3-b9cc-da6cdab2ab21 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.019266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141b0edc-66cd-49f3-b9cc-da6cdab2ab21 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:51.019266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141b0edc-66cd-49f3-b9cc-da6cdab2ab21 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.019266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141b0edc-66cd-49f3-b9cc-da6cdab2ab21 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.019570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141b0edc-66cd-49f3-b9cc-da6cdab2ab21 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:51.144332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-141b0edc-66cd-49f3-b9cc-da6cdab2ab21 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:51.157006 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-141b0edc-66cd-49f3-b9cc-da6cdab2ab21 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1272 microversion: 2.1 time: 0.169438 Aug 27 04:52:51.158726 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 172/358] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:50 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:51.177406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:51.178293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:51.194094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.194915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.195415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:51.199175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.199680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.200131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:51.685577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:51.697436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:51.698924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:51.700696 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b37c272a-8552-4a57-a7bd-1f37e8af5a65 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1569 microversion: 2.25 time: 0.540534 Aug 27 04:52:51.701499 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 173/359] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:51 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1569 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:51.715403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-01a42738-a03d-433f-961b-1baa32514b1b tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:51.722001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-01a42738-a03d-433f-961b-1baa32514b1b tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '0eb086b594b84aa1a8aa1b7fc2d28563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cdcc6289b347c5b7456b85e1cbda31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-01a42738-a03d-433f-961b-1baa32514b1b tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Request method failure captured: Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMZDJSXNwdy0QCM-7gJQpeOVnYaazgRGt1-CcUyYMLkCscklHTlLp2USKFrLK1en1Bwrh5SmSedbcygyWIGQOv4BqpDKUIatdzd00Ny1vVfWkUG--zwzIGEZGWej0ESMAVXutCjAaJ2hnIu1_FuDogm1Hhi-meJ6SQ01pSE9SJvF_w Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:52:51.724821 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10cdcc6289b347c5b7456b85e1cbda31", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 0eb086b594b84aa1a8aa1b7fc2d28563 Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 04:52:51.726038 n-d-820368-35 devstack@n-api.service[128547]: action_args: {} Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:51.726733 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:52:51.727795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-01a42738-a03d-433f-961b-1baa32514b1b tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:51.730260 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-01a42738-a03d-433f-961b-1baa32514b1b tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.025108 Aug 27 04:52:51.730260 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 174/360] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 04:52:51 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:51.737488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2877324b-a08d-45d0-901d-6414d0d3d789 req-0dcea6e0-7827-4622-84f4-e1092323e4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198422a0-c1e8-4c71-9ecd-43b3c3e0178d", "tag": "4fa25b75-187a-4e66-b47e-299b07e84a8d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:51.756139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2877324b-a08d-45d0-901d-6414d0d3d789 req-0dcea6e0-7827-4622-84f4-e1092323e4cd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.756910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2877324b-a08d-45d0-901d-6414d0d3d789 req-0dcea6e0-7827-4622-84f4-e1092323e4cd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.757502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2877324b-a08d-45d0-901d-6414d0d3d789 req-0dcea6e0-7827-4622-84f4-e1092323e4cd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:51.783053 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2877324b-a08d-45d0-901d-6414d0d3d789 req-0dcea6e0-7827-4622-84f4-e1092323e4cd service nova] Creating event network-changed:4fa25b75-187a-4e66-b47e-299b07e84a8d for instance 198422a0-c1e8-4c71-9ecd-43b3c3e0178d on n-h1-820368-35 Aug 27 04:52:51.789053 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2877324b-a08d-45d0-901d-6414d0d3d789 req-0dcea6e0-7827-4622-84f4-e1092323e4cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055157 Aug 27 04:52:51.790131 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 175/361] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:51.796890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ea6cc2f6-5e68-4778-914d-a39ba64c57a7 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-479999280"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:51.801295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.aggregate [None req-ea6cc2f6-5e68-4778-914d-a39ba64c57a7 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Generated uuid 2b097035-9121-4e73-bf20-2c1e34a8b384 for aggregate {{(pid=128547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:51.817195 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d479b02-54d8-45f3-aedd-44730fb064ad tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.166461 Aug 27 04:52:51.820080 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 187/362] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 04:52:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:51.825721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c42be7ba-d79d-4595-9c27-dad170f8f3c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:51.826396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c42be7ba-d79d-4595-9c27-dad170f8f3c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:51.836377 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ea6cc2f6-5e68-4778-914d-a39ba64c57a7 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042578 Aug 27 04:52:51.837598 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 176/363] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:51.849956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-90952332-260b-45ff-9a1b-f042b13a11eb tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-820368-35"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:51.852551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42be7ba-d79d-4595-9c27-dad170f8f3c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.853305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42be7ba-d79d-4595-9c27-dad170f8f3c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.854268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42be7ba-d79d-4595-9c27-dad170f8f3c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:51.855249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42be7ba-d79d-4595-9c27-dad170f8f3c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.855910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42be7ba-d79d-4595-9c27-dad170f8f3c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.856571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42be7ba-d79d-4595-9c27-dad170f8f3c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:51.881206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90952332-260b-45ff-9a1b-f042b13a11eb tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.881445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90952332-260b-45ff-9a1b-f042b13a11eb tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.881883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90952332-260b-45ff-9a1b-f042b13a11eb tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:52.071540 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-90952332-260b-45ff-9a1b-f042b13a11eb tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.226926 Aug 27 04:52:52.072199 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 177/364] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 04:52:51 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:52:52.077594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-539545344", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "71a3611e-27fd-46d0-9b26-df83ee6c57af"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:52.151443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] validate_networks() for [('71a3611e-27fd-46d0-9b26-df83ee6c57af', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:52:52.285959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c42be7ba-d79d-4595-9c27-dad170f8f3c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:52.293478 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c42be7ba-d79d-4595-9c27-dad170f8f3c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1316 microversion: 2.1 time: 0.471784 Aug 27 04:52:52.307226 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 188/365] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:51 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:52.312668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:52.321342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:52.328122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:52.328864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:52.329487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:52.330384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:52.331231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:52.331813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:52.426542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:52.440197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:52.441960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:52.447236 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f194c28-8239-4bb7-8617-dc6cba2068f2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.138342 Aug 27 04:52:52.447877 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 189/366] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:52 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:52.453818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-be62929a-940f-42f6-bb17-d214c49f922d tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:52.457407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-be62929a-940f-42f6-bb17-d214c49f922d tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '0eb086b594b84aa1a8aa1b7fc2d28563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cdcc6289b347c5b7456b85e1cbda31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-be62929a-940f-42f6-bb17-d214c49f922d tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Request method failure captured: Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 43 Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMZDJSXNwdy0QCM-7gJQpeOVnYaazgRGt1-CcUyYMLkCscklHTlLp2USKFrLK1en1Bwrh5SmSedbcygyWIGQOv4BqpDKUIatdzd00Ny1vVfWkUG--zwzIGEZGWej0ESMAVXutCjAaJ2hnIu1_FuDogm1Hhi-meJ6SQ01pSE9SJvF_w Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:52:52.459297 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10cdcc6289b347c5b7456b85e1cbda31", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10cdcc6289b347c5b7456b85e1cbda31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 10cdcc6289b347c5b7456b85e1cbda31 Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-829484347 Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 0eb086b594b84aa1a8aa1b7fc2d28563 Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-829484347-project Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: {"remove_host": {"host": "n-h2-820368-35"}} Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:52.460703 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-820368-35'}}} Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:52.461468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 04:52:52.462570 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:52.465392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-be62929a-940f-42f6-bb17-d214c49f922d tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:52.466444 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-be62929a-940f-42f6-bb17-d214c49f922d tempest-AggregatesAdminNegativeTestJSON-829484347 tempest-AggregatesAdminNegativeTestJSON-829484347-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.017470 Aug 27 04:52:52.467233 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 190/367] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 04:52:52 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:52.472961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5fd5c5df-4b85-40b2-a9f7-0f29e72384bc tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:52.473868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5fd5c5df-4b85-40b2-a9f7-0f29e72384bc tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:52.481197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd5c5df-4b85-40b2-a9f7-0f29e72384bc tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:52.481831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd5c5df-4b85-40b2-a9f7-0f29e72384bc tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:52.482524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd5c5df-4b85-40b2-a9f7-0f29e72384bc tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:52.483549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd5c5df-4b85-40b2-a9f7-0f29e72384bc tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:52.484803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd5c5df-4b85-40b2-a9f7-0f29e72384bc tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:52.485579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd5c5df-4b85-40b2-a9f7-0f29e72384bc tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:52.830094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5fd5c5df-4b85-40b2-a9f7-0f29e72384bc tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:52.845842 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5fd5c5df-4b85-40b2-a9f7-0f29e72384bc tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1314 microversion: 2.1 time: 0.377023 Aug 27 04:52:52.846588 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 191/368] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:52 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:52.852104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f41a7ad5-0d2e-4324-b023-e0587dcc75e0 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:52.864700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41a7ad5-0d2e-4324-b023-e0587dcc75e0 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:52.865648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41a7ad5-0d2e-4324-b023-e0587dcc75e0 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:52.866308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41a7ad5-0d2e-4324-b023-e0587dcc75e0 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:53.033683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:53.034171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:53.034255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:53.034834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:53.035569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:53.045508 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f41a7ad5-0d2e-4324-b023-e0587dcc75e0 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.197307 Aug 27 04:52:53.047623 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 192/369] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 04:52:52 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:53.072796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:53.073614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:53.082113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:53.082862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:53.084669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:53.085601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:53.086319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:53.086828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:53.087672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:53.088978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:53.091597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:53.092739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:53.098409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:53.100203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:53.149584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Getting quotas for project 0088fd72e34f43fa97050fd334f61ea6. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:53.155948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Getting quotas for user ce1a0cee656e407a98b414918319c246 and project 0088fd72e34f43fa97050fd334f61ea6. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:53.174912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:52:53.177802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:52:53.235252 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a57fbbe9-8486-41f3-8086-907a0d81e810 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160632 Aug 27 04:52:53.246513 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 178/370] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:52:53.253128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4caf29ae-deb3-4dea-9a77-9ed54e595f3a req-6967d4a9-35a6-4001-b5a0-a4059c9a564f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba13511-9622-4b36-84cc-de60709bc808", "tag": "89aa4311-8b23-488b-93c4-03f74c9c1d6f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:53.265982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4caf29ae-deb3-4dea-9a77-9ed54e595f3a req-6967d4a9-35a6-4001-b5a0-a4059c9a564f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:53.267539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4caf29ae-deb3-4dea-9a77-9ed54e595f3a req-6967d4a9-35a6-4001-b5a0-a4059c9a564f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:53.268149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4caf29ae-deb3-4dea-9a77-9ed54e595f3a req-6967d4a9-35a6-4001-b5a0-a4059c9a564f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:53.282755 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4caf29ae-deb3-4dea-9a77-9ed54e595f3a req-6967d4a9-35a6-4001-b5a0-a4059c9a564f service nova] Creating event network-changed:89aa4311-8b23-488b-93c4-03f74c9c1d6f for instance bba13511-9622-4b36-84cc-de60709bc808 on n-h2-820368-35 Aug 27 04:52:53.299375 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4caf29ae-deb3-4dea-9a77-9ed54e595f3a req-6967d4a9-35a6-4001-b5a0-a4059c9a564f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039812 Aug 27 04:52:53.303498 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 179/371] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:53.313008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-502486fd-4726-402d-855a-849123efeb57 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:53.364308 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-502486fd-4726-402d-855a-849123efeb57 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.058879 Aug 27 04:52:53.365577 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 180/372] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:52:53 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:52:53.371572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d894a05f-6914-4614-aebb-3a899ac019ef tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:53.372674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d894a05f-6914-4614-aebb-3a899ac019ef tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:53.676690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d894a05f-6914-4614-aebb-3a899ac019ef tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:53.686986 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d894a05f-6914-4614-aebb-3a899ac019ef tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1223 microversion: 2.1 time: 0.320038 Aug 27 04:52:53.691744 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 181/373] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:53 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1223 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:53.708047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0e0a08d0-a5c3-4fb2-9fba-1a3d945b1b9e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:53.708859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0e0a08d0-a5c3-4fb2-9fba-1a3d945b1b9e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:53.718539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e0a08d0-a5c3-4fb2-9fba-1a3d945b1b9e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:53.719303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e0a08d0-a5c3-4fb2-9fba-1a3d945b1b9e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:53.724695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e0a08d0-a5c3-4fb2-9fba-1a3d945b1b9e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:53.725466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e0a08d0-a5c3-4fb2-9fba-1a3d945b1b9e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:53.726082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e0a08d0-a5c3-4fb2-9fba-1a3d945b1b9e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:53.726514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e0a08d0-a5c3-4fb2-9fba-1a3d945b1b9e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:53.938466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:53.948450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:53.950169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:53.951691 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-93371df9-ac7b-43cf-9067-529f11f974e6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1569 microversion: 2.25 time: 0.902814 Aug 27 04:52:53.952476 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 193/374] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:53 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1569 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:53.957462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-caa7ffe9-60d0-4290-8fbd-c01db8ebd215 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1299286409"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:53.961201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-caa7ffe9-60d0-4290-8fbd-c01db8ebd215 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Generated uuid 6bb5b946-2f80-4647-b457-6fe9c016a606 for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:52:53.990895 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-caa7ffe9-60d0-4290-8fbd-c01db8ebd215 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.037104 Aug 27 04:52:53.992295 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 194/375] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 04:52:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:53.997297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:53.998334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:54.007487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:54.008396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:54.008996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:54.010263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:54.011066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:54.012063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:54.063821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0e0a08d0-a5c3-4fb2-9fba-1a3d945b1b9e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:54.072000 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0e0a08d0-a5c3-4fb2-9fba-1a3d945b1b9e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1316 microversion: 2.1 time: 0.378971 Aug 27 04:52:54.084133 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 182/376] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:53 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:54.101861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-240b1e76-201a-46bf-8537-8cf979887c89 req-cf4ba11b-2fcc-40b5-926d-113778a02753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57a38fc-e317-4555-bba4-f2cedd73562d", "name": "network-vif-unplugged", "status": "completed", "tag": "5f3f4146-89cf-410e-80ce-9aa915641be8"}, {"name": "network-changed", "server_uuid": "b57a38fc-e317-4555-bba4-f2cedd73562d", "tag": "5f3f4146-89cf-410e-80ce-9aa915641be8"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:54.113225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-240b1e76-201a-46bf-8537-8cf979887c89 req-cf4ba11b-2fcc-40b5-926d-113778a02753 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:54.113981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-240b1e76-201a-46bf-8537-8cf979887c89 req-cf4ba11b-2fcc-40b5-926d-113778a02753 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:54.114582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-240b1e76-201a-46bf-8537-8cf979887c89 req-cf4ba11b-2fcc-40b5-926d-113778a02753 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:54.131560 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-240b1e76-201a-46bf-8537-8cf979887c89 req-cf4ba11b-2fcc-40b5-926d-113778a02753 service nova] Creating event network-vif-unplugged:5f3f4146-89cf-410e-80ce-9aa915641be8 for instance b57a38fc-e317-4555-bba4-f2cedd73562d on n-h1-820368-35 Aug 27 04:52:54.132214 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-240b1e76-201a-46bf-8537-8cf979887c89 req-cf4ba11b-2fcc-40b5-926d-113778a02753 service nova] Creating event network-changed:5f3f4146-89cf-410e-80ce-9aa915641be8 for instance b57a38fc-e317-4555-bba4-f2cedd73562d on n-h1-820368-35 Aug 27 04:52:54.139607 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-240b1e76-201a-46bf-8537-8cf979887c89 req-cf4ba11b-2fcc-40b5-926d-113778a02753 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.053702 Aug 27 04:52:54.140947 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 183/377] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:54.149549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2fe1c71b-bb3c-48fe-ae93-ab4d9af21c47 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:54.150564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2fe1c71b-bb3c-48fe-ae93-ab4d9af21c47 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:54.158770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fe1c71b-bb3c-48fe-ae93-ab4d9af21c47 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:54.159676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fe1c71b-bb3c-48fe-ae93-ab4d9af21c47 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:54.160274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fe1c71b-bb3c-48fe-ae93-ab4d9af21c47 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:54.161838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fe1c71b-bb3c-48fe-ae93-ab4d9af21c47 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:54.163211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fe1c71b-bb3c-48fe-ae93-ab4d9af21c47 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:54.164208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fe1c71b-bb3c-48fe-ae93-ab4d9af21c47 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:54.223145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:54.239256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:54.242622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:54.249893 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b0e061ee-267a-4e38-b6e0-abb23a49b2ff tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.256297 Aug 27 04:52:54.251597 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 195/378] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:53 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:54.258256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:54.272353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:54.273619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:54.274119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:54.285420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:54.287177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:54.287177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:54.296488 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.compute.aggregates [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 04:52:54.297451 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Request method failure captured: Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 42 Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMbGOQoslN-cY1P8DANhOiuI9AGyA4kvo6EapHJXn6usJC3CACYTxNEBCp4dqRrevwQ7S0VtEJXmCe8gRyfqwK8fdePo9-yo8dMu1A7eUS0t-SVteQLxRZYDL_HAaaI4QsY4SY19wc8xkz3BVvG6T66mGo5TfIp2FNU1yQAhr7v8cI Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:52:54.302323 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c040c4b53497405dab7a07c96ad3e0ef", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c040c4b53497405dab7a07c96ad3e0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c040c4b53497405dab7a07c96ad3e0ef Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649 Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9437dbdb71fc4fee9b3481887c8cc500 Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: {"remove_host": {"host": "nonexist_host"}} Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:52:54.303794 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 04:52:54.304733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 27 04:52:54.306155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:54.307742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:54.309117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:54.309117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:54.309117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:54.309117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:54.309117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 27 04:52:54.309117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:52:54.321460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:54.322387 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8fc443e-9160-4326-9eb8-e70adf65a75d tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.069605 Aug 27 04:52:54.325286 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 196/379] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 04:52:54 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:52:54.334314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9751a74-0121-4ce2-be37-97cadc9937c1 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:54.396626 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9751a74-0121-4ce2-be37-97cadc9937c1 tempest-AggregatesAdminNegativeTestJSON-1245194649 tempest-AggregatesAdminNegativeTestJSON-1245194649-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.065691 Aug 27 04:52:54.398546 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 197/380] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:52:54 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 04:52:54.491148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2fe1c71b-bb3c-48fe-ae93-ab4d9af21c47 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:54.501141 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2fe1c71b-bb3c-48fe-ae93-ab4d9af21c47 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1314 microversion: 2.1 time: 0.358855 Aug 27 04:52:54.501748 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 184/381] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:54 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:54.716015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d34df9ab-5ebf-415b-8d9c-f5f7949d1be6 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:54.717696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d34df9ab-5ebf-415b-8d9c-f5f7949d1be6 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:54.728805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d34df9ab-5ebf-415b-8d9c-f5f7949d1be6 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:54.729412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d34df9ab-5ebf-415b-8d9c-f5f7949d1be6 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:54.730094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d34df9ab-5ebf-415b-8d9c-f5f7949d1be6 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:54.731004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d34df9ab-5ebf-415b-8d9c-f5f7949d1be6 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:54.731925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d34df9ab-5ebf-415b-8d9c-f5f7949d1be6 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:54.732514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d34df9ab-5ebf-415b-8d9c-f5f7949d1be6 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:54.811683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d34df9ab-5ebf-415b-8d9c-f5f7949d1be6 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:54.821461 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d34df9ab-5ebf-415b-8d9c-f5f7949d1be6 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1227 microversion: 2.1 time: 0.112955 Aug 27 04:52:54.822050 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 198/382] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:54 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1227 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:54.975698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:54.976710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:54.983624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:54.985035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:54.985688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:54.986923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:54.987723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:54.988343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:55.097355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c746de00-6c0a-43d2-8037-055e4fe8fc68 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:55.098451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c746de00-6c0a-43d2-8037-055e4fe8fc68 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:55.105406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c746de00-6c0a-43d2-8037-055e4fe8fc68 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.106175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c746de00-6c0a-43d2-8037-055e4fe8fc68 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.107121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c746de00-6c0a-43d2-8037-055e4fe8fc68 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:55.108111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c746de00-6c0a-43d2-8037-055e4fe8fc68 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.109371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c746de00-6c0a-43d2-8037-055e4fe8fc68 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.110020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c746de00-6c0a-43d2-8037-055e4fe8fc68 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:55.379579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:55.422248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:55.424837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:55.426124 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e0b004b5-2af7-4997-ba49-7f4ea6fd36bb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1569 microversion: 2.25 time: 0.454956 Aug 27 04:52:55.426871 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 185/383] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:54 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1569 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:55.445299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:55.450019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:55.524843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.526026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.529426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:55.547970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.549587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.551328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:55.555869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c746de00-6c0a-43d2-8037-055e4fe8fc68 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:55.565705 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c746de00-6c0a-43d2-8037-055e4fe8fc68 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1316 microversion: 2.1 time: 0.472241 Aug 27 04:52:55.566320 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 199/384] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:55 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:55.582996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4d965870-9d5b-414d-bca0-045c8455e692 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:55.583657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4d965870-9d5b-414d-bca0-045c8455e692 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:55.604009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d965870-9d5b-414d-bca0-045c8455e692 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.604596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d965870-9d5b-414d-bca0-045c8455e692 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.604928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d965870-9d5b-414d-bca0-045c8455e692 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:55.605634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d965870-9d5b-414d-bca0-045c8455e692 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.611415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d965870-9d5b-414d-bca0-045c8455e692 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.614481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d965870-9d5b-414d-bca0-045c8455e692 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:55.842245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:55.855032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:55.857174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:55.864521 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-02b6b761-a2ef-48ed-afcf-b9d524192f3c tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.436208 Aug 27 04:52:55.866334 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 186/385] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:55 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:55.871771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8f512e9-75f9-4b9b-9353-770930b7fb3a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:55.872411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8f512e9-75f9-4b9b-9353-770930b7fb3a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:55.884956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8f512e9-75f9-4b9b-9353-770930b7fb3a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.884956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8f512e9-75f9-4b9b-9353-770930b7fb3a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.884956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8f512e9-75f9-4b9b-9353-770930b7fb3a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:55.884956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8f512e9-75f9-4b9b-9353-770930b7fb3a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.885589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8f512e9-75f9-4b9b-9353-770930b7fb3a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.885589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8f512e9-75f9-4b9b-9353-770930b7fb3a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:56.010938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8f512e9-75f9-4b9b-9353-770930b7fb3a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:56.025760 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8f512e9-75f9-4b9b-9353-770930b7fb3a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1219 microversion: 2.1 time: 0.155518 Aug 27 04:52:56.026393 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 187/386] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:55 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:56.060731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4d965870-9d5b-414d-bca0-045c8455e692 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:56.063502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:56.090731 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4d965870-9d5b-414d-bca0-045c8455e692 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1314 microversion: 2.1 time: 0.523284 Aug 27 04:52:56.103076 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 200/387] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:55 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:56.454488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:56.455124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:56.466959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:56.467697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:56.470442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:56.471402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:56.476549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:56.477245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:56.589217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1d441ca6-931b-42fa-b31c-75c71db8385b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:56.590092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1d441ca6-931b-42fa-b31c-75c71db8385b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:56.598260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d441ca6-931b-42fa-b31c-75c71db8385b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:56.613205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d441ca6-931b-42fa-b31c-75c71db8385b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:56.615410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d441ca6-931b-42fa-b31c-75c71db8385b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:56.620026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d441ca6-931b-42fa-b31c-75c71db8385b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:56.627186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d441ca6-931b-42fa-b31c-75c71db8385b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:56.627977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d441ca6-931b-42fa-b31c-75c71db8385b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:57.017047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:57.051137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:57.054223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:57.059122 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ebe40b3c-fdde-4caf-95d1-33599a679835 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1569 microversion: 2.25 time: 0.609129 Aug 27 04:52:57.077083 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 188/388] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:56 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1569 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:57.093467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:57.094411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:57.114505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:57.116138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:57.118109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:57.119707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:57.120568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:57.122728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:57.166136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:57.207976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1d441ca6-931b-42fa-b31c-75c71db8385b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:57.217379 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1d441ca6-931b-42fa-b31c-75c71db8385b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1316 microversion: 2.1 time: 0.632565 Aug 27 04:52:57.220802 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 201/389] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:56 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1316 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:57.236837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-49c24a81-9971-41d0-b959-ef7bbedc9ff7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:57.237469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-49c24a81-9971-41d0-b959-ef7bbedc9ff7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:57.259418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c24a81-9971-41d0-b959-ef7bbedc9ff7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:57.259932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c24a81-9971-41d0-b959-ef7bbedc9ff7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:57.260388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c24a81-9971-41d0-b959-ef7bbedc9ff7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:57.263497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c24a81-9971-41d0-b959-ef7bbedc9ff7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:57.265793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c24a81-9971-41d0-b959-ef7bbedc9ff7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:57.266720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c24a81-9971-41d0-b959-ef7bbedc9ff7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:57.323495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=22 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:57.463557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:57.474833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:57.481392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:57.493013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-49c24a81-9971-41d0-b959-ef7bbedc9ff7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:57.505211 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ad08e674-b7e8-4c47-a717-8df175a14224 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1447 microversion: 2.75 time: 0.426288 Aug 27 04:52:57.505854 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-49c24a81-9971-41d0-b959-ef7bbedc9ff7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1293 microversion: 2.1 time: 0.280520 Aug 27 04:52:57.506488 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 202/390] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:57 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1293 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:57.524069 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 189/391] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:57 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1447 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:57.535982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ac50d293-1f62-454f-9d23-19f6fafd932c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:57.536638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ac50d293-1f62-454f-9d23-19f6fafd932c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:57.552383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac50d293-1f62-454f-9d23-19f6fafd932c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:57.553526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac50d293-1f62-454f-9d23-19f6fafd932c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:57.553977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac50d293-1f62-454f-9d23-19f6fafd932c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:57.554710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac50d293-1f62-454f-9d23-19f6fafd932c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:57.557794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac50d293-1f62-454f-9d23-19f6fafd932c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:57.558709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac50d293-1f62-454f-9d23-19f6fafd932c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:58.088071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:58.089021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:58.108642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:58.110976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:58.112001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:58.113869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:58.115072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:58.116540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:58.298471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ac50d293-1f62-454f-9d23-19f6fafd932c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:58.307132 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ac50d293-1f62-454f-9d23-19f6fafd932c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1314 microversion: 2.1 time: 0.794212 Aug 27 04:52:58.310087 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 203/392] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:57 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:58.339948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4663aadf-63fd-4940-a95c-06f98afa97c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:58.341996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4663aadf-63fd-4940-a95c-06f98afa97c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:58.357149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4663aadf-63fd-4940-a95c-06f98afa97c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:58.361919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4663aadf-63fd-4940-a95c-06f98afa97c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:58.362410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4663aadf-63fd-4940-a95c-06f98afa97c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:58.363199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4663aadf-63fd-4940-a95c-06f98afa97c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:58.363677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4663aadf-63fd-4940-a95c-06f98afa97c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:58.364113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4663aadf-63fd-4940-a95c-06f98afa97c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:58.712428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:58.720701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:58.722530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:58.724330 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c5eae716-f258-4304-8f56-9451367a0a61 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1569 microversion: 2.25 time: 0.640255 Aug 27 04:52:58.725239 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 190/393] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:58 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1569 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:58.730955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4a92610e-eb89-4ee7-8360-46e2dbe19d88 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:58.731737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4a92610e-eb89-4ee7-8360-46e2dbe19d88 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:58.749401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a92610e-eb89-4ee7-8360-46e2dbe19d88 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:58.750695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a92610e-eb89-4ee7-8360-46e2dbe19d88 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:58.751364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a92610e-eb89-4ee7-8360-46e2dbe19d88 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:58.752581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a92610e-eb89-4ee7-8360-46e2dbe19d88 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:58.753066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a92610e-eb89-4ee7-8360-46e2dbe19d88 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:58.753907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a92610e-eb89-4ee7-8360-46e2dbe19d88 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:58.774728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4663aadf-63fd-4940-a95c-06f98afa97c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:58.786693 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4663aadf-63fd-4940-a95c-06f98afa97c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1316 microversion: 2.1 time: 0.460467 Aug 27 04:52:58.793832 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 204/394] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:58 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1316 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:58.823896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:58.824574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:58.841623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:58.842122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:58.847612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:58.851323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:58.852026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:58.853214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:58.927923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4a92610e-eb89-4ee7-8360-46e2dbe19d88 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:58.935669 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4a92610e-eb89-4ee7-8360-46e2dbe19d88 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1281 microversion: 2.1 time: 0.209292 Aug 27 04:52:58.936474 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 191/395] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:58 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:59.044330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:59.053961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:59.056477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:59.062951 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4993de13-8417-4d79-947a-0b4e62b1b901 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1453 microversion: 2.75 time: 0.268168 Aug 27 04:52:59.063706 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 205/396] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:58 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1453 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:59.333237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cac08ec8-3971-4321-a860-1356b5c5b7fd tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:59.333965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cac08ec8-3971-4321-a860-1356b5c5b7fd tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:59.342996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac08ec8-3971-4321-a860-1356b5c5b7fd tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:59.343545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac08ec8-3971-4321-a860-1356b5c5b7fd tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:59.343999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac08ec8-3971-4321-a860-1356b5c5b7fd tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:59.347791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac08ec8-3971-4321-a860-1356b5c5b7fd tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:59.348822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac08ec8-3971-4321-a860-1356b5c5b7fd tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:59.349637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac08ec8-3971-4321-a860-1356b5c5b7fd tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:59.698702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-e117eb1c-0aa3-4b06-a70a-f3682b39d6e9 req-40774b90-2802-4ce6-a9d8-65113ad572c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198422a0-c1e8-4c71-9ecd-43b3c3e0178d", "name": "network-vif-plugged", "status": "completed", "tag": "4fa25b75-187a-4e66-b47e-299b07e84a8d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:59.732559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e117eb1c-0aa3-4b06-a70a-f3682b39d6e9 req-40774b90-2802-4ce6-a9d8-65113ad572c0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:59.733425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e117eb1c-0aa3-4b06-a70a-f3682b39d6e9 req-40774b90-2802-4ce6-a9d8-65113ad572c0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:59.735485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e117eb1c-0aa3-4b06-a70a-f3682b39d6e9 req-40774b90-2802-4ce6-a9d8-65113ad572c0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:59.791443 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-e117eb1c-0aa3-4b06-a70a-f3682b39d6e9 req-40774b90-2802-4ce6-a9d8-65113ad572c0 service nova] Creating event network-vif-plugged:4fa25b75-187a-4e66-b47e-299b07e84a8d for instance 198422a0-c1e8-4c71-9ecd-43b3c3e0178d on n-h1-820368-35 Aug 27 04:52:59.809515 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-e117eb1c-0aa3-4b06-a70a-f3682b39d6e9 req-40774b90-2802-4ce6-a9d8-65113ad572c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112047 Aug 27 04:52:59.810706 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 206/397] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:52:59.830783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:59.831909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:59.835825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cac08ec8-3971-4321-a860-1356b5c5b7fd tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:59.851985 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cac08ec8-3971-4321-a860-1356b5c5b7fd tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1314 microversion: 2.1 time: 0.525403 Aug 27 04:52:59.855363 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 192/398] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:59 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:59.865300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:59.867042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:59.868298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a65dbfb3-4c72-49fd-9c5e-a334695f80e1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:59.868960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:59.870863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a65dbfb3-4c72-49fd-9c5e-a334695f80e1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:59.871543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:59.872718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:59.874263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:59.893272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a65dbfb3-4c72-49fd-9c5e-a334695f80e1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:59.894407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a65dbfb3-4c72-49fd-9c5e-a334695f80e1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:59.894858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a65dbfb3-4c72-49fd-9c5e-a334695f80e1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:59.899243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a65dbfb3-4c72-49fd-9c5e-a334695f80e1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:59.901168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a65dbfb3-4c72-49fd-9c5e-a334695f80e1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:59.909107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a65dbfb3-4c72-49fd-9c5e-a334695f80e1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:00.257674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:00.267026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:00.276452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:00.279061 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8823c6db-a701-4fcc-a4e0-6874f56430d8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1569 microversion: 2.25 time: 0.465678 Aug 27 04:53:00.279061 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 207/399] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:59 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1569 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:00.294196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a65dbfb3-4c72-49fd-9c5e-a334695f80e1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:00.302364 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a65dbfb3-4c72-49fd-9c5e-a334695f80e1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1316 microversion: 2.1 time: 0.445187 Aug 27 04:53:00.303029 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 193/400] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:59 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:00.319724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3800e9f7-6619-41c7-8d55-f2f5cc7e001d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:00.320339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3800e9f7-6619-41c7-8d55-f2f5cc7e001d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:00.326561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3800e9f7-6619-41c7-8d55-f2f5cc7e001d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:00.327051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3800e9f7-6619-41c7-8d55-f2f5cc7e001d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:00.328058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3800e9f7-6619-41c7-8d55-f2f5cc7e001d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:00.328939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3800e9f7-6619-41c7-8d55-f2f5cc7e001d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:00.329392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3800e9f7-6619-41c7-8d55-f2f5cc7e001d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:00.329811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3800e9f7-6619-41c7-8d55-f2f5cc7e001d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:00.478277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1964066234", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:00.518381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3800e9f7-6619-41c7-8d55-f2f5cc7e001d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:00.530391 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3800e9f7-6619-41c7-8d55-f2f5cc7e001d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1323 microversion: 2.1 time: 0.216993 Aug 27 04:53:00.534094 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 194/401] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:00 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1323 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:00.540199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:00.540821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:00.542208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:53:00.548557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:00.549100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:00.549680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:00.550393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:00.550842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:00.551329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:00.912292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:00.926189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:00.927718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:00.942991 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14d8ce19-1ca1-4602-bede-faf8bf380dd8 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1453 microversion: 2.75 time: 0.407730 Aug 27 04:53:00.943607 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 195/402] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:00 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1453 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:00.967252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-badeabdd-4a97-4c80-8a93-d4aafb5f93ca tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:00.967883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-badeabdd-4a97-4c80-8a93-d4aafb5f93ca tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:00.974012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-badeabdd-4a97-4c80-8a93-d4aafb5f93ca tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:00.974515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-badeabdd-4a97-4c80-8a93-d4aafb5f93ca tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:00.974962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-badeabdd-4a97-4c80-8a93-d4aafb5f93ca tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:00.975713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-badeabdd-4a97-4c80-8a93-d4aafb5f93ca tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:00.976174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-badeabdd-4a97-4c80-8a93-d4aafb5f93ca tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:00.976609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-badeabdd-4a97-4c80-8a93-d4aafb5f93ca tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:01.301787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:53:01.302277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:53:01.302688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:53:01.303126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:53:01.303548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:53:01.313068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-badeabdd-4a97-4c80-8a93-d4aafb5f93ca tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:01.324423 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-badeabdd-4a97-4c80-8a93-d4aafb5f93ca tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1314 microversion: 2.1 time: 0.366320 Aug 27 04:53:01.324659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:01.325149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:01.326090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:01.327056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:01.327964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:01.328562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:01.335624 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 196/403] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:00 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:01.345087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:01.345981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:01.351582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=23 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:01.364925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:01.365753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:01.366383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:01.369894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:01.372189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:01.372945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:01.405105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Getting quotas for project 45c2a8d4be674caeab73db8e28ac1459. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:01.414339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Getting quotas for user 3917d606c35f4db1af916815167fae74 and project 45c2a8d4be674caeab73db8e28ac1459. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:01.461246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:53:01.463946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:53:01.587286 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-93edcb2c-684c-4761-9c37-fe3aded3cfc5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305720 Aug 27 04:53:01.587951 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 208/404] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:53:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:53:01.603726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ba31d334-a8d4-42e1-b4a5-f9d05c78190f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:01.604626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ba31d334-a8d4-42e1-b4a5-f9d05c78190f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:01.633969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:01.635897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba31d334-a8d4-42e1-b4a5-f9d05c78190f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:01.645998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba31d334-a8d4-42e1-b4a5-f9d05c78190f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:01.646587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba31d334-a8d4-42e1-b4a5-f9d05c78190f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:01.647429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba31d334-a8d4-42e1-b4a5-f9d05c78190f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:01.647967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba31d334-a8d4-42e1-b4a5-f9d05c78190f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:01.652514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba31d334-a8d4-42e1-b4a5-f9d05c78190f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:01.729967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:01.739701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:01.741165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:01.742351 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-60ef2f8e-37cd-421e-bb3d-42e9eb7a5fe2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1569 microversion: 2.25 time: 0.404926 Aug 27 04:53:01.742926 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 197/405] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:01 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1569 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:01.781575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9df16568-b279-4a3e-adaf-051071a6b395 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:01.782674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9df16568-b279-4a3e-adaf-051071a6b395 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:01.814782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9df16568-b279-4a3e-adaf-051071a6b395 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:01.816038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9df16568-b279-4a3e-adaf-051071a6b395 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:01.816502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9df16568-b279-4a3e-adaf-051071a6b395 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:01.817267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9df16568-b279-4a3e-adaf-051071a6b395 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:01.819335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9df16568-b279-4a3e-adaf-051071a6b395 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:01.819966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9df16568-b279-4a3e-adaf-051071a6b395 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.131389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ba31d334-a8d4-42e1-b4a5-f9d05c78190f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:02.143378 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ba31d334-a8d4-42e1-b4a5-f9d05c78190f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1316 microversion: 2.1 time: 0.551424 Aug 27 04:53:02.144390 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 209/406] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:01 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:02.151275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-640f2691-dafd-4cfc-8719-4c354a0d25f0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:02.152147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-640f2691-dafd-4cfc-8719-4c354a0d25f0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:02.194699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9df16568-b279-4a3e-adaf-051071a6b395 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:02.203818 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9df16568-b279-4a3e-adaf-051071a6b395 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1323 microversion: 2.1 time: 0.441852 Aug 27 04:53:02.226591 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 198/407] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:01 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1323 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:02.233437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c0f357ff-d3d6-4908-add1-43d951d05b10 req-8f67a132-3f16-4598-84be-a79cfa4c9c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba13511-9622-4b36-84cc-de60709bc808", "name": "network-vif-plugged", "status": "completed", "tag": "89aa4311-8b23-488b-93c4-03f74c9c1d6f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:02.251436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c0f357ff-d3d6-4908-add1-43d951d05b10 req-8f67a132-3f16-4598-84be-a79cfa4c9c19 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.252172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c0f357ff-d3d6-4908-add1-43d951d05b10 req-8f67a132-3f16-4598-84be-a79cfa4c9c19 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.252769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c0f357ff-d3d6-4908-add1-43d951d05b10 req-8f67a132-3f16-4598-84be-a79cfa4c9c19 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.275597 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c0f357ff-d3d6-4908-add1-43d951d05b10 req-8f67a132-3f16-4598-84be-a79cfa4c9c19 service nova] Creating event network-vif-plugged:89aa4311-8b23-488b-93c4-03f74c9c1d6f for instance bba13511-9622-4b36-84cc-de60709bc808 on n-h2-820368-35 Aug 27 04:53:02.283362 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c0f357ff-d3d6-4908-add1-43d951d05b10 req-8f67a132-3f16-4598-84be-a79cfa4c9c19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053701 Aug 27 04:53:02.284300 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 199/408] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:02.289568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:02.305277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-640f2691-dafd-4cfc-8719-4c354a0d25f0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:02.314474 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-640f2691-dafd-4cfc-8719-4c354a0d25f0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1220 microversion: 2.1 time: 0.168732 Aug 27 04:53:02.317168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:02.318146 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 210/409] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:02 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1220 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:02.331165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.331165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.331165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.331165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.347942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-9dfefa65-ec6d-4277-aeb2-2b26c2cf1e8a req-c0049669-3896-473f-897e-81da9c9f753f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503ce154-c117-40cb-bde8-137c354ee752", "tag": "407dd1cf-2e5c-4663-beb4-7811e097981f"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:02.355195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.356256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.365754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9dfefa65-ec6d-4277-aeb2-2b26c2cf1e8a req-c0049669-3896-473f-897e-81da9c9f753f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.372001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9dfefa65-ec6d-4277-aeb2-2b26c2cf1e8a req-c0049669-3896-473f-897e-81da9c9f753f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.372725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9dfefa65-ec6d-4277-aeb2-2b26c2cf1e8a req-c0049669-3896-473f-897e-81da9c9f753f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.405212 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-9dfefa65-ec6d-4277-aeb2-2b26c2cf1e8a req-c0049669-3896-473f-897e-81da9c9f753f service nova] Creating event network-changed:407dd1cf-2e5c-4663-beb4-7811e097981f for instance 503ce154-c117-40cb-bde8-137c354ee752 on n-h1-820368-35 Aug 27 04:53:02.420387 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-9dfefa65-ec6d-4277-aeb2-2b26c2cf1e8a req-c0049669-3896-473f-897e-81da9c9f753f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085709 Aug 27 04:53:02.422130 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 211/410] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:02.427773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c37c2697-9daa-4e9a-8ad1-849c66cd2e3a tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:02.430918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c37c2697-9daa-4e9a-8ad1-849c66cd2e3a tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:02.444284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37c2697-9daa-4e9a-8ad1-849c66cd2e3a tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.444782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37c2697-9daa-4e9a-8ad1-849c66cd2e3a tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.449868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37c2697-9daa-4e9a-8ad1-849c66cd2e3a tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.450712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37c2697-9daa-4e9a-8ad1-849c66cd2e3a tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.451234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37c2697-9daa-4e9a-8ad1-849c66cd2e3a tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.451681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37c2697-9daa-4e9a-8ad1-849c66cd2e3a tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.594497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:02.603839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:02.605676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:02.611842 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bdf9976a-874e-4944-b017-0827de6a4a0d tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1453 microversion: 2.75 time: 0.326382 Aug 27 04:53:02.612588 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 200/411] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:02 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1453 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:02.770967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:02.772429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:02.779283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.779867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.790878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.791969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.792538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.793083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.824839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c37c2697-9daa-4e9a-8ad1-849c66cd2e3a tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:02.834495 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c37c2697-9daa-4e9a-8ad1-849c66cd2e3a tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1314 microversion: 2.1 time: 0.411147 Aug 27 04:53:02.835436 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 212/412] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:02 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:03.022234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:03.065724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:03.074679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:03.076410 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ae109e3d-31ae-4c2b-8908-9af01ed53827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1569 microversion: 2.25 time: 0.310887 Aug 27 04:53:03.077573 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 201/413] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:02 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:53:03.164246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-55929397-c30c-4030-917c-2e480e79b9ea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:03.164810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-55929397-c30c-4030-917c-2e480e79b9ea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:03.172228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55929397-c30c-4030-917c-2e480e79b9ea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.172228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55929397-c30c-4030-917c-2e480e79b9ea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.172676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55929397-c30c-4030-917c-2e480e79b9ea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.173481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55929397-c30c-4030-917c-2e480e79b9ea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.173944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55929397-c30c-4030-917c-2e480e79b9ea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.174371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55929397-c30c-4030-917c-2e480e79b9ea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.233511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cfe025a6-97df-4d37-8890-14f9a814339f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:03.234177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cfe025a6-97df-4d37-8890-14f9a814339f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:03.236527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=12 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:03.253528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cfe025a6-97df-4d37-8890-14f9a814339f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.254149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cfe025a6-97df-4d37-8890-14f9a814339f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.255421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cfe025a6-97df-4d37-8890-14f9a814339f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.256231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cfe025a6-97df-4d37-8890-14f9a814339f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.256771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cfe025a6-97df-4d37-8890-14f9a814339f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.258161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cfe025a6-97df-4d37-8890-14f9a814339f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.366814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-55929397-c30c-4030-917c-2e480e79b9ea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:03.377444 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-55929397-c30c-4030-917c-2e480e79b9ea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1465 microversion: 2.1 time: 0.216855 Aug 27 04:53:03.377963 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 213/414] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:03 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1465 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:03.387077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d5eb9f65-77b8-4f58-960f-3f1bc615f1d6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:03.387718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d5eb9f65-77b8-4f58-960f-3f1bc615f1d6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:03.394263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5eb9f65-77b8-4f58-960f-3f1bc615f1d6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.395021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5eb9f65-77b8-4f58-960f-3f1bc615f1d6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.395514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5eb9f65-77b8-4f58-960f-3f1bc615f1d6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.396227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5eb9f65-77b8-4f58-960f-3f1bc615f1d6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.396677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5eb9f65-77b8-4f58-960f-3f1bc615f1d6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.397100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5eb9f65-77b8-4f58-960f-3f1bc615f1d6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.463154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cfe025a6-97df-4d37-8890-14f9a814339f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:03.474818 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cfe025a6-97df-4d37-8890-14f9a814339f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1323 microversion: 2.1 time: 0.245945 Aug 27 04:53:03.478678 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 202/415] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:03 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:03.479605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5eb9f65-77b8-4f58-960f-3f1bc615f1d6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:03.491027 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d5eb9f65-77b8-4f58-960f-3f1bc615f1d6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1272 microversion: 2.1 time: 0.108938 Aug 27 04:53:03.492342 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 214/416] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:03 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:03.640504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:03.641471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:03.648583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.649291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.649926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.650844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.651532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.652158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.667684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e3dfca5-bc0b-44fb-8327-ac0354b605ed tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:03.668374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1e3dfca5-bc0b-44fb-8327-ac0354b605ed tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:03.675578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e3dfca5-bc0b-44fb-8327-ac0354b605ed tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.676213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e3dfca5-bc0b-44fb-8327-ac0354b605ed tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.676664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e3dfca5-bc0b-44fb-8327-ac0354b605ed tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.677379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e3dfca5-bc0b-44fb-8327-ac0354b605ed tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.677835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e3dfca5-bc0b-44fb-8327-ac0354b605ed tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.678264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e3dfca5-bc0b-44fb-8327-ac0354b605ed tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.684424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=10 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:03.740267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:03.749710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:03.751579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:03.758529 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f984a519-60c5-4ba9-a7d3-f9b553f20a37 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1453 microversion: 2.75 time: 0.122430 Aug 27 04:53:03.759698 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 215/417] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:03 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:53:03.860974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-be46807d-ca43-493b-967a-d2195331369d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:03.862061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-be46807d-ca43-493b-967a-d2195331369d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:03.871232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be46807d-ca43-493b-967a-d2195331369d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.872020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be46807d-ca43-493b-967a-d2195331369d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.872664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be46807d-ca43-493b-967a-d2195331369d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.873621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be46807d-ca43-493b-967a-d2195331369d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.874949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be46807d-ca43-493b-967a-d2195331369d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.875594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be46807d-ca43-493b-967a-d2195331369d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:04.111521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-be46807d-ca43-493b-967a-d2195331369d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:04.120181 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-be46807d-ca43-493b-967a-d2195331369d tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1314 microversion: 2.1 time: 0.267654 Aug 27 04:53:04.120824 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e3dfca5-bc0b-44fb-8327-ac0354b605ed tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1618 microversion: 2.1 time: 0.637754 Aug 27 04:53:04.121083 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 216/418] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:03 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:04.121450 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 203/419] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:03 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1618 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:04.126253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:04.126923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:04.133672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:04.133672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:04.134128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:04.134830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:04.135311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:04.135734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:04.143571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6f5eb8c1-c26d-41e0-979d-7b833e94a951 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Action: 'create', calling method: .version_select at 0x7fb56590c160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-460897101", "policies": ["affinity"]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:04.149775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:04.170349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-6f5eb8c1-c26d-41e0-979d-7b833e94a951 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:04.178914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-6f5eb8c1-c26d-41e0-979d-7b833e94a951 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:04.262823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-6f5eb8c1-c26d-41e0-979d-7b833e94a951 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:04.268955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-6f5eb8c1-c26d-41e0-979d-7b833e94a951 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:04.282685 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6f5eb8c1-c26d-41e0-979d-7b833e94a951 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.143413 Aug 27 04:53:04.283505 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 204/420] 10.222.0.58 () {60 vars in 1174 bytes} [Sat Aug 27 04:53:04 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:04.283987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:04.292460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:04.296050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:04.297267 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-71b83bf5-34cc-4c23-95a4-521a187c0ea4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1569 microversion: 2.25 time: 0.175245 Aug 27 04:53:04.298674 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 217/421] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:04 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:04.413142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1112254898", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "aa8dd1db-315c-47d2-af7f-40f3948a37fb"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:04.479323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:53:04.497787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f3e87d82-706b-47f0-803a-1e248c56da33 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:04.498675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f3e87d82-706b-47f0-803a-1e248c56da33 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:04.512558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3e87d82-706b-47f0-803a-1e248c56da33 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:04.519480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3e87d82-706b-47f0-803a-1e248c56da33 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:04.520077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3e87d82-706b-47f0-803a-1e248c56da33 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:04.521085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3e87d82-706b-47f0-803a-1e248c56da33 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:04.521787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3e87d82-706b-47f0-803a-1e248c56da33 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:04.522437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3e87d82-706b-47f0-803a-1e248c56da33 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:04.908464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f3e87d82-706b-47f0-803a-1e248c56da33 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:04.920650 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f3e87d82-706b-47f0-803a-1e248c56da33 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1323 microversion: 2.1 time: 0.425906 Aug 27 04:53:04.936881 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 218/422] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:04 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1323 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:04.950763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-afef5ae3-58fe-402a-afd2-cd052d7e48cb tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:04.951461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-afef5ae3-58fe-402a-afd2-cd052d7e48cb tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:04.966862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:53:04.967380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:53:04.967494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afef5ae3-58fe-402a-afd2-cd052d7e48cb tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:04.968573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:53:04.968778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afef5ae3-58fe-402a-afd2-cd052d7e48cb tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:04.969004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:53:04.969132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afef5ae3-58fe-402a-afd2-cd052d7e48cb tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:04.969432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:53:04.970333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afef5ae3-58fe-402a-afd2-cd052d7e48cb tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:04.971629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afef5ae3-58fe-402a-afd2-cd052d7e48cb tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:04.972246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afef5ae3-58fe-402a-afd2-cd052d7e48cb tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:05.024919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:05.025591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:05.026236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:05.027119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:05.027594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:05.028456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:05.065889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:05.089167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:05.132708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Going to run 2 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:53:05.136215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-afef5ae3-58fe-402a-afd2-cd052d7e48cb tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:05.145764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:53:05.168355 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-afef5ae3-58fe-402a-afd2-cd052d7e48cb tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1272 microversion: 2.1 time: 0.222441 Aug 27 04:53:05.169063 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 219/423] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:04 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:05.226236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:05.228699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:05.237592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128547) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 27 04:53:05.252292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:05.257355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:05.257503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:05.264134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:05.265518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:05.265518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:05.293390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:05.299827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:05.326171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:05.371861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:05.381855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:05.390394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:05.400575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:05.402670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:05.405089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=a534099b-1082-4506-97ae-da1e66618172,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:53:05.410005 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9e244309-5215-49e7-87d0-830fc4f7fcde tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1438 microversion: 2.75 time: 0.221812 Aug 27 04:53:05.410889 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 220/424] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:05 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1438 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:05.424886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-606e604c-17f4-41dd-af09-9db7ce47e606 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:05.424886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-606e604c-17f4-41dd-af09-9db7ce47e606 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:05.434848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606e604c-17f4-41dd-af09-9db7ce47e606 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:05.434848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606e604c-17f4-41dd-af09-9db7ce47e606 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:05.434848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606e604c-17f4-41dd-af09-9db7ce47e606 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:05.434848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606e604c-17f4-41dd-af09-9db7ce47e606 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:05.435284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606e604c-17f4-41dd-af09-9db7ce47e606 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:05.435284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606e604c-17f4-41dd-af09-9db7ce47e606 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:05.518409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:05.524168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:05.584702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:05.587836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-606e604c-17f4-41dd-af09-9db7ce47e606 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:05.602949 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-606e604c-17f4-41dd-af09-9db7ce47e606 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1314 microversion: 2.1 time: 0.184385 Aug 27 04:53:05.603764 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 221/425] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:05 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:05.651506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:05.660877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:05.665323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:05.673107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:05.674558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:05.675887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:05.676718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:05.677504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:05.678177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:05.741110 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-296cadeb-ce92-4c07-9e80-b7aa02a66e52 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.332703 Aug 27 04:53:05.742304 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 205/426] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:53:04 2022] POST /compute/v2.1/servers => generated 32 bytes in 1336 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:53:06.002029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:06.005200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:06.008880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:06.017229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.017760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.018748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.019728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.020322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.031584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.112411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:06.123482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:06.125494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:06.135427 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ee025e4-c99c-4244-afc0-0c95fadde7e5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1569 microversion: 2.25 time: 0.496351 Aug 27 04:53:06.151346 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 222/427] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:05 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1569 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:06.163445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-98df084b-8623-43be-aa71-c9c298c4d143 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:06.186493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-98df084b-8623-43be-aa71-c9c298c4d143 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:06.188599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-98df084b-8623-43be-aa71-c9c298c4d143 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Searching by: {'deleted': False, 'project_id': '4074bf02227441b091b6e7d62f83b9e0'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:53:06.226020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:53:06.226444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:53:06.227075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:53:06.228514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:53:06.228956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:53:06.244386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98df084b-8623-43be-aa71-c9c298c4d143 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.251393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98df084b-8623-43be-aa71-c9c298c4d143 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.251924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98df084b-8623-43be-aa71-c9c298c4d143 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.252805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98df084b-8623-43be-aa71-c9c298c4d143 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.262977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98df084b-8623-43be-aa71-c9c298c4d143 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.263401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98df084b-8623-43be-aa71-c9c298c4d143 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.346789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:06.363673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.363880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.366318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.369844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.370364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.372512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.559382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-98df084b-8623-43be-aa71-c9c298c4d143 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:53:06.580374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:06.732761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:06.777479 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e30248da-3ffb-4c5e-a0c3-0bc1459c5589 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949/action" status: 202 len: 1944 microversion: 2.75 time: 1.033724 Aug 27 04:53:06.778585 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 206/428] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 04:53:05 2022] POST /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949/action => generated 1944 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 04:53:06.783471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-02129ffb-7183-47c4-8e4f-129778faab37 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:06.791670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-02129ffb-7183-47c4-8e4f-129778faab37 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:06.816922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02129ffb-7183-47c4-8e4f-129778faab37 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.823451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02129ffb-7183-47c4-8e4f-129778faab37 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.823946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02129ffb-7183-47c4-8e4f-129778faab37 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.824715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02129ffb-7183-47c4-8e4f-129778faab37 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.825184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02129ffb-7183-47c4-8e4f-129778faab37 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.825609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02129ffb-7183-47c4-8e4f-129778faab37 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.826294 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-98df084b-8623-43be-aa71-c9c298c4d143 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.673587 Aug 27 04:53:06.834466 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 223/429] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 04:53:06 2022] GET /compute/v2.1/servers => generated 1003 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:06.841649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-668e56b4-bb34-47ab-b0c5-f61a576049a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:06.842536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-668e56b4-bb34-47ab-b0c5-f61a576049a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:06.853490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-668e56b4-bb34-47ab-b0c5-f61a576049a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.854494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-668e56b4-bb34-47ab-b0c5-f61a576049a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.855080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-668e56b4-bb34-47ab-b0c5-f61a576049a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.855981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-668e56b4-bb34-47ab-b0c5-f61a576049a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.856572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-668e56b4-bb34-47ab-b0c5-f61a576049a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.858106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-668e56b4-bb34-47ab-b0c5-f61a576049a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:07.134068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-668e56b4-bb34-47ab-b0c5-f61a576049a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:07.143733 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-668e56b4-bb34-47ab-b0c5-f61a576049a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1278 microversion: 2.1 time: 0.307559 Aug 27 04:53:07.151128 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 224/430] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:06 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1278 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:07.166996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9348ac2c-fa17-41cb-8ea2-525b2c77bab3 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:07.168578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9348ac2c-fa17-41cb-8ea2-525b2c77bab3 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:07.188385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9348ac2c-fa17-41cb-8ea2-525b2c77bab3 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:07.194090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9348ac2c-fa17-41cb-8ea2-525b2c77bab3 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:07.194674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9348ac2c-fa17-41cb-8ea2-525b2c77bab3 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:07.195741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9348ac2c-fa17-41cb-8ea2-525b2c77bab3 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:07.196190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9348ac2c-fa17-41cb-8ea2-525b2c77bab3 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:07.196709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9348ac2c-fa17-41cb-8ea2-525b2c77bab3 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:07.809961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02129ffb-7183-47c4-8e4f-129778faab37 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:07.826085 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-02129ffb-7183-47c4-8e4f-129778faab37 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1323 microversion: 2.1 time: 1.046221 Aug 27 04:53:07.827528 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 207/431] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:06 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1323 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:07.832259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1d81adc-8964-41e5-86ed-cf0ff48a528f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:07.833093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d1d81adc-8964-41e5-86ed-cf0ff48a528f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:07.850415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1d81adc-8964-41e5-86ed-cf0ff48a528f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:07.851330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1d81adc-8964-41e5-86ed-cf0ff48a528f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:07.852001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1d81adc-8964-41e5-86ed-cf0ff48a528f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:07.852948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1d81adc-8964-41e5-86ed-cf0ff48a528f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:07.853615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1d81adc-8964-41e5-86ed-cf0ff48a528f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:07.854261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1d81adc-8964-41e5-86ed-cf0ff48a528f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.188252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-d1d81adc-8964-41e5-86ed-cf0ff48a528f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:08.216010 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1d81adc-8964-41e5-86ed-cf0ff48a528f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.387109 Aug 27 04:53:08.216595 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 208/432] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:07 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:08.223748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-74af6832-d22b-4fec-a2b5-c998c2c8b131 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:08.224950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-74af6832-d22b-4fec-a2b5-c998c2c8b131 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:08.233287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74af6832-d22b-4fec-a2b5-c998c2c8b131 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.234885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74af6832-d22b-4fec-a2b5-c998c2c8b131 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.235755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74af6832-d22b-4fec-a2b5-c998c2c8b131 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.236743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74af6832-d22b-4fec-a2b5-c998c2c8b131 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.237376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74af6832-d22b-4fec-a2b5-c998c2c8b131 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.237963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74af6832-d22b-4fec-a2b5-c998c2c8b131 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.357922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-74af6832-d22b-4fec-a2b5-c998c2c8b131 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:08.361538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9348ac2c-fa17-41cb-8ea2-525b2c77bab3 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:08.369711 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9348ac2c-fa17-41cb-8ea2-525b2c77bab3 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1464 microversion: 2.1 time: 1.221468 Aug 27 04:53:08.370021 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-74af6832-d22b-4fec-a2b5-c998c2c8b131 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1271 microversion: 2.1 time: 0.151542 Aug 27 04:53:08.384226 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 209/433] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:08 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:08.386278 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 225/434] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:07 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1464 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:08.390118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:08.390732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:08.393790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-171f6036-3c39-4a85-9cfd-7f8b0db2cd82 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:08.395181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-171f6036-3c39-4a85-9cfd-7f8b0db2cd82 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:08.398183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.398889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.399536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.400393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.400993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.401569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.403494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-171f6036-3c39-4a85-9cfd-7f8b0db2cd82 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.404161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-171f6036-3c39-4a85-9cfd-7f8b0db2cd82 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.405256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-171f6036-3c39-4a85-9cfd-7f8b0db2cd82 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.406137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-171f6036-3c39-4a85-9cfd-7f8b0db2cd82 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.406594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-171f6036-3c39-4a85-9cfd-7f8b0db2cd82 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.407319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-171f6036-3c39-4a85-9cfd-7f8b0db2cd82 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.541147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-171f6036-3c39-4a85-9cfd-7f8b0db2cd82 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:08.549609 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-171f6036-3c39-4a85-9cfd-7f8b0db2cd82 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1278 microversion: 2.1 time: 0.161355 Aug 27 04:53:08.550194 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 226/435] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:08 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:08.704327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6716a6e5-1206-43ed-bd66-1db58cd64e74 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Calling method '.version_select at 0x7fb565ce30d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:08.715306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6716a6e5-1206-43ed-bd66-1db58cd64e74 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.715801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6716a6e5-1206-43ed-bd66-1db58cd64e74 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.716237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6716a6e5-1206-43ed-bd66-1db58cd64e74 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.733798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6716a6e5-1206-43ed-bd66-1db58cd64e74 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.734525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6716a6e5-1206-43ed-bd66-1db58cd64e74 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.735014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6716a6e5-1206-43ed-bd66-1db58cd64e74 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.760321 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6716a6e5-1206-43ed-bd66-1db58cd64e74 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/2009e731b78d429f9a702e5638135166?start=2022-08-26T04%3A53%3A08.384483&end=2022-08-28T04%3A53%3A08.384483" status: 200 len: 643 microversion: 2.1 time: 0.208771 Aug 27 04:53:08.762139 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 227/436] 10.222.0.58 () {58 vars in 1412 bytes} [Sat Aug 27 04:53:08 2022] GET /compute/v2.1/os-simple-tenant-usage/2009e731b78d429f9a702e5638135166?start=2022-08-26T04%3A53%3A08.384483&end=2022-08-28T04%3A53%3A08.384483 => generated 643 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:08.776272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10fa68ed-e1be-4d5b-a29f-aa726e2a5ac2 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '.version_select at 0x7fb565a6aca0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:08.795341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10fa68ed-e1be-4d5b-a29f-aa726e2a5ac2 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.796411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10fa68ed-e1be-4d5b-a29f-aa726e2a5ac2 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.803629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10fa68ed-e1be-4d5b-a29f-aa726e2a5ac2 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.818414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10fa68ed-e1be-4d5b-a29f-aa726e2a5ac2 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.818914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10fa68ed-e1be-4d5b-a29f-aa726e2a5ac2 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.834017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10fa68ed-e1be-4d5b-a29f-aa726e2a5ac2 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.865453 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10fa68ed-e1be-4d5b-a29f-aa726e2a5ac2 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/2009e731b78d429f9a702e5638135166?start=2022-08-26T04%3A53%3A08.384483&end=2022-08-28T04%3A53%3A08.384483" status: 200 len: 695 microversion: 2.1 time: 0.092919 Aug 27 04:53:08.866401 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 228/437] 10.222.0.58 () {58 vars in 1412 bytes} [Sat Aug 27 04:53:08 2022] GET /compute/v2.1/os-simple-tenant-usage/2009e731b78d429f9a702e5638135166?start=2022-08-26T04%3A53%3A08.384483&end=2022-08-28T04%3A53%3A08.384483 => generated 695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:08.871963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d7b65600-12b2-4fb3-a6ab-c0e291e8eed4 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:08.872578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d7b65600-12b2-4fb3-a6ab-c0e291e8eed4 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:08.891925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7b65600-12b2-4fb3-a6ab-c0e291e8eed4 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.897276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7b65600-12b2-4fb3-a6ab-c0e291e8eed4 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.897957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7b65600-12b2-4fb3-a6ab-c0e291e8eed4 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.898681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7b65600-12b2-4fb3-a6ab-c0e291e8eed4 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.899205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7b65600-12b2-4fb3-a6ab-c0e291e8eed4 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.899630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7b65600-12b2-4fb3-a6ab-c0e291e8eed4 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.928575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:08.937709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:08.939343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:08.940513 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e5c01b43-a58e-43a6-964d-9b8d830b9756 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1569 microversion: 2.25 time: 0.568475 Aug 27 04:53:08.955510 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 210/438] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:08 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1569 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:08.961028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c138d763-6a9b-4fb2-8f3f-1e0cb2b7e742 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Calling method '.version_select at 0x7fb56580d160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:09.000702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c138d763-6a9b-4fb2-8f3f-1e0cb2b7e742 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.001819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c138d763-6a9b-4fb2-8f3f-1e0cb2b7e742 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.002728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c138d763-6a9b-4fb2-8f3f-1e0cb2b7e742 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.038753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c138d763-6a9b-4fb2-8f3f-1e0cb2b7e742 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.039815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c138d763-6a9b-4fb2-8f3f-1e0cb2b7e742 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.040640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c138d763-6a9b-4fb2-8f3f-1e0cb2b7e742 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.084293 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c138d763-6a9b-4fb2-8f3f-1e0cb2b7e742 tempest-TenantUsagesTestJSON-1189506041 tempest-TenantUsagesTestJSON-1189506041-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T04%3A53%3A08.384483&end=2022-08-28T04%3A53%3A08.384483&detailed=1" status: 200 len: 5499 microversion: 2.1 time: 0.127223 Aug 27 04:53:09.085589 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 211/439] 10.222.0.58 () {58 vars in 1335 bytes} [Sat Aug 27 04:53:08 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T04%3A53%3A08.384483&end=2022-08-28T04%3A53%3A08.384483&detailed=1 => generated 5499 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:09.107747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-36d32916-843a-4c28-b551-c60421cf3f5c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:09.109157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-36d32916-843a-4c28-b551-c60421cf3f5c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:09.133802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36d32916-843a-4c28-b551-c60421cf3f5c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.136526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36d32916-843a-4c28-b551-c60421cf3f5c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.138806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36d32916-843a-4c28-b551-c60421cf3f5c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.146375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36d32916-843a-4c28-b551-c60421cf3f5c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.147116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36d32916-843a-4c28-b551-c60421cf3f5c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.148437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36d32916-843a-4c28-b551-c60421cf3f5c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.201714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-36d32916-843a-4c28-b551-c60421cf3f5c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:53:09.414500 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-36d32916-843a-4c28-b551-c60421cf3f5c tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 204 len: 0 microversion: 2.1 time: 0.311955 Aug 27 04:53:09.415277 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 212/440] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:53:09 2022] DELETE /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:53:09.421378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf783043-69cd-49e5-88be-c5c5e4746202 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:09.424426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf783043-69cd-49e5-88be-c5c5e4746202 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:09.438769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf783043-69cd-49e5-88be-c5c5e4746202 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.439564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf783043-69cd-49e5-88be-c5c5e4746202 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.440180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf783043-69cd-49e5-88be-c5c5e4746202 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.441075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf783043-69cd-49e5-88be-c5c5e4746202 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.441537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf783043-69cd-49e5-88be-c5c5e4746202 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.441971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf783043-69cd-49e5-88be-c5c5e4746202 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.570407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-cf783043-69cd-49e5-88be-c5c5e4746202 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:09.594212 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf783043-69cd-49e5-88be-c5c5e4746202 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.177468 Aug 27 04:53:09.608975 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 213/441] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:09 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:09.618451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2714c873-ab43-4a48-bbbd-11f1fafeb425 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:09.619461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2714c873-ab43-4a48-bbbd-11f1fafeb425 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:09.626192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2714c873-ab43-4a48-bbbd-11f1fafeb425 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.626790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2714c873-ab43-4a48-bbbd-11f1fafeb425 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.627302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2714c873-ab43-4a48-bbbd-11f1fafeb425 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.628458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2714c873-ab43-4a48-bbbd-11f1fafeb425 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.628907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2714c873-ab43-4a48-bbbd-11f1fafeb425 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.629338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2714c873-ab43-4a48-bbbd-11f1fafeb425 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.654520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d7b65600-12b2-4fb3-a6ab-c0e291e8eed4 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:09.665650 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d7b65600-12b2-4fb3-a6ab-c0e291e8eed4 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1323 microversion: 2.1 time: 0.797499 Aug 27 04:53:09.666576 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 229/442] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:08 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1323 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:09.682321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-39abe133-db97-4b3b-8972-1bacb9eb9346 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:09.683032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-39abe133-db97-4b3b-8972-1bacb9eb9346 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:09.691816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39abe133-db97-4b3b-8972-1bacb9eb9346 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.692631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39abe133-db97-4b3b-8972-1bacb9eb9346 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.693270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39abe133-db97-4b3b-8972-1bacb9eb9346 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.694388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39abe133-db97-4b3b-8972-1bacb9eb9346 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.694892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39abe133-db97-4b3b-8972-1bacb9eb9346 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.695535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39abe133-db97-4b3b-8972-1bacb9eb9346 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.723620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2714c873-ab43-4a48-bbbd-11f1fafeb425 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:09.742274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2714c873-ab43-4a48-bbbd-11f1fafeb425 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1277 microversion: 2.1 time: 0.132073 Aug 27 04:53:09.744691 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 214/443] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:09 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:09.754082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8bfe7059-459e-4750-a266-4b6f73cb4f10 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:09.755140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8bfe7059-459e-4750-a266-4b6f73cb4f10 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:09.762959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfe7059-459e-4750-a266-4b6f73cb4f10 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.763693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfe7059-459e-4750-a266-4b6f73cb4f10 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.765035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfe7059-459e-4750-a266-4b6f73cb4f10 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.765944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfe7059-459e-4750-a266-4b6f73cb4f10 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.766711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfe7059-459e-4750-a266-4b6f73cb4f10 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.767332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfe7059-459e-4750-a266-4b6f73cb4f10 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.886802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8bfe7059-459e-4750-a266-4b6f73cb4f10 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:09.898596 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8bfe7059-459e-4750-a266-4b6f73cb4f10 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1278 microversion: 2.1 time: 0.151287 Aug 27 04:53:09.899748 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 215/444] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:09 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:09.967170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:09.969568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:09.977724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.978293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.979006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.980850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.982042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.986572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:10.035030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-39abe133-db97-4b3b-8972-1bacb9eb9346 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:10.052899 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-39abe133-db97-4b3b-8972-1bacb9eb9346 tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1470 microversion: 2.1 time: 0.384384 Aug 27 04:53:10.053809 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 230/445] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:09 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1470 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:10.131463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1bf7b10f-e6f9-4389-9d58-daba2cd9d62e req-70007420-d066-4450-bf72-2387616403dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503ce154-c117-40cb-bde8-137c354ee752", "name": "network-vif-plugged", "status": "completed", "tag": "407dd1cf-2e5c-4663-beb4-7811e097981f"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:10.147745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1bf7b10f-e6f9-4389-9d58-daba2cd9d62e req-70007420-d066-4450-bf72-2387616403dd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:10.148263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1bf7b10f-e6f9-4389-9d58-daba2cd9d62e req-70007420-d066-4450-bf72-2387616403dd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:10.148719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1bf7b10f-e6f9-4389-9d58-daba2cd9d62e req-70007420-d066-4450-bf72-2387616403dd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:10.162959 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1bf7b10f-e6f9-4389-9d58-daba2cd9d62e req-70007420-d066-4450-bf72-2387616403dd service nova] Creating event network-vif-plugged:407dd1cf-2e5c-4663-beb4-7811e097981f for instance 503ce154-c117-40cb-bde8-137c354ee752 on n-h1-820368-35 Aug 27 04:53:10.168809 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1bf7b10f-e6f9-4389-9d58-daba2cd9d62e req-70007420-d066-4450-bf72-2387616403dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047909 Aug 27 04:53:10.169877 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 231/446] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:10.298860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:10.325656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:10.328436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:10.331704 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2e5a0f5e-0bc2-4e4f-9844-6547deea9e62 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1559 microversion: 2.25 time: 0.371343 Aug 27 04:53:10.335353 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 216/447] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:09 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1559 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:53:10.360371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-172cbbc9-0000-46c7-b75e-448fdbdf9edc tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '.version_select at 0x7fb565a6f3a0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:10.364256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172cbbc9-0000-46c7-b75e-448fdbdf9edc tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:10.364748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172cbbc9-0000-46c7-b75e-448fdbdf9edc tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:10.365197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172cbbc9-0000-46c7-b75e-448fdbdf9edc tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:10.385600 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-172cbbc9-0000-46c7-b75e-448fdbdf9edc tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 684 microversion: 2.25 time: 0.030879 Aug 27 04:53:10.386213 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 232/448] 10.222.0.58 () {60 vars in 1184 bytes} [Sat Aug 27 04:53:10 2022] GET /compute/v2.1/os-migrations => generated 684 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:53:10.400690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6b4d15a-8c9d-4917-a71b-f06a1c191685 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:10.401953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a6b4d15a-8c9d-4917-a71b-f06a1c191685 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:10.409849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6b4d15a-8c9d-4917-a71b-f06a1c191685 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:10.410342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6b4d15a-8c9d-4917-a71b-f06a1c191685 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:10.410956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6b4d15a-8c9d-4917-a71b-f06a1c191685 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:10.411703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6b4d15a-8c9d-4917-a71b-f06a1c191685 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:10.412321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6b4d15a-8c9d-4917-a71b-f06a1c191685 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:10.412751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6b4d15a-8c9d-4917-a71b-f06a1c191685 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:10.550369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-a6b4d15a-8c9d-4917-a71b-f06a1c191685 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid b57a38fc-e317-4555-bba4-f2cedd73562d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:10.564075 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a6b4d15a-8c9d-4917-a71b-f06a1c191685 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 2054 microversion: 2.25 time: 0.167203 Aug 27 04:53:10.564907 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 217/449] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:10 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 2054 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:10.631780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-56e03932-e07e-44f6-84e7-ffdd893c988a tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:10.634150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-56e03932-e07e-44f6-84e7-ffdd893c988a tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:10.650099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56e03932-e07e-44f6-84e7-ffdd893c988a tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:10.650601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56e03932-e07e-44f6-84e7-ffdd893c988a tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:10.651048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56e03932-e07e-44f6-84e7-ffdd893c988a tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:10.651789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56e03932-e07e-44f6-84e7-ffdd893c988a tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:10.656140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56e03932-e07e-44f6-84e7-ffdd893c988a tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:10.657413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56e03932-e07e-44f6-84e7-ffdd893c988a tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:10.688122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb690d19-98a3-439e-926c-bd2173398ee7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:10.688742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bb690d19-98a3-439e-926c-bd2173398ee7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:10.699184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb690d19-98a3-439e-926c-bd2173398ee7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:10.700631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb690d19-98a3-439e-926c-bd2173398ee7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:10.701319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb690d19-98a3-439e-926c-bd2173398ee7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:10.702553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb690d19-98a3-439e-926c-bd2173398ee7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:10.703261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb690d19-98a3-439e-926c-bd2173398ee7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:10.703913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb690d19-98a3-439e-926c-bd2173398ee7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:10.932866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-56e03932-e07e-44f6-84e7-ffdd893c988a tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:10.957796 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-56e03932-e07e-44f6-84e7-ffdd893c988a tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.335752 Aug 27 04:53:10.959197 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 233/450] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:10 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:10.985798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1238895085", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "051dccae-a303-46a8-a77e-49031a700014"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:11.064567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] validate_networks() for [('051dccae-a303-46a8-a77e-49031a700014', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:53:11.292538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb690d19-98a3-439e-926c-bd2173398ee7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:11.302490 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb690d19-98a3-439e-926c-bd2173398ee7 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1323 microversion: 2.1 time: 0.618931 Aug 27 04:53:11.316028 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 218/451] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:10 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1323 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:11.323479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d7d354e1-d6a6-4535-ab6e-d2b7a986f539 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:11.326187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d7d354e1-d6a6-4535-ab6e-d2b7a986f539 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:11.334566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7d354e1-d6a6-4535-ab6e-d2b7a986f539 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:11.336261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7d354e1-d6a6-4535-ab6e-d2b7a986f539 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:11.336942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7d354e1-d6a6-4535-ab6e-d2b7a986f539 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:11.338070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7d354e1-d6a6-4535-ab6e-d2b7a986f539 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:11.338785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7d354e1-d6a6-4535-ab6e-d2b7a986f539 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:11.339502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7d354e1-d6a6-4535-ab6e-d2b7a986f539 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.063787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d7d354e1-d6a6-4535-ab6e-d2b7a986f539 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:12.074082 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d7d354e1-d6a6-4535-ab6e-d2b7a986f539 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1319 microversion: 2.1 time: 0.755803 Aug 27 04:53:12.079244 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 219/452] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:11 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1319 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:12.089834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8ba79b17-ac41-4c3e-89a2-6c11cf65db29 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:12.090556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8ba79b17-ac41-4c3e-89a2-6c11cf65db29 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:12.098723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ba79b17-ac41-4c3e-89a2-6c11cf65db29 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.100554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ba79b17-ac41-4c3e-89a2-6c11cf65db29 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.101946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ba79b17-ac41-4c3e-89a2-6c11cf65db29 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.104070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ba79b17-ac41-4c3e-89a2-6c11cf65db29 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.104714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ba79b17-ac41-4c3e-89a2-6c11cf65db29 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.105292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ba79b17-ac41-4c3e-89a2-6c11cf65db29 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.133377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:12.310957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:12.538734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8ba79b17-ac41-4c3e-89a2-6c11cf65db29 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:12.551632 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8ba79b17-ac41-4c3e-89a2-6c11cf65db29 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1320 microversion: 2.1 time: 0.466420 Aug 27 04:53:12.572857 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 220/453] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:12 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1320 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:12.601035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:12.604158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:12.617643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.618797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.621652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.624799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.625663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.631408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.714818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:53:12.715707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:53:12.716342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:53:12.717031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:53:12.718232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:53:12.723820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.724342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.726790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.727516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lazy-loading 'fault' on Instance uuid bba13511-9622-4b36-84cc-de60709bc808 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:12.744431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.746649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.747774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.748584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.749057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.749484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.787662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Getting quotas for project f5c7422cdaca490aaffc4004f77d830c. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:12.796205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Getting quotas for user b7d4fe4aaf864bb58c162620c9948d89 and project f5c7422cdaca490aaffc4004f77d830c. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:12.814359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:53:12.818689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:53:12.895652 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3504e131-9e4e-42d2-a651-994998b3bfa7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.935034 Aug 27 04:53:12.896452 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 234/454] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 04:53:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:53:12.912291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db11a523d564978a1225898267909d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009e731b78d429f9a702e5638135166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:12.917957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0389278e-e1fe-4900-8992-ec195e4a70e8 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:12.919765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0389278e-e1fe-4900-8992-ec195e4a70e8 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:12.930687 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0ecc6622-4336-4c79-ba83-7c03e863e84b tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 200 len: 1304 microversion: 2.1 time: 0.353364 Aug 27 04:53:12.933241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0389278e-e1fe-4900-8992-ec195e4a70e8 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.933817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0389278e-e1fe-4900-8992-ec195e4a70e8 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.934462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0389278e-e1fe-4900-8992-ec195e4a70e8 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.935549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0389278e-e1fe-4900-8992-ec195e4a70e8 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.937560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0389278e-e1fe-4900-8992-ec195e4a70e8 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.939313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0389278e-e1fe-4900-8992-ec195e4a70e8 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.958559 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 221/455] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:12 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 1304 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:12.967696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-71f98b8b-507b-425e-9b33-9d9e47ae34a0 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:12.969041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-71f98b8b-507b-425e-9b33-9d9e47ae34a0 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:12.978172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f98b8b-507b-425e-9b33-9d9e47ae34a0 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.980777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f98b8b-507b-425e-9b33-9d9e47ae34a0 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.981457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f98b8b-507b-425e-9b33-9d9e47ae34a0 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.984294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f98b8b-507b-425e-9b33-9d9e47ae34a0 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.984996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f98b8b-507b-425e-9b33-9d9e47ae34a0 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.986299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f98b8b-507b-425e-9b33-9d9e47ae34a0 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:13.282336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-0389278e-e1fe-4900-8992-ec195e4a70e8 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:13.318036 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0389278e-e1fe-4900-8992-ec195e4a70e8 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.420280 Aug 27 04:53:13.340085 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 235/456] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:12 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:13.354860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-e32a5a41-a094-4d5f-b8b2-06451d88907a req-62cb4b95-81a7-4437-b21b-be896ce253d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba13511-9622-4b36-84cc-de60709bc808", "name": "network-vif-deleted", "tag": "89aa4311-8b23-488b-93c4-03f74c9c1d6f"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:13.369486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e32a5a41-a094-4d5f-b8b2-06451d88907a req-62cb4b95-81a7-4437-b21b-be896ce253d6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:13.370087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e32a5a41-a094-4d5f-b8b2-06451d88907a req-62cb4b95-81a7-4437-b21b-be896ce253d6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:13.370527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e32a5a41-a094-4d5f-b8b2-06451d88907a req-62cb4b95-81a7-4437-b21b-be896ce253d6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:13.396991 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-e32a5a41-a094-4d5f-b8b2-06451d88907a req-62cb4b95-81a7-4437-b21b-be896ce253d6 service nova] Creating event network-vif-deleted:89aa4311-8b23-488b-93c4-03f74c9c1d6f for instance bba13511-9622-4b36-84cc-de60709bc808 on n-h2-820368-35 Aug 27 04:53:13.414061 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-e32a5a41-a094-4d5f-b8b2-06451d88907a req-62cb4b95-81a7-4437-b21b-be896ce253d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072717 Aug 27 04:53:13.415198 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 236/457] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:13.422337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb4ac76d-0799-4619-a3dc-f91725f69621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:13.423331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cb4ac76d-0799-4619-a3dc-f91725f69621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:13.525428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb4ac76d-0799-4619-a3dc-f91725f69621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:13.533661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb4ac76d-0799-4619-a3dc-f91725f69621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:13.535138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb4ac76d-0799-4619-a3dc-f91725f69621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:13.536277 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb4ac76d-0799-4619-a3dc-f91725f69621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1262 microversion: 2.25 time: 0.119863 Aug 27 04:53:13.563479 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 237/458] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:13 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1262 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:13.569074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-56b75e1f-61dd-4050-821b-71f2162b4153 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:13.570045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-56b75e1f-61dd-4050-821b-71f2162b4153 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:13.585187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56b75e1f-61dd-4050-821b-71f2162b4153 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:13.585695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56b75e1f-61dd-4050-821b-71f2162b4153 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:13.586136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56b75e1f-61dd-4050-821b-71f2162b4153 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:13.586860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56b75e1f-61dd-4050-821b-71f2162b4153 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:13.587376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56b75e1f-61dd-4050-821b-71f2162b4153 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:13.591277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56b75e1f-61dd-4050-821b-71f2162b4153 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:13.692193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71f98b8b-507b-425e-9b33-9d9e47ae34a0 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:13.710264 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-71f98b8b-507b-425e-9b33-9d9e47ae34a0 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 200 len: 1519 microversion: 2.1 time: 0.748560 Aug 27 04:53:13.712099 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 222/459] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:12 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 1519 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:13.718646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-86c0a773-e170-4885-955b-89e1ef1e44ee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:13.719694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-86c0a773-e170-4885-955b-89e1ef1e44ee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:13.732563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86c0a773-e170-4885-955b-89e1ef1e44ee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:13.735205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86c0a773-e170-4885-955b-89e1ef1e44ee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:13.735347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86c0a773-e170-4885-955b-89e1ef1e44ee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:13.735973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86c0a773-e170-4885-955b-89e1ef1e44ee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:13.736425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86c0a773-e170-4885-955b-89e1ef1e44ee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:13.736879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86c0a773-e170-4885-955b-89e1ef1e44ee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:13.972204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-56b75e1f-61dd-4050-821b-71f2162b4153 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:13.986426 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-56b75e1f-61dd-4050-821b-71f2162b4153 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1319 microversion: 2.1 time: 0.419629 Aug 27 04:53:14.002280 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 238/460] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:13 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:14.008373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Action: 'action', calling method: .version_select at 0x7fb5672bf8b0>, body: {"addFloatingIp": {"address": "172.25.9.205"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:14.017273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:14.028018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:14.029062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:14.029709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:14.030679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:14.035784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:14.036450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:14.132403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "refresh_cache-3cb98f2a-181a-4dd0-b454-8adec268f65f" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:53:14.133101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquired lock "refresh_cache-3cb98f2a-181a-4dd0-b454-8adec268f65f" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:53:14.181841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86c0a773-e170-4885-955b-89e1ef1e44ee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:14.191052 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-86c0a773-e170-4885-955b-89e1ef1e44ee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1320 microversion: 2.1 time: 0.477584 Aug 27 04:53:14.192263 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 223/461] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:13 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1320 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:14.197752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-95fdd803-6b49-490d-a51b-1950e5a8a29a req-e91b0107-24e9-46ad-ba7b-593fab36dc0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0109b00-ad83-4acd-9862-a64c21cd8516", "tag": "c5cad2de-145b-4862-b2c8-caafb3f0baa8"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:14.214841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-95fdd803-6b49-490d-a51b-1950e5a8a29a req-e91b0107-24e9-46ad-ba7b-593fab36dc0a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:14.215602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-95fdd803-6b49-490d-a51b-1950e5a8a29a req-e91b0107-24e9-46ad-ba7b-593fab36dc0a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:14.216201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-95fdd803-6b49-490d-a51b-1950e5a8a29a req-e91b0107-24e9-46ad-ba7b-593fab36dc0a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:14.246412 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-95fdd803-6b49-490d-a51b-1950e5a8a29a req-e91b0107-24e9-46ad-ba7b-593fab36dc0a service nova] Creating event network-changed:c5cad2de-145b-4862-b2c8-caafb3f0baa8 for instance c0109b00-ad83-4acd-9862-a64c21cd8516 on n-h2-820368-35 Aug 27 04:53:14.252612 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-95fdd803-6b49-490d-a51b-1950e5a8a29a req-e91b0107-24e9-46ad-ba7b-593fab36dc0a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058100 Aug 27 04:53:14.254603 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 224/462] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:14.260745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:14.262516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] [instance: bba13511-9622-4b36-84cc-de60709bc808] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:14.269076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:14.269561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:14.271014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:14.271763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:14.272219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:14.272810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:14.288590 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] HTTP exception thrown: Instance bba13511-9622-4b36-84cc-de60709bc808 could not be found. Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Request method failure captured: Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 HTTP/1.1 Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMbf93O_Ac0yMDITpstoqefMbQyoLA7QuoDc7JbuB8TKDUqCa_iLehEkJpw6QcK5bq60k8NAJsssYuAEKbqt_MXwbAmG6sK_a7WS19quWyEO-2hZ_i0rfN866Xd7TCSSNKAmNz-WN5nDVJXqJ1DieGa04du16jAZokEVWF-RVjSTpE Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 2009e731b78d429f9a702e5638135166 Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TenantUsagesTestJSON-1604988118 Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:53:14.291383 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2009e731b78d429f9a702e5638135166", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2009e731b78d429f9a702e5638135166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2009e731b78d429f9a702e5638135166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2009e731b78d429f9a702e5638135166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TenantUsagesTestJSON-1604988118 Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 2009e731b78d429f9a702e5638135166 Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1604988118 Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TenantUsagesTestJSON-1604988118-project Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 1db11a523d564978a1225898267909d8 Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TenantUsagesTestJSON-1604988118-project Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance bba13511-9622-4b36-84cc-de60709bc808 could not be found. Aug 27 04:53:14.292737 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'bba13511-9622-4b36-84cc-de60709bc808'} Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba13511-9622-4b36-84cc-de60709bc808 could not be found. Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:14.293651 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba13511-9622-4b36-84cc-de60709bc808 could not be found. Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba13511-9622-4b36-84cc-de60709bc808 could not be found. Aug 27 04:53:14.295075 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:14.299849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] Returning 404 to user: Instance bba13511-9622-4b36-84cc-de60709bc808 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:14.301099 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e0ebd52f-cf2a-4710-8875-54afe10fdb4f tempest-TenantUsagesTestJSON-1604988118 tempest-TenantUsagesTestJSON-1604988118-project] 10.222.0.58 "GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808" status: 404 len: 111 microversion: 2.1 time: 0.045043 Aug 27 04:53:14.302195 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 225/463] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:14 2022] GET /compute/v2.1/servers/bba13511-9622-4b36-84cc-de60709bc808 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:14.348379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4933194e-db0c-458e-9c0b-c0c35cb75954 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:14.349126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4933194e-db0c-458e-9c0b-c0c35cb75954 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:14.356146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4933194e-db0c-458e-9c0b-c0c35cb75954 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:14.357204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4933194e-db0c-458e-9c0b-c0c35cb75954 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:14.357922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4933194e-db0c-458e-9c0b-c0c35cb75954 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:14.359532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4933194e-db0c-458e-9c0b-c0c35cb75954 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:14.360365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4933194e-db0c-458e-9c0b-c0c35cb75954 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:14.361027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4933194e-db0c-458e-9c0b-c0c35cb75954 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:14.542400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-4933194e-db0c-458e-9c0b-c0c35cb75954 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:14.584425 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4933194e-db0c-458e-9c0b-c0c35cb75954 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.240020 Aug 27 04:53:14.588189 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 226/464] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:14 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:53:14.598743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:14.599888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:14.608160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:14.608986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:14.609435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:14.610312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:14.610799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:14.611272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:14.869349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:14.890836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:14.899380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:14.903266 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1dba355c-3141-4bc0-bbbf-082a80a0e85b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1314 microversion: 2.25 time: 0.312308 Aug 27 04:53:14.907790 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 227/465] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:14 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:15.009871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec74827e-cbe6-4089-8d9b-3a3d68c84cea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:15.010494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec74827e-cbe6-4089-8d9b-3a3d68c84cea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:15.018267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec74827e-cbe6-4089-8d9b-3a3d68c84cea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:15.018771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec74827e-cbe6-4089-8d9b-3a3d68c84cea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:15.019249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec74827e-cbe6-4089-8d9b-3a3d68c84cea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:15.019985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec74827e-cbe6-4089-8d9b-3a3d68c84cea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:15.020441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec74827e-cbe6-4089-8d9b-3a3d68c84cea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:15.034736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec74827e-cbe6-4089-8d9b-3a3d68c84cea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:15.675454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=30 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:15.791057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ec74827e-cbe6-4089-8d9b-3a3d68c84cea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:15.807547 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec74827e-cbe6-4089-8d9b-3a3d68c84cea tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1319 microversion: 2.1 time: 0.801186 Aug 27 04:53:15.811704 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 228/466] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:15 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1319 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:15.820498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-73045694-2363-4aa9-a62b-e5d95ae825fa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:15.821439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-73045694-2363-4aa9-a62b-e5d95ae825fa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:15.834478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73045694-2363-4aa9-a62b-e5d95ae825fa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:15.835228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73045694-2363-4aa9-a62b-e5d95ae825fa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:15.835910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73045694-2363-4aa9-a62b-e5d95ae825fa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:15.837523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73045694-2363-4aa9-a62b-e5d95ae825fa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:15.838328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73045694-2363-4aa9-a62b-e5d95ae825fa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:15.838918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73045694-2363-4aa9-a62b-e5d95ae825fa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.100417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-73045694-2363-4aa9-a62b-e5d95ae825fa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:16.115214 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-73045694-2363-4aa9-a62b-e5d95ae825fa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1320 microversion: 2.1 time: 0.300931 Aug 27 04:53:16.116149 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 229/467] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:15 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1320 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:16.121866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-33fb1463-a5e5-4b8c-861f-863ae1926f76 req-e5e1d878-1e8e-43bf-9670-c60580a66180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ffdf84a-8782-47da-94fc-2fd50baa7121", "tag": "645e142f-1fd0-4053-b3f9-9eb22ea2f13c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:16.142632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-33fb1463-a5e5-4b8c-861f-863ae1926f76 req-e5e1d878-1e8e-43bf-9670-c60580a66180 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.143133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-33fb1463-a5e5-4b8c-861f-863ae1926f76 req-e5e1d878-1e8e-43bf-9670-c60580a66180 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.143563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-33fb1463-a5e5-4b8c-861f-863ae1926f76 req-e5e1d878-1e8e-43bf-9670-c60580a66180 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.158407 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-33fb1463-a5e5-4b8c-861f-863ae1926f76 req-e5e1d878-1e8e-43bf-9670-c60580a66180 service nova] Creating event network-changed:645e142f-1fd0-4053-b3f9-9eb22ea2f13c for instance 6ffdf84a-8782-47da-94fc-2fd50baa7121 on n-h1-820368-35 Aug 27 04:53:16.166412 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-33fb1463-a5e5-4b8c-861f-863ae1926f76 req-e5e1d878-1e8e-43bf-9670-c60580a66180 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048542 Aug 27 04:53:16.167186 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 230/468] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:16.173076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0d3c657d-3ad6-4df0-93f8-d5eca29976cc tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:16.173775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0d3c657d-3ad6-4df0-93f8-d5eca29976cc tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:16.179940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d3c657d-3ad6-4df0-93f8-d5eca29976cc tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.180430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d3c657d-3ad6-4df0-93f8-d5eca29976cc tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.180865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d3c657d-3ad6-4df0-93f8-d5eca29976cc tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.181730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d3c657d-3ad6-4df0-93f8-d5eca29976cc tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.182361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d3c657d-3ad6-4df0-93f8-d5eca29976cc tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.182794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d3c657d-3ad6-4df0-93f8-d5eca29976cc tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.330037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-0d3c657d-3ad6-4df0-93f8-d5eca29976cc tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:16.356237 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0d3c657d-3ad6-4df0-93f8-d5eca29976cc tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.187630 Aug 27 04:53:16.371354 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 231/469] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:16 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:16.371354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:16.371354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:16.371354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.371743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.371743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.372922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.373541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.374236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.590797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Building network info cache for instance {{(pid=128548) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:53:16.656772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:16.669525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:16.673131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:16.677027 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-84359bba-269b-45c1-84e1-8f0c8752c767 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1362 microversion: 2.25 time: 0.317401 Aug 27 04:53:16.678600 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 232/470] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:16 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:16.689769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9e4c5fa3-a196-49c7-8d5d-256a9072be3b req-ade4a518-6c6f-4b06-afc7-66b23418385d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a534099b-1082-4506-97ae-da1e66618172", "tag": "2d29ce65-e94c-40f4-8546-0a5a9a18a415"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:16.728036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9e4c5fa3-a196-49c7-8d5d-256a9072be3b req-ade4a518-6c6f-4b06-afc7-66b23418385d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.728734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9e4c5fa3-a196-49c7-8d5d-256a9072be3b req-ade4a518-6c6f-4b06-afc7-66b23418385d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.729497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9e4c5fa3-a196-49c7-8d5d-256a9072be3b req-ade4a518-6c6f-4b06-afc7-66b23418385d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.753556 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9e4c5fa3-a196-49c7-8d5d-256a9072be3b req-ade4a518-6c6f-4b06-afc7-66b23418385d service nova] Creating event network-changed:2d29ce65-e94c-40f4-8546-0a5a9a18a415 for instance a534099b-1082-4506-97ae-da1e66618172 on n-h1-820368-35 Aug 27 04:53:16.763229 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9e4c5fa3-a196-49c7-8d5d-256a9072be3b req-ade4a518-6c6f-4b06-afc7-66b23418385d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082500 Aug 27 04:53:16.765669 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 233/471] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:16.840183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a1439bfb-2732-4b09-a9fb-5d04a7177ce1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:16.841233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a1439bfb-2732-4b09-a9fb-5d04a7177ce1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:16.855564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1439bfb-2732-4b09-a9fb-5d04a7177ce1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.858429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1439bfb-2732-4b09-a9fb-5d04a7177ce1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.860486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1439bfb-2732-4b09-a9fb-5d04a7177ce1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.862925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1439bfb-2732-4b09-a9fb-5d04a7177ce1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.866784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1439bfb-2732-4b09-a9fb-5d04a7177ce1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.868098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1439bfb-2732-4b09-a9fb-5d04a7177ce1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:17.241341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a1439bfb-2732-4b09-a9fb-5d04a7177ce1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:17.266165 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a1439bfb-2732-4b09-a9fb-5d04a7177ce1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1319 microversion: 2.1 time: 0.433774 Aug 27 04:53:17.268254 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 234/472] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:16 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:17.281577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b23ded89-be07-47fc-9511-68dd72787bf9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:17.284538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b23ded89-be07-47fc-9511-68dd72787bf9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:17.297719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23ded89-be07-47fc-9511-68dd72787bf9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:17.298455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23ded89-be07-47fc-9511-68dd72787bf9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:17.301362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23ded89-be07-47fc-9511-68dd72787bf9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:17.302113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23ded89-be07-47fc-9511-68dd72787bf9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:17.302750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23ded89-be07-47fc-9511-68dd72787bf9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:17.303241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23ded89-be07-47fc-9511-68dd72787bf9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:17.593274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b23ded89-be07-47fc-9511-68dd72787bf9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:17.608554 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b23ded89-be07-47fc-9511-68dd72787bf9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1320 microversion: 2.1 time: 0.338511 Aug 27 04:53:17.609524 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 235/473] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:17 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:17.627699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5aa5656b-1512-4425-9f8c-09522856b708 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:17.628836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5aa5656b-1512-4425-9f8c-09522856b708 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:17.635186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa5656b-1512-4425-9f8c-09522856b708 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:17.635914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa5656b-1512-4425-9f8c-09522856b708 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:17.636510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa5656b-1512-4425-9f8c-09522856b708 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:17.637383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa5656b-1512-4425-9f8c-09522856b708 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:17.638006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa5656b-1512-4425-9f8c-09522856b708 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:17.638572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa5656b-1512-4425-9f8c-09522856b708 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:17.758688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Updating instance_info_cache with network_info: [{"id": "d2ef900d-23fd-47bd-9461-d82bd76c45a0", "address": "fa:16:3e:ba:3f:20", "network": {"id": "71a3611e-27fd-46d0-9b26-df83ee6c57af", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-315764033-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0088fd72e34f43fa97050fd334f61ea6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2ef900d-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128548) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:53:17.771369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-5aa5656b-1512-4425-9f8c-09522856b708 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:17.790317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Releasing lock "refresh_cache-3cb98f2a-181a-4dd0-b454-8adec268f65f" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:53:17.793751 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-158278df-e36c-4d49-a37f-778d5ea71609 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "POST /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f/action" status: 202 len: 0 microversion: 2.1 time: 3.789984 Aug 27 04:53:17.795234 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 239/474] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:14 2022] POST /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f/action => generated 0 bytes in 3792 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:53:17.800683 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5aa5656b-1512-4425-9f8c-09522856b708 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.177035 Aug 27 04:53:17.802746 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 236/475] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:17 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:17.808129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:17.808935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:17.811365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Action: 'action', calling method: .version_select at 0x7fb5672c18b0>, body: {"addFloatingIp": {"address": "172.25.9.205"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:17.814735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:17.816531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:17.817250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:17.817837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:17.818704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:17.819376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:17.819949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:17.823390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:17.824599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:17.825249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:17.825556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:17.827194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:17.828125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:17.829540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:17.913864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "refresh_cache-503ce154-c117-40cb-bde8-137c354ee752" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:53:17.914523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquired lock "refresh_cache-503ce154-c117-40cb-bde8-137c354ee752" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:53:18.241628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:18.255370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:18.257322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:18.260484 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7caeb0d1-13ed-4f28-a424-e250d9567017 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1362 microversion: 2.25 time: 0.463290 Aug 27 04:53:18.264077 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 240/476] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:17 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1362 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:18.288467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3fda67e-f53d-450f-b6ea-26c28880c292 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:18.289561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a3fda67e-f53d-450f-b6ea-26c28880c292 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:18.299579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fda67e-f53d-450f-b6ea-26c28880c292 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:18.301170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fda67e-f53d-450f-b6ea-26c28880c292 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:18.302618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fda67e-f53d-450f-b6ea-26c28880c292 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:18.305159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fda67e-f53d-450f-b6ea-26c28880c292 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:18.305855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fda67e-f53d-450f-b6ea-26c28880c292 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:18.306865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fda67e-f53d-450f-b6ea-26c28880c292 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:18.909923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a3fda67e-f53d-450f-b6ea-26c28880c292 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:18.921739 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a3fda67e-f53d-450f-b6ea-26c28880c292 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1319 microversion: 2.1 time: 0.636732 Aug 27 04:53:18.923452 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 241/477] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:18 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1319 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:18.933371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d77e9cf5-11f1-4bda-855d-d8524788fe2a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:18.934598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d77e9cf5-11f1-4bda-855d-d8524788fe2a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:18.946193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d77e9cf5-11f1-4bda-855d-d8524788fe2a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:18.948033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d77e9cf5-11f1-4bda-855d-d8524788fe2a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:18.949085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d77e9cf5-11f1-4bda-855d-d8524788fe2a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:18.950366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d77e9cf5-11f1-4bda-855d-d8524788fe2a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:18.951125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d77e9cf5-11f1-4bda-855d-d8524788fe2a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:18.952671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d77e9cf5-11f1-4bda-855d-d8524788fe2a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:19.029541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:19.751073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d77e9cf5-11f1-4bda-855d-d8524788fe2a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:19.759818 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d77e9cf5-11f1-4bda-855d-d8524788fe2a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1320 microversion: 2.1 time: 0.834968 Aug 27 04:53:19.765348 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 242/478] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:18 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1320 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:19.771203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-76428bd0-dae0-46a3-8b7b-018f491ac9b1 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:19.771847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-76428bd0-dae0-46a3-8b7b-018f491ac9b1 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:19.794843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76428bd0-dae0-46a3-8b7b-018f491ac9b1 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:19.795420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76428bd0-dae0-46a3-8b7b-018f491ac9b1 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:19.796361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76428bd0-dae0-46a3-8b7b-018f491ac9b1 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:19.796935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76428bd0-dae0-46a3-8b7b-018f491ac9b1 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:19.797642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76428bd0-dae0-46a3-8b7b-018f491ac9b1 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:19.798222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76428bd0-dae0-46a3-8b7b-018f491ac9b1 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:19.953938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-76428bd0-dae0-46a3-8b7b-018f491ac9b1 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:19.973933 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-76428bd0-dae0-46a3-8b7b-018f491ac9b1 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.207116 Aug 27 04:53:19.974786 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 243/479] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:19 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:19.987424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d3d4dfa4-754e-45eb-ae35-930b24d21f98 req-d6b41b7a-da6c-43af-ac0b-6d503783b2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb98f2a-181a-4dd0-b454-8adec268f65f", "tag": "d2ef900d-23fd-47bd-9461-d82bd76c45a0"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:19.990912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d3d4dfa4-754e-45eb-ae35-930b24d21f98 req-d6b41b7a-da6c-43af-ac0b-6d503783b2b4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:19.991690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d3d4dfa4-754e-45eb-ae35-930b24d21f98 req-d6b41b7a-da6c-43af-ac0b-6d503783b2b4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:19.992273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d3d4dfa4-754e-45eb-ae35-930b24d21f98 req-d6b41b7a-da6c-43af-ac0b-6d503783b2b4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:20.004492 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d3d4dfa4-754e-45eb-ae35-930b24d21f98 req-d6b41b7a-da6c-43af-ac0b-6d503783b2b4 service nova] Creating event network-changed:d2ef900d-23fd-47bd-9461-d82bd76c45a0 for instance 3cb98f2a-181a-4dd0-b454-8adec268f65f on n-h1-820368-35 Aug 27 04:53:20.010809 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d3d4dfa4-754e-45eb-ae35-930b24d21f98 req-d6b41b7a-da6c-43af-ac0b-6d503783b2b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034481 Aug 27 04:53:20.011787 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 244/480] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:20.018189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:20.018986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:20.035395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:20.035924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:20.036376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:20.037129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:20.037576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:20.038008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:20.391570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:20.401845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:20.405823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:20.407197 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae21f743-7572-4ab8-9515-6afc10101dec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1362 microversion: 2.25 time: 0.394276 Aug 27 04:53:20.407759 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 245/481] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:20 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:20.412439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5aacbbbe-a651-484f-a97b-a9497308563d req-65174026-b2d3-4258-ae38-eee7ba6fb6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36549027-8a9f-4d92-8525-bdd6fa5ed50e", "tag": "6db9659b-7f15-473d-b767-a63311e81850"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:20.417393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:20.424708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5aacbbbe-a651-484f-a97b-a9497308563d req-65174026-b2d3-4258-ae38-eee7ba6fb6bc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:20.425190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5aacbbbe-a651-484f-a97b-a9497308563d req-65174026-b2d3-4258-ae38-eee7ba6fb6bc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:20.425623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5aacbbbe-a651-484f-a97b-a9497308563d req-65174026-b2d3-4258-ae38-eee7ba6fb6bc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:20.437490 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-5aacbbbe-a651-484f-a97b-a9497308563d req-65174026-b2d3-4258-ae38-eee7ba6fb6bc service nova] Creating event network-changed:6db9659b-7f15-473d-b767-a63311e81850 for instance 36549027-8a9f-4d92-8525-bdd6fa5ed50e on n-h2-820368-35 Aug 27 04:53:20.442600 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5aacbbbe-a651-484f-a97b-a9497308563d req-65174026-b2d3-4258-ae38-eee7ba6fb6bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033546 Aug 27 04:53:20.443520 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 246/482] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:20.448686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33ae6ea8-30ba-47a8-902d-0ffa9541f9da tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:20.449385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-33ae6ea8-30ba-47a8-902d-0ffa9541f9da tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:20.455547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ae6ea8-30ba-47a8-902d-0ffa9541f9da tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:20.456036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ae6ea8-30ba-47a8-902d-0ffa9541f9da tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:20.456478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ae6ea8-30ba-47a8-902d-0ffa9541f9da tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:20.457187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ae6ea8-30ba-47a8-902d-0ffa9541f9da tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:20.457748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ae6ea8-30ba-47a8-902d-0ffa9541f9da tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:20.458176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ae6ea8-30ba-47a8-902d-0ffa9541f9da tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:20.673385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-33ae6ea8-30ba-47a8-902d-0ffa9541f9da tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:20.682789 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-33ae6ea8-30ba-47a8-902d-0ffa9541f9da tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1319 microversion: 2.1 time: 0.238039 Aug 27 04:53:20.683618 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 247/483] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:20 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:20.880831 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-75f6f989-60e6-4ad8-aff7-eb096730e43e tempest-TenantUsagesNegativeTestJSON-1890796741 tempest-TenantUsagesNegativeTestJSON-1890796741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T04%3A53%3A20.315261&end=2022-08-28T04%3A53%3A20.315261" status: 404 len: 112 microversion: - time: 0.195961 Aug 27 04:53:20.881615 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 248/484] 10.222.0.58 () {58 vars in 1316 bytes} [Sat Aug 27 04:53:20 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T04%3A53%3A20.315261&end=2022-08-28T04%3A53%3A20.315261 => generated 112 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 04:53:20.955672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-27132081-6580-482b-b908-25af2f05dbe7 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Action: 'update', calling method: .version_select at 0x7fb5657e9430>, body: {"quota_set": {"ram": "5120"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:21.023979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27132081-6580-482b-b908-25af2f05dbe7 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:21.024456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27132081-6580-482b-b908-25af2f05dbe7 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:21.024883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27132081-6580-482b-b908-25af2f05dbe7 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:21.025623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27132081-6580-482b-b908-25af2f05dbe7 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:21.026103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27132081-6580-482b-b908-25af2f05dbe7 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:21.026523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27132081-6580-482b-b908-25af2f05dbe7 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:21.079717 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-27132081-6580-482b-b908-25af2f05dbe7 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/5c895e6c3c59420d8af2464b961a207e" status: 200 len: 148 microversion: 2.57 time: 0.191949 Aug 27 04:53:21.080646 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 249/485] 10.222.0.58 () {62 vars in 1303 bytes} [Sat Aug 27 04:53:20 2022] PUT /compute/v2.1/os-quota-sets/5c895e6c3c59420d8af2464b961a207e => generated 148 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:53:21.085562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-81d2adb2-e691-4c6f-93e9-183b5d333fa7 req-f0eaddf3-48b5-4a86-8992-bc397e89b3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffdf84a-8782-47da-94fc-2fd50baa7121", "name": "network-vif-plugged", "status": "completed", "tag": "645e142f-1fd0-4053-b3f9-9eb22ea2f13c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:21.095836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-81d2adb2-e691-4c6f-93e9-183b5d333fa7 req-f0eaddf3-48b5-4a86-8992-bc397e89b3ce service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:21.096307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-81d2adb2-e691-4c6f-93e9-183b5d333fa7 req-f0eaddf3-48b5-4a86-8992-bc397e89b3ce service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:21.096733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-81d2adb2-e691-4c6f-93e9-183b5d333fa7 req-f0eaddf3-48b5-4a86-8992-bc397e89b3ce service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:21.109410 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-81d2adb2-e691-4c6f-93e9-183b5d333fa7 req-f0eaddf3-48b5-4a86-8992-bc397e89b3ce service nova] Creating event network-vif-plugged:645e142f-1fd0-4053-b3f9-9eb22ea2f13c for instance 6ffdf84a-8782-47da-94fc-2fd50baa7121 on n-h1-820368-35 Aug 27 04:53:21.114933 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-81d2adb2-e691-4c6f-93e9-183b5d333fa7 req-f0eaddf3-48b5-4a86-8992-bc397e89b3ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032751 Aug 27 04:53:21.115754 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 250/486] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:21.120857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f231ed1a-f85a-47d9-a9bc-432d938e723b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:21.121553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f231ed1a-f85a-47d9-a9bc-432d938e723b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:21.128313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f231ed1a-f85a-47d9-a9bc-432d938e723b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:21.128795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f231ed1a-f85a-47d9-a9bc-432d938e723b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:21.129223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f231ed1a-f85a-47d9-a9bc-432d938e723b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:21.130034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f231ed1a-f85a-47d9-a9bc-432d938e723b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:21.130480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f231ed1a-f85a-47d9-a9bc-432d938e723b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:21.130902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f231ed1a-f85a-47d9-a9bc-432d938e723b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:21.332576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f231ed1a-f85a-47d9-a9bc-432d938e723b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:21.340948 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f231ed1a-f85a-47d9-a9bc-432d938e723b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1320 microversion: 2.1 time: 0.224121 Aug 27 04:53:21.342814 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 251/487] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:21 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:21.347387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3309c1e7-d7a8-4f41-8b93-29d8ef141d02 tempest-TenantUsagesNegativeTestJSON-1890796741 tempest-TenantUsagesNegativeTestJSON-1890796741-project-admin] Calling method '.version_select at 0x7fb5659368b0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:21.351927 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3309c1e7-d7a8-4f41-8b93-29d8ef141d02 tempest-TenantUsagesNegativeTestJSON-1890796741 tempest-TenantUsagesNegativeTestJSON-1890796741-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3309c1e7-d7a8-4f41-8b93-29d8ef141d02 tempest-TenantUsagesNegativeTestJSON-1890796741 tempest-TenantUsagesNegativeTestJSON-1890796741-project-admin] Request method failure captured: Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-simple-tenant-usage/93a87ff1686848e38d972a6c1e336b38?start=2022-08-28T04%3A53%3A20.315261&end=2022-08-26T04%3A53%3A20.315261 HTTP/1.1 Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaNAInLutlDEUwbcRl8z2JHqp3EmOOwDHAA0-BdRNQm5TkK1MhzhdiP_MpPW6Fco-LiBwq1GGHOOp3rengbWSae1SZoX5ZQ9W39hAAErlOY8z_Y1d_lBXfh9TpxnGgUIhWNvkz5idBvIOyuAMwmXDZ0AUbb6qwd0R-nd7vfOEmtYHFI Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 8d5661d1dd5248ed834ccb05b9122923 Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1890796741 Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:53:21.353928 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8d5661d1dd5248ed834ccb05b9122923", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8d5661d1dd5248ed834ccb05b9122923"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8d5661d1dd5248ed834ccb05b9122923"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8d5661d1dd5248ed834ccb05b9122923"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1890796741 Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 8d5661d1dd5248ed834ccb05b9122923 Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1890796741 Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TenantUsagesNegativeTestJSON-1890796741-project-admin Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: e138e7aaaeb444d697c0c1abd540770d Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1890796741-project-admin Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid start time. The start time cannot occur after the end time. Aug 27 04:53:21.355223 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '93a87ff1686848e38d972a6c1e336b38'} Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 04:53:21.355998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 27 04:53:21.357155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:21.357155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:21.357155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:21.357155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:21.357155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:21.357155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:21.357155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:21.357155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:21.357155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 27 04:53:21.357155 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:21.359066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3309c1e7-d7a8-4f41-8b93-29d8ef141d02 tempest-TenantUsagesNegativeTestJSON-1890796741 tempest-TenantUsagesNegativeTestJSON-1890796741-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:21.360053 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3309c1e7-d7a8-4f41-8b93-29d8ef141d02 tempest-TenantUsagesNegativeTestJSON-1890796741 tempest-TenantUsagesNegativeTestJSON-1890796741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/93a87ff1686848e38d972a6c1e336b38?start=2022-08-28T04%3A53%3A20.315261&end=2022-08-26T04%3A53%3A20.315261" status: 400 len: 111 microversion: 2.1 time: 0.016068 Aug 27 04:53:21.360711 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 252/488] 10.222.0.58 () {58 vars in 1412 bytes} [Sat Aug 27 04:53:21 2022] GET /compute/v2.1/os-simple-tenant-usage/93a87ff1686848e38d972a6c1e336b38?start=2022-08-28T04%3A53%3A20.315261&end=2022-08-26T04%3A53%3A20.315261 => generated 111 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:53:21.370203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-688a3d36-0651-4265-bba0-1cc8779ab986 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:21.370936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-688a3d36-0651-4265-bba0-1cc8779ab986 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:21.378202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-688a3d36-0651-4265-bba0-1cc8779ab986 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:21.378984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-688a3d36-0651-4265-bba0-1cc8779ab986 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:21.379751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-688a3d36-0651-4265-bba0-1cc8779ab986 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:21.380767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-688a3d36-0651-4265-bba0-1cc8779ab986 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:21.381440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-688a3d36-0651-4265-bba0-1cc8779ab986 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:21.382080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-688a3d36-0651-4265-bba0-1cc8779ab986 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:21.398784 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.network.neutron [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] re-assign floating IP 172.25.9.205 from instance 3cb98f2a-181a-4dd0-b454-8adec268f65f Aug 27 04:53:21.454797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Building network info cache for instance {{(pid=128547) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:53:21.459941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-688a3d36-0651-4265-bba0-1cc8779ab986 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:21.478594 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-688a3d36-0651-4265-bba0-1cc8779ab986 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.111923 Aug 27 04:53:21.479782 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 253/489] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:21 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:21.485041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-81459dd9-e841-4f53-83cd-457b2046e262 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Calling method '.version_select at 0x7fb5659368b0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:21.574358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81459dd9-e841-4f53-83cd-457b2046e262 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:21.575126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81459dd9-e841-4f53-83cd-457b2046e262 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:21.576429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81459dd9-e841-4f53-83cd-457b2046e262 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:21.577385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81459dd9-e841-4f53-83cd-457b2046e262 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:21.578009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81459dd9-e841-4f53-83cd-457b2046e262 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:21.584604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81459dd9-e841-4f53-83cd-457b2046e262 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:21.608631 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-81459dd9-e841-4f53-83cd-457b2046e262 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/5c895e6c3c59420d8af2464b961a207e/detail" status: 200 len: 463 microversion: 2.57 time: 0.127117 Aug 27 04:53:21.609498 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 254/490] 10.222.0.58 () {60 vars in 1304 bytes} [Sat Aug 27 04:53:21 2022] GET /compute/v2.1/os-quota-sets/5c895e6c3c59420d8af2464b961a207e/detail => generated 463 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:53:21.744531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0e2fbc9-6999-4695-ac55-c58cbfcdadc2 tempest-TenantUsagesNegativeTestJSON-896188996 tempest-TenantUsagesNegativeTestJSON-896188996-project] Calling method '.version_select at 0x7fb565a6ae50>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:21.749628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c0e2fbc9-6999-4695-ac55-c58cbfcdadc2 tempest-TenantUsagesNegativeTestJSON-896188996 tempest-TenantUsagesNegativeTestJSON-896188996-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '35753acbbb2542c39a8695cd2d3fafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a87ff1686848e38d972a6c1e336b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0e2fbc9-6999-4695-ac55-c58cbfcdadc2 tempest-TenantUsagesNegativeTestJSON-896188996 tempest-TenantUsagesNegativeTestJSON-896188996-project] Request method failure captured: Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T04%3A53%3A20.315261&end=2022-08-28T04%3A53%3A20.315261&detailed=1 HTTP/1.1 Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaM_9AUotHponObUo70w5BV54a8FUCEtQpmF-AFTn1rd95t_g_9iEZ_TRWTO8iaN9mefwrL65_IEZ8KvpGrv0NZZtV3QpMNhkHIGIDuNunFq5gVl3ZLiU2CR8Rkoj-RROc8IUqR6gdZeujhLbHu878-7i4mA9VE0k1W9zR-Ntpvt2x4 Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 93a87ff1686848e38d972a6c1e336b38 Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-896188996 Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:53:21.757533 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_93a87ff1686848e38d972a6c1e336b38", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/93a87ff1686848e38d972a6c1e336b38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93a87ff1686848e38d972a6c1e336b38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93a87ff1686848e38d972a6c1e336b38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-896188996 Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 93a87ff1686848e38d972a6c1e336b38 Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-896188996 Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TenantUsagesNegativeTestJSON-896188996-project Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 35753acbbb2542c39a8695cd2d3fafe7 Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-896188996-project Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: action_args: {} Aug 27 04:53:21.759025 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:53:21.760080 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:53:21.761490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:53:21.762833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 04:53:21.762833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:21.763996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0e2fbc9-6999-4695-ac55-c58cbfcdadc2 tempest-TenantUsagesNegativeTestJSON-896188996 tempest-TenantUsagesNegativeTestJSON-896188996-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:21.765142 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c0e2fbc9-6999-4695-ac55-c58cbfcdadc2 tempest-TenantUsagesNegativeTestJSON-896188996 tempest-TenantUsagesNegativeTestJSON-896188996-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T04%3A53%3A20.315261&end=2022-08-28T04%3A53%3A20.315261&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.154429 Aug 27 04:53:21.766238 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 255/491] 10.222.0.58 () {58 vars in 1335 bytes} [Sat Aug 27 04:53:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T04%3A53%3A20.315261&end=2022-08-28T04%3A53%3A20.315261&detailed=1 => generated 123 bytes in 156 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:21.787150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:21.788164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:21.805250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:21.806077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:21.806208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:21.806832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:21.807330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:21.807745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:22.363030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:22.375813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:22.380156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:22.381800 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e16f2a4b-e491-40af-a91e-d91d7587129c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1362 microversion: 2.25 time: 0.614360 Aug 27 04:53:22.383637 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 256/492] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:21 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1362 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:22.406139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d2a1be73-ae8d-44ee-8271-20d7fc6bd976 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:22.408274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d2a1be73-ae8d-44ee-8271-20d7fc6bd976 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:22.420153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a1be73-ae8d-44ee-8271-20d7fc6bd976 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:22.421022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a1be73-ae8d-44ee-8271-20d7fc6bd976 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:22.421137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Updating instance_info_cache with network_info: [{"id": "d2ef900d-23fd-47bd-9461-d82bd76c45a0", "address": "fa:16:3e:ba:3f:20", "network": {"id": "71a3611e-27fd-46d0-9b26-df83ee6c57af", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-315764033-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0088fd72e34f43fa97050fd334f61ea6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2ef900d-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:53:22.422234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a1be73-ae8d-44ee-8271-20d7fc6bd976 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:22.423318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a1be73-ae8d-44ee-8271-20d7fc6bd976 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:22.424183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a1be73-ae8d-44ee-8271-20d7fc6bd976 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:22.424828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a1be73-ae8d-44ee-8271-20d7fc6bd976 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:22.433168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:22.440689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Building network info cache for instance {{(pid=128547) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:53:22.650687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d2a1be73-ae8d-44ee-8271-20d7fc6bd976 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:22.666963 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d2a1be73-ae8d-44ee-8271-20d7fc6bd976 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1319 microversion: 2.1 time: 0.281782 Aug 27 04:53:22.680089 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 257/493] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:22 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:22.689314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Action: 'update', calling method: .version_select at 0x7fb5657d19d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:22.967381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:22.968161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:22.968781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:22.969741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:22.970206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:22.970640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.035929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.036801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.037442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.038457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.039193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.039811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.135012 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c3f96d0e-00e4-486e-ab18-7efba6a33b81 tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/5c895e6c3c59420d8af2464b961a207e?user_id=de73728acc564956bdafa11c7dc102c6" status: 200 len: 148 microversion: 2.57 time: 0.453535 Aug 27 04:53:23.139482 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 258/494] 10.222.0.58 () {62 vars in 1384 bytes} [Sat Aug 27 04:53:22 2022] PUT /compute/v2.1/os-quota-sets/5c895e6c3c59420d8af2464b961a207e?user_id=de73728acc564956bdafa11c7dc102c6 => generated 148 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:53:23.164762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f49982c6-8d1f-49fb-8714-c022d7df5e47 req-d916d827-32c2-4f33-8ea0-c1b9c55d0f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb98f2a-181a-4dd0-b454-8adec268f65f", "tag": "d2ef900d-23fd-47bd-9461-d82bd76c45a0"}, {"name": "network-changed", "server_uuid": "503ce154-c117-40cb-bde8-137c354ee752", "tag": "407dd1cf-2e5c-4663-beb4-7811e097981f"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:23.187277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f49982c6-8d1f-49fb-8714-c022d7df5e47 req-d916d827-32c2-4f33-8ea0-c1b9c55d0f8f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.189279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f49982c6-8d1f-49fb-8714-c022d7df5e47 req-d916d827-32c2-4f33-8ea0-c1b9c55d0f8f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.190376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f49982c6-8d1f-49fb-8714-c022d7df5e47 req-d916d827-32c2-4f33-8ea0-c1b9c55d0f8f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.210107 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f49982c6-8d1f-49fb-8714-c022d7df5e47 req-d916d827-32c2-4f33-8ea0-c1b9c55d0f8f service nova] Creating event network-changed:d2ef900d-23fd-47bd-9461-d82bd76c45a0 for instance 3cb98f2a-181a-4dd0-b454-8adec268f65f on n-h1-820368-35 Aug 27 04:53:23.210871 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f49982c6-8d1f-49fb-8714-c022d7df5e47 req-d916d827-32c2-4f33-8ea0-c1b9c55d0f8f service nova] Creating event network-changed:407dd1cf-2e5c-4663-beb4-7811e097981f for instance 503ce154-c117-40cb-bde8-137c354ee752 on n-h1-820368-35 Aug 27 04:53:23.220425 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f49982c6-8d1f-49fb-8714-c022d7df5e47 req-d916d827-32c2-4f33-8ea0-c1b9c55d0f8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.078827 Aug 27 04:53:23.221543 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 259/495] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:23.230139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ac3549b3-1933-4218-836d-b69495719ffa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:23.231016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ac3549b3-1933-4218-836d-b69495719ffa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:23.237699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac3549b3-1933-4218-836d-b69495719ffa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.238935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac3549b3-1933-4218-836d-b69495719ffa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.239682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac3549b3-1933-4218-836d-b69495719ffa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.240362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac3549b3-1933-4218-836d-b69495719ffa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.240888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac3549b3-1933-4218-836d-b69495719ffa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.241488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac3549b3-1933-4218-836d-b69495719ffa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.283038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Updating instance_info_cache with network_info: [{"id": "407dd1cf-2e5c-4663-beb4-7811e097981f", "address": "fa:16:3e:ac:67:52", "network": {"id": "71a3611e-27fd-46d0-9b26-df83ee6c57af", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-315764033-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0088fd72e34f43fa97050fd334f61ea6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap407dd1cf-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:53:23.298558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Releasing lock "refresh_cache-503ce154-c117-40cb-bde8-137c354ee752" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:53:23.299636 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7f76494d-ed0e-4e50-8bd7-c87b5bb90d2e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "POST /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752/action" status: 202 len: 0 microversion: 2.1 time: 5.495492 Aug 27 04:53:23.300719 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 237/496] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:17 2022] POST /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752/action => generated 0 bytes in 5497 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:53:23.310082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-12c4e3ea-8ed6-4a55-b513-fa5538f7af75 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:23.311415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-12c4e3ea-8ed6-4a55-b513-fa5538f7af75 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:23.319687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12c4e3ea-8ed6-4a55-b513-fa5538f7af75 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.320481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12c4e3ea-8ed6-4a55-b513-fa5538f7af75 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.320943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12c4e3ea-8ed6-4a55-b513-fa5538f7af75 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.321858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12c4e3ea-8ed6-4a55-b513-fa5538f7af75 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.322313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12c4e3ea-8ed6-4a55-b513-fa5538f7af75 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.322740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12c4e3ea-8ed6-4a55-b513-fa5538f7af75 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.492364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-12c4e3ea-8ed6-4a55-b513-fa5538f7af75 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:23.546902 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-12c4e3ea-8ed6-4a55-b513-fa5538f7af75 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.244449 Aug 27 04:53:23.548403 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 238/497] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:23 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:23.564302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-37a22f45-8c49-4d14-8d58-97e84dbcce1d tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] Calling method '.version_select at 0x7fb5658218b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:23.611767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ac3549b3-1933-4218-836d-b69495719ffa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:23.621829 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ac3549b3-1933-4218-836d-b69495719ffa tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1320 microversion: 2.1 time: 0.398862 Aug 27 04:53:23.622449 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 260/498] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:23 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:23.634082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Action: 'action', calling method: .version_select at 0x7fb567204ee0>, body: {"removeFloatingIp": {"address": "172.25.9.205"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:23.763276 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-37a22f45-8c49-4d14-8d58-97e84dbcce1d tempest-QuotasAdminTestV257-10919604 tempest-QuotasAdminTestV257-10919604-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/5c895e6c3c59420d8af2464b961a207e?user_id=de73728acc564956bdafa11c7dc102c6" status: 200 len: 190 microversion: 2.57 time: 0.212480 Aug 27 04:53:23.764154 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 239/499] 10.222.0.58 () {60 vars in 1364 bytes} [Sat Aug 27 04:53:23 2022] GET /compute/v2.1/os-quota-sets/5c895e6c3c59420d8af2464b961a207e?user_id=de73728acc564956bdafa11c7dc102c6 => generated 190 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:53:23.780053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:23.780929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:23.789003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.789735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.790369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.791481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.792074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.792640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.918005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:23.924194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.924686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.925124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.925932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.927217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.927735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:24.077445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:24.088543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:24.090796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:24.092251 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c8203af5-8cb9-4812-b80f-2892bbff1b02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1362 microversion: 2.25 time: 0.326968 Aug 27 04:53:24.108483 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 240/500] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:23 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:24.113784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-08d07af0-2eb6-44d5-8c42-46d3eefb7ed5 req-856c2061-d984-42cb-a366-7e9956c1536f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0109b00-ad83-4acd-9862-a64c21cd8516", "name": "network-vif-plugged", "status": "completed", "tag": "c5cad2de-145b-4862-b2c8-caafb3f0baa8"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:24.120915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:24.128148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-08d07af0-2eb6-44d5-8c42-46d3eefb7ed5 req-856c2061-d984-42cb-a366-7e9956c1536f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:24.129493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-08d07af0-2eb6-44d5-8c42-46d3eefb7ed5 req-856c2061-d984-42cb-a366-7e9956c1536f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:24.130302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-08d07af0-2eb6-44d5-8c42-46d3eefb7ed5 req-856c2061-d984-42cb-a366-7e9956c1536f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:24.143392 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-08d07af0-2eb6-44d5-8c42-46d3eefb7ed5 req-856c2061-d984-42cb-a366-7e9956c1536f service nova] Creating event network-vif-plugged:c5cad2de-145b-4862-b2c8-caafb3f0baa8 for instance c0109b00-ad83-4acd-9862-a64c21cd8516 on n-h2-820368-35 Aug 27 04:53:24.151027 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-08d07af0-2eb6-44d5-8c42-46d3eefb7ed5 req-856c2061-d984-42cb-a366-7e9956c1536f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041161 Aug 27 04:53:24.152292 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 241/501] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:24.160277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0279436b-d9c2-445c-a655-fb2863fab594 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:24.161126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0279436b-d9c2-445c-a655-fb2863fab594 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:24.167563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0279436b-d9c2-445c-a655-fb2863fab594 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:24.168207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0279436b-d9c2-445c-a655-fb2863fab594 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:24.168746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0279436b-d9c2-445c-a655-fb2863fab594 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:24.172268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0279436b-d9c2-445c-a655-fb2863fab594 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:24.172839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0279436b-d9c2-445c-a655-fb2863fab594 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:24.174077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0279436b-d9c2-445c-a655-fb2863fab594 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:24.271605 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] HTTP exception thrown: Floating IP 172.25.9.205 is not associated with instance 3cb98f2a-181a-4dd0-b454-8adec268f65f. Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Request method failure captured: Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f/action HTTP/1.1 Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 49 Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMPYWBJpVa-CaOasAHwBZpaZbOWam1ZW0rrBx-sBW_Uk-fny0wlQUfO9-lJmehUOnPWhB_mpIQsllrAjZrkhOnS69ICjAn53AriKEde4oonJqYR_OdcAUqL_wfbAVjZ0rlG4wXDxi-FZlf6N2SDUP7tWD61_A0fDqKxLHASHdDeKvo Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 0088fd72e34f43fa97050fd334f61ea6 Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:53:24.273365 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0088fd72e34f43fa97050fd334f61ea6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 0088fd72e34f43fa97050fd334f61ea6 Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FloatingIPsAssociationTestJSON-21290556-project Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ce1a0cee656e407a98b414918319c246 Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-21290556-project Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: {"removeFloatingIp": {"address": "172.25.9.205"}} Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:53:24.274897 n-d-820368-35 devstack@n-api.service[128548]: exception: Floating IP 172.25.9.205 is not associated with instance 3cb98f2a-181a-4dd0-b454-8adec268f65f. Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '3cb98f2a-181a-4dd0-b454-8adec268f65f', 'body': {'removeFloatingIp': {'address': '172.25.9.205'}}} Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.205 is not associated with instance 3cb98f2a-181a-4dd0-b454-8adec268f65f. Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:24.276343 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:24.277830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:24.277830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:24.277830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:24.277830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:24.277830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.205 is not associated with instance 3cb98f2a-181a-4dd0-b454-8adec268f65f. Aug 27 04:53:24.277830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:24.277830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Returning 409 to user: Floating IP 172.25.9.205 is not associated with instance 3cb98f2a-181a-4dd0-b454-8adec268f65f. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:24.277830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9330be45-a6ac-4cdf-a2cb-a85211abbb6a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "POST /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f/action" status: 409 len: 146 microversion: 2.1 time: 0.647739 Aug 27 04:53:24.277830 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 261/502] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:23 2022] POST /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f/action => generated 146 bytes in 649 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:53:24.287697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.205"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:24.565600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0279436b-d9c2-445c-a655-fb2863fab594 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:24.581472 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0279436b-d9c2-445c-a655-fb2863fab594 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1319 microversion: 2.1 time: 0.427732 Aug 27 04:53:24.582412 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 242/503] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:24 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:24.598906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a696d2ab-be70-4fef-b760-9eea0ceeb9a7 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:24.599503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a696d2ab-be70-4fef-b760-9eea0ceeb9a7 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:24.605551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:24.612302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:24.612927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a696d2ab-be70-4fef-b760-9eea0ceeb9a7 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:24.613050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:24.613190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a696d2ab-be70-4fef-b760-9eea0ceeb9a7 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:24.613284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:24.613378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a696d2ab-be70-4fef-b760-9eea0ceeb9a7 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:24.613921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a696d2ab-be70-4fef-b760-9eea0ceeb9a7 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:24.614052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:24.614382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:24.614511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a696d2ab-be70-4fef-b760-9eea0ceeb9a7 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:24.614805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a696d2ab-be70-4fef-b760-9eea0ceeb9a7 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:24.614914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:24.715660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-a696d2ab-be70-4fef-b760-9eea0ceeb9a7 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:24.750623 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a696d2ab-be70-4fef-b760-9eea0ceeb9a7 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.165156 Aug 27 04:53:24.752291 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 243/504] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:24 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:24.758014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fff592a2-fd71-4910-a409-ad85720c030c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:24.759169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fff592a2-fd71-4910-a409-ad85720c030c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:24.766279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fff592a2-fd71-4910-a409-ad85720c030c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:24.766931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fff592a2-fd71-4910-a409-ad85720c030c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:24.767523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fff592a2-fd71-4910-a409-ad85720c030c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:24.768353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fff592a2-fd71-4910-a409-ad85720c030c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:24.769078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fff592a2-fd71-4910-a409-ad85720c030c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:24.770207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fff592a2-fd71-4910-a409-ad85720c030c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:25.078535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fff592a2-fd71-4910-a409-ad85720c030c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:25.085179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "refresh_cache-503ce154-c117-40cb-bde8-137c354ee752" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:53:25.085787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquired lock "refresh_cache-503ce154-c117-40cb-bde8-137c354ee752" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:53:25.087527 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fff592a2-fd71-4910-a409-ad85720c030c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1320 microversion: 2.1 time: 0.333843 Aug 27 04:53:25.099497 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 244/505] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:24 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1320 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:25.122095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:25.123225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:25.130767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:25.131691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:25.132289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:25.133343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:25.134922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:25.134922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:25.859449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:25.868956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:25.870925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:25.872302 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6c67ed4e-edd2-4e36-9511-7408c185a4ad tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1362 microversion: 2.25 time: 0.754752 Aug 27 04:53:25.874098 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 245/506] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:25 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1362 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:53:25.879612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-47104909-3e6b-4b24-b3ab-e2cdf05b8237 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:25.880418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-47104909-3e6b-4b24-b3ab-e2cdf05b8237 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:25.887527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47104909-3e6b-4b24-b3ab-e2cdf05b8237 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:25.888331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47104909-3e6b-4b24-b3ab-e2cdf05b8237 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:25.889164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47104909-3e6b-4b24-b3ab-e2cdf05b8237 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:25.890107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47104909-3e6b-4b24-b3ab-e2cdf05b8237 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:25.891041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47104909-3e6b-4b24-b3ab-e2cdf05b8237 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:25.891802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47104909-3e6b-4b24-b3ab-e2cdf05b8237 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:26.243577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-47104909-3e6b-4b24-b3ab-e2cdf05b8237 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:26.262167 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-47104909-3e6b-4b24-b3ab-e2cdf05b8237 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1468 microversion: 2.1 time: 0.386826 Aug 27 04:53:26.262765 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 246/507] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:25 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:26.290232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8fd7370c-6728-4073-aefd-21c5cb6cbb29 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:26.293232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8fd7370c-6728-4073-aefd-21c5cb6cbb29 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:26.307734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd7370c-6728-4073-aefd-21c5cb6cbb29 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:26.308295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd7370c-6728-4073-aefd-21c5cb6cbb29 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:26.308778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd7370c-6728-4073-aefd-21c5cb6cbb29 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:26.309561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd7370c-6728-4073-aefd-21c5cb6cbb29 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:26.310020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd7370c-6728-4073-aefd-21c5cb6cbb29 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:26.311239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd7370c-6728-4073-aefd-21c5cb6cbb29 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:26.457909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-8fd7370c-6728-4073-aefd-21c5cb6cbb29 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:26.481112 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8fd7370c-6728-4073-aefd-21c5cb6cbb29 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.207934 Aug 27 04:53:26.482243 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 247/508] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:26 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:26.490948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-397e897c-37dc-4d7c-b9a3-e76cc9c6691b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:26.491767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-397e897c-37dc-4d7c-b9a3-e76cc9c6691b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:26.497652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-397e897c-37dc-4d7c-b9a3-e76cc9c6691b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:26.498309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-397e897c-37dc-4d7c-b9a3-e76cc9c6691b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:26.498899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-397e897c-37dc-4d7c-b9a3-e76cc9c6691b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:26.499981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-397e897c-37dc-4d7c-b9a3-e76cc9c6691b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:26.500620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-397e897c-37dc-4d7c-b9a3-e76cc9c6691b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:26.501048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-397e897c-37dc-4d7c-b9a3-e76cc9c6691b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:26.801406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Building network info cache for instance {{(pid=128548) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:53:26.822034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-397e897c-37dc-4d7c-b9a3-e76cc9c6691b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:26.833496 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-397e897c-37dc-4d7c-b9a3-e76cc9c6691b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1470 microversion: 2.1 time: 0.349753 Aug 27 04:53:26.834345 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 248/509] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:26 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1470 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:26.845545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a095e996-48ed-4e9a-88eb-fd74a4662e8d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:26.846389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a095e996-48ed-4e9a-88eb-fd74a4662e8d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:26.862820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a095e996-48ed-4e9a-88eb-fd74a4662e8d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:26.863620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a095e996-48ed-4e9a-88eb-fd74a4662e8d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:26.864433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a095e996-48ed-4e9a-88eb-fd74a4662e8d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:26.865695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a095e996-48ed-4e9a-88eb-fd74a4662e8d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:26.867862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a095e996-48ed-4e9a-88eb-fd74a4662e8d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:26.868295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a095e996-48ed-4e9a-88eb-fd74a4662e8d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:27.356647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a095e996-48ed-4e9a-88eb-fd74a4662e8d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:27.371710 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a095e996-48ed-4e9a-88eb-fd74a4662e8d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 200 len: 1319 microversion: 2.1 time: 0.533212 Aug 27 04:53:27.372574 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 249/510] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:26 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:27.388941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-30ca8993-ab4d-4075-b384-51a447db556b req-0ca254d6-f209-4143-a1a5-e510e7b6df24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503ce154-c117-40cb-bde8-137c354ee752", "tag": "407dd1cf-2e5c-4663-beb4-7811e097981f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:27.419300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-30ca8993-ab4d-4075-b384-51a447db556b req-0ca254d6-f209-4143-a1a5-e510e7b6df24 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:27.422406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-30ca8993-ab4d-4075-b384-51a447db556b req-0ca254d6-f209-4143-a1a5-e510e7b6df24 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:27.423013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-30ca8993-ab4d-4075-b384-51a447db556b req-0ca254d6-f209-4143-a1a5-e510e7b6df24 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:27.450809 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-30ca8993-ab4d-4075-b384-51a447db556b req-0ca254d6-f209-4143-a1a5-e510e7b6df24 service nova] Creating event network-changed:407dd1cf-2e5c-4663-beb4-7811e097981f for instance 503ce154-c117-40cb-bde8-137c354ee752 on n-h1-820368-35 Aug 27 04:53:27.460439 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-30ca8993-ab4d-4075-b384-51a447db556b req-0ca254d6-f209-4143-a1a5-e510e7b6df24 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085742 Aug 27 04:53:27.464876 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 250/511] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:28.094885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc2121db-7b2a-409f-9f70-8257edd458ac tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:28.096046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dc2121db-7b2a-409f-9f70-8257edd458ac tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:28.103659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc2121db-7b2a-409f-9f70-8257edd458ac tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.104675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc2121db-7b2a-409f-9f70-8257edd458ac tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.105195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc2121db-7b2a-409f-9f70-8257edd458ac tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.106038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc2121db-7b2a-409f-9f70-8257edd458ac tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.106702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc2121db-7b2a-409f-9f70-8257edd458ac tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.107895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc2121db-7b2a-409f-9f70-8257edd458ac tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.109523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Updating instance_info_cache with network_info: [{"id": "407dd1cf-2e5c-4663-beb4-7811e097981f", "address": "fa:16:3e:ac:67:52", "network": {"id": "71a3611e-27fd-46d0-9b26-df83ee6c57af", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-315764033-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0088fd72e34f43fa97050fd334f61ea6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap407dd1cf-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128548) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:53:28.119342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:28.134157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Releasing lock "refresh_cache-503ce154-c117-40cb-bde8-137c354ee752" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:53:28.135618 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fca095c3-ad2c-4182-b2ea-2ff43bf55010 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "POST /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752/action" status: 202 len: 0 microversion: 2.1 time: 3.855305 Aug 27 04:53:28.136264 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 262/512] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:24 2022] POST /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752/action => generated 0 bytes in 3857 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:53:28.142787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:28.143434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:28.150600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.151734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.152377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.152777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dc2121db-7b2a-409f-9f70-8257edd458ac tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:53:28.153540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.154227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.154847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.272939 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dc2121db-7b2a-409f-9f70-8257edd458ac tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 204 len: 0 microversion: 2.1 time: 0.806380 Aug 27 04:53:28.274358 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 251/513] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:53:27 2022] DELETE /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:53:28.284711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f58b9e8d-28ab-4d9a-a125-4cf4eb732b8f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:28.287633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f58b9e8d-28ab-4d9a-a125-4cf4eb732b8f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:28.295702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f58b9e8d-28ab-4d9a-a125-4cf4eb732b8f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.296561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f58b9e8d-28ab-4d9a-a125-4cf4eb732b8f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.297341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f58b9e8d-28ab-4d9a-a125-4cf4eb732b8f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.298492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f58b9e8d-28ab-4d9a-a125-4cf4eb732b8f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.299362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f58b9e8d-28ab-4d9a-a125-4cf4eb732b8f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.300351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f58b9e8d-28ab-4d9a-a125-4cf4eb732b8f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.336972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:28.439900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-f58b9e8d-28ab-4d9a-a125-4cf4eb732b8f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:28.468083 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f58b9e8d-28ab-4d9a-a125-4cf4eb732b8f tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.190824 Aug 27 04:53:28.469373 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 252/514] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:28 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:28.476168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-6a2243a5-48af-4c22-8ac6-8ac14ae8b66a req-a76856eb-5ae0-45ed-8522-14c95474a650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a534099b-1082-4506-97ae-da1e66618172", "name": "network-vif-plugged", "status": "completed", "tag": "2d29ce65-e94c-40f4-8546-0a5a9a18a415"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:28.492045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6a2243a5-48af-4c22-8ac6-8ac14ae8b66a req-a76856eb-5ae0-45ed-8522-14c95474a650 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.492824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6a2243a5-48af-4c22-8ac6-8ac14ae8b66a req-a76856eb-5ae0-45ed-8522-14c95474a650 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.493501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6a2243a5-48af-4c22-8ac6-8ac14ae8b66a req-a76856eb-5ae0-45ed-8522-14c95474a650 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.522193 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-6a2243a5-48af-4c22-8ac6-8ac14ae8b66a req-a76856eb-5ae0-45ed-8522-14c95474a650 service nova] Creating event network-vif-plugged:2d29ce65-e94c-40f4-8546-0a5a9a18a415 for instance a534099b-1082-4506-97ae-da1e66618172 on n-h1-820368-35 Aug 27 04:53:28.530986 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-6a2243a5-48af-4c22-8ac6-8ac14ae8b66a req-a76856eb-5ae0-45ed-8522-14c95474a650 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059427 Aug 27 04:53:28.531801 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 253/515] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:28.540853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82f070cf-afd8-4f22-9e6b-f0a5a4426c3d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:28.541485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-82f070cf-afd8-4f22-9e6b-f0a5a4426c3d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:28.548843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82f070cf-afd8-4f22-9e6b-f0a5a4426c3d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.549130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82f070cf-afd8-4f22-9e6b-f0a5a4426c3d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.549567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82f070cf-afd8-4f22-9e6b-f0a5a4426c3d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.550274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82f070cf-afd8-4f22-9e6b-f0a5a4426c3d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.550893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82f070cf-afd8-4f22-9e6b-f0a5a4426c3d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.551141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:28.551400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82f070cf-afd8-4f22-9e6b-f0a5a4426c3d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.561178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:28.568379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:28.569830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5054e2d5-a23c-42cd-9bc5-5cdc0e39a500 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1362 microversion: 2.25 time: 0.431973 Aug 27 04:53:28.579145 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 263/516] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:28 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:28.590208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-82f070cf-afd8-4f22-9e6b-f0a5a4426c3d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:53:28.600044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e360dbd4-f1e6-4bde-99ec-24406fd22833 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:28.600971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e360dbd4-f1e6-4bde-99ec-24406fd22833 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:28.608413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e360dbd4-f1e6-4bde-99ec-24406fd22833 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.611163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e360dbd4-f1e6-4bde-99ec-24406fd22833 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.614141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e360dbd4-f1e6-4bde-99ec-24406fd22833 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.617726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e360dbd4-f1e6-4bde-99ec-24406fd22833 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.618480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e360dbd4-f1e6-4bde-99ec-24406fd22833 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.619078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e360dbd4-f1e6-4bde-99ec-24406fd22833 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.729456 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-82f070cf-afd8-4f22-9e6b-f0a5a4426c3d tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "DELETE /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 204 len: 0 microversion: 2.1 time: 0.195636 Aug 27 04:53:28.733304 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 254/517] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:53:28 2022] DELETE /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:53:28.737970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a133130-b7f6-4e60-bd23-feff0b2ff6e9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:28.739883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6a133130-b7f6-4e60-bd23-feff0b2ff6e9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:28.747343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a133130-b7f6-4e60-bd23-feff0b2ff6e9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.748565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a133130-b7f6-4e60-bd23-feff0b2ff6e9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.749062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a133130-b7f6-4e60-bd23-feff0b2ff6e9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.749964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a133130-b7f6-4e60-bd23-feff0b2ff6e9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.750398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a133130-b7f6-4e60-bd23-feff0b2ff6e9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.750950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a133130-b7f6-4e60-bd23-feff0b2ff6e9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:29.077559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6a133130-b7f6-4e60-bd23-feff0b2ff6e9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:29.079220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e360dbd4-f1e6-4bde-99ec-24406fd22833 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:29.089770 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e360dbd4-f1e6-4bde-99ec-24406fd22833 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1476 microversion: 2.1 time: 0.508789 Aug 27 04:53:29.090435 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6a133130-b7f6-4e60-bd23-feff0b2ff6e9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 200 len: 1319 microversion: 2.1 time: 0.355539 Aug 27 04:53:29.092206 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 255/518] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:28 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:29.107252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.205"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:29.107884 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 264/519] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:28 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1476 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:29.111039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:29.125845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:29.126415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:29.126773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:29.130723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:29.131246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:29.131706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:29.173968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "refresh_cache-3cb98f2a-181a-4dd0-b454-8adec268f65f" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:53:29.179145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquired lock "refresh_cache-3cb98f2a-181a-4dd0-b454-8adec268f65f" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:53:29.496682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-165037fa-e4d6-4d49-8dad-47cc3daaaf9e tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:29.497449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-165037fa-e4d6-4d49-8dad-47cc3daaaf9e tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:29.513659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-165037fa-e4d6-4d49-8dad-47cc3daaaf9e tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:29.514317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-165037fa-e4d6-4d49-8dad-47cc3daaaf9e tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:29.514861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-165037fa-e4d6-4d49-8dad-47cc3daaaf9e tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:29.515737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-165037fa-e4d6-4d49-8dad-47cc3daaaf9e tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:29.516374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-165037fa-e4d6-4d49-8dad-47cc3daaaf9e tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:29.516845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-165037fa-e4d6-4d49-8dad-47cc3daaaf9e tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:29.672202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-165037fa-e4d6-4d49-8dad-47cc3daaaf9e tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:29.711250 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-165037fa-e4d6-4d49-8dad-47cc3daaaf9e tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.218261 Aug 27 04:53:29.711854 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 265/520] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:29 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:53:29.760989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:29.761609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:29.775326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:29.775828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:29.776269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:29.776989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:29.777449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:29.777879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:30.451437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:30.464156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:30.469197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:30.471151 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b52e6dd2-aa77-4804-adaf-bc29abdd4497 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1362 microversion: 2.25 time: 0.725873 Aug 27 04:53:30.475389 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 266/521] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:29 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1362 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:30.480231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a462bb3-b1a0-4fd6-84ae-f187321683aa tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:30.491061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a462bb3-b1a0-4fd6-84ae-f187321683aa tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:30.497340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a462bb3-b1a0-4fd6-84ae-f187321683aa tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:30.498656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a462bb3-b1a0-4fd6-84ae-f187321683aa tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:30.498874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a462bb3-b1a0-4fd6-84ae-f187321683aa tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:30.499672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a462bb3-b1a0-4fd6-84ae-f187321683aa tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:30.500128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a462bb3-b1a0-4fd6-84ae-f187321683aa tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:30.500553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a462bb3-b1a0-4fd6-84ae-f187321683aa tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:30.832199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1a462bb3-b1a0-4fd6-84ae-f187321683aa tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:30.848606 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a462bb3-b1a0-4fd6-84ae-f187321683aa tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 200 len: 1319 microversion: 2.1 time: 0.371547 Aug 27 04:53:30.849504 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 267/522] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:30 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:30.863207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b560c19c-e48c-4aab-b8f8-9fbe3a7f62b6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:30.864117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b560c19c-e48c-4aab-b8f8-9fbe3a7f62b6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:30.876884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b560c19c-e48c-4aab-b8f8-9fbe3a7f62b6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:30.878181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b560c19c-e48c-4aab-b8f8-9fbe3a7f62b6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:30.878817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b560c19c-e48c-4aab-b8f8-9fbe3a7f62b6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:30.879991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b560c19c-e48c-4aab-b8f8-9fbe3a7f62b6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:30.880616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b560c19c-e48c-4aab-b8f8-9fbe3a7f62b6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:30.881204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b560c19c-e48c-4aab-b8f8-9fbe3a7f62b6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:31.749403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b560c19c-e48c-4aab-b8f8-9fbe3a7f62b6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:31.763632 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b560c19c-e48c-4aab-b8f8-9fbe3a7f62b6 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 200 len: 1476 microversion: 2.1 time: 0.912823 Aug 27 04:53:31.766430 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 268/523] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:30 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 1476 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:31.773898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6325d343-9333-4b9b-b23a-096fc1d04cae req-2ff31944-16a4-4c80-a3ab-9b8b8764a7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36549027-8a9f-4d92-8525-bdd6fa5ed50e", "name": "network-vif-plugged", "status": "completed", "tag": "6db9659b-7f15-473d-b767-a63311e81850"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:31.804638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6325d343-9333-4b9b-b23a-096fc1d04cae req-2ff31944-16a4-4c80-a3ab-9b8b8764a7e3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:31.805219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6325d343-9333-4b9b-b23a-096fc1d04cae req-2ff31944-16a4-4c80-a3ab-9b8b8764a7e3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:31.809752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6325d343-9333-4b9b-b23a-096fc1d04cae req-2ff31944-16a4-4c80-a3ab-9b8b8764a7e3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:31.825456 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6325d343-9333-4b9b-b23a-096fc1d04cae req-2ff31944-16a4-4c80-a3ab-9b8b8764a7e3 service nova] Creating event network-vif-plugged:6db9659b-7f15-473d-b767-a63311e81850 for instance 36549027-8a9f-4d92-8525-bdd6fa5ed50e on n-h2-820368-35 Aug 27 04:53:31.835569 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6325d343-9333-4b9b-b23a-096fc1d04cae req-2ff31944-16a4-4c80-a3ab-9b8b8764a7e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067021 Aug 27 04:53:31.837002 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 269/524] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:31.846224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f3ef4496-d945-4deb-b0d9-d196614039c0 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:31.846932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f3ef4496-d945-4deb-b0d9-d196614039c0 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:31.860855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3ef4496-d945-4deb-b0d9-d196614039c0 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:31.861362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3ef4496-d945-4deb-b0d9-d196614039c0 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:31.863703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3ef4496-d945-4deb-b0d9-d196614039c0 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:31.864512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3ef4496-d945-4deb-b0d9-d196614039c0 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:31.869109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3ef4496-d945-4deb-b0d9-d196614039c0 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:31.869109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3ef4496-d945-4deb-b0d9-d196614039c0 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:32.414358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-f3ef4496-d945-4deb-b0d9-d196614039c0 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:32.475742 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f3ef4496-d945-4deb-b0d9-d196614039c0 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.634556 Aug 27 04:53:32.479417 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 270/525] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:31 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:32.486110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f8fd49c1-7566-4740-be50-adc8004d7aeb req-935ee569-25d0-4e4a-8361-3832136469fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0109b00-ad83-4acd-9862-a64c21cd8516", "name": "network-vif-deleted", "tag": "c5cad2de-145b-4862-b2c8-caafb3f0baa8"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:32.510767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f8fd49c1-7566-4740-be50-adc8004d7aeb req-935ee569-25d0-4e4a-8361-3832136469fd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:32.512297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f8fd49c1-7566-4740-be50-adc8004d7aeb req-935ee569-25d0-4e4a-8361-3832136469fd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:32.512978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f8fd49c1-7566-4740-be50-adc8004d7aeb req-935ee569-25d0-4e4a-8361-3832136469fd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:32.529930 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f8fd49c1-7566-4740-be50-adc8004d7aeb req-935ee569-25d0-4e4a-8361-3832136469fd service nova] Creating event network-vif-deleted:c5cad2de-145b-4862-b2c8-caafb3f0baa8 for instance c0109b00-ad83-4acd-9862-a64c21cd8516 on n-h2-820368-35 Aug 27 04:53:32.539218 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f8fd49c1-7566-4740-be50-adc8004d7aeb req-935ee569-25d0-4e4a-8361-3832136469fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058278 Aug 27 04:53:32.540016 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 271/526] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:32.550927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:32.551893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:32.565333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:32.566017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:32.566652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:32.567410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:32.568544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:32.569140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:32.914099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:32.935624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:32.947862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:32.954549 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9ce2b6e4-dd68-49ef-a6de-22a0ae25d2db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1362 microversion: 2.25 time: 0.413088 Aug 27 04:53:32.955801 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 272/527] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:32 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:32.970823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f6f00b9-628c-4481-a1be-7203ef2e2a20 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:32.974946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f6f00b9-628c-4481-a1be-7203ef2e2a20 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:32.992835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f6f00b9-628c-4481-a1be-7203ef2e2a20 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:32.993593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f6f00b9-628c-4481-a1be-7203ef2e2a20 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:32.994935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f6f00b9-628c-4481-a1be-7203ef2e2a20 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:32.995955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f6f00b9-628c-4481-a1be-7203ef2e2a20 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:32.999952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f6f00b9-628c-4481-a1be-7203ef2e2a20 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:33.001776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f6f00b9-628c-4481-a1be-7203ef2e2a20 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:33.061764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=18 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:33.127213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=30 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:33.538960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f6f00b9-628c-4481-a1be-7203ef2e2a20 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:33.557899 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f6f00b9-628c-4481-a1be-7203ef2e2a20 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 200 len: 1469 microversion: 2.1 time: 0.596979 Aug 27 04:53:33.558789 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 273/528] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:32 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 1469 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:33.590016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:33.593211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:33.612301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:33.621726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:33.623630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:33.624562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:33.626197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:33.627288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:33.659064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Building network info cache for instance {{(pid=128547) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:53:33.682027 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] HTTP exception thrown: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Request method failure captured: Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 HTTP/1.1 Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMqdWWOVNaYg8XVJDOIdDz9S7IVDQabmLJgp4Cz5dM7fJm7PFXds1jtbNzsSjw4rAkKPSp6fZY5cGwTxOL_xj1PCgTQdOklT32MGiuibuAAteT6Kv11iHjAtKeEMEB93RZWa2h0aeFc7hXZ1MMrXB8AjRMIrK9MJQKYYUj_yxxX9bs Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:53:33.684147 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45c2a8d4be674caeab73db8e28ac1459", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 3917d606c35f4db1af916815167fae74 Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:53:33.685458 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'c0109b00-ad83-4acd-9862-a64c21cd8516'} Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:33.686316 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:53:33.688045 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:33.695606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Returning 404 to user: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:33.700799 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-11646312-e7af-4fb2-9f30-ce70c529809d tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 404 len: 111 microversion: 2.1 time: 0.121850 Aug 27 04:53:33.702763 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 274/529] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:33 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:33.707750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-26f724b8-8c66-48f6-8c4a-39d07586ea0c tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:33.710946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-26f724b8-8c66-48f6-8c4a-39d07586ea0c tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:33.746326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f724b8-8c66-48f6-8c4a-39d07586ea0c tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:33.749760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f724b8-8c66-48f6-8c4a-39d07586ea0c tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:33.750589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f724b8-8c66-48f6-8c4a-39d07586ea0c tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:33.753164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f724b8-8c66-48f6-8c4a-39d07586ea0c tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:33.756494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f724b8-8c66-48f6-8c4a-39d07586ea0c tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:33.756760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:33.757332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f724b8-8c66-48f6-8c4a-39d07586ea0c tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:34.090911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-26f724b8-8c66-48f6-8c4a-39d07586ea0c tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:34.123364 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-26f724b8-8c66-48f6-8c4a-39d07586ea0c tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1931 microversion: 2.75 time: 0.419217 Aug 27 04:53:34.124372 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 275/530] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:33 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1931 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:34.129687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:34.135831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:34.136896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Searching by: {'reservation_id': 'r-sc30w5t6', 'deleted': False, 'project_id': '4074bf02227441b091b6e7d62f83b9e0'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:53:34.142568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:34.144487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:34.145036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:34.145489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:34.146364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:34.146960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:34.147568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:34.386404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:53:34.536801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:34.558433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:34.561281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:34.561960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:34.937739 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd78160c-708e-439d-beb8-4d4dbc0137c9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-sc30w5t6" status: 200 len: 2930 microversion: 2.1 time: 0.812073 Aug 27 04:53:34.938340 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 276/531] 10.222.0.58 () {58 vars in 1197 bytes} [Sat Aug 27 04:53:34 2022] GET /compute/v2.1/servers/detail?reservation_id=r-sc30w5t6 => generated 2930 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:34.955891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-613df0c5-80b0-4119-8961-13dfe6ac9994 req-ce36b41a-0575-4f33-bd63-4ffacc4b6e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb98f2a-181a-4dd0-b454-8adec268f65f", "tag": "d2ef900d-23fd-47bd-9461-d82bd76c45a0"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:34.970225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-613df0c5-80b0-4119-8961-13dfe6ac9994 req-ce36b41a-0575-4f33-bd63-4ffacc4b6e16 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:34.970707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-613df0c5-80b0-4119-8961-13dfe6ac9994 req-ce36b41a-0575-4f33-bd63-4ffacc4b6e16 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:34.972321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-613df0c5-80b0-4119-8961-13dfe6ac9994 req-ce36b41a-0575-4f33-bd63-4ffacc4b6e16 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:34.991220 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-613df0c5-80b0-4119-8961-13dfe6ac9994 req-ce36b41a-0575-4f33-bd63-4ffacc4b6e16 service nova] Creating event network-changed:d2ef900d-23fd-47bd-9461-d82bd76c45a0 for instance 3cb98f2a-181a-4dd0-b454-8adec268f65f on n-h1-820368-35 Aug 27 04:53:34.998621 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-613df0c5-80b0-4119-8961-13dfe6ac9994 req-ce36b41a-0575-4f33-bd63-4ffacc4b6e16 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058233 Aug 27 04:53:35.003249 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 277/532] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:35.073665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e1402345-7aac-4b6f-b1b8-248aab031bc8 tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] Calling method '.version_select at 0x7fb5657615e0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:35.283463 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e1402345-7aac-4b6f-b1b8-248aab031bc8 tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.278753 Aug 27 04:53:35.286114 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 278/533] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 04:53:35 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:53:35.290784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1682099806", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:35.396132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:53:36.040855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Updating instance_info_cache with network_info: [{"id": "d2ef900d-23fd-47bd-9461-d82bd76c45a0", "address": "fa:16:3e:ba:3f:20", "network": {"id": "71a3611e-27fd-46d0-9b26-df83ee6c57af", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-315764033-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0088fd72e34f43fa97050fd334f61ea6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2ef900d-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:53:36.057658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Releasing lock "refresh_cache-3cb98f2a-181a-4dd0-b454-8adec268f65f" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:53:36.060567 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4702ec1d-8e95-4c7d-9dbc-5b331a657cdd tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "POST /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f/action" status: 202 len: 0 microversion: 2.1 time: 6.965616 Aug 27 04:53:36.061418 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 256/534] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:29 2022] POST /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f/action => generated 0 bytes in 6969 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:53:36.071298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:36.072221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:36.082869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.084032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.084697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.087131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.088385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.089047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.108097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:53:36.108713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:53:36.109261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:53:36.109830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:53:36.110253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:53:36.121301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.122159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.122802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.123721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.124332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.124935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.158156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Getting quotas for project 45c2a8d4be674caeab73db8e28ac1459. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:36.164982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Getting quotas for user 3917d606c35f4db1af916815167fae74 and project 45c2a8d4be674caeab73db8e28ac1459. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:36.179289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:53:36.183681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:53:36.256199 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-69cdb122-d443-40f5-8be8-5c2a469156af tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968985 Aug 27 04:53:36.257944 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 279/535] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:53:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:53:36.274485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-50e57eb1-c65d-4488-8527-0777f7f5f8f9 req-dfc366a6-2634-425b-bbc3-a03249d19b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503ce154-c117-40cb-bde8-137c354ee752", "name": "network-vif-deleted", "tag": "407dd1cf-2e5c-4663-beb4-7811e097981f"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:36.289083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-50e57eb1-c65d-4488-8527-0777f7f5f8f9 req-dfc366a6-2634-425b-bbc3-a03249d19b33 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.290122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-50e57eb1-c65d-4488-8527-0777f7f5f8f9 req-dfc366a6-2634-425b-bbc3-a03249d19b33 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.290722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-50e57eb1-c65d-4488-8527-0777f7f5f8f9 req-dfc366a6-2634-425b-bbc3-a03249d19b33 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.302929 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-50e57eb1-c65d-4488-8527-0777f7f5f8f9 req-dfc366a6-2634-425b-bbc3-a03249d19b33 service nova] Creating event network-vif-deleted:407dd1cf-2e5c-4663-beb4-7811e097981f for instance 503ce154-c117-40cb-bde8-137c354ee752 on n-h1-820368-35 Aug 27 04:53:36.308665 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-50e57eb1-c65d-4488-8527-0777f7f5f8f9 req-dfc366a6-2634-425b-bbc3-a03249d19b33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049214 Aug 27 04:53:36.309822 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 280/536] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:36.315054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5f92abd-526e-4ca2-9dab-36a5e6dd26de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:36.340483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:36.345623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.compute.server_groups [None req-c5f92abd-526e-4ca2-9dab-36a5e6dd26de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Querying cell ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) for 2 instances {{(pid=128548) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 04:53:36.346571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5f92abd-526e-4ca2-9dab-36a5e6dd26de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.347286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5f92abd-526e-4ca2-9dab-36a5e6dd26de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.347873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5f92abd-526e-4ca2-9dab-36a5e6dd26de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.359753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:36.361436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:36.362637 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8997dc79-f4b9-4b8a-b7dd-8176a9e2e470 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1558 microversion: 2.25 time: 0.299445 Aug 27 04:53:36.363284 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 257/537] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:36 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1558 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:36.367804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e179878-8352-4411-a0fa-cb2622362d07 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:36.368402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e179878-8352-4411-a0fa-cb2622362d07 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:36.381914 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5f92abd-526e-4ca2-9dab-36a5e6dd26de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/aa8dd1db-315c-47d2-af7f-40f3948a37fb" status: 200 len: 265 microversion: 2.1 time: 0.070729 Aug 27 04:53:36.388575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179878-8352-4411-a0fa-cb2622362d07 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.388575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179878-8352-4411-a0fa-cb2622362d07 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.388575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179878-8352-4411-a0fa-cb2622362d07 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.388575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179878-8352-4411-a0fa-cb2622362d07 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.388921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179878-8352-4411-a0fa-cb2622362d07 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.389057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179878-8352-4411-a0fa-cb2622362d07 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.389423 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 281/538] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 04:53:36 2022] GET /compute/v2.1/os-server-groups/aa8dd1db-315c-47d2-af7f-40f3948a37fb => generated 265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:36.394679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c98e1892-512a-46b5-9cc0-c6818076d607 tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] Action: 'create', calling method: .version_select at 0x7fb565788ca0>, body: {"pool": "non_exist_pool"} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:36.428028 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c98e1892-512a-46b5-9cc0-c6818076d607 tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] HTTP exception thrown: Floating IP pool not found. Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c98e1892-512a-46b5-9cc0-c6818076d607 tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] Request method failure captured: Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 26 Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaNNetEB4m_brlMzozKBDoyPdYv122DIicYzxP7CClKMSYkt37-xyK6ns-YZdIEryWoG115LpCbWBftSWe5nOizYavyAcKVbwwjhn6UK7qwNCFtWbsazWhcG_cUjjlGfXewWQpQiF28dgfvyqV_7d95x4tpsy4HrUZ4ba-gPxmzCmH0 Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: fe08fa1a1857423a9d064d7a296a9046 Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1822493319 Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:53:36.430946 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe08fa1a1857423a9d064d7a296a9046", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe08fa1a1857423a9d064d7a296a9046"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe08fa1a1857423a9d064d7a296a9046"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe08fa1a1857423a9d064d7a296a9046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1822493319 Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: fe08fa1a1857423a9d064d7a296a9046 Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1822493319 Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FloatingIPsNegativeTestJSON-1822493319-project Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 1315f9fa64d34c2fb14df1decb347f07 Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1822493319-project Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: {"pool": "non_exist_pool"} Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: exception: Floating IP pool not found. Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 27 04:53:36.432265 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:36.433147 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c98e1892-512a-46b5-9cc0-c6818076d607 tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] Returning 404 to user: Floating IP pool not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:36.434257 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c98e1892-512a-46b5-9cc0-c6818076d607 tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.041822 Aug 27 04:53:36.435990 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 282/539] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 04:53:36 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:53:36.437837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c41e0eb5-0477-4b79-9ba0-6a89d1fb0b10 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '.version_select at 0x7fb565612dc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:36.535868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-8e179878-8352-4411-a0fa-cb2622362d07 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:36.566158 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e179878-8352-4411-a0fa-cb2622362d07 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1937 microversion: 2.75 time: 0.201666 Aug 27 04:53:36.579290 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 258/540] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:36 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1937 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:36.584182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2907a033-9e04-43d4-b232-20a189c7437f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:36.585058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2907a033-9e04-43d4-b232-20a189c7437f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:36.665495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2907a033-9e04-43d4-b232-20a189c7437f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:36.674250 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2907a033-9e04-43d4-b232-20a189c7437f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1220 microversion: 2.1 time: 0.106074 Aug 27 04:53:36.677966 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 259/541] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:36 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:36.686872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cab7464b-7a0e-4d1b-a15c-bea76373498b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:36.690222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cab7464b-7a0e-4d1b-a15c-bea76373498b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:36.703337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab7464b-7a0e-4d1b-a15c-bea76373498b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.707794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab7464b-7a0e-4d1b-a15c-bea76373498b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.708444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab7464b-7a0e-4d1b-a15c-bea76373498b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.709346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab7464b-7a0e-4d1b-a15c-bea76373498b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.710131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab7464b-7a0e-4d1b-a15c-bea76373498b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.710767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab7464b-7a0e-4d1b-a15c-bea76373498b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.745949 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c41e0eb5-0477-4b79-9ba0-6a89d1fb0b10 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/754ee238-562c-4a17-bc34-bebeb9910a1e" status: 200 len: 184 microversion: 2.1 time: 0.311538 Aug 27 04:53:36.746803 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 283/542] 10.222.0.58 () {58 vars in 1260 bytes} [Sat Aug 27 04:53:36 2022] GET /compute/v2.1/os-floating-ips/754ee238-562c-4a17-bc34-bebeb9910a1e => generated 184 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:36.753564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e3b8f4d4-c72d-4d11-b4ff-0e457d9b6454 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:36.754717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e3b8f4d4-c72d-4d11-b4ff-0e457d9b6454 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:36.762121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3b8f4d4-c72d-4d11-b4ff-0e457d9b6454 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.762703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3b8f4d4-c72d-4d11-b4ff-0e457d9b6454 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.763734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3b8f4d4-c72d-4d11-b4ff-0e457d9b6454 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.764447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3b8f4d4-c72d-4d11-b4ff-0e457d9b6454 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.764904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3b8f4d4-c72d-4d11-b4ff-0e457d9b6454 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.765340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3b8f4d4-c72d-4d11-b4ff-0e457d9b6454 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.966873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-cab7464b-7a0e-4d1b-a15c-bea76373498b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid 36549027-8a9f-4d92-8525-bdd6fa5ed50e {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:36.997936 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cab7464b-7a0e-4d1b-a15c-bea76373498b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 2053 microversion: 2.25 time: 0.311263 Aug 27 04:53:36.999360 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 260/543] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:36 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 2053 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:37.004738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d1e04b5-eb4b-460c-adf0-47d5dd43d46a tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] Calling method '.version_select at 0x7fb5657a7a60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:37.041789 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e3b8f4d4-c72d-4d11-b4ff-0e457d9b6454 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 200 len: 1621 microversion: 2.1 time: 0.294154 Aug 27 04:53:37.044679 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 284/544] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:36 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 1621 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:37.069096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.205"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:37.114924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-7d1e04b5-eb4b-460c-adf0-47d5dd43d46a tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fc65dd8b-915a-4c13-bff1-83548f2cefce could not be found", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:53:37.115644 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-7d1e04b5-eb4b-460c-adf0-47d5dd43d46a tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] HTTP exception thrown: Floating IP not found for ID fc65dd8b-915a-4c13-bff1-83548f2cefce Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d1e04b5-eb4b-460c-adf0-47d5dd43d46a tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] Request method failure captured: Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/os-floating-ips/fc65dd8b-915a-4c13-bff1-83548f2cefce HTTP/1.1 Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaNNetEB4m_brlMzozKBDoyPdYv122DIicYzxP7CClKMSYkt37-xyK6ns-YZdIEryWoG115LpCbWBftSWe5nOizYavyAcKVbwwjhn6UK7qwNCFtWbsazWhcG_cUjjlGfXewWQpQiF28dgfvyqV_7d95x4tpsy4HrUZ4ba-gPxmzCmH0 Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: fe08fa1a1857423a9d064d7a296a9046 Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1822493319 Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:53:37.139275 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe08fa1a1857423a9d064d7a296a9046", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe08fa1a1857423a9d064d7a296a9046"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe08fa1a1857423a9d064d7a296a9046"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe08fa1a1857423a9d064d7a296a9046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1822493319 Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: fe08fa1a1857423a9d064d7a296a9046 Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1822493319 Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FloatingIPsNegativeTestJSON-1822493319-project Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 1315f9fa64d34c2fb14df1decb347f07 Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1822493319-project Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: exception: Floating IP not found for ID fc65dd8b-915a-4c13-bff1-83548f2cefce Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'fc65dd8b-915a-4c13-bff1-83548f2cefce'} Aug 27 04:53:37.140567 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:53:37.141423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP fc65dd8b-915a-4c13-bff1-83548f2cefce could not be found Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc424b17-8f48-42f2-a135-a82f2f43b76c'] Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID fc65dd8b-915a-4c13-bff1-83548f2cefce. Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:37.142557 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID fc65dd8b-915a-4c13-bff1-83548f2cefce Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:37.143747 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:37.144910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID fc65dd8b-915a-4c13-bff1-83548f2cefce Aug 27 04:53:37.144910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:37.144910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d1e04b5-eb4b-460c-adf0-47d5dd43d46a tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] Returning 404 to user: Floating IP not found for ID fc65dd8b-915a-4c13-bff1-83548f2cefce {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:37.144910 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7d1e04b5-eb4b-460c-adf0-47d5dd43d46a tempest-FloatingIPsNegativeTestJSON-1822493319 tempest-FloatingIPsNegativeTestJSON-1822493319-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/fc65dd8b-915a-4c13-bff1-83548f2cefce" status: 404 len: 111 microversion: 2.1 time: 0.140512 Aug 27 04:53:37.146848 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 261/545] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 04:53:36 2022] DELETE /compute/v2.1/os-floating-ips/fc65dd8b-915a-4c13-bff1-83548f2cefce => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:37.152148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1425825-236d-40ad-b2bd-c9276083db0f tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:37.152973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d1425825-236d-40ad-b2bd-c9276083db0f tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:37.173318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1425825-236d-40ad-b2bd-c9276083db0f tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:37.174116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1425825-236d-40ad-b2bd-c9276083db0f tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:37.174714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1425825-236d-40ad-b2bd-c9276083db0f tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:37.175645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1425825-236d-40ad-b2bd-c9276083db0f tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:37.176256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1425825-236d-40ad-b2bd-c9276083db0f tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:37.176857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1425825-236d-40ad-b2bd-c9276083db0f tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:37.402449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:37.410949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:37.411809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:37.412489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:37.413438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:37.414113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:37.415305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:37.420501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:37.463629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-d1425825-236d-40ad-b2bd-c9276083db0f tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid 36549027-8a9f-4d92-8525-bdd6fa5ed50e {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:37.511819 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1425825-236d-40ad-b2bd-c9276083db0f tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 2053 microversion: 2.25 time: 0.363626 Aug 27 04:53:37.514089 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 262/546] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:37 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 2053 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:37.524784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-45cec596-4a8f-4b1f-b227-fe36b9482df2 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:37.525648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-45cec596-4a8f-4b1f-b227-fe36b9482df2 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:37.542564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45cec596-4a8f-4b1f-b227-fe36b9482df2 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:37.548397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45cec596-4a8f-4b1f-b227-fe36b9482df2 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:37.549013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45cec596-4a8f-4b1f-b227-fe36b9482df2 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:37.549910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45cec596-4a8f-4b1f-b227-fe36b9482df2 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:37.550525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45cec596-4a8f-4b1f-b227-fe36b9482df2 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:37.553055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45cec596-4a8f-4b1f-b227-fe36b9482df2 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:37.814367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "refresh_cache-3cb98f2a-181a-4dd0-b454-8adec268f65f" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:53:37.814768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquired lock "refresh_cache-3cb98f2a-181a-4dd0-b454-8adec268f65f" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:53:37.933685 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-45cec596-4a8f-4b1f-b227-fe36b9482df2 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 200 len: 1622 microversion: 2.1 time: 0.418181 Aug 27 04:53:37.934217 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 263/547] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:37 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 1622 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:37.943633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f40c788a-4463-45ca-9ece-68a9e249a0ff tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:37.961576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f40c788a-4463-45ca-9ece-68a9e249a0ff tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:37.962067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f40c788a-4463-45ca-9ece-68a9e249a0ff tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:37.962508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f40c788a-4463-45ca-9ece-68a9e249a0ff tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:37.965610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f40c788a-4463-45ca-9ece-68a9e249a0ff tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:37.967692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f40c788a-4463-45ca-9ece-68a9e249a0ff tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:37.971735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f40c788a-4463-45ca-9ece-68a9e249a0ff tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:38.069207 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f40c788a-4463-45ca-9ece-68a9e249a0ff tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.129558 Aug 27 04:53:38.072419 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 264/548] 10.222.0.58 () {60 vars in 1217 bytes} [Sat Aug 27 04:53:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:53:38.081357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e5472a02-7c84-4c6a-99dd-8f36ef250a58 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:38.082735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e5472a02-7c84-4c6a-99dd-8f36ef250a58 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:38.099604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5472a02-7c84-4c6a-99dd-8f36ef250a58 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:38.100105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5472a02-7c84-4c6a-99dd-8f36ef250a58 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:38.100549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5472a02-7c84-4c6a-99dd-8f36ef250a58 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:38.101280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5472a02-7c84-4c6a-99dd-8f36ef250a58 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:38.103992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5472a02-7c84-4c6a-99dd-8f36ef250a58 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:38.106020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5472a02-7c84-4c6a-99dd-8f36ef250a58 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:38.263732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-e5472a02-7c84-4c6a-99dd-8f36ef250a58 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:38.309562 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e5472a02-7c84-4c6a-99dd-8f36ef250a58 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1937 microversion: 2.75 time: 0.234629 Aug 27 04:53:38.310732 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 265/549] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:38 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1937 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:38.320240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-07f63476-a2f9-4f5b-a2b8-a4ecccadb853 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:38.320861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-07f63476-a2f9-4f5b-a2b8-a4ecccadb853 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:38.334132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07f63476-a2f9-4f5b-a2b8-a4ecccadb853 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:38.340233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07f63476-a2f9-4f5b-a2b8-a4ecccadb853 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:38.340695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07f63476-a2f9-4f5b-a2b8-a4ecccadb853 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:38.341481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07f63476-a2f9-4f5b-a2b8-a4ecccadb853 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:38.343252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07f63476-a2f9-4f5b-a2b8-a4ecccadb853 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:38.343785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07f63476-a2f9-4f5b-a2b8-a4ecccadb853 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:38.498703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-07f63476-a2f9-4f5b-a2b8-a4ecccadb853 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:38.510377 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-07f63476-a2f9-4f5b-a2b8-a4ecccadb853 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1280 microversion: 2.1 time: 0.198264 Aug 27 04:53:38.520178 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 266/550] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:38 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1280 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:38.525138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-28b3e3db-ebb7-4bf5-976c-0f0ef4655c42 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Action: 'create', calling method: .version_select at 0x7fb5656b1280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1693829650", "policies": ["anti-affinity"]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:38.605781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-28b3e3db-ebb7-4bf5-976c-0f0ef4655c42 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:38.614511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-28b3e3db-ebb7-4bf5-976c-0f0ef4655c42 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:38.752382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-28b3e3db-ebb7-4bf5-976c-0f0ef4655c42 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:38.775479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-28b3e3db-ebb7-4bf5-976c-0f0ef4655c42 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:38.823513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:38.827836 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-28b3e3db-ebb7-4bf5-976c-0f0ef4655c42 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.306471 Aug 27 04:53:38.833354 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 267/551] 10.222.0.58 () {60 vars in 1174 bytes} [Sat Aug 27 04:53:38 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:38.840372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2fac21cb-ae95-466b-8752-0a8748e3f3e1 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:38.844955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2fac21cb-ae95-466b-8752-0a8748e3f3e1 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:38.858507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fac21cb-ae95-466b-8752-0a8748e3f3e1 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:38.861658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fac21cb-ae95-466b-8752-0a8748e3f3e1 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:38.862355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fac21cb-ae95-466b-8752-0a8748e3f3e1 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:38.863325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fac21cb-ae95-466b-8752-0a8748e3f3e1 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:38.864808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fac21cb-ae95-466b-8752-0a8748e3f3e1 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:38.866735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fac21cb-ae95-466b-8752-0a8748e3f3e1 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:38.984853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:39.036129 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2fac21cb-ae95-466b-8752-0a8748e3f3e1 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e/action" status: 202 len: 0 microversion: 2.25 time: 0.199151 Aug 27 04:53:39.037291 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 268/552] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 04:53:38 2022] POST /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:53:39.043074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-988544802", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4fe81053-9d62-48f5-a301-6d865ee72ba0"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:39.152416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:53:39.419178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Building network info cache for instance {{(pid=128548) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:53:39.762785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:53:39.762785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:53:39.762785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:53:39.764135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:53:39.764322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:53:39.800351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:39.800848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:39.801290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:39.802024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:39.804720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:39.808506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:39.841845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:39.848536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:39.863608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Going to run 2 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:53:39.866345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:53:39.970389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:39.983016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:40.054712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:40.067950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:40.102093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=8f0c7f12-e408-4c56-911d-df18d1064e61,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:53:40.223140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:40.232015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:40.313769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:40.331696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'server_group_members'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:40.385153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Updating instance_info_cache with network_info: [{"id": "d2ef900d-23fd-47bd-9461-d82bd76c45a0", "address": "fa:16:3e:ba:3f:20", "network": {"id": "71a3611e-27fd-46d0-9b26-df83ee6c57af", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-315764033-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0088fd72e34f43fa97050fd334f61ea6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2ef900d-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128548) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:53:40.395101 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-25f28946-5657-451f-abc6-268be28f5c3e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.356335 Aug 27 04:53:40.403032 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 269/553] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:53:39 2022] POST /compute/v2.1/servers => generated 32 bytes in 1365 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:53:40.413672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Releasing lock "refresh_cache-3cb98f2a-181a-4dd0-b454-8adec268f65f" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:53:40.414523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-062e5dac-9193-4a3f-831b-f30074230100 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:40.414657 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-67206d1b-5ab3-45e4-9556-8ba859600fa8 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "POST /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f/action" status: 202 len: 0 microversion: 2.1 time: 3.367187 Aug 27 04:53:40.415190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-062e5dac-9193-4a3f-831b-f30074230100 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:40.415700 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 285/554] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:37 2022] POST /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f/action => generated 0 bytes in 3369 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:53:40.427024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-423b93b0-9a48-4c19-beda-3a4d0ed61e86 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:40.428426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-423b93b0-9a48-4c19-beda-3a4d0ed61e86 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:40.438316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-062e5dac-9193-4a3f-831b-f30074230100 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.440124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-062e5dac-9193-4a3f-831b-f30074230100 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.440771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-062e5dac-9193-4a3f-831b-f30074230100 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.441682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-062e5dac-9193-4a3f-831b-f30074230100 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.442298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-062e5dac-9193-4a3f-831b-f30074230100 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.442886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-062e5dac-9193-4a3f-831b-f30074230100 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.444009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423b93b0-9a48-4c19-beda-3a4d0ed61e86 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.444692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423b93b0-9a48-4c19-beda-3a4d0ed61e86 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.445284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423b93b0-9a48-4c19-beda-3a4d0ed61e86 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.446151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423b93b0-9a48-4c19-beda-3a4d0ed61e86 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.446753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423b93b0-9a48-4c19-beda-3a4d0ed61e86 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.447725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423b93b0-9a48-4c19-beda-3a4d0ed61e86 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.629387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-423b93b0-9a48-4c19-beda-3a4d0ed61e86 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:40.666846 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-423b93b0-9a48-4c19-beda-3a4d0ed61e86 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1937 microversion: 2.75 time: 0.249707 Aug 27 04:53:40.679658 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 286/555] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:40 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1937 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:40.707492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-35a80109-f3b4-4bd2-87eb-f230bc7dc5bc req-0a5ee8a6-5c62-413e-b228-f8b99bf5369b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb98f2a-181a-4dd0-b454-8adec268f65f", "tag": "d2ef900d-23fd-47bd-9461-d82bd76c45a0"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:40.730144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-35a80109-f3b4-4bd2-87eb-f230bc7dc5bc req-0a5ee8a6-5c62-413e-b228-f8b99bf5369b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.730639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-35a80109-f3b4-4bd2-87eb-f230bc7dc5bc req-0a5ee8a6-5c62-413e-b228-f8b99bf5369b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.736026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-35a80109-f3b4-4bd2-87eb-f230bc7dc5bc req-0a5ee8a6-5c62-413e-b228-f8b99bf5369b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.762000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-062e5dac-9193-4a3f-831b-f30074230100 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid 36549027-8a9f-4d92-8525-bdd6fa5ed50e {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:40.768012 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-35a80109-f3b4-4bd2-87eb-f230bc7dc5bc req-0a5ee8a6-5c62-413e-b228-f8b99bf5369b service nova] Creating event network-changed:d2ef900d-23fd-47bd-9461-d82bd76c45a0 for instance 3cb98f2a-181a-4dd0-b454-8adec268f65f on n-h1-820368-35 Aug 27 04:53:40.780716 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-062e5dac-9193-4a3f-831b-f30074230100 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 2038 microversion: 2.25 time: 0.374896 Aug 27 04:53:40.781308 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 270/556] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:40 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 2038 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:40.782271 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-35a80109-f3b4-4bd2-87eb-f230bc7dc5bc req-0a5ee8a6-5c62-413e-b228-f8b99bf5369b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101214 Aug 27 04:53:40.783316 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 287/557] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:40.791318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ea1dcf60-5449-4002-a72a-a7a6c39063a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:40.792442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ea1dcf60-5449-4002-a72a-a7a6c39063a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:40.793091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9872e616-d4e0-4f6e-b21d-b406b818cdcc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:40.800056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea1dcf60-5449-4002-a72a-a7a6c39063a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.801168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea1dcf60-5449-4002-a72a-a7a6c39063a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.802225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea1dcf60-5449-4002-a72a-a7a6c39063a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.803191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea1dcf60-5449-4002-a72a-a7a6c39063a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.803909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea1dcf60-5449-4002-a72a-a7a6c39063a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.804498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea1dcf60-5449-4002-a72a-a7a6c39063a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.805099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9872e616-d4e0-4f6e-b21d-b406b818cdcc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:40.807044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9872e616-d4e0-4f6e-b21d-b406b818cdcc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Searching by: {'deleted': False, 'project_id': '4074bf02227441b091b6e7d62f83b9e0'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:53:40.841562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9872e616-d4e0-4f6e-b21d-b406b818cdcc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.847417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9872e616-d4e0-4f6e-b21d-b406b818cdcc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.848043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9872e616-d4e0-4f6e-b21d-b406b818cdcc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.848929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9872e616-d4e0-4f6e-b21d-b406b818cdcc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.849703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9872e616-d4e0-4f6e-b21d-b406b818cdcc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.850000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9872e616-d4e0-4f6e-b21d-b406b818cdcc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.906568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-9872e616-d4e0-4f6e-b21d-b406b818cdcc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:53:40.952614 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9872e616-d4e0-4f6e-b21d-b406b818cdcc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.168079 Aug 27 04:53:40.961249 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 288/558] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 04:53:40 2022] GET /compute/v2.1/servers => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:40.970933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:40.972323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:40.980785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.982323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.983273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.984258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.985507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.986098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.995015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ea1dcf60-5449-4002-a72a-a7a6c39063a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:41.004738 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ea1dcf60-5449-4002-a72a-a7a6c39063a0 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1278 microversion: 2.1 time: 0.221922 Aug 27 04:53:41.014274 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] HTTP exception thrown: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Request method failure captured: Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 HTTP/1.1 Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMPYWBJpVa-CaOasAHwBZpaZbOWam1ZW0rrBx-sBW_Uk-fny0wlQUfO9-lJmehUOnPWhB_mpIQsllrAjZrkhOnS69ICjAn53AriKEde4oonJqYR_OdcAUqL_wfbAVjZ0rlG4wXDxi-FZlf6N2SDUP7tWD61_A0fDqKxLHASHdDeKvo Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 0088fd72e34f43fa97050fd334f61ea6 Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:53:41.016157 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0088fd72e34f43fa97050fd334f61ea6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 0088fd72e34f43fa97050fd334f61ea6 Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FloatingIPsAssociationTestJSON-21290556-project Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ce1a0cee656e407a98b414918319c246 Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-21290556-project Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. Aug 27 04:53:41.037730 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '503ce154-c117-40cb-bde8-137c354ee752'} Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:41.039463 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. Aug 27 04:53:41.041135 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:41.042541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Returning 404 to user: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:41.042541 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-43b8c4b1-e738-422b-9981-51159b9a8275 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "DELETE /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 404 len: 111 microversion: 2.1 time: 0.054664 Aug 27 04:53:41.042709 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 271/560] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:40 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1278 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:41.042805 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 289/560] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:53:40 2022] DELETE /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:41.042805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3e433f00-093c-4122-b091-69487fdfe7cf tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:41.042805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3e433f00-093c-4122-b091-69487fdfe7cf tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:41.045914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b12adca-09d4-4392-b404-fbc931ebba51 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-820368-35", "block_migration": "auto"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:41.049961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b12adca-09d4-4392-b404-fbc931ebba51 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:41.068144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b12adca-09d4-4392-b404-fbc931ebba51 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:41.068865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b12adca-09d4-4392-b404-fbc931ebba51 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:41.069792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b12adca-09d4-4392-b404-fbc931ebba51 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:41.072129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b12adca-09d4-4392-b404-fbc931ebba51 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:41.077037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b12adca-09d4-4392-b404-fbc931ebba51 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:41.077623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b12adca-09d4-4392-b404-fbc931ebba51 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:41.146206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-2b12adca-09d4-4392-b404-fbc931ebba51 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'flavor' on Instance uuid 36549027-8a9f-4d92-8525-bdd6fa5ed50e {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:41.181434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b12adca-09d4-4392-b404-fbc931ebba51 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Going to try to live migrate instance to n-h1-820368-35 {{(pid=128547) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:53:41.239701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3e433f00-093c-4122-b091-69487fdfe7cf tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:41.252714 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3e433f00-093c-4122-b091-69487fdfe7cf tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1218 microversion: 2.1 time: 0.225405 Aug 27 04:53:41.253470 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 290/561] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:41 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:41.264021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:41.277928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 503ce154-c117-40cb-bde8-137c354ee752] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:41.306899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:41.307429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:41.307863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:41.316402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:41.317120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:41.323775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:41.373347 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] HTTP exception thrown: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Request method failure captured: Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 HTTP/1.1 Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMPYWBJpVa-CaOasAHwBZpaZbOWam1ZW0rrBx-sBW_Uk-fny0wlQUfO9-lJmehUOnPWhB_mpIQsllrAjZrkhOnS69ICjAn53AriKEde4oonJqYR_OdcAUqL_wfbAVjZ0rlG4wXDxi-FZlf6N2SDUP7tWD61_A0fDqKxLHASHdDeKvo Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 0088fd72e34f43fa97050fd334f61ea6 Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:53:41.394709 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0088fd72e34f43fa97050fd334f61ea6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 0088fd72e34f43fa97050fd334f61ea6 Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FloatingIPsAssociationTestJSON-21290556-project Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ce1a0cee656e407a98b414918319c246 Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-21290556-project Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. Aug 27 04:53:41.396360 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '503ce154-c117-40cb-bde8-137c354ee752'} Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:41.397325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. Aug 27 04:53:41.398470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:41.406082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Returning 404 to user: Instance 503ce154-c117-40cb-bde8-137c354ee752 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:41.407032 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c9468fd0-7f33-41c9-bbd9-3d813c5f360e tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752" status: 404 len: 111 microversion: 2.1 time: 0.152169 Aug 27 04:53:41.408028 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 291/562] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:41 2022] GET /compute/v2.1/servers/503ce154-c117-40cb-bde8-137c354ee752 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:41.420604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-42fcc42e-e82b-47e8-bf36-7ed19c22ae8a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '.version_select at 0x7fb565612d30>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:43.458114 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b12adca-09d4-4392-b404-fbc931ebba51 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e/action" status: 202 len: 0 microversion: 2.25 time: 2.430988 Aug 27 04:53:43.459366 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 272/563] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 04:53:41 2022] POST /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e/action => generated 0 bytes in 2433 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:53:43.470278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-04d0c289-1307-4d4a-9736-96ad66339a87 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:43.471236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-04d0c289-1307-4d4a-9736-96ad66339a87 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:43.492297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04d0c289-1307-4d4a-9736-96ad66339a87 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.499845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04d0c289-1307-4d4a-9736-96ad66339a87 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.500583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04d0c289-1307-4d4a-9736-96ad66339a87 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.502159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04d0c289-1307-4d4a-9736-96ad66339a87 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.502159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04d0c289-1307-4d4a-9736-96ad66339a87 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.503930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04d0c289-1307-4d4a-9736-96ad66339a87 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.720036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-04d0c289-1307-4d4a-9736-96ad66339a87 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] Lazy-loading 'services' on Instance uuid 7b8912f4-0d26-4213-a195-1826c6cfd949 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:43.761892 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-04d0c289-1307-4d4a-9736-96ad66339a87 tempest-ServersAdmin275Test-1101525459 tempest-ServersAdmin275Test-1101525459-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1922 microversion: 2.75 time: 0.297441 Aug 27 04:53:43.765440 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 273/564] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:43 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1922 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:43.775841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-37effb74-e638-415d-9a31-95cf5856c706 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:43.776957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-37effb74-e638-415d-9a31-95cf5856c706 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:43.807491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37effb74-e638-415d-9a31-95cf5856c706 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.808203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37effb74-e638-415d-9a31-95cf5856c706 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.812001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37effb74-e638-415d-9a31-95cf5856c706 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.813163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37effb74-e638-415d-9a31-95cf5856c706 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.813840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37effb74-e638-415d-9a31-95cf5856c706 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.814963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37effb74-e638-415d-9a31-95cf5856c706 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.886352 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-42fcc42e-e82b-47e8-bf36-7ed19c22ae8a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/754ee238-562c-4a17-bc34-bebeb9910a1e" status: 202 len: 0 microversion: 2.1 time: 2.469958 Aug 27 04:53:43.888112 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 292/565] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 04:53:41 2022] DELETE /compute/v2.1/os-floating-ips/754ee238-562c-4a17-bc34-bebeb9910a1e => generated 0 bytes in 2472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:53:43.893404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1ebce390-6774-4345-a3ab-30f74bdbeb49 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:43.894512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1ebce390-6774-4345-a3ab-30f74bdbeb49 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:43.914938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ebce390-6774-4345-a3ab-30f74bdbeb49 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.917791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ebce390-6774-4345-a3ab-30f74bdbeb49 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.923183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ebce390-6774-4345-a3ab-30f74bdbeb49 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.925824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ebce390-6774-4345-a3ab-30f74bdbeb49 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.927711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ebce390-6774-4345-a3ab-30f74bdbeb49 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.930154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ebce390-6774-4345-a3ab-30f74bdbeb49 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.170914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1ebce390-6774-4345-a3ab-30f74bdbeb49 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:44.181366 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1ebce390-6774-4345-a3ab-30f74bdbeb49 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1276 microversion: 2.1 time: 0.289844 Aug 27 04:53:44.183159 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 293/566] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:43 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1276 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:44.193881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:44.195910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:44.212075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.215480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.216172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.219513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.220090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.221124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.285483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-37effb74-e638-415d-9a31-95cf5856c706 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:44.298386 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-37effb74-e638-415d-9a31-95cf5856c706 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1320 microversion: 2.1 time: 0.531491 Aug 27 04:53:44.302205 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 274/567] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:43 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1320 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:44.338454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-845f2dc3-761f-46b8-993e-35b20c068752 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:44.338964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-845f2dc3-761f-46b8-993e-35b20c068752 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:44.353981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-845f2dc3-761f-46b8-993e-35b20c068752 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.354415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-845f2dc3-761f-46b8-993e-35b20c068752 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.354858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-845f2dc3-761f-46b8-993e-35b20c068752 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.362772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-845f2dc3-761f-46b8-993e-35b20c068752 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.363318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-845f2dc3-761f-46b8-993e-35b20c068752 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.363764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-845f2dc3-761f-46b8-993e-35b20c068752 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.424457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-845f2dc3-761f-46b8-993e-35b20c068752 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:53:44.538209 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-845f2dc3-761f-46b8-993e-35b20c068752 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 204 len: 0 microversion: 2.75 time: 0.206917 Aug 27 04:53:44.545220 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 275/568] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:53:44 2022] DELETE /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:53:44.560717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-013f787b-1409-42ce-bf37-45cc383989cf tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:44.563218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-013f787b-1409-42ce-bf37-45cc383989cf tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:44.578484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-013f787b-1409-42ce-bf37-45cc383989cf tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.578484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-013f787b-1409-42ce-bf37-45cc383989cf tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.583878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-013f787b-1409-42ce-bf37-45cc383989cf tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.585124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-013f787b-1409-42ce-bf37-45cc383989cf tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.585363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-013f787b-1409-42ce-bf37-45cc383989cf tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.585845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-013f787b-1409-42ce-bf37-45cc383989cf tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.638717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-013f787b-1409-42ce-bf37-45cc383989cf tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:53:44.784268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:44.798990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:44.803860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:44.808435 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eb681048-8264-4789-90f5-1123973703b5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 0.624161 Aug 27 04:53:44.810656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:44.811422 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 294/569] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:44 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:44.819515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:44.820613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:44.829827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.830861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.832523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.833655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.834683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.836395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.850211 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-013f787b-1409-42ce-bf37-45cc383989cf tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 204 len: 0 microversion: 2.1 time: 0.301538 Aug 27 04:53:44.851467 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 276/570] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:53:44 2022] DELETE /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:53:44.860630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8a5b71b4-a81c-4874-bfde-8ea8fd9f841a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:44.861731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8a5b71b4-a81c-4874-bfde-8ea8fd9f841a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:44.874198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a5b71b4-a81c-4874-bfde-8ea8fd9f841a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.875645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a5b71b4-a81c-4874-bfde-8ea8fd9f841a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.876891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a5b71b4-a81c-4874-bfde-8ea8fd9f841a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.880566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a5b71b4-a81c-4874-bfde-8ea8fd9f841a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.881316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a5b71b4-a81c-4874-bfde-8ea8fd9f841a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.882172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a5b71b4-a81c-4874-bfde-8ea8fd9f841a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:45.394032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:45.426290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:45.431624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:45.443820 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7938a103-c682-45b2-a5c8-5bb0ab33acc2 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1444 microversion: 2.75 time: 0.631155 Aug 27 04:53:45.444428 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 295/571] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:44 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1444 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:45.449421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-417fd9fb-4622-4785-befc-4e029b207694 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:45.456126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-417fd9fb-4622-4785-befc-4e029b207694 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:45.470739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-417fd9fb-4622-4785-befc-4e029b207694 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:45.476051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-417fd9fb-4622-4785-befc-4e029b207694 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:45.476748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-417fd9fb-4622-4785-befc-4e029b207694 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:45.478851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-417fd9fb-4622-4785-befc-4e029b207694 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:45.479528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-417fd9fb-4622-4785-befc-4e029b207694 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:45.480112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-417fd9fb-4622-4785-befc-4e029b207694 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:45.905423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-417fd9fb-4622-4785-befc-4e029b207694 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:45.913291 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-417fd9fb-4622-4785-befc-4e029b207694 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1318 microversion: 2.1 time: 0.467463 Aug 27 04:53:45.914733 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 296/572] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:45 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:45.919789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9863087-c4a4-4dda-8665-39e9ca038de7 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:45.923824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c9863087-c4a4-4dda-8665-39e9ca038de7 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:45.931995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8a5b71b4-a81c-4874-bfde-8ea8fd9f841a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:45.946612 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8a5b71b4-a81c-4874-bfde-8ea8fd9f841a tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1525 microversion: 2.1 time: 1.090678 Aug 27 04:53:45.950529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9863087-c4a4-4dda-8665-39e9ca038de7 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:45.951879 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 277/573] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:44 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1525 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:45.953231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9863087-c4a4-4dda-8665-39e9ca038de7 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:45.955018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9863087-c4a4-4dda-8665-39e9ca038de7 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:45.956078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9863087-c4a4-4dda-8665-39e9ca038de7 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:45.956791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9863087-c4a4-4dda-8665-39e9ca038de7 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:45.957425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9863087-c4a4-4dda-8665-39e9ca038de7 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:45.970150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:45.970840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:45.981525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:45.982434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:45.983424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:45.984454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:45.985154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:45.986058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:46.390849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c9863087-c4a4-4dda-8665-39e9ca038de7 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:46.391721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:46.399839 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c9863087-c4a4-4dda-8665-39e9ca038de7 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1320 microversion: 2.1 time: 0.483789 Aug 27 04:53:46.406581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:46.408106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:46.409723 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a74d8525-de18-4ad4-9b98-801c836cb844 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 0.455251 Aug 27 04:53:46.410801 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 278/574] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:45 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:46.412941 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 297/575] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:45 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:46.475561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:46.476216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:46.483186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:46.483949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:46.484391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:46.485112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:46.485623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:46.486232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:46.587843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:46.601660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:46.623361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:46.638379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b28f7bfa194488f92f834e9fd6a2425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acba01e0a94222a710cc9d02258b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:46.660965 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a5796213-aa51-4714-a645-0f1981fc4a45 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 200 len: 1444 microversion: 2.75 time: 0.190387 Aug 27 04:53:46.662069 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 279/576] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:46 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 1444 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:46.938618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8838b660-4e1c-4b7f-bfaa-31934757112d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:46.939167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8838b660-4e1c-4b7f-bfaa-31934757112d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:46.957099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8838b660-4e1c-4b7f-bfaa-31934757112d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:46.958368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8838b660-4e1c-4b7f-bfaa-31934757112d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:46.958799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8838b660-4e1c-4b7f-bfaa-31934757112d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:46.959729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8838b660-4e1c-4b7f-bfaa-31934757112d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:46.960185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8838b660-4e1c-4b7f-bfaa-31934757112d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:46.960604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8838b660-4e1c-4b7f-bfaa-31934757112d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:46.972818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a421ed7d-9a4d-4494-ac7d-ffec4369c83f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:46.973432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a421ed7d-9a4d-4494-ac7d-ffec4369c83f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:46.982780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a421ed7d-9a4d-4494-ac7d-ffec4369c83f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:46.993293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a421ed7d-9a4d-4494-ac7d-ffec4369c83f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:46.993978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a421ed7d-9a4d-4494-ac7d-ffec4369c83f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:46.999170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a421ed7d-9a4d-4494-ac7d-ffec4369c83f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:47.000739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a421ed7d-9a4d-4494-ac7d-ffec4369c83f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:47.001447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a421ed7d-9a4d-4494-ac7d-ffec4369c83f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:47.924607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8838b660-4e1c-4b7f-bfaa-31934757112d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:47.933442 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8838b660-4e1c-4b7f-bfaa-31934757112d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1318 microversion: 2.1 time: 0.999167 Aug 27 04:53:47.944155 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 298/577] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:46 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1318 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:47.958985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-852acdbe-c90d-4e9f-bef9-a50776520941 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:47.959980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-852acdbe-c90d-4e9f-bef9-a50776520941 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:47.974226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a421ed7d-9a4d-4494-ac7d-ffec4369c83f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:47.985576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-852acdbe-c90d-4e9f-bef9-a50776520941 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:47.987818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-852acdbe-c90d-4e9f-bef9-a50776520941 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:47.988497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-852acdbe-c90d-4e9f-bef9-a50776520941 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:47.988917 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a421ed7d-9a4d-4494-ac7d-ffec4369c83f tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1525 microversion: 2.1 time: 1.018193 Aug 27 04:53:48.004261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-852acdbe-c90d-4e9f-bef9-a50776520941 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.004740 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 280/578] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:46 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1525 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:48.009747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:48.010562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-852acdbe-c90d-4e9f-bef9-a50776520941 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.011259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-852acdbe-c90d-4e9f-bef9-a50776520941 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:48.018592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:48.042562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.043438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.044236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:48.045353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.055129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.058414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:48.646108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:48.654819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-852acdbe-c90d-4e9f-bef9-a50776520941 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:48.657497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:48.659318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:48.660836 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6352e7ee-7999-42a5-813b-fad717e34e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 0.654970 Aug 27 04:53:48.665315 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-852acdbe-c90d-4e9f-bef9-a50776520941 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1320 microversion: 2.1 time: 0.719706 Aug 27 04:53:48.666613 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 299/579] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:47 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1320 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:48.677801 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 281/580] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:48 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:48.683233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-844e52c3-18da-4e5b-b749-68b235c6df7f req-a9c20475-4723-48a4-aec2-b0ba32598a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2661a725-4e21-43b0-a754-44a4d7089111", "tag": "f2503f63-abb6-4c6d-8386-a81b301071ba"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:48.684334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:48.684448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] [instance: 7b8912f4-0d26-4213-a195-1826c6cfd949] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:48.694976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.695889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-844e52c3-18da-4e5b-b749-68b235c6df7f req-a9c20475-4723-48a4-aec2-b0ba32598a7c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.696040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.696643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:48.697121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-844e52c3-18da-4e5b-b749-68b235c6df7f req-a9c20475-4723-48a4-aec2-b0ba32598a7c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.697367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.697959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.698437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-844e52c3-18da-4e5b-b749-68b235c6df7f req-a9c20475-4723-48a4-aec2-b0ba32598a7c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:48.698553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:48.723864 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-844e52c3-18da-4e5b-b749-68b235c6df7f req-a9c20475-4723-48a4-aec2-b0ba32598a7c service nova] Creating event network-changed:f2503f63-abb6-4c6d-8386-a81b301071ba for instance 2661a725-4e21-43b0-a754-44a4d7089111 on n-h1-820368-35 Aug 27 04:53:48.740029 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] HTTP exception thrown: Instance 7b8912f4-0d26-4213-a195-1826c6cfd949 could not be found. Aug 27 04:53:48.740477 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-844e52c3-18da-4e5b-b749-68b235c6df7f req-a9c20475-4723-48a4-aec2-b0ba32598a7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056345 Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Request method failure captured: Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 HTTP/1.1 Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMAt4Bil7Jf9FpPgBkLdOWJHi40GNog0G64QO8V65YRHDVqkrVzGAj-Npe7qqvoMo6S2HZKoqoFxXzoiBRgs20rM7FuNcn9f9z5iGQFldMY4hD3bL502KEpzu68UuvKX4XQ3lSD0H7LJ2Kggb-kP1W7EhudWvH_9oKgQXoB2P4Sg8s Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.75 Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c2acba01e0a94222a710cc9d02258b79 Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersAdmin275Test-432378177 Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:53:48.742728 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c2acba01e0a94222a710cc9d02258b79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c2acba01e0a94222a710cc9d02258b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c2acba01e0a94222a710cc9d02258b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c2acba01e0a94222a710cc9d02258b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersAdmin275Test-432378177 Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c2acba01e0a94222a710cc9d02258b79 Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersAdmin275Test-432378177 Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersAdmin275Test-432378177-project Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 1b28f7bfa194488f92f834e9fd6a2425 Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersAdmin275Test-432378177-project Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 7b8912f4-0d26-4213-a195-1826c6cfd949 could not be found. Aug 27 04:53:48.744532 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '7b8912f4-0d26-4213-a195-1826c6cfd949'} Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b8912f4-0d26-4213-a195-1826c6cfd949 could not be found. Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:48.745298 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b8912f4-0d26-4213-a195-1826c6cfd949 could not be found. Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b8912f4-0d26-4213-a195-1826c6cfd949 could not be found. Aug 27 04:53:48.746862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:48.748122 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 282/581] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:48.748873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] Returning 404 to user: Instance 7b8912f4-0d26-4213-a195-1826c6cfd949 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:48.750994 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-857b7c06-e46e-478c-9035-d336859bbbb5 tempest-ServersAdmin275Test-432378177 tempest-ServersAdmin275Test-432378177-project] 10.222.0.58 "GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949" status: 404 len: 111 microversion: 2.75 time: 0.080652 Aug 27 04:53:48.753221 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 300/582] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:48 2022] GET /compute/v2.1/servers/7b8912f4-0d26-4213-a195-1826c6cfd949 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:53:48.979897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-25616ac4-ad64-4e13-a61a-f26edff72d0a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:48.981226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25616ac4-ad64-4e13-a61a-f26edff72d0a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:48.993525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25616ac4-ad64-4e13-a61a-f26edff72d0a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.994100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25616ac4-ad64-4e13-a61a-f26edff72d0a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.995671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25616ac4-ad64-4e13-a61a-f26edff72d0a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:48.997106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25616ac4-ad64-4e13-a61a-f26edff72d0a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.997791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25616ac4-ad64-4e13-a61a-f26edff72d0a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.998382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25616ac4-ad64-4e13-a61a-f26edff72d0a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:49.015216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b6acfc6-8c21-4f8d-8ab2-f8b92e59bf79 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:49.017034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3b6acfc6-8c21-4f8d-8ab2-f8b92e59bf79 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:49.029346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b6acfc6-8c21-4f8d-8ab2-f8b92e59bf79 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:49.032107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b6acfc6-8c21-4f8d-8ab2-f8b92e59bf79 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:49.035483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b6acfc6-8c21-4f8d-8ab2-f8b92e59bf79 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:49.036418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b6acfc6-8c21-4f8d-8ab2-f8b92e59bf79 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:49.037044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b6acfc6-8c21-4f8d-8ab2-f8b92e59bf79 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:49.039325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b6acfc6-8c21-4f8d-8ab2-f8b92e59bf79 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:49.706838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-25616ac4-ad64-4e13-a61a-f26edff72d0a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:49.726563 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-25616ac4-ad64-4e13-a61a-f26edff72d0a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1318 microversion: 2.1 time: 0.760783 Aug 27 04:53:49.729091 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 283/583] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:48 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1318 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:49.741676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2972549b-6794-402e-8b7e-c6ee4321edd9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:49.743565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2972549b-6794-402e-8b7e-c6ee4321edd9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:49.759635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2972549b-6794-402e-8b7e-c6ee4321edd9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:49.760084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2972549b-6794-402e-8b7e-c6ee4321edd9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:49.760650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2972549b-6794-402e-8b7e-c6ee4321edd9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:49.761380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2972549b-6794-402e-8b7e-c6ee4321edd9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:49.761838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2972549b-6794-402e-8b7e-c6ee4321edd9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:49.762311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2972549b-6794-402e-8b7e-c6ee4321edd9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:49.818320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:49.882153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3b6acfc6-8c21-4f8d-8ab2-f8b92e59bf79 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:49.891875 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3b6acfc6-8c21-4f8d-8ab2-f8b92e59bf79 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1525 microversion: 2.1 time: 0.885698 Aug 27 04:53:49.893525 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 301/584] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:49 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1525 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:49.913501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:49.914409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:49.953268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:49.953970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:49.954427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:49.967225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:49.967930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:49.968618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:50.348749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=32 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:50.598432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2972549b-6794-402e-8b7e-c6ee4321edd9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:50.612439 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2972549b-6794-402e-8b7e-c6ee4321edd9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1320 microversion: 2.1 time: 0.874186 Aug 27 04:53:50.617352 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 284/585] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:49 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1320 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:50.759044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a8feb944-690d-43cf-b965-48a330ca649e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:50.763684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a8feb944-690d-43cf-b965-48a330ca649e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:50.785204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8feb944-690d-43cf-b965-48a330ca649e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:50.785710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8feb944-690d-43cf-b965-48a330ca649e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:50.786154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8feb944-690d-43cf-b965-48a330ca649e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:50.786881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8feb944-690d-43cf-b965-48a330ca649e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:50.787365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8feb944-690d-43cf-b965-48a330ca649e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:50.787794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8feb944-690d-43cf-b965-48a330ca649e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:50.860476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:50.958669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:50.973995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:50.976119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:50.977871 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f0f19794-4317-4adb-8df9-6899a8670773 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 1.082907 Aug 27 04:53:50.980851 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 302/586] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:49 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:50.987777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:50.988781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:51.000661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:51.003007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:51.003007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:51.005966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:51.006757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:51.007840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:51.063945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:51.064500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:51.064868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:51.065327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lazy-loading 'fault' on Instance uuid 3cb98f2a-181a-4dd0-b454-8adec268f65f {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:51.193501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:51.216480 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-493a53b3-72a8-4431-ad3e-8e8dad58e22c tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1314 microversion: 2.1 time: 0.230726 Aug 27 04:53:51.226624 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 303/587] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:50 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:51.241300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c6a865c9-7145-4c05-8627-79718547934a req-298e7ad8-f05a-4606-a70d-8c5d09f367d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f37868-9c79-436c-8fc3-295e678cb656", "tag": "db4f91f2-079f-42ab-b80a-082ab7b26351"}, {"server_uuid": "3cb98f2a-181a-4dd0-b454-8adec268f65f", "name": "network-vif-deleted", "tag": "d2ef900d-23fd-47bd-9461-d82bd76c45a0"}, {"server_uuid": "36549027-8a9f-4d92-8525-bdd6fa5ed50e", "name": "network-vif-unplugged", "status": "completed", "tag": "6db9659b-7f15-473d-b767-a63311e81850"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:51.270104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=10 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:51.276186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c6a865c9-7145-4c05-8627-79718547934a req-298e7ad8-f05a-4606-a70d-8c5d09f367d5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:51.279558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c6a865c9-7145-4c05-8627-79718547934a req-298e7ad8-f05a-4606-a70d-8c5d09f367d5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:51.280254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c6a865c9-7145-4c05-8627-79718547934a req-298e7ad8-f05a-4606-a70d-8c5d09f367d5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:51.284347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a8feb944-690d-43cf-b965-48a330ca649e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:51.296501 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a8feb944-690d-43cf-b965-48a330ca649e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1318 microversion: 2.1 time: 0.549697 Aug 27 04:53:51.300324 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 285/588] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:50 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:51.314554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9eb9867e-a3ab-4b21-990d-9d6724041106 req-68089449-161d-486a-a877-d2283e788c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0c7f12-e408-4c56-911d-df18d1064e61", "tag": "378e16c7-73cf-4379-9ce3-5ce58609cf51"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:51.329580 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c6a865c9-7145-4c05-8627-79718547934a req-298e7ad8-f05a-4606-a70d-8c5d09f367d5 service nova] Creating event network-changed:db4f91f2-079f-42ab-b80a-082ab7b26351 for instance 69f37868-9c79-436c-8fc3-295e678cb656 on n-h2-820368-35 Aug 27 04:53:51.330382 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c6a865c9-7145-4c05-8627-79718547934a req-298e7ad8-f05a-4606-a70d-8c5d09f367d5 service nova] Creating event network-vif-deleted:d2ef900d-23fd-47bd-9461-d82bd76c45a0 for instance 3cb98f2a-181a-4dd0-b454-8adec268f65f on n-h1-820368-35 Aug 27 04:53:51.332709 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c6a865c9-7145-4c05-8627-79718547934a req-298e7ad8-f05a-4606-a70d-8c5d09f367d5 service nova] Creating event network-vif-unplugged:6db9659b-7f15-473d-b767-a63311e81850 for instance 36549027-8a9f-4d92-8525-bdd6fa5ed50e on n-h2-820368-35 Aug 27 04:53:51.348213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9eb9867e-a3ab-4b21-990d-9d6724041106 req-68089449-161d-486a-a877-d2283e788c00 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:51.350753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9eb9867e-a3ab-4b21-990d-9d6724041106 req-68089449-161d-486a-a877-d2283e788c00 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:51.352169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9eb9867e-a3ab-4b21-990d-9d6724041106 req-68089449-161d-486a-a877-d2283e788c00 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:51.366967 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c6a865c9-7145-4c05-8627-79718547934a req-298e7ad8-f05a-4606-a70d-8c5d09f367d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.137195 Aug 27 04:53:51.368425 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 304/589] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:51.383617 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9eb9867e-a3ab-4b21-990d-9d6724041106 req-68089449-161d-486a-a877-d2283e788c00 service nova] Creating event network-changed:378e16c7-73cf-4379-9ce3-5ce58609cf51 for instance 8f0c7f12-e408-4c56-911d-df18d1064e61 on n-h1-820368-35 Aug 27 04:53:51.398825 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9eb9867e-a3ab-4b21-990d-9d6724041106 req-68089449-161d-486a-a877-d2283e788c00 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094583 Aug 27 04:53:51.401703 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 286/590] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:51.641487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-097fa1f0-eed6-4b01-9af6-f47478812736 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:51.642544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-097fa1f0-eed6-4b01-9af6-f47478812736 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:51.658849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-097fa1f0-eed6-4b01-9af6-f47478812736 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:51.660215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-097fa1f0-eed6-4b01-9af6-f47478812736 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:51.660816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-097fa1f0-eed6-4b01-9af6-f47478812736 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:51.662897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-097fa1f0-eed6-4b01-9af6-f47478812736 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:51.665501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-097fa1f0-eed6-4b01-9af6-f47478812736 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:51.666674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-097fa1f0-eed6-4b01-9af6-f47478812736 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:51.755521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:51.959505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-097fa1f0-eed6-4b01-9af6-f47478812736 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:51.970087 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-097fa1f0-eed6-4b01-9af6-f47478812736 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1320 microversion: 2.1 time: 0.334043 Aug 27 04:53:51.971018 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 305/591] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:51 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1320 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:52.003822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:52.004861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:52.020773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:52.022953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:52.023712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:52.025202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:52.026072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:52.027050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:52.239465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:52.240547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:52.252779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:52.253291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:52.254139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:52.254874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:52.255363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:52.255797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:52.339956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:52.340495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:52.340936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:52.344261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lazy-loading 'fault' on Instance uuid 3cb98f2a-181a-4dd0-b454-8adec268f65f {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:52.615573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:52.631791 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9aa3c5ef-5eca-4b7c-82df-9309e40cf506 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1314 microversion: 2.1 time: 0.396702 Aug 27 04:53:52.633081 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 306/592] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:52 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:52.642301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-47df2515-2f3e-4fb6-9aa4-a67544446eed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:52.646409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:52.647016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-47df2515-2f3e-4fb6-9aa4-a67544446eed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:52.655432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:52.656888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:52.658100 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6504f3e2-7091-492a-9009-bfbb6391d774 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 0.659276 Aug 27 04:53:52.658664 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 287/593] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:51 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:52.662733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47df2515-2f3e-4fb6-9aa4-a67544446eed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:52.663566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47df2515-2f3e-4fb6-9aa4-a67544446eed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:52.664167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47df2515-2f3e-4fb6-9aa4-a67544446eed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:52.665232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47df2515-2f3e-4fb6-9aa4-a67544446eed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:52.665843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47df2515-2f3e-4fb6-9aa4-a67544446eed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:52.666560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47df2515-2f3e-4fb6-9aa4-a67544446eed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:52.820169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-47df2515-2f3e-4fb6-9aa4-a67544446eed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:52.830061 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-47df2515-2f3e-4fb6-9aa4-a67544446eed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1318 microversion: 2.1 time: 0.195536 Aug 27 04:53:52.843917 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 307/594] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:52 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:52.993690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-39b6c8b2-dab5-496a-be87-38508aa36d2c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:52.994483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-39b6c8b2-dab5-496a-be87-38508aa36d2c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:53.003301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39b6c8b2-dab5-496a-be87-38508aa36d2c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:53.004070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39b6c8b2-dab5-496a-be87-38508aa36d2c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:53.004815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39b6c8b2-dab5-496a-be87-38508aa36d2c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:53.005684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39b6c8b2-dab5-496a-be87-38508aa36d2c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:53.006397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39b6c8b2-dab5-496a-be87-38508aa36d2c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:53.006976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39b6c8b2-dab5-496a-be87-38508aa36d2c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:53.297407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-39b6c8b2-dab5-496a-be87-38508aa36d2c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:53.311985 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-39b6c8b2-dab5-496a-be87-38508aa36d2c tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1320 microversion: 2.1 time: 0.322102 Aug 27 04:53:53.327515 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 288/595] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:52 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1320 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:53.550859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f2f04070-bfc6-46d4-9974-447fd1e36a51 req-91357541-d5b5-4e57-a860-fa7a19131521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36549027-8a9f-4d92-8525-bdd6fa5ed50e", "tag": "6db9659b-7f15-473d-b767-a63311e81850"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:53.586597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f2f04070-bfc6-46d4-9974-447fd1e36a51 req-91357541-d5b5-4e57-a860-fa7a19131521 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:53.591486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f2f04070-bfc6-46d4-9974-447fd1e36a51 req-91357541-d5b5-4e57-a860-fa7a19131521 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:53.592022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f2f04070-bfc6-46d4-9974-447fd1e36a51 req-91357541-d5b5-4e57-a860-fa7a19131521 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:53.654122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:53.654782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:53.663643 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f2f04070-bfc6-46d4-9974-447fd1e36a51 req-91357541-d5b5-4e57-a860-fa7a19131521 service nova] Creating event network-changed:6db9659b-7f15-473d-b767-a63311e81850 for instance 36549027-8a9f-4d92-8525-bdd6fa5ed50e on n-h2-820368-35 Aug 27 04:53:53.677724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:53.680631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:53.681098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:53.683468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:53.684626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:53.691502 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f2f04070-bfc6-46d4-9974-447fd1e36a51 req-91357541-d5b5-4e57-a860-fa7a19131521 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152862 Aug 27 04:53:53.693082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:53.697895 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 308/596] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:53.716699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:53.725375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:53.774400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:53.776136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:53.777315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:53.779784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:53.782710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:53.786555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:53.854034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:53.854863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:53.856895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:53.857995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lazy-loading 'fault' on Instance uuid 3cb98f2a-181a-4dd0-b454-8adec268f65f {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:54.035494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a0cee656e407a98b414918319c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0088fd72e34f43fa97050fd334f61ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:54.052797 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fcdee773-ff2f-4ab1-a0f6-637a6da90716 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 200 len: 1314 microversion: 2.1 time: 0.402194 Aug 27 04:53:54.055345 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 289/597] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:53 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:54.069306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3db99aee-8e54-4c10-a4df-ccd4aa6f75e0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:54.070388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3db99aee-8e54-4c10-a4df-ccd4aa6f75e0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:54.103003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db99aee-8e54-4c10-a4df-ccd4aa6f75e0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:54.103577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db99aee-8e54-4c10-a4df-ccd4aa6f75e0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:54.104988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db99aee-8e54-4c10-a4df-ccd4aa6f75e0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:54.107958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db99aee-8e54-4c10-a4df-ccd4aa6f75e0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:54.109381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db99aee-8e54-4c10-a4df-ccd4aa6f75e0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:54.110269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db99aee-8e54-4c10-a4df-ccd4aa6f75e0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:54.436227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:54.458202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:54.462421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:54.466266 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ab0cfcb3-4c60-4a1b-adf6-03bb23796f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 0.765781 Aug 27 04:53:54.472179 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 309/598] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:53 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:54.491271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5fb82316-14ae-4948-bfda-18854fb8d9f3 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:54.491271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5fb82316-14ae-4948-bfda-18854fb8d9f3 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:54.512482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb82316-14ae-4948-bfda-18854fb8d9f3 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:54.513190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb82316-14ae-4948-bfda-18854fb8d9f3 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:54.513808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb82316-14ae-4948-bfda-18854fb8d9f3 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:54.516616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb82316-14ae-4948-bfda-18854fb8d9f3 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:54.517289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb82316-14ae-4948-bfda-18854fb8d9f3 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:54.518996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb82316-14ae-4948-bfda-18854fb8d9f3 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:54.659184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3db99aee-8e54-4c10-a4df-ccd4aa6f75e0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:54.670483 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3db99aee-8e54-4c10-a4df-ccd4aa6f75e0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1318 microversion: 2.1 time: 0.612290 Aug 27 04:53:54.687349 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 290/599] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:54 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:55.043714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5fb82316-14ae-4948-bfda-18854fb8d9f3 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:55.061413 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5fb82316-14ae-4948-bfda-18854fb8d9f3 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1320 microversion: 2.1 time: 0.583293 Aug 27 04:53:55.063039 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 310/600] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:54 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1320 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:55.079428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:55.080043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] [instance: 3cb98f2a-181a-4dd0-b454-8adec268f65f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:55.097463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:55.097956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:55.098393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:55.099135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:55.099750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:55.100042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:55.145773 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] HTTP exception thrown: Instance 3cb98f2a-181a-4dd0-b454-8adec268f65f could not be found. Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Request method failure captured: Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f HTTP/1.1 Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMPYWBJpVa-CaOasAHwBZpaZbOWam1ZW0rrBx-sBW_Uk-fny0wlQUfO9-lJmehUOnPWhB_mpIQsllrAjZrkhOnS69ICjAn53AriKEde4oonJqYR_OdcAUqL_wfbAVjZ0rlG4wXDxi-FZlf6N2SDUP7tWD61_A0fDqKxLHASHdDeKvo Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 0088fd72e34f43fa97050fd334f61ea6 Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:53:55.168875 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0088fd72e34f43fa97050fd334f61ea6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0088fd72e34f43fa97050fd334f61ea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 0088fd72e34f43fa97050fd334f61ea6 Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-21290556 Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FloatingIPsAssociationTestJSON-21290556-project Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ce1a0cee656e407a98b414918319c246 Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-21290556-project Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 3cb98f2a-181a-4dd0-b454-8adec268f65f could not be found. Aug 27 04:53:55.170436 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '3cb98f2a-181a-4dd0-b454-8adec268f65f'} Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb98f2a-181a-4dd0-b454-8adec268f65f could not be found. Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:55.171323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb98f2a-181a-4dd0-b454-8adec268f65f could not be found. Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb98f2a-181a-4dd0-b454-8adec268f65f could not be found. Aug 27 04:53:55.172632 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.174733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] Returning 404 to user: Instance 3cb98f2a-181a-4dd0-b454-8adec268f65f could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:55.175813 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-10822f38-8a09-42a3-80aa-e0f85f5611a5 tempest-FloatingIPsAssociationTestJSON-21290556 tempest-FloatingIPsAssociationTestJSON-21290556-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f" status: 404 len: 111 microversion: 2.1 time: 0.104575 Aug 27 04:53:55.176912 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 291/601] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:55 2022] GET /compute/v2.1/servers/3cb98f2a-181a-4dd0-b454-8adec268f65f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:55.390648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-98fa05a4-769f-40b9-bf3f-ff376ee855d9 tempest-ListImageFiltersNegativeTestJSON-1812426669 tempest-ListImageFiltersNegativeTestJSON-1812426669-project] Calling method '.version_select at 0x7fb56562a0d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:55.429176 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-98fa05a4-769f-40b9-bf3f-ff376ee855d9 tempest-ListImageFiltersNegativeTestJSON-1812426669 tempest-ListImageFiltersNegativeTestJSON-1812426669-project] HTTP exception thrown: Image not found. Aug 27 04:53:55.433240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f3b92928-de3b-4164-a7a6-a14ce1ee6c01 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Action: 'create', calling method: .version_select at 0x7fb5655dbe50>, body: {"keypair": {"name": "tempest-keypair-1813761272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArSuU+3O+Z/u1HxXvQ0NlEYXdOv7OuvtTW+Jc6JcJtxpJ+0rasEA8xVi3xHdPchA2pIMmhG01mXzzLhAbnTCVeAED3dAJCvku0v37BRj0dJVTHvfwz6Ol7APqlUILwnvQ=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-98fa05a4-769f-40b9-bf3f-ff376ee855d9 tempest-ListImageFiltersNegativeTestJSON-1812426669 tempest-ListImageFiltersNegativeTestJSON-1812426669-project] Request method failure captured: Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/images/ac8ae128-f863-4813-b34a-f0807c55f377 HTTP/1.1 Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaNi2QEQTDS-bosk6LhQR_O175C9_AmPGUhxZ8nWe72wAX8pOU-1IhY4z0oP3LB0NxsQRx-RlhEpNuQgrqtNuYUE4rEgxrmH_m26RdHDq1-8qr1_mrbCOQ4IxnNphfwOO5CUJ5fkS0lxzQhOvSs_E6AXbvbR-hBXOrxb0sJoK1cDRb8 Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: a23431782bdf488c8f2fea66a9f454f7 Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1812426669 Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:53:55.442795 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a23431782bdf488c8f2fea66a9f454f7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a23431782bdf488c8f2fea66a9f454f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a23431782bdf488c8f2fea66a9f454f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a23431782bdf488c8f2fea66a9f454f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1812426669 Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: a23431782bdf488c8f2fea66a9f454f7 Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1812426669 Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ListImageFiltersNegativeTestJSON-1812426669-project Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 2b03213ba5f64f579e35d3fa0c132389 Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1812426669-project Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: exception: Image not found. Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'ac8ae128-f863-4813-b34a-f0807c55f377'} Aug 27 04:53:55.444661 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:53:55.445482 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ac8ae128-f863-4813-b34a-f0807c55f377 Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:53:55.446623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac8ae128-f863-4813-b34a-f0807c55f377 could not be found. Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:53:55.447808 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:53:55.448888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:53:55.451844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-98fa05a4-769f-40b9-bf3f-ff376ee855d9 tempest-ListImageFiltersNegativeTestJSON-1812426669 tempest-ListImageFiltersNegativeTestJSON-1812426669-project] Returning 404 to user: Image not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:55.452934 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-98fa05a4-769f-40b9-bf3f-ff376ee855d9 tempest-ListImageFiltersNegativeTestJSON-1812426669 tempest-ListImageFiltersNegativeTestJSON-1812426669-project] 10.222.0.58 "GET /compute/v2.1/images/ac8ae128-f863-4813-b34a-f0807c55f377" status: 404 len: 62 microversion: 2.1 time: 0.367648 Aug 27 04:53:55.453759 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 311/602] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:55 2022] GET /compute/v2.1/images/ac8ae128-f863-4813-b34a-f0807c55f377 => generated 62 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:53:55.462882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-f3b92928-de3b-4164-a7a6-a14ce1ee6c01 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:55.469184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-f3b92928-de3b-4164-a7a6-a14ce1ee6c01 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for user fe20c7972e2f4ceabb62c815f29ea0dc and project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:55.498861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:55.499799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:55.505984 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f3b92928-de3b-4164-a7a6-a14ce1ee6c01 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.327687 Aug 27 04:53:55.507232 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 292/603] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 04:53:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:55.517934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ce6b2673-a61f-4d79-b92b-45578893d0e1 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Calling method '.version_select at 0x7fb565821b80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:55.519655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:55.520362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:55.523353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:55.524324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:55.524955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:55.529689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:55.547578 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ce6b2673-a61f-4d79-b92b-45578893d0e1 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1813761272" status: 200 len: 497 microversion: 2.1 time: 0.033768 Aug 27 04:53:55.550327 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 293/604] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 04:53:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1813761272 => generated 497 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:55.561555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b14d2e29-72ee-4c5c-8ee4-d10d6eeee26d tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Calling method '.version_select at 0x7fb5655f3b80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:55.617519 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b14d2e29-72ee-4c5c-8ee4-d10d6eeee26d tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813761272" status: 202 len: 0 microversion: 2.1 time: 0.059799 Aug 27 04:53:55.618325 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 294/605] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 04:53:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813761272 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:53:55.631794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5a055928-089b-4d9c-988c-a3027c1defe9 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Action: 'create', calling method: .version_select at 0x7fb5655dbd30>, body: {"keypair": {"name": "tempest-keypair-1492791315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaTC6/4yraVPhzrbk8uAwhcfbrPgcGxml02WDjMlp0feYh9zP6AV0L5JorjmcNTPwZWyNI4MgLGKyZMlpS42NHncDzw93Fg5V9lKTqZKlNiRdvhEU80/6yID5G+4kzVMA=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:55.660352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5a055928-089b-4d9c-988c-a3027c1defe9 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:55.667606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5a055928-089b-4d9c-988c-a3027c1defe9 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for user fe20c7972e2f4ceabb62c815f29ea0dc and project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:55.710954 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5a055928-089b-4d9c-988c-a3027c1defe9 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083780 Aug 27 04:53:55.711906 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 295/606] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 04:53:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:55.721637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-25c7053a-200c-4c27-80cd-6e784141d6eb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:55.722799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25c7053a-200c-4c27-80cd-6e784141d6eb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:55.732232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25c7053a-200c-4c27-80cd-6e784141d6eb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:55.733949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25c7053a-200c-4c27-80cd-6e784141d6eb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:55.734795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25c7053a-200c-4c27-80cd-6e784141d6eb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:55.738283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25c7053a-200c-4c27-80cd-6e784141d6eb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:55.739489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25c7053a-200c-4c27-80cd-6e784141d6eb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:55.740150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25c7053a-200c-4c27-80cd-6e784141d6eb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:56.225668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:56.239728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:56.241611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:56.243174 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e23f659-94f4-4c87-b644-cac8e5a33833 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 0.748890 Aug 27 04:53:56.245660 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 312/607] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:55 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:56.264093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a7f424e8-c202-459e-8976-34e6158064f9 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Calling method '.version_select at 0x7fb5655c68b0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:56.310339 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a7f424e8-c202-459e-8976-34e6158064f9 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492791315" status: 202 len: 0 microversion: 2.1 time: 0.062702 Aug 27 04:53:56.310878 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 313/608] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 04:53:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492791315 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:53:56.315643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-85796ea5-b9c3-4ace-a8bb-082b05e3dce5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:56.316570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-85796ea5-b9c3-4ace-a8bb-082b05e3dce5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:56.323717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85796ea5-b9c3-4ace-a8bb-082b05e3dce5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:56.325121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85796ea5-b9c3-4ace-a8bb-082b05e3dce5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:56.326216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85796ea5-b9c3-4ace-a8bb-082b05e3dce5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:56.327241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85796ea5-b9c3-4ace-a8bb-082b05e3dce5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:56.328091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85796ea5-b9c3-4ace-a8bb-082b05e3dce5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:56.328816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85796ea5-b9c3-4ace-a8bb-082b05e3dce5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:56.334087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-25c7053a-200c-4c27-80cd-6e784141d6eb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:56.344694 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-25c7053a-200c-4c27-80cd-6e784141d6eb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1318 microversion: 2.1 time: 0.630997 Aug 27 04:53:56.345283 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 296/609] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:55 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:56.361732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d74028e-5bf0-4e51-a6db-6b73dea0bdf6 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Action: 'create', calling method: .version_select at 0x7fb5655c2820>, body: {"keypair": {"name": "tempest-keypair-1019725166", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:56.397430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3d74028e-5bf0-4e51-a6db-6b73dea0bdf6 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:56.405875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3d74028e-5bf0-4e51-a6db-6b73dea0bdf6 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for user fe20c7972e2f4ceabb62c815f29ea0dc and project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:56.438169 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d74028e-5bf0-4e51-a6db-6b73dea0bdf6 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.091580 Aug 27 04:53:56.438996 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 297/610] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 04:53:56 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:56.449858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8a03613-dd9c-48d6-8f7b-a6ec46948930 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Calling method '.version_select at 0x7fb5655f34c0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:56.501359 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8a03613-dd9c-48d6-8f7b-a6ec46948930 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019725166" status: 202 len: 0 microversion: 2.1 time: 0.055291 Aug 27 04:53:56.508980 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 298/611] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 04:53:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019725166 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:53:56.515807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2cde2aa5-44e4-43a4-b5e8-de5e23a13a3d tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Action: 'create', calling method: .version_select at 0x7fb5655a5b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-792177189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuhp1Pe/+jep8HmUT7x/lYYjLxHswmGvaEy7JyRfDGvDlsu2XfAAkGPc7YHD5xjhjXropne29bTQd/UtDxxwiETkpoISrilDpTk9w/6sBRMUrWzorLJJd4BzrfY/3E6Kg=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:56.548665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-2cde2aa5-44e4-43a4-b5e8-de5e23a13a3d tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:56.568954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-2cde2aa5-44e4-43a4-b5e8-de5e23a13a3d tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for user fe20c7972e2f4ceabb62c815f29ea0dc and project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:56.617030 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2cde2aa5-44e4-43a4-b5e8-de5e23a13a3d tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.106668 Aug 27 04:53:56.626605 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 299/612] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 04:53:56 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:56.634388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-451217f5-a6af-4ca5-acf3-6496c3db843f tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Action: 'create', calling method: .version_select at 0x7fb5655b05e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1544729000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwG3EJigKVnX2JoY2UKWQzBfOtULSoxXNeUojX0cv+jkA4Ln9KSTGlgd2g6Lae6ODezcomto9Z5Lo9WnOwcKuezuDHXxOJdxTU/Z3VNURxUDWLoT2RU0xxFZfsyC8iIpg=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:56.661087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:56.674555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-451217f5-a6af-4ca5-acf3-6496c3db843f tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:56.687488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-451217f5-a6af-4ca5-acf3-6496c3db843f tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for user fe20c7972e2f4ceabb62c815f29ea0dc and project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:56.761236 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-451217f5-a6af-4ca5-acf3-6496c3db843f tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.132582 Aug 27 04:53:56.762524 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 300/613] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 04:53:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:56.776567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-28edd98e-b14d-4e3f-9bac-6bb8a154c60b tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Action: 'create', calling method: .version_select at 0x7fb5655853a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-399606771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxAGkpMBMJ+id2gAF8HyUUu3/7dGqfn961G2bdLTU2fOkHaSlE5UWxk0FTFXCK4v9v1Cc7LaF/V6hU3WFPX1cY9UlIBvE0SMcysvSURoRfGwH2+3wH0tRZfW4nTf8XQAg=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:56.817023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-28edd98e-b14d-4e3f-9bac-6bb8a154c60b tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:53:56.829389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-28edd98e-b14d-4e3f-9bac-6bb8a154c60b tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Getting quotas for user fe20c7972e2f4ceabb62c815f29ea0dc and project 91ef679f49b74e148cc55ae8b4a4f833. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:53:56.895407 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-28edd98e-b14d-4e3f-9bac-6bb8a154c60b tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.123538 Aug 27 04:53:56.904322 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 301/614] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 04:53:56 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:56.911403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7c804fdd-5ee2-44c4-8c6f-7a0890ed1730 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Calling method '.version_select at 0x7fb5655db820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:56.917218 n-d-820368-35 devstack@n-api.service[128547]: WARNING oslo_db.sqlalchemy.utils [None req-7c804fdd-5ee2-44c4-8c6f-7a0890ed1730 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 04:53:56.932042 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7c804fdd-5ee2-44c4-8c6f-7a0890ed1730 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.025478 Aug 27 04:53:56.933084 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 302/615] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 04:53:56 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:56.974523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e922e68-fa45-46c6-8f06-9cac1fb5dd16 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Calling method '.version_select at 0x7fb5655a8b80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:57.029823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-85796ea5-b9c3-4ace-a8bb-082b05e3dce5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:57.050551 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-85796ea5-b9c3-4ace-a8bb-082b05e3dce5 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1320 microversion: 2.1 time: 0.738324 Aug 27 04:53:57.077174 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 314/616] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:56 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1320 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:57.087422 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e922e68-fa45-46c6-8f06-9cac1fb5dd16 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-399606771" status: 202 len: 0 microversion: 2.1 time: 0.138802 Aug 27 04:53:57.092083 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 303/617] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 04:53:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-399606771 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:53:57.099558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97b907ce-4648-4c23-b288-3c321fbf256b tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Calling method '.version_select at 0x7fb5655d6160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:57.157919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:57.178208 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-97b907ce-4648-4c23-b288-3c321fbf256b tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1544729000" status: 202 len: 0 microversion: 2.1 time: 0.084766 Aug 27 04:53:57.182395 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 315/618] 10.222.0.58 () {58 vars in 1278 bytes} [Sat Aug 27 04:53:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1544729000 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:53:57.193764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-748b6dd6-19b3-410b-a010-6139c5ddf4e9 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] Calling method '.version_select at 0x7fb5655c2790>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:57.260384 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-748b6dd6-19b3-410b-a010-6139c5ddf4e9 tempest-KeyPairsV2TestJSON-1116732595 tempest-KeyPairsV2TestJSON-1116732595-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-792177189" status: 202 len: 0 microversion: 2.1 time: 0.071369 Aug 27 04:53:57.271059 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 304/619] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 04:53:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-792177189 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:53:57.274443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:57.277192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:57.303076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:57.315049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:57.316582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:57.318089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:57.320111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:57.322377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:57.367348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-074e5286-f46f-42a8-a3b0-2b3f28fd3b80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:57.368377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-074e5286-f46f-42a8-a3b0-2b3f28fd3b80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:57.379979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-074e5286-f46f-42a8-a3b0-2b3f28fd3b80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:57.380736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-074e5286-f46f-42a8-a3b0-2b3f28fd3b80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:57.381355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-074e5286-f46f-42a8-a3b0-2b3f28fd3b80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:57.383942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-074e5286-f46f-42a8-a3b0-2b3f28fd3b80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:57.384601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-074e5286-f46f-42a8-a3b0-2b3f28fd3b80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:57.385195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-074e5286-f46f-42a8-a3b0-2b3f28fd3b80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:58.662388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:58.672731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:58.674164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:58.681607 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d452b81-4c38-4ead-9fda-fefaa4a6357a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 1.414404 Aug 27 04:53:58.690891 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 316/620] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:57 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:58.703713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-72d96ce0-4d96-4036-9f07-a0d9275aa5dc tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:58.704533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-72d96ce0-4d96-4036-9f07-a0d9275aa5dc tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:58.729394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72d96ce0-4d96-4036-9f07-a0d9275aa5dc tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:58.729880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72d96ce0-4d96-4036-9f07-a0d9275aa5dc tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:58.736643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72d96ce0-4d96-4036-9f07-a0d9275aa5dc tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:58.737499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72d96ce0-4d96-4036-9f07-a0d9275aa5dc tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:58.742608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72d96ce0-4d96-4036-9f07-a0d9275aa5dc tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:58.743157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72d96ce0-4d96-4036-9f07-a0d9275aa5dc tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:58.792143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-074e5286-f46f-42a8-a3b0-2b3f28fd3b80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:58.815164 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-074e5286-f46f-42a8-a3b0-2b3f28fd3b80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1318 microversion: 2.1 time: 1.451501 Aug 27 04:53:58.815746 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 305/621] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:57 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1318 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:58.848457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-db357280-c398-4cc0-85c4-a50ef74947ef req-5b002d45-6a18-4ed4-bbeb-93fa5198aec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2661a725-4e21-43b0-a754-44a4d7089111", "name": "network-vif-plugged", "status": "completed", "tag": "f2503f63-abb6-4c6d-8386-a81b301071ba"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:58.899792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-db357280-c398-4cc0-85c4-a50ef74947ef req-5b002d45-6a18-4ed4-bbeb-93fa5198aec7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:58.900291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-db357280-c398-4cc0-85c4-a50ef74947ef req-5b002d45-6a18-4ed4-bbeb-93fa5198aec7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:58.900731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-db357280-c398-4cc0-85c4-a50ef74947ef req-5b002d45-6a18-4ed4-bbeb-93fa5198aec7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:58.931742 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-db357280-c398-4cc0-85c4-a50ef74947ef req-5b002d45-6a18-4ed4-bbeb-93fa5198aec7 service nova] Creating event network-vif-plugged:f2503f63-abb6-4c6d-8386-a81b301071ba for instance 2661a725-4e21-43b0-a754-44a4d7089111 on n-h1-820368-35 Aug 27 04:53:58.940755 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-db357280-c398-4cc0-85c4-a50ef74947ef req-5b002d45-6a18-4ed4-bbeb-93fa5198aec7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123735 Aug 27 04:53:58.941887 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 306/622] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:59.548099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-72d96ce0-4d96-4036-9f07-a0d9275aa5dc tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:59.561754 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-72d96ce0-4d96-4036-9f07-a0d9275aa5dc tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1320 microversion: 2.1 time: 0.862532 Aug 27 04:53:59.578745 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 317/623] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:58 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1320 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:59.752628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:59.753564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:59.768572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:59.772768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:59.775477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:59.791684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:59.814649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:59.836466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:59.846027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d4376431-7f7f-4567-a8a3-77f8183d94f7 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:59.846657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d4376431-7f7f-4567-a8a3-77f8183d94f7 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:59.860466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4376431-7f7f-4567-a8a3-77f8183d94f7 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:59.862315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4376431-7f7f-4567-a8a3-77f8183d94f7 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:59.891213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4376431-7f7f-4567-a8a3-77f8183d94f7 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:59.904058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4376431-7f7f-4567-a8a3-77f8183d94f7 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:59.904740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4376431-7f7f-4567-a8a3-77f8183d94f7 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:59.905161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4376431-7f7f-4567-a8a3-77f8183d94f7 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:00.643756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d4376431-7f7f-4567-a8a3-77f8183d94f7 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:00.653332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:00.653647 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d4376431-7f7f-4567-a8a3-77f8183d94f7 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1318 microversion: 2.1 time: 0.811683 Aug 27 04:54:00.655857 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 318/624] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:59 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1318 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:00.661817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7f7206a5-0a53-4635-8bb4-bfa042f85fee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:00.662642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7f7206a5-0a53-4635-8bb4-bfa042f85fee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:00.662923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:00.664527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:00.671758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7206a5-0a53-4635-8bb4-bfa042f85fee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:00.672260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7206a5-0a53-4635-8bb4-bfa042f85fee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:00.672902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7206a5-0a53-4635-8bb4-bfa042f85fee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:00.673767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7206a5-0a53-4635-8bb4-bfa042f85fee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:00.674180 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-43365d20-83f6-4ef1-8f95-8e4f2503ee52 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 0.937971 Aug 27 04:54:00.674905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7206a5-0a53-4635-8bb4-bfa042f85fee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:00.677456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7206a5-0a53-4635-8bb4-bfa042f85fee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:00.681719 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 307/625] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:59 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:00.961874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ea3549e8-28ad-4f24-84f4-c84cec410d88 req-6e3cfd0f-fcd6-48dd-8429-f69d525115f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f37868-9c79-436c-8fc3-295e678cb656", "name": "network-vif-plugged", "status": "completed", "tag": "db4f91f2-079f-42ab-b80a-082ab7b26351"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:00.975357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ea3549e8-28ad-4f24-84f4-c84cec410d88 req-6e3cfd0f-fcd6-48dd-8429-f69d525115f9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:00.987865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ea3549e8-28ad-4f24-84f4-c84cec410d88 req-6e3cfd0f-fcd6-48dd-8429-f69d525115f9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:00.988489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ea3549e8-28ad-4f24-84f4-c84cec410d88 req-6e3cfd0f-fcd6-48dd-8429-f69d525115f9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:01.010108 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ea3549e8-28ad-4f24-84f4-c84cec410d88 req-6e3cfd0f-fcd6-48dd-8429-f69d525115f9 service nova] Creating event network-vif-plugged:db4f91f2-079f-42ab-b80a-082ab7b26351 for instance 69f37868-9c79-436c-8fc3-295e678cb656 on n-h2-820368-35 Aug 27 04:54:01.015353 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ea3549e8-28ad-4f24-84f4-c84cec410d88 req-6e3cfd0f-fcd6-48dd-8429-f69d525115f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057490 Aug 27 04:54:01.016686 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 308/626] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:54:01.281967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7f7206a5-0a53-4635-8bb4-bfa042f85fee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:01.300747 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7f7206a5-0a53-4635-8bb4-bfa042f85fee tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1320 microversion: 2.1 time: 0.642670 Aug 27 04:54:01.300747 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 319/627] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:00 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1320 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:01.682926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-06986b6d-9968-411a-bf31-9275f290fe2d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:01.683897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-06986b6d-9968-411a-bf31-9275f290fe2d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:01.695258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06986b6d-9968-411a-bf31-9275f290fe2d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:01.695764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06986b6d-9968-411a-bf31-9275f290fe2d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:01.696209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06986b6d-9968-411a-bf31-9275f290fe2d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:01.696937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06986b6d-9968-411a-bf31-9275f290fe2d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:01.697400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06986b6d-9968-411a-bf31-9275f290fe2d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:01.708574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06986b6d-9968-411a-bf31-9275f290fe2d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:01.726787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:01.728682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:01.748529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:01.751164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:01.755867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:01.756537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:01.757002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:01.757501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:02.663662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-06986b6d-9968-411a-bf31-9275f290fe2d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:02.673596 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-06986b6d-9968-411a-bf31-9275f290fe2d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1318 microversion: 2.1 time: 0.994865 Aug 27 04:54:02.674442 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 309/628] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:01 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1318 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:02.680740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0797d8b0-a063-4357-9feb-1914d7eebde9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:02.682272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0797d8b0-a063-4357-9feb-1914d7eebde9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:02.691721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0797d8b0-a063-4357-9feb-1914d7eebde9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:02.692848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0797d8b0-a063-4357-9feb-1914d7eebde9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:02.693434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0797d8b0-a063-4357-9feb-1914d7eebde9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:02.694385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0797d8b0-a063-4357-9feb-1914d7eebde9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:02.695179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0797d8b0-a063-4357-9feb-1914d7eebde9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:02.696033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0797d8b0-a063-4357-9feb-1914d7eebde9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:02.715790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:02.731018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:02.733921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:02.735565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dbe97ab0-9635-4630-be31-1ce0f8598440 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 1.018306 Aug 27 04:54:02.749904 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 320/629] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:01 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:03.373098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0797d8b0-a063-4357-9feb-1914d7eebde9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:03.388641 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0797d8b0-a063-4357-9feb-1914d7eebde9 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1320 microversion: 2.1 time: 0.712982 Aug 27 04:54:03.391251 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 310/630] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:02 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1320 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:03.704011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4038a873-6ba5-44c5-b394-84e39aa0c4fc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:03.704693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4038a873-6ba5-44c5-b394-84e39aa0c4fc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:03.717086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4038a873-6ba5-44c5-b394-84e39aa0c4fc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:03.717770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4038a873-6ba5-44c5-b394-84e39aa0c4fc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:03.718012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4038a873-6ba5-44c5-b394-84e39aa0c4fc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:03.718732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4038a873-6ba5-44c5-b394-84e39aa0c4fc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:03.719215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4038a873-6ba5-44c5-b394-84e39aa0c4fc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:03.719643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4038a873-6ba5-44c5-b394-84e39aa0c4fc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:03.768610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:03.770492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:03.784750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:03.785558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:03.787653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:03.789981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:03.791193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:03.791897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:03.851420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:04.292049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:04.297747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4038a873-6ba5-44c5-b394-84e39aa0c4fc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:04.312146 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4038a873-6ba5-44c5-b394-84e39aa0c4fc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1468 microversion: 2.1 time: 0.614045 Aug 27 04:54:04.313098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:04.317404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:04.322582 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-700f21b9-bced-4251-b9c2-19bccd86f3ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 0.558580 Aug 27 04:54:04.329047 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 321/631] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:03 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1468 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:04.334872 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 311/632] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:03 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:04.346073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-32319417-8bc7-482f-97a7-486db196e7b0 req-0c8a7b91-f860-4afe-b47c-39aa7a646fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0c7f12-e408-4c56-911d-df18d1064e61", "name": "network-vif-plugged", "status": "completed", "tag": "378e16c7-73cf-4379-9ce3-5ce58609cf51"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:04.358071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dcf405b2-05ea-462e-9810-f52e4abdea01 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:04.358702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dcf405b2-05ea-462e-9810-f52e4abdea01 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:04.371478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-32319417-8bc7-482f-97a7-486db196e7b0 req-0c8a7b91-f860-4afe-b47c-39aa7a646fcf service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:04.372481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-32319417-8bc7-482f-97a7-486db196e7b0 req-0c8a7b91-f860-4afe-b47c-39aa7a646fcf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:04.373171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-32319417-8bc7-482f-97a7-486db196e7b0 req-0c8a7b91-f860-4afe-b47c-39aa7a646fcf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:04.376437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf405b2-05ea-462e-9810-f52e4abdea01 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:04.378044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf405b2-05ea-462e-9810-f52e4abdea01 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:04.378506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf405b2-05ea-462e-9810-f52e4abdea01 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:04.379271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf405b2-05ea-462e-9810-f52e4abdea01 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:04.381799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf405b2-05ea-462e-9810-f52e4abdea01 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:04.382497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf405b2-05ea-462e-9810-f52e4abdea01 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:04.405219 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-32319417-8bc7-482f-97a7-486db196e7b0 req-0c8a7b91-f860-4afe-b47c-39aa7a646fcf service nova] Creating event network-vif-plugged:378e16c7-73cf-4379-9ce3-5ce58609cf51 for instance 8f0c7f12-e408-4c56-911d-df18d1064e61 on n-h1-820368-35 Aug 27 04:54:04.420767 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-32319417-8bc7-482f-97a7-486db196e7b0 req-0c8a7b91-f860-4afe-b47c-39aa7a646fcf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089519 Aug 27 04:54:04.423554 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 322/633] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:04.436338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2ff16795-9449-4ffe-86ba-35eeceb70fd1 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:04.439796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2ff16795-9449-4ffe-86ba-35eeceb70fd1 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:04.452663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff16795-9449-4ffe-86ba-35eeceb70fd1 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:04.455965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff16795-9449-4ffe-86ba-35eeceb70fd1 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:04.456632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff16795-9449-4ffe-86ba-35eeceb70fd1 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:04.459533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff16795-9449-4ffe-86ba-35eeceb70fd1 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:04.460589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff16795-9449-4ffe-86ba-35eeceb70fd1 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:04.463715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff16795-9449-4ffe-86ba-35eeceb70fd1 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:05.095512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2ff16795-9449-4ffe-86ba-35eeceb70fd1 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:05.119768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dcf405b2-05ea-462e-9810-f52e4abdea01 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:05.129661 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2ff16795-9449-4ffe-86ba-35eeceb70fd1 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1470 microversion: 2.1 time: 0.683136 Aug 27 04:54:05.130924 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 323/634] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:04 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1470 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:05.132692 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dcf405b2-05ea-462e-9810-f52e4abdea01 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61" status: 200 len: 1318 microversion: 2.1 time: 0.790721 Aug 27 04:54:05.135181 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 312/635] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:04 2022] GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 => generated 1318 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:05.174795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7796a430-5b91-4635-80ab-bf9402c65e83 tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:05.182288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7796a430-5b91-4635-80ab-bf9402c65e83 tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:05.217953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7796a430-5b91-4635-80ab-bf9402c65e83 tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:05.224059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7796a430-5b91-4635-80ab-bf9402c65e83 tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:05.224747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7796a430-5b91-4635-80ab-bf9402c65e83 tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:05.225682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7796a430-5b91-4635-80ab-bf9402c65e83 tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:05.226301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7796a430-5b91-4635-80ab-bf9402c65e83 tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:05.227597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7796a430-5b91-4635-80ab-bf9402c65e83 tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:05.361164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:05.362030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:05.374792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:05.375325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:05.427456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:05.433967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:05.437772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:05.440695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:05.669989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:05.678022 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7796a430-5b91-4635-80ab-bf9402c65e83 tempest-DeleteServersAdminTestJSON-2135337006 tempest-DeleteServersAdminTestJSON-2135337006-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111/action" status: 202 len: 0 microversion: 2.1 time: 0.517874 Aug 27 04:54:05.679446 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 324/636] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:54:05 2022] POST /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:54:05.709468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:05.710639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:05.746893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:05.749083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:05.749083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:05.749306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:05.751960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:05.753858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:05.823342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:05.824517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:05.824956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:05.825405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lazy-loading 'fault' on Instance uuid 2661a725-4e21-43b0-a754-44a4d7089111 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:54:06.424958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:06.443852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:06.448717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:06.450011 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-46eb8877-56ae-4b38-b1ca-4ac8c37da662 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 1.093174 Aug 27 04:54:06.453212 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 313/637] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:05 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:54:06.459885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-80d59d7e-c91c-4e34-afd7-d66f6b8119db tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:06.460500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80d59d7e-c91c-4e34-afd7-d66f6b8119db tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:06.464811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:06.479652 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8bd0ec9d-28f4-4ac1-a592-00eeab47cf9b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1453 microversion: 2.1 time: 0.793653 Aug 27 04:54:06.487572 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 325/638] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:05 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1453 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:06.497259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80d59d7e-c91c-4e34-afd7-d66f6b8119db tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:06.497765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80d59d7e-c91c-4e34-afd7-d66f6b8119db tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:06.498215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80d59d7e-c91c-4e34-afd7-d66f6b8119db tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:06.498945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80d59d7e-c91c-4e34-afd7-d66f6b8119db tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:06.499434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80d59d7e-c91c-4e34-afd7-d66f6b8119db tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:06.499863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80d59d7e-c91c-4e34-afd7-d66f6b8119db tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:06.513146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d21c5b0-d900-4225-bd48-0351cba0d612 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:06.513730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d21c5b0-d900-4225-bd48-0351cba0d612 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:06.540431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d21c5b0-d900-4225-bd48-0351cba0d612 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:06.541055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d21c5b0-d900-4225-bd48-0351cba0d612 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:06.541509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d21c5b0-d900-4225-bd48-0351cba0d612 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:06.542266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d21c5b0-d900-4225-bd48-0351cba0d612 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:06.553552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d21c5b0-d900-4225-bd48-0351cba0d612 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:06.555705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d21c5b0-d900-4225-bd48-0351cba0d612 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:06.645637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d21c5b0-d900-4225-bd48-0351cba0d612 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:54:06.843753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=24 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:06.953398 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d21c5b0-d900-4225-bd48-0351cba0d612 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 204 len: 0 microversion: 2.1 time: 0.444469 Aug 27 04:54:06.954503 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 326/639] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:54:06 2022] DELETE /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:54:06.975449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-80d59d7e-c91c-4e34-afd7-d66f6b8119db tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:06.975677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:06.978867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:06.987277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:06.988492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:06.989663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:06.991369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:06.991717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:06.992254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:07.010174 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-80d59d7e-c91c-4e34-afd7-d66f6b8119db tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61" status: 200 len: 1318 microversion: 2.1 time: 0.555837 Aug 27 04:54:07.010782 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 314/640] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:06 2022] GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:07.110396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:07.112206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:07.112656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:07.113111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lazy-loading 'fault' on Instance uuid 2661a725-4e21-43b0-a754-44a4d7089111 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:54:07.333758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:07.342532 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0fb1d2ba-d352-439a-b535-65059e474866 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1459 microversion: 2.1 time: 0.383141 Aug 27 04:54:07.351576 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 327/641] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:06 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1459 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:07.477550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:07.478846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:07.488755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:07.489464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:07.499490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:07.500686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:07.501369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:07.502271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:07.749698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:07.759011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:07.761338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:07.763066 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14bb9cb1-77b0-4cc0-98fe-1715af216f30 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 0.289643 Aug 27 04:54:07.798313 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 315/642] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:07 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:08.046617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a96b40c-a798-4231-bacb-4204bf7d79f4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:08.048169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7a96b40c-a798-4231-bacb-4204bf7d79f4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:08.057880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a96b40c-a798-4231-bacb-4204bf7d79f4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:08.061192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a96b40c-a798-4231-bacb-4204bf7d79f4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:08.062848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a96b40c-a798-4231-bacb-4204bf7d79f4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:08.063864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a96b40c-a798-4231-bacb-4204bf7d79f4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:08.084429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a96b40c-a798-4231-bacb-4204bf7d79f4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:08.085729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a96b40c-a798-4231-bacb-4204bf7d79f4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:08.365523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:08.366152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:08.377430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:08.379944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:08.384219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:08.385664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:08.386943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:08.387571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:08.447929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7a96b40c-a798-4231-bacb-4204bf7d79f4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:08.466396 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a96b40c-a798-4231-bacb-4204bf7d79f4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61" status: 200 len: 1318 microversion: 2.1 time: 0.424129 Aug 27 04:54:08.478976 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 328/643] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:08 2022] GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:08.489865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:08.490429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:08.490801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:08.491443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lazy-loading 'fault' on Instance uuid 2661a725-4e21-43b0-a754-44a4d7089111 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:54:08.711278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:08.722342 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-48db04dd-8e18-4aa0-a9ec-a631db944a7a tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1459 microversion: 2.1 time: 0.359766 Aug 27 04:54:08.724350 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 316/644] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:08 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1459 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:08.795759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:08.804338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:08.814785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:08.815327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:08.815762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:08.816472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:08.822968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:08.823467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:09.489834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de457765-584e-4f10-ad8f-e545a68e9b98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:09.491038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de457765-584e-4f10-ad8f-e545a68e9b98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:09.510946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de457765-584e-4f10-ad8f-e545a68e9b98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:09.511912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de457765-584e-4f10-ad8f-e545a68e9b98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:09.512540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de457765-584e-4f10-ad8f-e545a68e9b98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:09.513439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de457765-584e-4f10-ad8f-e545a68e9b98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:09.514229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de457765-584e-4f10-ad8f-e545a68e9b98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:09.514808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de457765-584e-4f10-ad8f-e545a68e9b98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:09.765993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:09.778264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:09.781314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:09.782805 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3584651a-f5b9-4698-8849-a53d11a0df18 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1568 microversion: 2.25 time: 0.992793 Aug 27 04:54:09.783759 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 329/645] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:08 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1568 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:09.789010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:09.789889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:09.804487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:09.805142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:09.805689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:09.807832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:09.808433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:09.808960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:09.869092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de457765-584e-4f10-ad8f-e545a68e9b98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:09.880116 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de457765-584e-4f10-ad8f-e545a68e9b98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61" status: 200 len: 1467 microversion: 2.1 time: 0.394060 Aug 27 04:54:09.890410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:09.891515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:09.892192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:09.892749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lazy-loading 'fault' on Instance uuid 2661a725-4e21-43b0-a754-44a4d7089111 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:54:09.896751 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 317/646] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:09 2022] GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 => generated 1467 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:09.906416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:09.918690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:09.920012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Searching by: {'reservation_id': 'r-tupn0xm3', 'deleted': False, 'project_id': '4074bf02227441b091b6e7d62f83b9e0'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:54:09.937615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:09.941757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:09.942429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:09.943410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:09.944202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:09.946011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:10.172953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:54:10.496709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:10.512296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:10.513043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:10.513786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:11.237878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3917d606c35f4db1af916815167fae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c2a8d4be674caeab73db8e28ac1459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:11.268779 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-190fefa5-6be8-48f9-b6ff-1c63f9492991 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 200 len: 1459 microversion: 2.1 time: 1.481293 Aug 27 04:54:11.269431 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 330/647] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:09 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 1459 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:11.278345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:11.278963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:11.300939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:11.301441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:11.301885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:11.302607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:11.303078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:11.303520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:11.514377 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-87fa9d78-5df1-4bc8-82a6-4b0cce1b2547 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-tupn0xm3" status: 200 len: 2928 microversion: 2.1 time: 1.614555 Aug 27 04:54:11.515041 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 318/648] 10.222.0.58 () {58 vars in 1197 bytes} [Sat Aug 27 04:54:09 2022] GET /compute/v2.1/servers/detail?reservation_id=r-tupn0xm3 => generated 2928 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:11.536809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f61678b6-15cd-487a-8e9e-96537fc4f298 req-6ee30262-df85-417b-9a13-5c6c50fbb451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2661a725-4e21-43b0-a754-44a4d7089111", "name": "network-vif-deleted", "tag": "f2503f63-abb6-4c6d-8386-a81b301071ba"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:11.574304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f61678b6-15cd-487a-8e9e-96537fc4f298 req-6ee30262-df85-417b-9a13-5c6c50fbb451 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:11.580168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f61678b6-15cd-487a-8e9e-96537fc4f298 req-6ee30262-df85-417b-9a13-5c6c50fbb451 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:11.580805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f61678b6-15cd-487a-8e9e-96537fc4f298 req-6ee30262-df85-417b-9a13-5c6c50fbb451 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:11.611071 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f61678b6-15cd-487a-8e9e-96537fc4f298 req-6ee30262-df85-417b-9a13-5c6c50fbb451 service nova] Creating event network-vif-deleted:f2503f63-abb6-4c6d-8386-a81b301071ba for instance 2661a725-4e21-43b0-a754-44a4d7089111 on n-h1-820368-35 Aug 27 04:54:11.633653 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f61678b6-15cd-487a-8e9e-96537fc4f298 req-6ee30262-df85-417b-9a13-5c6c50fbb451 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104991 Aug 27 04:54:11.634496 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 319/649] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:11.644268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b107997-0822-4902-9216-f2221421f231 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:11.695430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.compute.server_groups [None req-6b107997-0822-4902-9216-f2221421f231 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Querying cell ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) for 2 instances {{(pid=128547) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 04:54:11.697921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b107997-0822-4902-9216-f2221421f231 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:11.698807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b107997-0822-4902-9216-f2221421f231 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:11.700625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b107997-0822-4902-9216-f2221421f231 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:11.748772 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b107997-0822-4902-9216-f2221421f231 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/4fe81053-9d62-48f5-a301-6d865ee72ba0" status: 200 len: 271 microversion: 2.1 time: 0.112674 Aug 27 04:54:11.755721 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 320/650] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 04:54:11 2022] GET /compute/v2.1/os-server-groups/4fe81053-9d62-48f5-a301-6d865ee72ba0 => generated 271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:11.762308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd6ae819-0c0d-40f4-8fdb-1f478e1c9149 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:11.763793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cd6ae819-0c0d-40f4-8fdb-1f478e1c9149 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:11.771573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd6ae819-0c0d-40f4-8fdb-1f478e1c9149 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:11.772247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd6ae819-0c0d-40f4-8fdb-1f478e1c9149 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:11.772868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd6ae819-0c0d-40f4-8fdb-1f478e1c9149 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:11.773804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd6ae819-0c0d-40f4-8fdb-1f478e1c9149 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:11.774473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd6ae819-0c0d-40f4-8fdb-1f478e1c9149 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:11.775109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd6ae819-0c0d-40f4-8fdb-1f478e1c9149 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:11.934775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:11.943993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:11.952337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:11.953848 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2ab664f8-be9f-4c46-92f3-07b1851b7960 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1543 microversion: 2.25 time: 0.682971 Aug 27 04:54:11.959939 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 331/651] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:11 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1543 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:11.978213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d49573b4-16dc-45ee-9474-a8bfac9edb97 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '.version_select at 0x7fb565504310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:11.982698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d49573b4-16dc-45ee-9474-a8bfac9edb97 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:11.983438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d49573b4-16dc-45ee-9474-a8bfac9edb97 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:11.989213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d49573b4-16dc-45ee-9474-a8bfac9edb97 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:12.012993 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d49573b4-16dc-45ee-9474-a8bfac9edb97 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1108 microversion: 2.25 time: 0.038321 Aug 27 04:54:12.019536 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 332/652] 10.222.0.58 () {60 vars in 1184 bytes} [Sat Aug 27 04:54:11 2022] GET /compute/v2.1/os-migrations => generated 1108 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:12.037085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f8229f64-effa-4640-a565-c2524dcafac2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:12.048031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f8229f64-effa-4640-a565-c2524dcafac2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:12.055805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8229f64-effa-4640-a565-c2524dcafac2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:12.056642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8229f64-effa-4640-a565-c2524dcafac2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:12.057324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8229f64-effa-4640-a565-c2524dcafac2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:12.058501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8229f64-effa-4640-a565-c2524dcafac2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:12.059656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8229f64-effa-4640-a565-c2524dcafac2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:12.063254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8229f64-effa-4640-a565-c2524dcafac2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:12.361056 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cd6ae819-0c0d-40f4-8fdb-1f478e1c9149 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 200 len: 1621 microversion: 2.1 time: 0.603682 Aug 27 04:54:12.363523 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 321/653] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:11 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 1621 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:12.372636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:12.373273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:12.400252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:12.403376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:12.404160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:12.405389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:12.418974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:12.426811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:12.477914 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] HTTP exception thrown: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Request method failure captured: Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 HTTP/1.1 Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMqdWWOVNaYg8XVJDOIdDz9S7IVDQabmLJgp4Cz5dM7fJm7PFXds1jtbNzsSjw4rAkKPSp6fZY5cGwTxOL_xj1PCgTQdOklT32MGiuibuAAteT6Kv11iHjAtKeEMEB93RZWa2h0aeFc7hXZ1MMrXB8AjRMIrK9MJQKYYUj_yxxX9bs Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:54:12.490671 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45c2a8d4be674caeab73db8e28ac1459", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 3917d606c35f4db1af916815167fae74 Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:12.492332 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '2661a725-4e21-43b0-a754-44a4d7089111'} Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:54:12.493071 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:12.494323 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:12.497656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Returning 404 to user: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:54:12.498744 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e658187c-d124-4443-a9f3-5182ad75104b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 404 len: 111 microversion: 2.1 time: 0.134262 Aug 27 04:54:12.504045 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 322/654] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:12 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:54:12.512159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d9cbaaa-0dbf-46f4-9c59-a324e16861ad tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:12.523173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d9cbaaa-0dbf-46f4-9c59-a324e16861ad tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:12.543448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9cbaaa-0dbf-46f4-9c59-a324e16861ad tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:12.546235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9cbaaa-0dbf-46f4-9c59-a324e16861ad tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:12.546874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9cbaaa-0dbf-46f4-9c59-a324e16861ad tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:12.547852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9cbaaa-0dbf-46f4-9c59-a324e16861ad tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:12.550101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9cbaaa-0dbf-46f4-9c59-a324e16861ad tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:12.551988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9cbaaa-0dbf-46f4-9c59-a324e16861ad tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.008153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-f8229f64-effa-4640-a565-c2524dcafac2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid 36549027-8a9f-4d92-8525-bdd6fa5ed50e {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:54:13.045855 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f8229f64-effa-4640-a565-c2524dcafac2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 2038 microversion: 2.25 time: 1.014286 Aug 27 04:54:13.047039 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 333/655] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:12 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 2038 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:13.054833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:13.056827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:13.091904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.095955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.096855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.098983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.100119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.101573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.150401 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] HTTP exception thrown: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Request method failure captured: Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 HTTP/1.1 Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMqdWWOVNaYg8XVJDOIdDz9S7IVDQabmLJgp4Cz5dM7fJm7PFXds1jtbNzsSjw4rAkKPSp6fZY5cGwTxOL_xj1PCgTQdOklT32MGiuibuAAteT6Kv11iHjAtKeEMEB93RZWa2h0aeFc7hXZ1MMrXB8AjRMIrK9MJQKYYUj_yxxX9bs Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:54:13.155546 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45c2a8d4be674caeab73db8e28ac1459", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 3917d606c35f4db1af916815167fae74 Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:13.157093 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2661a725-4e21-43b0-a754-44a4d7089111'} Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:54:13.158104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:13.159573 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.163666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Returning 404 to user: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:54:13.164745 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e340d6a5-9dda-40cf-9c6e-f064c3f10e78 tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 404 len: 111 microversion: 2.1 time: 0.115281 Aug 27 04:54:13.168984 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 334/656] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:54:13 2022] DELETE /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:54:13.179457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d269def9-8497-4fcd-930b-1eda446de122 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Action: 'create', calling method: .version_select at 0x7fb5654e9dc0>, body: {"keypair": {"name": "tempest-keypair-41584641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJCzw0I9kA1DwjM6RgI2cIEKRAa7m0BIREA9ZKrW3gEMCWAiLcXH/V1mROUtmIwDgtFhjaNzSuj/FK8tIoN91JbQOtP4HEA0XuWZBpbxScG4vUQdskDCCAyRH/8S5tuOw=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:13.218630 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d9cbaaa-0dbf-46f4-9c59-a324e16861ad tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61" status: 200 len: 1620 microversion: 2.1 time: 0.713228 Aug 27 04:54:13.222494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d269def9-8497-4fcd-930b-1eda446de122 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Getting quotas for project f5c7422cdaca490aaffc4004f77d830c. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:13.223777 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 323/657] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:12 2022] GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 => generated 1620 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:13.230579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:13.233197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d269def9-8497-4fcd-930b-1eda446de122 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Getting quotas for user b7d4fe4aaf864bb58c162620c9948d89 and project f5c7422cdaca490aaffc4004f77d830c. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:13.236341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: 2661a725-4e21-43b0-a754-44a4d7089111] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:13.275271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.278958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.280159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.282125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.289514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.298407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.314817 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d269def9-8497-4fcd-930b-1eda446de122 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.25 time: 0.143996 Aug 27 04:54:13.316119 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 335/658] 10.222.0.58 () {62 vars in 1200 bytes} [Sat Aug 27 04:54:13 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 04:54:13.323446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-56c5ba83-9158-421a-a3d1-9c46a8bc06e0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:13.330804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-56c5ba83-9158-421a-a3d1-9c46a8bc06e0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:13.360838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56c5ba83-9158-421a-a3d1-9c46a8bc06e0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.360992 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] HTTP exception thrown: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:13.361816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56c5ba83-9158-421a-a3d1-9c46a8bc06e0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.362269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56c5ba83-9158-421a-a3d1-9c46a8bc06e0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Request method failure captured: Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 HTTP/1.1 Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMqdWWOVNaYg8XVJDOIdDz9S7IVDQabmLJgp4Cz5dM7fJm7PFXds1jtbNzsSjw4rAkKPSp6fZY5cGwTxOL_xj1PCgTQdOklT32MGiuibuAAteT6Kv11iHjAtKeEMEB93RZWa2h0aeFc7hXZ1MMrXB8AjRMIrK9MJQKYYUj_yxxX9bs Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:54:13.362546 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45c2a8d4be674caeab73db8e28ac1459", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 3917d606c35f4db1af916815167fae74 Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:13.364088 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '2661a725-4e21-43b0-a754-44a4d7089111'} Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:54:13.364979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. Aug 27 04:54:13.366396 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.367671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Returning 404 to user: Instance 2661a725-4e21-43b0-a754-44a4d7089111 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:54:13.367671 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-08dc4871-49fe-46d7-9c3a-a1eeeb72712f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111" status: 404 len: 111 microversion: 2.1 time: 0.139029 Aug 27 04:54:13.367671 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 324/659] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:13 2022] GET /compute/v2.1/servers/2661a725-4e21-43b0-a754-44a4d7089111 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:54:13.367933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56c5ba83-9158-421a-a3d1-9c46a8bc06e0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.368023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56c5ba83-9158-421a-a3d1-9c46a8bc06e0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.368447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56c5ba83-9158-421a-a3d1-9c46a8bc06e0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.403052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:13.408564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:13.437119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.437419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.437868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.441738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.442413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.443007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.473974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-56c5ba83-9158-421a-a3d1-9c46a8bc06e0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:54:13.495921 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] HTTP exception thrown: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Request method failure captured: Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 HTTP/1.1 Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMqdWWOVNaYg8XVJDOIdDz9S7IVDQabmLJgp4Cz5dM7fJm7PFXds1jtbNzsSjw4rAkKPSp6fZY5cGwTxOL_xj1PCgTQdOklT32MGiuibuAAteT6Kv11iHjAtKeEMEB93RZWa2h0aeFc7hXZ1MMrXB8AjRMIrK9MJQKYYUj_yxxX9bs Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:54:13.498888 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45c2a8d4be674caeab73db8e28ac1459", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 3917d606c35f4db1af916815167fae74 Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:54:13.500287 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'c0109b00-ad83-4acd-9862-a64c21cd8516'} Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:54:13.501022 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:54:13.502457 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.516645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Returning 404 to user: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:54:13.517530 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1da0ca1c-b181-4eb2-af7a-f2493c7e824f tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 404 len: 111 microversion: 2.1 time: 0.136077 Aug 27 04:54:13.534818 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 325/660] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:54:13 2022] DELETE /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:54:13.539808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:13.540436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] [instance: c0109b00-ad83-4acd-9862-a64c21cd8516] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:13.567991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.568480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.568926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.569641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.570103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.570536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.632221 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] HTTP exception thrown: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Request method failure captured: Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 HTTP/1.1 Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMqdWWOVNaYg8XVJDOIdDz9S7IVDQabmLJgp4Cz5dM7fJm7PFXds1jtbNzsSjw4rAkKPSp6fZY5cGwTxOL_xj1PCgTQdOklT32MGiuibuAAteT6Kv11iHjAtKeEMEB93RZWa2h0aeFc7hXZ1MMrXB8AjRMIrK9MJQKYYUj_yxxX9bs Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:54:13.633930 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45c2a8d4be674caeab73db8e28ac1459", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45c2a8d4be674caeab73db8e28ac1459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 45c2a8d4be674caeab73db8e28ac1459 Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472224229 Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 3917d606c35f4db1af916815167fae74 Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472224229-project Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:54:13.635548 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'c0109b00-ad83-4acd-9862-a64c21cd8516'} Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:54:13.636897 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. Aug 27 04:54:13.639001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:13.645627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] Returning 404 to user: Instance c0109b00-ad83-4acd-9862-a64c21cd8516 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:54:13.647888 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-31c8b9ef-6325-478e-99bc-dd5c4492ce8b tempest-DeleteServersAdminTestJSON-1472224229 tempest-DeleteServersAdminTestJSON-1472224229-project] 10.222.0.58 "GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516" status: 404 len: 111 microversion: 2.1 time: 0.111913 Aug 27 04:54:13.657420 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 326/661] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:13 2022] GET /compute/v2.1/servers/c0109b00-ad83-4acd-9862-a64c21cd8516 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:54:13.674787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-11142010", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "198422a0-c1e8-4c71-9ecd-43b3c3e0178d"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:13.775923 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-56c5ba83-9158-421a-a3d1-9c46a8bc06e0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 204 len: 0 microversion: 2.1 time: 0.458226 Aug 27 04:54:13.777145 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 336/662] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:54:13 2022] DELETE /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:54:13.854359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:54:14.121123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1070821995", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "354078131", "adminPass": "***", "networks": [{"uuid": "d7928017-ad01-4c58-b5a0-c8dfbe169b07"}], "security_groups": [{"name": "tempest-securitygroup--141916901"}], "key_name": "tempest-keypair-1341876475", "user_data": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:14.823032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] validate_networks() for [('d7928017-ad01-4c58-b5a0-c8dfbe169b07', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:54:15.174759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:54:15.175352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:54:15.175689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:54:15.176104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:54:15.176523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:54:15.210206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:15.210705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:15.212430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:15.213385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:15.219834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:15.220547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:15.291285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:15.301839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:15.339835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:54:15.342267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:15.433353 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4eaefbc-4820-4430-a0ca-d11d2151b285 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774207 Aug 27 04:54:15.434009 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 327/663] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:54:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:54:15.445422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6275b323-beeb-461d-82ce-d6dc24ca2265 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:15.446051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6275b323-beeb-461d-82ce-d6dc24ca2265 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:15.472894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:15.601054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6275b323-beeb-461d-82ce-d6dc24ca2265 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:15.609999 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6275b323-beeb-461d-82ce-d6dc24ca2265 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1215 microversion: 2.1 time: 0.168565 Aug 27 04:54:15.627343 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 328/664] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:15 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:16.272084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-97d42f37-a4e2-46af-a5f4-2a2546cdca55 tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] Action: 'create', calling method: .version_select at 0x7fb5655da1f0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:16.320110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-97d42f37-a4e2-46af-a5f4-2a2546cdca55 tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] Getting quotas for project a1d74f47669446a2b5bf491f9af6d6c2. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:16.342745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-97d42f37-a4e2-46af-a5f4-2a2546cdca55 tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] Getting quotas for user 1ba4bc1420194d5b9b187695e38fc82a and project a1d74f47669446a2b5bf491f9af6d6c2. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:16.487000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-97d42f37-a4e2-46af-a5f4-2a2546cdca55 tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] Getting quotas for project a1d74f47669446a2b5bf491f9af6d6c2. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:16.493513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-97d42f37-a4e2-46af-a5f4-2a2546cdca55 tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] Getting quotas for user 1ba4bc1420194d5b9b187695e38fc82a and project a1d74f47669446a2b5bf491f9af6d6c2. Resources: {'server_groups'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:16.510279 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-97d42f37-a4e2-46af-a5f4-2a2546cdca55 tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.492948 Aug 27 04:54:16.519222 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 329/665] 10.222.0.58 () {62 vars in 1214 bytes} [Sat Aug 27 04:54:16 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:54:16.524440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69621ed1-b98c-4ee1-bc0c-65004337384f tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:16.545135 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-69621ed1-b98c-4ee1-bc0c-65004337384f tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.024470 Aug 27 04:54:16.552583 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 330/666] 10.222.0.58 () {60 vars in 1193 bytes} [Sat Aug 27 04:54:16 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:54:16.559190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-42e4022c-1cdc-478f-b028-2c68ade6ca78 tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:16.569037 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-42e4022c-1cdc-478f-b028-2c68ade6ca78 tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/87441294-d186-4697-bf17-2dd3b64b2786" status: 200 len: 235 microversion: 2.64 time: 0.014699 Aug 27 04:54:16.576350 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 331/667] 10.222.0.58 () {60 vars in 1304 bytes} [Sat Aug 27 04:54:16 2022] GET /compute/v2.1/os-server-groups/87441294-d186-4697-bf17-2dd3b64b2786 => generated 235 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:54:16.581856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-13618262-bbfb-4942-baa7-8f58c12303da tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:16.630443 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-13618262-bbfb-4942-baa7-8f58c12303da tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/87441294-d186-4697-bf17-2dd3b64b2786" status: 204 len: 0 microversion: 2.64 time: 0.052547 Aug 27 04:54:16.631489 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 332/668] 10.222.0.58 () {60 vars in 1307 bytes} [Sat Aug 27 04:54:16 2022] DELETE /compute/v2.1/os-server-groups/87441294-d186-4697-bf17-2dd3b64b2786 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:54:16.643863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f4b40b10-b929-4036-98fa-664d6e85a58f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:16.644855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f4b40b10-b929-4036-98fa-664d6e85a58f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:16.652022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4b40b10-b929-4036-98fa-664d6e85a58f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:16.652889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4b40b10-b929-4036-98fa-664d6e85a58f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:16.653612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4b40b10-b929-4036-98fa-664d6e85a58f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:16.654593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4b40b10-b929-4036-98fa-664d6e85a58f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:16.655327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4b40b10-b929-4036-98fa-664d6e85a58f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:16.656023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4b40b10-b929-4036-98fa-664d6e85a58f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:16.880392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f4b40b10-b929-4036-98fa-664d6e85a58f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:16.888740 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f4b40b10-b929-4036-98fa-664d6e85a58f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1219 microversion: 2.1 time: 0.249229 Aug 27 04:54:16.905325 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 333/669] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:16 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1219 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:16.911300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab54a4aa-9e36-4289-a8cf-66a7a248044e tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:16.919283 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-ab54a4aa-9e36-4289-a8cf-66a7a248044e tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] HTTP exception thrown: Instance group 87441294-d186-4697-bf17-2dd3b64b2786 could not be found. Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab54a4aa-9e36-4289-a8cf-66a7a248044e tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] Request method failure captured: Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/os-server-groups/87441294-d186-4697-bf17-2dd3b64b2786 HTTP/1.1 Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaN35awLY5Mqysp2KX-RWNLR58nh0aHrsfpZVbb8a2XGQW3PVnC2CG6nWOPKcPf6P1GfeQ0GwcsSdQ9KHkZqiD6HUScKWaqjP5kgHk9V41UAPP9B7ioaxbUpj_VgLw8DUHve-UN7uL-OvHM9dtJqMEco2lU0-_yRxXiJqqx_VHJABnk Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.64 Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: a1d74f47669446a2b5bf491f9af6d6c2 Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerGroup264TestJSON-96958386 Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:54:16.929798 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a1d74f47669446a2b5bf491f9af6d6c2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a1d74f47669446a2b5bf491f9af6d6c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a1d74f47669446a2b5bf491f9af6d6c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a1d74f47669446a2b5bf491f9af6d6c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerGroup264TestJSON-96958386 Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: a1d74f47669446a2b5bf491f9af6d6c2 Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerGroup264TestJSON-96958386 Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerGroup264TestJSON-96958386-project Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 1ba4bc1420194d5b9b187695e38fc82a Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerGroup264TestJSON-96958386-project Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance group 87441294-d186-4697-bf17-2dd3b64b2786 could not be found. Aug 27 04:54:16.932102 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '87441294-d186-4697-bf17-2dd3b64b2786'} Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 87441294-d186-4697-bf17-2dd3b64b2786 could not be found. Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:16.933626 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 87441294-d186-4697-bf17-2dd3b64b2786 could not be found. Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 87441294-d186-4697-bf17-2dd3b64b2786 could not be found. Aug 27 04:54:16.934904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:16.936032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab54a4aa-9e36-4289-a8cf-66a7a248044e tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] Returning 404 to user: Instance group 87441294-d186-4697-bf17-2dd3b64b2786 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:54:16.936032 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ab54a4aa-9e36-4289-a8cf-66a7a248044e tempest-ServerGroup264TestJSON-96958386 tempest-ServerGroup264TestJSON-96958386-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/87441294-d186-4697-bf17-2dd3b64b2786" status: 404 len: 117 microversion: 2.64 time: 0.024625 Aug 27 04:54:16.937303 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 334/670] 10.222.0.58 () {60 vars in 1307 bytes} [Sat Aug 27 04:54:16 2022] DELETE /compute/v2.1/os-server-groups/87441294-d186-4697-bf17-2dd3b64b2786 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:54:17.917255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-34302a51-a604-4816-9cc7-d44fabecb0d5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:17.919427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-34302a51-a604-4816-9cc7-d44fabecb0d5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:17.951322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34302a51-a604-4816-9cc7-d44fabecb0d5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:17.954224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34302a51-a604-4816-9cc7-d44fabecb0d5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:17.957151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34302a51-a604-4816-9cc7-d44fabecb0d5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:17.960086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34302a51-a604-4816-9cc7-d44fabecb0d5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:17.960601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34302a51-a604-4816-9cc7-d44fabecb0d5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:17.963339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34302a51-a604-4816-9cc7-d44fabecb0d5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:18.151399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:54:18.152369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:54:18.153471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:54:18.154058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:54:18.154633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:54:18.176865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:18.177531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:18.179049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:18.180203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:18.180829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:18.181990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:18.205876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Getting quotas for project c83a0d500b9c445ea02dc63360a3c4cf. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:18.212826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Getting quotas for user ddc99cf572d545be8638aaeb6f59749d and project c83a0d500b9c445ea02dc63360a3c4cf. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:18.216766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-34302a51-a604-4816-9cc7-d44fabecb0d5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:18.224500 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-34302a51-a604-4816-9cc7-d44fabecb0d5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1273 microversion: 2.1 time: 0.316174 Aug 27 04:54:18.227439 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 335/671] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:17 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1273 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:18.232012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:54:18.235186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:18.319675 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5388ffb-d2cf-4493-af67-480c3024d197 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.203744 Aug 27 04:54:18.321034 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 337/672] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:54:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 4206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:54:18.333087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdad1a07-1360-42ca-a781-1af98115e96b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:18.333706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cdad1a07-1360-42ca-a781-1af98115e96b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:19.226274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdad1a07-1360-42ca-a781-1af98115e96b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:19.235523 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cdad1a07-1360-42ca-a781-1af98115e96b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1263 microversion: 2.1 time: 0.906157 Aug 27 04:54:19.247739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-32c0ca95-4ebe-41cc-a79e-cd8860073df9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:19.248572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-32c0ca95-4ebe-41cc-a79e-cd8860073df9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:19.267006 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 336/673] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:18 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1263 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:19.267631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32c0ca95-4ebe-41cc-a79e-cd8860073df9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:19.267631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32c0ca95-4ebe-41cc-a79e-cd8860073df9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:19.267631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32c0ca95-4ebe-41cc-a79e-cd8860073df9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:19.267631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32c0ca95-4ebe-41cc-a79e-cd8860073df9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:19.267998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32c0ca95-4ebe-41cc-a79e-cd8860073df9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:19.268126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32c0ca95-4ebe-41cc-a79e-cd8860073df9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:19.458631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1878325554", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "051dccae-a303-46a8-a77e-49031a700014"}], "security_groups": [{"name": "tempest-securitygroup--913407833"}], "key_name": "tempest-keypair-41584641", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:19.550427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-32c0ca95-4ebe-41cc-a79e-cd8860073df9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:19.571067 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-32c0ca95-4ebe-41cc-a79e-cd8860073df9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1273 microversion: 2.1 time: 0.318742 Aug 27 04:54:19.577044 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 338/674] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:19 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1273 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:20.046063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] validate_networks() for [('051dccae-a303-46a8-a77e-49031a700014', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:54:20.276670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-67e4d6d1-5d3e-4c59-abf8-cd0864ca5443 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:20.277568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-67e4d6d1-5d3e-4c59-abf8-cd0864ca5443 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:20.290005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67e4d6d1-5d3e-4c59-abf8-cd0864ca5443 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:20.290505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67e4d6d1-5d3e-4c59-abf8-cd0864ca5443 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:20.290948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67e4d6d1-5d3e-4c59-abf8-cd0864ca5443 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:20.291903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67e4d6d1-5d3e-4c59-abf8-cd0864ca5443 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:20.292874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67e4d6d1-5d3e-4c59-abf8-cd0864ca5443 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:20.293334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67e4d6d1-5d3e-4c59-abf8-cd0864ca5443 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:20.353047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:20.695349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-67e4d6d1-5d3e-4c59-abf8-cd0864ca5443 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:20.712849 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-67e4d6d1-5d3e-4c59-abf8-cd0864ca5443 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1315 microversion: 2.1 time: 0.440015 Aug 27 04:54:20.715705 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 339/675] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:20 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:20.757395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-86a66280-59e4-448d-a5c3-882543a075bf req-e179b7b9-8361-4f9e-a132-8227d51fcbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8582438a-00e8-41b1-8aeb-662d153b4983", "name": "network-vif-unplugged", "status": "completed", "tag": "efa2644d-7860-4145-ae82-550f59ddc80c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:20.789302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-86a66280-59e4-448d-a5c3-882543a075bf req-e179b7b9-8361-4f9e-a132-8227d51fcbd7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:20.789788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-86a66280-59e4-448d-a5c3-882543a075bf req-e179b7b9-8361-4f9e-a132-8227d51fcbd7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:20.791622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-86a66280-59e4-448d-a5c3-882543a075bf req-e179b7b9-8361-4f9e-a132-8227d51fcbd7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:20.825986 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-86a66280-59e4-448d-a5c3-882543a075bf req-e179b7b9-8361-4f9e-a132-8227d51fcbd7 service nova] Creating event network-vif-unplugged:efa2644d-7860-4145-ae82-550f59ddc80c for instance 8582438a-00e8-41b1-8aeb-662d153b4983 on n-h2-820368-35 Aug 27 04:54:20.843639 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-86a66280-59e4-448d-a5c3-882543a075bf req-e179b7b9-8361-4f9e-a132-8227d51fcbd7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109977 Aug 27 04:54:20.846171 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 340/676] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:20.859932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cf43234c-21e7-4932-a4dc-0bfa319df96d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:20.863011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cf43234c-21e7-4932-a4dc-0bfa319df96d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:20.878092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf43234c-21e7-4932-a4dc-0bfa319df96d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:20.880431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf43234c-21e7-4932-a4dc-0bfa319df96d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:20.881347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf43234c-21e7-4932-a4dc-0bfa319df96d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:20.891872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf43234c-21e7-4932-a4dc-0bfa319df96d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:20.892664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf43234c-21e7-4932-a4dc-0bfa319df96d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:20.893980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf43234c-21e7-4932-a4dc-0bfa319df96d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:21.743393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cf43234c-21e7-4932-a4dc-0bfa319df96d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:21.758811 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cf43234c-21e7-4932-a4dc-0bfa319df96d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1315 microversion: 2.1 time: 0.910426 Aug 27 04:54:21.759453 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 341/677] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:20 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:21.776155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-446aae72-26e7-47ef-b2d5-2fad0c4125ae tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:21.776781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-446aae72-26e7-47ef-b2d5-2fad0c4125ae tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:21.803696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-446aae72-26e7-47ef-b2d5-2fad0c4125ae tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:21.806742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-446aae72-26e7-47ef-b2d5-2fad0c4125ae tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:21.812374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-446aae72-26e7-47ef-b2d5-2fad0c4125ae tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:21.814830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-446aae72-26e7-47ef-b2d5-2fad0c4125ae tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:21.815387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-446aae72-26e7-47ef-b2d5-2fad0c4125ae tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:21.817998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-446aae72-26e7-47ef-b2d5-2fad0c4125ae tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:21.990375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-446aae72-26e7-47ef-b2d5-2fad0c4125ae tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:22.003961 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-446aae72-26e7-47ef-b2d5-2fad0c4125ae tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1321 microversion: 2.1 time: 0.243320 Aug 27 04:54:22.017578 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 342/678] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:21 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:22.721492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:54:22.722656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:54:22.723407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:54:22.724035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:54:22.724673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:54:22.749550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:22.750428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:22.755780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:22.756960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:22.757654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:22.762050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:22.823756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-104448467", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "6631de15-3af6-42f4-8228-9ee244a14ce1"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:22.859372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Getting quotas for project f5c7422cdaca490aaffc4004f77d830c. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:22.882858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Getting quotas for user b7d4fe4aaf864bb58c162620c9948d89 and project f5c7422cdaca490aaffc4004f77d830c. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:22.943773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:54:22.945295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:22.971531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] validate_networks() for [('6631de15-3af6-42f4-8228-9ee244a14ce1', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:54:23.069952 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a18b685a-99d0-4600-8353-c1b429b22ace tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 3.616826 Aug 27 04:54:23.075432 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 337/679] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 04:54:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 3624 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 04:54:23.085410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8df21b04-5422-4bba-a55d-6ec2528885f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:23.086823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8df21b04-5422-4bba-a55d-6ec2528885f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:23.100764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8df21b04-5422-4bba-a55d-6ec2528885f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:23.105161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8df21b04-5422-4bba-a55d-6ec2528885f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:23.119606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8df21b04-5422-4bba-a55d-6ec2528885f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:23.121237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8df21b04-5422-4bba-a55d-6ec2528885f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:23.123782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8df21b04-5422-4bba-a55d-6ec2528885f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:23.128048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8df21b04-5422-4bba-a55d-6ec2528885f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:25.728396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8df21b04-5422-4bba-a55d-6ec2528885f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:25.744373 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8df21b04-5422-4bba-a55d-6ec2528885f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1315 microversion: 2.1 time: 2.667443 Aug 27 04:54:25.748067 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 338/680] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:23 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1315 bytes in 2672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:25.757757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cbdf0b93-3e92-4cd3-8980-21ab35294a2c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:25.765578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cbdf0b93-3e92-4cd3-8980-21ab35294a2c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:25.789574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbdf0b93-3e92-4cd3-8980-21ab35294a2c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:25.790322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbdf0b93-3e92-4cd3-8980-21ab35294a2c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:25.796790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbdf0b93-3e92-4cd3-8980-21ab35294a2c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:25.808942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbdf0b93-3e92-4cd3-8980-21ab35294a2c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:25.813668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbdf0b93-3e92-4cd3-8980-21ab35294a2c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:25.814385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbdf0b93-3e92-4cd3-8980-21ab35294a2c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:25.829969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:26.120953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cbdf0b93-3e92-4cd3-8980-21ab35294a2c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:26.137798 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cbdf0b93-3e92-4cd3-8980-21ab35294a2c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1321 microversion: 2.1 time: 0.388354 Aug 27 04:54:26.145104 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 339/681] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:25 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:26.159399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:26.160035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:26.201628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:26.202138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:26.202670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:26.203446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:26.210868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:26.211479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:27.103410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:54:27.104596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:54:27.105397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:54:27.106051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:54:27.106683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:54:27.110624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:27.137880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:27.140952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:27.141511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:27.143682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:27.144344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:27.145518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:27.214108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Getting quotas for project 9d672c3f0e4c4128ad7c4b3a1c1fd868. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:27.222201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:27.235507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:27.237990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:27.240923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Getting quotas for user dcf7892387894e07a7e0f35c70a5e1dd and project 9d672c3f0e4c4128ad7c4b3a1c1fd868. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:27.243557 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1dc494fc-a13d-4704-b02e-19d923f494ce tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1354 microversion: 2.25 time: 1.096791 Aug 27 04:54:27.249652 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 340/682] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:26 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1354 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:27.292940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Going to run 3 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:54:27.296347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:27.401677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: f8f4d090-8163-469c-b801-7864b9155ed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=35d5a4df-1045-4b64-b58c-2383ce224d63,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:27.506012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=f8f4d090-8163-469c-b801-7864b9155ed3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:27.590526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd9254ba-bc85-490c-b794-94b92137e2a9 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-496027073", "id": 1953592594, "os-flavor-access:is_public": "False"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:27.641851 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cd9254ba-bc85-490c-b794-94b92137e2a9 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.390637 Aug 27 04:54:27.660252 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 341/683] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:54:27 2022] POST /compute/v2.1/flavors => generated 430 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:27.665233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-912ece11-5cd8-42a9-b9d2-9eb7c3495ba0 req-711671da-8127-4d20-bd8c-a2421e62d64a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9", "tag": "9a5e5638-e923-4d24-8aa1-20e1f4dbb2b0"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:27.728837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-912ece11-5cd8-42a9-b9d2-9eb7c3495ba0 req-711671da-8127-4d20-bd8c-a2421e62d64a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:27.729490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-912ece11-5cd8-42a9-b9d2-9eb7c3495ba0 req-711671da-8127-4d20-bd8c-a2421e62d64a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:27.730004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-912ece11-5cd8-42a9-b9d2-9eb7c3495ba0 req-711671da-8127-4d20-bd8c-a2421e62d64a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:27.770563 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-912ece11-5cd8-42a9-b9d2-9eb7c3495ba0 req-711671da-8127-4d20-bd8c-a2421e62d64a service nova] Creating event network-changed:9a5e5638-e923-4d24-8aa1-20e1f4dbb2b0 for instance 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 on n-h2-820368-35 Aug 27 04:54:27.773010 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dbd87b02-dcd7-4324-9e56-0c59bc5b7984 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.754253 Aug 27 04:54:27.793038 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 343/684] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:54:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 5775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:54:27.805444 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-912ece11-5cd8-42a9-b9d2-9eb7c3495ba0 req-711671da-8127-4d20-bd8c-a2421e62d64a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135634 Aug 27 04:54:27.811469 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 342/685] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:27.817164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-62247844-d37d-46c4-a4e0-7b732c461454 req-60c07d51-4ed2-411e-a308-671e6e55e3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8582438a-00e8-41b1-8aeb-662d153b4983", "name": "network-vif-deleted", "tag": "efa2644d-7860-4145-ae82-550f59ddc80c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:27.818399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3848368e-bfeb-4ea5-8061-634f62d42068 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:27.819377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3848368e-bfeb-4ea5-8061-634f62d42068 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:27.826977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3848368e-bfeb-4ea5-8061-634f62d42068 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:27.827832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3848368e-bfeb-4ea5-8061-634f62d42068 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:27.828938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3848368e-bfeb-4ea5-8061-634f62d42068 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:27.829986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3848368e-bfeb-4ea5-8061-634f62d42068 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:27.830715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3848368e-bfeb-4ea5-8061-634f62d42068 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:27.832038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3848368e-bfeb-4ea5-8061-634f62d42068 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:27.865860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-62247844-d37d-46c4-a4e0-7b732c461454 req-60c07d51-4ed2-411e-a308-671e6e55e3b4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:27.866421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-62247844-d37d-46c4-a4e0-7b732c461454 req-60c07d51-4ed2-411e-a308-671e6e55e3b4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:27.868316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-62247844-d37d-46c4-a4e0-7b732c461454 req-60c07d51-4ed2-411e-a308-671e6e55e3b4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:27.898377 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-62247844-d37d-46c4-a4e0-7b732c461454 req-60c07d51-4ed2-411e-a308-671e6e55e3b4 service nova] Creating event network-vif-deleted:efa2644d-7860-4145-ae82-550f59ddc80c for instance 8582438a-00e8-41b1-8aeb-662d153b4983 on n-h2-820368-35 Aug 27 04:54:27.914624 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-62247844-d37d-46c4-a4e0-7b732c461454 req-60c07d51-4ed2-411e-a308-671e6e55e3b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119920 Aug 27 04:54:27.915675 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 344/686] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:27.928644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5f640a01-1163-4214-b1da-85f09b53cb65 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:27.936352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5f640a01-1163-4214-b1da-85f09b53cb65 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:27.957030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f640a01-1163-4214-b1da-85f09b53cb65 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:27.957988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f640a01-1163-4214-b1da-85f09b53cb65 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:27.958084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f640a01-1163-4214-b1da-85f09b53cb65 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:27.958717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f640a01-1163-4214-b1da-85f09b53cb65 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:27.959473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f640a01-1163-4214-b1da-85f09b53cb65 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:27.960042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f640a01-1163-4214-b1da-85f09b53cb65 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:28.138756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3848368e-bfeb-4ea5-8061-634f62d42068 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:28.150794 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3848368e-bfeb-4ea5-8061-634f62d42068 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1315 microversion: 2.1 time: 0.334819 Aug 27 04:54:28.154376 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 343/687] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:27 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:28.159458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-548bfc72-c148-4dc8-81d6-a539bb388dd8 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "19d9dcc166914649a2dd7b5788edca2c"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:28.321480 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-548bfc72-c148-4dc8-81d6-a539bb388dd8 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1953592594/action" status: 200 len: 97 microversion: 2.1 time: 0.165763 Aug 27 04:54:28.324448 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 344/688] 10.222.0.58 () {60 vars in 1200 bytes} [Sat Aug 27 04:54:28 2022] POST /compute/v2.1/flavors/1953592594/action => generated 97 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:28.334468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c95a6264-7e76-43e0-a050-7a697caffa96 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:28.361517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c95a6264-7e76-43e0-a050-7a697caffa96 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:28.363883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c95a6264-7e76-43e0-a050-7a697caffa96 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Searching by: {'deleted': False, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:54:28.393672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95a6264-7e76-43e0-a050-7a697caffa96 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:28.394424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95a6264-7e76-43e0-a050-7a697caffa96 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:28.395035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95a6264-7e76-43e0-a050-7a697caffa96 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:28.396111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95a6264-7e76-43e0-a050-7a697caffa96 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:28.411767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95a6264-7e76-43e0-a050-7a697caffa96 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:28.412796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95a6264-7e76-43e0-a050-7a697caffa96 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:28.455585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5f640a01-1163-4214-b1da-85f09b53cb65 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:28.480888 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5f640a01-1163-4214-b1da-85f09b53cb65 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 0.561678 Aug 27 04:54:28.486419 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 345/689] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:27 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:28.502163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:28.517006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:28.542802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:28.544191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:28.544864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:28.545848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:28.550872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:28.557511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:28.724110 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c95a6264-7e76-43e0-a050-7a697caffa96 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.397124 Aug 27 04:54:28.725447 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 345/690] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 04:54:28 2022] GET /compute/v2.1/servers => generated 1015 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:28.918425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:28.940749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:28.945176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:28.951111 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ca889bf0-2b59-4653-9306-f05e532efc67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1342 microversion: 2.25 time: 0.454311 Aug 27 04:54:28.951990 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 346/691] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:28 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1342 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:28.964625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-166f6af4-c065-46f3-af84-6c121a5ff024 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:28.965258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-166f6af4-c065-46f3-af84-6c121a5ff024 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:28.994117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d77715ef-3d4f-4349-9fb5-79c1a7385e11 tempest-FlavorsAccessTestJSON-710061842 tempest-FlavorsAccessTestJSON-710061842-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:29.084433 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d77715ef-3d4f-4349-9fb5-79c1a7385e11 tempest-FlavorsAccessTestJSON-710061842 tempest-FlavorsAccessTestJSON-710061842-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 6234 microversion: 2.1 time: 0.357574 Aug 27 04:54:29.085868 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 346/692] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:54:28 2022] GET /compute/v2.1/flavors/detail => generated 6234 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:29.107423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7db9a391-8bff-44a3-807b-092f8a1bd53b tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "19d9dcc166914649a2dd7b5788edca2c"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:29.275422 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7db9a391-8bff-44a3-807b-092f8a1bd53b tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1953592594/action" status: 200 len: 21 microversion: 2.1 time: 0.173060 Aug 27 04:54:29.280326 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 347/693] 10.222.0.58 () {60 vars in 1200 bytes} [Sat Aug 27 04:54:29 2022] POST /compute/v2.1/flavors/1953592594/action => generated 21 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:29.317464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5b4e15fd-f7f4-432a-baeb-3de6cb274396 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:29.323038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5b4e15fd-f7f4-432a-baeb-3de6cb274396 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:29.359776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:29.388426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b4e15fd-f7f4-432a-baeb-3de6cb274396 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:29.391005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b4e15fd-f7f4-432a-baeb-3de6cb274396 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:29.392095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b4e15fd-f7f4-432a-baeb-3de6cb274396 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:29.394730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b4e15fd-f7f4-432a-baeb-3de6cb274396 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:29.395433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b4e15fd-f7f4-432a-baeb-3de6cb274396 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:29.410940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b4e15fd-f7f4-432a-baeb-3de6cb274396 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:29.625343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-166f6af4-c065-46f3-af84-6c121a5ff024 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:29.633999 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-166f6af4-c065-46f3-af84-6c121a5ff024 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1222 microversion: 2.1 time: 0.680527 Aug 27 04:54:29.637319 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 347/694] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:28 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1222 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:29.651314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-09dc59cd-e0da-4b0e-b68f-1492203b6751 tempest-FlavorsAccessTestJSON-710061842 tempest-FlavorsAccessTestJSON-710061842-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:29.708922 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-09dc59cd-e0da-4b0e-b68f-1492203b6751 tempest-FlavorsAccessTestJSON-710061842 tempest-FlavorsAccessTestJSON-710061842-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.070012 Aug 27 04:54:29.709552 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 348/695] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:54:29 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:29.725034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-03c8d59c-49b4-4d9c-8e78-e30dff3194da tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:29.725034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-03c8d59c-49b4-4d9c-8e78-e30dff3194da tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:29.738988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03c8d59c-49b4-4d9c-8e78-e30dff3194da tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:29.739520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03c8d59c-49b4-4d9c-8e78-e30dff3194da tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:29.743123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03c8d59c-49b4-4d9c-8e78-e30dff3194da tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:29.744259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03c8d59c-49b4-4d9c-8e78-e30dff3194da tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:29.745711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03c8d59c-49b4-4d9c-8e78-e30dff3194da tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:29.747399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03c8d59c-49b4-4d9c-8e78-e30dff3194da tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:30.426811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5b4e15fd-f7f4-432a-baeb-3de6cb274396 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:30.444520 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5b4e15fd-f7f4-432a-baeb-3de6cb274396 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1315 microversion: 2.1 time: 1.146946 Aug 27 04:54:30.460516 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 348/696] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:29 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1315 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:30.475617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a51c535d-e46c-4649-b4d4-50b38605ed58 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:30.529826 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a51c535d-e46c-4649-b4d4-50b38605ed58 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1953592594" status: 202 len: 0 microversion: 2.1 time: 0.067734 Aug 27 04:54:30.530582 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 349/697] 10.222.0.58 () {58 vars in 1161 bytes} [Sat Aug 27 04:54:30 2022] DELETE /compute/v2.1/flavors/1953592594 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:54:30.538974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:30.542637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:30.574447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:30.575293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:30.585977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:30.585977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:30.585977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:30.586590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:30.930694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-03c8d59c-49b4-4d9c-8e78-e30dff3194da tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:30.952699 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-03c8d59c-49b4-4d9c-8e78-e30dff3194da tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 1.233238 Aug 27 04:54:30.971335 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 349/698] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:29 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:30.986455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-ef490f62-a91d-4a5d-8bf6-1a935b4646b1 req-76922b2f-7dcc-4ed9-ae28-892b668f3567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffd03e4-cebb-4c94-a9f9-fc0887472298", "tag": "db5f8da9-4df5-4598-a365-b238e6e53d2f"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:31.012284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ef490f62-a91d-4a5d-8bf6-1a935b4646b1 req-76922b2f-7dcc-4ed9-ae28-892b668f3567 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:31.015932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ef490f62-a91d-4a5d-8bf6-1a935b4646b1 req-76922b2f-7dcc-4ed9-ae28-892b668f3567 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:31.016742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ef490f62-a91d-4a5d-8bf6-1a935b4646b1 req-76922b2f-7dcc-4ed9-ae28-892b668f3567 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:31.027781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:31.060549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:31.062624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:31.082360 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7f239497-baae-4d49-9353-e79c9319de9f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.547185 Aug 27 04:54:31.088145 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 350/699] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:30 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:31.093688 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-ef490f62-a91d-4a5d-8bf6-1a935b4646b1 req-76922b2f-7dcc-4ed9-ae28-892b668f3567 service nova] Creating event network-changed:db5f8da9-4df5-4598-a365-b238e6e53d2f for instance dffd03e4-cebb-4c94-a9f9-fc0887472298 on n-h2-820368-35 Aug 27 04:54:31.122968 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-ef490f62-a91d-4a5d-8bf6-1a935b4646b1 req-76922b2f-7dcc-4ed9-ae28-892b668f3567 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147689 Aug 27 04:54:31.123498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-299144c2-2cbb-4a2c-8aa1-ddc61f07083f tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:31.124530 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 350/700] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:31.139815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-53736db6-b1f5-4768-983e-7e7b0be78f17 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:31.156329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-53736db6-b1f5-4768-983e-7e7b0be78f17 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:31.191871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53736db6-b1f5-4768-983e-7e7b0be78f17 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:31.195992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53736db6-b1f5-4768-983e-7e7b0be78f17 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:31.198290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53736db6-b1f5-4768-983e-7e7b0be78f17 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:31.199316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53736db6-b1f5-4768-983e-7e7b0be78f17 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:31.204011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53736db6-b1f5-4768-983e-7e7b0be78f17 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:31.210224 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-299144c2-2cbb-4a2c-8aa1-ddc61f07083f tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.118826 Aug 27 04:54:31.211476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53736db6-b1f5-4768-983e-7e7b0be78f17 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:31.253958 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 351/701] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:54:31 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:31.271363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b65b906-cdc1-461a-b6b9-d53656a57777 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-210593548", "id": 710528943, "os-flavor-access:is_public": "False"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:31.343892 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b65b906-cdc1-461a-b6b9-d53656a57777 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.088714 Aug 27 04:54:31.353083 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 352/702] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:54:31 2022] POST /compute/v2.1/flavors => generated 427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:31.359348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ae4c264a-3a18-468e-be9d-7e77e795c1c2 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:31.386531 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ae4c264a-3a18-468e-be9d-7e77e795c1c2 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/710528943/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.031514 Aug 27 04:54:31.387151 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 353/703] 10.222.0.58 () {58 vars in 1206 bytes} [Sat Aug 27 04:54:31 2022] GET /compute/v2.1/flavors/710528943/os-flavor-access => generated 21 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:31.411451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1f7e753-3cb9-41b7-b161-a4bf315822d8 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:31.441318 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1f7e753-3cb9-41b7-b161-a4bf315822d8 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/710528943" status: 202 len: 0 microversion: 2.1 time: 0.040942 Aug 27 04:54:31.446277 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 354/704] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:54:31 2022] DELETE /compute/v2.1/flavors/710528943 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:54:31.456050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ec528d9-e4ef-43f8-ba40-eba37aaf5e06 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:31.527941 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ec528d9-e4ef-43f8-ba40-eba37aaf5e06 tempest-FlavorsAccessTestJSON-1717206691 tempest-FlavorsAccessTestJSON-1717206691-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.079921 Aug 27 04:54:31.529883 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 355/705] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:54:31 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:31.558523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5523ad86-d01f-4b50-92af-82644efc59b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:31.559354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5523ad86-d01f-4b50-92af-82644efc59b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:31.566309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5523ad86-d01f-4b50-92af-82644efc59b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:31.567033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5523ad86-d01f-4b50-92af-82644efc59b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:31.567663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5523ad86-d01f-4b50-92af-82644efc59b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:31.568589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5523ad86-d01f-4b50-92af-82644efc59b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:31.569188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5523ad86-d01f-4b50-92af-82644efc59b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:31.569776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5523ad86-d01f-4b50-92af-82644efc59b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:31.620850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-53736db6-b1f5-4768-983e-7e7b0be78f17 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:31.638068 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-53736db6-b1f5-4768-983e-7e7b0be78f17 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1226 microversion: 2.1 time: 0.502958 Aug 27 04:54:31.644374 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 351/706] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:31 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1226 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:31.991583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f32fcb0b-5cda-450f-ba48-96da95dfb855 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:31.992939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f32fcb0b-5cda-450f-ba48-96da95dfb855 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:32.009632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f32fcb0b-5cda-450f-ba48-96da95dfb855 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:32.012386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f32fcb0b-5cda-450f-ba48-96da95dfb855 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:32.015889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f32fcb0b-5cda-450f-ba48-96da95dfb855 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:32.017415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f32fcb0b-5cda-450f-ba48-96da95dfb855 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:32.019681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f32fcb0b-5cda-450f-ba48-96da95dfb855 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:32.025928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f32fcb0b-5cda-450f-ba48-96da95dfb855 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:32.913269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=26 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:33.126230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5523ad86-d01f-4b50-92af-82644efc59b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:33.141975 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5523ad86-d01f-4b50-92af-82644efc59b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1315 microversion: 2.1 time: 1.610746 Aug 27 04:54:33.157165 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 356/707] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:31 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1315 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:33.178172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:33.179218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:33.186139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:33.187076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:33.187775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:33.188904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:33.198223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:33.199042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:34.265790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f32fcb0b-5cda-450f-ba48-96da95dfb855 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:34.303537 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f32fcb0b-5cda-450f-ba48-96da95dfb855 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 2.315163 Aug 27 04:54:34.304418 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 352/708] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:31 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:34.334887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a0b3d2c-7a7c-486d-b69d-fe8019d68a7d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:34.336398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0a0b3d2c-7a7c-486d-b69d-fe8019d68a7d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:34.350835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a0b3d2c-7a7c-486d-b69d-fe8019d68a7d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:34.351707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a0b3d2c-7a7c-486d-b69d-fe8019d68a7d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:34.352369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a0b3d2c-7a7c-486d-b69d-fe8019d68a7d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:34.353457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a0b3d2c-7a7c-486d-b69d-fe8019d68a7d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:34.354098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a0b3d2c-7a7c-486d-b69d-fe8019d68a7d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:34.354715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a0b3d2c-7a7c-486d-b69d-fe8019d68a7d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:34.488512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0a0b3d2c-7a7c-486d-b69d-fe8019d68a7d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:34.500011 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a0b3d2c-7a7c-486d-b69d-fe8019d68a7d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1280 microversion: 2.1 time: 0.175598 Aug 27 04:54:34.503401 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 353/709] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:34 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1280 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:34.516047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-27873dd0-3583-42bd-aec2-7c71706872a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:34.518366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-27873dd0-3583-42bd-aec2-7c71706872a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:34.535625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27873dd0-3583-42bd-aec2-7c71706872a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:34.536427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27873dd0-3583-42bd-aec2-7c71706872a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:34.537060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27873dd0-3583-42bd-aec2-7c71706872a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:34.537959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27873dd0-3583-42bd-aec2-7c71706872a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:34.539369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27873dd0-3583-42bd-aec2-7c71706872a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:34.543766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27873dd0-3583-42bd-aec2-7c71706872a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:35.633462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:35.651632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:35.655577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:35.659655 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5795c3d9-dbc5-42b1-8f13-0434f0f014f1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 2.498401 Aug 27 04:54:35.660258 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 357/710] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:33 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 2503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:35.675018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8540f1a-0fbb-4c81-be19-496352311fda tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:35.675907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8540f1a-0fbb-4c81-be19-496352311fda tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:35.693909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8540f1a-0fbb-4c81-be19-496352311fda tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:35.696669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8540f1a-0fbb-4c81-be19-496352311fda tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:35.698769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8540f1a-0fbb-4c81-be19-496352311fda tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:35.700969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8540f1a-0fbb-4c81-be19-496352311fda tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:35.701420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8540f1a-0fbb-4c81-be19-496352311fda tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:35.701839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8540f1a-0fbb-4c81-be19-496352311fda tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:36.229006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-27873dd0-3583-42bd-aec2-7c71706872a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:36.241571 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-27873dd0-3583-42bd-aec2-7c71706872a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1315 microversion: 2.1 time: 1.736825 Aug 27 04:54:36.243428 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 354/711] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:34 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1315 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:36.261806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d2b4d4da-97ed-4d28-b30e-8634eb4a51bd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:36.265068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d2b4d4da-97ed-4d28-b30e-8634eb4a51bd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:36.288590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2b4d4da-97ed-4d28-b30e-8634eb4a51bd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:36.289327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2b4d4da-97ed-4d28-b30e-8634eb4a51bd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:36.289747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2b4d4da-97ed-4d28-b30e-8634eb4a51bd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:36.292771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2b4d4da-97ed-4d28-b30e-8634eb4a51bd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:36.294282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2b4d4da-97ed-4d28-b30e-8634eb4a51bd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:36.294813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2b4d4da-97ed-4d28-b30e-8634eb4a51bd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:36.549254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d2b4d4da-97ed-4d28-b30e-8634eb4a51bd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:36.579256 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d2b4d4da-97ed-4d28-b30e-8634eb4a51bd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1280 microversion: 2.1 time: 0.321260 Aug 27 04:54:36.579936 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 355/712] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:36 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1280 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:36.600378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-e1dcf944-3535-425a-9f0c-7de7f915ea45 req-38dc8654-fb70-499c-82fa-b394fa84464a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9", "name": "network-vif-plugged", "status": "completed", "tag": "9a5e5638-e923-4d24-8aa1-20e1f4dbb2b0"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:36.645883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e1dcf944-3535-425a-9f0c-7de7f915ea45 req-38dc8654-fb70-499c-82fa-b394fa84464a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:36.657849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e1dcf944-3535-425a-9f0c-7de7f915ea45 req-38dc8654-fb70-499c-82fa-b394fa84464a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:36.664608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e1dcf944-3535-425a-9f0c-7de7f915ea45 req-38dc8654-fb70-499c-82fa-b394fa84464a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:36.709857 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-e1dcf944-3535-425a-9f0c-7de7f915ea45 req-38dc8654-fb70-499c-82fa-b394fa84464a service nova] Creating event network-vif-plugged:9a5e5638-e923-4d24-8aa1-20e1f4dbb2b0 for instance 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 on n-h2-820368-35 Aug 27 04:54:36.731366 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-e1dcf944-3535-425a-9f0c-7de7f915ea45 req-38dc8654-fb70-499c-82fa-b394fa84464a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150091 Aug 27 04:54:36.732105 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 356/713] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:36.752150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:36.761208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:36.786824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:36.788107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:36.788548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:36.798580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:36.806006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:36.807053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:37.112864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8540f1a-0fbb-4c81-be19-496352311fda tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:37.121907 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8540f1a-0fbb-4c81-be19-496352311fda tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 1.460578 Aug 27 04:54:37.141474 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 358/714] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:35 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:37.169979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:37.392204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1300572398", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": "none"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:37.542152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:54:37.542673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:54:37.543984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:54:37.544635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:54:37.554433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:54:37.574495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:37.575381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:37.576018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:37.577083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:37.577774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:37.578610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:37.627678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Getting quotas for project 61be3047d2d54f82bd101442569d4469. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:37.637956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Getting quotas for user c6a42d438e5f4ad2924427828385a08b and project 61be3047d2d54f82bd101442569d4469. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:37.677844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:54:37.686538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: 65da6e54-b203-4fed-8737-af53723d3b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:37.798560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:37.819253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:37.824872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:37.826926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-08a8bf68-ccc6-4f76-a00d-307571e3ae60 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 1.088724 Aug 27 04:54:37.834447 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-356049a8-7f95-43a8-b2b2-0a2a94673933 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.691452 Aug 27 04:54:37.841934 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 359/715] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 04:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:54:37.843592 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 357/716] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:36 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:37.850435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-efbc7a74-4a4e-46cf-ae93-d759320756e0 req-24e912b8-fb29-468b-af20-629aab281532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c927e5-5b82-4fd6-8538-fe5456c92f9f", "tag": "e042543b-f075-4259-b806-252f41c2843b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:37.857810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b334ec03-922a-4897-8f61-f9041b539d5f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:37.858740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b334ec03-922a-4897-8f61-f9041b539d5f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:37.879738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b334ec03-922a-4897-8f61-f9041b539d5f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:37.880557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b334ec03-922a-4897-8f61-f9041b539d5f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:37.882617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b334ec03-922a-4897-8f61-f9041b539d5f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:37.886511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b334ec03-922a-4897-8f61-f9041b539d5f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:37.890461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b334ec03-922a-4897-8f61-f9041b539d5f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:37.891274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b334ec03-922a-4897-8f61-f9041b539d5f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:37.899436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-efbc7a74-4a4e-46cf-ae93-d759320756e0 req-24e912b8-fb29-468b-af20-629aab281532 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:37.899933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-efbc7a74-4a4e-46cf-ae93-d759320756e0 req-24e912b8-fb29-468b-af20-629aab281532 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:37.901138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-efbc7a74-4a4e-46cf-ae93-d759320756e0 req-24e912b8-fb29-468b-af20-629aab281532 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:37.968760 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-efbc7a74-4a4e-46cf-ae93-d759320756e0 req-24e912b8-fb29-468b-af20-629aab281532 service nova] Creating event network-changed:e042543b-f075-4259-b806-252f41c2843b for instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f on n-h1-820368-35 Aug 27 04:54:37.997446 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-efbc7a74-4a4e-46cf-ae93-d759320756e0 req-24e912b8-fb29-468b-af20-629aab281532 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144664 Aug 27 04:54:37.999532 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 360/717] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:38.018998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-475afa1a-151c-4dba-9f3a-c970e0e8e23f tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:38.019784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-475afa1a-151c-4dba-9f3a-c970e0e8e23f tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:38.042487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475afa1a-151c-4dba-9f3a-c970e0e8e23f tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:38.042981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475afa1a-151c-4dba-9f3a-c970e0e8e23f tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:38.043513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475afa1a-151c-4dba-9f3a-c970e0e8e23f tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:38.054848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475afa1a-151c-4dba-9f3a-c970e0e8e23f tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:38.055434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475afa1a-151c-4dba-9f3a-c970e0e8e23f tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:38.055891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475afa1a-151c-4dba-9f3a-c970e0e8e23f tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:38.386313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-475afa1a-151c-4dba-9f3a-c970e0e8e23f tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:38.403838 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-475afa1a-151c-4dba-9f3a-c970e0e8e23f tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1280 microversion: 2.1 time: 0.399809 Aug 27 04:54:38.405923 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 361/718] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:37 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1280 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:38.419249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c16e5343-1b64-477f-bfbd-433623d71f74 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:38.420508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c16e5343-1b64-477f-bfbd-433623d71f74 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: 65da6e54-b203-4fed-8737-af53723d3b89] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:38.753569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c16e5343-1b64-477f-bfbd-433623d71f74 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:38.768764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c16e5343-1b64-477f-bfbd-433623d71f74 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:38.778325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c16e5343-1b64-477f-bfbd-433623d71f74 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:38.791860 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c16e5343-1b64-477f-bfbd-433623d71f74 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89" status: 200 len: 1278 microversion: 2.47 time: 0.383520 Aug 27 04:54:38.808856 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 362/719] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:38 2022] GET /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89 => generated 1278 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:38.820849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b1a41d2-55a3-44cd-bdf6-659d6fc9e1ff tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:38.833594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9b1a41d2-55a3-44cd-bdf6-659d6fc9e1ff tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:38.854537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a41d2-55a3-44cd-bdf6-659d6fc9e1ff tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:38.854994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a41d2-55a3-44cd-bdf6-659d6fc9e1ff tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:38.857344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a41d2-55a3-44cd-bdf6-659d6fc9e1ff tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:38.858291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a41d2-55a3-44cd-bdf6-659d6fc9e1ff tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:38.863717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a41d2-55a3-44cd-bdf6-659d6fc9e1ff tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:38.867077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a41d2-55a3-44cd-bdf6-659d6fc9e1ff tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:38.999516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b334ec03-922a-4897-8f61-f9041b539d5f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:39.009414 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b334ec03-922a-4897-8f61-f9041b539d5f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1315 microversion: 2.1 time: 1.164535 Aug 27 04:54:39.011877 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 358/720] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:37 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1315 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:39.027943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:39.030055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:39.044234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:39.045618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:39.047648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:39.050121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:39.050885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:39.053418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:39.633983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=18 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:39.893034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9b1a41d2-55a3-44cd-bdf6-659d6fc9e1ff tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:39.904874 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9b1a41d2-55a3-44cd-bdf6-659d6fc9e1ff tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 1.096240 Aug 27 04:54:39.905570 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 363/721] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:38 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:39.926385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1264128119", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": "none"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:40.005990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:54:40.006980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:54:40.007670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:54:40.008179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:54:40.008702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:54:40.031973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:40.032832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:40.033537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:40.034410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:40.035608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:40.036158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:40.055021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=11 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:40.066247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Getting quotas for project 61be3047d2d54f82bd101442569d4469. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:40.073205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Getting quotas for user c6a42d438e5f4ad2924427828385a08b and project 61be3047d2d54f82bd101442569d4469. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:40.088587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:54:40.091419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:40.165189 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e09262df-2b8d-4b2a-8de0-5f157c99142a tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.244085 Aug 27 04:54:40.169946 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 364/722] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 04:54:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 250 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:54:40.179437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b19ec145-f9f6-4019-b689-fda835b103c3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:40.180394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b19ec145-f9f6-4019-b689-fda835b103c3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:40.199290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b19ec145-f9f6-4019-b689-fda835b103c3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:40.200096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b19ec145-f9f6-4019-b689-fda835b103c3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:40.201426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b19ec145-f9f6-4019-b689-fda835b103c3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:40.202409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b19ec145-f9f6-4019-b689-fda835b103c3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:40.203112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b19ec145-f9f6-4019-b689-fda835b103c3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:40.204804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b19ec145-f9f6-4019-b689-fda835b103c3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:40.418521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:40.441485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:40.443243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:40.444785 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-148f44b5-bb9f-472b-a00f-47d37bc2e52a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 1.431630 Aug 27 04:54:40.464461 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 359/723] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:39 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:40.756053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ba836c04-56f2-4d30-a0bf-f99871319314 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Action: 'create', calling method: .version_select at 0x7fb565695e50>, body: {"keypair": {"name": "tempest-keypair-1528187119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcKwpFfE9H7jcZIPKaleLZLpAWlzB3PcoEcgzGqsGPU9e8MVZ7KtVBfDx7SFxMwmXLy+9FXp1MnR1sbF+EWoOqHBh/3iBnT3gXQbOy+6Ny+B/igvgXuwRtK+1AQqj05Rg=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:40.776836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ba836c04-56f2-4d30-a0bf-f99871319314 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Getting quotas for project 9000246cdf0a492592d1c978ec3d48e0. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:40.789369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ba836c04-56f2-4d30-a0bf-f99871319314 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Getting quotas for user 9327ad9c2a544d968733a07f5139bf3b and project 9000246cdf0a492592d1c978ec3d48e0. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:40.798765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b19ec145-f9f6-4019-b689-fda835b103c3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:40.838379 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b19ec145-f9f6-4019-b689-fda835b103c3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.667095 Aug 27 04:54:40.856093 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 365/724] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:40 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:40.863670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7ff147c4-4fdd-4fa1-9bb1-6f7f063a34dd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:40.867069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7ff147c4-4fdd-4fa1-9bb1-6f7f063a34dd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:40.873326 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ba836c04-56f2-4d30-a0bf-f99871319314 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.404110 Aug 27 04:54:40.873800 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 360/725] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 04:54:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:40.885348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6bceea44-5a37-476b-ac59-4aba5ca8fdd5 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:40.904397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ff147c4-4fdd-4fa1-9bb1-6f7f063a34dd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:40.906328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ff147c4-4fdd-4fa1-9bb1-6f7f063a34dd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:40.908890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ff147c4-4fdd-4fa1-9bb1-6f7f063a34dd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:40.909955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6bceea44-5a37-476b-ac59-4aba5ca8fdd5 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:40.910297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ff147c4-4fdd-4fa1-9bb1-6f7f063a34dd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:40.912375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ff147c4-4fdd-4fa1-9bb1-6f7f063a34dd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:40.915048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ff147c4-4fdd-4fa1-9bb1-6f7f063a34dd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:40.921422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bceea44-5a37-476b-ac59-4aba5ca8fdd5 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:40.923580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bceea44-5a37-476b-ac59-4aba5ca8fdd5 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:40.924443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bceea44-5a37-476b-ac59-4aba5ca8fdd5 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:40.925484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bceea44-5a37-476b-ac59-4aba5ca8fdd5 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:40.926251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bceea44-5a37-476b-ac59-4aba5ca8fdd5 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:40.927675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bceea44-5a37-476b-ac59-4aba5ca8fdd5 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:41.046598 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6bceea44-5a37-476b-ac59-4aba5ca8fdd5 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "PUT /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 992 microversion: 2.47 time: 0.171171 Aug 27 04:54:41.047655 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 361/726] 10.222.0.58 () {62 vars in 1297 bytes} [Sat Aug 27 04:54:40 2022] PUT /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 992 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:54:41.052869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-57138a37-726f-4033-80be-a132ce8c95ec req-43ee332e-eda9-4f74-a937-e8b546fa29e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f4d090-8163-469c-b801-7864b9155ed3", "tag": "3c575205-29ce-4475-a574-a3f0cf85516a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:41.064619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-57138a37-726f-4033-80be-a132ce8c95ec req-43ee332e-eda9-4f74-a937-e8b546fa29e2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:41.065418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-57138a37-726f-4033-80be-a132ce8c95ec req-43ee332e-eda9-4f74-a937-e8b546fa29e2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:41.066036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-57138a37-726f-4033-80be-a132ce8c95ec req-43ee332e-eda9-4f74-a937-e8b546fa29e2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:41.082636 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-57138a37-726f-4033-80be-a132ce8c95ec req-43ee332e-eda9-4f74-a937-e8b546fa29e2 service nova] Creating event network-changed:3c575205-29ce-4475-a574-a3f0cf85516a for instance f8f4d090-8163-469c-b801-7864b9155ed3 on n-h1-820368-35 Aug 27 04:54:41.093922 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-57138a37-726f-4033-80be-a132ce8c95ec req-43ee332e-eda9-4f74-a937-e8b546fa29e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044697 Aug 27 04:54:41.095234 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 362/727] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:41.102022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f227facb-f9fe-4312-a3ea-988c622429c2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:41.103032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f227facb-f9fe-4312-a3ea-988c622429c2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:41.111831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f227facb-f9fe-4312-a3ea-988c622429c2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:41.112553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f227facb-f9fe-4312-a3ea-988c622429c2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:41.113775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f227facb-f9fe-4312-a3ea-988c622429c2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:41.114791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f227facb-f9fe-4312-a3ea-988c622429c2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:41.115526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f227facb-f9fe-4312-a3ea-988c622429c2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:41.116292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f227facb-f9fe-4312-a3ea-988c622429c2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:41.142972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:41.407133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7ff147c4-4fdd-4fa1-9bb1-6f7f063a34dd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:41.420657 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7ff147c4-4fdd-4fa1-9bb1-6f7f063a34dd tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1315 microversion: 2.1 time: 0.562669 Aug 27 04:54:41.421623 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 366/728] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:40 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:41.427080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:41.427836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:41.435114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:41.435633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:41.436075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:41.436788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:41.437297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:41.437803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:41.561583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f227facb-f9fe-4312-a3ea-988c622429c2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:41.570337 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f227facb-f9fe-4312-a3ea-988c622429c2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 0.473444 Aug 27 04:54:41.571135 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 363/729] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:41 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:41.576469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:41.577246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:41.584699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:41.585160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:41.585953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:41.587027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:41.588493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:41.589585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:41.638772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:41.649001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:41.652366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:41.657237 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b6139582-d54b-4202-b340-a162ed3b07ee tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1282 microversion: 2.47 time: 0.234478 Aug 27 04:54:41.660340 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 367/730] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:41 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1282 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:41.864184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-56fc60e2-9c34-4173-b77c-c6e4ef14f995 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:41.864817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-56fc60e2-9c34-4173-b77c-c6e4ef14f995 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:41.894949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56fc60e2-9c34-4173-b77c-c6e4ef14f995 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:41.921217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56fc60e2-9c34-4173-b77c-c6e4ef14f995 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:41.924972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56fc60e2-9c34-4173-b77c-c6e4ef14f995 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:41.925989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56fc60e2-9c34-4173-b77c-c6e4ef14f995 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:41.926632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56fc60e2-9c34-4173-b77c-c6e4ef14f995 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:41.927258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56fc60e2-9c34-4173-b77c-c6e4ef14f995 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:41.995353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:42.016717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:42.021760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:42.024855 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-be04fb4e-8293-4f63-836c-718b45d5972f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.452587 Aug 27 04:54:42.029708 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 364/731] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:41 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:42.442740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e4274e72-5aab-4279-b87a-4c4a9e0fe805 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:42.445335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e4274e72-5aab-4279-b87a-4c4a9e0fe805 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:42.454221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4274e72-5aab-4279-b87a-4c4a9e0fe805 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:42.461949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4274e72-5aab-4279-b87a-4c4a9e0fe805 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:42.463226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4274e72-5aab-4279-b87a-4c4a9e0fe805 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:42.466116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4274e72-5aab-4279-b87a-4c4a9e0fe805 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:42.469535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4274e72-5aab-4279-b87a-4c4a9e0fe805 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:42.470189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4274e72-5aab-4279-b87a-4c4a9e0fe805 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:42.581506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-56fc60e2-9c34-4173-b77c-c6e4ef14f995 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:42.590174 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-56fc60e2-9c34-4173-b77c-c6e4ef14f995 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.731626 Aug 27 04:54:42.597458 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 368/732] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:41 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:42.612235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-28993ac3-af43-41c8-b15a-94d6b8ec8cf2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:42.613230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-28993ac3-af43-41c8-b15a-94d6b8ec8cf2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:42.626978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28993ac3-af43-41c8-b15a-94d6b8ec8cf2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:42.631526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28993ac3-af43-41c8-b15a-94d6b8ec8cf2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:42.632196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28993ac3-af43-41c8-b15a-94d6b8ec8cf2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:42.633094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28993ac3-af43-41c8-b15a-94d6b8ec8cf2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:42.633705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28993ac3-af43-41c8-b15a-94d6b8ec8cf2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:42.634290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28993ac3-af43-41c8-b15a-94d6b8ec8cf2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:42.858017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e4274e72-5aab-4279-b87a-4c4a9e0fe805 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:42.871908 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e4274e72-5aab-4279-b87a-4c4a9e0fe805 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1464 microversion: 2.1 time: 0.432961 Aug 27 04:54:42.886871 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 365/733] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:42 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1464 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:42.886871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:42.889293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:42.906263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:42.907351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:42.907800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:42.910518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:42.911186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:42.913008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:42.948639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-28993ac3-af43-41c8-b15a-94d6b8ec8cf2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:42.969450 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-28993ac3-af43-41c8-b15a-94d6b8ec8cf2 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 0.366610 Aug 27 04:54:42.984405 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 369/734] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:42 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:42.999250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:43.016603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:43.020603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:43.021994 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5be5072c-d176-4e72-a68f-df3a93fff657 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1282 microversion: 2.47 time: 0.146780 Aug 27 04:54:43.026738 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 366/735] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:42 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:43.039127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ade5c739-db3c-428a-b1ef-7d052578b216 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:43.043655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ade5c739-db3c-428a-b1ef-7d052578b216 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:43.064214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ade5c739-db3c-428a-b1ef-7d052578b216 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:43.066075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ade5c739-db3c-428a-b1ef-7d052578b216 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:43.067750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ade5c739-db3c-428a-b1ef-7d052578b216 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:43.070885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ade5c739-db3c-428a-b1ef-7d052578b216 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:43.071669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ade5c739-db3c-428a-b1ef-7d052578b216 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:43.072136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ade5c739-db3c-428a-b1ef-7d052578b216 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:43.357092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-461fa427-6ec5-4587-8bd8-b7c138ec3f6b tempest-FloatingIPDetailsNegativeTestJSON-2126949261 tempest-FloatingIPDetailsNegativeTestJSON-2126949261-project] Calling method '.version_select at 0x7fb565806160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:43.372084 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ade5c739-db3c-428a-b1ef-7d052578b216 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1617 microversion: 2.1 time: 0.342130 Aug 27 04:54:43.372589 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 367/736] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:43 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1617 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:43.377489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:43.377989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:43.399753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:43.400791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:43.401233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:43.401950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:43.402404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:43.402833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:43.487942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-461fa427-6ec5-4587-8bd8-b7c138ec3f6b tempest-FloatingIPDetailsNegativeTestJSON-2126949261 tempest-FloatingIPDetailsNegativeTestJSON-2126949261-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP dc67af31-c284-4ede-bc6e-56929df143bb could not be found", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:54:43.489079 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-461fa427-6ec5-4587-8bd8-b7c138ec3f6b tempest-FloatingIPDetailsNegativeTestJSON-2126949261 tempest-FloatingIPDetailsNegativeTestJSON-2126949261-project] HTTP exception thrown: Floating IP not found for ID dc67af31-c284-4ede-bc6e-56929df143bb Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-461fa427-6ec5-4587-8bd8-b7c138ec3f6b tempest-FloatingIPDetailsNegativeTestJSON-2126949261 tempest-FloatingIPDetailsNegativeTestJSON-2126949261-project] Request method failure captured: Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-floating-ips/dc67af31-c284-4ede-bc6e-56929df143bb HTTP/1.1 Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaOSAL9OQh_luxAnBoRRPhXSm64yGFQajn3FBW_YEBs3qOUfo0wux18w97WhZnXeXhN5gTVJGdzTv2NLXPE0keNA6BjG9O353nAM90cMBuyJ8BXlmPtd2sA1L5Z8bv2b1B8yUJAAvCUAgQ8USrroy3KjCoi2af8j4ndHz7F8AQRqQD0 Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: edcff93b9d5348ec94ed9cb43ce997f0 Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2126949261 Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:54:43.491501 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_edcff93b9d5348ec94ed9cb43ce997f0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/edcff93b9d5348ec94ed9cb43ce997f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/edcff93b9d5348ec94ed9cb43ce997f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/edcff93b9d5348ec94ed9cb43ce997f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2126949261 Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: edcff93b9d5348ec94ed9cb43ce997f0 Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2126949261 Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2126949261-project Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 2e647f50912e486f8e4036944c6ce32d Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2126949261-project Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: exception: Floating IP not found for ID dc67af31-c284-4ede-bc6e-56929df143bb Aug 27 04:54:43.492805 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'dc67af31-c284-4ede-bc6e-56929df143bb'} Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:54:43.493551 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP dc67af31-c284-4ede-bc6e-56929df143bb could not be found Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93fdccd1-33fd-451f-9d54-637418064bac'] Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID dc67af31-c284-4ede-bc6e-56929df143bb. Aug 27 04:54:43.494746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID dc67af31-c284-4ede-bc6e-56929df143bb Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:43.497827 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:54:43.502307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:54:43.502307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID dc67af31-c284-4ede-bc6e-56929df143bb Aug 27 04:54:43.502307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:54:43.504324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-461fa427-6ec5-4587-8bd8-b7c138ec3f6b tempest-FloatingIPDetailsNegativeTestJSON-2126949261 tempest-FloatingIPDetailsNegativeTestJSON-2126949261-project] Returning 404 to user: Floating IP not found for ID dc67af31-c284-4ede-bc6e-56929df143bb {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:54:43.506273 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-461fa427-6ec5-4587-8bd8-b7c138ec3f6b tempest-FloatingIPDetailsNegativeTestJSON-2126949261 tempest-FloatingIPDetailsNegativeTestJSON-2126949261-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/dc67af31-c284-4ede-bc6e-56929df143bb" status: 404 len: 111 microversion: 2.1 time: 0.516414 Aug 27 04:54:43.508304 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 370/737] 10.222.0.58 () {58 vars in 1260 bytes} [Sat Aug 27 04:54:42 2022] GET /compute/v2.1/os-floating-ips/dc67af31-c284-4ede-bc6e-56929df143bb => generated 111 bytes in 523 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:54:43.515379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c9e9ef72-fd9e-4cf2-805f-2ec74f73b586 req-5857d607-edfa-4128-8e32-7115e6b4b31b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d5a4df-1045-4b64-b58c-2383ce224d63", "tag": "7664fef3-23d1-4397-942a-44d07372001b"}, {"name": "network-changed", "server_uuid": "eb532469-9212-4d66-b601-a0f0bcf27b24", "tag": "b7904933-9b12-452f-ac97-d6716cfe787a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:43.529596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c9e9ef72-fd9e-4cf2-805f-2ec74f73b586 req-5857d607-edfa-4128-8e32-7115e6b4b31b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:43.530882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c9e9ef72-fd9e-4cf2-805f-2ec74f73b586 req-5857d607-edfa-4128-8e32-7115e6b4b31b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:43.531586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c9e9ef72-fd9e-4cf2-805f-2ec74f73b586 req-5857d607-edfa-4128-8e32-7115e6b4b31b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:43.537600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:43.554409 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c9e9ef72-fd9e-4cf2-805f-2ec74f73b586 req-5857d607-edfa-4128-8e32-7115e6b4b31b service nova] Creating event network-changed:7664fef3-23d1-4397-942a-44d07372001b for instance 35d5a4df-1045-4b64-b58c-2383ce224d63 on n-h2-820368-35 Aug 27 04:54:43.555553 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c9e9ef72-fd9e-4cf2-805f-2ec74f73b586 req-5857d607-edfa-4128-8e32-7115e6b4b31b service nova] Creating event network-changed:b7904933-9b12-452f-ac97-d6716cfe787a for instance eb532469-9212-4d66-b601-a0f0bcf27b24 on n-h2-820368-35 Aug 27 04:54:43.563773 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c9e9ef72-fd9e-4cf2-805f-2ec74f73b586 req-5857d607-edfa-4128-8e32-7115e6b4b31b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053975 Aug 27 04:54:43.565519 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 371/738] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:43.572293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-499362003", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["198422a0-c1e8-4c71-9ecd-43b3c3e0178d"]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:43.633538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:43.639835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:54:43.648483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:43.650879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:43.652647 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b09e491d-5f9b-4f85-b5eb-49d5ba9ae4f3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.278902 Aug 27 04:54:43.653441 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 368/739] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:43 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:43.878689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88e160af-d4c7-492c-84fd-c110a65dda90 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1747860965", "ram": 512, "vcpus": 1, "disk": 10, "id": 1792348551, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:43.913038 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88e160af-d4c7-492c-84fd-c110a65dda90 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.243404 Aug 27 04:54:43.920674 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 369/740] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:54:43 2022] POST /compute/v2.1/flavors => generated 416 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:43.923252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4803ce91-8a3d-42e5-ac89-eed1e5d6e0d9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:43.924119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4803ce91-8a3d-42e5-ac89-eed1e5d6e0d9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:43.930741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4803ce91-8a3d-42e5-ac89-eed1e5d6e0d9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:43.931425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4803ce91-8a3d-42e5-ac89-eed1e5d6e0d9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:43.931984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4803ce91-8a3d-42e5-ac89-eed1e5d6e0d9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:43.932799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4803ce91-8a3d-42e5-ac89-eed1e5d6e0d9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:43.933263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4803ce91-8a3d-42e5-ac89-eed1e5d6e0d9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:43.933693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4803ce91-8a3d-42e5-ac89-eed1e5d6e0d9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:44.047473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:54:44.048853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:54:44.050573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:54:44.051554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:54:44.052280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:54:44.071592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:44.072758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:44.073612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:44.075501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:44.076646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:44.077476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:44.102812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:44.113012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:44.128984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=7 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:44.151574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:54:44.157780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:44.201753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4803ce91-8a3d-42e5-ac89-eed1e5d6e0d9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:44.213430 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4803ce91-8a3d-42e5-ac89-eed1e5d6e0d9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.297505 Aug 27 04:54:44.227815 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 370/741] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:43 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:44.233447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d0f69d7-de05-446e-a0b2-19287b10921c tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:44.254657 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ce674fe4-241a-42ba-bda4-665a81e94d98 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686939 Aug 27 04:54:44.257254 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 372/742] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:54:44.268662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6003db24-bfa7-4e48-9159-fbe3515e4cab tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:44.269019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6003db24-bfa7-4e48-9159-fbe3515e4cab tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:44.280426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6003db24-bfa7-4e48-9159-fbe3515e4cab tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:44.280426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6003db24-bfa7-4e48-9159-fbe3515e4cab tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:44.281139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6003db24-bfa7-4e48-9159-fbe3515e4cab tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:44.282190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6003db24-bfa7-4e48-9159-fbe3515e4cab tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:44.282712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6003db24-bfa7-4e48-9159-fbe3515e4cab tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:44.283201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6003db24-bfa7-4e48-9159-fbe3515e4cab tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:44.300467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=13,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:44.307908 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d0f69d7-de05-446e-a0b2-19287b10921c tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1792348551/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.076781 Aug 27 04:54:44.315467 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 371/743] 10.222.0.58 () {60 vars in 1224 bytes} [Sat Aug 27 04:54:44 2022] POST /compute/v2.1/flavors/1792348551/os-extra_specs => generated 66 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:44.328861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:44.332643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:44.348420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:44.351077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:44.352032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:44.354986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:44.357313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:44.357904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:44.811659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:44.823782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:44.835879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:44.838171 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1f195e34-345a-43d0-99b2-ef743071b12e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1274 microversion: 2.47 time: 0.521017 Aug 27 04:54:44.839374 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 372/744] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:44 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1274 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:44.856808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ede3dd9-f78a-45c2-b806-efe189164d15 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:44.857737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5ede3dd9-f78a-45c2-b806-efe189164d15 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:45.095727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5ede3dd9-f78a-45c2-b806-efe189164d15 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:45.117827 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5ede3dd9-f78a-45c2-b806-efe189164d15 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1216 microversion: 2.1 time: 0.277191 Aug 27 04:54:45.127895 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 373/745] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:44 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1216 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:45.274186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6003db24-bfa7-4e48-9159-fbe3515e4cab tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:45.289534 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6003db24-bfa7-4e48-9159-fbe3515e4cab tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 1.031155 Aug 27 04:54:45.295060 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 373/746] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:44 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:45.303921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b8319579-f37d-49b3-ab9a-fafbb606241b tempest-FlavorsExtraSpecsTestJSON-1160918787 tempest-FlavorsExtraSpecsTestJSON-1160918787-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:45.323434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:45.324090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:45.333067 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b8319579-f37d-49b3-ab9a-fafbb606241b tempest-FlavorsExtraSpecsTestJSON-1160918787 tempest-FlavorsExtraSpecsTestJSON-1160918787-project] 10.222.0.58 "GET /compute/v2.1/flavors/1792348551/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.203449 Aug 27 04:54:45.333865 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 374/747] 10.222.0.58 () {58 vars in 1203 bytes} [Sat Aug 27 04:54:45 2022] GET /compute/v2.1/flavors/1792348551/os-extra_specs => generated 66 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:45.340003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:45.342815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:45.344778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:45.347297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cd302e33-1d30-4677-aea8-8b9703a273bc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:45.347874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:45.348491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cd302e33-1d30-4677-aea8-8b9703a273bc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:45.350027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:45.350570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:45.377841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd302e33-1d30-4677-aea8-8b9703a273bc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:45.378499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd302e33-1d30-4677-aea8-8b9703a273bc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:45.378947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd302e33-1d30-4677-aea8-8b9703a273bc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:45.379693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd302e33-1d30-4677-aea8-8b9703a273bc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:45.380139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd302e33-1d30-4677-aea8-8b9703a273bc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:45.380800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd302e33-1d30-4677-aea8-8b9703a273bc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:46.005301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:46.029768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:46.034688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cd302e33-1d30-4677-aea8-8b9703a273bc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:46.045019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:46.053595 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cd302e33-1d30-4677-aea8-8b9703a273bc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.707927 Aug 27 04:54:46.054803 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 375/748] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:45 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:46.056872 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a3f2c6b2-178a-4f4f-9d4f-cfb32c380007 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.753102 Aug 27 04:54:46.057499 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 374/749] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:45 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:46.078537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:46.080433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b5bb6db0-7061-46ed-b533-c0587c1ec4c7 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:46.083600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:46.110546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:46.111538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:46.112132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:46.113000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:46.113613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:46.114209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:46.149015 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b5bb6db0-7061-46ed-b533-c0587c1ec4c7 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1792348551/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.091415 Aug 27 04:54:46.150300 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 376/750] 10.222.0.58 () {60 vars in 1224 bytes} [Sat Aug 27 04:54:46 2022] POST /compute/v2.1/flavors/1792348551/os-extra_specs => generated 66 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:46.162737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f692317-0145-43aa-8ee8-04e43e2fa493 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:46.163914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f692317-0145-43aa-8ee8-04e43e2fa493 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:46.178334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f692317-0145-43aa-8ee8-04e43e2fa493 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:46.181907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f692317-0145-43aa-8ee8-04e43e2fa493 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:46.183103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f692317-0145-43aa-8ee8-04e43e2fa493 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:46.185710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f692317-0145-43aa-8ee8-04e43e2fa493 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:46.186428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f692317-0145-43aa-8ee8-04e43e2fa493 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:46.187070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f692317-0145-43aa-8ee8-04e43e2fa493 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:46.339138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:46.351795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:46.356606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:46.361619 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-022252ea-4402-4723-863f-9c9c7850c8b4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1348 microversion: 2.47 time: 0.298406 Aug 27 04:54:46.362685 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 375/751] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:46 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1348 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:46.380288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2793d839-79ce-465a-a0a3-627c3815bbfc tempest-FlavorsExtraSpecsTestJSON-1160918787 tempest-FlavorsExtraSpecsTestJSON-1160918787-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:46.386257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f692317-0145-43aa-8ee8-04e43e2fa493 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:46.397248 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2793d839-79ce-465a-a0a3-627c3815bbfc tempest-FlavorsExtraSpecsTestJSON-1160918787 tempest-FlavorsExtraSpecsTestJSON-1160918787-project] 10.222.0.58 "GET /compute/v2.1/flavors/1792348551/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.030529 Aug 27 04:54:46.399018 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f692317-0145-43aa-8ee8-04e43e2fa493 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1220 microversion: 2.1 time: 0.242513 Aug 27 04:54:46.399701 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 377/752] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:46 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1220 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:46.404529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1556f8e1-b0be-4c87-8c0d-e2c5cd91eb35 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:46.409346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1556f8e1-b0be-4c87-8c0d-e2c5cd91eb35 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:46.410835 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 376/753] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 04:54:46 2022] GET /compute/v2.1/flavors/1792348551/os-extra_specs/hw:numa_nodes => generated 22 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:46.432929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dff7eea3-40dc-4669-863c-f28c69f0d44d tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:46.437349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1556f8e1-b0be-4c87-8c0d-e2c5cd91eb35 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:46.438108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1556f8e1-b0be-4c87-8c0d-e2c5cd91eb35 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:46.438600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1556f8e1-b0be-4c87-8c0d-e2c5cd91eb35 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:46.441527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1556f8e1-b0be-4c87-8c0d-e2c5cd91eb35 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:46.442052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1556f8e1-b0be-4c87-8c0d-e2c5cd91eb35 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:46.442496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1556f8e1-b0be-4c87-8c0d-e2c5cd91eb35 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:46.487454 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dff7eea3-40dc-4669-863c-f28c69f0d44d tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1792348551/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.073747 Aug 27 04:54:46.498503 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 377/754] 10.222.0.58 () {60 vars in 1224 bytes} [Sat Aug 27 04:54:46 2022] POST /compute/v2.1/flavors/1792348551/os-extra_specs => generated 66 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:46.504931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b72bd8a8-aebf-43da-ba67-fb7f677594e1 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:46.527594 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b72bd8a8-aebf-43da-ba67-fb7f677594e1 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1792348551/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022576 Aug 27 04:54:46.533213 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 378/755] 10.222.0.58 () {58 vars in 1203 bytes} [Sat Aug 27 04:54:46 2022] GET /compute/v2.1/flavors/1792348551/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:46.538073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f820875d-8ec3-47d8-960c-a603e24c1fdd tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:46.611559 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f820875d-8ec3-47d8-960c-a603e24c1fdd tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/1792348551/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.076973 Aug 27 04:54:46.617246 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 379/756] 10.222.0.58 () {60 vars in 1265 bytes} [Sat Aug 27 04:54:46 2022] PUT /compute/v2.1/flavors/1792348551/os-extra_specs/hw:numa_nodes => generated 22 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:46.628970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-13c34a4a-4858-4d8c-bbc8-d9eeb84f8cb0 req-57d2fc36-8c65-40b6-b0d9-75ea83bd6dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dffd03e4-cebb-4c94-a9f9-fc0887472298", "name": "network-vif-plugged", "status": "completed", "tag": "db5f8da9-4df5-4598-a365-b238e6e53d2f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:46.661447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-13c34a4a-4858-4d8c-bbc8-d9eeb84f8cb0 req-57d2fc36-8c65-40b6-b0d9-75ea83bd6dac service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:46.663513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-13c34a4a-4858-4d8c-bbc8-d9eeb84f8cb0 req-57d2fc36-8c65-40b6-b0d9-75ea83bd6dac service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:46.664188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-13c34a4a-4858-4d8c-bbc8-d9eeb84f8cb0 req-57d2fc36-8c65-40b6-b0d9-75ea83bd6dac service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:46.680804 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-13c34a4a-4858-4d8c-bbc8-d9eeb84f8cb0 req-57d2fc36-8c65-40b6-b0d9-75ea83bd6dac service nova] Creating event network-vif-plugged:db5f8da9-4df5-4598-a365-b238e6e53d2f for instance dffd03e4-cebb-4c94-a9f9-fc0887472298 on n-h2-820368-35 Aug 27 04:54:46.691742 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-13c34a4a-4858-4d8c-bbc8-d9eeb84f8cb0 req-57d2fc36-8c65-40b6-b0d9-75ea83bd6dac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073066 Aug 27 04:54:46.692664 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 380/757] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:46.704345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-86b428c4-aade-473d-b021-efd439c7aab2 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:46.716567 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-86b428c4-aade-473d-b021-efd439c7aab2 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1792348551/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022312 Aug 27 04:54:46.717869 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 381/758] 10.222.0.58 () {58 vars in 1203 bytes} [Sat Aug 27 04:54:46 2022] GET /compute/v2.1/flavors/1792348551/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:46.723653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-149584360", "imageRef": "1fa4d537-1391-4ad7-bf12-ccc5ee95df96", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "bd5daa5c-da10-4501-8875-6f4cf09d9239"}], "security_groups": [{"name": "tempest-securitygroup--1418434099"}], "key_name": "tempest-keypair-1528187119", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:46.731846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1556f8e1-b0be-4c87-8c0d-e2c5cd91eb35 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:46.743071 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1556f8e1-b0be-4c87-8c0d-e2c5cd91eb35 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 0.340672 Aug 27 04:54:46.745783 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 378/759] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:46 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:46.760477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bf1255f7-d568-4ac4-b5c2-e006826d4f78 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:46.848910 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bf1255f7-d568-4ac4-b5c2-e006826d4f78 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1792348551/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.101488 Aug 27 04:54:46.852515 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 379/760] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 04:54:46 2022] DELETE /compute/v2.1/flavors/1792348551/os-extra_specs/hw:numa_nodes => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:54:46.858026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1632e0a4-303e-4948-82c9-3192bfa65412 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:46.913116 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1632e0a4-303e-4948-82c9-3192bfa65412 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1792348551/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.059324 Aug 27 04:54:46.913715 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 380/761] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 04:54:46 2022] DELETE /compute/v2.1/flavors/1792348551/os-extra_specs/hw:cpu_policy => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 04:54:46.927448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9ec544e-0378-4b2e-a756-81362f145862 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:46.940433 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9ec544e-0378-4b2e-a756-81362f145862 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1792348551/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022046 Aug 27 04:54:46.947447 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 381/762] 10.222.0.58 () {58 vars in 1203 bytes} [Sat Aug 27 04:54:46 2022] GET /compute/v2.1/flavors/1792348551/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:46.957990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] validate_networks() for [('bd5daa5c-da10-4501-8875-6f4cf09d9239', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:54:46.958673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f680efd-f8e0-46a9-a2fd-3c84e1df717e tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:46.981167 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f680efd-f8e0-46a9-a2fd-3c84e1df717e tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1792348551" status: 202 len: 0 microversion: 2.1 time: 0.031118 Aug 27 04:54:46.986700 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 382/763] 10.222.0.58 () {58 vars in 1161 bytes} [Sat Aug 27 04:54:46 2022] DELETE /compute/v2.1/flavors/1792348551 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:54:47.002636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-56bdf350-b36f-4d29-8585-47bace22e8e9 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:47.030355 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-56bdf350-b36f-4d29-8585-47bace22e8e9 tempest-FlavorsExtraSpecsTestJSON-1274974451 tempest-FlavorsExtraSpecsTestJSON-1274974451-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.041699 Aug 27 04:54:47.031801 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 383/764] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:54:46 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:47.077161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ee9970dc-b5e6-4fcd-bb5b-42af01e95b95 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:47.077765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ee9970dc-b5e6-4fcd-bb5b-42af01e95b95 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:47.083746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee9970dc-b5e6-4fcd-bb5b-42af01e95b95 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.084449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee9970dc-b5e6-4fcd-bb5b-42af01e95b95 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.085178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee9970dc-b5e6-4fcd-bb5b-42af01e95b95 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.086043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee9970dc-b5e6-4fcd-bb5b-42af01e95b95 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.086645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee9970dc-b5e6-4fcd-bb5b-42af01e95b95 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.087285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee9970dc-b5e6-4fcd-bb5b-42af01e95b95 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.360463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ee9970dc-b5e6-4fcd-bb5b-42af01e95b95 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:47.371927 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ee9970dc-b5e6-4fcd-bb5b-42af01e95b95 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.299831 Aug 27 04:54:47.388736 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 384/765] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:47 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:47.393915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:47.396819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:47.410855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.416646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.417441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.418417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.419122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.419782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.612033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:54:47.613194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:54:47.613906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:54:47.614326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:54:47.614738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:54:47.624590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.625279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.625877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.627153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.628208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.628918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.647814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:47.649881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Getting quotas for project 9000246cdf0a492592d1c978ec3d48e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:47.656165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:47.657947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:47.659536 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c4db7ee-04f2-477e-b74b-c6101bf766fc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.269411 Aug 27 04:54:47.660326 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 385/766] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:47 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:47.665215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:47.666638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:47.668374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Getting quotas for user 9327ad9c2a544d968733a07f5139bf3b and project 9000246cdf0a492592d1c978ec3d48e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:47.674473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.675425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.676121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.677233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.678216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.678753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.699238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:54:47.703781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fa4d537-1391-4ad7-bf12-ccc5ee95df96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:47.762604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:47.771868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:47.773317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:47.776028 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6a0552b-42d0-4fb9-9a81-b233a11f00e3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1336 microversion: 2.47 time: 0.112868 Aug 27 04:54:47.776771 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 386/767] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:47 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1336 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:47.795931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6282f37a-c776-4db0-bdd7-816112693bb1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:47.795931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6282f37a-c776-4db0-bdd7-816112693bb1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:47.796129 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d056027-d6f9-4c15-97d9-78f92e2ed775 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.073431 Aug 27 04:54:47.796129 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 382/768] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:54:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:54:47.807429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6282f37a-c776-4db0-bdd7-816112693bb1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.807429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6282f37a-c776-4db0-bdd7-816112693bb1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.807429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6282f37a-c776-4db0-bdd7-816112693bb1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.807429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6282f37a-c776-4db0-bdd7-816112693bb1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.807872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-beee0cb4-5fa8-4137-b738-9013c67cfea9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:47.808404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6282f37a-c776-4db0-bdd7-816112693bb1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.808505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-beee0cb4-5fa8-4137-b738-9013c67cfea9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:47.808596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6282f37a-c776-4db0-bdd7-816112693bb1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.834130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beee0cb4-5fa8-4137-b738-9013c67cfea9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.834629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beee0cb4-5fa8-4137-b738-9013c67cfea9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.835584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beee0cb4-5fa8-4137-b738-9013c67cfea9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.836492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beee0cb4-5fa8-4137-b738-9013c67cfea9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:47.838136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beee0cb4-5fa8-4137-b738-9013c67cfea9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:47.838585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beee0cb4-5fa8-4137-b738-9013c67cfea9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.933283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6282f37a-c776-4db0-bdd7-816112693bb1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:47.949539 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6282f37a-c776-4db0-bdd7-816112693bb1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1212 microversion: 2.1 time: 0.169177 Aug 27 04:54:47.951171 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 387/769] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:47 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1212 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:47.968292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6e6fa0e9-6142-49ea-aed3-5a0688e1f913 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:47.969266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6e6fa0e9-6142-49ea-aed3-5a0688e1f913 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:48.143529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6e6fa0e9-6142-49ea-aed3-5a0688e1f913 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:48.151552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-beee0cb4-5fa8-4137-b738-9013c67cfea9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:48.158286 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6e6fa0e9-6142-49ea-aed3-5a0688e1f913 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1245 microversion: 2.1 time: 0.203717 Aug 27 04:54:48.172237 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 388/770] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:47 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1245 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:48.174682 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-beee0cb4-5fa8-4137-b738-9013c67cfea9 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 0.377957 Aug 27 04:54:48.175616 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 383/771] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:47 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:48.397178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cffa50ba-4539-44db-9d3e-05659428c436 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:48.399905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cffa50ba-4539-44db-9d3e-05659428c436 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:48.410809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cffa50ba-4539-44db-9d3e-05659428c436 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:48.411338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cffa50ba-4539-44db-9d3e-05659428c436 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:48.411833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cffa50ba-4539-44db-9d3e-05659428c436 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:48.412479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cffa50ba-4539-44db-9d3e-05659428c436 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:48.412938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cffa50ba-4539-44db-9d3e-05659428c436 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:48.413369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cffa50ba-4539-44db-9d3e-05659428c436 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:48.623758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cffa50ba-4539-44db-9d3e-05659428c436 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:48.635783 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cffa50ba-4539-44db-9d3e-05659428c436 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.243351 Aug 27 04:54:48.636472 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 389/772] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:48 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:48.687448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:48.688822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:48.695666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:48.696382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:48.697062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:48.697979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:48.698609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:48.699218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:48.802268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:48.802882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:48.812734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:48.813395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:48.813847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:48.814566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:48.815022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:48.815511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:48.882362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:48.896837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:48.898751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:48.901351 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fac299ba-b731-4b7c-9a14-b928919459c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.218305 Aug 27 04:54:48.902496 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 384/773] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:48 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:48.946455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:48.957689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:48.959641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:48.960970 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2c9f9082-c811-47ce-9d3f-10645cb9d593 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1336 microversion: 2.47 time: 0.162603 Aug 27 04:54:48.963027 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 390/774] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:48 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1336 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:54:48.976191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-970cc152-f51d-4eb0-8de7-3311898be0ba tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:48.980528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-970cc152-f51d-4eb0-8de7-3311898be0ba tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:49.003330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-970cc152-f51d-4eb0-8de7-3311898be0ba tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.003833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-970cc152-f51d-4eb0-8de7-3311898be0ba tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.004544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-970cc152-f51d-4eb0-8de7-3311898be0ba tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:49.006319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-970cc152-f51d-4eb0-8de7-3311898be0ba tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.007559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-970cc152-f51d-4eb0-8de7-3311898be0ba tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.007995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-970cc152-f51d-4eb0-8de7-3311898be0ba tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:49.116496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-970cc152-f51d-4eb0-8de7-3311898be0ba tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:49.128220 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-970cc152-f51d-4eb0-8de7-3311898be0ba tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1212 microversion: 2.1 time: 0.154667 Aug 27 04:54:49.130074 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 385/775] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:48 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1212 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:49.184508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-91cb5fa1-9fa7-477b-baab-29c3d5645c55 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:49.185382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-91cb5fa1-9fa7-477b-baab-29c3d5645c55 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:49.199947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-211b3e01-ce71-45f4-b403-ff85d880fda0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:49.200571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-211b3e01-ce71-45f4-b403-ff85d880fda0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:49.207644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211b3e01-ce71-45f4-b403-ff85d880fda0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.208950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211b3e01-ce71-45f4-b403-ff85d880fda0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.209616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211b3e01-ce71-45f4-b403-ff85d880fda0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:49.210491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211b3e01-ce71-45f4-b403-ff85d880fda0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.211267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211b3e01-ce71-45f4-b403-ff85d880fda0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.211997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb5fa1-9fa7-477b-baab-29c3d5645c55 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.213620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211b3e01-ce71-45f4-b403-ff85d880fda0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:49.214091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb5fa1-9fa7-477b-baab-29c3d5645c55 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.214968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb5fa1-9fa7-477b-baab-29c3d5645c55 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:49.231992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb5fa1-9fa7-477b-baab-29c3d5645c55 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.232529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb5fa1-9fa7-477b-baab-29c3d5645c55 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.233002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb5fa1-9fa7-477b-baab-29c3d5645c55 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:49.251703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:49.409117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-91cb5fa1-9fa7-477b-baab-29c3d5645c55 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:49.432316 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-91cb5fa1-9fa7-477b-baab-29c3d5645c55 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1241 microversion: 2.1 time: 0.249049 Aug 27 04:54:49.433278 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 391/776] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:49 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1241 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:49.557206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-211b3e01-ce71-45f4-b403-ff85d880fda0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:49.567063 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-211b3e01-ce71-45f4-b403-ff85d880fda0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 0.373314 Aug 27 04:54:49.573051 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 386/777] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:49 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:49.656847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7f2f3af1-b57e-4cb3-ae6b-52d824565e45 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:49.658902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7f2f3af1-b57e-4cb3-ae6b-52d824565e45 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:49.666694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f2f3af1-b57e-4cb3-ae6b-52d824565e45 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.667593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f2f3af1-b57e-4cb3-ae6b-52d824565e45 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.668038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f2f3af1-b57e-4cb3-ae6b-52d824565e45 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:49.668769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f2f3af1-b57e-4cb3-ae6b-52d824565e45 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.669255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f2f3af1-b57e-4cb3-ae6b-52d824565e45 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.669913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f2f3af1-b57e-4cb3-ae6b-52d824565e45 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:49.836986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7f2f3af1-b57e-4cb3-ae6b-52d824565e45 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:49.856003 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7f2f3af1-b57e-4cb3-ae6b-52d824565e45 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.192587 Aug 27 04:54:49.856682 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 392/778] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:49 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:49.928280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:49.928903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:49.938269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.938965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.939427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:49.940143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.940925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.941411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.000914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:50.002486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:50.017122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:50.018088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:50.018733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.025222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:50.025722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:50.026170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.165046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:50.174712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:50.180855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:50.182222 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b09cda91-d5df-41ec-beeb-66e1b46dd933 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.257905 Aug 27 04:54:50.188112 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 387/779] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:49 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:54:50.202225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:50.206273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-38d63a39-d80c-4c7d-a5ec-02c4c0ef4c37 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:50.206890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-38d63a39-d80c-4c7d-a5ec-02c4c0ef4c37 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:50.218456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d63a39-d80c-4c7d-a5ec-02c4c0ef4c37 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:50.224057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:50.225496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:50.226685 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e1406b0b-b46b-440c-8ef4-84a19ff01488 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1336 microversion: 2.47 time: 0.229974 Aug 27 04:54:50.227388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d63a39-d80c-4c7d-a5ec-02c4c0ef4c37 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:50.228668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d63a39-d80c-4c7d-a5ec-02c4c0ef4c37 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.229578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d63a39-d80c-4c7d-a5ec-02c4c0ef4c37 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:50.230229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d63a39-d80c-4c7d-a5ec-02c4c0ef4c37 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:50.230840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d63a39-d80c-4c7d-a5ec-02c4c0ef4c37 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.235958 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 393/780] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:49 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1336 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:54:50.303000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-38d63a39-d80c-4c7d-a5ec-02c4c0ef4c37 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:50.330418 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-38d63a39-d80c-4c7d-a5ec-02c4c0ef4c37 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1268 microversion: 2.1 time: 0.140874 Aug 27 04:54:50.344727 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 388/781] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:50 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:50.418850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-89697627-4f77-4cf4-8a17-c97ba4d11cd8 req-73604e17-1002-47e0-a580-defd626b3e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c927e5-5b82-4fd6-8538-fe5456c92f9f", "name": "network-vif-plugged", "status": "completed", "tag": "e042543b-f075-4259-b806-252f41c2843b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:50.441580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-89697627-4f77-4cf4-8a17-c97ba4d11cd8 req-73604e17-1002-47e0-a580-defd626b3e51 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:50.443993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-89697627-4f77-4cf4-8a17-c97ba4d11cd8 req-73604e17-1002-47e0-a580-defd626b3e51 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:50.447223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-89697627-4f77-4cf4-8a17-c97ba4d11cd8 req-73604e17-1002-47e0-a580-defd626b3e51 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.457539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-311867ea-6a75-490a-8d53-1616d96446b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:50.458880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-311867ea-6a75-490a-8d53-1616d96446b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:50.466772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-311867ea-6a75-490a-8d53-1616d96446b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:50.474272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-311867ea-6a75-490a-8d53-1616d96446b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:50.475001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-311867ea-6a75-490a-8d53-1616d96446b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.475990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-311867ea-6a75-490a-8d53-1616d96446b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:50.476628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-311867ea-6a75-490a-8d53-1616d96446b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:50.477277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-311867ea-6a75-490a-8d53-1616d96446b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.503854 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-89697627-4f77-4cf4-8a17-c97ba4d11cd8 req-73604e17-1002-47e0-a580-defd626b3e51 service nova] Creating event network-vif-plugged:e042543b-f075-4259-b806-252f41c2843b for instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f on n-h1-820368-35 Aug 27 04:54:50.511451 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-89697627-4f77-4cf4-8a17-c97ba4d11cd8 req-73604e17-1002-47e0-a580-defd626b3e51 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096411 Aug 27 04:54:50.513428 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 394/782] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:50.590267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-311867ea-6a75-490a-8d53-1616d96446b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:50.593112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4a286361-ce12-4472-834a-3c619d1e8290 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:50.593819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4a286361-ce12-4472-834a-3c619d1e8290 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:50.600308 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-311867ea-6a75-490a-8d53-1616d96446b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1297 microversion: 2.1 time: 0.147848 Aug 27 04:54:50.603374 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 389/783] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:50 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:50.604679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a286361-ce12-4472-834a-3c619d1e8290 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:50.605404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a286361-ce12-4472-834a-3c619d1e8290 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:50.606047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a286361-ce12-4472-834a-3c619d1e8290 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.606964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a286361-ce12-4472-834a-3c619d1e8290 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:50.607638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a286361-ce12-4472-834a-3c619d1e8290 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:50.608274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a286361-ce12-4472-834a-3c619d1e8290 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.799652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4a286361-ce12-4472-834a-3c619d1e8290 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:50.809327 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4a286361-ce12-4472-834a-3c619d1e8290 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1388 microversion: 2.1 time: 0.223714 Aug 27 04:54:50.813039 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 395/784] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:50 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1388 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:50.880454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-345c2145-20a1-419a-a77f-665ce33f17e1 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:50.881194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-345c2145-20a1-419a-a77f-665ce33f17e1 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:50.888457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-345c2145-20a1-419a-a77f-665ce33f17e1 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:50.889025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-345c2145-20a1-419a-a77f-665ce33f17e1 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:50.889686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-345c2145-20a1-419a-a77f-665ce33f17e1 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.890754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-345c2145-20a1-419a-a77f-665ce33f17e1 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:50.891340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-345c2145-20a1-419a-a77f-665ce33f17e1 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:50.891856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-345c2145-20a1-419a-a77f-665ce33f17e1 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.097699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-345c2145-20a1-419a-a77f-665ce33f17e1 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:51.111973 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-345c2145-20a1-419a-a77f-665ce33f17e1 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.239225 Aug 27 04:54:51.117371 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 390/785] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:50 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:51.213202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:51.214121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:51.226774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.229884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.230420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.234340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.235826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.236507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.260439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:51.261120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:51.281868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.283824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.284530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.288573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.290251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.290904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.403713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:51.413672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:51.415321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:51.416858 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c4cd7242-09a3-4a1d-9968-94c771898a58 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1336 microversion: 2.47 time: 0.162624 Aug 27 04:54:51.432183 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 391/786] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:51 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1336 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:54:51.439867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1722cde8-7ec6-456b-9bb0-5488a0b9d065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:51.442243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1722cde8-7ec6-456b-9bb0-5488a0b9d065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:51.450307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1722cde8-7ec6-456b-9bb0-5488a0b9d065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.450879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1722cde8-7ec6-456b-9bb0-5488a0b9d065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.451404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1722cde8-7ec6-456b-9bb0-5488a0b9d065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.452196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1722cde8-7ec6-456b-9bb0-5488a0b9d065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.453077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1722cde8-7ec6-456b-9bb0-5488a0b9d065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.453838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1722cde8-7ec6-456b-9bb0-5488a0b9d065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.483319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:51.493942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:51.496257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:51.497854 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e61f9c0b-66df-4714-ad57-5d3ef94494fe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.288943 Aug 27 04:54:51.498926 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 396/787] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:51 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:51.523589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1722cde8-7ec6-456b-9bb0-5488a0b9d065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:51.532770 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1722cde8-7ec6-456b-9bb0-5488a0b9d065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1274 microversion: 2.1 time: 0.098657 Aug 27 04:54:51.533363 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 392/788] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:51 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:51.624601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-45fa322f-35f6-4a3a-8f39-39409d617be3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:51.625566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-45fa322f-35f6-4a3a-8f39-39409d617be3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:51.637148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45fa322f-35f6-4a3a-8f39-39409d617be3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.638033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45fa322f-35f6-4a3a-8f39-39409d617be3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.642204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45fa322f-35f6-4a3a-8f39-39409d617be3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.644267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45fa322f-35f6-4a3a-8f39-39409d617be3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.644998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45fa322f-35f6-4a3a-8f39-39409d617be3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.646230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45fa322f-35f6-4a3a-8f39-39409d617be3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.728921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45fa322f-35f6-4a3a-8f39-39409d617be3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:51.743996 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-45fa322f-35f6-4a3a-8f39-39409d617be3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1297 microversion: 2.1 time: 0.124622 Aug 27 04:54:51.745199 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 397/789] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:51 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1297 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:51.833626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a1f0afdb-f19c-4f72-8e08-a051d9aeb068 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:51.834242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a1f0afdb-f19c-4f72-8e08-a051d9aeb068 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:51.841337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f0afdb-f19c-4f72-8e08-a051d9aeb068 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.841827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f0afdb-f19c-4f72-8e08-a051d9aeb068 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.842331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f0afdb-f19c-4f72-8e08-a051d9aeb068 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.843133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f0afdb-f19c-4f72-8e08-a051d9aeb068 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.843692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f0afdb-f19c-4f72-8e08-a051d9aeb068 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.844121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f0afdb-f19c-4f72-8e08-a051d9aeb068 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:52.135506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0b3e7068-f5d1-4b10-9659-128979618c32 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:52.136124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0b3e7068-f5d1-4b10-9659-128979618c32 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:52.142561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b3e7068-f5d1-4b10-9659-128979618c32 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:52.143055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b3e7068-f5d1-4b10-9659-128979618c32 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:52.151197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b3e7068-f5d1-4b10-9659-128979618c32 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:52.152431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b3e7068-f5d1-4b10-9659-128979618c32 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:52.153540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b3e7068-f5d1-4b10-9659-128979618c32 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:52.154377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b3e7068-f5d1-4b10-9659-128979618c32 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:52.298255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a1f0afdb-f19c-4f72-8e08-a051d9aeb068 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:52.316381 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a1f0afdb-f19c-4f72-8e08-a051d9aeb068 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1587 microversion: 2.1 time: 0.486513 Aug 27 04:54:52.317202 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 393/790] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:51 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1587 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:52.345226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-61091a7e-b9b7-4443-94ec-4386859cf051 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:52.345705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-61091a7e-b9b7-4443-94ec-4386859cf051 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:52.361889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61091a7e-b9b7-4443-94ec-4386859cf051 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:52.362608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61091a7e-b9b7-4443-94ec-4386859cf051 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:52.363596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61091a7e-b9b7-4443-94ec-4386859cf051 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:52.364474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61091a7e-b9b7-4443-94ec-4386859cf051 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:52.365081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61091a7e-b9b7-4443-94ec-4386859cf051 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:52.365923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61091a7e-b9b7-4443-94ec-4386859cf051 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:52.578529 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-61091a7e-b9b7-4443-94ec-4386859cf051 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238146 Aug 27 04:54:52.579328 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 394/791] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 04:54:52 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298/os-interface => generated 284 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:52.590603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:52.591260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:52.606605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:52.607117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:52.607573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:52.608457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:52.609176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:52.609762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:52.795122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0b3e7068-f5d1-4b10-9659-128979618c32 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:52.804772 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0b3e7068-f5d1-4b10-9659-128979618c32 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.673162 Aug 27 04:54:52.807520 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 398/792] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:52 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:52.813656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:52.814502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:52.823217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:52.825626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:52.827250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:52.832686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:52.835025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:52.837161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:52.902157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:52.905630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:52.933210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:52.934880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:52.936101 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f6c5442-f570-4dc0-8f78-b29798048680 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1336 microversion: 2.47 time: 0.356021 Aug 27 04:54:52.944097 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 395/793] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:52 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1336 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:52.967637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-40b2d593-94b1-47fc-8ce8-a77535207a1f req-02988d71-9ea5-4808-ac8b-1edbba65b208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d5a4df-1045-4b64-b58c-2383ce224d63", "name": "network-vif-plugged", "status": "completed", "tag": "7664fef3-23d1-4397-942a-44d07372001b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:52.998172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-40b2d593-94b1-47fc-8ce8-a77535207a1f req-02988d71-9ea5-4808-ac8b-1edbba65b208 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:52.998648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-40b2d593-94b1-47fc-8ce8-a77535207a1f req-02988d71-9ea5-4808-ac8b-1edbba65b208 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:52.999074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-40b2d593-94b1-47fc-8ce8-a77535207a1f req-02988d71-9ea5-4808-ac8b-1edbba65b208 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:53.021577 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-40b2d593-94b1-47fc-8ce8-a77535207a1f req-02988d71-9ea5-4808-ac8b-1edbba65b208 service nova] Creating event network-vif-plugged:7664fef3-23d1-4397-942a-44d07372001b for instance 35d5a4df-1045-4b64-b58c-2383ce224d63 on n-h2-820368-35 Aug 27 04:54:53.033905 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-40b2d593-94b1-47fc-8ce8-a77535207a1f req-02988d71-9ea5-4808-ac8b-1edbba65b208 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087428 Aug 27 04:54:53.034989 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 396/794] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:53.050007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-80f056ca-1588-4d84-b171-7d9f492ba9f0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:53.050714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80f056ca-1588-4d84-b171-7d9f492ba9f0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:53.079214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80f056ca-1588-4d84-b171-7d9f492ba9f0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.079730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80f056ca-1588-4d84-b171-7d9f492ba9f0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.080189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80f056ca-1588-4d84-b171-7d9f492ba9f0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:53.092776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80f056ca-1588-4d84-b171-7d9f492ba9f0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.093469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80f056ca-1588-4d84-b171-7d9f492ba9f0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.093911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80f056ca-1588-4d84-b171-7d9f492ba9f0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:53.452603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:53.469456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:53.471810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:53.473807 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae7d7421-e1a6-40b3-b018-6bb72add0e92 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.664720 Aug 27 04:54:53.474541 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 399/795] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:52 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:53.484615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f975d3c-a888-4b75-943a-0201eccd1b47 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:53.487993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f975d3c-a888-4b75-943a-0201eccd1b47 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:53.502884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f975d3c-a888-4b75-943a-0201eccd1b47 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.503766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f975d3c-a888-4b75-943a-0201eccd1b47 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.504412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f975d3c-a888-4b75-943a-0201eccd1b47 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:53.507011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f975d3c-a888-4b75-943a-0201eccd1b47 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.513174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f975d3c-a888-4b75-943a-0201eccd1b47 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.514369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f975d3c-a888-4b75-943a-0201eccd1b47 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:53.648198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f975d3c-a888-4b75-943a-0201eccd1b47 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:53.665635 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f975d3c-a888-4b75-943a-0201eccd1b47 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1303 microversion: 2.1 time: 0.189685 Aug 27 04:54:53.666227 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 400/796] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:53 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:53.691532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-80f056ca-1588-4d84-b171-7d9f492ba9f0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:53.700226 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-80f056ca-1588-4d84-b171-7d9f492ba9f0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.659909 Aug 27 04:54:53.705370 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 397/797] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:53 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:53.834493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-718d46b4-d770-4f61-aacc-587a2f68eac6 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:53.835313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-718d46b4-d770-4f61-aacc-587a2f68eac6 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:53.852769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-718d46b4-d770-4f61-aacc-587a2f68eac6 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.854509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-718d46b4-d770-4f61-aacc-587a2f68eac6 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.857503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-718d46b4-d770-4f61-aacc-587a2f68eac6 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:53.858549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-718d46b4-d770-4f61-aacc-587a2f68eac6 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.859625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-718d46b4-d770-4f61-aacc-587a2f68eac6 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.863306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-718d46b4-d770-4f61-aacc-587a2f68eac6 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:53.977334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5b7b378-a895-4147-a26c-da8eac2befa7 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Calling method '.version_select at 0x7fb565e2e820>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:53.981888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b7b378-a895-4147-a26c-da8eac2befa7 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.983005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b7b378-a895-4147-a26c-da8eac2befa7 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.986066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b7b378-a895-4147-a26c-da8eac2befa7 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:53.987063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b7b378-a895-4147-a26c-da8eac2befa7 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.988427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b7b378-a895-4147-a26c-da8eac2befa7 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.988427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b7b378-a895-4147-a26c-da8eac2befa7 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.033424 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5b7b378-a895-4147-a26c-da8eac2befa7 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.352578 Aug 27 04:54:54.034788 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 401/798] 10.222.0.58 () {58 vars in 1128 bytes} [Sat Aug 27 04:54:53 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:54.041796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70f05eec-9118-499a-9ff2-1610e72c73ef tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Calling method '.version_select at 0x7fb565ebb160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:54.124481 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70f05eec-9118-499a-9ff2-1610e72c73ef tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf" status: 200 len: 637 microversion: 2.1 time: 0.087873 Aug 27 04:54:54.127229 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 402/799] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:54 2022] GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf => generated 637 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:54.140928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:54.141560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:54.155948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.156602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.156880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.157596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.158047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.158467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.329705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:54.339850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:54.342192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:54.343851 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ea450ab1-0f5d-427f-bd25-9d8c8e225a19 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1336 microversion: 2.47 time: 0.214295 Aug 27 04:54:54.344651 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 403/800] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:54 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1336 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:54.349783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a7c8449-6b0f-4790-b4b9-f44b382224d0 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Calling method '.version_select at 0x7fb565936550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:54.354867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7c8449-6b0f-4790-b4b9-f44b382224d0 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.355545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7c8449-6b0f-4790-b4b9-f44b382224d0 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.356149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7c8449-6b0f-4790-b4b9-f44b382224d0 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.357035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7c8449-6b0f-4790-b4b9-f44b382224d0 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.358167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7c8449-6b0f-4790-b4b9-f44b382224d0 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.358760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7c8449-6b0f-4790-b4b9-f44b382224d0 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.388706 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a7c8449-6b0f-4790-b4b9-f44b382224d0 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.042639 Aug 27 04:54:54.389899 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 404/801] 10.222.0.58 () {58 vars in 1139 bytes} [Sat Aug 27 04:54:54 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:54.394856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90dadab2-ec0c-4eca-9418-986a8a176615 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Action: 'update_all', calling method: .version_select at 0x7fb565504820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:54.453055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-90dadab2-ec0c-4eca-9418-986a8a176615 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:54.456009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=89,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:DELETE=5 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:54.460326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-90dadab2-ec0c-4eca-9418-986a8a176615 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for user a3175b8c1703451fa0f5fbc163cbe4a4 and project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:54.602664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-718d46b4-d770-4f61-aacc-587a2f68eac6 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:54.611781 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-718d46b4-d770-4f61-aacc-587a2f68eac6 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.784273 Aug 27 04:54:54.612939 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 398/802] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:53 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:54.629624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-81dd7e87-e536-4997-978d-1935b7627d24 req-a7186585-d040-48ca-be2f-61e8de1ee862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0c46e5a-ffeb-41a5-9593-6d64703ae23d", "tag": "4ba304c5-0b28-4523-9219-f55fd7244c04"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:54.659307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-81dd7e87-e536-4997-978d-1935b7627d24 req-a7186585-d040-48ca-be2f-61e8de1ee862 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.659799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-81dd7e87-e536-4997-978d-1935b7627d24 req-a7186585-d040-48ca-be2f-61e8de1ee862 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.660233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-81dd7e87-e536-4997-978d-1935b7627d24 req-a7186585-d040-48ca-be2f-61e8de1ee862 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.676842 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-81dd7e87-e536-4997-978d-1935b7627d24 req-a7186585-d040-48ca-be2f-61e8de1ee862 service nova] Creating event network-changed:4ba304c5-0b28-4523-9219-f55fd7244c04 for instance a0c46e5a-ffeb-41a5-9593-6d64703ae23d on n-h2-820368-35 Aug 27 04:54:54.697484 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-81dd7e87-e536-4997-978d-1935b7627d24 req-a7186585-d040-48ca-be2f-61e8de1ee862 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081837 Aug 27 04:54:54.698828 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 399/803] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:54.714243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-411dcaf4-0412-4001-813e-f414a6489c47 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Calling method '.version_select at 0x7fb5659261f0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:54.718365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-411dcaf4-0412-4001-813e-f414a6489c47 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.719464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-411dcaf4-0412-4001-813e-f414a6489c47 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.720092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-411dcaf4-0412-4001-813e-f414a6489c47 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.721035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-411dcaf4-0412-4001-813e-f414a6489c47 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.723255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-411dcaf4-0412-4001-813e-f414a6489c47 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.723910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-411dcaf4-0412-4001-813e-f414a6489c47 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.826716 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-411dcaf4-0412-4001-813e-f414a6489c47 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.126459 Aug 27 04:54:54.828015 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 400/804] 10.222.0.58 () {58 vars in 1145 bytes} [Sat Aug 27 04:54:54 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:54.833013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:54.834110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:54.846971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.847527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.848133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.849081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.849626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.850199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.896996 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90dadab2-ec0c-4eca-9418-986a8a176615 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 61 microversion: 2.1 time: 0.505600 Aug 27 04:54:54.898189 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 405/805] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:54:54 2022] PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 61 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:54.903715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ab0fa42-9865-4fb8-a143-e8f47ae6d3e3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:54.904686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ab0fa42-9865-4fb8-a143-e8f47ae6d3e3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:54.912199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ab0fa42-9865-4fb8-a143-e8f47ae6d3e3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.913385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ab0fa42-9865-4fb8-a143-e8f47ae6d3e3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.914037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ab0fa42-9865-4fb8-a143-e8f47ae6d3e3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.915275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ab0fa42-9865-4fb8-a143-e8f47ae6d3e3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.915996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ab0fa42-9865-4fb8-a143-e8f47ae6d3e3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.916589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ab0fa42-9865-4fb8-a143-e8f47ae6d3e3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.337160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7ab0fa42-9865-4fb8-a143-e8f47ae6d3e3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:55.345223 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ab0fa42-9865-4fb8-a143-e8f47ae6d3e3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.445646 Aug 27 04:54:55.348614 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 406/806] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:54 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:55.355021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e62243c4-78d0-47ec-b2b8-64bea44ca6ef tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:55.355831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e62243c4-78d0-47ec-b2b8-64bea44ca6ef tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:55.361973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e62243c4-78d0-47ec-b2b8-64bea44ca6ef tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.362666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e62243c4-78d0-47ec-b2b8-64bea44ca6ef tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.364837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e62243c4-78d0-47ec-b2b8-64bea44ca6ef tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.369623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:55.373383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e62243c4-78d0-47ec-b2b8-64bea44ca6ef tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.374225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e62243c4-78d0-47ec-b2b8-64bea44ca6ef tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.374925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e62243c4-78d0-47ec-b2b8-64bea44ca6ef tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.401341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:55.402931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:55.404461 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b9260f22-337a-48d4-85e5-ba3c955aa6f8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.575148 Aug 27 04:54:55.405301 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 401/807] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:54 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:55.410608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eaa549f5-d359-4316-a00c-cbc56356e0cb tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Calling method '.version_select at 0x7fb565821670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:55.417048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaa549f5-d359-4316-a00c-cbc56356e0cb tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.417922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaa549f5-d359-4316-a00c-cbc56356e0cb tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.418574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaa549f5-d359-4316-a00c-cbc56356e0cb tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.419550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaa549f5-d359-4316-a00c-cbc56356e0cb tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.420217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaa549f5-d359-4316-a00c-cbc56356e0cb tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.420826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaa549f5-d359-4316-a00c-cbc56356e0cb tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.446418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:55.454353 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eaa549f5-d359-4316-a00c-cbc56356e0cb tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.047161 Aug 27 04:54:55.455323 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 402/808] 10.222.0.58 () {58 vars in 1128 bytes} [Sat Aug 27 04:54:55 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:55.461134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cc0a3a90-ce6f-43ad-8e45-6432cf73d61c tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Calling method '.version_select at 0x7fb5655404c0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:55.656769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e62243c4-78d0-47ec-b2b8-64bea44ca6ef tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:55.681557 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e62243c4-78d0-47ec-b2b8-64bea44ca6ef tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.319587 Aug 27 04:54:55.696939 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 407/809] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:55 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:55.717633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:55.718488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:55.734213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.734720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.735202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.735928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.736390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.736912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.825968 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cc0a3a90-ce6f-43ad-8e45-6432cf73d61c tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "DELETE /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.369491 Aug 27 04:54:55.826705 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 403/810] 10.222.0.58 () {58 vars in 1296 bytes} [Sat Aug 27 04:54:55 2022] DELETE /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata/os_version => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:54:55.837728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0b9def1-33e0-4f2a-ad38-c54a73efb3c4 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Calling method '.version_select at 0x7fb565540280>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:55.841682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b9def1-33e0-4f2a-ad38-c54a73efb3c4 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.842286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b9def1-33e0-4f2a-ad38-c54a73efb3c4 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.843254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b9def1-33e0-4f2a-ad38-c54a73efb3c4 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.844244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b9def1-33e0-4f2a-ad38-c54a73efb3c4 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.844810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b9def1-33e0-4f2a-ad38-c54a73efb3c4 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.845345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0b9def1-33e0-4f2a-ad38-c54a73efb3c4 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.850690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:55.859687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:55.861140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:55.862276 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-051da4e2-fbf5-4796-a3d7-c36d41a94a08 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1336 microversion: 2.47 time: 0.163460 Aug 27 04:54:55.863193 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 408/811] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:55 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1336 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:55.868924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e414dd9-3365-4bc6-aad4-7169afa724ea tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:55.869734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9e414dd9-3365-4bc6-aad4-7169afa724ea tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:55.871570 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e0b9def1-33e0-4f2a-ad38-c54a73efb3c4 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.043320 Aug 27 04:54:55.880997 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 404/812] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:54:55 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:55.886587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e414dd9-3365-4bc6-aad4-7169afa724ea tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.887584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e414dd9-3365-4bc6-aad4-7169afa724ea tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.888109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e414dd9-3365-4bc6-aad4-7169afa724ea tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.888833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ce92b84-7e5c-4234-b682-b0f6cc732e97 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:55.888981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e414dd9-3365-4bc6-aad4-7169afa724ea tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.889522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e414dd9-3365-4bc6-aad4-7169afa724ea tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.889695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ce92b84-7e5c-4234-b682-b0f6cc732e97 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:55.890245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e414dd9-3365-4bc6-aad4-7169afa724ea tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.898067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce92b84-7e5c-4234-b682-b0f6cc732e97 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.898722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce92b84-7e5c-4234-b682-b0f6cc732e97 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.899449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce92b84-7e5c-4234-b682-b0f6cc732e97 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.900965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce92b84-7e5c-4234-b682-b0f6cc732e97 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.901540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce92b84-7e5c-4234-b682-b0f6cc732e97 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.902051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce92b84-7e5c-4234-b682-b0f6cc732e97 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.138149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1ce92b84-7e5c-4234-b682-b0f6cc732e97 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:56.148066 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ce92b84-7e5c-4234-b682-b0f6cc732e97 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1587 microversion: 2.1 time: 0.265666 Aug 27 04:54:56.158593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9e414dd9-3365-4bc6-aad4-7169afa724ea tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:56.165982 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 405/813] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:55 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1587 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:56.168670 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9e414dd9-3365-4bc6-aad4-7169afa724ea tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.304083 Aug 27 04:54:56.171528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-49c9fed9-1db9-4351-b818-271f55bd99d8 req-933604e0-8651-4aaa-9474-de649c82d337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffd03e4-cebb-4c94-a9f9-fc0887472298", "tag": "db5f8da9-4df5-4598-a365-b238e6e53d2f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:56.178766 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 409/814] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:55 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:56.182561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-49c9fed9-1db9-4351-b818-271f55bd99d8 req-933604e0-8651-4aaa-9474-de649c82d337 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.183740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-49c9fed9-1db9-4351-b818-271f55bd99d8 req-933604e0-8651-4aaa-9474-de649c82d337 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.184268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-49c9fed9-1db9-4351-b818-271f55bd99d8 req-933604e0-8651-4aaa-9474-de649c82d337 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.185075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01a72190-06e8-4c75-9e1f-88cb1dcc247d tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Calling method '.version_select at 0x7fb565695940>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:56.197322 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-49c9fed9-1db9-4351-b818-271f55bd99d8 req-933604e0-8651-4aaa-9474-de649c82d337 service nova] Creating event network-changed:db5f8da9-4df5-4598-a365-b238e6e53d2f for instance dffd03e4-cebb-4c94-a9f9-fc0887472298 on n-h2-820368-35 Aug 27 04:54:56.202730 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-49c9fed9-1db9-4351-b818-271f55bd99d8 req-933604e0-8651-4aaa-9474-de649c82d337 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035298 Aug 27 04:54:56.203765 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 406/815] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:56.209611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9ca42ade-c69e-4506-8779-1ed8b73a74c1 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Calling method '.version_select at 0x7fb565bb0790>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:56.214256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca42ade-c69e-4506-8779-1ed8b73a74c1 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.214797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca42ade-c69e-4506-8779-1ed8b73a74c1 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.215259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca42ade-c69e-4506-8779-1ed8b73a74c1 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.216157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca42ade-c69e-4506-8779-1ed8b73a74c1 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.216799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca42ade-c69e-4506-8779-1ed8b73a74c1 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.217386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca42ade-c69e-4506-8779-1ed8b73a74c1 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.247301 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9ca42ade-c69e-4506-8779-1ed8b73a74c1 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.042039 Aug 27 04:54:56.248367 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 407/816] 10.222.0.58 () {58 vars in 1128 bytes} [Sat Aug 27 04:54:56 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:56.253611 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01a72190-06e8-4c75-9e1f-88cb1dcc247d tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 37 microversion: 2.1 time: 0.073290 Aug 27 04:54:56.262519 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 410/817] 10.222.0.58 () {58 vars in 1260 bytes} [Sat Aug 27 04:54:56 2022] GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 37 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:56.268642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0e7059fd-7aca-43fd-a420-b14439e12982 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Action: 'update_all', calling method: .version_select at 0x7fb5654cc550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:56.270847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-835f7ef5-0c42-49be-b7d6-b9bc1c48aa55 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Calling method '.version_select at 0x7fb5658ce670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:56.284702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835f7ef5-0c42-49be-b7d6-b9bc1c48aa55 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.286519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835f7ef5-0c42-49be-b7d6-b9bc1c48aa55 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.287494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835f7ef5-0c42-49be-b7d6-b9bc1c48aa55 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.317460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835f7ef5-0c42-49be-b7d6-b9bc1c48aa55 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.318187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835f7ef5-0c42-49be-b7d6-b9bc1c48aa55 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.319242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835f7ef5-0c42-49be-b7d6-b9bc1c48aa55 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.351337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0e7059fd-7aca-43fd-a420-b14439e12982 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:56.359325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0e7059fd-7aca-43fd-a420-b14439e12982 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for user a3175b8c1703451fa0f5fbc163cbe4a4 and project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:56.392211 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-835f7ef5-0c42-49be-b7d6-b9bc1c48aa55 tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h2-820368-35" status: 200 len: 999 microversion: 2.1 time: 0.136918 Aug 27 04:54:56.395137 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 408/818] 10.222.0.58 () {58 vars in 1173 bytes} [Sat Aug 27 04:54:56 2022] GET /compute/v2.1/os-hosts/n-h2-820368-35 => generated 999 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:56.398610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d96952a-0476-4dfd-8cb0-d16b407b5a58 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:56.400042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d96952a-0476-4dfd-8cb0-d16b407b5a58 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:56.406411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d96952a-0476-4dfd-8cb0-d16b407b5a58 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.406906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d96952a-0476-4dfd-8cb0-d16b407b5a58 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.408681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d96952a-0476-4dfd-8cb0-d16b407b5a58 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.408681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d96952a-0476-4dfd-8cb0-d16b407b5a58 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.408681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d96952a-0476-4dfd-8cb0-d16b407b5a58 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.408939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d96952a-0476-4dfd-8cb0-d16b407b5a58 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.624196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d96952a-0476-4dfd-8cb0-d16b407b5a58 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:56.633358 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d96952a-0476-4dfd-8cb0-d16b407b5a58 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.239023 Aug 27 04:54:56.637557 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 409/819] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:56 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:56.645393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8cab63d0-611f-42d3-a19a-12edd9cce2ac tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Calling method '.version_select at 0x7fb565bde5e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:56.668338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cab63d0-611f-42d3-a19a-12edd9cce2ac tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.668979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cab63d0-611f-42d3-a19a-12edd9cce2ac tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.669671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cab63d0-611f-42d3-a19a-12edd9cce2ac tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.683435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cab63d0-611f-42d3-a19a-12edd9cce2ac tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.684046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cab63d0-611f-42d3-a19a-12edd9cce2ac tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.684688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cab63d0-611f-42d3-a19a-12edd9cce2ac tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.738919 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8cab63d0-611f-42d3-a19a-12edd9cce2ac tempest-HostsAdminTestJSON-628233096 tempest-HostsAdminTestJSON-628233096-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h1-820368-35" status: 200 len: 867 microversion: 2.1 time: 0.099792 Aug 27 04:54:56.745208 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 410/820] 10.222.0.58 () {58 vars in 1173 bytes} [Sat Aug 27 04:54:56 2022] GET /compute/v2.1/os-hosts/n-h1-820368-35 => generated 867 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:56.745461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:56.746653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:56.755445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.756541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.757370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.763830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0e7059fd-7aca-43fd-a420-b14439e12982 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 61 microversion: 2.1 time: 0.499611 Aug 27 04:54:56.766023 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 411/821] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:54:56 2022] PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 61 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:56.768415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.774782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-964c0006-6fc7-4180-8f78-0ec8b8706e2a req-87231d52-37d8-442f-a490-6e572304e4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb532469-9212-4d66-b601-a0f0bcf27b24", "name": "network-vif-plugged", "status": "completed", "tag": "b7904933-9b12-452f-ac97-d6716cfe787a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:56.776568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.777558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.790858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-964c0006-6fc7-4180-8f78-0ec8b8706e2a req-87231d52-37d8-442f-a490-6e572304e4d9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.791808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-964c0006-6fc7-4180-8f78-0ec8b8706e2a req-87231d52-37d8-442f-a490-6e572304e4d9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.792542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-964c0006-6fc7-4180-8f78-0ec8b8706e2a req-87231d52-37d8-442f-a490-6e572304e4d9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.808142 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-964c0006-6fc7-4180-8f78-0ec8b8706e2a req-87231d52-37d8-442f-a490-6e572304e4d9 service nova] Creating event network-vif-plugged:b7904933-9b12-452f-ac97-d6716cfe787a for instance eb532469-9212-4d66-b601-a0f0bcf27b24 on n-h2-820368-35 Aug 27 04:54:56.814265 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-964c0006-6fc7-4180-8f78-0ec8b8706e2a req-87231d52-37d8-442f-a490-6e572304e4d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046821 Aug 27 04:54:56.814985 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 412/822] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:56.820588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-305db48f-24fe-46db-a72d-efc8bf66111a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:56.821581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-305db48f-24fe-46db-a72d-efc8bf66111a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:56.828709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-305db48f-24fe-46db-a72d-efc8bf66111a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.829567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-305db48f-24fe-46db-a72d-efc8bf66111a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.830693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-305db48f-24fe-46db-a72d-efc8bf66111a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.831824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-305db48f-24fe-46db-a72d-efc8bf66111a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.832504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-305db48f-24fe-46db-a72d-efc8bf66111a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.833300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-305db48f-24fe-46db-a72d-efc8bf66111a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:57.076584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:57.085481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:57.087059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:57.093473 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-794781df-fedb-4499-94fe-aafb8ac748eb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.347577 Aug 27 04:54:57.094128 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 411/823] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:56 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:57.099385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2c7d5d6-fccc-4622-b38e-b70d8977fd90 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Calling method '.version_select at 0x7fb5655c2790>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:57.112168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-305db48f-24fe-46db-a72d-efc8bf66111a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:57.121849 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-305db48f-24fe-46db-a72d-efc8bf66111a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.305404 Aug 27 04:54:57.122439 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 413/824] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:56 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:57.128190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:57.129115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:57.135531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:57.136509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:57.137354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:57.138330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:57.138995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:57.139664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:57.162328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:57.232287 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b2c7d5d6-fccc-4622-b38e-b70d8977fd90 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.136515 Aug 27 04:54:57.234110 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 412/825] 10.222.0.58 () {58 vars in 1290 bytes} [Sat Aug 27 04:54:57 2022] GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata/os_distro => generated 33 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:57.242128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-559a4ee5-cc31-40c3-a9cb-91e66614bc4b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:57.249491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-559a4ee5-cc31-40c3-a9cb-91e66614bc4b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:57.268244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-559a4ee5-cc31-40c3-a9cb-91e66614bc4b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:57.274091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-559a4ee5-cc31-40c3-a9cb-91e66614bc4b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:57.276247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-559a4ee5-cc31-40c3-a9cb-91e66614bc4b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:57.277276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-559a4ee5-cc31-40c3-a9cb-91e66614bc4b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:57.281166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-559a4ee5-cc31-40c3-a9cb-91e66614bc4b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:57.281947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-559a4ee5-cc31-40c3-a9cb-91e66614bc4b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:57.287615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:57.352210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:57.352210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:57.352210 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d33b668d-fdeb-49c8-a1e5-0d7625e928f4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1336 microversion: 2.47 time: 0.196870 Aug 27 04:54:57.353668 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 414/826] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:57 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1336 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:57.353668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e9760068-3082-4def-884d-f4dbe09e484e tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Action: 'update_all', calling method: .version_select at 0x7fb56562ad30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:57.432400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-e9760068-3082-4def-884d-f4dbe09e484e tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:57.440953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-e9760068-3082-4def-884d-f4dbe09e484e tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for user a3175b8c1703451fa0f5fbc163cbe4a4 and project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:57.614333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-559a4ee5-cc31-40c3-a9cb-91e66614bc4b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:57.624369 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-559a4ee5-cc31-40c3-a9cb-91e66614bc4b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.388226 Aug 27 04:54:57.625222 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 413/827] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:57 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:57.659210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c8d16afb-ba17-4a4b-8f46-f1f1c5586773 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:57.660383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c8d16afb-ba17-4a4b-8f46-f1f1c5586773 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:57.667872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8d16afb-ba17-4a4b-8f46-f1f1c5586773 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:57.668373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8d16afb-ba17-4a4b-8f46-f1f1c5586773 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:57.669043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8d16afb-ba17-4a4b-8f46-f1f1c5586773 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:57.671306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8d16afb-ba17-4a4b-8f46-f1f1c5586773 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:57.671540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8d16afb-ba17-4a4b-8f46-f1f1c5586773 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:57.671990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8d16afb-ba17-4a4b-8f46-f1f1c5586773 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:57.700528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=26 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:57.722538 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e9760068-3082-4def-884d-f4dbe09e484e tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 61 microversion: 2.1 time: 0.395343 Aug 27 04:54:57.723708 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 415/828] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:54:57 2022] PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 61 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:57.733849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-35bfaeba-bce3-42b8-b129-b2e5aca90d44 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Calling method '.version_select at 0x7fb565a6aca0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:57.798756 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-35bfaeba-bce3-42b8-b129-b2e5aca90d44 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 61 microversion: 2.1 time: 0.069075 Aug 27 04:54:57.799842 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 416/829] 10.222.0.58 () {58 vars in 1260 bytes} [Sat Aug 27 04:54:57 2022] GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 61 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:54:57.811776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02ecd7f1-f8a0-4ca6-88ef-f779021fe2c0 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Action: 'update_all', calling method: .version_select at 0x7fb565d74430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:57.887672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-02ecd7f1-f8a0-4ca6-88ef-f779021fe2c0 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:57.894922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-02ecd7f1-f8a0-4ca6-88ef-f779021fe2c0 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for user a3175b8c1703451fa0f5fbc163cbe4a4 and project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:57.964151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c8d16afb-ba17-4a4b-8f46-f1f1c5586773 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:57.975965 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c8d16afb-ba17-4a4b-8f46-f1f1c5586773 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.321718 Aug 27 04:54:57.977402 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 414/830] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:57 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:58.118305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:58.121933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:58.130186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.136720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.137768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:58.141744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.142949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.145410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:58.204912 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-02ecd7f1-f8a0-4ca6-88ef-f779021fe2c0 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 61 microversion: 2.1 time: 0.396718 Aug 27 04:54:58.205794 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 417/831] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:54:57 2022] PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 61 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:54:58.211183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1539864-de5f-436a-9be5-b9505e8e0065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:58.212778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a1539864-de5f-436a-9be5-b9505e8e0065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:58.229181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1539864-de5f-436a-9be5-b9505e8e0065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.231967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1539864-de5f-436a-9be5-b9505e8e0065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.234864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1539864-de5f-436a-9be5-b9505e8e0065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:58.235991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1539864-de5f-436a-9be5-b9505e8e0065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.238496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1539864-de5f-436a-9be5-b9505e8e0065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.239852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1539864-de5f-436a-9be5-b9505e8e0065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:58.448797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:58.467246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:58.471811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:58.475271 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-93483506-a4ed-4298-aa01-6133fd2f92e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.360911 Aug 27 04:54:58.486419 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 415/832] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:58 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:54:58.498952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7fd77934-53d3-4cda-8181-c28387bae814 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Action: 'update_all', calling method: .version_select at 0x7fb565585310>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:58.609322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-7fd77934-53d3-4cda-8181-c28387bae814 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:58.616127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a1539864-de5f-436a-9be5-b9505e8e0065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:58.630639 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a1539864-de5f-436a-9be5-b9505e8e0065 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.423504 Aug 27 04:54:58.631376 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 418/833] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:58 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:58.631534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-7fd77934-53d3-4cda-8181-c28387bae814 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for user a3175b8c1703451fa0f5fbc163cbe4a4 and project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:58.639635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:58.641605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:58.652287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.656023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.659976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:58.661787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.662480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.665812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:58.784851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:58.800851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:58.802591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:58.804038 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9ec41fe9-9b6b-47a6-afed-507147b8a067 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1336 microversion: 2.47 time: 0.170375 Aug 27 04:54:58.807526 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 419/834] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:58 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1336 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:58.817599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cfb6c1fe-2aa3-44a5-817a-96cc997f2940 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:58.819366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cfb6c1fe-2aa3-44a5-817a-96cc997f2940 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:58.827889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfb6c1fe-2aa3-44a5-817a-96cc997f2940 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.828654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfb6c1fe-2aa3-44a5-817a-96cc997f2940 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.829360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfb6c1fe-2aa3-44a5-817a-96cc997f2940 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:58.830242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfb6c1fe-2aa3-44a5-817a-96cc997f2940 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.830861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfb6c1fe-2aa3-44a5-817a-96cc997f2940 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.831539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfb6c1fe-2aa3-44a5-817a-96cc997f2940 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:59.101920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cfb6c1fe-2aa3-44a5-817a-96cc997f2940 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:59.110858 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cfb6c1fe-2aa3-44a5-817a-96cc997f2940 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.301547 Aug 27 04:54:59.111800 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 420/835] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:58 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:59.129640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b53307f0-0371-4dc9-90c7-f05440bb97c8 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:59.130787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b53307f0-0371-4dc9-90c7-f05440bb97c8 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:59.148473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53307f0-0371-4dc9-90c7-f05440bb97c8 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:59.150404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53307f0-0371-4dc9-90c7-f05440bb97c8 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:59.150926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53307f0-0371-4dc9-90c7-f05440bb97c8 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:59.153806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53307f0-0371-4dc9-90c7-f05440bb97c8 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:59.154363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53307f0-0371-4dc9-90c7-f05440bb97c8 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:59.155138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53307f0-0371-4dc9-90c7-f05440bb97c8 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:59.199051 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7fd77934-53d3-4cda-8181-c28387bae814 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 64 microversion: 2.1 time: 0.709384 Aug 27 04:54:59.200232 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 416/836] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:54:58 2022] PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 64 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:59.205355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5562cec5-5f7d-427e-88c1-a94c345a7683 req-37983841-569d-4ec1-8033-bbfe00a4d606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f4d090-8163-469c-b801-7864b9155ed3", "name": "network-vif-plugged", "status": "completed", "tag": "3c575205-29ce-4475-a574-a3f0cf85516a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:59.222747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5562cec5-5f7d-427e-88c1-a94c345a7683 req-37983841-569d-4ec1-8033-bbfe00a4d606 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:59.223366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5562cec5-5f7d-427e-88c1-a94c345a7683 req-37983841-569d-4ec1-8033-bbfe00a4d606 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:59.223804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5562cec5-5f7d-427e-88c1-a94c345a7683 req-37983841-569d-4ec1-8033-bbfe00a4d606 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:59.242035 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5562cec5-5f7d-427e-88c1-a94c345a7683 req-37983841-569d-4ec1-8033-bbfe00a4d606 service nova] Creating event network-vif-plugged:3c575205-29ce-4475-a574-a3f0cf85516a for instance f8f4d090-8163-469c-b801-7864b9155ed3 on n-h1-820368-35 Aug 27 04:54:59.259124 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5562cec5-5f7d-427e-88c1-a94c345a7683 req-37983841-569d-4ec1-8033-bbfe00a4d606 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055614 Aug 27 04:54:59.260104 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 417/837] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:59.268553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-99b955e0-edb8-4dbc-9c00-392909238c1e tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Calling method '.version_select at 0x7fb565be5c10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:59.312320 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-99b955e0-edb8-4dbc-9c00-392909238c1e tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 64 microversion: 2.1 time: 0.050897 Aug 27 04:54:59.313672 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 418/838] 10.222.0.58 () {58 vars in 1260 bytes} [Sat Aug 27 04:54:59 2022] GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 64 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:59.331418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d4f6c33c-48f9-4f79-a50d-ead48444b87d tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Action: 'update_all', calling method: .version_select at 0x7fb565926550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:59.386903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-d4f6c33c-48f9-4f79-a50d-ead48444b87d tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:59.392585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-d4f6c33c-48f9-4f79-a50d-ead48444b87d tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for user a3175b8c1703451fa0f5fbc163cbe4a4 and project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:59.413202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b53307f0-0371-4dc9-90c7-f05440bb97c8 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:59.424607 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b53307f0-0371-4dc9-90c7-f05440bb97c8 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.311329 Aug 27 04:54:59.425214 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 421/839] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:59 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:59.514293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:59.515754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:59.522809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:59.523636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:59.524987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:59.526120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:59.527410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:59.528123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:59.787625 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d4f6c33c-48f9-4f79-a50d-ead48444b87d tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 61 microversion: 2.1 time: 0.466440 Aug 27 04:54:59.788496 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 419/840] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:54:59 2022] PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 61 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:54:59.797040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0d21f79f-4119-4d43-8511-37709034026e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:59.797792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0d21f79f-4119-4d43-8511-37709034026e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:59.808975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d21f79f-4119-4d43-8511-37709034026e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:59.809477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d21f79f-4119-4d43-8511-37709034026e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:59.809917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d21f79f-4119-4d43-8511-37709034026e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:59.810635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d21f79f-4119-4d43-8511-37709034026e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:59.811111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d21f79f-4119-4d43-8511-37709034026e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:59.811568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d21f79f-4119-4d43-8511-37709034026e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:59.832840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:59.855061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:59.856967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:59.866050 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-074cc6f2-88f6-463d-b164-aade04e2833d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.357577 Aug 27 04:54:59.868757 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 422/841] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:59 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:59.878396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f7ff05f4-8a03-4d16-90e1-8b9900fb00f7 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Action: 'update', calling method: .version_select at 0x7fb565695940>, body: {"meta": {"os_version": "alt"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:59.960156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f7ff05f4-8a03-4d16-90e1-8b9900fb00f7 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:59.966013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f7ff05f4-8a03-4d16-90e1-8b9900fb00f7 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for user a3175b8c1703451fa0f5fbc163cbe4a4 and project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:00.033970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0d21f79f-4119-4d43-8511-37709034026e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:00.042233 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0d21f79f-4119-4d43-8511-37709034026e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.252693 Aug 27 04:55:00.046586 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 420/842] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:59 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:00.052143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:00.052918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:00.059988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.060720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.061409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.062555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.063267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.063921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.177549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:00.199013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:00.204376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:00.206483 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-24d09057-d4e2-4dfb-8a5f-e51cc565bb98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1357 microversion: 2.47 time: 0.158513 Aug 27 04:55:00.207675 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 421/843] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:00 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:00.221777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-814da4e6-dd4f-4e05-9aa9-368141d7e853 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:00.222874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-814da4e6-dd4f-4e05-9aa9-368141d7e853 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:00.236820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-814da4e6-dd4f-4e05-9aa9-368141d7e853 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.239809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-814da4e6-dd4f-4e05-9aa9-368141d7e853 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.240518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-814da4e6-dd4f-4e05-9aa9-368141d7e853 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.241631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-814da4e6-dd4f-4e05-9aa9-368141d7e853 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.242350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-814da4e6-dd4f-4e05-9aa9-368141d7e853 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.243440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-814da4e6-dd4f-4e05-9aa9-368141d7e853 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.352164 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f7ff05f4-8a03-4d16-90e1-8b9900fb00f7 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.481940 Aug 27 04:55:00.352937 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 423/844] 10.222.0.58 () {60 vars in 1313 bytes} [Sat Aug 27 04:54:59 2022] PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata/os_version => generated 31 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:55:00.364045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:00.374168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:00.394916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.395454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.395899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.396680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.397146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.397670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.427599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-814da4e6-dd4f-4e05-9aa9-368141d7e853 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:00.432181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:00.441130 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-814da4e6-dd4f-4e05-9aa9-368141d7e853 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.229171 Aug 27 04:55:00.441894 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 422/845] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:00 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:00.447569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b1c05d4d-9424-49d8-9acb-01c689d19ec0 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Calling method '.version_select at 0x7fb5655db040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:00.561489 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b1c05d4d-9424-49d8-9acb-01c689d19ec0 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 58 microversion: 2.1 time: 0.118536 Aug 27 04:55:00.562353 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 423/846] 10.222.0.58 () {58 vars in 1260 bytes} [Sat Aug 27 04:55:00 2022] GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 58 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:55:00.577897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f5f443c-1ef5-4f18-b304-60252676aac5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:00.580744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0f5f443c-1ef5-4f18-b304-60252676aac5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:00.589973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f5f443c-1ef5-4f18-b304-60252676aac5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.594187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f5f443c-1ef5-4f18-b304-60252676aac5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.594187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f5f443c-1ef5-4f18-b304-60252676aac5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.594187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f5f443c-1ef5-4f18-b304-60252676aac5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.594187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f5f443c-1ef5-4f18-b304-60252676aac5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.594771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f5f443c-1ef5-4f18-b304-60252676aac5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.608937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:55:00.609642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:55:00.610513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:55:00.611325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:55:00.615706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:55:00.707033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:00.714725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.715328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.715995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.716988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.717440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.717867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.760670 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9131a160-314b-4279-8650-b20b92b2d963 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "POST /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b/action" status: 202 len: 1079 microversion: 2.47 time: 0.406325 Aug 27 04:55:00.775574 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 424/847] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 04:55:00 2022] POST /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b/action => generated 1079 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 04:55:00.782177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b4c70787-136b-4fb6-a352-c14598f56063 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Action: 'update_all', calling method: .version_select at 0x7fb565a24c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:00.794047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0f5f443c-1ef5-4f18-b304-60252676aac5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:00.819726 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f5f443c-1ef5-4f18-b304-60252676aac5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.245797 Aug 27 04:55:00.828836 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 424/848] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:00 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:00.843489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:00.844708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:00.857427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.857979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.858478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.867992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.871299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.872067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.882037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b4c70787-136b-4fb6-a352-c14598f56063 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:00.897069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b4c70787-136b-4fb6-a352-c14598f56063 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for user a3175b8c1703451fa0f5fbc163cbe4a4 and project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:00.967209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:00.986072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:00.988770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:00.990219 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fcc8e11e-322c-4d98-a5ef-1fa290989deb tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.160282 Aug 27 04:55:00.990856 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 425/849] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:00 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:01.009505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:01.010220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:01.027116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:01.031701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:01.032563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:01.033973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:01.034618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:01.035267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:01.253504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:01.264919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:01.266746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:01.268050 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3205b565-9340-4f11-825b-a98b8b950e55 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1409 microversion: 2.25 time: 0.275932 Aug 27 04:55:01.279120 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 426/850] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:00 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1409 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:01.279120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-826f1fd2-69fa-4e73-a2cf-6334ad221bad tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:01.279120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-826f1fd2-69fa-4e73-a2cf-6334ad221bad tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:01.282737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-826f1fd2-69fa-4e73-a2cf-6334ad221bad tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:01.283771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-826f1fd2-69fa-4e73-a2cf-6334ad221bad tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:01.284277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-826f1fd2-69fa-4e73-a2cf-6334ad221bad tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:01.286826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-826f1fd2-69fa-4e73-a2cf-6334ad221bad tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:01.286826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-826f1fd2-69fa-4e73-a2cf-6334ad221bad tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:01.286826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-826f1fd2-69fa-4e73-a2cf-6334ad221bad tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:01.362639 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b4c70787-136b-4fb6-a352-c14598f56063 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 61 microversion: 2.1 time: 0.585861 Aug 27 04:55:01.363774 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 425/851] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:55:00 2022] PUT /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 61 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:55:01.373925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd49c157-d5e6-48a2-a0c2-b3f91295e87c tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Action: 'create', calling method: .version_select at 0x7fb565a6a700>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:01.437683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-dd49c157-d5e6-48a2-a0c2-b3f91295e87c tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:01.444142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-dd49c157-d5e6-48a2-a0c2-b3f91295e87c tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Getting quotas for user a3175b8c1703451fa0f5fbc163cbe4a4 and project f95b489040a74201907dc9b01098c3ca. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:01.570917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-826f1fd2-69fa-4e73-a2cf-6334ad221bad tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:01.579620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-826f1fd2-69fa-4e73-a2cf-6334ad221bad tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.308957 Aug 27 04:55:01.580208 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 427/852] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:01 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:01.610394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7de2fd48-2cee-478e-9358-f8ab8960493c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:01.610640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7de2fd48-2cee-478e-9358-f8ab8960493c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:01.632178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7de2fd48-2cee-478e-9358-f8ab8960493c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:01.632613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7de2fd48-2cee-478e-9358-f8ab8960493c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:01.633064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7de2fd48-2cee-478e-9358-f8ab8960493c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:01.634320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7de2fd48-2cee-478e-9358-f8ab8960493c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:01.634781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7de2fd48-2cee-478e-9358-f8ab8960493c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:01.635248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7de2fd48-2cee-478e-9358-f8ab8960493c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:01.937335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7de2fd48-2cee-478e-9358-f8ab8960493c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:01.946383 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7de2fd48-2cee-478e-9358-f8ab8960493c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.339722 Aug 27 04:55:01.965140 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 428/853] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:01 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:01.973472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8cd28840-d1e3-4974-8ca9-608c7cf8cdfa tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:01.975733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8cd28840-d1e3-4974-8ca9-608c7cf8cdfa tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:01.987138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd28840-d1e3-4974-8ca9-608c7cf8cdfa tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:01.987637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd28840-d1e3-4974-8ca9-608c7cf8cdfa tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:01.988204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd28840-d1e3-4974-8ca9-608c7cf8cdfa tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:01.988922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd28840-d1e3-4974-8ca9-608c7cf8cdfa tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:01.989383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd28840-d1e3-4974-8ca9-608c7cf8cdfa tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:01.989809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd28840-d1e3-4974-8ca9-608c7cf8cdfa tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.042350 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd49c157-d5e6-48a2-a0c2-b3f91295e87c tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "POST /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 85 microversion: 2.1 time: 0.672595 Aug 27 04:55:02.047301 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 426/854] 10.222.0.58 () {60 vars in 1281 bytes} [Sat Aug 27 04:55:01 2022] POST /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 85 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:55:02.052378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:02.053087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:02.062264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.062768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.063261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.064046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.064506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.064937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.264331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:02.279588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:02.281982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:02.288527 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d7db86c0-1edb-4a32-9a04-51b3a3c4c303 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.239996 Aug 27 04:55:02.289412 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 427/855] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:02 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:02.306994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e85a5a10-71b4-4603-9771-4479b8857751 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] Calling method '.version_select at 0x7fb5655c6af0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:02.312399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8cd28840-d1e3-4974-8ca9-608c7cf8cdfa tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:02.322126 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8cd28840-d1e3-4974-8ca9-608c7cf8cdfa tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.355708 Aug 27 04:55:02.322880 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 429/856] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:01 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:02.394987 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e85a5a10-71b4-4603-9771-4479b8857751 tempest-ImagesMetadataTestJSON-2000792283 tempest-ImagesMetadataTestJSON-2000792283-project] 10.222.0.58 "GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata" status: 200 len: 85 microversion: 2.1 time: 0.103667 Aug 27 04:55:02.401834 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 428/857] 10.222.0.58 () {58 vars in 1260 bytes} [Sat Aug 27 04:55:02 2022] GET /compute/v2.1/images/c886736d-5088-4a70-a299-d3b89d01c6cf/metadata => generated 85 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:55:02.419605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:02.426693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:02.447323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.451771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.454343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.456019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.457959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.458632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.544650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6d02d1b2-d9a9-4064-ba28-62fb468d7705 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Calling method '.version_select at 0x7fb565585310>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:02.546861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d02d1b2-d9a9-4064-ba28-62fb468d7705 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.547650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d02d1b2-d9a9-4064-ba28-62fb468d7705 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.548103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d02d1b2-d9a9-4064-ba28-62fb468d7705 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.573546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d02d1b2-d9a9-4064-ba28-62fb468d7705 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.574353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d02d1b2-d9a9-4064-ba28-62fb468d7705 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.574803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d02d1b2-d9a9-4064-ba28-62fb468d7705 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.588281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d02d1b2-d9a9-4064-ba28-62fb468d7705 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.588833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d02d1b2-d9a9-4064-ba28-62fb468d7705 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.589278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d02d1b2-d9a9-4064-ba28-62fb468d7705 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.599063 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6d02d1b2-d9a9-4064-ba28-62fb468d7705 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.273259 Aug 27 04:55:02.600186 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 430/858] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:55:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:02.612591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-74ef2f3a-f42d-4154-9810-81ed4ca895f2 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:02.613204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-74ef2f3a-f42d-4154-9810-81ed4ca895f2 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:02.620122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74ef2f3a-f42d-4154-9810-81ed4ca895f2 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.620597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74ef2f3a-f42d-4154-9810-81ed4ca895f2 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.621030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74ef2f3a-f42d-4154-9810-81ed4ca895f2 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.621739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74ef2f3a-f42d-4154-9810-81ed4ca895f2 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.622724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74ef2f3a-f42d-4154-9810-81ed4ca895f2 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.623196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74ef2f3a-f42d-4154-9810-81ed4ca895f2 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.750020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:02.764485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:02.766767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:02.784552 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f7040b8-b6fe-4945-9b1e-49d18e7647d1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1605 microversion: 2.25 time: 0.374542 Aug 27 04:55:02.785425 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 429/859] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:02 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1605 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:02.790803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-82abdaea-9be2-4695-b347-4093e28dd25f tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Calling method '.version_select at 0x7fb5655c60d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:02.795319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82abdaea-9be2-4695-b347-4093e28dd25f tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.802280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82abdaea-9be2-4695-b347-4093e28dd25f tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.804005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82abdaea-9be2-4695-b347-4093e28dd25f tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.828754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82abdaea-9be2-4695-b347-4093e28dd25f tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.829251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82abdaea-9be2-4695-b347-4093e28dd25f tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.829962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82abdaea-9be2-4695-b347-4093e28dd25f tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.838644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-74ef2f3a-f42d-4154-9810-81ed4ca895f2 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:02.842480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82abdaea-9be2-4695-b347-4093e28dd25f tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.842974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82abdaea-9be2-4695-b347-4093e28dd25f tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.843450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82abdaea-9be2-4695-b347-4093e28dd25f tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.850388 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-82abdaea-9be2-4695-b347-4093e28dd25f tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.063241 Aug 27 04:55:02.851276 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 430/860] 10.222.0.58 () {58 vars in 1167 bytes} [Sat Aug 27 04:55:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:02.853324 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-74ef2f3a-f42d-4154-9810-81ed4ca895f2 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.251315 Aug 27 04:55:02.854072 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 431/861] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:02 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:02.857587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c585bd16-22e7-4a6f-9186-3b18c60dafa3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:02.858090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c585bd16-22e7-4a6f-9186-3b18c60dafa3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:02.869503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-91e00fa6-ca72-43d4-a67b-389a1bbac863 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Calling method '.version_select at 0x7fb5655da550>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:02.871603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91e00fa6-ca72-43d4-a67b-389a1bbac863 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.874510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91e00fa6-ca72-43d4-a67b-389a1bbac863 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.875320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91e00fa6-ca72-43d4-a67b-389a1bbac863 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.880672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c585bd16-22e7-4a6f-9186-3b18c60dafa3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.883637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c585bd16-22e7-4a6f-9186-3b18c60dafa3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.888519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c585bd16-22e7-4a6f-9186-3b18c60dafa3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.889735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c585bd16-22e7-4a6f-9186-3b18c60dafa3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.890948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c585bd16-22e7-4a6f-9186-3b18c60dafa3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.892752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c585bd16-22e7-4a6f-9186-3b18c60dafa3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.914170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91e00fa6-ca72-43d4-a67b-389a1bbac863 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.915691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91e00fa6-ca72-43d4-a67b-389a1bbac863 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.916152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91e00fa6-ca72-43d4-a67b-389a1bbac863 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.930776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91e00fa6-ca72-43d4-a67b-389a1bbac863 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.931294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91e00fa6-ca72-43d4-a67b-389a1bbac863 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.931737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91e00fa6-ca72-43d4-a67b-389a1bbac863 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.939855 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-91e00fa6-ca72-43d4-a67b-389a1bbac863 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.074129 Aug 27 04:55:02.940837 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 432/862] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:55:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:55:02.952209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-20d77aac-2c3c-4a66-8ec4-fb053a554013 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Calling method '.version_select at 0x7fb5656b09d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:02.954383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d77aac-2c3c-4a66-8ec4-fb053a554013 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.954973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d77aac-2c3c-4a66-8ec4-fb053a554013 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.955443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d77aac-2c3c-4a66-8ec4-fb053a554013 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.979847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d77aac-2c3c-4a66-8ec4-fb053a554013 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.980529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d77aac-2c3c-4a66-8ec4-fb053a554013 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.982428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d77aac-2c3c-4a66-8ec4-fb053a554013 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.992656 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-20d77aac-2c3c-4a66-8ec4-fb053a554013 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.041104 Aug 27 04:55:03.003617 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 433/863] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:55:02 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:03.008549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c58eafd6-7b35-4ea5-b6b3-39a94fd3808e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:03.009388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c58eafd6-7b35-4ea5-b6b3-39a94fd3808e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:03.017344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c58eafd6-7b35-4ea5-b6b3-39a94fd3808e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.018113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c58eafd6-7b35-4ea5-b6b3-39a94fd3808e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.018592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c58eafd6-7b35-4ea5-b6b3-39a94fd3808e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.019338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c58eafd6-7b35-4ea5-b6b3-39a94fd3808e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.019803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c58eafd6-7b35-4ea5-b6b3-39a94fd3808e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.020224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c58eafd6-7b35-4ea5-b6b3-39a94fd3808e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.036367 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c585bd16-22e7-4a6f-9186-3b18c60dafa3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.183844 Aug 27 04:55:03.045084 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 431/864] 10.222.0.58 () {60 vars in 1316 bytes} [Sat Aug 27 04:55:02 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:55:03.049360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6939a626-8a71-4bbd-8a12-964931117c99 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Calling method '.version_select at 0x7fb56611e1f0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:03.051210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6939a626-8a71-4bbd-8a12-964931117c99 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.051705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6939a626-8a71-4bbd-8a12-964931117c99 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.052147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6939a626-8a71-4bbd-8a12-964931117c99 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.074019 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6939a626-8a71-4bbd-8a12-964931117c99 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.035631 Aug 27 04:55:03.078923 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 432/865] 10.222.0.58 () {58 vars in 1179 bytes} [Sat Aug 27 04:55:03 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:03.086957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-58d3fafa-5a38-4be5-ab03-da310e3b141e tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Calling method '.version_select at 0x7fb565761d30>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:03.093262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d3fafa-5a38-4be5-ab03-da310e3b141e tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.094168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d3fafa-5a38-4be5-ab03-da310e3b141e tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.094913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d3fafa-5a38-4be5-ab03-da310e3b141e tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.114971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d3fafa-5a38-4be5-ab03-da310e3b141e tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.115510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d3fafa-5a38-4be5-ab03-da310e3b141e tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.115955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d3fafa-5a38-4be5-ab03-da310e3b141e tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.140228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d3fafa-5a38-4be5-ab03-da310e3b141e tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.140811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d3fafa-5a38-4be5-ab03-da310e3b141e tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.141473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d3fafa-5a38-4be5-ab03-da310e3b141e tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.149600 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-58d3fafa-5a38-4be5-ab03-da310e3b141e tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.066166 Aug 27 04:55:03.151210 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 433/866] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:55:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:55:03.165527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2dc556c9-ba25-4ffc-8ea0-abbe26020be8 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Calling method '.version_select at 0x7fb565ce30d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:03.167698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dc556c9-ba25-4ffc-8ea0-abbe26020be8 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.168226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dc556c9-ba25-4ffc-8ea0-abbe26020be8 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.168683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dc556c9-ba25-4ffc-8ea0-abbe26020be8 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.186178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dc556c9-ba25-4ffc-8ea0-abbe26020be8 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.192114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dc556c9-ba25-4ffc-8ea0-abbe26020be8 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.192850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dc556c9-ba25-4ffc-8ea0-abbe26020be8 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.216901 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2dc556c9-ba25-4ffc-8ea0-abbe26020be8 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.055952 Aug 27 04:55:03.229048 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 434/867] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:55:03 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:03.243004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d7b0f23-b790-4cb9-ab62-56c8d5c2d1b9 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Calling method '.version_select at 0x7fb5656954c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:03.247883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f23-b790-4cb9-ab62-56c8d5c2d1b9 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.248371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f23-b790-4cb9-ab62-56c8d5c2d1b9 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.251430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f23-b790-4cb9-ab62-56c8d5c2d1b9 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.272402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:03.283637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f23-b790-4cb9-ab62-56c8d5c2d1b9 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.284136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f23-b790-4cb9-ab62-56c8d5c2d1b9 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.284582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f23-b790-4cb9-ab62-56c8d5c2d1b9 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.290904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c58eafd6-7b35-4ea5-b6b3-39a94fd3808e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:03.292032 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d7b0f23-b790-4cb9-ab62-56c8d5c2d1b9 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.055789 Aug 27 04:55:03.292983 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 435/868] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:55:03 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:03.312249 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c58eafd6-7b35-4ea5-b6b3-39a94fd3808e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.306915 Aug 27 04:55:03.312855 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 434/869] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:03 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:03.317538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:03.318111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:03.326898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eb5cd81e-10e3-4353-a328-a57fbd200f56 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Calling method '.version_select at 0x7fb565a243a0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:03.328527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb5cd81e-10e3-4353-a328-a57fbd200f56 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.329013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb5cd81e-10e3-4353-a328-a57fbd200f56 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.329450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb5cd81e-10e3-4353-a328-a57fbd200f56 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.349621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.350121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.350600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.351314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.351772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.359500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.364626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb5cd81e-10e3-4353-a328-a57fbd200f56 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.366978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb5cd81e-10e3-4353-a328-a57fbd200f56 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.367575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb5cd81e-10e3-4353-a328-a57fbd200f56 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.406087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb5cd81e-10e3-4353-a328-a57fbd200f56 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.407003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb5cd81e-10e3-4353-a328-a57fbd200f56 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.407702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb5cd81e-10e3-4353-a328-a57fbd200f56 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.456361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:03.473065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:03.474999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:03.476619 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2336dc6d-4edd-4392-8b73-8680df402b3b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.162761 Aug 27 04:55:03.478043 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 435/870] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:03 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:03.483029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a19730bb-ad6a-4862-83e4-026fc084b8b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:03.483856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a19730bb-ad6a-4862-83e4-026fc084b8b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:03.499225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a19730bb-ad6a-4862-83e4-026fc084b8b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.500515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a19730bb-ad6a-4862-83e4-026fc084b8b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.500976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a19730bb-ad6a-4862-83e4-026fc084b8b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.502137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a19730bb-ad6a-4862-83e4-026fc084b8b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.502838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a19730bb-ad6a-4862-83e4-026fc084b8b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.503326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a19730bb-ad6a-4862-83e4-026fc084b8b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.719752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a19730bb-ad6a-4862-83e4-026fc084b8b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:03.729809 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a19730bb-ad6a-4862-83e4-026fc084b8b4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.250668 Aug 27 04:55:03.731203 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 436/871] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:03 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:03.880701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d2574fe6-c8b5-47c4-8f41-e203307e96d6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:03.881739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d2574fe6-c8b5-47c4-8f41-e203307e96d6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:03.893553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2574fe6-c8b5-47c4-8f41-e203307e96d6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.894612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2574fe6-c8b5-47c4-8f41-e203307e96d6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.895058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2574fe6-c8b5-47c4-8f41-e203307e96d6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.896806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2574fe6-c8b5-47c4-8f41-e203307e96d6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.897572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2574fe6-c8b5-47c4-8f41-e203307e96d6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.898165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2574fe6-c8b5-47c4-8f41-e203307e96d6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:04.072746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d2574fe6-c8b5-47c4-8f41-e203307e96d6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:04.089387 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d2574fe6-c8b5-47c4-8f41-e203307e96d6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.210439 Aug 27 04:55:04.090425 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 437/872] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:03 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:04.333921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a3a6e9a-2912-46a0-bf45-81653de1346a tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:04.334600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a3a6e9a-2912-46a0-bf45-81653de1346a tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:04.341409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3a6e9a-2912-46a0-bf45-81653de1346a tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:04.342317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3a6e9a-2912-46a0-bf45-81653de1346a tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:04.342317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3a6e9a-2912-46a0-bf45-81653de1346a tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:04.343237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3a6e9a-2912-46a0-bf45-81653de1346a tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:04.343695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3a6e9a-2912-46a0-bf45-81653de1346a tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:04.344128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3a6e9a-2912-46a0-bf45-81653de1346a tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:04.367327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:04.556263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a3a6e9a-2912-46a0-bf45-81653de1346a tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:04.568839 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a3a6e9a-2912-46a0-bf45-81653de1346a tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.238698 Aug 27 04:55:04.569718 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 438/873] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:04 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:04.574475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:04.575498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:04.581818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:04.582412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:04.583107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:04.585028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:04.585565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:04.586102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:04.663045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:04.672778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:04.674630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:04.675430 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-57e4e2fa-7ead-42cd-b3d2-38f2a6507137 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.104948 Aug 27 04:55:04.676435 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 439/874] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:04 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:04.754174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-122ab042-839c-4757-a169-b3793f6ab3a3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:04.754790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-122ab042-839c-4757-a169-b3793f6ab3a3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:04.762581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-122ab042-839c-4757-a169-b3793f6ab3a3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:04.763074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-122ab042-839c-4757-a169-b3793f6ab3a3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:04.763584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-122ab042-839c-4757-a169-b3793f6ab3a3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:04.765166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-122ab042-839c-4757-a169-b3793f6ab3a3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:04.765631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-122ab042-839c-4757-a169-b3793f6ab3a3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:04.766066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-122ab042-839c-4757-a169-b3793f6ab3a3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:04.967348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-122ab042-839c-4757-a169-b3793f6ab3a3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:04.972066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:04.990963 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-122ab042-839c-4757-a169-b3793f6ab3a3 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.238809 Aug 27 04:55:04.992236 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 440/875] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:04 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:05.027997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-58e17da8-62fc-4046-bd8d-7b811c4803f7 req-4901ec4d-dbcb-4b76-9efb-aa4bae05c798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c927e5-5b82-4fd6-8538-fe5456c92f9f", "tag": "e042543b-f075-4259-b806-252f41c2843b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:05.040135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-58e17da8-62fc-4046-bd8d-7b811c4803f7 req-4901ec4d-dbcb-4b76-9efb-aa4bae05c798 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:05.040702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-58e17da8-62fc-4046-bd8d-7b811c4803f7 req-4901ec4d-dbcb-4b76-9efb-aa4bae05c798 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:05.041211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-58e17da8-62fc-4046-bd8d-7b811c4803f7 req-4901ec4d-dbcb-4b76-9efb-aa4bae05c798 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:05.061099 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-58e17da8-62fc-4046-bd8d-7b811c4803f7 req-4901ec4d-dbcb-4b76-9efb-aa4bae05c798 service nova] Creating event network-changed:e042543b-f075-4259-b806-252f41c2843b for instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f on n-h1-820368-35 Aug 27 04:55:05.068402 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-58e17da8-62fc-4046-bd8d-7b811c4803f7 req-4901ec4d-dbcb-4b76-9efb-aa4bae05c798 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043964 Aug 27 04:55:05.069701 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 441/876] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:55:05.114982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3aea2cdb-7e09-4736-9727-cd0cde7725b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:05.116760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3aea2cdb-7e09-4736-9727-cd0cde7725b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:05.124204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3aea2cdb-7e09-4736-9727-cd0cde7725b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:05.124896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3aea2cdb-7e09-4736-9727-cd0cde7725b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:05.125567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3aea2cdb-7e09-4736-9727-cd0cde7725b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:05.127469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3aea2cdb-7e09-4736-9727-cd0cde7725b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:05.128081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3aea2cdb-7e09-4736-9727-cd0cde7725b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:05.128712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3aea2cdb-7e09-4736-9727-cd0cde7725b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:05.309404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3aea2cdb-7e09-4736-9727-cd0cde7725b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:05.323544 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3aea2cdb-7e09-4736-9727-cd0cde7725b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.217090 Aug 27 04:55:05.324931 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 442/877] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:05 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:05.557111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e4239430-340e-4563-90ef-8324d5457d10 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Calling method '.version_select at 0x7fb56580db80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:05.579818 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e4239430-340e-4563-90ef-8324d5457d10 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] HTTP exception thrown: Image not found. Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e4239430-340e-4563-90ef-8324d5457d10 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Request method failure captured: Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/images/9868d0ac-cbb6-4c43-b345-a6deff07b7fd/metadata/os_distro HTTP/1.1 Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaOpEqs4qXurZD_f2XcBMLg0HTEFJ17ZcwcpYjFlGVqrp1xgUTgr35xfNnExG7thuIbxDU5DOhkxRp75vhpiRb5t8-YXQEl9SHTEttdVgduCSg2ajVfP2laOJctglrR7QFD3MmuL_jmDs2sVRoSwcFVpCpezJyu0VdTqIADJ7r2BNOo Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:05.589214 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_abe2e6c8b0bb4abfb227c987e0f72bce", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 4e8a8cffb79e41a8a70aa64a07b6a8b3 Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: exception: Image not found. Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'image_id': '9868d0ac-cbb6-4c43-b345-a6deff07b7fd', 'id': 'os_distro'} Aug 27 04:55:05.590642 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:05.591547 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9868d0ac-cbb6-4c43-b345-a6deff07b7fd Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:05.592688 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9868d0ac-cbb6-4c43-b345-a6deff07b7fd could not be found. Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:55:05.593891 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.595054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e4239430-340e-4563-90ef-8324d5457d10 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Returning 404 to user: Image not found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:05.599354 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e4239430-340e-4563-90ef-8324d5457d10 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] 10.222.0.58 "DELETE /compute/v2.1/images/9868d0ac-cbb6-4c43-b345-a6deff07b7fd/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.167757 Aug 27 04:55:05.599354 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 443/878] 10.222.0.58 () {58 vars in 1293 bytes} [Sat Aug 27 04:55:05 2022] DELETE /compute/v2.1/images/9868d0ac-cbb6-4c43-b345-a6deff07b7fd/metadata/os_distro => generated 62 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:55:05.603389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bafbac80-d9c0-4200-ab1b-9d7cc6d71f01 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:05.604025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bafbac80-d9c0-4200-ab1b-9d7cc6d71f01 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:05.613566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bafbac80-d9c0-4200-ab1b-9d7cc6d71f01 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:05.614057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bafbac80-d9c0-4200-ab1b-9d7cc6d71f01 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:05.614501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bafbac80-d9c0-4200-ab1b-9d7cc6d71f01 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:05.615225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bafbac80-d9c0-4200-ab1b-9d7cc6d71f01 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:05.616910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bafbac80-d9c0-4200-ab1b-9d7cc6d71f01 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:05.617345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bafbac80-d9c0-4200-ab1b-9d7cc6d71f01 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:05.757848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bafbac80-d9c0-4200-ab1b-9d7cc6d71f01 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:05.765888 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bafbac80-d9c0-4200-ab1b-9d7cc6d71f01 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.166830 Aug 27 04:55:05.766533 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 444/879] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:05 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:05.771449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-347b6df8-73c7-49b2-a75c-b3593cce9d65 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Calling method '.version_select at 0x7fb5656b0670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:05.800227 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-347b6df8-73c7-49b2-a75c-b3593cce9d65 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] HTTP exception thrown: Image not found. Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-347b6df8-73c7-49b2-a75c-b3593cce9d65 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Request method failure captured: Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/images/de87fbf5-d86f-4f5e-996b-f95f7795f6ad/metadata/os_version HTTP/1.1 Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaOpEqs4qXurZD_f2XcBMLg0HTEFJ17ZcwcpYjFlGVqrp1xgUTgr35xfNnExG7thuIbxDU5DOhkxRp75vhpiRb5t8-YXQEl9SHTEttdVgduCSg2ajVfP2laOJctglrR7QFD3MmuL_jmDs2sVRoSwcFVpCpezJyu0VdTqIADJ7r2BNOo Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:05.802480 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_abe2e6c8b0bb4abfb227c987e0f72bce", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 4e8a8cffb79e41a8a70aa64a07b6a8b3 Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: exception: Image not found. Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'image_id': 'de87fbf5-d86f-4f5e-996b-f95f7795f6ad', 'id': 'os_version'} Aug 27 04:55:05.803972 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:05.804790 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID de87fbf5-d86f-4f5e-996b-f95f7795f6ad Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:05.805915 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image de87fbf5-d86f-4f5e-996b-f95f7795f6ad could not be found. Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:55:05.807241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.808393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-347b6df8-73c7-49b2-a75c-b3593cce9d65 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Returning 404 to user: Image not found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:05.809600 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-347b6df8-73c7-49b2-a75c-b3593cce9d65 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] 10.222.0.58 "GET /compute/v2.1/images/de87fbf5-d86f-4f5e-996b-f95f7795f6ad/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.036253 Aug 27 04:55:05.809600 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 445/880] 10.222.0.58 () {58 vars in 1293 bytes} [Sat Aug 27 04:55:05 2022] GET /compute/v2.1/images/de87fbf5-d86f-4f5e-996b-f95f7795f6ad/metadata/os_version => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:55:05.810988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:05.811623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:05.815383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:05.821122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:05.821619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:05.822053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:05.822769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:05.823245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:05.823772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:05.889917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:05.898580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:05.900635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:05.901795 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6a13d946-c26d-4013-ad65-3e8a5641d0ab tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.096493 Aug 27 04:55:05.902375 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 446/881] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:05 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:05.909828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dbc47d21-28ef-49f0-80d7-97713817fd7f tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Calling method '.version_select at 0x7fb5653694c0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:05.930455 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-dbc47d21-28ef-49f0-80d7-97713817fd7f tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] HTTP exception thrown: Image not found. Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dbc47d21-28ef-49f0-80d7-97713817fd7f tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Request method failure captured: Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/images/d702e36d-985d-4402-8364-5cacdb0468e3/metadata HTTP/1.1 Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaOpEqs4qXurZD_f2XcBMLg0HTEFJ17ZcwcpYjFlGVqrp1xgUTgr35xfNnExG7thuIbxDU5DOhkxRp75vhpiRb5t8-YXQEl9SHTEttdVgduCSg2ajVfP2laOJctglrR7QFD3MmuL_jmDs2sVRoSwcFVpCpezJyu0VdTqIADJ7r2BNOo Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:05.932577 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_abe2e6c8b0bb4abfb227c987e0f72bce", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 4e8a8cffb79e41a8a70aa64a07b6a8b3 Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: exception: Image not found. Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'image_id': 'd702e36d-985d-4402-8364-5cacdb0468e3'} Aug 27 04:55:05.933992 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:05.934911 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d702e36d-985d-4402-8364-5cacdb0468e3 Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:05.935995 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d702e36d-985d-4402-8364-5cacdb0468e3 could not be found. Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:55:05.937143 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.938383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dbc47d21-28ef-49f0-80d7-97713817fd7f tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Returning 404 to user: Image not found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:05.939571 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dbc47d21-28ef-49f0-80d7-97713817fd7f tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] 10.222.0.58 "GET /compute/v2.1/images/d702e36d-985d-4402-8364-5cacdb0468e3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.030609 Aug 27 04:55:05.939571 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 447/882] 10.222.0.58 () {58 vars in 1260 bytes} [Sat Aug 27 04:55:05 2022] GET /compute/v2.1/images/d702e36d-985d-4402-8364-5cacdb0468e3/metadata => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:55:05.943992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8575bf60-bf5b-4594-809e-08f511a6d54b tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Action: 'update_all', calling method: .version_select at 0x7fb5655c2a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:05.968477 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-8575bf60-bf5b-4594-809e-08f511a6d54b tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] HTTP exception thrown: Image not found. Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8575bf60-bf5b-4594-809e-08f511a6d54b tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Request method failure captured: Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: request: PUT /compute/v2.1/images/288f9870-9ba6-4752-8ea7-f0229d5f53b1/metadata HTTP/1.1 Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 57 Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaOpEqs4qXurZD_f2XcBMLg0HTEFJ17ZcwcpYjFlGVqrp1xgUTgr35xfNnExG7thuIbxDU5DOhkxRp75vhpiRb5t8-YXQEl9SHTEttdVgduCSg2ajVfP2laOJctglrR7QFD3MmuL_jmDs2sVRoSwcFVpCpezJyu0VdTqIADJ7r2BNOo Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:05.970555 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_abe2e6c8b0bb4abfb227c987e0f72bce", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 4e8a8cffb79e41a8a70aa64a07b6a8b3 Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:55:05.971993 n-d-820368-35 devstack@n-api.service[128547]: exception: Image not found. Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'image_id': '288f9870-9ba6-4752-8ea7-f0229d5f53b1', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:05.972818 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 288f9870-9ba6-4752-8ea7-f0229d5f53b1 Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:05.973907 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 288f9870-9ba6-4752-8ea7-f0229d5f53b1 could not be found. Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:05.975122 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:55:05.976273 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:05.978154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8575bf60-bf5b-4594-809e-08f511a6d54b tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Returning 404 to user: Image not found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:05.978154 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8575bf60-bf5b-4594-809e-08f511a6d54b tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] 10.222.0.58 "PUT /compute/v2.1/images/288f9870-9ba6-4752-8ea7-f0229d5f53b1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031850 Aug 27 04:55:05.978154 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 448/883] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:55:05 2022] PUT /compute/v2.1/images/288f9870-9ba6-4752-8ea7-f0229d5f53b1/metadata => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:55:05.982606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ccbc3d26-bdd5-4cb2-b557-0adbd2430701 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Action: 'update', calling method: .version_select at 0x7fb5655c29d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:06.004991 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-ccbc3d26-bdd5-4cb2-b557-0adbd2430701 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] HTTP exception thrown: Image not found. Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ccbc3d26-bdd5-4cb2-b557-0adbd2430701 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Request method failure captured: Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: request: PUT /compute/v2.1/images/44badcc0-b0b4-487c-8920-3d0703a277be/metadata/os_distro HTTP/1.1 Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 30 Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaOpEqs4qXurZD_f2XcBMLg0HTEFJ17ZcwcpYjFlGVqrp1xgUTgr35xfNnExG7thuIbxDU5DOhkxRp75vhpiRb5t8-YXQEl9SHTEttdVgduCSg2ajVfP2laOJctglrR7QFD3MmuL_jmDs2sVRoSwcFVpCpezJyu0VdTqIADJ7r2BNOo Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:06.007129 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_abe2e6c8b0bb4abfb227c987e0f72bce", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 4e8a8cffb79e41a8a70aa64a07b6a8b3 Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: {"meta": {"os_distro": "alt"}} Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: exception: Image not found. Aug 27 04:55:06.008507 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'image_id': '44badcc0-b0b4-487c-8920-3d0703a277be', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:06.009364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 44badcc0-b0b4-487c-8920-3d0703a277be Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:06.010405 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 44badcc0-b0b4-487c-8920-3d0703a277be could not be found. Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:06.011558 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:55:06.012698 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.013913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ccbc3d26-bdd5-4cb2-b557-0adbd2430701 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Returning 404 to user: Image not found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:06.013913 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ccbc3d26-bdd5-4cb2-b557-0adbd2430701 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] 10.222.0.58 "PUT /compute/v2.1/images/44badcc0-b0b4-487c-8920-3d0703a277be/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.030072 Aug 27 04:55:06.013913 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 449/884] 10.222.0.58 () {60 vars in 1310 bytes} [Sat Aug 27 04:55:05 2022] PUT /compute/v2.1/images/44badcc0-b0b4-487c-8920-3d0703a277be/metadata/os_distro => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:55:06.016808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e275beed-39c0-4840-9f6c-cc12e6f59c4b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:06.017400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e275beed-39c0-4840-9f6c-cc12e6f59c4b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:06.030063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e275beed-39c0-4840-9f6c-cc12e6f59c4b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:06.030554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e275beed-39c0-4840-9f6c-cc12e6f59c4b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:06.030999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e275beed-39c0-4840-9f6c-cc12e6f59c4b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:06.031808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e275beed-39c0-4840-9f6c-cc12e6f59c4b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:06.032264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e275beed-39c0-4840-9f6c-cc12e6f59c4b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:06.032688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e275beed-39c0-4840-9f6c-cc12e6f59c4b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:06.165257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e275beed-39c0-4840-9f6c-cc12e6f59c4b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:06.174668 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e275beed-39c0-4840-9f6c-cc12e6f59c4b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.163353 Aug 27 04:55:06.175272 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 450/885] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:06 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:06.180398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82267aa7-e475-47c2-a22a-1888b3a62937 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Action: 'create', calling method: .version_select at 0x7fb5653694c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:06.203607 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-82267aa7-e475-47c2-a22a-1888b3a62937 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] HTTP exception thrown: Image not found. Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82267aa7-e475-47c2-a22a-1888b3a62937 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Request method failure captured: Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/images/f02885ac-48ae-45ce-a8c5-ea1f7d445511/metadata HTTP/1.1 Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 57 Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaOpEqs4qXurZD_f2XcBMLg0HTEFJ17ZcwcpYjFlGVqrp1xgUTgr35xfNnExG7thuIbxDU5DOhkxRp75vhpiRb5t8-YXQEl9SHTEttdVgduCSg2ajVfP2laOJctglrR7QFD3MmuL_jmDs2sVRoSwcFVpCpezJyu0VdTqIADJ7r2BNOo Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:06.205714 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_abe2e6c8b0bb4abfb227c987e0f72bce", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/abe2e6c8b0bb4abfb227c987e0f72bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: abe2e6c8b0bb4abfb227c987e0f72bce Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883 Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 4e8a8cffb79e41a8a70aa64a07b6a8b3 Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1188977883-project Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: exception: Image not found. Aug 27 04:55:06.207213 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'image_id': 'f02885ac-48ae-45ce-a8c5-ea1f7d445511', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:06.208332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f02885ac-48ae-45ce-a8c5-ea1f7d445511 Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:55:06.209703 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f02885ac-48ae-45ce-a8c5-ea1f7d445511 could not be found. Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:06.211145 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:55:06.213272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:06.214776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82267aa7-e475-47c2-a22a-1888b3a62937 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] Returning 404 to user: Image not found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:06.214776 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-82267aa7-e475-47c2-a22a-1888b3a62937 tempest-ImagesMetadataNegativeTestJSON-1188977883 tempest-ImagesMetadataNegativeTestJSON-1188977883-project] 10.222.0.58 "POST /compute/v2.1/images/f02885ac-48ae-45ce-a8c5-ea1f7d445511/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031117 Aug 27 04:55:06.214776 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 451/886] 10.222.0.58 () {60 vars in 1281 bytes} [Sat Aug 27 04:55:06 2022] POST /compute/v2.1/images/f02885ac-48ae-45ce-a8c5-ea1f7d445511/metadata => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:55:06.342974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=13 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:06.348839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b8ff435-9cf0-4fe8-badd-0b797639da38 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:06.349486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6b8ff435-9cf0-4fe8-badd-0b797639da38 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:06.357502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8ff435-9cf0-4fe8-badd-0b797639da38 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:06.358016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8ff435-9cf0-4fe8-badd-0b797639da38 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:06.358495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8ff435-9cf0-4fe8-badd-0b797639da38 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:06.359277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8ff435-9cf0-4fe8-badd-0b797639da38 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:06.359771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8ff435-9cf0-4fe8-badd-0b797639da38 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:06.360201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8ff435-9cf0-4fe8-badd-0b797639da38 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:06.497140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6b8ff435-9cf0-4fe8-badd-0b797639da38 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:06.505856 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b8ff435-9cf0-4fe8-badd-0b797639da38 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.163542 Aug 27 04:55:06.506418 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 452/887] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:06 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:06.787948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5e83121f-9b58-4f43-a00c-709bec4b9191 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:06.788544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5e83121f-9b58-4f43-a00c-709bec4b9191 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:06.794533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e83121f-9b58-4f43-a00c-709bec4b9191 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:06.795028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e83121f-9b58-4f43-a00c-709bec4b9191 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:06.795827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e83121f-9b58-4f43-a00c-709bec4b9191 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:06.796583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e83121f-9b58-4f43-a00c-709bec4b9191 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:06.797074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e83121f-9b58-4f43-a00c-709bec4b9191 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:06.797788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e83121f-9b58-4f43-a00c-709bec4b9191 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:06.944029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5e83121f-9b58-4f43-a00c-709bec4b9191 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:06.951755 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5e83121f-9b58-4f43-a00c-709bec4b9191 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.167644 Aug 27 04:55:06.952548 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 453/888] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:06 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:06.957498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:06.958296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:06.964233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:06.964795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:06.965240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:06.965930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:06.966384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:06.966803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:07.033729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:07.042398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:07.043850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:07.044999 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0d60f066-d466-4541-8e48-bf93b68cbbd4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.091280 Aug 27 04:55:07.045553 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 454/889] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:06 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:07.195945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8097d7b7-081d-44da-8619-96c170bf4d3d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:07.196549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8097d7b7-081d-44da-8619-96c170bf4d3d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:07.202265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8097d7b7-081d-44da-8619-96c170bf4d3d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:07.202749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8097d7b7-081d-44da-8619-96c170bf4d3d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:07.203223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8097d7b7-081d-44da-8619-96c170bf4d3d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:07.203909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8097d7b7-081d-44da-8619-96c170bf4d3d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:07.204354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8097d7b7-081d-44da-8619-96c170bf4d3d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:07.204772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8097d7b7-081d-44da-8619-96c170bf4d3d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:07.331238 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eb5cd81e-10e3-4353-a328-a57fbd200f56 tempest-HypervisorAdminTestJSON-1997257524 tempest-HypervisorAdminTestJSON-1997257524-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 4.019143 Aug 27 04:55:07.336918 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 436/890] 10.222.0.58 () {58 vars in 1173 bytes} [Sat Aug 27 04:55:03 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 4025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:07.383855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8097d7b7-081d-44da-8619-96c170bf4d3d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:07.392371 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8097d7b7-081d-44da-8619-96c170bf4d3d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.200268 Aug 27 04:55:07.393998 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 455/891] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:07 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:07.532006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1a0c0d0-f327-4249-92a2-6c9c3dda51d1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:07.533656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a1a0c0d0-f327-4249-92a2-6c9c3dda51d1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:07.561876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a0c0d0-f327-4249-92a2-6c9c3dda51d1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:07.562414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a0c0d0-f327-4249-92a2-6c9c3dda51d1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:07.563943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a0c0d0-f327-4249-92a2-6c9c3dda51d1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:07.564988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a0c0d0-f327-4249-92a2-6c9c3dda51d1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:07.565534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a0c0d0-f327-4249-92a2-6c9c3dda51d1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:07.565960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a0c0d0-f327-4249-92a2-6c9c3dda51d1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:07.866157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a1a0c0d0-f327-4249-92a2-6c9c3dda51d1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:07.874038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:07.878652 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a1a0c0d0-f327-4249-92a2-6c9c3dda51d1 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.353715 Aug 27 04:55:07.879760 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 437/892] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:07 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:07.973449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fde4763c-beaa-4c7a-82b4-6d0a63d93f0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:07.974070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fde4763c-beaa-4c7a-82b4-6d0a63d93f0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:07.980261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fde4763c-beaa-4c7a-82b4-6d0a63d93f0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:07.980982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fde4763c-beaa-4c7a-82b4-6d0a63d93f0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:07.981600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fde4763c-beaa-4c7a-82b4-6d0a63d93f0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:07.982489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fde4763c-beaa-4c7a-82b4-6d0a63d93f0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:07.983125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fde4763c-beaa-4c7a-82b4-6d0a63d93f0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:07.983712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fde4763c-beaa-4c7a-82b4-6d0a63d93f0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:08.072330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:08.073414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:08.081113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:08.081904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:08.082550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:08.083778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:08.084423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:08.084858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:08.193500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:08.202373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:08.203855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:08.205032 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f71d1948-114c-4763-84d8-a25b7d30d29b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.140491 Aug 27 04:55:08.205618 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 438/893] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:08 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:08.291529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fde4763c-beaa-4c7a-82b4-6d0a63d93f0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:08.303183 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fde4763c-beaa-4c7a-82b4-6d0a63d93f0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.333908 Aug 27 04:55:08.316339 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 456/894] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:07 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:08.357765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-a0c7f4d4-3845-4888-b715-ad23e25d928c req-551f9e87-7260-4e4b-8c9c-c2b66f3089ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ea01df-9498-452f-b285-a3c01aa2fcae", "tag": "05c43341-73e9-4a72-9a96-baad1ae0699a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:08.378511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a0c7f4d4-3845-4888-b715-ad23e25d928c req-551f9e87-7260-4e4b-8c9c-c2b66f3089ca service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:08.379466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a0c7f4d4-3845-4888-b715-ad23e25d928c req-551f9e87-7260-4e4b-8c9c-c2b66f3089ca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:08.380127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a0c7f4d4-3845-4888-b715-ad23e25d928c req-551f9e87-7260-4e4b-8c9c-c2b66f3089ca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:08.393268 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-a0c7f4d4-3845-4888-b715-ad23e25d928c req-551f9e87-7260-4e4b-8c9c-c2b66f3089ca service nova] Creating event network-changed:05c43341-73e9-4a72-9a96-baad1ae0699a for instance 87ea01df-9498-452f-b285-a3c01aa2fcae on n-h2-820368-35 Aug 27 04:55:08.398915 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-a0c7f4d4-3845-4888-b715-ad23e25d928c req-551f9e87-7260-4e4b-8c9c-c2b66f3089ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044897 Aug 27 04:55:08.400269 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 439/895] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:08.414984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c84bb828-ec5d-4c2a-bbd3-89a38f41808a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:08.415868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c84bb828-ec5d-4c2a-bbd3-89a38f41808a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:08.426526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84bb828-ec5d-4c2a-bbd3-89a38f41808a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:08.427175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84bb828-ec5d-4c2a-bbd3-89a38f41808a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:08.428043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84bb828-ec5d-4c2a-bbd3-89a38f41808a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:08.429001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84bb828-ec5d-4c2a-bbd3-89a38f41808a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:08.429706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84bb828-ec5d-4c2a-bbd3-89a38f41808a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:08.430912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84bb828-ec5d-4c2a-bbd3-89a38f41808a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:08.579328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c84bb828-ec5d-4c2a-bbd3-89a38f41808a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:08.587043 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c84bb828-ec5d-4c2a-bbd3-89a38f41808a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.177125 Aug 27 04:55:08.587641 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 457/896] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:08 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:08.903544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-018945b9-c142-47c6-9383-f81cc5e38269 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:08.904288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-018945b9-c142-47c6-9383-f81cc5e38269 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:08.917483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-018945b9-c142-47c6-9383-f81cc5e38269 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:08.918001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-018945b9-c142-47c6-9383-f81cc5e38269 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:08.918441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-018945b9-c142-47c6-9383-f81cc5e38269 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:08.919227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-018945b9-c142-47c6-9383-f81cc5e38269 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:08.919688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-018945b9-c142-47c6-9383-f81cc5e38269 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:08.920149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-018945b9-c142-47c6-9383-f81cc5e38269 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:09.062280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-018945b9-c142-47c6-9383-f81cc5e38269 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:09.073200 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-018945b9-c142-47c6-9383-f81cc5e38269 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.175606 Aug 27 04:55:09.073899 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 440/897] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:08 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:09.228383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:09.229667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:09.239246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:09.239910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:09.240570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:09.241563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:09.242174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:09.242785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:09.326242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aec42259-9262-4162-95ba-d4a0b9283a5d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:09.326867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aec42259-9262-4162-95ba-d4a0b9283a5d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:09.338069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec42259-9262-4162-95ba-d4a0b9283a5d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:09.338754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec42259-9262-4162-95ba-d4a0b9283a5d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:09.339380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec42259-9262-4162-95ba-d4a0b9283a5d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:09.343639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec42259-9262-4162-95ba-d4a0b9283a5d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:09.344453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec42259-9262-4162-95ba-d4a0b9283a5d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:09.345048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec42259-9262-4162-95ba-d4a0b9283a5d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:09.401177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:09.405208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:09.419949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:09.421405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:09.422595 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9dba3343-6af0-45d6-8205-552fbef63d31 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.198279 Aug 27 04:55:09.438424 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 458/898] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:09 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:09.573728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aec42259-9262-4162-95ba-d4a0b9283a5d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:09.582974 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aec42259-9262-4162-95ba-d4a0b9283a5d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1322 microversion: 2.1 time: 0.260267 Aug 27 04:55:09.583798 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 441/899] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:09 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:09.609195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1bdb2f41-c201-45d6-8190-735d30c3c3d7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:09.610198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1bdb2f41-c201-45d6-8190-735d30c3c3d7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:09.618769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bdb2f41-c201-45d6-8190-735d30c3c3d7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:09.619581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bdb2f41-c201-45d6-8190-735d30c3c3d7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:09.620330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bdb2f41-c201-45d6-8190-735d30c3c3d7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:09.621212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bdb2f41-c201-45d6-8190-735d30c3c3d7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:09.621904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bdb2f41-c201-45d6-8190-735d30c3c3d7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:09.622610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bdb2f41-c201-45d6-8190-735d30c3c3d7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:09.676090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c25c1c26-35ce-4b0a-972a-5ed129500b7f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565496040>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:09.733766 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c25c1c26-35ce-4b0a-972a-5ed129500b7f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/58616362-f7e6-4be6-875e-c4c3cd4cf72b" status: 200 len: 661 microversion: 2.1 time: 0.061590 Aug 27 04:55:09.739690 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 442/900] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:09 2022] GET /compute/v2.1/images/58616362-f7e6-4be6-875e-c4c3cd4cf72b => generated 661 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:09.760480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af758df4-c573-4348-b6fe-53f4714a8e4a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5655d6040>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:09.817316 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af758df4-c573-4348-b6fe-53f4714a8e4a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/58616362-f7e6-4be6-875e-c4c3cd4cf72b" status: 200 len: 661 microversion: 2.1 time: 0.068524 Aug 27 04:55:09.817664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1bdb2f41-c201-45d6-8190-735d30c3c3d7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:09.817891 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 443/901] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:09 2022] GET /compute/v2.1/images/58616362-f7e6-4be6-875e-c4c3cd4cf72b => generated 661 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:09.826481 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1bdb2f41-c201-45d6-8190-735d30c3c3d7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.222318 Aug 27 04:55:09.832355 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 459/902] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:09 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:10.095042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f47f1e0-a971-401e-b590-653c022e4426 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:10.095683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f47f1e0-a971-401e-b590-653c022e4426 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:10.102657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47f1e0-a971-401e-b590-653c022e4426 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.103180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47f1e0-a971-401e-b590-653c022e4426 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.103618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47f1e0-a971-401e-b590-653c022e4426 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.104324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47f1e0-a971-401e-b590-653c022e4426 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.104782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47f1e0-a971-401e-b590-653c022e4426 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.105206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47f1e0-a971-401e-b590-653c022e4426 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.238256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f47f1e0-a971-401e-b590-653c022e4426 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:10.246955 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f47f1e0-a971-401e-b590-653c022e4426 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.156240 Aug 27 04:55:10.247596 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 444/903] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:10 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:10.445411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:10.446059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:10.452467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.452952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.453387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.454094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.454549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.454976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.526401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:10.534431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:10.535900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:10.537045 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-54adb2ad-10a6-47ea-a342-12f480ed427e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.095548 Aug 27 04:55:10.537605 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 460/904] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:10 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:10.604132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-365e8d49-93f0-491c-b35b-b631898cf880 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:10.604746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-365e8d49-93f0-491c-b35b-b631898cf880 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:10.610586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-365e8d49-93f0-491c-b35b-b631898cf880 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.611068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-365e8d49-93f0-491c-b35b-b631898cf880 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.611615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-365e8d49-93f0-491c-b35b-b631898cf880 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.612292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-365e8d49-93f0-491c-b35b-b631898cf880 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.612752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-365e8d49-93f0-491c-b35b-b631898cf880 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.613174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-365e8d49-93f0-491c-b35b-b631898cf880 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.702208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f68c5de5-d8d1-418b-b669-5427f606a435 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Calling method '.version_select at 0x7fb5654130d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:10.704027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f68c5de5-d8d1-418b-b669-5427f606a435 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.704542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f68c5de5-d8d1-418b-b669-5427f606a435 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.704976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f68c5de5-d8d1-418b-b669-5427f606a435 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.722471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f68c5de5-d8d1-418b-b669-5427f606a435 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.722973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f68c5de5-d8d1-418b-b669-5427f606a435 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.723449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f68c5de5-d8d1-418b-b669-5427f606a435 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.733827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f68c5de5-d8d1-418b-b669-5427f606a435 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.734310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f68c5de5-d8d1-418b-b669-5427f606a435 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.734747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f68c5de5-d8d1-418b-b669-5427f606a435 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.740741 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f68c5de5-d8d1-418b-b669-5427f606a435 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.157363 Aug 27 04:55:10.741330 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 445/905] 10.222.0.58 () {60 vars in 1187 bytes} [Sat Aug 27 04:55:10 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:55:10.748616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-365e8d49-93f0-491c-b35b-b631898cf880 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:10.751837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a4e9279-af32-412e-af12-f9b2386bc021 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Calling method '.version_select at 0x7fb565936550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:10.753750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a4e9279-af32-412e-af12-f9b2386bc021 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.754227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a4e9279-af32-412e-af12-f9b2386bc021 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.754658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a4e9279-af32-412e-af12-f9b2386bc021 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.756512 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-365e8d49-93f0-491c-b35b-b631898cf880 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1515 microversion: 2.1 time: 0.156759 Aug 27 04:55:10.757080 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 461/906] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:10 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:10.767468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a4e9279-af32-412e-af12-f9b2386bc021 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.767945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a4e9279-af32-412e-af12-f9b2386bc021 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.768375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a4e9279-af32-412e-af12-f9b2386bc021 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.774960 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a4e9279-af32-412e-af12-f9b2386bc021 tempest-HypervisorAdminV228Test-315607188 tempest-HypervisorAdminV228Test-315607188-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 719 microversion: 2.28 time: 0.027175 Aug 27 04:55:10.779124 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 446/907] 10.222.0.58 () {60 vars in 1193 bytes} [Sat Aug 27 04:55:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 719 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:55:10.779248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1aeef23-c93b-4060-a66c-251fda2d0ddd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:10.779248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d1aeef23-c93b-4060-a66c-251fda2d0ddd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: f8f4d090-8163-469c-b801-7864b9155ed3] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:10.784878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1aeef23-c93b-4060-a66c-251fda2d0ddd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.784878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1aeef23-c93b-4060-a66c-251fda2d0ddd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.785161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1aeef23-c93b-4060-a66c-251fda2d0ddd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.785642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1aeef23-c93b-4060-a66c-251fda2d0ddd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.786093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1aeef23-c93b-4060-a66c-251fda2d0ddd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.786514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1aeef23-c93b-4060-a66c-251fda2d0ddd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.849063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-09e75bcb-fca7-490e-a34f-1e0330b0b541 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:10.849807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-09e75bcb-fca7-490e-a34f-1e0330b0b541 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:10.856595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e75bcb-fca7-490e-a34f-1e0330b0b541 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.857160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e75bcb-fca7-490e-a34f-1e0330b0b541 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.857666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e75bcb-fca7-490e-a34f-1e0330b0b541 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.858586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e75bcb-fca7-490e-a34f-1e0330b0b541 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:10.859137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e75bcb-fca7-490e-a34f-1e0330b0b541 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:10.859636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e75bcb-fca7-490e-a34f-1e0330b0b541 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.969048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d1aeef23-c93b-4060-a66c-251fda2d0ddd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:10.984005 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1aeef23-c93b-4060-a66c-251fda2d0ddd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3" status: 200 len: 1516 microversion: 2.1 time: 0.207398 Aug 27 04:55:10.986147 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 462/908] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:10 2022] GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3 => generated 1516 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:11.005390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-83199aae-eff4-4ca2-8c3b-b39f1df52abf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:11.006006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-83199aae-eff4-4ca2-8c3b-b39f1df52abf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:11.016298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83199aae-eff4-4ca2-8c3b-b39f1df52abf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.016933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83199aae-eff4-4ca2-8c3b-b39f1df52abf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.017625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83199aae-eff4-4ca2-8c3b-b39f1df52abf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.018604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83199aae-eff4-4ca2-8c3b-b39f1df52abf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.019222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83199aae-eff4-4ca2-8c3b-b39f1df52abf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.019743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83199aae-eff4-4ca2-8c3b-b39f1df52abf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.038649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-09e75bcb-fca7-490e-a34f-1e0330b0b541 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:11.046778 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-09e75bcb-fca7-490e-a34f-1e0330b0b541 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.202250 Aug 27 04:55:11.060878 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 447/909] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:10 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:11.172554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-83199aae-eff4-4ca2-8c3b-b39f1df52abf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:11.181461 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-83199aae-eff4-4ca2-8c3b-b39f1df52abf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 200 len: 1515 microversion: 2.1 time: 0.180165 Aug 27 04:55:11.182035 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 463/910] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:11 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:11.201841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-131a7286-bdeb-4fff-ab7f-c06d6533377c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:11.202197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-131a7286-bdeb-4fff-ab7f-c06d6533377c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:11.209047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-131a7286-bdeb-4fff-ab7f-c06d6533377c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.209625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-131a7286-bdeb-4fff-ab7f-c06d6533377c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.210121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-131a7286-bdeb-4fff-ab7f-c06d6533377c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.211535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-131a7286-bdeb-4fff-ab7f-c06d6533377c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.212063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-131a7286-bdeb-4fff-ab7f-c06d6533377c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.212615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-131a7286-bdeb-4fff-ab7f-c06d6533377c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.240204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-131a7286-bdeb-4fff-ab7f-c06d6533377c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:55:11.269021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b22859e2-32ab-405f-a005-ded86c224555 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:11.269943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b22859e2-32ab-405f-a005-ded86c224555 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:11.284094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22859e2-32ab-405f-a005-ded86c224555 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.284788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22859e2-32ab-405f-a005-ded86c224555 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.285671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22859e2-32ab-405f-a005-ded86c224555 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.285988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22859e2-32ab-405f-a005-ded86c224555 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.286599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22859e2-32ab-405f-a005-ded86c224555 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.287055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22859e2-32ab-405f-a005-ded86c224555 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.293474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:11.368389 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-131a7286-bdeb-4fff-ab7f-c06d6533377c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "DELETE /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 204 len: 0 microversion: 2.1 time: 0.170479 Aug 27 04:55:11.368973 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 448/911] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:55:11 2022] DELETE /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:55:11.379971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-db1e641e-e9b1-428b-b1a1-ba21247cf1a3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:11.380894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-db1e641e-e9b1-428b-b1a1-ba21247cf1a3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:11.387814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db1e641e-e9b1-428b-b1a1-ba21247cf1a3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.388190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db1e641e-e9b1-428b-b1a1-ba21247cf1a3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.388677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db1e641e-e9b1-428b-b1a1-ba21247cf1a3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.389397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db1e641e-e9b1-428b-b1a1-ba21247cf1a3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.389829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db1e641e-e9b1-428b-b1a1-ba21247cf1a3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.390418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db1e641e-e9b1-428b-b1a1-ba21247cf1a3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.454502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=36 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:11.525307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b22859e2-32ab-405f-a005-ded86c224555 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:11.533105 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b22859e2-32ab-405f-a005-ded86c224555 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.268483 Aug 27 04:55:11.533680 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 464/912] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:11 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:11.538469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-999cd907-5edf-4372-80d3-034d4595363c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5655f34c0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:11.580663 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-999cd907-5edf-4372-80d3-034d4595363c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/b08ecac4-2e76-480e-8f24-fcbe168dd5c5" status: 200 len: 661 microversion: 2.1 time: 0.045749 Aug 27 04:55:11.581237 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 465/913] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:11 2022] GET /compute/v2.1/images/b08ecac4-2e76-480e-8f24-fcbe168dd5c5 => generated 661 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:11.585726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:11.586903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:11.593321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.593808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.594246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.594949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.595435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.595863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.608488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-db1e641e-e9b1-428b-b1a1-ba21247cf1a3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:11.618906 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-db1e641e-e9b1-428b-b1a1-ba21247cf1a3 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 200 len: 1521 microversion: 2.1 time: 0.243345 Aug 27 04:55:11.620009 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 449/914] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:11 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:11.625183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bc133c02-b4f2-450d-9ad3-cb265c6d0b41 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565413af0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:11.687321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:11.689908 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bc133c02-b4f2-450d-9ad3-cb265c6d0b41 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/b08ecac4-2e76-480e-8f24-fcbe168dd5c5" status: 200 len: 661 microversion: 2.1 time: 0.068716 Aug 27 04:55:11.690646 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 450/915] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:11 2022] GET /compute/v2.1/images/b08ecac4-2e76-480e-8f24-fcbe168dd5c5 => generated 661 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:11.699342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:11.699342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:11.705785 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1e891bb-654a-4a69-a179-3930ac3445a0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.123466 Aug 27 04:55:11.706319 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 466/916] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:11 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:12.068403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-85a89217-3c29-4cb2-9c20-67de2c4ca0e5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:12.069022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-85a89217-3c29-4cb2-9c20-67de2c4ca0e5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:12.075378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85a89217-3c29-4cb2-9c20-67de2c4ca0e5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:12.075873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85a89217-3c29-4cb2-9c20-67de2c4ca0e5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:12.076311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85a89217-3c29-4cb2-9c20-67de2c4ca0e5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:12.077024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85a89217-3c29-4cb2-9c20-67de2c4ca0e5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:12.077457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85a89217-3c29-4cb2-9c20-67de2c4ca0e5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:12.077882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85a89217-3c29-4cb2-9c20-67de2c4ca0e5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:12.212606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-85a89217-3c29-4cb2-9c20-67de2c4ca0e5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:12.220559 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-85a89217-3c29-4cb2-9c20-67de2c4ca0e5 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.156224 Aug 27 04:55:12.221141 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 451/917] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:12 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:12.553434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-193af186-a273-4306-9ae1-74b2d53457ae tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:12.554050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-193af186-a273-4306-9ae1-74b2d53457ae tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:12.561288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-193af186-a273-4306-9ae1-74b2d53457ae tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:12.561788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-193af186-a273-4306-9ae1-74b2d53457ae tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:12.562220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-193af186-a273-4306-9ae1-74b2d53457ae tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:12.562984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-193af186-a273-4306-9ae1-74b2d53457ae tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:12.563466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-193af186-a273-4306-9ae1-74b2d53457ae tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:12.563892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-193af186-a273-4306-9ae1-74b2d53457ae tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:12.642386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ca94594b-3935-4db0-b227-2a353d46725e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:12.643320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ca94594b-3935-4db0-b227-2a353d46725e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:12.650058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca94594b-3935-4db0-b227-2a353d46725e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:12.650544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca94594b-3935-4db0-b227-2a353d46725e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:12.650980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca94594b-3935-4db0-b227-2a353d46725e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:12.651710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca94594b-3935-4db0-b227-2a353d46725e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:12.652161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca94594b-3935-4db0-b227-2a353d46725e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:12.652582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca94594b-3935-4db0-b227-2a353d46725e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:12.709119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-193af186-a273-4306-9ae1-74b2d53457ae tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:12.719977 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-193af186-a273-4306-9ae1-74b2d53457ae tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.167462 Aug 27 04:55:12.719977 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 467/918] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:12 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:12.734319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:12.735211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:12.741560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:12.742699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:12.743019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:12.743835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:12.744296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:12.744724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:12.837317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:12.843405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ca94594b-3935-4db0-b227-2a353d46725e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:12.850793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:12.852490 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ca94594b-3935-4db0-b227-2a353d46725e tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 200 len: 1521 microversion: 2.1 time: 0.214411 Aug 27 04:55:12.853524 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 452/919] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:12 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:12.855888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:12.857558 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-54b68424-c99e-4f2e-b669-a20a99aac5c4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.131917 Aug 27 04:55:12.858230 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 468/920] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:12 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:55:13.196368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad14019f-407e-42d7-a4aa-26164fcec13e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565496d30>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:13.237971 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad14019f-407e-42d7-a4aa-26164fcec13e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/e1a86243-bf05-41c0-ab5e-80282ed8da4a" status: 200 len: 661 microversion: 2.1 time: 0.045216 Aug 27 04:55:13.247071 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 453/921] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:13 2022] GET /compute/v2.1/images/e1a86243-bf05-41c0-ab5e-80282ed8da4a => generated 661 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:55:13.247408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5c98b8fd-4a36-441d-b14d-c3b2184afd44 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:13.247408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5c98b8fd-4a36-441d-b14d-c3b2184afd44 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:13.251544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c98b8fd-4a36-441d-b14d-c3b2184afd44 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:13.252265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c98b8fd-4a36-441d-b14d-c3b2184afd44 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:13.252699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-455de7a4-c015-4d51-a6c3-5917194412bd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56562ab80>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:13.253008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c98b8fd-4a36-441d-b14d-c3b2184afd44 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:13.253906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c98b8fd-4a36-441d-b14d-c3b2184afd44 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:13.254370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c98b8fd-4a36-441d-b14d-c3b2184afd44 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:13.254803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c98b8fd-4a36-441d-b14d-c3b2184afd44 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:13.305440 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-455de7a4-c015-4d51-a6c3-5917194412bd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/e1a86243-bf05-41c0-ab5e-80282ed8da4a" status: 200 len: 661 microversion: 2.1 time: 0.057016 Aug 27 04:55:13.305903 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 454/922] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:13 2022] GET /compute/v2.1/images/e1a86243-bf05-41c0-ab5e-80282ed8da4a => generated 661 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:13.402901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5c98b8fd-4a36-441d-b14d-c3b2184afd44 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:13.411226 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5c98b8fd-4a36-441d-b14d-c3b2184afd44 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.174500 Aug 27 04:55:13.411825 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 469/923] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:13 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:13.440850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-13791612", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:13.493677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:55:13.688484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:55:13.688907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:55:13.689385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:55:13.689794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:55:13.690202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:55:13.699643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:13.700125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:13.700561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:13.701456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:13.701906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:13.702335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:13.712964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dbb55aed-8341-48fe-ab37-81af731f9ebc tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Action: 'create', calling method: .version_select at 0x7fb5652ba1f0>, body: {"keypair": {"name": "tempest-keypair-1095853579", "type": "ssh", "user_id": "db832f72f9f944f89d952398470c99cc", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKV3WrV0leEoRRKgxOFETXPp4EbTpVAH73/USp2HCH4270h4gm/02AWR+K6/nOFe/6NdzuIf5VBMZs5Dh1VVuFLpnt3TwYaIFqzEDpFesuUWG3D4sDm7LEH/4QFZUivpA=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:13.720437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Getting quotas for project dc1919f166be4c6b9b3e2b79bf5ac906. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:13.725560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Getting quotas for user dfd207ef0074450894338b376ba462ee and project dc1919f166be4c6b9b3e2b79bf5ac906. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:13.727553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-dbb55aed-8341-48fe-ab37-81af731f9ebc tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Getting quotas for project b3bcaea1ad87443a8376a0416e26cb4c. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:13.732871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-dbb55aed-8341-48fe-ab37-81af731f9ebc tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Getting quotas for user 1a99add130dc4b3baa640439af13da7a and project b3bcaea1ad87443a8376a0416e26cb4c. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:13.737638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:55:13.740044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:55:13.758474 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dbb55aed-8341-48fe-ab37-81af731f9ebc tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.161805 Aug 27 04:55:13.767611 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 470/924] 10.222.0.58 () {62 vars in 1200 bytes} [Sat Aug 27 04:55:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 164 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 27 04:55:13.767611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-85695d22-888b-4a66-8673-bcecabef51b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:13.767611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-85695d22-888b-4a66-8673-bcecabef51b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:13.770431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85695d22-888b-4a66-8673-bcecabef51b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:13.770928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85695d22-888b-4a66-8673-bcecabef51b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:13.771391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85695d22-888b-4a66-8673-bcecabef51b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:13.772129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85695d22-888b-4a66-8673-bcecabef51b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:13.772645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85695d22-888b-4a66-8673-bcecabef51b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:13.773004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85695d22-888b-4a66-8673-bcecabef51b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:13.789243 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-97bb3b2c-4805-4d53-8c50-34a8f90e09cb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.353399 Aug 27 04:55:13.789884 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 455/925] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:55:13.809363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e4395495-053e-4a53-97fb-a34f062f44d0 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Action: 'create', calling method: .version_select at 0x7fb565419670>, body: {"keypair": {"name": "tempest-keypair-1296238902", "type": "ssh", "user_id": "db832f72f9f944f89d952398470c99cc", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGjF4hj7iFFEL6oxaQ1W7zdcjEIectH4ZVj633uWfeNiEGBAFrR3d2fvy4bFEoGDKyYQpRhC5O5uks8tonGuQcfctI39Xvqzxrxg8xb83Z1oI4+0DHN8DwzXBwwIAblEQ=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:13.831934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-e4395495-053e-4a53-97fb-a34f062f44d0 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Getting quotas for project b3bcaea1ad87443a8376a0416e26cb4c. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:13.838085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-e4395495-053e-4a53-97fb-a34f062f44d0 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Getting quotas for user 1a99add130dc4b3baa640439af13da7a and project b3bcaea1ad87443a8376a0416e26cb4c. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:13.865327 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e4395495-053e-4a53-97fb-a34f062f44d0 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.073488 Aug 27 04:55:13.865979 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 456/926] 10.222.0.58 () {62 vars in 1200 bytes} [Sat Aug 27 04:55:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 04:55:13.875547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa2ec22f-9bdb-4d5c-aa2b-5ee0ee043022 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:13.877242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aa2ec22f-9bdb-4d5c-aa2b-5ee0ee043022 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:13.885365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa2ec22f-9bdb-4d5c-aa2b-5ee0ee043022 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:13.885853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa2ec22f-9bdb-4d5c-aa2b-5ee0ee043022 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:13.886299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa2ec22f-9bdb-4d5c-aa2b-5ee0ee043022 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:13.887369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa2ec22f-9bdb-4d5c-aa2b-5ee0ee043022 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:13.887834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa2ec22f-9bdb-4d5c-aa2b-5ee0ee043022 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:13.888260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa2ec22f-9bdb-4d5c-aa2b-5ee0ee043022 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:13.970243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-85695d22-888b-4a66-8673-bcecabef51b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:13.977920 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-85695d22-888b-4a66-8673-bcecabef51b6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.217783 Aug 27 04:55:13.978509 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 471/927] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:13 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:13.982719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-af540c3e-422a-4c22-bf6e-ff12ea46c4db tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Calling method '.version_select at 0x7fb5652bab80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:13.991243 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-af540c3e-422a-4c22-bf6e-ff12ea46c4db tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1095853579?user_id=db832f72f9f944f89d952398470c99cc" status: 200 len: 513 microversion: 2.10 time: 0.011681 Aug 27 04:55:13.991991 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 472/928] 10.222.0.58 () {60 vars in 1340 bytes} [Sat Aug 27 04:55:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1095853579?user_id=db832f72f9f944f89d952398470c99cc => generated 513 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:55:13.997573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:13.998373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:14.005318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:14.005808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:14.006410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:14.007320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:14.008711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:14.009147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:14.050168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aa2ec22f-9bdb-4d5c-aa2b-5ee0ee043022 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:14.059643 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aa2ec22f-9bdb-4d5c-aa2b-5ee0ee043022 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 200 len: 1521 microversion: 2.1 time: 0.189155 Aug 27 04:55:14.059643 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 457/929] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:13 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:14.064220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-990901089", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:14.080359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:14.091446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:14.093143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:14.094541 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7799eb05-a8e6-4d3b-b636-08eab7105b98 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.100375 Aug 27 04:55:14.095847 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 473/930] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:13 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:14.100432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-36fa930c-8dd4-498e-a494-f69b32dd23e8 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Action: 'create', calling method: .version_select at 0x7fb5652dea60>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1991458607", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInSC62j0u0ZpYuahojdrEgdgkd1JnI4ByG9vPcZYBby9A2O6hFThEDVZMtGSw75A5dWOGSb8KvgMn1c6r01QPCOmtZ0iqUolPh+YyQznh/s787eMTEEkOEsnheYHVtaag=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:14.117868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-36fa930c-8dd4-498e-a494-f69b32dd23e8 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Getting quotas for project b3bcaea1ad87443a8376a0416e26cb4c. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:14.123394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-36fa930c-8dd4-498e-a494-f69b32dd23e8 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Getting quotas for user 1a99add130dc4b3baa640439af13da7a and project b3bcaea1ad87443a8376a0416e26cb4c. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:14.139006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:55:14.151274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-36fa930c-8dd4-498e-a494-f69b32dd23e8 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.051928 Aug 27 04:55:14.152029 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 474/931] 10.222.0.58 () {62 vars in 1200 bytes} [Sat Aug 27 04:55:14 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 04:55:14.164298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-071b6473-b3d2-4272-83c4-fa26decb2620 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Calling method '.version_select at 0x7fb5652cf820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:14.168927 n-d-820368-35 devstack@n-api.service[128547]: WARNING oslo_db.sqlalchemy.utils [None req-071b6473-b3d2-4272-83c4-fa26decb2620 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 04:55:14.175557 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-071b6473-b3d2-4272-83c4-fa26decb2620 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs?user_id=db832f72f9f944f89d952398470c99cc" status: 200 len: 726 microversion: 2.10 time: 0.016704 Aug 27 04:55:14.176526 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 475/932] 10.222.0.58 () {60 vars in 1259 bytes} [Sat Aug 27 04:55:14 2022] GET /compute/v2.1/os-keypairs?user_id=db832f72f9f944f89d952398470c99cc => generated 726 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:55:14.193644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b54ae8f9-9470-44ce-8641-4e5bd9b35a83 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Calling method '.version_select at 0x7fb56528c160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:14.217618 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b54ae8f9-9470-44ce-8641-4e5bd9b35a83 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1991458607" status: 204 len: 0 microversion: 2.10 time: 0.032481 Aug 27 04:55:14.218193 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 476/933] 10.222.0.58 () {60 vars in 1325 bytes} [Sat Aug 27 04:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1991458607 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:55:14.226327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf4ccd9a-f214-475b-81cf-6b59957a7879 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Calling method '.version_select at 0x7fb56528cf70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:14.260041 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf4ccd9a-f214-475b-81cf-6b59957a7879 tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296238902?user_id=db832f72f9f944f89d952398470c99cc" status: 204 len: 0 microversion: 2.10 time: 0.037277 Aug 27 04:55:14.261481 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 477/934] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296238902?user_id=db832f72f9f944f89d952398470c99cc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 04:55:14.270237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69c864a5-18d0-4e2e-beb1-0db80c36c4af tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] Calling method '.version_select at 0x7fb5652f33a0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:14.291522 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-69c864a5-18d0-4e2e-beb1-0db80c36c4af tempest-KeyPairsV210TestJSON-1979711018 tempest-KeyPairsV210TestJSON-1979711018-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095853579?user_id=db832f72f9f944f89d952398470c99cc" status: 204 len: 0 microversion: 2.10 time: 0.025209 Aug 27 04:55:14.292760 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 478/935] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095853579?user_id=db832f72f9f944f89d952398470c99cc => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:55:14.423148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:55:14.423699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:55:14.424046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:55:14.424465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:55:14.425048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:55:14.433746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3c541f2a-f89b-482f-9a89-f6e770aeda0d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:14.435174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3c541f2a-f89b-482f-9a89-f6e770aeda0d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:14.437755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:14.438463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:14.439303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:14.439784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:14.440247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:14.440682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:14.448520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c541f2a-f89b-482f-9a89-f6e770aeda0d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:14.449122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c541f2a-f89b-482f-9a89-f6e770aeda0d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:14.449574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c541f2a-f89b-482f-9a89-f6e770aeda0d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:14.450313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c541f2a-f89b-482f-9a89-f6e770aeda0d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:14.455431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c541f2a-f89b-482f-9a89-f6e770aeda0d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:14.456218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c541f2a-f89b-482f-9a89-f6e770aeda0d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:14.466225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Getting quotas for project dc1919f166be4c6b9b3e2b79bf5ac906. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:14.473436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Getting quotas for user dfd207ef0074450894338b376ba462ee and project dc1919f166be4c6b9b3e2b79bf5ac906. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:14.491240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:55:14.494313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:55:14.565324 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ca0325e-bd6c-430b-bc02-5a8a5fc8090b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504629 Aug 27 04:55:14.567261 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 458/936] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:55:14.578053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dafe868d-a0d7-46c2-bf7a-f254895ef31c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:14.578687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dafe868d-a0d7-46c2-bf7a-f254895ef31c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:14.671761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dafe868d-a0d7-46c2-bf7a-f254895ef31c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:14.682524 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dafe868d-a0d7-46c2-bf7a-f254895ef31c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1217 microversion: 2.1 time: 0.108892 Aug 27 04:55:14.684658 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 459/937] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:14 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:14.707988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3c541f2a-f89b-482f-9a89-f6e770aeda0d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:14.719005 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3c541f2a-f89b-482f-9a89-f6e770aeda0d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.289534 Aug 27 04:55:14.719969 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 479/938] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:14 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:14.998074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b04a6ad-c0e2-4104-9664-cff1076f66c3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:14.999723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2b04a6ad-c0e2-4104-9664-cff1076f66c3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:15.008314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b04a6ad-c0e2-4104-9664-cff1076f66c3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.009565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b04a6ad-c0e2-4104-9664-cff1076f66c3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.010014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b04a6ad-c0e2-4104-9664-cff1076f66c3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.011261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b04a6ad-c0e2-4104-9664-cff1076f66c3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.011873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b04a6ad-c0e2-4104-9664-cff1076f66c3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.012545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b04a6ad-c0e2-4104-9664-cff1076f66c3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.081499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3daa205e-b1cb-486d-88fb-3d9aa2f26d4d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:15.082169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3daa205e-b1cb-486d-88fb-3d9aa2f26d4d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:15.088994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3daa205e-b1cb-486d-88fb-3d9aa2f26d4d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.089762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3daa205e-b1cb-486d-88fb-3d9aa2f26d4d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.090430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3daa205e-b1cb-486d-88fb-3d9aa2f26d4d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.091255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3daa205e-b1cb-486d-88fb-3d9aa2f26d4d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.091814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3daa205e-b1cb-486d-88fb-3d9aa2f26d4d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.092316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3daa205e-b1cb-486d-88fb-3d9aa2f26d4d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.252378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2b04a6ad-c0e2-4104-9664-cff1076f66c3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:15.260755 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2b04a6ad-c0e2-4104-9664-cff1076f66c3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.266732 Aug 27 04:55:15.261256 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 460/939] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:14 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:15.275376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:15.275985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:15.282008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.282492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.282926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.283646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.284097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.284519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.312586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3daa205e-b1cb-486d-88fb-3d9aa2f26d4d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:15.321622 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3daa205e-b1cb-486d-88fb-3d9aa2f26d4d tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 200 len: 1521 microversion: 2.1 time: 0.244196 Aug 27 04:55:15.322197 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 480/940] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:15 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:15.354025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:15.363365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:15.364834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:15.366797 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3f58b37f-a1fc-45b0-aad3-aaac11d000a9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.104256 Aug 27 04:55:15.367397 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 461/941] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:15 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:15.707272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ca0643ed-f2af-4235-bfd8-820f4e57c499 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:15.708361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ca0643ed-f2af-4235-bfd8-820f4e57c499 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:15.716704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0643ed-f2af-4235-bfd8-820f4e57c499 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.716898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0643ed-f2af-4235-bfd8-820f4e57c499 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.717777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0643ed-f2af-4235-bfd8-820f4e57c499 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.719199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0643ed-f2af-4235-bfd8-820f4e57c499 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.719752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0643ed-f2af-4235-bfd8-820f4e57c499 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.720118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0643ed-f2af-4235-bfd8-820f4e57c499 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.740606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e441df29-6ec9-4238-a19d-1391d48d747a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:15.741329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e441df29-6ec9-4238-a19d-1391d48d747a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:15.749593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e441df29-6ec9-4238-a19d-1391d48d747a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.750325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e441df29-6ec9-4238-a19d-1391d48d747a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.750741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e441df29-6ec9-4238-a19d-1391d48d747a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.751938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e441df29-6ec9-4238-a19d-1391d48d747a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.752647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e441df29-6ec9-4238-a19d-1391d48d747a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.753179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e441df29-6ec9-4238-a19d-1391d48d747a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.758858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:15.812258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ca0643ed-f2af-4235-bfd8-820f4e57c499 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:15.830511 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ca0643ed-f2af-4235-bfd8-820f4e57c499 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1221 microversion: 2.1 time: 0.121899 Aug 27 04:55:15.830511 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 481/942] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:15 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:15.983122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e441df29-6ec9-4238-a19d-1391d48d747a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:15.991335 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e441df29-6ec9-4238-a19d-1391d48d747a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.255046 Aug 27 04:55:15.992658 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 462/943] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:15 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:16.283515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-136951d6-a2d1-4336-aa1d-aac0427f43fb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:16.284247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-136951d6-a2d1-4336-aa1d-aac0427f43fb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:16.290548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-136951d6-a2d1-4336-aa1d-aac0427f43fb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:16.291530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-136951d6-a2d1-4336-aa1d-aac0427f43fb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:16.292025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-136951d6-a2d1-4336-aa1d-aac0427f43fb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:16.292795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-136951d6-a2d1-4336-aa1d-aac0427f43fb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:16.293317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-136951d6-a2d1-4336-aa1d-aac0427f43fb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:16.293887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-136951d6-a2d1-4336-aa1d-aac0427f43fb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:16.342477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9cffba20-0dde-427c-bcf7-e8868f79e349 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:16.343411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9cffba20-0dde-427c-bcf7-e8868f79e349 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:16.356365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cffba20-0dde-427c-bcf7-e8868f79e349 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:16.364864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cffba20-0dde-427c-bcf7-e8868f79e349 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:16.365628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cffba20-0dde-427c-bcf7-e8868f79e349 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:16.366587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cffba20-0dde-427c-bcf7-e8868f79e349 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:16.368060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cffba20-0dde-427c-bcf7-e8868f79e349 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:16.368696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cffba20-0dde-427c-bcf7-e8868f79e349 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:16.516414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-136951d6-a2d1-4336-aa1d-aac0427f43fb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:16.525405 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-136951d6-a2d1-4336-aa1d-aac0427f43fb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.247320 Aug 27 04:55:16.538569 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 482/944] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:16 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:16.543979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:16.545627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:16.555355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:16.557262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:16.557919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:16.559529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:16.560258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:16.560993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:16.574888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9cffba20-0dde-427c-bcf7-e8868f79e349 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:16.584234 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9cffba20-0dde-427c-bcf7-e8868f79e349 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 200 len: 1521 microversion: 2.1 time: 0.245706 Aug 27 04:55:16.585184 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 463/945] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:16 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:16.654349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:16.663666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:16.666823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:16.680536 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c9704ea5-db6b-4d30-b4b0-e3d9a3c3a69f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.139826 Aug 27 04:55:16.681212 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 483/946] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:16 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:16.842872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1dfd0d2e-c0a4-40c7-a963-abfad13e34ff tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:16.843674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1dfd0d2e-c0a4-40c7-a963-abfad13e34ff tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:16.849980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dfd0d2e-c0a4-40c7-a963-abfad13e34ff tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:16.850477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dfd0d2e-c0a4-40c7-a963-abfad13e34ff tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:16.851984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dfd0d2e-c0a4-40c7-a963-abfad13e34ff tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:16.852697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dfd0d2e-c0a4-40c7-a963-abfad13e34ff tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:16.853343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dfd0d2e-c0a4-40c7-a963-abfad13e34ff tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:16.853946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dfd0d2e-c0a4-40c7-a963-abfad13e34ff tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:16.944261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1dfd0d2e-c0a4-40c7-a963-abfad13e34ff tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:16.953087 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1dfd0d2e-c0a4-40c7-a963-abfad13e34ff tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1221 microversion: 2.1 time: 0.114778 Aug 27 04:55:16.953667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 464/947] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:16 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:17.013025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-26105ef7-85da-43f5-8c1a-0f948e8bdb7b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:17.014252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-26105ef7-85da-43f5-8c1a-0f948e8bdb7b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:17.020590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26105ef7-85da-43f5-8c1a-0f948e8bdb7b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.021191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26105ef7-85da-43f5-8c1a-0f948e8bdb7b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.021734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26105ef7-85da-43f5-8c1a-0f948e8bdb7b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.022537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26105ef7-85da-43f5-8c1a-0f948e8bdb7b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.023679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26105ef7-85da-43f5-8c1a-0f948e8bdb7b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.024225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26105ef7-85da-43f5-8c1a-0f948e8bdb7b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.301368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-207df107-a9a6-47ac-a33b-e5d4dec1eb14 req-09b96f6b-326d-43c3-b98b-d83c08f9a0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c46e5a-ffeb-41a5-9593-6d64703ae23d", "name": "network-vif-plugged", "status": "completed", "tag": "4ba304c5-0b28-4523-9219-f55fd7244c04"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:17.334686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:17.341889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-207df107-a9a6-47ac-a33b-e5d4dec1eb14 req-09b96f6b-326d-43c3-b98b-d83c08f9a0d2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.343533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-207df107-a9a6-47ac-a33b-e5d4dec1eb14 req-09b96f6b-326d-43c3-b98b-d83c08f9a0d2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.346689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-207df107-a9a6-47ac-a33b-e5d4dec1eb14 req-09b96f6b-326d-43c3-b98b-d83c08f9a0d2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.385415 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-207df107-a9a6-47ac-a33b-e5d4dec1eb14 req-09b96f6b-326d-43c3-b98b-d83c08f9a0d2 service nova] Creating event network-vif-plugged:4ba304c5-0b28-4523-9219-f55fd7244c04 for instance a0c46e5a-ffeb-41a5-9593-6d64703ae23d on n-h2-820368-35 Aug 27 04:55:17.392523 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-207df107-a9a6-47ac-a33b-e5d4dec1eb14 req-09b96f6b-326d-43c3-b98b-d83c08f9a0d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097531 Aug 27 04:55:17.393447 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 465/948] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:55:17.493445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-26105ef7-85da-43f5-8c1a-0f948e8bdb7b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:17.509517 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-26105ef7-85da-43f5-8c1a-0f948e8bdb7b tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.495041 Aug 27 04:55:17.510143 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 484/949] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:17 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:17.513926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-aabe09b5-2469-442f-9b87-a0e3d1c7b441 req-6e8223eb-f8fe-4692-9c51-0379ef804ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd002ec2-35f3-43fb-b976-ecb02f1b7738", "tag": "4783370e-a485-40e1-8ea2-5a10e13b0d87"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:17.525311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aabe09b5-2469-442f-9b87-a0e3d1c7b441 req-6e8223eb-f8fe-4692-9c51-0379ef804ec6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.526017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aabe09b5-2469-442f-9b87-a0e3d1c7b441 req-6e8223eb-f8fe-4692-9c51-0379ef804ec6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.526643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aabe09b5-2469-442f-9b87-a0e3d1c7b441 req-6e8223eb-f8fe-4692-9c51-0379ef804ec6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.546281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ff06c29-e548-4e2e-8976-0ff5caca9a0d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:17.546895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ff06c29-e548-4e2e-8976-0ff5caca9a0d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:17.553833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff06c29-e548-4e2e-8976-0ff5caca9a0d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.557566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff06c29-e548-4e2e-8976-0ff5caca9a0d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.558019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff06c29-e548-4e2e-8976-0ff5caca9a0d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.558891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff06c29-e548-4e2e-8976-0ff5caca9a0d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.559454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff06c29-e548-4e2e-8976-0ff5caca9a0d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.559879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff06c29-e548-4e2e-8976-0ff5caca9a0d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.568541 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-aabe09b5-2469-442f-9b87-a0e3d1c7b441 req-6e8223eb-f8fe-4692-9c51-0379ef804ec6 service nova] Creating event network-changed:4783370e-a485-40e1-8ea2-5a10e13b0d87 for instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 on n-h1-820368-35 Aug 27 04:55:17.575451 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-aabe09b5-2469-442f-9b87-a0e3d1c7b441 req-6e8223eb-f8fe-4692-9c51-0379ef804ec6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069950 Aug 27 04:55:17.576705 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 466/950] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:17.606705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5fdcde64-7f34-45dd-8e3b-c7d772315c44 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:17.607597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5fdcde64-7f34-45dd-8e3b-c7d772315c44 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:17.614450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcde64-7f34-45dd-8e3b-c7d772315c44 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.615310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcde64-7f34-45dd-8e3b-c7d772315c44 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.615842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcde64-7f34-45dd-8e3b-c7d772315c44 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.616687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcde64-7f34-45dd-8e3b-c7d772315c44 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.617787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcde64-7f34-45dd-8e3b-c7d772315c44 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.618390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcde64-7f34-45dd-8e3b-c7d772315c44 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.881060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1ff06c29-e548-4e2e-8976-0ff5caca9a0d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:17.891558 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ff06c29-e548-4e2e-8976-0ff5caca9a0d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.349182 Aug 27 04:55:17.905756 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 485/951] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:17 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:17.912309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5fdcde64-7f34-45dd-8e3b-c7d772315c44 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:17.922331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:17.922993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:17.930052 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5fdcde64-7f34-45dd-8e3b-c7d772315c44 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 200 len: 1521 microversion: 2.1 time: 0.328419 Aug 27 04:55:17.931292 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 467/952] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:17 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:17.937567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.938063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.938507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.939587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.940045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.940467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.973764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f840653-a095-4572-8a43-d0d5256ff265 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:17.974682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4f840653-a095-4572-8a43-d0d5256ff265 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:17.981493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f840653-a095-4572-8a43-d0d5256ff265 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.981987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f840653-a095-4572-8a43-d0d5256ff265 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.982615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f840653-a095-4572-8a43-d0d5256ff265 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.983591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f840653-a095-4572-8a43-d0d5256ff265 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.984459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f840653-a095-4572-8a43-d0d5256ff265 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.985072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f840653-a095-4572-8a43-d0d5256ff265 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:18.027682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:18.037637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:18.039675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:18.040858 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4dd4ddfa-e550-4f82-b56a-d79b68f9afb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.143456 Aug 27 04:55:18.041419 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 486/953] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:17 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:18.062368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f840653-a095-4572-8a43-d0d5256ff265 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:18.070618 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f840653-a095-4572-8a43-d0d5256ff265 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1221 microversion: 2.1 time: 0.100579 Aug 27 04:55:18.071605 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 468/954] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:17 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1221 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:18.531391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e7fcb43-053d-4269-92e8-9bf2a97c022e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:18.532010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3e7fcb43-053d-4269-92e8-9bf2a97c022e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:18.543466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e7fcb43-053d-4269-92e8-9bf2a97c022e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:18.544986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e7fcb43-053d-4269-92e8-9bf2a97c022e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:18.545468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e7fcb43-053d-4269-92e8-9bf2a97c022e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:18.547987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e7fcb43-053d-4269-92e8-9bf2a97c022e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:18.548604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e7fcb43-053d-4269-92e8-9bf2a97c022e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:18.549867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e7fcb43-053d-4269-92e8-9bf2a97c022e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:18.690564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3e7fcb43-053d-4269-92e8-9bf2a97c022e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:18.700344 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e7fcb43-053d-4269-92e8-9bf2a97c022e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.174316 Aug 27 04:55:18.701353 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 487/955] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:18 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:18.917074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-73888ee0-c915-468c-8587-e52c508b5071 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:18.917614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-73888ee0-c915-468c-8587-e52c508b5071 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:18.928083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73888ee0-c915-468c-8587-e52c508b5071 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:18.929095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73888ee0-c915-468c-8587-e52c508b5071 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:18.929532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73888ee0-c915-468c-8587-e52c508b5071 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:18.931050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73888ee0-c915-468c-8587-e52c508b5071 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:18.932836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73888ee0-c915-468c-8587-e52c508b5071 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:18.933382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73888ee0-c915-468c-8587-e52c508b5071 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:18.952891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4be7f407-efc9-4bdf-917f-acdda5f04e60 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:18.953856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4be7f407-efc9-4bdf-917f-acdda5f04e60 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:18.957173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:18.962353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be7f407-efc9-4bdf-917f-acdda5f04e60 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:18.963120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be7f407-efc9-4bdf-917f-acdda5f04e60 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:18.963780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be7f407-efc9-4bdf-917f-acdda5f04e60 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:18.964696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be7f407-efc9-4bdf-917f-acdda5f04e60 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:18.965341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be7f407-efc9-4bdf-917f-acdda5f04e60 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:18.965992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be7f407-efc9-4bdf-917f-acdda5f04e60 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:19.193748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4be7f407-efc9-4bdf-917f-acdda5f04e60 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:19.195412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-73888ee0-c915-468c-8587-e52c508b5071 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:19.198283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:19.218367 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-73888ee0-c915-468c-8587-e52c508b5071 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.306364 Aug 27 04:55:19.220189 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 469/956] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:18 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:19.220590 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4be7f407-efc9-4bdf-917f-acdda5f04e60 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 200 len: 1521 microversion: 2.1 time: 0.268718 Aug 27 04:55:19.237715 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 488/957] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:18 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:19.245827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:19.247840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b712a9d-5b2e-433c-884e-c9c944f26576 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:19.248522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8b712a9d-5b2e-433c-884e-c9c944f26576 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:19.250333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:19.261094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b712a9d-5b2e-433c-884e-c9c944f26576 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:19.261300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:19.261793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:19.262166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b712a9d-5b2e-433c-884e-c9c944f26576 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:19.262696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:19.262813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b712a9d-5b2e-433c-884e-c9c944f26576 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:19.263871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:19.264106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b712a9d-5b2e-433c-884e-c9c944f26576 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:19.264735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b712a9d-5b2e-433c-884e-c9c944f26576 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:19.265095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:19.265224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b712a9d-5b2e-433c-884e-c9c944f26576 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:19.265861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:19.355535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b712a9d-5b2e-433c-884e-c9c944f26576 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:19.376060 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b712a9d-5b2e-433c-884e-c9c944f26576 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1269 microversion: 2.1 time: 0.136583 Aug 27 04:55:19.376775 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 489/958] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:19 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1269 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:19.398776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:19.409119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:19.411848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:19.413199 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-afc96224-7684-471b-a34c-713b5c12fde7 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.179451 Aug 27 04:55:19.414041 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 470/959] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:19 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:19.596859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-6ff50b2e-e9df-4fef-8a9f-5950b569f555 req-79219bfb-721a-483f-bb22-36d5e9df7b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d5a4df-1045-4b64-b58c-2383ce224d63", "name": "network-vif-deleted", "tag": "7664fef3-23d1-4397-942a-44d07372001b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:19.607791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6ff50b2e-e9df-4fef-8a9f-5950b569f555 req-79219bfb-721a-483f-bb22-36d5e9df7b5d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:19.608450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6ff50b2e-e9df-4fef-8a9f-5950b569f555 req-79219bfb-721a-483f-bb22-36d5e9df7b5d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:19.609105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6ff50b2e-e9df-4fef-8a9f-5950b569f555 req-79219bfb-721a-483f-bb22-36d5e9df7b5d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:19.624538 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-6ff50b2e-e9df-4fef-8a9f-5950b569f555 req-79219bfb-721a-483f-bb22-36d5e9df7b5d service nova] Creating event network-vif-deleted:7664fef3-23d1-4397-942a-44d07372001b for instance 35d5a4df-1045-4b64-b58c-2383ce224d63 on n-h2-820368-35 Aug 27 04:55:19.631666 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-6ff50b2e-e9df-4fef-8a9f-5950b569f555 req-79219bfb-721a-483f-bb22-36d5e9df7b5d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038446 Aug 27 04:55:19.632822 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 490/960] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:55:19.721869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b6ffbcec-0ad2-46c6-8e04-2bc9839dcada tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:19.722491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b6ffbcec-0ad2-46c6-8e04-2bc9839dcada tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:19.733171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6ffbcec-0ad2-46c6-8e04-2bc9839dcada tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:19.734194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6ffbcec-0ad2-46c6-8e04-2bc9839dcada tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:19.734712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6ffbcec-0ad2-46c6-8e04-2bc9839dcada tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:19.736177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6ffbcec-0ad2-46c6-8e04-2bc9839dcada tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:19.736996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6ffbcec-0ad2-46c6-8e04-2bc9839dcada tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:19.737667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6ffbcec-0ad2-46c6-8e04-2bc9839dcada tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:19.937399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b6ffbcec-0ad2-46c6-8e04-2bc9839dcada tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:19.947659 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b6ffbcec-0ad2-46c6-8e04-2bc9839dcada tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.229481 Aug 27 04:55:19.948339 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 471/961] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:19 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:20.242778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-48319a63-c8dc-49a0-a591-a371022649f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:20.243720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:20.244187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-48319a63-c8dc-49a0-a591-a371022649f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:20.245191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:20.252655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:20.253465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:20.253590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48319a63-c8dc-49a0-a591-a371022649f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:20.253967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:20.254307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48319a63-c8dc-49a0-a591-a371022649f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:20.254817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:20.254926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48319a63-c8dc-49a0-a591-a371022649f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:20.255347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:20.255740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48319a63-c8dc-49a0-a591-a371022649f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:20.255998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:20.256271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48319a63-c8dc-49a0-a591-a371022649f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:20.256845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48319a63-c8dc-49a0-a591-a371022649f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:20.313115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:20.313909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:20.314366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:20.315745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lazy-loading 'fault' on Instance uuid 35d5a4df-1045-4b64-b58c-2383ce224d63 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:55:20.414148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:20.425052 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f20414d5-c339-48ed-ba6b-caf381a843a4 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 200 len: 1312 microversion: 2.1 time: 0.185283 Aug 27 04:55:20.428138 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 472/962] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:20 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:20.440976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-781ccb76-6599-4dfd-b842-373416352cc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:20.444068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-781ccb76-6599-4dfd-b842-373416352cc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:20.453850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-781ccb76-6599-4dfd-b842-373416352cc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:20.464184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-781ccb76-6599-4dfd-b842-373416352cc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:20.464918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-781ccb76-6599-4dfd-b842-373416352cc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:20.465847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-781ccb76-6599-4dfd-b842-373416352cc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:20.466600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-781ccb76-6599-4dfd-b842-373416352cc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:20.467236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-781ccb76-6599-4dfd-b842-373416352cc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:20.563460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-48319a63-c8dc-49a0-a591-a371022649f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:20.573647 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-48319a63-c8dc-49a0-a591-a371022649f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1316 microversion: 2.1 time: 0.336735 Aug 27 04:55:20.574281 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 491/963] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:20 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:20.587073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-781ccb76-6599-4dfd-b842-373416352cc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:20.587240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:20.587240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:20.587390 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-781ccb76-6599-4dfd-b842-373416352cc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1269 microversion: 2.1 time: 0.155645 Aug 27 04:55:20.587390 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 473/964] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:20 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:20.589252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:20.589804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:20.590342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:20.591134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:20.592547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:20.592990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:20.665651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:20.675663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:20.676656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:20.678202 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-98e4086e-b4b5-45e5-8d3e-2c0ea9f3177e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.102865 Aug 27 04:55:20.678971 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 492/965] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:20 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:20.973319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6a909ad-c8d8-4bba-a09c-471fe0eeb28a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:20.973952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6a909ad-c8d8-4bba-a09c-471fe0eeb28a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:20.982674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a909ad-c8d8-4bba-a09c-471fe0eeb28a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:20.983197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a909ad-c8d8-4bba-a09c-471fe0eeb28a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:20.983644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a909ad-c8d8-4bba-a09c-471fe0eeb28a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:20.984364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a909ad-c8d8-4bba-a09c-471fe0eeb28a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:20.984827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a909ad-c8d8-4bba-a09c-471fe0eeb28a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:20.985286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6a909ad-c8d8-4bba-a09c-471fe0eeb28a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:21.274416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6a909ad-c8d8-4bba-a09c-471fe0eeb28a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:21.291772 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6a909ad-c8d8-4bba-a09c-471fe0eeb28a tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.323316 Aug 27 04:55:21.304648 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 474/966] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:20 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:21.446384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:21.447282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:21.466683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:21.467236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:21.467682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:21.468413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:21.468873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:21.469334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:21.543458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:21.545039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:21.545828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:21.546573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lazy-loading 'fault' on Instance uuid 35d5a4df-1045-4b64-b58c-2383ce224d63 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:55:21.602871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e023d16f-8353-45d6-bf60-5fbae5802747 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:21.606476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e023d16f-8353-45d6-bf60-5fbae5802747 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:21.627063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e023d16f-8353-45d6-bf60-5fbae5802747 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:21.628415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e023d16f-8353-45d6-bf60-5fbae5802747 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:21.630150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e023d16f-8353-45d6-bf60-5fbae5802747 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:21.631308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e023d16f-8353-45d6-bf60-5fbae5802747 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:21.633688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e023d16f-8353-45d6-bf60-5fbae5802747 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:21.635120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e023d16f-8353-45d6-bf60-5fbae5802747 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:21.667139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:21.698307 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-37767ca5-6085-4f5b-9790-c51c8e0a05a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 200 len: 1312 microversion: 2.1 time: 0.250708 Aug 27 04:55:21.700772 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 493/967] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:21 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:21.719073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de29141c-5558-45a6-91dd-bd6dcdde27b0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:21.720111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de29141c-5558-45a6-91dd-bd6dcdde27b0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:21.729386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de29141c-5558-45a6-91dd-bd6dcdde27b0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:21.730391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de29141c-5558-45a6-91dd-bd6dcdde27b0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:21.731427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de29141c-5558-45a6-91dd-bd6dcdde27b0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:21.734151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de29141c-5558-45a6-91dd-bd6dcdde27b0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:21.736161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de29141c-5558-45a6-91dd-bd6dcdde27b0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:21.736817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de29141c-5558-45a6-91dd-bd6dcdde27b0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.229529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e023d16f-8353-45d6-bf60-5fbae5802747 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:22.242882 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e023d16f-8353-45d6-bf60-5fbae5802747 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1466 microversion: 2.1 time: 0.648367 Aug 27 04:55:22.245546 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 475/968] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:21 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1466 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:22.260050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:22.260986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:22.275004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:22.283734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:22.284580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.285598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:22.286171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:22.286705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.300841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de29141c-5558-45a6-91dd-bd6dcdde27b0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:22.311928 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de29141c-5558-45a6-91dd-bd6dcdde27b0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1317 microversion: 2.1 time: 0.608787 Aug 27 04:55:22.312894 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 494/969] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:21 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:22.324916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4b98ba8e-2740-43ec-b57e-75f4cbe17485 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:22.325776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4b98ba8e-2740-43ec-b57e-75f4cbe17485 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:22.333787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b98ba8e-2740-43ec-b57e-75f4cbe17485 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:22.343875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b98ba8e-2740-43ec-b57e-75f4cbe17485 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:22.344601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b98ba8e-2740-43ec-b57e-75f4cbe17485 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.345590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b98ba8e-2740-43ec-b57e-75f4cbe17485 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:22.346080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b98ba8e-2740-43ec-b57e-75f4cbe17485 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:22.346851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b98ba8e-2740-43ec-b57e-75f4cbe17485 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.424252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:22.436598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:22.440022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:22.442518 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-973f5a97-1582-4dff-872b-ad1c323e3949 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.193972 Aug 27 04:55:22.444316 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 476/970] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:22 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:22.450150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e534f0c-980d-4e8e-ae35-1b2f936b8ba6 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:22.451223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e534f0c-980d-4e8e-ae35-1b2f936b8ba6 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:22.461162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e534f0c-980d-4e8e-ae35-1b2f936b8ba6 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:22.462002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e534f0c-980d-4e8e-ae35-1b2f936b8ba6 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:22.463008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e534f0c-980d-4e8e-ae35-1b2f936b8ba6 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.464045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e534f0c-980d-4e8e-ae35-1b2f936b8ba6 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:22.464728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e534f0c-980d-4e8e-ae35-1b2f936b8ba6 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:22.466046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e534f0c-980d-4e8e-ae35-1b2f936b8ba6 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.749956 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4b98ba8e-2740-43ec-b57e-75f4cbe17485 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1619 microversion: 2.1 time: 0.435906 Aug 27 04:55:22.750625 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 495/971] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:22 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1619 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:22.776322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:22.777209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:22.793477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:22.796570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:22.806311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.809757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:22.810558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:22.813113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.839010 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] HTTP exception thrown: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Request method failure captured: Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 HTTP/1.1 Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaN9p80i7VzzZ3N0Ow-qcbmbUNxdpBEQt3q20xICDr7dsI1hzIcxkholQmsRqxgKpEYvQwSnRrPROwy4alJy0ksg-McIfoWyz1B85M2GBDbxz_qRoZdZPU8ddLoHEcLqWw-poQjwfwEP-iOAfhgHqlgyEJGC4zGb5Fsn1l56GXmw2r8 Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:22.843560 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9d672c3f0e4c4128ad7c4b3a1c1fd868", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: dcf7892387894e07a7e0f35c70a5e1dd Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:22.845169 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '35d5a4df-1045-4b64-b58c-2383ce224d63'} Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:22.846067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:22.847580 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:22.850543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Returning 404 to user: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:22.851680 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-44d07997-bc34-426a-8c76-340d5aedac0c tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 404 len: 111 microversion: 2.1 time: 0.085689 Aug 27 04:55:22.853278 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 496/972] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:22 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:55:22.864681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e6e4a451-93e4-4964-bfb3-a897958311f5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:22.884083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e534f0c-980d-4e8e-ae35-1b2f936b8ba6 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:22.910693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e6e4a451-93e4-4964-bfb3-a897958311f5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:22.911830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e534f0c-980d-4e8e-ae35-1b2f936b8ba6 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.466058 Aug 27 04:55:22.919346 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 477/973] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:22 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:22.920576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e6e4a451-93e4-4964-bfb3-a897958311f5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:55:22.928429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e4a451-93e4-4964-bfb3-a897958311f5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:22.929256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e4a451-93e4-4964-bfb3-a897958311f5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:22.929844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e4a451-93e4-4964-bfb3-a897958311f5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.931600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e4a451-93e4-4964-bfb3-a897958311f5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:22.932332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e4a451-93e4-4964-bfb3-a897958311f5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:22.933060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e4a451-93e4-4964-bfb3-a897958311f5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.968186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-244080354", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "198422a0-c1e8-4c71-9ecd-43b3c3e0178d"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:23.069272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:55:23.124873 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e6e4a451-93e4-4964-bfb3-a897958311f5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.266455 Aug 27 04:55:23.126363 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 497/974] 10.222.0.58 () {58 vars in 1230 bytes} [Sat Aug 27 04:55:22 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:55:23.141974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-438d539d-82f9-4494-963b-96b76127ee67 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-438d539d-82f9-4494-963b-96b76127ee67 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Request method failure captured: Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaN9p80i7VzzZ3N0Ow-qcbmbUNxdpBEQt3q20xICDr7dsI1hzIcxkholQmsRqxgKpEYvQwSnRrPROwy4alJy0ksg-McIfoWyz1B85M2GBDbxz_qRoZdZPU8ddLoHEcLqWw-poQjwfwEP-iOAfhgHqlgyEJGC4zGb5Fsn1l56GXmw2r8 Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:23.154682 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9d672c3f0e4c4128ad7c4b3a1c1fd868", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: dcf7892387894e07a7e0f35c70a5e1dd Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 04:55:23.156180 n-d-820368-35 devstack@n-api.service[128547]: action_args: {} Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:23.156914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:23.158274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:23.159501 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:55:23.159501 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:55:23.159501 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 04:55:23.159501 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.162665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-438d539d-82f9-4494-963b-96b76127ee67 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:23.164205 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-438d539d-82f9-4494-963b-96b76127ee67 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.026290 Aug 27 04:55:23.166501 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 498/975] 10.222.0.58 () {58 vars in 1182 bytes} [Sat Aug 27 04:55:23 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:55:23.172345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-19a4cbdd-7e34-4aee-9cd2-f775399bab55 req-c099b747-fd37-42ff-9b11-2cc3a1af11fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ea01df-9498-452f-b285-a3c01aa2fcae", "name": "network-vif-plugged", "status": "completed", "tag": "05c43341-73e9-4a72-9a96-baad1ae0699a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:23.184454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-19a4cbdd-7e34-4aee-9cd2-f775399bab55 req-c099b747-fd37-42ff-9b11-2cc3a1af11fb service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.185436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-19a4cbdd-7e34-4aee-9cd2-f775399bab55 req-c099b747-fd37-42ff-9b11-2cc3a1af11fb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.186091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-19a4cbdd-7e34-4aee-9cd2-f775399bab55 req-c099b747-fd37-42ff-9b11-2cc3a1af11fb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.201691 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-19a4cbdd-7e34-4aee-9cd2-f775399bab55 req-c099b747-fd37-42ff-9b11-2cc3a1af11fb service nova] Creating event network-vif-plugged:05c43341-73e9-4a72-9a96-baad1ae0699a for instance 87ea01df-9498-452f-b285-a3c01aa2fcae on n-h2-820368-35 Aug 27 04:55:23.215368 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-19a4cbdd-7e34-4aee-9cd2-f775399bab55 req-c099b747-fd37-42ff-9b11-2cc3a1af11fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047374 Aug 27 04:55:23.216930 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 499/976] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:23.223342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53a6b60d-7209-48b6-abcf-0a0f145d01ff tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:23.228545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-53a6b60d-7209-48b6-abcf-0a0f145d01ff tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:23.230180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-53a6b60d-7209-48b6-abcf-0a0f145d01ff tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Searching by: {'deleted': False, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:55:23.236075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a6b60d-7209-48b6-abcf-0a0f145d01ff tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.237015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a6b60d-7209-48b6-abcf-0a0f145d01ff tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.237663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a6b60d-7209-48b6-abcf-0a0f145d01ff tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.239175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a6b60d-7209-48b6-abcf-0a0f145d01ff tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.239844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a6b60d-7209-48b6-abcf-0a0f145d01ff tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.240574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a6b60d-7209-48b6-abcf-0a0f145d01ff tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.291463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-53a6b60d-7209-48b6-abcf-0a0f145d01ff tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:55:23.369697 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-53a6b60d-7209-48b6-abcf-0a0f145d01ff tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.150195 Aug 27 04:55:23.371770 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 500/977] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 04:55:23 2022] GET /compute/v2.1/servers => generated 681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:23.378554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-243af93e-fab5-4abe-b1dd-91f2ffaffceb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:23.379749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-243af93e-fab5-4abe-b1dd-91f2ffaffceb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:23.388197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-243af93e-fab5-4abe-b1dd-91f2ffaffceb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.389150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-243af93e-fab5-4abe-b1dd-91f2ffaffceb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.390289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-243af93e-fab5-4abe-b1dd-91f2ffaffceb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.391864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-243af93e-fab5-4abe-b1dd-91f2ffaffceb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.392545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-243af93e-fab5-4abe-b1dd-91f2ffaffceb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.393179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-243af93e-fab5-4abe-b1dd-91f2ffaffceb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.665663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:55:23.667555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:55:23.668397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:55:23.669722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:55:23.672472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:55:23.687041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.688904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.689572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.690597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.691659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.692327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.730847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:23.735021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-243af93e-fab5-4abe-b1dd-91f2ffaffceb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:23.739235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Getting quotas for user 113873d86b0c417e92a88af412281fe6 and project 4074bf02227441b091b6e7d62f83b9e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:23.744400 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-243af93e-fab5-4abe-b1dd-91f2ffaffceb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1317 microversion: 2.1 time: 0.371104 Aug 27 04:55:23.747079 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 501/978] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:23 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:23.752696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:23.760688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:23.761453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.compute.servers [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Removing options 'limit' from query {{(pid=128547) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1510}} Aug 27 04:55:23.762516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Searching by: {'deleted': False, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:55:23.771800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.775134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.775660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.776451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.776914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.777338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.785342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:55:23.787743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:55:23.813720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:55:23.855548 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1293e023-c366-4325-a3e7-66be43011ecd tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.107168 Aug 27 04:55:23.857008 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 502/979] 10.222.0.58 () {58 vars in 1144 bytes} [Sat Aug 27 04:55:23 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:23.864680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:23.865747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:23.873807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.874871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.875602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.876783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.877802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.878794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.907038 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6ac3dde9-472f-4da1-a4fc-00bb3453f9f3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942884 Aug 27 04:55:23.908696 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 478/980] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:55:23.920833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c54f1ab5-e598-4f44-9201-c7adb5bd2234 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c54f1ab5-e598-4f44-9201-c7adb5bd2234 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Request method failure captured: Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaN9p80i7VzzZ3N0Ow-qcbmbUNxdpBEQt3q20xICDr7dsI1hzIcxkholQmsRqxgKpEYvQwSnRrPROwy4alJy0ksg-McIfoWyz1B85M2GBDbxz_qRoZdZPU8ddLoHEcLqWw-poQjwfwEP-iOAfhgHqlgyEJGC4zGb5Fsn1l56GXmw2r8 Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:55:23.937368 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9d672c3f0e4c4128ad7c4b3a1c1fd868", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: dcf7892387894e07a7e0f35c70a5e1dd Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 04:55:23.938666 n-d-820368-35 devstack@n-api.service[128548]: action_args: {} Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi '-1' Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:23.939550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.940975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:23.942126 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:23.942126 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:23.942126 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:55:23.942126 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:55:23.942126 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 04:55:23.942126 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:23.949296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c54f1ab5-e598-4f44-9201-c7adb5bd2234 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:23.950436 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c54f1ab5-e598-4f44-9201-c7adb5bd2234 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.040646 Aug 27 04:55:23.951298 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 479/981] 10.222.0.58 () {58 vars in 1142 bytes} [Sat Aug 27 04:55:23 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:55:23.956462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3e87808b-ae8e-4f85-a8de-06f16f34ef26 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:23.957340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3e87808b-ae8e-4f85-a8de-06f16f34ef26 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:24.130575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:24.182352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:24.193645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:24.196846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:24.198727 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f44a3109-b8c9-4f2e-afa6-a986a4ca5d3c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.340304 Aug 27 04:55:24.199887 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 503/982] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:23 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:24.204830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2cfe0946-0ad5-4a01-8012-21de92af0ddb tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:24.205757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2cfe0946-0ad5-4a01-8012-21de92af0ddb tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:24.209086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3e87808b-ae8e-4f85-a8de-06f16f34ef26 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:24.220238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfe0946-0ad5-4a01-8012-21de92af0ddb tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.220883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfe0946-0ad5-4a01-8012-21de92af0ddb tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.222033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfe0946-0ad5-4a01-8012-21de92af0ddb tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.223551 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3e87808b-ae8e-4f85-a8de-06f16f34ef26 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1216 microversion: 2.1 time: 0.267713 Aug 27 04:55:24.224570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfe0946-0ad5-4a01-8012-21de92af0ddb tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.226480 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 480/983] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:23 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1216 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:24.239015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfe0946-0ad5-4a01-8012-21de92af0ddb tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.239558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfe0946-0ad5-4a01-8012-21de92af0ddb tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.245986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89102956-8d82-46a5-b445-bf496ed62ed7 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89102956-8d82-46a5-b445-bf496ed62ed7 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Request method failure captured: Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaN9p80i7VzzZ3N0Ow-qcbmbUNxdpBEQt3q20xICDr7dsI1hzIcxkholQmsRqxgKpEYvQwSnRrPROwy4alJy0ksg-McIfoWyz1B85M2GBDbxz_qRoZdZPU8ddLoHEcLqWw-poQjwfwEP-iOAfhgHqlgyEJGC4zGb5Fsn1l56GXmw2r8 Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:55:24.251907 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9d672c3f0e4c4128ad7c4b3a1c1fd868", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: dcf7892387894e07a7e0f35c70a5e1dd Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 04:55:24.253376 n-d-820368-35 devstack@n-api.service[128548]: action_args: {} Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'testing' Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:24.254103 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:24.255681 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:24.256923 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:24.256923 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:24.256923 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:55:24.256923 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:55:24.256923 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 04:55:24.256923 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:24.276001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89102956-8d82-46a5-b445-bf496ed62ed7 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:24.283469 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89102956-8d82-46a5-b445-bf496ed62ed7 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.052394 Aug 27 04:55:24.298942 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 481/984] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 04:55:24 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:55:24.312802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-bada15d6-be71-4f24-bbb9-343c2f89f07b req-7d2868c9-2bea-4563-9e38-bba8ea9ab484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb8d618-f311-4f64-825c-f1816fe41876", "tag": "35ed7764-fd62-4b34-a259-e6ca2280e1f2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:24.338531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bada15d6-be71-4f24-bbb9-343c2f89f07b req-7d2868c9-2bea-4563-9e38-bba8ea9ab484 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.339889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bada15d6-be71-4f24-bbb9-343c2f89f07b req-7d2868c9-2bea-4563-9e38-bba8ea9ab484 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.340810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bada15d6-be71-4f24-bbb9-343c2f89f07b req-7d2868c9-2bea-4563-9e38-bba8ea9ab484 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.365717 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-bada15d6-be71-4f24-bbb9-343c2f89f07b req-7d2868c9-2bea-4563-9e38-bba8ea9ab484 service nova] Creating event network-changed:35ed7764-fd62-4b34-a259-e6ca2280e1f2 for instance 0fb8d618-f311-4f64-825c-f1816fe41876 on n-h2-820368-35 Aug 27 04:55:24.380622 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-bada15d6-be71-4f24-bbb9-343c2f89f07b req-7d2868c9-2bea-4563-9e38-bba8ea9ab484 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073456 Aug 27 04:55:24.381370 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 482/985] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:24.387776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dda26582-def3-4ac3-b069-ba22d913e8a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:24.407433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dda26582-def3-4ac3-b069-ba22d913e8a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:24.412677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dda26582-def3-4ac3-b069-ba22d913e8a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:55:24.427419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.compute.servers [None req-dda26582-def3-4ac3-b069-ba22d913e8a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Flavor 'non_existing_flavor' could not be found {{(pid=128548) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 27 04:55:24.428708 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dda26582-def3-4ac3-b069-ba22d913e8a9 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.045444 Aug 27 04:55:24.429899 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 483/986] 10.222.0.58 () {58 vars in 1178 bytes} [Sat Aug 27 04:55:24 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:55:24.441828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0216d794-34b1-4e8c-88c9-f70a842824fc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:24.452239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0216d794-34b1-4e8c-88c9-f70a842824fc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:24.459157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0216d794-34b1-4e8c-88c9-f70a842824fc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:55:24.468664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0216d794-34b1-4e8c-88c9-f70a842824fc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.472218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0216d794-34b1-4e8c-88c9-f70a842824fc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.472744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0216d794-34b1-4e8c-88c9-f70a842824fc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.474211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0216d794-34b1-4e8c-88c9-f70a842824fc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.474770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0216d794-34b1-4e8c-88c9-f70a842824fc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.475316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0216d794-34b1-4e8c-88c9-f70a842824fc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.494085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2cfe0946-0ad5-4a01-8012-21de92af0ddb tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:24.509343 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2cfe0946-0ad5-4a01-8012-21de92af0ddb tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1371 microversion: 2.1 time: 0.308368 Aug 27 04:55:24.519614 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 504/987] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:24 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:24.576265 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0216d794-34b1-4e8c-88c9-f70a842824fc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.138498 Aug 27 04:55:24.576791 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 484/988] 10.222.0.58 () {58 vars in 1174 bytes} [Sat Aug 27 04:55:24 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:55:24.588830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-26a79411-e5ae-4488-91fb-15b00fb86c50 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:24.595653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-26a79411-e5ae-4488-91fb-15b00fb86c50 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:24.596470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-26a79411-e5ae-4488-91fb-15b00fb86c50 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:55:24.602924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26a79411-e5ae-4488-91fb-15b00fb86c50 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.603513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26a79411-e5ae-4488-91fb-15b00fb86c50 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.603956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26a79411-e5ae-4488-91fb-15b00fb86c50 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.604692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26a79411-e5ae-4488-91fb-15b00fb86c50 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.605151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26a79411-e5ae-4488-91fb-15b00fb86c50 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.605629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26a79411-e5ae-4488-91fb-15b00fb86c50 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.704066 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-26a79411-e5ae-4488-91fb-15b00fb86c50 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.118938 Aug 27 04:55:24.705012 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 505/989] 10.222.0.58 () {58 vars in 1184 bytes} [Sat Aug 27 04:55:24 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:55:24.716774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:24.722492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:24.723632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Searching by: {'deleted': False, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:55:24.730014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.730814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.731492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.732416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.733060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.733688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.771360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-18e38d73-6ad9-4fb6-90de-f137f88792f0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:24.773478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-18e38d73-6ad9-4fb6-90de-f137f88792f0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:24.780750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e38d73-6ad9-4fb6-90de-f137f88792f0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.781492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e38d73-6ad9-4fb6-90de-f137f88792f0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.782238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e38d73-6ad9-4fb6-90de-f137f88792f0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.783249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e38d73-6ad9-4fb6-90de-f137f88792f0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.783891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e38d73-6ad9-4fb6-90de-f137f88792f0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.784484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e38d73-6ad9-4fb6-90de-f137f88792f0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.890834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:55:24.946650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:25.045434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:25.053477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.054461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.055110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.070250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-18e38d73-6ad9-4fb6-90de-f137f88792f0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:25.078581 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-18e38d73-6ad9-4fb6-90de-f137f88792f0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1317 microversion: 2.1 time: 0.314506 Aug 27 04:55:25.091151 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 506/990] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:24 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:25.225738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:25.226394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:25.232736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.233459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.234119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.235353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.236016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.236452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.297729 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5581ff2c-246a-4ab1-884f-61d0852b89d5 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.584891 Aug 27 04:55:25.298896 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 485/991] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:55:24 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:25.305788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-83b5f1ad-2163-4d35-98ea-7a899756c892 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:25.308428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-83b5f1ad-2163-4d35-98ea-7a899756c892 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:25.315774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83b5f1ad-2163-4d35-98ea-7a899756c892 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.316962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83b5f1ad-2163-4d35-98ea-7a899756c892 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.318625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83b5f1ad-2163-4d35-98ea-7a899756c892 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.319689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83b5f1ad-2163-4d35-98ea-7a899756c892 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.320876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83b5f1ad-2163-4d35-98ea-7a899756c892 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.321518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83b5f1ad-2163-4d35-98ea-7a899756c892 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.368246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:25.404410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:25.416852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:25.419698 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0b2a8b8e-1f53-4877-a08b-bde8306009d9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.198472 Aug 27 04:55:25.424543 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 507/992] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:25 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:25.432070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40fc3de5-24b3-4ce3-ab11-7701938ca480 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:25.437917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-40fc3de5-24b3-4ce3-ab11-7701938ca480 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:25.439441 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40fc3de5-24b3-4ce3-ab11-7701938ca480 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013470 Aug 27 04:55:25.456209 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 508/993] 10.222.0.58 () {58 vars in 1178 bytes} [Sat Aug 27 04:55:25 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:55:25.480670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-943da685-ad5d-4017-96f3-7efffab61521 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:25.515695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-943da685-ad5d-4017-96f3-7efffab61521 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:25.516661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-943da685-ad5d-4017-96f3-7efffab61521 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Searching by: {'deleted': False, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:55:25.524349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-943da685-ad5d-4017-96f3-7efffab61521 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.527268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-943da685-ad5d-4017-96f3-7efffab61521 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.527941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-943da685-ad5d-4017-96f3-7efffab61521 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.528897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-943da685-ad5d-4017-96f3-7efffab61521 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.530623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-943da685-ad5d-4017-96f3-7efffab61521 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.532039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-943da685-ad5d-4017-96f3-7efffab61521 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.532398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-83b5f1ad-2163-4d35-98ea-7a899756c892 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:25.560881 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-83b5f1ad-2163-4d35-98ea-7a899756c892 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1268 microversion: 2.1 time: 0.260697 Aug 27 04:55:25.572641 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 486/994] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:25 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1268 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:25.588204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-06ae0d1f-ad94-4b8d-a4e9-837d998759f4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:25.591148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-06ae0d1f-ad94-4b8d-a4e9-837d998759f4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:25.598983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-943da685-ad5d-4017-96f3-7efffab61521 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:55:25.610566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06ae0d1f-ad94-4b8d-a4e9-837d998759f4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.611897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06ae0d1f-ad94-4b8d-a4e9-837d998759f4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.613327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06ae0d1f-ad94-4b8d-a4e9-837d998759f4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.615622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06ae0d1f-ad94-4b8d-a4e9-837d998759f4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.616524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06ae0d1f-ad94-4b8d-a4e9-837d998759f4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.620079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06ae0d1f-ad94-4b8d-a4e9-837d998759f4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.643194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:25.715033 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-943da685-ad5d-4017-96f3-7efffab61521 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.243665 Aug 27 04:55:25.721409 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 509/995] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 04:55:25 2022] GET /compute/v2.1/servers => generated 681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:25.736088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:25.736601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:25.754222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.754490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.754972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.757669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.758132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.758558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.795584 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] HTTP exception thrown: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Request method failure captured: Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 HTTP/1.1 Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaN9p80i7VzzZ3N0Ow-qcbmbUNxdpBEQt3q20xICDr7dsI1hzIcxkholQmsRqxgKpEYvQwSnRrPROwy4alJy0ksg-McIfoWyz1B85M2GBDbxz_qRoZdZPU8ddLoHEcLqWw-poQjwfwEP-iOAfhgHqlgyEJGC4zGb5Fsn1l56GXmw2r8 Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:25.800344 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9d672c3f0e4c4128ad7c4b3a1c1fd868", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: dcf7892387894e07a7e0f35c70a5e1dd Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:25.801926 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '35d5a4df-1045-4b64-b58c-2383ce224d63'} Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:25.802657 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:25.803991 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:25.807944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Returning 404 to user: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:25.808952 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-44ae3b66-d2c3-4ea8-8e76-760ae5d50f04 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "DELETE /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 404 len: 111 microversion: 2.1 time: 0.076694 Aug 27 04:55:25.809605 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 510/996] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:55:25 2022] DELETE /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:55:25.817999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ca2ed55-3e0a-486e-bcac-eb85fff916bf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:25.832523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3ca2ed55-3e0a-486e-bcac-eb85fff916bf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: f8f4d090-8163-469c-b801-7864b9155ed3] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:25.847739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ca2ed55-3e0a-486e-bcac-eb85fff916bf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.852693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ca2ed55-3e0a-486e-bcac-eb85fff916bf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.853292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ca2ed55-3e0a-486e-bcac-eb85fff916bf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.854300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ca2ed55-3e0a-486e-bcac-eb85fff916bf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.854838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ca2ed55-3e0a-486e-bcac-eb85fff916bf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.855355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ca2ed55-3e0a-486e-bcac-eb85fff916bf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.915505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3ca2ed55-3e0a-486e-bcac-eb85fff916bf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: f8f4d090-8163-469c-b801-7864b9155ed3] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:55:25.978566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-06ae0d1f-ad94-4b8d-a4e9-837d998759f4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:25.986768 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-06ae0d1f-ad94-4b8d-a4e9-837d998759f4 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1557 microversion: 2.1 time: 0.412787 Aug 27 04:55:25.990455 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 487/997] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:25 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1557 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:26.015621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1b10ffea-a0ae-41ac-b6de-bcb3d58cfd33 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:26.016381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1b10ffea-a0ae-41ac-b6de-bcb3d58cfd33 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:26.026345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b10ffea-a0ae-41ac-b6de-bcb3d58cfd33 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.027110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b10ffea-a0ae-41ac-b6de-bcb3d58cfd33 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.027736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b10ffea-a0ae-41ac-b6de-bcb3d58cfd33 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.028599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b10ffea-a0ae-41ac-b6de-bcb3d58cfd33 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.029256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b10ffea-a0ae-41ac-b6de-bcb3d58cfd33 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.029850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b10ffea-a0ae-41ac-b6de-bcb3d58cfd33 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.062740 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3ca2ed55-3e0a-486e-bcac-eb85fff916bf tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3" status: 204 len: 0 microversion: 2.1 time: 0.248132 Aug 27 04:55:26.063798 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 511/998] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:55:25 2022] DELETE /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:55:26.082948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-15690eb5-6c65-43e8-9e59-08082f913341 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:26.086087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-15690eb5-6c65-43e8-9e59-08082f913341 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:26.092653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15690eb5-6c65-43e8-9e59-08082f913341 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.093142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15690eb5-6c65-43e8-9e59-08082f913341 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.093791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15690eb5-6c65-43e8-9e59-08082f913341 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.094668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15690eb5-6c65-43e8-9e59-08082f913341 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.095307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15690eb5-6c65-43e8-9e59-08082f913341 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.095949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15690eb5-6c65-43e8-9e59-08082f913341 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.130199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-15690eb5-6c65-43e8-9e59-08082f913341 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:55:26.169426 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1b10ffea-a0ae-41ac-b6de-bcb3d58cfd33 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156878 Aug 27 04:55:26.170495 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 488/999] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 04:55:26 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:26.182388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2a6d23ce-ce29-40c9-9b6d-c9f62a15e7b8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:26.184807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2a6d23ce-ce29-40c9-9b6d-c9f62a15e7b8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:26.200250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a6d23ce-ce29-40c9-9b6d-c9f62a15e7b8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.201269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a6d23ce-ce29-40c9-9b6d-c9f62a15e7b8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.202196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a6d23ce-ce29-40c9-9b6d-c9f62a15e7b8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.203187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a6d23ce-ce29-40c9-9b6d-c9f62a15e7b8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.203859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a6d23ce-ce29-40c9-9b6d-c9f62a15e7b8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.204504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a6d23ce-ce29-40c9-9b6d-c9f62a15e7b8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.274060 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-15690eb5-6c65-43e8-9e59-08082f913341 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 204 len: 0 microversion: 2.1 time: 0.204778 Aug 27 04:55:26.276843 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 512/1000] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:55:26 2022] DELETE /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:55:26.290020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:26.292046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: 35d5a4df-1045-4b64-b58c-2383ce224d63] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:26.313467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.314009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.319009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.319867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.320352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.320820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.355999 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] HTTP exception thrown: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Request method failure captured: Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 HTTP/1.1 Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaN9p80i7VzzZ3N0Ow-qcbmbUNxdpBEQt3q20xICDr7dsI1hzIcxkholQmsRqxgKpEYvQwSnRrPROwy4alJy0ksg-McIfoWyz1B85M2GBDbxz_qRoZdZPU8ddLoHEcLqWw-poQjwfwEP-iOAfhgHqlgyEJGC4zGb5Fsn1l56GXmw2r8 Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:26.358887 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9d672c3f0e4c4128ad7c4b3a1c1fd868", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: dcf7892387894e07a7e0f35c70a5e1dd Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:26.360564 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '35d5a4df-1045-4b64-b58c-2383ce224d63'} Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:26.361274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. Aug 27 04:55:26.362433 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:26.363519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Returning 404 to user: Instance 35d5a4df-1045-4b64-b58c-2383ce224d63 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:26.363519 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-222c87d1-244e-438b-b346-e454db10e952 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63" status: 404 len: 111 microversion: 2.1 time: 0.079095 Aug 27 04:55:26.365989 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 513/1001] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:26 2022] GET /compute/v2.1/servers/35d5a4df-1045-4b64-b58c-2383ce224d63 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:55:26.372613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-48eefb80-a801-4b9d-913b-3a8e81e0acaa tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:26.373277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-48eefb80-a801-4b9d-913b-3a8e81e0acaa tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: f8f4d090-8163-469c-b801-7864b9155ed3] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:26.381926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48eefb80-a801-4b9d-913b-3a8e81e0acaa tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.382979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48eefb80-a801-4b9d-913b-3a8e81e0acaa tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.383462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48eefb80-a801-4b9d-913b-3a8e81e0acaa tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.384177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48eefb80-a801-4b9d-913b-3a8e81e0acaa tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.384628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48eefb80-a801-4b9d-913b-3a8e81e0acaa tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.385058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48eefb80-a801-4b9d-913b-3a8e81e0acaa tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.420455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2a6d23ce-ce29-40c9-9b6d-c9f62a15e7b8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:26.442332 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2a6d23ce-ce29-40c9-9b6d-c9f62a15e7b8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1317 microversion: 2.1 time: 0.270640 Aug 27 04:55:26.443315 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 489/1002] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:26 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:26.452389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:26.453365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:26.472298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.472900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.473355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.474105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.476545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.477146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.629484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:26.640129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:26.642959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:26.646006 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f83e8bc6-77d3-461b-b49d-81369ca0937f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.201382 Aug 27 04:55:26.650304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-48eefb80-a801-4b9d-913b-3a8e81e0acaa tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:26.659607 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-48eefb80-a801-4b9d-913b-3a8e81e0acaa tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3" status: 200 len: 1522 microversion: 2.1 time: 0.292243 Aug 27 04:55:26.660853 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 490/1003] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:26 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:26.661245 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 514/1004] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:26 2022] GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:26.689224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5865ee4b-f110-49eb-9d5e-c35bd35498f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:26.690043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5865ee4b-f110-49eb-9d5e-c35bd35498f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:26.697316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5865ee4b-f110-49eb-9d5e-c35bd35498f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.698023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5865ee4b-f110-49eb-9d5e-c35bd35498f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.698610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5865ee4b-f110-49eb-9d5e-c35bd35498f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.699746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5865ee4b-f110-49eb-9d5e-c35bd35498f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.700400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5865ee4b-f110-49eb-9d5e-c35bd35498f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.701183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5865ee4b-f110-49eb-9d5e-c35bd35498f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.903880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0bf12876-f12a-4c15-92f3-7f5961be87f3 req-efc48acc-e633-4e8e-8dab-bd92ed6d70a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd002ec2-35f3-43fb-b976-ecb02f1b7738", "name": "network-vif-plugged", "status": "completed", "tag": "4783370e-a485-40e1-8ea2-5a10e13b0d87"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:26.922092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0bf12876-f12a-4c15-92f3-7f5961be87f3 req-efc48acc-e633-4e8e-8dab-bd92ed6d70a3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:26.923662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0bf12876-f12a-4c15-92f3-7f5961be87f3 req-efc48acc-e633-4e8e-8dab-bd92ed6d70a3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:26.924282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0bf12876-f12a-4c15-92f3-7f5961be87f3 req-efc48acc-e633-4e8e-8dab-bd92ed6d70a3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.944363 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0bf12876-f12a-4c15-92f3-7f5961be87f3 req-efc48acc-e633-4e8e-8dab-bd92ed6d70a3 service nova] Creating event network-vif-plugged:4783370e-a485-40e1-8ea2-5a10e13b0d87 for instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 on n-h1-820368-35 Aug 27 04:55:26.952323 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0bf12876-f12a-4c15-92f3-7f5961be87f3 req-efc48acc-e633-4e8e-8dab-bd92ed6d70a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060643 Aug 27 04:55:26.954442 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 515/1005] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:27.252310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5865ee4b-f110-49eb-9d5e-c35bd35498f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:27.261191 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5865ee4b-f110-49eb-9d5e-c35bd35498f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1276 microversion: 2.1 time: 0.599066 Aug 27 04:55:27.262266 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 491/1006] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:26 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1276 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:27.543385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d5d7d73-6672-4760-89c5-0972eb22bf2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:27.544349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7d5d7d73-6672-4760-89c5-0972eb22bf2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:27.557073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d5d7d73-6672-4760-89c5-0972eb22bf2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:27.557582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d5d7d73-6672-4760-89c5-0972eb22bf2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:27.558027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d5d7d73-6672-4760-89c5-0972eb22bf2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:27.558752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d5d7d73-6672-4760-89c5-0972eb22bf2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:27.562016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d5d7d73-6672-4760-89c5-0972eb22bf2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:27.562512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d5d7d73-6672-4760-89c5-0972eb22bf2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:27.689767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:27.690398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:27.704217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:27.708174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:27.708651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:27.709563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:27.710023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:27.711688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:27.980805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:28.015741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:28.019583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:28.024335 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5154bb53-482a-4c8c-9d96-d72e4194d75c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.339923 Aug 27 04:55:28.033928 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 492/1007] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:27 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:28.055411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f74da9f-3061-40ed-8670-826a0df38dc0 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:28.062958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f74da9f-3061-40ed-8670-826a0df38dc0 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: f8f4d090-8163-469c-b801-7864b9155ed3] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:28.089182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f74da9f-3061-40ed-8670-826a0df38dc0 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:28.089731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f74da9f-3061-40ed-8670-826a0df38dc0 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:28.097361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f74da9f-3061-40ed-8670-826a0df38dc0 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:28.098163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f74da9f-3061-40ed-8670-826a0df38dc0 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:28.098650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f74da9f-3061-40ed-8670-826a0df38dc0 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:28.099131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f74da9f-3061-40ed-8670-826a0df38dc0 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:28.336205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7d5d7d73-6672-4760-89c5-0972eb22bf2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:28.346310 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7d5d7d73-6672-4760-89c5-0972eb22bf2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1317 microversion: 2.1 time: 0.809082 Aug 27 04:55:28.351868 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 516/1008] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:27 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1317 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:28.362258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-09abb6b4-7eff-435e-b5ed-2113182a6159 req-77ff8760-8987-4ce1-8a7c-350995a28480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ea01df-9498-452f-b285-a3c01aa2fcae", "tag": "05c43341-73e9-4a72-9a96-baad1ae0699a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:28.390482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-09abb6b4-7eff-435e-b5ed-2113182a6159 req-77ff8760-8987-4ce1-8a7c-350995a28480 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:28.391141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-09abb6b4-7eff-435e-b5ed-2113182a6159 req-77ff8760-8987-4ce1-8a7c-350995a28480 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:28.391659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-09abb6b4-7eff-435e-b5ed-2113182a6159 req-77ff8760-8987-4ce1-8a7c-350995a28480 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:28.405355 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-09abb6b4-7eff-435e-b5ed-2113182a6159 req-77ff8760-8987-4ce1-8a7c-350995a28480 service nova] Creating event network-changed:05c43341-73e9-4a72-9a96-baad1ae0699a for instance 87ea01df-9498-452f-b285-a3c01aa2fcae on n-h2-820368-35 Aug 27 04:55:28.411146 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-09abb6b4-7eff-435e-b5ed-2113182a6159 req-77ff8760-8987-4ce1-8a7c-350995a28480 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057868 Aug 27 04:55:28.417563 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 517/1009] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:28.424231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6fd31030-0e73-415c-be5b-722adf05460d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:28.425282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6fd31030-0e73-415c-be5b-722adf05460d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:28.432996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fd31030-0e73-415c-be5b-722adf05460d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:28.433777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fd31030-0e73-415c-be5b-722adf05460d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:28.434421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fd31030-0e73-415c-be5b-722adf05460d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:28.435561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fd31030-0e73-415c-be5b-722adf05460d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:28.436677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fd31030-0e73-415c-be5b-722adf05460d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:28.438209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fd31030-0e73-415c-be5b-722adf05460d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:28.484789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f74da9f-3061-40ed-8670-826a0df38dc0 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:28.494323 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f74da9f-3061-40ed-8670-826a0df38dc0 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3" status: 200 len: 1522 microversion: 2.1 time: 0.458004 Aug 27 04:55:28.495127 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 493/1010] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:28 2022] GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:28.565786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6fd31030-0e73-415c-be5b-722adf05460d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:28.574416 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6fd31030-0e73-415c-be5b-722adf05460d tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1274 microversion: 2.1 time: 0.155222 Aug 27 04:55:28.575003 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 518/1011] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:28 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1274 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:29.049175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:29.050086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:29.064298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:29.066152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:29.066975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:29.067872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:29.068489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:29.069073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:29.372453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:29.382018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d8e51952-f310-4818-9ab2-0c32524bc50f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:29.383307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d8e51952-f310-4818-9ab2-0c32524bc50f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:29.387499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:29.390114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:29.393876 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5ca99187-9a32-43ba-a762-a545d6c3fe87 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.348567 Aug 27 04:55:29.395149 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 494/1012] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:29 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:29.401204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e51952-f310-4818-9ab2-0c32524bc50f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:29.401650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e51952-f310-4818-9ab2-0c32524bc50f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:29.402091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e51952-f310-4818-9ab2-0c32524bc50f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:29.411296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e51952-f310-4818-9ab2-0c32524bc50f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:29.411985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e51952-f310-4818-9ab2-0c32524bc50f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:29.415574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e51952-f310-4818-9ab2-0c32524bc50f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:29.517539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d0bd5f91-ebdf-418c-826e-9eddf760797b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:29.518867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d0bd5f91-ebdf-418c-826e-9eddf760797b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: f8f4d090-8163-469c-b801-7864b9155ed3] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:29.547133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0bd5f91-ebdf-418c-826e-9eddf760797b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:29.555941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0bd5f91-ebdf-418c-826e-9eddf760797b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:29.557243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0bd5f91-ebdf-418c-826e-9eddf760797b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:29.558223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0bd5f91-ebdf-418c-826e-9eddf760797b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:29.559513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0bd5f91-ebdf-418c-826e-9eddf760797b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:29.564194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0bd5f91-ebdf-418c-826e-9eddf760797b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:29.768607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d0bd5f91-ebdf-418c-826e-9eddf760797b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:29.778318 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d0bd5f91-ebdf-418c-826e-9eddf760797b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3" status: 200 len: 1480 microversion: 2.1 time: 0.265733 Aug 27 04:55:29.793377 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 495/1013] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:29 2022] GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3 => generated 1480 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:29.830580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9fcc5228-697a-4d91-a4de-aa01e1ff2a33 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:29.831511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9fcc5228-697a-4d91-a4de-aa01e1ff2a33 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:29.855705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc5228-697a-4d91-a4de-aa01e1ff2a33 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:29.858609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc5228-697a-4d91-a4de-aa01e1ff2a33 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:29.859929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc5228-697a-4d91-a4de-aa01e1ff2a33 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:29.864681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc5228-697a-4d91-a4de-aa01e1ff2a33 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:29.866070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc5228-697a-4d91-a4de-aa01e1ff2a33 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:29.867205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc5228-697a-4d91-a4de-aa01e1ff2a33 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:30.018130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9fcc5228-697a-4d91-a4de-aa01e1ff2a33 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:30.030779 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9fcc5228-697a-4d91-a4de-aa01e1ff2a33 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1274 microversion: 2.1 time: 0.219092 Aug 27 04:55:30.035128 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 496/1014] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:29 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:30.094806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d8e51952-f310-4818-9ab2-0c32524bc50f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:30.126396 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d8e51952-f310-4818-9ab2-0c32524bc50f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1317 microversion: 2.1 time: 0.756270 Aug 27 04:55:30.128911 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 519/1015] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:29 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1317 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:30.417840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:30.418565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:30.428798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-137dc71c-e0ae-4599-bc35-a314450fa05e req-e3038a53-3bce-483e-99b2-86c84fbc4474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f4d090-8163-469c-b801-7864b9155ed3", "name": "network-vif-deleted", "tag": "3c575205-29ce-4475-a574-a3f0cf85516a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:30.437096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:30.438036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:30.438697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:30.440555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:30.446073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-137dc71c-e0ae-4599-bc35-a314450fa05e req-e3038a53-3bce-483e-99b2-86c84fbc4474 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:30.446898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:30.447781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-137dc71c-e0ae-4599-bc35-a314450fa05e req-e3038a53-3bce-483e-99b2-86c84fbc4474 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:30.448351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:30.448963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-137dc71c-e0ae-4599-bc35-a314450fa05e req-e3038a53-3bce-483e-99b2-86c84fbc4474 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:30.489061 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-137dc71c-e0ae-4599-bc35-a314450fa05e req-e3038a53-3bce-483e-99b2-86c84fbc4474 service nova] Creating event network-vif-deleted:3c575205-29ce-4475-a574-a3f0cf85516a for instance f8f4d090-8163-469c-b801-7864b9155ed3 on n-h1-820368-35 Aug 27 04:55:30.499474 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-137dc71c-e0ae-4599-bc35-a314450fa05e req-e3038a53-3bce-483e-99b2-86c84fbc4474 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074804 Aug 27 04:55:30.505504 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 520/1016] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:30.556048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:30.565975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:30.567810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:30.569335 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cc378e2f-b2a8-480a-bb0d-6fa69f86e485 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.155942 Aug 27 04:55:30.583603 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 497/1017] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:30 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:30.813936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:30.814640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: f8f4d090-8163-469c-b801-7864b9155ed3] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:30.822433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:30.822928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:30.830116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:30.831001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:30.831538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:30.831979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:30.927173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:30.930459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:30.932188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:30.932865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lazy-loading 'fault' on Instance uuid f8f4d090-8163-469c-b801-7864b9155ed3 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:55:31.030295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:31.046834 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed5ea8ae-2c3d-48ab-9add-ed04831d080b tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3" status: 200 len: 1312 microversion: 2.1 time: 0.237598 Aug 27 04:55:31.062790 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 521/1018] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:30 2022] GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3 => generated 1312 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:31.062961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-82577008-95b5-4421-856d-21c1fdbc9b11 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:31.063445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-82577008-95b5-4421-856d-21c1fdbc9b11 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:31.072117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82577008-95b5-4421-856d-21c1fdbc9b11 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:31.073016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82577008-95b5-4421-856d-21c1fdbc9b11 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:31.073606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82577008-95b5-4421-856d-21c1fdbc9b11 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:31.074873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82577008-95b5-4421-856d-21c1fdbc9b11 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:31.075536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82577008-95b5-4421-856d-21c1fdbc9b11 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:31.076757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82577008-95b5-4421-856d-21c1fdbc9b11 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:31.153639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-36729499-35c4-4873-aafb-86091469b451 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:31.154271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-36729499-35c4-4873-aafb-86091469b451 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:31.167873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36729499-35c4-4873-aafb-86091469b451 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:31.168375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36729499-35c4-4873-aafb-86091469b451 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:31.168817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36729499-35c4-4873-aafb-86091469b451 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:31.174067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36729499-35c4-4873-aafb-86091469b451 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:31.174638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36729499-35c4-4873-aafb-86091469b451 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:31.175111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36729499-35c4-4873-aafb-86091469b451 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:32.014045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-36729499-35c4-4873-aafb-86091469b451 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:32.033726 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-36729499-35c4-4873-aafb-86091469b451 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1317 microversion: 2.1 time: 0.881341 Aug 27 04:55:32.034920 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 522/1019] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:31 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1317 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:32.047401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:32.049471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:32.065251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:32.065961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:32.068356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:32.069957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:32.072911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:32.074208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:32.175422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-82577008-95b5-4421-856d-21c1fdbc9b11 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:32.216792 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-82577008-95b5-4421-856d-21c1fdbc9b11 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 1.157642 Aug 27 04:55:32.217396 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 498/1020] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:31 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:32.236566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:32.237196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: f8f4d090-8163-469c-b801-7864b9155ed3] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:32.255695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:32.256547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:32.256809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:32.257618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:32.258080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:32.258513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:32.298113 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] HTTP exception thrown: Instance f8f4d090-8163-469c-b801-7864b9155ed3 could not be found. Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Request method failure captured: Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3 HTTP/1.1 Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaN9p80i7VzzZ3N0Ow-qcbmbUNxdpBEQt3q20xICDr7dsI1hzIcxkholQmsRqxgKpEYvQwSnRrPROwy4alJy0ksg-McIfoWyz1B85M2GBDbxz_qRoZdZPU8ddLoHEcLqWw-poQjwfwEP-iOAfhgHqlgyEJGC4zGb5Fsn1l56GXmw2r8 Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:55:32.317141 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9d672c3f0e4c4128ad7c4b3a1c1fd868", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: dcf7892387894e07a7e0f35c70a5e1dd Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance f8f4d090-8163-469c-b801-7864b9155ed3 could not be found. Aug 27 04:55:32.318731 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'f8f4d090-8163-469c-b801-7864b9155ed3'} Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f4d090-8163-469c-b801-7864b9155ed3 could not be found. Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:32.319772 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f4d090-8163-469c-b801-7864b9155ed3 could not be found. Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f4d090-8163-469c-b801-7864b9155ed3 could not be found. Aug 27 04:55:32.321171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:32.322542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Returning 404 to user: Instance f8f4d090-8163-469c-b801-7864b9155ed3 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:32.322542 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f581366d-353b-4d87-b991-34581c0a93ab tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3" status: 404 len: 111 microversion: 2.1 time: 0.086513 Aug 27 04:55:32.322542 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 499/1021] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:32 2022] GET /compute/v2.1/servers/f8f4d090-8163-469c-b801-7864b9155ed3 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:55:32.326994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b862372a-1ace-4688-b147-260e675394cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:32.327860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b862372a-1ace-4688-b147-260e675394cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:32.346710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b862372a-1ace-4688-b147-260e675394cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:32.347490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b862372a-1ace-4688-b147-260e675394cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:32.348085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b862372a-1ace-4688-b147-260e675394cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:32.348988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b862372a-1ace-4688-b147-260e675394cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:32.349604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b862372a-1ace-4688-b147-260e675394cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:32.350187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b862372a-1ace-4688-b147-260e675394cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:32.368962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:32.380611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:32.382645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:32.391687 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d9b47363-9c0c-4be8-8a81-61d9628d5085 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.354315 Aug 27 04:55:32.400244 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 523/1022] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:32 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:32.529223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-446834fb-9fcd-4cd8-9a44-b5935ca27be9 req-a25bd283-38c5-4eb8-a1aa-e8d0096b50e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e86e4e3-9732-459d-aa87-306b7a76374f", "tag": "3c078f89-20fc-44b6-9e24-7cd010231165"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:32.546451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-446834fb-9fcd-4cd8-9a44-b5935ca27be9 req-a25bd283-38c5-4eb8-a1aa-e8d0096b50e4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:32.546930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-446834fb-9fcd-4cd8-9a44-b5935ca27be9 req-a25bd283-38c5-4eb8-a1aa-e8d0096b50e4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:32.547554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-446834fb-9fcd-4cd8-9a44-b5935ca27be9 req-a25bd283-38c5-4eb8-a1aa-e8d0096b50e4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:32.574610 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-446834fb-9fcd-4cd8-9a44-b5935ca27be9 req-a25bd283-38c5-4eb8-a1aa-e8d0096b50e4 service nova] Creating event network-changed:3c078f89-20fc-44b6-9e24-7cd010231165 for instance 5e86e4e3-9732-459d-aa87-306b7a76374f on n-h1-820368-35 Aug 27 04:55:32.580720 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-446834fb-9fcd-4cd8-9a44-b5935ca27be9 req-a25bd283-38c5-4eb8-a1aa-e8d0096b50e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055211 Aug 27 04:55:32.585482 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 524/1023] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:55:32.826460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b862372a-1ace-4688-b147-260e675394cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:32.834436 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b862372a-1ace-4688-b147-260e675394cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1521 microversion: 2.1 time: 0.511102 Aug 27 04:55:32.835592 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 500/1024] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:32 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:33.056585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc273428-fb22-4ef3-9d10-3aa6b65bd4be tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:33.057298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dc273428-fb22-4ef3-9d10-3aa6b65bd4be tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:33.074228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc273428-fb22-4ef3-9d10-3aa6b65bd4be tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.074986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc273428-fb22-4ef3-9d10-3aa6b65bd4be tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.075624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc273428-fb22-4ef3-9d10-3aa6b65bd4be tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.076653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc273428-fb22-4ef3-9d10-3aa6b65bd4be tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.077309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc273428-fb22-4ef3-9d10-3aa6b65bd4be tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.077948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc273428-fb22-4ef3-9d10-3aa6b65bd4be tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.242484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ae56b66-3494-433a-86cd-fd1eeb4bd6b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:33.244247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5ae56b66-3494-433a-86cd-fd1eeb4bd6b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:33.257202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae56b66-3494-433a-86cd-fd1eeb4bd6b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.258008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae56b66-3494-433a-86cd-fd1eeb4bd6b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.258449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae56b66-3494-433a-86cd-fd1eeb4bd6b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.259410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae56b66-3494-433a-86cd-fd1eeb4bd6b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.260028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae56b66-3494-433a-86cd-fd1eeb4bd6b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.262049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae56b66-3494-433a-86cd-fd1eeb4bd6b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.809545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dc273428-fb22-4ef3-9d10-3aa6b65bd4be tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:33.835938 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dc273428-fb22-4ef3-9d10-3aa6b65bd4be tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1317 microversion: 2.1 time: 0.784850 Aug 27 04:55:33.838974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5ae56b66-3494-433a-86cd-fd1eeb4bd6b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:33.839482 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 525/1025] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:33 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1317 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:33.849346 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5ae56b66-3494-433a-86cd-fd1eeb4bd6b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 0.612854 Aug 27 04:55:33.851222 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 501/1026] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:33 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:33.856937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:33.857567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:33.859905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:33.861225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:33.865370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.865864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.866888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.867619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.868070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.869594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.870248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.870434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.871516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.872536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.873127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.873897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.897915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:33.936755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.939640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.940192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.942952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lazy-loading 'fault' on Instance uuid eb532469-9212-4d66-b601-a0f0bcf27b24 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:55:33.948819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:33.976185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:33.985356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:33.986809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:33.988011 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3c356e52-206a-47c7-82bd-3ed0efea38c3 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.147397 Aug 27 04:55:33.988729 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 526/1027] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:33 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:34.029870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf7892387894e07a7e0f35c70a5e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d672c3f0e4c4128ad7c4b3a1c1fd868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:34.037793 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-afacbdd5-e74b-4c41-bc6a-e863477861cc tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 200 len: 1312 microversion: 2.1 time: 0.183544 Aug 27 04:55:34.039123 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 502/1028] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:33 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:34.542228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-788578402", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "00de91a4-56de-4dd2-b930-888a9f762ad7"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:34.597343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] validate_networks() for [('00de91a4-56de-4dd2-b930-888a9f762ad7', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:55:34.618978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-4f09a718-4071-4d7d-8a4b-9e2749af3a50 req-67ba88ce-0a91-4d64-b2f7-c3efb7465548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb532469-9212-4d66-b601-a0f0bcf27b24", "name": "network-vif-deleted", "tag": "b7904933-9b12-452f-ac97-d6716cfe787a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:34.635350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4f09a718-4071-4d7d-8a4b-9e2749af3a50 req-67ba88ce-0a91-4d64-b2f7-c3efb7465548 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:34.636423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4f09a718-4071-4d7d-8a4b-9e2749af3a50 req-67ba88ce-0a91-4d64-b2f7-c3efb7465548 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:34.636618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4f09a718-4071-4d7d-8a4b-9e2749af3a50 req-67ba88ce-0a91-4d64-b2f7-c3efb7465548 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:34.653636 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-4f09a718-4071-4d7d-8a4b-9e2749af3a50 req-67ba88ce-0a91-4d64-b2f7-c3efb7465548 service nova] Creating event network-vif-deleted:b7904933-9b12-452f-ac97-d6716cfe787a for instance eb532469-9212-4d66-b601-a0f0bcf27b24 on n-h2-820368-35 Aug 27 04:55:34.658757 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-4f09a718-4071-4d7d-8a4b-9e2749af3a50 req-67ba88ce-0a91-4d64-b2f7-c3efb7465548 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044420 Aug 27 04:55:34.659742 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 503/1029] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:55:34.880623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f6a5ba6-4874-4ad4-b475-208372001081 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:34.881494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f6a5ba6-4874-4ad4-b475-208372001081 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:34.884367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=10 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:34.890780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f6a5ba6-4874-4ad4-b475-208372001081 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:34.891622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f6a5ba6-4874-4ad4-b475-208372001081 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:34.892282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f6a5ba6-4874-4ad4-b475-208372001081 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:34.893195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f6a5ba6-4874-4ad4-b475-208372001081 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:34.893838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f6a5ba6-4874-4ad4-b475-208372001081 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:34.894671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f6a5ba6-4874-4ad4-b475-208372001081 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.045632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=28 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:35.111190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:55:35.112577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:55:35.113281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:55:35.113910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:55:35.114544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:55:35.125266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:35.126111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:35.126797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.127791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:35.128492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:35.129162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.132917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9f6a5ba6-4874-4ad4-b475-208372001081 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:35.141266 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f6a5ba6-4874-4ad4-b475-208372001081 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1317 microversion: 2.1 time: 0.265472 Aug 27 04:55:35.149239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Getting quotas for project dd2736d36f16463c81a760e69e48fd28. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:35.155135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Getting quotas for user 17c08abee58846229f9255f8d86f762a and project dd2736d36f16463c81a760e69e48fd28. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:35.155366 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 504/1030] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:34 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:35.160228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-da5e868d-1e1f-4187-ab59-ff45fc4bc5a0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:35.161109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-da5e868d-1e1f-4187-ab59-ff45fc4bc5a0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:35.165725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:35.168283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da5e868d-1e1f-4187-ab59-ff45fc4bc5a0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:35.169345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da5e868d-1e1f-4187-ab59-ff45fc4bc5a0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:35.169867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:55:35.170159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da5e868d-1e1f-4187-ab59-ff45fc4bc5a0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.171112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da5e868d-1e1f-4187-ab59-ff45fc4bc5a0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:35.171759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da5e868d-1e1f-4187-ab59-ff45fc4bc5a0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:35.172345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da5e868d-1e1f-4187-ab59-ff45fc4bc5a0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.172741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:55:35.229944 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bbb96447-fb5a-408e-bda6-804529ca1f47 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805043 Aug 27 04:55:35.230767 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 527/1031] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:55:35.235893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:35.237036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:35.245798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:35.247269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:35.248001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.249107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:35.249755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:35.250466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.351043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:35.361114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:35.364370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:35.366985 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c24cef6d-63ff-46ce-a84c-9ffab1a790c1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.134882 Aug 27 04:55:35.383359 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 528/1032] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:35 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:35.387888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:35.388532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] [instance: eb532469-9212-4d66-b601-a0f0bcf27b24] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:35.401580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-da5e868d-1e1f-4187-ab59-ff45fc4bc5a0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:35.406482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:35.407716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:35.408281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.409020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:35.409487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:35.409946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.411327 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-da5e868d-1e1f-4187-ab59-ff45fc4bc5a0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 0.254750 Aug 27 04:55:35.412240 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 505/1033] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:35 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:35.418371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-73042409-f1e0-4b1b-a0e5-1d889160ffd7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:35.418985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-73042409-f1e0-4b1b-a0e5-1d889160ffd7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:35.421297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:35.453229 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] HTTP exception thrown: Instance eb532469-9212-4d66-b601-a0f0bcf27b24 could not be found. Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Request method failure captured: Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 HTTP/1.1 Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaN9p80i7VzzZ3N0Ow-qcbmbUNxdpBEQt3q20xICDr7dsI1hzIcxkholQmsRqxgKpEYvQwSnRrPROwy4alJy0ksg-McIfoWyz1B85M2GBDbxz_qRoZdZPU8ddLoHEcLqWw-poQjwfwEP-iOAfhgHqlgyEJGC4zGb5Fsn1l56GXmw2r8 Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:35.461663 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9d672c3f0e4c4128ad7c4b3a1c1fd868", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d672c3f0e4c4128ad7c4b3a1c1fd868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 9d672c3f0e4c4128ad7c4b3a1c1fd868 Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-54399481 Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: dcf7892387894e07a7e0f35c70a5e1dd Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ListServersNegativeTestJSON-54399481-project Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance eb532469-9212-4d66-b601-a0f0bcf27b24 could not be found. Aug 27 04:55:35.463479 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'eb532469-9212-4d66-b601-a0f0bcf27b24'} Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb532469-9212-4d66-b601-a0f0bcf27b24 could not be found. Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:35.464341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb532469-9212-4d66-b601-a0f0bcf27b24 could not be found. Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb532469-9212-4d66-b601-a0f0bcf27b24 could not be found. Aug 27 04:55:35.465663 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:35.473438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] Returning 404 to user: Instance eb532469-9212-4d66-b601-a0f0bcf27b24 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:35.474561 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1c8e9c17-d85c-4638-b2bb-7dea3b669788 tempest-ListServersNegativeTestJSON-54399481 tempest-ListServersNegativeTestJSON-54399481-project] 10.222.0.58 "GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24" status: 404 len: 111 microversion: 2.1 time: 0.098670 Aug 27 04:55:35.479348 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 529/1034] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:35 2022] GET /compute/v2.1/servers/eb532469-9212-4d66-b601-a0f0bcf27b24 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:55:35.490331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f53cf762-20a7-429c-bf99-930a398f7154 req-8b1b4549-df31-449d-b4c1-e70671ada33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb8d618-f311-4f64-825c-f1816fe41876", "name": "network-vif-plugged", "status": "completed", "tag": "35ed7764-fd62-4b34-a259-e6ca2280e1f2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:35.504895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f53cf762-20a7-429c-bf99-930a398f7154 req-8b1b4549-df31-449d-b4c1-e70671ada33d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:35.505522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f53cf762-20a7-429c-bf99-930a398f7154 req-8b1b4549-df31-449d-b4c1-e70671ada33d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:35.506208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f53cf762-20a7-429c-bf99-930a398f7154 req-8b1b4549-df31-449d-b4c1-e70671ada33d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.508771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-73042409-f1e0-4b1b-a0e5-1d889160ffd7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:35.519322 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-73042409-f1e0-4b1b-a0e5-1d889160ffd7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1210 microversion: 2.1 time: 0.105450 Aug 27 04:55:35.519967 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 506/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:35 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:35.535494 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f53cf762-20a7-429c-bf99-930a398f7154 req-8b1b4549-df31-449d-b4c1-e70671ada33d service nova] Creating event network-vif-plugged:35ed7764-fd62-4b34-a259-e6ca2280e1f2 for instance 0fb8d618-f311-4f64-825c-f1816fe41876 on n-h2-820368-35 Aug 27 04:55:35.540176 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f53cf762-20a7-429c-bf99-930a398f7154 req-8b1b4549-df31-449d-b4c1-e70671ada33d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053974 Aug 27 04:55:35.543031 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 530/1036] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:36.162310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8d0fb63-997e-43a4-8920-297a0e4f2e77 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:36.162970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e8d0fb63-997e-43a4-8920-297a0e4f2e77 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:36.169533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d0fb63-997e-43a4-8920-297a0e4f2e77 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.170285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d0fb63-997e-43a4-8920-297a0e4f2e77 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.170905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d0fb63-997e-43a4-8920-297a0e4f2e77 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.171641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d0fb63-997e-43a4-8920-297a0e4f2e77 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.172263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d0fb63-997e-43a4-8920-297a0e4f2e77 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.172695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d0fb63-997e-43a4-8920-297a0e4f2e77 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.312984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e8d0fb63-997e-43a4-8920-297a0e4f2e77 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:36.321708 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e8d0fb63-997e-43a4-8920-297a0e4f2e77 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1317 microversion: 2.1 time: 0.163347 Aug 27 04:55:36.322273 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 507/1037] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:36 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:36.392697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:36.393714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:36.401047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.401531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.402164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.402871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.403349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.404117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.432223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-68dfe39b-ba1a-4c5e-b5e8-4277b1f746c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:36.433068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68dfe39b-ba1a-4c5e-b5e8-4277b1f746c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:36.439791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68dfe39b-ba1a-4c5e-b5e8-4277b1f746c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.440494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68dfe39b-ba1a-4c5e-b5e8-4277b1f746c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.440934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68dfe39b-ba1a-4c5e-b5e8-4277b1f746c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.441834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68dfe39b-ba1a-4c5e-b5e8-4277b1f746c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.442455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68dfe39b-ba1a-4c5e-b5e8-4277b1f746c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.442886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68dfe39b-ba1a-4c5e-b5e8-4277b1f746c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.482473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:36.495632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:36.497385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:36.498757 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-328e4b2f-52bf-4b71-9cba-5a5d1c90f979 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.110502 Aug 27 04:55:36.515551 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 531/1038] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:36 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:36.542937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9047196a-07dc-4591-ad87-642f14addb26 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:36.544792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9047196a-07dc-4591-ad87-642f14addb26 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:36.554774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9047196a-07dc-4591-ad87-642f14addb26 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.555299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9047196a-07dc-4591-ad87-642f14addb26 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.555736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9047196a-07dc-4591-ad87-642f14addb26 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.556447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9047196a-07dc-4591-ad87-642f14addb26 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.556916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9047196a-07dc-4591-ad87-642f14addb26 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.557317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9047196a-07dc-4591-ad87-642f14addb26 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.598916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-68dfe39b-ba1a-4c5e-b5e8-4277b1f746c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:36.606614 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-68dfe39b-ba1a-4c5e-b5e8-4277b1f746c0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 0.178190 Aug 27 04:55:36.608981 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 508/1039] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:36 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:36.661806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9047196a-07dc-4591-ad87-642f14addb26 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:36.673444 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9047196a-07dc-4591-ad87-642f14addb26 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1206 microversion: 2.1 time: 0.134755 Aug 27 04:55:36.684551 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 532/1040] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:36 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1206 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:37.343289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7bf3c16b-c0df-438b-ac1d-8c887ccde249 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:37.343905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7bf3c16b-c0df-438b-ac1d-8c887ccde249 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:37.353460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c16b-c0df-438b-ac1d-8c887ccde249 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.353887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c16b-c0df-438b-ac1d-8c887ccde249 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.354332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c16b-c0df-438b-ac1d-8c887ccde249 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.355053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c16b-c0df-438b-ac1d-8c887ccde249 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.355544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c16b-c0df-438b-ac1d-8c887ccde249 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.355968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c16b-c0df-438b-ac1d-8c887ccde249 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.523756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:37.524481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:37.531000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.531785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.532420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.533335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.533994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.534626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.551790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7bf3c16b-c0df-438b-ac1d-8c887ccde249 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:37.562647 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7bf3c16b-c0df-438b-ac1d-8c887ccde249 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1317 microversion: 2.1 time: 0.223181 Aug 27 04:55:37.563770 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 509/1041] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:37 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:37.608149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:37.617008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:37.618689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:37.620150 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a52de78d-3e6a-4de7-a617-143b27fd703b tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1366 microversion: 2.47 time: 0.100867 Aug 27 04:55:37.620890 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 533/1042] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:37 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:55:37.636212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ea84c3ab-1990-4709-9bec-74b7ee195d47 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:37.637165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ea84c3ab-1990-4709-9bec-74b7ee195d47 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:37.643645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea84c3ab-1990-4709-9bec-74b7ee195d47 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.644364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea84c3ab-1990-4709-9bec-74b7ee195d47 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.644873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea84c3ab-1990-4709-9bec-74b7ee195d47 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.645661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea84c3ab-1990-4709-9bec-74b7ee195d47 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.646202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea84c3ab-1990-4709-9bec-74b7ee195d47 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.646809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea84c3ab-1990-4709-9bec-74b7ee195d47 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.698152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a4ec2031-f9d4-4a1d-a2b0-0f83d28e0230 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:37.698762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a4ec2031-f9d4-4a1d-a2b0-0f83d28e0230 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:37.705309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ec2031-f9d4-4a1d-a2b0-0f83d28e0230 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.706044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ec2031-f9d4-4a1d-a2b0-0f83d28e0230 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.706688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ec2031-f9d4-4a1d-a2b0-0f83d28e0230 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.708563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ec2031-f9d4-4a1d-a2b0-0f83d28e0230 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.709197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ec2031-f9d4-4a1d-a2b0-0f83d28e0230 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.710369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ec2031-f9d4-4a1d-a2b0-0f83d28e0230 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.855052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a4ec2031-f9d4-4a1d-a2b0-0f83d28e0230 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:37.866204 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a4ec2031-f9d4-4a1d-a2b0-0f83d28e0230 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1262 microversion: 2.1 time: 0.172398 Aug 27 04:55:37.866794 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 534/1043] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:37 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1262 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:37.898696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ea84c3ab-1990-4709-9bec-74b7ee195d47 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:37.907400 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ea84c3ab-1990-4709-9bec-74b7ee195d47 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 0.275507 Aug 27 04:55:37.909264 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 510/1044] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:37 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:38.584245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3c5940ec-8ecc-481e-8fe3-6b1e4f6bd4dc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:38.584886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3c5940ec-8ecc-481e-8fe3-6b1e4f6bd4dc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:38.591277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c5940ec-8ecc-481e-8fe3-6b1e4f6bd4dc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.591756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c5940ec-8ecc-481e-8fe3-6b1e4f6bd4dc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.592184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c5940ec-8ecc-481e-8fe3-6b1e4f6bd4dc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:38.592884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c5940ec-8ecc-481e-8fe3-6b1e4f6bd4dc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.593333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c5940ec-8ecc-481e-8fe3-6b1e4f6bd4dc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.593754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c5940ec-8ecc-481e-8fe3-6b1e4f6bd4dc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:38.644081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:38.644689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:38.652106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.652794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.653633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:38.654541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.654999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.655455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:38.741391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:38.752186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:38.753886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:38.755362 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd59126d-e566-4f97-aff7-6821347186a4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1372 microversion: 2.47 time: 0.115402 Aug 27 04:55:38.755920 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 511/1045] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:38 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:55:38.770184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3c5940ec-8ecc-481e-8fe3-6b1e4f6bd4dc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:38.785495 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3c5940ec-8ecc-481e-8fe3-6b1e4f6bd4dc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1467 microversion: 2.1 time: 0.205161 Aug 27 04:55:38.795458 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 535/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:38 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1467 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:38.806416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e296419e-1eaa-4a87-b53f-2e0ed193465a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:38.807131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e296419e-1eaa-4a87-b53f-2e0ed193465a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:38.813620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e296419e-1eaa-4a87-b53f-2e0ed193465a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.814119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e296419e-1eaa-4a87-b53f-2e0ed193465a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.814555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e296419e-1eaa-4a87-b53f-2e0ed193465a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:38.815305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e296419e-1eaa-4a87-b53f-2e0ed193465a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.815765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e296419e-1eaa-4a87-b53f-2e0ed193465a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.816262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e296419e-1eaa-4a87-b53f-2e0ed193465a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:38.890059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7b74ef32-fa1b-4375-ba6f-21d8331a3116 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:38.890684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7b74ef32-fa1b-4375-ba6f-21d8331a3116 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:38.899923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b74ef32-fa1b-4375-ba6f-21d8331a3116 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.900369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b74ef32-fa1b-4375-ba6f-21d8331a3116 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.900809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b74ef32-fa1b-4375-ba6f-21d8331a3116 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:38.901512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b74ef32-fa1b-4375-ba6f-21d8331a3116 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.902113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b74ef32-fa1b-4375-ba6f-21d8331a3116 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.902971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b74ef32-fa1b-4375-ba6f-21d8331a3116 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:39.013910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7b74ef32-fa1b-4375-ba6f-21d8331a3116 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:39.027081 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7b74ef32-fa1b-4375-ba6f-21d8331a3116 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1268 microversion: 2.1 time: 0.138741 Aug 27 04:55:39.029923 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 536/1047] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:38 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1268 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:39.032538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e296419e-1eaa-4a87-b53f-2e0ed193465a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:39.035042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eeb069a0-d6b0-4251-a961-c283807912f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:39.035756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eeb069a0-d6b0-4251-a961-c283807912f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:39.044733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeb069a0-d6b0-4251-a961-c283807912f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:39.045464 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e296419e-1eaa-4a87-b53f-2e0ed193465a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738" status: 200 len: 1466 microversion: 2.1 time: 0.242946 Aug 27 04:55:39.046800 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 512/1048] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:38 2022] GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738 => generated 1466 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:39.048143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeb069a0-d6b0-4251-a961-c283807912f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:39.048625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeb069a0-d6b0-4251-a961-c283807912f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:39.049548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeb069a0-d6b0-4251-a961-c283807912f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:39.050016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeb069a0-d6b0-4251-a961-c283807912f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:39.050496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeb069a0-d6b0-4251-a961-c283807912f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:39.067048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b7fdca7-a8cb-49e5-8027-3ca7f62bd142 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1923251991"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:39.069498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9b7fdca7-a8cb-49e5-8027-3ca7f62bd142 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:39.087993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b7fdca7-a8cb-49e5-8027-3ca7f62bd142 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:39.088492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b7fdca7-a8cb-49e5-8027-3ca7f62bd142 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:39.088932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b7fdca7-a8cb-49e5-8027-3ca7f62bd142 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:39.089662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b7fdca7-a8cb-49e5-8027-3ca7f62bd142 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:39.090120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b7fdca7-a8cb-49e5-8027-3ca7f62bd142 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:39.090547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b7fdca7-a8cb-49e5-8027-3ca7f62bd142 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:39.324559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eeb069a0-d6b0-4251-a961-c283807912f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:39.343419 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eeb069a0-d6b0-4251-a961-c283807912f8 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 0.311938 Aug 27 04:55:39.344826 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 537/1049] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:39 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:39.368724 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9b7fdca7-a8cb-49e5-8027-3ca7f62bd142 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "POST /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738/action" status: 202 len: 0 microversion: 2.1 time: 0.305340 Aug 27 04:55:39.371195 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 513/1050] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:55:39 2022] POST /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 04:55:39.382409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0a892451-7019-4ce5-8df8-b3aa2b8a8232 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5652ba9d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:39.514237 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0a892451-7019-4ce5-8df8-b3aa2b8a8232 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.136574 Aug 27 04:55:39.522268 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 538/1051] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:39 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:39.779936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:39.781224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:39.788739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:39.791660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:39.792310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:39.793219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:39.793847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:39.794439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:39.882734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:39.893871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:39.895531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:39.897004 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1bb52ee4-43de-44ab-884b-7d94382cce0f tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1372 microversion: 2.47 time: 0.121391 Aug 27 04:55:39.897743 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 514/1052] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:39 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1372 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:40.049858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2be3c96-50b7-4ced-8688-ec4d3f800a30 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:40.051236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a2be3c96-50b7-4ced-8688-ec4d3f800a30 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:40.059131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2be3c96-50b7-4ced-8688-ec4d3f800a30 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:40.059762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2be3c96-50b7-4ced-8688-ec4d3f800a30 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:40.060284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2be3c96-50b7-4ced-8688-ec4d3f800a30 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:40.061179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2be3c96-50b7-4ced-8688-ec4d3f800a30 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:40.061701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2be3c96-50b7-4ced-8688-ec4d3f800a30 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:40.062228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2be3c96-50b7-4ced-8688-ec4d3f800a30 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:40.197521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a2be3c96-50b7-4ced-8688-ec4d3f800a30 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:40.206690 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2be3c96-50b7-4ced-8688-ec4d3f800a30 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.161684 Aug 27 04:55:40.207297 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 539/1053] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:40 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:40.365145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bfa42c89-2947-42e7-81e1-580cac86882c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:40.365828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bfa42c89-2947-42e7-81e1-580cac86882c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:40.382534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfa42c89-2947-42e7-81e1-580cac86882c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:40.383039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfa42c89-2947-42e7-81e1-580cac86882c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:40.383522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfa42c89-2947-42e7-81e1-580cac86882c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:40.387900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfa42c89-2947-42e7-81e1-580cac86882c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:40.389130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfa42c89-2947-42e7-81e1-580cac86882c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:40.389868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfa42c89-2947-42e7-81e1-580cac86882c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:40.433484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c0c101e0-9020-4a31-beda-fe1f6495d653 req-8fb3ef06-66a4-4caf-8571-c632b85b3df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e86e4e3-9732-459d-aa87-306b7a76374f", "name": "network-vif-plugged", "status": "completed", "tag": "3c078f89-20fc-44b6-9e24-7cd010231165"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:40.460923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c0c101e0-9020-4a31-beda-fe1f6495d653 req-8fb3ef06-66a4-4caf-8571-c632b85b3df3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:40.464050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c0c101e0-9020-4a31-beda-fe1f6495d653 req-8fb3ef06-66a4-4caf-8571-c632b85b3df3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:40.464703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c0c101e0-9020-4a31-beda-fe1f6495d653 req-8fb3ef06-66a4-4caf-8571-c632b85b3df3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:40.488056 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c0c101e0-9020-4a31-beda-fe1f6495d653 req-8fb3ef06-66a4-4caf-8571-c632b85b3df3 service nova] Creating event network-vif-plugged:3c078f89-20fc-44b6-9e24-7cd010231165 for instance 5e86e4e3-9732-459d-aa87-306b7a76374f on n-h1-820368-35 Aug 27 04:55:40.494172 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c0c101e0-9020-4a31-beda-fe1f6495d653 req-8fb3ef06-66a4-4caf-8571-c632b85b3df3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064490 Aug 27 04:55:40.495264 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 540/1054] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:40.537371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2b87ff4-3f86-448f-aa46-beeb4dbc918e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565206280>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:40.575766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bfa42c89-2947-42e7-81e1-580cac86882c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:40.590003 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bfa42c89-2947-42e7-81e1-580cac86882c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 0.228678 Aug 27 04:55:40.591663 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 515/1055] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:40 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:40.601007 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b2b87ff4-3f86-448f-aa46-beeb4dbc918e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.067833 Aug 27 04:55:40.603293 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 541/1056] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:40 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:40.921061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:40.922273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:40.930420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:40.931151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:40.931725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:40.932683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:40.933190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:40.933631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:41.019457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:41.029257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:41.030714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:41.032489 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a1e4f985-4dff-479a-9cdc-09c79a6dd110 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1372 microversion: 2.47 time: 0.116002 Aug 27 04:55:41.033799 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 516/1057] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:40 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:41.202823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-a63bdcc7-4506-41ce-aacc-826ac47790e4 req-1de8b6cd-74e8-4b4f-875a-625b33b08cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a984e8-a342-45d3-80b7-f149773c4c19", "tag": "4f37ae87-ac14-4a9c-adf4-091cf9796741"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:41.216355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a63bdcc7-4506-41ce-aacc-826ac47790e4 req-1de8b6cd-74e8-4b4f-875a-625b33b08cc6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:41.217035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a63bdcc7-4506-41ce-aacc-826ac47790e4 req-1de8b6cd-74e8-4b4f-875a-625b33b08cc6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:41.217579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a63bdcc7-4506-41ce-aacc-826ac47790e4 req-1de8b6cd-74e8-4b4f-875a-625b33b08cc6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:41.228711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-91a3ad5f-5237-415a-a2ea-1478264c2b36 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:41.229887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-91a3ad5f-5237-415a-a2ea-1478264c2b36 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:41.238592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91a3ad5f-5237-415a-a2ea-1478264c2b36 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:41.239146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91a3ad5f-5237-415a-a2ea-1478264c2b36 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:41.239571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91a3ad5f-5237-415a-a2ea-1478264c2b36 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:41.240280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91a3ad5f-5237-415a-a2ea-1478264c2b36 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:41.241157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91a3ad5f-5237-415a-a2ea-1478264c2b36 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:41.241541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91a3ad5f-5237-415a-a2ea-1478264c2b36 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:41.245568 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-a63bdcc7-4506-41ce-aacc-826ac47790e4 req-1de8b6cd-74e8-4b4f-875a-625b33b08cc6 service nova] Creating event network-changed:4f37ae87-ac14-4a9c-adf4-091cf9796741 for instance e6a984e8-a342-45d3-80b7-f149773c4c19 on n-h2-820368-35 Aug 27 04:55:41.252043 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-a63bdcc7-4506-41ce-aacc-826ac47790e4 req-1de8b6cd-74e8-4b4f-875a-625b33b08cc6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056671 Aug 27 04:55:41.252997 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 542/1058] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:41.391478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-91a3ad5f-5237-415a-a2ea-1478264c2b36 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:41.400312 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-91a3ad5f-5237-415a-a2ea-1478264c2b36 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.176996 Aug 27 04:55:41.401444 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 517/1059] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:41 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:41.618087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a5d08c4d-dfe9-440f-ad1d-b5285b09e8aa tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565186c10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:41.668654 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a5d08c4d-dfe9-440f-ad1d-b5285b09e8aa tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.055915 Aug 27 04:55:41.669355 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 543/1060] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:41 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:41.680618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8380232-fe95-4fb6-817c-fe1922bcf63b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:41.681306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e8380232-fe95-4fb6-817c-fe1922bcf63b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:41.687379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8380232-fe95-4fb6-817c-fe1922bcf63b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:41.692303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8380232-fe95-4fb6-817c-fe1922bcf63b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:41.692959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8380232-fe95-4fb6-817c-fe1922bcf63b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:41.693839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8380232-fe95-4fb6-817c-fe1922bcf63b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:41.694453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8380232-fe95-4fb6-817c-fe1922bcf63b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:41.695025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8380232-fe95-4fb6-817c-fe1922bcf63b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:41.851214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e8380232-fe95-4fb6-817c-fe1922bcf63b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:41.859324 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e8380232-fe95-4fb6-817c-fe1922bcf63b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 0.183133 Aug 27 04:55:41.859911 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 518/1061] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:41 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:42.054669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1546622557", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": "none"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:42.058186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:42.058791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:42.065199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:42.065682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:42.066117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:42.066807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:42.067282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:42.067717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:42.087046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:42.110374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:55:42.110794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:55:42.111295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:55:42.111702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:55:42.112109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:55:42.121298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:42.121775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:42.122202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:42.122924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:42.123405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:42.123830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:42.139303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:42.141185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Getting quotas for project 80ecb503b9f840d586c6b54b99a70801. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:42.146337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Getting quotas for user 77547bac37a14d749ed51cedda6389f0 and project 80ecb503b9f840d586c6b54b99a70801. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:42.147417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:42.148866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:42.150031 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f63757a8-aadf-4ad5-98f7-281281533072 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1372 microversion: 2.47 time: 0.095798 Aug 27 04:55:42.150594 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 519/1062] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:42 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:55:42.158456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:55:42.161024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:55:42.208945 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd4a7363-0b40-4e01-a2dc-abe93757182e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.264627 Aug 27 04:55:42.209743 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 544/1063] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 04:55:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 266 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:55:42.220497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f7dbdd8-4963-48af-a109-fd595b982e13 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:42.221115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4f7dbdd8-4963-48af-a109-fd595b982e13 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:42.276961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f7dbdd8-4963-48af-a109-fd595b982e13 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:42.284099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f7dbdd8-4963-48af-a109-fd595b982e13 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:42.285531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f7dbdd8-4963-48af-a109-fd595b982e13 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:42.286654 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f7dbdd8-4963-48af-a109-fd595b982e13 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1281 microversion: 2.47 time: 0.070118 Aug 27 04:55:42.287239 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 520/1064] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:42 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:42.421482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b89141b8-1ab9-4437-b25a-e9a7616d209d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:42.422379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b89141b8-1ab9-4437-b25a-e9a7616d209d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:42.430883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b89141b8-1ab9-4437-b25a-e9a7616d209d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:42.431463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b89141b8-1ab9-4437-b25a-e9a7616d209d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:42.431974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b89141b8-1ab9-4437-b25a-e9a7616d209d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:42.432765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b89141b8-1ab9-4437-b25a-e9a7616d209d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:42.433247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b89141b8-1ab9-4437-b25a-e9a7616d209d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:42.433665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b89141b8-1ab9-4437-b25a-e9a7616d209d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:42.588844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b89141b8-1ab9-4437-b25a-e9a7616d209d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:42.596681 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b89141b8-1ab9-4437-b25a-e9a7616d209d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.179398 Aug 27 04:55:42.597727 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 545/1065] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:42 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:42.684553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7b0fca32-a232-44f5-8e4d-fab0dd662a12 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56529edc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:42.729992 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7b0fca32-a232-44f5-8e4d-fab0dd662a12 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.049175 Aug 27 04:55:42.730552 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 521/1066] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:42 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:42.880528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a99f7957-b915-453e-9a5b-80e505e44fac tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:42.881656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a99f7957-b915-453e-9a5b-80e505e44fac tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:42.887851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a99f7957-b915-453e-9a5b-80e505e44fac tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:42.888338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a99f7957-b915-453e-9a5b-80e505e44fac tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:42.888780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a99f7957-b915-453e-9a5b-80e505e44fac tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:42.889486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a99f7957-b915-453e-9a5b-80e505e44fac tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:42.889966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a99f7957-b915-453e-9a5b-80e505e44fac tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:42.891421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a99f7957-b915-453e-9a5b-80e505e44fac tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:43.029218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a99f7957-b915-453e-9a5b-80e505e44fac tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:43.037115 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a99f7957-b915-453e-9a5b-80e505e44fac tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 0.160442 Aug 27 04:55:43.038019 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 546/1067] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:42 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:43.175932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:43.176569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:43.182901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:43.183422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:43.183863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:43.184622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:43.185074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:43.185498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:43.251511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:43.261326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:43.262782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:43.263979 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-02789adb-a1e9-42eb-89ac-99d0f5a668b0 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1372 microversion: 2.47 time: 0.093537 Aug 27 04:55:43.264535 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 522/1068] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:43 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:55:43.311411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:43.312021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:43.318390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:43.319567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:43.320003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:43.320699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:43.321151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:43.321574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:43.383653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:43.391915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:43.393350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:43.394440 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4fbc6379-ccf2-4a95-82b7-828c1c196d4e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1285 microversion: 2.47 time: 0.086967 Aug 27 04:55:43.394993 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 547/1069] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:43 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:43.618304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4967f3fa-a9f8-40d0-92d5-3722becfc309 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:43.618905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4967f3fa-a9f8-40d0-92d5-3722becfc309 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:43.625035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4967f3fa-a9f8-40d0-92d5-3722becfc309 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:43.625770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4967f3fa-a9f8-40d0-92d5-3722becfc309 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:43.626202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4967f3fa-a9f8-40d0-92d5-3722becfc309 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:43.626884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4967f3fa-a9f8-40d0-92d5-3722becfc309 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:43.627356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4967f3fa-a9f8-40d0-92d5-3722becfc309 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:43.627775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4967f3fa-a9f8-40d0-92d5-3722becfc309 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:43.745418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b983c6e-9f62-4b56-8419-884a4d5e788c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5652e1f70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:43.756864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4967f3fa-a9f8-40d0-92d5-3722becfc309 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:43.764802 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4967f3fa-a9f8-40d0-92d5-3722becfc309 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.150880 Aug 27 04:55:43.765398 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 523/1070] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:43 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:43.789675 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b983c6e-9f62-4b56-8419-884a4d5e788c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.048001 Aug 27 04:55:43.790243 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 548/1071] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:43 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:44.058399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-77da5c40-335e-460a-bb89-f5106ea828ce tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:44.059014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-77da5c40-335e-460a-bb89-f5106ea828ce tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:44.065014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77da5c40-335e-460a-bb89-f5106ea828ce tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.065497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77da5c40-335e-460a-bb89-f5106ea828ce tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.065932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77da5c40-335e-460a-bb89-f5106ea828ce tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.066623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77da5c40-335e-460a-bb89-f5106ea828ce tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.067074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77da5c40-335e-460a-bb89-f5106ea828ce tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.067521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77da5c40-335e-460a-bb89-f5106ea828ce tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.195507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-77da5c40-335e-460a-bb89-f5106ea828ce tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:44.203124 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-77da5c40-335e-460a-bb89-f5106ea828ce tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 0.148483 Aug 27 04:55:44.203636 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 524/1072] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:44 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:44.286720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:44.288040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:44.294064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.294546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.294982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.295709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.296162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.296591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.359812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:44.367698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:44.369157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:44.370309 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cdff7064-2261-4d0b-bcf7-59f1e8ae6178 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1372 microversion: 2.47 time: 0.087564 Aug 27 04:55:44.370870 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 549/1073] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:44 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:44.416521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:44.417135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:44.423185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.423676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.424116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.424830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.425270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.425697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.486958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:44.495112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:44.496550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:44.497682 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d51bd7a3-2288-472b-ac1d-9a48d1aada8c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1285 microversion: 2.47 time: 0.085067 Aug 27 04:55:44.498239 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 525/1074] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:44 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:44.785637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c3953495-a9db-4616-9e51-57b73e9de679 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:44.786172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c3953495-a9db-4616-9e51-57b73e9de679 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:44.793228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3953495-a9db-4616-9e51-57b73e9de679 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.793706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3953495-a9db-4616-9e51-57b73e9de679 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.794136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3953495-a9db-4616-9e51-57b73e9de679 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.794824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3953495-a9db-4616-9e51-57b73e9de679 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.795316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3953495-a9db-4616-9e51-57b73e9de679 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.795851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3953495-a9db-4616-9e51-57b73e9de679 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.804223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f39d657-761b-4458-a9d8-352724718055 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565413e50>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:44.847914 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f39d657-761b-4458-a9d8-352724718055 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.047441 Aug 27 04:55:44.848524 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 526/1075] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:44 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:44.928592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c3953495-a9db-4616-9e51-57b73e9de679 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:44.936219 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c3953495-a9db-4616-9e51-57b73e9de679 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.154676 Aug 27 04:55:44.936823 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 550/1076] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:44 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:45.224737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b01b3da9-7557-44b8-9cdb-9016bb6aae78 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:45.225380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b01b3da9-7557-44b8-9cdb-9016bb6aae78 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:45.231467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b01b3da9-7557-44b8-9cdb-9016bb6aae78 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:45.232017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b01b3da9-7557-44b8-9cdb-9016bb6aae78 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:45.232453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b01b3da9-7557-44b8-9cdb-9016bb6aae78 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:45.233148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b01b3da9-7557-44b8-9cdb-9016bb6aae78 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:45.233600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b01b3da9-7557-44b8-9cdb-9016bb6aae78 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:45.234022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b01b3da9-7557-44b8-9cdb-9016bb6aae78 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:45.394806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:45.396043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:45.402627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:45.403159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:45.403609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:45.404867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:45.405331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:45.405762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:45.413110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b01b3da9-7557-44b8-9cdb-9016bb6aae78 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:45.428795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:45.429033 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b01b3da9-7557-44b8-9cdb-9016bb6aae78 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 0.208681 Aug 27 04:55:45.434499 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 527/1077] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:45 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:45.489855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:45.500204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:45.501969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:45.503410 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d3b682c4-e97b-4339-8627-1c998968816c tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1372 microversion: 2.47 time: 0.113546 Aug 27 04:55:45.504297 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 551/1078] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:45 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:55:45.526430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:45.527049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:45.533596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:45.534138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:45.534650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:45.535484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:45.536063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:45.536552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:45.619749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:45.629933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:45.632405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:45.633925 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-72df6e3e-78aa-4290-b623-1257ab47813c tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1333 microversion: 2.47 time: 0.111425 Aug 27 04:55:45.635190 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 528/1079] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:45 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1333 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:45.863622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c9297500-5a7b-47c3-99a5-799dc8b22af3 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565185dc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:45.909495 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c9297500-5a7b-47c3-99a5-799dc8b22af3 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.049793 Aug 27 04:55:45.910060 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 552/1080] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:45 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:45.956662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-77ce508d-8cda-45a1-a4db-2d5204123d1d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:45.957271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-77ce508d-8cda-45a1-a4db-2d5204123d1d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:45.963243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77ce508d-8cda-45a1-a4db-2d5204123d1d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:45.963725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77ce508d-8cda-45a1-a4db-2d5204123d1d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:45.964163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77ce508d-8cda-45a1-a4db-2d5204123d1d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:45.964854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77ce508d-8cda-45a1-a4db-2d5204123d1d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:45.965311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77ce508d-8cda-45a1-a4db-2d5204123d1d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:45.965737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77ce508d-8cda-45a1-a4db-2d5204123d1d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:46.109178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-77ce508d-8cda-45a1-a4db-2d5204123d1d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:46.117309 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-77ce508d-8cda-45a1-a4db-2d5204123d1d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.164496 Aug 27 04:55:46.117866 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 529/1081] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:45 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:46.455455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-37b18d16-1038-4f4a-87b6-ac37ae68a4cb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:46.456078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-37b18d16-1038-4f4a-87b6-ac37ae68a4cb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:46.462632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b18d16-1038-4f4a-87b6-ac37ae68a4cb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:46.463144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b18d16-1038-4f4a-87b6-ac37ae68a4cb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:46.463598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b18d16-1038-4f4a-87b6-ac37ae68a4cb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:46.464291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b18d16-1038-4f4a-87b6-ac37ae68a4cb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:46.464758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b18d16-1038-4f4a-87b6-ac37ae68a4cb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:46.465249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b18d16-1038-4f4a-87b6-ac37ae68a4cb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:46.533108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:46.533713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:46.540854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:46.541338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:46.541769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:46.542498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:46.542952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:46.543401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:46.619293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:46.628131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-37b18d16-1038-4f4a-87b6-ac37ae68a4cb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:46.628360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:46.629835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:46.631626 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-daac7260-d747-43de-a801-fb566aac686d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1372 microversion: 2.47 time: 0.102788 Aug 27 04:55:46.632190 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 530/1082] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:46 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:46.639210 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-37b18d16-1038-4f4a-87b6-ac37ae68a4cb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1316 microversion: 2.1 time: 0.187241 Aug 27 04:55:46.640034 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 553/1083] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:46 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:46.657259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:46.658108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:46.664087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:46.664578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:46.665027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:46.665728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:46.666187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:46.666615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:46.730469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:46.738661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:46.740141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:46.741296 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c2594696-6cbe-4681-b051-288612da87fb tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1339 microversion: 2.47 time: 0.087982 Aug 27 04:55:46.741884 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 531/1084] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:46 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:46.924815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-24968b13-6410-4a5c-a02f-307de4661be6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56517fc10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:46.970964 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-24968b13-6410-4a5c-a02f-307de4661be6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.050049 Aug 27 04:55:46.971576 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 554/1085] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:46 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:47.138076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e71f1050-de67-48f5-aa73-2d778de4a582 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:47.138795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e71f1050-de67-48f5-aa73-2d778de4a582 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:47.145120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e71f1050-de67-48f5-aa73-2d778de4a582 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.145607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e71f1050-de67-48f5-aa73-2d778de4a582 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.146194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e71f1050-de67-48f5-aa73-2d778de4a582 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.147031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e71f1050-de67-48f5-aa73-2d778de4a582 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.147659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e71f1050-de67-48f5-aa73-2d778de4a582 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.148090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e71f1050-de67-48f5-aa73-2d778de4a582 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.309405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e71f1050-de67-48f5-aa73-2d778de4a582 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:47.317376 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e71f1050-de67-48f5-aa73-2d778de4a582 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.182844 Aug 27 04:55:47.318280 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 532/1086] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:47 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:47.656169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:47.656930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:47.663478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c60ab91f-30ba-42e0-9376-26ea20dfd349 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:47.663969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.664196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.664310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c60ab91f-30ba-42e0-9376-26ea20dfd349 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:47.664639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.665355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.665837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.666265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.671187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c60ab91f-30ba-42e0-9376-26ea20dfd349 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.671700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c60ab91f-30ba-42e0-9376-26ea20dfd349 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.672207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c60ab91f-30ba-42e0-9376-26ea20dfd349 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.672976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c60ab91f-30ba-42e0-9376-26ea20dfd349 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.673506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c60ab91f-30ba-42e0-9376-26ea20dfd349 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.674000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c60ab91f-30ba-42e0-9376-26ea20dfd349 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.756388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:47.765356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:47.766809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:47.768042 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de48f938-bb40-4f34-8857-c5854f727729 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1357 microversion: 2.47 time: 0.116038 Aug 27 04:55:47.768634 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 555/1087] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:47 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1357 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:47.773553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:47.774162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:47.780333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.780927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.781433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.782489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.783219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.784854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.838088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c60ab91f-30ba-42e0-9376-26ea20dfd349 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:47.846162 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c60ab91f-30ba-42e0-9376-26ea20dfd349 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1466 microversion: 2.1 time: 0.188021 Aug 27 04:55:47.846743 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 533/1088] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:47 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1466 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:47.854364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:47.858965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:47.862804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:47.863873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:47.864416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:47.864729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Searching by: {'deleted': False, 'project_id': '61be3047d2d54f82bd101442569d4469'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:55:47.865573 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-746d1b88-324f-43c4-b562-7308dea8b611 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1339 microversion: 2.47 time: 0.096000 Aug 27 04:55:47.866158 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 556/1089] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:47 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:47.869888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.870360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.870677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8a9333e1-0a59-4373-b8cf-b7bdde869b75 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:47.870785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.871309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8a9333e1-0a59-4373-b8cf-b7bdde869b75 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:47.871491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.872014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.872437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.877424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a9333e1-0a59-4373-b8cf-b7bdde869b75 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.877918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a9333e1-0a59-4373-b8cf-b7bdde869b75 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.878390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a9333e1-0a59-4373-b8cf-b7bdde869b75 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.879128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a9333e1-0a59-4373-b8cf-b7bdde869b75 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:47.880080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a9333e1-0a59-4373-b8cf-b7bdde869b75 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:47.880080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a9333e1-0a59-4373-b8cf-b7bdde869b75 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.988189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:55:48.005350 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8a9333e1-0a59-4373-b8cf-b7bdde869b75 tempest-ServersOnMultiNodesTest-393949868 tempest-ServersOnMultiNodesTest-393949868-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1619 microversion: 2.1 time: 0.138173 Aug 27 04:55:48.006016 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 557/1090] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:47 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1619 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:48.010463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0948bbf6-30bc-4244-9f50-86747059a0a4 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565195940>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.053897 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0948bbf6-30bc-4244-9f50-86747059a0a4 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.046868 Aug 27 04:55:48.054461 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 558/1091] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:48 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:48.059439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e42d8c9e-e14e-481e-bfed-98659acb2d96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.059935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e42d8c9e-e14e-481e-bfed-98659acb2d96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:48.066530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e42d8c9e-e14e-481e-bfed-98659acb2d96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.067022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e42d8c9e-e14e-481e-bfed-98659acb2d96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.067497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e42d8c9e-e14e-481e-bfed-98659acb2d96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.068200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e42d8c9e-e14e-481e-bfed-98659acb2d96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.068507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.068657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e42d8c9e-e14e-481e-bfed-98659acb2d96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.069091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e42d8c9e-e14e-481e-bfed-98659acb2d96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.075299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.075788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.076226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.087818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.089267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.096384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e42d8c9e-e14e-481e-bfed-98659acb2d96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:55:48.129887 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5297ce49-3575-402a-b694-51c7012c7ab4 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.274564 Aug 27 04:55:48.130673 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 534/1092] 10.222.0.58 () {60 vars in 1187 bytes} [Sat Aug 27 04:55:47 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:48.162702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c406635d-8372-4f39-bf1b-63ffa23b61d1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.163251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c406635d-8372-4f39-bf1b-63ffa23b61d1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:48.178091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c406635d-8372-4f39-bf1b-63ffa23b61d1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.178586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c406635d-8372-4f39-bf1b-63ffa23b61d1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.179025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c406635d-8372-4f39-bf1b-63ffa23b61d1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.179772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c406635d-8372-4f39-bf1b-63ffa23b61d1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.180232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c406635d-8372-4f39-bf1b-63ffa23b61d1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.180655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c406635d-8372-4f39-bf1b-63ffa23b61d1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.202570 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e42d8c9e-e14e-481e-bfed-98659acb2d96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 204 len: 0 microversion: 2.1 time: 0.143271 Aug 27 04:55:48.210144 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 559/1093] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:55:48 2022] DELETE /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:55:48.213316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c406635d-8372-4f39-bf1b-63ffa23b61d1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:55:48.216968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-287d5efb-1fde-400c-b0a5-a6b04b0ee2de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.217740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-287d5efb-1fde-400c-b0a5-a6b04b0ee2de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:48.227148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-287d5efb-1fde-400c-b0a5-a6b04b0ee2de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.227655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-287d5efb-1fde-400c-b0a5-a6b04b0ee2de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.228288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-287d5efb-1fde-400c-b0a5-a6b04b0ee2de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.229537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-287d5efb-1fde-400c-b0a5-a6b04b0ee2de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.230087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-287d5efb-1fde-400c-b0a5-a6b04b0ee2de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.230525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-287d5efb-1fde-400c-b0a5-a6b04b0ee2de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.306055 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c406635d-8372-4f39-bf1b-63ffa23b61d1 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 204 len: 0 microversion: 2.47 time: 0.147300 Aug 27 04:55:48.306966 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 535/1094] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:55:48 2022] DELETE /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:55:48.316185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.316947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:48.323669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.324153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.325387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.325533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.326067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.326332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.392291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-287d5efb-1fde-400c-b0a5-a6b04b0ee2de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.401179 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-287d5efb-1fde-400c-b0a5-a6b04b0ee2de tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1472 microversion: 2.1 time: 0.189452 Aug 27 04:55:48.408684 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 560/1095] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:48 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:48.408684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bc7e748a-0b3a-4fe5-a668-bc6c1cf87108 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.408684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bc7e748a-0b3a-4fe5-a668-bc6c1cf87108 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:48.414428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7e748a-0b3a-4fe5-a668-bc6c1cf87108 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.415231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7e748a-0b3a-4fe5-a668-bc6c1cf87108 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.415377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.416145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7e748a-0b3a-4fe5-a668-bc6c1cf87108 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.417016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7e748a-0b3a-4fe5-a668-bc6c1cf87108 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.418064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7e748a-0b3a-4fe5-a668-bc6c1cf87108 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.418665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7e748a-0b3a-4fe5-a668-bc6c1cf87108 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.419409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:48.425902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.427352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.428550 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e92e1435-f4f2-40a8-ad67-582aa63a3dbf tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1363 microversion: 2.47 time: 0.116975 Aug 27 04:55:48.429303 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 536/1096] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:48 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1363 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:55:48.552122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bc7e748a-0b3a-4fe5-a668-bc6c1cf87108 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.560585 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bc7e748a-0b3a-4fe5-a668-bc6c1cf87108 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.157424 Aug 27 04:55:48.561246 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 561/1097] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:48 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:48.892941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.893576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:48.901386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.901873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.902312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.903014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.903494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.903926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.969823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.978485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.979804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.980920 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2031a694-312d-45d1-89c2-c6fb4b74dead tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1339 microversion: 2.47 time: 0.091919 Aug 27 04:55:48.981478 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 537/1098] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:48 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1339 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:49.067848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a25e846b-737e-4442-92a5-8092c4657582 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565195040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:49.111456 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a25e846b-737e-4442-92a5-8092c4657582 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.047334 Aug 27 04:55:49.112009 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 562/1099] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:49 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:49.423315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8cacce1-9e13-437b-a7a1-746e37ad2dc5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:49.423929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8cacce1-9e13-437b-a7a1-746e37ad2dc5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:49.429943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8cacce1-9e13-437b-a7a1-746e37ad2dc5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:49.430433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8cacce1-9e13-437b-a7a1-746e37ad2dc5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:49.430874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8cacce1-9e13-437b-a7a1-746e37ad2dc5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:49.431598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8cacce1-9e13-437b-a7a1-746e37ad2dc5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:49.432060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8cacce1-9e13-437b-a7a1-746e37ad2dc5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:49.432494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8cacce1-9e13-437b-a7a1-746e37ad2dc5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:49.452190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:49.452841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:49.458868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:49.459890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:49.460329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:49.461059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:49.461515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:49.461948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:49.532533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:49.541298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:49.542738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:49.544013 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-12be4def-daa6-4fe7-ac5c-15fc5ac97c7e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1363 microversion: 2.47 time: 0.095767 Aug 27 04:55:49.544577 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 563/1100] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:49 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1363 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:55:49.581317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b53618b6-5f28-4910-8b47-0f1b755cadb1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:49.581953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b53618b6-5f28-4910-8b47-0f1b755cadb1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:49.587458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8cacce1-9e13-437b-a7a1-746e37ad2dc5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:49.588519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b53618b6-5f28-4910-8b47-0f1b755cadb1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:49.589008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b53618b6-5f28-4910-8b47-0f1b755cadb1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:49.589440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b53618b6-5f28-4910-8b47-0f1b755cadb1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:49.590133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b53618b6-5f28-4910-8b47-0f1b755cadb1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:49.590589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b53618b6-5f28-4910-8b47-0f1b755cadb1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:49.591006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b53618b6-5f28-4910-8b47-0f1b755cadb1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:49.595294 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8cacce1-9e13-437b-a7a1-746e37ad2dc5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1472 microversion: 2.1 time: 0.176054 Aug 27 04:55:49.595959 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 538/1101] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:49 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:49.723160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b53618b6-5f28-4910-8b47-0f1b755cadb1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:49.731141 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b53618b6-5f28-4910-8b47-0f1b755cadb1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.153643 Aug 27 04:55:49.731854 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 564/1102] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:49 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:50.004339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:50.004976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:50.011976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:50.012485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:50.012921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:50.013612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:50.014066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:50.014489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:50.078307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:50.086318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:50.087794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:50.088912 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af042c13-7431-4112-a1c0-b89e3b058ea3 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1339 microversion: 2.47 time: 0.088712 Aug 27 04:55:50.089466 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 539/1103] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:49 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:50.126871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-02ab4d59-0e05-4b83-9006-e937bfc38fd6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56517f940>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:50.168889 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-02ab4d59-0e05-4b83-9006-e937bfc38fd6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.046056 Aug 27 04:55:50.169579 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 565/1104] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:50 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:50.426214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-fe3bc8bf-2077-460f-9e4e-15d7b614a4a9 req-6607116f-e185-4a8d-9b9f-9146e87c6c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a984e8-a342-45d3-80b7-f149773c4c19", "name": "network-vif-plugged", "status": "completed", "tag": "4f37ae87-ac14-4a9c-adf4-091cf9796741"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:50.436844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fe3bc8bf-2077-460f-9e4e-15d7b614a4a9 req-6607116f-e185-4a8d-9b9f-9146e87c6c81 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:50.437365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fe3bc8bf-2077-460f-9e4e-15d7b614a4a9 req-6607116f-e185-4a8d-9b9f-9146e87c6c81 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:50.437770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fe3bc8bf-2077-460f-9e4e-15d7b614a4a9 req-6607116f-e185-4a8d-9b9f-9146e87c6c81 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:50.448800 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-fe3bc8bf-2077-460f-9e4e-15d7b614a4a9 req-6607116f-e185-4a8d-9b9f-9146e87c6c81 service nova] Creating event network-vif-plugged:4f37ae87-ac14-4a9c-adf4-091cf9796741 for instance e6a984e8-a342-45d3-80b7-f149773c4c19 on n-h2-820368-35 Aug 27 04:55:50.453448 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-fe3bc8bf-2077-460f-9e4e-15d7b614a4a9 req-6607116f-e185-4a8d-9b9f-9146e87c6c81 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030945 Aug 27 04:55:50.454050 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 540/1105] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:50.566428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:50.567071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:50.574380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:50.574854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:50.577927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:50.577927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:50.578361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:50.578798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:50.619048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e92c80e2-572a-47c6-8fa7-d62d6914b1a6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:50.619988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e92c80e2-572a-47c6-8fa7-d62d6914b1a6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:50.627538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92c80e2-572a-47c6-8fa7-d62d6914b1a6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:50.628279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92c80e2-572a-47c6-8fa7-d62d6914b1a6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:50.628817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92c80e2-572a-47c6-8fa7-d62d6914b1a6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:50.629632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92c80e2-572a-47c6-8fa7-d62d6914b1a6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:50.630312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92c80e2-572a-47c6-8fa7-d62d6914b1a6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:50.630852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e92c80e2-572a-47c6-8fa7-d62d6914b1a6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:50.661410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:50.671619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:50.673293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:50.674624 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-61a23a99-ac48-4dea-a7dd-bdc070763c24 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1363 microversion: 2.47 time: 0.112333 Aug 27 04:55:50.675430 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 566/1106] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:50 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1363 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:50.752337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-463f8413-1ee0-4abf-9eab-9febba0525ff tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:50.753237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-463f8413-1ee0-4abf-9eab-9febba0525ff tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:50.759707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-463f8413-1ee0-4abf-9eab-9febba0525ff tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:50.760429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-463f8413-1ee0-4abf-9eab-9febba0525ff tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:50.760893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-463f8413-1ee0-4abf-9eab-9febba0525ff tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:50.761616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-463f8413-1ee0-4abf-9eab-9febba0525ff tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:50.762104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-463f8413-1ee0-4abf-9eab-9febba0525ff tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:50.762510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-463f8413-1ee0-4abf-9eab-9febba0525ff tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:50.766286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e92c80e2-572a-47c6-8fa7-d62d6914b1a6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:50.775197 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e92c80e2-572a-47c6-8fa7-d62d6914b1a6 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1472 microversion: 2.1 time: 0.161342 Aug 27 04:55:50.776343 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 541/1107] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:50 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:50.899687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-463f8413-1ee0-4abf-9eab-9febba0525ff tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:50.907713 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-463f8413-1ee0-4abf-9eab-9febba0525ff tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.159529 Aug 27 04:55:50.908271 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 567/1108] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:50 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:51.111313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:51.111867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:51.118204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:51.118684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:51.119135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:51.119824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:51.120277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:51.120701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:51.183284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b985195c-876b-43b5-9cac-e16294a14d2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565185e50>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:51.188289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:51.197132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:51.198571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:51.199756 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ed797740-7f53-4123-ab14-7bb6bac00e19 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1339 microversion: 2.47 time: 0.092447 Aug 27 04:55:51.200326 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 542/1109] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:51 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:51.228029 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b985195c-876b-43b5-9cac-e16294a14d2f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.048797 Aug 27 04:55:51.228598 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 568/1110] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:51 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:51.698410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:51.699036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:51.707330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:51.708107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:51.708722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:51.709615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:51.710413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:51.710730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:51.776581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:51.794172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:51.795743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:51.797204 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-56ab6777-6b1c-4ed0-9bfe-af858fcbc522 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1363 microversion: 2.47 time: 0.102559 Aug 27 04:55:51.798274 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 543/1111] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:51 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1363 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:51.806814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68fb557b-d146-40e4-8bf2-bdb768c0b128 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:51.808435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68fb557b-d146-40e4-8bf2-bdb768c0b128 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:51.818211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fb557b-d146-40e4-8bf2-bdb768c0b128 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:51.819365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fb557b-d146-40e4-8bf2-bdb768c0b128 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:51.821176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fb557b-d146-40e4-8bf2-bdb768c0b128 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:51.822339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fb557b-d146-40e4-8bf2-bdb768c0b128 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:51.822938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fb557b-d146-40e4-8bf2-bdb768c0b128 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:51.823492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fb557b-d146-40e4-8bf2-bdb768c0b128 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:51.929986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b4bc3f4-0a17-46b7-9c76-db1892600737 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:51.930728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2b4bc3f4-0a17-46b7-9c76-db1892600737 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:51.936757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bc3f4-0a17-46b7-9c76-db1892600737 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:51.937318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bc3f4-0a17-46b7-9c76-db1892600737 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:51.937816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bc3f4-0a17-46b7-9c76-db1892600737 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:51.938595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bc3f4-0a17-46b7-9c76-db1892600737 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:51.939144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bc3f4-0a17-46b7-9c76-db1892600737 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:51.939571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bc3f4-0a17-46b7-9c76-db1892600737 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:51.991689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68fb557b-d146-40e4-8bf2-bdb768c0b128 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:51.999557 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68fb557b-d146-40e4-8bf2-bdb768c0b128 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1472 microversion: 2.1 time: 0.206329 Aug 27 04:55:52.000227 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 569/1112] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:51 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1472 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:52.077023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2b4bc3f4-0a17-46b7-9c76-db1892600737 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:52.084596 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2b4bc3f4-0a17-46b7-9c76-db1892600737 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.159485 Aug 27 04:55:52.085158 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 544/1113] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:51 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:52.223436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:52.224042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:52.226599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=14 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:52.227370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=12 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:52.233870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:52.234357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:52.234793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:52.235524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:52.235975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:52.236400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:52.243627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-91903b2a-7128-474d-ae31-ff240a265545 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565191670>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:52.294814 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-91903b2a-7128-474d-ae31-ff240a265545 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.055767 Aug 27 04:55:52.295837 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 545/1114] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:52 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:52.306484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:52.314738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:52.316289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:52.317408 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-91836f6a-6616-4103-8ee3-17afa505ea5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1339 microversion: 2.47 time: 0.097983 Aug 27 04:55:52.317956 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 570/1115] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:52 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:52.476420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-eaf743f8-95d9-4826-9220-23dd25aee4d6 req-3e2a3347-ea48-4dfc-b0e6-86626f954162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd002ec2-35f3-43fb-b976-ecb02f1b7738", "name": "network-vif-plugged", "status": "completed", "tag": "4783370e-a485-40e1-8ea2-5a10e13b0d87"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:52.486808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-eaf743f8-95d9-4826-9220-23dd25aee4d6 req-3e2a3347-ea48-4dfc-b0e6-86626f954162 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:52.487321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-eaf743f8-95d9-4826-9220-23dd25aee4d6 req-3e2a3347-ea48-4dfc-b0e6-86626f954162 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:52.487755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-eaf743f8-95d9-4826-9220-23dd25aee4d6 req-3e2a3347-ea48-4dfc-b0e6-86626f954162 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:52.498120 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-eaf743f8-95d9-4826-9220-23dd25aee4d6 req-3e2a3347-ea48-4dfc-b0e6-86626f954162 service nova] Creating event network-vif-plugged:4783370e-a485-40e1-8ea2-5a10e13b0d87 for instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 on n-h1-820368-35 Aug 27 04:55:52.503491 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-eaf743f8-95d9-4826-9220-23dd25aee4d6 req-3e2a3347-ea48-4dfc-b0e6-86626f954162 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032177 Aug 27 04:55:52.504120 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 546/1116] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:55:52.617764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-6bd13757-a86b-41dd-a3a6-c6c1396cdf03 req-78e1794c-08ff-4bb9-9c4c-e0bb1480cce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e86e4e3-9732-459d-aa87-306b7a76374f", "name": "network-vif-deleted", "tag": "3c078f89-20fc-44b6-9e24-7cd010231165"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:52.631385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6bd13757-a86b-41dd-a3a6-c6c1396cdf03 req-78e1794c-08ff-4bb9-9c4c-e0bb1480cce8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:52.632283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6bd13757-a86b-41dd-a3a6-c6c1396cdf03 req-78e1794c-08ff-4bb9-9c4c-e0bb1480cce8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:52.636076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6bd13757-a86b-41dd-a3a6-c6c1396cdf03 req-78e1794c-08ff-4bb9-9c4c-e0bb1480cce8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:52.668505 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-6bd13757-a86b-41dd-a3a6-c6c1396cdf03 req-78e1794c-08ff-4bb9-9c4c-e0bb1480cce8 service nova] Creating event network-vif-deleted:3c078f89-20fc-44b6-9e24-7cd010231165 for instance 5e86e4e3-9732-459d-aa87-306b7a76374f on n-h1-820368-35 Aug 27 04:55:52.680909 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-6bd13757-a86b-41dd-a3a6-c6c1396cdf03 req-78e1794c-08ff-4bb9-9c4c-e0bb1480cce8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066915 Aug 27 04:55:52.681522 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 571/1117] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:52.823633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:52.824815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:52.831513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:52.832629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:52.833311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:52.835348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:52.836044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:52.836718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:52.912366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:52.932371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:52.934254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:52.935506 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a20bdab3-dda7-4010-bab7-3ee41c841592 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1363 microversion: 2.47 time: 0.117067 Aug 27 04:55:52.936052 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 547/1118] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:52 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1363 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:53.022736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:53.024415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:53.035765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.036532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.037073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.038019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.038483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.038973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.082643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.083167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.083621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.084112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lazy-loading 'fault' on Instance uuid 5e86e4e3-9732-459d-aa87-306b7a76374f {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:55:53.087448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:53.105818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-59a8c006-e4e6-4470-a60e-c4ad861c77d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:53.107566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-59a8c006-e4e6-4470-a60e-c4ad861c77d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:53.117013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a8c006-e4e6-4470-a60e-c4ad861c77d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.117779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a8c006-e4e6-4470-a60e-c4ad861c77d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.118446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a8c006-e4e6-4470-a60e-c4ad861c77d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.119543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a8c006-e4e6-4470-a60e-c4ad861c77d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.120246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a8c006-e4e6-4470-a60e-c4ad861c77d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.120917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a8c006-e4e6-4470-a60e-c4ad861c77d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.149167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:53.157592 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-506abb26-1238-48f9-abe6-7d5b442cae96 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 200 len: 1306 microversion: 2.1 time: 0.140262 Aug 27 04:55:53.160129 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 572/1119] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:53 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 1306 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:53.285988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-59a8c006-e4e6-4470-a60e-c4ad861c77d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:53.296153 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-59a8c006-e4e6-4470-a60e-c4ad861c77d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.194433 Aug 27 04:55:53.297115 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 548/1120] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:53 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:53.309918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-04445653-8340-4da9-a729-b84bad2cff76 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565172430>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:53.340252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:53.340856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:53.347000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.347653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.348095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.348875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.349907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.350348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.355711 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-04445653-8340-4da9-a729-b84bad2cff76 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.049448 Aug 27 04:55:53.356274 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 573/1121] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:53 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:53.413688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:53.421725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:53.423176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:53.424304 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6adfddf0-242d-44d3-b70c-4d242cc72f6d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1339 microversion: 2.47 time: 0.087883 Aug 27 04:55:53.424865 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 549/1122] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:53 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:55:53.959660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:53.960349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:53.966533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.967012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.967475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.968163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.968611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.969032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.000506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:54.004248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.004772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.005206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.005650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lazy-loading 'fault' on Instance uuid f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:55:54.056433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:54.069419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:54.070989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:54.072248 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b103c59a-8b97-4ce7-a8aa-4f1bf5803c06 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 200 len: 1368 microversion: 2.47 time: 0.117062 Aug 27 04:55:54.073363 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 574/1123] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:53 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 1368 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:54.181673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:54.183276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 5e86e4e3-9732-459d-aa87-306b7a76374f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:54.189841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.190599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.191148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.192197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.192766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.193928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.208437 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] HTTP exception thrown: Instance 5e86e4e3-9732-459d-aa87-306b7a76374f could not be found. Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Request method failure captured: Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f HTTP/1.1 Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMY1qHnSwS1R8lTLyEZpfcwh5hCoXkzotR9jOR2p2AdfSdoBaXr9xo5Qs5AwnpClVIv_uSMUYdTcbJGG1bGKoa9FCezps1Pwbaw5Q-rfKGHFEUMQzY_fBNgr5vYtWKYE6dl5a47pYUpTtpNyImLWoA2aPEk2Ztp0ryewpXtbk1sKFE Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:55:54.210925 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4074bf02227441b091b6e7d62f83b9e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 113873d86b0c417e92a88af412281fe6 Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 5e86e4e3-9732-459d-aa87-306b7a76374f could not be found. Aug 27 04:55:54.212740 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '5e86e4e3-9732-459d-aa87-306b7a76374f'} Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e86e4e3-9732-459d-aa87-306b7a76374f could not be found. Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:54.216944 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e86e4e3-9732-459d-aa87-306b7a76374f could not be found. Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e86e4e3-9732-459d-aa87-306b7a76374f could not be found. Aug 27 04:55:54.218451 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.220485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Returning 404 to user: Instance 5e86e4e3-9732-459d-aa87-306b7a76374f could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:54.220485 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-83d13fd2-ea00-4279-b929-2cc29d47acc9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f" status: 404 len: 111 microversion: 2.1 time: 0.035629 Aug 27 04:55:54.220485 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 550/1124] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:54 2022] GET /compute/v2.1/servers/5e86e4e3-9732-459d-aa87-306b7a76374f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:55:54.221186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab2b3916-3208-4685-9d0d-71751dacd963 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:54.221694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ab2b3916-3208-4685-9d0d-71751dacd963 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:54.227937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2b3916-3208-4685-9d0d-71751dacd963 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.228505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2b3916-3208-4685-9d0d-71751dacd963 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.228987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2b3916-3208-4685-9d0d-71751dacd963 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.229711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2b3916-3208-4685-9d0d-71751dacd963 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.230189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2b3916-3208-4685-9d0d-71751dacd963 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.230666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2b3916-3208-4685-9d0d-71751dacd963 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.257506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ab2b3916-3208-4685-9d0d-71751dacd963 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:55:54.319239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90cc0011-cbc8-486a-84df-d5ffba5de7ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:54.319852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-90cc0011-cbc8-486a-84df-d5ffba5de7ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:54.328133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90cc0011-cbc8-486a-84df-d5ffba5de7ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.328839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90cc0011-cbc8-486a-84df-d5ffba5de7ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.329434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90cc0011-cbc8-486a-84df-d5ffba5de7ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.330153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90cc0011-cbc8-486a-84df-d5ffba5de7ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.330591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90cc0011-cbc8-486a-84df-d5ffba5de7ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.331010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90cc0011-cbc8-486a-84df-d5ffba5de7ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.356511 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ab2b3916-3208-4685-9d0d-71751dacd963 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 204 len: 0 microversion: 2.1 time: 0.138829 Aug 27 04:55:54.357944 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 575/1125] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:55:54 2022] DELETE /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:55:54.367200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-518f7835-d1d0-433f-86cb-c144b010ee3b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:54.368986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-518f7835-d1d0-433f-86cb-c144b010ee3b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:54.376559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-518f7835-d1d0-433f-86cb-c144b010ee3b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.377054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-518f7835-d1d0-433f-86cb-c144b010ee3b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.377489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-518f7835-d1d0-433f-86cb-c144b010ee3b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.378204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-518f7835-d1d0-433f-86cb-c144b010ee3b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.378689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-518f7835-d1d0-433f-86cb-c144b010ee3b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.379139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-518f7835-d1d0-433f-86cb-c144b010ee3b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.537856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-90cc0011-cbc8-486a-84df-d5ffba5de7ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:54.545896 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90cc0011-cbc8-486a-84df-d5ffba5de7ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.231987 Aug 27 04:55:54.546564 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 551/1126] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:54 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:54.562132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-518f7835-d1d0-433f-86cb-c144b010ee3b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:54.565261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-20173f6a-cde1-4824-afa5-4d02a6342637 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5651950d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:54.571754 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-518f7835-d1d0-433f-86cb-c144b010ee3b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1472 microversion: 2.1 time: 0.209401 Aug 27 04:55:54.572622 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 576/1127] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:54 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1472 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:54.578084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:54.578777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:54.586187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.586793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.587340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.588236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.589103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.589726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.613594 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-20173f6a-cde1-4824-afa5-4d02a6342637 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.052882 Aug 27 04:55:54.614251 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 552/1128] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:54 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:54.656014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:54.664980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:54.666425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:54.667763 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9b00b393-6edc-4d32-ab87-8a529176dd2e tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1360 microversion: 2.47 time: 0.093991 Aug 27 04:55:54.668374 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 577/1129] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:54 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1360 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:54.690774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8cf03299-7cbb-48c8-8169-b8255a83d375 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-757256093"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:54.693728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8cf03299-7cbb-48c8-8169-b8255a83d375 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:54.700852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cf03299-7cbb-48c8-8169-b8255a83d375 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.701543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cf03299-7cbb-48c8-8169-b8255a83d375 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.702139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cf03299-7cbb-48c8-8169-b8255a83d375 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.703007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cf03299-7cbb-48c8-8169-b8255a83d375 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.703644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cf03299-7cbb-48c8-8169-b8255a83d375 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.704234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8cf03299-7cbb-48c8-8169-b8255a83d375 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.923680 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8cf03299-7cbb-48c8-8169-b8255a83d375 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "POST /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6/action" status: 202 len: 52 microversion: 2.47 time: 0.236410 Aug 27 04:55:54.924484 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 553/1130] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 04:55:54 2022] POST /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6/action => generated 52 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 27 04:55:54.936279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-af3073a6-8328-4420-af70-6c51cafc8706 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:54.937008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-af3073a6-8328-4420-af70-6c51cafc8706 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:54.944486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3073a6-8328-4420-af70-6c51cafc8706 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.945059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3073a6-8328-4420-af70-6c51cafc8706 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.945566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3073a6-8328-4420-af70-6c51cafc8706 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.946419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3073a6-8328-4420-af70-6c51cafc8706 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.946982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3073a6-8328-4420-af70-6c51cafc8706 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.947507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3073a6-8328-4420-af70-6c51cafc8706 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.976109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-af3073a6-8328-4420-af70-6c51cafc8706 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:55:55.058307 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-af3073a6-8328-4420-af70-6c51cafc8706 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "DELETE /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 204 len: 0 microversion: 2.47 time: 0.125576 Aug 27 04:55:55.058906 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 578/1131] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:55:54 2022] DELETE /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:55:55.067799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:55.068869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:55.071027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:55.076819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.077461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.077965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.078743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.079306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.079735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.108385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:55.113830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:55.122850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.130355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.131175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.132111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.134093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.134689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.167201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:55.175694 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] HTTP exception thrown: Instance f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b could not be found. Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Request method failure captured: Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b HTTP/1.1 Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaOMb4XJcL9SrGntJo1zB7xL_SL3KyEdG9y93MXg_h0Z4z76cdts9VBnUnue3jjgWZKpIyKlJFT8tyRL2Pwpkb-B6QqdTVdecSPQemQo8Ka5FhNRi37UDxTqrnIEhEs_3x3CBAUP5hgxyoH5ZSMhHlfou8c2fKef9bdxJBmb6IV0tdU Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61be3047d2d54f82bd101442569d4469 Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerShowV247Test-2102095973 Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:55.178076 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61be3047d2d54f82bd101442569d4469", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61be3047d2d54f82bd101442569d4469"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61be3047d2d54f82bd101442569d4469"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61be3047d2d54f82bd101442569d4469"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerShowV247Test-2102095973 Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61be3047d2d54f82bd101442569d4469 Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerShowV247Test-2102095973 Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerShowV247Test-2102095973-project Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c6a42d438e5f4ad2924427828385a08b Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerShowV247Test-2102095973-project Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b could not be found. Aug 27 04:55:55.179763 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b'} Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b could not be found. Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:55.180675 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b could not be found. Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b could not be found. Aug 27 04:55:55.182357 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:55.184860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Returning 404 to user: Instance f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:55.184860 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-94f69af2-ba4f-4505-b2a4-7bcc65e5ae5d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b" status: 404 len: 111 microversion: 2.47 time: 0.088539 Aug 27 04:55:55.184860 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 579/1132] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:55 2022] GET /compute/v2.1/servers/f4e3bcf9-cbfa-49f5-9a5a-369d9b8ee13b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:55:55.186657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:55.188405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:55.189984 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-21cbc1d7-247e-498a-81a5-41e31ee3b65d tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1366 microversion: 2.47 time: 0.126483 Aug 27 04:55:55.190577 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 554/1133] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:55 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:55:55.192470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40feb14e-34c7-49ec-a676-9979c800bc7d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:55.193229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-40feb14e-34c7-49ec-a676-9979c800bc7d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: 65da6e54-b203-4fed-8737-af53723d3b89] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:55.200234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40feb14e-34c7-49ec-a676-9979c800bc7d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.200736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40feb14e-34c7-49ec-a676-9979c800bc7d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.201157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40feb14e-34c7-49ec-a676-9979c800bc7d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.201884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40feb14e-34c7-49ec-a676-9979c800bc7d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.202338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40feb14e-34c7-49ec-a676-9979c800bc7d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.202764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40feb14e-34c7-49ec-a676-9979c800bc7d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.232573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-40feb14e-34c7-49ec-a676-9979c800bc7d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: 65da6e54-b203-4fed-8737-af53723d3b89] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:55:55.339030 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40feb14e-34c7-49ec-a676-9979c800bc7d tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89" status: 204 len: 0 microversion: 2.47 time: 0.150482 Aug 27 04:55:55.339692 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 580/1134] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 04:55:55 2022] DELETE /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 04:55:55.350291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:55.351559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: 65da6e54-b203-4fed-8737-af53723d3b89] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:55.358567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.359451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.360042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.360918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.361511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.362069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.445441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:55.460125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:55.461582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:55.462793 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2eaf7676-ec96-47c9-8607-106465e27069 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89" status: 200 len: 1363 microversion: 2.47 time: 0.117757 Aug 27 04:55:55.479026 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 555/1135] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:55 2022] GET /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89 => generated 1363 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:55.571849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-55d46e38-9b0d-4843-b200-0e6f6bac75b8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:55.573532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-55d46e38-9b0d-4843-b200-0e6f6bac75b8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:55.580341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55d46e38-9b0d-4843-b200-0e6f6bac75b8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.581574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55d46e38-9b0d-4843-b200-0e6f6bac75b8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.582234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55d46e38-9b0d-4843-b200-0e6f6bac75b8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.583436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55d46e38-9b0d-4843-b200-0e6f6bac75b8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.584650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55d46e38-9b0d-4843-b200-0e6f6bac75b8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.585399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55d46e38-9b0d-4843-b200-0e6f6bac75b8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.594109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f1f75071-48b2-4dd6-9587-31f970f281f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:55.595207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f1f75071-48b2-4dd6-9587-31f970f281f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:55.606240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1f75071-48b2-4dd6-9587-31f970f281f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.609460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1f75071-48b2-4dd6-9587-31f970f281f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.610138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1f75071-48b2-4dd6-9587-31f970f281f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.613775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1f75071-48b2-4dd6-9587-31f970f281f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.614504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1f75071-48b2-4dd6-9587-31f970f281f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.615266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1f75071-48b2-4dd6-9587-31f970f281f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.628138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:55.851503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-55d46e38-9b0d-4843-b200-0e6f6bac75b8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:55.869638 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-55d46e38-9b0d-4843-b200-0e6f6bac75b8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1310 microversion: 2.1 time: 0.302151 Aug 27 04:55:55.870441 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 581/1136] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:55 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1310 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:55.877360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69b9240c-929c-4e5c-aa64-e670b2267202 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565206700>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:55.879865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f1f75071-48b2-4dd6-9587-31f970f281f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:55.889681 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f1f75071-48b2-4dd6-9587-31f970f281f9 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1472 microversion: 2.1 time: 0.300580 Aug 27 04:55:55.891848 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 556/1137] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:55 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1472 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:55.938435 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-69b9240c-929c-4e5c-aa64-e670b2267202 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.066777 Aug 27 04:55:55.939814 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 582/1138] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:55 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:56.213032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:56.213654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:56.219771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.220262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.220951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:56.221738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.222269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.222906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:56.298250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:56.315591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:56.317237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:56.319879 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a0b68814-e734-47cd-84ab-e64d69fa5530 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1366 microversion: 2.47 time: 0.110828 Aug 27 04:55:56.320879 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 557/1139] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:56 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:56.487231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:56.487231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: 65da6e54-b203-4fed-8737-af53723d3b89] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:56.494157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.494647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.495116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:56.495856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.496341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.496790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:56.566587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:56.576494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:56.578412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:56.579954 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-85e4cc2c-da75-47c0-9612-41800489dc4e tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89" status: 200 len: 1363 microversion: 2.47 time: 0.097856 Aug 27 04:55:56.580711 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 583/1140] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:56 2022] GET /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89 => generated 1363 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:56.890822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b16472cc-7f07-45fa-9455-a9f3f3c7fe39 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:56.891565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b16472cc-7f07-45fa-9455-a9f3f3c7fe39 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:56.898836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16472cc-7f07-45fa-9455-a9f3f3c7fe39 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.899454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16472cc-7f07-45fa-9455-a9f3f3c7fe39 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.899955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16472cc-7f07-45fa-9455-a9f3f3c7fe39 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:56.900865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16472cc-7f07-45fa-9455-a9f3f3c7fe39 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.901510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16472cc-7f07-45fa-9455-a9f3f3c7fe39 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.902184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16472cc-7f07-45fa-9455-a9f3f3c7fe39 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:56.914647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-010aeac7-1be1-4c35-949b-938eca8dfc1c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:56.915544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-010aeac7-1be1-4c35-949b-938eca8dfc1c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:56.926792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-010aeac7-1be1-4c35-949b-938eca8dfc1c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.927452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-010aeac7-1be1-4c35-949b-938eca8dfc1c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.927960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-010aeac7-1be1-4c35-949b-938eca8dfc1c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:56.930013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-010aeac7-1be1-4c35-949b-938eca8dfc1c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.930137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-010aeac7-1be1-4c35-949b-938eca8dfc1c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.935717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-010aeac7-1be1-4c35-949b-938eca8dfc1c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.140638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-010aeac7-1be1-4c35-949b-938eca8dfc1c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:57.151530 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-010aeac7-1be1-4c35-949b-938eca8dfc1c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1472 microversion: 2.1 time: 0.241451 Aug 27 04:55:57.152519 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 584/1141] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:56 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1472 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:57.157630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-70fd563c-206b-4c3e-90fb-e4372feef1de tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56510a280>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:57.176598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b16472cc-7f07-45fa-9455-a9f3f3c7fe39 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:57.186350 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b16472cc-7f07-45fa-9455-a9f3f3c7fe39 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1492 microversion: 2.1 time: 0.299227 Aug 27 04:55:57.187907 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 558/1142] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:56 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1492 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:57.230043 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-70fd563c-206b-4c3e-90fb-e4372feef1de tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.076154 Aug 27 04:55:57.238160 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 585/1143] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:57 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:57.347164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:57.348385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:57.364872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.365554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.366148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.367063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.367704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.368956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.390776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e6935f2-5502-4933-85ac-4d4a55e86343 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:57.391705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9e6935f2-5502-4933-85ac-4d4a55e86343 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:57.399435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e6935f2-5502-4933-85ac-4d4a55e86343 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.400179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e6935f2-5502-4933-85ac-4d4a55e86343 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.400766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e6935f2-5502-4933-85ac-4d4a55e86343 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.401650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e6935f2-5502-4933-85ac-4d4a55e86343 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.402266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e6935f2-5502-4933-85ac-4d4a55e86343 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.402876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e6935f2-5502-4933-85ac-4d4a55e86343 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.873213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:57.887705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:57.892602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:57.903244 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a702c749-f017-478d-9c68-9b016d78ae5f tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1366 microversion: 2.47 time: 0.563056 Aug 27 04:55:57.910994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:57.915843 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9e6935f2-5502-4933-85ac-4d4a55e86343 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1645 microversion: 2.1 time: 0.704448 Aug 27 04:55:57.915980 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 586/1144] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:57 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1366 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:57.926417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:57.927912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: 65da6e54-b203-4fed-8737-af53723d3b89] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:57.937636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.938376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.939156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.940397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.940693 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 559/1145] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:57 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1645 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:57.941829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.942604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.946307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8970ff9d-80ae-431f-a080-73d68869e646 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:57.950433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8970ff9d-80ae-431f-a080-73d68869e646 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:57.965860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8970ff9d-80ae-431f-a080-73d68869e646 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.966364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8970ff9d-80ae-431f-a080-73d68869e646 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.966810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8970ff9d-80ae-431f-a080-73d68869e646 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.967571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8970ff9d-80ae-431f-a080-73d68869e646 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.968038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8970ff9d-80ae-431f-a080-73d68869e646 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.968469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8970ff9d-80ae-431f-a080-73d68869e646 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.970711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:58.038419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.043771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.044495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.044978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lazy-loading 'fault' on Instance uuid 65da6e54-b203-4fed-8737-af53723d3b89 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:55:58.063651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:58.146806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:58.156609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:58.158031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6a42d438e5f4ad2924427828385a08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be3047d2d54f82bd101442569d4469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:58.159457 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1462d46c-899a-4604-a38a-b56d02bfffb9 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89" status: 200 len: 1368 microversion: 2.47 time: 0.242538 Aug 27 04:55:58.160834 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 587/1146] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:57 2022] GET /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:58.182991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-08b36a5f-9e75-489b-96ac-4f7940443283 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:58.184549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-08b36a5f-9e75-489b-96ac-4f7940443283 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:58.193335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08b36a5f-9e75-489b-96ac-4f7940443283 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.194059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08b36a5f-9e75-489b-96ac-4f7940443283 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.194650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08b36a5f-9e75-489b-96ac-4f7940443283 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.195595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08b36a5f-9e75-489b-96ac-4f7940443283 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.196200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08b36a5f-9e75-489b-96ac-4f7940443283 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.196803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08b36a5f-9e75-489b-96ac-4f7940443283 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.294106 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8970ff9d-80ae-431f-a080-73d68869e646 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1645 microversion: 2.1 time: 0.351321 Aug 27 04:55:58.295405 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 560/1147] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:57 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1645 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:58.328056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9ef0c773-3c1a-4fc4-9c2e-fcf3ebbf5af7 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56514f670>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:58.402622 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9ef0c773-3c1a-4fc4-9c2e-fcf3ebbf5af7 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.104930 Aug 27 04:55:58.403905 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 561/1148] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:58 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:58.416427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-62110e7b-da17-48c8-824c-72375eee6541 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:58.420397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62110e7b-da17-48c8-824c-72375eee6541 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.422765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62110e7b-da17-48c8-824c-72375eee6541 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.422765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62110e7b-da17-48c8-824c-72375eee6541 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.422765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62110e7b-da17-48c8-824c-72375eee6541 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.423079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62110e7b-da17-48c8-824c-72375eee6541 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.423380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62110e7b-da17-48c8-824c-72375eee6541 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.448641 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-62110e7b-da17-48c8-824c-72375eee6541 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.035721 Aug 27 04:55:58.449097 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 562/1149] 10.222.0.58 () {58 vars in 1176 bytes} [Sat Aug 27 04:55:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:58.460470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-08b36a5f-9e75-489b-96ac-4f7940443283 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:58.463081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1bdcd350-48b8-4c52-a26c-00acb755186e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-820368-35", "block_migration": true, "disk_over_commit": false}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:58.465658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1bdcd350-48b8-4c52-a26c-00acb755186e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:58.475507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bdcd350-48b8-4c52-a26c-00acb755186e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.476011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bdcd350-48b8-4c52-a26c-00acb755186e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.476455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bdcd350-48b8-4c52-a26c-00acb755186e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.476572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-08b36a5f-9e75-489b-96ac-4f7940443283 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1472 microversion: 2.1 time: 0.303157 Aug 27 04:55:58.477556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bdcd350-48b8-4c52-a26c-00acb755186e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.477674 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 588/1150] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:58 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:58.478125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bdcd350-48b8-4c52-a26c-00acb755186e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.478558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bdcd350-48b8-4c52-a26c-00acb755186e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.565461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-1bdcd350-48b8-4c52-a26c-00acb755186e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lazy-loading 'flavor' on Instance uuid e6a984e8-a342-45d3-80b7-f149773c4c19 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:55:58.617055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1bdcd350-48b8-4c52-a26c-00acb755186e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Going to try to live migrate instance to n-h1-820368-35 {{(pid=128548) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:55:58.730060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3d415e14-0841-4189-b808-87efe82cf4f2 req-fed73b3f-83bd-44b6-b657-66f9c9374664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c46e5a-ffeb-41a5-9593-6d64703ae23d", "name": "network-vif-deleted", "tag": "4ba304c5-0b28-4523-9219-f55fd7244c04"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:58.743767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3d415e14-0841-4189-b808-87efe82cf4f2 req-fed73b3f-83bd-44b6-b657-66f9c9374664 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.744652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3d415e14-0841-4189-b808-87efe82cf4f2 req-fed73b3f-83bd-44b6-b657-66f9c9374664 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.746167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3d415e14-0841-4189-b808-87efe82cf4f2 req-fed73b3f-83bd-44b6-b657-66f9c9374664 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.762255 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3d415e14-0841-4189-b808-87efe82cf4f2 req-fed73b3f-83bd-44b6-b657-66f9c9374664 service nova] Creating event network-vif-deleted:4ba304c5-0b28-4523-9219-f55fd7244c04 for instance a0c46e5a-ffeb-41a5-9593-6d64703ae23d on n-h2-820368-35 Aug 27 04:55:58.774698 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3d415e14-0841-4189-b808-87efe82cf4f2 req-fed73b3f-83bd-44b6-b657-66f9c9374664 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049544 Aug 27 04:55:58.775536 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 589/1151] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:55:58.938640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:58.940491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:58.960810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.962656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.963944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.966037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.966864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.976940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:59.083872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:59.093098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:59.094546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:59.095904 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d8a2c200-d031-4d55-8a36-7f9d05363973 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1366 microversion: 2.47 time: 0.168508 Aug 27 04:55:59.096867 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 590/1152] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:58 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:55:59.187835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:59.188453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] [instance: 65da6e54-b203-4fed-8737-af53723d3b89] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:59.196967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:59.197387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:59.197829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:59.198551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:59.199007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:59.199464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:59.231000 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] HTTP exception thrown: Instance 65da6e54-b203-4fed-8737-af53723d3b89 could not be found. Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Request method failure captured: Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89 HTTP/1.1 Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaOMb4XJcL9SrGntJo1zB7xL_SL3KyEdG9y93MXg_h0Z4z76cdts9VBnUnue3jjgWZKpIyKlJFT8tyRL2Pwpkb-B6QqdTVdecSPQemQo8Ka5FhNRi37UDxTqrnIEhEs_3x3CBAUP5hgxyoH5ZSMhHlfou8c2fKef9bdxJBmb6IV0tdU Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61be3047d2d54f82bd101442569d4469 Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerShowV247Test-2102095973 Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:55:59.232716 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61be3047d2d54f82bd101442569d4469", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61be3047d2d54f82bd101442569d4469"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61be3047d2d54f82bd101442569d4469"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61be3047d2d54f82bd101442569d4469"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerShowV247Test-2102095973 Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61be3047d2d54f82bd101442569d4469 Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerShowV247Test-2102095973 Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerShowV247Test-2102095973-project Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c6a42d438e5f4ad2924427828385a08b Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerShowV247Test-2102095973-project Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 65da6e54-b203-4fed-8737-af53723d3b89 could not be found. Aug 27 04:55:59.234434 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '65da6e54-b203-4fed-8737-af53723d3b89'} Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65da6e54-b203-4fed-8737-af53723d3b89 could not be found. Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:59.235305 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65da6e54-b203-4fed-8737-af53723d3b89 could not be found. Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65da6e54-b203-4fed-8737-af53723d3b89 could not be found. Aug 27 04:55:59.237199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:55:59.240274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] Returning 404 to user: Instance 65da6e54-b203-4fed-8737-af53723d3b89 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:59.240274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-76e0eca0-0539-4cef-b306-62420bfdf8d2 tempest-ServerShowV247Test-2102095973 tempest-ServerShowV247Test-2102095973-project] 10.222.0.58 "GET /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89" status: 404 len: 111 microversion: 2.47 time: 0.050100 Aug 27 04:55:59.240955 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 591/1153] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:55:59 2022] GET /compute/v2.1/servers/65da6e54-b203-4fed-8737-af53723d3b89 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:55:59.418316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c0ce6225-b543-41d2-873f-46f3e3c37d59 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565206310>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:59.489380 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c0ce6225-b543-41d2-873f-46f3e3c37d59 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.074826 Aug 27 04:55:59.503259 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 592/1154] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:59 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:59.510431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:59.511450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:59.518035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:59.518884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:59.519572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:59.520522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:59.521277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:59.521919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:59.560131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:59.560998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:59.562127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:59.562676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lazy-loading 'fault' on Instance uuid a0c46e5a-ffeb-41a5-9593-6d64703ae23d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:55:59.615312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:59.624057 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c044290d-6518-49ac-ae13-7c7ffac84afe tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1306 microversion: 2.1 time: 0.119331 Aug 27 04:55:59.626111 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 593/1155] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:59 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1306 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:00.119844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:00.121815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:00.134318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:00.134930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:00.135661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:00.136490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:00.137181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:00.137678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:00.232996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:00.246131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:00.247939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:00.250520 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-34eaa7d3-554d-40c6-8613-9e39ec1249df tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1366 microversion: 2.47 time: 0.134107 Aug 27 04:56:00.252006 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 594/1156] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:00 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:56:00.510134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-58491a09-b100-4254-88c9-f12c37e5c941 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56517f3a0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:00.564928 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-58491a09-b100-4254-88c9-f12c37e5c941 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.060919 Aug 27 04:56:00.565509 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 595/1157] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:00 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:00.650266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:00.651198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:00.657520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:00.658074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:00.658508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:00.659249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:00.659698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:00.660119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:00.698331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:00.698985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:00.699822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:00.700489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lazy-loading 'fault' on Instance uuid a0c46e5a-ffeb-41a5-9593-6d64703ae23d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:00.751530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:00.760075 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec2ee1b7-8625-4eaa-894c-639306f937ed tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1306 microversion: 2.1 time: 0.114338 Aug 27 04:56:00.760877 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 596/1158] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:00 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1306 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:01.279225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:01.280082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:01.302821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:01.304186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:01.306010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:01.309186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:01.309957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:01.310591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:01.398613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:01.408281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:01.410072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:01.411289 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-23ec6c6d-6f2b-4e80-a564-be5ee2249f9a tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1366 microversion: 2.47 time: 0.137612 Aug 27 04:56:01.412408 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 597/1159] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:01 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:56:01.494937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f253173d-f910-48f4-b4f1-baa677495e83 tempest-QuotasTestJSON-1581718580 tempest-QuotasTestJSON-1581718580-project] Calling method '.version_select at 0x7fb565185310>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:01.562458 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f253173d-f910-48f4-b4f1-baa677495e83 tempest-QuotasTestJSON-1581718580 tempest-QuotasTestJSON-1581718580-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/c9aa7829fd594828b97e9a69a4f450e1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.148586 Aug 27 04:56:01.563556 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 598/1160] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 04:56:01 2022] GET /compute/v2.1/os-quota-sets/c9aa7829fd594828b97e9a69a4f450e1/defaults => generated 371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:01.575736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5c66d081-863f-4cc2-9bea-f4635c6d4d3b tempest-QuotasTestJSON-1581718580 tempest-QuotasTestJSON-1581718580-project] Calling method '.version_select at 0x7fb56517f9d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:01.662217 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5c66d081-863f-4cc2-9bea-f4635c6d4d3b tempest-QuotasTestJSON-1581718580 tempest-QuotasTestJSON-1581718580-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/c9aa7829fd594828b97e9a69a4f450e1" status: 200 len: 371 microversion: 2.1 time: 0.089643 Aug 27 04:56:01.663354 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 599/1161] 10.222.0.58 () {58 vars in 1242 bytes} [Sat Aug 27 04:56:01 2022] GET /compute/v2.1/os-quota-sets/c9aa7829fd594828b97e9a69a4f450e1 => generated 371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:01.668499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0e5d4d8a-eb8f-4873-af62-040e9669dc1b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56510ab80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:01.745429 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0e5d4d8a-eb8f-4873-af62-040e9669dc1b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.080742 Aug 27 04:56:01.746454 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 600/1162] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:01 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:01.751734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e7549dd-3fb9-470e-95ff-66bb308670e7 tempest-QuotasTestJSON-1581718580 tempest-QuotasTestJSON-1581718580-project] Calling method '.version_select at 0x7fb56512cca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:01.832118 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e7549dd-3fb9-470e-95ff-66bb308670e7 tempest-QuotasTestJSON-1581718580 tempest-QuotasTestJSON-1581718580-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/c9aa7829fd594828b97e9a69a4f450e1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.084584 Aug 27 04:56:01.833055 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 601/1163] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 04:56:01 2022] GET /compute/v2.1/os-quota-sets/c9aa7829fd594828b97e9a69a4f450e1/defaults => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:01.840573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:01.841577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:01.848515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:01.849829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:01.850493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:01.852016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:01.852917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:01.853825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:01.895524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:01.896427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:01.897111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:01.897668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lazy-loading 'fault' on Instance uuid a0c46e5a-ffeb-41a5-9593-6d64703ae23d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:01.951189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:01.962601 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-25078ddb-5327-4748-91f2-ca640e6746e4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 200 len: 1306 microversion: 2.1 time: 0.128103 Aug 27 04:56:01.963635 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 602/1164] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:01 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 1306 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:01.968438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0014c002-8bf5-41ad-b987-bc1b01c51c0b tempest-QuotasTestJSON-1581718580 tempest-QuotasTestJSON-1581718580-project] Calling method '.version_select at 0x7fb565206820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:02.052402 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0014c002-8bf5-41ad-b987-bc1b01c51c0b tempest-QuotasTestJSON-1581718580 tempest-QuotasTestJSON-1581718580-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/c9aa7829fd594828b97e9a69a4f450e1" status: 200 len: 371 microversion: 2.1 time: 0.087201 Aug 27 04:56:02.053374 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 603/1165] 10.222.0.58 () {58 vars in 1242 bytes} [Sat Aug 27 04:56:01 2022] GET /compute/v2.1/os-quota-sets/c9aa7829fd594828b97e9a69a4f450e1 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:02.061924 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1bdcd350-48b8-4c52-a26c-00acb755186e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19/action" status: 202 len: 0 microversion: 2.1 time: 3.603865 Aug 27 04:56:02.063367 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 563/1166] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:55:58 2022] POST /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19/action => generated 0 bytes in 3606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:56:02.066936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82284a29-3cb0-48ec-ac7e-f4ddd6682f6f tempest-QuotasTestJSON-1581718580 tempest-QuotasTestJSON-1581718580-project] Calling method '.version_select at 0x7fb56510a700>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:02.073064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c816c07-e560-49fe-a4b2-f525a2377367 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:02.074060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c816c07-e560-49fe-a4b2-f525a2377367 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:02.084879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c816c07-e560-49fe-a4b2-f525a2377367 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:02.086760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c816c07-e560-49fe-a4b2-f525a2377367 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:02.087591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c816c07-e560-49fe-a4b2-f525a2377367 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:02.088705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c816c07-e560-49fe-a4b2-f525a2377367 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:02.089414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c816c07-e560-49fe-a4b2-f525a2377367 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:02.090057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c816c07-e560-49fe-a4b2-f525a2377367 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:02.180310 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-82284a29-3cb0-48ec-ac7e-f4ddd6682f6f tempest-QuotasTestJSON-1581718580 tempest-QuotasTestJSON-1581718580-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/c9aa7829fd594828b97e9a69a4f450e1?user_id=aaf4b968a92a4e668448bdb5eb6faf34" status: 200 len: 371 microversion: 2.1 time: 0.118907 Aug 27 04:56:02.181347 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 604/1167] 10.222.0.58 () {58 vars in 1323 bytes} [Sat Aug 27 04:56:02 2022] GET /compute/v2.1/os-quota-sets/c9aa7829fd594828b97e9a69a4f450e1?user_id=aaf4b968a92a4e668448bdb5eb6faf34 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:02.357745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6c816c07-e560-49fe-a4b2-f525a2377367 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:02.383168 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c816c07-e560-49fe-a4b2-f525a2377367 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1502 microversion: 2.1 time: 0.313826 Aug 27 04:56:02.385168 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 564/1168] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:02 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1502 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:02.435016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:02.436804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:02.443925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:02.445590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:02.446255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:02.447186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:02.448665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:02.449295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:02.538695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:02.547950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:02.549672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:02.550942 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-29ca3012-147a-4020-b8d0-e580945d1dbf tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1366 microversion: 2.47 time: 0.120570 Aug 27 04:56:02.551624 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 605/1169] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:02 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:02.761444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9ccee712-c313-4aab-ab0e-58fd2b0c6cbb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650c7f70>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:02.827880 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9ccee712-c313-4aab-ab0e-58fd2b0c6cbb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.069829 Aug 27 04:56:02.828759 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 565/1170] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:02 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:02.986345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:02.987256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a0c46e5a-ffeb-41a5-9593-6d64703ae23d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:03.003422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.004141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.004710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.008678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.009170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.009849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.039776 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] HTTP exception thrown: Instance a0c46e5a-ffeb-41a5-9593-6d64703ae23d could not be found. Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Request method failure captured: Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d HTTP/1.1 Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMY1qHnSwS1R8lTLyEZpfcwh5hCoXkzotR9jOR2p2AdfSdoBaXr9xo5Qs5AwnpClVIv_uSMUYdTcbJGG1bGKoa9FCezps1Pwbaw5Q-rfKGHFEUMQzY_fBNgr5vYtWKYE6dl5a47pYUpTtpNyImLWoA2aPEk2Ztp0ryewpXtbk1sKFE Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:56:03.060446 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4074bf02227441b091b6e7d62f83b9e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 113873d86b0c417e92a88af412281fe6 Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance a0c46e5a-ffeb-41a5-9593-6d64703ae23d could not be found. Aug 27 04:56:03.062221 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'a0c46e5a-ffeb-41a5-9593-6d64703ae23d'} Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c46e5a-ffeb-41a5-9593-6d64703ae23d could not be found. Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:03.063076 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c46e5a-ffeb-41a5-9593-6d64703ae23d could not be found. Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c46e5a-ffeb-41a5-9593-6d64703ae23d could not be found. Aug 27 04:56:03.064966 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.066967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Returning 404 to user: Instance a0c46e5a-ffeb-41a5-9593-6d64703ae23d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:03.067820 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5cd3b5a9-e695-4e32-9f7f-7041d2393989 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d" status: 404 len: 111 microversion: 2.1 time: 0.085829 Aug 27 04:56:03.071460 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 606/1171] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:02 2022] GET /compute/v2.1/servers/a0c46e5a-ffeb-41a5-9593-6d64703ae23d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:03.077777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-48e81fd6-1fbb-4522-9796-c4bdb8adacc3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:03.078616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-48e81fd6-1fbb-4522-9796-c4bdb8adacc3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:03.087292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48e81fd6-1fbb-4522-9796-c4bdb8adacc3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.088173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48e81fd6-1fbb-4522-9796-c4bdb8adacc3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.090044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48e81fd6-1fbb-4522-9796-c4bdb8adacc3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.091140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48e81fd6-1fbb-4522-9796-c4bdb8adacc3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.091810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48e81fd6-1fbb-4522-9796-c4bdb8adacc3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.092372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48e81fd6-1fbb-4522-9796-c4bdb8adacc3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.136167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-48e81fd6-1fbb-4522-9796-c4bdb8adacc3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:56:03.256150 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-48e81fd6-1fbb-4522-9796-c4bdb8adacc3 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 204 len: 0 microversion: 2.1 time: 0.180223 Aug 27 04:56:03.275330 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 566/1172] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:56:03 2022] DELETE /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:56:03.282806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-87326ed1-ff27-4558-8b83-e45e5137107c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:03.283576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-87326ed1-ff27-4558-8b83-e45e5137107c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:03.294789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87326ed1-ff27-4558-8b83-e45e5137107c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.298180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87326ed1-ff27-4558-8b83-e45e5137107c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.298748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87326ed1-ff27-4558-8b83-e45e5137107c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.299535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87326ed1-ff27-4558-8b83-e45e5137107c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.302834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87326ed1-ff27-4558-8b83-e45e5137107c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.303357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87326ed1-ff27-4558-8b83-e45e5137107c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.407670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7bb3fdf3-7c29-4c02-9291-e050c25da96f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:03.408381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7bb3fdf3-7c29-4c02-9291-e050c25da96f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:03.423664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdf3-7c29-4c02-9291-e050c25da96f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.425133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdf3-7c29-4c02-9291-e050c25da96f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.426185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdf3-7c29-4c02-9291-e050c25da96f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.431765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdf3-7c29-4c02-9291-e050c25da96f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.432498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdf3-7c29-4c02-9291-e050c25da96f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.433457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdf3-7c29-4c02-9291-e050c25da96f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.596599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-87326ed1-ff27-4558-8b83-e45e5137107c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:03.612820 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-87326ed1-ff27-4558-8b83-e45e5137107c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1470 microversion: 2.1 time: 0.335942 Aug 27 04:56:03.627855 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 607/1173] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:03 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1470 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:03.634514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:03.635674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:03.643021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.643852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.645240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.646320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.647127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.649140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.697543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.698167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.698713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.699315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lazy-loading 'fault' on Instance uuid 12b83c67-2c55-44d2-8f1f-5c030a4327d6 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:03.769573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:03.793986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:03.806380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:03.807448 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bfb09d45-abe4-46a6-bb90-37652680d198 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1371 microversion: 2.47 time: 0.177952 Aug 27 04:56:03.808065 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 608/1174] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:03 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:03.809952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7bb3fdf3-7c29-4c02-9291-e050c25da96f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:03.825433 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7bb3fdf3-7c29-4c02-9291-e050c25da96f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1502 microversion: 2.1 time: 0.423149 Aug 27 04:56:03.825780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-fa3b8575-44aa-4779-9f74-f07fc20b3741 req-b8fcbc8a-c2d7-4630-b84c-41bf34c27de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a984e8-a342-45d3-80b7-f149773c4c19", "name": "network-vif-unplugged", "status": "completed", "tag": "4f37ae87-ac14-4a9c-adf4-091cf9796741"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:03.829134 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 567/1175] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:03 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1502 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:03.844270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-38282748-89c8-413f-b7aa-d74bb945f393 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56524aca0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:03.860224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fa3b8575-44aa-4779-9f74-f07fc20b3741 req-b8fcbc8a-c2d7-4630-b84c-41bf34c27de1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.860981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fa3b8575-44aa-4779-9f74-f07fc20b3741 req-b8fcbc8a-c2d7-4630-b84c-41bf34c27de1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.861426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fa3b8575-44aa-4779-9f74-f07fc20b3741 req-b8fcbc8a-c2d7-4630-b84c-41bf34c27de1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.909877 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-fa3b8575-44aa-4779-9f74-f07fc20b3741 req-b8fcbc8a-c2d7-4630-b84c-41bf34c27de1 service nova] Creating event network-vif-unplugged:4f37ae87-ac14-4a9c-adf4-091cf9796741 for instance e6a984e8-a342-45d3-80b7-f149773c4c19 on n-h2-820368-35 Aug 27 04:56:03.915519 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-38282748-89c8-413f-b7aa-d74bb945f393 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.075034 Aug 27 04:56:03.917232 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 568/1176] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:03 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:03.936798 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-fa3b8575-44aa-4779-9f74-f07fc20b3741 req-b8fcbc8a-c2d7-4630-b84c-41bf34c27de1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117830 Aug 27 04:56:03.937846 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 609/1177] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:04.530856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e786afb-2c4f-4929-99f4-0f1c6edd910c tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Action: 'create', calling method: .version_select at 0x7fb56509d1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-134285866"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:04.639854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-37778f73-686c-4ff4-a511-14d8f9321b94 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:04.640570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-37778f73-686c-4ff4-a511-14d8f9321b94 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:04.655599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37778f73-686c-4ff4-a511-14d8f9321b94 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:04.656145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37778f73-686c-4ff4-a511-14d8f9321b94 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:04.656685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37778f73-686c-4ff4-a511-14d8f9321b94 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:04.657516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37778f73-686c-4ff4-a511-14d8f9321b94 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:04.658042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37778f73-686c-4ff4-a511-14d8f9321b94 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:04.658574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37778f73-686c-4ff4-a511-14d8f9321b94 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:04.849083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-37778f73-686c-4ff4-a511-14d8f9321b94 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:04.857336 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-37778f73-686c-4ff4-a511-14d8f9321b94 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1470 microversion: 2.1 time: 0.222800 Aug 27 04:56:04.871880 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 610/1178] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:04 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:04.877475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:04.878332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:04.884489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:04.886133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:04.886851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:04.887591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:04.888591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:04.889274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:04.889801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:04.939786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:04.940691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:04.941347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:04.942129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lazy-loading 'fault' on Instance uuid 12b83c67-2c55-44d2-8f1f-5c030a4327d6 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:04.994690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:05.004017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:05.006218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:05.007571 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1eedbf72-1590-4852-980e-94de5d92ee20 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1371 microversion: 2.47 time: 0.134325 Aug 27 04:56:05.009302 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 611/1179] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:04 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:05.014633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b6d33bb0-dd0c-4d04-8db3-8cf049c6613f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:05.015565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b6d33bb0-dd0c-4d04-8db3-8cf049c6613f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:05.022369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6d33bb0-dd0c-4d04-8db3-8cf049c6613f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:05.023144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6d33bb0-dd0c-4d04-8db3-8cf049c6613f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:05.023809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6d33bb0-dd0c-4d04-8db3-8cf049c6613f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:05.024909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6d33bb0-dd0c-4d04-8db3-8cf049c6613f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:05.025437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6d33bb0-dd0c-4d04-8db3-8cf049c6613f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:05.026113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6d33bb0-dd0c-4d04-8db3-8cf049c6613f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:05.188469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6d33bb0-dd0c-4d04-8db3-8cf049c6613f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:05.193268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:05.198880 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b6d33bb0-dd0c-4d04-8db3-8cf049c6613f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1502 microversion: 2.1 time: 0.188051 Aug 27 04:56:05.199772 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 612/1180] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:05 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:05.218773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e8aaade-c341-4a45-b452-4530575f3632 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56512c8b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:05.268297 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e8aaade-c341-4a45-b452-4530575f3632 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.055689 Aug 27 04:56:05.269142 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 613/1181] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:05 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:05.437488 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2e786afb-2c4f-4929-99f4-0f1c6edd910c tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.047912 Aug 27 04:56:05.438948 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 569/1182] 10.222.0.58 () {60 vars in 1155 bytes} [Sat Aug 27 04:56:04 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1050 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 04:56:05.454009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6c6eaeaa-ecd7-49f0-870e-3e73a04fa29a tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb565172a60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:05.638404 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6c6eaeaa-ecd7-49f0-870e-3e73a04fa29a tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74" status: 200 len: 344 microversion: 2.1 time: 0.188664 Aug 27 04:56:05.639205 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 614/1183] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 04:56:05 2022] GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:56:05.879406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bd210e08-33c0-4568-9414-feef497e1d05 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:05.881337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bd210e08-33c0-4568-9414-feef497e1d05 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:05.892988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd210e08-33c0-4568-9414-feef497e1d05 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:05.893969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd210e08-33c0-4568-9414-feef497e1d05 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:05.894655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd210e08-33c0-4568-9414-feef497e1d05 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:05.895665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd210e08-33c0-4568-9414-feef497e1d05 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:05.896349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd210e08-33c0-4568-9414-feef497e1d05 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:05.896873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd210e08-33c0-4568-9414-feef497e1d05 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:05.958494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3388fe25-5f2b-4ef1-b37c-6d4f1b53b14d req-3d46505c-c088-43ff-b03f-f2993153701c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a984e8-a342-45d3-80b7-f149773c4c19", "tag": "4f37ae87-ac14-4a9c-adf4-091cf9796741"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:05.970222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3388fe25-5f2b-4ef1-b37c-6d4f1b53b14d req-3d46505c-c088-43ff-b03f-f2993153701c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:05.970815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3388fe25-5f2b-4ef1-b37c-6d4f1b53b14d req-3d46505c-c088-43ff-b03f-f2993153701c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:05.971548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3388fe25-5f2b-4ef1-b37c-6d4f1b53b14d req-3d46505c-c088-43ff-b03f-f2993153701c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:05.988454 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3388fe25-5f2b-4ef1-b37c-6d4f1b53b14d req-3d46505c-c088-43ff-b03f-f2993153701c service nova] Creating event network-changed:4f37ae87-ac14-4a9c-adf4-091cf9796741 for instance e6a984e8-a342-45d3-80b7-f149773c4c19 on n-h2-820368-35 Aug 27 04:56:05.997215 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3388fe25-5f2b-4ef1-b37c-6d4f1b53b14d req-3d46505c-c088-43ff-b03f-f2993153701c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042941 Aug 27 04:56:05.998435 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 615/1184] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:06.056633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:06.060536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:06.081873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:06.084731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:06.088007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:06.092473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:06.094500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:06.095144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:06.189227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:06.189803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:06.192059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:06.192812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lazy-loading 'fault' on Instance uuid 12b83c67-2c55-44d2-8f1f-5c030a4327d6 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:06.209103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bd210e08-33c0-4568-9414-feef497e1d05 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:06.225273 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bd210e08-33c0-4568-9414-feef497e1d05 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1470 microversion: 2.1 time: 0.344229 Aug 27 04:56:06.227814 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 570/1185] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:05 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1470 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:06.256534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad6c0c01-8e18-4152-99fc-1597f7489b66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:06.266270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad6c0c01-8e18-4152-99fc-1597f7489b66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:06.300332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad6c0c01-8e18-4152-99fc-1597f7489b66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:06.301154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad6c0c01-8e18-4152-99fc-1597f7489b66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:06.303560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad6c0c01-8e18-4152-99fc-1597f7489b66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:06.305565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad6c0c01-8e18-4152-99fc-1597f7489b66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:06.306571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad6c0c01-8e18-4152-99fc-1597f7489b66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:06.307298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad6c0c01-8e18-4152-99fc-1597f7489b66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:06.379940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:06.398613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:06.400415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77547bac37a14d749ed51cedda6389f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecb503b9f840d586c6b54b99a70801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:06.401491 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7409db85-a0ae-4de8-b2fa-d087b60623ea tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 200 len: 1371 microversion: 2.47 time: 0.358101 Aug 27 04:56:06.415118 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 616/1186] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:06 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:06.430510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d436cd4e-98a6-4ac3-ba76-c9d8927c4d58 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650d3d30>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:06.496087 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d436cd4e-98a6-4ac3-ba76-c9d8927c4d58 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1453 microversion: 2.1 time: 0.090976 Aug 27 04:56:06.497058 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 617/1187] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:06 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:06.507722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e5bbddbd-2ee2-46c8-b990-fa45e3b7a310 req-32b6686a-dc57-4311-b140-53491259e068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9", "name": "network-vif-deleted", "tag": "9a5e5638-e923-4d24-8aa1-20e1f4dbb2b0"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:06.524315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e5bbddbd-2ee2-46c8-b990-fa45e3b7a310 req-32b6686a-dc57-4311-b140-53491259e068 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:06.533407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e5bbddbd-2ee2-46c8-b990-fa45e3b7a310 req-32b6686a-dc57-4311-b140-53491259e068 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:06.534023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e5bbddbd-2ee2-46c8-b990-fa45e3b7a310 req-32b6686a-dc57-4311-b140-53491259e068 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:06.558208 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e5bbddbd-2ee2-46c8-b990-fa45e3b7a310 req-32b6686a-dc57-4311-b140-53491259e068 service nova] Creating event network-vif-deleted:9a5e5638-e923-4d24-8aa1-20e1f4dbb2b0 for instance 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 on n-h2-820368-35 Aug 27 04:56:06.585776 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e5bbddbd-2ee2-46c8-b990-fa45e3b7a310 req-32b6686a-dc57-4311-b140-53491259e068 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087457 Aug 27 04:56:06.590095 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 618/1188] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:06.653392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-55a3d607-a99e-434d-8e6b-3aa778a449b9 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb5650dc040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:06.657205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad6c0c01-8e18-4152-99fc-1597f7489b66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:06.675308 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad6c0c01-8e18-4152-99fc-1597f7489b66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1502 microversion: 2.1 time: 0.435453 Aug 27 04:56:06.677042 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 571/1189] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:06 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1502 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:06.738040 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-55a3d607-a99e-434d-8e6b-3aa778a449b9 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74" status: 200 len: 344 microversion: 2.1 time: 0.088864 Aug 27 04:56:06.738909 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 619/1190] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 04:56:06 2022] GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:07.251162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:07.251699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:07.259202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.259616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.260046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.260732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.261263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.261685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.293748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.294219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.294829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.295488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lazy-loading 'fault' on Instance uuid 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:07.336292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:07.344022 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7629f46c-6d22-447f-874c-71e0e917aede tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 200 len: 1305 microversion: 2.1 time: 0.097048 Aug 27 04:56:07.344667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 572/1191] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:07 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:07.430637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:07.431401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] [instance: 12b83c67-2c55-44d2-8f1f-5c030a4327d6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:07.437622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.438089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.438522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.439284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.439695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.440116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.454941 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] HTTP exception thrown: Instance 12b83c67-2c55-44d2-8f1f-5c030a4327d6 could not be found. Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Request method failure captured: Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 HTTP/1.1 Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaPNIcxeRHkyvDhV8MeoI4Man0FGFhlIY5WxHT-LS5J13T7zpYZXNhlM3-B9H6DHlUsvbEP4TQkYebzcip4z4JaG-1CvY48XlcBGl-Uf098ve7XKKdhX5e5isDquAClcWUTKnAujkaVMLRH4EtcrBHDLCTV7QsL81ZIsUiDsw2pM-Qo Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 80ecb503b9f840d586c6b54b99a70801 Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersAaction247Test-135979309 Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:56:07.456613 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80ecb503b9f840d586c6b54b99a70801", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80ecb503b9f840d586c6b54b99a70801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80ecb503b9f840d586c6b54b99a70801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80ecb503b9f840d586c6b54b99a70801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersAaction247Test-135979309 Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 80ecb503b9f840d586c6b54b99a70801 Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersAaction247Test-135979309 Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersAaction247Test-135979309-project Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 77547bac37a14d749ed51cedda6389f0 Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersAaction247Test-135979309-project Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 12b83c67-2c55-44d2-8f1f-5c030a4327d6 could not be found. Aug 27 04:56:07.458411 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '12b83c67-2c55-44d2-8f1f-5c030a4327d6'} Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b83c67-2c55-44d2-8f1f-5c030a4327d6 could not be found. Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:07.459527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b83c67-2c55-44d2-8f1f-5c030a4327d6 could not be found. Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b83c67-2c55-44d2-8f1f-5c030a4327d6 could not be found. Aug 27 04:56:07.460878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:07.462102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] Returning 404 to user: Instance 12b83c67-2c55-44d2-8f1f-5c030a4327d6 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:07.462102 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3014e265-c0ac-469e-a338-6a2287574ca5 tempest-ServersAaction247Test-135979309 tempest-ServersAaction247Test-135979309-project] 10.222.0.58 "GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6" status: 404 len: 111 microversion: 2.47 time: 0.032277 Aug 27 04:56:07.462102 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 620/1192] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:07 2022] GET /compute/v2.1/servers/12b83c67-2c55-44d2-8f1f-5c030a4327d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:56:07.512660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af1ceb92-7490-4c47-8c3f-a03ecc9a1bfa tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5651b5940>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:07.605530 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af1ceb92-7490-4c47-8c3f-a03ecc9a1bfa tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1462 microversion: 2.1 time: 0.093022 Aug 27 04:56:07.612878 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 573/1193] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:07 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1462 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:07.640735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c596268a-ab59-4eee-b974-8497dfc76fa3 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650dcee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:07.699419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-548c82af-5047-4011-98fe-861b79003938 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:07.700931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-548c82af-5047-4011-98fe-861b79003938 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:07.722064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-548c82af-5047-4011-98fe-861b79003938 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.722532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-548c82af-5047-4011-98fe-861b79003938 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.722965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-548c82af-5047-4011-98fe-861b79003938 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.726576 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c596268a-ab59-4eee-b974-8497dfc76fa3 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 200 len: 1462 microversion: 2.1 time: 0.112620 Aug 27 04:56:07.731528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-548c82af-5047-4011-98fe-861b79003938 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.732370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-548c82af-5047-4011-98fe-861b79003938 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.732840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-548c82af-5047-4011-98fe-861b79003938 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.738217 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 621/1194] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:07 2022] GET /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 1462 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:07.746125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-efa45d39-b43f-471e-ac2f-84dfd5335ffd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:07.753459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-efa45d39-b43f-471e-ac2f-84dfd5335ffd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:07.764913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efa45d39-b43f-471e-ac2f-84dfd5335ffd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.765672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efa45d39-b43f-471e-ac2f-84dfd5335ffd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.767892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efa45d39-b43f-471e-ac2f-84dfd5335ffd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.770198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efa45d39-b43f-471e-ac2f-84dfd5335ffd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.770891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efa45d39-b43f-471e-ac2f-84dfd5335ffd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.772715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efa45d39-b43f-471e-ac2f-84dfd5335ffd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.776492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:07.981191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-548c82af-5047-4011-98fe-861b79003938 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:07.989987 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-548c82af-5047-4011-98fe-861b79003938 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1502 microversion: 2.1 time: 0.296729 Aug 27 04:56:07.990566 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 574/1195] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:07 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1502 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:07.995423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-751776ef-d6cf-45d7-a1fc-be9c71611cc0 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb5651b5d30>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:08.003565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-efa45d39-b43f-471e-ac2f-84dfd5335ffd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:08.013058 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-efa45d39-b43f-471e-ac2f-84dfd5335ffd tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738" status: 200 len: 1466 microversion: 2.1 time: 0.273513 Aug 27 04:56:08.013629 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 622/1196] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:07 2022] GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738 => generated 1466 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:08.033655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7b9a4d55-7453-4b30-90f2-898943e4c709 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-235871061"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:08.037494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7b9a4d55-7453-4b30-90f2-898943e4c709 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:08.043432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b9a4d55-7453-4b30-90f2-898943e4c709 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.043920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b9a4d55-7453-4b30-90f2-898943e4c709 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.044359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b9a4d55-7453-4b30-90f2-898943e4c709 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.045094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b9a4d55-7453-4b30-90f2-898943e4c709 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.045539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b9a4d55-7453-4b30-90f2-898943e4c709 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.045967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b9a4d55-7453-4b30-90f2-898943e4c709 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.061028 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-751776ef-d6cf-45d7-a1fc-be9c71611cc0 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74" status: 200 len: 345 microversion: 2.1 time: 0.069024 Aug 27 04:56:08.062448 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 575/1197] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 04:56:07 2022] GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:08.077337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5dc0809e-19bc-4891-8609-2681fe3be867 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Action: 'create', calling method: .version_select at 0x7fb5652ae160>, body: {"snapshot": {"volume_id": "c4b71fd6-41dc-4f0e-a1f7-61380123fa74", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1172080760"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:08.262006 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7b9a4d55-7453-4b30-90f2-898943e4c709 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "POST /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876/action" status: 202 len: 0 microversion: 2.1 time: 0.232293 Aug 27 04:56:08.262950 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 623/1198] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:08 2022] POST /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 04:56:08.278500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-75486901-e773-4e20-8542-319c238293fb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650dcee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:08.330209 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-75486901-e773-4e20-8542-319c238293fb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.058531 Aug 27 04:56:08.330923 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 624/1199] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:08 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:08.366312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:08.367354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:08.382908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.384234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.386201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.387473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.388157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.388837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.404116 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] HTTP exception thrown: Instance 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 could not be found. Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Request method failure captured: Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 HTTP/1.1 Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMY1qHnSwS1R8lTLyEZpfcwh5hCoXkzotR9jOR2p2AdfSdoBaXr9xo5Qs5AwnpClVIv_uSMUYdTcbJGG1bGKoa9FCezps1Pwbaw5Q-rfKGHFEUMQzY_fBNgr5vYtWKYE6dl5a47pYUpTtpNyImLWoA2aPEk2Ztp0ryewpXtbk1sKFE Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:56:08.405779 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4074bf02227441b091b6e7d62f83b9e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 113873d86b0c417e92a88af412281fe6 Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 could not be found. Aug 27 04:56:08.407428 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9'} Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 could not be found. Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:08.408267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 could not be found. Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 could not be found. Aug 27 04:56:08.409466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:08.410550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Returning 404 to user: Instance 3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:08.410550 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-432c4f5e-fe6e-40e8-aa28-4424ab298a8f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9" status: 404 len: 111 microversion: 2.1 time: 0.046263 Aug 27 04:56:08.410550 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 625/1200] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:08 2022] GET /compute/v2.1/servers/3b2fda1f-5fc7-45a3-ba63-8995cc9d1aa9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:56:08.415559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2514fc7a-e948-4057-9d09-d84c291e5a9f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:08.416058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2514fc7a-e948-4057-9d09-d84c291e5a9f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:08.422704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2514fc7a-e948-4057-9d09-d84c291e5a9f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.423454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2514fc7a-e948-4057-9d09-d84c291e5a9f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.423895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2514fc7a-e948-4057-9d09-d84c291e5a9f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.424600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2514fc7a-e948-4057-9d09-d84c291e5a9f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.425212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2514fc7a-e948-4057-9d09-d84c291e5a9f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.425796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2514fc7a-e948-4057-9d09-d84c291e5a9f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.430574 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5dc0809e-19bc-4891-8609-2681fe3be867 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.359569 Aug 27 04:56:08.431415 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 576/1201] 10.222.0.58 () {60 vars in 1162 bytes} [Sat Aug 27 04:56:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:08.439639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:08.444866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e7ab460e-f027-4051-8305-5ba1c4487eec tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb564ffeaf0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:08.454803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2514fc7a-e948-4057-9d09-d84c291e5a9f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:56:08.540572 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e7ab460e-f027-4051-8305-5ba1c4487eec tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a" status: 200 len: 287 microversion: 2.1 time: 0.101770 Aug 27 04:56:08.541145 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 577/1202] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 04:56:08 2022] GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:56:08.555186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f56217af-1c10-4b38-9fa4-1584a1b3210d tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb5650dc9d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:08.560266 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2514fc7a-e948-4057-9d09-d84c291e5a9f tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61" status: 204 len: 0 microversion: 2.1 time: 0.147961 Aug 27 04:56:08.561184 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 626/1203] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:56:08 2022] DELETE /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:56:08.578687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8a28507a-78e0-46b5-87d7-f51aad2808a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:08.579813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8a28507a-78e0-46b5-87d7-f51aad2808a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:08.587464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a28507a-78e0-46b5-87d7-f51aad2808a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.588397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a28507a-78e0-46b5-87d7-f51aad2808a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.589103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a28507a-78e0-46b5-87d7-f51aad2808a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.590032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a28507a-78e0-46b5-87d7-f51aad2808a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.590700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a28507a-78e0-46b5-87d7-f51aad2808a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.591410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a28507a-78e0-46b5-87d7-f51aad2808a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.614754 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f56217af-1c10-4b38-9fa4-1584a1b3210d tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.064269 Aug 27 04:56:08.615619 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 578/1204] 10.222.0.58 () {58 vars in 1140 bytes} [Sat Aug 27 04:56:08 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:08.626315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8a28507a-78e0-46b5-87d7-f51aad2808a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:56:08.627079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a2d89d9a-bbb9-4772-a30b-2ac1f72b41b3 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb5650c7820>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:08.666370 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a2d89d9a-bbb9-4772-a30b-2ac1f72b41b3 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a" status: 200 len: 287 microversion: 2.1 time: 0.042655 Aug 27 04:56:08.667273 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 579/1205] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 04:56:08 2022] GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:08.720509 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8a28507a-78e0-46b5-87d7-f51aad2808a4 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 204 len: 0 microversion: 2.1 time: 0.146306 Aug 27 04:56:08.721272 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 627/1206] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:56:08 2022] DELETE /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:56:08.730731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad603d55-c0e4-4a42-a4e3-ba4dfd0305dc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:08.731949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad603d55-c0e4-4a42-a4e3-ba4dfd0305dc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:08.740306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad603d55-c0e4-4a42-a4e3-ba4dfd0305dc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.741087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad603d55-c0e4-4a42-a4e3-ba4dfd0305dc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.742062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad603d55-c0e4-4a42-a4e3-ba4dfd0305dc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.742976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad603d55-c0e4-4a42-a4e3-ba4dfd0305dc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.744033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad603d55-c0e4-4a42-a4e3-ba4dfd0305dc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.744796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad603d55-c0e4-4a42-a4e3-ba4dfd0305dc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.892255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad603d55-c0e4-4a42-a4e3-ba4dfd0305dc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:08.902587 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad603d55-c0e4-4a42-a4e3-ba4dfd0305dc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61" status: 200 len: 1473 microversion: 2.1 time: 0.176390 Aug 27 04:56:08.903181 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 580/1207] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:08 2022] GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:09.013044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-455adab3-48b4-450e-a161-6dd5ce60c151 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:09.014359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-455adab3-48b4-450e-a161-6dd5ce60c151 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:09.025837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455adab3-48b4-450e-a161-6dd5ce60c151 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:09.026379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455adab3-48b4-450e-a161-6dd5ce60c151 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:09.027039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455adab3-48b4-450e-a161-6dd5ce60c151 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:09.027867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455adab3-48b4-450e-a161-6dd5ce60c151 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:09.028443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455adab3-48b4-450e-a161-6dd5ce60c151 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:09.028959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455adab3-48b4-450e-a161-6dd5ce60c151 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:09.174419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-455adab3-48b4-450e-a161-6dd5ce60c151 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:09.183396 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-455adab3-48b4-450e-a161-6dd5ce60c151 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1502 microversion: 2.1 time: 0.175214 Aug 27 04:56:09.184131 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 628/1208] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:09 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:09.345279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-34e03e5d-2a6d-46f0-8ad8-6bc1e3824862 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650c7dc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:09.394435 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-34e03e5d-2a6d-46f0-8ad8-6bc1e3824862 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.052842 Aug 27 04:56:09.396242 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 581/1209] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:09 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:09.679637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e20a3cb7-d9b9-4f2a-9002-7d46ca70508a tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb5650e24c0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:09.714468 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e20a3cb7-d9b9-4f2a-9002-7d46ca70508a tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a" status: 200 len: 287 microversion: 2.1 time: 0.039072 Aug 27 04:56:09.718616 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 629/1210] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 04:56:09 2022] GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:09.927568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2a80f9af-2c78-4541-b137-b32ab6995023 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:09.928825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2a80f9af-2c78-4541-b137-b32ab6995023 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:09.941755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a80f9af-2c78-4541-b137-b32ab6995023 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:09.946510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a80f9af-2c78-4541-b137-b32ab6995023 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:09.947201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a80f9af-2c78-4541-b137-b32ab6995023 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:09.951893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a80f9af-2c78-4541-b137-b32ab6995023 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:09.959229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a80f9af-2c78-4541-b137-b32ab6995023 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:09.959885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a80f9af-2c78-4541-b137-b32ab6995023 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:10.127354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2a80f9af-2c78-4541-b137-b32ab6995023 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:10.135839 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2a80f9af-2c78-4541-b137-b32ab6995023 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61" status: 200 len: 1473 microversion: 2.1 time: 0.214478 Aug 27 04:56:10.136600 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 582/1211] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:09 2022] GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 => generated 1473 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:10.204648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aede91ae-da35-410e-85e2-b1bf303c8e25 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:10.205268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aede91ae-da35-410e-85e2-b1bf303c8e25 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:10.211872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aede91ae-da35-410e-85e2-b1bf303c8e25 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:10.212619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aede91ae-da35-410e-85e2-b1bf303c8e25 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:10.213043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aede91ae-da35-410e-85e2-b1bf303c8e25 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:10.214911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aede91ae-da35-410e-85e2-b1bf303c8e25 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:10.215302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aede91ae-da35-410e-85e2-b1bf303c8e25 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:10.215775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aede91ae-da35-410e-85e2-b1bf303c8e25 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:10.355929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aede91ae-da35-410e-85e2-b1bf303c8e25 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:10.364042 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aede91ae-da35-410e-85e2-b1bf303c8e25 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1502 microversion: 2.1 time: 0.163203 Aug 27 04:56:10.364606 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 630/1212] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:10 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:10.409505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7467d27f-ce86-4773-ab55-5373685c14b6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564ffef70>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:10.454847 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7467d27f-ce86-4773-ab55-5373685c14b6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.049146 Aug 27 04:56:10.455480 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 583/1213] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:10 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:10.727696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fc0104ca-3274-431e-bae8-861621c528fa tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb5650d0ee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:10.759840 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fc0104ca-3274-431e-bae8-861621c528fa tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a" status: 200 len: 288 microversion: 2.1 time: 0.036542 Aug 27 04:56:10.760519 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 631/1214] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 04:56:10 2022] GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:10.773144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fc0f3ef1-1527-4258-bc49-b28f72b46710 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb56500b280>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:10.844368 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fc0f3ef1-1527-4258-bc49-b28f72b46710 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a" status: 202 len: 0 microversion: 2.1 time: 0.075384 Aug 27 04:56:10.846864 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 584/1215] 10.222.0.58 () {58 vars in 1254 bytes} [Sat Aug 27 04:56:10 2022] DELETE /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:56:10.855230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b20b0bb5-c0f5-47cd-8573-cc84ce3f3ab0 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb565091af0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:10.905172 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b20b0bb5-c0f5-47cd-8573-cc84ce3f3ab0 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a" status: 200 len: 287 microversion: 2.1 time: 0.054248 Aug 27 04:56:10.905746 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 632/1216] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 04:56:10 2022] GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:11.159135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1b14ee33-db59-4fe9-86fe-f84032a1102a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:11.164101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1b14ee33-db59-4fe9-86fe-f84032a1102a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:11.171891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b14ee33-db59-4fe9-86fe-f84032a1102a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:11.172688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b14ee33-db59-4fe9-86fe-f84032a1102a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:11.173472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b14ee33-db59-4fe9-86fe-f84032a1102a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:11.174406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b14ee33-db59-4fe9-86fe-f84032a1102a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:11.175075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b14ee33-db59-4fe9-86fe-f84032a1102a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:11.176155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b14ee33-db59-4fe9-86fe-f84032a1102a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:11.306945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1b14ee33-db59-4fe9-86fe-f84032a1102a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:11.316020 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1b14ee33-db59-4fe9-86fe-f84032a1102a tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61" status: 200 len: 1431 microversion: 2.1 time: 0.162323 Aug 27 04:56:11.331550 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 585/1217] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:11 2022] GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 => generated 1431 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:11.365606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-98c3a940-13b5-4998-80cc-37bd693e4d2a req-4c3b57d9-3b61-4b46-a2ea-bf30f1ddc4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0c7f12-e408-4c56-911d-df18d1064e61", "name": "network-vif-deleted", "tag": "378e16c7-73cf-4379-9ce3-5ce58609cf51"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:11.385812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7e32573b-622c-4785-8ae5-e1efb29876b9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:11.386447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7e32573b-622c-4785-8ae5-e1efb29876b9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:11.392927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-98c3a940-13b5-4998-80cc-37bd693e4d2a req-4c3b57d9-3b61-4b46-a2ea-bf30f1ddc4c6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:11.395441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-98c3a940-13b5-4998-80cc-37bd693e4d2a req-4c3b57d9-3b61-4b46-a2ea-bf30f1ddc4c6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:11.395891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-98c3a940-13b5-4998-80cc-37bd693e4d2a req-4c3b57d9-3b61-4b46-a2ea-bf30f1ddc4c6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:11.403693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e32573b-622c-4785-8ae5-e1efb29876b9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:11.404440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e32573b-622c-4785-8ae5-e1efb29876b9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:11.407311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e32573b-622c-4785-8ae5-e1efb29876b9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:11.408248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e32573b-622c-4785-8ae5-e1efb29876b9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:11.414530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e32573b-622c-4785-8ae5-e1efb29876b9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:11.414984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e32573b-622c-4785-8ae5-e1efb29876b9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:11.416571 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-98c3a940-13b5-4998-80cc-37bd693e4d2a req-4c3b57d9-3b61-4b46-a2ea-bf30f1ddc4c6 service nova] Creating event network-vif-deleted:378e16c7-73cf-4379-9ce3-5ce58609cf51 for instance 8f0c7f12-e408-4c56-911d-df18d1064e61 on n-h1-820368-35 Aug 27 04:56:11.434667 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-98c3a940-13b5-4998-80cc-37bd693e4d2a req-4c3b57d9-3b61-4b46-a2ea-bf30f1ddc4c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073407 Aug 27 04:56:11.435867 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 633/1218] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:11.481092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c1e0894-3c8b-4e81-876b-80e1c6cefaa0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650e2ca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:11.565999 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c1e0894-3c8b-4e81-876b-80e1c6cefaa0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.096274 Aug 27 04:56:11.566600 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 634/1219] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:11 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:11.699853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-fc1b6b52-1dac-4ca7-9473-b4b399ddb28d req-63812efe-b71f-427e-a075-7723ed650380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd002ec2-35f3-43fb-b976-ecb02f1b7738", "name": "network-vif-unplugged", "status": "completed", "tag": "4783370e-a485-40e1-8ea2-5a10e13b0d87"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:11.713238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7e32573b-622c-4785-8ae5-e1efb29876b9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:11.717373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fc1b6b52-1dac-4ca7-9473-b4b399ddb28d req-63812efe-b71f-427e-a075-7723ed650380 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:11.718242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fc1b6b52-1dac-4ca7-9473-b4b399ddb28d req-63812efe-b71f-427e-a075-7723ed650380 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:11.721215 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7e32573b-622c-4785-8ae5-e1efb29876b9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1502 microversion: 2.1 time: 0.339718 Aug 27 04:56:11.726131 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 586/1220] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:11 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1502 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:11.734886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fc1b6b52-1dac-4ca7-9473-b4b399ddb28d req-63812efe-b71f-427e-a075-7723ed650380 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:11.813025 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-fc1b6b52-1dac-4ca7-9473-b4b399ddb28d req-63812efe-b71f-427e-a075-7723ed650380 service nova] Creating event network-vif-unplugged:4783370e-a485-40e1-8ea2-5a10e13b0d87 for instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 on n-h1-820368-35 Aug 27 04:56:11.829247 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-fc1b6b52-1dac-4ca7-9473-b4b399ddb28d req-63812efe-b71f-427e-a075-7723ed650380 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133015 Aug 27 04:56:11.830448 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 635/1221] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:11.920118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f0c6040-5d3c-4a4c-a955-5ad8a0bba8bf tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb56501a430>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:11.981171 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f0c6040-5d3c-4a4c-a955-5ad8a0bba8bf tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a" status: 200 len: 287 microversion: 2.1 time: 0.066138 Aug 27 04:56:11.987681 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 587/1222] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 04:56:11 2022] GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:12.335475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:12.339939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:12.340848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:12.347843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:12.348621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:12.349228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:12.350114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:12.350736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:12.351350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:12.386978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:12.388254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:12.388884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:12.389503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lazy-loading 'fault' on Instance uuid 8f0c7f12-e408-4c56-911d-df18d1064e61 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:12.467703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:12.475822 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-09759a24-6ae4-4594-b7af-78f4a72df274 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61" status: 200 len: 1308 microversion: 2.1 time: 0.141260 Aug 27 04:56:12.494977 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 636/1223] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:12 2022] GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:12.594391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e93267f0-8660-4bfa-a0a8-c89d7eb22fc6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5651b5a60>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:12.677600 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e93267f0-8660-4bfa-a0a8-c89d7eb22fc6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.095446 Aug 27 04:56:12.690352 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 588/1224] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:12 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:12.746567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aa74f099-fb7e-4e01-9b4c-ef40310c3532 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:12.747343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aa74f099-fb7e-4e01-9b4c-ef40310c3532 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:12.764240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa74f099-fb7e-4e01-9b4c-ef40310c3532 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:12.765213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa74f099-fb7e-4e01-9b4c-ef40310c3532 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:12.765933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa74f099-fb7e-4e01-9b4c-ef40310c3532 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:12.767712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa74f099-fb7e-4e01-9b4c-ef40310c3532 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:12.768486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa74f099-fb7e-4e01-9b4c-ef40310c3532 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:12.770101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa74f099-fb7e-4e01-9b4c-ef40310c3532 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:12.997712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ed0c7605-caf9-41d7-9133-d20ec824df42 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb56501a040>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:13.048564 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ed0c7605-caf9-41d7-9133-d20ec824df42 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a" status: 200 len: 287 microversion: 2.1 time: 0.056379 Aug 27 04:56:13.049146 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 589/1225] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 04:56:12 2022] GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:56:13.062188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aa74f099-fb7e-4e01-9b4c-ef40310c3532 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:13.071024 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aa74f099-fb7e-4e01-9b4c-ef40310c3532 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1502 microversion: 2.1 time: 0.328526 Aug 27 04:56:13.071882 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 637/1226] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:12 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1502 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:13.464366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-be263e29-595e-44dc-bd28-5a00127486f4 req-06ed9ce8-ce84-45c9-aead-e32dd35729f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f37868-9c79-436c-8fc3-295e678cb656", "name": "network-vif-deleted", "tag": "db4f91f2-079f-42ab-b80a-082ab7b26351"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:13.474319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-be263e29-595e-44dc-bd28-5a00127486f4 req-06ed9ce8-ce84-45c9-aead-e32dd35729f4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.474765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-be263e29-595e-44dc-bd28-5a00127486f4 req-06ed9ce8-ce84-45c9-aead-e32dd35729f4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.475223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-be263e29-595e-44dc-bd28-5a00127486f4 req-06ed9ce8-ce84-45c9-aead-e32dd35729f4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.486541 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-be263e29-595e-44dc-bd28-5a00127486f4 req-06ed9ce8-ce84-45c9-aead-e32dd35729f4 service nova] Creating event network-vif-deleted:db4f91f2-079f-42ab-b80a-082ab7b26351 for instance 69f37868-9c79-436c-8fc3-295e678cb656 on n-h2-820368-35 Aug 27 04:56:13.492257 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-be263e29-595e-44dc-bd28-5a00127486f4 req-06ed9ce8-ce84-45c9-aead-e32dd35729f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031254 Aug 27 04:56:13.493135 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 590/1227] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:13.497725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:13.498341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 8f0c7f12-e408-4c56-911d-df18d1064e61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:13.504882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.505412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.505851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.506552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.507222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.507647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.523490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:13.524948 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] HTTP exception thrown: Instance 8f0c7f12-e408-4c56-911d-df18d1064e61 could not be found. Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Request method failure captured: Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 HTTP/1.1 Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMY1qHnSwS1R8lTLyEZpfcwh5hCoXkzotR9jOR2p2AdfSdoBaXr9xo5Qs5AwnpClVIv_uSMUYdTcbJGG1bGKoa9FCezps1Pwbaw5Q-rfKGHFEUMQzY_fBNgr5vYtWKYE6dl5a47pYUpTtpNyImLWoA2aPEk2Ztp0ryewpXtbk1sKFE Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:56:13.526959 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4074bf02227441b091b6e7d62f83b9e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 113873d86b0c417e92a88af412281fe6 Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 8f0c7f12-e408-4c56-911d-df18d1064e61 could not be found. Aug 27 04:56:13.528361 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '8f0c7f12-e408-4c56-911d-df18d1064e61'} Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f0c7f12-e408-4c56-911d-df18d1064e61 could not be found. Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:13.529120 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f0c7f12-e408-4c56-911d-df18d1064e61 could not be found. Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f0c7f12-e408-4c56-911d-df18d1064e61 could not be found. Aug 27 04:56:13.530321 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.532827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Returning 404 to user: Instance 8f0c7f12-e408-4c56-911d-df18d1064e61 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:13.533925 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-16a890c8-f913-4db3-b4f6-7d132471853b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61" status: 404 len: 111 microversion: 2.1 time: 0.040107 Aug 27 04:56:13.535055 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 638/1228] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:13 2022] GET /compute/v2.1/servers/8f0c7f12-e408-4c56-911d-df18d1064e61 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:56:13.544490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:13.545339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 69f37868-9c79-436c-8fc3-295e678cb656] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:13.551924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.552466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.552901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.553599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.554043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.554638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.573019 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] HTTP exception thrown: Instance 69f37868-9c79-436c-8fc3-295e678cb656 could not be found. Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Request method failure captured: Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 HTTP/1.1 Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMY1qHnSwS1R8lTLyEZpfcwh5hCoXkzotR9jOR2p2AdfSdoBaXr9xo5Qs5AwnpClVIv_uSMUYdTcbJGG1bGKoa9FCezps1Pwbaw5Q-rfKGHFEUMQzY_fBNgr5vYtWKYE6dl5a47pYUpTtpNyImLWoA2aPEk2Ztp0ryewpXtbk1sKFE Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:56:13.575168 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4074bf02227441b091b6e7d62f83b9e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 113873d86b0c417e92a88af412281fe6 Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 69f37868-9c79-436c-8fc3-295e678cb656 could not be found. Aug 27 04:56:13.576583 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '69f37868-9c79-436c-8fc3-295e678cb656'} Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f37868-9c79-436c-8fc3-295e678cb656 could not be found. Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:13.577313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f37868-9c79-436c-8fc3-295e678cb656 could not be found. Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f37868-9c79-436c-8fc3-295e678cb656 could not be found. Aug 27 04:56:13.578517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.581356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Returning 404 to user: Instance 69f37868-9c79-436c-8fc3-295e678cb656 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:13.582472 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0947687b-91b3-4ea8-9965-ae3172984cd5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656" status: 404 len: 111 microversion: 2.1 time: 0.042771 Aug 27 04:56:13.584267 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 591/1229] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:13 2022] GET /compute/v2.1/servers/69f37868-9c79-436c-8fc3-295e678cb656 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:56:13.591877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e65c252-a0a0-4931-aa5e-9258aed18e7b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:13.627683 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e65c252-a0a0-4931-aa5e-9258aed18e7b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/4fe81053-9d62-48f5-a301-6d865ee72ba0" status: 204 len: 0 microversion: 2.1 time: 0.039460 Aug 27 04:56:13.639189 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 639/1230] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 04:56:13 2022] DELETE /compute/v2.1/os-server-groups/4fe81053-9d62-48f5-a301-6d865ee72ba0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:56:13.642019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b554282-8b89-429c-a9ed-8f5e357cf136 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:13.642549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b554282-8b89-429c-a9ed-8f5e357cf136 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:13.653603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b554282-8b89-429c-a9ed-8f5e357cf136 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.654089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b554282-8b89-429c-a9ed-8f5e357cf136 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.654529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b554282-8b89-429c-a9ed-8f5e357cf136 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.655264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b554282-8b89-429c-a9ed-8f5e357cf136 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.655728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b554282-8b89-429c-a9ed-8f5e357cf136 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.656155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b554282-8b89-429c-a9ed-8f5e357cf136 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.695568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5ea5867b-934c-488a-ba9b-98aa5c78c580 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650aea60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:13.700747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b554282-8b89-429c-a9ed-8f5e357cf136 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:56:13.769797 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5ea5867b-934c-488a-ba9b-98aa5c78c580 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.079404 Aug 27 04:56:13.771100 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 640/1231] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:13 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:13.821095 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b554282-8b89-429c-a9ed-8f5e357cf136 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 204 len: 0 microversion: 2.1 time: 0.187107 Aug 27 04:56:13.823186 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 592/1232] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:56:13 2022] DELETE /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:56:13.838787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-35aa7127-fe2a-4a24-899f-646d659afd66 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:13.839428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-35aa7127-fe2a-4a24-899f-646d659afd66 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:13.846541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35aa7127-fe2a-4a24-899f-646d659afd66 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.847031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35aa7127-fe2a-4a24-899f-646d659afd66 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.847526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35aa7127-fe2a-4a24-899f-646d659afd66 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.848793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35aa7127-fe2a-4a24-899f-646d659afd66 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.849279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35aa7127-fe2a-4a24-899f-646d659afd66 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.849706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35aa7127-fe2a-4a24-899f-646d659afd66 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.879574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-35aa7127-fe2a-4a24-899f-646d659afd66 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:56:13.973941 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-35aa7127-fe2a-4a24-899f-646d659afd66 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 204 len: 0 microversion: 2.1 time: 0.145029 Aug 27 04:56:13.974661 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 641/1233] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:56:13 2022] DELETE /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:56:13.986974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-da94c08e-395a-49ef-96ed-3f284c61a5b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:13.987923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-da94c08e-395a-49ef-96ed-3f284c61a5b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:13.998686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da94c08e-395a-49ef-96ed-3f284c61a5b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.999442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da94c08e-395a-49ef-96ed-3f284c61a5b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:14.000566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da94c08e-395a-49ef-96ed-3f284c61a5b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:14.001752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da94c08e-395a-49ef-96ed-3f284c61a5b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:14.002417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da94c08e-395a-49ef-96ed-3f284c61a5b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:14.002842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da94c08e-395a-49ef-96ed-3f284c61a5b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:14.061722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-83c7a6d5-0eb6-4ab4-97d7-e86d903d3910 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb565037550>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:14.091445 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-83c7a6d5-0eb6-4ab4-97d7-e86d903d3910 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] HTTP exception thrown: Snapshot 3c3cf527-1929-44eb-adc8-429823aff71a could not be found. Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-83c7a6d5-0eb6-4ab4-97d7-e86d903d3910 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Request method failure captured: Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a HTTP/1.1 Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaPkIDV3bhMyof_vWEN2PmVwiAeMhrCyUC94Rk-vbcAGsezvJXvT5a4sbUORw-KAG-KOPPifCUV7NAYkdLtyruJRe4-NDjhfXajtaOYsWfnssQ5WEWj1Ilt_e0VZvJmKtNFyykxZb0UhQOAFoyWnmVoxWNT3CmA5GRgUdGRuRV6my2I Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: b268c46f464241d0a5601e905163ef4d Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:56:14.128765 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b268c46f464241d0a5601e905163ef4d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: b268c46f464241d0a5601e905163ef4d Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-VolumesSnapshotsTestJSON-862503693-project Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 90ca8d67fce841f6a6c2193ab579c6c9 Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-VolumesSnapshotsTestJSON-862503693-project Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: exception: Snapshot 3c3cf527-1929-44eb-adc8-429823aff71a could not be found. Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '3c3cf527-1929-44eb-adc8-429823aff71a'} Aug 27 04:56:14.130179 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3c3cf527-1929-44eb-adc8-429823aff71a could not be found. (HTTP 404) (Request-ID: req-c12017a0-0518-4442-a20e-ca0d61046afb) Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:14.131044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:56:14.132296 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3c3cf527-1929-44eb-adc8-429823aff71a could not be found. Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 27 04:56:14.135345 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3c3cf527-1929-44eb-adc8-429823aff71a could not be found. Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3c3cf527-1929-44eb-adc8-429823aff71a could not be found. Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-83c7a6d5-0eb6-4ab4-97d7-e86d903d3910 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Returning 404 to user: Snapshot 3c3cf527-1929-44eb-adc8-429823aff71a could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:14.137063 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-83c7a6d5-0eb6-4ab4-97d7-e86d903d3910 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a" status: 404 len: 111 microversion: 2.1 time: 0.072942 Aug 27 04:56:14.138067 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 642/1234] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 04:56:14 2022] GET /compute/v2.1/os-snapshots/3c3cf527-1929-44eb-adc8-429823aff71a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:56:14.138067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b59ca01f-652b-4c9d-b8d0-5269fafff82b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:14.138067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b59ca01f-652b-4c9d-b8d0-5269fafff82b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:14.144057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b59ca01f-652b-4c9d-b8d0-5269fafff82b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:14.144554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b59ca01f-652b-4c9d-b8d0-5269fafff82b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:14.145001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b59ca01f-652b-4c9d-b8d0-5269fafff82b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:14.147224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b59ca01f-652b-4c9d-b8d0-5269fafff82b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:14.147224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b59ca01f-652b-4c9d-b8d0-5269fafff82b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:14.147224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b59ca01f-652b-4c9d-b8d0-5269fafff82b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:14.157924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-da94c08e-395a-49ef-96ed-3f284c61a5b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:14.167793 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-da94c08e-395a-49ef-96ed-3f284c61a5b0 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 200 len: 1475 microversion: 2.1 time: 0.188374 Aug 27 04:56:14.168594 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 593/1235] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:13 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 1475 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:14.172974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ade79cee-55e9-4103-a92a-bc416bf8f2b8 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb56509d0d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:14.260220 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ade79cee-55e9-4103-a92a-bc416bf8f2b8 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74" status: 202 len: 0 microversion: 2.1 time: 0.090710 Aug 27 04:56:14.260777 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 594/1236] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 04:56:14 2022] DELETE /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:56:14.269541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5377e4f-5fce-4082-b0e8-f6e718333d7c tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb5651b53a0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:14.324832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b59ca01f-652b-4c9d-b8d0-5269fafff82b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:14.334890 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b59ca01f-652b-4c9d-b8d0-5269fafff82b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1502 microversion: 2.1 time: 0.202547 Aug 27 04:56:14.335809 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 643/1237] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:14 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:14.342938 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5377e4f-5fce-4082-b0e8-f6e718333d7c tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74" status: 200 len: 344 microversion: 2.1 time: 0.077652 Aug 27 04:56:14.343734 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 595/1238] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 04:56:14 2022] GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:14.785631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b6d270e7-9dd7-4ad0-ab46-e7b070fe19b5 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565037040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:14.842087 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b6d270e7-9dd7-4ad0-ab46-e7b070fe19b5 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.060379 Aug 27 04:56:14.842662 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 644/1239] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:14 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:15.190090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-df3cc8f0-bba7-45d1-a2bb-48cc4c1db56b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:15.190782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-df3cc8f0-bba7-45d1-a2bb-48cc4c1db56b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:15.200755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df3cc8f0-bba7-45d1-a2bb-48cc4c1db56b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:15.201647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df3cc8f0-bba7-45d1-a2bb-48cc4c1db56b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:15.202305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df3cc8f0-bba7-45d1-a2bb-48cc4c1db56b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:15.203320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df3cc8f0-bba7-45d1-a2bb-48cc4c1db56b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:15.204146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df3cc8f0-bba7-45d1-a2bb-48cc4c1db56b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:15.204687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df3cc8f0-bba7-45d1-a2bb-48cc4c1db56b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:15.357432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9fc536d2-322f-42fb-a4f5-70d602774c76 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:15.358033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9fc536d2-322f-42fb-a4f5-70d602774c76 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:15.376635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fc536d2-322f-42fb-a4f5-70d602774c76 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:15.376635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fc536d2-322f-42fb-a4f5-70d602774c76 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:15.376635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fc536d2-322f-42fb-a4f5-70d602774c76 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:15.376635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fc536d2-322f-42fb-a4f5-70d602774c76 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:15.376972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fc536d2-322f-42fb-a4f5-70d602774c76 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:15.377683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fc536d2-322f-42fb-a4f5-70d602774c76 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:15.417669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-df3cc8f0-bba7-45d1-a2bb-48cc4c1db56b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:15.427722 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-df3cc8f0-bba7-45d1-a2bb-48cc4c1db56b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 200 len: 1475 microversion: 2.1 time: 0.243216 Aug 27 04:56:15.431227 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 596/1240] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:15 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 1475 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:15.439948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bb2a98eb-eced-4cdf-a934-01148bb55d90 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb56502d550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:15.514702 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bb2a98eb-eced-4cdf-a934-01148bb55d90 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74" status: 200 len: 344 microversion: 2.1 time: 0.084976 Aug 27 04:56:15.515339 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 597/1241] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 04:56:15 2022] GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:15.590108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9fc536d2-322f-42fb-a4f5-70d602774c76 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:15.604678 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9fc536d2-322f-42fb-a4f5-70d602774c76 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1492 microversion: 2.1 time: 0.251371 Aug 27 04:56:15.605927 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 645/1242] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:15 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1492 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:15.627309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8c219bbe-8474-4ede-8a11-bfcc1294e660 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '.version_select at 0x7fb56502d430>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:15.631344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c219bbe-8474-4ede-8a11-bfcc1294e660 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:15.631928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c219bbe-8474-4ede-8a11-bfcc1294e660 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:15.632616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c219bbe-8474-4ede-8a11-bfcc1294e660 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:15.642025 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8c219bbe-8474-4ede-8a11-bfcc1294e660 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1178 microversion: 2.1 time: 0.018614 Aug 27 04:56:15.642966 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 598/1243] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 04:56:15 2022] GET /compute/v2.1/os-migrations => generated 1178 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:15.657221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5b3b6ad2-ad9b-4a0b-8aea-db8a37287af0 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:15.657848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5b3b6ad2-ad9b-4a0b-8aea-db8a37287af0 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:15.665422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b3b6ad2-ad9b-4a0b-8aea-db8a37287af0 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:15.666079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b3b6ad2-ad9b-4a0b-8aea-db8a37287af0 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:15.666558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b3b6ad2-ad9b-4a0b-8aea-db8a37287af0 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:15.667462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b3b6ad2-ad9b-4a0b-8aea-db8a37287af0 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:15.667930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b3b6ad2-ad9b-4a0b-8aea-db8a37287af0 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:15.668406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b3b6ad2-ad9b-4a0b-8aea-db8a37287af0 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:15.818306 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5b3b6ad2-ad9b-4a0b-8aea-db8a37287af0 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1645 microversion: 2.1 time: 0.165192 Aug 27 04:56:15.819144 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 646/1244] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:15 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1645 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:15.856104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ca74113e-f4ea-433a-9631-58d260829e3c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650c78b0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:15.921841 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ca74113e-f4ea-433a-9631-58d260829e3c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.069231 Aug 27 04:56:15.922727 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 599/1245] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:15 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:15.981381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-689140863", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "00de91a4-56de-4dd2-b930-888a9f762ad7"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:16.045218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] validate_networks() for [('00de91a4-56de-4dd2-b930-888a9f762ad7', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:56:16.450529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0c9b5f74-97a5-4578-aa00-be2486001765 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:16.451390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c9b5f74-97a5-4578-aa00-be2486001765 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:16.457732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c9b5f74-97a5-4578-aa00-be2486001765 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:16.458289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c9b5f74-97a5-4578-aa00-be2486001765 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:16.458813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c9b5f74-97a5-4578-aa00-be2486001765 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:16.459609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c9b5f74-97a5-4578-aa00-be2486001765 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:16.460136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c9b5f74-97a5-4578-aa00-be2486001765 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:16.460631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c9b5f74-97a5-4578-aa00-be2486001765 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:16.611977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:56:16.612481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:56:16.613069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:56:16.613549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:56:16.614855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:56:16.626755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:16.627468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:16.628104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:16.629556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:16.630171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:16.630956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:16.654497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Getting quotas for project dd2736d36f16463c81a760e69e48fd28. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:56:16.662472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Getting quotas for user 17c08abee58846229f9255f8d86f762a and project dd2736d36f16463c81a760e69e48fd28. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:56:16.667942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0c9b5f74-97a5-4578-aa00-be2486001765 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:16.677734 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0c9b5f74-97a5-4578-aa00-be2486001765 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 200 len: 1475 microversion: 2.1 time: 0.231833 Aug 27 04:56:16.678750 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 600/1246] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:16 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 1475 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:16.679984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:56:16.682951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:56:16.683577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b1e859f4-4837-4f16-b394-e0d4d373195e tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb56500b790>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:16.718463 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-b1e859f4-4837-4f16-b394-e0d4d373195e tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] HTTP exception thrown: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b1e859f4-4837-4f16-b394-e0d4d373195e tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Request method failure captured: Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 HTTP/1.1 Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaPkIDV3bhMyof_vWEN2PmVwiAeMhrCyUC94Rk-vbcAGsezvJXvT5a4sbUORw-KAG-KOPPifCUV7NAYkdLtyruJRe4-NDjhfXajtaOYsWfnssQ5WEWj1Ilt_e0VZvJmKtNFyykxZb0UhQOAFoyWnmVoxWNT3CmA5GRgUdGRuRV6my2I Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: b268c46f464241d0a5601e905163ef4d Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:56:16.740408 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b268c46f464241d0a5601e905163ef4d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: b268c46f464241d0a5601e905163ef4d Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesSnapshotsTestJSON-862503693-project Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 90ca8d67fce841f6a6c2193ab579c6c9 Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesSnapshotsTestJSON-862503693-project Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: exception: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'c4b71fd6-41dc-4f0e-a1f7-61380123fa74'} Aug 27 04:56:16.741817 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. (HTTP 404) (Request-ID: req-d7ddd18a-02e5-46d9-81ba-c68f5f93baa0) Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:16.742623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:56:16.744436 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 04:56:16.752552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b1e859f4-4837-4f16-b394-e0d4d373195e tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Returning 404 to user: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b1e859f4-4837-4f16-b394-e0d4d373195e tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74" status: 404 len: 109 microversion: 2.1 time: 0.062254 Aug 27 04:56:16.755582 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 601/1247] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 04:56:16 2022] GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:16.758234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a4444bb-6c42-48c0-be98-7e049089cc1d tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb5651b5f70>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:16.760985 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-46f4bd54-261b-43b8-bbc2-2700c63ed32b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783707 Aug 27 04:56:16.767229 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 647/1248] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:56:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:56:16.775135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8bba845d-0c5d-4b67-8a90-79b25f5d6d45 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:16.775773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8bba845d-0c5d-4b67-8a90-79b25f5d6d45 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:16.823545 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-1a4444bb-6c42-48c0-be98-7e049089cc1d tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] HTTP exception thrown: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a4444bb-6c42-48c0-be98-7e049089cc1d tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Request method failure captured: Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 HTTP/1.1 Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaPkIDV3bhMyof_vWEN2PmVwiAeMhrCyUC94Rk-vbcAGsezvJXvT5a4sbUORw-KAG-KOPPifCUV7NAYkdLtyruJRe4-NDjhfXajtaOYsWfnssQ5WEWj1Ilt_e0VZvJmKtNFyykxZb0UhQOAFoyWnmVoxWNT3CmA5GRgUdGRuRV6my2I Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: b268c46f464241d0a5601e905163ef4d Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:56:16.825577 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b268c46f464241d0a5601e905163ef4d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: b268c46f464241d0a5601e905163ef4d Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesSnapshotsTestJSON-862503693-project Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 90ca8d67fce841f6a6c2193ab579c6c9 Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesSnapshotsTestJSON-862503693-project Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: exception: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'c4b71fd6-41dc-4f0e-a1f7-61380123fa74'} Aug 27 04:56:16.827009 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. (HTTP 404) (Request-ID: req-e9e3fccd-76a0-416b-8f2f-40575bde9472) Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:16.828192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 04:56:16.829812 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 04:56:16.830951 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:16.833958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.833958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.833958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:16.833958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.833958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.833958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:16.833958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:16.833958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:16.833958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:16.833958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.833958 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.837778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a4444bb-6c42-48c0-be98-7e049089cc1d tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Returning 404 to user: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:16.837778 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a4444bb-6c42-48c0-be98-7e049089cc1d tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74" status: 404 len: 109 microversion: 2.1 time: 0.083939 Aug 27 04:56:16.842008 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 602/1249] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 04:56:16 2022] DELETE /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:56:16.846982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a0d6b85f-837d-4ab2-b2e9-afcbb9b80b84 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Calling method '.version_select at 0x7fb56500b790>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:16.873099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8bba845d-0c5d-4b67-8a90-79b25f5d6d45 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:16.885397 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8bba845d-0c5d-4b67-8a90-79b25f5d6d45 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1210 microversion: 2.1 time: 0.114947 Aug 27 04:56:16.886381 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 648/1250] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:16 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:16.903466 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-a0d6b85f-837d-4ab2-b2e9-afcbb9b80b84 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] HTTP exception thrown: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a0d6b85f-837d-4ab2-b2e9-afcbb9b80b84 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Request method failure captured: Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 HTTP/1.1 Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaPkIDV3bhMyof_vWEN2PmVwiAeMhrCyUC94Rk-vbcAGsezvJXvT5a4sbUORw-KAG-KOPPifCUV7NAYkdLtyruJRe4-NDjhfXajtaOYsWfnssQ5WEWj1Ilt_e0VZvJmKtNFyykxZb0UhQOAFoyWnmVoxWNT3CmA5GRgUdGRuRV6my2I Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: b268c46f464241d0a5601e905163ef4d Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:56:16.905896 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b268c46f464241d0a5601e905163ef4d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b268c46f464241d0a5601e905163ef4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: b268c46f464241d0a5601e905163ef4d Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-862503693 Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesSnapshotsTestJSON-862503693-project Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 90ca8d67fce841f6a6c2193ab579c6c9 Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesSnapshotsTestJSON-862503693-project Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: exception: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'c4b71fd6-41dc-4f0e-a1f7-61380123fa74'} Aug 27 04:56:16.907222 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. (HTTP 404) (Request-ID: req-14924fe0-3cf4-4524-923c-84e48f8ccd9d) Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:16.908014 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:56:16.909133 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 04:56:16.910238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a0d6b85f-837d-4ab2-b2e9-afcbb9b80b84 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] Returning 404 to user: Volume c4b71fd6-41dc-4f0e-a1f7-61380123fa74 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:16.911920 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a0d6b85f-837d-4ab2-b2e9-afcbb9b80b84 tempest-VolumesSnapshotsTestJSON-862503693 tempest-VolumesSnapshotsTestJSON-862503693-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74" status: 404 len: 109 microversion: 2.1 time: 0.063976 Aug 27 04:56:16.912708 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 603/1251] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 04:56:16 2022] GET /compute/v2.1/os-volumes/c4b71fd6-41dc-4f0e-a1f7-61380123fa74 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:16.937692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5524e708-58bc-4170-9e11-5428e6506269 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650d3ca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:16.996047 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5524e708-58bc-4170-9e11-5428e6506269 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.062457 Aug 27 04:56:17.003010 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 649/1252] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:16 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:17.140930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-db444b62-9551-482a-8736-9f9860779024 req-efcc7343-08ba-4dc3-aaba-4facde6ec5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb8d618-f311-4f64-825c-f1816fe41876", "name": "network-vif-plugged", "status": "completed", "tag": "35ed7764-fd62-4b34-a259-e6ca2280e1f2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:17.156487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-db444b62-9551-482a-8736-9f9860779024 req-efcc7343-08ba-4dc3-aaba-4facde6ec5f4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.157794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-db444b62-9551-482a-8736-9f9860779024 req-efcc7343-08ba-4dc3-aaba-4facde6ec5f4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.158196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-db444b62-9551-482a-8736-9f9860779024 req-efcc7343-08ba-4dc3-aaba-4facde6ec5f4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.172430 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-db444b62-9551-482a-8736-9f9860779024 req-efcc7343-08ba-4dc3-aaba-4facde6ec5f4 service nova] Creating event network-vif-plugged:35ed7764-fd62-4b34-a259-e6ca2280e1f2 for instance 0fb8d618-f311-4f64-825c-f1816fe41876 on n-h2-820368-35 Aug 27 04:56:17.179517 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-db444b62-9551-482a-8736-9f9860779024 req-efcc7343-08ba-4dc3-aaba-4facde6ec5f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043566 Aug 27 04:56:17.181949 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 604/1253] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:17.704393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69213556-c064-46c1-9166-7ffbf02bdb80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:17.705639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-69213556-c064-46c1-9166-7ffbf02bdb80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:17.713391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69213556-c064-46c1-9166-7ffbf02bdb80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.714362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69213556-c064-46c1-9166-7ffbf02bdb80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.715550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69213556-c064-46c1-9166-7ffbf02bdb80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.716708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69213556-c064-46c1-9166-7ffbf02bdb80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.718665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69213556-c064-46c1-9166-7ffbf02bdb80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.719487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69213556-c064-46c1-9166-7ffbf02bdb80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.912818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b3dc3516-d8a0-4ae2-afd7-ec12f85b6577 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:17.913816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b3dc3516-d8a0-4ae2-afd7-ec12f85b6577 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:17.948365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3dc3516-d8a0-4ae2-afd7-ec12f85b6577 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.948904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3dc3516-d8a0-4ae2-afd7-ec12f85b6577 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.949359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3dc3516-d8a0-4ae2-afd7-ec12f85b6577 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.953037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3dc3516-d8a0-4ae2-afd7-ec12f85b6577 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.954385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3dc3516-d8a0-4ae2-afd7-ec12f85b6577 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.954899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3dc3516-d8a0-4ae2-afd7-ec12f85b6577 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.998145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-69213556-c064-46c1-9166-7ffbf02bdb80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:18.012434 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-69213556-c064-46c1-9166-7ffbf02bdb80 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 200 len: 1475 microversion: 2.1 time: 0.307908 Aug 27 04:56:18.013102 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 650/1254] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:17 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 1475 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:18.030267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdacb4f7-566e-4eb7-bc6e-a3ee20f1a683 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650378b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:18.100533 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cdacb4f7-566e-4eb7-bc6e-a3ee20f1a683 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.086228 Aug 27 04:56:18.101124 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 651/1255] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:18 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:18.143678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b3dc3516-d8a0-4ae2-afd7-ec12f85b6577 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:18.157096 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b3dc3516-d8a0-4ae2-afd7-ec12f85b6577 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1262 microversion: 2.1 time: 0.252582 Aug 27 04:56:18.157779 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 605/1256] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:17 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1262 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:18.479022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4d7f9d66-97b8-4606-8cdf-0495c0305b39 req-8e4b85db-8e9b-4593-ad9f-a6ffc7056508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a534099b-1082-4506-97ae-da1e66618172", "name": "network-vif-deleted", "tag": "2d29ce65-e94c-40f4-8546-0a5a9a18a415"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:18.498472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4d7f9d66-97b8-4606-8cdf-0495c0305b39 req-8e4b85db-8e9b-4593-ad9f-a6ffc7056508 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:18.510740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4d7f9d66-97b8-4606-8cdf-0495c0305b39 req-8e4b85db-8e9b-4593-ad9f-a6ffc7056508 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:18.512483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4d7f9d66-97b8-4606-8cdf-0495c0305b39 req-8e4b85db-8e9b-4593-ad9f-a6ffc7056508 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:18.529193 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4d7f9d66-97b8-4606-8cdf-0495c0305b39 req-8e4b85db-8e9b-4593-ad9f-a6ffc7056508 service nova] Creating event network-vif-deleted:2d29ce65-e94c-40f4-8546-0a5a9a18a415 for instance a534099b-1082-4506-97ae-da1e66618172 on n-h1-820368-35 Aug 27 04:56:18.535286 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4d7f9d66-97b8-4606-8cdf-0495c0305b39 req-8e4b85db-8e9b-4593-ad9f-a6ffc7056508 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061481 Aug 27 04:56:18.537029 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 652/1257] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:19.035294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:19.037488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:19.050835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.054134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.054996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.059587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.061252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.061987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.118121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-846a1efe-52f5-4e8e-8f8d-c174162978de tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650379d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:19.152022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.154326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.162723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.166471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lazy-loading 'fault' on Instance uuid a534099b-1082-4506-97ae-da1e66618172 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:19.189392 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-846a1efe-52f5-4e8e-8f8d-c174162978de tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.077399 Aug 27 04:56:19.189971 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 653/1258] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:19 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:19.200738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ff47f69-f6bd-4228-a645-072b808d5d79 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:19.201433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ff47f69-f6bd-4228-a645-072b808d5d79 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:19.203487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:19.209096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff47f69-f6bd-4228-a645-072b808d5d79 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.209833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff47f69-f6bd-4228-a645-072b808d5d79 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.210489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff47f69-f6bd-4228-a645-072b808d5d79 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.211384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff47f69-f6bd-4228-a645-072b808d5d79 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.212008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff47f69-f6bd-4228-a645-072b808d5d79 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.212599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff47f69-f6bd-4228-a645-072b808d5d79 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.227817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:19.250511 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7f4bab1d-599d-45d9-aa41-6221ba26816b tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 200 len: 1309 microversion: 2.1 time: 0.217594 Aug 27 04:56:19.263827 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 606/1259] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:19 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 1309 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:19.346351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1ff47f69-f6bd-4228-a645-072b808d5d79 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:19.358866 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ff47f69-f6bd-4228-a645-072b808d5d79 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1268 microversion: 2.1 time: 0.167094 Aug 27 04:56:19.362615 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 654/1260] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:19 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:20.205933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-acf6300e-cfd0-4214-b599-b238a6b9a29d tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56500b280>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:20.273662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:20.274415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:20.289024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:20.289879 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-acf6300e-cfd0-4214-b599-b238a6b9a29d tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.089122 Aug 27 04:56:20.290578 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 607/1261] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:20 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:20.291268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:20.293097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:20.294035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:20.294498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:20.294927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:20.381311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:20.382563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:20.384027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:20.384755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lazy-loading 'fault' on Instance uuid a534099b-1082-4506-97ae-da1e66618172 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:20.390793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b0c055db-eb43-47c4-b66a-f1d231478b4f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:20.391461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b0c055db-eb43-47c4-b66a-f1d231478b4f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:20.407736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0c055db-eb43-47c4-b66a-f1d231478b4f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:20.420030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0c055db-eb43-47c4-b66a-f1d231478b4f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:20.420791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0c055db-eb43-47c4-b66a-f1d231478b4f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:20.421705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0c055db-eb43-47c4-b66a-f1d231478b4f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:20.423652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0c055db-eb43-47c4-b66a-f1d231478b4f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:20.425818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0c055db-eb43-47c4-b66a-f1d231478b4f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:20.463330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:20.480609 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d1358da-e929-48f0-b91e-a13ae56fbe99 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 200 len: 1309 microversion: 2.1 time: 0.211945 Aug 27 04:56:20.481106 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 655/1262] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:20 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 1309 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:20.587240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-015cb39c-b841-465a-8249-8d8428c1f075 req-dee9aa64-fa0f-4932-93fc-df9ac647dbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffdf84a-8782-47da-94fc-2fd50baa7121", "name": "network-vif-deleted", "tag": "645e142f-1fd0-4053-b3f9-9eb22ea2f13c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:20.610686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-015cb39c-b841-465a-8249-8d8428c1f075 req-dee9aa64-fa0f-4932-93fc-df9ac647dbed service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:20.611306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-015cb39c-b841-465a-8249-8d8428c1f075 req-dee9aa64-fa0f-4932-93fc-df9ac647dbed service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:20.611954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-015cb39c-b841-465a-8249-8d8428c1f075 req-dee9aa64-fa0f-4932-93fc-df9ac647dbed service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:20.635966 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-015cb39c-b841-465a-8249-8d8428c1f075 req-dee9aa64-fa0f-4932-93fc-df9ac647dbed service nova] Creating event network-vif-deleted:645e142f-1fd0-4053-b3f9-9eb22ea2f13c for instance 6ffdf84a-8782-47da-94fc-2fd50baa7121 on n-h1-820368-35 Aug 27 04:56:20.647387 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-015cb39c-b841-465a-8249-8d8428c1f075 req-dee9aa64-fa0f-4932-93fc-df9ac647dbed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066080 Aug 27 04:56:20.652662 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 656/1263] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:56:20.757137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b0c055db-eb43-47c4-b66a-f1d231478b4f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:20.768749 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b0c055db-eb43-47c4-b66a-f1d231478b4f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1310 microversion: 2.1 time: 0.387441 Aug 27 04:56:20.783476 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 608/1264] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:20 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1310 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:21.305372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d37c6263-5e0b-4223-9e8e-7defc84f045c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565004670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:21.381016 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d37c6263-5e0b-4223-9e8e-7defc84f045c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.080272 Aug 27 04:56:21.385795 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 657/1265] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:21 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:21.501870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:21.502488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: a534099b-1082-4506-97ae-da1e66618172] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:21.513089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.513589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.514030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.514835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.515581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.516485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.540678 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] HTTP exception thrown: Instance a534099b-1082-4506-97ae-da1e66618172 could not be found. Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Request method failure captured: Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 HTTP/1.1 Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMY1qHnSwS1R8lTLyEZpfcwh5hCoXkzotR9jOR2p2AdfSdoBaXr9xo5Qs5AwnpClVIv_uSMUYdTcbJGG1bGKoa9FCezps1Pwbaw5Q-rfKGHFEUMQzY_fBNgr5vYtWKYE6dl5a47pYUpTtpNyImLWoA2aPEk2Ztp0ryewpXtbk1sKFE Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:56:21.544025 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4074bf02227441b091b6e7d62f83b9e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 113873d86b0c417e92a88af412281fe6 Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance a534099b-1082-4506-97ae-da1e66618172 could not be found. Aug 27 04:56:21.545843 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'a534099b-1082-4506-97ae-da1e66618172'} Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a534099b-1082-4506-97ae-da1e66618172 could not be found. Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:21.546820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a534099b-1082-4506-97ae-da1e66618172 could not be found. Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a534099b-1082-4506-97ae-da1e66618172 could not be found. Aug 27 04:56:21.548815 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.551540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Returning 404 to user: Instance a534099b-1082-4506-97ae-da1e66618172 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:21.552785 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d9b296f3-edee-43cc-bec9-a888ad7fc1f5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172" status: 404 len: 111 microversion: 2.1 time: 0.054261 Aug 27 04:56:21.552785 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 609/1266] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:21 2022] GET /compute/v2.1/servers/a534099b-1082-4506-97ae-da1e66618172 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:21.563685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:21.564173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 6ffdf84a-8782-47da-94fc-2fd50baa7121] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:21.576450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.577848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.578465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.579322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.580073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.580716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.606565 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] HTTP exception thrown: Instance 6ffdf84a-8782-47da-94fc-2fd50baa7121 could not be found. Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Request method failure captured: Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 HTTP/1.1 Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaMY1qHnSwS1R8lTLyEZpfcwh5hCoXkzotR9jOR2p2AdfSdoBaXr9xo5Qs5AwnpClVIv_uSMUYdTcbJGG1bGKoa9FCezps1Pwbaw5Q-rfKGHFEUMQzY_fBNgr5vYtWKYE6dl5a47pYUpTtpNyImLWoA2aPEk2Ztp0ryewpXtbk1sKFE Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:56:21.619176 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4074bf02227441b091b6e7d62f83b9e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 113873d86b0c417e92a88af412281fe6 Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 6ffdf84a-8782-47da-94fc-2fd50baa7121 could not be found. Aug 27 04:56:21.620924 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '6ffdf84a-8782-47da-94fc-2fd50baa7121'} Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ffdf84a-8782-47da-94fc-2fd50baa7121 could not be found. Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:21.621849 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ffdf84a-8782-47da-94fc-2fd50baa7121 could not be found. Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ffdf84a-8782-47da-94fc-2fd50baa7121 could not be found. Aug 27 04:56:21.623416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.625102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Returning 404 to user: Instance 6ffdf84a-8782-47da-94fc-2fd50baa7121 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:21.636001 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-97757c47-f589-4bf9-8d98-f633c0c79deb tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121" status: 404 len: 111 microversion: 2.1 time: 0.078179 Aug 27 04:56:21.636875 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 658/1267] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:21 2022] GET /compute/v2.1/servers/6ffdf84a-8782-47da-94fc-2fd50baa7121 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:21.645260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2dd310e8-d2ed-4453-a4b2-b32f6329c7e5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:21.700090 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2dd310e8-d2ed-4453-a4b2-b32f6329c7e5 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/aa8dd1db-315c-47d2-af7f-40f3948a37fb" status: 204 len: 0 microversion: 2.1 time: 0.058699 Aug 27 04:56:21.702282 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 610/1268] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 04:56:21 2022] DELETE /compute/v2.1/os-server-groups/aa8dd1db-315c-47d2-af7f-40f3948a37fb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:56:21.711302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7e51725f-750d-4359-bbbf-49ea0e991cda tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:21.712239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7e51725f-750d-4359-bbbf-49ea0e991cda tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:21.722660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e51725f-750d-4359-bbbf-49ea0e991cda tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.725638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e51725f-750d-4359-bbbf-49ea0e991cda tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.726319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e51725f-750d-4359-bbbf-49ea0e991cda tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.727364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e51725f-750d-4359-bbbf-49ea0e991cda tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.728043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e51725f-750d-4359-bbbf-49ea0e991cda tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.729724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e51725f-750d-4359-bbbf-49ea0e991cda tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.776490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7e51725f-750d-4359-bbbf-49ea0e991cda tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:56:21.793290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3e85daac-93f4-496e-8ccf-3a4cd315f39e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:21.793932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3e85daac-93f4-496e-8ccf-3a4cd315f39e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:21.808450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e85daac-93f4-496e-8ccf-3a4cd315f39e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.820636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e85daac-93f4-496e-8ccf-3a4cd315f39e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.821542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e85daac-93f4-496e-8ccf-3a4cd315f39e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.822534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e85daac-93f4-496e-8ccf-3a4cd315f39e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.823366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e85daac-93f4-496e-8ccf-3a4cd315f39e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.824020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e85daac-93f4-496e-8ccf-3a4cd315f39e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.884261 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7e51725f-750d-4359-bbbf-49ea0e991cda tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 204 len: 0 microversion: 2.1 time: 0.176970 Aug 27 04:56:21.885614 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 659/1269] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:56:21 2022] DELETE /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:56:21.907321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6f39d1e0-cbd9-44ee-827a-9910157f1d74 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:21.913267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6f39d1e0-cbd9-44ee-827a-9910157f1d74 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:21.928333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f39d1e0-cbd9-44ee-827a-9910157f1d74 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.929652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f39d1e0-cbd9-44ee-827a-9910157f1d74 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.931474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f39d1e0-cbd9-44ee-827a-9910157f1d74 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.933069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f39d1e0-cbd9-44ee-827a-9910157f1d74 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.933536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f39d1e0-cbd9-44ee-827a-9910157f1d74 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.936134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f39d1e0-cbd9-44ee-827a-9910157f1d74 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:22.155027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3e85daac-93f4-496e-8ccf-3a4cd315f39e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:22.166428 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3e85daac-93f4-496e-8ccf-3a4cd315f39e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1310 microversion: 2.1 time: 0.379739 Aug 27 04:56:22.169643 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 611/1270] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:21 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1310 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:22.200472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6f39d1e0-cbd9-44ee-827a-9910157f1d74 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:22.214756 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6f39d1e0-cbd9-44ee-827a-9910157f1d74 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1471 microversion: 2.1 time: 0.324738 Aug 27 04:56:22.217160 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 660/1271] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:21 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1471 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:22.399723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f41db374-2b63-4fcd-a7c9-81f789c0c1d6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f8a940>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:22.472792 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f41db374-2b63-4fcd-a7c9-81f789c0c1d6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.079227 Aug 27 04:56:22.474508 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 612/1272] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:22 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:22.703675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c3072bda-d08a-469b-8060-66f051db166a req-0e615247-7ccb-4df7-af2b-666521b60527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b37de1a-3cba-44f1-b297-7031a8831ce1", "tag": "5e0e371f-d224-460c-af4d-acb183057d97"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:22.726440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c3072bda-d08a-469b-8060-66f051db166a req-0e615247-7ccb-4df7-af2b-666521b60527 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:22.727390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c3072bda-d08a-469b-8060-66f051db166a req-0e615247-7ccb-4df7-af2b-666521b60527 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:22.730169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c3072bda-d08a-469b-8060-66f051db166a req-0e615247-7ccb-4df7-af2b-666521b60527 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:22.749341 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c3072bda-d08a-469b-8060-66f051db166a req-0e615247-7ccb-4df7-af2b-666521b60527 service nova] Creating event network-changed:5e0e371f-d224-460c-af4d-acb183057d97 for instance 5b37de1a-3cba-44f1-b297-7031a8831ce1 on n-h1-820368-35 Aug 27 04:56:22.757103 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c3072bda-d08a-469b-8060-66f051db166a req-0e615247-7ccb-4df7-af2b-666521b60527 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056788 Aug 27 04:56:22.758362 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 661/1273] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:23.203541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bf71351f-08b8-4e92-a9b3-099d5affd304 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:23.204942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bf71351f-08b8-4e92-a9b3-099d5affd304 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:23.216129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf71351f-08b8-4e92-a9b3-099d5affd304 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:23.216913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf71351f-08b8-4e92-a9b3-099d5affd304 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:23.217578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf71351f-08b8-4e92-a9b3-099d5affd304 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:23.218754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf71351f-08b8-4e92-a9b3-099d5affd304 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:23.219484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf71351f-08b8-4e92-a9b3-099d5affd304 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:23.220416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf71351f-08b8-4e92-a9b3-099d5affd304 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:23.239297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-06bb2ae3-e102-462e-9951-2acceb6eaf0e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:23.240379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-06bb2ae3-e102-462e-9951-2acceb6eaf0e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:23.280918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06bb2ae3-e102-462e-9951-2acceb6eaf0e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:23.284516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06bb2ae3-e102-462e-9951-2acceb6eaf0e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:23.288569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06bb2ae3-e102-462e-9951-2acceb6eaf0e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:23.289563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06bb2ae3-e102-462e-9951-2acceb6eaf0e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:23.293483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06bb2ae3-e102-462e-9951-2acceb6eaf0e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:23.297077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06bb2ae3-e102-462e-9951-2acceb6eaf0e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:23.314345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:23.549761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-06bb2ae3-e102-462e-9951-2acceb6eaf0e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:23.568593 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-06bb2ae3-e102-462e-9951-2acceb6eaf0e tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1471 microversion: 2.1 time: 0.335803 Aug 27 04:56:23.571903 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 662/1274] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:23 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1471 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:23.580922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-505bb674-788c-4153-bf7b-7f891109ca8e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fff700>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:23.586338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bf71351f-08b8-4e92-a9b3-099d5affd304 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:23.596389 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bf71351f-08b8-4e92-a9b3-099d5affd304 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1310 microversion: 2.1 time: 0.403487 Aug 27 04:56:23.596988 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 613/1275] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:23 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1310 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:23.662697 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-505bb674-788c-4153-bf7b-7f891109ca8e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.089252 Aug 27 04:56:23.671156 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 663/1276] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:23 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:24.599199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-554757e6-38ad-44b6-929d-c71bad6442cc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:24.599809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-554757e6-38ad-44b6-929d-c71bad6442cc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:24.608534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-554757e6-38ad-44b6-929d-c71bad6442cc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.609598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-554757e6-38ad-44b6-929d-c71bad6442cc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.610210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-554757e6-38ad-44b6-929d-c71bad6442cc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.614541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-554757e6-38ad-44b6-929d-c71bad6442cc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.615281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-554757e6-38ad-44b6-929d-c71bad6442cc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.615900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-554757e6-38ad-44b6-929d-c71bad6442cc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.620020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2f3b9396-ff48-48c9-9d48-73d51c61c31c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:24.620651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2f3b9396-ff48-48c9-9d48-73d51c61c31c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:24.637091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f3b9396-ff48-48c9-9d48-73d51c61c31c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.637604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f3b9396-ff48-48c9-9d48-73d51c61c31c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.638054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f3b9396-ff48-48c9-9d48-73d51c61c31c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.638785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f3b9396-ff48-48c9-9d48-73d51c61c31c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.639287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f3b9396-ff48-48c9-9d48-73d51c61c31c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.639719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f3b9396-ff48-48c9-9d48-73d51c61c31c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.935556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-554757e6-38ad-44b6-929d-c71bad6442cc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:24.947875 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-554757e6-38ad-44b6-929d-c71bad6442cc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1471 microversion: 2.1 time: 0.353841 Aug 27 04:56:24.958450 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 614/1277] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:24 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1471 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:24.980050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3b8f5b2-20fe-46f0-8341-1a53690a0df9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56500b700>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:24.990599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2f3b9396-ff48-48c9-9d48-73d51c61c31c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:25.010155 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2f3b9396-ff48-48c9-9d48-73d51c61c31c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1310 microversion: 2.1 time: 0.394516 Aug 27 04:56:25.012632 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 664/1278] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:24 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1310 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:25.063048 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a3b8f5b2-20fe-46f0-8341-1a53690a0df9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.100780 Aug 27 04:56:25.064069 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 615/1279] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:24 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:25.981861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-44e09d61-82d3-4c8d-a169-8c0a32a65a29 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:25.982849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-44e09d61-82d3-4c8d-a169-8c0a32a65a29 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:25.992049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44e09d61-82d3-4c8d-a169-8c0a32a65a29 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:25.994119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44e09d61-82d3-4c8d-a169-8c0a32a65a29 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:25.995800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44e09d61-82d3-4c8d-a169-8c0a32a65a29 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:25.997351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44e09d61-82d3-4c8d-a169-8c0a32a65a29 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:25.998010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44e09d61-82d3-4c8d-a169-8c0a32a65a29 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:26.003448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44e09d61-82d3-4c8d-a169-8c0a32a65a29 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:26.008882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:26.044714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a4c7c56c-8b94-4960-b708-6e33fbaf3967 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:26.048409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a4c7c56c-8b94-4960-b708-6e33fbaf3967 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:26.068855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:26.077873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c7c56c-8b94-4960-b708-6e33fbaf3967 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:26.078720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c7c56c-8b94-4960-b708-6e33fbaf3967 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:26.082922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c7c56c-8b94-4960-b708-6e33fbaf3967 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:26.083988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c7c56c-8b94-4960-b708-6e33fbaf3967 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:26.087493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c7c56c-8b94-4960-b708-6e33fbaf3967 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:26.088899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c7c56c-8b94-4960-b708-6e33fbaf3967 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:26.339588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a4c7c56c-8b94-4960-b708-6e33fbaf3967 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:26.351737 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a4c7c56c-8b94-4960-b708-6e33fbaf3967 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1310 microversion: 2.1 time: 0.315198 Aug 27 04:56:26.355872 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 616/1280] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:26 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1310 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:26.368621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-170273c3-5afc-49ca-9518-fd5b83ace6e0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f8aaf0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:26.419474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-44e09d61-82d3-4c8d-a169-8c0a32a65a29 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:26.434251 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-44e09d61-82d3-4c8d-a169-8c0a32a65a29 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1471 microversion: 2.1 time: 0.454752 Aug 27 04:56:26.451573 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 665/1281] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:25 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1471 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:26.487189 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-170273c3-5afc-49ca-9518-fd5b83ace6e0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.128915 Aug 27 04:56:26.489144 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 617/1282] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:26 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:27.386270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d72f7bad-b02a-4647-a004-8c53a038539a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:27.387572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d72f7bad-b02a-4647-a004-8c53a038539a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:27.389950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:27.394038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:27.411125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d72f7bad-b02a-4647-a004-8c53a038539a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:27.414744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d72f7bad-b02a-4647-a004-8c53a038539a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:27.415515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d72f7bad-b02a-4647-a004-8c53a038539a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:27.416519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d72f7bad-b02a-4647-a004-8c53a038539a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:27.417224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d72f7bad-b02a-4647-a004-8c53a038539a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:27.419045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d72f7bad-b02a-4647-a004-8c53a038539a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:27.471339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-461eb750-effd-465c-aae0-a02cbb4cc6bc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:27.472550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-461eb750-effd-465c-aae0-a02cbb4cc6bc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:27.490669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-461eb750-effd-465c-aae0-a02cbb4cc6bc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:27.491482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-461eb750-effd-465c-aae0-a02cbb4cc6bc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:27.494002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-461eb750-effd-465c-aae0-a02cbb4cc6bc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:27.495127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-461eb750-effd-465c-aae0-a02cbb4cc6bc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:27.498082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-461eb750-effd-465c-aae0-a02cbb4cc6bc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:27.498777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-461eb750-effd-465c-aae0-a02cbb4cc6bc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:27.740988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d72f7bad-b02a-4647-a004-8c53a038539a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:27.752054 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d72f7bad-b02a-4647-a004-8c53a038539a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1310 microversion: 2.1 time: 0.374487 Aug 27 04:56:27.765710 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 666/1283] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:27 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1310 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:27.784631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d5fe192e-f740-49c8-b2e9-4bd6237eb2eb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650048b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:27.902414 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d5fe192e-f740-49c8-b2e9-4bd6237eb2eb tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.132108 Aug 27 04:56:27.912598 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 667/1284] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:27 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:27.950396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-461eb750-effd-465c-aae0-a02cbb4cc6bc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:27.963158 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-461eb750-effd-465c-aae0-a02cbb4cc6bc tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1471 microversion: 2.1 time: 0.501173 Aug 27 04:56:27.966740 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 618/1285] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:27 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1471 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:28.145025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4894cd30-d951-451d-9441-2ee851e9d644 req-da4a81cd-9ecb-4471-9948-87f245fa058a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198422a0-c1e8-4c71-9ecd-43b3c3e0178d", "name": "network-vif-deleted", "tag": "4fa25b75-187a-4e66-b47e-299b07e84a8d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:28.163676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4894cd30-d951-451d-9441-2ee851e9d644 req-da4a81cd-9ecb-4471-9948-87f245fa058a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:28.166212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4894cd30-d951-451d-9441-2ee851e9d644 req-da4a81cd-9ecb-4471-9948-87f245fa058a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:28.168519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4894cd30-d951-451d-9441-2ee851e9d644 req-da4a81cd-9ecb-4471-9948-87f245fa058a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:28.198163 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4894cd30-d951-451d-9441-2ee851e9d644 req-da4a81cd-9ecb-4471-9948-87f245fa058a service nova] Creating event network-vif-deleted:4fa25b75-187a-4e66-b47e-299b07e84a8d for instance 198422a0-c1e8-4c71-9ecd-43b3c3e0178d on n-h1-820368-35 Aug 27 04:56:28.212842 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4894cd30-d951-451d-9441-2ee851e9d644 req-da4a81cd-9ecb-4471-9948-87f245fa058a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070775 Aug 27 04:56:28.214012 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 668/1286] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:28.793490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d1758a41-3de4-4f15-927f-51680ad751ad tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:28.794749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d1758a41-3de4-4f15-927f-51680ad751ad tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:28.817806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1758a41-3de4-4f15-927f-51680ad751ad tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:28.820969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1758a41-3de4-4f15-927f-51680ad751ad tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:28.821583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1758a41-3de4-4f15-927f-51680ad751ad tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:28.822714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1758a41-3de4-4f15-927f-51680ad751ad tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:28.823363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1758a41-3de4-4f15-927f-51680ad751ad tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:28.823942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1758a41-3de4-4f15-927f-51680ad751ad tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:28.922515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f905630-b0fc-43b0-82db-e06638d08f66 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fff550>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:29.008473 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f905630-b0fc-43b0-82db-e06638d08f66 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.089087 Aug 27 04:56:29.010589 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 669/1287] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:28 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:29.017442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:29.019998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:29.038542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:29.039279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:29.039899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:29.041689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:29.042434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:29.043205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:29.094203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:29.095279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:29.096314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:29.097244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lazy-loading 'fault' on Instance uuid 198422a0-c1e8-4c71-9ecd-43b3c3e0178d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:29.159056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d1758a41-3de4-4f15-927f-51680ad751ad tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:29.168709 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d1758a41-3de4-4f15-927f-51680ad751ad tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1310 microversion: 2.1 time: 0.382021 Aug 27 04:56:29.192319 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 619/1288] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:28 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1310 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:29.224092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113873d86b0c417e92a88af412281fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4074bf02227441b091b6e7d62f83b9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:29.237485 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-11752d5e-a651-4c43-b6bf-f7733e2bef3c tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 200 len: 1306 microversion: 2.1 time: 0.225418 Aug 27 04:56:29.243689 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 670/1289] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:29 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 1306 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:30.026763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b0454383-8651-4837-9477-5244ed90741e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fab160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:30.095005 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b0454383-8651-4837-9477-5244ed90741e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.075303 Aug 27 04:56:30.095893 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 620/1290] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:30 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:30.208281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e466bb37-47a9-4390-9ef5-d1ab38ffb99f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:30.209610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e466bb37-47a9-4390-9ef5-d1ab38ffb99f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:30.216915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e466bb37-47a9-4390-9ef5-d1ab38ffb99f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:30.217294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e466bb37-47a9-4390-9ef5-d1ab38ffb99f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:30.217902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e466bb37-47a9-4390-9ef5-d1ab38ffb99f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:30.218817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e466bb37-47a9-4390-9ef5-d1ab38ffb99f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:30.219488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e466bb37-47a9-4390-9ef5-d1ab38ffb99f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:30.220081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e466bb37-47a9-4390-9ef5-d1ab38ffb99f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:30.261105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:30.261739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] [instance: 198422a0-c1e8-4c71-9ecd-43b3c3e0178d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:30.273787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:30.274289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:30.275126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:30.278809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:30.280500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:30.281448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:30.323036 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] HTTP exception thrown: Instance 198422a0-c1e8-4c71-9ecd-43b3c3e0178d could not be found. Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Request method failure captured: Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d HTTP/1.1 Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaMY1qHnSwS1R8lTLyEZpfcwh5hCoXkzotR9jOR2p2AdfSdoBaXr9xo5Qs5AwnpClVIv_uSMUYdTcbJGG1bGKoa9FCezps1Pwbaw5Q-rfKGHFEUMQzY_fBNgr5vYtWKYE6dl5a47pYUpTtpNyImLWoA2aPEk2Ztp0ryewpXtbk1sKFE Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:56:30.324775 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4074bf02227441b091b6e7d62f83b9e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4074bf02227441b091b6e7d62f83b9e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 4074bf02227441b091b6e7d62f83b9e0 Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-699709562 Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 113873d86b0c417e92a88af412281fe6 Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersOnMultiNodesTest-699709562-project Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 198422a0-c1e8-4c71-9ecd-43b3c3e0178d could not be found. Aug 27 04:56:30.326479 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '198422a0-c1e8-4c71-9ecd-43b3c3e0178d'} Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198422a0-c1e8-4c71-9ecd-43b3c3e0178d could not be found. Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:30.327534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198422a0-c1e8-4c71-9ecd-43b3c3e0178d could not be found. Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198422a0-c1e8-4c71-9ecd-43b3c3e0178d could not be found. Aug 27 04:56:30.329391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.331171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] Returning 404 to user: Instance 198422a0-c1e8-4c71-9ecd-43b3c3e0178d could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:30.331171 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3a1719a6-cdf9-4a89-a790-c10510e37e28 tempest-ServersOnMultiNodesTest-699709562 tempest-ServersOnMultiNodesTest-699709562-project] 10.222.0.58 "GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d" status: 404 len: 111 microversion: 2.1 time: 0.069565 Aug 27 04:56:30.342914 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 621/1291] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:30 2022] GET /compute/v2.1/servers/198422a0-c1e8-4c71-9ecd-43b3c3e0178d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:30.520404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e466bb37-47a9-4390-9ef5-d1ab38ffb99f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:30.533092 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e466bb37-47a9-4390-9ef5-d1ab38ffb99f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1310 microversion: 2.1 time: 0.329354 Aug 27 04:56:30.535894 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 671/1292] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:30 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1310 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:30.702373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-63db0400-0743-41b9-bcd9-b464c05ac8e9 req-58778d1b-3c91-4a34-ba4e-fc2216933458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b37de1a-3cba-44f1-b297-7031a8831ce1", "name": "network-vif-plugged", "status": "completed", "tag": "5e0e371f-d224-460c-af4d-acb183057d97"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:30.723385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-63db0400-0743-41b9-bcd9-b464c05ac8e9 req-58778d1b-3c91-4a34-ba4e-fc2216933458 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:30.724509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-63db0400-0743-41b9-bcd9-b464c05ac8e9 req-58778d1b-3c91-4a34-ba4e-fc2216933458 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:30.726977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-63db0400-0743-41b9-bcd9-b464c05ac8e9 req-58778d1b-3c91-4a34-ba4e-fc2216933458 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:30.746020 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-63db0400-0743-41b9-bcd9-b464c05ac8e9 req-58778d1b-3c91-4a34-ba4e-fc2216933458 service nova] Creating event network-vif-plugged:5e0e371f-d224-460c-af4d-acb183057d97 for instance 5b37de1a-3cba-44f1-b297-7031a8831ce1 on n-h1-820368-35 Aug 27 04:56:30.764784 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-63db0400-0743-41b9-bcd9-b464c05ac8e9 req-58778d1b-3c91-4a34-ba4e-fc2216933458 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065891 Aug 27 04:56:30.767173 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 622/1293] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:31.112837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fd69b70f-06b6-4e58-85e2-7edf0d04db6c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565056940>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:31.187983 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fd69b70f-06b6-4e58-85e2-7edf0d04db6c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.081878 Aug 27 04:56:31.189378 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 672/1294] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:31 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:31.560944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4a2ea522-14df-4291-8411-9b7f013882f2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:31.563751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4a2ea522-14df-4291-8411-9b7f013882f2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:31.581044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a2ea522-14df-4291-8411-9b7f013882f2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:31.582181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a2ea522-14df-4291-8411-9b7f013882f2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:31.582511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a2ea522-14df-4291-8411-9b7f013882f2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:31.586646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a2ea522-14df-4291-8411-9b7f013882f2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:31.588371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a2ea522-14df-4291-8411-9b7f013882f2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:31.588847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a2ea522-14df-4291-8411-9b7f013882f2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:31.929255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4a2ea522-14df-4291-8411-9b7f013882f2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:31.946073 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4a2ea522-14df-4291-8411-9b7f013882f2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1310 microversion: 2.1 time: 0.390099 Aug 27 04:56:31.947399 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 623/1295] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:31 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1310 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:32.204057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0b4d9892-8b77-4b04-89bf-d3b0f6007699 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56509fdc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:32.261909 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0b4d9892-8b77-4b04-89bf-d3b0f6007699 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.062222 Aug 27 04:56:32.263429 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 673/1296] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:32 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:32.970282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cabcb3c3-df29-43ed-b9b1-b9d39b47e0a2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:32.971731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cabcb3c3-df29-43ed-b9b1-b9d39b47e0a2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:32.985103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cabcb3c3-df29-43ed-b9b1-b9d39b47e0a2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:32.985848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cabcb3c3-df29-43ed-b9b1-b9d39b47e0a2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:32.986440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cabcb3c3-df29-43ed-b9b1-b9d39b47e0a2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:32.987588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cabcb3c3-df29-43ed-b9b1-b9d39b47e0a2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:32.991829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cabcb3c3-df29-43ed-b9b1-b9d39b47e0a2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:32.995839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cabcb3c3-df29-43ed-b9b1-b9d39b47e0a2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:33.277748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c38c31b4-68a0-44cd-9d08-e23d698e38e9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565056ca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:33.355566 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c38c31b4-68a0-44cd-9d08-e23d698e38e9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.081504 Aug 27 04:56:33.364256 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 674/1297] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:33 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:33.723159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cabcb3c3-df29-43ed-b9b1-b9d39b47e0a2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:33.738528 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cabcb3c3-df29-43ed-b9b1-b9d39b47e0a2 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1491 microversion: 2.1 time: 0.772449 Aug 27 04:56:33.742171 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 624/1298] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:32 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1491 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:33.767274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0ffba0c7-6866-435c-ae41-27219420c9ef tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:33.768449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0ffba0c7-6866-435c-ae41-27219420c9ef tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:33.775599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ffba0c7-6866-435c-ae41-27219420c9ef tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:33.776426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ffba0c7-6866-435c-ae41-27219420c9ef tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:33.777295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ffba0c7-6866-435c-ae41-27219420c9ef tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:33.778361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ffba0c7-6866-435c-ae41-27219420c9ef tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:33.779037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ffba0c7-6866-435c-ae41-27219420c9ef tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:33.779864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ffba0c7-6866-435c-ae41-27219420c9ef tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.047141 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0ffba0c7-6866-435c-ae41-27219420c9ef tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1644 microversion: 2.1 time: 0.283354 Aug 27 04:56:34.059116 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 675/1299] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:33 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1644 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:34.068836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bd022172-a4f7-45d9-a08c-14fb93160d79 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:34.069905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bd022172-a4f7-45d9-a08c-14fb93160d79 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:34.081088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd022172-a4f7-45d9-a08c-14fb93160d79 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.082460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd022172-a4f7-45d9-a08c-14fb93160d79 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.083698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd022172-a4f7-45d9-a08c-14fb93160d79 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.088901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd022172-a4f7-45d9-a08c-14fb93160d79 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.090216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd022172-a4f7-45d9-a08c-14fb93160d79 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.092244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd022172-a4f7-45d9-a08c-14fb93160d79 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.371024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-18e0a8b2-413f-473b-9d0c-f5529799d7a0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565004e50>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:34.441946 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-18e0a8b2-413f-473b-9d0c-f5529799d7a0 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.074091 Aug 27 04:56:34.442878 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 676/1300] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:34 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:34.842149 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bd022172-a4f7-45d9-a08c-14fb93160d79 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1644 microversion: 2.1 time: 0.776734 Aug 27 04:56:34.843343 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 625/1301] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:34 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1644 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:34.868238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9bf5da2d-263f-45b5-bf79-59916e1ee219 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:34.872761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bf5da2d-263f-45b5-bf79-59916e1ee219 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.873245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bf5da2d-263f-45b5-bf79-59916e1ee219 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.874153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bf5da2d-263f-45b5-bf79-59916e1ee219 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.875570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bf5da2d-263f-45b5-bf79-59916e1ee219 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.876024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bf5da2d-263f-45b5-bf79-59916e1ee219 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.877111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bf5da2d-263f-45b5-bf79-59916e1ee219 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.924173 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9bf5da2d-263f-45b5-bf79-59916e1ee219 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.060968 Aug 27 04:56:34.937065 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 677/1302] 10.222.0.58 () {58 vars in 1176 bytes} [Sat Aug 27 04:56:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:56:34.949189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fbb0ae3e-3f36-433f-8bf4-f065c4e336b1 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:34.949958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fbb0ae3e-3f36-433f-8bf4-f065c4e336b1 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:34.956639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb0ae3e-3f36-433f-8bf4-f065c4e336b1 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.957794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb0ae3e-3f36-433f-8bf4-f065c4e336b1 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.958460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb0ae3e-3f36-433f-8bf4-f065c4e336b1 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.959450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb0ae3e-3f36-433f-8bf4-f065c4e336b1 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.960127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb0ae3e-3f36-433f-8bf4-f065c4e336b1 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.960791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb0ae3e-3f36-433f-8bf4-f065c4e336b1 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:35.057689 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fbb0ae3e-3f36-433f-8bf4-f065c4e336b1 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1/action" status: 202 len: 0 microversion: 2.1 time: 0.112139 Aug 27 04:56:35.059555 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 626/1303] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:34 2022] POST /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:56:35.075694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e7134f08-867a-425c-a9cb-e5395cd73f0c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:35.087394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e7134f08-867a-425c-a9cb-e5395cd73f0c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:35.108180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7134f08-867a-425c-a9cb-e5395cd73f0c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:35.109009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7134f08-867a-425c-a9cb-e5395cd73f0c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:35.113754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7134f08-867a-425c-a9cb-e5395cd73f0c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:35.114680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7134f08-867a-425c-a9cb-e5395cd73f0c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:35.115793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7134f08-867a-425c-a9cb-e5395cd73f0c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:35.116752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7134f08-867a-425c-a9cb-e5395cd73f0c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:35.334833 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e7134f08-867a-425c-a9cb-e5395cd73f0c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1649 microversion: 2.1 time: 0.271091 Aug 27 04:56:35.335450 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 678/1304] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:35 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1649 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:35.459301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0e029cea-e4dc-4e2a-8258-64e63a52c518 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5651b53a0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:35.541798 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0e029cea-e4dc-4e2a-8258-64e63a52c518 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1452 microversion: 2.1 time: 0.088092 Aug 27 04:56:35.542361 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 627/1305] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:35 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:36.224603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-158ed6a9-10b7-420d-ac95-e0811443da70 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:36.228576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158ed6a9-10b7-420d-ac95-e0811443da70 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.229137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158ed6a9-10b7-420d-ac95-e0811443da70 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.229643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158ed6a9-10b7-420d-ac95-e0811443da70 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.230449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158ed6a9-10b7-420d-ac95-e0811443da70 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.230969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158ed6a9-10b7-420d-ac95-e0811443da70 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.231488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158ed6a9-10b7-420d-ac95-e0811443da70 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.257009 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-158ed6a9-10b7-420d-ac95-e0811443da70 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.180215 Aug 27 04:56:36.257712 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 679/1306] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 04:56:36 2022] GET /compute/v2.1/os-services => generated 949 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:36.271923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-23d522e3-b237-4a12-9a90-27491a199a76 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:36.275956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23d522e3-b237-4a12-9a90-27491a199a76 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.276450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23d522e3-b237-4a12-9a90-27491a199a76 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.276951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23d522e3-b237-4a12-9a90-27491a199a76 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.277759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23d522e3-b237-4a12-9a90-27491a199a76 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.278401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23d522e3-b237-4a12-9a90-27491a199a76 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.278831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23d522e3-b237-4a12-9a90-27491a199a76 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.303071 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-23d522e3-b237-4a12-9a90-27491a199a76 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-820368-35" status: 200 len: 581 microversion: 2.1 time: 0.036228 Aug 27 04:56:36.303881 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 628/1307] 10.222.0.58 () {58 vars in 1174 bytes} [Sat Aug 27 04:56:36 2022] GET /compute/v2.1/os-services?host=n-d-820368-35 => generated 581 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:36.317433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-700ebe0e-0b49-41bc-b23d-58b7983f83c0 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:36.321053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700ebe0e-0b49-41bc-b23d-58b7983f83c0 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.321534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700ebe0e-0b49-41bc-b23d-58b7983f83c0 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.321976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700ebe0e-0b49-41bc-b23d-58b7983f83c0 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.322761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700ebe0e-0b49-41bc-b23d-58b7983f83c0 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.323254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700ebe0e-0b49-41bc-b23d-58b7983f83c0 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.323682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-700ebe0e-0b49-41bc-b23d-58b7983f83c0 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.356084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17166f3b-c514-4b86-9d6b-f2babfe81773 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:36.356850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-17166f3b-c514-4b86-9d6b-f2babfe81773 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:36.363496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17166f3b-c514-4b86-9d6b-f2babfe81773 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.364190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17166f3b-c514-4b86-9d6b-f2babfe81773 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.364366 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-700ebe0e-0b49-41bc-b23d-58b7983f83c0 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.050908 Aug 27 04:56:36.364957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17166f3b-c514-4b86-9d6b-f2babfe81773 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.365266 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 680/1308] 10.222.0.58 () {58 vars in 1176 bytes} [Sat Aug 27 04:56:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:36.366022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17166f3b-c514-4b86-9d6b-f2babfe81773 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.366486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17166f3b-c514-4b86-9d6b-f2babfe81773 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.366913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17166f3b-c514-4b86-9d6b-f2babfe81773 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.379604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9d90605d-2b13-429c-b861-dbd17173e937 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:36.384804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d90605d-2b13-429c-b861-dbd17173e937 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.385302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d90605d-2b13-429c-b861-dbd17173e937 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.385895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d90605d-2b13-429c-b861-dbd17173e937 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.386648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d90605d-2b13-429c-b861-dbd17173e937 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.387431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d90605d-2b13-429c-b861-dbd17173e937 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.388976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d90605d-2b13-429c-b861-dbd17173e937 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.420496 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9d90605d-2b13-429c-b861-dbd17173e937 tempest-ServicesAdminTestJSON-176597482 tempest-ServicesAdminTestJSON-176597482-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.045751 Aug 27 04:56:36.421120 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 681/1309] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 04:56:36 2022] GET /compute/v2.1/os-services => generated 949 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:56:36.514332 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-17166f3b-c514-4b86-9d6b-f2babfe81773 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1629 microversion: 2.1 time: 0.161820 Aug 27 04:56:36.515279 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 629/1310] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:36 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1629 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:36.535630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7a673ed3-7577-4e54-965c-04585d9a8aa9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-820368-35", "block_migration": true, "disk_over_commit": false}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:36.538668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7a673ed3-7577-4e54-965c-04585d9a8aa9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:36.544747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a673ed3-7577-4e54-965c-04585d9a8aa9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.545845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a673ed3-7577-4e54-965c-04585d9a8aa9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.546743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a673ed3-7577-4e54-965c-04585d9a8aa9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.547906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a673ed3-7577-4e54-965c-04585d9a8aa9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.548688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a673ed3-7577-4e54-965c-04585d9a8aa9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.549265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a673ed3-7577-4e54-965c-04585d9a8aa9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.558947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-595fd0c6-7cd6-47c1-8b7a-d83b125aa41d tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5651b5c10>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:36.578517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-7a673ed3-7577-4e54-965c-04585d9a8aa9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lazy-loading 'flavor' on Instance uuid 5b37de1a-3cba-44f1-b297-7031a8831ce1 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:36.593001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7a673ed3-7577-4e54-965c-04585d9a8aa9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Going to try to live migrate instance to n-h2-820368-35 {{(pid=128547) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:56:36.644670 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-595fd0c6-7cd6-47c1-8b7a-d83b125aa41d tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1461 microversion: 2.1 time: 0.091135 Aug 27 04:56:36.651292 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 630/1311] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:36 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1461 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:36.659035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d15c9656-0af8-4607-b06b-880eb6445d3a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fabaf0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:36.736811 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d15c9656-0af8-4607-b06b-880eb6445d3a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 200 len: 1461 microversion: 2.1 time: 0.081578 Aug 27 04:56:36.745996 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 631/1312] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:36 2022] GET /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:36.751303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b2994a7d-8b63-43f7-8148-b9eea5021872 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:36.752150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b2994a7d-8b63-43f7-8148-b9eea5021872 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:36.759450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2994a7d-8b63-43f7-8148-b9eea5021872 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.760317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2994a7d-8b63-43f7-8148-b9eea5021872 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.760991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2994a7d-8b63-43f7-8148-b9eea5021872 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.761920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2994a7d-8b63-43f7-8148-b9eea5021872 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.762532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2994a7d-8b63-43f7-8148-b9eea5021872 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.763133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2994a7d-8b63-43f7-8148-b9eea5021872 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.917909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b2994a7d-8b63-43f7-8148-b9eea5021872 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:36.928728 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b2994a7d-8b63-43f7-8148-b9eea5021872 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1467 microversion: 2.1 time: 0.181368 Aug 27 04:56:36.931131 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 632/1313] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:36 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1467 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:36.950623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5dc70481-6bee-4340-94e7-545e8f97f75b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1786521446"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:36.953233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5dc70481-6bee-4340-94e7-545e8f97f75b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:36.963122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc70481-6bee-4340-94e7-545e8f97f75b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.963618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc70481-6bee-4340-94e7-545e8f97f75b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.964051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc70481-6bee-4340-94e7-545e8f97f75b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.969028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc70481-6bee-4340-94e7-545e8f97f75b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.969637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc70481-6bee-4340-94e7-545e8f97f75b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.970518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc70481-6bee-4340-94e7-545e8f97f75b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:37.309704 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5dc70481-6bee-4340-94e7-545e8f97f75b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "POST /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738/action" status: 202 len: 0 microversion: 2.1 time: 0.360515 Aug 27 04:56:37.311963 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 633/1314] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:36 2022] POST /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:56:37.337650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b24c688-69fe-4420-adc0-f5cb2d5a3927 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650054c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:37.414972 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2b24c688-69fe-4420-adc0-f5cb2d5a3927 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.092479 Aug 27 04:56:37.419804 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 634/1315] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:37 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:38.213761 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7a673ed3-7577-4e54-965c-04585d9a8aa9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1/action" status: 202 len: 0 microversion: 2.1 time: 1.681990 Aug 27 04:56:38.215054 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 682/1316] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:36 2022] POST /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1/action => generated 0 bytes in 1684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:56:38.224546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b4bfa53-b609-40b0-a11b-d4aeed7e53c1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:38.225411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2b4bfa53-b609-40b0-a11b-d4aeed7e53c1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:38.233461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bfa53-b609-40b0-a11b-d4aeed7e53c1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:38.233949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bfa53-b609-40b0-a11b-d4aeed7e53c1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:38.235313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bfa53-b609-40b0-a11b-d4aeed7e53c1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:38.236194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bfa53-b609-40b0-a11b-d4aeed7e53c1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:38.236845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bfa53-b609-40b0-a11b-d4aeed7e53c1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:38.237453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b4bfa53-b609-40b0-a11b-d4aeed7e53c1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:38.437632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b503c152-00c7-448a-82e9-0f0e3cc1095e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565004790>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:38.443962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2b4bfa53-b609-40b0-a11b-d4aeed7e53c1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:38.454335 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2b4bfa53-b609-40b0-a11b-d4aeed7e53c1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1501 microversion: 2.1 time: 0.234828 Aug 27 04:56:38.457217 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 635/1317] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:38 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1501 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:38.809295 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b503c152-00c7-448a-82e9-0f0e3cc1095e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.379025 Aug 27 04:56:38.810213 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 683/1318] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:38 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:39.154343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d1fde9fe-ce17-4f57-b5e0-ec5426ea5cf7 req-d0e036af-634d-4959-a971-10d32571f317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb8d618-f311-4f64-825c-f1816fe41876", "name": "network-vif-unplugged", "status": "completed", "tag": "35ed7764-fd62-4b34-a259-e6ca2280e1f2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:39.180477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d1fde9fe-ce17-4f57-b5e0-ec5426ea5cf7 req-d0e036af-634d-4959-a971-10d32571f317 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:39.181638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d1fde9fe-ce17-4f57-b5e0-ec5426ea5cf7 req-d0e036af-634d-4959-a971-10d32571f317 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:39.182911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d1fde9fe-ce17-4f57-b5e0-ec5426ea5cf7 req-d0e036af-634d-4959-a971-10d32571f317 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:39.208389 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d1fde9fe-ce17-4f57-b5e0-ec5426ea5cf7 req-d0e036af-634d-4959-a971-10d32571f317 service nova] Creating event network-vif-unplugged:35ed7764-fd62-4b34-a259-e6ca2280e1f2 for instance 0fb8d618-f311-4f64-825c-f1816fe41876 on n-h2-820368-35 Aug 27 04:56:39.213924 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d1fde9fe-ce17-4f57-b5e0-ec5426ea5cf7 req-d0e036af-634d-4959-a971-10d32571f317 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064426 Aug 27 04:56:39.215135 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 636/1319] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:39.477782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3eefa3f4-f634-41aa-889c-982e50716f38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:39.478431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3eefa3f4-f634-41aa-889c-982e50716f38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:39.493571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eefa3f4-f634-41aa-889c-982e50716f38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:39.494236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eefa3f4-f634-41aa-889c-982e50716f38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:39.494684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eefa3f4-f634-41aa-889c-982e50716f38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:39.495498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eefa3f4-f634-41aa-889c-982e50716f38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:39.495998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eefa3f4-f634-41aa-889c-982e50716f38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:39.496431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eefa3f4-f634-41aa-889c-982e50716f38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:39.828339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b1f7c163-8f59-4c5b-a8c8-3afdb5170d5f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fab9d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:39.863287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3eefa3f4-f634-41aa-889c-982e50716f38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:39.877884 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3eefa3f4-f634-41aa-889c-982e50716f38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1501 microversion: 2.1 time: 0.402292 Aug 27 04:56:39.883719 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 684/1320] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:39 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1501 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:39.891830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b1f7c163-8f59-4c5b-a8c8-3afdb5170d5f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.070247 Aug 27 04:56:39.892407 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 637/1321] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:39 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:40.112014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-79a38c2b-0262-4fe5-ad94-13b127cc60a1 req-77c6c204-f04f-4c05-9bde-ace5169fe4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b37de1a-3cba-44f1-b297-7031a8831ce1", "name": "network-vif-unplugged", "status": "completed", "tag": "5e0e371f-d224-460c-af4d-acb183057d97"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:40.125571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-79a38c2b-0262-4fe5-ad94-13b127cc60a1 req-77c6c204-f04f-4c05-9bde-ace5169fe4aa service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:40.126937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-79a38c2b-0262-4fe5-ad94-13b127cc60a1 req-77c6c204-f04f-4c05-9bde-ace5169fe4aa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:40.127953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-79a38c2b-0262-4fe5-ad94-13b127cc60a1 req-77c6c204-f04f-4c05-9bde-ace5169fe4aa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:40.141830 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-79a38c2b-0262-4fe5-ad94-13b127cc60a1 req-77c6c204-f04f-4c05-9bde-ace5169fe4aa service nova] Creating event network-vif-unplugged:5e0e371f-d224-460c-af4d-acb183057d97 for instance 5b37de1a-3cba-44f1-b297-7031a8831ce1 on n-h1-820368-35 Aug 27 04:56:40.148492 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-79a38c2b-0262-4fe5-ad94-13b127cc60a1 req-77c6c204-f04f-4c05-9bde-ace5169fe4aa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041443 Aug 27 04:56:40.149878 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 685/1322] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:40.914433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fd3a25cb-d552-4b2b-9ae1-a1867e191dbc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565037a60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:40.915173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b558f599-164b-4ef5-b3b8-32e33eaa0243 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:40.917119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b558f599-164b-4ef5-b3b8-32e33eaa0243 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:40.931880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b558f599-164b-4ef5-b3b8-32e33eaa0243 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:40.933922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b558f599-164b-4ef5-b3b8-32e33eaa0243 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:40.934829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b558f599-164b-4ef5-b3b8-32e33eaa0243 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:40.935881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b558f599-164b-4ef5-b3b8-32e33eaa0243 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:40.936490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b558f599-164b-4ef5-b3b8-32e33eaa0243 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:40.937073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b558f599-164b-4ef5-b3b8-32e33eaa0243 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:40.988329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:40.991342 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fd3a25cb-d552-4b2b-9ae1-a1867e191dbc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.088977 Aug 27 04:56:40.993950 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 686/1323] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:40 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:41.151624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b558f599-164b-4ef5-b3b8-32e33eaa0243 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:41.163334 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b558f599-164b-4ef5-b3b8-32e33eaa0243 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1501 microversion: 2.1 time: 0.265130 Aug 27 04:56:41.178806 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 638/1324] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:40 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1501 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:42.010735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ddb35eaf-76d4-4389-b812-b94d25fc1b25 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fff430>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:42.080146 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ddb35eaf-76d4-4389-b812-b94d25fc1b25 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.074819 Aug 27 04:56:42.096663 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 687/1325] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:42 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:42.178299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-67d981c3-aea6-4a43-8cd7-5110c81e8e4b req-e435adb0-fe8b-49c4-a5b8-c7e892ca0b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b37de1a-3cba-44f1-b297-7031a8831ce1", "tag": "5e0e371f-d224-460c-af4d-acb183057d97"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:42.187865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-768ce603-1371-43aa-ab87-6204e4d58326 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:42.188597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-768ce603-1371-43aa-ab87-6204e4d58326 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:42.198820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-67d981c3-aea6-4a43-8cd7-5110c81e8e4b req-e435adb0-fe8b-49c4-a5b8-c7e892ca0b83 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:42.198993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-768ce603-1371-43aa-ab87-6204e4d58326 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:42.199763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-67d981c3-aea6-4a43-8cd7-5110c81e8e4b req-e435adb0-fe8b-49c4-a5b8-c7e892ca0b83 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:42.200580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-67d981c3-aea6-4a43-8cd7-5110c81e8e4b req-e435adb0-fe8b-49c4-a5b8-c7e892ca0b83 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:42.207781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-768ce603-1371-43aa-ab87-6204e4d58326 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:42.208489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-768ce603-1371-43aa-ab87-6204e4d58326 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:42.209414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-768ce603-1371-43aa-ab87-6204e4d58326 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:42.210042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-768ce603-1371-43aa-ab87-6204e4d58326 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:42.210624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-768ce603-1371-43aa-ab87-6204e4d58326 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:42.218408 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-67d981c3-aea6-4a43-8cd7-5110c81e8e4b req-e435adb0-fe8b-49c4-a5b8-c7e892ca0b83 service nova] Creating event network-changed:5e0e371f-d224-460c-af4d-acb183057d97 for instance 5b37de1a-3cba-44f1-b297-7031a8831ce1 on n-h1-820368-35 Aug 27 04:56:42.225385 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-67d981c3-aea6-4a43-8cd7-5110c81e8e4b req-e435adb0-fe8b-49c4-a5b8-c7e892ca0b83 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052227 Aug 27 04:56:42.227538 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 639/1326] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:42.535438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-768ce603-1371-43aa-ab87-6204e4d58326 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:42.549641 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-768ce603-1371-43aa-ab87-6204e4d58326 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1501 microversion: 2.1 time: 0.364089 Aug 27 04:56:42.554596 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 688/1327] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:42 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1501 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:43.103857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8777f949-409b-40eb-b5de-a18a4e7deb88 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fabf70>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:43.194644 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8777f949-409b-40eb-b5de-a18a4e7deb88 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.095903 Aug 27 04:56:43.197911 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 640/1328] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:43 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:43.582439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c205196f-3eda-4f72-be40-00487cc55466 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:43.583072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c205196f-3eda-4f72-be40-00487cc55466 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:43.599907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c205196f-3eda-4f72-be40-00487cc55466 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:43.600724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c205196f-3eda-4f72-be40-00487cc55466 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:43.601193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c205196f-3eda-4f72-be40-00487cc55466 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:43.604027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c205196f-3eda-4f72-be40-00487cc55466 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:43.605466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c205196f-3eda-4f72-be40-00487cc55466 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:43.606113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c205196f-3eda-4f72-be40-00487cc55466 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:44.213866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd337496-bbc4-466c-adcb-5674c68920d1 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565191430>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:44.234276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c205196f-3eda-4f72-be40-00487cc55466 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:44.244028 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c205196f-3eda-4f72-be40-00487cc55466 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1501 microversion: 2.1 time: 0.672919 Aug 27 04:56:44.244623 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 689/1329] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:43 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1501 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:44.320445 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd337496-bbc4-466c-adcb-5674c68920d1 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.112195 Aug 27 04:56:44.328454 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 641/1330] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:44 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:44.809991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-6939d179-7342-437f-81ff-6bb677f82560 req-6357649a-2f1a-4ab2-a05f-2cdb1c4f3cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd002ec2-35f3-43fb-b976-ecb02f1b7738", "name": "network-vif-plugged", "status": "completed", "tag": "4783370e-a485-40e1-8ea2-5a10e13b0d87"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:44.829340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6939d179-7342-437f-81ff-6bb677f82560 req-6357649a-2f1a-4ab2-a05f-2cdb1c4f3cca service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:44.833697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6939d179-7342-437f-81ff-6bb677f82560 req-6357649a-2f1a-4ab2-a05f-2cdb1c4f3cca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:44.834468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6939d179-7342-437f-81ff-6bb677f82560 req-6357649a-2f1a-4ab2-a05f-2cdb1c4f3cca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:44.860356 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-6939d179-7342-437f-81ff-6bb677f82560 req-6357649a-2f1a-4ab2-a05f-2cdb1c4f3cca service nova] Creating event network-vif-plugged:4783370e-a485-40e1-8ea2-5a10e13b0d87 for instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 on n-h1-820368-35 Aug 27 04:56:44.878253 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-6939d179-7342-437f-81ff-6bb677f82560 req-6357649a-2f1a-4ab2-a05f-2cdb1c4f3cca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074112 Aug 27 04:56:44.881984 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 690/1331] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:45.270892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-346f034c-0396-4945-9fdf-7a09b818f17f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:45.271719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-346f034c-0396-4945-9fdf-7a09b818f17f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:45.279726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-346f034c-0396-4945-9fdf-7a09b818f17f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:45.280580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-346f034c-0396-4945-9fdf-7a09b818f17f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:45.281171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-346f034c-0396-4945-9fdf-7a09b818f17f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:45.282117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-346f034c-0396-4945-9fdf-7a09b818f17f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:45.282643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-346f034c-0396-4945-9fdf-7a09b818f17f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:45.283298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-346f034c-0396-4945-9fdf-7a09b818f17f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:45.335966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b843d279-a32a-4fc5-97f9-42f145cc734a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fff310>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:45.427281 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b843d279-a32a-4fc5-97f9-42f145cc734a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.095436 Aug 27 04:56:45.429371 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 691/1332] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:45 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:45.553564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-346f034c-0396-4945-9fdf-7a09b818f17f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:45.561695 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-346f034c-0396-4945-9fdf-7a09b818f17f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1501 microversion: 2.1 time: 0.296350 Aug 27 04:56:45.562577 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 642/1333] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:45 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1501 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:46.443517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:46.449776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2ce68f61-52b7-4b9d-884c-fc22c80b44a1 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650919d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:46.535891 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2ce68f61-52b7-4b9d-884c-fc22c80b44a1 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.094896 Aug 27 04:56:46.537272 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 692/1334] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:46 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:46.591860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-79d013e0-e2f1-45ac-90b6-d4a9082ec461 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:46.594233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-79d013e0-e2f1-45ac-90b6-d4a9082ec461 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:46.611369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:46.615527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d013e0-e2f1-45ac-90b6-d4a9082ec461 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:46.616692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d013e0-e2f1-45ac-90b6-d4a9082ec461 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:46.617474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d013e0-e2f1-45ac-90b6-d4a9082ec461 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:46.618573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d013e0-e2f1-45ac-90b6-d4a9082ec461 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:46.619837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d013e0-e2f1-45ac-90b6-d4a9082ec461 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:46.621385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d013e0-e2f1-45ac-90b6-d4a9082ec461 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:46.889677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-79d013e0-e2f1-45ac-90b6-d4a9082ec461 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:46.899053 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-79d013e0-e2f1-45ac-90b6-d4a9082ec461 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1501 microversion: 2.1 time: 0.315267 Aug 27 04:56:46.913274 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 643/1335] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:46 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1501 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:47.554109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-771eed37-264a-48a6-b8f1-853f3fe8da00 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650ae160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:47.621948 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-771eed37-264a-48a6-b8f1-853f3fe8da00 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.074189 Aug 27 04:56:47.623407 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 693/1336] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:47 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:47.921533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab8123da-9705-4710-afd2-bf32100e8095 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:47.922245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ab8123da-9705-4710-afd2-bf32100e8095 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:47.929244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab8123da-9705-4710-afd2-bf32100e8095 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:47.929810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab8123da-9705-4710-afd2-bf32100e8095 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:47.930309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab8123da-9705-4710-afd2-bf32100e8095 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:47.931496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab8123da-9705-4710-afd2-bf32100e8095 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:47.932127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab8123da-9705-4710-afd2-bf32100e8095 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:47.932703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab8123da-9705-4710-afd2-bf32100e8095 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:48.142144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ab8123da-9705-4710-afd2-bf32100e8095 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:48.155301 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ab8123da-9705-4710-afd2-bf32100e8095 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1501 microversion: 2.1 time: 0.237885 Aug 27 04:56:48.156110 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 644/1337] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:47 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1501 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:48.638774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2f825fd0-48fc-436e-b5b0-2e3f9a8a6097 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56503f820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:48.725653 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2f825fd0-48fc-436e-b5b0-2e3f9a8a6097 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.090641 Aug 27 04:56:48.727204 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 694/1338] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:48 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:49.177542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9079f17-bf47-4d74-8802-7af9a56c5325 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:49.178807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9079f17-bf47-4d74-8802-7af9a56c5325 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:49.196989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9079f17-bf47-4d74-8802-7af9a56c5325 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:49.199611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9079f17-bf47-4d74-8802-7af9a56c5325 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:49.201534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9079f17-bf47-4d74-8802-7af9a56c5325 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:49.205011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9079f17-bf47-4d74-8802-7af9a56c5325 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:49.206180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9079f17-bf47-4d74-8802-7af9a56c5325 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:49.206826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9079f17-bf47-4d74-8802-7af9a56c5325 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:49.702609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f9079f17-bf47-4d74-8802-7af9a56c5325 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:49.728131 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9079f17-bf47-4d74-8802-7af9a56c5325 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1501 microversion: 2.1 time: 0.555750 Aug 27 04:56:49.729990 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 645/1339] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:49 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1501 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:49.751372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a00f6cb2-5f3b-49ee-a9a3-61b188db040d tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650a4af0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:50.763481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-66af849a-b16a-4f8b-a639-34f89966038d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:50.764118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-66af849a-b16a-4f8b-a639-34f89966038d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:50.795416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66af849a-b16a-4f8b-a639-34f89966038d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:50.797140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66af849a-b16a-4f8b-a639-34f89966038d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:50.799008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66af849a-b16a-4f8b-a639-34f89966038d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:50.818014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66af849a-b16a-4f8b-a639-34f89966038d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:50.820005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66af849a-b16a-4f8b-a639-34f89966038d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:50.820453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66af849a-b16a-4f8b-a639-34f89966038d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:50.906572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a00f6cb2-5f3b-49ee-a9a3-61b188db040d tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 1.161570 Aug 27 04:56:50.921447 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 695/1340] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:49 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:51.363275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66af849a-b16a-4f8b-a639-34f89966038d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:51.373759 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-66af849a-b16a-4f8b-a639-34f89966038d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1476 microversion: 2.1 time: 0.623428 Aug 27 04:56:51.380218 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 646/1341] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:50 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1476 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:51.400830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6d300f67-1b7f-4218-8ce0-59fe093228c9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '.version_select at 0x7fb56503f9d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:51.408888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d300f67-1b7f-4218-8ce0-59fe093228c9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:51.409423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d300f67-1b7f-4218-8ce0-59fe093228c9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:51.409883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d300f67-1b7f-4218-8ce0-59fe093228c9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:51.447610 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6d300f67-1b7f-4218-8ce0-59fe093228c9 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.050807 Aug 27 04:56:51.452797 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 696/1342] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 04:56:51 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:51.465659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-212154c3-df34-4154-b017-dcd68a1cbc9e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:51.466527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-212154c3-df34-4154-b017-dcd68a1cbc9e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:51.473524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212154c3-df34-4154-b017-dcd68a1cbc9e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:51.474268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212154c3-df34-4154-b017-dcd68a1cbc9e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:51.474854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212154c3-df34-4154-b017-dcd68a1cbc9e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:51.475764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212154c3-df34-4154-b017-dcd68a1cbc9e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:51.476408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212154c3-df34-4154-b017-dcd68a1cbc9e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:51.476998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212154c3-df34-4154-b017-dcd68a1cbc9e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:51.691167 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-212154c3-df34-4154-b017-dcd68a1cbc9e tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1629 microversion: 2.1 time: 0.210698 Aug 27 04:56:51.697105 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 647/1343] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:51 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1629 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:51.726630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d820510-b3ff-42e4-a271-a5d4d41f873d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Action: 'create', calling method: .version_select at 0x7fb5650ae280>, body: {"keypair": {"name": "tempest-keypair-241873685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVObCRvupXptkGF7HJdFQR6fvtTv2f8dDiW8SXEMsP2G5wDjAgMwrIp2QWzz2ZO9AEgt7o6bRRxO5CrSRN+XuIVw0+F16dpvNQyOka1znJeJojesDP0Fi+XVXZZcDN/sA=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:51.741900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:51.764672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5d820510-b3ff-42e4-a271-a5d4d41f873d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Getting quotas for project dd2736d36f16463c81a760e69e48fd28. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:56:51.810151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fa0214c2-997b-4124-a5fc-f793662cd8c0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:51.811163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fa0214c2-997b-4124-a5fc-f793662cd8c0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:51.819841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5d820510-b3ff-42e4-a271-a5d4d41f873d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Getting quotas for user 17c08abee58846229f9255f8d86f762a and project dd2736d36f16463c81a760e69e48fd28. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:56:51.822582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa0214c2-997b-4124-a5fc-f793662cd8c0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:51.824635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa0214c2-997b-4124-a5fc-f793662cd8c0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:51.826047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa0214c2-997b-4124-a5fc-f793662cd8c0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:51.829797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa0214c2-997b-4124-a5fc-f793662cd8c0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:51.830484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa0214c2-997b-4124-a5fc-f793662cd8c0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:51.831161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa0214c2-997b-4124-a5fc-f793662cd8c0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:51.876060 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d820510-b3ff-42e4-a271-a5d4d41f873d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153506 Aug 27 04:56:51.877163 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 697/1344] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 04:56:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:51.880409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fa0214c2-997b-4124-a5fc-f793662cd8c0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:56:51.922485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5e45cb68-8187-47ee-b94a-dcee7043e4e9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56509f9d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:52.144602 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fa0214c2-997b-4124-a5fc-f793662cd8c0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 204 len: 0 microversion: 2.1 time: 0.348180 Aug 27 04:56:52.149526 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 648/1345] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:56:51 2022] DELETE /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:56:52.166609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-068d547e-72e6-4c6d-bc90-b916ccea8404 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:52.169610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-068d547e-72e6-4c6d-bc90-b916ccea8404 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:52.198269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068d547e-72e6-4c6d-bc90-b916ccea8404 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:52.198911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068d547e-72e6-4c6d-bc90-b916ccea8404 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:52.202431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068d547e-72e6-4c6d-bc90-b916ccea8404 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:52.205086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068d547e-72e6-4c6d-bc90-b916ccea8404 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:52.206780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068d547e-72e6-4c6d-bc90-b916ccea8404 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:52.207267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068d547e-72e6-4c6d-bc90-b916ccea8404 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:52.585160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-068d547e-72e6-4c6d-bc90-b916ccea8404 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:52.605281 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-068d547e-72e6-4c6d-bc90-b916ccea8404 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1712 microversion: 2.1 time: 0.450936 Aug 27 04:56:52.616224 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 649/1346] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:52 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1712 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:53.485760 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5e45cb68-8187-47ee-b94a-dcee7043e4e9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 1.567482 Aug 27 04:56:53.486676 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 698/1347] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:51 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:53.642098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d692928-14cb-48d6-b904-af2b2377bd1c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:53.642761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d692928-14cb-48d6-b904-af2b2377bd1c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:53.656699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d692928-14cb-48d6-b904-af2b2377bd1c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:53.657631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d692928-14cb-48d6-b904-af2b2377bd1c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:53.658257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d692928-14cb-48d6-b904-af2b2377bd1c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:53.660055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d692928-14cb-48d6-b904-af2b2377bd1c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:53.660688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d692928-14cb-48d6-b904-af2b2377bd1c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:53.662530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d692928-14cb-48d6-b904-af2b2377bd1c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:53.988276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d692928-14cb-48d6-b904-af2b2377bd1c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:54.000911 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d692928-14cb-48d6-b904-af2b2377bd1c tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1712 microversion: 2.1 time: 0.362716 Aug 27 04:56:54.003905 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 650/1348] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:53 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1712 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:54.517471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-186d2c8b-a878-4cbc-820b-1e6c5786f9aa tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565004160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:54.562855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2389bd30-8bd6-43e4-ab3c-25e7b8728e67 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:54.563868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2389bd30-8bd6-43e4-ab3c-25e7b8728e67 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:54.577258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2389bd30-8bd6-43e4-ab3c-25e7b8728e67 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:54.577968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2389bd30-8bd6-43e4-ab3c-25e7b8728e67 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:54.578603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2389bd30-8bd6-43e4-ab3c-25e7b8728e67 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:54.579527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2389bd30-8bd6-43e4-ab3c-25e7b8728e67 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:54.580149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2389bd30-8bd6-43e4-ab3c-25e7b8728e67 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:54.585175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2389bd30-8bd6-43e4-ab3c-25e7b8728e67 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:54.602925 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-186d2c8b-a878-4cbc-820b-1e6c5786f9aa tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.105275 Aug 27 04:56:54.604052 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 699/1349] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:54 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:55.023670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-78e9dc62-32da-491f-8d52-8faeb1d88b72 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:55.024738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-78e9dc62-32da-491f-8d52-8faeb1d88b72 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:55.037973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78e9dc62-32da-491f-8d52-8faeb1d88b72 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:55.045359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78e9dc62-32da-491f-8d52-8faeb1d88b72 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:55.046364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78e9dc62-32da-491f-8d52-8faeb1d88b72 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:55.048190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78e9dc62-32da-491f-8d52-8faeb1d88b72 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:55.053047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78e9dc62-32da-491f-8d52-8faeb1d88b72 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:55.053863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78e9dc62-32da-491f-8d52-8faeb1d88b72 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:56.057773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-78e9dc62-32da-491f-8d52-8faeb1d88b72 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:56.066795 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-78e9dc62-32da-491f-8d52-8faeb1d88b72 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1645 microversion: 2.1 time: 1.047081 Aug 27 04:56:56.071986 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 700/1350] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:55 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1645 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:56.092314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-47935e3f-0409-40d5-9947-ab09b4b05ab3 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fff8b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:56.209034 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-47935e3f-0409-40d5-9947-ab09b4b05ab3 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.135409 Aug 27 04:56:56.210459 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 701/1351] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:56 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:57.032879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-2389bd30-8bd6-43e4-ab3c-25e7b8728e67 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid 71c927e5-5b82-4fd6-8538-fe5456c92f9f {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:57.095680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-62f64867-4231-4073-a0b1-eaa641a60140 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:57.097237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-62f64867-4231-4073-a0b1-eaa641a60140 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:57.103642 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2389bd30-8bd6-43e4-ab3c-25e7b8728e67 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 2345 microversion: 2.25 time: 2.544645 Aug 27 04:56:57.117474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f64867-4231-4073-a0b1-eaa641a60140 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:57.126556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f64867-4231-4073-a0b1-eaa641a60140 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:57.127899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f64867-4231-4073-a0b1-eaa641a60140 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:57.132904 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 651/1352] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:54 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 2345 bytes in 2574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:57.139690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f64867-4231-4073-a0b1-eaa641a60140 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:57.140385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f64867-4231-4073-a0b1-eaa641a60140 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:57.141186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f64867-4231-4073-a0b1-eaa641a60140 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:57.151478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a6622f5-cea9-4026-bf5f-f79e7fa7e280 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:57.169566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a6622f5-cea9-4026-bf5f-f79e7fa7e280 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:57.172001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a6622f5-cea9-4026-bf5f-f79e7fa7e280 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:57.172699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a6622f5-cea9-4026-bf5f-f79e7fa7e280 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:57.175627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a6622f5-cea9-4026-bf5f-f79e7fa7e280 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:57.176295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a6622f5-cea9-4026-bf5f-f79e7fa7e280 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:57.177555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a6622f5-cea9-4026-bf5f-f79e7fa7e280 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:57.220683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:57.265676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:57.299866 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a6622f5-cea9-4026-bf5f-f79e7fa7e280 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.163699 Aug 27 04:56:57.308455 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 652/1353] 10.222.0.58 () {60 vars in 1217 bytes} [Sat Aug 27 04:56:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:56:57.321208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-201f6013-1c1b-4b96-9bd8-114453388786 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f3ee50>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:57.445430 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-201f6013-1c1b-4b96-9bd8-114453388786 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.135270 Aug 27 04:56:57.447164 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 653/1354] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:57 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:57.763662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-62f64867-4231-4073-a0b1-eaa641a60140 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:57.801188 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-62f64867-4231-4073-a0b1-eaa641a60140 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1645 microversion: 2.1 time: 0.709171 Aug 27 04:56:57.807706 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 702/1355] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:57 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1645 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:58.408041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-579257293", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "00de91a4-56de-4dd2-b930-888a9f762ad7"}], "security_groups": [{"name": "tempest-securitygroup--104584363"}], "key_name": "tempest-keypair-241873685", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:58.418765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-e8bb47a2-d992-41ed-9533-e1db2d16202d req-1116d44c-b1dd-467e-ad26-af486b2a9d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dffd03e4-cebb-4c94-a9f9-fc0887472298", "name": "network-vif-deleted", "tag": "db5f8da9-4df5-4598-a365-b238e6e53d2f"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:58.445263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e8bb47a2-d992-41ed-9533-e1db2d16202d req-1116d44c-b1dd-467e-ad26-af486b2a9d0c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:58.445756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e8bb47a2-d992-41ed-9533-e1db2d16202d req-1116d44c-b1dd-467e-ad26-af486b2a9d0c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:58.446197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e8bb47a2-d992-41ed-9533-e1db2d16202d req-1116d44c-b1dd-467e-ad26-af486b2a9d0c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:58.518964 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-e8bb47a2-d992-41ed-9533-e1db2d16202d req-1116d44c-b1dd-467e-ad26-af486b2a9d0c service nova] Creating event network-vif-deleted:db5f8da9-4df5-4598-a365-b238e6e53d2f for instance dffd03e4-cebb-4c94-a9f9-fc0887472298 on n-h2-820368-35 Aug 27 04:56:58.551324 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-e8bb47a2-d992-41ed-9533-e1db2d16202d req-1116d44c-b1dd-467e-ad26-af486b2a9d0c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.797453 Aug 27 04:56:58.552230 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 654/1356] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:56:58.560505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bbd5239c-8355-407f-85e9-8f1076229d4c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fab4c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:58.712055 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bbd5239c-8355-407f-85e9-8f1076229d4c tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.132236 Aug 27 04:56:58.713403 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 655/1357] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:58 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:58.847007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:58.852197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:58.895081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:58.905424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:58.917405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:58.918215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:58.918707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:58.926331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:58.942926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] validate_networks() for [('00de91a4-56de-4dd2-b930-888a9f762ad7', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:56:59.082825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:59.083362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:59.083812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:59.084279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lazy-loading 'fault' on Instance uuid dffd03e4-cebb-4c94-a9f9-fc0887472298 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:59.426120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc99cf572d545be8638aaeb6f59749d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83a0d500b9c445ea02dc63360a3c4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:59.437471 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-86b076b5-3ad1-42bc-8fa6-6dfa4c128260 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 200 len: 1353 microversion: 2.1 time: 0.611641 Aug 27 04:56:59.439330 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 656/1358] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:58 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 1353 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:59.729987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f21be7b-c332-4353-a05b-62566ebcde01 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565191430>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:59.821997 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f21be7b-c332-4353-a05b-62566ebcde01 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.096356 Aug 27 04:56:59.823114 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 657/1359] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:59 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:00.461966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:00.462512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:00.479831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:00.480868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:00.484301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.486182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:00.489755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:00.490795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.516947 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] HTTP exception thrown: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Request method failure captured: Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 HTTP/1.1 Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLnUl3dJWZjPacPM0CLiCYx-EmD-vTs1w6nAWFX90zUEp-Ll9k5lKTm8lU01q1gqOj_auXDQs3sKxqOhDNvGRFtJG2nuZfRoQJrjipbjsFTyUcc42LeQG22lX8NG4sveknwR4eRUn7VjeyexdxLYHPu_o1rVjxd-1tMYBG6Gh3gfIM Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:00.519521 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c83a0d500b9c445ea02dc63360a3c4cf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ddc99cf572d545be8638aaeb6f59749d Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:00.521296 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'dffd03e4-cebb-4c94-a9f9-fc0887472298'} Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:00.522257 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:00.524434 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.532197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Returning 404 to user: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:00.538730 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7af8a3d8-2e95-41b8-b037-ac1aa88f5327 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 404 len: 111 microversion: 2.1 time: 0.079968 Aug 27 04:57:00.544083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:57:00.544519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:57:00.545127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:57:00.545765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:57:00.546439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:57:00.553623 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 658/1360] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:00 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:57:00.563117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:00.565859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:00.589743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:00.590982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:00.591519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:00.591970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.596608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:00.597483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.598654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:00.599397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:00.600101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.600726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:00.601462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:00.602143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.640506 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] HTTP exception thrown: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Request method failure captured: Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 HTTP/1.1 Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLnUl3dJWZjPacPM0CLiCYx-EmD-vTs1w6nAWFX90zUEp-Ll9k5lKTm8lU01q1gqOj_auXDQs3sKxqOhDNvGRFtJG2nuZfRoQJrjipbjsFTyUcc42LeQG22lX8NG4sveknwR4eRUn7VjeyexdxLYHPu_o1rVjxd-1tMYBG6Gh3gfIM Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:00.642758 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c83a0d500b9c445ea02dc63360a3c4cf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ddc99cf572d545be8638aaeb6f59749d Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:00.644211 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '8582438a-00e8-41b1-8aeb-662d153b4983'} Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:00.644981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:00.646219 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.648989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Returning 404 to user: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:00.648989 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9dbbd12f-d98b-4738-a9e2-23269c9d044a tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 404 len: 111 microversion: 2.1 time: 0.088491 Aug 27 04:57:00.648989 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 659/1361] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:57:00 2022] DELETE /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:00.673636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:00.680430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:00.701951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Getting quotas for project dd2736d36f16463c81a760e69e48fd28. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:57:00.703042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:00.706262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:00.707043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.710323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:00.712043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:00.714673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.728751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Getting quotas for user 17c08abee58846229f9255f8d86f762a and project dd2736d36f16463c81a760e69e48fd28. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:57:00.746712 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] HTTP exception thrown: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Request method failure captured: Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 HTTP/1.1 Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLnUl3dJWZjPacPM0CLiCYx-EmD-vTs1w6nAWFX90zUEp-Ll9k5lKTm8lU01q1gqOj_auXDQs3sKxqOhDNvGRFtJG2nuZfRoQJrjipbjsFTyUcc42LeQG22lX8NG4sveknwR4eRUn7VjeyexdxLYHPu_o1rVjxd-1tMYBG6Gh3gfIM Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:00.749695 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c83a0d500b9c445ea02dc63360a3c4cf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ddc99cf572d545be8638aaeb6f59749d Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:00.751436 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '8582438a-00e8-41b1-8aeb-662d153b4983'} Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:00.752925 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:00.754441 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:00.760775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Returning 404 to user: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:00.761969 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-19ffcb9a-99c7-429a-b432-232ff18d8554 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 404 len: 111 microversion: 2.1 time: 0.110885 Aug 27 04:57:00.765995 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 660/1362] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:00 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:00.767511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:57:00.770084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:57:00.779267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f354639-16fe-424d-97e4-830e2c7d4bc0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '.version_select at 0x7fb56500b700>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:00.820730 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f354639-16fe-424d-97e4-830e2c7d4bc0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341876475" status: 202 len: 0 microversion: 2.1 time: 0.052633 Aug 27 04:57:00.842523 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 661/1363] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 04:57:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341876475 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:00.893407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b1f81b93-c203-4912-a3dc-853f81004608 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f67b80>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:00.948795 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-601384d7-bd7b-4274-bfd4-339ed6bde7eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.544229 Aug 27 04:57:00.952993 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 703/1364] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:56:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 2550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:57:00.969317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dcdcccba-7957-4bab-833a-5f26d0568fde tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:00.970406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dcdcccba-7957-4bab-833a-5f26d0568fde tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:01.037780 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b1f81b93-c203-4912-a3dc-853f81004608 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.190587 Aug 27 04:57:01.047052 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 662/1365] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:00 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:01.053177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9ed2ca3-adc2-496c-881d-ce04c7feb5ac tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24693607-5d61-434b-92db-d85e8107c515", "device": "/dev/xvdb"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:01.086467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c9ed2ca3-adc2-496c-881d-ce04c7feb5ac tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:01.095547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9ed2ca3-adc2-496c-881d-ce04c7feb5ac tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:01.096895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9ed2ca3-adc2-496c-881d-ce04c7feb5ac tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:01.098383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9ed2ca3-adc2-496c-881d-ce04c7feb5ac tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:01.099711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9ed2ca3-adc2-496c-881d-ce04c7feb5ac tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:01.100405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9ed2ca3-adc2-496c-881d-ce04c7feb5ac tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:01.101081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9ed2ca3-adc2-496c-881d-ce04c7feb5ac tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:01.170194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dcdcccba-7957-4bab-833a-5f26d0568fde tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:01.178647 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dcdcccba-7957-4bab-833a-5f26d0568fde tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1233 microversion: 2.1 time: 0.218368 Aug 27 04:57:01.188695 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 704/1366] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:00 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1233 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:01.306819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:01.896711 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c9ed2ca3-adc2-496c-881d-ce04c7feb5ac tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "POST /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.837207 Aug 27 04:57:01.900667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 663/1367] 10.222.0.58 () {62 vars in 1364 bytes} [Sat Aug 27 04:57:01 2022] POST /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments => generated 194 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:57:02.062664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4e0569c-3da1-4df4-a80b-9749517e6c46 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565004ee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:02.167481 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4e0569c-3da1-4df4-a80b-9749517e6c46 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.108812 Aug 27 04:57:02.168301 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 705/1368] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:02 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:02.210098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8835afb8-f725-47ca-9616-2e76934b28eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:02.211557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8835afb8-f725-47ca-9616-2e76934b28eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:02.377682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8835afb8-f725-47ca-9616-2e76934b28eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:02.388765 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8835afb8-f725-47ca-9616-2e76934b28eb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1233 microversion: 2.1 time: 0.187167 Aug 27 04:57:02.389665 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 664/1369] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:02 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1233 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:03.008998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ebda8b57-b6e4-4f87-990d-189209490a72 tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:03.068708 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ebda8b57-b6e4-4f87-990d-189209490a72 tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/620994732" status: 202 len: 0 microversion: 2.1 time: 0.063456 Aug 27 04:57:03.069808 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 665/1370] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:57:03 2022] DELETE /compute/v2.1/flavors/620994732 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:03.078492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8e2099e-0cf5-45cc-9b52-400e70545104 tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:03.134596 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8e2099e-0cf5-45cc-9b52-400e70545104 tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.060403 Aug 27 04:57:03.135867 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 666/1371] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:03 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:03.159210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-877b555d-5085-4db0-9e77-353cbfd6ad45 tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:03.252671 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-877b555d-5085-4db0-9e77-353cbfd6ad45 tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/354078131" status: 202 len: 0 microversion: 2.1 time: 0.096585 Aug 27 04:57:03.259985 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 667/1372] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:57:03 2022] DELETE /compute/v2.1/flavors/354078131 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:57:03.288055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-017c4b05-dc65-4f36-ba11-3e080f426a5f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f67ee0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:03.309644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7c15d16c-49e9-4cd3-ab3b-01e48e635e23 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Action: 'create', calling method: .version_select at 0x7fb565008ca0>, body: {"keypair": {"name": "tempest-keypair-1550944591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvu6AUshp6rieieXFow/oeuzljUQhWu0YEJgyX+HfV1D+oCb8aGBEvi9KfLVDUiG1XOiTPb+QS7YpxRnqQ1vXuzX2+oHyRtvB1D2SWqW2ZvfvAwv+z0g1tsXi1dgwHJ6Q=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:03.346749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-7c15d16c-49e9-4cd3-ab3b-01e48e635e23 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Getting quotas for project 24e778c9967549f5b7641c2b8df74302. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:57:03.358952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-7c15d16c-49e9-4cd3-ab3b-01e48e635e23 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Getting quotas for user d16fabfbcd5b4a7182b18918a1e3e3e7 and project 24e778c9967549f5b7641c2b8df74302. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:57:03.401255 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-017c4b05-dc65-4f36-ba11-3e080f426a5f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.139276 Aug 27 04:57:03.410246 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 668/1373] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:03 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:03.421556 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7c15d16c-49e9-4cd3-ab3b-01e48e635e23 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.820739 Aug 27 04:57:03.422334 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 706/1374] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 04:57:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:03.428157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-40d70455-2872-4aa3-a2c4-e76779745cd5 tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:03.435859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-945fd247-c2c6-4bfa-be6b-9a3696c34986 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:03.436568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-945fd247-c2c6-4bfa-be6b-9a3696c34986 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:03.443307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-945fd247-c2c6-4bfa-be6b-9a3696c34986 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:03.447744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-945fd247-c2c6-4bfa-be6b-9a3696c34986 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:03.448471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-945fd247-c2c6-4bfa-be6b-9a3696c34986 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:03.449556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-945fd247-c2c6-4bfa-be6b-9a3696c34986 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:03.450242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-945fd247-c2c6-4bfa-be6b-9a3696c34986 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:03.451616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-945fd247-c2c6-4bfa-be6b-9a3696c34986 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:03.475644 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-40d70455-2872-4aa3-a2c4-e76779745cd5 tempest-ServersWithSpecificFlavorTestJSON-357726778 tempest-ServersWithSpecificFlavorTestJSON-357726778-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064180 Aug 27 04:57:03.477726 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 669/1375] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:03.514825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:03.522466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:03.545115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:03.550553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:03.553743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:03.554765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:03.558077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:03.558770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:03.612628 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] HTTP exception thrown: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Request method failure captured: Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 HTTP/1.1 Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLnUl3dJWZjPacPM0CLiCYx-EmD-vTs1w6nAWFX90zUEp-Ll9k5lKTm8lU01q1gqOj_auXDQs3sKxqOhDNvGRFtJG2nuZfRoQJrjipbjsFTyUcc42LeQG22lX8NG4sveknwR4eRUn7VjeyexdxLYHPu_o1rVjxd-1tMYBG6Gh3gfIM Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:03.616304 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c83a0d500b9c445ea02dc63360a3c4cf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ddc99cf572d545be8638aaeb6f59749d Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:03.619143 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'dffd03e4-cebb-4c94-a9f9-fc0887472298'} Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:03.620119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:03.621888 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.625523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Returning 404 to user: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:03.630468 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-583a0cb2-8f34-44b2-b93f-e8f4b1d25200 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 404 len: 111 microversion: 2.1 time: 0.127236 Aug 27 04:57:03.635911 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 670/1376] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:57:03 2022] DELETE /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:03.649012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:03.653443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: dffd03e4-cebb-4c94-a9f9-fc0887472298] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:03.666910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-945fd247-c2c6-4bfa-be6b-9a3696c34986 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:03.675423 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-945fd247-c2c6-4bfa-be6b-9a3696c34986 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1229 microversion: 2.1 time: 0.250520 Aug 27 04:57:03.677685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:03.678497 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 707/1377] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:03 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1229 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:03.679813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:03.685023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:03.685862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:03.686343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:03.690325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:03.738209 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] HTTP exception thrown: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Request method failure captured: Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 HTTP/1.1 Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLnUl3dJWZjPacPM0CLiCYx-EmD-vTs1w6nAWFX90zUEp-Ll9k5lKTm8lU01q1gqOj_auXDQs3sKxqOhDNvGRFtJG2nuZfRoQJrjipbjsFTyUcc42LeQG22lX8NG4sveknwR4eRUn7VjeyexdxLYHPu_o1rVjxd-1tMYBG6Gh3gfIM Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:03.744481 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c83a0d500b9c445ea02dc63360a3c4cf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ddc99cf572d545be8638aaeb6f59749d Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:03.745935 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'dffd03e4-cebb-4c94-a9f9-fc0887472298'} Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:03.746685 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. Aug 27 04:57:03.749727 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.750834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Returning 404 to user: Instance dffd03e4-cebb-4c94-a9f9-fc0887472298 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:03.750834 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3b9a3244-d024-45e1-85f6-f5f07eab325b tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298" status: 404 len: 111 microversion: 2.1 time: 0.113218 Aug 27 04:57:03.755790 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 671/1378] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:03 2022] GET /compute/v2.1/servers/dffd03e4-cebb-4c94-a9f9-fc0887472298 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:03.759884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:03.760741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:03.769459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:03.771679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:03.773281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:03.787482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:03.792521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:03.793252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:03.847872 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] HTTP exception thrown: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Request method failure captured: Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 HTTP/1.1 Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaLnUl3dJWZjPacPM0CLiCYx-EmD-vTs1w6nAWFX90zUEp-Ll9k5lKTm8lU01q1gqOj_auXDQs3sKxqOhDNvGRFtJG2nuZfRoQJrjipbjsFTyUcc42LeQG22lX8NG4sveknwR4eRUn7VjeyexdxLYHPu_o1rVjxd-1tMYBG6Gh3gfIM Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:57:03.855182 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c83a0d500b9c445ea02dc63360a3c4cf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ddc99cf572d545be8638aaeb6f59749d Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:03.857199 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '8582438a-00e8-41b1-8aeb-662d153b4983'} Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:03.858131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:03.859880 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.863749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Returning 404 to user: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:03.867213 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6fc5420e-bb3f-4032-b407-3fe3f83e51d0 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 404 len: 111 microversion: 2.1 time: 0.111866 Aug 27 04:57:03.869079 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 708/1379] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:57:03 2022] DELETE /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:57:03.879262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:03.880110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] [instance: 8582438a-00e8-41b1-8aeb-662d153b4983] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:03.891067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:03.891783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:03.893179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:03.894188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:03.894837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:03.895487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:03.917251 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] HTTP exception thrown: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Request method failure captured: Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 HTTP/1.1 Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaLnUl3dJWZjPacPM0CLiCYx-EmD-vTs1w6nAWFX90zUEp-Ll9k5lKTm8lU01q1gqOj_auXDQs3sKxqOhDNvGRFtJG2nuZfRoQJrjipbjsFTyUcc42LeQG22lX8NG4sveknwR4eRUn7VjeyexdxLYHPu_o1rVjxd-1tMYBG6Gh3gfIM Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:03.919292 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c83a0d500b9c445ea02dc63360a3c4cf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c83a0d500b9c445ea02dc63360a3c4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c83a0d500b9c445ea02dc63360a3c4cf Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304 Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ddc99cf572d545be8638aaeb6f59749d Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-946673304-project Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:03.921007 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '8582438a-00e8-41b1-8aeb-662d153b4983'} Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:03.921831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. Aug 27 04:57:03.923554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:03.926033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] Returning 404 to user: Instance 8582438a-00e8-41b1-8aeb-662d153b4983 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:03.927927 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-60a559fc-8e36-49b1-8e9a-50e41f690d12 tempest-ServersWithSpecificFlavorTestJSON-946673304 tempest-ServersWithSpecificFlavorTestJSON-946673304-project] 10.222.0.58 "GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983" status: 404 len: 111 microversion: 2.1 time: 0.053648 Aug 27 04:57:03.929084 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 672/1380] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:03 2022] GET /compute/v2.1/servers/8582438a-00e8-41b1-8aeb-662d153b4983 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:04.425333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-118b76b9-911d-444c-8ee0-04026a9f98b6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565008a60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:04.530294 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-118b76b9-911d-444c-8ee0-04026a9f98b6 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.117005 Aug 27 04:57:04.531138 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 709/1381] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:04 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:04.705927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-acdb0c6a-e834-427c-ba47-5da6124953e3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:04.707304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-acdb0c6a-e834-427c-ba47-5da6124953e3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:04.727327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acdb0c6a-e834-427c-ba47-5da6124953e3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:04.728185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acdb0c6a-e834-427c-ba47-5da6124953e3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:04.730388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acdb0c6a-e834-427c-ba47-5da6124953e3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:04.731835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acdb0c6a-e834-427c-ba47-5da6124953e3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:04.738244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acdb0c6a-e834-427c-ba47-5da6124953e3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:04.738934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acdb0c6a-e834-427c-ba47-5da6124953e3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:05.346437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-acdb0c6a-e834-427c-ba47-5da6124953e3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:05.364718 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-acdb0c6a-e834-427c-ba47-5da6124953e3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1303 microversion: 2.1 time: 0.663028 Aug 27 04:57:05.368989 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 673/1382] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:04 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1303 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:05.546141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-845ab024-a7ab-48d4-9e8d-87e9f1b96060 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650180d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:05.643673 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-845ab024-a7ab-48d4-9e8d-87e9f1b96060 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.101568 Aug 27 04:57:05.645569 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 710/1383] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:05 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:06.390782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-50eb26d6-3b9c-4459-ac7f-e4f428602e53 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:06.391594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-50eb26d6-3b9c-4459-ac7f-e4f428602e53 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:06.404498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eb26d6-3b9c-4459-ac7f-e4f428602e53 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:06.405398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eb26d6-3b9c-4459-ac7f-e4f428602e53 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:06.406091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eb26d6-3b9c-4459-ac7f-e4f428602e53 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:06.407108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eb26d6-3b9c-4459-ac7f-e4f428602e53 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:06.410081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eb26d6-3b9c-4459-ac7f-e4f428602e53 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:06.410814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eb26d6-3b9c-4459-ac7f-e4f428602e53 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:06.663188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-730eb4e2-40a3-4393-a2f9-817ae5519889 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650a4ee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:06.753928 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-730eb4e2-40a3-4393-a2f9-817ae5519889 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.088777 Aug 27 04:57:06.758758 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 711/1384] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:06 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:06.966840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-50eb26d6-3b9c-4459-ac7f-e4f428602e53 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:06.975420 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-50eb26d6-3b9c-4459-ac7f-e4f428602e53 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1291 microversion: 2.1 time: 0.588601 Aug 27 04:57:06.984866 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 674/1385] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:06 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1291 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:07.776983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b6dc2e56-27ed-422f-9852-6cce81d69bf8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565018160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:07.859211 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b6dc2e56-27ed-422f-9852-6cce81d69bf8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.086656 Aug 27 04:57:07.865010 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 712/1386] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:07 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:07.999315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8389062c-d9ff-476f-bd2c-a05bd3e39436 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:08.004649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8389062c-d9ff-476f-bd2c-a05bd3e39436 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:08.007245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:08.023817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8389062c-d9ff-476f-bd2c-a05bd3e39436 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:08.039274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8389062c-d9ff-476f-bd2c-a05bd3e39436 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:08.042340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8389062c-d9ff-476f-bd2c-a05bd3e39436 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:08.044270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8389062c-d9ff-476f-bd2c-a05bd3e39436 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:08.047789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8389062c-d9ff-476f-bd2c-a05bd3e39436 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:08.051613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8389062c-d9ff-476f-bd2c-a05bd3e39436 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:08.781247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8389062c-d9ff-476f-bd2c-a05bd3e39436 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:08.813508 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8389062c-d9ff-476f-bd2c-a05bd3e39436 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1358 microversion: 2.1 time: 0.818728 Aug 27 04:57:08.826207 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 675/1387] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:07 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1358 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:08.881269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65ce70be-2cfa-4ccf-bfa0-9688206e8922 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565022d30>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:08.972880 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-65ce70be-2cfa-4ccf-bfa0-9688206e8922 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.096848 Aug 27 04:57:08.973470 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 713/1388] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:08 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:09.846636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6201d740-3fae-40e1-bec7-1a602e498e66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:09.847393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6201d740-3fae-40e1-bec7-1a602e498e66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:09.858691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6201d740-3fae-40e1-bec7-1a602e498e66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:09.864139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6201d740-3fae-40e1-bec7-1a602e498e66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:09.864780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6201d740-3fae-40e1-bec7-1a602e498e66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:09.865692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6201d740-3fae-40e1-bec7-1a602e498e66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:09.866319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6201d740-3fae-40e1-bec7-1a602e498e66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:09.867049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6201d740-3fae-40e1-bec7-1a602e498e66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:09.989777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7bdfc1fb-4eaa-485c-b2fd-bcf72efa5c36 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565004a60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:10.072485 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7bdfc1fb-4eaa-485c-b2fd-bcf72efa5c36 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.087054 Aug 27 04:57:10.073604 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 714/1389] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:09 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:10.139424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2033240990", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "5b5f4cf8-9522-441e-b471-d0d27607bafd"}], "security_groups": [{"name": "tempest-securitygroup--607976629"}], "key_name": "tempest-keypair-1550944591", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:10.652292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:10.663721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6201d740-3fae-40e1-bec7-1a602e498e66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:10.673482 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6201d740-3fae-40e1-bec7-1a602e498e66 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1358 microversion: 2.1 time: 0.829985 Aug 27 04:57:10.682196 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 676/1390] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:09 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1358 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:10.686995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-8b96340f-adcf-4bc7-8261-7a15a70cd692 req-4bafc785-4bcc-4324-9974-d4eec6152ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2a6f90-d3c3-4741-b08c-ba80f635644d", "tag": "c01490d9-89be-4dee-aa67-dfb553426cc3"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:10.721011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] validate_networks() for [('5b5f4cf8-9522-441e-b471-d0d27607bafd', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:57:10.733418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8b96340f-adcf-4bc7-8261-7a15a70cd692 req-4bafc785-4bcc-4324-9974-d4eec6152ea0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:10.736422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8b96340f-adcf-4bc7-8261-7a15a70cd692 req-4bafc785-4bcc-4324-9974-d4eec6152ea0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:10.737116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8b96340f-adcf-4bc7-8261-7a15a70cd692 req-4bafc785-4bcc-4324-9974-d4eec6152ea0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:10.771546 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-8b96340f-adcf-4bc7-8261-7a15a70cd692 req-4bafc785-4bcc-4324-9974-d4eec6152ea0 service nova] Creating event network-changed:c01490d9-89be-4dee-aa67-dfb553426cc3 for instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d on n-h2-820368-35 Aug 27 04:57:10.807388 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-8b96340f-adcf-4bc7-8261-7a15a70cd692 req-4bafc785-4bcc-4324-9974-d4eec6152ea0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123799 Aug 27 04:57:10.808020 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 677/1391] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:11.090749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e1f3da9-e019-49f9-b21e-ea0b99b20774 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5651b5790>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:11.176640 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e1f3da9-e019-49f9-b21e-ea0b99b20774 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.092216 Aug 27 04:57:11.177215 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 678/1392] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:11 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:11.695190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bf4e9bb3-cd4e-434e-bbc2-14d3c6723515 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:11.696287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bf4e9bb3-cd4e-434e-bbc2-14d3c6723515 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:11.715001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf4e9bb3-cd4e-434e-bbc2-14d3c6723515 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:11.716621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf4e9bb3-cd4e-434e-bbc2-14d3c6723515 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:11.717077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf4e9bb3-cd4e-434e-bbc2-14d3c6723515 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:11.718121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf4e9bb3-cd4e-434e-bbc2-14d3c6723515 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:11.718229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf4e9bb3-cd4e-434e-bbc2-14d3c6723515 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:11.723899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf4e9bb3-cd4e-434e-bbc2-14d3c6723515 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:12.385948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:13.000011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bf4e9bb3-cd4e-434e-bbc2-14d3c6723515 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:13.013124 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bf4e9bb3-cd4e-434e-bbc2-14d3c6723515 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1358 microversion: 2.1 time: 1.320331 Aug 27 04:57:13.013745 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 679/1393] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:11 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1358 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:13.033179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6e41151c-fa2b-46ef-8c1c-27729b59ff65 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564faa0d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:13.130893 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6e41151c-fa2b-46ef-8c1c-27729b59ff65 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.109993 Aug 27 04:57:13.131609 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 680/1394] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:13 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:13.378057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=16 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:13.412697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:57:13.413528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:57:13.414293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:57:13.414935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:57:13.419447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:57:13.437414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:13.439255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:13.440442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:13.443252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:13.444020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:13.445773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:13.495526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Getting quotas for project 24e778c9967549f5b7641c2b8df74302. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:57:13.508995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Getting quotas for user d16fabfbcd5b4a7182b18918a1e3e3e7 and project 24e778c9967549f5b7641c2b8df74302. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:57:13.561183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:57:13.567758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:57:13.768913 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-81070459-9e94-40de-bcf3-cbb3932c1dbe tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.633595 Aug 27 04:57:13.771400 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 715/1395] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 3637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:57:13.783973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa69791d-32d4-4a05-8063-41ab20b89b60 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:13.784599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aa69791d-32d4-4a05-8063-41ab20b89b60 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:13.957689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aa69791d-32d4-4a05-8063-41ab20b89b60 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:13.965577 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aa69791d-32d4-4a05-8063-41ab20b89b60 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1242 microversion: 2.1 time: 0.188517 Aug 27 04:57:13.972515 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 681/1396] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:13 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1242 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:14.034943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-03c8094f-2b51-4cf0-b0a8-fe8c8c71f97e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:14.038124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-03c8094f-2b51-4cf0-b0a8-fe8c8c71f97e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:14.056881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03c8094f-2b51-4cf0-b0a8-fe8c8c71f97e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:14.057763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03c8094f-2b51-4cf0-b0a8-fe8c8c71f97e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:14.060273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03c8094f-2b51-4cf0-b0a8-fe8c8c71f97e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:14.063699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03c8094f-2b51-4cf0-b0a8-fe8c8c71f97e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:14.065018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03c8094f-2b51-4cf0-b0a8-fe8c8c71f97e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:14.065655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03c8094f-2b51-4cf0-b0a8-fe8c8c71f97e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:14.146793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8b4e46d7-5106-4c6a-9ac8-17447ac5bbef tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56509d5e0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:14.240666 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8b4e46d7-5106-4c6a-9ac8-17447ac5bbef tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.098752 Aug 27 04:57:14.243288 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 682/1397] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:14 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:14.463065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-03c8094f-2b51-4cf0-b0a8-fe8c8c71f97e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:14.472537 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-03c8094f-2b51-4cf0-b0a8-fe8c8c71f97e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1358 microversion: 2.1 time: 0.442827 Aug 27 04:57:14.483440 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 716/1398] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:14 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1358 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:14.996293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bf243953-eee5-45d2-801f-3e62b2808115 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:14.997571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bf243953-eee5-45d2-801f-3e62b2808115 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:15.006773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf243953-eee5-45d2-801f-3e62b2808115 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:15.007675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf243953-eee5-45d2-801f-3e62b2808115 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:15.008319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf243953-eee5-45d2-801f-3e62b2808115 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:15.009518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf243953-eee5-45d2-801f-3e62b2808115 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:15.010172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf243953-eee5-45d2-801f-3e62b2808115 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:15.010928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf243953-eee5-45d2-801f-3e62b2808115 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:15.244699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bf243953-eee5-45d2-801f-3e62b2808115 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:15.258845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-92fe673f-2a38-4552-80af-6e492061a425 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fffca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:15.295334 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bf243953-eee5-45d2-801f-3e62b2808115 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1246 microversion: 2.1 time: 0.299429 Aug 27 04:57:15.296752 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 683/1399] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:14 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1246 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:15.362731 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-92fe673f-2a38-4552-80af-6e492061a425 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.107066 Aug 27 04:57:15.364336 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 717/1400] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:15 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:15.516127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-187cd328-6e54-46be-a0a2-21432d86e459 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:15.517463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-187cd328-6e54-46be-a0a2-21432d86e459 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:15.549261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-187cd328-6e54-46be-a0a2-21432d86e459 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:15.550034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-187cd328-6e54-46be-a0a2-21432d86e459 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:15.550642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-187cd328-6e54-46be-a0a2-21432d86e459 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:15.553383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-187cd328-6e54-46be-a0a2-21432d86e459 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:15.554152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-187cd328-6e54-46be-a0a2-21432d86e459 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:15.554796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-187cd328-6e54-46be-a0a2-21432d86e459 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:16.239380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-187cd328-6e54-46be-a0a2-21432d86e459 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:16.251448 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-187cd328-6e54-46be-a0a2-21432d86e459 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1358 microversion: 2.1 time: 0.740152 Aug 27 04:57:16.254668 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 684/1401] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:15 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1358 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:16.325361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-732aeb50-0fea-417d-8897-1cccd1bf3966 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:16.327064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-732aeb50-0fea-417d-8897-1cccd1bf3966 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:16.338054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-732aeb50-0fea-417d-8897-1cccd1bf3966 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:16.339012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-732aeb50-0fea-417d-8897-1cccd1bf3966 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:16.339830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-732aeb50-0fea-417d-8897-1cccd1bf3966 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:16.341166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-732aeb50-0fea-417d-8897-1cccd1bf3966 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:16.341906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-732aeb50-0fea-417d-8897-1cccd1bf3966 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:16.342560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-732aeb50-0fea-417d-8897-1cccd1bf3966 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:16.385589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a84c8a27-1008-4bc4-ac71-af3215b4391e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56524a1f0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:16.478149 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a84c8a27-1008-4bc4-ac71-af3215b4391e tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1453 microversion: 2.1 time: 0.102817 Aug 27 04:57:16.479155 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 685/1402] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:16 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:16.645665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-732aeb50-0fea-417d-8897-1cccd1bf3966 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:16.680840 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-732aeb50-0fea-417d-8897-1cccd1bf3966 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1302 microversion: 2.1 time: 0.364815 Aug 27 04:57:16.692414 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 718/1403] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:16 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1302 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:17.104652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b54d515e-8697-4cb1-85c8-929f83b0f19e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d63e3d2-9aaa-48c4-8edc-587b39ab4b6a"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:17.110849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b54d515e-8697-4cb1-85c8-929f83b0f19e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:17.139594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b54d515e-8697-4cb1-85c8-929f83b0f19e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:17.142809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b54d515e-8697-4cb1-85c8-929f83b0f19e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:17.143377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b54d515e-8697-4cb1-85c8-929f83b0f19e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:17.144244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b54d515e-8697-4cb1-85c8-929f83b0f19e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:17.144841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b54d515e-8697-4cb1-85c8-929f83b0f19e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:17.145279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b54d515e-8697-4cb1-85c8-929f83b0f19e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:17.275506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6a323ef-32d2-4382-92d4-2ad9acd76b10 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:17.276415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a6a323ef-32d2-4382-92d4-2ad9acd76b10 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:17.286035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6a323ef-32d2-4382-92d4-2ad9acd76b10 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:17.286789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6a323ef-32d2-4382-92d4-2ad9acd76b10 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:17.287449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6a323ef-32d2-4382-92d4-2ad9acd76b10 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:17.289211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6a323ef-32d2-4382-92d4-2ad9acd76b10 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:17.289989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6a323ef-32d2-4382-92d4-2ad9acd76b10 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:17.290608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6a323ef-32d2-4382-92d4-2ad9acd76b10 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:17.523573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a6a323ef-32d2-4382-92d4-2ad9acd76b10 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:17.532646 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a6a323ef-32d2-4382-92d4-2ad9acd76b10 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1358 microversion: 2.1 time: 0.262273 Aug 27 04:57:17.533582 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 719/1404] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:17 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:17.539369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7cecbf0a-cbe0-4f6c-a35d-83ae8877faa4 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564fff430>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:17.563130 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b54d515e-8697-4cb1-85c8-929f83b0f19e tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "POST /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464014 Aug 27 04:57:17.564853 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 686/1405] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 04:57:17 2022] POST /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-volume_attachments => generated 194 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:17.615041 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7cecbf0a-cbe0-4f6c-a35d-83ae8877faa4 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1462 microversion: 2.1 time: 0.076784 Aug 27 04:57:17.625276 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 720/1406] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:17 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1462 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:17.634258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1690d4c1-1365-4fce-b8c0-ab8c34571c11 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564ebcdc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:17.691816 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1690d4c1-1365-4fce-b8c0-ab8c34571c11 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 200 len: 1462 microversion: 2.1 time: 0.064239 Aug 27 04:57:17.692742 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 687/1407] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:17 2022] GET /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 1462 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:17.711265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f33f281f-42ff-4946-91d5-5ae8d8f1153f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:17.715374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f33f281f-42ff-4946-91d5-5ae8d8f1153f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:17.715734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f783983-8d42-4a6e-9496-178ca23033c3 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:17.716921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f783983-8d42-4a6e-9496-178ca23033c3 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:17.727069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f783983-8d42-4a6e-9496-178ca23033c3 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:17.727856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f783983-8d42-4a6e-9496-178ca23033c3 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:17.728464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f783983-8d42-4a6e-9496-178ca23033c3 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:17.728914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f33f281f-42ff-4946-91d5-5ae8d8f1153f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:17.729528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f33f281f-42ff-4946-91d5-5ae8d8f1153f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:17.729788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f783983-8d42-4a6e-9496-178ca23033c3 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:17.730407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f783983-8d42-4a6e-9496-178ca23033c3 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:17.730537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f33f281f-42ff-4946-91d5-5ae8d8f1153f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:17.731335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f783983-8d42-4a6e-9496-178ca23033c3 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:17.731660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f33f281f-42ff-4946-91d5-5ae8d8f1153f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:17.732263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f33f281f-42ff-4946-91d5-5ae8d8f1153f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:17.732982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f33f281f-42ff-4946-91d5-5ae8d8f1153f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:17.895987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f783983-8d42-4a6e-9496-178ca23033c3 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:17.909468 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f783983-8d42-4a6e-9496-178ca23033c3 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1300 microversion: 2.1 time: 0.201534 Aug 27 04:57:17.910109 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 688/1408] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:17 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1300 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:18.040849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f33f281f-42ff-4946-91d5-5ae8d8f1153f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:18.068573 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f33f281f-42ff-4946-91d5-5ae8d8f1153f tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738" status: 200 len: 1479 microversion: 2.1 time: 0.364686 Aug 27 04:57:18.083724 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 721/1409] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:17 2022] GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738 => generated 1479 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:18.559864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b2dc6194-d473-4401-b336-f83394be9d32 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:18.563153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b2dc6194-d473-4401-b336-f83394be9d32 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:18.611299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2dc6194-d473-4401-b336-f83394be9d32 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:18.612084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2dc6194-d473-4401-b336-f83394be9d32 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:18.614940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2dc6194-d473-4401-b336-f83394be9d32 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:18.616261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2dc6194-d473-4401-b336-f83394be9d32 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:18.619351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2dc6194-d473-4401-b336-f83394be9d32 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:18.623041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2dc6194-d473-4401-b336-f83394be9d32 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:18.934241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6844b48f-28f0-42ad-905f-267b7c692612 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:18.935642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6844b48f-28f0-42ad-905f-267b7c692612 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:18.949153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6844b48f-28f0-42ad-905f-267b7c692612 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:18.950544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6844b48f-28f0-42ad-905f-267b7c692612 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:18.958730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6844b48f-28f0-42ad-905f-267b7c692612 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:18.960758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6844b48f-28f0-42ad-905f-267b7c692612 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:18.961261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6844b48f-28f0-42ad-905f-267b7c692612 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:18.961718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6844b48f-28f0-42ad-905f-267b7c692612 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:19.274859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b2dc6194-d473-4401-b336-f83394be9d32 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:19.285924 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b2dc6194-d473-4401-b336-f83394be9d32 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1358 microversion: 2.1 time: 0.735130 Aug 27 04:57:19.301192 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 689/1410] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:18 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1358 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:19.307946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-602c847a-337a-4a12-8798-010c3ea7d8d9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:19.308574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-602c847a-337a-4a12-8798-010c3ea7d8d9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:19.328573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-602c847a-337a-4a12-8798-010c3ea7d8d9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:19.331863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-602c847a-337a-4a12-8798-010c3ea7d8d9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:19.333458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-602c847a-337a-4a12-8798-010c3ea7d8d9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:19.334267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-602c847a-337a-4a12-8798-010c3ea7d8d9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:19.334747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-602c847a-337a-4a12-8798-010c3ea7d8d9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:19.337408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-602c847a-337a-4a12-8798-010c3ea7d8d9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:19.603906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6844b48f-28f0-42ad-905f-267b7c692612 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:19.612920 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6844b48f-28f0-42ad-905f-267b7c692612 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1367 microversion: 2.1 time: 0.684294 Aug 27 04:57:19.613509 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 722/1411] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:18 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1367 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:19.858733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-602c847a-337a-4a12-8798-010c3ea7d8d9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:19.872652 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-602c847a-337a-4a12-8798-010c3ea7d8d9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738" status: 200 len: 1466 microversion: 2.1 time: 0.569130 Aug 27 04:57:19.874065 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 690/1412] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:19 2022] GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738 => generated 1466 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:19.900112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e26e74d8-488c-4dfb-a5eb-c373cb2ed27d tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565056dc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:20.036566 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e26e74d8-488c-4dfb-a5eb-c373cb2ed27d tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images?changes-since=2022-08-27T04%3A55%3A12Z" status: 200 len: 1902 microversion: 2.1 time: 0.140253 Aug 27 04:57:20.050325 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 723/1413] 10.222.0.58 () {58 vars in 1199 bytes} [Sat Aug 27 04:57:19 2022] GET /compute/v2.1/images?changes-since=2022-08-27T04%3A55%3A12Z => generated 1902 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:20.059688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-217c00d3-6490-4a70-8c04-0465d5dae145 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f2eaf0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:20.217053 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-217c00d3-6490-4a70-8c04-0465d5dae145 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-218373559" status: 200 len: 484 microversion: 2.1 time: 0.163570 Aug 27 04:57:20.218464 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 691/1414] 10.222.0.58 () {58 vars in 1229 bytes} [Sat Aug 27 04:57:20 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-218373559 => generated 484 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:20.232726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b112f753-80ac-48fb-b2ac-3b961a0463ae tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565022af0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:20.407986 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b112f753-80ac-48fb-b2ac-3b961a0463ae tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images?server=dd002ec2-35f3-43fb-b976-ecb02f1b7738" status: 200 len: 958 microversion: 2.1 time: 0.179499 Aug 27 04:57:20.420187 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 724/1415] 10.222.0.58 () {58 vars in 1209 bytes} [Sat Aug 27 04:57:20 2022] GET /compute/v2.1/images?server=dd002ec2-35f3-43fb-b976-ecb02f1b7738 => generated 958 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:20.432182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-757bb0ba-1da5-49d6-91dc-d4c2907b288e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:20.433213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-757bb0ba-1da5-49d6-91dc-d4c2907b288e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:20.446660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-757bb0ba-1da5-49d6-91dc-d4c2907b288e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:20.449189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-757bb0ba-1da5-49d6-91dc-d4c2907b288e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:20.451979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-757bb0ba-1da5-49d6-91dc-d4c2907b288e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:20.452960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-757bb0ba-1da5-49d6-91dc-d4c2907b288e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:20.454083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-757bb0ba-1da5-49d6-91dc-d4c2907b288e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:20.456476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-757bb0ba-1da5-49d6-91dc-d4c2907b288e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:20.638068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d36680d9-31cd-463a-ba47-006736820e10 req-c0a8b5e2-a52f-4e65-a042-b64d5b6e7657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2a6f90-d3c3-4741-b08c-ba80f635644d", "name": "network-vif-plugged", "status": "completed", "tag": "c01490d9-89be-4dee-aa67-dfb553426cc3"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:20.671302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d36680d9-31cd-463a-ba47-006736820e10 req-c0a8b5e2-a52f-4e65-a042-b64d5b6e7657 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:20.674846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d36680d9-31cd-463a-ba47-006736820e10 req-c0a8b5e2-a52f-4e65-a042-b64d5b6e7657 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:20.676777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d36680d9-31cd-463a-ba47-006736820e10 req-c0a8b5e2-a52f-4e65-a042-b64d5b6e7657 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:20.713878 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d36680d9-31cd-463a-ba47-006736820e10 req-c0a8b5e2-a52f-4e65-a042-b64d5b6e7657 service nova] Creating event network-vif-plugged:c01490d9-89be-4dee-aa67-dfb553426cc3 for instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d on n-h2-820368-35 Aug 27 04:57:20.750326 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d36680d9-31cd-463a-ba47-006736820e10 req-c0a8b5e2-a52f-4e65-a042-b64d5b6e7657 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.473864 Aug 27 04:57:20.752053 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 692/1416] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:20.768410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-23c0aa4b-0366-4d4b-8695-bb584cd674d3 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb56500b5e0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:20.916902 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-23c0aa4b-0366-4d4b-8695-bb584cd674d3 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 484 microversion: 2.1 time: 0.161109 Aug 27 04:57:20.918197 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 693/1417] 10.222.0.58 () {58 vars in 1317 bytes} [Sat Aug 27 04:57:20 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F0fb8d618-f311-4f64-825c-f1816fe41876 => generated 484 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:21.040291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-757bb0ba-1da5-49d6-91dc-d4c2907b288e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:21.054447 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-757bb0ba-1da5-49d6-91dc-d4c2907b288e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1358 microversion: 2.1 time: 0.630540 Aug 27 04:57:21.055127 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 725/1418] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:20 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1358 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:21.066320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-643edd6d-3f73-485e-975a-52274e19d324 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:21.069325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-643edd6d-3f73-485e-975a-52274e19d324 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:21.078922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-643edd6d-3f73-485e-975a-52274e19d324 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:21.080371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-643edd6d-3f73-485e-975a-52274e19d324 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:21.081019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-643edd6d-3f73-485e-975a-52274e19d324 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:21.081997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-643edd6d-3f73-485e-975a-52274e19d324 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:21.082648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-643edd6d-3f73-485e-975a-52274e19d324 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:21.083355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-643edd6d-3f73-485e-975a-52274e19d324 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:21.479684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-81318b35-f3ba-44f4-8b5e-6750e401b5ea req-af266fe3-ebfc-4edd-a8e2-b6475bc69cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d93cb9-3f13-452d-8309-c6e3918db383", "tag": "c932029b-b0e9-4e5a-8cfb-cae6a4379bad"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:21.500173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-81318b35-f3ba-44f4-8b5e-6750e401b5ea req-af266fe3-ebfc-4edd-a8e2-b6475bc69cc1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:21.502848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-81318b35-f3ba-44f4-8b5e-6750e401b5ea req-af266fe3-ebfc-4edd-a8e2-b6475bc69cc1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:21.504233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-81318b35-f3ba-44f4-8b5e-6750e401b5ea req-af266fe3-ebfc-4edd-a8e2-b6475bc69cc1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:21.520498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-643edd6d-3f73-485e-975a-52274e19d324 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:21.529906 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-643edd6d-3f73-485e-975a-52274e19d324 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1367 microversion: 2.1 time: 0.473394 Aug 27 04:57:21.530490 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 726/1419] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:21 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1367 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:21.546558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5ba8e31d-e19e-4c9d-ba6f-25b32b096369 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565022ca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:21.574010 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-81318b35-f3ba-44f4-8b5e-6750e401b5ea req-af266fe3-ebfc-4edd-a8e2-b6475bc69cc1 service nova] Creating event network-changed:c932029b-b0e9-4e5a-8cfb-cae6a4379bad for instance 13d93cb9-3f13-452d-8309-c6e3918db383 on n-h1-820368-35 Aug 27 04:57:21.604653 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-81318b35-f3ba-44f4-8b5e-6750e401b5ea req-af266fe3-ebfc-4edd-a8e2-b6475bc69cc1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.685051 Aug 27 04:57:21.613928 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 694/1420] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:21.631201 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5ba8e31d-e19e-4c9d-ba6f-25b32b096369 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 484 microversion: 2.1 time: 0.096166 Aug 27 04:57:21.631871 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 727/1421] 10.222.0.58 () {58 vars in 1303 bytes} [Sat Aug 27 04:57:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F0fb8d618-f311-4f64-825c-f1816fe41876 => generated 484 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:21.646795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-51119fbc-67e1-4312-9f4d-3aad8ca96448 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f6c160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:21.867416 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-51119fbc-67e1-4312-9f4d-3aad8ca96448 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3705 microversion: 2.1 time: 0.226106 Aug 27 04:57:21.868354 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 695/1422] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 04:57:21 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3705 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:21.884555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22b8cf19-c506-424e-9fdb-d6ca3090acc9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650a4e50>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:22.072309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e9d22fb-7fbc-462b-91c3-82c0a94a4bc5 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:22.075621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9e9d22fb-7fbc-462b-91c3-82c0a94a4bc5 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:22.084516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e9d22fb-7fbc-462b-91c3-82c0a94a4bc5 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:22.085249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e9d22fb-7fbc-462b-91c3-82c0a94a4bc5 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:22.085877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e9d22fb-7fbc-462b-91c3-82c0a94a4bc5 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:22.086767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e9d22fb-7fbc-462b-91c3-82c0a94a4bc5 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:22.087437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e9d22fb-7fbc-462b-91c3-82c0a94a4bc5 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:22.088052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e9d22fb-7fbc-462b-91c3-82c0a94a4bc5 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:22.101299 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22b8cf19-c506-424e-9fdb-d6ca3090acc9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.221248 Aug 27 04:57:22.103973 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 728/1423] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 04:57:21 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:22.108729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-50dbb9f6-ff4b-40e1-996f-0e4880cb1f72 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:22.109348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-50dbb9f6-ff4b-40e1-996f-0e4880cb1f72 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:22.118525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:22.132005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dbb9f6-ff4b-40e1-996f-0e4880cb1f72 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:22.132489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dbb9f6-ff4b-40e1-996f-0e4880cb1f72 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:22.133078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dbb9f6-ff4b-40e1-996f-0e4880cb1f72 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:22.133824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dbb9f6-ff4b-40e1-996f-0e4880cb1f72 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:22.134316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dbb9f6-ff4b-40e1-996f-0e4880cb1f72 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:22.135340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dbb9f6-ff4b-40e1-996f-0e4880cb1f72 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:22.468566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:22.481535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-9e9d22fb-7fbc-462b-91c3-82c0a94a4bc5 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid 71c927e5-5b82-4fd6-8538-fe5456c92f9f {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:57:22.515315 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9e9d22fb-7fbc-462b-91c3-82c0a94a4bc5 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 2423 microversion: 2.25 time: 0.451649 Aug 27 04:57:22.515904 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 696/1424] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:22 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 2423 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:22.529209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-115bc18b-a9e2-4a0a-bc56-8a9b9d32d89b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564ed51f0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:22.530731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-50dbb9f6-ff4b-40e1-996f-0e4880cb1f72 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:22.563235 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-50dbb9f6-ff4b-40e1-996f-0e4880cb1f72 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1358 microversion: 2.1 time: 0.455424 Aug 27 04:57:22.567780 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 729/1425] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:22 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1358 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:22.596407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eaf7173d-782d-474e-852c-6b854173cf30 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-820368-35", "block_migration": "auto"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:22.610295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eaf7173d-782d-474e-852c-6b854173cf30 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:22.642306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaf7173d-782d-474e-852c-6b854173cf30 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:22.642651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaf7173d-782d-474e-852c-6b854173cf30 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:22.643118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaf7173d-782d-474e-852c-6b854173cf30 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:22.649123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaf7173d-782d-474e-852c-6b854173cf30 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:22.649999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaf7173d-782d-474e-852c-6b854173cf30 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:22.650456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eaf7173d-782d-474e-852c-6b854173cf30 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:22.730304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-eaf7173d-782d-474e-852c-6b854173cf30 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'flavor' on Instance uuid 71c927e5-5b82-4fd6-8538-fe5456c92f9f {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:57:22.754608 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-115bc18b-a9e2-4a0a-bc56-8a9b9d32d89b tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.236255 Aug 27 04:57:22.761773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eaf7173d-782d-474e-852c-6b854173cf30 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Going to try to live migrate instance to n-h2-820368-35 {{(pid=128547) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:57:22.767260 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 697/1426] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 04:57:22 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:22.803464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-047aed22-1d2a-40b4-8fb7-990f5fdad2a4 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:22.806494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-047aed22-1d2a-40b4-8fb7-990f5fdad2a4 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:22.822682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-047aed22-1d2a-40b4-8fb7-990f5fdad2a4 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:22.823284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-047aed22-1d2a-40b4-8fb7-990f5fdad2a4 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:22.824100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-047aed22-1d2a-40b4-8fb7-990f5fdad2a4 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:22.825026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-047aed22-1d2a-40b4-8fb7-990f5fdad2a4 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:22.825643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-047aed22-1d2a-40b4-8fb7-990f5fdad2a4 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:22.828580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-047aed22-1d2a-40b4-8fb7-990f5fdad2a4 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:23.473738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:23.541423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:23.591917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-047aed22-1d2a-40b4-8fb7-990f5fdad2a4 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:23.601445 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-047aed22-1d2a-40b4-8fb7-990f5fdad2a4 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1367 microversion: 2.1 time: 0.830009 Aug 27 04:57:23.602280 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 698/1427] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:22 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1367 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:23.607268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-567fa5bd-8475-4212-9e10-32e8b85889aa req-f726f9da-673a-4778-ab50-50373210a7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd002ec2-35f3-43fb-b976-ecb02f1b7738", "name": "network-vif-unplugged", "status": "completed", "tag": "4783370e-a485-40e1-8ea2-5a10e13b0d87"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:23.617553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-567fa5bd-8475-4212-9e10-32e8b85889aa req-f726f9da-673a-4778-ab50-50373210a7ed service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:23.618302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-567fa5bd-8475-4212-9e10-32e8b85889aa req-f726f9da-673a-4778-ab50-50373210a7ed service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:23.619593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-567fa5bd-8475-4212-9e10-32e8b85889aa req-f726f9da-673a-4778-ab50-50373210a7ed service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:23.632182 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-567fa5bd-8475-4212-9e10-32e8b85889aa req-f726f9da-673a-4778-ab50-50373210a7ed service nova] Creating event network-vif-unplugged:4783370e-a485-40e1-8ea2-5a10e13b0d87 for instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 on n-h1-820368-35 Aug 27 04:57:23.646211 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-567fa5bd-8475-4212-9e10-32e8b85889aa req-f726f9da-673a-4778-ab50-50373210a7ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042148 Aug 27 04:57:23.648268 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 699/1428] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:23.663902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-30749c2a-33dc-4006-9fc1-4ee65b1f63c9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565ed6550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:23.834039 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-30749c2a-33dc-4006-9fc1-4ee65b1f63c9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/detail?changes-since=2022-08-27T04%3A55%3A08Z" status: 200 len: 6326 microversion: 2.1 time: 0.183230 Aug 27 04:57:23.835204 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 700/1429] 10.222.0.58 () {58 vars in 1220 bytes} [Sat Aug 27 04:57:23 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-27T04%3A55%3A08Z => generated 6326 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:23.965497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:24.089439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-40c7aa53-d4bf-446d-9812-6d1821d823b3 tempest-PortsAdminExtendedAttrsTestJSON-460037439 tempest-PortsAdminExtendedAttrsTestJSON-460037439-project-admin] Calling method '.version_select at 0x7fb564f3e430>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:24.091608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c7aa53-d4bf-446d-9812-6d1821d823b3 tempest-PortsAdminExtendedAttrsTestJSON-460037439 tempest-PortsAdminExtendedAttrsTestJSON-460037439-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.092181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c7aa53-d4bf-446d-9812-6d1821d823b3 tempest-PortsAdminExtendedAttrsTestJSON-460037439 tempest-PortsAdminExtendedAttrsTestJSON-460037439-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.092718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c7aa53-d4bf-446d-9812-6d1821d823b3 tempest-PortsAdminExtendedAttrsTestJSON-460037439 tempest-PortsAdminExtendedAttrsTestJSON-460037439-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:24.110543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c7aa53-d4bf-446d-9812-6d1821d823b3 tempest-PortsAdminExtendedAttrsTestJSON-460037439 tempest-PortsAdminExtendedAttrsTestJSON-460037439-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.111563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c7aa53-d4bf-446d-9812-6d1821d823b3 tempest-PortsAdminExtendedAttrsTestJSON-460037439 tempest-PortsAdminExtendedAttrsTestJSON-460037439-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.112269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c7aa53-d4bf-446d-9812-6d1821d823b3 tempest-PortsAdminExtendedAttrsTestJSON-460037439 tempest-PortsAdminExtendedAttrsTestJSON-460037439-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:24.126519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c7aa53-d4bf-446d-9812-6d1821d823b3 tempest-PortsAdminExtendedAttrsTestJSON-460037439 tempest-PortsAdminExtendedAttrsTestJSON-460037439-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.127310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c7aa53-d4bf-446d-9812-6d1821d823b3 tempest-PortsAdminExtendedAttrsTestJSON-460037439 tempest-PortsAdminExtendedAttrsTestJSON-460037439-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.128004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c7aa53-d4bf-446d-9812-6d1821d823b3 tempest-PortsAdminExtendedAttrsTestJSON-460037439 tempest-PortsAdminExtendedAttrsTestJSON-460037439-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:24.136808 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-40c7aa53-d4bf-446d-9812-6d1821d823b3 tempest-PortsAdminExtendedAttrsTestJSON-460037439 tempest-PortsAdminExtendedAttrsTestJSON-460037439-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.300186 Aug 27 04:57:24.148325 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 701/1430] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:24.153787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8b42258-3e78-4792-93cd-37c4435bcf9a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:24.154831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8b42258-3e78-4792-93cd-37c4435bcf9a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:24.161620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b42258-3e78-4792-93cd-37c4435bcf9a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.162392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b42258-3e78-4792-93cd-37c4435bcf9a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.163062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b42258-3e78-4792-93cd-37c4435bcf9a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:24.164084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b42258-3e78-4792-93cd-37c4435bcf9a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.164818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b42258-3e78-4792-93cd-37c4435bcf9a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.165488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b42258-3e78-4792-93cd-37c4435bcf9a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:24.393128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8b42258-3e78-4792-93cd-37c4435bcf9a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:24.403818 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8b42258-3e78-4792-93cd-37c4435bcf9a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1539 microversion: 2.1 time: 0.254107 Aug 27 04:57:24.406679 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 702/1431] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:24 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:24.415538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90ea2e1e-825a-4e84-8f38-5578c58b6796 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f73f70>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:24.538110 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90ea2e1e-825a-4e84-8f38-5578c58b6796 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-218373559" status: 200 len: 664 microversion: 2.1 time: 0.129450 Aug 27 04:57:24.538909 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 703/1432] 10.222.0.58 () {58 vars in 1250 bytes} [Sat Aug 27 04:57:24 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-218373559 => generated 664 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:24.552716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-28fc5ec7-43c5-4f2b-8a00-2e5d8909cbcc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:24.556324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-28fc5ec7-43c5-4f2b-8a00-2e5d8909cbcc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:24.573836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28fc5ec7-43c5-4f2b-8a00-2e5d8909cbcc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.574707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28fc5ec7-43c5-4f2b-8a00-2e5d8909cbcc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.575402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28fc5ec7-43c5-4f2b-8a00-2e5d8909cbcc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:24.578719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28fc5ec7-43c5-4f2b-8a00-2e5d8909cbcc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.579955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28fc5ec7-43c5-4f2b-8a00-2e5d8909cbcc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.580820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28fc5ec7-43c5-4f2b-8a00-2e5d8909cbcc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:24.722359 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-28fc5ec7-43c5-4f2b-8a00-2e5d8909cbcc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181836 Aug 27 04:57:24.723949 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 704/1433] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 04:57:24 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:24.730220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5da5faa8-ba3d-4c73-9063-97944dacf8ad tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f67550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:24.814835 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5da5faa8-ba3d-4c73-9063-97944dacf8ad tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1464 microversion: 2.1 time: 0.089448 Aug 27 04:57:24.822313 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 705/1434] 10.222.0.58 () {58 vars in 1338 bytes} [Sat Aug 27 04:57:24 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1464 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:24.833915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ba0878dd-2a36-46bb-adda-8badc6b4e6db tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:24.834793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ba0878dd-2a36-46bb-adda-8badc6b4e6db tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:24.848328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba0878dd-2a36-46bb-adda-8badc6b4e6db tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.853197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba0878dd-2a36-46bb-adda-8badc6b4e6db tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.854145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba0878dd-2a36-46bb-adda-8badc6b4e6db tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:24.855458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba0878dd-2a36-46bb-adda-8badc6b4e6db tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.862341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba0878dd-2a36-46bb-adda-8badc6b4e6db tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.863179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba0878dd-2a36-46bb-adda-8badc6b4e6db tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:25.173621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ba0878dd-2a36-46bb-adda-8badc6b4e6db tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:25.185610 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ba0878dd-2a36-46bb-adda-8badc6b4e6db tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1367 microversion: 2.1 time: 0.359476 Aug 27 04:57:25.186434 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 706/1435] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:24 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:25.193600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-09430a27-22a9-4723-b39d-1d0d4e8be656 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f67550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:25.280761 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-09430a27-22a9-4723-b39d-1d0d4e8be656 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1464 microversion: 2.1 time: 0.092994 Aug 27 04:57:25.294461 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 707/1436] 10.222.0.58 () {58 vars in 1324 bytes} [Sat Aug 27 04:57:25 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1464 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:25.303369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-84326c62-b3bf-4b47-9c38-631a42128a8d tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565005d30>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:25.431321 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-84326c62-b3bf-4b47-9c38-631a42128a8d tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7789 microversion: 2.1 time: 0.134540 Aug 27 04:57:25.435472 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 708/1437] 10.222.0.58 () {58 vars in 1170 bytes} [Sat Aug 27 04:57:25 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7789 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:25.455992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-192dbe32-86dd-4801-922e-9d2458a29b19 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f67790>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:25.552087 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-192dbe32-86dd-4801-922e-9d2458a29b19 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.104142 Aug 27 04:57:25.553109 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 709/1438] 10.222.0.58 () {58 vars in 1170 bytes} [Sat Aug 27 04:57:25 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:25.570702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb9543d0-7e59-4c4c-b56a-1d6ce58d3aba tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5656128b0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:25.642404 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb9543d0-7e59-4c4c-b56a-1d6ce58d3aba tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/596ae1e8-61a9-43bf-be37-48ea5ff9a76f" status: 200 len: 784 microversion: 2.1 time: 0.076293 Aug 27 04:57:25.653324 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 710/1439] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:25 2022] GET /compute/v2.1/images/596ae1e8-61a9-43bf-be37-48ea5ff9a76f => generated 784 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:25.666462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4259bc65-91a8-4862-a593-a6f57e6221a2 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565870ee0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:25.838852 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4259bc65-91a8-4862-a593-a6f57e6221a2 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.184106 Aug 27 04:57:25.843234 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 711/1440] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:57:25 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:25.856265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ea69b54-5cbf-49aa-920a-c4e2bd6ec647 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb564f73430>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:26.913049 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eaf7173d-782d-474e-852c-6b854173cf30 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/action" status: 202 len: 0 microversion: 2.25 time: 4.339541 Aug 27 04:57:26.914021 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 730/1441] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 04:57:22 2022] POST /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/action => generated 0 bytes in 4346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:57:26.924711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c0642c21-9087-40b9-b0b0-419fba268194 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:26.925336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c0642c21-9087-40b9-b0b0-419fba268194 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:26.976882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0642c21-9087-40b9-b0b0-419fba268194 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:26.981615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0642c21-9087-40b9-b0b0-419fba268194 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:26.986786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0642c21-9087-40b9-b0b0-419fba268194 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:26.994056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0642c21-9087-40b9-b0b0-419fba268194 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:26.995854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0642c21-9087-40b9-b0b0-419fba268194 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:26.999615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0642c21-9087-40b9-b0b0-419fba268194 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:27.300338 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6ea69b54-5cbf-49aa-920a-c4e2bd6ec647 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "DELETE /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c" status: 204 len: 0 microversion: 2.1 time: 1.448964 Aug 27 04:57:27.303659 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 712/1442] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:25 2022] DELETE /compute/v2.1/images/64dd8415-a82b-41c4-9041-53e891bb778c => generated 0 bytes in 1453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:57:27.309728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:27.310347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:27.320681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:27.323260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:27.324696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:27.325543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:27.326022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:27.332523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:27.624566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c0642c21-9087-40b9-b0b0-419fba268194 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:27.627594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:27.636928 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c0642c21-9087-40b9-b0b0-419fba268194 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1367 microversion: 2.1 time: 0.718124 Aug 27 04:57:27.642310 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 731/1443] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:26 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1367 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:27.657360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-905bd3c2-9cd2-4629-851a-ced6dc963316 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565056280>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:27.766680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:27.778833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:27.780802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:27.785245 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-efc3582f-28f1-4103-ba2a-74ba54ec04b7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.479519 Aug 27 04:57:27.788596 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 713/1444] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:27 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:27.980989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-ce30488e-e858-4d29-a2b6-f508f861b67c req-9288a7c6-78fa-48cf-bb40-56c41f012cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2a6f90-d3c3-4741-b08c-ba80f635644d", "tag": "c01490d9-89be-4dee-aa67-dfb553426cc3"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:28.000384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=7 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:28.002830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ce30488e-e858-4d29-a2b6-f508f861b67c req-9288a7c6-78fa-48cf-bb40-56c41f012cc7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:28.005868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ce30488e-e858-4d29-a2b6-f508f861b67c req-9288a7c6-78fa-48cf-bb40-56c41f012cc7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:28.008363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ce30488e-e858-4d29-a2b6-f508f861b67c req-9288a7c6-78fa-48cf-bb40-56c41f012cc7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:28.048140 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-ce30488e-e858-4d29-a2b6-f508f861b67c req-9288a7c6-78fa-48cf-bb40-56c41f012cc7 service nova] Creating event network-changed:c01490d9-89be-4dee-aa67-dfb553426cc3 for instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d on n-h2-820368-35 Aug 27 04:57:28.058858 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-ce30488e-e858-4d29-a2b6-f508f861b67c req-9288a7c6-78fa-48cf-bb40-56c41f012cc7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082305 Aug 27 04:57:28.060779 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 714/1445] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:57:28.673824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-35c15a22-d926-45f1-932f-766e7aa1bfda tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:28.674574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-35c15a22-d926-45f1-932f-766e7aa1bfda tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:28.704704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c15a22-d926-45f1-932f-766e7aa1bfda tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:28.705619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c15a22-d926-45f1-932f-766e7aa1bfda tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:28.710107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c15a22-d926-45f1-932f-766e7aa1bfda tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:28.710107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c15a22-d926-45f1-932f-766e7aa1bfda tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:28.710107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c15a22-d926-45f1-932f-766e7aa1bfda tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:28.710107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c15a22-d926-45f1-932f-766e7aa1bfda tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:29.065312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-35c15a22-d926-45f1-932f-766e7aa1bfda tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:29.075292 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-35c15a22-d926-45f1-932f-766e7aa1bfda tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1367 microversion: 2.1 time: 0.416533 Aug 27 04:57:29.078184 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 715/1446] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:28 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:29.090899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:29.092791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:29.096010 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-905bd3c2-9cd2-4629-851a-ced6dc963316 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "DELETE /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db" status: 204 len: 0 microversion: 2.1 time: 1.448076 Aug 27 04:57:29.099894 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 732/1447] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:27 2022] DELETE /compute/v2.1/images/c0745443-a1ab-4a42-beca-dd711c8e76db => generated 0 bytes in 1454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:57:29.105879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-72fe1a33-ca15-42a2-aa04-2bb41c74cc68 req-70bd686b-6c56-4058-b0f6-83fecdff8c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d93cb9-3f13-452d-8309-c6e3918db383", "name": "network-vif-plugged", "status": "completed", "tag": "c932029b-b0e9-4e5a-8cfb-cae6a4379bad"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:29.109630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:29.112988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:29.113743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:29.114611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:29.116602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:29.117203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:29.139069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-72fe1a33-ca15-42a2-aa04-2bb41c74cc68 req-70bd686b-6c56-4058-b0f6-83fecdff8c24 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:29.144716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-72fe1a33-ca15-42a2-aa04-2bb41c74cc68 req-70bd686b-6c56-4058-b0f6-83fecdff8c24 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:29.145186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-72fe1a33-ca15-42a2-aa04-2bb41c74cc68 req-70bd686b-6c56-4058-b0f6-83fecdff8c24 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:29.191081 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-72fe1a33-ca15-42a2-aa04-2bb41c74cc68 req-70bd686b-6c56-4058-b0f6-83fecdff8c24 service nova] Creating event network-vif-plugged:c932029b-b0e9-4e5a-8cfb-cae6a4379bad for instance 13d93cb9-3f13-452d-8309-c6e3918db383 on n-h1-820368-35 Aug 27 04:57:29.201463 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-72fe1a33-ca15-42a2-aa04-2bb41c74cc68 req-70bd686b-6c56-4058-b0f6-83fecdff8c24 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100177 Aug 27 04:57:29.208155 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 733/1448] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:29.223355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-93649c51-0e30-440d-8d78-db9f406effee tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650d38b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:29.436836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:29.450019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:29.452681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:29.454234 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-86158777-ed1f-46f2-a2bb-6d8f21a857e0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.373415 Aug 27 04:57:29.465802 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 716/1449] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:29 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:30.101679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab67cf9e-3ac7-45c4-b056-9656eb543340 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:30.102354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ab67cf9e-3ac7-45c4-b056-9656eb543340 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:30.112498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab67cf9e-3ac7-45c4-b056-9656eb543340 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.114901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab67cf9e-3ac7-45c4-b056-9656eb543340 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.115575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab67cf9e-3ac7-45c4-b056-9656eb543340 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.116585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab67cf9e-3ac7-45c4-b056-9656eb543340 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.117965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab67cf9e-3ac7-45c4-b056-9656eb543340 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.118916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab67cf9e-3ac7-45c4-b056-9656eb543340 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.430479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ab67cf9e-3ac7-45c4-b056-9656eb543340 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:30.441777 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ab67cf9e-3ac7-45c4-b056-9656eb543340 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1367 microversion: 2.1 time: 0.344005 Aug 27 04:57:30.443449 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 717/1450] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:30 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:30.661833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b5a0890b-012d-41ab-b20c-9c08448792e9 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1972199868", "id": 102812680, "os-flavor-access:is_public": "True"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:30.686972 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b5a0890b-012d-41ab-b20c-9c08448792e9 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.241793 Aug 27 04:57:30.688659 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-93649c51-0e30-440d-8d78-db9f406effee tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "DELETE /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071" status: 204 len: 0 microversion: 2.1 time: 1.478583 Aug 27 04:57:30.689145 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 718/1451] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:30 2022] POST /compute/v2.1/flavors => generated 427 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:30.690207 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 734/1452] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:29 2022] DELETE /compute/v2.1/images/5b148ada-e053-4c03-ac2d-8f8259762071 => generated 0 bytes in 1481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:57:30.698319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ef5e5ba-8601-4b26-83f9-0420ffeafa97 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:30.698938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6ef5e5ba-8601-4b26-83f9-0420ffeafa97 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:30.704851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:30.705499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:30.710033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ef5e5ba-8601-4b26-83f9-0420ffeafa97 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.710763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ef5e5ba-8601-4b26-83f9-0420ffeafa97 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.711424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ef5e5ba-8601-4b26-83f9-0420ffeafa97 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.711826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.712316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.712723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ef5e5ba-8601-4b26-83f9-0420ffeafa97 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.712869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.713430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.713664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ef5e5ba-8601-4b26-83f9-0420ffeafa97 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.713880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.714302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.714613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ef5e5ba-8601-4b26-83f9-0420ffeafa97 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.753988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6ef5e5ba-8601-4b26-83f9-0420ffeafa97 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:57:30.878484 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6ef5e5ba-8601-4b26-83f9-0420ffeafa97 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 204 len: 0 microversion: 2.1 time: 0.183986 Aug 27 04:57:30.883187 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 735/1453] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:57:30 2022] DELETE /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:57:30.889204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba05f779-9388-470a-a5d8-76d623086d43 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:30.913208 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba05f779-9388-470a-a5d8-76d623086d43 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/102812680" status: 202 len: 0 microversion: 2.1 time: 0.028174 Aug 27 04:57:30.914182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:30.915152 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 736/1454] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:57:30 2022] DELETE /compute/v2.1/flavors/102812680 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:30.921946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fd702d23-91a3-4307-86cb-ed4d1dd6de45 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:30.923806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fd702d23-91a3-4307-86cb-ed4d1dd6de45 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:30.929171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:30.931022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:30.932341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd702d23-91a3-4307-86cb-ed4d1dd6de45 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.932644 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d5a86d04-7362-4a02-b7f3-e9b02a37fd4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.240304 Aug 27 04:57:30.933110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd702d23-91a3-4307-86cb-ed4d1dd6de45 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.933911 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 719/1455] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:30 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:30.934046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd702d23-91a3-4307-86cb-ed4d1dd6de45 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.935137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd702d23-91a3-4307-86cb-ed4d1dd6de45 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.935713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd702d23-91a3-4307-86cb-ed4d1dd6de45 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.936334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd702d23-91a3-4307-86cb-ed4d1dd6de45 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.939705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-91fb9619-6202-4eb6-a821-8d69b28768ee tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:30.965404 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-91fb9619-6202-4eb6-a821-8d69b28768ee tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029994 Aug 27 04:57:30.976807 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 720/1456] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:30.990411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1b4e839c-684b-48dd-8339-349786ddec7f tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1274765327", "id": 990728149, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:31.011046 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1b4e839c-684b-48dd-8339-349786ddec7f tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.028824 Aug 27 04:57:31.011763 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 721/1457] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:30 2022] POST /compute/v2.1/flavors => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:57:31.023942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b8f79298-eeea-4025-a7c1-19401cda3946 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.062369 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b8f79298-eeea-4025-a7c1-19401cda3946 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.042259 Aug 27 04:57:31.078360 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 722/1458] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:31 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:31.087469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b4512892-0960-4ced-ba53-4e14209b1337 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.118250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fd702d23-91a3-4307-86cb-ed4d1dd6de45 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:31.127727 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fd702d23-91a3-4307-86cb-ed4d1dd6de45 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1473 microversion: 2.1 time: 0.210612 Aug 27 04:57:31.128831 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 737/1459] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:30 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1473 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:31.132808 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b4512892-0960-4ced-ba53-4e14209b1337 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/990728149" status: 202 len: 0 microversion: 2.1 time: 0.052043 Aug 27 04:57:31.133621 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 723/1460] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:57:31 2022] DELETE /compute/v2.1/flavors/990728149 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:31.147501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-766f51b6-cf1b-4e1b-bf7d-cec41bb23a48 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.176264 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-766f51b6-cf1b-4e1b-bf7d-cec41bb23a48 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037892 Aug 27 04:57:31.177560 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 738/1461] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:31.196766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d9fc242e-dc4f-49f5-ba1c-a5b85289b382 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1580712004", "id": 619856069, "os-flavor-access:is_public": "True"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:31.217482 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d9fc242e-dc4f-49f5-ba1c-a5b85289b382 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.024647 Aug 27 04:57:31.218593 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 724/1462] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:31 2022] POST /compute/v2.1/flavors => generated 426 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:31.230681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c06e7115-1fbc-462c-8652-841528756e6c tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.259597 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c06e7115-1fbc-462c-8652-841528756e6c tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/619856069" status: 202 len: 0 microversion: 2.1 time: 0.031689 Aug 27 04:57:31.260424 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 739/1463] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:57:31 2022] DELETE /compute/v2.1/flavors/619856069 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:31.270663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-136d4255-1281-4997-8b62-bffbd6154d8e tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.306153 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-136d4255-1281-4997-8b62-bffbd6154d8e tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041328 Aug 27 04:57:31.320713 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 725/1464] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:31.333969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6d5233c3-4641-4c6e-a3a7-28cbb56a1f84 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1113278434", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:31.386803 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6d5233c3-4641-4c6e-a3a7-28cbb56a1f84 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.058110 Aug 27 04:57:31.388874 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 740/1465] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:31 2022] POST /compute/v2.1/flavors => generated 507 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:31.400054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc4fcfcd-3536-4165-80a7-b0b7e55b1801 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.446920 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dc4fcfcd-3536-4165-80a7-b0b7e55b1801 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/7dd25c40-6954-44f0-9629-1649b707c77d" status: 202 len: 0 microversion: 2.1 time: 0.051523 Aug 27 04:57:31.448010 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 726/1466] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:57:31 2022] DELETE /compute/v2.1/flavors/7dd25c40-6954-44f0-9629-1649b707c77d => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:31.467343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8a74609e-9033-48d8-8880-89e75b0217d8 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.468255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-310edfef-95f5-4ba4-badb-b6f42ba68922 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.469006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-310edfef-95f5-4ba4-badb-b6f42ba68922 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:31.475631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310edfef-95f5-4ba4-badb-b6f42ba68922 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:31.476822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310edfef-95f5-4ba4-badb-b6f42ba68922 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:31.477339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310edfef-95f5-4ba4-badb-b6f42ba68922 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:31.478318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310edfef-95f5-4ba4-badb-b6f42ba68922 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:31.478846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310edfef-95f5-4ba4-badb-b6f42ba68922 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:31.479410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310edfef-95f5-4ba4-badb-b6f42ba68922 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:31.511012 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8a74609e-9033-48d8-8880-89e75b0217d8 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045113 Aug 27 04:57:31.512936 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 727/1467] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:31.531209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f3a037f-3547-483d-bd30-4a9d5ec363e5 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1442969214", "id": "146e76fe-bccd-48de-a1e0-0e24769e7abe", "os-flavor-access:is_public": "True"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:31.560851 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f3a037f-3547-483d-bd30-4a9d5ec363e5 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.033596 Aug 27 04:57:31.562230 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 728/1468] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:31 2022] POST /compute/v2.1/flavors => generated 507 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:57:31.582566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d9ff3f64-6189-4bb9-8729-1a675c426478 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.607947 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d9ff3f64-6189-4bb9-8729-1a675c426478 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/146e76fe-bccd-48de-a1e0-0e24769e7abe" status: 202 len: 0 microversion: 2.1 time: 0.036567 Aug 27 04:57:31.609011 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 729/1469] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:57:31 2022] DELETE /compute/v2.1/flavors/146e76fe-bccd-48de-a1e0-0e24769e7abe => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:31.617496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ff41cf6b-4eb9-40b5-969f-11afd22c5d87 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.648003 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ff41cf6b-4eb9-40b5-969f-11afd22c5d87 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032363 Aug 27 04:57:31.648003 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 730/1470] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:31.670992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8bac6bb8-7fd1-448b-9df3-5f6e879cb292 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2025780710", "id": 974612915, "os-flavor-access:is_public": "True"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:31.703839 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8bac6bb8-7fd1-448b-9df3-5f6e879cb292 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.039227 Aug 27 04:57:31.704943 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 731/1471] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:31 2022] POST /compute/v2.1/flavors => generated 411 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:57:31.717722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89964c9d-82fa-4655-85b2-0dcbc6e7b808 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.726314 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89964c9d-82fa-4655-85b2-0dcbc6e7b808 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/974612915" status: 200 len: 411 microversion: 2.1 time: 0.012792 Aug 27 04:57:31.727139 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 732/1472] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 04:57:31 2022] GET /compute/v2.1/flavors/974612915 => generated 411 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:57:31.822441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-310edfef-95f5-4ba4-badb-b6f42ba68922 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:31.831733 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-310edfef-95f5-4ba4-badb-b6f42ba68922 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1558 microversion: 2.1 time: 0.368135 Aug 27 04:57:31.834090 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 741/1473] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:31 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1558 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:31.856611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57a952c1-8b9f-4466-9cb0-c94b311e487b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.857790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-57a952c1-8b9f-4466-9cb0-c94b311e487b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:31.865960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a952c1-8b9f-4466-9cb0-c94b311e487b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:31.868067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a952c1-8b9f-4466-9cb0-c94b311e487b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:31.868863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a952c1-8b9f-4466-9cb0-c94b311e487b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:31.870065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a952c1-8b9f-4466-9cb0-c94b311e487b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:31.871334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a952c1-8b9f-4466-9cb0-c94b311e487b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:31.872102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a952c1-8b9f-4466-9cb0-c94b311e487b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.045795 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-57a952c1-8b9f-4466-9cb0-c94b311e487b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.193218 Aug 27 04:57:32.046396 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 742/1474] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 04:57:31 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:32.058162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:32.058774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:32.065590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.066083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.066711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.067681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.068331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.074366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-320e7808-5a04-459b-9e42-85b907de38b6 tempest-FlavorsAdminTestJSON-929212158 tempest-FlavorsAdminTestJSON-929212158-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:32.083803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.116424 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-320e7808-5a04-459b-9e42-85b907de38b6 tempest-FlavorsAdminTestJSON-929212158 tempest-FlavorsAdminTestJSON-929212158-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.380142 Aug 27 04:57:32.134988 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 733/1475] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:31 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:32.143537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-57b3c380-5d51-45ed-8497-84dc9027f665 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:32.177993 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-57b3c380-5d51-45ed-8497-84dc9027f665 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/974612915" status: 202 len: 0 microversion: 2.1 time: 0.038517 Aug 27 04:57:32.179584 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 734/1476] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:57:32 2022] DELETE /compute/v2.1/flavors/974612915 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:32.188539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9ac78ed-67e6-4908-983c-f3c87bb55817 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:32.189522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9ac78ed-67e6-4908-983c-f3c87bb55817 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:32.196006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ac78ed-67e6-4908-983c-f3c87bb55817 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.196771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ac78ed-67e6-4908-983c-f3c87bb55817 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.197433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ac78ed-67e6-4908-983c-f3c87bb55817 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.199428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ac78ed-67e6-4908-983c-f3c87bb55817 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.200068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ac78ed-67e6-4908-983c-f3c87bb55817 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.200664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ac78ed-67e6-4908-983c-f3c87bb55817 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.481161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:32.506356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f9ac78ed-67e6-4908-983c-f3c87bb55817 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:32.514993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:32.518135 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9ac78ed-67e6-4908-983c-f3c87bb55817 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1473 microversion: 2.1 time: 0.330554 Aug 27 04:57:32.518962 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 735/1477] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:32 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1473 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:32.540758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:32.541365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6b7c8f1a-7e07-444e-9389-fa759eb4a7f2 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:32.547206 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2f67a03-de10-451d-b5c6-740eb9fc42e7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.491397 Aug 27 04:57:32.549354 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 743/1478] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:32 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:32.631215 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6b7c8f1a-7e07-444e-9389-fa759eb4a7f2 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.111024 Aug 27 04:57:32.632231 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 736/1479] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:32.660489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1808dd0-0618-4441-9ca8-cf8ae37f2dd7 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1709794548", "id": 1643232573, "os-flavor-access:is_public": "False"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:32.704508 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1808dd0-0618-4441-9ca8-cf8ae37f2dd7 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.049462 Aug 27 04:57:32.705546 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 744/1480] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:32 2022] POST /compute/v2.1/flavors => generated 430 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:32.717689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-decaf35a-122e-4a79-90df-eb0e84f9b41f tempest-FlavorsAdminTestJSON-929212158 tempest-FlavorsAdminTestJSON-929212158-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "1643232573"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:32.736833 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-decaf35a-122e-4a79-90df-eb0e84f9b41f tempest-FlavorsAdminTestJSON-929212158 tempest-FlavorsAdminTestJSON-929212158-project] HTTP exception thrown: Flavor 1643232573 could not be found. Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-decaf35a-122e-4a79-90df-eb0e84f9b41f tempest-FlavorsAdminTestJSON-929212158 tempest-FlavorsAdminTestJSON-929212158-project] Request method failure captured: Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 107 Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaQ3fSgWR6oWECi1hrOpRsXM2gLmHBG5u1Qn7-IT77WghR1Mj-nbYg7L0yyj6vj-nwk3BEmsMSivgwC-vfsGzUd4X1vbk16uq_9pUT4JOW6HqiXfgKwey4bFps1oN9QNVLxsQC1bZCoHUTWcBCrronbfUyKW6s6zblxS6E9eKctS6JY Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: b3d058c914e34295a844a7211304691c Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FlavorsAdminTestJSON-929212158 Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:32.749515 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b3d058c914e34295a844a7211304691c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b3d058c914e34295a844a7211304691c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b3d058c914e34295a844a7211304691c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b3d058c914e34295a844a7211304691c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FlavorsAdminTestJSON-929212158 Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: b3d058c914e34295a844a7211304691c Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-929212158 Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FlavorsAdminTestJSON-929212158-project Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 7bf4ea8a7c87443395bca891a91302ff Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FlavorsAdminTestJSON-929212158-project Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "test", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "1643232573"}} Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:57:32.752041 n-d-820368-35 devstack@n-api.service[128548]: exception: Flavor 1643232573 could not be found. Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '1643232573'}}} Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1643232573 could not be found. Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.753181 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1643232573 could not be found. Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:32.754977 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:32.756825 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:32.756825 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:32.756825 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:32.756825 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1643232573 could not be found. Aug 27 04:57:32.756825 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.756825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-decaf35a-122e-4a79-90df-eb0e84f9b41f tempest-FlavorsAdminTestJSON-929212158 tempest-FlavorsAdminTestJSON-929212158-project] Returning 400 to user: Flavor 1643232573 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:32.756825 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-decaf35a-122e-4a79-90df-eb0e84f9b41f tempest-FlavorsAdminTestJSON-929212158 tempest-FlavorsAdminTestJSON-929212158-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.039179 Aug 27 04:57:32.761055 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 737/1481] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:32 2022] POST /compute/v2.1/servers => generated 81 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:32.766912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ee680308-83a5-4134-b02e-a0d28c44c245 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:32.817983 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ee680308-83a5-4134-b02e-a0d28c44c245 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1643232573" status: 202 len: 0 microversion: 2.1 time: 0.055638 Aug 27 04:57:32.819262 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 745/1482] 10.222.0.58 () {58 vars in 1161 bytes} [Sat Aug 27 04:57:32 2022] DELETE /compute/v2.1/flavors/1643232573 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:57:32.827904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6d864c1c-aef5-477d-ac69-1ea801ce2306 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:32.864977 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6d864c1c-aef5-477d-ac69-1ea801ce2306 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041405 Aug 27 04:57:32.881481 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 738/1483] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:32.888229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eed3dc4a-a2dd-4c0e-aeee-e1fa9f23f5e1 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1675100881", "id": 1240797540, "os-flavor-access:is_public": "False"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:32.926186 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eed3dc4a-a2dd-4c0e-aeee-e1fa9f23f5e1 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.042005 Aug 27 04:57:32.927197 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 746/1484] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:32 2022] POST /compute/v2.1/flavors => generated 415 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:32.940479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-004b72c1-a539-4a7d-8b31-f172b95589d9 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-174996409", "id": 148083309, "os-flavor-access:is_public": "True"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:32.979643 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-004b72c1-a539-4a7d-8b31-f172b95589d9 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.044165 Aug 27 04:57:32.983138 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 739/1485] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:32 2022] POST /compute/v2.1/flavors => generated 410 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:32.992057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a16c1602-1908-4afc-8bbd-5ef616b26bee tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.032730 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a16c1602-1908-4afc-8bbd-5ef616b26bee tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.044145 Aug 27 04:57:33.033331 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 747/1486] 10.222.0.58 () {58 vars in 1169 bytes} [Sat Aug 27 04:57:32 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:33.046597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a8f2dbbb-09b2-49dc-b564-3b48db6cb895 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.068981 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a8f2dbbb-09b2-49dc-b564-3b48db6cb895 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.026677 Aug 27 04:57:33.076923 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 740/1487] 10.222.0.58 () {58 vars in 1177 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:33.082622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-84e14f60-4bd1-4aa9-9f8a-95dea33d33d1 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.093073 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-84e14f60-4bd1-4aa9-9f8a-95dea33d33d1 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.014278 Aug 27 04:57:33.093653 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 748/1488] 10.222.0.58 () {58 vars in 1171 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:33.108001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-367ef38f-f345-4152-9add-288a957efe28 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.120865 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-367ef38f-f345-4152-9add-288a957efe28 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.017926 Aug 27 04:57:33.122305 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 741/1489] 10.222.0.58 () {58 vars in 1169 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:57:33.137146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-52101662-4f63-45c2-8980-2380c4743ff8 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.166955 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-52101662-4f63-45c2-8980-2380c4743ff8 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.035395 Aug 27 04:57:33.180081 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 749/1490] 10.222.0.58 () {58 vars in 1169 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:33.186766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5e29b679-5861-4ea8-bc8b-fb837a524712 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.225946 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5e29b679-5861-4ea8-bc8b-fb837a524712 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.043049 Aug 27 04:57:33.238023 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 742/1491] 10.222.0.58 () {58 vars in 1175 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:33.244028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6c3deb6d-c6ef-495d-bcde-f7957d5e56fa tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.268913 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6c3deb6d-c6ef-495d-bcde-f7957d5e56fa tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.028605 Aug 27 04:57:33.287274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ef3e8f9e-a49e-4ff0-a1e9-08da7a70906f tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.293004 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 750/1492] 10.222.0.58 () {58 vars in 1173 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:33.311909 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ef3e8f9e-a49e-4ff0-a1e9-08da7a70906f tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.028311 Aug 27 04:57:33.324895 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 743/1493] 10.222.0.58 () {58 vars in 1169 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:33.331251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d0b1a2e4-2e06-4ea7-9f91-87909f4b7f23 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.376493 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d0b1a2e4-2e06-4ea7-9f91-87909f4b7f23 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/148083309" status: 202 len: 0 microversion: 2.1 time: 0.048822 Aug 27 04:57:33.378337 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 751/1494] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:57:33 2022] DELETE /compute/v2.1/flavors/148083309 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:33.387951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a8af7817-7ba4-417e-a9ab-053c0b748b98 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.415072 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a8af7817-7ba4-417e-a9ab-053c0b748b98 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032576 Aug 27 04:57:33.416160 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 744/1495] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:33.434152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fd335bf1-9375-41f7-b892-1392a563006f tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.457441 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fd335bf1-9375-41f7-b892-1392a563006f tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1240797540" status: 202 len: 0 microversion: 2.1 time: 0.026961 Aug 27 04:57:33.458462 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 752/1496] 10.222.0.58 () {58 vars in 1161 bytes} [Sat Aug 27 04:57:33 2022] DELETE /compute/v2.1/flavors/1240797540 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:33.467230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d790a49-9fc9-4613-94b4-5e56ceb03f1e tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.495511 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0d790a49-9fc9-4613-94b4-5e56ceb03f1e tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031987 Aug 27 04:57:33.496416 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 745/1497] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:33.514985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fee4391c-3b92-4f49-8b54-b101f12feefd tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1243398733", "id": 1539144961, "os-flavor-access:is_public": "False"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:33.543732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7c8d5517-6dbe-423c-b06a-0247d517f60a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.544454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7c8d5517-6dbe-423c-b06a-0247d517f60a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:33.545083 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fee4391c-3b92-4f49-8b54-b101f12feefd tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.033788 Aug 27 04:57:33.552242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c8d5517-6dbe-423c-b06a-0247d517f60a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:33.554165 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 753/1498] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:33 2022] POST /compute/v2.1/flavors => generated 415 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:33.566417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-244f3860-7fa0-44c0-af85-35338a562269 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.581934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c8d5517-6dbe-423c-b06a-0247d517f60a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:33.582503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c8d5517-6dbe-423c-b06a-0247d517f60a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:33.583311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c8d5517-6dbe-423c-b06a-0247d517f60a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:33.583964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c8d5517-6dbe-423c-b06a-0247d517f60a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:33.584946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c8d5517-6dbe-423c-b06a-0247d517f60a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:33.593678 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-244f3860-7fa0-44c0-af85-35338a562269 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036476 Aug 27 04:57:33.594415 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 754/1499] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:33.636380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.641117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:33.668546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:33.671624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:33.675843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:33.676613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:33.681060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:33.682943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:34.283074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:34.297696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:34.299481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:34.301862 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1389aede-9de3-4a49-a941-98ee4f5b5cdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.693901 Aug 27 04:57:34.302650 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 755/1500] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:34.307608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7c8d5517-6dbe-423c-b06a-0247d517f60a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:34.310710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fe073311-4093-446d-bed3-5971cb2bd20b tempest-FlavorsAdminTestJSON-929212158 tempest-FlavorsAdminTestJSON-929212158-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:34.317558 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7c8d5517-6dbe-423c-b06a-0247d517f60a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1473 microversion: 2.1 time: 0.775456 Aug 27 04:57:34.332234 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 746/1501] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1473 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:34.339048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-20ac059f-8f73-4c00-91c1-72a72eb404cf req-86d71019-864d-485e-8e28-a345fff5473d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d93cb9-3f13-452d-8309-c6e3918db383", "tag": "c932029b-b0e9-4e5a-8cfb-cae6a4379bad"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:34.358533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-20ac059f-8f73-4c00-91c1-72a72eb404cf req-86d71019-864d-485e-8e28-a345fff5473d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:34.360830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-20ac059f-8f73-4c00-91c1-72a72eb404cf req-86d71019-864d-485e-8e28-a345fff5473d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:34.362095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-20ac059f-8f73-4c00-91c1-72a72eb404cf req-86d71019-864d-485e-8e28-a345fff5473d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:34.373394 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fe073311-4093-446d-bed3-5971cb2bd20b tempest-FlavorsAdminTestJSON-929212158 tempest-FlavorsAdminTestJSON-929212158-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069112 Aug 27 04:57:34.378417 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-20ac059f-8f73-4c00-91c1-72a72eb404cf req-86d71019-864d-485e-8e28-a345fff5473d service nova] Creating event network-changed:c932029b-b0e9-4e5a-8cfb-cae6a4379bad for instance 13d93cb9-3f13-452d-8309-c6e3918db383 on n-h1-820368-35 Aug 27 04:57:34.388114 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 756/1502] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:34.400093 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-20ac059f-8f73-4c00-91c1-72a72eb404cf req-86d71019-864d-485e-8e28-a345fff5473d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066435 Aug 27 04:57:34.400911 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 747/1503] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:34.410378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-801ba7bd-c3c8-4e80-8260-26d543e6f590 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:34.457464 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-801ba7bd-c3c8-4e80-8260-26d543e6f590 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1539144961" status: 202 len: 0 microversion: 2.1 time: 0.066488 Aug 27 04:57:34.463504 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 757/1504] 10.222.0.58 () {58 vars in 1161 bytes} [Sat Aug 27 04:57:34 2022] DELETE /compute/v2.1/flavors/1539144961 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:34.467945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a27ee020-eea6-46db-a8dd-49c36cedc537 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:34.473770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:DELETE=12 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:34.520846 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a27ee020-eea6-46db-a8dd-49c36cedc537 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057285 Aug 27 04:57:34.532255 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 748/1505] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:34.552990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f5619992-38da-4ec0-b843-0bce8bd86ba4 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-859897218", "id": 488072384, "os-flavor-access:is_public": "True"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:34.567018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=18,nova_api:INSERT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:34.592501 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f5619992-38da-4ec0-b843-0bce8bd86ba4 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.044320 Aug 27 04:57:34.601848 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 758/1506] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:34 2022] POST /compute/v2.1/flavors => generated 410 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:34.606799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-62f0b65f-9f69-4764-bc3a-cc88a4362961 tempest-FlavorsAdminTestJSON-929212158 tempest-FlavorsAdminTestJSON-929212158-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:34.655260 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-62f0b65f-9f69-4764-bc3a-cc88a4362961 tempest-FlavorsAdminTestJSON-929212158 tempest-FlavorsAdminTestJSON-929212158-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.053200 Aug 27 04:57:34.656604 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 749/1507] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:34 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:34.674981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-72d20397-8499-46bb-aaf3-70e929597d8f tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:34.697445 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-72d20397-8499-46bb-aaf3-70e929597d8f tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/488072384" status: 202 len: 0 microversion: 2.1 time: 0.026466 Aug 27 04:57:34.708929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2fa297f2-3b74-4088-a13b-11230dd38ee7 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:34.716989 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 759/1508] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 04:57:34 2022] DELETE /compute/v2.1/flavors/488072384 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:34.746312 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2fa297f2-3b74-4088-a13b-11230dd38ee7 tempest-FlavorsAdminTestJSON-1958960929 tempest-FlavorsAdminTestJSON-1958960929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042588 Aug 27 04:57:34.756567 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 750/1509] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:57:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:35.326138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:35.328502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:35.340252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-976bb2f2-8a33-494f-a65d-516aa5bf88ca tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:35.341191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-976bb2f2-8a33-494f-a65d-516aa5bf88ca tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:35.364283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:35.364793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:35.374783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:35.376306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-976bb2f2-8a33-494f-a65d-516aa5bf88ca tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:35.378083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:35.378994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-976bb2f2-8a33-494f-a65d-516aa5bf88ca tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:35.379568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:35.380680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-976bb2f2-8a33-494f-a65d-516aa5bf88ca tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:35.381211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:35.383689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-976bb2f2-8a33-494f-a65d-516aa5bf88ca tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:35.389183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-976bb2f2-8a33-494f-a65d-516aa5bf88ca tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:35.390106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-976bb2f2-8a33-494f-a65d-516aa5bf88ca tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:35.930213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-976bb2f2-8a33-494f-a65d-516aa5bf88ca tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:35.938991 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-976bb2f2-8a33-494f-a65d-516aa5bf88ca tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1473 microversion: 2.1 time: 0.603280 Aug 27 04:57:35.943810 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 751/1510] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:35 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1473 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:35.977603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:35.992115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:35.995066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:36.000931 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3cffe312-33c5-4799-9a00-966b56bf68ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.675457 Aug 27 04:57:36.002126 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 760/1511] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:35 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:36.274583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3fa6d0f5-8530-4edb-b3d1-eafce3aa6e34 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:36.277319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3fa6d0f5-8530-4edb-b3d1-eafce3aa6e34 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:36.288158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa6d0f5-8530-4edb-b3d1-eafce3aa6e34 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:36.289014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa6d0f5-8530-4edb-b3d1-eafce3aa6e34 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:36.289735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa6d0f5-8530-4edb-b3d1-eafce3aa6e34 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:36.299674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa6d0f5-8530-4edb-b3d1-eafce3aa6e34 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:36.300704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa6d0f5-8530-4edb-b3d1-eafce3aa6e34 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:36.301428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa6d0f5-8530-4edb-b3d1-eafce3aa6e34 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:36.376287 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3fa6d0f5-8530-4edb-b3d1-eafce3aa6e34 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106239 Aug 27 04:57:36.382231 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 752/1512] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 04:57:36 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:36.396255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-84b1eb91-834e-4d00-bff5-3cbb1a98cb81 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:36.396883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-84b1eb91-834e-4d00-bff5-3cbb1a98cb81 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:36.425233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84b1eb91-834e-4d00-bff5-3cbb1a98cb81 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:36.426505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84b1eb91-834e-4d00-bff5-3cbb1a98cb81 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:36.427634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84b1eb91-834e-4d00-bff5-3cbb1a98cb81 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:36.430041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84b1eb91-834e-4d00-bff5-3cbb1a98cb81 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:36.432231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84b1eb91-834e-4d00-bff5-3cbb1a98cb81 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:36.434683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84b1eb91-834e-4d00-bff5-3cbb1a98cb81 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:36.448258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d80309e1-130a-453b-bda1-adfbb5418e3b req-891c6af3-68ef-4e99-a3ea-30fdbcd89eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb8d618-f311-4f64-825c-f1816fe41876", "name": "network-vif-deleted", "tag": "35ed7764-fd62-4b34-a259-e6ca2280e1f2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:36.463363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d80309e1-130a-453b-bda1-adfbb5418e3b req-891c6af3-68ef-4e99-a3ea-30fdbcd89eb8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:36.463852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d80309e1-130a-453b-bda1-adfbb5418e3b req-891c6af3-68ef-4e99-a3ea-30fdbcd89eb8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:36.464292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d80309e1-130a-453b-bda1-adfbb5418e3b req-891c6af3-68ef-4e99-a3ea-30fdbcd89eb8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:36.566630 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d80309e1-130a-453b-bda1-adfbb5418e3b req-891c6af3-68ef-4e99-a3ea-30fdbcd89eb8 service nova] Creating event network-vif-deleted:35ed7764-fd62-4b34-a259-e6ca2280e1f2 for instance 0fb8d618-f311-4f64-825c-f1816fe41876 on n-h2-820368-35 Aug 27 04:57:36.584387 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d80309e1-130a-453b-bda1-adfbb5418e3b req-891c6af3-68ef-4e99-a3ea-30fdbcd89eb8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143672 Aug 27 04:57:36.591511 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 753/1513] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 04:57:36.902690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-84b1eb91-834e-4d00-bff5-3cbb1a98cb81 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lazy-loading 'services' on Instance uuid 87ea01df-9498-452f-b285-a3c01aa2fcae {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:57:36.967834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:36.968638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:36.983702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:36.985279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:36.986109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:36.987000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:36.987625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:36.988119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:37.036652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:37.037299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:37.037840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:37.038396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lazy-loading 'fault' on Instance uuid 0fb8d618-f311-4f64-825c-f1816fe41876 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:57:37.109089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:37.126322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:37.149575 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bcdb4d5e-556d-4611-8f9b-f6098d618dc8 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 200 len: 1307 microversion: 2.1 time: 0.182329 Aug 27 04:57:37.151180 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 754/1514] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:36 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 1307 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:37.168906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:37.171554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:37.182545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:37.188596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:37.189105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:37.189937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:37.190412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:37.190841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:37.465179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:37.475770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:37.478378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:37.479608 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-08c19861-1472-4eeb-aea4-98b14c1030f7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.327111 Aug 27 04:57:37.482432 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 755/1515] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:37 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:37.525574 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-84b1eb91-834e-4d00-bff5-3cbb1a98cb81 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "DELETE /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-volume_attachments/7d63e3d2-9aaa-48c4-8edc-587b39ab4b6a" status: 202 len: 0 microversion: 2.1 time: 1.136734 Aug 27 04:57:37.526589 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 761/1516] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 04:57:36 2022] DELETE /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-volume_attachments/7d63e3d2-9aaa-48c4-8edc-587b39ab4b6a => generated 0 bytes in 1139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:38.175331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:38.175949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: 0fb8d618-f311-4f64-825c-f1816fe41876] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:38.189422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:38.190578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:38.191213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:38.192135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:38.195359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:38.196089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:38.217949 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] HTTP exception thrown: Instance 0fb8d618-f311-4f64-825c-f1816fe41876 could not be found. Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Request method failure captured: Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 HTTP/1.1 Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaOr1v3A8YJA7M-zBbS-efm6dA6-jg1tufSGvf3kSgUgPqSoVm8rFty9M42vblOCr13BZQTyZ2NbbyjuN7pgxdoLmXckUeIVJiNGZdZAyqh062xo8MkkQGJ3ZVKt9LaZ_8lqXZ26nLeOY2WWoHn31sQVA55W53rj9UawzSonvgs6JKw Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: dc1919f166be4c6b9b3e2b79bf5ac906 Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ListImageFiltersTestJSON-845079345 Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:38.221264 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc1919f166be4c6b9b3e2b79bf5ac906", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc1919f166be4c6b9b3e2b79bf5ac906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1919f166be4c6b9b3e2b79bf5ac906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1919f166be4c6b9b3e2b79bf5ac906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ListImageFiltersTestJSON-845079345 Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: dc1919f166be4c6b9b3e2b79bf5ac906 Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-845079345 Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ListImageFiltersTestJSON-845079345-project Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: dfd207ef0074450894338b376ba462ee Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ListImageFiltersTestJSON-845079345-project Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 0fb8d618-f311-4f64-825c-f1816fe41876 could not be found. Aug 27 04:57:38.223351 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '0fb8d618-f311-4f64-825c-f1816fe41876'} Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb8d618-f311-4f64-825c-f1816fe41876 could not be found. Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:38.224635 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb8d618-f311-4f64-825c-f1816fe41876 could not be found. Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb8d618-f311-4f64-825c-f1816fe41876 could not be found. Aug 27 04:57:38.226333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:38.228962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Returning 404 to user: Instance 0fb8d618-f311-4f64-825c-f1816fe41876 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:38.228962 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-78e8b63a-23af-4439-8d37-73b4e0892371 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876" status: 404 len: 111 microversion: 2.1 time: 0.052196 Aug 27 04:57:38.228962 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 756/1517] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:38 2022] GET /compute/v2.1/servers/0fb8d618-f311-4f64-825c-f1816fe41876 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:38.233683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c1367212-3a1b-47b4-bc3b-2d84c8254f10 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:38.234275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c1367212-3a1b-47b4-bc3b-2d84c8254f10 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:38.247354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1367212-3a1b-47b4-bc3b-2d84c8254f10 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:38.249020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1367212-3a1b-47b4-bc3b-2d84c8254f10 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:38.249540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1367212-3a1b-47b4-bc3b-2d84c8254f10 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:38.250345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1367212-3a1b-47b4-bc3b-2d84c8254f10 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:38.250865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1367212-3a1b-47b4-bc3b-2d84c8254f10 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:38.251467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1367212-3a1b-47b4-bc3b-2d84c8254f10 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:38.292139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c1367212-3a1b-47b4-bc3b-2d84c8254f10 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:57:38.446937 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c1367212-3a1b-47b4-bc3b-2d84c8254f10 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738" status: 204 len: 0 microversion: 2.1 time: 0.217141 Aug 27 04:57:38.447813 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 762/1518] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:57:38 2022] DELETE /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:57:38.458396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fdc34a42-bab6-4c8c-9324-215b09301878 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:38.460726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fdc34a42-bab6-4c8c-9324-215b09301878 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:38.484082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc34a42-bab6-4c8c-9324-215b09301878 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:38.485843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc34a42-bab6-4c8c-9324-215b09301878 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:38.486583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc34a42-bab6-4c8c-9324-215b09301878 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:38.490199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc34a42-bab6-4c8c-9324-215b09301878 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:38.491985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc34a42-bab6-4c8c-9324-215b09301878 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:38.492775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc34a42-bab6-4c8c-9324-215b09301878 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:38.508899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:38.509627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:38.527984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:38.528681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:38.528947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:38.533060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:38.533704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:38.535426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:38.801426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fdc34a42-bab6-4c8c-9324-215b09301878 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:38.812364 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fdc34a42-bab6-4c8c-9324-215b09301878 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738" status: 200 len: 1472 microversion: 2.1 time: 0.359831 Aug 27 04:57:38.813534 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 757/1519] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:38 2022] GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738 => generated 1472 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:38.850368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:38.861674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:38.863611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:38.865167 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e98815b-e0c2-4c7d-a3d9-0972631d6615 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.363128 Aug 27 04:57:38.865996 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 763/1520] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:38 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:57:39.834966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60ef78ac-477a-4a8d-97f5-9a2b886e2bcc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:39.835765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60ef78ac-477a-4a8d-97f5-9a2b886e2bcc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:39.843172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ef78ac-477a-4a8d-97f5-9a2b886e2bcc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:39.844619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ef78ac-477a-4a8d-97f5-9a2b886e2bcc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:39.846010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ef78ac-477a-4a8d-97f5-9a2b886e2bcc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:39.847001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ef78ac-477a-4a8d-97f5-9a2b886e2bcc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:39.847756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ef78ac-477a-4a8d-97f5-9a2b886e2bcc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:39.848354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ef78ac-477a-4a8d-97f5-9a2b886e2bcc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:39.895274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:39.898070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:39.913871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:39.914650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:39.917635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:39.918639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:39.919397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:39.923805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:40.088600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-60ef78ac-477a-4a8d-97f5-9a2b886e2bcc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:40.099044 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-60ef78ac-477a-4a8d-97f5-9a2b886e2bcc tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738" status: 200 len: 1472 microversion: 2.1 time: 0.268959 Aug 27 04:57:40.099929 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 758/1521] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:39 2022] GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738 => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:40.162334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:40.175027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:40.176809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:40.178762 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-723b1d41-0b14-40e4-9726-aa41d89961e1 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.293607 Aug 27 04:57:40.180234 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 764/1522] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:39 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:41.121155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33a81e0c-db43-4c56-b4da-38a10f498a52 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:41.121707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-33a81e0c-db43-4c56-b4da-38a10f498a52 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:41.134735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33a81e0c-db43-4c56-b4da-38a10f498a52 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:41.135283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33a81e0c-db43-4c56-b4da-38a10f498a52 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:41.135753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33a81e0c-db43-4c56-b4da-38a10f498a52 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:41.136449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33a81e0c-db43-4c56-b4da-38a10f498a52 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:41.137138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33a81e0c-db43-4c56-b4da-38a10f498a52 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:41.138140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33a81e0c-db43-4c56-b4da-38a10f498a52 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:41.210336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:41.210963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:41.221750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:41.222294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:41.222705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:41.223483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:41.223953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:41.224424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:41.508113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:41.523662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:41.526514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:41.533721 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-23b52b08-c4ff-43e9-bc0d-0dc3202c8854 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.331975 Aug 27 04:57:41.540231 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 765/1523] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:41 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:57:41.561109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-33a81e0c-db43-4c56-b4da-38a10f498a52 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:41.571251 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-33a81e0c-db43-4c56-b4da-38a10f498a52 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738" status: 200 len: 1472 microversion: 2.1 time: 0.453315 Aug 27 04:57:41.572343 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 759/1524] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:41 2022] GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738 => generated 1472 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:41.831120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a1c257df-0e28-4d3e-bcc2-ffe94acd6a07 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Calling method '.version_select at 0x7fb565195430>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:41.835652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1c257df-0e28-4d3e-bcc2-ffe94acd6a07 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:41.836585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1c257df-0e28-4d3e-bcc2-ffe94acd6a07 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:41.837215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1c257df-0e28-4d3e-bcc2-ffe94acd6a07 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:41.838152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1c257df-0e28-4d3e-bcc2-ffe94acd6a07 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:41.838786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1c257df-0e28-4d3e-bcc2-ffe94acd6a07 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:41.839440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1c257df-0e28-4d3e-bcc2-ffe94acd6a07 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:41.870183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-51b772f7-2ea9-453a-be83-a18ff70661cc req-a43a1573-fc97-425a-b5eb-9c9e23687fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd002ec2-35f3-43fb-b976-ecb02f1b7738", "name": "network-vif-deleted", "tag": "4783370e-a485-40e1-8ea2-5a10e13b0d87"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:41.894107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-51b772f7-2ea9-453a-be83-a18ff70661cc req-a43a1573-fc97-425a-b5eb-9c9e23687fc7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:41.894742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-51b772f7-2ea9-453a-be83-a18ff70661cc req-a43a1573-fc97-425a-b5eb-9c9e23687fc7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:41.895875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-51b772f7-2ea9-453a-be83-a18ff70661cc req-a43a1573-fc97-425a-b5eb-9c9e23687fc7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:41.913367 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-51b772f7-2ea9-453a-be83-a18ff70661cc req-a43a1573-fc97-425a-b5eb-9c9e23687fc7 service nova] Creating event network-vif-deleted:4783370e-a485-40e1-8ea2-5a10e13b0d87 for instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 on n-h1-820368-35 Aug 27 04:57:41.919730 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a1c257df-0e28-4d3e-bcc2-ffe94acd6a07 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.323017 Aug 27 04:57:41.923201 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 766/1525] 10.222.0.58 () {58 vars in 1128 bytes} [Sat Aug 27 04:57:41 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:41.930565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-51b772f7-2ea9-453a-be83-a18ff70661cc req-a43a1573-fc97-425a-b5eb-9c9e23687fc7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054714 Aug 27 04:57:41.932586 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 760/1526] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:57:42.142801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82f520b9-7410-4e48-9a39-b2dbfc7be348 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Calling method '.version_select at 0x7fb5651850d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.147818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-82f520b9-7410-4e48-9a39-b2dbfc7be348 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '829e3f7df77d4729a30f8176ac8ec911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd595fd311d4639baa70d72106d78a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82f520b9-7410-4e48-9a39-b2dbfc7be348 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Request method failure captured: Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaRDyiROgBclTNVIBIz7IU4hr1imH32Wcml1zVkl1W8xI2COMSrBFR6vmDu92_7NcvgKSJkF8WHIu7D1GgjRql1HqiY94ln7rxUsj8gbaxhu2Y2q7fsyQZKyR5MqEWs85OO46SzTc2EitQhmgi-5BbnlHLW9FJflLifUlPb7ZDWSP_E Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:57:42.157547 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5dd595fd311d4639baa70d72106d78a2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 829e3f7df77d4729a30f8176ac8ec911 Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: action_args: {} Aug 27 04:57:42.159152 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:57:42.160110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 04:57:42.161902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.163338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82f520b9-7410-4e48-9a39-b2dbfc7be348 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.163338 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-82f520b9-7410-4e48-9a39-b2dbfc7be348 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.230620 Aug 27 04:57:42.163338 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 767/1527] 10.222.0.58 () {58 vars in 1128 bytes} [Sat Aug 27 04:57:41 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 232 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:42.170574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8ece87af-5429-429b-b1ea-e0b74c9f2a06 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Calling method '.version_select at 0x7fb5650d9040>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.174340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8ece87af-5429-429b-b1ea-e0b74c9f2a06 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '829e3f7df77d4729a30f8176ac8ec911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd595fd311d4639baa70d72106d78a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8ece87af-5429-429b-b1ea-e0b74c9f2a06 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Request method failure captured: Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-hosts/n-d-820368-35/reboot HTTP/1.1 Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRDyiROgBclTNVIBIz7IU4hr1imH32Wcml1zVkl1W8xI2COMSrBFR6vmDu92_7NcvgKSJkF8WHIu7D1GgjRql1HqiY94ln7rxUsj8gbaxhu2Y2q7fsyQZKyR5MqEWs85OO46SzTc2EitQhmgi-5BbnlHLW9FJflLifUlPb7ZDWSP_E Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:42.181165 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5dd595fd311d4639baa70d72106d78a2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 829e3f7df77d4729a30f8176ac8ec911 Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'n-d-820368-35'} Aug 27 04:57:42.183026 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:57:42.184150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 04:57:42.185799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.187284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8ece87af-5429-429b-b1ea-e0b74c9f2a06 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.190940 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8ece87af-5429-429b-b1ea-e0b74c9f2a06 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-820368-35/reboot" status: 403 len: 111 microversion: 2.1 time: 0.019629 Aug 27 04:57:42.191690 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 761/1528] 10.222.0.58 () {58 vars in 1191 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/os-hosts/n-d-820368-35/reboot => generated 111 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:42.202683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a4b00572-e170-419b-aabf-d0ba4a7927bb tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Calling method '.version_select at 0x7fb565195310>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.223762 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a4b00572-e170-419b-aabf-d0ba4a7927bb tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a4b00572-e170-419b-aabf-d0ba4a7927bb tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Request method failure captured: Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaRFYHgX2Bn0FxW1oAOhQlyyQVVI_TzVfRT6yR2z9Vo5tsNkpxH60IgFv-i1o6PGqEN58DFS8eaWLAxl2PULI75Pq0xt8lcr5T2ai16TKHFEG9EwiUTZK_p4tkprLWN75ITYS61aVOpviOiDatpnU8nYMAgSgfOJL4XvuA3HURs6WCo Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:57:42.226150 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a0f9c9cce074305b43d920b90088c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 35b9741627d047fab6d811d3630afec2 Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'nonexistent_hostname'} Aug 27 04:57:42.227974 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:57:42.229228 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 04:57:42.230622 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a4b00572-e170-419b-aabf-d0ba4a7927bb tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a4b00572-e170-419b-aabf-d0ba4a7927bb tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.030341 Aug 27 04:57:42.233163 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 768/1529] 10.222.0.58 () {58 vars in 1212 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:57:42.238175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d110c035-65e9-446c-9146-2d2baaf22b4c tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Calling method '.version_select at 0x7fb56500b4c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.240313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d110c035-65e9-446c-9146-2d2baaf22b4c tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '829e3f7df77d4729a30f8176ac8ec911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd595fd311d4639baa70d72106d78a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d110c035-65e9-446c-9146-2d2baaf22b4c tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Request method failure captured: Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-hosts/n-d-820368-35 HTTP/1.1 Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRDyiROgBclTNVIBIz7IU4hr1imH32Wcml1zVkl1W8xI2COMSrBFR6vmDu92_7NcvgKSJkF8WHIu7D1GgjRql1HqiY94ln7rxUsj8gbaxhu2Y2q7fsyQZKyR5MqEWs85OO46SzTc2EitQhmgi-5BbnlHLW9FJflLifUlPb7ZDWSP_E Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:42.244721 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5dd595fd311d4639baa70d72106d78a2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 829e3f7df77d4729a30f8176ac8ec911 Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'n-d-820368-35'} Aug 27 04:57:42.246224 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:57:42.247196 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 04:57:42.248737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.251373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d110c035-65e9-446c-9146-2d2baaf22b4c tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.253389 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d110c035-65e9-446c-9146-2d2baaf22b4c tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-820368-35" status: 403 len: 109 microversion: 2.1 time: 0.019888 Aug 27 04:57:42.254282 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 762/1530] 10.222.0.58 () {58 vars in 1170 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/os-hosts/n-d-820368-35 => generated 109 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:42.262876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-64e7467a-b622-42e5-804e-b83ade82465c tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Calling method '.version_select at 0x7fb5651a3e50>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.274145 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-64e7467a-b622-42e5-804e-b83ade82465c tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-64e7467a-b622-42e5-804e-b83ade82465c tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Request method failure captured: Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaRFYHgX2Bn0FxW1oAOhQlyyQVVI_TzVfRT6yR2z9Vo5tsNkpxH60IgFv-i1o6PGqEN58DFS8eaWLAxl2PULI75Pq0xt8lcr5T2ai16TKHFEG9EwiUTZK_p4tkprLWN75ITYS61aVOpviOiDatpnU8nYMAgSgfOJL4XvuA3HURs6WCo Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:57:42.282453 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a0f9c9cce074305b43d920b90088c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 35b9741627d047fab6d811d3630afec2 Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'nonexistent_hostname'} Aug 27 04:57:42.284183 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.285590 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.287932 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.290750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-64e7467a-b622-42e5-804e-b83ade82465c tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.290750 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-64e7467a-b622-42e5-804e-b83ade82465c tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.024986 Aug 27 04:57:42.298508 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 769/1531] 10.222.0.58 () {58 vars in 1191 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:57:42.308527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8529d0da-6a74-4366-8ad8-a03a5356a013 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Calling method '.version_select at 0x7fb565612700>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.310554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8529d0da-6a74-4366-8ad8-a03a5356a013 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '829e3f7df77d4729a30f8176ac8ec911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd595fd311d4639baa70d72106d78a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8529d0da-6a74-4366-8ad8-a03a5356a013 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Request method failure captured: Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-hosts/n-d-820368-35/shutdown HTTP/1.1 Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRDyiROgBclTNVIBIz7IU4hr1imH32Wcml1zVkl1W8xI2COMSrBFR6vmDu92_7NcvgKSJkF8WHIu7D1GgjRql1HqiY94ln7rxUsj8gbaxhu2Y2q7fsyQZKyR5MqEWs85OO46SzTc2EitQhmgi-5BbnlHLW9FJflLifUlPb7ZDWSP_E Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:42.312324 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5dd595fd311d4639baa70d72106d78a2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 829e3f7df77d4729a30f8176ac8ec911 Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'n-d-820368-35'} Aug 27 04:57:42.314174 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:57:42.315399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 04:57:42.316952 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.319286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8529d0da-6a74-4366-8ad8-a03a5356a013 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.319286 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8529d0da-6a74-4366-8ad8-a03a5356a013 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-820368-35/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.013506 Aug 27 04:57:42.327529 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 763/1532] 10.222.0.58 () {58 vars in 1197 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/os-hosts/n-d-820368-35/shutdown => generated 113 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:42.329163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb548baa-6f50-40ba-afe3-76719e8914b1 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Calling method '.version_select at 0x7fb565185c10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.343246 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-bb548baa-6f50-40ba-afe3-76719e8914b1 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb548baa-6f50-40ba-afe3-76719e8914b1 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Request method failure captured: Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaRFYHgX2Bn0FxW1oAOhQlyyQVVI_TzVfRT6yR2z9Vo5tsNkpxH60IgFv-i1o6PGqEN58DFS8eaWLAxl2PULI75Pq0xt8lcr5T2ai16TKHFEG9EwiUTZK_p4tkprLWN75ITYS61aVOpviOiDatpnU8nYMAgSgfOJL4XvuA3HURs6WCo Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:57:42.346535 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a0f9c9cce074305b43d920b90088c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 35b9741627d047fab6d811d3630afec2 Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'nonexistent_hostname'} Aug 27 04:57:42.348344 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:57:42.349307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 04:57:42.350706 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb548baa-6f50-40ba-afe3-76719e8914b1 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb548baa-6f50-40ba-afe3-76719e8914b1 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.023050 Aug 27 04:57:42.352483 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 770/1533] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:57:42.360439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d106d95-71ab-4eae-b3f3-eb1aff859976 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Calling method '.version_select at 0x7fb565870700>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.362423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d106d95-71ab-4eae-b3f3-eb1aff859976 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '829e3f7df77d4729a30f8176ac8ec911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd595fd311d4639baa70d72106d78a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d106d95-71ab-4eae-b3f3-eb1aff859976 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Request method failure captured: Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-hosts/n-d-820368-35/startup HTTP/1.1 Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRDyiROgBclTNVIBIz7IU4hr1imH32Wcml1zVkl1W8xI2COMSrBFR6vmDu92_7NcvgKSJkF8WHIu7D1GgjRql1HqiY94ln7rxUsj8gbaxhu2Y2q7fsyQZKyR5MqEWs85OO46SzTc2EitQhmgi-5BbnlHLW9FJflLifUlPb7ZDWSP_E Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:42.365903 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5dd595fd311d4639baa70d72106d78a2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 829e3f7df77d4729a30f8176ac8ec911 Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'n-d-820368-35'} Aug 27 04:57:42.367723 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:57:42.368676 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 04:57:42.370110 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.372109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d106d95-71ab-4eae-b3f3-eb1aff859976 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.372109 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0d106d95-71ab-4eae-b3f3-eb1aff859976 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-820368-35/startup" status: 403 len: 110 microversion: 2.1 time: 0.013024 Aug 27 04:57:42.372109 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 764/1534] 10.222.0.58 () {58 vars in 1194 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/os-hosts/n-d-820368-35/startup => generated 110 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:57:42.391553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-771ce43f-724a-4182-88bf-c4da2769712e tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Calling method '.version_select at 0x7fb5652060d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.404515 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-771ce43f-724a-4182-88bf-c4da2769712e tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-771ce43f-724a-4182-88bf-c4da2769712e tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Request method failure captured: Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaRFYHgX2Bn0FxW1oAOhQlyyQVVI_TzVfRT6yR2z9Vo5tsNkpxH60IgFv-i1o6PGqEN58DFS8eaWLAxl2PULI75Pq0xt8lcr5T2ai16TKHFEG9EwiUTZK_p4tkprLWN75ITYS61aVOpviOiDatpnU8nYMAgSgfOJL4XvuA3HURs6WCo Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:57:42.407187 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a0f9c9cce074305b43d920b90088c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 35b9741627d047fab6d811d3630afec2 Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'nonexistent_hostname'} Aug 27 04:57:42.409036 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:57:42.410098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 04:57:42.411502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-771ce43f-724a-4182-88bf-c4da2769712e tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-771ce43f-724a-4182-88bf-c4da2769712e tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.026491 Aug 27 04:57:42.413005 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 771/1535] 10.222.0.58 () {58 vars in 1215 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:57:42.418786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ac61e38-e74b-4663-bf91-363b8fcfcfb3 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Action: 'update', calling method: .version_select at 0x7fb5650dc940>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ac61e38-e74b-4663-bf91-363b8fcfcfb3 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Request method failure captured: Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: request: PUT /compute/v2.1/os-hosts/n-d-820368-35 HTTP/1.1 Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 51 Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRFYHgX2Bn0FxW1oAOhQlyyQVVI_TzVfRT6yR2z9Vo5tsNkpxH60IgFv-i1o6PGqEN58DFS8eaWLAxl2PULI75Pq0xt8lcr5T2ai16TKHFEG9EwiUTZK_p4tkprLWN75ITYS61aVOpviOiDatpnU8nYMAgSgfOJL4XvuA3HURs6WCo Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:57:42.423459 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a0f9c9cce074305b43d920b90088c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 35b9741627d047fab6d811d3630afec2 Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: {"status": "enable", "maintenance_mode": "invalid"} Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:57:42.425211 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'n-d-820368-35', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance: Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.426333 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.428290 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.429591 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.429591 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:57:42.429591 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:57:42.429591 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:57:42.429591 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.429591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ac61e38-e74b-4663-bf91-363b8fcfcfb3 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.429591 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5ac61e38-e74b-4663-bf91-363b8fcfcfb3 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-820368-35" status: 400 len: 199 microversion: 2.1 time: 0.010509 Aug 27 04:57:42.429591 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 765/1536] 10.222.0.58 () {60 vars in 1190 bytes} [Sat Aug 27 04:57:42 2022] PUT /compute/v2.1/os-hosts/n-d-820368-35 => generated 199 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:57:42.437179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-85c150ed-9ce2-49ac-b64b-a7ac1ec64ab0 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Action: 'update', calling method: .version_select at 0x7fb565185940>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-85c150ed-9ce2-49ac-b64b-a7ac1ec64ab0 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Request method failure captured: Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: request: PUT /compute/v2.1/os-hosts/n-d-820368-35 HTTP/1.1 Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 51 Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaRFYHgX2Bn0FxW1oAOhQlyyQVVI_TzVfRT6yR2z9Vo5tsNkpxH60IgFv-i1o6PGqEN58DFS8eaWLAxl2PULI75Pq0xt8lcr5T2ai16TKHFEG9EwiUTZK_p4tkprLWN75ITYS61aVOpviOiDatpnU8nYMAgSgfOJL4XvuA3HURs6WCo Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:57:42.442758 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a0f9c9cce074305b43d920b90088c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 35b9741627d047fab6d811d3630afec2 Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: {"status": "invalid", "maintenance_mode": "enable"} Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:57:42.444699 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'n-d-820368-35', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance: Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.445760 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.447845 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.449419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.449419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:57:42.449419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:57:42.449419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:57:42.449419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.449419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-85c150ed-9ce2-49ac-b64b-a7ac1ec64ab0 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.449419 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-85c150ed-9ce2-49ac-b64b-a7ac1ec64ab0 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-820368-35" status: 400 len: 189 microversion: 2.1 time: 0.013769 Aug 27 04:57:42.449419 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 772/1537] 10.222.0.58 () {60 vars in 1190 bytes} [Sat Aug 27 04:57:42 2022] PUT /compute/v2.1/os-hosts/n-d-820368-35 => generated 189 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:57:42.454489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a7ef0085-ef08-4c56-aa55-b1df7cf8ee34 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Action: 'update', calling method: .version_select at 0x7fb5650d9ca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:42.459638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a7ef0085-ef08-4c56-aa55-b1df7cf8ee34 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '829e3f7df77d4729a30f8176ac8ec911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd595fd311d4639baa70d72106d78a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a7ef0085-ef08-4c56-aa55-b1df7cf8ee34 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Request method failure captured: Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: request: PUT /compute/v2.1/os-hosts/n-d-820368-35 HTTP/1.1 Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 50 Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRDyiROgBclTNVIBIz7IU4hr1imH32Wcml1zVkl1W8xI2COMSrBFR6vmDu92_7NcvgKSJkF8WHIu7D1GgjRql1HqiY94ln7rxUsj8gbaxhu2Y2q7fsyQZKyR5MqEWs85OO46SzTc2EitQhmgi-5BbnlHLW9FJflLifUlPb7ZDWSP_E Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:42.461273 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5dd595fd311d4639baa70d72106d78a2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dd595fd311d4639baa70d72106d78a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 5dd595fd311d4639baa70d72106d78a2 Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-734278856 Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 829e3f7df77d4729a30f8176ac8ec911 Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-HostsAdminNegativeTestJSON-734278856-project Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 04:57:42.463082 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'n-d-820368-35', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:57:42.464238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 04:57:42.465714 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.466981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a7ef0085-ef08-4c56-aa55-b1df7cf8ee34 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.466981 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a7ef0085-ef08-4c56-aa55-b1df7cf8ee34 tempest-HostsAdminNegativeTestJSON-734278856 tempest-HostsAdminNegativeTestJSON-734278856-project] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-820368-35" status: 403 len: 111 microversion: 2.1 time: 0.012302 Aug 27 04:57:42.475947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4db0afef-099a-42ad-a632-09b608b133af tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Action: 'update', calling method: .version_select at 0x7fb56510adc0>, body: {"status": null, "maintenance_mode": null} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:42.477893 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 766/1538] 10.222.0.58 () {60 vars in 1190 bytes} [Sat Aug 27 04:57:42 2022] PUT /compute/v2.1/os-hosts/n-d-820368-35 => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4db0afef-099a-42ad-a632-09b608b133af tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Request method failure captured: Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: request: PUT /compute/v2.1/os-hosts/n-d-820368-35 HTTP/1.1 Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 42 Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaRFYHgX2Bn0FxW1oAOhQlyyQVVI_TzVfRT6yR2z9Vo5tsNkpxH60IgFv-i1o6PGqEN58DFS8eaWLAxl2PULI75Pq0xt8lcr5T2ai16TKHFEG9EwiUTZK_p4tkprLWN75ITYS61aVOpviOiDatpnU8nYMAgSgfOJL4XvuA3HURs6WCo Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 04:57:42.489700 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a0f9c9cce074305b43d920b90088c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 35b9741627d047fab6d811d3630afec2 Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: {"status": null, "maintenance_mode": null} Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 04:57:42.491705 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'n-d-820368-35', 'body': {'status': None, 'maintenance_mode': None}} Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance: Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi None Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.492898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.494910 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.496198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:57:42.496198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:57:42.496198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 04:57:42.496198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.496198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4db0afef-099a-42ad-a632-09b608b133af tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.496198 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4db0afef-099a-42ad-a632-09b608b133af tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-820368-35" status: 400 len: 127 microversion: 2.1 time: 0.019666 Aug 27 04:57:42.496198 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 773/1539] 10.222.0.58 () {60 vars in 1190 bytes} [Sat Aug 27 04:57:42 2022] PUT /compute/v2.1/os-hosts/n-d-820368-35 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:57:42.502086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-287ea124-7375-4360-9b27-08ce87933d48 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Action: 'update', calling method: .version_select at 0x7fb564f73a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:42.506668 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.hosts [None req-287ea124-7375-4360-9b27-08ce87933d48 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Enabling host nonexistent_hostname. Aug 27 04:57:42.517289 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-287ea124-7375-4360-9b27-08ce87933d48 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-287ea124-7375-4360-9b27-08ce87933d48 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Request method failure captured: Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 50 Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRFYHgX2Bn0FxW1oAOhQlyyQVVI_TzVfRT6yR2z9Vo5tsNkpxH60IgFv-i1o6PGqEN58DFS8eaWLAxl2PULI75Pq0xt8lcr5T2ai16TKHFEG9EwiUTZK_p4tkprLWN75ITYS61aVOpviOiDatpnU8nYMAgSgfOJL4XvuA3HURs6WCo Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:57:42.519330 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a0f9c9cce074305b43d920b90088c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a0f9c9cce074305b43d920b90088c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 4a0f9c9cce074305b43d920b90088c99 Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1716119658 Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 35b9741627d047fab6d811d3630afec2 Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1716119658-project-admin Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.521113 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:57:42.522394 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:57:42.524238 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:42.526422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-287ea124-7375-4360-9b27-08ce87933d48 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:42.527975 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-287ea124-7375-4360-9b27-08ce87933d48 tempest-HostsAdminNegativeTestJSON-1716119658 tempest-HostsAdminNegativeTestJSON-1716119658-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023331 Aug 27 04:57:42.527975 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 767/1540] 10.222.0.58 () {60 vars in 1211 bytes} [Sat Aug 27 04:57:42 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:57:42.563647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.564425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:42.595555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.596302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:42.602228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:42.602933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:42.611877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:42.612907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:42.613397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:42.613842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:42.616514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:42.617010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:42.622912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:42.623397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:42.624419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:42.624910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:42.625344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:42.687128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:42.687662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:42.688109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:42.688578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lazy-loading 'fault' on Instance uuid dd002ec2-35f3-43fb-b976-ecb02f1b7738 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:57:42.794133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd207ef0074450894338b376ba462ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1919f166be4c6b9b3e2b79bf5ac906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.811533 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b30fd9ca-3432-4916-bb82-3ea42e4a726a tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738" status: 200 len: 1306 microversion: 2.1 time: 0.218174 Aug 27 04:57:42.815053 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 768/1541] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738 => generated 1306 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:42.932958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.954694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.959139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.963626 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4b9fef2c-8607-4228-ba56-6952a79e0a01 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.403924 Aug 27 04:57:42.966078 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 774/1542] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:43.836570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:43.837197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] [instance: dd002ec2-35f3-43fb-b976-ecb02f1b7738] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:43.846340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:43.847366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:43.847927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:43.848995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:43.849453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:43.850223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:43.871403 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] HTTP exception thrown: Instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 could not be found. Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Request method failure captured: Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738 HTTP/1.1 Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaOr1v3A8YJA7M-zBbS-efm6dA6-jg1tufSGvf3kSgUgPqSoVm8rFty9M42vblOCr13BZQTyZ2NbbyjuN7pgxdoLmXckUeIVJiNGZdZAyqh062xo8MkkQGJ3ZVKt9LaZ_8lqXZ26nLeOY2WWoHn31sQVA55W53rj9UawzSonvgs6JKw Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: dc1919f166be4c6b9b3e2b79bf5ac906 Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ListImageFiltersTestJSON-845079345 Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:43.874182 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc1919f166be4c6b9b3e2b79bf5ac906", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc1919f166be4c6b9b3e2b79bf5ac906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1919f166be4c6b9b3e2b79bf5ac906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1919f166be4c6b9b3e2b79bf5ac906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ListImageFiltersTestJSON-845079345 Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: dc1919f166be4c6b9b3e2b79bf5ac906 Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-845079345 Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ListImageFiltersTestJSON-845079345-project Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: dfd207ef0074450894338b376ba462ee Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ListImageFiltersTestJSON-845079345-project Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 could not be found. Aug 27 04:57:43.875990 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'dd002ec2-35f3-43fb-b976-ecb02f1b7738'} Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 could not be found. Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:43.877134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 could not be found. Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 could not be found. Aug 27 04:57:43.878712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:43.880141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Returning 404 to user: Instance dd002ec2-35f3-43fb-b976-ecb02f1b7738 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:43.880141 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f080d538-4563-4547-96ce-b21c7e080573 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738" status: 404 len: 111 microversion: 2.1 time: 0.044483 Aug 27 04:57:43.880141 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 769/1543] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:43 2022] GET /compute/v2.1/servers/dd002ec2-35f3-43fb-b976-ecb02f1b7738 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:43.906925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9589bf87-cab5-4506-afcb-53b36bd9d433 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5651a3b80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:43.990205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:43.990952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:44.002470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.002985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.004038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.005021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.005666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.009083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.358442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:44.377325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:44.379738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:44.381367 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b7ce69a9-c149-4b34-a59f-3c1ac767e363 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.395718 Aug 27 04:57:44.383227 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 770/1544] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:43 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:57:44.394002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce9ebc9b-cde7-47b6-b8e0-dd36b9d879c0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:44.398737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ce9ebc9b-cde7-47b6-b8e0-dd36b9d879c0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:44.418192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce9ebc9b-cde7-47b6-b8e0-dd36b9d879c0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.420322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce9ebc9b-cde7-47b6-b8e0-dd36b9d879c0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.422325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce9ebc9b-cde7-47b6-b8e0-dd36b9d879c0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.431969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce9ebc9b-cde7-47b6-b8e0-dd36b9d879c0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.433133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce9ebc9b-cde7-47b6-b8e0-dd36b9d879c0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.433903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce9ebc9b-cde7-47b6-b8e0-dd36b9d879c0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.501353 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce9ebc9b-cde7-47b6-b8e0-dd36b9d879c0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116846 Aug 27 04:57:44.507127 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 771/1545] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 04:57:44 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:57:44.615377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24c02152-df19-4325-a2f3-3f9499c1e375 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:44.618606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-24c02152-df19-4325-a2f3-3f9499c1e375 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:44.630067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c02152-df19-4325-a2f3-3f9499c1e375 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.632623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c02152-df19-4325-a2f3-3f9499c1e375 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.636219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c02152-df19-4325-a2f3-3f9499c1e375 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.637254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c02152-df19-4325-a2f3-3f9499c1e375 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.639215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c02152-df19-4325-a2f3-3f9499c1e375 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.640005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c02152-df19-4325-a2f3-3f9499c1e375 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.644178 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9589bf87-cab5-4506-afcb-53b36bd9d433 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "DELETE /compute/v2.1/images/e1a86243-bf05-41c0-ab5e-80282ed8da4a" status: 204 len: 0 microversion: 2.1 time: 0.760569 Aug 27 04:57:44.647855 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 775/1546] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:43 2022] DELETE /compute/v2.1/images/e1a86243-bf05-41c0-ab5e-80282ed8da4a => generated 0 bytes in 764 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:57:44.654553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f318086d-e957-4617-b54e-7c9af19c7320 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb5650d3040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:44.701284 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-24c02152-df19-4325-a2f3-3f9499c1e375 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089718 Aug 27 04:57:44.709819 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 772/1547] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 04:57:44 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:57:44.814233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9a0216e4-d31d-47c1-ae77-f5dbb80193b2 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:44.814844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9a0216e4-d31d-47c1-ae77-f5dbb80193b2 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:44.834090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a0216e4-d31d-47c1-ae77-f5dbb80193b2 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.834090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a0216e4-d31d-47c1-ae77-f5dbb80193b2 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.834090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a0216e4-d31d-47c1-ae77-f5dbb80193b2 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.834090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a0216e4-d31d-47c1-ae77-f5dbb80193b2 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.834459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a0216e4-d31d-47c1-ae77-f5dbb80193b2 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.834459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a0216e4-d31d-47c1-ae77-f5dbb80193b2 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.867835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9a0216e4-d31d-47c1-ae77-f5dbb80193b2 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:57:44.996874 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9a0216e4-d31d-47c1-ae77-f5dbb80193b2 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "DELETE /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 204 len: 0 microversion: 2.1 time: 0.192369 Aug 27 04:57:44.997668 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 773/1548] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:57:44 2022] DELETE /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:57:45.009434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-618509c1-d7c6-46c9-a633-119f163a30e7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:45.010155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-618509c1-d7c6-46c9-a633-119f163a30e7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:45.017309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-618509c1-d7c6-46c9-a633-119f163a30e7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:45.018113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-618509c1-d7c6-46c9-a633-119f163a30e7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:45.019010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-618509c1-d7c6-46c9-a633-119f163a30e7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:45.019771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-618509c1-d7c6-46c9-a633-119f163a30e7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:45.020234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-618509c1-d7c6-46c9-a633-119f163a30e7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:45.021349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-618509c1-d7c6-46c9-a633-119f163a30e7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:45.176219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-618509c1-d7c6-46c9-a633-119f163a30e7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:45.185786 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-618509c1-d7c6-46c9-a633-119f163a30e7 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1682 microversion: 2.1 time: 0.182436 Aug 27 04:57:45.186726 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 774/1549] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:45 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:45.407420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:45.408373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:45.416115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:45.416891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:45.417584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:45.418513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:45.419304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:45.419965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:45.573509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:45.583971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:45.585948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:45.587160 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e51e1f6c-07af-4e87-b308-bf6558f325ff tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.184982 Aug 27 04:57:45.587810 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 775/1550] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:45 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:57:45.644770 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f318086d-e957-4617-b54e-7c9af19c7320 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "DELETE /compute/v2.1/images/b08ecac4-2e76-480e-8f24-fcbe168dd5c5" status: 204 len: 0 microversion: 2.1 time: 0.994162 Aug 27 04:57:45.645413 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 776/1551] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:44 2022] DELETE /compute/v2.1/images/b08ecac4-2e76-480e-8f24-fcbe168dd5c5 => generated 0 bytes in 995 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:57:45.657177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa5d336f-aa51-4595-b3fa-4afcdc4a34a9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] Calling method '.version_select at 0x7fb565191c10>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:46.208781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b91b3a1a-2273-4b24-9ac1-b9a8b6c3c57c tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:46.209444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b91b3a1a-2273-4b24-9ac1-b9a8b6c3c57c tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:46.222216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b91b3a1a-2273-4b24-9ac1-b9a8b6c3c57c tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:46.223175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b91b3a1a-2273-4b24-9ac1-b9a8b6c3c57c tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:46.224079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b91b3a1a-2273-4b24-9ac1-b9a8b6c3c57c tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:46.225762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b91b3a1a-2273-4b24-9ac1-b9a8b6c3c57c tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:46.226553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b91b3a1a-2273-4b24-9ac1-b9a8b6c3c57c tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:46.227233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b91b3a1a-2273-4b24-9ac1-b9a8b6c3c57c tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:46.332459 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aa5d336f-aa51-4595-b3fa-4afcdc4a34a9 tempest-ListImageFiltersTestJSON-845079345 tempest-ListImageFiltersTestJSON-845079345-project] 10.222.0.58 "DELETE /compute/v2.1/images/58616362-f7e6-4be6-875e-c4c3cd4cf72b" status: 204 len: 0 microversion: 2.1 time: 0.682129 Aug 27 04:57:46.333258 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 776/1552] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:45 2022] DELETE /compute/v2.1/images/58616362-f7e6-4be6-875e-c4c3cd4cf72b => generated 0 bytes in 684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:57:46.445647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b91b3a1a-2273-4b24-9ac1-b9a8b6c3c57c tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:46.456092 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b91b3a1a-2273-4b24-9ac1-b9a8b6c3c57c tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1682 microversion: 2.1 time: 0.251568 Aug 27 04:57:46.457305 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 777/1553] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:46 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1682 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:46.626144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:46.626996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:46.640469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:46.641161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:46.641769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:46.642570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:46.644915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:46.645369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:46.884587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9641fc56-4670-42ff-8493-036db5c7a6d6 req-f3f84cc6-fe7f-44ad-9436-a86b7708d0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c927e5-5b82-4fd6-8538-fe5456c92f9f", "name": "network-vif-unplugged", "status": "completed", "tag": "e042543b-f075-4259-b806-252f41c2843b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:46.895169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9641fc56-4670-42ff-8493-036db5c7a6d6 req-f3f84cc6-fe7f-44ad-9436-a86b7708d0d1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:46.895908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9641fc56-4670-42ff-8493-036db5c7a6d6 req-f3f84cc6-fe7f-44ad-9436-a86b7708d0d1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:46.896668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9641fc56-4670-42ff-8493-036db5c7a6d6 req-f3f84cc6-fe7f-44ad-9436-a86b7708d0d1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:46.901254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:46.914770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:46.918663 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9641fc56-4670-42ff-8493-036db5c7a6d6 req-f3f84cc6-fe7f-44ad-9436-a86b7708d0d1 service nova] Creating event network-vif-unplugged:e042543b-f075-4259-b806-252f41c2843b for instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f on n-h1-820368-35 Aug 27 04:57:46.918848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:46.926087 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9641fc56-4670-42ff-8493-036db5c7a6d6 req-f3f84cc6-fe7f-44ad-9436-a86b7708d0d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046155 Aug 27 04:57:46.926542 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f4eb170-1d14-4922-af61-58a7af39a79e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.309692 Aug 27 04:57:46.927556 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 778/1554] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:57:46.927682 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 777/1555] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:46 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:47.478707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9cf20b24-c1ac-4ccb-829e-b0e1c41c0f54 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:47.479419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9cf20b24-c1ac-4ccb-829e-b0e1c41c0f54 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:47.490344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cf20b24-c1ac-4ccb-829e-b0e1c41c0f54 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:47.490861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cf20b24-c1ac-4ccb-829e-b0e1c41c0f54 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:47.491309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cf20b24-c1ac-4ccb-829e-b0e1c41c0f54 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:47.493478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cf20b24-c1ac-4ccb-829e-b0e1c41c0f54 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:47.494184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cf20b24-c1ac-4ccb-829e-b0e1c41c0f54 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:47.494624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cf20b24-c1ac-4ccb-829e-b0e1c41c0f54 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:47.825318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9cf20b24-c1ac-4ccb-829e-b0e1c41c0f54 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:47.836913 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9cf20b24-c1ac-4ccb-829e-b0e1c41c0f54 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1682 microversion: 2.1 time: 0.362118 Aug 27 04:57:47.838198 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 778/1556] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:47 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1682 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:47.950950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:47.951739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:47.962271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:47.962271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:47.962600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:47.963572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:47.964094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:47.964537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:48.212844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:48.224138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:48.226355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:48.227863 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bd21ceea-ec78-49d7-b827-ad36335bd8e4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.281668 Aug 27 04:57:48.229003 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 779/1557] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:47 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:48.493015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-caa7a123-2f89-4ce7-aa6d-45509ddba7e7 req-2037d1ab-1066-442f-96bf-82e5a583982a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ea01df-9498-452f-b285-a3c01aa2fcae", "name": "network-vif-deleted", "tag": "05c43341-73e9-4a72-9a96-baad1ae0699a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:48.508806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-caa7a123-2f89-4ce7-aa6d-45509ddba7e7 req-2037d1ab-1066-442f-96bf-82e5a583982a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:48.510825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-caa7a123-2f89-4ce7-aa6d-45509ddba7e7 req-2037d1ab-1066-442f-96bf-82e5a583982a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:48.512732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-caa7a123-2f89-4ce7-aa6d-45509ddba7e7 req-2037d1ab-1066-442f-96bf-82e5a583982a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:48.547436 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-caa7a123-2f89-4ce7-aa6d-45509ddba7e7 req-2037d1ab-1066-442f-96bf-82e5a583982a service nova] Creating event network-vif-deleted:05c43341-73e9-4a72-9a96-baad1ae0699a for instance 87ea01df-9498-452f-b285-a3c01aa2fcae on n-h2-820368-35 Aug 27 04:57:48.556461 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-caa7a123-2f89-4ce7-aa6d-45509ddba7e7 req-2037d1ab-1066-442f-96bf-82e5a583982a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068839 Aug 27 04:57:48.557073 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 780/1558] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:57:48.705480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2a54ce71-c789-4488-861f-b51e35662709 tempest-QuotaClassesAdmin257Test-938372938 tempest-QuotaClassesAdmin257Test-938372938-project-admin] Calling method '.version_select at 0x7fb565d14160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:48.733088 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2a54ce71-c789-4488-861f-b51e35662709 tempest-QuotaClassesAdmin257Test-938372938 tempest-QuotaClassesAdmin257Test-938372938-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.480333 Aug 27 04:57:48.734509 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 779/1559] 10.222.0.58 () {60 vars in 1226 bytes} [Sat Aug 27 04:57:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:57:48.747345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c4b8d1e3-7955-4f3c-a966-d6facb8544b1 tempest-QuotaClassesAdmin257Test-938372938 tempest-QuotaClassesAdmin257Test-938372938-project-admin] Action: 'update', calling method: .version_select at 0x7fb5650dc550>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:48.859735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:48.860447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:48.875076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:48.875588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:48.876022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:48.876731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:48.877181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:48.877616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:48.933239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:48.964968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:48.965467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:48.965909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:48.966446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lazy-loading 'fault' on Instance uuid 87ea01df-9498-452f-b285-a3c01aa2fcae {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:57:49.004768 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c4b8d1e3-7955-4f3c-a966-d6facb8544b1 tempest-QuotaClassesAdmin257Test-938372938 tempest-QuotaClassesAdmin257Test-938372938-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.262998 Aug 27 04:57:49.006406 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 781/1560] 10.222.0.58 () {62 vars in 1247 bytes} [Sat Aug 27 04:57:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:57:49.012863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2270f1ab-d4ca-40dc-8be1-ddc8e421cf99 req-ea249fd6-0a99-4064-8a95-e28e9a692c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c927e5-5b82-4fd6-8538-fe5456c92f9f", "tag": "e042543b-f075-4259-b806-252f41c2843b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:49.024924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2270f1ab-d4ca-40dc-8be1-ddc8e421cf99 req-ea249fd6-0a99-4064-8a95-e28e9a692c36 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:49.025857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2270f1ab-d4ca-40dc-8be1-ddc8e421cf99 req-ea249fd6-0a99-4064-8a95-e28e9a692c36 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:49.026461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2270f1ab-d4ca-40dc-8be1-ddc8e421cf99 req-ea249fd6-0a99-4064-8a95-e28e9a692c36 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:49.039718 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2270f1ab-d4ca-40dc-8be1-ddc8e421cf99 req-ea249fd6-0a99-4064-8a95-e28e9a692c36 service nova] Creating event network-changed:e042543b-f075-4259-b806-252f41c2843b for instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f on n-h1-820368-35 Aug 27 04:57:49.045069 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2270f1ab-d4ca-40dc-8be1-ddc8e421cf99 req-ea249fd6-0a99-4064-8a95-e28e9a692c36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037251 Aug 27 04:57:49.045987 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 782/1561] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:49.051944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7eb50a06-346d-4363-8bff-229e4f2f662a tempest-QuotaClassesAdmin257Test-938372938 tempest-QuotaClassesAdmin257Test-938372938-project-admin] Calling method '.version_select at 0x7fb56512c820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:49.065643 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7eb50a06-346d-4363-8bff-229e4f2f662a tempest-QuotaClassesAdmin257Test-938372938 tempest-QuotaClassesAdmin257Test-938372938-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.017239 Aug 27 04:57:49.066409 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 783/1562] 10.222.0.58 () {60 vars in 1226 bytes} [Sat Aug 27 04:57:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:57:49.077882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9327ad9c2a544d968733a07f5139bf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9000246cdf0a492592d1c978ec3d48e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:49.078122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-34c22420-1fd3-4aa1-a4dd-5663ba53cf18 tempest-QuotaClassesAdmin257Test-938372938 tempest-QuotaClassesAdmin257Test-938372938-project-admin] Action: 'update', calling method: .version_select at 0x7fb565206af0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:49.088032 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e51c6e0a-33f0-4c2a-92b0-2d9f94b64235 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 200 len: 1331 microversion: 2.1 time: 0.232805 Aug 27 04:57:49.105487 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 780/1563] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:48 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 1331 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:49.193899 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-34c22420-1fd3-4aa1-a4dd-5663ba53cf18 tempest-QuotaClassesAdmin257Test-938372938 tempest-QuotaClassesAdmin257Test-938372938-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.118483 Aug 27 04:57:49.196156 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 784/1564] 10.222.0.58 () {62 vars in 1247 bytes} [Sat Aug 27 04:57:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:57:49.259485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:49.260393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:49.282402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:49.283365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:49.285316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:49.286310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:49.291294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:49.291755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:49.721048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:49.745430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:49.753026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:49.754840 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3bfcd932-d24b-4a7b-998a-274f39edc49c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.499455 Aug 27 04:57:49.757539 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 781/1565] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:49 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:50.115245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:50.116655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:50.127390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:50.128157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:50.129093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:50.130159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:50.130926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:50.132411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:50.152740 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] HTTP exception thrown: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Request method failure captured: Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae HTTP/1.1 Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaNXZ2l670xYpYrUoTcl-8mYc0Cm5Unahr6AlA2sxnhKVYt-muOPSNEBE0yaZfLrqo3HEFu7g2cnEhHwc_eqzzgshfKPaO9orYkEeiuOY4wS0SYPKaQ_LLS1sbiL-x66ljDqxOm4WGY5khSXJczPMZ_Sro-dGmIOw6BX8SVuPLSjfks Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 9000246cdf0a492592d1c978ec3d48e0 Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1384196113 Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:57:50.155466 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9000246cdf0a492592d1c978ec3d48e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9000246cdf0a492592d1c978ec3d48e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9000246cdf0a492592d1c978ec3d48e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9000246cdf0a492592d1c978ec3d48e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1384196113 Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 9000246cdf0a492592d1c978ec3d48e0 Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1384196113 Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachSCSIVolumeTestJSON-1384196113-project Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 9327ad9c2a544d968733a07f5139bf3b Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1384196113-project Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:50.157050 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '87ea01df-9498-452f-b285-a3c01aa2fcae'} Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:50.157877 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:50.159263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:50.161904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Returning 404 to user: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:50.163468 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-07c8de85-699f-4d80-be94-db2907bbaff0 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 404 len: 111 microversion: 2.1 time: 0.055210 Aug 27 04:57:50.164678 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 785/1566] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:50 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:50.174067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-76b83578-faf5-46ee-b53f-aaa09112287d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '.version_select at 0x7fb5650dc940>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:50.230763 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-76b83578-faf5-46ee-b53f-aaa09112287d tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1528187119" status: 202 len: 0 microversion: 2.1 time: 0.061574 Aug 27 04:57:50.231541 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 782/1567] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 04:57:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1528187119 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:50.783343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:50.784038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:50.802591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:50.803116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:50.803554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:50.804266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:50.804719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:50.805350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:51.314288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:51.331853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:51.333321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:51.339251 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f57900cf-a9b0-4388-8fd2-51da7970313a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.558403 Aug 27 04:57:51.341053 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 786/1568] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:50 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:57:52.367201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:52.368888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:52.404472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:52.404998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:52.405505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:52.406753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:52.408215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:52.414473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:52.796999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:52.818793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:52.825472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:52.830044 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-978c0db8-cd9d-4c04-a610-9c59f2baee6e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.467102 Aug 27 04:57:52.831377 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 783/1569] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:52 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:53.856881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:53.857497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:53.864952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:53.869188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:53.870798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:53.871459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:53.877406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:53.878147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:53.878756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:54.193895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:54.220110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:54.227440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:54.233913 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e3ad1881-8d2c-4ed5-90da-e157afb2fcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.379642 Aug 27 04:57:54.236172 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 787/1570] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:53 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:55.260800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:55.261427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:55.283393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:55.289953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:55.291257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:55.294051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:55.294548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:55.294963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:55.730638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:55.753312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:55.757637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:55.768594 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1fcac841-24b3-4081-a036-23ea52c3b4db tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.511961 Aug 27 04:57:55.772359 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 784/1571] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:55 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:55.792022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-493985039", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:55.812304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=79,nova_api:DELETE=3,nova_api:UPDATE=15 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:55.898052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:57:56.545087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:57:56.546959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:57:56.553332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:57:56.554772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:57:56.555415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:57:56.581960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:56.583567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:56.586034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:56.597665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:56.598489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:56.601788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:56.695323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Getting quotas for project 9c9b4a8740a14f9fbca3b63948d195e3. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:57:56.722745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Getting quotas for user 8a034099db9e45d8a675f6bea872e33a and project 9c9b4a8740a14f9fbca3b63948d195e3. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:57:56.760541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:57:56.762935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:57:56.805846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:56.807620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:56.814519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:56.829651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:56.830373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:56.831904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:56.832569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:56.833205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:56.934265 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba2630f4-e91d-47eb-b60f-8472d1701e81 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.395529 Aug 27 04:57:56.935821 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 788/1572] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:57:57.025863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1411829863", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:57.134828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:57:58.341707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:58.355905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:58.363078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:58.366117 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-889bd21e-cea1-4d53-83f7-0bfd0109c7cf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 1.573969 Aug 27 04:57:58.383132 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 785/1573] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:56 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:58.497224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:57:58.497682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:57:58.499966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:57:58.500578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:57:58.501001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:57:58.526919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:58.528220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:58.530751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:58.531761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:58.533540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:58.535143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:58.594103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Getting quotas for project 9c9b4a8740a14f9fbca3b63948d195e3. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:57:58.606800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Getting quotas for user 8a034099db9e45d8a675f6bea872e33a and project 9c9b4a8740a14f9fbca3b63948d195e3. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:57:58.661395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:57:58.663905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:57:58.825223 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d0a26768-fef4-46c4-af4f-c4bfab2bdc82 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.805961 Aug 27 04:57:58.834748 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 789/1574] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:57:58.845145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-298d63b9-89bb-4134-b3e0-cf72ed79e6ee tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:58.846163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-298d63b9-89bb-4134-b3e0-cf72ed79e6ee tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:58.848420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:59.057363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-298d63b9-89bb-4134-b3e0-cf72ed79e6ee tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:59.065421 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-298d63b9-89bb-4134-b3e0-cf72ed79e6ee tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1214 microversion: 2.1 time: 0.232631 Aug 27 04:57:59.066017 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 786/1575] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:58 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1214 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:59.213581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:59.214085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:59.229753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:59.231324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:59.231801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:59.232969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:59.232969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:59.233987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:59.326841 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] HTTP exception thrown: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Request method failure captured: Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae HTTP/1.1 Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaNXZ2l670xYpYrUoTcl-8mYc0Cm5Unahr6AlA2sxnhKVYt-muOPSNEBE0yaZfLrqo3HEFu7g2cnEhHwc_eqzzgshfKPaO9orYkEeiuOY4wS0SYPKaQ_LLS1sbiL-x66ljDqxOm4WGY5khSXJczPMZ_Sro-dGmIOw6BX8SVuPLSjfks Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 9000246cdf0a492592d1c978ec3d48e0 Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1384196113 Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:57:59.333591 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9000246cdf0a492592d1c978ec3d48e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9000246cdf0a492592d1c978ec3d48e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9000246cdf0a492592d1c978ec3d48e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9000246cdf0a492592d1c978ec3d48e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1384196113 Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 9000246cdf0a492592d1c978ec3d48e0 Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1384196113 Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachSCSIVolumeTestJSON-1384196113-project Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 9327ad9c2a544d968733a07f5139bf3b Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1384196113-project Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:59.335946 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '87ea01df-9498-452f-b285-a3c01aa2fcae'} Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:59.336847 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:59.338229 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:57:59.341370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Returning 404 to user: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:59.341370 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7a32626f-e4a4-4f7d-912c-2aed21fe4b67 tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "DELETE /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 404 len: 111 microversion: 2.1 time: 0.127924 Aug 27 04:57:59.346427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:59.347043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] [instance: 87ea01df-9498-452f-b285-a3c01aa2fcae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:59.355449 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 790/1576] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:57:59 2022] DELETE /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:57:59.357230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:59.357729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:59.358841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:59.359472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:59.359962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:59.360387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:59.392759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:59.393377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:59.401268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:59.403558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:59.406247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:59.408049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:59.409397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:59.411246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:59.431368 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] HTTP exception thrown: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Request method failure captured: Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae HTTP/1.1 Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaNXZ2l670xYpYrUoTcl-8mYc0Cm5Unahr6AlA2sxnhKVYt-muOPSNEBE0yaZfLrqo3HEFu7g2cnEhHwc_eqzzgshfKPaO9orYkEeiuOY4wS0SYPKaQ_LLS1sbiL-x66ljDqxOm4WGY5khSXJczPMZ_Sro-dGmIOw6BX8SVuPLSjfks Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 9000246cdf0a492592d1c978ec3d48e0 Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1384196113 Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:57:59.433069 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9000246cdf0a492592d1c978ec3d48e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9000246cdf0a492592d1c978ec3d48e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9000246cdf0a492592d1c978ec3d48e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9000246cdf0a492592d1c978ec3d48e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1384196113 Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 9000246cdf0a492592d1c978ec3d48e0 Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1384196113 Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachSCSIVolumeTestJSON-1384196113-project Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9327ad9c2a544d968733a07f5139bf3b Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1384196113-project Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:59.434916 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '87ea01df-9498-452f-b285-a3c01aa2fcae'} Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:59.435885 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. Aug 27 04:57:59.437609 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:57:59.439049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] Returning 404 to user: Instance 87ea01df-9498-452f-b285-a3c01aa2fcae could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:59.439049 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7fb91b98-07f1-46a7-8732-bb54d635ee4f tempest-AttachSCSIVolumeTestJSON-1384196113 tempest-AttachSCSIVolumeTestJSON-1384196113-project] 10.222.0.58 "GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae" status: 404 len: 111 microversion: 2.1 time: 0.092598 Aug 27 04:57:59.439049 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 787/1577] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:59 2022] GET /compute/v2.1/servers/87ea01df-9498-452f-b285-a3c01aa2fcae => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:58:00.086568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b85fc768-4dda-4e2a-afc5-d8f07f9c9640 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:00.087486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b85fc768-4dda-4e2a-afc5-d8f07f9c9640 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:00.109595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b85fc768-4dda-4e2a-afc5-d8f07f9c9640 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:00.110091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b85fc768-4dda-4e2a-afc5-d8f07f9c9640 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:00.110535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b85fc768-4dda-4e2a-afc5-d8f07f9c9640 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:00.111282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b85fc768-4dda-4e2a-afc5-d8f07f9c9640 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:00.131980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b85fc768-4dda-4e2a-afc5-d8f07f9c9640 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:00.132427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b85fc768-4dda-4e2a-afc5-d8f07f9c9640 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:00.454180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b85fc768-4dda-4e2a-afc5-d8f07f9c9640 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:00.467133 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b85fc768-4dda-4e2a-afc5-d8f07f9c9640 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1218 microversion: 2.1 time: 0.384843 Aug 27 04:58:00.467782 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 788/1578] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:00 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1218 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:00.578424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:00.612075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:00.616186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:00.619627 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0911804b-13c3-4549-91bc-dc29913ddcd6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 1.231524 Aug 27 04:58:00.625262 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 791/1579] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:59 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:58:01.492882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d26593d-cc8f-4374-acb9-b3b332f40b33 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:01.493505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d26593d-cc8f-4374-acb9-b3b332f40b33 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:01.524386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d26593d-cc8f-4374-acb9-b3b332f40b33 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:01.525185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d26593d-cc8f-4374-acb9-b3b332f40b33 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:01.525817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d26593d-cc8f-4374-acb9-b3b332f40b33 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:01.526854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d26593d-cc8f-4374-acb9-b3b332f40b33 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:01.531798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d26593d-cc8f-4374-acb9-b3b332f40b33 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:01.532526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d26593d-cc8f-4374-acb9-b3b332f40b33 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:01.654379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:01.657616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:01.681550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d26593d-cc8f-4374-acb9-b3b332f40b33 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:01.688105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:01.688859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:01.689319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:01.690522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:01.690998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:01.691466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:01.692969 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d26593d-cc8f-4374-acb9-b3b332f40b33 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1274 microversion: 2.1 time: 0.203621 Aug 27 04:58:01.695482 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 789/1580] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:01 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:02.278159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:02.291865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:02.294774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:02.297395 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f0ab5e6-1687-422b-930c-9f99c4c53e95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.647006 Aug 27 04:58:02.313097 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 792/1581] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:58:01 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:58:02.720702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fff2a6ad-677f-4ddb-b505-27ede6568e03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:02.721327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fff2a6ad-677f-4ddb-b505-27ede6568e03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:02.730598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fff2a6ad-677f-4ddb-b505-27ede6568e03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:02.731454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fff2a6ad-677f-4ddb-b505-27ede6568e03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:02.732223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fff2a6ad-677f-4ddb-b505-27ede6568e03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:02.734180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fff2a6ad-677f-4ddb-b505-27ede6568e03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:02.734872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fff2a6ad-677f-4ddb-b505-27ede6568e03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:02.735505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fff2a6ad-677f-4ddb-b505-27ede6568e03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:02.879318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fff2a6ad-677f-4ddb-b505-27ede6568e03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:02.888591 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fff2a6ad-677f-4ddb-b505-27ede6568e03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1272 microversion: 2.1 time: 0.177298 Aug 27 04:58:02.889182 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 790/1582] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:02 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:03.325916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:03.328587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:03.356720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:03.357236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:03.357687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:03.361435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:03.361922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:03.365153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:03.542423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:03.555327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:03.556250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:03.557479 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3de8a239-27ef-425c-a5f7-1460d4dcde06 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.237546 Aug 27 04:58:03.565694 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 793/1583] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:58:03 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:58:03.910598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-106ab0bf-e897-4b07-b8cf-059770f4c82e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:03.911887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-106ab0bf-e897-4b07-b8cf-059770f4c82e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:03.918966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106ab0bf-e897-4b07-b8cf-059770f4c82e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:03.919842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106ab0bf-e897-4b07-b8cf-059770f4c82e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:03.920822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106ab0bf-e897-4b07-b8cf-059770f4c82e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:03.921774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106ab0bf-e897-4b07-b8cf-059770f4c82e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:03.922489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106ab0bf-e897-4b07-b8cf-059770f4c82e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:03.923237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106ab0bf-e897-4b07-b8cf-059770f4c82e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:04.005738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-106ab0bf-e897-4b07-b8cf-059770f4c82e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:04.018142 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-106ab0bf-e897-4b07-b8cf-059770f4c82e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1272 microversion: 2.1 time: 0.111159 Aug 27 04:58:04.019513 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 791/1584] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:03 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:04.581306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:04.582514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:04.590396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:04.602605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:04.603458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:04.604393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:04.605012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:04.605627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:04.830818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:04.850362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:04.851835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:04.853030 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-453d7094-7adc-44ba-a4b6-8d6dbb7af171 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.275662 Aug 27 04:58:04.854096 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 794/1585] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:58:04 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:58:05.038904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89a903ec-1bea-4488-8a54-036563e89149 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:05.040290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89a903ec-1bea-4488-8a54-036563e89149 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:05.046855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:05.048861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a903ec-1bea-4488-8a54-036563e89149 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:05.049529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a903ec-1bea-4488-8a54-036563e89149 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:05.050235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a903ec-1bea-4488-8a54-036563e89149 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:05.051217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a903ec-1bea-4488-8a54-036563e89149 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:05.051834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a903ec-1bea-4488-8a54-036563e89149 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:05.053554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a903ec-1bea-4488-8a54-036563e89149 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:05.144388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89a903ec-1bea-4488-8a54-036563e89149 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:05.164650 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89a903ec-1bea-4488-8a54-036563e89149 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1272 microversion: 2.1 time: 0.126236 Aug 27 04:58:05.165394 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 792/1586] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:05 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:05.882933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:05.883800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:05.898302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:05.899099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:05.899742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:05.901097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:05.905227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:05.905672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:06.157854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:06.175447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:06.178447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:06.180144 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de2ae4a3-94df-45b7-88c8-c8be66afd1c6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.307295 Aug 27 04:58:06.181193 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 795/1587] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:58:05 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:58:06.186610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4da85008-7eb7-4e1f-bb2f-708e3fe556f6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:06.190026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4da85008-7eb7-4e1f-bb2f-708e3fe556f6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:06.206779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da85008-7eb7-4e1f-bb2f-708e3fe556f6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:06.210600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da85008-7eb7-4e1f-bb2f-708e3fe556f6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:06.212309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da85008-7eb7-4e1f-bb2f-708e3fe556f6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:06.213910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da85008-7eb7-4e1f-bb2f-708e3fe556f6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:06.214554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da85008-7eb7-4e1f-bb2f-708e3fe556f6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:06.215189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da85008-7eb7-4e1f-bb2f-708e3fe556f6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:06.739177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4da85008-7eb7-4e1f-bb2f-708e3fe556f6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:06.747816 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4da85008-7eb7-4e1f-bb2f-708e3fe556f6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1314 microversion: 2.1 time: 0.565405 Aug 27 04:58:06.748708 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 793/1588] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:06 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:07.209905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:07.211378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:07.233861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:07.235853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:07.236425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:07.237720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:07.238328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:07.238880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:07.769105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-017cbef4-746d-45d2-acab-bbd765a0e0a4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:07.770513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-017cbef4-746d-45d2-acab-bbd765a0e0a4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:07.779128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-017cbef4-746d-45d2-acab-bbd765a0e0a4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:07.791078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-017cbef4-746d-45d2-acab-bbd765a0e0a4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:07.791892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-017cbef4-746d-45d2-acab-bbd765a0e0a4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:07.792844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-017cbef4-746d-45d2-acab-bbd765a0e0a4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:07.793485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-017cbef4-746d-45d2-acab-bbd765a0e0a4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:07.794083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-017cbef4-746d-45d2-acab-bbd765a0e0a4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:08.174540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:08.189824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:08.192728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:08.196294 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-322a944e-27e0-438f-9b04-fcb0119c1674 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.990928 Aug 27 04:58:08.198535 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 796/1589] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:58:07 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:58:08.208738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-017cbef4-746d-45d2-acab-bbd765a0e0a4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:08.217949 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-017cbef4-746d-45d2-acab-bbd765a0e0a4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1314 microversion: 2.1 time: 0.453051 Aug 27 04:58:08.219615 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 794/1590] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:07 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:08.390560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4b8fd27f-5b3f-4448-a6f3-0f7003091b46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923-project-admin] Calling method '.version_select at 0x7fb5652e1d30>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:08.394531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b8fd27f-5b3f-4448-a6f3-0f7003091b46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:08.395880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b8fd27f-5b3f-4448-a6f3-0f7003091b46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:08.396557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b8fd27f-5b3f-4448-a6f3-0f7003091b46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:08.414347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b8fd27f-5b3f-4448-a6f3-0f7003091b46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:08.415509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b8fd27f-5b3f-4448-a6f3-0f7003091b46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:08.416450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b8fd27f-5b3f-4448-a6f3-0f7003091b46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:08.432797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b8fd27f-5b3f-4448-a6f3-0f7003091b46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:08.433536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b8fd27f-5b3f-4448-a6f3-0f7003091b46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:08.434246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b8fd27f-5b3f-4448-a6f3-0f7003091b46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:08.447460 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4b8fd27f-5b3f-4448-a6f3-0f7003091b46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1039725923-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.247258 Aug 27 04:58:08.447652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-3e4e2b0a-ebc9-4710-9ee5-afaeeaa69b97 req-b700e309-8663-4320-a51d-71c7b646750a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0722d6-d717-436e-b051-df3b185dddd5", "tag": "dc0145a6-c0bf-434f-b124-20af43f72b43"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:08.448070 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 797/1591] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:58:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:08.465279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3e4e2b0a-ebc9-4710-9ee5-afaeeaa69b97 req-b700e309-8663-4320-a51d-71c7b646750a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:08.467473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3e4e2b0a-ebc9-4710-9ee5-afaeeaa69b97 req-b700e309-8663-4320-a51d-71c7b646750a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:08.468241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3e4e2b0a-ebc9-4710-9ee5-afaeeaa69b97 req-b700e309-8663-4320-a51d-71c7b646750a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:08.484181 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-3e4e2b0a-ebc9-4710-9ee5-afaeeaa69b97 req-b700e309-8663-4320-a51d-71c7b646750a service nova] Creating event network-changed:dc0145a6-c0bf-434f-b124-20af43f72b43 for instance eb0722d6-d717-436e-b051-df3b185dddd5 on n-h1-820368-35 Aug 27 04:58:08.494949 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-3e4e2b0a-ebc9-4710-9ee5-afaeeaa69b97 req-b700e309-8663-4320-a51d-71c7b646750a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050730 Aug 27 04:58:08.496486 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 795/1592] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:09.224500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:09.225720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:09.228862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:09.229608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:09.238476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:09.244295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ff638bc-61a5-4d5d-bf30-0f42a1d3c432 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:09.245777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:09.246125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ff638bc-61a5-4d5d-bf30-0f42a1d3c432 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:09.246267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:09.246709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:09.247755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:09.249144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:09.249859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:09.255306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff638bc-61a5-4d5d-bf30-0f42a1d3c432 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:09.256478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff638bc-61a5-4d5d-bf30-0f42a1d3c432 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:09.257103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff638bc-61a5-4d5d-bf30-0f42a1d3c432 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:09.258781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff638bc-61a5-4d5d-bf30-0f42a1d3c432 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:09.259532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff638bc-61a5-4d5d-bf30-0f42a1d3c432 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:09.260201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff638bc-61a5-4d5d-bf30-0f42a1d3c432 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:09.872015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7ff638bc-61a5-4d5d-bf30-0f42a1d3c432 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:09.884919 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ff638bc-61a5-4d5d-bf30-0f42a1d3c432 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1314 microversion: 2.1 time: 0.649656 Aug 27 04:58:09.885162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:09.886165 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 796/1593] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:09 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:09.895901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:09.897336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:09.898517 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-66d5a9de-cc05-44b7-83ab-c139e787fcdb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1812 microversion: 2.25 time: 0.681290 Aug 27 04:58:09.899069 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 798/1594] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:58:09 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1812 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:58:10.544997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-26655de3-0ed7-41ab-b330-4db37eba158e req-21487926-4146-4693-8005-031c0e528e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880cf22b-b828-43db-9178-fb5e0229e5f6", "tag": "02b97725-ed60-47a3-9076-4587ce039a32"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:10.555830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26655de3-0ed7-41ab-b330-4db37eba158e req-21487926-4146-4693-8005-031c0e528e08 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:10.556521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26655de3-0ed7-41ab-b330-4db37eba158e req-21487926-4146-4693-8005-031c0e528e08 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:10.557140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26655de3-0ed7-41ab-b330-4db37eba158e req-21487926-4146-4693-8005-031c0e528e08 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:10.570682 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-26655de3-0ed7-41ab-b330-4db37eba158e req-21487926-4146-4693-8005-031c0e528e08 service nova] Creating event network-changed:02b97725-ed60-47a3-9076-4587ce039a32 for instance 880cf22b-b828-43db-9178-fb5e0229e5f6 on n-h2-820368-35 Aug 27 04:58:10.576763 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-26655de3-0ed7-41ab-b330-4db37eba158e req-21487926-4146-4693-8005-031c0e528e08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036910 Aug 27 04:58:10.577377 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 797/1595] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:10.912691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-04faf58c-0e15-445e-81aa-f007815bdfe4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:10.919688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-04faf58c-0e15-445e-81aa-f007815bdfe4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:10.923231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:10.923997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:10.936654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:10.937162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:10.937315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04faf58c-0e15-445e-81aa-f007815bdfe4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:10.937607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:10.938436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:10.938754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04faf58c-0e15-445e-81aa-f007815bdfe4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:10.938891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:10.939342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:10.943282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04faf58c-0e15-445e-81aa-f007815bdfe4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:10.945259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04faf58c-0e15-445e-81aa-f007815bdfe4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:10.946191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04faf58c-0e15-445e-81aa-f007815bdfe4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:10.946967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04faf58c-0e15-445e-81aa-f007815bdfe4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:11.926859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-04faf58c-0e15-445e-81aa-f007815bdfe4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:11.936545 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-04faf58c-0e15-445e-81aa-f007815bdfe4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1314 microversion: 2.1 time: 1.027855 Aug 27 04:58:11.937668 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 799/1596] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:10 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1314 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:11.987462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:11.996663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:11.999069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:12.000449 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6064de7a-6879-4a87-ab4f-09aed9dcaa8d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1802 microversion: 2.25 time: 1.082431 Aug 27 04:58:12.001125 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 798/1597] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:58:10 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1802 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:58:12.025181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-43363384-f2e9-49c7-b60d-956152be08fd tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '.version_select at 0x7fb56510aee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:12.028961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43363384-f2e9-49c7-b60d-956152be08fd tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:12.029532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43363384-f2e9-49c7-b60d-956152be08fd tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:12.030227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43363384-f2e9-49c7-b60d-956152be08fd tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:12.041516 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-43363384-f2e9-49c7-b60d-956152be08fd tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2380 microversion: 2.25 time: 0.021057 Aug 27 04:58:12.042222 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 800/1598] 10.222.0.58 () {60 vars in 1184 bytes} [Sat Aug 27 04:58:12 2022] GET /compute/v2.1/os-migrations => generated 2380 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:58:12.059168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-12c3cfbb-1c0b-4ce1-ac18-e22fe1e4d0c9 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:12.059905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-12c3cfbb-1c0b-4ce1-ac18-e22fe1e4d0c9 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:12.067415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c3cfbb-1c0b-4ce1-ac18-e22fe1e4d0c9 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:12.068015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c3cfbb-1c0b-4ce1-ac18-e22fe1e4d0c9 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:12.068627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c3cfbb-1c0b-4ce1-ac18-e22fe1e4d0c9 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:12.070278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c3cfbb-1c0b-4ce1-ac18-e22fe1e4d0c9 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:12.070992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c3cfbb-1c0b-4ce1-ac18-e22fe1e4d0c9 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:12.072055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c3cfbb-1c0b-4ce1-ac18-e22fe1e4d0c9 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:12.602080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-12c3cfbb-1c0b-4ce1-ac18-e22fe1e4d0c9 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid 71c927e5-5b82-4fd6-8538-fe5456c92f9f {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:58:12.635936 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-12c3cfbb-1c0b-4ce1-ac18-e22fe1e4d0c9 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 2423 microversion: 2.25 time: 0.579247 Aug 27 04:58:12.638071 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 799/1599] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:58:12 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 2423 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:58:12.664345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4b06c89c-cb98-4ceb-acff-c457e8a21a4a tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:12.665127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4b06c89c-cb98-4ceb-acff-c457e8a21a4a tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:12.675157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b06c89c-cb98-4ceb-acff-c457e8a21a4a tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:12.675789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b06c89c-cb98-4ceb-acff-c457e8a21a4a tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:12.676342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b06c89c-cb98-4ceb-acff-c457e8a21a4a tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:12.678847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b06c89c-cb98-4ceb-acff-c457e8a21a4a tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:12.679480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b06c89c-cb98-4ceb-acff-c457e8a21a4a tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:12.682132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b06c89c-cb98-4ceb-acff-c457e8a21a4a tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:12.725609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:12.958496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f491bf2-bb88-4658-ab36-860228642d44 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:12.960583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f491bf2-bb88-4658-ab36-860228642d44 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:12.970984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f491bf2-bb88-4658-ab36-860228642d44 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:12.971905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f491bf2-bb88-4658-ab36-860228642d44 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:12.972524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f491bf2-bb88-4658-ab36-860228642d44 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:12.980273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f491bf2-bb88-4658-ab36-860228642d44 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:12.981009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f491bf2-bb88-4658-ab36-860228642d44 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:12.981634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f491bf2-bb88-4658-ab36-860228642d44 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:13.023104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:13.349838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9f491bf2-bb88-4658-ab36-860228642d44 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:13.362185 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f491bf2-bb88-4658-ab36-860228642d44 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1314 microversion: 2.1 time: 0.407539 Aug 27 04:58:13.377238 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 800/1600] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:12 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:13.400454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-4b06c89c-cb98-4ceb-acff-c457e8a21a4a tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid 71c927e5-5b82-4fd6-8538-fe5456c92f9f {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:58:13.417265 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4b06c89c-cb98-4ceb-acff-c457e8a21a4a tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 2423 microversion: 2.25 time: 0.756645 Aug 27 04:58:13.418103 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 801/1601] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:58:12 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 2423 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:58:13.511078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9ccf2ad-b02b-4b79-b67a-c13d6c9005e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:13.511601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9ccf2ad-b02b-4b79-b67a-c13d6c9005e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:13.521118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ccf2ad-b02b-4b79-b67a-c13d6c9005e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:13.521579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ccf2ad-b02b-4b79-b67a-c13d6c9005e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:13.522026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ccf2ad-b02b-4b79-b67a-c13d6c9005e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:13.530503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ccf2ad-b02b-4b79-b67a-c13d6c9005e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:13.531424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ccf2ad-b02b-4b79-b67a-c13d6c9005e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:13.532636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9ccf2ad-b02b-4b79-b67a-c13d6c9005e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:13.735607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-f9ccf2ad-b02b-4b79-b67a-c13d6c9005e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lazy-loading 'services' on Instance uuid 71c927e5-5b82-4fd6-8538-fe5456c92f9f {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:58:13.928198 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9ccf2ad-b02b-4b79-b67a-c13d6c9005e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "DELETE /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments/24693607-5d61-434b-92db-d85e8107c515" status: 202 len: 0 microversion: 2.25 time: 0.421187 Aug 27 04:58:13.929070 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 801/1602] 10.222.0.58 () {60 vars in 1457 bytes} [Sat Aug 27 04:58:13 2022] DELETE /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments/24693607-5d61-434b-92db-d85e8107c515 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:58:13.941735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-691c16cf-a4d6-409b-a12a-3034ccde9a86 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:13.948833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-691c16cf-a4d6-409b-a12a-3034ccde9a86 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:13.965787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691c16cf-a4d6-409b-a12a-3034ccde9a86 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:13.969631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691c16cf-a4d6-409b-a12a-3034ccde9a86 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:13.970400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691c16cf-a4d6-409b-a12a-3034ccde9a86 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:13.971495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691c16cf-a4d6-409b-a12a-3034ccde9a86 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:13.972235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691c16cf-a4d6-409b-a12a-3034ccde9a86 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:13.972836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691c16cf-a4d6-409b-a12a-3034ccde9a86 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:14.034883 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-691c16cf-a4d6-409b-a12a-3034ccde9a86 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.099022 Aug 27 04:58:14.041753 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 802/1603] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:58:13 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:58:14.385421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65f75ddd-c764-4f0f-af44-ae9ce6c9edc0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:14.386283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-65f75ddd-c764-4f0f-af44-ae9ce6c9edc0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:14.393435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f75ddd-c764-4f0f-af44-ae9ce6c9edc0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:14.394199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f75ddd-c764-4f0f-af44-ae9ce6c9edc0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:14.395252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f75ddd-c764-4f0f-af44-ae9ce6c9edc0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:14.396314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f75ddd-c764-4f0f-af44-ae9ce6c9edc0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:14.397010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f75ddd-c764-4f0f-af44-ae9ce6c9edc0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:14.397665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f75ddd-c764-4f0f-af44-ae9ce6c9edc0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:15.048104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2592217c-38d7-4825-abfd-03ee3a8a31ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:15.050480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2592217c-38d7-4825-abfd-03ee3a8a31ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:15.060219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2592217c-38d7-4825-abfd-03ee3a8a31ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:15.062587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2592217c-38d7-4825-abfd-03ee3a8a31ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:15.063946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2592217c-38d7-4825-abfd-03ee3a8a31ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:15.065394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2592217c-38d7-4825-abfd-03ee3a8a31ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:15.070386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2592217c-38d7-4825-abfd-03ee3a8a31ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:15.071122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2592217c-38d7-4825-abfd-03ee3a8a31ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:15.113252 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2592217c-38d7-4825-abfd-03ee3a8a31ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.068848 Aug 27 04:58:15.119444 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 803/1604] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:58:15 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:58:15.272752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-65f75ddd-c764-4f0f-af44-ae9ce6c9edc0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:15.285460 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-65f75ddd-c764-4f0f-af44-ae9ce6c9edc0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1314 microversion: 2.1 time: 0.902692 Aug 27 04:58:15.288970 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 802/1605] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:14 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1314 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:16.127082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-595a102e-377f-48e2-b577-14bf0b6851d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:16.130294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-595a102e-377f-48e2-b577-14bf0b6851d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:16.148850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595a102e-377f-48e2-b577-14bf0b6851d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:16.149356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595a102e-377f-48e2-b577-14bf0b6851d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:16.149799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595a102e-377f-48e2-b577-14bf0b6851d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:16.150533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595a102e-377f-48e2-b577-14bf0b6851d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:16.150994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595a102e-377f-48e2-b577-14bf0b6851d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:16.151457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595a102e-377f-48e2-b577-14bf0b6851d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:16.242664 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-595a102e-377f-48e2-b577-14bf0b6851d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119961 Aug 27 04:58:16.245811 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 804/1606] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:58:16 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:58:16.309693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0345d2b5-e865-46a0-a663-c8f2fea939af tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:16.311055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0345d2b5-e865-46a0-a663-c8f2fea939af tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:16.325018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0345d2b5-e865-46a0-a663-c8f2fea939af tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:16.325802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0345d2b5-e865-46a0-a663-c8f2fea939af tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:16.333485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0345d2b5-e865-46a0-a663-c8f2fea939af tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:16.334991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0345d2b5-e865-46a0-a663-c8f2fea939af tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:16.337059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0345d2b5-e865-46a0-a663-c8f2fea939af tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:16.339424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0345d2b5-e865-46a0-a663-c8f2fea939af tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:16.762200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0345d2b5-e865-46a0-a663-c8f2fea939af tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:16.799430 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0345d2b5-e865-46a0-a663-c8f2fea939af tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1314 microversion: 2.1 time: 0.492657 Aug 27 04:58:16.804045 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 803/1607] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:16 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:17.260262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2bbc9a30-8645-41cb-a36a-7a21c66dd671 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:17.261912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2bbc9a30-8645-41cb-a36a-7a21c66dd671 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:17.293587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bbc9a30-8645-41cb-a36a-7a21c66dd671 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.295291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bbc9a30-8645-41cb-a36a-7a21c66dd671 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.300017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bbc9a30-8645-41cb-a36a-7a21c66dd671 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.300806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bbc9a30-8645-41cb-a36a-7a21c66dd671 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.301295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bbc9a30-8645-41cb-a36a-7a21c66dd671 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.301736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bbc9a30-8645-41cb-a36a-7a21c66dd671 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.384300 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2bbc9a30-8645-41cb-a36a-7a21c66dd671 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.130990 Aug 27 04:58:17.395485 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 805/1608] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:58:17 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:58:17.543446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-a36df68a-4cde-475c-a8b0-3f14ed1e57c5 req-f30836b2-ef20-4a6b-b600-637aef484bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0722d6-d717-436e-b051-df3b185dddd5", "name": "network-vif-plugged", "status": "completed", "tag": "dc0145a6-c0bf-434f-b124-20af43f72b43"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:17.574335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a36df68a-4cde-475c-a8b0-3f14ed1e57c5 req-f30836b2-ef20-4a6b-b600-637aef484bd4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.574943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a36df68a-4cde-475c-a8b0-3f14ed1e57c5 req-f30836b2-ef20-4a6b-b600-637aef484bd4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.584763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a36df68a-4cde-475c-a8b0-3f14ed1e57c5 req-f30836b2-ef20-4a6b-b600-637aef484bd4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.618226 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-a36df68a-4cde-475c-a8b0-3f14ed1e57c5 req-f30836b2-ef20-4a6b-b600-637aef484bd4 service nova] Creating event network-vif-plugged:dc0145a6-c0bf-434f-b124-20af43f72b43 for instance eb0722d6-d717-436e-b051-df3b185dddd5 on n-h1-820368-35 Aug 27 04:58:17.628162 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-a36df68a-4cde-475c-a8b0-3f14ed1e57c5 req-f30836b2-ef20-4a6b-b600-637aef484bd4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086826 Aug 27 04:58:17.629473 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 804/1609] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:17.837195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-937ae987-9b10-4531-8017-8805d431ccd1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:17.838223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-937ae987-9b10-4531-8017-8805d431ccd1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:17.852696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-937ae987-9b10-4531-8017-8805d431ccd1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.853483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-937ae987-9b10-4531-8017-8805d431ccd1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.854159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-937ae987-9b10-4531-8017-8805d431ccd1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.856498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-937ae987-9b10-4531-8017-8805d431ccd1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.857441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-937ae987-9b10-4531-8017-8805d431ccd1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.861288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-937ae987-9b10-4531-8017-8805d431ccd1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:18.394604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-937ae987-9b10-4531-8017-8805d431ccd1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:18.403122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6b077d1f-ac39-42bc-b5b2-ddde836fd603 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:18.406008 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-937ae987-9b10-4531-8017-8805d431ccd1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1314 microversion: 2.1 time: 0.578873 Aug 27 04:58:18.406315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6b077d1f-ac39-42bc-b5b2-ddde836fd603 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:18.406975 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 806/1610] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:17 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:18.413833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b077d1f-ac39-42bc-b5b2-ddde836fd603 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:18.414847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b077d1f-ac39-42bc-b5b2-ddde836fd603 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:18.415545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b077d1f-ac39-42bc-b5b2-ddde836fd603 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:18.416522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b077d1f-ac39-42bc-b5b2-ddde836fd603 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:18.417221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b077d1f-ac39-42bc-b5b2-ddde836fd603 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:18.417877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b077d1f-ac39-42bc-b5b2-ddde836fd603 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:18.459950 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6b077d1f-ac39-42bc-b5b2-ddde836fd603 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066385 Aug 27 04:58:18.467276 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 805/1611] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:58:18 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:58:19.426276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd0b88ac-769c-4c20-b17d-9374514581eb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:19.427564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cd0b88ac-769c-4c20-b17d-9374514581eb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:19.441681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd0b88ac-769c-4c20-b17d-9374514581eb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:19.442499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd0b88ac-769c-4c20-b17d-9374514581eb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:19.443186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd0b88ac-769c-4c20-b17d-9374514581eb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:19.444383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd0b88ac-769c-4c20-b17d-9374514581eb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:19.445038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd0b88ac-769c-4c20-b17d-9374514581eb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:19.445645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd0b88ac-769c-4c20-b17d-9374514581eb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:19.473788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6108a5f4-e22a-4443-8437-ab4b04ded827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:19.476850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6108a5f4-e22a-4443-8437-ab4b04ded827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:19.490634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6108a5f4-e22a-4443-8437-ab4b04ded827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:19.502498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6108a5f4-e22a-4443-8437-ab4b04ded827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:19.507803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6108a5f4-e22a-4443-8437-ab4b04ded827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:19.508836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6108a5f4-e22a-4443-8437-ab4b04ded827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:19.509491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6108a5f4-e22a-4443-8437-ab4b04ded827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:19.509930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6108a5f4-e22a-4443-8437-ab4b04ded827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:19.589265 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6108a5f4-e22a-4443-8437-ab4b04ded827 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119339 Aug 27 04:58:19.590229 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 806/1612] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:58:19 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:58:19.831979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-cd20ddb7-3f82-4095-97ca-9b19946f9be0 req-1f8f89e3-fea4-498f-afc2-e20039eff158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880cf22b-b828-43db-9178-fb5e0229e5f6", "name": "network-vif-plugged", "status": "completed", "tag": "02b97725-ed60-47a3-9076-4587ce039a32"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:19.852572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cd20ddb7-3f82-4095-97ca-9b19946f9be0 req-1f8f89e3-fea4-498f-afc2-e20039eff158 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:19.852971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cd20ddb7-3f82-4095-97ca-9b19946f9be0 req-1f8f89e3-fea4-498f-afc2-e20039eff158 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:19.853451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cd20ddb7-3f82-4095-97ca-9b19946f9be0 req-1f8f89e3-fea4-498f-afc2-e20039eff158 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:19.882007 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-cd20ddb7-3f82-4095-97ca-9b19946f9be0 req-1f8f89e3-fea4-498f-afc2-e20039eff158 service nova] Creating event network-vif-plugged:02b97725-ed60-47a3-9076-4587ce039a32 for instance 880cf22b-b828-43db-9178-fb5e0229e5f6 on n-h2-820368-35 Aug 27 04:58:19.892770 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-cd20ddb7-3f82-4095-97ca-9b19946f9be0 req-1f8f89e3-fea4-498f-afc2-e20039eff158 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064631 Aug 27 04:58:19.896239 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 807/1613] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:58:20.460280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cd0b88ac-769c-4c20-b17d-9374514581eb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:20.468224 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cd0b88ac-769c-4c20-b17d-9374514581eb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1314 microversion: 2.1 time: 1.045788 Aug 27 04:58:20.468753 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 807/1614] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:19 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1314 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:20.604033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d6cfaa3-683c-4cd3-92d2-35c2d558363d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:20.606006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d6cfaa3-683c-4cd3-92d2-35c2d558363d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:20.626992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d6cfaa3-683c-4cd3-92d2-35c2d558363d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:20.627528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d6cfaa3-683c-4cd3-92d2-35c2d558363d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:20.627979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d6cfaa3-683c-4cd3-92d2-35c2d558363d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:20.628694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d6cfaa3-683c-4cd3-92d2-35c2d558363d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:20.629155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d6cfaa3-683c-4cd3-92d2-35c2d558363d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:20.629586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d6cfaa3-683c-4cd3-92d2-35c2d558363d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:20.711389 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d6cfaa3-683c-4cd3-92d2-35c2d558363d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112799 Aug 27 04:58:20.711992 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 808/1615] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:58:20 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:58:21.489878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d211e493-31ec-41e6-b33c-7160b25f69ab tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:21.489878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d211e493-31ec-41e6-b33c-7160b25f69ab tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:21.502231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d211e493-31ec-41e6-b33c-7160b25f69ab tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.502619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d211e493-31ec-41e6-b33c-7160b25f69ab tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.503058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d211e493-31ec-41e6-b33c-7160b25f69ab tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.503813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d211e493-31ec-41e6-b33c-7160b25f69ab tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.504274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d211e493-31ec-41e6-b33c-7160b25f69ab tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.504704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d211e493-31ec-41e6-b33c-7160b25f69ab tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.728764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-86d67e29-10e2-44cc-aef1-e76ed28a04ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:21.732583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-86d67e29-10e2-44cc-aef1-e76ed28a04ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:21.749975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d67e29-10e2-44cc-aef1-e76ed28a04ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.752016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d67e29-10e2-44cc-aef1-e76ed28a04ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.752669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d67e29-10e2-44cc-aef1-e76ed28a04ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.762340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d67e29-10e2-44cc-aef1-e76ed28a04ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.765075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d67e29-10e2-44cc-aef1-e76ed28a04ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.765727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d67e29-10e2-44cc-aef1-e76ed28a04ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.877149 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-86d67e29-10e2-44cc-aef1-e76ed28a04ef tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.157056 Aug 27 04:58:21.891506 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 809/1616] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:58:21 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:58:22.368327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d211e493-31ec-41e6-b33c-7160b25f69ab tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:22.385244 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d211e493-31ec-41e6-b33c-7160b25f69ab tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1314 microversion: 2.1 time: 0.899704 Aug 27 04:58:22.401387 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 808/1617] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:21 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1314 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:22.891158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f47ba33e-c030-4c25-962e-5b005bce67ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:22.893949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f47ba33e-c030-4c25-962e-5b005bce67ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:22.927966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47ba33e-c030-4c25-962e-5b005bce67ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:22.931659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47ba33e-c030-4c25-962e-5b005bce67ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:22.932500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47ba33e-c030-4c25-962e-5b005bce67ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:22.934146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47ba33e-c030-4c25-962e-5b005bce67ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:22.945985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47ba33e-c030-4c25-962e-5b005bce67ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:22.952897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47ba33e-c030-4c25-962e-5b005bce67ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:23.009093 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f47ba33e-c030-4c25-962e-5b005bce67ae tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.123298 Aug 27 04:58:23.015916 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 810/1618] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 04:58:22 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:23.408706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d2c93993-d691-4930-8834-ac8b5ee37c4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:23.410395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d2c93993-d691-4930-8834-ac8b5ee37c4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:23.426920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2c93993-d691-4930-8834-ac8b5ee37c4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:23.427374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2c93993-d691-4930-8834-ac8b5ee37c4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:23.427833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2c93993-d691-4930-8834-ac8b5ee37c4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:23.428566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2c93993-d691-4930-8834-ac8b5ee37c4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:23.429035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2c93993-d691-4930-8834-ac8b5ee37c4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:23.429477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2c93993-d691-4930-8834-ac8b5ee37c4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:23.827819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d2c93993-d691-4930-8834-ac8b5ee37c4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:23.855588 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d2c93993-d691-4930-8834-ac8b5ee37c4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1464 microversion: 2.1 time: 0.453492 Aug 27 04:58:23.867778 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 809/1619] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:23 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1464 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:23.880635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8fab5568-277e-4b4b-bed4-fab0715f73a3 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:23.881619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8fab5568-277e-4b4b-bed4-fab0715f73a3 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:23.891958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fab5568-277e-4b4b-bed4-fab0715f73a3 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:23.892626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fab5568-277e-4b4b-bed4-fab0715f73a3 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:23.894053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fab5568-277e-4b4b-bed4-fab0715f73a3 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:23.895498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fab5568-277e-4b4b-bed4-fab0715f73a3 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:23.898007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fab5568-277e-4b4b-bed4-fab0715f73a3 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:23.898921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fab5568-277e-4b4b-bed4-fab0715f73a3 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:24.163977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8fab5568-277e-4b4b-bed4-fab0715f73a3 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:24.177360 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8fab5568-277e-4b4b-bed4-fab0715f73a3 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1463 microversion: 2.1 time: 0.302226 Aug 27 04:58:24.187172 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 811/1620] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:23 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:24.468722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1470237331", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "eb0722d6-d717-436e-b051-df3b185dddd5"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:24.598111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:58:25.054155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:58:25.054585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:58:25.055068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:58:25.056359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:58:25.056975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:58:25.067741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:25.068698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:25.072524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:25.073735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:25.074393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:25.075660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:25.152086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Getting quotas for project 9c9b4a8740a14f9fbca3b63948d195e3. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:58:25.173405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Getting quotas for user 8a034099db9e45d8a675f6bea872e33a and project 9c9b4a8740a14f9fbca3b63948d195e3. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:58:25.217991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:58:25.220772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:58:25.325062 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f89627d-8a78-4e8a-8abe-b227f9b28359 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863173 Aug 27 04:58:25.327332 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 810/1621] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:58:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:58:25.338195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ea67247c-3958-434c-abec-3c1396fa3d37 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:25.338753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ea67247c-3958-434c-abec-3c1396fa3d37 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:25.524861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ea67247c-3958-434c-abec-3c1396fa3d37 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:25.533530 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ea67247c-3958-434c-abec-3c1396fa3d37 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1214 microversion: 2.1 time: 0.199397 Aug 27 04:58:25.534110 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 812/1622] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:25 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:26.571974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8b342fc-547c-4ba4-a112-c320da06db95 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:26.576006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f8b342fc-547c-4ba4-a112-c320da06db95 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:26.593162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:26.598280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b342fc-547c-4ba4-a112-c320da06db95 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:26.600583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b342fc-547c-4ba4-a112-c320da06db95 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:26.601987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b342fc-547c-4ba4-a112-c320da06db95 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:26.605693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b342fc-547c-4ba4-a112-c320da06db95 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:26.607762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b342fc-547c-4ba4-a112-c320da06db95 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:26.608672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b342fc-547c-4ba4-a112-c320da06db95 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:26.907120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f8b342fc-547c-4ba4-a112-c320da06db95 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:26.931641 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8b342fc-547c-4ba4-a112-c320da06db95 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1210 microversion: 2.1 time: 0.365382 Aug 27 04:58:26.932251 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 811/1623] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:26 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1210 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:27.956111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-995f303b-11d4-448e-af6f-a5abab2476ef tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:27.957740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-995f303b-11d4-448e-af6f-a5abab2476ef tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:27.979375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995f303b-11d4-448e-af6f-a5abab2476ef tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.983347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995f303b-11d4-448e-af6f-a5abab2476ef tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.985635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995f303b-11d4-448e-af6f-a5abab2476ef tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:27.989369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995f303b-11d4-448e-af6f-a5abab2476ef tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.990287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995f303b-11d4-448e-af6f-a5abab2476ef tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.992853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995f303b-11d4-448e-af6f-a5abab2476ef tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:28.121346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-995f303b-11d4-448e-af6f-a5abab2476ef tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:28.133671 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-995f303b-11d4-448e-af6f-a5abab2476ef tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1284 microversion: 2.1 time: 0.183235 Aug 27 04:58:28.136552 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 813/1624] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:27 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:29.157957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cac9825f-e4c7-45f4-afda-5035419ec2a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:29.160387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cac9825f-e4c7-45f4-afda-5035419ec2a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:29.177441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac9825f-e4c7-45f4-afda-5035419ec2a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:29.180668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac9825f-e4c7-45f4-afda-5035419ec2a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:29.182728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac9825f-e4c7-45f4-afda-5035419ec2a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:29.184452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac9825f-e4c7-45f4-afda-5035419ec2a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:29.186675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac9825f-e4c7-45f4-afda-5035419ec2a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:29.187371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cac9825f-e4c7-45f4-afda-5035419ec2a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:29.334095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cac9825f-e4c7-45f4-afda-5035419ec2a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:29.346330 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cac9825f-e4c7-45f4-afda-5035419ec2a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1272 microversion: 2.1 time: 0.192547 Aug 27 04:58:29.348591 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 812/1625] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:29 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:30.370532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a33530f7-3175-4a69-b911-e2a20959d8ad tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:30.373461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a33530f7-3175-4a69-b911-e2a20959d8ad tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:30.387429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a33530f7-3175-4a69-b911-e2a20959d8ad tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:30.389841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a33530f7-3175-4a69-b911-e2a20959d8ad tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:30.390681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a33530f7-3175-4a69-b911-e2a20959d8ad tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:30.391646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a33530f7-3175-4a69-b911-e2a20959d8ad tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:30.394374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a33530f7-3175-4a69-b911-e2a20959d8ad tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:30.395069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a33530f7-3175-4a69-b911-e2a20959d8ad tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:30.776778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a33530f7-3175-4a69-b911-e2a20959d8ad tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:30.793413 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a33530f7-3175-4a69-b911-e2a20959d8ad tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1314 microversion: 2.1 time: 0.427599 Aug 27 04:58:30.795915 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 814/1626] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:30 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:31.424825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-43c87cdd-9c1c-45c1-a196-e7f99f4cdda7 req-064a465e-dc94-4408-9abc-07215deb110d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55a29c81-2946-4132-a3a3-c7a53b508cd9", "tag": "311e69d6-d905-4ef0-8a7c-36dea5177757"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:31.490584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-43c87cdd-9c1c-45c1-a196-e7f99f4cdda7 req-064a465e-dc94-4408-9abc-07215deb110d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:31.491412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-43c87cdd-9c1c-45c1-a196-e7f99f4cdda7 req-064a465e-dc94-4408-9abc-07215deb110d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:31.491873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-43c87cdd-9c1c-45c1-a196-e7f99f4cdda7 req-064a465e-dc94-4408-9abc-07215deb110d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:31.526335 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-43c87cdd-9c1c-45c1-a196-e7f99f4cdda7 req-064a465e-dc94-4408-9abc-07215deb110d service nova] Creating event network-changed:311e69d6-d905-4ef0-8a7c-36dea5177757 for instance 55a29c81-2946-4132-a3a3-c7a53b508cd9 on n-h1-820368-35 Aug 27 04:58:31.543487 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-43c87cdd-9c1c-45c1-a196-e7f99f4cdda7 req-064a465e-dc94-4408-9abc-07215deb110d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120040 Aug 27 04:58:31.549232 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 813/1627] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:31.817503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-84147b04-7f07-4c13-9001-59b5bee9ff71 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:31.818328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-84147b04-7f07-4c13-9001-59b5bee9ff71 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:31.835713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84147b04-7f07-4c13-9001-59b5bee9ff71 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:31.836453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84147b04-7f07-4c13-9001-59b5bee9ff71 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:31.837519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84147b04-7f07-4c13-9001-59b5bee9ff71 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:31.843362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84147b04-7f07-4c13-9001-59b5bee9ff71 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:31.845659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84147b04-7f07-4c13-9001-59b5bee9ff71 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:31.846673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84147b04-7f07-4c13-9001-59b5bee9ff71 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:32.281668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-84147b04-7f07-4c13-9001-59b5bee9ff71 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:32.291224 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-84147b04-7f07-4c13-9001-59b5bee9ff71 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1314 microversion: 2.1 time: 0.478199 Aug 27 04:58:32.295200 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 815/1628] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:31 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:33.318864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-25d85b78-0a8c-4278-9c37-21c0c32838d1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:33.320402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25d85b78-0a8c-4278-9c37-21c0c32838d1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:33.347552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25d85b78-0a8c-4278-9c37-21c0c32838d1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:33.349460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25d85b78-0a8c-4278-9c37-21c0c32838d1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:33.351238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25d85b78-0a8c-4278-9c37-21c0c32838d1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:33.353859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25d85b78-0a8c-4278-9c37-21c0c32838d1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:33.355020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25d85b78-0a8c-4278-9c37-21c0c32838d1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:33.355992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25d85b78-0a8c-4278-9c37-21c0c32838d1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:33.832878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-25d85b78-0a8c-4278-9c37-21c0c32838d1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:33.844342 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-25d85b78-0a8c-4278-9c37-21c0c32838d1 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1314 microversion: 2.1 time: 0.531588 Aug 27 04:58:33.845297 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 814/1629] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:33 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:34.866779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89fb6473-8f81-421b-8607-510088de57a6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:34.867807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89fb6473-8f81-421b-8607-510088de57a6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:34.890615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89fb6473-8f81-421b-8607-510088de57a6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:34.891041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89fb6473-8f81-421b-8607-510088de57a6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:34.891781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89fb6473-8f81-421b-8607-510088de57a6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:34.894895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89fb6473-8f81-421b-8607-510088de57a6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:34.895647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89fb6473-8f81-421b-8607-510088de57a6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:34.896242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89fb6473-8f81-421b-8607-510088de57a6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:35.274407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89fb6473-8f81-421b-8607-510088de57a6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:35.285204 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89fb6473-8f81-421b-8607-510088de57a6 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1314 microversion: 2.1 time: 0.423101 Aug 27 04:58:35.300904 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 816/1630] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:34 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:36.310190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-79de9212-6964-413a-ad3d-e143dd546e80 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:36.311690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-79de9212-6964-413a-ad3d-e143dd546e80 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:36.324141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:36.326517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:36.332840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79de9212-6964-413a-ad3d-e143dd546e80 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:36.333778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79de9212-6964-413a-ad3d-e143dd546e80 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:36.335974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79de9212-6964-413a-ad3d-e143dd546e80 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:36.337038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79de9212-6964-413a-ad3d-e143dd546e80 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:36.338757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79de9212-6964-413a-ad3d-e143dd546e80 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:36.341096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79de9212-6964-413a-ad3d-e143dd546e80 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:37.375394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-79de9212-6964-413a-ad3d-e143dd546e80 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:37.398334 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-79de9212-6964-413a-ad3d-e143dd546e80 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1314 microversion: 2.1 time: 1.093011 Aug 27 04:58:37.398961 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 815/1631] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:36 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1314 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:38.422940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bafdac49-20dc-4ad0-ad09-60329fed1041 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:38.423579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bafdac49-20dc-4ad0-ad09-60329fed1041 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:38.425690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:38.428691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=52 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:38.460504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bafdac49-20dc-4ad0-ad09-60329fed1041 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:38.464395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bafdac49-20dc-4ad0-ad09-60329fed1041 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:38.465744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bafdac49-20dc-4ad0-ad09-60329fed1041 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:38.467910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bafdac49-20dc-4ad0-ad09-60329fed1041 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:38.469507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bafdac49-20dc-4ad0-ad09-60329fed1041 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:38.471804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bafdac49-20dc-4ad0-ad09-60329fed1041 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:39.313185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bafdac49-20dc-4ad0-ad09-60329fed1041 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:39.356324 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bafdac49-20dc-4ad0-ad09-60329fed1041 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1314 microversion: 2.1 time: 0.936816 Aug 27 04:58:39.358947 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 817/1632] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:38 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:40.387055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-980d167c-8d0c-424f-855b-18cdb20a59b7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:40.392683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-980d167c-8d0c-424f-855b-18cdb20a59b7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:40.422535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-980d167c-8d0c-424f-855b-18cdb20a59b7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:40.422928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-980d167c-8d0c-424f-855b-18cdb20a59b7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:40.423601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-980d167c-8d0c-424f-855b-18cdb20a59b7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:40.425003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-980d167c-8d0c-424f-855b-18cdb20a59b7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:40.428814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-980d167c-8d0c-424f-855b-18cdb20a59b7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:40.429485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-980d167c-8d0c-424f-855b-18cdb20a59b7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:40.901427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-736a02bd-2497-4e8d-9a80-c3eda4609a7b req-d69a1f66-d1da-4ca8-a290-024ca6b423c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a29c81-2946-4132-a3a3-c7a53b508cd9", "name": "network-vif-plugged", "status": "completed", "tag": "311e69d6-d905-4ef0-8a7c-36dea5177757"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:40.931725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-980d167c-8d0c-424f-855b-18cdb20a59b7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:40.935884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-736a02bd-2497-4e8d-9a80-c3eda4609a7b req-d69a1f66-d1da-4ca8-a290-024ca6b423c2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:40.936697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-736a02bd-2497-4e8d-9a80-c3eda4609a7b req-d69a1f66-d1da-4ca8-a290-024ca6b423c2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:40.937367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-736a02bd-2497-4e8d-9a80-c3eda4609a7b req-d69a1f66-d1da-4ca8-a290-024ca6b423c2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:40.940021 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-980d167c-8d0c-424f-855b-18cdb20a59b7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1314 microversion: 2.1 time: 0.560735 Aug 27 04:58:40.954936 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 816/1633] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:40 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:40.967079 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-736a02bd-2497-4e8d-9a80-c3eda4609a7b req-d69a1f66-d1da-4ca8-a290-024ca6b423c2 service nova] Creating event network-vif-plugged:311e69d6-d905-4ef0-8a7c-36dea5177757 for instance 55a29c81-2946-4132-a3a3-c7a53b508cd9 on n-h1-820368-35 Aug 27 04:58:40.980139 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-736a02bd-2497-4e8d-9a80-c3eda4609a7b req-d69a1f66-d1da-4ca8-a290-024ca6b423c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081230 Aug 27 04:58:40.983730 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 818/1634] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:58:41.961674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-37b9e29a-38fc-4878-986c-597f607eb932 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:41.962296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-37b9e29a-38fc-4878-986c-597f607eb932 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:41.973617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b9e29a-38fc-4878-986c-597f607eb932 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:41.974123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b9e29a-38fc-4878-986c-597f607eb932 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:41.974552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b9e29a-38fc-4878-986c-597f607eb932 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:41.975296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b9e29a-38fc-4878-986c-597f607eb932 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:41.975754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b9e29a-38fc-4878-986c-597f607eb932 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:41.976179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37b9e29a-38fc-4878-986c-597f607eb932 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:42.363217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9ca8a3d2-30b6-41e0-9028-54b8232554e4 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Action: 'create', calling method: .version_select at 0x7fb5654969d0>, body: {"pool": null} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:42.380111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-37b9e29a-38fc-4878-986c-597f607eb932 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:42.410672 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-37b9e29a-38fc-4878-986c-597f607eb932 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1314 microversion: 2.1 time: 0.452818 Aug 27 04:58:42.411610 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 817/1635] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:41 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:43.433372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9cf4c06b-3c3d-4599-8199-87bd7a2b3050 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:43.434644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9cf4c06b-3c3d-4599-8199-87bd7a2b3050 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:43.464231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9cf4c06b-3c3d-4599-8199-87bd7a2b3050 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:43.466580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9cf4c06b-3c3d-4599-8199-87bd7a2b3050 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:43.468337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9cf4c06b-3c3d-4599-8199-87bd7a2b3050 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:43.470777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9cf4c06b-3c3d-4599-8199-87bd7a2b3050 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:43.472859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9cf4c06b-3c3d-4599-8199-87bd7a2b3050 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:43.474444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9cf4c06b-3c3d-4599-8199-87bd7a2b3050 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:43.517590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=96 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:44.469249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9cf4c06b-3c3d-4599-8199-87bd7a2b3050 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:44.481671 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9cf4c06b-3c3d-4599-8199-87bd7a2b3050 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1314 microversion: 2.1 time: 1.052674 Aug 27 04:58:44.491380 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 818/1636] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:43 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1314 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:45.418833 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9ca8a3d2-30b6-41e0-9028-54b8232554e4 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.331429 Aug 27 04:58:45.420240 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 819/1637] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 04:58:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:58:45.433072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fdc18f94-90dc-450e-ad11-14b4e0515f29 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Calling method '.version_select at 0x7fb5652cfd30>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:45.526475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-000daebb-b8f5-4904-8b15-15b3442b0289 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:45.526475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-000daebb-b8f5-4904-8b15-15b3442b0289 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:45.538079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000daebb-b8f5-4904-8b15-15b3442b0289 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:45.540317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000daebb-b8f5-4904-8b15-15b3442b0289 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:45.542883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000daebb-b8f5-4904-8b15-15b3442b0289 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:45.547030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000daebb-b8f5-4904-8b15-15b3442b0289 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:45.548284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000daebb-b8f5-4904-8b15-15b3442b0289 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:45.557766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000daebb-b8f5-4904-8b15-15b3442b0289 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:45.616465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:45.961426 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fdc18f94-90dc-450e-ad11-14b4e0515f29 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/e3c8ff3a-3d95-4dc1-884d-007b482ca388" status: 200 len: 142 microversion: 2.1 time: 0.532537 Aug 27 04:58:45.964055 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 819/1638] 10.222.0.58 () {58 vars in 1260 bytes} [Sat Aug 27 04:58:45 2022] GET /compute/v2.1/os-floating-ips/e3c8ff3a-3d95-4dc1-884d-007b482ca388 => generated 142 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:45.979665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-000daebb-b8f5-4904-8b15-15b3442b0289 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:45.988121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-888e6201-dcf8-4fe9-b408-9715232fb9c6 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Calling method '.version_select at 0x7fb5651a3d30>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:46.009792 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-000daebb-b8f5-4904-8b15-15b3442b0289 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1464 microversion: 2.1 time: 0.489908 Aug 27 04:58:46.011724 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 820/1639] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:45 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1464 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:46.508440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4cfe3179-689d-455a-a9d3-f47264ed8267 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:46.517194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4cfe3179-689d-455a-a9d3-f47264ed8267 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Searching by: {'deleted': False, 'project_id': '67531b37d1384299b2dc1defe983ff44'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:58:46.527800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cfe3179-689d-455a-a9d3-f47264ed8267 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:46.531464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cfe3179-689d-455a-a9d3-f47264ed8267 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:46.532579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cfe3179-689d-455a-a9d3-f47264ed8267 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:46.533422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cfe3179-689d-455a-a9d3-f47264ed8267 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:46.534073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cfe3179-689d-455a-a9d3-f47264ed8267 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:46.536223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cfe3179-689d-455a-a9d3-f47264ed8267 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:46.589195 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4cfe3179-689d-455a-a9d3-f47264ed8267 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.554014 Aug 27 04:58:46.590641 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 821/1640] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 04:58:46 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:58:46.612730 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-888e6201-dcf8-4fe9-b408-9715232fb9c6 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.638772 Aug 27 04:58:46.614140 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 820/1641] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 04:58:45 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:46.616112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:46.624219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Searching by: {'deleted': False} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:58:46.626966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-489dc722-3700-4ee9-b06d-d11801e7b3e2 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Calling method '.version_select at 0x7fb5652ba700>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:46.631582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:46.634150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:46.635006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:46.636662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:46.637401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:46.638017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:46.804268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:58:46.928546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:46.929101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:46.929545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:48.334181 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e10ba59d-b62d-49a3-a198-5bf880e71d1a tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16848 microversion: 2.1 time: 1.724898 Aug 27 04:58:48.335885 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 822/1642] 10.222.0.58 () {58 vars in 1171 bytes} [Sat Aug 27 04:58:46 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16848 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:58:48.378560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-561cfe1d-007a-4090-b8ee-5347607ea06b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:48.385437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-561cfe1d-007a-4090-b8ee-5347607ea06b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Searching by: {'deleted': False, 'project_id': '67531b37d1384299b2dc1defe983ff44'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:58:48.406290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561cfe1d-007a-4090-b8ee-5347607ea06b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:48.406872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561cfe1d-007a-4090-b8ee-5347607ea06b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:48.407367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561cfe1d-007a-4090-b8ee-5347607ea06b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:48.408177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561cfe1d-007a-4090-b8ee-5347607ea06b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:48.408671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561cfe1d-007a-4090-b8ee-5347607ea06b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:48.409145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561cfe1d-007a-4090-b8ee-5347607ea06b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:48.502571 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-561cfe1d-007a-4090-b8ee-5347607ea06b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?tenant_id=9c9b4a8740a14f9fbca3b63948d195e3" status: 200 len: 15 microversion: 2.1 time: 0.127631 Aug 27 04:58:48.512394 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 823/1643] 10.222.0.58 () {58 vars in 1231 bytes} [Sat Aug 27 04:58:48 2022] GET /compute/v2.1/servers/detail?tenant_id=9c9b4a8740a14f9fbca3b63948d195e3 => generated 15 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:58:48.535644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:48.542649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Searching by: {'tenant_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'deleted': False} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:58:48.555120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:48.555923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:48.556453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:48.557546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:48.558071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:48.558576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:48.601452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:58:48.730125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:48.733152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:48.734114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.063351 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3e605770-3d25-4143-ae89-810d1a87a344 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9c9b4a8740a14f9fbca3b63948d195e3" status: 200 len: 4833 microversion: 2.1 time: 0.531985 Aug 27 04:58:49.065795 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 824/1644] 10.222.0.58 () {58 vars in 1257 bytes} [Sat Aug 27 04:58:48 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9c9b4a8740a14f9fbca3b63948d195e3 => generated 4833 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:49.089083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17e3a849-eaf9-4ada-a790-c9e3a435086d tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:49.095779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-17e3a849-eaf9-4ada-a790-c9e3a435086d tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Searching by: {'tenant_id': '67531b37d1384299b2dc1defe983ff44', 'deleted': False} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:58:49.100925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17e3a849-eaf9-4ada-a790-c9e3a435086d tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.101407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17e3a849-eaf9-4ada-a790-c9e3a435086d tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.101840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17e3a849-eaf9-4ada-a790-c9e3a435086d tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.102557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17e3a849-eaf9-4ada-a790-c9e3a435086d tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.103008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17e3a849-eaf9-4ada-a790-c9e3a435086d tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.103586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17e3a849-eaf9-4ada-a790-c9e3a435086d tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.171896 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-17e3a849-eaf9-4ada-a790-c9e3a435086d tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=67531b37d1384299b2dc1defe983ff44" status: 200 len: 15 microversion: 2.1 time: 0.081891 Aug 27 04:58:49.174916 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 825/1645] 10.222.0.58 () {58 vars in 1257 bytes} [Sat Aug 27 04:58:49 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=67531b37d1384299b2dc1defe983ff44 => generated 15 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:58:49.201677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1cd91c44-dc06-49ca-b86a-b2cfd3cdd41e tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:49.219424 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1cd91c44-dc06-49ca-b86a-b2cfd3cdd41e tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.023161 Aug 27 04:58:49.220717 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 826/1646] 10.222.0.58 () {58 vars in 1189 bytes} [Sat Aug 27 04:58:49 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:58:49.260386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-be752095-ef95-4226-a5da-5a8a2f137569 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:49.265704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-be752095-ef95-4226-a5da-5a8a2f137569 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:49.281310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be752095-ef95-4226-a5da-5a8a2f137569 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.281310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be752095-ef95-4226-a5da-5a8a2f137569 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.281682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be752095-ef95-4226-a5da-5a8a2f137569 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.282186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be752095-ef95-4226-a5da-5a8a2f137569 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.285013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be752095-ef95-4226-a5da-5a8a2f137569 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.285422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be752095-ef95-4226-a5da-5a8a2f137569 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.350671 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-489dc722-3700-4ee9-b06d-d11801e7b3e2 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/e3c8ff3a-3d95-4dc1-884d-007b482ca388" status: 202 len: 0 microversion: 2.1 time: 2.728440 Aug 27 04:58:49.356411 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 821/1647] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 04:58:46 2022] DELETE /compute/v2.1/os-floating-ips/e3c8ff3a-3d95-4dc1-884d-007b482ca388 => generated 0 bytes in 2730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:58:49.360969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6302a2aa-f172-4db5-bf43-56d3ceb0996f tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Action: 'create', calling method: .version_select at 0x7fb565091ca0>, body: {"pool": null} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:49.515512 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-be752095-ef95-4226-a5da-5a8a2f137569 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action" status: 202 len: 0 microversion: 2.1 time: 0.272533 Aug 27 04:58:49.517334 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 827/1648] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:49 2022] POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:58:49.528343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-27439bb1-d200-48b4-8841-8f1f3f230ffd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:49.546626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-27439bb1-d200-48b4-8841-8f1f3f230ffd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:49.548332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-27439bb1-d200-48b4-8841-8f1f3f230ffd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:58:49.558034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27439bb1-d200-48b4-8841-8f1f3f230ffd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.559408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27439bb1-d200-48b4-8841-8f1f3f230ffd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.560105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27439bb1-d200-48b4-8841-8f1f3f230ffd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.561013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27439bb1-d200-48b4-8841-8f1f3f230ffd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.561485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27439bb1-d200-48b4-8841-8f1f3f230ffd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.562712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27439bb1-d200-48b4-8841-8f1f3f230ffd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.678130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-27439bb1-d200-48b4-8841-8f1f3f230ffd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:58:49.790136 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-27439bb1-d200-48b4-8841-8f1f3f230ffd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.268540 Aug 27 04:58:49.794594 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 828/1649] 10.222.0.58 () {58 vars in 1150 bytes} [Sat Aug 27 04:58:49 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:49.810915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d9126df9-54ec-4e79-a1f0-d450c4dd98e7 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:49.814559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d9126df9-54ec-4e79-a1f0-d450c4dd98e7 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:49.833966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9126df9-54ec-4e79-a1f0-d450c4dd98e7 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.836191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9126df9-54ec-4e79-a1f0-d450c4dd98e7 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.839293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9126df9-54ec-4e79-a1f0-d450c4dd98e7 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.840802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9126df9-54ec-4e79-a1f0-d450c4dd98e7 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.842005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9126df9-54ec-4e79-a1f0-d450c4dd98e7 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.843382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9126df9-54ec-4e79-a1f0-d450c4dd98e7 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.969385 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d9126df9-54ec-4e79-a1f0-d450c4dd98e7 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action" status: 202 len: 0 microversion: 2.1 time: 0.166440 Aug 27 04:58:49.973602 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 829/1650] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:49 2022] POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:58:49.981277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b4052102-060e-4570-99e8-24c65e3260fb tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:49.987701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b4052102-060e-4570-99e8-24c65e3260fb tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:49.997276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4052102-060e-4570-99e8-24c65e3260fb tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:50.003069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4052102-060e-4570-99e8-24c65e3260fb tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:50.003718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4052102-060e-4570-99e8-24c65e3260fb tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:50.004543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4052102-060e-4570-99e8-24c65e3260fb tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:50.009848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4052102-060e-4570-99e8-24c65e3260fb tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:50.010708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4052102-060e-4570-99e8-24c65e3260fb tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:50.491003 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b4052102-060e-4570-99e8-24c65e3260fb tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1616 microversion: 2.1 time: 0.516036 Aug 27 04:58:50.499003 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 830/1651] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:49 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1616 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:50.521946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5e309d56-f174-4118-9171-5f85d0823741 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:50.524985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5e309d56-f174-4118-9171-5f85d0823741 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:50.537837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e309d56-f174-4118-9171-5f85d0823741 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:50.538130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e309d56-f174-4118-9171-5f85d0823741 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:50.538580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e309d56-f174-4118-9171-5f85d0823741 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:50.541746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e309d56-f174-4118-9171-5f85d0823741 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:50.542158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e309d56-f174-4118-9171-5f85d0823741 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:50.544862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e309d56-f174-4118-9171-5f85d0823741 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:50.839482 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5e309d56-f174-4118-9171-5f85d0823741 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1616 microversion: 2.1 time: 0.322180 Aug 27 04:58:50.854801 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 831/1652] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:50 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1616 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:50.861042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ac511453-0f32-44d4-ba5a-cae3fc5d3cac tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:50.874174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ac511453-0f32-44d4-ba5a-cae3fc5d3cac tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Searching by: {'host': 'n-h1-820368-35', 'deleted': False} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:58:50.884787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac511453-0f32-44d4-ba5a-cae3fc5d3cac tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:50.885270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac511453-0f32-44d4-ba5a-cae3fc5d3cac tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:50.885712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac511453-0f32-44d4-ba5a-cae3fc5d3cac tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:50.886455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac511453-0f32-44d4-ba5a-cae3fc5d3cac tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:50.887523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac511453-0f32-44d4-ba5a-cae3fc5d3cac tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:50.888364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac511453-0f32-44d4-ba5a-cae3fc5d3cac tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.009541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-ac511453-0f32-44d4-ba5a-cae3fc5d3cac tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:58:51.124117 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ac511453-0f32-44d4-ba5a-cae3fc5d3cac tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=n-h1-820368-35&all_tenants=1" status: 200 len: 1652 microversion: 2.1 time: 0.268162 Aug 27 04:58:51.143550 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 832/1653] 10.222.0.58 () {58 vars in 1192 bytes} [Sat Aug 27 04:58:50 2022] GET /compute/v2.1/servers?host=n-h1-820368-35&all_tenants=1 => generated 1652 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:51.148417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-289fe9d4-afbf-4e40-b5dc-eacc7efa6eb6 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:51.155341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-289fe9d4-afbf-4e40-b5dc-eacc7efa6eb6 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:58:51.175879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-289fe9d4-afbf-4e40-b5dc-eacc7efa6eb6 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.176522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-289fe9d4-afbf-4e40-b5dc-eacc7efa6eb6 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.177063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-289fe9d4-afbf-4e40-b5dc-eacc7efa6eb6 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.178001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-289fe9d4-afbf-4e40-b5dc-eacc7efa6eb6 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.178543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-289fe9d4-afbf-4e40-b5dc-eacc7efa6eb6 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.179044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-289fe9d4-afbf-4e40-b5dc-eacc7efa6eb6 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.205478 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-289fe9d4-afbf-4e40-b5dc-eacc7efa6eb6 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.060393 Aug 27 04:58:51.214499 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 833/1654] 10.222.0.58 () {58 vars in 1196 bytes} [Sat Aug 27 04:58:51 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:58:51.220234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ea22653a-b175-49b0-abe6-7084faf4f5cc tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:51.222608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ea22653a-b175-49b0-abe6-7084faf4f5cc tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:51.230151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea22653a-b175-49b0-abe6-7084faf4f5cc tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.231377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea22653a-b175-49b0-abe6-7084faf4f5cc tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.231925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea22653a-b175-49b0-abe6-7084faf4f5cc tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.232724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea22653a-b175-49b0-abe6-7084faf4f5cc tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.233255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea22653a-b175-49b0-abe6-7084faf4f5cc tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.233754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea22653a-b175-49b0-abe6-7084faf4f5cc tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.310507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:51.367054 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ea22653a-b175-49b0-abe6-7084faf4f5cc tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action" status: 202 len: 0 microversion: 2.1 time: 0.150208 Aug 27 04:58:51.370768 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 834/1655] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:51 2022] POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:58:51.380014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:51.385709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:51.394059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.394999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.396153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.397584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.398369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.399278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.525984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:58:51.526668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:58:51.537108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:58:51.537546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:58:51.537984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:58:51.670914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:51.679271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.680350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.681143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.682092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.682823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.683624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.749807 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d55beecd-6c08-47f0-8211-1dd1768ec5fb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action" status: 202 len: 1067 microversion: 2.1 time: 0.377540 Aug 27 04:58:51.763026 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 835/1656] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:51 2022] POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action => generated 1067 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 04:58:51.767868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f1a1b151-4101-4dd0-b3a5-d9378b52dc92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:51.768758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f1a1b151-4101-4dd0-b3a5-d9378b52dc92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:51.775080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1a1b151-4101-4dd0-b3a5-d9378b52dc92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.775571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1a1b151-4101-4dd0-b3a5-d9378b52dc92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.776013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1a1b151-4101-4dd0-b3a5-d9378b52dc92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.776729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1a1b151-4101-4dd0-b3a5-d9378b52dc92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.777189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1a1b151-4101-4dd0-b3a5-d9378b52dc92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.778296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1a1b151-4101-4dd0-b3a5-d9378b52dc92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:52.264849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f1a1b151-4101-4dd0-b3a5-d9378b52dc92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:52.272802 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f1a1b151-4101-4dd0-b3a5-d9378b52dc92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1471 microversion: 2.1 time: 0.508933 Aug 27 04:58:52.283543 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 836/1657] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:51 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1471 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:52.562251 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6302a2aa-f172-4db5-bf43-56d3ceb0996f tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.205044 Aug 27 04:58:52.563968 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 822/1658] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 04:58:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:52.583226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7966d548-c0e0-4893-b2a7-7ee4529d60be tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Calling method '.version_select at 0x7fb564f510d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:53.230517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-425dd6e8-e274-4731-82d7-a983ffe8e82c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:53.231043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-425dd6e8-e274-4731-82d7-a983ffe8e82c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:53.243538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-425dd6e8-e274-4731-82d7-a983ffe8e82c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:53.244049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-425dd6e8-e274-4731-82d7-a983ffe8e82c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:53.244494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-425dd6e8-e274-4731-82d7-a983ffe8e82c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:53.245219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-425dd6e8-e274-4731-82d7-a983ffe8e82c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:53.245682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-425dd6e8-e274-4731-82d7-a983ffe8e82c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:53.246221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-425dd6e8-e274-4731-82d7-a983ffe8e82c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:53.920437 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-425dd6e8-e274-4731-82d7-a983ffe8e82c tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1811 microversion: 2.1 time: 0.694595 Aug 27 04:58:53.924512 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 823/1659] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:53 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1811 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:53.934130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5fd3f22f-4657-44d6-b6e3-2494ce0621a9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:53.937583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5fd3f22f-4657-44d6-b6e3-2494ce0621a9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:53.951058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fd3f22f-4657-44d6-b6e3-2494ce0621a9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:53.951806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fd3f22f-4657-44d6-b6e3-2494ce0621a9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:53.953203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fd3f22f-4657-44d6-b6e3-2494ce0621a9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:53.954125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fd3f22f-4657-44d6-b6e3-2494ce0621a9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:53.957701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fd3f22f-4657-44d6-b6e3-2494ce0621a9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:53.958361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fd3f22f-4657-44d6-b6e3-2494ce0621a9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:54.379333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5fd3f22f-4657-44d6-b6e3-2494ce0621a9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:54.388528 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5fd3f22f-4657-44d6-b6e3-2494ce0621a9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1471 microversion: 2.1 time: 0.462764 Aug 27 04:58:54.389765 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 824/1660] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:53 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1471 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:54.394809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-24ecdeac-a71c-4515-88c3-46d7687a1472 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:54.398971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24ecdeac-a71c-4515-88c3-46d7687a1472 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:54.399739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24ecdeac-a71c-4515-88c3-46d7687a1472 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:54.400642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24ecdeac-a71c-4515-88c3-46d7687a1472 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:54.401533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24ecdeac-a71c-4515-88c3-46d7687a1472 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:54.402682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24ecdeac-a71c-4515-88c3-46d7687a1472 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:54.403304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24ecdeac-a71c-4515-88c3-46d7687a1472 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:54.434432 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-24ecdeac-a71c-4515-88c3-46d7687a1472 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.043111 Aug 27 04:58:54.435473 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 825/1661] 10.222.0.58 () {58 vars in 1176 bytes} [Sat Aug 27 04:58:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:55.287883 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7966d548-c0e0-4893-b2a7-7ee4529d60be tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/8d320a51-b076-45b6-8b26-56f8de9b5e57" status: 202 len: 0 microversion: 2.1 time: 2.714992 Aug 27 04:58:55.292170 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 837/1662] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 04:58:52 2022] DELETE /compute/v2.1/os-floating-ips/8d320a51-b076-45b6-8b26-56f8de9b5e57 => generated 0 bytes in 2720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:58:55.297778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ead8e061-0ab3-4509-8047-52b195113f35 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Calling method '.version_select at 0x7fb565091ee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:55.366765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-ead8e061-0ab3-4509-8047-52b195113f35 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8d320a51-b076-45b6-8b26-56f8de9b5e57 could not be found", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:58:55.367725 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-ead8e061-0ab3-4509-8047-52b195113f35 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] HTTP exception thrown: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57 Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ead8e061-0ab3-4509-8047-52b195113f35 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Request method failure captured: Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-floating-ips/8d320a51-b076-45b6-8b26-56f8de9b5e57 HTTP/1.1 Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaSBwFT3bLdNJETHzhdXFqWRpRhdAIboaK4OgPD5GXqPgBPcFepKVYwxQKQnszkFC5bWlzT0rLRmJOwxWTPMTjLSzrxLshadaLLN8SNFJzrxE8cLherZMnXcR9lilJ1Wm2dsVTgwsvP-A3KYCk26LPnaxEnTrMC1an4J1blqHeo_JO4 Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 35f1fcb5ca3544e397f0bb33a0eb2999 Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FloatingIPsTestJSON-1078939796 Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 04:58:55.369944 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_35f1fcb5ca3544e397f0bb33a0eb2999", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/35f1fcb5ca3544e397f0bb33a0eb2999"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35f1fcb5ca3544e397f0bb33a0eb2999"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35f1fcb5ca3544e397f0bb33a0eb2999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FloatingIPsTestJSON-1078939796 Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 35f1fcb5ca3544e397f0bb33a0eb2999 Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1078939796 Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FloatingIPsTestJSON-1078939796-project Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c38c83116d92490e98265b6cec524b21 Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FloatingIPsTestJSON-1078939796-project Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: exception: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57 Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '8d320a51-b076-45b6-8b26-56f8de9b5e57'} Aug 27 04:58:55.372753 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:58:55.373872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8d320a51-b076-45b6-8b26-56f8de9b5e57 could not be found Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00a640c9-6ae4-4bf0-99db-41fbc0316c3d'] Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57. Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:55.375621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57 Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:55.377354 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:55.378952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57 Aug 27 04:58:55.378952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.381312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ead8e061-0ab3-4509-8047-52b195113f35 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Returning 404 to user: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57 {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:55.381312 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ead8e061-0ab3-4509-8047-52b195113f35 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/8d320a51-b076-45b6-8b26-56f8de9b5e57" status: 404 len: 111 microversion: 2.1 time: 0.087820 Aug 27 04:58:55.381925 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 826/1663] 10.222.0.58 () {58 vars in 1260 bytes} [Sat Aug 27 04:58:55 2022] GET /compute/v2.1/os-floating-ips/8d320a51-b076-45b6-8b26-56f8de9b5e57 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:58:55.391732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f15721c-5593-4c03-a9f5-f694ed6d6d75 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Calling method '.version_select at 0x7fb564f51e50>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:55.412331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-375e2219-5ba9-4e4c-aa5c-9c8af71b229b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:55.413241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-375e2219-5ba9-4e4c-aa5c-9c8af71b229b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:55.434124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375e2219-5ba9-4e4c-aa5c-9c8af71b229b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:55.434946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375e2219-5ba9-4e4c-aa5c-9c8af71b229b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:55.435591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375e2219-5ba9-4e4c-aa5c-9c8af71b229b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:55.436704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375e2219-5ba9-4e4c-aa5c-9c8af71b229b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:55.437122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375e2219-5ba9-4e4c-aa5c-9c8af71b229b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:55.437728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375e2219-5ba9-4e4c-aa5c-9c8af71b229b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:55.463930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-0f15721c-5593-4c03-a9f5-f694ed6d6d75 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8d320a51-b076-45b6-8b26-56f8de9b5e57 could not be found", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:58:55.464927 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-0f15721c-5593-4c03-a9f5-f694ed6d6d75 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] HTTP exception thrown: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57 Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f15721c-5593-4c03-a9f5-f694ed6d6d75 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Request method failure captured: Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-floating-ips/8d320a51-b076-45b6-8b26-56f8de9b5e57 HTTP/1.1 Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaSBwFT3bLdNJETHzhdXFqWRpRhdAIboaK4OgPD5GXqPgBPcFepKVYwxQKQnszkFC5bWlzT0rLRmJOwxWTPMTjLSzrxLshadaLLN8SNFJzrxE8cLherZMnXcR9lilJ1Wm2dsVTgwsvP-A3KYCk26LPnaxEnTrMC1an4J1blqHeo_JO4 Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 35f1fcb5ca3544e397f0bb33a0eb2999 Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FloatingIPsTestJSON-1078939796 Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:58:55.472774 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_35f1fcb5ca3544e397f0bb33a0eb2999", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/35f1fcb5ca3544e397f0bb33a0eb2999"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35f1fcb5ca3544e397f0bb33a0eb2999"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35f1fcb5ca3544e397f0bb33a0eb2999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FloatingIPsTestJSON-1078939796 Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 35f1fcb5ca3544e397f0bb33a0eb2999 Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1078939796 Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FloatingIPsTestJSON-1078939796-project Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c38c83116d92490e98265b6cec524b21 Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FloatingIPsTestJSON-1078939796-project Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: exception: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57 Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '8d320a51-b076-45b6-8b26-56f8de9b5e57'} Aug 27 04:58:55.474371 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:58:55.478429 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8d320a51-b076-45b6-8b26-56f8de9b5e57 could not be found Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad3ee062-5a0b-4998-9a5e-5f6ec5c2d88d'] Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57. Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:55.482419 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57 Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:55.486286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:55.491286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57 Aug 27 04:58:55.491286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:58:55.492165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f15721c-5593-4c03-a9f5-f694ed6d6d75 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] Returning 404 to user: Floating IP not found for ID 8d320a51-b076-45b6-8b26-56f8de9b5e57 {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:55.493644 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f15721c-5593-4c03-a9f5-f694ed6d6d75 tempest-FloatingIPsTestJSON-1078939796 tempest-FloatingIPsTestJSON-1078939796-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/8d320a51-b076-45b6-8b26-56f8de9b5e57" status: 404 len: 111 microversion: 2.1 time: 0.106197 Aug 27 04:58:55.494454 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 838/1664] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 04:58:55 2022] DELETE /compute/v2.1/os-floating-ips/8d320a51-b076-45b6-8b26-56f8de9b5e57 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:58:56.510852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-375e2219-5ba9-4e4c-aa5c-9c8af71b229b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:56.525108 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-375e2219-5ba9-4e4c-aa5c-9c8af71b229b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1471 microversion: 2.1 time: 1.118616 Aug 27 04:58:56.540543 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 827/1665] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:55 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1471 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:57.127277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-42fd5a32-08aa-4dcc-94b7-496bb0252181 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5ba9f89-78f5-462e-a44b-33ea64ce31b7", "device": "/dev/xvdb"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:57.133712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-42fd5a32-08aa-4dcc-94b7-496bb0252181 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:57.149770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42fd5a32-08aa-4dcc-94b7-496bb0252181 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:57.151740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42fd5a32-08aa-4dcc-94b7-496bb0252181 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:57.154588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42fd5a32-08aa-4dcc-94b7-496bb0252181 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:57.155650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42fd5a32-08aa-4dcc-94b7-496bb0252181 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:57.157930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42fd5a32-08aa-4dcc-94b7-496bb0252181 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:57.158586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42fd5a32-08aa-4dcc-94b7-496bb0252181 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:57.552122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f6b269f2-9ba3-4987-9354-f1e14f8c738a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:57.552776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f6b269f2-9ba3-4987-9354-f1e14f8c738a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:57.585424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=26 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:57.587734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6b269f2-9ba3-4987-9354-f1e14f8c738a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:57.589270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6b269f2-9ba3-4987-9354-f1e14f8c738a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:57.591473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6b269f2-9ba3-4987-9354-f1e14f8c738a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:57.592399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6b269f2-9ba3-4987-9354-f1e14f8c738a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:57.595798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6b269f2-9ba3-4987-9354-f1e14f8c738a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:57.596488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6b269f2-9ba3-4987-9354-f1e14f8c738a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:57.812155 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-42fd5a32-08aa-4dcc-94b7-496bb0252181 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "POST /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691125 Aug 27 04:58:57.812715 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 839/1666] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 04:58:57 2022] POST /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:58.814425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f6b269f2-9ba3-4987-9354-f1e14f8c738a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:58.827646 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f6b269f2-9ba3-4987-9354-f1e14f8c738a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1471 microversion: 2.1 time: 1.282188 Aug 27 04:58:58.828241 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 828/1667] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:57 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1471 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:59.850934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:59.857017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd652056-2602-4451-95fa-6871cc2bcd28 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:59.857748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd652056-2602-4451-95fa-6871cc2bcd28 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:59.890317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd652056-2602-4451-95fa-6871cc2bcd28 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:59.893089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd652056-2602-4451-95fa-6871cc2bcd28 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:59.898732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd652056-2602-4451-95fa-6871cc2bcd28 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:59.900998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd652056-2602-4451-95fa-6871cc2bcd28 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:59.924185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd652056-2602-4451-95fa-6871cc2bcd28 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:59.936923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd652056-2602-4451-95fa-6871cc2bcd28 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:00.823512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd652056-2602-4451-95fa-6871cc2bcd28 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:00.841439 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd652056-2602-4451-95fa-6871cc2bcd28 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1471 microversion: 2.1 time: 0.992475 Aug 27 04:59:00.842031 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 840/1668] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:59 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1471 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:01.862864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-665f21c4-ad6a-41c5-ae00-cdabab2959f0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:01.863534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-665f21c4-ad6a-41c5-ae00-cdabab2959f0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:01.875450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-665f21c4-ad6a-41c5-ae00-cdabab2959f0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:01.879822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-665f21c4-ad6a-41c5-ae00-cdabab2959f0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:01.880699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-665f21c4-ad6a-41c5-ae00-cdabab2959f0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:01.883219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-665f21c4-ad6a-41c5-ae00-cdabab2959f0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:01.886616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-665f21c4-ad6a-41c5-ae00-cdabab2959f0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:01.892014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-665f21c4-ad6a-41c5-ae00-cdabab2959f0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:02.630310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-665f21c4-ad6a-41c5-ae00-cdabab2959f0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:02.646516 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-665f21c4-ad6a-41c5-ae00-cdabab2959f0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1471 microversion: 2.1 time: 0.786653 Aug 27 04:59:02.648323 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 829/1669] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:01 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1471 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:03.405106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-17047979", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "051dccae-a303-46a8-a77e-49031a700014"}], "block_device_mapping_v2": [{"uuid": "50b4e022-4ad6-4126-a2c8-650e3000976e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:03.445330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=16 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:03.578559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] validate_networks() for [('051dccae-a303-46a8-a77e-49031a700014', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:59:03.671842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad9ff3e2-bb42-4638-9afb-8569991661a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:03.672470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ad9ff3e2-bb42-4638-9afb-8569991661a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:03.684262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad9ff3e2-bb42-4638-9afb-8569991661a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:03.684765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad9ff3e2-bb42-4638-9afb-8569991661a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:03.685211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad9ff3e2-bb42-4638-9afb-8569991661a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:03.690637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad9ff3e2-bb42-4638-9afb-8569991661a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:03.691709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad9ff3e2-bb42-4638-9afb-8569991661a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:03.692724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad9ff3e2-bb42-4638-9afb-8569991661a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:04.413135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:04.513861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ad9ff3e2-bb42-4638-9afb-8569991661a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:04.535276 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ad9ff3e2-bb42-4638-9afb-8569991661a8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1471 microversion: 2.1 time: 0.867889 Aug 27 04:59:04.539658 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 830/1670] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:03 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1471 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:05.339825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:59:05.340375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:59:05.340966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:59:05.341596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:59:05.342120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:59:05.362998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:05.363634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:05.364273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:05.365110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:05.365825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:05.366886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:05.411399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Getting quotas for project f5c7422cdaca490aaffc4004f77d830c. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:05.419985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Getting quotas for user b7d4fe4aaf864bb58c162620c9948d89 and project f5c7422cdaca490aaffc4004f77d830c. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:05.564109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-06aac204-4a8e-47ab-8149-cfc73d7cac4a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:05.564740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-06aac204-4a8e-47ab-8149-cfc73d7cac4a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:05.578913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06aac204-4a8e-47ab-8149-cfc73d7cac4a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:05.580601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06aac204-4a8e-47ab-8149-cfc73d7cac4a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:05.581650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06aac204-4a8e-47ab-8149-cfc73d7cac4a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:05.585177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06aac204-4a8e-47ab-8149-cfc73d7cac4a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:05.589679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06aac204-4a8e-47ab-8149-cfc73d7cac4a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:05.590997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06aac204-4a8e-47ab-8149-cfc73d7cac4a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:05.603182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:59:05.606470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50b4e022-4ad6-4126-a2c8-650e3000976e',volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:59:05.963380 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10f5e8d0-18e6-42e4-84f1-b233516172d6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.561724 Aug 27 04:59:05.966228 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 841/1671] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 04:59:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2568 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:59:05.981481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5d93535-c4ec-4bc9-bc4a-712d5f89bb79 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:05.982105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c5d93535-c4ec-4bc9-bc4a-712d5f89bb79 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:06.942560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c5d93535-c4ec-4bc9-bc4a-712d5f89bb79 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:06.950333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c5d93535-c4ec-4bc9-bc4a-712d5f89bb79 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:06.958503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c5d93535-c4ec-4bc9-bc4a-712d5f89bb79 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:06.959739 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5d93535-c4ec-4bc9-bc4a-712d5f89bb79 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1102 microversion: 2.25 time: 0.986364 Aug 27 04:59:06.960341 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 842/1672] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:05 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1102 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:59:07.007175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-06aac204-4a8e-47ab-8149-cfc73d7cac4a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:07.021780 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-06aac204-4a8e-47ab-8149-cfc73d7cac4a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1477 microversion: 2.1 time: 1.462675 Aug 27 04:59:07.024239 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 831/1673] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:05 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1477 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:07.888259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f57af2af-3c50-44d9-9a4e-c158a6f985ea req-49b8e66a-9982-4cf4-a4dd-4e89e959cb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0722d6-d717-436e-b051-df3b185dddd5", "name": "network-vif-unplugged", "status": "completed", "tag": "dc0145a6-c0bf-434f-b124-20af43f72b43"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:07.900069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f57af2af-3c50-44d9-9a4e-c158a6f985ea req-49b8e66a-9982-4cf4-a4dd-4e89e959cb0b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:07.900818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f57af2af-3c50-44d9-9a4e-c158a6f985ea req-49b8e66a-9982-4cf4-a4dd-4e89e959cb0b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:07.901454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f57af2af-3c50-44d9-9a4e-c158a6f985ea req-49b8e66a-9982-4cf4-a4dd-4e89e959cb0b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:07.913149 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f57af2af-3c50-44d9-9a4e-c158a6f985ea req-49b8e66a-9982-4cf4-a4dd-4e89e959cb0b service nova] Creating event network-vif-unplugged:dc0145a6-c0bf-434f-b124-20af43f72b43 for instance eb0722d6-d717-436e-b051-df3b185dddd5 on n-h1-820368-35 Aug 27 04:59:07.919294 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f57af2af-3c50-44d9-9a4e-c158a6f985ea req-49b8e66a-9982-4cf4-a4dd-4e89e959cb0b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035302 Aug 27 04:59:07.920125 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 843/1674] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:07.996156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:07.998317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:08.009652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:08.011478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:08.012220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:08.013176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:08.013863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:08.013994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-421a74ac-aa1f-4d5f-97fe-2317e67b6672 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "362bb9d0-5bfa-427c-9204-738b54633eb2"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:08.016526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-421a74ac-aa1f-4d5f-97fe-2317e67b6672 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:08.016669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:08.027812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421a74ac-aa1f-4d5f-97fe-2317e67b6672 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:08.028567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421a74ac-aa1f-4d5f-97fe-2317e67b6672 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:08.029177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421a74ac-aa1f-4d5f-97fe-2317e67b6672 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:08.030062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421a74ac-aa1f-4d5f-97fe-2317e67b6672 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:08.030836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421a74ac-aa1f-4d5f-97fe-2317e67b6672 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:08.031641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421a74ac-aa1f-4d5f-97fe-2317e67b6672 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:08.263309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:08.278752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:08.284988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:08.287591 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-61032139-09b5-47b6-9c6f-87344e073d1d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1231 microversion: 2.25 time: 0.298884 Aug 27 04:59:08.289980 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 832/1675] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:07 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1231 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:08.298755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2f9c9a1a-5561-46c2-beea-caca9917c9c9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:08.299446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2f9c9a1a-5561-46c2-beea-caca9917c9c9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:08.316448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9c9a1a-5561-46c2-beea-caca9917c9c9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:08.326379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9c9a1a-5561-46c2-beea-caca9917c9c9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:08.331881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9c9a1a-5561-46c2-beea-caca9917c9c9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:08.332785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9c9a1a-5561-46c2-beea-caca9917c9c9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:08.333270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9c9a1a-5561-46c2-beea-caca9917c9c9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:08.336693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9c9a1a-5561-46c2-beea-caca9917c9c9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:08.665112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2f9c9a1a-5561-46c2-beea-caca9917c9c9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:08.675715 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2f9c9a1a-5561-46c2-beea-caca9917c9c9 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1477 microversion: 2.1 time: 0.384463 Aug 27 04:59:08.688955 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 833/1676] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:08 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1477 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:09.314719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:09.315567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:09.333211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:09.337357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:09.339429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:09.341650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:09.342760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:09.345966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:09.501895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:09.519862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:09.521386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:09.522638 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f04eb0dd-80fb-4675-a563-7bc706d14afe tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1249 microversion: 2.25 time: 0.212192 Aug 27 04:59:09.523625 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 834/1677] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:09 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1249 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:59:09.777950 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bc18c9bf-5599-47fc-82ca-188379e4f916 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] 10.222.0.58 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.252433 Aug 27 04:59:09.780280 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 835/1678] 10.222.0.58 () {58 vars in 1128 bytes} [Sat Aug 27 04:59:09 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 04:59:09.801367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f0cc9e4d-227c-42f3-8cdd-6f12fb99becd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:09.802473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f0cc9e4d-227c-42f3-8cdd-6f12fb99becd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:09.814680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0cc9e4d-227c-42f3-8cdd-6f12fb99becd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:09.815465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0cc9e4d-227c-42f3-8cdd-6f12fb99becd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:09.816405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0cc9e4d-227c-42f3-8cdd-6f12fb99becd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:09.817507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0cc9e4d-227c-42f3-8cdd-6f12fb99becd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:09.818078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0cc9e4d-227c-42f3-8cdd-6f12fb99becd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:09.818920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0cc9e4d-227c-42f3-8cdd-6f12fb99becd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:10.044412 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-421a74ac-aa1f-4d5f-97fe-2317e67b6672 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "POST /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.039125 Aug 27 04:59:10.045021 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 844/1679] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 04:59:08 2022] POST /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments => generated 194 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:59:10.060353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7b0b938a-e03c-4c7a-a5f8-0d85a9b19c43 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Calling method '.version_select at 0x7fb564c50160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:10.116213 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-7b0b938a-e03c-4c7a-a5f8-0d85a9b19c43 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] HTTP exception thrown: Image not found. Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7b0b938a-e03c-4c7a-a5f8-0d85a9b19c43 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Request method failure captured: Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaSd_hwTobU6lGUkFZ_Cajk4DGzi2lnl7Ier6mp1Oj82CHoD9fYJ0UY1SfDf9w2CCPQ9z9kYRSxUyBP60ewG51tXYndiEL3fkj--L3TGr9kzDEgxeTc0umikPCf9CGDQccFMQ8zhOwCOLReok3qHU3b8cJF7nULWFI_s80DyFoLFbQc Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: dc1eccd8a79f498e86ed1b7f1b8c140c Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:59:10.121804 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc1eccd8a79f498e86ed1b7f1b8c140c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: dc1eccd8a79f498e86ed1b7f1b8c140c Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesDeleteNegativeTestJSON-1938827842-project Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 7020a6f33e054f8ca13c04f21dcb7e31 Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842-project Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: exception: Image not found. Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '-1'} Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:59:10.124214 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.125300 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:59:10.126789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7b0b938a-e03c-4c7a-a5f8-0d85a9b19c43 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Returning 404 to user: Image not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:59:10.128207 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7b0b938a-e03c-4c7a-a5f8-0d85a9b19c43 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] 10.222.0.58 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.072853 Aug 27 04:59:10.129235 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 845/1680] 10.222.0.58 () {58 vars in 1134 bytes} [Sat Aug 27 04:59:10 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:59:10.136447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4e3529ef-3df1-4ca9-979d-184f1d6bcc6f tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Calling method '.version_select at 0x7fb564c58670>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:10.180459 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-4e3529ef-3df1-4ca9-979d-184f1d6bcc6f tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] HTTP exception thrown: Image not found. Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4e3529ef-3df1-4ca9-979d-184f1d6bcc6f tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Request method failure captured: Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/images/ed6a7b47-15bf-41a0-9cbc-b9f16a9693fj HTTP/1.1 Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaSd_hwTobU6lGUkFZ_Cajk4DGzi2lnl7Ier6mp1Oj82CHoD9fYJ0UY1SfDf9w2CCPQ9z9kYRSxUyBP60ewG51tXYndiEL3fkj--L3TGr9kzDEgxeTc0umikPCf9CGDQccFMQ8zhOwCOLReok3qHU3b8cJF7nULWFI_s80DyFoLFbQc Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: dc1eccd8a79f498e86ed1b7f1b8c140c Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:59:10.182395 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc1eccd8a79f498e86ed1b7f1b8c140c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: dc1eccd8a79f498e86ed1b7f1b8c140c Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesDeleteNegativeTestJSON-1938827842-project Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 7020a6f33e054f8ca13c04f21dcb7e31 Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842-project Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: exception: Image not found. Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'ed6a7b47-15bf-41a0-9cbc-b9f16a9693fj'} Aug 27 04:59:10.184143 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ed6a7b47-15bf-41a0-9cbc-b9f16a9693fj to delete Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.185216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ed6a7b47-15bf-41a0-9cbc-b9f16a9693fj could not be found. Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:59:10.186749 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.188375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4e3529ef-3df1-4ca9-979d-184f1d6bcc6f tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Returning 404 to user: Image not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:59:10.190087 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4e3529ef-3df1-4ca9-979d-184f1d6bcc6f tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] 10.222.0.58 "DELETE /compute/v2.1/images/ed6a7b47-15bf-41a0-9cbc-b9f16a9693fj" status: 404 len: 62 microversion: 2.1 time: 0.058682 Aug 27 04:59:10.191230 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 846/1681] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:10 2022] DELETE /compute/v2.1/images/ed6a7b47-15bf-41a0-9cbc-b9f16a9693fj => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:59:10.200435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0405a4a-1a82-4750-b5f7-0b3fa0786f81 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Calling method '.version_select at 0x7fb564c418b0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:10.226019 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c0405a4a-1a82-4750-b5f7-0b3fa0786f81 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] HTTP exception thrown: Image not found. Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0405a4a-1a82-4750-b5f7-0b3fa0786f81 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Request method failure captured: Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/images/2866d052-a1b2-4dd1-a88e-460d1f50c89f1 HTTP/1.1 Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaSd_hwTobU6lGUkFZ_Cajk4DGzi2lnl7Ier6mp1Oj82CHoD9fYJ0UY1SfDf9w2CCPQ9z9kYRSxUyBP60ewG51tXYndiEL3fkj--L3TGr9kzDEgxeTc0umikPCf9CGDQccFMQ8zhOwCOLReok3qHU3b8cJF7nULWFI_s80DyFoLFbQc Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: dc1eccd8a79f498e86ed1b7f1b8c140c Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:59:10.227970 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc1eccd8a79f498e86ed1b7f1b8c140c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: dc1eccd8a79f498e86ed1b7f1b8c140c Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesDeleteNegativeTestJSON-1938827842-project Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 7020a6f33e054f8ca13c04f21dcb7e31 Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842-project Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: exception: Image not found. Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2866d052-a1b2-4dd1-a88e-460d1f50c89f1'} Aug 27 04:59:10.230314 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2866d052-a1b2-4dd1-a88e-460d1f50c89f1 to delete Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.231313 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2866d052-a1b2-4dd1-a88e-460d1f50c89f1 could not be found. Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:59:10.232647 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0405a4a-1a82-4750-b5f7-0b3fa0786f81 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Returning 404 to user: Image not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:59:10.234006 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c0405a4a-1a82-4750-b5f7-0b3fa0786f81 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] 10.222.0.58 "DELETE /compute/v2.1/images/2866d052-a1b2-4dd1-a88e-460d1f50c89f1" status: 404 len: 62 microversion: 2.1 time: 0.035368 Aug 27 04:59:10.236975 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 847/1682] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 04:59:10 2022] DELETE /compute/v2.1/images/2866d052-a1b2-4dd1-a88e-460d1f50c89f1 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:59:10.241615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-74311b20-bcc4-4bcb-ad00-f9f4d6727eb9 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Calling method '.version_select at 0x7fb564c58310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:10.277527 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-74311b20-bcc4-4bcb-ad00-f9f4d6727eb9 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] HTTP exception thrown: Image not found. Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-74311b20-bcc4-4bcb-ad00-f9f4d6727eb9 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Request method failure captured: Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/images/tempest-invalid-398550930 HTTP/1.1 Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaSd_hwTobU6lGUkFZ_Cajk4DGzi2lnl7Ier6mp1Oj82CHoD9fYJ0UY1SfDf9w2CCPQ9z9kYRSxUyBP60ewG51tXYndiEL3fkj--L3TGr9kzDEgxeTc0umikPCf9CGDQccFMQ8zhOwCOLReok3qHU3b8cJF7nULWFI_s80DyFoLFbQc Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: dc1eccd8a79f498e86ed1b7f1b8c140c Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:59:10.280098 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc1eccd8a79f498e86ed1b7f1b8c140c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: dc1eccd8a79f498e86ed1b7f1b8c140c Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesDeleteNegativeTestJSON-1938827842-project Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 7020a6f33e054f8ca13c04f21dcb7e31 Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842-project Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: exception: Image not found. Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'tempest-invalid-398550930'} Aug 27 04:59:10.282130 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-398550930 to delete Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.283303 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-398550930 could not be found. Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:59:10.285228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-74311b20-bcc4-4bcb-ad00-f9f4d6727eb9 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Returning 404 to user: Image not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:59:10.287041 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-74311b20-bcc4-4bcb-ad00-f9f4d6727eb9 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] 10.222.0.58 "DELETE /compute/v2.1/images/tempest-invalid-398550930" status: 404 len: 62 microversion: 2.1 time: 0.046831 Aug 27 04:59:10.289626 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 848/1683] 10.222.0.58 () {58 vars in 1203 bytes} [Sat Aug 27 04:59:10 2022] DELETE /compute/v2.1/images/tempest-invalid-398550930 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:59:10.297379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1eb011eb-31dd-4f98-95ee-422cc6bba719 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Calling method '.version_select at 0x7fb564c41160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:10.335467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f0cc9e4d-227c-42f3-8cdd-6f12fb99becd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:10.361176 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f0cc9e4d-227c-42f3-8cdd-6f12fb99becd tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1477 microversion: 2.1 time: 0.574377 Aug 27 04:59:10.362765 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 836/1684] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:09 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1477 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:10.362893 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-1eb011eb-31dd-4f98-95ee-422cc6bba719 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] HTTP exception thrown: Image not found. Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1eb011eb-31dd-4f98-95ee-422cc6bba719 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Request method failure captured: Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/images/50ddbd02-0562-4e41-9a07-0171b07eeee5 HTTP/1.1 Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaSd_hwTobU6lGUkFZ_Cajk4DGzi2lnl7Ier6mp1Oj82CHoD9fYJ0UY1SfDf9w2CCPQ9z9kYRSxUyBP60ewG51tXYndiEL3fkj--L3TGr9kzDEgxeTc0umikPCf9CGDQccFMQ8zhOwCOLReok3qHU3b8cJF7nULWFI_s80DyFoLFbQc Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: dc1eccd8a79f498e86ed1b7f1b8c140c Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 04:59:10.364683 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc1eccd8a79f498e86ed1b7f1b8c140c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc1eccd8a79f498e86ed1b7f1b8c140c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: dc1eccd8a79f498e86ed1b7f1b8c140c Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842 Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesDeleteNegativeTestJSON-1938827842-project Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 7020a6f33e054f8ca13c04f21dcb7e31 Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1938827842-project Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: exception: Image not found. Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '50ddbd02-0562-4e41-9a07-0171b07eeee5'} Aug 27 04:59:10.366271 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 50ddbd02-0562-4e41-9a07-0171b07eeee5 to delete Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.372255 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50ddbd02-0562-4e41-9a07-0171b07eeee5 could not be found. Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:59:10.374150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1eb011eb-31dd-4f98-95ee-422cc6bba719 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] Returning 404 to user: Image not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:59:10.376695 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1eb011eb-31dd-4f98-95ee-422cc6bba719 tempest-ImagesDeleteNegativeTestJSON-1938827842 tempest-ImagesDeleteNegativeTestJSON-1938827842-project] 10.222.0.58 "DELETE /compute/v2.1/images/50ddbd02-0562-4e41-9a07-0171b07eeee5" status: 404 len: 62 microversion: 2.1 time: 0.073352 Aug 27 04:59:10.379990 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 849/1685] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:10 2022] DELETE /compute/v2.1/images/50ddbd02-0562-4e41-9a07-0171b07eeee5 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:59:10.549411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:10.550126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:10.567730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:10.569781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:10.572205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:10.576497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:10.580631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:10.581488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:10.825830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:10.848930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:10.850556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:10.851963 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ba6d198-2b07-46c0-b268-1004c244286f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1249 microversion: 2.25 time: 0.306566 Aug 27 04:59:10.853633 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 837/1686] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:10 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1249 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:11.388341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ebbcc00a-ed8b-4f11-bc39-aba5aa026db2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:11.389077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ebbcc00a-ed8b-4f11-bc39-aba5aa026db2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:11.392022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:11.409556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebbcc00a-ed8b-4f11-bc39-aba5aa026db2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:11.410049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebbcc00a-ed8b-4f11-bc39-aba5aa026db2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:11.410484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebbcc00a-ed8b-4f11-bc39-aba5aa026db2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:11.424382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebbcc00a-ed8b-4f11-bc39-aba5aa026db2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:11.425121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebbcc00a-ed8b-4f11-bc39-aba5aa026db2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:11.425729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebbcc00a-ed8b-4f11-bc39-aba5aa026db2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:11.626587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ebbcc00a-ed8b-4f11-bc39-aba5aa026db2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:11.639257 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ebbcc00a-ed8b-4f11-bc39-aba5aa026db2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1477 microversion: 2.1 time: 0.253972 Aug 27 04:59:11.640235 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 850/1687] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:11 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1477 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:11.878308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:11.879713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:11.888516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:11.889372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:11.890048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:11.891006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:11.891718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:11.892405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:12.181331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:12.191148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:12.192874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:12.194232 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d0cc02ef-18e6-477d-bafb-2b09b6bf4ba9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1291 microversion: 2.25 time: 0.320670 Aug 27 04:59:12.195400 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 838/1688] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:11 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1291 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:12.664928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-606b65b7-8007-41f9-ad76-dc138d68c177 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:12.665550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-606b65b7-8007-41f9-ad76-dc138d68c177 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:12.676820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606b65b7-8007-41f9-ad76-dc138d68c177 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:12.677215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606b65b7-8007-41f9-ad76-dc138d68c177 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:12.677769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606b65b7-8007-41f9-ad76-dc138d68c177 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:12.678458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606b65b7-8007-41f9-ad76-dc138d68c177 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:12.678808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606b65b7-8007-41f9-ad76-dc138d68c177 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:12.679342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-606b65b7-8007-41f9-ad76-dc138d68c177 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:13.217515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:13.218343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:13.235000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:13.236050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:13.237426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:13.238418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:13.239118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:13.239773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:13.271465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-606b65b7-8007-41f9-ad76-dc138d68c177 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:13.283665 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-606b65b7-8007-41f9-ad76-dc138d68c177 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1477 microversion: 2.1 time: 0.622419 Aug 27 04:59:13.285285 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 851/1689] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:12 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1477 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:13.775250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:13.778270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=90 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:13.816398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:13.818288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:13.821681 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d924615-38a0-4c3f-8d65-93f2b5bf11d3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1291 microversion: 2.25 time: 0.608994 Aug 27 04:59:13.824844 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 839/1690] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:13 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1291 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:59:14.125358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1b06e8db-ea70-478c-91bb-4d515278c29b req-54ac5368-38a7-454f-9cbb-0658a3b3cde1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd4a82a-8c52-4d07-8009-16cb1268e380", "tag": "1e9e24a3-3955-4a83-97cb-a0d969604b5a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:14.148462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1b06e8db-ea70-478c-91bb-4d515278c29b req-54ac5368-38a7-454f-9cbb-0658a3b3cde1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.150714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1b06e8db-ea70-478c-91bb-4d515278c29b req-54ac5368-38a7-454f-9cbb-0658a3b3cde1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.152197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1b06e8db-ea70-478c-91bb-4d515278c29b req-54ac5368-38a7-454f-9cbb-0658a3b3cde1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.180411 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1b06e8db-ea70-478c-91bb-4d515278c29b req-54ac5368-38a7-454f-9cbb-0658a3b3cde1 service nova] Creating event network-changed:1e9e24a3-3955-4a83-97cb-a0d969604b5a for instance ccd4a82a-8c52-4d07-8009-16cb1268e380 on n-h2-820368-35 Aug 27 04:59:14.193247 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1b06e8db-ea70-478c-91bb-4d515278c29b req-54ac5368-38a7-454f-9cbb-0658a3b3cde1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073943 Aug 27 04:59:14.196144 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 852/1691] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:14.308399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e892bb01-bfaf-43d9-9f8b-9c2e74eafedc tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:14.309224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e892bb01-bfaf-43d9-9f8b-9c2e74eafedc tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:14.317441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e892bb01-bfaf-43d9-9f8b-9c2e74eafedc tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.318246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e892bb01-bfaf-43d9-9f8b-9c2e74eafedc tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.318799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e892bb01-bfaf-43d9-9f8b-9c2e74eafedc tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.319661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e892bb01-bfaf-43d9-9f8b-9c2e74eafedc tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.320231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e892bb01-bfaf-43d9-9f8b-9c2e74eafedc tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.320769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e892bb01-bfaf-43d9-9f8b-9c2e74eafedc tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.634896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-56d0ecdf-5627-4a8e-b332-b8d48b2d7adc req-67b14b06-8fa7-4aa6-abd5-be548a4c28f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0722d6-d717-436e-b051-df3b185dddd5", "name": "network-vif-plugged", "status": "completed", "tag": "dc0145a6-c0bf-434f-b124-20af43f72b43"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:14.678385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-56d0ecdf-5627-4a8e-b332-b8d48b2d7adc req-67b14b06-8fa7-4aa6-abd5-be548a4c28f1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.680748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-56d0ecdf-5627-4a8e-b332-b8d48b2d7adc req-67b14b06-8fa7-4aa6-abd5-be548a4c28f1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.682429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-56d0ecdf-5627-4a8e-b332-b8d48b2d7adc req-67b14b06-8fa7-4aa6-abd5-be548a4c28f1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.699859 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-56d0ecdf-5627-4a8e-b332-b8d48b2d7adc req-67b14b06-8fa7-4aa6-abd5-be548a4c28f1 service nova] Creating event network-vif-plugged:dc0145a6-c0bf-434f-b124-20af43f72b43 for instance eb0722d6-d717-436e-b051-df3b185dddd5 on n-h1-820368-35 Aug 27 04:59:14.705256 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-56d0ecdf-5627-4a8e-b332-b8d48b2d7adc req-67b14b06-8fa7-4aa6-abd5-be548a4c28f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085891 Aug 27 04:59:14.706338 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 853/1692] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:14.849776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:14.851578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:14.869826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.870875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.872743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.875667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.881502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.882432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.916153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e892bb01-bfaf-43d9-9f8b-9c2e74eafedc tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:14.980599 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e892bb01-bfaf-43d9-9f8b-9c2e74eafedc tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1477 microversion: 2.1 time: 0.677613 Aug 27 04:59:14.983698 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 840/1693] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:14 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1477 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:15.279641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:15.296731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:15.298829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:15.300642 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-285f2cb3-d499-4fe9-b007-5a3f013554ec tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1291 microversion: 2.25 time: 0.456536 Aug 27 04:59:15.301430 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 854/1694] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:14 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1291 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:59:16.006247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-96c14ba1-532d-4d5f-8e61-671f6aaa5680 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:16.007652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-96c14ba1-532d-4d5f-8e61-671f6aaa5680 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:16.026587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96c14ba1-532d-4d5f-8e61-671f6aaa5680 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:16.026587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96c14ba1-532d-4d5f-8e61-671f6aaa5680 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:16.026587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96c14ba1-532d-4d5f-8e61-671f6aaa5680 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:16.026587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96c14ba1-532d-4d5f-8e61-671f6aaa5680 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:16.027047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96c14ba1-532d-4d5f-8e61-671f6aaa5680 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:16.027047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96c14ba1-532d-4d5f-8e61-671f6aaa5680 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:16.327730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:16.328360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:16.340286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:16.345701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:16.355909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:16.359822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:16.360955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:16.361649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:16.362271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:16.398754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-96c14ba1-532d-4d5f-8e61-671f6aaa5680 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:16.418026 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-96c14ba1-532d-4d5f-8e61-671f6aaa5680 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1477 microversion: 2.1 time: 0.415897 Aug 27 04:59:16.425128 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 841/1695] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:16 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1477 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:16.949641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:17.218312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:17.230376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:17.240272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:17.241719 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f0d1a6b-792f-4e0f-a5eb-d7347687eed0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1291 microversion: 2.25 time: 0.919678 Aug 27 04:59:17.243057 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 855/1696] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:16 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1291 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:17.449254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-84edb860-d9bc-458a-8fd4-233929d80be2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:17.449877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-84edb860-d9bc-458a-8fd4-233929d80be2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:17.468653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84edb860-d9bc-458a-8fd4-233929d80be2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:17.469445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84edb860-d9bc-458a-8fd4-233929d80be2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:17.469992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84edb860-d9bc-458a-8fd4-233929d80be2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:17.470733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84edb860-d9bc-458a-8fd4-233929d80be2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:17.471337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84edb860-d9bc-458a-8fd4-233929d80be2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:17.471656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84edb860-d9bc-458a-8fd4-233929d80be2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:17.714389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-84edb860-d9bc-458a-8fd4-233929d80be2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:17.729570 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-84edb860-d9bc-458a-8fd4-233929d80be2 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1463 microversion: 2.1 time: 0.283910 Aug 27 04:59:17.730707 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 842/1697] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:17 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1463 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:17.752141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-430a4769-9fe7-47f3-b980-29d814b27d63 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:17.753318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-430a4769-9fe7-47f3-b980-29d814b27d63 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:17.775438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-430a4769-9fe7-47f3-b980-29d814b27d63 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:17.777129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-430a4769-9fe7-47f3-b980-29d814b27d63 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:17.777759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-430a4769-9fe7-47f3-b980-29d814b27d63 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:17.778868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-430a4769-9fe7-47f3-b980-29d814b27d63 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:17.779541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-430a4769-9fe7-47f3-b980-29d814b27d63 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:17.780141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-430a4769-9fe7-47f3-b980-29d814b27d63 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:17.833276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:18.200276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-430a4769-9fe7-47f3-b980-29d814b27d63 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:18.213600 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-430a4769-9fe7-47f3-b980-29d814b27d63 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1463 microversion: 2.1 time: 0.466911 Aug 27 04:59:18.215821 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 856/1698] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:17 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1463 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:18.235664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:18.238571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:18.255182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:18.255672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:18.256453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:18.257395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:18.258048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:18.259014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:18.267769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:18.268802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:18.285337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:18.289978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:18.290689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:18.291701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:18.298788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:18.299526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:18.430113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:59:18.430851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:59:18.431545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:59:18.432674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:59:18.433266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:59:18.533853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:18.545294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:18.546084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:18.547710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:18.552948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:18.552948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:18.554809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:18.639755 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-525905ba-0354-44f5-9e4c-386d33736c03 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action" status: 202 len: 1067 microversion: 2.1 time: 0.407134 Aug 27 04:59:18.655731 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 843/1699] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:59:18 2022] POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action => generated 1067 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 04:59:18.663043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6f226df6-a8bf-4928-a4b2-93eb7d5ea325 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:18.664137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6f226df6-a8bf-4928-a4b2-93eb7d5ea325 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:18.674018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f226df6-a8bf-4928-a4b2-93eb7d5ea325 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:18.675054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f226df6-a8bf-4928-a4b2-93eb7d5ea325 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:18.677341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f226df6-a8bf-4928-a4b2-93eb7d5ea325 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:18.677341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f226df6-a8bf-4928-a4b2-93eb7d5ea325 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:18.677341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f226df6-a8bf-4928-a4b2-93eb7d5ea325 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:18.678688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f226df6-a8bf-4928-a4b2-93eb7d5ea325 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:19.254529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:19.269924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:19.272332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:19.277745 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-53a3af5a-df3c-4b21-9d83-d4f4270d18f9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1291 microversion: 2.25 time: 1.013743 Aug 27 04:59:19.278602 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 857/1700] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:18 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1291 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:19.349678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6f226df6-a8bf-4928-a4b2-93eb7d5ea325 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:19.368466 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6f226df6-a8bf-4928-a4b2-93eb7d5ea325 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.711147 Aug 27 04:59:19.369067 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 844/1701] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:18 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:20.301511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:20.302346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:20.329284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:20.331378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:20.334949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:20.335776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:20.336253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:20.337460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:20.390014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-329f1307-9f95-49a3-bb12-56c2ff82b981 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:20.390644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-329f1307-9f95-49a3-bb12-56c2ff82b981 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:20.414486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329f1307-9f95-49a3-bb12-56c2ff82b981 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:20.414993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329f1307-9f95-49a3-bb12-56c2ff82b981 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:20.417859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329f1307-9f95-49a3-bb12-56c2ff82b981 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:20.418966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329f1307-9f95-49a3-bb12-56c2ff82b981 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:20.420156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329f1307-9f95-49a3-bb12-56c2ff82b981 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:20.421099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329f1307-9f95-49a3-bb12-56c2ff82b981 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:21.622862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:21.642480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:21.646933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:21.648990 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b725cb80-6ba0-4a98-aa3e-a278edd30fd5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1291 microversion: 2.25 time: 1.352171 Aug 27 04:59:21.668761 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 858/1702] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:20 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1291 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:21.923857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-329f1307-9f95-49a3-bb12-56c2ff82b981 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:21.940281 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-329f1307-9f95-49a3-bb12-56c2ff82b981 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 1.551176 Aug 27 04:59:21.941467 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 845/1703] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:20 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:22.287661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b4d10f99-715d-4895-9bed-c1dead37e6a6 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:22.288298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b4d10f99-715d-4895-9bed-c1dead37e6a6 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:22.295420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4d10f99-715d-4895-9bed-c1dead37e6a6 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:22.295922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4d10f99-715d-4895-9bed-c1dead37e6a6 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:22.296364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4d10f99-715d-4895-9bed-c1dead37e6a6 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:22.297093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4d10f99-715d-4895-9bed-c1dead37e6a6 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:22.302679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4d10f99-715d-4895-9bed-c1dead37e6a6 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:22.303464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4d10f99-715d-4895-9bed-c1dead37e6a6 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:22.676972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:22.677605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:22.685038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:22.685538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:22.685985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:22.686707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:22.687197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:22.687641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:22.974755 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b4d10f99-715d-4895-9bed-c1dead37e6a6 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1857 microversion: 2.1 time: 0.690277 Aug 27 04:59:22.992942 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 859/1704] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:22 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1857 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:22.998794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-68984632-8c9d-44ba-bb25-b5ee7c0e01da tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:22.999718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68984632-8c9d-44ba-bb25-b5ee7c0e01da tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:23.007460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68984632-8c9d-44ba-bb25-b5ee7c0e01da tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:23.008234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68984632-8c9d-44ba-bb25-b5ee7c0e01da tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:23.008873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68984632-8c9d-44ba-bb25-b5ee7c0e01da tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:23.009780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68984632-8c9d-44ba-bb25-b5ee7c0e01da tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:23.010438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68984632-8c9d-44ba-bb25-b5ee7c0e01da tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:23.011035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68984632-8c9d-44ba-bb25-b5ee7c0e01da tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:23.412434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:23.422107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:23.426982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:23.428223 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d8a315a2-617d-42b8-940b-21f647a34020 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1279 microversion: 2.25 time: 0.755257 Aug 27 04:59:23.428942 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 846/1705] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:22 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1279 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:59:23.442962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4c5a12d-5516-4cb3-89b3-30a56525819b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-820368-35", "block_migration": true, "disk_over_commit": false}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:23.445830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4c5a12d-5516-4cb3-89b3-30a56525819b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:23.455166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c5a12d-5516-4cb3-89b3-30a56525819b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:23.455994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c5a12d-5516-4cb3-89b3-30a56525819b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:23.456699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c5a12d-5516-4cb3-89b3-30a56525819b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:23.457437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c5a12d-5516-4cb3-89b3-30a56525819b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:23.457938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c5a12d-5516-4cb3-89b3-30a56525819b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:23.458511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c5a12d-5516-4cb3-89b3-30a56525819b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:23.487369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-b4c5a12d-5516-4cb3-89b3-30a56525819b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lazy-loading 'flavor' on Instance uuid 9f2a6f90-d3c3-4741-b08c-ba80f635644d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:59:23.501066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4c5a12d-5516-4cb3-89b3-30a56525819b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Going to try to live migrate instance to n-h1-820368-35 {{(pid=128547) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:59:23.648806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-68984632-8c9d-44ba-bb25-b5ee7c0e01da tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:23.658642 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-68984632-8c9d-44ba-bb25-b5ee7c0e01da tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.664483 Aug 27 04:59:23.671596 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 860/1706] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:22 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:24.444348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4d69e726-a758-48c7-8798-5af225b50940 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Action: 'create', calling method: .version_select at 0x7fb5656954c0>, body: {"keypair": {"name": "tempest-keypair-203506146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNueBunBS5owEGO3Sv4sAi5B3u/uZMwHrdQZX8Wukjvx/tChEB6wUm7Nn3dj0NHcvTx613+ocoaigT1uNHIub9ovsao10lB1Ruwjj/iL35wiYsrHgWfmNveBfXdxZWaIMA=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:24.530868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4d69e726-a758-48c7-8798-5af225b50940 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Getting quotas for project 8a3dc24c6ca7475e8fc12b435cb84c63. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:24.537618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4d69e726-a758-48c7-8798-5af225b50940 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Getting quotas for user 4d0ae33c8651467ba9b736900f782a7b and project 8a3dc24c6ca7475e8fc12b435cb84c63. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:24.600679 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4d69e726-a758-48c7-8798-5af225b50940 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.161329 Aug 27 04:59:24.601653 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 861/1707] 10.222.0.58 () {62 vars in 1200 bytes} [Sat Aug 27 04:59:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 164 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 04:59:24.616108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:24.622927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:24.646981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:24.647670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:24.648318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:24.649150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:24.649977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:24.650546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:25.019138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:25.032360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:25.034488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:25.037792 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-42a57d4a-96a1-491b-9a98-6e51efba3951 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1279 microversion: 2.25 time: 0.426347 Aug 27 04:59:25.062551 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 862/1708] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:24 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1279 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:25.069635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1946c8bd-d4f9-4b9d-9fdd-413d6b16d464 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:25.070794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1946c8bd-d4f9-4b9d-9fdd-413d6b16d464 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:25.080586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1946c8bd-d4f9-4b9d-9fdd-413d6b16d464 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:25.081325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1946c8bd-d4f9-4b9d-9fdd-413d6b16d464 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:25.081985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1946c8bd-d4f9-4b9d-9fdd-413d6b16d464 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:25.082896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1946c8bd-d4f9-4b9d-9fdd-413d6b16d464 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:25.083579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1946c8bd-d4f9-4b9d-9fdd-413d6b16d464 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:25.084179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1946c8bd-d4f9-4b9d-9fdd-413d6b16d464 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:25.478607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1946c8bd-d4f9-4b9d-9fdd-413d6b16d464 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:25.492492 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1946c8bd-d4f9-4b9d-9fdd-413d6b16d464 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.428188 Aug 27 04:59:25.493747 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 863/1709] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:25 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:25.511942 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4c5a12d-5516-4cb3-89b3-30a56525819b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/action" status: 202 len: 0 microversion: 2.1 time: 2.072705 Aug 27 04:59:25.517817 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 847/1710] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 04:59:23 2022] POST /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/action => generated 0 bytes in 2079 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:59:25.523520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c9249cc-4b0d-4a11-9642-8d33a7cf633d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:25.524337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c9249cc-4b0d-4a11-9642-8d33a7cf633d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:25.568750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c9249cc-4b0d-4a11-9642-8d33a7cf633d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:25.569798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c9249cc-4b0d-4a11-9642-8d33a7cf633d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:25.577428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c9249cc-4b0d-4a11-9642-8d33a7cf633d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:25.579042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c9249cc-4b0d-4a11-9642-8d33a7cf633d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:25.580788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c9249cc-4b0d-4a11-9642-8d33a7cf633d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:25.582856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c9249cc-4b0d-4a11-9642-8d33a7cf633d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:25.906846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c9249cc-4b0d-4a11-9642-8d33a7cf633d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:25.924631 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c9249cc-4b0d-4a11-9642-8d33a7cf633d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.405606 Aug 27 04:59:25.925953 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 864/1711] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:25 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:26.067726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:26.068875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:26.079715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:26.080432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:26.081049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:26.081971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:26.082596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:26.083258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:26.388593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:26.415202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:26.417132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:26.418688 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d732c78-0766-44c8-8dda-a1776c43a680 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1279 microversion: 2.25 time: 0.355810 Aug 27 04:59:26.420210 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 848/1712] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:26 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1279 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:26.523691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c756c52a-6f4d-4a96-a4d2-987a953f18b8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:26.524985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c756c52a-6f4d-4a96-a4d2-987a953f18b8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:26.544699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c756c52a-6f4d-4a96-a4d2-987a953f18b8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:26.547144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c756c52a-6f4d-4a96-a4d2-987a953f18b8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:26.549547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c756c52a-6f4d-4a96-a4d2-987a953f18b8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:26.551911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c756c52a-6f4d-4a96-a4d2-987a953f18b8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:26.552567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c756c52a-6f4d-4a96-a4d2-987a953f18b8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:26.553563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c756c52a-6f4d-4a96-a4d2-987a953f18b8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:26.947287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c756c52a-6f4d-4a96-a4d2-987a953f18b8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:26.949726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-908c7774-dba9-43a2-a66e-3e7c782697af tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:26.951067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-908c7774-dba9-43a2-a66e-3e7c782697af tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:26.955033 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c756c52a-6f4d-4a96-a4d2-987a953f18b8 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.440417 Aug 27 04:59:26.959500 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 865/1713] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:26 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:26.994850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908c7774-dba9-43a2-a66e-3e7c782697af tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:26.995489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908c7774-dba9-43a2-a66e-3e7c782697af tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:26.995939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908c7774-dba9-43a2-a66e-3e7c782697af tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:27.000218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908c7774-dba9-43a2-a66e-3e7c782697af tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:27.000830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908c7774-dba9-43a2-a66e-3e7c782697af tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:27.001277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908c7774-dba9-43a2-a66e-3e7c782697af tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:27.323599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-908c7774-dba9-43a2-a66e-3e7c782697af tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:27.348712 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-908c7774-dba9-43a2-a66e-3e7c782697af tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.405386 Aug 27 04:59:27.350714 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 849/1714] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:26 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:27.443891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:27.444853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:27.452764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:27.453702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:27.454208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:27.455010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:27.455542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:27.455970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:27.985142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6cc517a5-b5a7-4d8b-a63c-ff27867fd435 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:27.986300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6cc517a5-b5a7-4d8b-a63c-ff27867fd435 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:28.001472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=48 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:28.007055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6cc517a5-b5a7-4d8b-a63c-ff27867fd435 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:28.019546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6cc517a5-b5a7-4d8b-a63c-ff27867fd435 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:28.020123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6cc517a5-b5a7-4d8b-a63c-ff27867fd435 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:28.020915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6cc517a5-b5a7-4d8b-a63c-ff27867fd435 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:28.021399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6cc517a5-b5a7-4d8b-a63c-ff27867fd435 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:28.021837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6cc517a5-b5a7-4d8b-a63c-ff27867fd435 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:28.209871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:28.229655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:28.231178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:28.232569 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-04b60196-3549-4fce-9497-f3e7928beaaa tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1279 microversion: 2.25 time: 0.793467 Aug 27 04:59:28.243186 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 866/1715] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:27 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1279 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:28.375067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fcde20c4-a715-4524-b628-22c54a6bdb1f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:28.376118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fcde20c4-a715-4524-b628-22c54a6bdb1f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:28.385254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcde20c4-a715-4524-b628-22c54a6bdb1f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:28.386135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcde20c4-a715-4524-b628-22c54a6bdb1f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:28.388168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcde20c4-a715-4524-b628-22c54a6bdb1f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:28.389622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcde20c4-a715-4524-b628-22c54a6bdb1f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:28.391930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcde20c4-a715-4524-b628-22c54a6bdb1f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:28.392632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcde20c4-a715-4524-b628-22c54a6bdb1f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:28.504150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6cc517a5-b5a7-4d8b-a63c-ff27867fd435 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:28.514185 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6cc517a5-b5a7-4d8b-a63c-ff27867fd435 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.535319 Aug 27 04:59:28.522631 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 850/1716] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:27 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:28.951474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fcde20c4-a715-4524-b628-22c54a6bdb1f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:28.961541 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fcde20c4-a715-4524-b628-22c54a6bdb1f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.592127 Aug 27 04:59:28.967577 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 867/1717] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:28 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:29.262249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:29.263060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:29.286637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:29.287662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:29.292205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:29.293047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:29.293710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:29.295268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:29.544422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2af4f889-0cde-454f-b893-cfc5c9960661 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:29.545798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2af4f889-0cde-454f-b893-cfc5c9960661 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:29.565490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4f889-0cde-454f-b893-cfc5c9960661 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:29.566387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4f889-0cde-454f-b893-cfc5c9960661 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:29.567536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4f889-0cde-454f-b893-cfc5c9960661 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:29.570158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4f889-0cde-454f-b893-cfc5c9960661 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:29.574636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4f889-0cde-454f-b893-cfc5c9960661 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:29.575377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4f889-0cde-454f-b893-cfc5c9960661 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:29.966490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:29.977926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:29.981666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:29.983106 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-88290091-0f7c-4793-b809-8b46a47c37d4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1279 microversion: 2.25 time: 0.726894 Aug 27 04:59:29.984975 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 851/1718] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:29 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1279 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:29.992066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1582617489", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "32cf6d11-5c35-4b8b-9ba9-ad4c03b77c54"}, {"port": "67c91f3b-28ff-46ab-b299-4183c0d6b2c2", "tag": "port-1"}, {"port": "9ee1e1d7-0d6d-4cbb-b872-87f8a3941c0d", "tag": "port-2"}, {"uuid": "e96d9258-d488-4d3e-a6d3-8c934d00f116", "tag": "net-1"}, {"uuid": "e96d9258-d488-4d3e-a6d3-8c934d00f116"}, {"uuid": "2cc57fb6-9024-4171-83a4-ca44e5ba59b4", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2cc57fb6-9024-4171-83a4-ca44e5ba59b4", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "3fa9fc8c-2f6f-4f0d-846c-3b3b0021e94a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c15cfaba-f24f-41d0-97c2-e8e1d52d67c2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6bc599b5-8dc2-4031-ad3b-129b8cf0fcfb", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1155667494"}], "key_name": "tempest-keypair-203506146", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:30.014857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2af4f889-0cde-454f-b893-cfc5c9960661 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:30.046294 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2af4f889-0cde-454f-b893-cfc5c9960661 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.507616 Aug 27 04:59:30.046900 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 868/1719] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:29 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:30.067058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7686fdc2-8c17-4b87-a5fb-a8d137937007 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:30.069641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7686fdc2-8c17-4b87-a5fb-a8d137937007 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:30.089960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7686fdc2-8c17-4b87-a5fb-a8d137937007 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:30.094744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7686fdc2-8c17-4b87-a5fb-a8d137937007 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:30.095523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7686fdc2-8c17-4b87-a5fb-a8d137937007 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:30.099067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7686fdc2-8c17-4b87-a5fb-a8d137937007 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:30.100315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7686fdc2-8c17-4b87-a5fb-a8d137937007 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:30.105513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7686fdc2-8c17-4b87-a5fb-a8d137937007 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:30.570832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] validate_networks() for [('32cf6d11-5c35-4b8b-9ba9-ad4c03b77c54', None, None, None, None, None), (None, None, '67c91f3b-28ff-46ab-b299-4183c0d6b2c2', None, None, None), (None, None, '9ee1e1d7-0d6d-4cbb-b872-87f8a3941c0d', None, None, None), ('e96d9258-d488-4d3e-a6d3-8c934d00f116', None, None, None, None, None), ('e96d9258-d488-4d3e-a6d3-8c934d00f116', None, None, None, None, None), ('2cc57fb6-9024-4171-83a4-ca44e5ba59b4', '10.2.2.100', None, None, None, None), ('2cc57fb6-9024-4171-83a4-ca44e5ba59b4', '10.2.2.200', None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:59:30.775597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7686fdc2-8c17-4b87-a5fb-a8d137937007 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:30.792608 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7686fdc2-8c17-4b87-a5fb-a8d137937007 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.743666 Aug 27 04:59:30.793873 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 869/1720] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:30 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:31.005252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-790d0c23-b56a-4d57-9350-42251264eca1 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Action: 'create', calling method: .version_select at 0x7fb564f51ca0>, body: {"keypair": {"name": "tempest-keypair-615069309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnoNeSYZrBiJsA1Y3XnV2PRCapl7btVaChS7KTEyzY/CDRtBt7pCwpsMJpMWjUq1TyOu7aAdbhvy8BFJ+7oXe+RpxtNk1DjKrgr1Cfa6qjuc3XGVpRQ6UZygB+dESG1fQ=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:31.023634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-790d0c23-b56a-4d57-9350-42251264eca1 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Getting quotas for project 6f32eb94d0f645c8b93736aa9cbca4ac. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:31.029821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-790d0c23-b56a-4d57-9350-42251264eca1 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Getting quotas for user 4efec2d2acb54894b87d63ff5f2c8238 and project 6f32eb94d0f645c8b93736aa9cbca4ac. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:31.060279 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-790d0c23-b56a-4d57-9350-42251264eca1 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.264974 Aug 27 04:59:31.060967 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 870/1721] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 04:59:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:31.289389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b6c1effe-fd8f-413e-83b2-b67cd52b5764"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:31.301952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:31.313769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:31.314818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:31.316618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:31.319212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:31.319983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:31.321313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:31.538139 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] HTTP exception thrown: Volume b6c1effe-fd8f-413e-83b2-b67cd52b5764 could not be found. Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Request method failure captured: Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: request: PUT /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments/362bb9d0-5bfa-427c-9204-738b54633eb2 HTTP/1.1 Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 74 Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaQeyNEph6AW5f-eiqCka1QSB7LTyKe8xvj2TXqdNmekLkIvevqibjcFAUIc4H4ypcKeFFdvh99BKFqPZqS6aw4n5MYMBsRLNOvCSYtHNXZVs3Q8RnFb6VgFqTlUxXYKyNtRqY-MLj-oIez_1_klgxPQfNS7lwJhmJDPFmkeWUXfbfE Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 03f3054975754cb1a7bea84907cf7b1e Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesAdminNegativeTest-553811104 Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 04:59:31.541485 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_03f3054975754cb1a7bea84907cf7b1e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/03f3054975754cb1a7bea84907cf7b1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/03f3054975754cb1a7bea84907cf7b1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/03f3054975754cb1a7bea84907cf7b1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesAdminNegativeTest-553811104 Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 03f3054975754cb1a7bea84907cf7b1e Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-553811104 Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesAdminNegativeTest-553811104-project-admin Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 845bc2cde797467893b8fdbccd7a0c08 Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesAdminNegativeTest-553811104-project-admin Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: {"volumeAttachment": {"volumeId": "b6c1effe-fd8f-413e-83b2-b67cd52b5764"}} Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 04:59:31.543640 n-d-820368-35 devstack@n-api.service[128548]: exception: Volume b6c1effe-fd8f-413e-83b2-b67cd52b5764 could not be found. Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'server_id': '13d93cb9-3f13-452d-8309-c6e3918db383', 'id': '362bb9d0-5bfa-427c-9204-738b54633eb2', 'body': {'volumeAttachment': {'volumeId': 'b6c1effe-fd8f-413e-83b2-b67cd52b5764'}}} Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:59:31.544877 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6c1effe-fd8f-413e-83b2-b67cd52b5764 could not be found. (HTTP 404) (Request-ID: req-926d5f15-b33b-4b75-a073-405b37867ace) Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:59:31.546764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6c1effe-fd8f-413e-83b2-b67cd52b5764 could not be found. Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:59:31.548745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume b6c1effe-fd8f-413e-83b2-b67cd52b5764 could not be found. Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6c1effe-fd8f-413e-83b2-b67cd52b5764 could not be found. Aug 27 04:59:31.550402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.556228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Returning 400 to user: Volume b6c1effe-fd8f-413e-83b2-b67cd52b5764 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:59:31.557500 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9c6904e-50e0-497b-a8f9-af6cbc3e72c8 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments/362bb9d0-5bfa-427c-9204-738b54633eb2" status: 400 len: 107 microversion: 2.1 time: 0.495281 Aug 27 04:59:31.562024 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 871/1722] 10.222.0.58 () {60 vars in 1433 bytes} [Sat Aug 27 04:59:31 2022] PUT /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments/362bb9d0-5bfa-427c-9204-738b54633eb2 => generated 107 bytes in 500 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:59:31.579621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:31.580536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:31.600973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:31.601614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:31.601903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:31.602653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:31.603268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:31.603613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:32.362518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:32.374567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:32.380064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:32.382269 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e841fa45-c4ea-4063-b0d0-6d2f70d7613a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1279 microversion: 2.25 time: 0.817798 Aug 27 04:59:32.383953 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 872/1723] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:31 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1279 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:32.399003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-71c8d4f9-f71b-4e78-bd09-1aba92dbcb7b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:32.400583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-71c8d4f9-f71b-4e78-bd09-1aba92dbcb7b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:32.408028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71c8d4f9-f71b-4e78-bd09-1aba92dbcb7b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:32.411831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71c8d4f9-f71b-4e78-bd09-1aba92dbcb7b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:32.414731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71c8d4f9-f71b-4e78-bd09-1aba92dbcb7b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:32.414731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71c8d4f9-f71b-4e78-bd09-1aba92dbcb7b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:32.414731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71c8d4f9-f71b-4e78-bd09-1aba92dbcb7b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:32.414731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71c8d4f9-f71b-4e78-bd09-1aba92dbcb7b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:33.076692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-71c8d4f9-f71b-4e78-bd09-1aba92dbcb7b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:33.093076 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-71c8d4f9-f71b-4e78-bd09-1aba92dbcb7b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.706335 Aug 27 04:59:33.108016 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 873/1724] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:32 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:33.120014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1eef140f-945c-430f-8b31-cae05a93a173 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:33.121043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1eef140f-945c-430f-8b31-cae05a93a173 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:33.135747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1eef140f-945c-430f-8b31-cae05a93a173 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:33.137730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1eef140f-945c-430f-8b31-cae05a93a173 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:33.138760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1eef140f-945c-430f-8b31-cae05a93a173 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:33.141317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1eef140f-945c-430f-8b31-cae05a93a173 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:33.142571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1eef140f-945c-430f-8b31-cae05a93a173 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:33.144110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1eef140f-945c-430f-8b31-cae05a93a173 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:33.332249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-1eef140f-945c-430f-8b31-cae05a93a173 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lazy-loading 'services' on Instance uuid 13d93cb9-3f13-452d-8309-c6e3918db383 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:59:33.489249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:33.513911 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1eef140f-945c-430f-8b31-cae05a93a173 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments/362bb9d0-5bfa-427c-9204-738b54633eb2" status: 202 len: 0 microversion: 2.1 time: 0.402873 Aug 27 04:59:33.516393 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 874/1725] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 04:59:33 2022] DELETE /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments/362bb9d0-5bfa-427c-9204-738b54633eb2 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:59:33.524938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8b7eac8-d474-4208-9ec8-f0045ce0ed28 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:33.526813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8b7eac8-d474-4208-9ec8-f0045ce0ed28 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:33.535848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b7eac8-d474-4208-9ec8-f0045ce0ed28 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:33.536836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b7eac8-d474-4208-9ec8-f0045ce0ed28 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:33.538376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b7eac8-d474-4208-9ec8-f0045ce0ed28 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:33.539351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b7eac8-d474-4208-9ec8-f0045ce0ed28 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:33.543359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b7eac8-d474-4208-9ec8-f0045ce0ed28 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:33.544104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8b7eac8-d474-4208-9ec8-f0045ce0ed28 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:34.299506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8b7eac8-d474-4208-9ec8-f0045ce0ed28 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:34.329181 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8b7eac8-d474-4208-9ec8-f0045ce0ed28 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.799109 Aug 27 04:59:34.332287 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 875/1726] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:33 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:34.351595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:34.354000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:34.383746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:34.384254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:34.387361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:34.389407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:34.392667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:34.393697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:34.941885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:34.957072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:34.959798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:34.961146 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8be92e6-5197-4b1e-8f31-b6447f527105 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1279 microversion: 2.25 time: 0.625393 Aug 27 04:59:34.961747 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 876/1727] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:34 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1279 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:34.967483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e1318c3e-5acc-4b93-8300-6e37d484a48c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:34.970421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e1318c3e-5acc-4b93-8300-6e37d484a48c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:34.977370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1318c3e-5acc-4b93-8300-6e37d484a48c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:34.978656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1318c3e-5acc-4b93-8300-6e37d484a48c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:34.979384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1318c3e-5acc-4b93-8300-6e37d484a48c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:34.980302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1318c3e-5acc-4b93-8300-6e37d484a48c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:34.980944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1318c3e-5acc-4b93-8300-6e37d484a48c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:34.981544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1318c3e-5acc-4b93-8300-6e37d484a48c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:35.026178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e1318c3e-5acc-4b93-8300-6e37d484a48c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062916 Aug 27 04:59:35.027796 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 877/1728] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 04:59:34 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:35.033126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cfe093fc-eee1-49ce-989b-87d5b592722c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:35.034125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cfe093fc-eee1-49ce-989b-87d5b592722c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:35.043028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe093fc-eee1-49ce-989b-87d5b592722c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:35.044719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe093fc-eee1-49ce-989b-87d5b592722c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:35.045751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe093fc-eee1-49ce-989b-87d5b592722c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:35.046927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe093fc-eee1-49ce-989b-87d5b592722c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:35.047627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe093fc-eee1-49ce-989b-87d5b592722c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:35.048425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe093fc-eee1-49ce-989b-87d5b592722c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:35.455057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cfe093fc-eee1-49ce-989b-87d5b592722c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:35.464957 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cfe093fc-eee1-49ce-989b-87d5b592722c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.435742 Aug 27 04:59:35.465544 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 878/1729] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:35 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:35.493541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8c811557-6661-4f07-8728-c8a15de6c86d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:35.498534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8c811557-6661-4f07-8728-c8a15de6c86d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:35.516333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c811557-6661-4f07-8728-c8a15de6c86d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:35.518593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c811557-6661-4f07-8728-c8a15de6c86d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:35.519082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c811557-6661-4f07-8728-c8a15de6c86d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:35.519866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c811557-6661-4f07-8728-c8a15de6c86d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:35.521203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c811557-6661-4f07-8728-c8a15de6c86d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:35.523352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c811557-6661-4f07-8728-c8a15de6c86d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:36.498718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8c811557-6661-4f07-8728-c8a15de6c86d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:36.516671 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8c811557-6661-4f07-8728-c8a15de6c86d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 1.038632 Aug 27 04:59:36.517416 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 879/1730] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:35 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:36.536202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:36.536824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:36.551335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:36.552022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:36.553676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:36.554610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:36.565490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:36.565904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:36.992993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:37.002084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:37.015646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:37.017091 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-28b74f87-b171-49ed-b37e-45333615f7e9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1279 microversion: 2.25 time: 0.488700 Aug 27 04:59:37.018038 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 880/1731] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:36 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1279 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:37.022976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-07addc64-2113-48ca-b177-f39d85e22b30 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:37.025817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-07addc64-2113-48ca-b177-f39d85e22b30 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:37.048285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07addc64-2113-48ca-b177-f39d85e22b30 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:37.048782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07addc64-2113-48ca-b177-f39d85e22b30 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:37.049219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07addc64-2113-48ca-b177-f39d85e22b30 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:37.049949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07addc64-2113-48ca-b177-f39d85e22b30 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:37.050405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07addc64-2113-48ca-b177-f39d85e22b30 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:37.051067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07addc64-2113-48ca-b177-f39d85e22b30 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:37.108986 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-07addc64-2113-48ca-b177-f39d85e22b30 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089268 Aug 27 04:59:37.122379 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 881/1732] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 04:59:37 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:37.127670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-2c064406-3b63-40e2-845f-7221f6e41706 req-0a54e8f2-b896-4d25-bbfc-3a38c93b17f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd4a82a-8c52-4d07-8009-16cb1268e380", "name": "network-vif-plugged", "status": "completed", "tag": "1e9e24a3-3955-4a83-97cb-a0d969604b5a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:37.146877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2c064406-3b63-40e2-845f-7221f6e41706 req-0a54e8f2-b896-4d25-bbfc-3a38c93b17f8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:37.152466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2c064406-3b63-40e2-845f-7221f6e41706 req-0a54e8f2-b896-4d25-bbfc-3a38c93b17f8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:37.153057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2c064406-3b63-40e2-845f-7221f6e41706 req-0a54e8f2-b896-4d25-bbfc-3a38c93b17f8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:37.185227 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-2c064406-3b63-40e2-845f-7221f6e41706 req-0a54e8f2-b896-4d25-bbfc-3a38c93b17f8 service nova] Creating event network-vif-plugged:1e9e24a3-3955-4a83-97cb-a0d969604b5a for instance ccd4a82a-8c52-4d07-8009-16cb1268e380 on n-h2-820368-35 Aug 27 04:59:37.191079 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-2c064406-3b63-40e2-845f-7221f6e41706 req-0a54e8f2-b896-4d25-bbfc-3a38c93b17f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067102 Aug 27 04:59:37.191715 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 882/1733] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:37.196792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cac9f516-48ee-4bdd-92b8-bf565bc0ec92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:37.197498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cac9f516-48ee-4bdd-92b8-bf565bc0ec92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:37.217201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cac9f516-48ee-4bdd-92b8-bf565bc0ec92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:37.217710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cac9f516-48ee-4bdd-92b8-bf565bc0ec92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:37.218153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cac9f516-48ee-4bdd-92b8-bf565bc0ec92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:37.218901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cac9f516-48ee-4bdd-92b8-bf565bc0ec92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:37.219387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cac9f516-48ee-4bdd-92b8-bf565bc0ec92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:37.219816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cac9f516-48ee-4bdd-92b8-bf565bc0ec92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:37.748849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cac9f516-48ee-4bdd-92b8-bf565bc0ec92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:37.769800 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cac9f516-48ee-4bdd-92b8-bf565bc0ec92 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.576730 Aug 27 04:59:37.770521 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 883/1734] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:37 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:37.794775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "4c30a03b-f4f7-43b1-a37d-05a13e0f38c8"}], "security_groups": [{"name": "tempest-securitygroup--495364823"}], "key_name": "tempest-keypair-615069309", "user_data": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:38.075413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:59:38.076328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:59:38.076939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:59:38.077493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:59:38.078177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:59:38.087709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] validate_networks() for [('4c30a03b-f4f7-43b1-a37d-05a13e0f38c8', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:59:38.109118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:38.112953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:38.113582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:38.116032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:38.121244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:38.123942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:38.200886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Getting quotas for project 8a3dc24c6ca7475e8fc12b435cb84c63. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:38.221275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Getting quotas for user 4d0ae33c8651467ba9b736900f782a7b and project 8a3dc24c6ca7475e8fc12b435cb84c63. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:38.568303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:59:38.571462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='3fa9fc8c-2f6f-4f0d-846c-3b3b0021e94a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c15cfaba-f24f-41d0-97c2-e8e1d52d67c2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6bc599b5-8dc2-4031-ad3b-129b8cf0fcfb',volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:59:38.840133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:59:38.841297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:59:38.841902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:59:38.842459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:59:38.843154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:59:38.855378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:38.856075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:38.857219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:38.858597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:38.859259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:38.859816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:38.881877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Getting quotas for project 6f32eb94d0f645c8b93736aa9cbca4ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:38.892958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Getting quotas for user 4efec2d2acb54894b87d63ff5f2c8238 and project 6f32eb94d0f645c8b93736aa9cbca4ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:38.922060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:38.943187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:59:38.947375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:59:39.061044 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9172281-0c49-4265-9e31-ea3f6d426457 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.288846 Aug 27 04:59:39.063365 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 884/1735] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:59:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:59:39.074107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3d0cd48c-be40-495e-923a-9b6dbaf0c6a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:39.077076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3d0cd48c-be40-495e-923a-9b6dbaf0c6a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:39.088916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d0cd48c-be40-495e-923a-9b6dbaf0c6a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:39.090103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d0cd48c-be40-495e-923a-9b6dbaf0c6a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:39.090907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d0cd48c-be40-495e-923a-9b6dbaf0c6a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:39.091923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d0cd48c-be40-495e-923a-9b6dbaf0c6a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:39.092960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d0cd48c-be40-495e-923a-9b6dbaf0c6a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:39.094144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d0cd48c-be40-495e-923a-9b6dbaf0c6a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:39.215200 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ee5740a3-a8ed-4f1d-ac20-b8a9b0921371 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 9.228828 Aug 27 04:59:39.222996 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 852/1736] 10.222.0.58 () {62 vars in 1189 bytes} [Sat Aug 27 04:59:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 9237 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:59:39.228132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:39.228947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:39.236297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:39.236958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:39.237543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:39.238446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:39.239041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:39.239637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:39.242776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:39.821305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3d0cd48c-be40-495e-923a-9b6dbaf0c6a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:39.836564 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3d0cd48c-be40-495e-923a-9b6dbaf0c6a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.771676 Aug 27 04:59:39.842975 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 885/1737] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:39 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:39.848260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c6901b0-92b2-4b5a-8262-362627e9a9b7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:39.861804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c6901b0-92b2-4b5a-8262-362627e9a9b7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:39.886489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6901b0-92b2-4b5a-8262-362627e9a9b7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:39.886989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6901b0-92b2-4b5a-8262-362627e9a9b7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:39.887497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6901b0-92b2-4b5a-8262-362627e9a9b7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:39.888239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6901b0-92b2-4b5a-8262-362627e9a9b7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:39.888701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6901b0-92b2-4b5a-8262-362627e9a9b7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:39.889129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6901b0-92b2-4b5a-8262-362627e9a9b7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:40.002967 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c6901b0-92b2-4b5a-8262-362627e9a9b7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158792 Aug 27 04:59:40.003597 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 886/1738] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 04:59:39 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:40.024349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9fdc810-f2cd-47ff-8051-fe8090657110 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:40.025585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c9fdc810-f2cd-47ff-8051-fe8090657110 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:40.054961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9fdc810-f2cd-47ff-8051-fe8090657110 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:40.055742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9fdc810-f2cd-47ff-8051-fe8090657110 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:40.056356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9fdc810-f2cd-47ff-8051-fe8090657110 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:40.057227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9fdc810-f2cd-47ff-8051-fe8090657110 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:40.058183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9fdc810-f2cd-47ff-8051-fe8090657110 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:40.058615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9fdc810-f2cd-47ff-8051-fe8090657110 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:40.082311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:40.121395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:40.128077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:40.135053 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-52e62466-3fa8-4e2c-84be-f2b28735858b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1279 microversion: 2.25 time: 0.906992 Aug 27 04:59:40.135932 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 853/1739] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:39 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1279 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:40.176470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7917bbc7-0dac-46a1-af2f-45ad9c1f4a26 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:40.177452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7917bbc7-0dac-46a1-af2f-45ad9c1f4a26 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:40.193711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7917bbc7-0dac-46a1-af2f-45ad9c1f4a26 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:40.197360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7917bbc7-0dac-46a1-af2f-45ad9c1f4a26 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:40.198301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7917bbc7-0dac-46a1-af2f-45ad9c1f4a26 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:40.201212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7917bbc7-0dac-46a1-af2f-45ad9c1f4a26 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:40.201701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7917bbc7-0dac-46a1-af2f-45ad9c1f4a26 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:40.202330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7917bbc7-0dac-46a1-af2f-45ad9c1f4a26 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:40.431315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7917bbc7-0dac-46a1-af2f-45ad9c1f4a26 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:40.439838 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7917bbc7-0dac-46a1-af2f-45ad9c1f4a26 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1229 microversion: 2.1 time: 0.294854 Aug 27 04:59:40.447809 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 854/1740] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:40 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1229 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:40.453025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab9f5690-ff7e-49fe-96b5-862b8be3a2ae tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:40.457447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ab9f5690-ff7e-49fe-96b5-862b8be3a2ae tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:40.682966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ab9f5690-ff7e-49fe-96b5-862b8be3a2ae tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:40.698856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ab9f5690-ff7e-49fe-96b5-862b8be3a2ae tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:40.709156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ab9f5690-ff7e-49fe-96b5-862b8be3a2ae tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:40.711132 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ab9f5690-ff7e-49fe-96b5-862b8be3a2ae tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1285 microversion: 2.42 time: 0.261936 Aug 27 04:59:40.711848 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 855/1741] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:40 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:40.738147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c9fdc810-f2cd-47ff-8051-fe8090657110 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:40.749436 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c9fdc810-f2cd-47ff-8051-fe8090657110 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.738063 Aug 27 04:59:40.751144 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 887/1742] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:40 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:40.858920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-72ee391b-b428-4eb5-a6d4-8339e9db5b1a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:40.859857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-72ee391b-b428-4eb5-a6d4-8339e9db5b1a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:40.873612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72ee391b-b428-4eb5-a6d4-8339e9db5b1a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:40.875669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72ee391b-b428-4eb5-a6d4-8339e9db5b1a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:40.877514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72ee391b-b428-4eb5-a6d4-8339e9db5b1a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:40.880030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72ee391b-b428-4eb5-a6d4-8339e9db5b1a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:40.883847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72ee391b-b428-4eb5-a6d4-8339e9db5b1a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:40.885135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72ee391b-b428-4eb5-a6d4-8339e9db5b1a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:41.014947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3cbcea57-3c83-4837-9b31-5bac3bc41347 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:41.017258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3cbcea57-3c83-4837-9b31-5bac3bc41347 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:41.032090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cbcea57-3c83-4837-9b31-5bac3bc41347 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:41.032746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cbcea57-3c83-4837-9b31-5bac3bc41347 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:41.035716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cbcea57-3c83-4837-9b31-5bac3bc41347 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:41.036749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cbcea57-3c83-4837-9b31-5bac3bc41347 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:41.037359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cbcea57-3c83-4837-9b31-5bac3bc41347 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:41.044199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cbcea57-3c83-4837-9b31-5bac3bc41347 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:41.116560 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3cbcea57-3c83-4837-9b31-5bac3bc41347 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105523 Aug 27 04:59:41.119762 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 888/1743] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 04:59:41 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:41.177173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:41.177821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:41.186282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:41.191710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:41.192471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:41.195282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:41.195931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:41.196374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:41.476924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-72ee391b-b428-4eb5-a6d4-8339e9db5b1a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:41.494596 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-72ee391b-b428-4eb5-a6d4-8339e9db5b1a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.640284 Aug 27 04:59:41.506260 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 856/1744] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:40 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:41.506260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-32fd2c11-79ec-4800-a09e-8333d3ad4034 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:41.506260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-32fd2c11-79ec-4800-a09e-8333d3ad4034 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:41.521608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fd2c11-79ec-4800-a09e-8333d3ad4034 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:41.522338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fd2c11-79ec-4800-a09e-8333d3ad4034 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:41.523877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fd2c11-79ec-4800-a09e-8333d3ad4034 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:41.531329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fd2c11-79ec-4800-a09e-8333d3ad4034 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:41.532019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fd2c11-79ec-4800-a09e-8333d3ad4034 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:41.533978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fd2c11-79ec-4800-a09e-8333d3ad4034 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:41.566995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:41.584104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:41.586833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:41.588782 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-54f20d85-544f-406e-bef1-4caacff0db9e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1475 microversion: 2.25 time: 0.421168 Aug 27 04:59:41.592688 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 889/1745] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:41 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1475 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:41.617064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc2b4205-752f-4312-bfd4-c27c39165642 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:41.617781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cc2b4205-752f-4312-bfd4-c27c39165642 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:41.628320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc2b4205-752f-4312-bfd4-c27c39165642 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:41.630877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc2b4205-752f-4312-bfd4-c27c39165642 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:41.633941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc2b4205-752f-4312-bfd4-c27c39165642 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:41.635226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc2b4205-752f-4312-bfd4-c27c39165642 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:41.635806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc2b4205-752f-4312-bfd4-c27c39165642 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:41.636343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc2b4205-752f-4312-bfd4-c27c39165642 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:41.748739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-32fd2c11-79ec-4800-a09e-8333d3ad4034 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:41.760388 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-32fd2c11-79ec-4800-a09e-8333d3ad4034 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1277 microversion: 2.1 time: 0.262477 Aug 27 04:59:41.773590 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 857/1746] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:41 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1277 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:41.786958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:41.787708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:41.796375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:41.797201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:41.797851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:41.798799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:41.799494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:41.800225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.060422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-cc2b4205-752f-4312-bfd4-c27c39165642 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid ccd4a82a-8c52-4d07-8009-16cb1268e380 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:59:42.092960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:42.103610 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cc2b4205-752f-4312-bfd4-c27c39165642 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1968 microversion: 2.25 time: 0.490167 Aug 27 04:59:42.104518 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 890/1747] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:41 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1968 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:42.109795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1d12199e-32c1-421c-a683-ea8fe98efcfb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:42.110896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1d12199e-32c1-421c-a683-ea8fe98efcfb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:42.112520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:42.118404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:42.119548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d12199e-32c1-421c-a683-ea8fe98efcfb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.121038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d12199e-32c1-421c-a683-ea8fe98efcfb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.121240 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7b539d14-23b5-4d5f-a456-2af9515ab955 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1575 microversion: 2.42 time: 0.340914 Aug 27 04:59:42.122278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d12199e-32c1-421c-a683-ea8fe98efcfb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.123028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d12199e-32c1-421c-a683-ea8fe98efcfb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.123430 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 858/1748] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:41 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1575 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:42.123822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d12199e-32c1-421c-a683-ea8fe98efcfb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.124345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d12199e-32c1-421c-a683-ea8fe98efcfb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.135681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-237a0fc8-a240-4955-aa37-2eb777904d58 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:42.139194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-237a0fc8-a240-4955-aa37-2eb777904d58 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:42.153552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237a0fc8-a240-4955-aa37-2eb777904d58 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.154166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237a0fc8-a240-4955-aa37-2eb777904d58 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.154709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237a0fc8-a240-4955-aa37-2eb777904d58 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.159451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237a0fc8-a240-4955-aa37-2eb777904d58 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.161007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237a0fc8-a240-4955-aa37-2eb777904d58 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.161557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237a0fc8-a240-4955-aa37-2eb777904d58 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.469039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1d12199e-32c1-421c-a683-ea8fe98efcfb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:42.481011 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1d12199e-32c1-421c-a683-ea8fe98efcfb tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.374732 Aug 27 04:59:42.483459 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 891/1749] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:42 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:42.489785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-041bd2a0-d035-4900-80dc-3a8953563baa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:42.493870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-041bd2a0-d035-4900-80dc-3a8953563baa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:42.501452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-041bd2a0-d035-4900-80dc-3a8953563baa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.502000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-041bd2a0-d035-4900-80dc-3a8953563baa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.502514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-041bd2a0-d035-4900-80dc-3a8953563baa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.503366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-041bd2a0-d035-4900-80dc-3a8953563baa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.504749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-041bd2a0-d035-4900-80dc-3a8953563baa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.505383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-041bd2a0-d035-4900-80dc-3a8953563baa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.534187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-237a0fc8-a240-4955-aa37-2eb777904d58 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid ccd4a82a-8c52-4d07-8009-16cb1268e380 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:59:42.535042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:42.549900 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-041bd2a0-d035-4900-80dc-3a8953563baa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064872 Aug 27 04:59:42.551337 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 892/1750] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 04:59:42 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:42.552939 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-237a0fc8-a240-4955-aa37-2eb777904d58 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1968 microversion: 2.25 time: 0.427667 Aug 27 04:59:42.553992 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 859/1751] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:42 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1968 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:42.556474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-344a55a7-a110-4858-a87c-f17fa0ee329a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:42.557091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-344a55a7-a110-4858-a87c-f17fa0ee329a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:42.564366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-344a55a7-a110-4858-a87c-f17fa0ee329a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.565207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-344a55a7-a110-4858-a87c-f17fa0ee329a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.568021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-344a55a7-a110-4858-a87c-f17fa0ee329a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.568021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-344a55a7-a110-4858-a87c-f17fa0ee329a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.568021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-344a55a7-a110-4858-a87c-f17fa0ee329a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.568021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-344a55a7-a110-4858-a87c-f17fa0ee329a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.578176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-237d6e0c-0a1c-4ade-895b-56ad899838ec tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:42.582120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237d6e0c-0a1c-4ade-895b-56ad899838ec tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.582781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237d6e0c-0a1c-4ade-895b-56ad899838ec tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.583521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237d6e0c-0a1c-4ade-895b-56ad899838ec tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.584973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237d6e0c-0a1c-4ade-895b-56ad899838ec tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.585666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237d6e0c-0a1c-4ade-895b-56ad899838ec tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.586278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-237d6e0c-0a1c-4ade-895b-56ad899838ec tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.615331 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-237d6e0c-0a1c-4ade-895b-56ad899838ec tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.041267 Aug 27 04:59:42.623763 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 860/1752] 10.222.0.58 () {60 vars in 1217 bytes} [Sat Aug 27 04:59:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:59:42.630115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d96161fd-ef58-45a5-8aa5-d80a94b3f096 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-820368-35", "block_migration": "auto"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:42.632805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d96161fd-ef58-45a5-8aa5-d80a94b3f096 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:42.639597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d96161fd-ef58-45a5-8aa5-d80a94b3f096 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.640094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d96161fd-ef58-45a5-8aa5-d80a94b3f096 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.640535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d96161fd-ef58-45a5-8aa5-d80a94b3f096 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.641295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d96161fd-ef58-45a5-8aa5-d80a94b3f096 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.641758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d96161fd-ef58-45a5-8aa5-d80a94b3f096 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.642184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d96161fd-ef58-45a5-8aa5-d80a94b3f096 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.678920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-d96161fd-ef58-45a5-8aa5-d80a94b3f096 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'flavor' on Instance uuid ccd4a82a-8c52-4d07-8009-16cb1268e380 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:59:42.693577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d96161fd-ef58-45a5-8aa5-d80a94b3f096 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Going to try to live migrate instance to n-h1-820368-35 {{(pid=128547) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:59:42.787019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-344a55a7-a110-4858-a87c-f17fa0ee329a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:42.814934 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-344a55a7-a110-4858-a87c-f17fa0ee329a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.254840 Aug 27 04:59:42.818700 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 893/1753] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:42 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:42.826843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4afb6e4d-c61d-440f-bdfa-02c976944be0 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:42.829535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4afb6e4d-c61d-440f-bdfa-02c976944be0 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:42.843851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4afb6e4d-c61d-440f-bdfa-02c976944be0 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.845498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4afb6e4d-c61d-440f-bdfa-02c976944be0 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.846163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4afb6e4d-c61d-440f-bdfa-02c976944be0 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.853208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4afb6e4d-c61d-440f-bdfa-02c976944be0 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.853976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4afb6e4d-c61d-440f-bdfa-02c976944be0 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.854610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4afb6e4d-c61d-440f-bdfa-02c976944be0 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:43.006555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4afb6e4d-c61d-440f-bdfa-02c976944be0 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:43.017261 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4afb6e4d-c61d-440f-bdfa-02c976944be0 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1285 microversion: 2.1 time: 0.196907 Aug 27 04:59:43.037674 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 894/1754] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:42 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:43.148415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:43.149200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:43.177677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:43.178340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:43.180357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:43.184755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:43.186694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:43.187245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:43.387483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:43.412827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:43.416910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:43.421030 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-26a577cc-d2f9-4f2a-81e8-f3fb5d361b29 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1575 microversion: 2.42 time: 0.276842 Aug 27 04:59:43.424838 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 895/1755] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:43 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1575 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:43.507261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-afcc9be1-811d-44c3-ac1d-659eff58f209 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:43.508055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-afcc9be1-811d-44c3-ac1d-659eff58f209 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:43.514902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afcc9be1-811d-44c3-ac1d-659eff58f209 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:43.515693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afcc9be1-811d-44c3-ac1d-659eff58f209 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:43.516124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afcc9be1-811d-44c3-ac1d-659eff58f209 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:43.517016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afcc9be1-811d-44c3-ac1d-659eff58f209 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:43.517640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afcc9be1-811d-44c3-ac1d-659eff58f209 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:43.518247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afcc9be1-811d-44c3-ac1d-659eff58f209 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:43.783637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-afcc9be1-811d-44c3-ac1d-659eff58f209 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:43.802105 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-afcc9be1-811d-44c3-ac1d-659eff58f209 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.301469 Aug 27 04:59:43.813011 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 896/1756] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:43 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:43.818330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-681a9639-b733-403e-9af7-ed54d4c20997 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:43.820943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-681a9639-b733-403e-9af7-ed54d4c20997 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:43.826926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-681a9639-b733-403e-9af7-ed54d4c20997 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:43.827447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-681a9639-b733-403e-9af7-ed54d4c20997 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:43.827889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-681a9639-b733-403e-9af7-ed54d4c20997 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:43.828591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-681a9639-b733-403e-9af7-ed54d4c20997 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:43.829642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-681a9639-b733-403e-9af7-ed54d4c20997 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:43.830084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-681a9639-b733-403e-9af7-ed54d4c20997 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:43.893407 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-681a9639-b733-403e-9af7-ed54d4c20997 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075980 Aug 27 04:59:43.902468 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 897/1757] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 04:59:43 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:59:43.912117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-82f2651a-afd3-44cb-8e14-5280a23515d1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:43.917508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-82f2651a-afd3-44cb-8e14-5280a23515d1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:43.930236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82f2651a-afd3-44cb-8e14-5280a23515d1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:43.931921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82f2651a-afd3-44cb-8e14-5280a23515d1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:43.932988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82f2651a-afd3-44cb-8e14-5280a23515d1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:43.940074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82f2651a-afd3-44cb-8e14-5280a23515d1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:43.940572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82f2651a-afd3-44cb-8e14-5280a23515d1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:43.941018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82f2651a-afd3-44cb-8e14-5280a23515d1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:44.742315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-82f2651a-afd3-44cb-8e14-5280a23515d1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:44.756992 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-82f2651a-afd3-44cb-8e14-5280a23515d1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.852766 Aug 27 04:59:44.757624 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 898/1758] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:43 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:44.778473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8d9b523-678a-43d1-8493-d48b71550f57 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:44.779115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e8d9b523-678a-43d1-8493-d48b71550f57 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:44.819591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d9b523-678a-43d1-8493-d48b71550f57 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:44.820174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d9b523-678a-43d1-8493-d48b71550f57 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:44.820634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d9b523-678a-43d1-8493-d48b71550f57 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:44.821945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d9b523-678a-43d1-8493-d48b71550f57 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:44.822412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d9b523-678a-43d1-8493-d48b71550f57 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:44.830615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8d9b523-678a-43d1-8493-d48b71550f57 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:45.008039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e8d9b523-678a-43d1-8493-d48b71550f57 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:45.017452 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e8d9b523-678a-43d1-8493-d48b71550f57 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1283 microversion: 2.1 time: 0.243382 Aug 27 04:59:45.036753 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 899/1759] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:44 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1283 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:45.042014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-647842065", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "5b5f4cf8-9522-441e-b471-d0d27607bafd"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:45.176353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] validate_networks() for [('5b5f4cf8-9522-441e-b471-d0d27607bafd', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:59:47.178090 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d96161fd-ef58-45a5-8aa5-d80a94b3f096 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380/action" status: 202 len: 0 microversion: 2.25 time: 4.552318 Aug 27 04:59:47.181343 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 861/1760] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 04:59:42 2022] POST /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380/action => generated 0 bytes in 4557 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:59:47.193362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:47.195449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:47.249669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:47.255827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:47.256542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:47.257114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:59:47.257768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:59:47.258757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:59:47.258878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:47.259843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:59:47.260544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:59:47.261929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:47.266953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:47.300092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=15 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:47.301936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:47.306890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:47.307583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:47.309008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:47.309636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:47.310214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:47.377474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Getting quotas for project 24e778c9967549f5b7641c2b8df74302. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:47.395604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Getting quotas for user d16fabfbcd5b4a7182b18918a1e3e3e7 and project 24e778c9967549f5b7641c2b8df74302. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:47.432396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:59:47.434917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:59:47.533171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:47.546100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:47.547340 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-86c8e1c0-5108-49bd-af5b-a7d5baccec5a tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.505772 Aug 27 04:59:47.548254 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 900/1761] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 04:59:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:59:47.557633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-47e4de79-ae05-4003-aa40-a37cbf2a3ec0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:47.558931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-47e4de79-ae05-4003-aa40-a37cbf2a3ec0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:47.559843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:47.561091 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-72b13f17-58ea-4f66-a91e-6990ac540714 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1593 microversion: 2.42 time: 0.378395 Aug 27 04:59:47.561679 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 862/1762] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:47 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1593 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:47.571917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-62f428c5-d28a-4fc9-b462-5ef92f54b766 req-1772b0af-2d54-42b1-9bc3-3467b9948b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2a6f90-d3c3-4741-b08c-ba80f635644d", "name": "network-vif-unplugged", "status": "completed", "tag": "c01490d9-89be-4dee-aa67-dfb553426cc3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:47.593526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e4de79-ae05-4003-aa40-a37cbf2a3ec0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:47.600537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e4de79-ae05-4003-aa40-a37cbf2a3ec0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:47.601801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e4de79-ae05-4003-aa40-a37cbf2a3ec0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:47.603366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e4de79-ae05-4003-aa40-a37cbf2a3ec0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:47.608854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-62f428c5-d28a-4fc9-b462-5ef92f54b766 req-1772b0af-2d54-42b1-9bc3-3467b9948b00 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:47.609275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-62f428c5-d28a-4fc9-b462-5ef92f54b766 req-1772b0af-2d54-42b1-9bc3-3467b9948b00 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:47.609715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-62f428c5-d28a-4fc9-b462-5ef92f54b766 req-1772b0af-2d54-42b1-9bc3-3467b9948b00 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:47.634315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e4de79-ae05-4003-aa40-a37cbf2a3ec0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:47.635827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e4de79-ae05-4003-aa40-a37cbf2a3ec0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:47.642465 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-62f428c5-d28a-4fc9-b462-5ef92f54b766 req-1772b0af-2d54-42b1-9bc3-3467b9948b00 service nova] Creating event network-vif-unplugged:c01490d9-89be-4dee-aa67-dfb553426cc3 for instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d on n-h2-820368-35 Aug 27 04:59:47.655541 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-62f428c5-d28a-4fc9-b462-5ef92f54b766 req-1772b0af-2d54-42b1-9bc3-3467b9948b00 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092408 Aug 27 04:59:47.660056 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 863/1763] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:47.670789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8bdf4975-74e1-48a4-b62f-934a215b314f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:47.671808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8bdf4975-74e1-48a4-b62f-934a215b314f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:47.679535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bdf4975-74e1-48a4-b62f-934a215b314f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:47.680298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bdf4975-74e1-48a4-b62f-934a215b314f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:47.681132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bdf4975-74e1-48a4-b62f-934a215b314f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:47.682014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bdf4975-74e1-48a4-b62f-934a215b314f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:47.682615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bdf4975-74e1-48a4-b62f-934a215b314f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:47.683226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bdf4975-74e1-48a4-b62f-934a215b314f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:48.211004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8bdf4975-74e1-48a4-b62f-934a215b314f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:48.226942 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8bdf4975-74e1-48a4-b62f-934a215b314f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.564163 Aug 27 04:59:48.228542 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 864/1764] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:47 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:48.234516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68ed112e-b0e5-4497-84ec-9c67e277df3e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:48.235352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68ed112e-b0e5-4497-84ec-9c67e277df3e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:48.255895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ed112e-b0e5-4497-84ec-9c67e277df3e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:48.257145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ed112e-b0e5-4497-84ec-9c67e277df3e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:48.260207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ed112e-b0e5-4497-84ec-9c67e277df3e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:48.264229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ed112e-b0e5-4497-84ec-9c67e277df3e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:48.265003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ed112e-b0e5-4497-84ec-9c67e277df3e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:48.266721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68ed112e-b0e5-4497-84ec-9c67e277df3e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:48.344203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-47e4de79-ae05-4003-aa40-a37cbf2a3ec0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:48.361581 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-47e4de79-ae05-4003-aa40-a37cbf2a3ec0 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.808723 Aug 27 04:59:48.374513 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 901/1765] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:47 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:48.398067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:48.398694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:48.429368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:48.429881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:48.430330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:48.434657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:48.435299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:48.436553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:48.865272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68ed112e-b0e5-4497-84ec-9c67e277df3e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:48.878577 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68ed112e-b0e5-4497-84ec-9c67e277df3e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1350 microversion: 2.1 time: 0.645566 Aug 27 04:59:48.879527 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 865/1766] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:48 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1350 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:48.896582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23186085-8a77-4574-b2e3-716164e35992 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:48.897327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-23186085-8a77-4574-b2e3-716164e35992 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:48.914339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23186085-8a77-4574-b2e3-716164e35992 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:48.925200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23186085-8a77-4574-b2e3-716164e35992 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:48.926340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23186085-8a77-4574-b2e3-716164e35992 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:48.927128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23186085-8a77-4574-b2e3-716164e35992 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:48.927609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23186085-8a77-4574-b2e3-716164e35992 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:48.935780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23186085-8a77-4574-b2e3-716164e35992 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:49.029404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:49.043080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:49.044621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:49.048398 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-38256489-22ce-4568-aa00-e1c0f3c803c3 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.659178 Aug 27 04:59:49.053327 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 902/1767] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:48 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:49.070064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:49.070188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:49.079779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:49.081543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:49.081981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:49.082727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:49.083372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:49.083966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:49.149991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23186085-8a77-4574-b2e3-716164e35992 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:49.166116 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-23186085-8a77-4574-b2e3-716164e35992 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1213 microversion: 2.1 time: 0.282383 Aug 27 04:59:49.168864 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 866/1768] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:48 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1213 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:49.255120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2a94c0e-6049-4b29-9ed9-4222fd0f5d29 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:49.255739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a2a94c0e-6049-4b29-9ed9-4222fd0f5d29 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:49.265313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2a94c0e-6049-4b29-9ed9-4222fd0f5d29 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:49.267720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2a94c0e-6049-4b29-9ed9-4222fd0f5d29 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:49.268511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2a94c0e-6049-4b29-9ed9-4222fd0f5d29 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:49.270625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2a94c0e-6049-4b29-9ed9-4222fd0f5d29 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:49.271188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2a94c0e-6049-4b29-9ed9-4222fd0f5d29 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:49.271687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2a94c0e-6049-4b29-9ed9-4222fd0f5d29 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:49.976463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:49.983817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a2a94c0e-6049-4b29-9ed9-4222fd0f5d29 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:49.996858 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2a94c0e-6049-4b29-9ed9-4222fd0f5d29 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.745676 Aug 27 04:59:50.000046 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 867/1769] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:49 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:50.004418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:50.009751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:50.011507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a333f179-e7ab-47d6-bb57-f07e0c8e9135 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:50.012223 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b45f6365-7ee1-448a-b658-e39bb5aebe3c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1661 microversion: 2.42 time: 0.957709 Aug 27 04:59:50.013340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a333f179-e7ab-47d6-bb57-f07e0c8e9135 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:50.014203 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 903/1770] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:49 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1661 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:50.028264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b7f904e8-6fac-47a6-9efc-09e82e0b902d req-ebd9103c-0adc-499e-98a9-d2d1f7f96a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2a6f90-d3c3-4741-b08c-ba80f635644d", "tag": "c01490d9-89be-4dee-aa67-dfb553426cc3"}, {"name": "network-changed", "server_uuid": "7fa8507d-68a8-41bb-95b8-7cae5c5e7216", "tag": "251ac4eb-fa7e-4c6a-9b51-d6264fbc8ca4"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:50.030766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a333f179-e7ab-47d6-bb57-f07e0c8e9135 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:50.031273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a333f179-e7ab-47d6-bb57-f07e0c8e9135 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:50.032126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a333f179-e7ab-47d6-bb57-f07e0c8e9135 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:50.037175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a333f179-e7ab-47d6-bb57-f07e0c8e9135 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:50.037669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a333f179-e7ab-47d6-bb57-f07e0c8e9135 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:50.038166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a333f179-e7ab-47d6-bb57-f07e0c8e9135 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:50.052579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b7f904e8-6fac-47a6-9efc-09e82e0b902d req-ebd9103c-0adc-499e-98a9-d2d1f7f96a04 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:50.053066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b7f904e8-6fac-47a6-9efc-09e82e0b902d req-ebd9103c-0adc-499e-98a9-d2d1f7f96a04 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:50.053505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b7f904e8-6fac-47a6-9efc-09e82e0b902d req-ebd9103c-0adc-499e-98a9-d2d1f7f96a04 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:50.088768 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b7f904e8-6fac-47a6-9efc-09e82e0b902d req-ebd9103c-0adc-499e-98a9-d2d1f7f96a04 service nova] Creating event network-changed:c01490d9-89be-4dee-aa67-dfb553426cc3 for instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d on n-h2-820368-35 Aug 27 04:59:50.089503 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b7f904e8-6fac-47a6-9efc-09e82e0b902d req-ebd9103c-0adc-499e-98a9-d2d1f7f96a04 service nova] Creating event network-changed:251ac4eb-fa7e-4c6a-9b51-d6264fbc8ca4 for instance 7fa8507d-68a8-41bb-95b8-7cae5c5e7216 on n-h1-820368-35 Aug 27 04:59:50.103273 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b7f904e8-6fac-47a6-9efc-09e82e0b902d req-ebd9103c-0adc-499e-98a9-d2d1f7f96a04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085769 Aug 27 04:59:50.104159 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 904/1771] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:50.117519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-72b863d4-3c91-48ec-9580-f4a59b910ef3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:50.118826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-72b863d4-3c91-48ec-9580-f4a59b910ef3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:50.127658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72b863d4-3c91-48ec-9580-f4a59b910ef3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:50.128294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72b863d4-3c91-48ec-9580-f4a59b910ef3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:50.128919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72b863d4-3c91-48ec-9580-f4a59b910ef3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:50.129758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72b863d4-3c91-48ec-9580-f4a59b910ef3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:50.130225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72b863d4-3c91-48ec-9580-f4a59b910ef3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:50.130656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72b863d4-3c91-48ec-9580-f4a59b910ef3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:50.346413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a333f179-e7ab-47d6-bb57-f07e0c8e9135 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:50.361364 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a333f179-e7ab-47d6-bb57-f07e0c8e9135 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1472 microversion: 2.1 time: 0.359480 Aug 27 04:59:50.363776 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 868/1772] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:50 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1472 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:50.381272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:50.382350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:50.398888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:50.400360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:50.400963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:50.402326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:50.402937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:50.403595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:50.695459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:50.735508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-72b863d4-3c91-48ec-9580-f4a59b910ef3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:50.758423 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-72b863d4-3c91-48ec-9580-f4a59b910ef3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1350 microversion: 2.1 time: 0.653113 Aug 27 04:59:50.763887 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 905/1773] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:50 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1350 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:50.779440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-72ecc6f0-1e71-412a-b86d-167f53aedc0e tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:50.781226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-72ecc6f0-1e71-412a-b86d-167f53aedc0e tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:50.800124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72ecc6f0-1e71-412a-b86d-167f53aedc0e tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:50.800850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72ecc6f0-1e71-412a-b86d-167f53aedc0e tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:50.801506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72ecc6f0-1e71-412a-b86d-167f53aedc0e tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:50.807848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72ecc6f0-1e71-412a-b86d-167f53aedc0e tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:50.814665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72ecc6f0-1e71-412a-b86d-167f53aedc0e tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:50.815741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72ecc6f0-1e71-412a-b86d-167f53aedc0e tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:51.024251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-72ecc6f0-1e71-412a-b86d-167f53aedc0e tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:51.035673 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-72ecc6f0-1e71-412a-b86d-167f53aedc0e tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1275 microversion: 2.1 time: 0.269582 Aug 27 04:59:51.042878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:51.045578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:51.066912 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 906/1774] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:50 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:51.076127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4466e5a9-2aaa-4e51-a9c7-f37017d36c5d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:51.077407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:51.080220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4466e5a9-2aaa-4e51-a9c7-f37017d36c5d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:51.082154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:51.083689 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e6e249d-e4e9-4323-b9b5-5a07cc1e4ba2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.715833 Aug 27 04:59:51.100241 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 869/1775] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:50 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:51.111931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4466e5a9-2aaa-4e51-a9c7-f37017d36c5d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:51.112658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4466e5a9-2aaa-4e51-a9c7-f37017d36c5d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:51.113240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4466e5a9-2aaa-4e51-a9c7-f37017d36c5d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:51.114199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:51.115064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4466e5a9-2aaa-4e51-a9c7-f37017d36c5d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:51.115901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:51.116515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4466e5a9-2aaa-4e51-a9c7-f37017d36c5d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:51.117550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4466e5a9-2aaa-4e51-a9c7-f37017d36c5d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:51.135179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:51.136601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:51.140725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:51.141886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:51.142568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:51.143327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:51.653481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:51.683993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4466e5a9-2aaa-4e51-a9c7-f37017d36c5d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:51.699801 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4466e5a9-2aaa-4e51-a9c7-f37017d36c5d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.631356 Aug 27 04:59:51.701363 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 907/1776] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:51 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:51.706513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b344aa4c-ecae-4f46-94ba-a5739453be19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:51.707478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b344aa4c-ecae-4f46-94ba-a5739453be19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:51.712557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:51.724640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:51.728711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b344aa4c-ecae-4f46-94ba-a5739453be19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:51.729212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b344aa4c-ecae-4f46-94ba-a5739453be19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:51.731774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b344aa4c-ecae-4f46-94ba-a5739453be19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:51.732534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b344aa4c-ecae-4f46-94ba-a5739453be19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:51.732916 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ecfc991-6fa9-4a8a-a112-0091b4ddfbc3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1708 microversion: 2.42 time: 0.629372 Aug 27 04:59:51.733129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b344aa4c-ecae-4f46-94ba-a5739453be19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:51.737755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b344aa4c-ecae-4f46-94ba-a5739453be19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:51.742104 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 870/1777] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:51 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1708 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:51.788451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4734bca-9398-4bf0-8a93-d055634116fc tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:51.789277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4734bca-9398-4bf0-8a93-d055634116fc tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:51.833630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4734bca-9398-4bf0-8a93-d055634116fc tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:51.844736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4734bca-9398-4bf0-8a93-d055634116fc tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:51.845205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4734bca-9398-4bf0-8a93-d055634116fc tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:51.848585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4734bca-9398-4bf0-8a93-d055634116fc tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:51.854420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4734bca-9398-4bf0-8a93-d055634116fc tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:51.855474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4734bca-9398-4bf0-8a93-d055634116fc tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:52.081113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b344aa4c-ecae-4f46-94ba-a5739453be19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:52.096067 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b344aa4c-ecae-4f46-94ba-a5739453be19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1478 microversion: 2.1 time: 0.393291 Aug 27 04:59:52.097510 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 908/1778] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:51 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1478 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:52.104217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-caf15e3b-a7d6-45cc-93a3-0ec98d39a0aa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:52.105192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-caf15e3b-a7d6-45cc-93a3-0ec98d39a0aa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:52.118346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-caf15e3b-a7d6-45cc-93a3-0ec98d39a0aa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:52.119174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-caf15e3b-a7d6-45cc-93a3-0ec98d39a0aa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:52.119898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-caf15e3b-a7d6-45cc-93a3-0ec98d39a0aa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:52.120777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-caf15e3b-a7d6-45cc-93a3-0ec98d39a0aa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:52.121369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-caf15e3b-a7d6-45cc-93a3-0ec98d39a0aa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:52.122198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-caf15e3b-a7d6-45cc-93a3-0ec98d39a0aa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:52.265495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-caf15e3b-a7d6-45cc-93a3-0ec98d39a0aa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:52.276736 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-caf15e3b-a7d6-45cc-93a3-0ec98d39a0aa tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1275 microversion: 2.1 time: 0.177893 Aug 27 04:59:52.278290 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 909/1779] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:52 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:52.285082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b4734bca-9398-4bf0-8a93-d055634116fc tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:52.300087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:52.301039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:52.309566 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4734bca-9398-4bf0-8a93-d055634116fc tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1350 microversion: 2.1 time: 0.526505 Aug 27 04:59:52.323853 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 871/1780] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:51 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1350 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:52.332985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:52.333795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:52.334564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:52.335639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:52.336479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:52.336858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:52.364157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:52.726419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ad5d756-f3fc-49cc-b91e-87d563d88ded tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:52.744043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3ad5d756-f3fc-49cc-b91e-87d563d88ded tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:52.746977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:52.760166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ad5d756-f3fc-49cc-b91e-87d563d88ded tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:52.761061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ad5d756-f3fc-49cc-b91e-87d563d88ded tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:52.761700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ad5d756-f3fc-49cc-b91e-87d563d88ded tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:52.762622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ad5d756-f3fc-49cc-b91e-87d563d88ded tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:52.763266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ad5d756-f3fc-49cc-b91e-87d563d88ded tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:52.764233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ad5d756-f3fc-49cc-b91e-87d563d88ded tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:52.846749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:52.855748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:52.862918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:52.864277 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ead10339-5de7-433d-9aac-87ecda5f5de9 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.583912 Aug 27 04:59:52.871943 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 910/1781] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:52 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:52.883610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:52.883610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:52.894675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:52.895320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:52.895936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:52.896602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:52.897141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:52.897645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:53.382271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3ad5d756-f3fc-49cc-b91e-87d563d88ded tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:53.394141 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3ad5d756-f3fc-49cc-b91e-87d563d88ded tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.676205 Aug 27 04:59:53.396181 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 872/1782] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:52 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:53.403228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d84f2c7-2793-4d5f-bd8b-c0d4bc303f2d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:53.404703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d84f2c7-2793-4d5f-bd8b-c0d4bc303f2d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:53.413927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d84f2c7-2793-4d5f-bd8b-c0d4bc303f2d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:53.414719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d84f2c7-2793-4d5f-bd8b-c0d4bc303f2d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:53.415990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d84f2c7-2793-4d5f-bd8b-c0d4bc303f2d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:53.417297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d84f2c7-2793-4d5f-bd8b-c0d4bc303f2d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:53.417989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d84f2c7-2793-4d5f-bd8b-c0d4bc303f2d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:53.418492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d84f2c7-2793-4d5f-bd8b-c0d4bc303f2d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:53.436358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:53.450067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:53.452472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:53.454001 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-35788877-3086-4972-90a4-8d2c1d655f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1755 microversion: 2.42 time: 0.580984 Aug 27 04:59:53.463833 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 911/1783] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:52 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1755 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:53.478688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33f063ad-a5dd-4dcd-ba16-d06a43e8e344 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:53.479501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-33f063ad-a5dd-4dcd-ba16-d06a43e8e344 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:53.487320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33f063ad-a5dd-4dcd-ba16-d06a43e8e344 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:53.487826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33f063ad-a5dd-4dcd-ba16-d06a43e8e344 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:53.488341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33f063ad-a5dd-4dcd-ba16-d06a43e8e344 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:53.489294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33f063ad-a5dd-4dcd-ba16-d06a43e8e344 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:53.489814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33f063ad-a5dd-4dcd-ba16-d06a43e8e344 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:53.490309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33f063ad-a5dd-4dcd-ba16-d06a43e8e344 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:54.083886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d84f2c7-2793-4d5f-bd8b-c0d4bc303f2d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:54.110777 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d84f2c7-2793-4d5f-bd8b-c0d4bc303f2d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1478 microversion: 2.1 time: 0.712988 Aug 27 04:59:54.112458 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 873/1784] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:53 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1478 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:54.118090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ca482ac5-a605-4c34-9395-3fa86a81ef88 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:54.119882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ca482ac5-a605-4c34-9395-3fa86a81ef88 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:54.131521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca482ac5-a605-4c34-9395-3fa86a81ef88 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:54.132491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca482ac5-a605-4c34-9395-3fa86a81ef88 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:54.133264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca482ac5-a605-4c34-9395-3fa86a81ef88 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:54.135265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca482ac5-a605-4c34-9395-3fa86a81ef88 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:54.135987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca482ac5-a605-4c34-9395-3fa86a81ef88 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:54.136219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-33f063ad-a5dd-4dcd-ba16-d06a43e8e344 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:54.136923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca482ac5-a605-4c34-9395-3fa86a81ef88 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:54.151243 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-33f063ad-a5dd-4dcd-ba16-d06a43e8e344 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1317 microversion: 2.1 time: 0.684192 Aug 27 04:59:54.151872 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 912/1785] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:53 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1317 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:54.168248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:54.168949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:54.182789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:54.184848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:54.185921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:54.188278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:54.189995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:54.191165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:54.540796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ca482ac5-a605-4c34-9395-3fa86a81ef88 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:54.552623 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ca482ac5-a605-4c34-9395-3fa86a81ef88 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1350 microversion: 2.1 time: 0.438386 Aug 27 04:59:54.554608 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 874/1786] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:54 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1350 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:54.561367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-26887fe9-2a7f-4e51-849d-03544fa6fa88 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:54.562916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-26887fe9-2a7f-4e51-849d-03544fa6fa88 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:54.571960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26887fe9-2a7f-4e51-849d-03544fa6fa88 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:54.572688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26887fe9-2a7f-4e51-849d-03544fa6fa88 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:54.573273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26887fe9-2a7f-4e51-849d-03544fa6fa88 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:54.574163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26887fe9-2a7f-4e51-849d-03544fa6fa88 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:54.574775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26887fe9-2a7f-4e51-849d-03544fa6fa88 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:54.575371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26887fe9-2a7f-4e51-849d-03544fa6fa88 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:54.587837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:54.604782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:54.606290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:54.607506 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1c5af743-c7c7-4723-8228-117bef3873bf tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.454666 Aug 27 04:59:54.608069 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 913/1787] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:54 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:54.631619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:54.636067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:54.645913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:54.646625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:54.655041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:54.656131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:54.656752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:54.657530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:54.880987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-26887fe9-2a7f-4e51-849d-03544fa6fa88 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:54.892167 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-26887fe9-2a7f-4e51-849d-03544fa6fa88 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.336129 Aug 27 04:59:54.893121 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 875/1788] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:54 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:54.901635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f2583963-68c2-4f15-9f44-5ab440321204 req-b429bbf6-db84-47f2-9e8d-48f962d599f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0722d6-d717-436e-b051-df3b185dddd5", "name": "network-vif-unplugged", "status": "completed", "tag": "dc0145a6-c0bf-434f-b124-20af43f72b43"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:54.914930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f2583963-68c2-4f15-9f44-5ab440321204 req-b429bbf6-db84-47f2-9e8d-48f962d599f6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:54.916238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f2583963-68c2-4f15-9f44-5ab440321204 req-b429bbf6-db84-47f2-9e8d-48f962d599f6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:54.916921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f2583963-68c2-4f15-9f44-5ab440321204 req-b429bbf6-db84-47f2-9e8d-48f962d599f6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:54.932817 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f2583963-68c2-4f15-9f44-5ab440321204 req-b429bbf6-db84-47f2-9e8d-48f962d599f6 service nova] Creating event network-vif-unplugged:dc0145a6-c0bf-434f-b124-20af43f72b43 for instance eb0722d6-d717-436e-b051-df3b185dddd5 on n-h1-820368-35 Aug 27 04:59:54.942540 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f2583963-68c2-4f15-9f44-5ab440321204 req-b429bbf6-db84-47f2-9e8d-48f962d599f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046546 Aug 27 04:59:54.949072 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 876/1789] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:54.970446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:54.985762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:54.988254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:54.990747 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70be3c88-0c6b-4657-a3cf-dfc31eaac7e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1755 microversion: 2.42 time: 0.381733 Aug 27 04:59:54.991356 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 914/1790] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:54 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1755 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:55.096775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-332817ad-a8c9-496b-8d58-2ba752f8e4b5 req-8a881ec9-53be-4987-a169-ecdba05196f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f8af20a-0dda-4589-8e24-a20171f939ce", "tag": "4069efdd-8664-4635-b639-4811f05f8c16"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:55.112602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-332817ad-a8c9-496b-8d58-2ba752f8e4b5 req-8a881ec9-53be-4987-a169-ecdba05196f3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:55.113083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-332817ad-a8c9-496b-8d58-2ba752f8e4b5 req-8a881ec9-53be-4987-a169-ecdba05196f3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:55.113667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-332817ad-a8c9-496b-8d58-2ba752f8e4b5 req-8a881ec9-53be-4987-a169-ecdba05196f3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:55.128272 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-332817ad-a8c9-496b-8d58-2ba752f8e4b5 req-8a881ec9-53be-4987-a169-ecdba05196f3 service nova] Creating event network-changed:4069efdd-8664-4635-b639-4811f05f8c16 for instance 2f8af20a-0dda-4589-8e24-a20171f939ce on n-h2-820368-35 Aug 27 04:59:55.137223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-42e9861c-afe8-48ba-9090-d1d2c10338c7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:55.138002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-42e9861c-afe8-48ba-9090-d1d2c10338c7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:55.147020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42e9861c-afe8-48ba-9090-d1d2c10338c7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:55.151616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42e9861c-afe8-48ba-9090-d1d2c10338c7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:55.152365 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-332817ad-a8c9-496b-8d58-2ba752f8e4b5 req-8a881ec9-53be-4987-a169-ecdba05196f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061248 Aug 27 04:59:55.153096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42e9861c-afe8-48ba-9090-d1d2c10338c7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:55.154039 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 877/1791] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:59:55.154547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42e9861c-afe8-48ba-9090-d1d2c10338c7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:55.155185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42e9861c-afe8-48ba-9090-d1d2c10338c7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:55.155635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42e9861c-afe8-48ba-9090-d1d2c10338c7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:55.172957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6e7e0136-d491-499c-bbe4-3ccbeb50ade1 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:55.173667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6e7e0136-d491-499c-bbe4-3ccbeb50ade1 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:55.184245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7e0136-d491-499c-bbe4-3ccbeb50ade1 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:55.184732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7e0136-d491-499c-bbe4-3ccbeb50ade1 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:55.188436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7e0136-d491-499c-bbe4-3ccbeb50ade1 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:55.189222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7e0136-d491-499c-bbe4-3ccbeb50ade1 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:55.189698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7e0136-d491-499c-bbe4-3ccbeb50ade1 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:55.190127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7e0136-d491-499c-bbe4-3ccbeb50ade1 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:55.648887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6e7e0136-d491-499c-bbe4-3ccbeb50ade1 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:55.657789 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6e7e0136-d491-499c-bbe4-3ccbeb50ade1 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1317 microversion: 2.1 time: 0.488954 Aug 27 04:59:55.658387 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 878/1792] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:55 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:55.675924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-34616d23-3ab9-488e-b031-15ef06eaf022 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:55.676562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-34616d23-3ab9-488e-b031-15ef06eaf022 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:55.685921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34616d23-3ab9-488e-b031-15ef06eaf022 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:55.686695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34616d23-3ab9-488e-b031-15ef06eaf022 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:55.687352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34616d23-3ab9-488e-b031-15ef06eaf022 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:55.688377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34616d23-3ab9-488e-b031-15ef06eaf022 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:55.689098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34616d23-3ab9-488e-b031-15ef06eaf022 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:55.689698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34616d23-3ab9-488e-b031-15ef06eaf022 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:55.724564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-42e9861c-afe8-48ba-9090-d1d2c10338c7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:55.744444 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-42e9861c-afe8-48ba-9090-d1d2c10338c7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1478 microversion: 2.1 time: 0.611400 Aug 27 04:59:55.751428 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 915/1793] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:55 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1478 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:55.756694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:55.757620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:55.778226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:55.779480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:55.780127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:55.781499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:55.782171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:55.782813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:56.377937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-34616d23-3ab9-488e-b031-15ef06eaf022 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:56.391345 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-34616d23-3ab9-488e-b031-15ef06eaf022 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1350 microversion: 2.1 time: 0.731714 Aug 27 04:59:56.407073 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 879/1794] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:55 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1350 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:56.417855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-276a10eb-3902-4025-bdda-3f454623ab7c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:56.418635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-276a10eb-3902-4025-bdda-3f454623ab7c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:56.430824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-276a10eb-3902-4025-bdda-3f454623ab7c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:56.431754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-276a10eb-3902-4025-bdda-3f454623ab7c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:56.432423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-276a10eb-3902-4025-bdda-3f454623ab7c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:56.433535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-276a10eb-3902-4025-bdda-3f454623ab7c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:56.434207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-276a10eb-3902-4025-bdda-3f454623ab7c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:56.435270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-276a10eb-3902-4025-bdda-3f454623ab7c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:56.468291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:56.483501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:56.485402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:56.486706 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6888f67-2b08-4ae8-af62-58b45b7dda13 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.734018 Aug 27 04:59:56.487744 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 916/1795] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:55 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:56.493524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:56.494477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:56.501097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:56.501684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:56.502208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:56.503110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:56.503686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:56.514662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:56.964116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-276a10eb-3902-4025-bdda-3f454623ab7c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:56.973499 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-276a10eb-3902-4025-bdda-3f454623ab7c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.566705 Aug 27 04:59:56.979475 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 880/1796] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:56 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:56.984522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a0309c04-460d-4575-bd2d-52d55c3daa83 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:56.996557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a0309c04-460d-4575-bd2d-52d55c3daa83 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:57.006045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0309c04-460d-4575-bd2d-52d55c3daa83 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:57.006746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0309c04-460d-4575-bd2d-52d55c3daa83 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:57.012737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0309c04-460d-4575-bd2d-52d55c3daa83 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:57.013670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0309c04-460d-4575-bd2d-52d55c3daa83 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:57.014283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0309c04-460d-4575-bd2d-52d55c3daa83 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:57.014685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:57.015412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0309c04-460d-4575-bd2d-52d55c3daa83 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:57.027688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:57.039878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:57.043300 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7b083ed3-85af-4779-8ca7-c1bd1a20f3ed tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1802 microversion: 2.42 time: 0.553536 Aug 27 04:59:57.044961 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 917/1797] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:56 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1802 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:57.050691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd213467-dae1-4286-83b0-d589822bd590 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:57.052028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dd213467-dae1-4286-83b0-d589822bd590 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:57.060063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd213467-dae1-4286-83b0-d589822bd590 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:57.060751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd213467-dae1-4286-83b0-d589822bd590 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:57.061542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd213467-dae1-4286-83b0-d589822bd590 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:57.062550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd213467-dae1-4286-83b0-d589822bd590 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:57.063584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd213467-dae1-4286-83b0-d589822bd590 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:57.064173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd213467-dae1-4286-83b0-d589822bd590 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:57.342958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:57.389122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dd213467-dae1-4286-83b0-d589822bd590 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:57.398955 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd213467-dae1-4286-83b0-d589822bd590 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1478 microversion: 2.1 time: 0.352149 Aug 27 04:59:57.400760 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 918/1798] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:57 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1478 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:57.415049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4240bd8d-aa24-46f5-b192-6c2e7c452892 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:57.416750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4240bd8d-aa24-46f5-b192-6c2e7c452892 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:57.424212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=5 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:57.426385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4240bd8d-aa24-46f5-b192-6c2e7c452892 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:57.427053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4240bd8d-aa24-46f5-b192-6c2e7c452892 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:57.427813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4240bd8d-aa24-46f5-b192-6c2e7c452892 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:57.428529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4240bd8d-aa24-46f5-b192-6c2e7c452892 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:57.429132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4240bd8d-aa24-46f5-b192-6c2e7c452892 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:57.429911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4240bd8d-aa24-46f5-b192-6c2e7c452892 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:57.461615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a0309c04-460d-4575-bd2d-52d55c3daa83 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:57.475185 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a0309c04-460d-4575-bd2d-52d55c3daa83 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1317 microversion: 2.1 time: 0.493779 Aug 27 04:59:57.479142 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 881/1799] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:56 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:57.510415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:57.511032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:57.517172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:57.517858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:57.518464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:57.519204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:57.520115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:57.520703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:57.864250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4240bd8d-aa24-46f5-b192-6c2e7c452892 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:57.875159 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4240bd8d-aa24-46f5-b192-6c2e7c452892 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1350 microversion: 2.1 time: 0.464846 Aug 27 04:59:57.875870 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 919/1800] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:57 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1350 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:57.957487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:57.970392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:57.976051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:57.979357 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-892fc6b7-31ba-47fd-87fb-b24bd3f69227 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.473345 Aug 27 04:59:57.984203 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 882/1801] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:57 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:59:58.017962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-47904c8f-2b5d-4f0f-9dd6-c6d7e8fc5386 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:58.020288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-47904c8f-2b5d-4f0f-9dd6-c6d7e8fc5386 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:58.041966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47904c8f-2b5d-4f0f-9dd6-c6d7e8fc5386 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:58.044533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47904c8f-2b5d-4f0f-9dd6-c6d7e8fc5386 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:58.045475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47904c8f-2b5d-4f0f-9dd6-c6d7e8fc5386 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:58.047475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47904c8f-2b5d-4f0f-9dd6-c6d7e8fc5386 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:58.050000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47904c8f-2b5d-4f0f-9dd6-c6d7e8fc5386 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:58.050558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47904c8f-2b5d-4f0f-9dd6-c6d7e8fc5386 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:58.073099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:58.073989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:58.076550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:58.090856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:58.091617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:58.092257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:58.094126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:58.094764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:58.097174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:58.747950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-47904c8f-2b5d-4f0f-9dd6-c6d7e8fc5386 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:58.753187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:58.761476 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-47904c8f-2b5d-4f0f-9dd6-c6d7e8fc5386 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.762807 Aug 27 04:59:58.762717 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 920/1802] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:57 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:58.769337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e621205-bbee-4ea6-aa9a-b38d44852e6c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:58.769493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:58.770661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e621205-bbee-4ea6-aa9a-b38d44852e6c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:58.770854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:58.773563 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2de74933-59f6-4588-af3f-083afccbf060 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1802 microversion: 2.42 time: 0.706325 Aug 27 04:59:58.778654 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 883/1803] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:58 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1802 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:58.779868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e621205-bbee-4ea6-aa9a-b38d44852e6c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:58.780978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e621205-bbee-4ea6-aa9a-b38d44852e6c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:58.781624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e621205-bbee-4ea6-aa9a-b38d44852e6c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:58.782729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e621205-bbee-4ea6-aa9a-b38d44852e6c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:58.783450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e621205-bbee-4ea6-aa9a-b38d44852e6c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:58.784151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e621205-bbee-4ea6-aa9a-b38d44852e6c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:58.784407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d1ed4d7-bc84-4b22-8b1f-ccb6fce28038 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:58.793136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d1ed4d7-bc84-4b22-8b1f-ccb6fce28038 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:58.800856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d1ed4d7-bc84-4b22-8b1f-ccb6fce28038 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:58.801357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d1ed4d7-bc84-4b22-8b1f-ccb6fce28038 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:58.801797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d1ed4d7-bc84-4b22-8b1f-ccb6fce28038 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:58.805956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d1ed4d7-bc84-4b22-8b1f-ccb6fce28038 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:58.809105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d1ed4d7-bc84-4b22-8b1f-ccb6fce28038 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:58.809796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d1ed4d7-bc84-4b22-8b1f-ccb6fce28038 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:59.120547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e621205-bbee-4ea6-aa9a-b38d44852e6c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:59.134558 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e621205-bbee-4ea6-aa9a-b38d44852e6c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1478 microversion: 2.1 time: 0.368997 Aug 27 04:59:59.134956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d1ed4d7-bc84-4b22-8b1f-ccb6fce28038 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:59.136897 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 921/1804] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:58 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1478 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:59.142538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-83005cbe-305a-47a2-8924-36e808976907 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:59.143809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-83005cbe-305a-47a2-8924-36e808976907 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:59.153893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83005cbe-305a-47a2-8924-36e808976907 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:59.154621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83005cbe-305a-47a2-8924-36e808976907 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:59.156109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83005cbe-305a-47a2-8924-36e808976907 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:59.157955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83005cbe-305a-47a2-8924-36e808976907 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:59.160386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83005cbe-305a-47a2-8924-36e808976907 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:59.160993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83005cbe-305a-47a2-8924-36e808976907 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:59.163615 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d1ed4d7-bc84-4b22-8b1f-ccb6fce28038 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1317 microversion: 2.1 time: 0.383320 Aug 27 04:59:59.171687 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 884/1805] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:58 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:59.179913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:59.181071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:59.190254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:59.192049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:59.192838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:59.194522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:59.195341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:59.197465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:59.913998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:59.933023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:59.936588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:59.937117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-83005cbe-305a-47a2-8924-36e808976907 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:59.938923 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a6e38b5d-2f49-49ab-87d2-09aa4c2f0df7 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.765949 Aug 27 04:59:59.940910 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 885/1806] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:59 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:59.945222 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-83005cbe-305a-47a2-8924-36e808976907 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1350 microversion: 2.1 time: 0.806823 Aug 27 04:59:59.951358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-d7376053-3a8c-4a2c-802a-bd4bf1df1e86 req-35a9ae95-559a-47a8-ac2a-6cd7a9d074e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0722d6-d717-436e-b051-df3b185dddd5", "name": "network-vif-plugged", "status": "completed", "tag": "dc0145a6-c0bf-434f-b124-20af43f72b43"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:59.951946 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 922/1807] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:59 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1350 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:59.966321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d7376053-3a8c-4a2c-802a-bd4bf1df1e86 req-35a9ae95-559a-47a8-ac2a-6cd7a9d074e9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:59.967449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d7376053-3a8c-4a2c-802a-bd4bf1df1e86 req-35a9ae95-559a-47a8-ac2a-6cd7a9d074e9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:59.968195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d7376053-3a8c-4a2c-802a-bd4bf1df1e86 req-35a9ae95-559a-47a8-ac2a-6cd7a9d074e9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:59.969382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-251101e1-95b2-4d12-9ee8-be2719cf5f19 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:59.979918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-251101e1-95b2-4d12-9ee8-be2719cf5f19 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:59.985565 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-d7376053-3a8c-4a2c-802a-bd4bf1df1e86 req-35a9ae95-559a-47a8-ac2a-6cd7a9d074e9 service nova] Creating event network-vif-plugged:dc0145a6-c0bf-434f-b124-20af43f72b43 for instance eb0722d6-d717-436e-b051-df3b185dddd5 on n-h1-820368-35 Aug 27 04:59:59.986493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-251101e1-95b2-4d12-9ee8-be2719cf5f19 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:59.987142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-251101e1-95b2-4d12-9ee8-be2719cf5f19 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:59.987706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-251101e1-95b2-4d12-9ee8-be2719cf5f19 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:59.988534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-251101e1-95b2-4d12-9ee8-be2719cf5f19 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:59.989088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-251101e1-95b2-4d12-9ee8-be2719cf5f19 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:59.989611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-251101e1-95b2-4d12-9ee8-be2719cf5f19 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:59.992727 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-d7376053-3a8c-4a2c-802a-bd4bf1df1e86 req-35a9ae95-559a-47a8-ac2a-6cd7a9d074e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049758 Aug 27 04:59:59.994738 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 886/1808] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:00.002492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:00.003673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:00.013974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:00.014776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:00.015728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:00.017655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:00.018639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:00.019255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:00.346217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-251101e1-95b2-4d12-9ee8-be2719cf5f19 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:00.354895 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-251101e1-95b2-4d12-9ee8-be2719cf5f19 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.390505 Aug 27 05:00:00.367928 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 923/1809] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:59 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:00.376281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-75f7ccb8-e2da-453c-aeb0-382b2cc0815d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:00.377816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-75f7ccb8-e2da-453c-aeb0-382b2cc0815d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:00.390316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f7ccb8-e2da-453c-aeb0-382b2cc0815d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:00.391132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f7ccb8-e2da-453c-aeb0-382b2cc0815d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:00.392325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f7ccb8-e2da-453c-aeb0-382b2cc0815d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:00.393410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f7ccb8-e2da-453c-aeb0-382b2cc0815d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:00.394774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f7ccb8-e2da-453c-aeb0-382b2cc0815d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:00.396399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f7ccb8-e2da-453c-aeb0-382b2cc0815d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:00.433637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:00.458197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:00.459682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:00.460924 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bbb033e3-91e9-43c1-a0b5-da64a01d4c72 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1802 microversion: 2.42 time: 0.464834 Aug 27 05:00:00.461840 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 887/1810] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:59 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1802 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:00.466667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-777d4128-118b-4123-bf1f-a3687522b8dd tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:00.467287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-777d4128-118b-4123-bf1f-a3687522b8dd tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:00.473844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-777d4128-118b-4123-bf1f-a3687522b8dd tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:00.474265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-777d4128-118b-4123-bf1f-a3687522b8dd tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:00.475120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-777d4128-118b-4123-bf1f-a3687522b8dd tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:00.475630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-777d4128-118b-4123-bf1f-a3687522b8dd tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:00.475947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-777d4128-118b-4123-bf1f-a3687522b8dd tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:00.476373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-777d4128-118b-4123-bf1f-a3687522b8dd tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:00.493838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:00.907711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-75f7ccb8-e2da-453c-aeb0-382b2cc0815d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:00.918899 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-75f7ccb8-e2da-453c-aeb0-382b2cc0815d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1478 microversion: 2.1 time: 0.548881 Aug 27 05:00:00.921213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-777d4128-118b-4123-bf1f-a3687522b8dd tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:00.929456 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 924/1811] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:00 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1478 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:00.950440 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-777d4128-118b-4123-bf1f-a3687522b8dd tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1317 microversion: 2.1 time: 0.487283 Aug 27 05:00:00.963255 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 888/1812] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:00 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:00.966614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:00.970359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:00.979368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c0e580f4-2882-4f2d-b6fc-cb5dbab0ed93 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:00.982487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:00.982837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c0e580f4-2882-4f2d-b6fc-cb5dbab0ed93 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:00.987142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:00.987847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:00.990212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:00.991292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:00.992871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:00.993489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:01.005378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0e580f4-2882-4f2d-b6fc-cb5dbab0ed93 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:01.006143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0e580f4-2882-4f2d-b6fc-cb5dbab0ed93 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:01.007820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0e580f4-2882-4f2d-b6fc-cb5dbab0ed93 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:01.010333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0e580f4-2882-4f2d-b6fc-cb5dbab0ed93 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:01.013950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0e580f4-2882-4f2d-b6fc-cb5dbab0ed93 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:01.014525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0e580f4-2882-4f2d-b6fc-cb5dbab0ed93 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:01.314782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:01.332390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:01.341670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:01.343225 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-15d2d145-f2ce-48a0-a2cb-9844830f0748 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.381228 Aug 27 05:00:01.347358 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 925/1813] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:00 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:01.380770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-99f23155-8c95-4c80-b4e6-10ba38a36cfd tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:01.381610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-99f23155-8c95-4c80-b4e6-10ba38a36cfd tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:01.391125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f23155-8c95-4c80-b4e6-10ba38a36cfd tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:01.391792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f23155-8c95-4c80-b4e6-10ba38a36cfd tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:01.392373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f23155-8c95-4c80-b4e6-10ba38a36cfd tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:01.393220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f23155-8c95-4c80-b4e6-10ba38a36cfd tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:01.393807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f23155-8c95-4c80-b4e6-10ba38a36cfd tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:01.394365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f23155-8c95-4c80-b4e6-10ba38a36cfd tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:01.943072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c0e580f4-2882-4f2d-b6fc-cb5dbab0ed93 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:01.955848 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c0e580f4-2882-4f2d-b6fc-cb5dbab0ed93 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1350 microversion: 2.1 time: 0.984237 Aug 27 05:00:01.967880 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 889/1814] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:00 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1350 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:01.973616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:01.974249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:01.985973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:01.986489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:01.986945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:01.987701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:01.988167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:01.988605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:02.176512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-99f23155-8c95-4c80-b4e6-10ba38a36cfd tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:02.190181 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-99f23155-8c95-4c80-b4e6-10ba38a36cfd tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.813986 Aug 27 05:00:02.197496 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 926/1815] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:01 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:02.202800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6a9a0e10-921d-49f9-949f-8ba741b6b577 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:02.209352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6a9a0e10-921d-49f9-949f-8ba741b6b577 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:02.226715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e10-921d-49f9-949f-8ba741b6b577 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:02.228170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e10-921d-49f9-949f-8ba741b6b577 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:02.231199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e10-921d-49f9-949f-8ba741b6b577 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:02.232170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e10-921d-49f9-949f-8ba741b6b577 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:02.235285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e10-921d-49f9-949f-8ba741b6b577 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:02.235997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e10-921d-49f9-949f-8ba741b6b577 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:02.253166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:02.512499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:02.527746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:02.533989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:02.535413 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3c922da7-bcfc-4d4a-9c53-774debad3dd3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1849 microversion: 2.42 time: 0.565768 Aug 27 05:00:02.551119 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 890/1816] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:01 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1849 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:02.556723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab232703-855d-42ad-8549-4f84c6489322 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:02.557716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ab232703-855d-42ad-8549-4f84c6489322 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:02.569655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab232703-855d-42ad-8549-4f84c6489322 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:02.572181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab232703-855d-42ad-8549-4f84c6489322 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:02.572885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab232703-855d-42ad-8549-4f84c6489322 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:02.573854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab232703-855d-42ad-8549-4f84c6489322 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:02.576618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab232703-855d-42ad-8549-4f84c6489322 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:02.577347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab232703-855d-42ad-8549-4f84c6489322 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:02.594026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6a9a0e10-921d-49f9-949f-8ba741b6b577 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:02.607868 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6a9a0e10-921d-49f9-949f-8ba741b6b577 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1478 microversion: 2.1 time: 0.408741 Aug 27 05:00:02.609865 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 927/1817] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:02 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1478 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:02.621279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:02.624072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:02.638527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:02.640760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:02.641479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:02.644349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:02.644948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:02.646720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:02.926884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ab232703-855d-42ad-8549-4f84c6489322 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:02.934558 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ab232703-855d-42ad-8549-4f84c6489322 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1317 microversion: 2.1 time: 0.394101 Aug 27 05:00:02.937000 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 891/1818] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:02 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:02.974050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:02.979225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf50aa56-9cd0-43f6-b9f2-4a359e24acc6 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:02.983425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf50aa56-9cd0-43f6-b9f2-4a359e24acc6 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:02.992979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf50aa56-9cd0-43f6-b9f2-4a359e24acc6 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:02.996508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:03.000489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf50aa56-9cd0-43f6-b9f2-4a359e24acc6 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:03.004138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf50aa56-9cd0-43f6-b9f2-4a359e24acc6 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:03.005097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:03.006071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf50aa56-9cd0-43f6-b9f2-4a359e24acc6 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:03.007732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf50aa56-9cd0-43f6-b9f2-4a359e24acc6 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:03.008292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf50aa56-9cd0-43f6-b9f2-4a359e24acc6 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:03.009433 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c99100ac-06d6-4dcb-95a0-6c2343289b33 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.394981 Aug 27 05:00:03.014865 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 928/1819] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:02 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:03.074975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-ed7d7911-60fd-4ced-a8e0-3ab913d4c46c req-c5bdd606-484f-4978-b19f-e2b493c5d842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "tag": "a3e1f4af-7721-488e-9bc6-44bc8d5333b2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:03.090247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ed7d7911-60fd-4ced-a8e0-3ab913d4c46c req-c5bdd606-484f-4978-b19f-e2b493c5d842 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:03.091129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ed7d7911-60fd-4ced-a8e0-3ab913d4c46c req-c5bdd606-484f-4978-b19f-e2b493c5d842 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:03.091931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ed7d7911-60fd-4ced-a8e0-3ab913d4c46c req-c5bdd606-484f-4978-b19f-e2b493c5d842 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:03.114903 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-ed7d7911-60fd-4ced-a8e0-3ab913d4c46c req-c5bdd606-484f-4978-b19f-e2b493c5d842 service nova] Creating event network-changed:a3e1f4af-7721-488e-9bc6-44bc8d5333b2 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:00:03.123882 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-ed7d7911-60fd-4ced-a8e0-3ab913d4c46c req-c5bdd606-484f-4978-b19f-e2b493c5d842 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054068 Aug 27 05:00:03.124754 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 929/1820] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:03.217021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fdc178a1-df87-4ffe-adb6-6633dd021964 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:03.217975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fdc178a1-df87-4ffe-adb6-6633dd021964 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:03.231020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc178a1-df87-4ffe-adb6-6633dd021964 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:03.232401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc178a1-df87-4ffe-adb6-6633dd021964 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:03.233107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc178a1-df87-4ffe-adb6-6633dd021964 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:03.235498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc178a1-df87-4ffe-adb6-6633dd021964 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:03.236240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc178a1-df87-4ffe-adb6-6633dd021964 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:03.240502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdc178a1-df87-4ffe-adb6-6633dd021964 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:03.606476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cf50aa56-9cd0-43f6-b9f2-4a359e24acc6 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:03.615490 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf50aa56-9cd0-43f6-b9f2-4a359e24acc6 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1350 microversion: 2.1 time: 0.639964 Aug 27 05:00:03.632863 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 892/1821] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:02 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1350 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:03.641214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:03.650483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:03.661816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:03.662308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:03.666588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:03.667470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:03.667951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:03.669349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:03.721997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fdc178a1-df87-4ffe-adb6-6633dd021964 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:03.736857 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fdc178a1-df87-4ffe-adb6-6633dd021964 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.524384 Aug 27 05:00:03.737971 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 930/1822] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:03 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:03.748890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-594ff029-2329-4f40-b997-48d67118a05a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:03.751878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-594ff029-2329-4f40-b997-48d67118a05a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:03.778224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-594ff029-2329-4f40-b997-48d67118a05a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:03.778969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-594ff029-2329-4f40-b997-48d67118a05a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:03.793168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-594ff029-2329-4f40-b997-48d67118a05a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:03.793999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-594ff029-2329-4f40-b997-48d67118a05a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:03.794493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-594ff029-2329-4f40-b997-48d67118a05a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:03.794933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-594ff029-2329-4f40-b997-48d67118a05a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.088762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:04.106705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:04.109124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:04.111376 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-edbdfac2-11d7-4bb6-b9f1-a86c628f5685 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1849 microversion: 2.42 time: 0.476306 Aug 27 05:00:04.113896 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 893/1823] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:03 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1849 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:04.121504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5bf7c938-3b0b-4922-9372-dfe2d3a6832d req-0cb00226-13a3-42c5-a396-b1706962fefb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa8507d-68a8-41bb-95b8-7cae5c5e7216", "name": "network-vif-plugged", "status": "completed", "tag": "251ac4eb-fa7e-4c6a-9b51-d6264fbc8ca4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:04.137550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5bf7c938-3b0b-4922-9372-dfe2d3a6832d req-0cb00226-13a3-42c5-a396-b1706962fefb service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.138301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5bf7c938-3b0b-4922-9372-dfe2d3a6832d req-0cb00226-13a3-42c5-a396-b1706962fefb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.138935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5bf7c938-3b0b-4922-9372-dfe2d3a6832d req-0cb00226-13a3-42c5-a396-b1706962fefb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.157041 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5bf7c938-3b0b-4922-9372-dfe2d3a6832d req-0cb00226-13a3-42c5-a396-b1706962fefb service nova] Creating event network-vif-plugged:251ac4eb-fa7e-4c6a-9b51-d6264fbc8ca4 for instance 7fa8507d-68a8-41bb-95b8-7cae5c5e7216 on n-h1-820368-35 Aug 27 05:00:04.166201 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5bf7c938-3b0b-4922-9372-dfe2d3a6832d req-0cb00226-13a3-42c5-a396-b1706962fefb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050897 Aug 27 05:00:04.167401 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 894/1824] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:04.174198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c733859f-0cee-475a-8491-4b19049edc42 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:04.175118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c733859f-0cee-475a-8491-4b19049edc42 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:04.183746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c733859f-0cee-475a-8491-4b19049edc42 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.187989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-594ff029-2329-4f40-b997-48d67118a05a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:04.192362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c733859f-0cee-475a-8491-4b19049edc42 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.192821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c733859f-0cee-475a-8491-4b19049edc42 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.198038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c733859f-0cee-475a-8491-4b19049edc42 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.201370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c733859f-0cee-475a-8491-4b19049edc42 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.201954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c733859f-0cee-475a-8491-4b19049edc42 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.204792 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-594ff029-2329-4f40-b997-48d67118a05a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1463 microversion: 2.1 time: 0.465550 Aug 27 05:00:04.206076 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 931/1825] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:03 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1463 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:04.220129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:04.222272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:04.240181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.240906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.241555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.242420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.244228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.245579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.624788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:04.639417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:04.640865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:04.650333 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cad4339a-0de3-426e-bb4d-d4cbe4b4ec90 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.441904 Aug 27 05:00:04.651200 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 932/1826] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:04 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:04.659279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0085e06a-9adf-4e0d-aa47-3402ebbb7c6b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:04.667461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0085e06a-9adf-4e0d-aa47-3402ebbb7c6b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:04.669927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c733859f-0cee-475a-8491-4b19049edc42 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:04.675709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0085e06a-9adf-4e0d-aa47-3402ebbb7c6b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.676222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0085e06a-9adf-4e0d-aa47-3402ebbb7c6b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.676671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0085e06a-9adf-4e0d-aa47-3402ebbb7c6b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.677390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0085e06a-9adf-4e0d-aa47-3402ebbb7c6b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.677848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0085e06a-9adf-4e0d-aa47-3402ebbb7c6b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.678855 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c733859f-0cee-475a-8491-4b19049edc42 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1317 microversion: 2.1 time: 0.510058 Aug 27 05:00:04.681471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0085e06a-9adf-4e0d-aa47-3402ebbb7c6b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.692311 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 895/1827] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:04 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1317 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:04.697542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2d9a4846-530f-4b70-acf3-fb63b237aabf tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:04.698333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2d9a4846-530f-4b70-acf3-fb63b237aabf tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:04.705214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d9a4846-530f-4b70-acf3-fb63b237aabf tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.705959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d9a4846-530f-4b70-acf3-fb63b237aabf tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.706591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d9a4846-530f-4b70-acf3-fb63b237aabf tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.707491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d9a4846-530f-4b70-acf3-fb63b237aabf tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.708079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d9a4846-530f-4b70-acf3-fb63b237aabf tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.708646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d9a4846-530f-4b70-acf3-fb63b237aabf tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.861128 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0085e06a-9adf-4e0d-aa47-3402ebbb7c6b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action" status: 202 len: 0 microversion: 2.1 time: 0.207897 Aug 27 05:00:04.861779 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 933/1828] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:00:04 2022] POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:00:04.867744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3de338b1-79be-483e-9402-0f8656ed842a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:04.868986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3de338b1-79be-483e-9402-0f8656ed842a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:04.886521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3de338b1-79be-483e-9402-0f8656ed842a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.888391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3de338b1-79be-483e-9402-0f8656ed842a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.888986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3de338b1-79be-483e-9402-0f8656ed842a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.891468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3de338b1-79be-483e-9402-0f8656ed842a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.895554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3de338b1-79be-483e-9402-0f8656ed842a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.896215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3de338b1-79be-483e-9402-0f8656ed842a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.215927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2d9a4846-530f-4b70-acf3-fb63b237aabf tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:05.230795 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2d9a4846-530f-4b70-acf3-fb63b237aabf tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1350 microversion: 2.1 time: 0.537066 Aug 27 05:00:05.232763 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 896/1829] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:04 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1350 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:05.238555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:05.239368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:05.250354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.251223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.253398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.254338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.255416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.256183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.308988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.310381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.311032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.311710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lazy-loading 'fault' on Instance uuid eb0722d6-d717-436e-b051-df3b185dddd5 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:00:05.502620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3de338b1-79be-483e-9402-0f8656ed842a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:05.516508 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3de338b1-79be-483e-9402-0f8656ed842a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.653253 Aug 27 05:00:05.523729 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 934/1830] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:04 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:05.529299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:05.529919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:05.547019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.547560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.548179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.548937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.549397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.549828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.618677 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ef078b48-c87e-4a2b-96b5-f6c729a98812 tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1599 microversion: 2.1 time: 0.384026 Aug 27 05:00:05.631782 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 897/1831] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:05 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1599 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:05.631782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-a7eb2e84-6ce4-44c4-9d6b-5c897471388a req-71d3c545-6cdd-49f4-a530-116c61d8eafc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "tag": "67c91f3b-28ff-46ab-b299-4183c0d6b2c2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:05.637940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a7eb2e84-6ce4-44c4-9d6b-5c897471388a req-71d3c545-6cdd-49f4-a530-116c61d8eafc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.637940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a7eb2e84-6ce4-44c4-9d6b-5c897471388a req-71d3c545-6cdd-49f4-a530-116c61d8eafc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.637940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a7eb2e84-6ce4-44c4-9d6b-5c897471388a req-71d3c545-6cdd-49f4-a530-116c61d8eafc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.650318 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-a7eb2e84-6ce4-44c4-9d6b-5c897471388a req-71d3c545-6cdd-49f4-a530-116c61d8eafc service nova] Creating event network-changed:67c91f3b-28ff-46ab-b299-4183c0d6b2c2 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:00:05.657332 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-a7eb2e84-6ce4-44c4-9d6b-5c897471388a req-71d3c545-6cdd-49f4-a530-116c61d8eafc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035842 Aug 27 05:00:05.658514 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 898/1832] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:05.664284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-33c1862d-4364-4155-9139-29631b69196b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:05.667260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-33c1862d-4364-4155-9139-29631b69196b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:05.675776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c1862d-4364-4155-9139-29631b69196b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.676540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c1862d-4364-4155-9139-29631b69196b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.677057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c1862d-4364-4155-9139-29631b69196b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.677854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c1862d-4364-4155-9139-29631b69196b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.678391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c1862d-4364-4155-9139-29631b69196b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.678944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c1862d-4364-4155-9139-29631b69196b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.811171 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-33c1862d-4364-4155-9139-29631b69196b tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action" status: 202 len: 0 microversion: 2.1 time: 0.151117 Aug 27 05:00:05.814893 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 899/1833] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:00:05 2022] POST /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:00:05.818025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:05.818742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:05.828592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.829790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.830301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.831181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.831752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.832187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:06.024909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:06.043418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:06.046246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:06.050495 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88e9bb57-d921-44b0-8760-780552260039 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1870 microversion: 2.42 time: 0.525469 Aug 27 05:00:06.052594 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 935/1834] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:05 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1870 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:06.058477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c7c8374b-8f46-4691-af8a-6026f4388a27 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:06.060095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c7c8374b-8f46-4691-af8a-6026f4388a27 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:06.067736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7c8374b-8f46-4691-af8a-6026f4388a27 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:06.068611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7c8374b-8f46-4691-af8a-6026f4388a27 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:06.069504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7c8374b-8f46-4691-af8a-6026f4388a27 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:06.071785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7c8374b-8f46-4691-af8a-6026f4388a27 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:06.072387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7c8374b-8f46-4691-af8a-6026f4388a27 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:06.073916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7c8374b-8f46-4691-af8a-6026f4388a27 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:06.241927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:06.265399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:06.268902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:06.273696 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cab4a363-a155-4e7d-88af-dfe64ea755af tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.460348 Aug 27 05:00:06.275584 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 900/1835] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:05 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:06.284805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6bea0304-c7ec-4432-90a0-726351e4bdda tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:06.285602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6bea0304-c7ec-4432-90a0-726351e4bdda tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:06.320949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bea0304-c7ec-4432-90a0-726351e4bdda tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:06.323280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bea0304-c7ec-4432-90a0-726351e4bdda tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:06.327317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bea0304-c7ec-4432-90a0-726351e4bdda tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:06.329104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bea0304-c7ec-4432-90a0-726351e4bdda tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:06.329974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bea0304-c7ec-4432-90a0-726351e4bdda tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:06.330619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bea0304-c7ec-4432-90a0-726351e4bdda tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:06.983958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c7c8374b-8f46-4691-af8a-6026f4388a27 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:06.995425 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c7c8374b-8f46-4691-af8a-6026f4388a27 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1317 microversion: 2.1 time: 0.941310 Aug 27 05:00:06.996577 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 936/1836] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:06 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1317 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:07.002337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-9c2475eb-14eb-4885-9dad-4f5dc3a2dbff req-fd8f1ba4-f935-4487-8283-9f2c81bd3ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8af20a-0dda-4589-8e24-a20171f939ce", "name": "network-vif-plugged", "status": "completed", "tag": "4069efdd-8664-4635-b639-4811f05f8c16"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:07.014057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9c2475eb-14eb-4885-9dad-4f5dc3a2dbff req-fd8f1ba4-f935-4487-8283-9f2c81bd3ed4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.014755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9c2475eb-14eb-4885-9dad-4f5dc3a2dbff req-fd8f1ba4-f935-4487-8283-9f2c81bd3ed4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.015467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9c2475eb-14eb-4885-9dad-4f5dc3a2dbff req-fd8f1ba4-f935-4487-8283-9f2c81bd3ed4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.059206 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-9c2475eb-14eb-4885-9dad-4f5dc3a2dbff req-fd8f1ba4-f935-4487-8283-9f2c81bd3ed4 service nova] Creating event network-vif-plugged:4069efdd-8664-4635-b639-4811f05f8c16 for instance 2f8af20a-0dda-4589-8e24-a20171f939ce on n-h2-820368-35 Aug 27 05:00:07.068285 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-9c2475eb-14eb-4885-9dad-4f5dc3a2dbff req-fd8f1ba4-f935-4487-8283-9f2c81bd3ed4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069793 Aug 27 05:00:07.075703 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 937/1837] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:07.084095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a553e1f6-edb7-4166-b8ee-2943192e8d95 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:07.091543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a553e1f6-edb7-4166-b8ee-2943192e8d95 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:07.106384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a553e1f6-edb7-4166-b8ee-2943192e8d95 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.108029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a553e1f6-edb7-4166-b8ee-2943192e8d95 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.108631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a553e1f6-edb7-4166-b8ee-2943192e8d95 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.109654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a553e1f6-edb7-4166-b8ee-2943192e8d95 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.110357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a553e1f6-edb7-4166-b8ee-2943192e8d95 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.110928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a553e1f6-edb7-4166-b8ee-2943192e8d95 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.141498 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6bea0304-c7ec-4432-90a0-726351e4bdda tempest-ServersAdminTestJSON-1245149897 tempest-ServersAdminTestJSON-1245149897-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1616 microversion: 2.1 time: 0.864350 Aug 27 05:00:07.142082 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 901/1838] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:06 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1616 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:07.146582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57ec855d-bed9-4adb-982f-cfdb998d7896 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:07.163710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-57ec855d-bed9-4adb-982f-cfdb998d7896 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:07.170910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ec855d-bed9-4adb-982f-cfdb998d7896 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.171451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ec855d-bed9-4adb-982f-cfdb998d7896 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.171897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ec855d-bed9-4adb-982f-cfdb998d7896 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.172605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ec855d-bed9-4adb-982f-cfdb998d7896 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.173114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ec855d-bed9-4adb-982f-cfdb998d7896 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.173539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ec855d-bed9-4adb-982f-cfdb998d7896 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.611857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a553e1f6-edb7-4166-b8ee-2943192e8d95 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:07.626918 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a553e1f6-edb7-4166-b8ee-2943192e8d95 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1539 microversion: 2.1 time: 0.548256 Aug 27 05:00:07.628327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-57ec855d-bed9-4adb-982f-cfdb998d7896 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:07.640245 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-57ec855d-bed9-4adb-982f-cfdb998d7896 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.497145 Aug 27 05:00:07.641076 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 902/1839] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:07 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:07.644851 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 938/1840] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:07 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1539 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:07.648497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:07.649578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:07.657692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.659076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.659204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f470eda5-01cd-439f-bd59-b6d849d2d86d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:07.659687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f470eda5-01cd-439f-bd59-b6d849d2d86d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:07.660170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.661109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.661777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.662843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.675568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f470eda5-01cd-439f-bd59-b6d849d2d86d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.676071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f470eda5-01cd-439f-bd59-b6d849d2d86d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.676513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f470eda5-01cd-439f-bd59-b6d849d2d86d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.677235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f470eda5-01cd-439f-bd59-b6d849d2d86d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.677679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f470eda5-01cd-439f-bd59-b6d849d2d86d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.678108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f470eda5-01cd-439f-bd59-b6d849d2d86d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.747786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f470eda5-01cd-439f-bd59-b6d849d2d86d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:00:07.861342 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f470eda5-01cd-439f-bd59-b6d849d2d86d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "DELETE /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 204 len: 0 microversion: 2.1 time: 0.211938 Aug 27 05:00:07.865952 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 939/1841] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:00:07 2022] DELETE /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:00:07.875162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:07.876126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:07.882990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.883545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.884811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.885579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.886039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.886638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:08.085543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:08.098960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:08.101986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:08.105557 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cb7e67a0-fe4b-4c37-a5ff-8df8d3a0f2ba tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1891 microversion: 2.42 time: 0.462806 Aug 27 05:00:08.106136 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 903/1842] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:07 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1891 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:08.115140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-77d45845-9ff6-4aff-b2f8-0ecf2aea7bbd tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:08.120749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-77d45845-9ff6-4aff-b2f8-0ecf2aea7bbd tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:08.129567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d45845-9ff6-4aff-b2f8-0ecf2aea7bbd tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:08.130379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d45845-9ff6-4aff-b2f8-0ecf2aea7bbd tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:08.131207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d45845-9ff6-4aff-b2f8-0ecf2aea7bbd tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:08.132101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d45845-9ff6-4aff-b2f8-0ecf2aea7bbd tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:08.132729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d45845-9ff6-4aff-b2f8-0ecf2aea7bbd tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:08.133557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d45845-9ff6-4aff-b2f8-0ecf2aea7bbd tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:08.157077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:08.162036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:08.169951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:08.171699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:08.173760 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-967fb760-40de-4474-9758-e8c225bd94a4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.305795 Aug 27 05:00:08.174983 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 940/1843] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:07 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:08.180081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7c0dab4a-9469-48da-a240-df66172bd0fe tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:08.181779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7c0dab4a-9469-48da-a240-df66172bd0fe tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:08.189542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c0dab4a-9469-48da-a240-df66172bd0fe tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:08.190245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c0dab4a-9469-48da-a240-df66172bd0fe tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:08.190826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c0dab4a-9469-48da-a240-df66172bd0fe tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:08.191743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c0dab4a-9469-48da-a240-df66172bd0fe tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:08.192477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c0dab4a-9469-48da-a240-df66172bd0fe tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:08.193204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c0dab4a-9469-48da-a240-df66172bd0fe tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:08.298533 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-77d45845-9ff6-4aff-b2f8-0ecf2aea7bbd tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188401 Aug 27 05:00:08.299132 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 904/1844] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:00:08 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:08.303776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ebe42e12-f3e4-4ed5-b8b4-95cff2a21c58 req-64146843-c07f-4f78-a0f6-7ce88061fef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "tag": "9ee1e1d7-0d6d-4cbb-b872-87f8a3941c0d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:08.317158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ebe42e12-f3e4-4ed5-b8b4-95cff2a21c58 req-64146843-c07f-4f78-a0f6-7ce88061fef4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:08.317929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ebe42e12-f3e4-4ed5-b8b4-95cff2a21c58 req-64146843-c07f-4f78-a0f6-7ce88061fef4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:08.318565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ebe42e12-f3e4-4ed5-b8b4-95cff2a21c58 req-64146843-c07f-4f78-a0f6-7ce88061fef4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:08.334160 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ebe42e12-f3e4-4ed5-b8b4-95cff2a21c58 req-64146843-c07f-4f78-a0f6-7ce88061fef4 service nova] Creating event network-changed:9ee1e1d7-0d6d-4cbb-b872-87f8a3941c0d for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:00:08.343037 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ebe42e12-f3e4-4ed5-b8b4-95cff2a21c58 req-64146843-c07f-4f78-a0f6-7ce88061fef4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042687 Aug 27 05:00:08.344391 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 905/1845] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:08.350762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3a25c7ac-8449-4257-8628-b8b1b3ef4e63 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:08.351863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3a25c7ac-8449-4257-8628-b8b1b3ef4e63 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:08.360599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a25c7ac-8449-4257-8628-b8b1b3ef4e63 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:08.361423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a25c7ac-8449-4257-8628-b8b1b3ef4e63 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:08.362088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a25c7ac-8449-4257-8628-b8b1b3ef4e63 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:08.363717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a25c7ac-8449-4257-8628-b8b1b3ef4e63 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:08.364385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a25c7ac-8449-4257-8628-b8b1b3ef4e63 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:08.365034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a25c7ac-8449-4257-8628-b8b1b3ef4e63 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:08.866068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7c0dab4a-9469-48da-a240-df66172bd0fe tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:08.882982 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7c0dab4a-9469-48da-a240-df66172bd0fe tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1470 microversion: 2.1 time: 0.706143 Aug 27 05:00:08.894494 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 941/1846] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:08 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1470 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:08.900083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b6626f51-23ed-45f6-a4b6-cdd320d55103 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:08.900934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b6626f51-23ed-45f6-a4b6-cdd320d55103 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:08.909316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6626f51-23ed-45f6-a4b6-cdd320d55103 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:08.910039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6626f51-23ed-45f6-a4b6-cdd320d55103 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:08.910631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6626f51-23ed-45f6-a4b6-cdd320d55103 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:08.911705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6626f51-23ed-45f6-a4b6-cdd320d55103 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:08.912909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6626f51-23ed-45f6-a4b6-cdd320d55103 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:08.913631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6626f51-23ed-45f6-a4b6-cdd320d55103 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:08.919801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:08.999579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3a25c7ac-8449-4257-8628-b8b1b3ef4e63 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:09.016551 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3a25c7ac-8449-4257-8628-b8b1b3ef4e63 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1317 microversion: 2.1 time: 0.670117 Aug 27 05:00:09.017401 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 906/1847] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:08 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1317 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:09.131717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:09.138500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:09.148668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:09.149493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:09.150132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:09.150990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:09.151606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:09.152195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:09.508177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b6626f51-23ed-45f6-a4b6-cdd320d55103 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:09.524237 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b6626f51-23ed-45f6-a4b6-cdd320d55103 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.627175 Aug 27 05:00:09.527352 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 942/1848] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:08 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:09.533869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:09.534649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:09.543288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:09.543999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:09.544691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:09.545904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:09.546628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:09.547281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:10.232934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.250702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.254043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.255610 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4f307f31-2c91-4885-a28c-6306373e34a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1891 microversion: 2.42 time: 1.128249 Aug 27 05:00:10.257474 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 907/1849] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:09 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1891 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:10.265804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f0f3fc41-19c2-4c3b-a96e-abbccf03af4c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:10.266650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f0f3fc41-19c2-4c3b-a96e-abbccf03af4c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:10.276772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0f3fc41-19c2-4c3b-a96e-abbccf03af4c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:10.278100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0f3fc41-19c2-4c3b-a96e-abbccf03af4c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:10.279400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0f3fc41-19c2-4c3b-a96e-abbccf03af4c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:10.280886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0f3fc41-19c2-4c3b-a96e-abbccf03af4c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:10.282128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0f3fc41-19c2-4c3b-a96e-abbccf03af4c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:10.282788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0f3fc41-19c2-4c3b-a96e-abbccf03af4c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:10.355113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.367202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.369261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.370824 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ff04e443-fe54-4764-9167-6bdad66c7bb5 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.842080 Aug 27 05:00:10.371429 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 943/1850] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:09 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:10.392056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70e57fb5-d78e-486a-bf61-66034ddb17c7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:10.393022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-70e57fb5-d78e-486a-bf61-66034ddb17c7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:10.399198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e57fb5-d78e-486a-bf61-66034ddb17c7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:10.399714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e57fb5-d78e-486a-bf61-66034ddb17c7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:10.400301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e57fb5-d78e-486a-bf61-66034ddb17c7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:10.401024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e57fb5-d78e-486a-bf61-66034ddb17c7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:10.401464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e57fb5-d78e-486a-bf61-66034ddb17c7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:10.402026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e57fb5-d78e-486a-bf61-66034ddb17c7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:10.811682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f0f3fc41-19c2-4c3b-a96e-abbccf03af4c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.820754 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f0f3fc41-19c2-4c3b-a96e-abbccf03af4c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1470 microversion: 2.1 time: 0.561891 Aug 27 05:00:10.836413 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 908/1851] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:10 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1470 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:10.842029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1bd490f6-95e2-4204-8f40-7a1a8f83d1d6 req-2545eac0-395c-452d-b2b3-37d2199871d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "tag": "923d4ac2-c734-4a1c-a214-b065712f9202"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:10.853832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1bd490f6-95e2-4204-8f40-7a1a8f83d1d6 req-2545eac0-395c-452d-b2b3-37d2199871d0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:10.854582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1bd490f6-95e2-4204-8f40-7a1a8f83d1d6 req-2545eac0-395c-452d-b2b3-37d2199871d0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:10.855181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1bd490f6-95e2-4204-8f40-7a1a8f83d1d6 req-2545eac0-395c-452d-b2b3-37d2199871d0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:10.870358 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1bd490f6-95e2-4204-8f40-7a1a8f83d1d6 req-2545eac0-395c-452d-b2b3-37d2199871d0 service nova] Creating event network-changed:923d4ac2-c734-4a1c-a214-b065712f9202 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:00:10.876876 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1bd490f6-95e2-4204-8f40-7a1a8f83d1d6 req-2545eac0-395c-452d-b2b3-37d2199871d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038332 Aug 27 05:00:10.878404 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 909/1852] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:10.884249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-73db7315-4d04-4fdb-b970-cfd3d968c649 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:10.885012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-73db7315-4d04-4fdb-b970-cfd3d968c649 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:10.892013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73db7315-4d04-4fdb-b970-cfd3d968c649 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:10.892506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73db7315-4d04-4fdb-b970-cfd3d968c649 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:10.892947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73db7315-4d04-4fdb-b970-cfd3d968c649 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:10.893665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73db7315-4d04-4fdb-b970-cfd3d968c649 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:10.894125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73db7315-4d04-4fdb-b970-cfd3d968c649 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:10.894620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73db7315-4d04-4fdb-b970-cfd3d968c649 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:10.903040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-70e57fb5-d78e-486a-bf61-66034ddb17c7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.948507 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70e57fb5-d78e-486a-bf61-66034ddb17c7 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1507 microversion: 2.1 time: 0.563802 Aug 27 05:00:10.951130 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 944/1853] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:10 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1507 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:11.259696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-73db7315-4d04-4fdb-b970-cfd3d968c649 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:11.269505 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-73db7315-4d04-4fdb-b970-cfd3d968c649 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1714 microversion: 2.1 time: 0.389634 Aug 27 05:00:11.284912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:11.285805 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 910/1854] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:10 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1714 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:11.286337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:11.303510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:11.304244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:11.305374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:11.307366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:11.309312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:11.309972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:11.402756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:11.405652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:11.437894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:11.440947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:11.441638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:11.444553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:11.445242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:11.446038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.194122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:12.204445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:12.206045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:12.223581 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-771c7f71-48a4-4fa4-b550-703abc33183b tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.812620 Aug 27 05:00:12.224271 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 911/1855] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:11 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:12.230430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4bd6d7cc-263b-4f02-8443-eb40883f866a req-51ea34d2-b4d3-4f3a-8a80-20d04fdd1b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a29c81-2946-4132-a3a3-c7a53b508cd9", "name": "network-vif-deleted", "tag": "311e69d6-d905-4ef0-8a7c-36dea5177757"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:12.273421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4bd6d7cc-263b-4f02-8443-eb40883f866a req-51ea34d2-b4d3-4f3a-8a80-20d04fdd1b46 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.273950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4bd6d7cc-263b-4f02-8443-eb40883f866a req-51ea34d2-b4d3-4f3a-8a80-20d04fdd1b46 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.274507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4bd6d7cc-263b-4f02-8443-eb40883f866a req-51ea34d2-b4d3-4f3a-8a80-20d04fdd1b46 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.281554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:12.308932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:12.309527 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4bd6d7cc-263b-4f02-8443-eb40883f866a req-51ea34d2-b4d3-4f3a-8a80-20d04fdd1b46 service nova] Creating event network-vif-deleted:311e69d6-d905-4ef0-8a7c-36dea5177757 for instance 55a29c81-2946-4132-a3a3-c7a53b508cd9 on n-h1-820368-35 Aug 27 05:00:12.311647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:12.320535 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-17b8fbdb-0b2e-49c2-830c-eafad1cded16 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 1.042667 Aug 27 05:00:12.325793 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 945/1856] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:11 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:12.346394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:12.346607 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4bd6d7cc-263b-4f02-8443-eb40883f866a req-51ea34d2-b4d3-4f3a-8a80-20d04fdd1b46 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090781 Aug 27 05:00:12.348213 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 912/1857] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:12.349544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:12.353849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7a9b8146-d017-4800-977a-7e522129da1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:12.364200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7a9b8146-d017-4800-977a-7e522129da1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:12.380956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.386289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.387501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.389722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.390975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a9b8146-d017-4800-977a-7e522129da1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.391523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a9b8146-d017-4800-977a-7e522129da1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.392072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a9b8146-d017-4800-977a-7e522129da1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.392525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.393223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.398014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a9b8146-d017-4800-977a-7e522129da1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.398685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a9b8146-d017-4800-977a-7e522129da1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.399308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a9b8146-d017-4800-977a-7e522129da1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.475374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.477127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.479040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.480927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lazy-loading 'fault' on Instance uuid 55a29c81-2946-4132-a3a3-c7a53b508cd9 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:00:12.657542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:12.665693 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-18acb411-1b7e-4f22-9a81-c2ebc4901c6d tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 200 len: 1304 microversion: 2.1 time: 0.338576 Aug 27 05:00:12.682133 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 946/1858] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:12 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 1304 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:12.867520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7a9b8146-d017-4800-977a-7e522129da1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:12.890917 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7a9b8146-d017-4800-977a-7e522129da1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1704 microversion: 2.1 time: 0.541318 Aug 27 05:00:12.892288 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 913/1859] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:12 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1704 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:12.913049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a0b5c4e-137f-4028-a0dd-13516331eecb tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '.version_select at 0x7fb564b9b1f0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:12.917326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a0b5c4e-137f-4028-a0dd-13516331eecb tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.918587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a0b5c4e-137f-4028-a0dd-13516331eecb tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.919993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a0b5c4e-137f-4028-a0dd-13516331eecb tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.936915 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a0b5c4e-137f-4028-a0dd-13516331eecb tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2727 microversion: 2.1 time: 0.027936 Aug 27 05:00:12.948761 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 947/1860] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 05:00:12 2022] GET /compute/v2.1/os-migrations => generated 2727 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:12.948936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e92b8e43-f9a1-46b8-86ed-ce538cf74962 req-7cdb0025-a19b-4363-a13d-29236a5d7d9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "tag": "90a04fac-d169-4ae0-8392-e8d76b298cce"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:12.956877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70213304-a09b-47d9-835a-0e6e19af40ec tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:12.957966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-70213304-a09b-47d9-835a-0e6e19af40ec tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:12.965564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70213304-a09b-47d9-835a-0e6e19af40ec tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.966278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70213304-a09b-47d9-835a-0e6e19af40ec tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.966878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70213304-a09b-47d9-835a-0e6e19af40ec tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.967982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70213304-a09b-47d9-835a-0e6e19af40ec tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.968345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e92b8e43-f9a1-46b8-86ed-ce538cf74962 req-7cdb0025-a19b-4363-a13d-29236a5d7d9c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.969204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70213304-a09b-47d9-835a-0e6e19af40ec tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.969955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70213304-a09b-47d9-835a-0e6e19af40ec tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.974315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e92b8e43-f9a1-46b8-86ed-ce538cf74962 req-7cdb0025-a19b-4363-a13d-29236a5d7d9c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.974959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e92b8e43-f9a1-46b8-86ed-ce538cf74962 req-7cdb0025-a19b-4363-a13d-29236a5d7d9c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:13.000201 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e92b8e43-f9a1-46b8-86ed-ce538cf74962 req-7cdb0025-a19b-4363-a13d-29236a5d7d9c service nova] Creating event network-changed:90a04fac-d169-4ae0-8392-e8d76b298cce for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:00:13.025929 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e92b8e43-f9a1-46b8-86ed-ce538cf74962 req-7cdb0025-a19b-4363-a13d-29236a5d7d9c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069556 Aug 27 05:00:13.036913 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 914/1861] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:13.256156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:13.256941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:13.283004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:13.286234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:13.288873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:13.290864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:13.291869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:13.295219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:13.422323 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70213304-a09b-47d9-835a-0e6e19af40ec tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1857 microversion: 2.1 time: 0.472056 Aug 27 05:00:13.423029 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 948/1862] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:12 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1857 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:13.432827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:13.436651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:13.450100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:13.450605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:13.451027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:13.451925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:13.452573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:13.453136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:13.855019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:13.866428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:13.869561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:13.871341 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fb2a8524-3d36-4691-a1ff-0f7d4e893379 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.620702 Aug 27 05:00:13.890031 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 915/1863] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:13 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:13.896488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-876e6d54-b0da-41b2-a81e-46a3fbf509ee tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:13.897234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-876e6d54-b0da-41b2-a81e-46a3fbf509ee tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:13.904466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-876e6d54-b0da-41b2-a81e-46a3fbf509ee tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:13.905587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-876e6d54-b0da-41b2-a81e-46a3fbf509ee tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:13.906234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-876e6d54-b0da-41b2-a81e-46a3fbf509ee tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:13.907228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-876e6d54-b0da-41b2-a81e-46a3fbf509ee tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:13.907889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-876e6d54-b0da-41b2-a81e-46a3fbf509ee tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:13.908705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-876e6d54-b0da-41b2-a81e-46a3fbf509ee tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.531661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:14.544473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:14.554892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:14.557147 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d5e35a89-465e-4320-b636-21d34ab4f5bb tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 1.132598 Aug 27 05:00:14.572361 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 949/1864] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:13 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:14.581942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:14.582972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 55a29c81-2946-4132-a3a3-c7a53b508cd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:14.607256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.607994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.608582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.609619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.610229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.610818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.632945 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] HTTP exception thrown: Instance 55a29c81-2946-4132-a3a3-c7a53b508cd9 could not be found. Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Request method failure captured: Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 HTTP/1.1 Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRRhM-zRltZ1Aj5CIRS18bdBSvVu5YxeFNPwqqXoNV3q3itW1m399dWaO1ZX286AwGd1XnooELRfucmQ51X84j_tyJC-gOvyVPPa0KUNRBujvqAWBunZXEt9DWsEFA1N-NpEKWngtflusRWjmQh8I0AR4tw-cvOe53Qoc_pqR4PbPA Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 9c9b4a8740a14f9fbca3b63948d195e3 Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersAdminTestJSON-1460561960 Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9c9b4a8740a14f9fbca3b63948d195e3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9c9b4a8740a14f9fbca3b63948d195e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9c9b4a8740a14f9fbca3b63948d195e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9c9b4a8740a14f9fbca3b63948d195e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersAdminTestJSON-1460561960 Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 9c9b4a8740a14f9fbca3b63948d195e3 Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersAdminTestJSON-1460561960 Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersAdminTestJSON-1460561960-project Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 8a034099db9e45d8a675f6bea872e33a Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersAdminTestJSON-1460561960-project Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 55a29c81-2946-4132-a3a3-c7a53b508cd9 could not be found. Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '55a29c81-2946-4132-a3a3-c7a53b508cd9'} Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55a29c81-2946-4132-a3a3-c7a53b508cd9 could not be found. Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55a29c81-2946-4132-a3a3-c7a53b508cd9 could not be found. Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:14.636666 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.641229 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:14.641229 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:14.641229 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:14.641229 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:00:14.641229 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:00:14.641229 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55a29c81-2946-4132-a3a3-c7a53b508cd9 could not be found. Aug 27 05:00:14.641229 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.641229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Returning 404 to user: Instance 55a29c81-2946-4132-a3a3-c7a53b508cd9 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:00:14.641229 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-47e26e63-5aa9-4605-b958-37fb8eb7078c tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9" status: 404 len: 111 microversion: 2.1 time: 0.064927 Aug 27 05:00:14.641229 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 950/1865] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:14 2022] GET /compute/v2.1/servers/55a29c81-2946-4132-a3a3-c7a53b508cd9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:00:14.645100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "508b2c79-f100-4eb8-810c-c2238501c0b7"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:14.647951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:14.656109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.658943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.659283 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-876e6d54-b0da-41b2-a81e-46a3fbf509ee tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1857 microversion: 2.1 time: 0.764038 Aug 27 05:00:14.659719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.659719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.659719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.659719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.663410 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 916/1866] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:13 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1857 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:14.668864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8c2213c1-1e03-4552-8ee5-e2fafcdae6ab req-3c4fdfec-f5e3-41a5-aa9f-d32c0bef6e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa8507d-68a8-41bb-95b8-7cae5c5e7216", "tag": "251ac4eb-fa7e-4c6a-9b51-d6264fbc8ca4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:14.684219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8c2213c1-1e03-4552-8ee5-e2fafcdae6ab req-3c4fdfec-f5e3-41a5-aa9f-d32c0bef6e67 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.684710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8c2213c1-1e03-4552-8ee5-e2fafcdae6ab req-3c4fdfec-f5e3-41a5-aa9f-d32c0bef6e67 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.685357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8c2213c1-1e03-4552-8ee5-e2fafcdae6ab req-3c4fdfec-f5e3-41a5-aa9f-d32c0bef6e67 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.715784 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8c2213c1-1e03-4552-8ee5-e2fafcdae6ab req-3c4fdfec-f5e3-41a5-aa9f-d32c0bef6e67 service nova] Creating event network-changed:251ac4eb-fa7e-4c6a-9b51-d6264fbc8ca4 for instance 7fa8507d-68a8-41bb-95b8-7cae5c5e7216 on n-h1-820368-35 Aug 27 05:00:14.722926 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8c2213c1-1e03-4552-8ee5-e2fafcdae6ab req-3c4fdfec-f5e3-41a5-aa9f-d32c0bef6e67 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061149 Aug 27 05:00:14.724466 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 917/1867] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:14.740202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-baf5153f-4499-4aee-82b6-1d2a96ea5d19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:14.741350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-baf5153f-4499-4aee-82b6-1d2a96ea5d19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:14.757323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-baf5153f-4499-4aee-82b6-1d2a96ea5d19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.807487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-baf5153f-4499-4aee-82b6-1d2a96ea5d19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.050s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.812130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-baf5153f-4499-4aee-82b6-1d2a96ea5d19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.814248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-baf5153f-4499-4aee-82b6-1d2a96ea5d19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.815343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-baf5153f-4499-4aee-82b6-1d2a96ea5d19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.816637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-baf5153f-4499-4aee-82b6-1d2a96ea5d19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.872110 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] HTTP exception thrown: Volume 5d962710-28f5-4ef0-8351-672ac495efa5 could not be found. Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Request method failure captured: Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: request: PUT /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce/os-volume_attachments/5d962710-28f5-4ef0-8351-672ac495efa5 HTTP/1.1 Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 74 Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaQeyNEph6AW5f-eiqCka1QSB7LTyKe8xvj2TXqdNmekLkIvevqibjcFAUIc4H4ypcKeFFdvh99BKFqPZqS6aw4n5MYMBsRLNOvCSYtHNXZVs3Q8RnFb6VgFqTlUxXYKyNtRqY-MLj-oIez_1_klgxPQfNS7lwJhmJDPFmkeWUXfbfE Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 03f3054975754cb1a7bea84907cf7b1e Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesAdminNegativeTest-553811104 Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_03f3054975754cb1a7bea84907cf7b1e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/03f3054975754cb1a7bea84907cf7b1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/03f3054975754cb1a7bea84907cf7b1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/03f3054975754cb1a7bea84907cf7b1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesAdminNegativeTest-553811104 Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 03f3054975754cb1a7bea84907cf7b1e Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-553811104 Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesAdminNegativeTest-553811104-project-admin Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 845bc2cde797467893b8fdbccd7a0c08 Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesAdminNegativeTest-553811104-project-admin Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: {"volumeAttachment": {"volumeId": "508b2c79-f100-4eb8-810c-c2238501c0b7"}} Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: exception: Volume 5d962710-28f5-4ef0-8351-672ac495efa5 could not be found. Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'server_id': '2f8af20a-0dda-4589-8e24-a20171f939ce', 'id': '5d962710-28f5-4ef0-8351-672ac495efa5', 'body': {'volumeAttachment': {'volumeId': '508b2c79-f100-4eb8-810c-c2238501c0b7'}}} Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5d962710-28f5-4ef0-8351-672ac495efa5 could not be found. (HTTP 404) (Request-ID: req-0b17dce4-8fef-403d-beca-39ff1f1a7efc) Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 05:00:14.876070 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5d962710-28f5-4ef0-8351-672ac495efa5 could not be found. Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5d962710-28f5-4ef0-8351-672ac495efa5 could not be found. Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5d962710-28f5-4ef0-8351-672ac495efa5 could not be found. Aug 27 05:00:14.880742 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:14.883158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-baf5153f-4499-4aee-82b6-1d2a96ea5d19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:00:14.886392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] Returning 404 to user: Volume 5d962710-28f5-4ef0-8351-672ac495efa5 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:00:14.887440 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2f4eb882-c777-4537-9715-e2b04c6a7206 tempest-VolumesAdminNegativeTest-553811104 tempest-VolumesAdminNegativeTest-553811104-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce/os-volume_attachments/5d962710-28f5-4ef0-8351-672ac495efa5" status: 404 len: 109 microversion: 2.1 time: 0.246175 Aug 27 05:00:14.888949 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 951/1868] 10.222.0.58 () {60 vars in 1433 bytes} [Sat Aug 27 05:00:14 2022] PUT /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce/os-volume_attachments/5d962710-28f5-4ef0-8351-672ac495efa5 => generated 109 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:00:14.902295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f1eaecc3-a13b-4340-bd17-8c338eefbe2f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:14.907925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f1eaecc3-a13b-4340-bd17-8c338eefbe2f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:14.954719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1eaecc3-a13b-4340-bd17-8c338eefbe2f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.955567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1eaecc3-a13b-4340-bd17-8c338eefbe2f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.956374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1eaecc3-a13b-4340-bd17-8c338eefbe2f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.958143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1eaecc3-a13b-4340-bd17-8c338eefbe2f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.959449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1eaecc3-a13b-4340-bd17-8c338eefbe2f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.960920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1eaecc3-a13b-4340-bd17-8c338eefbe2f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:15.029050 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-baf5153f-4499-4aee-82b6-1d2a96ea5d19 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "DELETE /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 204 len: 0 microversion: 2.1 time: 0.300664 Aug 27 05:00:15.030063 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 918/1869] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:00:14 2022] DELETE /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:00:15.042773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:15.043524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:15.060182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:15.060681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:15.061121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:15.061833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:15.062288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:15.062715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:15.221924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-f1eaecc3-a13b-4340-bd17-8c338eefbe2f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lazy-loading 'services' on Instance uuid 9f2a6f90-d3c3-4741-b08c-ba80f635644d {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:00:15.377346 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f1eaecc3-a13b-4340-bd17-8c338eefbe2f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments/c5ba9f89-78f5-462e-a44b-33ea64ce31b7" status: 202 len: 0 microversion: 2.1 time: 0.485756 Aug 27 05:00:15.382381 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 952/1870] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:00:14 2022] DELETE /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments/c5ba9f89-78f5-462e-a44b-33ea64ce31b7 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:00:15.393249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f6e573fe-2884-4b03-b701-f6b7fb9aee3f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:15.395772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f6e573fe-2884-4b03-b701-f6b7fb9aee3f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:15.418766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6e573fe-2884-4b03-b701-f6b7fb9aee3f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:15.419914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6e573fe-2884-4b03-b701-f6b7fb9aee3f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:15.421860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6e573fe-2884-4b03-b701-f6b7fb9aee3f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:15.425840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6e573fe-2884-4b03-b701-f6b7fb9aee3f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:15.426574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6e573fe-2884-4b03-b701-f6b7fb9aee3f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:15.428352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6e573fe-2884-4b03-b701-f6b7fb9aee3f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:15.974812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:15.985382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:15.992351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:15.995373 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a4d35f1b-31e0-45e5-8b55-2f1c635af149 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.964071 Aug 27 05:00:15.998602 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 919/1871] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:15 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:16.005080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9330d402-1181-4ec7-866d-68fcd937a962 req-58622a08-16b2-4abe-8b35-bac8db1d4388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "tag": "67b4bbaf-e037-4c0b-af94-cb28ae1b24f7"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:16.034423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9330d402-1181-4ec7-866d-68fcd937a962 req-58622a08-16b2-4abe-8b35-bac8db1d4388 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:16.036176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9330d402-1181-4ec7-866d-68fcd937a962 req-58622a08-16b2-4abe-8b35-bac8db1d4388 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:16.036779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9330d402-1181-4ec7-866d-68fcd937a962 req-58622a08-16b2-4abe-8b35-bac8db1d4388 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:16.059826 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9330d402-1181-4ec7-866d-68fcd937a962 req-58622a08-16b2-4abe-8b35-bac8db1d4388 service nova] Creating event network-changed:67b4bbaf-e037-4c0b-af94-cb28ae1b24f7 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:00:16.067192 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9330d402-1181-4ec7-866d-68fcd937a962 req-58622a08-16b2-4abe-8b35-bac8db1d4388 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067050 Aug 27 05:00:16.068481 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 920/1872] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:16.074404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-255f83d6-7c08-430f-991d-0a9f3a608f84 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:16.077058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-255f83d6-7c08-430f-991d-0a9f3a608f84 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:16.085217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255f83d6-7c08-430f-991d-0a9f3a608f84 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:16.085980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255f83d6-7c08-430f-991d-0a9f3a608f84 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:16.086653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255f83d6-7c08-430f-991d-0a9f3a608f84 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:16.088161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255f83d6-7c08-430f-991d-0a9f3a608f84 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:16.088857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255f83d6-7c08-430f-991d-0a9f3a608f84 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:16.090407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255f83d6-7c08-430f-991d-0a9f3a608f84 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:16.152308 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-255f83d6-7c08-430f-991d-0a9f3a608f84 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082154 Aug 27 05:00:16.153618 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 921/1873] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:00:16 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:16.159625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:16.160512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:16.168045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:16.168880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:16.169651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:16.170587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:16.171352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:16.172079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:16.188582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f6e573fe-2884-4b03-b701-f6b7fb9aee3f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:16.215748 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f6e573fe-2884-4b03-b701-f6b7fb9aee3f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1470 microversion: 2.1 time: 0.830071 Aug 27 05:00:16.233033 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 953/1874] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:15 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1470 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:16.659945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:16.674928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:16.682190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:16.684100 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8755430c-08c5-42d8-9f3b-0a6b51b917c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.529118 Aug 27 05:00:16.687491 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 922/1875] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:16 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:17.023678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:17.027399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:17.062044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:17.067764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:17.068534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:17.070194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:17.072713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:17.074371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:17.166048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ff6e231f-7f0b-47e1-b0ac-af433fe7d2d7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:17.169576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ff6e231f-7f0b-47e1-b0ac-af433fe7d2d7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:17.186004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff6e231f-7f0b-47e1-b0ac-af433fe7d2d7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:17.186748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff6e231f-7f0b-47e1-b0ac-af433fe7d2d7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:17.187475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff6e231f-7f0b-47e1-b0ac-af433fe7d2d7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:17.189630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff6e231f-7f0b-47e1-b0ac-af433fe7d2d7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:17.190255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff6e231f-7f0b-47e1-b0ac-af433fe7d2d7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:17.191821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff6e231f-7f0b-47e1-b0ac-af433fe7d2d7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:17.260449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:17.274452 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ff6e231f-7f0b-47e1-b0ac-af433fe7d2d7 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113032 Aug 27 05:00:17.280469 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 923/1876] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:00:17 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:17.292041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1a2584c3-1552-493d-b037-d2c8e0a425ed tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:17.292685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1a2584c3-1552-493d-b037-d2c8e0a425ed tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:17.313776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a2584c3-1552-493d-b037-d2c8e0a425ed tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:17.314278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a2584c3-1552-493d-b037-d2c8e0a425ed tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:17.314704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a2584c3-1552-493d-b037-d2c8e0a425ed tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:17.322335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a2584c3-1552-493d-b037-d2c8e0a425ed tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:17.324945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a2584c3-1552-493d-b037-d2c8e0a425ed tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:17.325406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1a2584c3-1552-493d-b037-d2c8e0a425ed tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:18.073157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:18.086839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:18.097401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:18.098646 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d5d253be-d3ec-489d-8c19-80bee1a45b45 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 1.079356 Aug 27 05:00:18.099267 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 954/1877] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:17 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:18.112055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:18.112692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:18.130539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:18.131056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:18.136209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:18.137102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:18.137594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:18.140567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:18.160640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1a2584c3-1552-493d-b037-d2c8e0a425ed tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:18.169192 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1a2584c3-1552-493d-b037-d2c8e0a425ed tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1470 microversion: 2.1 time: 0.887039 Aug 27 05:00:18.186497 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 924/1878] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:17 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1470 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:18.223168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8436fa59-4abd-483e-b4b6-018165cc8ff6 req-a3615c35-3353-4a3f-b9f1-1918f1a82f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "tag": "8ee889f7-e538-4a59-8fc2-12d001a2065d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:18.241462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8436fa59-4abd-483e-b4b6-018165cc8ff6 req-a3615c35-3353-4a3f-b9f1-1918f1a82f26 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:18.242156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8436fa59-4abd-483e-b4b6-018165cc8ff6 req-a3615c35-3353-4a3f-b9f1-1918f1a82f26 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:18.242807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8436fa59-4abd-483e-b4b6-018165cc8ff6 req-a3615c35-3353-4a3f-b9f1-1918f1a82f26 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:18.282209 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8436fa59-4abd-483e-b4b6-018165cc8ff6 req-a3615c35-3353-4a3f-b9f1-1918f1a82f26 service nova] Creating event network-changed:8ee889f7-e538-4a59-8fc2-12d001a2065d for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:00:18.293051 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8436fa59-4abd-483e-b4b6-018165cc8ff6 req-a3615c35-3353-4a3f-b9f1-1918f1a82f26 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076261 Aug 27 05:00:18.293931 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 925/1879] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:18.299856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82bc2d8f-ca2b-4fb1-9b62-b26f1009b3d5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:18.302450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-82bc2d8f-ca2b-4fb1-9b62-b26f1009b3d5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:18.313793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82bc2d8f-ca2b-4fb1-9b62-b26f1009b3d5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:18.315201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82bc2d8f-ca2b-4fb1-9b62-b26f1009b3d5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:18.315679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82bc2d8f-ca2b-4fb1-9b62-b26f1009b3d5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:18.316459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82bc2d8f-ca2b-4fb1-9b62-b26f1009b3d5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:18.316898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82bc2d8f-ca2b-4fb1-9b62-b26f1009b3d5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:18.317325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82bc2d8f-ca2b-4fb1-9b62-b26f1009b3d5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:18.362234 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-82bc2d8f-ca2b-4fb1-9b62-b26f1009b3d5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067011 Aug 27 05:00:18.367528 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 926/1880] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:00:18 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:18.791398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:18.812349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:18.815934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:18.818323 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9ec41dea-c76a-4624-814a-da9aa80bfd83 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.718112 Aug 27 05:00:18.825509 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 955/1881] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:18 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:19.055893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-824ed2ee-494d-453f-a7d1-1b72079aebbf req-39755e4e-bfaf-41c4-85f3-54e05fe44415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880cf22b-b828-43db-9178-fb5e0229e5f6", "name": "network-vif-deleted", "tag": "02b97725-ed60-47a3-9076-4587ce039a32"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:19.104446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-824ed2ee-494d-453f-a7d1-1b72079aebbf req-39755e4e-bfaf-41c4-85f3-54e05fe44415 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.106913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-824ed2ee-494d-453f-a7d1-1b72079aebbf req-39755e4e-bfaf-41c4-85f3-54e05fe44415 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.110158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-824ed2ee-494d-453f-a7d1-1b72079aebbf req-39755e4e-bfaf-41c4-85f3-54e05fe44415 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.127308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:19.128121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:19.142144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.145789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.146448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.147872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.150689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.151169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.160889 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-824ed2ee-494d-453f-a7d1-1b72079aebbf req-39755e4e-bfaf-41c4-85f3-54e05fe44415 service nova] Creating event network-vif-deleted:02b97725-ed60-47a3-9076-4587ce039a32 for instance 880cf22b-b828-43db-9178-fb5e0229e5f6 on n-h2-820368-35 Aug 27 05:00:19.174255 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-824ed2ee-494d-453f-a7d1-1b72079aebbf req-39755e4e-bfaf-41c4-85f3-54e05fe44415 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124438 Aug 27 05:00:19.174950 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 927/1882] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:19.195046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:19.196162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:19.219238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.219962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.220576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.223460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.224579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.225507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.325613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:19.351543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.352265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.357164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.358333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lazy-loading 'fault' on Instance uuid 880cf22b-b828-43db-9178-fb5e0229e5f6 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:00:19.558194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:19.571942 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb1fd16d-1a64-4546-a687-7f91f2129b4b tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 200 len: 1304 microversion: 2.1 time: 0.381636 Aug 27 05:00:19.576292 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 928/1883] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:19 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 1304 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:19.598089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec0c7bc5-48a9-4212-9070-622c1a6dd792 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:19.600544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec0c7bc5-48a9-4212-9070-622c1a6dd792 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:19.615591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec0c7bc5-48a9-4212-9070-622c1a6dd792 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.616681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec0c7bc5-48a9-4212-9070-622c1a6dd792 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.617133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec0c7bc5-48a9-4212-9070-622c1a6dd792 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.620786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec0c7bc5-48a9-4212-9070-622c1a6dd792 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.621420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec0c7bc5-48a9-4212-9070-622c1a6dd792 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.621870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec0c7bc5-48a9-4212-9070-622c1a6dd792 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.715051 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec0c7bc5-48a9-4212-9070-622c1a6dd792 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137687 Aug 27 05:00:19.715879 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 929/1884] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:00:19 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:19.852954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:19.853671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:19.868942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.871775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.872390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.873468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.876844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.877382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.881390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:19.896459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:19.898460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:19.903813 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d43b1e92-0fff-4e43-b66f-65783892dddb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.781811 Aug 27 05:00:19.904748 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 956/1885] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:19 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:20.235726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:20.253989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:20.255460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:20.256643 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9151f676-85fe-4c6e-9b66-cdd1bd7b01e5 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.411351 Aug 27 05:00:20.257210 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 930/1886] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:19 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:20.602331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:20.604280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: 880cf22b-b828-43db-9178-fb5e0229e5f6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:20.612179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.612669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.613299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.614656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.615152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.615732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.636924 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] HTTP exception thrown: Instance 880cf22b-b828-43db-9178-fb5e0229e5f6 could not be found. Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Request method failure captured: Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 HTTP/1.1 Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRRhM-zRltZ1Aj5CIRS18bdBSvVu5YxeFNPwqqXoNV3q3itW1m399dWaO1ZX286AwGd1XnooELRfucmQ51X84j_tyJC-gOvyVPPa0KUNRBujvqAWBunZXEt9DWsEFA1N-NpEKWngtflusRWjmQh8I0AR4tw-cvOe53Qoc_pqR4PbPA Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 9c9b4a8740a14f9fbca3b63948d195e3 Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersAdminTestJSON-1460561960 Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9c9b4a8740a14f9fbca3b63948d195e3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9c9b4a8740a14f9fbca3b63948d195e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9c9b4a8740a14f9fbca3b63948d195e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9c9b4a8740a14f9fbca3b63948d195e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersAdminTestJSON-1460561960 Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 9c9b4a8740a14f9fbca3b63948d195e3 Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersAdminTestJSON-1460561960 Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersAdminTestJSON-1460561960-project Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 8a034099db9e45d8a675f6bea872e33a Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersAdminTestJSON-1460561960-project Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 880cf22b-b828-43db-9178-fb5e0229e5f6 could not be found. Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '880cf22b-b828-43db-9178-fb5e0229e5f6'} Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880cf22b-b828-43db-9178-fb5e0229e5f6 could not be found. Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880cf22b-b828-43db-9178-fb5e0229e5f6 could not be found. Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:20.639687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:20.644199 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:20.644199 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:20.644199 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:20.644199 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:00:20.644199 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:00:20.644199 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880cf22b-b828-43db-9178-fb5e0229e5f6 could not be found. Aug 27 05:00:20.644199 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:20.646006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Returning 404 to user: Instance 880cf22b-b828-43db-9178-fb5e0229e5f6 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:00:20.647238 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-963e17ef-3844-48f6-90f8-88dc1280ece7 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6" status: 404 len: 111 microversion: 2.1 time: 0.048760 Aug 27 05:00:20.650160 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 957/1887] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:20 2022] GET /compute/v2.1/servers/880cf22b-b828-43db-9178-fb5e0229e5f6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:00:20.657577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f0e44112-a184-4c58-ad47-a9b7504a139f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:20.658074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f0e44112-a184-4c58-ad47-a9b7504a139f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:20.673141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e44112-a184-4c58-ad47-a9b7504a139f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.676226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e44112-a184-4c58-ad47-a9b7504a139f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.677570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e44112-a184-4c58-ad47-a9b7504a139f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.681105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e44112-a184-4c58-ad47-a9b7504a139f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.682484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e44112-a184-4c58-ad47-a9b7504a139f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.683361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e44112-a184-4c58-ad47-a9b7504a139f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.737104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17ee1bf3-7e0e-45e5-a83f-c88935e40eb9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:20.740919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-17ee1bf3-7e0e-45e5-a83f-c88935e40eb9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:20.744134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f0e44112-a184-4c58-ad47-a9b7504a139f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:00:20.750020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17ee1bf3-7e0e-45e5-a83f-c88935e40eb9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.750759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17ee1bf3-7e0e-45e5-a83f-c88935e40eb9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.751375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17ee1bf3-7e0e-45e5-a83f-c88935e40eb9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.752247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17ee1bf3-7e0e-45e5-a83f-c88935e40eb9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.752905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17ee1bf3-7e0e-45e5-a83f-c88935e40eb9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.753468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17ee1bf3-7e0e-45e5-a83f-c88935e40eb9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.829468 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-17ee1bf3-7e0e-45e5-a83f-c88935e40eb9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102993 Aug 27 05:00:20.837719 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 958/1888] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:00:20 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:20.903651 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f0e44112-a184-4c58-ad47-a9b7504a139f tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 204 len: 0 microversion: 2.1 time: 0.247964 Aug 27 05:00:20.904400 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 931/1889] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:00:20 2022] DELETE /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:00:20.914633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-535190f5-2597-4be7-afb7-045f2f0b6e05 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:20.916120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-535190f5-2597-4be7-afb7-045f2f0b6e05 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:20.926290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535190f5-2597-4be7-afb7-045f2f0b6e05 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.928419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535190f5-2597-4be7-afb7-045f2f0b6e05 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.928419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535190f5-2597-4be7-afb7-045f2f0b6e05 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.928419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535190f5-2597-4be7-afb7-045f2f0b6e05 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.935673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:20.936497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535190f5-2597-4be7-afb7-045f2f0b6e05 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.937240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535190f5-2597-4be7-afb7-045f2f0b6e05 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.953306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:20.970501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.971287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.971829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.972722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.973334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.973710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.715943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-535190f5-2597-4be7-afb7-045f2f0b6e05 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:21.722590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:21.735646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:21.736343 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-535190f5-2597-4be7-afb7-045f2f0b6e05 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1469 microversion: 2.1 time: 0.821694 Aug 27 05:00:21.737472 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 959/1890] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:20 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1469 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:21.740548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:21.744224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:21.745633 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-532bc3c6-638c-455d-adc1-4addf1f3f237 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.816275 Aug 27 05:00:21.746683 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 932/1891] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:20 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:21.747536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:21.754118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.754872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.755555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.756475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.757031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.757581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.762804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:21.843662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-05c52ded-4e9f-427d-b9d8-e7044f641c2e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:21.845115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-05c52ded-4e9f-427d-b9d8-e7044f641c2e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:21.851299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05c52ded-4e9f-427d-b9d8-e7044f641c2e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.851791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05c52ded-4e9f-427d-b9d8-e7044f641c2e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.852250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05c52ded-4e9f-427d-b9d8-e7044f641c2e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.852980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05c52ded-4e9f-427d-b9d8-e7044f641c2e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.853439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05c52ded-4e9f-427d-b9d8-e7044f641c2e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.854057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05c52ded-4e9f-427d-b9d8-e7044f641c2e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.893243 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-05c52ded-4e9f-427d-b9d8-e7044f641c2e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054560 Aug 27 05:00:21.894198 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 933/1892] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:00:21 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:00:22.201252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:22.210796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:22.212242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:22.216543 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8dd8255c-acd9-4867-a602-baa4990e21d7 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.477845 Aug 27 05:00:22.220919 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 960/1893] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:21 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:22.758302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1a43a29-8795-41e8-9363-16671d8090f4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:22.760211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d1a43a29-8795-41e8-9363-16671d8090f4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:22.769717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89c4f608-91e6-4708-9acb-fb06b5c328b6 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:22.770947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89c4f608-91e6-4708-9acb-fb06b5c328b6 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:22.777635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1a43a29-8795-41e8-9363-16671d8090f4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:22.778420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1a43a29-8795-41e8-9363-16671d8090f4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:22.779673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1a43a29-8795-41e8-9363-16671d8090f4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:22.785232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1a43a29-8795-41e8-9363-16671d8090f4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:22.786106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1a43a29-8795-41e8-9363-16671d8090f4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:22.787435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1a43a29-8795-41e8-9363-16671d8090f4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:22.789654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89c4f608-91e6-4708-9acb-fb06b5c328b6 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:22.790228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89c4f608-91e6-4708-9acb-fb06b5c328b6 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:22.791194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89c4f608-91e6-4708-9acb-fb06b5c328b6 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:22.791918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89c4f608-91e6-4708-9acb-fb06b5c328b6 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:22.792367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89c4f608-91e6-4708-9acb-fb06b5c328b6 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:22.792792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89c4f608-91e6-4708-9acb-fb06b5c328b6 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:22.873716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89c4f608-91e6-4708-9acb-fb06b5c328b6 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:00:23.053442 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89c4f608-91e6-4708-9acb-fb06b5c328b6 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 204 len: 0 microversion: 2.1 time: 0.287456 Aug 27 05:00:23.054609 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 961/1894] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:00:22 2022] DELETE /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:00:23.062178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:23.063290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:23.070020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.070770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.073003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.074331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.075022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.075684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.227813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d1a43a29-8795-41e8-9363-16671d8090f4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:23.252991 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1a43a29-8795-41e8-9363-16671d8090f4 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1469 microversion: 2.1 time: 0.491459 Aug 27 05:00:23.255677 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 934/1895] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:22 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1469 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:23.268502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40649ea8-924c-4ca8-bef2-bdacc4100604 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:23.273157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-40649ea8-924c-4ca8-bef2-bdacc4100604 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:23.286032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40649ea8-924c-4ca8-bef2-bdacc4100604 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.286932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40649ea8-924c-4ca8-bef2-bdacc4100604 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.288294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40649ea8-924c-4ca8-bef2-bdacc4100604 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.289297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40649ea8-924c-4ca8-bef2-bdacc4100604 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.289943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40649ea8-924c-4ca8-bef2-bdacc4100604 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.290713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40649ea8-924c-4ca8-bef2-bdacc4100604 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.335331 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40649ea8-924c-4ca8-bef2-bdacc4100604 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077800 Aug 27 05:00:23.336154 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 935/1896] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:00:23 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:00:23.369433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-041710e2-cc9f-46b4-8e89-35a09fb58ccf tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:23.372169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-041710e2-cc9f-46b4-8e89-35a09fb58ccf tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:23.391010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-041710e2-cc9f-46b4-8e89-35a09fb58ccf tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.393318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-041710e2-cc9f-46b4-8e89-35a09fb58ccf tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.393991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-041710e2-cc9f-46b4-8e89-35a09fb58ccf tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.395876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-041710e2-cc9f-46b4-8e89-35a09fb58ccf tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.398947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-041710e2-cc9f-46b4-8e89-35a09fb58ccf tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.400319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-041710e2-cc9f-46b4-8e89-35a09fb58ccf tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.425681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:23.437984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:23.440199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:23.442193 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f56ef8df-5e5e-4609-8ac6-9026334b8fd0 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.386273 Aug 27 05:00:23.443304 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 962/1897] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:23 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:23.450901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:23.451675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:23.469121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.469121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.469121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.469121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.469121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.470445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.974539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-041710e2-cc9f-46b4-8e89-35a09fb58ccf tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:23.985527 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-041710e2-cc9f-46b4-8e89-35a09fb58ccf tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1513 microversion: 2.1 time: 0.646523 Aug 27 05:00:23.988982 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 936/1898] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:23 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1513 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:24.250210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8b974c5f-f2b6-420f-af2a-19941239d4f9 req-17858114-ff2b-45dd-ad97-615f79aa68a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0722d6-d717-436e-b051-df3b185dddd5", "name": "network-vif-deleted", "tag": "dc0145a6-c0bf-434f-b124-20af43f72b43"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:24.268975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8b974c5f-f2b6-420f-af2a-19941239d4f9 req-17858114-ff2b-45dd-ad97-615f79aa68a9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:24.269737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8b974c5f-f2b6-420f-af2a-19941239d4f9 req-17858114-ff2b-45dd-ad97-615f79aa68a9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:24.270773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8b974c5f-f2b6-420f-af2a-19941239d4f9 req-17858114-ff2b-45dd-ad97-615f79aa68a9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:24.296434 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8b974c5f-f2b6-420f-af2a-19941239d4f9 req-17858114-ff2b-45dd-ad97-615f79aa68a9 service nova] Creating event network-vif-deleted:dc0145a6-c0bf-434f-b124-20af43f72b43 for instance eb0722d6-d717-436e-b051-df3b185dddd5 on n-h1-820368-35 Aug 27 05:00:24.302458 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8b974c5f-f2b6-420f-af2a-19941239d4f9 req-17858114-ff2b-45dd-ad97-615f79aa68a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057015 Aug 27 05:00:24.307822 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 937/1899] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:00:24.315647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-213e7e09-2290-4827-bc88-e1ab4a40ca23 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:24.316731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-213e7e09-2290-4827-bc88-e1ab4a40ca23 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:24.325796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213e7e09-2290-4827-bc88-e1ab4a40ca23 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:24.327360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213e7e09-2290-4827-bc88-e1ab4a40ca23 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:24.328359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213e7e09-2290-4827-bc88-e1ab4a40ca23 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:24.329112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213e7e09-2290-4827-bc88-e1ab4a40ca23 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:24.329636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213e7e09-2290-4827-bc88-e1ab4a40ca23 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:24.330328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213e7e09-2290-4827-bc88-e1ab4a40ca23 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:24.488363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.538219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.542024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.543548 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-85293b21-4453-4cfb-9fe8-7a596ef1706e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 1.098943 Aug 27 05:00:24.544645 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 963/1900] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:23 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:24.561359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:24.561996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:24.562264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-213e7e09-2290-4827-bc88-e1ab4a40ca23 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.572215 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-213e7e09-2290-4827-bc88-e1ab4a40ca23 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1298 microversion: 2.1 time: 0.262831 Aug 27 05:00:24.586561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:24.586561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:24.586561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:24.586561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:24.586561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:24.587823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:24.588633 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 938/1901] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:24 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1298 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:24.916986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.935955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.937771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.952732 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d67e1d4-fee4-4282-9068-be3dbea88f31 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.393363 Aug 27 05:00:24.953662 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 964/1902] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:24 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:25.015983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa5a7221-4567-4908-b62e-fe53546c0bae tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:25.016640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fa5a7221-4567-4908-b62e-fe53546c0bae tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:25.029817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a7221-4567-4908-b62e-fe53546c0bae tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:25.030332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a7221-4567-4908-b62e-fe53546c0bae tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:25.030785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a7221-4567-4908-b62e-fe53546c0bae tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:25.031546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a7221-4567-4908-b62e-fe53546c0bae tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:25.032015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a7221-4567-4908-b62e-fe53546c0bae tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:25.040135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a7221-4567-4908-b62e-fe53546c0bae tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:25.571002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:25.573199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:25.592885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:25.594901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:25.596219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:25.597266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:25.599907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:25.600662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:25.743725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fa5a7221-4567-4908-b62e-fe53546c0bae tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:25.756340 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa5a7221-4567-4908-b62e-fe53546c0bae tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1513 microversion: 2.1 time: 0.744850 Aug 27 05:00:25.758638 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 939/1903] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:25 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1513 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:25.777571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:25.791515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:25.817546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:25.820917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:25.822121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:25.824819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:25.825320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:25.825769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:25.873758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:25.918458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:25.924047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:25.924585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:25.925064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lazy-loading 'fault' on Instance uuid eb0722d6-d717-436e-b051-df3b185dddd5 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:00:26.187610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.213306 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a571ac9c-dc5e-4b9b-9b3f-32de9b4a0f7e tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1303 microversion: 2.1 time: 0.451229 Aug 27 05:00:26.220676 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 940/1904] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:25 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1303 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:26.248449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:26.250916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:26.273846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:26.274734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:26.282088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:26.284855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:26.287571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:26.288322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:26.344636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.360938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.364743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.366251 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-645bcd9e-b00a-400e-b009-2ef80c2d569c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.802472 Aug 27 05:00:26.385773 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 965/1905] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:25 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:26.405523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c81f9375-882c-46ae-8a28-1df5aef96ddf req-968afe85-d140-4ef8-acbe-7c274d89632e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8af20a-0dda-4589-8e24-a20171f939ce", "name": "network-vif-deleted", "tag": "4069efdd-8664-4635-b639-4811f05f8c16"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:26.445150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c81f9375-882c-46ae-8a28-1df5aef96ddf req-968afe85-d140-4ef8-acbe-7c274d89632e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:26.446800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c81f9375-882c-46ae-8a28-1df5aef96ddf req-968afe85-d140-4ef8-acbe-7c274d89632e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:26.447474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c81f9375-882c-46ae-8a28-1df5aef96ddf req-968afe85-d140-4ef8-acbe-7c274d89632e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:26.483791 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c81f9375-882c-46ae-8a28-1df5aef96ddf req-968afe85-d140-4ef8-acbe-7c274d89632e service nova] Creating event network-vif-deleted:4069efdd-8664-4635-b639-4811f05f8c16 for instance 2f8af20a-0dda-4589-8e24-a20171f939ce on n-h2-820368-35 Aug 27 05:00:26.495676 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c81f9375-882c-46ae-8a28-1df5aef96ddf req-968afe85-d140-4ef8-acbe-7c274d89632e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105923 Aug 27 05:00:26.498438 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 966/1906] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:26.791594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:26.792682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:26.800444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:26.801133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:26.801665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:26.802486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:26.803318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:26.804740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:26.830651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.843726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.846259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.847623 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-65bc5a5c-bb54-4ca7-ba69-a5b6f6ad23f6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.622788 Aug 27 05:00:26.848390 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 941/1907] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:26 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:26.902498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:26.903411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:26.904101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:26.904747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lazy-loading 'fault' on Instance uuid 2f8af20a-0dda-4589-8e24-a20171f939ce {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:00:26.976122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.996668 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-97abfb2e-a721-4686-9f19-b1acc0687a3c tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 200 len: 1307 microversion: 2.1 time: 0.209191 Aug 27 05:00:27.002729 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 967/1908] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:26 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 1307 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:27.242357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:27.243038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:27.257418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:27.257912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:27.258348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:27.259156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:27.259613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:27.260209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:27.340582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:27.341778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:27.343326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:27.344004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lazy-loading 'fault' on Instance uuid eb0722d6-d717-436e-b051-df3b185dddd5 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:00:27.391127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:27.391820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:27.394130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:27.403462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:27.406434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:27.408755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:27.411447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:27.411980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:27.412440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:27.510221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a034099db9e45d8a675f6bea872e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9b4a8740a14f9fbca3b63948d195e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:27.524290 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e6657d89-ff1a-4b95-a5b9-5e42caafd75a tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 200 len: 1303 microversion: 2.1 time: 0.285326 Aug 27 05:00:27.543129 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 942/1909] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:27 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 1303 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:27.874858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:27.875797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:27.882530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:27.883573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:27.885143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:27.886101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:27.886758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:27.887557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:27.941086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:27.961219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:27.962890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:27.968331 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b2221cfd-bc0a-4159-b468-f6458f1b9b01 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.581254 Aug 27 05:00:27.971112 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 968/1910] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:27 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:28.019825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:28.020790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 2f8af20a-0dda-4589-8e24-a20171f939ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:28.034752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:28.037074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:28.041646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:28.042808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:28.043555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:28.045233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:28.086883 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] HTTP exception thrown: Instance 2f8af20a-0dda-4589-8e24-a20171f939ce could not be found. Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Request method failure captured: Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce HTTP/1.1 Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaQOmpUwe74D5fD23IwQ7dqGCkCAF-rlu0xwBYGs1RMleVbRNWDIGRAgkvmBBH1frEwAqK1yiW7PiEwfZHvuEoc-BRdc64-2cueQ6QZXZv6-pQq8AAGSTdLRCcIOevTrQAEN5RRwLEFJ6FH7hsGfVurdNx2Ryq_bOCb0kE_KmOiHYlE Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 24e778c9967549f5b7641c2b8df74302 Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesAdminNegativeTest-944776771 Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_24e778c9967549f5b7641c2b8df74302", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/24e778c9967549f5b7641c2b8df74302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24e778c9967549f5b7641c2b8df74302"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24e778c9967549f5b7641c2b8df74302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesAdminNegativeTest-944776771 Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 24e778c9967549f5b7641c2b8df74302 Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-944776771 Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesAdminNegativeTest-944776771-project Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: d16fabfbcd5b4a7182b18918a1e3e3e7 Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesAdminNegativeTest-944776771-project Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 2f8af20a-0dda-4589-8e24-a20171f939ce could not be found. Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2f8af20a-0dda-4589-8e24-a20171f939ce'} Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f8af20a-0dda-4589-8e24-a20171f939ce could not be found. Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f8af20a-0dda-4589-8e24-a20171f939ce could not be found. Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:28.090997 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:28.095024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:28.095024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:28.095024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:28.095024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:00:28.095024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:00:28.095024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f8af20a-0dda-4589-8e24-a20171f939ce could not be found. Aug 27 05:00:28.095024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:28.095024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Returning 404 to user: Instance 2f8af20a-0dda-4589-8e24-a20171f939ce could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:00:28.095024 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d0db1393-9d8d-4f4b-8fb3-38310ff54c34 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce" status: 404 len: 111 microversion: 2.1 time: 0.076768 Aug 27 05:00:28.095024 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 969/1911] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:28 2022] GET /compute/v2.1/servers/2f8af20a-0dda-4589-8e24-a20171f939ce => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:00:28.551411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:28.552437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] [instance: eb0722d6-d717-436e-b051-df3b185dddd5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:28.561361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:28.562192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:28.562877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:28.564444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:28.566191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:28.566779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:28.591538 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] HTTP exception thrown: Instance eb0722d6-d717-436e-b051-df3b185dddd5 could not be found. Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Request method failure captured: Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 HTTP/1.1 Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRRhM-zRltZ1Aj5CIRS18bdBSvVu5YxeFNPwqqXoNV3q3itW1m399dWaO1ZX286AwGd1XnooELRfucmQ51X84j_tyJC-gOvyVPPa0KUNRBujvqAWBunZXEt9DWsEFA1N-NpEKWngtflusRWjmQh8I0AR4tw-cvOe53Qoc_pqR4PbPA Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 9c9b4a8740a14f9fbca3b63948d195e3 Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersAdminTestJSON-1460561960 Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9c9b4a8740a14f9fbca3b63948d195e3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9c9b4a8740a14f9fbca3b63948d195e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9c9b4a8740a14f9fbca3b63948d195e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9c9b4a8740a14f9fbca3b63948d195e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersAdminTestJSON-1460561960 Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 9c9b4a8740a14f9fbca3b63948d195e3 Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersAdminTestJSON-1460561960 Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersAdminTestJSON-1460561960-project Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 8a034099db9e45d8a675f6bea872e33a Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersAdminTestJSON-1460561960-project Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance eb0722d6-d717-436e-b051-df3b185dddd5 could not be found. Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'eb0722d6-d717-436e-b051-df3b185dddd5'} Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0722d6-d717-436e-b051-df3b185dddd5 could not be found. Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0722d6-d717-436e-b051-df3b185dddd5 could not be found. Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:28.593371 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:28.598456 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:28.598456 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:28.598456 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:28.598456 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:00:28.598456 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:00:28.598456 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0722d6-d717-436e-b051-df3b185dddd5 could not be found. Aug 27 05:00:28.598456 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:28.601380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] Returning 404 to user: Instance eb0722d6-d717-436e-b051-df3b185dddd5 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:00:28.602807 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5bf1da98-fb5c-4085-a7fb-550076e23f01 tempest-ServersAdminTestJSON-1460561960 tempest-ServersAdminTestJSON-1460561960-project] 10.222.0.58 "GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5" status: 404 len: 111 microversion: 2.1 time: 0.056593 Aug 27 05:00:28.604162 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 970/1912] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:28 2022] GET /compute/v2.1/servers/eb0722d6-d717-436e-b051-df3b185dddd5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:00:28.897277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:28.914522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:28.919244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:28.928608 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-47326da8-330f-4e1a-a9a4-855eedcf8a8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 1.052868 Aug 27 05:00:28.932168 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 943/1913] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:27 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:29.000867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:29.001912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:29.021168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:29.023203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:29.024379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:29.025463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:29.026065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:29.027339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:29.434795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:29.454251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:29.458299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:29.465068 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8a14e2e1-4dc3-4837-b74c-a11c04db3e7f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.466953 Aug 27 05:00:29.487268 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 971/1914] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:28 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:29.955594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:29.956875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:29.964565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:29.966350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:29.967024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:29.967995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:29.968810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:29.969744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:30.335957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:30.350201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:30.354866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:30.361485 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1e9bbd7-28ab-4d03-a6f0-40eb92007d51 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.407847 Aug 27 05:00:30.362753 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 944/1915] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:29 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:30.495840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:30.496470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:30.511698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:30.512410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:30.515467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:30.516959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:30.517818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:30.525661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:31.036408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:31.058463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:31.062491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:31.066288 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e21684ad-2bc4-4d3e-9486-12971e957344 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.575691 Aug 27 05:00:31.070028 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 972/1916] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:30 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:31.390275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:31.391254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:31.406235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:31.406748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:31.407229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:31.409116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:31.413499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:31.414670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:31.699815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:31.720168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:31.728181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:31.730817 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f2c1aeab-739f-4c1a-a7c3-c9f8d1dd7427 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.344756 Aug 27 05:00:31.733849 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 945/1917] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:31 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:32.094578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:32.095894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:32.109951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:32.111564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:32.114369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:32.115533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:32.116147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:32.116734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:32.418929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:32.434013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:32.436244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:32.437626 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0d3a775d-db2d-4a04-8bf0-cc5399ad9517 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.347320 Aug 27 05:00:32.439041 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 973/1918] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:32 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:32.758556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:32.759758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:32.772999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:32.777148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:32.777540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:32.778285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:32.779832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:32.780352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:33.111584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:33.129505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:33.137432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:33.140342 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4a4b6e49-f155-4278-b299-5ee59f9f9813 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.386988 Aug 27 05:00:33.145863 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 946/1919] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:32 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:33.466541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:33.467275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:33.489750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:33.491540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:33.492613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:33.495226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:33.496930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:33.498699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:34.022624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:34.045316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:34.051137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:34.055647 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-002e036c-ce58-491c-88b7-6c7020eaa7e1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.593667 Aug 27 05:00:34.062991 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 974/1920] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:33 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:34.173504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:34.174075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:34.199835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:34.200342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:34.200791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:34.205888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:34.206535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:34.207417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:34.238593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1376337730", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:34.385174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:00:34.799492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:34.814212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:34.820574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:34.824550 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-885092a6-eaa4-4bde-a028-2f22d164a20c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.655342 Aug 27 05:00:34.839117 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 975/1921] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:34 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:35.075969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:00:35.082192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:35.084247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:00:35.085106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:00:35.087048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:00:35.088357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:35.088998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:00:35.107063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:35.107976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:35.110290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:35.112633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:35.115309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:35.117030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:35.118995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:35.121098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:35.123176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:35.127980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:35.129077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:35.132202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:35.199799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Getting quotas for project 6fd7543ea6e54136897717d844333ff2. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:00:35.213631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Getting quotas for user dd34049995f544aa9a540062dedae56c and project 6fd7543ea6e54136897717d844333ff2. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:00:35.256189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:00:35.263198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:00:35.384601 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-11f6110d-3269-4144-a8f0-a868c9a1e878 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.490018 Aug 27 05:00:35.397682 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 947/1922] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:00:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:00:35.416344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8ffff07-2fd1-4370-af49-64ecd1abef48 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:35.418782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8ffff07-2fd1-4370-af49-64ecd1abef48 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:35.573250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:35.577526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8ffff07-2fd1-4370-af49-64ecd1abef48 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:35.585394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:35.600517 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8ffff07-2fd1-4370-af49-64ecd1abef48 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1222 microversion: 2.1 time: 0.197376 Aug 27 05:00:35.604343 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 948/1923] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:35 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1222 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:35.607384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:35.609761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:35.611577 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-13edd052-f7b0-4699-b768-a92398438e39 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.533495 Aug 27 05:00:35.612678 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 976/1924] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:35 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:35.850020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:35.850694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:35.861415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:35.863915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:35.864683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:35.866664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:35.867986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:35.868464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.034504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-95dce3b3-9d02-40ca-be31-f2f1b56fa96d tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:36.035660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-95dce3b3-9d02-40ca-be31-f2f1b56fa96d tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:36.044845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95dce3b3-9d02-40ca-be31-f2f1b56fa96d tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.046301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95dce3b3-9d02-40ca-be31-f2f1b56fa96d tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.047630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95dce3b3-9d02-40ca-be31-f2f1b56fa96d tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.050126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95dce3b3-9d02-40ca-be31-f2f1b56fa96d tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.051402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95dce3b3-9d02-40ca-be31-f2f1b56fa96d tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.052616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95dce3b3-9d02-40ca-be31-f2f1b56fa96d tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.148728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-95dce3b3-9d02-40ca-be31-f2f1b56fa96d tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:00:36.357921 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-95dce3b3-9d02-40ca-be31-f2f1b56fa96d tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 204 len: 0 microversion: 2.1 time: 0.327791 Aug 27 05:00:36.359045 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 977/1925] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:00:36 2022] DELETE /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:00:36.367648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c49a9657-f6f5-42c0-bf1e-13b97e22556b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:36.369434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c49a9657-f6f5-42c0-bf1e-13b97e22556b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:36.383224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c49a9657-f6f5-42c0-bf1e-13b97e22556b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.384611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c49a9657-f6f5-42c0-bf1e-13b97e22556b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.387178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c49a9657-f6f5-42c0-bf1e-13b97e22556b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.390338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c49a9657-f6f5-42c0-bf1e-13b97e22556b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.391011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c49a9657-f6f5-42c0-bf1e-13b97e22556b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.395897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c49a9657-f6f5-42c0-bf1e-13b97e22556b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.502992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:36.518878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:36.521090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:36.524159 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e9a5041c-1e05-41e6-9df7-1153e613b001 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.678248 Aug 27 05:00:36.544011 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 949/1926] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:35 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:36.636513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-38e7b9dd-8502-4e2c-8cf7-b8bcbb75ce5f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:36.637471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-38e7b9dd-8502-4e2c-8cf7-b8bcbb75ce5f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:36.654092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38e7b9dd-8502-4e2c-8cf7-b8bcbb75ce5f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.660661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38e7b9dd-8502-4e2c-8cf7-b8bcbb75ce5f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.661318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38e7b9dd-8502-4e2c-8cf7-b8bcbb75ce5f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.663998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38e7b9dd-8502-4e2c-8cf7-b8bcbb75ce5f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.666733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38e7b9dd-8502-4e2c-8cf7-b8bcbb75ce5f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.670408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38e7b9dd-8502-4e2c-8cf7-b8bcbb75ce5f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.954735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-38e7b9dd-8502-4e2c-8cf7-b8bcbb75ce5f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:36.965648 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-38e7b9dd-8502-4e2c-8cf7-b8bcbb75ce5f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1218 microversion: 2.1 time: 0.333355 Aug 27 05:00:36.972875 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 950/1927] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:36 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1218 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:36.989515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:36.991448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:37.005392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:37.008177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:37.011340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:37.012534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:37.015755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:37.019265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:37.304565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c49a9657-f6f5-42c0-bf1e-13b97e22556b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:37.318311 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c49a9657-f6f5-42c0-bf1e-13b97e22556b tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1682 microversion: 2.1 time: 0.953158 Aug 27 05:00:37.334478 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 978/1928] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:36 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1682 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:37.561692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:37.563202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:37.577058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:37.578565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:37.580780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:37.581783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:37.584952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:37.586529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.005931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.023786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.026023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.028556 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6413070d-7918-4094-b521-70385ffd44e2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 1.053097 Aug 27 05:00:38.029455 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 951/1929] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:36 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:38.035671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-24461468-302a-4ac1-90c0-d6313de3ab9c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:38.036608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-24461468-302a-4ac1-90c0-d6313de3ab9c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:38.054372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24461468-302a-4ac1-90c0-d6313de3ab9c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:38.054948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24461468-302a-4ac1-90c0-d6313de3ab9c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:38.055680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24461468-302a-4ac1-90c0-d6313de3ab9c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.056500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24461468-302a-4ac1-90c0-d6313de3ab9c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:38.057160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24461468-302a-4ac1-90c0-d6313de3ab9c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:38.057749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24461468-302a-4ac1-90c0-d6313de3ab9c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.195149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-24461468-302a-4ac1-90c0-d6313de3ab9c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.210376 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-24461468-302a-4ac1-90c0-d6313de3ab9c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1280 microversion: 2.1 time: 0.178328 Aug 27 05:00:38.231121 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 952/1930] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:38 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1280 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:38.346545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2c0767b-cd51-4a59-98c7-855615dd2fff tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:38.348073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a2c0767b-cd51-4a59-98c7-855615dd2fff tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:38.360510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2c0767b-cd51-4a59-98c7-855615dd2fff tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:38.361124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2c0767b-cd51-4a59-98c7-855615dd2fff tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:38.362545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2c0767b-cd51-4a59-98c7-855615dd2fff tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.370552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2c0767b-cd51-4a59-98c7-855615dd2fff tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:38.371802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2c0767b-cd51-4a59-98c7-855615dd2fff tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:38.374403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2c0767b-cd51-4a59-98c7-855615dd2fff tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.863301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.878675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.880579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.885574 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bca66ef8-1b89-49fb-8c98-34f22bfe2a0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 1.327478 Aug 27 05:00:38.887390 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 979/1931] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:37 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:39.057974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:39.058614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:39.078439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.078947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.083572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:39.086541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.088641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.092698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:39.151573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a2c0767b-cd51-4a59-98c7-855615dd2fff tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:39.164432 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2c0767b-cd51-4a59-98c7-855615dd2fff tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1682 microversion: 2.1 time: 0.822402 Aug 27 05:00:39.167132 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 953/1932] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:38 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1682 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:39.252407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d3c34812-3f1e-4dca-8577-6fa5f974bb90 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:39.253038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d3c34812-3f1e-4dca-8577-6fa5f974bb90 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:39.293636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c34812-3f1e-4dca-8577-6fa5f974bb90 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.300754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c34812-3f1e-4dca-8577-6fa5f974bb90 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.301564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c34812-3f1e-4dca-8577-6fa5f974bb90 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:39.302495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c34812-3f1e-4dca-8577-6fa5f974bb90 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.303222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c34812-3f1e-4dca-8577-6fa5f974bb90 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.303803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c34812-3f1e-4dca-8577-6fa5f974bb90 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:39.608618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d3c34812-3f1e-4dca-8577-6fa5f974bb90 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:39.624994 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d3c34812-3f1e-4dca-8577-6fa5f974bb90 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1280 microversion: 2.1 time: 0.383875 Aug 27 05:00:39.626660 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 954/1933] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:39 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1280 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:39.681789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:39.701932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:39.705228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:39.706477 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f0508b5-1518-4161-8773-93d75eb52d06 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.654685 Aug 27 05:00:39.711640 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 980/1934] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:39 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:39.913047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:39.914192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:39.932421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.936044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.936637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:39.937802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.938287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.938720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.185825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ec3274ae-d6d2-4dd1-96bb-548accbd033f tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:40.186817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ec3274ae-d6d2-4dd1-96bb-548accbd033f tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:40.194338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3274ae-d6d2-4dd1-96bb-548accbd033f tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:40.197657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3274ae-d6d2-4dd1-96bb-548accbd033f tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:40.199227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3274ae-d6d2-4dd1-96bb-548accbd033f tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.201148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3274ae-d6d2-4dd1-96bb-548accbd033f tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:40.202167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3274ae-d6d2-4dd1-96bb-548accbd033f tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:40.204127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3274ae-d6d2-4dd1-96bb-548accbd033f tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.323363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:40.344419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:40.345985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:40.352772 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7c146db-32fa-4a5d-ae25-36f5b93723b2 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.441864 Aug 27 05:00:40.353442 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 955/1935] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:39 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:40.465977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ec3274ae-d6d2-4dd1-96bb-548accbd033f tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:40.477924 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ec3274ae-d6d2-4dd1-96bb-548accbd033f tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1682 microversion: 2.1 time: 0.295925 Aug 27 05:00:40.481587 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 981/1936] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:40 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1682 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:40.646131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0356eb14-4abd-4f03-a63e-dd291544bb4c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:40.647991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0356eb14-4abd-4f03-a63e-dd291544bb4c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:40.670334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0356eb14-4abd-4f03-a63e-dd291544bb4c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:40.673915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0356eb14-4abd-4f03-a63e-dd291544bb4c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:40.675869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0356eb14-4abd-4f03-a63e-dd291544bb4c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.676809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0356eb14-4abd-4f03-a63e-dd291544bb4c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:40.680173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0356eb14-4abd-4f03-a63e-dd291544bb4c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:40.682354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0356eb14-4abd-4f03-a63e-dd291544bb4c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.737574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:40.738461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:40.752253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:40.752993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:40.755724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.758118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:40.758871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:40.761710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.878142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0356eb14-4abd-4f03-a63e-dd291544bb4c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:40.894343 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0356eb14-4abd-4f03-a63e-dd291544bb4c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1280 microversion: 2.1 time: 0.252810 Aug 27 05:00:40.895341 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 956/1937] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:40 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1280 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:41.211849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:41.222420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:41.230939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:41.232397 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cf8c9158-59b2-4d7b-92b4-a188d098595f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.500733 Aug 27 05:00:41.251963 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 982/1938] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:40 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:41.378137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:41.378939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:41.405197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.410021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.412419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.413192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.413668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.414104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.501903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-62832681-5747-4583-adaf-0e6d823ab7cb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:41.502947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-62832681-5747-4583-adaf-0e6d823ab7cb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:41.526727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62832681-5747-4583-adaf-0e6d823ab7cb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.529245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62832681-5747-4583-adaf-0e6d823ab7cb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.535443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62832681-5747-4583-adaf-0e6d823ab7cb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.536217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62832681-5747-4583-adaf-0e6d823ab7cb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.536693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62832681-5747-4583-adaf-0e6d823ab7cb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.537130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62832681-5747-4583-adaf-0e6d823ab7cb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.865429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:41.890829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:41.895991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:41.897455 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14a46f31-b754-4a48-bfc3-f3627ad16f85 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.523882 Aug 27 05:00:41.898943 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 957/1939] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:41 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:41.917926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b6b275ea-f6c8-4b31-8962-93ee511d49b3 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:41.918551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b6b275ea-f6c8-4b31-8962-93ee511d49b3 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:41.943746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b275ea-f6c8-4b31-8962-93ee511d49b3 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.944261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b275ea-f6c8-4b31-8962-93ee511d49b3 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.944703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b275ea-f6c8-4b31-8962-93ee511d49b3 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.945442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b275ea-f6c8-4b31-8962-93ee511d49b3 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.945897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b275ea-f6c8-4b31-8962-93ee511d49b3 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.946353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b275ea-f6c8-4b31-8962-93ee511d49b3 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.966159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:42.198305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6b275ea-f6c8-4b31-8962-93ee511d49b3 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:42.201180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-62832681-5747-4583-adaf-0e6d823ab7cb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:42.212657 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b6b275ea-f6c8-4b31-8962-93ee511d49b3 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1280 microversion: 2.1 time: 0.300531 Aug 27 05:00:42.215015 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 958/1940] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:41 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1280 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:42.235145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-dc3c1f9c-37d6-4685-9e77-fed7a930554d req-6d8c2a05-a1c4-438a-90e6-8697f6a8fce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd4a82a-8c52-4d07-8009-16cb1268e380", "name": "network-vif-unplugged", "status": "completed", "tag": "1e9e24a3-3955-4a83-97cb-a0d969604b5a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:42.240042 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-62832681-5747-4583-adaf-0e6d823ab7cb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1682 microversion: 2.1 time: 0.740860 Aug 27 05:00:42.242776 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 983/1941] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:41 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1682 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:42.263784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-0a929218-e0b8-4e45-9659-1f5e3522a1c1 req-d98eef2c-e31f-479f-bea7-fb23bd64dd37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d93cb9-3f13-452d-8309-c6e3918db383", "name": "network-vif-unplugged", "status": "completed", "tag": "c932029b-b0e9-4e5a-8cfb-cae6a4379bad"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:42.275752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-dc3c1f9c-37d6-4685-9e77-fed7a930554d req-6d8c2a05-a1c4-438a-90e6-8697f6a8fce9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.280399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-dc3c1f9c-37d6-4685-9e77-fed7a930554d req-6d8c2a05-a1c4-438a-90e6-8697f6a8fce9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.281819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-dc3c1f9c-37d6-4685-9e77-fed7a930554d req-6d8c2a05-a1c4-438a-90e6-8697f6a8fce9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.301145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0a929218-e0b8-4e45-9659-1f5e3522a1c1 req-d98eef2c-e31f-479f-bea7-fb23bd64dd37 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.302728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0a929218-e0b8-4e45-9659-1f5e3522a1c1 req-d98eef2c-e31f-479f-bea7-fb23bd64dd37 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.304582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0a929218-e0b8-4e45-9659-1f5e3522a1c1 req-d98eef2c-e31f-479f-bea7-fb23bd64dd37 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.307180 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-dc3c1f9c-37d6-4685-9e77-fed7a930554d req-6d8c2a05-a1c4-438a-90e6-8697f6a8fce9 service nova] Creating event network-vif-unplugged:1e9e24a3-3955-4a83-97cb-a0d969604b5a for instance ccd4a82a-8c52-4d07-8009-16cb1268e380 on n-h2-820368-35 Aug 27 05:00:42.323999 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-dc3c1f9c-37d6-4685-9e77-fed7a930554d req-6d8c2a05-a1c4-438a-90e6-8697f6a8fce9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102829 Aug 27 05:00:42.339965 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 959/1942] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:42.352660 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-0a929218-e0b8-4e45-9659-1f5e3522a1c1 req-d98eef2c-e31f-479f-bea7-fb23bd64dd37 service nova] Creating event network-vif-unplugged:c932029b-b0e9-4e5a-8cfb-cae6a4379bad for instance 13d93cb9-3f13-452d-8309-c6e3918db383 on n-h1-820368-35 Aug 27 05:00:42.358332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:42.359055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:42.370569 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-0a929218-e0b8-4e45-9659-1f5e3522a1c1 req-d98eef2c-e31f-479f-bea7-fb23bd64dd37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122234 Aug 27 05:00:42.375808 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 984/1943] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:00:42.381349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.387762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.392232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.395766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.399253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.399764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.851601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:42.866773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:42.873036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:42.875859 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6344ddb8-5f3f-4c7e-bbac-d6374bc68d4c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.534341 Aug 27 05:00:42.878431 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 960/1944] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:42 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:42.948950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:42.949661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:42.959666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.970980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.971639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.972523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.972998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.973428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:43.238842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a41890bb-c879-43a5-8960-443c3d2aff46 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:43.239970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a41890bb-c879-43a5-8960-443c3d2aff46 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:43.250922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a41890bb-c879-43a5-8960-443c3d2aff46 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:43.252950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a41890bb-c879-43a5-8960-443c3d2aff46 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:43.253944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a41890bb-c879-43a5-8960-443c3d2aff46 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:43.255386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a41890bb-c879-43a5-8960-443c3d2aff46 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:43.258242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a41890bb-c879-43a5-8960-443c3d2aff46 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:43.261120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a41890bb-c879-43a5-8960-443c3d2aff46 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:43.360735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:43.374127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:43.376686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:43.380083 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c5ecb23-6f15-4bce-952d-3d1d72f4c691 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.450584 Aug 27 05:00:43.382386 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 985/1945] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:42 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:43.395556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3716230b-cd56-46ad-aeb6-0157a28a41c0 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:43.402949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3716230b-cd56-46ad-aeb6-0157a28a41c0 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:43.413075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a41890bb-c879-43a5-8960-443c3d2aff46 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:43.415548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3716230b-cd56-46ad-aeb6-0157a28a41c0 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:43.416196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3716230b-cd56-46ad-aeb6-0157a28a41c0 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:43.416796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3716230b-cd56-46ad-aeb6-0157a28a41c0 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:43.417678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3716230b-cd56-46ad-aeb6-0157a28a41c0 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:43.418277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3716230b-cd56-46ad-aeb6-0157a28a41c0 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:43.418846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3716230b-cd56-46ad-aeb6-0157a28a41c0 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:43.425649 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a41890bb-c879-43a5-8960-443c3d2aff46 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1280 microversion: 2.1 time: 0.192454 Aug 27 05:00:43.429354 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 961/1946] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:43 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:43.670540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3716230b-cd56-46ad-aeb6-0157a28a41c0 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:43.681750 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3716230b-cd56-46ad-aeb6-0157a28a41c0 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1615 microversion: 2.1 time: 0.294291 Aug 27 05:00:43.682790 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 986/1947] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:43 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1615 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:43.907840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:43.909795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:43.930579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:43.932522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:43.938971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:43.940607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:43.942373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:43.945242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:44.408128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:44.408753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:44.417502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:44.418350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:44.418451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:44.419456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:44.419910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:44.420336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:44.743498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:44.753760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:44.755256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:44.763822 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba9e0ed8-ebee-4a15-8135-df2dfdcaf064 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.859082 Aug 27 05:00:44.784847 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 962/1948] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:43 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:44.819349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9f880881-82b4-4b28-8a65-a4a69facd23b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:44.823869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9f880881-82b4-4b28-8a65-a4a69facd23b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:44.830116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:44.833678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f880881-82b4-4b28-8a65-a4a69facd23b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:44.834805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f880881-82b4-4b28-8a65-a4a69facd23b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:44.835580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f880881-82b4-4b28-8a65-a4a69facd23b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:44.836811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f880881-82b4-4b28-8a65-a4a69facd23b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:44.839392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f880881-82b4-4b28-8a65-a4a69facd23b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:44.842058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f880881-82b4-4b28-8a65-a4a69facd23b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:44.845418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:44.847433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:44.852832 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ad31a0d-c08b-4a92-82b8-962bb0e284ca tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.447729 Aug 27 05:00:44.854335 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 987/1949] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:44 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:44.870685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-9fa6dd4b-c956-4f05-963f-718c227e6efe req-090ea332-e9be-4a4f-bf6e-32fc02f025e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd4a82a-8c52-4d07-8009-16cb1268e380", "tag": "1e9e24a3-3955-4a83-97cb-a0d969604b5a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:44.896152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9fa6dd4b-c956-4f05-963f-718c227e6efe req-090ea332-e9be-4a4f-bf6e-32fc02f025e6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:44.896834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9fa6dd4b-c956-4f05-963f-718c227e6efe req-090ea332-e9be-4a4f-bf6e-32fc02f025e6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:44.897374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9fa6dd4b-c956-4f05-963f-718c227e6efe req-090ea332-e9be-4a4f-bf6e-32fc02f025e6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:44.952782 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-9fa6dd4b-c956-4f05-963f-718c227e6efe req-090ea332-e9be-4a4f-bf6e-32fc02f025e6 service nova] Creating event network-changed:1e9e24a3-3955-4a83-97cb-a0d969604b5a for instance ccd4a82a-8c52-4d07-8009-16cb1268e380 on n-h2-820368-35 Aug 27 05:00:44.960300 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-9fa6dd4b-c956-4f05-963f-718c227e6efe req-090ea332-e9be-4a4f-bf6e-32fc02f025e6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103136 Aug 27 05:00:44.961978 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 988/1950] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:44.978614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-05f16d76-66cb-4058-b98d-067480200766 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:44.979882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-05f16d76-66cb-4058-b98d-067480200766 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:44.988270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05f16d76-66cb-4058-b98d-067480200766 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:44.989020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05f16d76-66cb-4058-b98d-067480200766 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:44.989862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05f16d76-66cb-4058-b98d-067480200766 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:44.990806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05f16d76-66cb-4058-b98d-067480200766 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:44.991569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05f16d76-66cb-4058-b98d-067480200766 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:44.992513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05f16d76-66cb-4058-b98d-067480200766 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:45.174360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:45.337892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-05f16d76-66cb-4058-b98d-067480200766 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:45.359550 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-05f16d76-66cb-4058-b98d-067480200766 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1615 microversion: 2.1 time: 0.375608 Aug 27 05:00:45.374824 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 989/1951] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:44 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1615 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:45.599540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:45.796537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:45.797264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:45.823875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:45.824500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:45.824957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:45.826542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:45.831835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:45.832396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:46.450794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9f880881-82b4-4b28-8a65-a4a69facd23b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:46.475163 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9f880881-82b4-4b28-8a65-a4a69facd23b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1322 microversion: 2.1 time: 1.684932 Aug 27 05:00:46.476381 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 963/1952] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:44 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1322 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:46.506296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:46.507687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:46.523757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:46.524255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:46.525258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:46.536070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:46.537953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:46.540673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:46.760499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:46.776411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:46.781452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:46.782833 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0927401e-43a1-4787-81ac-1208d95ca0e3 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.995165 Aug 27 05:00:46.804636 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 990/1953] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:45 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:46.825100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:46.825964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:46.839013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:46.839207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:46.844977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:46.846990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:46.848998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:46.849708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:46.950572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:46.951081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:46.951553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:46.952013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lazy-loading 'fault' on Instance uuid 13d93cb9-3f13-452d-8309-c6e3918db383 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:00:47.276123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16fabfbcd5b4a7182b18918a1e3e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e778c9967549f5b7641c2b8df74302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:47.285746 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a8812a24-6068-4d3c-b0e0-26c318e45a01 tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 200 len: 1332 microversion: 2.1 time: 0.479580 Aug 27 05:00:47.286343 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 991/1954] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:46 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 1332 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:47.340336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:47.358811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:47.364926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:47.368109 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8d5519a-2cdc-4c7b-b5f5-9945617a8520 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.884592 Aug 27 05:00:47.369829 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 964/1955] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:46 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:47.516232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-99a4b4c4-e217-481f-8145-f48f5d535742 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:47.517073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-99a4b4c4-e217-481f-8145-f48f5d535742 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:47.535412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99a4b4c4-e217-481f-8145-f48f5d535742 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:47.536993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99a4b4c4-e217-481f-8145-f48f5d535742 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:47.542682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99a4b4c4-e217-481f-8145-f48f5d535742 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:47.545727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99a4b4c4-e217-481f-8145-f48f5d535742 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:47.550719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99a4b4c4-e217-481f-8145-f48f5d535742 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:47.553833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99a4b4c4-e217-481f-8145-f48f5d535742 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:47.636354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c71ee364-f211-44c1-8955-da068057463c req-ced1019f-804a-4f1a-8919-52c9065b5384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d93cb9-3f13-452d-8309-c6e3918db383", "name": "network-vif-deleted", "tag": "c932029b-b0e9-4e5a-8cfb-cae6a4379bad"}, {"name": "network-changed", "server_uuid": "2014233b-011e-4437-afd0-68fbecdb4158", "tag": "a670b863-8ae2-4980-a727-da85dced66a8"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:47.655829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:47.695735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c71ee364-f211-44c1-8955-da068057463c req-ced1019f-804a-4f1a-8919-52c9065b5384 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:47.705729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c71ee364-f211-44c1-8955-da068057463c req-ced1019f-804a-4f1a-8919-52c9065b5384 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:47.708381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c71ee364-f211-44c1-8955-da068057463c req-ced1019f-804a-4f1a-8919-52c9065b5384 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:47.773038 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c71ee364-f211-44c1-8955-da068057463c req-ced1019f-804a-4f1a-8919-52c9065b5384 service nova] Creating event network-vif-deleted:c932029b-b0e9-4e5a-8cfb-cae6a4379bad for instance 13d93cb9-3f13-452d-8309-c6e3918db383 on n-h1-820368-35 Aug 27 05:00:47.776868 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c71ee364-f211-44c1-8955-da068057463c req-ced1019f-804a-4f1a-8919-52c9065b5384 service nova] Creating event network-changed:a670b863-8ae2-4980-a727-da85dced66a8 for instance 2014233b-011e-4437-afd0-68fbecdb4158 on n-h2-820368-35 Aug 27 05:00:47.815665 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c71ee364-f211-44c1-8955-da068057463c req-ced1019f-804a-4f1a-8919-52c9065b5384 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.184262 Aug 27 05:00:47.819576 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 965/1956] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 05:00:47.848573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:47.852295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:47.870995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:47.872111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:47.872727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:47.873661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:47.875288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:47.876054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:48.733973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-99a4b4c4-e217-481f-8145-f48f5d535742 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:48.736851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:48.754892 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-99a4b4c4-e217-481f-8145-f48f5d535742 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1322 microversion: 2.1 time: 1.251253 Aug 27 05:00:48.772808 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 992/1957] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:47 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1322 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:48.789967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:48.798113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] [instance: 13d93cb9-3f13-452d-8309-c6e3918db383] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:48.810983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:48.813318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:48.814497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:48.816066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:48.818624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:48.819365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:48.881651 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] HTTP exception thrown: Instance 13d93cb9-3f13-452d-8309-c6e3918db383 could not be found. Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Request method failure captured: Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 HTTP/1.1 Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaQOmpUwe74D5fD23IwQ7dqGCkCAF-rlu0xwBYGs1RMleVbRNWDIGRAgkvmBBH1frEwAqK1yiW7PiEwfZHvuEoc-BRdc64-2cueQ6QZXZv6-pQq8AAGSTdLRCcIOevTrQAEN5RRwLEFJ6FH7hsGfVurdNx2Ryq_bOCb0kE_KmOiHYlE Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 24e778c9967549f5b7641c2b8df74302 Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesAdminNegativeTest-944776771 Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_24e778c9967549f5b7641c2b8df74302", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/24e778c9967549f5b7641c2b8df74302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24e778c9967549f5b7641c2b8df74302"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24e778c9967549f5b7641c2b8df74302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesAdminNegativeTest-944776771 Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 24e778c9967549f5b7641c2b8df74302 Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-944776771 Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesAdminNegativeTest-944776771-project Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: d16fabfbcd5b4a7182b18918a1e3e3e7 Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesAdminNegativeTest-944776771-project Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 13d93cb9-3f13-452d-8309-c6e3918db383 could not be found. Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '13d93cb9-3f13-452d-8309-c6e3918db383'} Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13d93cb9-3f13-452d-8309-c6e3918db383 could not be found. Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13d93cb9-3f13-452d-8309-c6e3918db383 could not be found. Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:48.891020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:48.895989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:48.895989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:48.895989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:48.895989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:00:48.895989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:00:48.895989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13d93cb9-3f13-452d-8309-c6e3918db383 could not be found. Aug 27 05:00:48.895989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:00:48.895989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Returning 404 to user: Instance 13d93cb9-3f13-452d-8309-c6e3918db383 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:00:48.900180 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5343bc65-1bcc-40a9-aa72-c756d025b0cc tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383" status: 404 len: 111 microversion: 2.1 time: 0.122136 Aug 27 05:00:48.901250 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 993/1958] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:48 2022] GET /compute/v2.1/servers/13d93cb9-3f13-452d-8309-c6e3918db383 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:00:48.917412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:48.926701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:48.930694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:48.943510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:48.952234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:48.954220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:48.955559 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d7200a3-5092-421d-a298-4b398cd9ca88 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 1.129751 Aug 27 05:00:48.958205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:48.970928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:48.979352 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 966/1959] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:47 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:48.983076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:48.985718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:48.990416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a311330c-b5ed-43d3-aa59-cbc94dfbdacb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] Calling method '.version_select at 0x7fb5655da820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:48.991303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:49.056077 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a311330c-b5ed-43d3-aa59-cbc94dfbdacb tempest-VolumesAdminNegativeTest-944776771 tempest-VolumesAdminNegativeTest-944776771-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550944591" status: 202 len: 0 microversion: 2.1 time: 0.073987 Aug 27 05:00:49.057576 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 967/1960] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 05:00:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550944591 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:00:49.720649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:49.730144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:49.739299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:49.741202 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eb6b74e8-5fde-47c2-8415-2d78db3a50f4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.838156 Aug 27 05:00:49.753308 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 994/1961] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:48 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:49.787103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e82c80a8-d1e8-4346-a179-b3a7c9171a33 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:49.787758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e82c80a8-d1e8-4346-a179-b3a7c9171a33 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:49.806413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82c80a8-d1e8-4346-a179-b3a7c9171a33 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:49.807187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82c80a8-d1e8-4346-a179-b3a7c9171a33 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:49.807841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82c80a8-d1e8-4346-a179-b3a7c9171a33 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:49.808836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82c80a8-d1e8-4346-a179-b3a7c9171a33 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:49.809486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82c80a8-d1e8-4346-a179-b3a7c9171a33 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:49.810122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82c80a8-d1e8-4346-a179-b3a7c9171a33 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:49.988443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:49.989638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:50.013840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:50.014605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:50.016394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:50.017343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:50.018008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:50.019999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:50.083080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e82c80a8-d1e8-4346-a179-b3a7c9171a33 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:50.092257 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e82c80a8-d1e8-4346-a179-b3a7c9171a33 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1322 microversion: 2.1 time: 0.312158 Aug 27 05:00:50.098197 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 968/1962] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:49 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:50.423895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:50.439349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:50.440939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:50.443923 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3fde7050-b6fe-42a0-8675-ba2b26ec2228 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.458662 Aug 27 05:00:50.472599 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 995/1963] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:49 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:50.792489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:50.793419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:50.822685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:50.823285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:50.824087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:50.825757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:50.829786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:50.830320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:51.155064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4c627dfe-c09c-4079-8be7-0e0b23389e5d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:51.155968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4c627dfe-c09c-4079-8be7-0e0b23389e5d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:51.190471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c627dfe-c09c-4079-8be7-0e0b23389e5d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:51.199948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c627dfe-c09c-4079-8be7-0e0b23389e5d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:51.200686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c627dfe-c09c-4079-8be7-0e0b23389e5d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:51.201607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c627dfe-c09c-4079-8be7-0e0b23389e5d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:51.204951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c627dfe-c09c-4079-8be7-0e0b23389e5d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:51.205646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c627dfe-c09c-4079-8be7-0e0b23389e5d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:51.469671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:51.497396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:51.505551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:51.507484 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-10755bec-4523-46f6-a3c0-4735aafd7f02 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.733054 Aug 27 05:00:51.509356 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 969/1964] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:50 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:51.523068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:51.523973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:51.542118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:51.542865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:51.543486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:51.549064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:51.550053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:51.551417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:52.665215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4c627dfe-c09c-4079-8be7-0e0b23389e5d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:52.681830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4c627dfe-c09c-4079-8be7-0e0b23389e5d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1322 microversion: 2.1 time: 1.560828 Aug 27 05:00:52.682458 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 996/1965] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:51 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1322 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:52.714666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:52.716067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:52.733880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:52.742431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:52.744911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:52.745902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:52.748416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:52.749320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:53.060243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:53.075445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:53.083977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:53.086000 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d48d1f5c-1dea-4069-bc1a-9c32bd61a583 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.382364 Aug 27 05:00:53.092889 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 997/1966] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:52 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:53.133159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:53.159834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:53.161404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:53.169777 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5c335e0-0292-4255-8c2f-21f600e6c6e9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 1.656599 Aug 27 05:00:53.170391 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 970/1967] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:51 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:53.702203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78220600-56aa-4bc9-9288-c768b4567e04 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:53.703499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-78220600-56aa-4bc9-9288-c768b4567e04 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:53.718488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78220600-56aa-4bc9-9288-c768b4567e04 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:53.719456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78220600-56aa-4bc9-9288-c768b4567e04 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:53.720082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78220600-56aa-4bc9-9288-c768b4567e04 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:53.722311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78220600-56aa-4bc9-9288-c768b4567e04 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:53.722948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78220600-56aa-4bc9-9288-c768b4567e04 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:53.726010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78220600-56aa-4bc9-9288-c768b4567e04 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:54.012043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-78220600-56aa-4bc9-9288-c768b4567e04 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:54.038841 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-78220600-56aa-4bc9-9288-c768b4567e04 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1322 microversion: 2.1 time: 0.339151 Aug 27 05:00:54.041305 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 998/1968] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:53 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:54.130657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:54.130657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:54.151201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:54.152372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:54.152984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:54.157334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:54.158003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:54.158451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:54.204531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:54.205063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:54.216865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:54.217368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:54.217812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:54.222753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:54.223276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:54.223715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:54.873141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:54.881885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:54.883361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:54.891564 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-89049f25-aa97-47c5-9ca5-0143dd12271c tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.775941 Aug 27 05:00:54.892782 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 971/1969] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:54 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:54.897468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:54.909463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:54.910932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:54.912128 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-37af88e3-6b09-4c2e-9737-379a6c8e680f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.712325 Aug 27 05:00:54.912674 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 999/1970] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:54 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:55.062216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7c1261ae-40c3-48a8-acd7-73c1018d0bad tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:55.062737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7c1261ae-40c3-48a8-acd7-73c1018d0bad tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:55.073706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c1261ae-40c3-48a8-acd7-73c1018d0bad tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:55.078381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c1261ae-40c3-48a8-acd7-73c1018d0bad tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:55.078980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c1261ae-40c3-48a8-acd7-73c1018d0bad tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:55.079851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c1261ae-40c3-48a8-acd7-73c1018d0bad tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:55.086654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c1261ae-40c3-48a8-acd7-73c1018d0bad tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:55.087371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c1261ae-40c3-48a8-acd7-73c1018d0bad tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:55.658037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7c1261ae-40c3-48a8-acd7-73c1018d0bad tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:55.663122 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7c1261ae-40c3-48a8-acd7-73c1018d0bad tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1322 microversion: 2.1 time: 0.604850 Aug 27 05:00:55.681565 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 972/1971] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:55 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:55.916057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:55.916684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:55.930288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:55.930987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:55.931395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:55.932135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:55.932599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:55.933026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:55.944533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:55.944952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:55.957251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:55.957745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:55.963075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:55.964673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:55.966151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:55.966751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:56.657633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:56.676332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:56.678192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:56.679750 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-02a5c787-ccd4-4104-a4c6-98f668a43a5a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.768260 Aug 27 05:00:56.680840 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1000/1972] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:55 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:56.701547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b95d60c1-1f7e-492a-af0b-d1328db52fb7 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:56.706025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b95d60c1-1f7e-492a-af0b-d1328db52fb7 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:56.725114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b95d60c1-1f7e-492a-af0b-d1328db52fb7 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:56.725813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b95d60c1-1f7e-492a-af0b-d1328db52fb7 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:56.726382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b95d60c1-1f7e-492a-af0b-d1328db52fb7 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:56.727281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b95d60c1-1f7e-492a-af0b-d1328db52fb7 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:56.730363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b95d60c1-1f7e-492a-af0b-d1328db52fb7 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:56.730954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b95d60c1-1f7e-492a-af0b-d1328db52fb7 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:57.092989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:57.122633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:57.134753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:57.136570 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ca0d4dc-7dee-4528-87b9-046c2ac19bb8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 1.199890 Aug 27 05:00:57.145159 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 973/1973] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:55 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:57.228941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b95d60c1-1f7e-492a-af0b-d1328db52fb7 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:57.258084 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b95d60c1-1f7e-492a-af0b-d1328db52fb7 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1322 microversion: 2.1 time: 0.564378 Aug 27 05:00:57.261493 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1001/1974] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:56 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1322 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:57.712899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:57.713526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:57.724664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:57.725173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:57.725620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:57.726347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:57.726806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:57.727273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:58.166828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:58.176926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:58.177760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:58.186688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:58.188185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:58.189381 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f491ed88-717a-4848-ae61-78ba258f0621 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1485 microversion: 2.25 time: 0.481889 Aug 27 05:00:58.189939 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 974/1975] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:57 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1485 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:58.198699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:58.204937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:58.206233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:58.208128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:58.209775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:58.210254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:58.210693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:58.279902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-51fd7d0a-8fb2-4b66-96a7-4edc8da864a1 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:58.280519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-51fd7d0a-8fb2-4b66-96a7-4edc8da864a1 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:58.289888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fd7d0a-8fb2-4b66-96a7-4edc8da864a1 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:58.294698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fd7d0a-8fb2-4b66-96a7-4edc8da864a1 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:58.296372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fd7d0a-8fb2-4b66-96a7-4edc8da864a1 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:58.299117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fd7d0a-8fb2-4b66-96a7-4edc8da864a1 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:58.300227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fd7d0a-8fb2-4b66-96a7-4edc8da864a1 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:58.300227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fd7d0a-8fb2-4b66-96a7-4edc8da864a1 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:59.542030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:59.546093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-51fd7d0a-8fb2-4b66-96a7-4edc8da864a1 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:59.571367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:59.572956 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-51fd7d0a-8fb2-4b66-96a7-4edc8da864a1 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1322 microversion: 2.1 time: 1.295641 Aug 27 05:00:59.574777 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 975/1976] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:58 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1322 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:59.576732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:59.578376 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b50708d5-1164-47ac-9dee-b99de28a3d8e tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 1.405663 Aug 27 05:00:59.579414 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1002/1977] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:58 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:59.581698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1236333853", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "00de91a4-56de-4dd2-b930-888a9f762ad7"}], "block_device_mapping_v2": [{"uuid": "ed17ba49-4812-4cd0-8ad7-103006d0768f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:59.585325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:59.585999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:59.602725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:59.603371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:59.603879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:59.605003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:59.605769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:59.606382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:59.712239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] validate_networks() for [('00de91a4-56de-4dd2-b930-888a9f762ad7', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:01:00.585212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:00.595906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:00.600522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:00.604427 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-59ade029-dc9f-4ed6-8414-2c2e3960133d tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1475 microversion: 2.25 time: 1.024015 Aug 27 05:01:00.612180 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1003/1978] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:59 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1475 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:00.617049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2ab3acd9-55ed-4e2f-b939-39a615b1f59b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:00.618016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2ab3acd9-55ed-4e2f-b939-39a615b1f59b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:00.631562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab3acd9-55ed-4e2f-b939-39a615b1f59b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:00.636318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab3acd9-55ed-4e2f-b939-39a615b1f59b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:00.637070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab3acd9-55ed-4e2f-b939-39a615b1f59b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:00.638063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab3acd9-55ed-4e2f-b939-39a615b1f59b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:00.638751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab3acd9-55ed-4e2f-b939-39a615b1f59b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:00.639421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ab3acd9-55ed-4e2f-b939-39a615b1f59b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.279885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2ab3acd9-55ed-4e2f-b939-39a615b1f59b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:01.295730 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2ab3acd9-55ed-4e2f-b939-39a615b1f59b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1322 microversion: 2.1 time: 0.682214 Aug 27 05:01:01.297050 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1004/1979] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:00 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:01.302599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:01.303519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:01.311851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.313111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.313782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.328814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.329828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.331028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.336706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:01:01.338418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:01:01.338906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:01:01.339338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:01:01.340106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:01:01.355941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.360583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.361435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.362373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.362980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.363595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.409483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Getting quotas for project dd2736d36f16463c81a760e69e48fd28. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:01:01.420124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Getting quotas for user 17c08abee58846229f9255f8d86f762a and project dd2736d36f16463c81a760e69e48fd28. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:01:01.495713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:01:01.498147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed17ba49-4812-4cd0-8ad7-103006d0768f',volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:01:01.754684 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf03459b-6c0e-48f0-88ce-a7d6d28bd1e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.178208 Aug 27 05:01:01.755379 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 976/1980] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:01:01.768522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:01.779055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dfd311e2-b073-4af8-8ca3-659a24bef7d2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '.version_select at 0x7fb565540160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:01.782555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:01.792287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:01.793605 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-86371b23-8620-46aa-9451-a695ec0c1e63 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.495264 Aug 27 05:01:01.794878 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1005/1981] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:01 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:01.796016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfd311e2-b073-4af8-8ca3-659a24bef7d2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.798482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfd311e2-b073-4af8-8ca3-659a24bef7d2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.799121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfd311e2-b073-4af8-8ca3-659a24bef7d2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.800414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-23ac7dd4-62cd-41db-bf66-149bc4529331 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:01.806597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-23ac7dd4-62cd-41db-bf66-149bc4529331 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:01.832503 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dfd311e2-b073-4af8-8ca3-659a24bef7d2 tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2984 microversion: 2.25 time: 0.071470 Aug 27 05:01:01.833148 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 977/1982] 10.222.0.58 () {60 vars in 1184 bytes} [Sat Aug 27 05:01:01 2022] GET /compute/v2.1/os-migrations => generated 2984 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:01.850265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c399c3ea-ff75-4e38-86fd-70e6d588914b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:01.851319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c399c3ea-ff75-4e38-86fd-70e6d588914b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:01.876264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c399c3ea-ff75-4e38-86fd-70e6d588914b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.876791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c399c3ea-ff75-4e38-86fd-70e6d588914b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.881219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c399c3ea-ff75-4e38-86fd-70e6d588914b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.882133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c399c3ea-ff75-4e38-86fd-70e6d588914b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.882622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c399c3ea-ff75-4e38-86fd-70e6d588914b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.885493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c399c3ea-ff75-4e38-86fd-70e6d588914b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.949319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:02.259560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-23ac7dd4-62cd-41db-bf66-149bc4529331 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:02.269835 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-23ac7dd4-62cd-41db-bf66-149bc4529331 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1053 microversion: 2.1 time: 0.471443 Aug 27 05:01:02.271271 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1006/1983] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:01 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1053 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:02.318952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b02174fc-8035-44cd-a505-13af30082465 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:02.319614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b02174fc-8035-44cd-a505-13af30082465 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:02.365486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b02174fc-8035-44cd-a505-13af30082465 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.371478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b02174fc-8035-44cd-a505-13af30082465 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.375074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b02174fc-8035-44cd-a505-13af30082465 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.375922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b02174fc-8035-44cd-a505-13af30082465 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.376572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b02174fc-8035-44cd-a505-13af30082465 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.377429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b02174fc-8035-44cd-a505-13af30082465 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.765428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-c399c3ea-ff75-4e38-86fd-70e6d588914b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] Lazy-loading 'services' on Instance uuid ccd4a82a-8c52-4d07-8009-16cb1268e380 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:01:02.803406 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c399c3ea-ff75-4e38-86fd-70e6d588914b tempest-LiveAutoBlockMigrationV225Test-238994938 tempest-LiveAutoBlockMigrationV225Test-238994938-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1968 microversion: 2.25 time: 0.958423 Aug 27 05:01:02.815500 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 978/1984] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:01 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1968 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:02.825367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-795cf411-9dbe-4b8f-a62f-4a4db4a3c653 req-0945a5c7-968a-403f-8fb8-7c6db1b71016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2014233b-011e-4437-afd0-68fbecdb4158", "name": "network-vif-plugged", "status": "completed", "tag": "a670b863-8ae2-4980-a727-da85dced66a8"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:02.855614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-795cf411-9dbe-4b8f-a62f-4a4db4a3c653 req-0945a5c7-968a-403f-8fb8-7c6db1b71016 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.856547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-795cf411-9dbe-4b8f-a62f-4a4db4a3c653 req-0945a5c7-968a-403f-8fb8-7c6db1b71016 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.857719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-795cf411-9dbe-4b8f-a62f-4a4db4a3c653 req-0945a5c7-968a-403f-8fb8-7c6db1b71016 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.877029 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-795cf411-9dbe-4b8f-a62f-4a4db4a3c653 req-0945a5c7-968a-403f-8fb8-7c6db1b71016 service nova] Creating event network-vif-plugged:a670b863-8ae2-4980-a727-da85dced66a8 for instance 2014233b-011e-4437-afd0-68fbecdb4158 on n-h2-820368-35 Aug 27 05:01:02.882450 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-795cf411-9dbe-4b8f-a62f-4a4db4a3c653 req-0945a5c7-968a-403f-8fb8-7c6db1b71016 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065406 Aug 27 05:01:02.883649 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 979/1985] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:02.890596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:02.891602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:02.900542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.901249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.901863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.902783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.903413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.903982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.927320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b02174fc-8035-44cd-a505-13af30082465 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:02.950745 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b02174fc-8035-44cd-a505-13af30082465 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1322 microversion: 2.1 time: 0.635958 Aug 27 05:01:02.951845 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1007/1986] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:02 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1322 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:02.963877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dfa9dfa2-04bf-4ef6-bcac-40de51d0c106 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:02.964734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dfa9dfa2-04bf-4ef6-bcac-40de51d0c106 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:02.974358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfa9dfa2-04bf-4ef6-bcac-40de51d0c106 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.975209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfa9dfa2-04bf-4ef6-bcac-40de51d0c106 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.975860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfa9dfa2-04bf-4ef6-bcac-40de51d0c106 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.976781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfa9dfa2-04bf-4ef6-bcac-40de51d0c106 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.978233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfa9dfa2-04bf-4ef6-bcac-40de51d0c106 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.979691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfa9dfa2-04bf-4ef6-bcac-40de51d0c106 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:03.102125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dfa9dfa2-04bf-4ef6-bcac-40de51d0c106 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:01:03.298184 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dfa9dfa2-04bf-4ef6-bcac-40de51d0c106 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 204 len: 0 microversion: 2.25 time: 0.343564 Aug 27 05:01:03.301712 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1008/1987] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:01:02 2022] DELETE /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:01:03.307473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-15e764ff-925b-48d9-a091-ef82c5d5ed3d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:03.308813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-15e764ff-925b-48d9-a091-ef82c5d5ed3d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:03.316457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15e764ff-925b-48d9-a091-ef82c5d5ed3d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:03.317189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15e764ff-925b-48d9-a091-ef82c5d5ed3d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:03.319308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15e764ff-925b-48d9-a091-ef82c5d5ed3d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:03.319308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15e764ff-925b-48d9-a091-ef82c5d5ed3d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:03.319308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15e764ff-925b-48d9-a091-ef82c5d5ed3d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:03.319748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15e764ff-925b-48d9-a091-ef82c5d5ed3d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:03.350916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:03.515037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.530559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.532135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.533357 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8bbedf38-456e-44c2-8b89-89e4f78b32b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.647745 Aug 27 05:01:03.533931 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 980/1988] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:02 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:03.551954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15e764ff-925b-48d9-a091-ef82c5d5ed3d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.563739 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-15e764ff-925b-48d9-a091-ef82c5d5ed3d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1151 microversion: 2.1 time: 0.262907 Aug 27 05:01:03.564024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:03.564792 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1009/1989] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:03 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1151 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:03.570149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:03.585385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:03.587080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:03.587689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:03.590255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:03.590804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:03.591344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:03.960243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.973760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d1239784-8b12-4e3d-b002-2f2307b256fd tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:03.974902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d1239784-8b12-4e3d-b002-2f2307b256fd tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:03.988581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.990744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1239784-8b12-4e3d-b002-2f2307b256fd tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:03.995541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.996453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1239784-8b12-4e3d-b002-2f2307b256fd tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:03.997064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1239784-8b12-4e3d-b002-2f2307b256fd tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:04.001084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1239784-8b12-4e3d-b002-2f2307b256fd tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:04.002668 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d9b2fb10-96c3-4693-b578-4479c38cde8e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1481 microversion: 2.25 time: 0.442452 Aug 27 05:01:04.003530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1239784-8b12-4e3d-b002-2f2307b256fd tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:04.004293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1239784-8b12-4e3d-b002-2f2307b256fd tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:04.007371 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 981/1990] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:03 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1481 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:04.492528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d1239784-8b12-4e3d-b002-2f2307b256fd tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:04.518358 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d1239784-8b12-4e3d-b002-2f2307b256fd tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1322 microversion: 2.1 time: 0.545298 Aug 27 05:01:04.519831 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1010/1991] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:03 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1322 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:04.561500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:04.561999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:04.576233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:04.585938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4dad728a-83f8-45f1-afbf-8a3bbf1d80e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:04.586669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4dad728a-83f8-45f1-afbf-8a3bbf1d80e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:04.592119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:04.595334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:04.601726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:04.602325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:04.603041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:04.607511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dad728a-83f8-45f1-afbf-8a3bbf1d80e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:04.610900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dad728a-83f8-45f1-afbf-8a3bbf1d80e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:04.611392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dad728a-83f8-45f1-afbf-8a3bbf1d80e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:04.612149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dad728a-83f8-45f1-afbf-8a3bbf1d80e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:04.615975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dad728a-83f8-45f1-afbf-8a3bbf1d80e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:04.618036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dad728a-83f8-45f1-afbf-8a3bbf1d80e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:05.450525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4dad728a-83f8-45f1-afbf-8a3bbf1d80e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:05.521424 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4dad728a-83f8-45f1-afbf-8a3bbf1d80e4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1169 microversion: 2.1 time: 0.940124 Aug 27 05:01:05.522029 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1011/1992] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:04 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1169 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:05.532303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:05.532866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:05.564404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:05.564930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:05.565430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:05.566369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:05.566841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:05.567307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.057255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.091917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.097583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.104377 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fc016a4a-8db3-49e8-af68-f328e0aa5b37 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 1.546865 Aug 27 05:01:06.120133 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 982/1993] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:04 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:06.125321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3f9b7d2a-948e-4fc8-bbb9-3aab09e43acc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:06.125936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3f9b7d2a-948e-4fc8-bbb9-3aab09e43acc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:06.156689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f9b7d2a-948e-4fc8-bbb9-3aab09e43acc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.157405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f9b7d2a-948e-4fc8-bbb9-3aab09e43acc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.158008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f9b7d2a-948e-4fc8-bbb9-3aab09e43acc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.158895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f9b7d2a-948e-4fc8-bbb9-3aab09e43acc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.160224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f9b7d2a-948e-4fc8-bbb9-3aab09e43acc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.161033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f9b7d2a-948e-4fc8-bbb9-3aab09e43acc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.209895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.240182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.244804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.248065 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-91cb7dae-5721-4719-82e5-09d40a175f95 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1481 microversion: 2.25 time: 0.724327 Aug 27 05:01:06.251832 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1012/1994] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:05 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1481 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:06.267458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-ee2022ef-8e87-465f-8327-7770ff4c3aa5 req-cde841d4-a9eb-4578-bee8-cc1266303f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd4a82a-8c52-4d07-8009-16cb1268e380", "name": "network-vif-deleted", "tag": "1e9e24a3-3955-4a83-97cb-a0d969604b5a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:06.300244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ee2022ef-8e87-465f-8327-7770ff4c3aa5 req-cde841d4-a9eb-4578-bee8-cc1266303f44 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.301074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ee2022ef-8e87-465f-8327-7770ff4c3aa5 req-cde841d4-a9eb-4578-bee8-cc1266303f44 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.301755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ee2022ef-8e87-465f-8327-7770ff4c3aa5 req-cde841d4-a9eb-4578-bee8-cc1266303f44 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.334296 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-ee2022ef-8e87-465f-8327-7770ff4c3aa5 req-cde841d4-a9eb-4578-bee8-cc1266303f44 service nova] Creating event network-vif-deleted:1e9e24a3-3955-4a83-97cb-a0d969604b5a for instance ccd4a82a-8c52-4d07-8009-16cb1268e380 on n-h1-820368-35 Aug 27 05:01:06.341533 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-ee2022ef-8e87-465f-8327-7770ff4c3aa5 req-cde841d4-a9eb-4578-bee8-cc1266303f44 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088021 Aug 27 05:01:06.344877 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1013/1995] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:06.544325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c31d13b4-4244-47e6-bc0b-d9f5a32270a3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:06.545046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c31d13b4-4244-47e6-bc0b-d9f5a32270a3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:06.562914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c31d13b4-4244-47e6-bc0b-d9f5a32270a3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.563479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c31d13b4-4244-47e6-bc0b-d9f5a32270a3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.563925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c31d13b4-4244-47e6-bc0b-d9f5a32270a3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.571866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c31d13b4-4244-47e6-bc0b-d9f5a32270a3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.572778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c31d13b4-4244-47e6-bc0b-d9f5a32270a3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.575465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c31d13b4-4244-47e6-bc0b-d9f5a32270a3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.880057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c31d13b4-4244-47e6-bc0b-d9f5a32270a3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.891906 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c31d13b4-4244-47e6-bc0b-d9f5a32270a3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1169 microversion: 2.1 time: 0.353560 Aug 27 05:01:06.895005 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1014/1996] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:06 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1169 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:07.128166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:07.128793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:07.138988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.139515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.140130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.141584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.142200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.142782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.208476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f9b7d2a-948e-4fc8-bbb9-3aab09e43acc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:07.217857 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3f9b7d2a-948e-4fc8-bbb9-3aab09e43acc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1472 microversion: 2.1 time: 1.096522 Aug 27 05:01:07.218450 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 983/1997] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:06 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1472 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:07.618739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cca92590-04c6-4f01-b876-744734456318 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:07.619718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cca92590-04c6-4f01-b876-744734456318 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] [instance: 65cdadc2-8e99-45bd-b627-130397f87616] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:07.627950 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-cca92590-04c6-4f01-b876-744734456318 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] HTTP exception thrown: Instance 65cdadc2-8e99-45bd-b627-130397f87616 could not be found. Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cca92590-04c6-4f01-b876-744734456318 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Request method failure captured: Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/65cdadc2-8e99-45bd-b627-130397f87616/action HTTP/1.1 Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 15 Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaTxBIF_fnnjRS6bsglfCEUGrXA3rn-5QNGOYEk2wJbW58r3qFDkXPQg2Sh8aiovvv799Wt-CuaLBfS9uMY7N_4fJgqFDvzj3YojQGxJRe9o-rFAz60WC5mllMSmXG7ewzZ0x_fPbUP3cLZyFpqYbsbgiIPBWBCkpZSpOIofCDSw4Zs Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 01b6d449222c46fcab1f1ec41081cb88 Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_01b6d449222c46fcab1f1ec41081cb88", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 01b6d449222c46fcab1f1ec41081cb88 Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersAdminNegativeTestJSON-1227236306-project-admin Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 2dbf6f16a78d476684fa4b09af692043 Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1227236306-project-admin Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: {"migrate": {}} Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 65cdadc2-8e99-45bd-b627-130397f87616 could not be found. Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '65cdadc2-8e99-45bd-b627-130397f87616', 'body': {'migrate': {}}} Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65cdadc2-8e99-45bd-b627-130397f87616 could not be found. Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65cdadc2-8e99-45bd-b627-130397f87616 could not be found. Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:07.637823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:07.643519 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:07.643519 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:07.643519 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:07.643519 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:07.643519 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65cdadc2-8e99-45bd-b627-130397f87616 could not be found. Aug 27 05:01:07.643519 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:07.643519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cca92590-04c6-4f01-b876-744734456318 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Returning 404 to user: Instance 65cdadc2-8e99-45bd-b627-130397f87616 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:07.646331 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cca92590-04c6-4f01-b876-744734456318 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/65cdadc2-8e99-45bd-b627-130397f87616/action" status: 404 len: 111 microversion: 2.1 time: 0.401991 Aug 27 05:01:07.656931 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 984/1998] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:01:07 2022] POST /compute/v2.1/servers/65cdadc2-8e99-45bd-b627-130397f87616/action => generated 111 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:01:07.667874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:07.668508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:07.716719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.717561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.721620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.722691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.730976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.733366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.755163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:07.765628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:07.767450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:07.768789 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6d5e4d26-bea5-4984-971f-0dddc6c98b5b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.645153 Aug 27 05:01:07.769539 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1015/1999] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:07 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:07.787301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-678979050", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:07.866258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:01:07.970054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:07.979780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:07.981568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:07.982968 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-05de5c94-2c14-48e2-98da-21e8e480aa67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1264 microversion: 2.25 time: 0.322401 Aug 27 05:01:08.005111 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 985/2000] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:07 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1264 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:08.012436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c874d1c6-3328-4df6-9c4a-fe10f52a718f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:08.013357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c874d1c6-3328-4df6-9c4a-fe10f52a718f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:08.019703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c874d1c6-3328-4df6-9c4a-fe10f52a718f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:08.020501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c874d1c6-3328-4df6-9c4a-fe10f52a718f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:08.021150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c874d1c6-3328-4df6-9c4a-fe10f52a718f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.022074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c874d1c6-3328-4df6-9c4a-fe10f52a718f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:08.022736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c874d1c6-3328-4df6-9c4a-fe10f52a718f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:08.023393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c874d1c6-3328-4df6-9c4a-fe10f52a718f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.480803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c874d1c6-3328-4df6-9c4a-fe10f52a718f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:08.497005 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c874d1c6-3328-4df6-9c4a-fe10f52a718f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1211 microversion: 2.1 time: 0.490234 Aug 27 05:01:08.501220 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 986/2001] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:08 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1211 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:08.659546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:01:08.659981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:01:08.664423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:01:08.665678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:01:08.667499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:01:08.704384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:08.705110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:08.705742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.706678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:08.707353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:08.707996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.745727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Getting quotas for project 6fd7543ea6e54136897717d844333ff2. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:01:08.759502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Getting quotas for user dd34049995f544aa9a540062dedae56c and project 6fd7543ea6e54136897717d844333ff2. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:01:08.777277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9abf5dd0-1662-4a2b-a687-1ffb60e79bc2 req-429e468f-19d2-4ca7-b7e1-c9707a55ccee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-plugged", "status": "completed", "tag": "9ee1e1d7-0d6d-4cbb-b872-87f8a3941c0d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:08.795263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:01:08.798166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:01:08.806090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9abf5dd0-1662-4a2b-a687-1ffb60e79bc2 req-429e468f-19d2-4ca7-b7e1-c9707a55ccee service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:08.806946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9abf5dd0-1662-4a2b-a687-1ffb60e79bc2 req-429e468f-19d2-4ca7-b7e1-c9707a55ccee service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:08.807570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9abf5dd0-1662-4a2b-a687-1ffb60e79bc2 req-429e468f-19d2-4ca7-b7e1-c9707a55ccee service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.840537 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9abf5dd0-1662-4a2b-a687-1ffb60e79bc2 req-429e468f-19d2-4ca7-b7e1-c9707a55ccee service nova] Creating event network-vif-plugged:9ee1e1d7-0d6d-4cbb-b872-87f8a3941c0d for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:01:08.856906 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9abf5dd0-1662-4a2b-a687-1ffb60e79bc2 req-429e468f-19d2-4ca7-b7e1-c9707a55ccee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087540 Aug 27 05:01:08.865377 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 987/2002] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:01:08.885421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:08.886444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:08.893187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:08.893951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:08.894617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.895561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:08.896209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:08.896828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.947632 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-de7d4222-37f2-45ad-b192-bdca75da71e4 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160315 Aug 27 05:01:08.954363 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1016/2003] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:01:08.967768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5885494-b564-4ff1-a35e-dbd5847fcf66 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:08.970010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f5885494-b564-4ff1-a35e-dbd5847fcf66 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:09.117361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f5885494-b564-4ff1-a35e-dbd5847fcf66 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.126488 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5885494-b564-4ff1-a35e-dbd5847fcf66 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1221 microversion: 2.1 time: 0.170894 Aug 27 05:01:09.131863 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1017/2004] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:08 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1221 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:09.164850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:09.168109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:09.194388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:09.194885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:09.195358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:09.199830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:09.200370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:09.201377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:09.427848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.441717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.445266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.449328 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-106d8685-5ede-42d7-8057-6347cdef5997 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1264 microversion: 2.25 time: 0.298300 Aug 27 05:01:09.450089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.450935 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1018/2005] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:09 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1264 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:09.478775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.482909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.484159 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cc51a7d3-2a43-4db0-b984-c454cdaee093 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.616544 Aug 27 05:01:09.484731 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 988/2006] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:08 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:09.521784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-121548fe-6b13-426c-acc0-a2ce2c61eb04 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:09.522702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-121548fe-6b13-426c-acc0-a2ce2c61eb04 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:09.541152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-121548fe-6b13-426c-acc0-a2ce2c61eb04 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:09.542903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-121548fe-6b13-426c-acc0-a2ce2c61eb04 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:09.543862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-121548fe-6b13-426c-acc0-a2ce2c61eb04 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:09.546218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-121548fe-6b13-426c-acc0-a2ce2c61eb04 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:09.547687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-121548fe-6b13-426c-acc0-a2ce2c61eb04 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:09.549552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-121548fe-6b13-426c-acc0-a2ce2c61eb04 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:09.792073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-121548fe-6b13-426c-acc0-a2ce2c61eb04 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.810457 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-121548fe-6b13-426c-acc0-a2ce2c61eb04 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1211 microversion: 2.1 time: 0.292951 Aug 27 05:01:09.815868 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1019/2007] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:09 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1211 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:10.161966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a1f8833b-ef95-42df-9aaf-0444ae9044cc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:10.163861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a1f8833b-ef95-42df-9aaf-0444ae9044cc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:10.196258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f8833b-ef95-42df-9aaf-0444ae9044cc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.198948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f8833b-ef95-42df-9aaf-0444ae9044cc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.199723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f8833b-ef95-42df-9aaf-0444ae9044cc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.200370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f8833b-ef95-42df-9aaf-0444ae9044cc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.200841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f8833b-ef95-42df-9aaf-0444ae9044cc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.204449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1f8833b-ef95-42df-9aaf-0444ae9044cc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.385630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a1f8833b-ef95-42df-9aaf-0444ae9044cc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:10.397337 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a1f8833b-ef95-42df-9aaf-0444ae9044cc tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1217 microversion: 2.1 time: 0.247976 Aug 27 05:01:10.430737 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 989/2008] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:10 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:10.475323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:10.476565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:10.497423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.500473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.504432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.510566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.512846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:10.514394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.514548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:10.519364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.548327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.551409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.553391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.561240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.561741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.565713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.845156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:10.854402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:10.863505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:10.870014 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-febc15bc-f75c-48ed-80d1-def38efcc675 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1264 microversion: 2.25 time: 0.398817 Aug 27 05:01:10.870897 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1020/2009] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:10 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1264 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:10.889488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-48c75622-9271-456d-a765-54b22ab21d75 req-e542aff5-e888-49d1-98b6-e7f18eab9c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25cb7fa-29c6-4d28-bd24-ecff7105f488", "tag": "940ba38f-dc68-41bd-b54d-beed96d7c9f6"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:10.903409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-48c75622-9271-456d-a765-54b22ab21d75 req-e542aff5-e888-49d1-98b6-e7f18eab9c4a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.911136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-48c75622-9271-456d-a765-54b22ab21d75 req-e542aff5-e888-49d1-98b6-e7f18eab9c4a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.912534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-48c75622-9271-456d-a765-54b22ab21d75 req-e542aff5-e888-49d1-98b6-e7f18eab9c4a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.938299 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-48c75622-9271-456d-a765-54b22ab21d75 req-e542aff5-e888-49d1-98b6-e7f18eab9c4a service nova] Creating event network-changed:940ba38f-dc68-41bd-b54d-beed96d7c9f6 for instance d25cb7fa-29c6-4d28-bd24-ecff7105f488 on n-h2-820368-35 Aug 27 05:01:10.954212 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-48c75622-9271-456d-a765-54b22ab21d75 req-e542aff5-e888-49d1-98b6-e7f18eab9c4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081856 Aug 27 05:01:10.958087 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1021/2010] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:10.971871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c0b9c7d-9fd5-4eb0-8149-aa578f7629ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:10.973027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c0b9c7d-9fd5-4eb0-8149-aa578f7629ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:11.003769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0b9c7d-9fd5-4eb0-8149-aa578f7629ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.004533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0b9c7d-9fd5-4eb0-8149-aa578f7629ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.005165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0b9c7d-9fd5-4eb0-8149-aa578f7629ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.006603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0b9c7d-9fd5-4eb0-8149-aa578f7629ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.008123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0b9c7d-9fd5-4eb0-8149-aa578f7629ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.009158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0b9c7d-9fd5-4eb0-8149-aa578f7629ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.383283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:11.408878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.435442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.437320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.440402 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2ef83a46-7597-47dd-8631-063d51958d48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.934514 Aug 27 05:01:11.446616 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 990/2011] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:10 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:11.451638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5d1be704-f34f-4b74-ae20-edac6812e371 req-f4ab2de1-2b3a-4213-a38f-0565a4915620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-plugged", "status": "completed", "tag": "a3e1f4af-7721-488e-9bc6-44bc8d5333b2"}, {"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-plugged", "status": "completed", "tag": "8ee889f7-e538-4a59-8fc2-12d001a2065d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:11.477387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:11.496970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5d1be704-f34f-4b74-ae20-edac6812e371 req-f4ab2de1-2b3a-4213-a38f-0565a4915620 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.497554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5d1be704-f34f-4b74-ae20-edac6812e371 req-f4ab2de1-2b3a-4213-a38f-0565a4915620 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.498142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5d1be704-f34f-4b74-ae20-edac6812e371 req-f4ab2de1-2b3a-4213-a38f-0565a4915620 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.527251 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5d1be704-f34f-4b74-ae20-edac6812e371 req-f4ab2de1-2b3a-4213-a38f-0565a4915620 service nova] Creating event network-vif-plugged:a3e1f4af-7721-488e-9bc6-44bc8d5333b2 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:01:11.527872 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5d1be704-f34f-4b74-ae20-edac6812e371 req-f4ab2de1-2b3a-4213-a38f-0565a4915620 service nova] Creating event network-vif-plugged:8ee889f7-e538-4a59-8fc2-12d001a2065d for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:01:11.541923 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5d1be704-f34f-4b74-ae20-edac6812e371 req-f4ab2de1-2b3a-4213-a38f-0565a4915620 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093395 Aug 27 05:01:11.544427 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 991/2012] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:11.561355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9286eeab-92f4-410a-a5fa-f1bffa80b131 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:11.565355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9286eeab-92f4-410a-a5fa-f1bffa80b131 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:11.578743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9286eeab-92f4-410a-a5fa-f1bffa80b131 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.583933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9286eeab-92f4-410a-a5fa-f1bffa80b131 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.584657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9286eeab-92f4-410a-a5fa-f1bffa80b131 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.593196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9286eeab-92f4-410a-a5fa-f1bffa80b131 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.593724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9286eeab-92f4-410a-a5fa-f1bffa80b131 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.594173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9286eeab-92f4-410a-a5fa-f1bffa80b131 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.813904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c0b9c7d-9fd5-4eb0-8149-aa578f7629ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.826926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c0b9c7d-9fd5-4eb0-8149-aa578f7629ed tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1211 microversion: 2.1 time: 0.866370 Aug 27 05:01:11.828020 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1022/2013] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:10 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1211 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:11.855889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9286eeab-92f4-410a-a5fa-f1bffa80b131 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.870275 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9286eeab-92f4-410a-a5fa-f1bffa80b131 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1291 microversion: 2.1 time: 0.323039 Aug 27 05:01:11.873436 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 992/2014] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:11 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1291 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:11.894694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:11.895341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:11.923580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.924180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.924632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.925374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.925830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.926256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.464572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:12.471784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:12.472783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:12.479326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:12.481009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:12.482182 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-788eed84-08f8-42c6-b3ce-307a1206fb4e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1264 microversion: 2.25 time: 0.591256 Aug 27 05:01:12.483060 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1023/2015] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:11 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1264 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:12.486541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.487067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.487546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.488284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.488740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.492768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.848261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fa42d8c0-397c-42b8-a052-271b6d4d929c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:12.849094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fa42d8c0-397c-42b8-a052-271b6d4d929c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:12.856761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa42d8c0-397c-42b8-a052-271b6d4d929c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.857244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa42d8c0-397c-42b8-a052-271b6d4d929c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.857676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa42d8c0-397c-42b8-a052-271b6d4d929c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.858375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa42d8c0-397c-42b8-a052-271b6d4d929c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.858936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa42d8c0-397c-42b8-a052-271b6d4d929c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.859383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa42d8c0-397c-42b8-a052-271b6d4d929c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:13.009323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.020990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.023209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.025536 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6997d425-3a39-4bbc-aa70-8c54f432ffb6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.559447 Aug 27 05:01:13.042361 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 993/2016] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:12 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:13.045966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2d41b858-7e0d-415f-914f-4b625071a1c0 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:13.046967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2d41b858-7e0d-415f-914f-4b625071a1c0 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:13.061317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d41b858-7e0d-415f-914f-4b625071a1c0 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:13.063826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d41b858-7e0d-415f-914f-4b625071a1c0 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:13.066703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d41b858-7e0d-415f-914f-4b625071a1c0 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:13.067688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d41b858-7e0d-415f-914f-4b625071a1c0 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:13.070018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d41b858-7e0d-415f-914f-4b625071a1c0 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:13.070877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d41b858-7e0d-415f-914f-4b625071a1c0 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:13.267172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2d41b858-7e0d-415f-914f-4b625071a1c0 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.280276 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2d41b858-7e0d-415f-914f-4b625071a1c0 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1279 microversion: 2.1 time: 0.247642 Aug 27 05:01:13.283982 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 994/2017] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:13 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:13.391320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fa42d8c0-397c-42b8-a052-271b6d4d929c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.400070 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fa42d8c0-397c-42b8-a052-271b6d4d929c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1211 microversion: 2.1 time: 0.554919 Aug 27 05:01:13.404741 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1024/2018] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:12 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1211 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:13.505493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:13.506111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:13.513279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:13.513775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:13.514221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:13.514941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:13.515472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:13.515853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:13.648720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f21d9010-2003-4804-8189-834774d04876 req-6ddb71d6-baeb-42d3-a8ca-1e218f5b99ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-plugged", "status": "completed", "tag": "67c91f3b-28ff-46ab-b299-4183c0d6b2c2"}, {"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-plugged", "status": "completed", "tag": "67b4bbaf-e037-4c0b-af94-cb28ae1b24f7"}, {"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-plugged", "status": "completed", "tag": "90a04fac-d169-4ae0-8392-e8d76b298cce"}, {"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-plugged", "status": "completed", "tag": "923d4ac2-c734-4a1c-a214-b065712f9202"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:13.651584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.660052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.669271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.670534 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f04cab3-b3ac-42f1-b1e6-8ac2ce2e4bbd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1264 microversion: 2.25 time: 0.168908 Aug 27 05:01:13.671648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f21d9010-2003-4804-8189-834774d04876 req-6ddb71d6-baeb-42d3-a8ca-1e218f5b99ab service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:13.672292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f21d9010-2003-4804-8189-834774d04876 req-6ddb71d6-baeb-42d3-a8ca-1e218f5b99ab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:13.672894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f21d9010-2003-4804-8189-834774d04876 req-6ddb71d6-baeb-42d3-a8ca-1e218f5b99ab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:13.678453 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 995/2019] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:13 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:13.706154 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f21d9010-2003-4804-8189-834774d04876 req-6ddb71d6-baeb-42d3-a8ca-1e218f5b99ab service nova] Creating event network-vif-plugged:67c91f3b-28ff-46ab-b299-4183c0d6b2c2 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:01:13.706909 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f21d9010-2003-4804-8189-834774d04876 req-6ddb71d6-baeb-42d3-a8ca-1e218f5b99ab service nova] Creating event network-vif-plugged:67b4bbaf-e037-4c0b-af94-cb28ae1b24f7 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:01:13.707577 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f21d9010-2003-4804-8189-834774d04876 req-6ddb71d6-baeb-42d3-a8ca-1e218f5b99ab service nova] Creating event network-vif-plugged:90a04fac-d169-4ae0-8392-e8d76b298cce for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:01:13.708266 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f21d9010-2003-4804-8189-834774d04876 req-6ddb71d6-baeb-42d3-a8ca-1e218f5b99ab service nova] Creating event network-vif-plugged:923d4ac2-c734-4a1c-a214-b065712f9202 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:01:13.717442 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f21d9010-2003-4804-8189-834774d04876 req-6ddb71d6-baeb-42d3-a8ca-1e218f5b99ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.096436 Aug 27 05:01:13.720671 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1025/2020] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:14.053882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:14.054501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:14.065253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.067941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.069632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.070810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.071983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.073245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.302832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.308896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-df0de455-9129-4929-8d6a-42e24764918e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:14.309647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-df0de455-9129-4929-8d6a-42e24764918e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:14.314103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.315878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.317307 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a657201-de14-47b0-92e1-89fa5283e29b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.267337 Aug 27 05:01:14.318138 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 996/2021] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:14 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:14.340821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df0de455-9129-4929-8d6a-42e24764918e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.341435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df0de455-9129-4929-8d6a-42e24764918e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.342238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df0de455-9129-4929-8d6a-42e24764918e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.343726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df0de455-9129-4929-8d6a-42e24764918e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.344187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df0de455-9129-4929-8d6a-42e24764918e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.344654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df0de455-9129-4929-8d6a-42e24764918e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.419410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-df0de455-9129-4929-8d6a-42e24764918e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.424152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-75ddbecf-ffcc-4b86-8841-b0911c51db08 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:14.424774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-75ddbecf-ffcc-4b86-8841-b0911c51db08 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:14.427799 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-df0de455-9129-4929-8d6a-42e24764918e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1279 microversion: 2.1 time: 0.125714 Aug 27 05:01:14.428483 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1026/2022] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:14 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1279 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:14.431198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75ddbecf-ffcc-4b86-8841-b0911c51db08 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.431948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75ddbecf-ffcc-4b86-8841-b0911c51db08 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.432617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75ddbecf-ffcc-4b86-8841-b0911c51db08 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.433542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75ddbecf-ffcc-4b86-8841-b0911c51db08 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.434203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75ddbecf-ffcc-4b86-8841-b0911c51db08 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.434838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75ddbecf-ffcc-4b86-8841-b0911c51db08 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.669160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-75ddbecf-ffcc-4b86-8841-b0911c51db08 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.677391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:14.694486 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-75ddbecf-ffcc-4b86-8841-b0911c51db08 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1211 microversion: 2.1 time: 0.273934 Aug 27 05:01:14.695887 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 997/2023] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:14 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1211 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:14.699804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:14.700624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:14.710931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.711467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.712473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.713205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.713668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.714102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.866880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.878697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.880732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.883140 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f8d040d0-9554-4dd7-854a-c9aa8999abd4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1264 microversion: 2.25 time: 0.186311 Aug 27 05:01:14.884761 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1027/2024] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:14 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:15.350574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:15.351273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:15.366079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.367012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.367701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.380844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.383186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.384496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.450710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-107c0ce8-e945-422f-9d4d-085e95e90b7c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:15.451421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-107c0ce8-e945-422f-9d4d-085e95e90b7c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:15.465771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-107c0ce8-e945-422f-9d4d-085e95e90b7c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.466268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-107c0ce8-e945-422f-9d4d-085e95e90b7c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.466710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-107c0ce8-e945-422f-9d4d-085e95e90b7c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.467451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-107c0ce8-e945-422f-9d4d-085e95e90b7c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.467906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-107c0ce8-e945-422f-9d4d-085e95e90b7c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.476296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-107c0ce8-e945-422f-9d4d-085e95e90b7c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.821965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:15.826464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-107c0ce8-e945-422f-9d4d-085e95e90b7c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:15.834800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:15.837767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:15.838178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-107c0ce8-e945-422f-9d4d-085e95e90b7c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1321 microversion: 2.1 time: 0.392717 Aug 27 05:01:15.839592 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6866b91e-2e39-4ffb-baca-b6513764ceac tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1879 microversion: 2.42 time: 0.493015 Aug 27 05:01:15.841578 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1028/2025] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:15 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:15.853302 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 998/2026] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:15 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1879 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:15.861095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-32d31ba8-c5a6-49f0-bfc5-22de267800e6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:15.863579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-32d31ba8-c5a6-49f0-bfc5-22de267800e6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:15.879194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32d31ba8-c5a6-49f0-bfc5-22de267800e6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.879860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32d31ba8-c5a6-49f0-bfc5-22de267800e6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.881125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32d31ba8-c5a6-49f0-bfc5-22de267800e6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.883036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32d31ba8-c5a6-49f0-bfc5-22de267800e6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.885062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32d31ba8-c5a6-49f0-bfc5-22de267800e6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.885792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32d31ba8-c5a6-49f0-bfc5-22de267800e6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.907939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:15.908611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:15.927118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.928980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.929826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.932171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.932906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.934602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:16.110288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:16.128756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:16.130277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:16.131559 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ae6d5b68-31b6-44b5-9425-3b9361bf2902 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1264 microversion: 2.25 time: 0.228587 Aug 27 05:01:16.143270 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 999/2027] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:15 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:16.319667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-32d31ba8-c5a6-49f0-bfc5-22de267800e6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:16.323057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:16.333941 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-32d31ba8-c5a6-49f0-bfc5-22de267800e6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1211 microversion: 2.1 time: 0.490910 Aug 27 05:01:16.340243 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1029/2028] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:15 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1211 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:16.490043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-28d7e608-21e8-452b-887c-fdb457c971bd req-afaabcf7-6a67-4213-8a18-6c8603fb0aeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4292482-017f-412f-bcbe-4884b556aa5b", "tag": "b2dc516c-713d-481e-96a0-a5df3dc90e8d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:16.502178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-28d7e608-21e8-452b-887c-fdb457c971bd req-afaabcf7-6a67-4213-8a18-6c8603fb0aeb service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:16.502667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-28d7e608-21e8-452b-887c-fdb457c971bd req-afaabcf7-6a67-4213-8a18-6c8603fb0aeb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:16.503133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-28d7e608-21e8-452b-887c-fdb457c971bd req-afaabcf7-6a67-4213-8a18-6c8603fb0aeb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:16.545468 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-28d7e608-21e8-452b-887c-fdb457c971bd req-afaabcf7-6a67-4213-8a18-6c8603fb0aeb service nova] Creating event network-changed:b2dc516c-713d-481e-96a0-a5df3dc90e8d for instance d4292482-017f-412f-bcbe-4884b556aa5b on n-h1-820368-35 Aug 27 05:01:16.569685 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-28d7e608-21e8-452b-887c-fdb457c971bd req-afaabcf7-6a67-4213-8a18-6c8603fb0aeb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079687 Aug 27 05:01:16.575508 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1000/2029] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:16.867542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:16.867956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17f1e021-6b94-4387-a705-30d61268682e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:16.869673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:16.870144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-17f1e021-6b94-4387-a705-30d61268682e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:16.890372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:16.892313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f1e021-6b94-4387-a705-30d61268682e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:16.892923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:16.893539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f1e021-6b94-4387-a705-30d61268682e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:16.894101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:16.894639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f1e021-6b94-4387-a705-30d61268682e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:16.895604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:16.896550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f1e021-6b94-4387-a705-30d61268682e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:16.897231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:16.898195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f1e021-6b94-4387-a705-30d61268682e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:16.898867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f1e021-6b94-4387-a705-30d61268682e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:16.899444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.441591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-17f1e021-6b94-4387-a705-30d61268682e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.451922 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-17f1e021-6b94-4387-a705-30d61268682e tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1321 microversion: 2.1 time: 0.594618 Aug 27 05:01:17.458600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.463062 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1030/2030] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:16 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:17.475725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:17.476408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:17.483342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.485161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.488857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.489540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.489980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.490700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.491173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.491398 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68d6220b-99c8-4323-a7a7-109331fff06f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2837 microversion: 2.42 time: 0.628624 Aug 27 05:01:17.492711 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1001/2031] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:16 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2837 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:17.507156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-85ed54d7-8e15-477b-84cf-cbf8ee8f586f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:17.508047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-85ed54d7-8e15-477b-84cf-cbf8ee8f586f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:17.519780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85ed54d7-8e15-477b-84cf-cbf8ee8f586f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.520467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85ed54d7-8e15-477b-84cf-cbf8ee8f586f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.524982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85ed54d7-8e15-477b-84cf-cbf8ee8f586f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.525998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85ed54d7-8e15-477b-84cf-cbf8ee8f586f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.526327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.526946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85ed54d7-8e15-477b-84cf-cbf8ee8f586f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.527570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85ed54d7-8e15-477b-84cf-cbf8ee8f586f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.808705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.836121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.845176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.848467 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-84a6b18e-ae84-40ed-b6cf-5248983eff1a tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 200 len: 1264 microversion: 2.25 time: 0.384273 Aug 27 05:01:17.863624 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1031/2032] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:17 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 1264 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:17.893264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1de2ea03-7426-4460-b1db-2c32bc925796 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:17.894440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1de2ea03-7426-4460-b1db-2c32bc925796 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:17.902744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1de2ea03-7426-4460-b1db-2c32bc925796 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.903677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1de2ea03-7426-4460-b1db-2c32bc925796 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.904325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1de2ea03-7426-4460-b1db-2c32bc925796 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.905222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1de2ea03-7426-4460-b1db-2c32bc925796 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.906338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1de2ea03-7426-4460-b1db-2c32bc925796 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.906998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1de2ea03-7426-4460-b1db-2c32bc925796 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:18.176266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-85ed54d7-8e15-477b-84cf-cbf8ee8f586f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:18.196118 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-85ed54d7-8e15-477b-84cf-cbf8ee8f586f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1211 microversion: 2.1 time: 0.699478 Aug 27 05:01:18.199029 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1002/2033] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:17 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1211 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:18.263586 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1de2ea03-7426-4460-b1db-2c32bc925796 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.387285 Aug 27 05:01:18.265102 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1032/2034] 10.222.0.58 () {60 vars in 1316 bytes} [Sat Aug 27 05:01:17 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8/os-interface => generated 1831 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:18.487181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dabc32fb-14a1-4179-802a-ff0e63c87213 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:18.487768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dabc32fb-14a1-4179-802a-ff0e63c87213 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:18.497136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:18.499066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dabc32fb-14a1-4179-802a-ff0e63c87213 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:18.500560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dabc32fb-14a1-4179-802a-ff0e63c87213 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:18.501031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dabc32fb-14a1-4179-802a-ff0e63c87213 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:18.501780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dabc32fb-14a1-4179-802a-ff0e63c87213 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:18.502394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dabc32fb-14a1-4179-802a-ff0e63c87213 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:18.502846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dabc32fb-14a1-4179-802a-ff0e63c87213 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:18.871588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:18.876837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:18.878450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: ccd4a82a-8c52-4d07-8009-16cb1268e380] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:18.900865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:18.907021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:18.907831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:18.909118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:18.909784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:18.910479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:18.951266 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] HTTP exception thrown: Instance ccd4a82a-8c52-4d07-8009-16cb1268e380 could not be found. Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Request method failure captured: Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 HTTP/1.1 Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaL0kD74fFlji4BayTy6rNAk62Up0r0shWNUA_hDsDid_cu5nC_4SdKXv21GckDyUIA9YsEIT6SVinK8DsWo_p2MkDLQS_iXCB4qfYrSYH8yjwbMWZedy6EwIDt4HeRjlNOHnzkB2c_JLOS9x0R4wfAzTmLvfz2MQ_oNh_7qno0UmxE Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: f5c7422cdaca490aaffc4004f77d830c Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5c7422cdaca490aaffc4004f77d830c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: f5c7422cdaca490aaffc4004f77d830c Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-LiveAutoBlockMigrationV225Test-204101716-project Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: b7d4fe4aaf864bb58c162620c9948d89 Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-204101716-project Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance ccd4a82a-8c52-4d07-8009-16cb1268e380 could not be found. Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'ccd4a82a-8c52-4d07-8009-16cb1268e380'} Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd4a82a-8c52-4d07-8009-16cb1268e380 could not be found. Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd4a82a-8c52-4d07-8009-16cb1268e380 could not be found. Aug 27 05:01:18.957174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:18.960851 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:18.960851 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:18.960851 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:18.960851 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:18.960851 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:18.960851 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:18.960851 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:18.960851 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd4a82a-8c52-4d07-8009-16cb1268e380 could not be found. Aug 27 05:01:18.960851 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:18.967044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Returning 404 to user: Instance ccd4a82a-8c52-4d07-8009-16cb1268e380 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:18.968208 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a82472d-4c36-4981-9ffc-2994157f9b21 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380" status: 404 len: 111 microversion: 2.25 time: 0.097515 Aug 27 05:01:18.969241 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1033/2035] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:18 2022] GET /compute/v2.1/servers/ccd4a82a-8c52-4d07-8009-16cb1268e380 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:01:19.221370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65e3934d-b6d8-4ad6-9f7e-d1e759d780e1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:19.221980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-65e3934d-b6d8-4ad6-9f7e-d1e759d780e1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:19.233040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=10 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:19.237542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65e3934d-b6d8-4ad6-9f7e-d1e759d780e1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:19.238440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65e3934d-b6d8-4ad6-9f7e-d1e759d780e1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:19.238953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65e3934d-b6d8-4ad6-9f7e-d1e759d780e1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:19.239971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65e3934d-b6d8-4ad6-9f7e-d1e759d780e1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:19.240498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65e3934d-b6d8-4ad6-9f7e-d1e759d780e1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:19.241323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65e3934d-b6d8-4ad6-9f7e-d1e759d780e1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:19.592501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dabc32fb-14a1-4179-802a-ff0e63c87213 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:19.601334 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dabc32fb-14a1-4179-802a-ff0e63c87213 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1321 microversion: 2.1 time: 1.117980 Aug 27 05:01:19.606902 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1003/2036] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:18 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1321 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:20.116886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-65e3934d-b6d8-4ad6-9f7e-d1e759d780e1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:20.130604 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-65e3934d-b6d8-4ad6-9f7e-d1e759d780e1 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1211 microversion: 2.1 time: 0.915534 Aug 27 05:01:20.131251 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1034/2037] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:19 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1211 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:20.628799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-39347b39-8363-4ae2-98e0-bfdb84585890 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:20.630325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-39347b39-8363-4ae2-98e0-bfdb84585890 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:20.660602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39347b39-8363-4ae2-98e0-bfdb84585890 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:20.661414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39347b39-8363-4ae2-98e0-bfdb84585890 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:20.662102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39347b39-8363-4ae2-98e0-bfdb84585890 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:20.663059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39347b39-8363-4ae2-98e0-bfdb84585890 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:20.665621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39347b39-8363-4ae2-98e0-bfdb84585890 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:20.666403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39347b39-8363-4ae2-98e0-bfdb84585890 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:21.152729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eee44e96-0edb-40bb-bb61-d7bec8beb3f9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:21.153271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eee44e96-0edb-40bb-bb61-d7bec8beb3f9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:21.162819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eee44e96-0edb-40bb-bb61-d7bec8beb3f9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:21.163340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eee44e96-0edb-40bb-bb61-d7bec8beb3f9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:21.163770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eee44e96-0edb-40bb-bb61-d7bec8beb3f9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:21.169393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eee44e96-0edb-40bb-bb61-d7bec8beb3f9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:21.170062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eee44e96-0edb-40bb-bb61-d7bec8beb3f9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:21.170812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eee44e96-0edb-40bb-bb61-d7bec8beb3f9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:21.437001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eee44e96-0edb-40bb-bb61-d7bec8beb3f9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:21.455845 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eee44e96-0edb-40bb-bb61-d7bec8beb3f9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1199 microversion: 2.1 time: 0.307820 Aug 27 05:01:21.456426 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1035/2038] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:21 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1199 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:21.534720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-39347b39-8363-4ae2-98e0-bfdb84585890 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:21.551386 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-39347b39-8363-4ae2-98e0-bfdb84585890 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1321 microversion: 2.1 time: 0.922598 Aug 27 05:01:21.553187 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1004/2039] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:20 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1321 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:22.022010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-48791eb4-e222-49cc-a4ab-d9f0317b0bf0 req-ee939fbb-b710-4d1f-b8e9-0ab6466087c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "tag": "a3e1f4af-7721-488e-9bc6-44bc8d5333b2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:22.046996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-48791eb4-e222-49cc-a4ab-d9f0317b0bf0 req-ee939fbb-b710-4d1f-b8e9-0ab6466087c9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:22.047658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-48791eb4-e222-49cc-a4ab-d9f0317b0bf0 req-ee939fbb-b710-4d1f-b8e9-0ab6466087c9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:22.048102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-48791eb4-e222-49cc-a4ab-d9f0317b0bf0 req-ee939fbb-b710-4d1f-b8e9-0ab6466087c9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:22.091991 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-48791eb4-e222-49cc-a4ab-d9f0317b0bf0 req-ee939fbb-b710-4d1f-b8e9-0ab6466087c9 service nova] Creating event network-changed:a3e1f4af-7721-488e-9bc6-44bc8d5333b2 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:01:22.123183 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-48791eb4-e222-49cc-a4ab-d9f0317b0bf0 req-ee939fbb-b710-4d1f-b8e9-0ab6466087c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104753 Aug 27 05:01:22.124532 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1036/2040] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:22.481993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d5f012e-5c0b-492e-8548-789ff92f8d68 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:22.482616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3d5f012e-5c0b-492e-8548-789ff92f8d68 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:22.500756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5f012e-5c0b-492e-8548-789ff92f8d68 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:22.507918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5f012e-5c0b-492e-8548-789ff92f8d68 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:22.508377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5f012e-5c0b-492e-8548-789ff92f8d68 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:22.514863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5f012e-5c0b-492e-8548-789ff92f8d68 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:22.516937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5f012e-5c0b-492e-8548-789ff92f8d68 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:22.517399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5f012e-5c0b-492e-8548-789ff92f8d68 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:22.576449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5257bb5f-a6aa-47a1-9874-43f082565b44 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:22.583497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5257bb5f-a6aa-47a1-9874-43f082565b44 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:22.601831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5257bb5f-a6aa-47a1-9874-43f082565b44 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:22.603977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5257bb5f-a6aa-47a1-9874-43f082565b44 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:22.605848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5257bb5f-a6aa-47a1-9874-43f082565b44 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:22.606705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5257bb5f-a6aa-47a1-9874-43f082565b44 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:22.608272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5257bb5f-a6aa-47a1-9874-43f082565b44 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:22.611529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5257bb5f-a6aa-47a1-9874-43f082565b44 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:23.072250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d5f012e-5c0b-492e-8548-789ff92f8d68 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:23.103820 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d5f012e-5c0b-492e-8548-789ff92f8d68 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1199 microversion: 2.1 time: 0.624844 Aug 27 05:01:23.107305 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1005/2041] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:22 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1199 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:23.333447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5257bb5f-a6aa-47a1-9874-43f082565b44 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:23.345517 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5257bb5f-a6aa-47a1-9874-43f082565b44 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1321 microversion: 2.1 time: 0.774076 Aug 27 05:01:23.348092 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1037/2042] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:22 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1321 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:24.132286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e981975d-c0f0-47f4-8287-aee7ba7f0cd0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:24.133548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e981975d-c0f0-47f4-8287-aee7ba7f0cd0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:24.146857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e981975d-c0f0-47f4-8287-aee7ba7f0cd0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.156116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e981975d-c0f0-47f4-8287-aee7ba7f0cd0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.156851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e981975d-c0f0-47f4-8287-aee7ba7f0cd0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.157777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e981975d-c0f0-47f4-8287-aee7ba7f0cd0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.162421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e981975d-c0f0-47f4-8287-aee7ba7f0cd0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.163060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e981975d-c0f0-47f4-8287-aee7ba7f0cd0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.371256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1e253304-d076-4cab-9218-ac1d35459fa5 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:24.372849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1e253304-d076-4cab-9218-ac1d35459fa5 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:24.404436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e253304-d076-4cab-9218-ac1d35459fa5 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.405234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e253304-d076-4cab-9218-ac1d35459fa5 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.411318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e253304-d076-4cab-9218-ac1d35459fa5 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.412337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e253304-d076-4cab-9218-ac1d35459fa5 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.412997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e253304-d076-4cab-9218-ac1d35459fa5 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.413626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e253304-d076-4cab-9218-ac1d35459fa5 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.525627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e981975d-c0f0-47f4-8287-aee7ba7f0cd0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:24.534189 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e981975d-c0f0-47f4-8287-aee7ba7f0cd0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1199 microversion: 2.1 time: 0.405736 Aug 27 05:01:24.534793 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1006/2043] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:24 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1199 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:24.815054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1e253304-d076-4cab-9218-ac1d35459fa5 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:24.827178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1e253304-d076-4cab-9218-ac1d35459fa5 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1321 microversion: 2.1 time: 0.463102 Aug 27 05:01:24.828391 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1038/2044] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:24 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:25.560857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c0dfb6f3-1532-476e-988f-231ff08f18ec tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:25.561563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c0dfb6f3-1532-476e-988f-231ff08f18ec tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:25.579671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dfb6f3-1532-476e-988f-231ff08f18ec tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:25.593118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dfb6f3-1532-476e-988f-231ff08f18ec tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:25.613550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dfb6f3-1532-476e-988f-231ff08f18ec tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:25.625414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dfb6f3-1532-476e-988f-231ff08f18ec tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:25.626959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dfb6f3-1532-476e-988f-231ff08f18ec tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:25.629610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dfb6f3-1532-476e-988f-231ff08f18ec tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:25.850290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a6eb8642-351c-41b8-930d-578710419990 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:25.850910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a6eb8642-351c-41b8-930d-578710419990 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:25.873051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6eb8642-351c-41b8-930d-578710419990 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:25.875811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6eb8642-351c-41b8-930d-578710419990 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:25.876476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6eb8642-351c-41b8-930d-578710419990 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:25.878023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6eb8642-351c-41b8-930d-578710419990 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:25.880890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6eb8642-351c-41b8-930d-578710419990 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:25.882590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6eb8642-351c-41b8-930d-578710419990 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:25.953176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c0dfb6f3-1532-476e-988f-231ff08f18ec tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:25.968034 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c0dfb6f3-1532-476e-988f-231ff08f18ec tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1199 microversion: 2.1 time: 0.411787 Aug 27 05:01:25.969311 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1007/2045] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:25 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1199 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:26.227053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a6eb8642-351c-41b8-930d-578710419990 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:26.240220 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a6eb8642-351c-41b8-930d-578710419990 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1321 microversion: 2.1 time: 0.391656 Aug 27 05:01:26.241487 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1039/2046] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:25 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:26.253064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-a69db244-d3fa-43df-9fed-71ccc15935bc req-1e5cf2c3-1948-4eec-a6a9-8b200cd6e433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4292482-017f-412f-bcbe-4884b556aa5b", "name": "network-vif-plugged", "status": "completed", "tag": "b2dc516c-713d-481e-96a0-a5df3dc90e8d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:26.289020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:26.294031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a69db244-d3fa-43df-9fed-71ccc15935bc req-1e5cf2c3-1948-4eec-a6a9-8b200cd6e433 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:26.297554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a69db244-d3fa-43df-9fed-71ccc15935bc req-1e5cf2c3-1948-4eec-a6a9-8b200cd6e433 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:26.301370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a69db244-d3fa-43df-9fed-71ccc15935bc req-1e5cf2c3-1948-4eec-a6a9-8b200cd6e433 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:26.316973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-73922918", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "364fb5e8-1451-445f-86e3-d7bd2084dd4a"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:26.344557 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-a69db244-d3fa-43df-9fed-71ccc15935bc req-1e5cf2c3-1948-4eec-a6a9-8b200cd6e433 service nova] Creating event network-vif-plugged:b2dc516c-713d-481e-96a0-a5df3dc90e8d for instance d4292482-017f-412f-bcbe-4884b556aa5b on n-h1-820368-35 Aug 27 05:01:26.356008 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-a69db244-d3fa-43df-9fed-71ccc15935bc req-1e5cf2c3-1948-4eec-a6a9-8b200cd6e433 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107889 Aug 27 05:01:26.360479 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1040/2047] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:26.432166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] validate_networks() for [('364fb5e8-1451-445f-86e3-d7bd2084dd4a', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:01:26.990359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d1da64b4-bae2-43ae-90ed-c961802bb002 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:26.990876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d1da64b4-bae2-43ae-90ed-c961802bb002 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:27.006988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1da64b4-bae2-43ae-90ed-c961802bb002 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:27.007535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1da64b4-bae2-43ae-90ed-c961802bb002 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:27.007973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1da64b4-bae2-43ae-90ed-c961802bb002 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:27.008736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1da64b4-bae2-43ae-90ed-c961802bb002 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:27.009199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1da64b4-bae2-43ae-90ed-c961802bb002 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:27.009626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1da64b4-bae2-43ae-90ed-c961802bb002 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:27.732166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d1da64b4-bae2-43ae-90ed-c961802bb002 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:27.741608 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d1da64b4-bae2-43ae-90ed-c961802bb002 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1199 microversion: 2.1 time: 0.755428 Aug 27 05:01:27.760314 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1041/2048] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:26 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1199 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:27.765600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5d00a8a7-04c2-4262-88d4-174aef539f32 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:27.766553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5d00a8a7-04c2-4262-88d4-174aef539f32 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:27.804384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:01:27.805339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:01:27.807209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:01:27.807801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:01:27.808361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:01:27.808519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d00a8a7-04c2-4262-88d4-174aef539f32 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:27.818092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d00a8a7-04c2-4262-88d4-174aef539f32 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:27.818678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d00a8a7-04c2-4262-88d4-174aef539f32 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:27.819837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d00a8a7-04c2-4262-88d4-174aef539f32 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:27.821430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d00a8a7-04c2-4262-88d4-174aef539f32 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:27.822136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d00a8a7-04c2-4262-88d4-174aef539f32 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:27.834904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:27.835427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:27.835865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:27.837339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:27.840715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:27.843447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:27.937575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Getting quotas for project d7ee77055a2a4ab19b6a5115dcbd97e7. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:01:27.955781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Getting quotas for user 89b25148fe994d42a4b0a98ccbcf4b70 and project d7ee77055a2a4ab19b6a5115dcbd97e7. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:01:28.028981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:01:28.032585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:01:28.205815 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40520d0d-3297-43b5-90b9-886805b0e450 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.176571 Aug 27 05:01:28.206495 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1008/2049] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:01:28.243655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a9f8b6b0-c7f9-4efc-a766-d30aae5cff6e tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:28.245325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a9f8b6b0-c7f9-4efc-a766-d30aae5cff6e tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:28.301272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d00a8a7-04c2-4262-88d4-174aef539f32 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:28.328404 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5d00a8a7-04c2-4262-88d4-174aef539f32 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1321 microversion: 2.1 time: 0.562544 Aug 27 05:01:28.331759 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1042/2050] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:27 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:28.419019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a9f8b6b0-c7f9-4efc-a766-d30aae5cff6e tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:28.430763 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a9f8b6b0-c7f9-4efc-a766-d30aae5cff6e tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1214 microversion: 2.1 time: 0.209985 Aug 27 05:01:28.432134 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1009/2051] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:28 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1214 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:28.794780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17c40ed4-ce64-4f6f-991b-c7dbb6c9a056 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:28.795784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-17c40ed4-ce64-4f6f-991b-c7dbb6c9a056 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:28.828977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17c40ed4-ce64-4f6f-991b-c7dbb6c9a056 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:28.829683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17c40ed4-ce64-4f6f-991b-c7dbb6c9a056 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:28.831249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17c40ed4-ce64-4f6f-991b-c7dbb6c9a056 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:28.833104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17c40ed4-ce64-4f6f-991b-c7dbb6c9a056 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:28.833739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17c40ed4-ce64-4f6f-991b-c7dbb6c9a056 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:28.835672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17c40ed4-ce64-4f6f-991b-c7dbb6c9a056 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.160998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-63b6b7ba-14ec-4adb-bd2d-a6e5bc0a8dab tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:29.161520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-63b6b7ba-14ec-4adb-bd2d-a6e5bc0a8dab tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:29.196548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63b6b7ba-14ec-4adb-bd2d-a6e5bc0a8dab tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.197054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63b6b7ba-14ec-4adb-bd2d-a6e5bc0a8dab tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.197537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63b6b7ba-14ec-4adb-bd2d-a6e5bc0a8dab tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.198210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63b6b7ba-14ec-4adb-bd2d-a6e5bc0a8dab tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.198678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63b6b7ba-14ec-4adb-bd2d-a6e5bc0a8dab tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.199156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63b6b7ba-14ec-4adb-bd2d-a6e5bc0a8dab tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.246400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-63b6b7ba-14ec-4adb-bd2d-a6e5bc0a8dab tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:01:29.353519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-17c40ed4-ce64-4f6f-991b-c7dbb6c9a056 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:29.365856 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-17c40ed4-ce64-4f6f-991b-c7dbb6c9a056 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1199 microversion: 2.1 time: 0.587353 Aug 27 05:01:29.386221 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1043/2052] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:28 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1199 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:29.402573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6031ba92-c464-45e6-a71f-e93ebe23704c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:29.404384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6031ba92-c464-45e6-a71f-e93ebe23704c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:29.421218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6031ba92-c464-45e6-a71f-e93ebe23704c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.421762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6031ba92-c464-45e6-a71f-e93ebe23704c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.422217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6031ba92-c464-45e6-a71f-e93ebe23704c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.422963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6031ba92-c464-45e6-a71f-e93ebe23704c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.423475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6031ba92-c464-45e6-a71f-e93ebe23704c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.423910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6031ba92-c464-45e6-a71f-e93ebe23704c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.497154 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-63b6b7ba-14ec-4adb-bd2d-a6e5bc0a8dab tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "DELETE /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 204 len: 0 microversion: 2.25 time: 0.337118 Aug 27 05:01:29.499004 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1010/2053] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:01:29 2022] DELETE /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:01:29.511913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-92398c95-3eda-4dfe-85c4-a03058d1056f tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:29.512637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-92398c95-3eda-4dfe-85c4-a03058d1056f tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:29.530199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92398c95-3eda-4dfe-85c4-a03058d1056f tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.530713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92398c95-3eda-4dfe-85c4-a03058d1056f tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.531338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92398c95-3eda-4dfe-85c4-a03058d1056f tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.532080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92398c95-3eda-4dfe-85c4-a03058d1056f tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.532538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92398c95-3eda-4dfe-85c4-a03058d1056f tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.532992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92398c95-3eda-4dfe-85c4-a03058d1056f tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.802554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6031ba92-c464-45e6-a71f-e93ebe23704c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:29.808678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-92398c95-3eda-4dfe-85c4-a03058d1056f tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:29.816053 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6031ba92-c464-45e6-a71f-e93ebe23704c tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1471 microversion: 2.1 time: 0.428615 Aug 27 05:01:29.816687 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1044/2054] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:29 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1471 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:29.819678 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-92398c95-3eda-4dfe-85c4-a03058d1056f tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1218 microversion: 2.1 time: 0.312247 Aug 27 05:01:29.820682 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1011/2055] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:29 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1218 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:29.838272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-36383e1d-f6d9-49b6-b073-f717d474ddd6 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:29.838810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-36383e1d-f6d9-49b6-b073-f717d474ddd6 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:29.839793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:29.840432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:29.850149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.850911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.851597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.852544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.853226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.853805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.874660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36383e1d-f6d9-49b6-b073-f717d474ddd6 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.878178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36383e1d-f6d9-49b6-b073-f717d474ddd6 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.879493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36383e1d-f6d9-49b6-b073-f717d474ddd6 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.879937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36383e1d-f6d9-49b6-b073-f717d474ddd6 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.880597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36383e1d-f6d9-49b6-b073-f717d474ddd6 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.881315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36383e1d-f6d9-49b6-b073-f717d474ddd6 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.918340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-36383e1d-f6d9-49b6-b073-f717d474ddd6 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lazy-loading 'flavor' on Instance uuid d4292482-017f-412f-bcbe-4884b556aa5b {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:01:30.089961 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-36383e1d-f6d9-49b6-b073-f717d474ddd6 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b/action" status: 202 len: 0 microversion: 2.1 time: 0.256012 Aug 27 05:01:30.093900 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1012/2056] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:01:29 2022] POST /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:01:30.110672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cabbc2ee-67d7-46ab-85ea-5ee4da1ad47f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:30.112220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cabbc2ee-67d7-46ab-85ea-5ee4da1ad47f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:30.136282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cabbc2ee-67d7-46ab-85ea-5ee4da1ad47f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:30.139409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cabbc2ee-67d7-46ab-85ea-5ee4da1ad47f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:30.139902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cabbc2ee-67d7-46ab-85ea-5ee4da1ad47f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:30.144314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cabbc2ee-67d7-46ab-85ea-5ee4da1ad47f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:30.145309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cabbc2ee-67d7-46ab-85ea-5ee4da1ad47f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:30.145764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cabbc2ee-67d7-46ab-85ea-5ee4da1ad47f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:30.180429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:30.190118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:30.191609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:30.192812 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0e5ed23d-ed28-4db0-a52a-c94214c7e670 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1730 microversion: 2.25 time: 0.375030 Aug 27 05:01:30.202799 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1045/2057] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:29 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1730 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:30.234093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:30.402755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f58dfeca-4818-40e2-b64e-61ccc4c31f52 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:30.404066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f58dfeca-4818-40e2-b64e-61ccc4c31f52 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:30.420288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f58dfeca-4818-40e2-b64e-61ccc4c31f52 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:30.422313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f58dfeca-4818-40e2-b64e-61ccc4c31f52 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:30.422834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f58dfeca-4818-40e2-b64e-61ccc4c31f52 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:30.423667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f58dfeca-4818-40e2-b64e-61ccc4c31f52 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:30.425490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f58dfeca-4818-40e2-b64e-61ccc4c31f52 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:30.427552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f58dfeca-4818-40e2-b64e-61ccc4c31f52 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:31.082041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f58dfeca-4818-40e2-b64e-61ccc4c31f52 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:31.090921 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f58dfeca-4818-40e2-b64e-61ccc4c31f52 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1199 microversion: 2.1 time: 0.692875 Aug 27 05:01:31.091556 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1046/2058] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:30 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1199 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:31.104311 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cabbc2ee-67d7-46ab-85ea-5ee4da1ad47f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1632 microversion: 2.1 time: 1.008503 Aug 27 05:01:31.121762 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1013/2059] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:30 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1632 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:31.136716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9a776de9-9810-470e-a687-306aa405f562 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:31.137356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9a776de9-9810-470e-a687-306aa405f562 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:31.157209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a776de9-9810-470e-a687-306aa405f562 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:31.157718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a776de9-9810-470e-a687-306aa405f562 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:31.158166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a776de9-9810-470e-a687-306aa405f562 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:31.158894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a776de9-9810-470e-a687-306aa405f562 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:31.159434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a776de9-9810-470e-a687-306aa405f562 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:31.159861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a776de9-9810-470e-a687-306aa405f562 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:31.227047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:31.228295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:31.242749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:31.259760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:31.260466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:31.261109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:31.261586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:31.262017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:31.369321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9a776de9-9810-470e-a687-306aa405f562 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:31.378253 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9a776de9-9810-470e-a687-306aa405f562 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1266 microversion: 2.1 time: 0.264937 Aug 27 05:01:31.391388 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1047/2060] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:31 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:31.667634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:31.683565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:31.685674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:31.687029 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f5e3d502-8f90-4961-9406-4a6f570526fd tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1730 microversion: 2.25 time: 0.463967 Aug 27 05:01:31.691749 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1014/2061] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:31 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1730 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:32.119618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f92bc8d7-0fda-44fd-a9d1-15b76e46c0b0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:32.123855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f92bc8d7-0fda-44fd-a9d1-15b76e46c0b0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:32.137193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92bc8d7-0fda-44fd-a9d1-15b76e46c0b0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:32.137909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92bc8d7-0fda-44fd-a9d1-15b76e46c0b0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:32.138506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92bc8d7-0fda-44fd-a9d1-15b76e46c0b0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:32.140141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92bc8d7-0fda-44fd-a9d1-15b76e46c0b0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:32.140824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92bc8d7-0fda-44fd-a9d1-15b76e46c0b0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:32.142586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bdb2f9a8-aa5d-4a6c-9faf-94952d9b8a98 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:32.143407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bdb2f9a8-aa5d-4a6c-9faf-94952d9b8a98 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:32.155646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdb2f9a8-aa5d-4a6c-9faf-94952d9b8a98 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:32.157764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92bc8d7-0fda-44fd-a9d1-15b76e46c0b0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:32.158595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdb2f9a8-aa5d-4a6c-9faf-94952d9b8a98 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:32.161828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdb2f9a8-aa5d-4a6c-9faf-94952d9b8a98 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:32.166368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdb2f9a8-aa5d-4a6c-9faf-94952d9b8a98 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:32.167139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdb2f9a8-aa5d-4a6c-9faf-94952d9b8a98 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:32.169787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdb2f9a8-aa5d-4a6c-9faf-94952d9b8a98 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:32.790323 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bdb2f9a8-aa5d-4a6c-9faf-94952d9b8a98 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1615 microversion: 2.1 time: 0.635736 Aug 27 05:01:32.791021 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1015/2062] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:32 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1615 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:32.811837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3eca4945-a656-4c53-82bd-b7785a401adb tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:32.813156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3eca4945-a656-4c53-82bd-b7785a401adb tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:32.820534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eca4945-a656-4c53-82bd-b7785a401adb tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:32.821837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eca4945-a656-4c53-82bd-b7785a401adb tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:32.822431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eca4945-a656-4c53-82bd-b7785a401adb tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:32.823457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eca4945-a656-4c53-82bd-b7785a401adb tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:32.824071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eca4945-a656-4c53-82bd-b7785a401adb tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:32.824768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3eca4945-a656-4c53-82bd-b7785a401adb tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:32.974839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3eca4945-a656-4c53-82bd-b7785a401adb tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:32.984666 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3eca4945-a656-4c53-82bd-b7785a401adb tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1272 microversion: 2.1 time: 0.178250 Aug 27 05:01:32.991605 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1016/2063] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:32 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:33.011333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:33.011975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:33.031293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.032064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.032696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.033674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.034371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.035031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.067112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f92bc8d7-0fda-44fd-a9d1-15b76e46c0b0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:33.077121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:33.086393 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f92bc8d7-0fda-44fd-a9d1-15b76e46c0b0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1199 microversion: 2.1 time: 0.978079 Aug 27 05:01:33.087741 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1048/2064] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:32 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1199 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:33.096053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:33.096639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:33.107563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.108416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.109147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.110002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.110587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.111183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.178473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:33.193914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:33.199583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:33.201327 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e2c4af01-5b93-4a1e-b679-87e531c139b4 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1663 microversion: 2.25 time: 0.208008 Aug 27 05:01:33.204313 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1017/2065] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:32 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1663 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:33.249287 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] HTTP exception thrown: Cannot 'migrate' instance d4292482-017f-412f-bcbe-4884b556aa5b while it is in vm_state suspended Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Request method failure captured: Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b/action HTTP/1.1 Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 15 Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaTxBIF_fnnjRS6bsglfCEUGrXA3rn-5QNGOYEk2wJbW58r3qFDkXPQg2Sh8aiovvv799Wt-CuaLBfS9uMY7N_4fJgqFDvzj3YojQGxJRe9o-rFAz60WC5mllMSmXG7ewzZ0x_fPbUP3cLZyFpqYbsbgiIPBWBCkpZSpOIofCDSw4Zs Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 01b6d449222c46fcab1f1ec41081cb88 Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_01b6d449222c46fcab1f1ec41081cb88", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 01b6d449222c46fcab1f1ec41081cb88 Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersAdminNegativeTestJSON-1227236306-project-admin Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 2dbf6f16a78d476684fa4b09af692043 Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1227236306-project-admin Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: {"migrate": {}} Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot 'migrate' instance d4292482-017f-412f-bcbe-4884b556aa5b while it is in vm_state suspended Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd4292482-017f-412f-bcbe-4884b556aa5b', 'body': {'migrate': {}}} Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d4292482-017f-412f-bcbe-4884b556aa5b in vm_state suspended. Cannot resize while the instance is in this state. Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:01:33.252361 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance d4292482-017f-412f-bcbe-4884b556aa5b while it is in vm_state suspended Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance d4292482-017f-412f-bcbe-4884b556aa5b while it is in vm_state suspended Aug 27 05:01:33.256066 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.259174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Returning 409 to user: Cannot 'migrate' instance d4292482-017f-412f-bcbe-4884b556aa5b while it is in vm_state suspended {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:33.260331 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-444d13d6-8435-4d03-8b67-950ddc2e48e0 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b/action" status: 409 len: 148 microversion: 2.1 time: 0.171674 Aug 27 05:01:33.261406 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1049/2066] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:01:33 2022] POST /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b/action => generated 148 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:01:33.278082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9d0e40e6-2e03-4bf4-b4b7-ca5592e0f573 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9d0e40e6-2e03-4bf4-b4b7-ca5592e0f573 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Request method failure captured: Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158/action HTTP/1.1 Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 39 Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaTxBIF_fnnjRS6bsglfCEUGrXA3rn-5QNGOYEk2wJbW58r3qFDkXPQg2Sh8aiovvv799Wt-CuaLBfS9uMY7N_4fJgqFDvzj3YojQGxJRe9o-rFAz60WC5mllMSmXG7ewzZ0x_fPbUP3cLZyFpqYbsbgiIPBWBCkpZSpOIofCDSw4Zs Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 01b6d449222c46fcab1f1ec41081cb88 Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_01b6d449222c46fcab1f1ec41081cb88", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 01b6d449222c46fcab1f1ec41081cb88 Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersAdminNegativeTestJSON-1227236306-project-admin Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 2dbf6f16a78d476684fa4b09af692043 Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1227236306-project-admin Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: {"os-resetState": {"state": "invalid"}} Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '2014233b-011e-4437-afd0-68fbecdb4158', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:01:33.282762 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:01:33.287201 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 05:01:33.287201 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.287201 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:33.287201 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.287201 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.287201 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:33.287201 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:33.287201 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:01:33.287201 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:01:33.287201 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 05:01:33.287201 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.289062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9d0e40e6-2e03-4bf4-b4b7-ca5592e0f573 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:33.291975 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9d0e40e6-2e03-4bf4-b4b7-ca5592e0f573 tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158/action" status: 400 len: 144 microversion: 2.1 time: 0.020767 Aug 27 05:01:33.302594 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1018/2067] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:01:33 2022] POST /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158/action => generated 144 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:01:33.307991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9d9678b3-fe03-4742-813a-3c28a16e7b3f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9d9678b3-fe03-4742-813a-3c28a16e7b3f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Request method failure captured: Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158/action HTTP/1.1 Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 31 Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaTxBIF_fnnjRS6bsglfCEUGrXA3rn-5QNGOYEk2wJbW58r3qFDkXPQg2Sh8aiovvv799Wt-CuaLBfS9uMY7N_4fJgqFDvzj3YojQGxJRe9o-rFAz60WC5mllMSmXG7ewzZ0x_fPbUP3cLZyFpqYbsbgiIPBWBCkpZSpOIofCDSw4Zs Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 01b6d449222c46fcab1f1ec41081cb88 Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_01b6d449222c46fcab1f1ec41081cb88", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 01b6d449222c46fcab1f1ec41081cb88 Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersAdminNegativeTestJSON-1227236306-project-admin Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 2dbf6f16a78d476684fa4b09af692043 Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1227236306-project-admin Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: {"os-resetState": {"state": 1}} Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2014233b-011e-4437-afd0-68fbecdb4158', 'body': {'os-resetState': {'state': 1}}} Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 1 Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 05:01:33.322949 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.326560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:33.326560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.326560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.326560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:33.326560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:33.326560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:01:33.326560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:01:33.326560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 05:01:33.326560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.332269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9d9678b3-fe03-4742-813a-3c28a16e7b3f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:33.333984 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9d9678b3-fe03-4742-813a-3c28a16e7b3f tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158/action" status: 400 len: 120 microversion: 2.1 time: 0.030326 Aug 27 05:01:33.335376 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1050/2068] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:01:33 2022] POST /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158/action => generated 120 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:01:33.344130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-52ac0f38-ea60-4d3c-aa69-2ea36d860e17 req-a3ff247e-3390-4556-81c4-876b009167ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c927e5-5b82-4fd6-8538-fe5456c92f9f", "name": "network-vif-deleted", "tag": "e042543b-f075-4259-b806-252f41c2843b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:33.360885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4095c6f3-5c63-4e91-b7a3-930e71fd859e tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:33.361394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-52ac0f38-ea60-4d3c-aa69-2ea36d860e17 req-a3ff247e-3390-4556-81c4-876b009167ab service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.362377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-52ac0f38-ea60-4d3c-aa69-2ea36d860e17 req-a3ff247e-3390-4556-81c4-876b009167ab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.363125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-52ac0f38-ea60-4d3c-aa69-2ea36d860e17 req-a3ff247e-3390-4556-81c4-876b009167ab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.364384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4095c6f3-5c63-4e91-b7a3-930e71fd859e tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Failed to fetch instance by id 999 {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 05:01:33.365077 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-4095c6f3-5c63-4e91-b7a3-930e71fd859e tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4095c6f3-5c63-4e91-b7a3-930e71fd859e tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Request method failure captured: Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 37 Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaTxBIF_fnnjRS6bsglfCEUGrXA3rn-5QNGOYEk2wJbW58r3qFDkXPQg2Sh8aiovvv799Wt-CuaLBfS9uMY7N_4fJgqFDvzj3YojQGxJRe9o-rFAz60WC5mllMSmXG7ewzZ0x_fPbUP3cLZyFpqYbsbgiIPBWBCkpZSpOIofCDSw4Zs Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 01b6d449222c46fcab1f1ec41081cb88 Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_01b6d449222c46fcab1f1ec41081cb88", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01b6d449222c46fcab1f1ec41081cb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 01b6d449222c46fcab1f1ec41081cb88 Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1227236306 Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersAdminNegativeTestJSON-1227236306-project-admin Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 2dbf6f16a78d476684fa4b09af692043 Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1227236306-project-admin Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: {"os-resetState": {"state": "error"}} Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 999 could not be found. Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:33.379988 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:33.384707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:33.384707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 05:01:33.384707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:33.385084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4095c6f3-5c63-4e91-b7a3-930e71fd859e tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:33.387427 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-52ac0f38-ea60-4d3c-aa69-2ea36d860e17 req-a3ff247e-3390-4556-81c4-876b009167ab service nova] Creating event network-vif-deleted:e042543b-f075-4259-b806-252f41c2843b for instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f on n-h2-820368-35 Aug 27 05:01:33.393046 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4095c6f3-5c63-4e91-b7a3-930e71fd859e tempest-ServersAdminNegativeTestJSON-1227236306 tempest-ServersAdminNegativeTestJSON-1227236306-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.037630 Aug 27 05:01:33.397664 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1051/2069] 10.222.0.58 () {60 vars in 1179 bytes} [Sat Aug 27 05:01:33 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:01:33.405944 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-52ac0f38-ea60-4d3c-aa69-2ea36d860e17 req-a3ff247e-3390-4556-81c4-876b009167ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077679 Aug 27 05:01:33.407947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bfae2320-88ab-48fc-a4ed-e3abf5ba4904 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:33.412150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bfae2320-88ab-48fc-a4ed-e3abf5ba4904 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:33.412574 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1019/2070] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:33.432216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfae2320-88ab-48fc-a4ed-e3abf5ba4904 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.434236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfae2320-88ab-48fc-a4ed-e3abf5ba4904 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.435250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfae2320-88ab-48fc-a4ed-e3abf5ba4904 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.437652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfae2320-88ab-48fc-a4ed-e3abf5ba4904 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.438463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfae2320-88ab-48fc-a4ed-e3abf5ba4904 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.440518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfae2320-88ab-48fc-a4ed-e3abf5ba4904 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.481851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bfae2320-88ab-48fc-a4ed-e3abf5ba4904 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:01:33.635964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-78fb73f5-c7f9-4c48-9433-ee94e3f680d7 req-a3a25b6e-ee15-45f0-a68b-960f3ff93574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25cb7fa-29c6-4d28-bd24-ecff7105f488", "name": "network-vif-plugged", "status": "completed", "tag": "940ba38f-dc68-41bd-b54d-beed96d7c9f6"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:33.670581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-78fb73f5-c7f9-4c48-9433-ee94e3f680d7 req-a3a25b6e-ee15-45f0-a68b-960f3ff93574 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.681350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-78fb73f5-c7f9-4c48-9433-ee94e3f680d7 req-a3a25b6e-ee15-45f0-a68b-960f3ff93574 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.684335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-78fb73f5-c7f9-4c48-9433-ee94e3f680d7 req-a3a25b6e-ee15-45f0-a68b-960f3ff93574 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.688998 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bfae2320-88ab-48fc-a4ed-e3abf5ba4904 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 204 len: 0 microversion: 2.1 time: 0.287705 Aug 27 05:01:33.690223 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1052/2071] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:01:33 2022] DELETE /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:01:33.714102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a7203c2-7c42-42b0-b276-e1444c85fb1d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:33.716734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0a7203c2-7c42-42b0-b276-e1444c85fb1d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:33.730660 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-78fb73f5-c7f9-4c48-9433-ee94e3f680d7 req-a3a25b6e-ee15-45f0-a68b-960f3ff93574 service nova] Creating event network-vif-plugged:940ba38f-dc68-41bd-b54d-beed96d7c9f6 for instance d25cb7fa-29c6-4d28-bd24-ecff7105f488 on n-h2-820368-35 Aug 27 05:01:33.731558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7203c2-7c42-42b0-b276-e1444c85fb1d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.732752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7203c2-7c42-42b0-b276-e1444c85fb1d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.734943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7203c2-7c42-42b0-b276-e1444c85fb1d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.736940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7203c2-7c42-42b0-b276-e1444c85fb1d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.739038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7203c2-7c42-42b0-b276-e1444c85fb1d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.741172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a7203c2-7c42-42b0-b276-e1444c85fb1d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.746355 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-78fb73f5-c7f9-4c48-9433-ee94e3f680d7 req-a3a25b6e-ee15-45f0-a68b-960f3ff93574 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116853 Aug 27 05:01:33.747674 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1020/2072] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:01:34.015292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d83b700-681a-4b1c-a20e-edfe2dec39ea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:34.017575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3d83b700-681a-4b1c-a20e-edfe2dec39ea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:34.039846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d83b700-681a-4b1c-a20e-edfe2dec39ea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:34.041822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d83b700-681a-4b1c-a20e-edfe2dec39ea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:34.043186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d83b700-681a-4b1c-a20e-edfe2dec39ea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:34.046889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d83b700-681a-4b1c-a20e-edfe2dec39ea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:34.048182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d83b700-681a-4b1c-a20e-edfe2dec39ea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:34.049362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d83b700-681a-4b1c-a20e-edfe2dec39ea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:34.273900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d83b700-681a-4b1c-a20e-edfe2dec39ea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:34.286891 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d83b700-681a-4b1c-a20e-edfe2dec39ea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1314 microversion: 2.1 time: 0.274061 Aug 27 05:01:34.299124 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1021/2073] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:34 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:34.303360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d7c93d0-e7f6-47ed-825f-a6241212443d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:34.303981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3d7c93d0-e7f6-47ed-825f-a6241212443d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:34.314315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d7c93d0-e7f6-47ed-825f-a6241212443d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:34.314885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d7c93d0-e7f6-47ed-825f-a6241212443d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:34.315055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0a7203c2-7c42-42b0-b276-e1444c85fb1d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:34.315572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d7c93d0-e7f6-47ed-825f-a6241212443d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:34.316158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d7c93d0-e7f6-47ed-825f-a6241212443d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:34.319647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d7c93d0-e7f6-47ed-825f-a6241212443d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:34.325254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d7c93d0-e7f6-47ed-825f-a6241212443d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:34.327624 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a7203c2-7c42-42b0-b276-e1444c85fb1d tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1468 microversion: 2.1 time: 0.625761 Aug 27 05:01:34.329927 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1053/2074] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:33 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1468 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:34.338330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:34.339212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:34.360891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:34.361633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:34.362423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:34.363506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:34.364118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:34.365861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:34.438431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:34.439871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:34.441171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:34.441838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lazy-loading 'fault' on Instance uuid 71c927e5-5b82-4fd6-8538-fe5456c92f9f {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:01:34.556598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d7c93d0-e7f6-47ed-825f-a6241212443d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:34.565421 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d7c93d0-e7f6-47ed-825f-a6241212443d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1199 microversion: 2.1 time: 0.276421 Aug 27 05:01:34.568073 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1022/2075] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:34 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1199 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:34.817894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:34.828297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:34.830672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:34.832157 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4a0489e9-6d82-4be4-b0bb-7f463b2f3cc8 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 200 len: 1374 microversion: 2.25 time: 0.501092 Aug 27 05:01:34.833247 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1054/2076] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:34 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 1374 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:35.238710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-fd2a80bb-f74e-4ff1-a229-c7581791ec86 req-e55c8766-367b-4fb1-bbe8-f983a43f75c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1041d0f9-34d3-4bed-b1fb-8a198135f234", "tag": "e423b874-4ad6-4501-bb4c-7947a4798049"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:35.285285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fd2a80bb-f74e-4ff1-a229-c7581791ec86 req-e55c8766-367b-4fb1-bbe8-f983a43f75c8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:35.290669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fd2a80bb-f74e-4ff1-a229-c7581791ec86 req-e55c8766-367b-4fb1-bbe8-f983a43f75c8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:35.291080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fd2a80bb-f74e-4ff1-a229-c7581791ec86 req-e55c8766-367b-4fb1-bbe8-f983a43f75c8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:35.315265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b929aa58-dda2-420f-8bdc-25734e95bffa tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:35.315265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b929aa58-dda2-420f-8bdc-25734e95bffa tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:35.324354 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-fd2a80bb-f74e-4ff1-a229-c7581791ec86 req-e55c8766-367b-4fb1-bbe8-f983a43f75c8 service nova] Creating event network-changed:e423b874-4ad6-4501-bb4c-7947a4798049 for instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 on n-h2-820368-35 Aug 27 05:01:35.338268 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-fd2a80bb-f74e-4ff1-a229-c7581791ec86 req-e55c8766-367b-4fb1-bbe8-f983a43f75c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106628 Aug 27 05:01:35.339231 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1023/2077] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:35.340001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b929aa58-dda2-420f-8bdc-25734e95bffa tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:35.340545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b929aa58-dda2-420f-8bdc-25734e95bffa tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:35.341185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b929aa58-dda2-420f-8bdc-25734e95bffa tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:35.342141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b929aa58-dda2-420f-8bdc-25734e95bffa tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:35.343327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b929aa58-dda2-420f-8bdc-25734e95bffa tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:35.343912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b929aa58-dda2-420f-8bdc-25734e95bffa tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:35.355767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5b2087ca-a985-463b-b8f1-f58b50ac3061 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:35.356683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5b2087ca-a985-463b-b8f1-f58b50ac3061 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:35.384277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b2087ca-a985-463b-b8f1-f58b50ac3061 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:35.390177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b2087ca-a985-463b-b8f1-f58b50ac3061 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:35.393065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b2087ca-a985-463b-b8f1-f58b50ac3061 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:35.394075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b2087ca-a985-463b-b8f1-f58b50ac3061 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:35.394873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b2087ca-a985-463b-b8f1-f58b50ac3061 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:35.395913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b2087ca-a985-463b-b8f1-f58b50ac3061 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:35.663324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5b2087ca-a985-463b-b8f1-f58b50ac3061 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:35.673934 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5b2087ca-a985-463b-b8f1-f58b50ac3061 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1468 microversion: 2.1 time: 0.328072 Aug 27 05:01:35.679239 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1024/2078] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:35 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1468 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:35.689316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e8805df-f967-4c3a-b6da-6189aff5eaa3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:35.690169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e8805df-f967-4c3a-b6da-6189aff5eaa3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:35.696982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b929aa58-dda2-420f-8bdc-25734e95bffa tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:35.702421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8805df-f967-4c3a-b6da-6189aff5eaa3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:35.703071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8805df-f967-4c3a-b6da-6189aff5eaa3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:35.704853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8805df-f967-4c3a-b6da-6189aff5eaa3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:35.706411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8805df-f967-4c3a-b6da-6189aff5eaa3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:35.710137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8805df-f967-4c3a-b6da-6189aff5eaa3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:35.710802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8805df-f967-4c3a-b6da-6189aff5eaa3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:35.713520 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b929aa58-dda2-420f-8bdc-25734e95bffa tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1314 microversion: 2.1 time: 0.407537 Aug 27 05:01:35.715966 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1055/2079] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:35 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:35.860448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:35.861272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 71c927e5-5b82-4fd6-8538-fe5456c92f9f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:35.874459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:35.874964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:35.875699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:35.876414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:35.876857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:35.877689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:35.897268 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] HTTP exception thrown: Instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f could not be found. Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Request method failure captured: Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f HTTP/1.1 Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaL0kD74fFlji4BayTy6rNAk62Up0r0shWNUA_hDsDid_cu5nC_4SdKXv21GckDyUIA9YsEIT6SVinK8DsWo_p2MkDLQS_iXCB4qfYrSYH8yjwbMWZedy6EwIDt4HeRjlNOHnzkB2c_JLOS9x0R4wfAzTmLvfz2MQ_oNh_7qno0UmxE Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: f5c7422cdaca490aaffc4004f77d830c Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5c7422cdaca490aaffc4004f77d830c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: f5c7422cdaca490aaffc4004f77d830c Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-LiveAutoBlockMigrationV225Test-204101716-project Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: b7d4fe4aaf864bb58c162620c9948d89 Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-204101716-project Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f could not be found. Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '71c927e5-5b82-4fd6-8538-fe5456c92f9f'} Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f could not be found. Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f could not be found. Aug 27 05:01:35.899168 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:35.903320 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:35.903320 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:35.903320 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:35.903320 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:35.903320 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:35.903320 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:35.903320 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:35.903320 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f could not be found. Aug 27 05:01:35.903320 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:35.903320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Returning 404 to user: Instance 71c927e5-5b82-4fd6-8538-fe5456c92f9f could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:35.903320 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-51f29de4-3378-457e-9d43-d50f83ea6723 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f" status: 404 len: 111 microversion: 2.25 time: 0.047044 Aug 27 05:01:35.905022 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1056/2080] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:35 2022] GET /compute/v2.1/servers/71c927e5-5b82-4fd6-8538-fe5456c92f9f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 05:01:35.909795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-12cdb143-2cfb-4674-b1ab-af06c9495cc6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '.version_select at 0x7fb564befb80>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:35.949941 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-12cdb143-2cfb-4674-b1ab-af06c9495cc6 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-41584641" status: 204 len: 0 microversion: 2.25 time: 0.042697 Aug 27 05:01:35.956840 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1057/2081] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:01:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-41584641 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:01:36.063162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e8805df-f967-4c3a-b6da-6189aff5eaa3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:36.080676 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e8805df-f967-4c3a-b6da-6189aff5eaa3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1381 microversion: 2.1 time: 0.399903 Aug 27 05:01:36.081455 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1025/2082] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:35 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1381 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:36.426587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fcb8386f-ab27-4c6e-82a7-6dca4504b4c5 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:36.427590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fcb8386f-ab27-4c6e-82a7-6dca4504b4c5 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:36.437284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcb8386f-ab27-4c6e-82a7-6dca4504b4c5 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:36.438382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcb8386f-ab27-4c6e-82a7-6dca4504b4c5 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:36.439027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcb8386f-ab27-4c6e-82a7-6dca4504b4c5 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:36.439987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcb8386f-ab27-4c6e-82a7-6dca4504b4c5 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:36.440568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcb8386f-ab27-4c6e-82a7-6dca4504b4c5 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:36.441198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcb8386f-ab27-4c6e-82a7-6dca4504b4c5 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:36.697692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f713844c-4fde-49bc-a5f0-07071b787565 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:36.698309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f713844c-4fde-49bc-a5f0-07071b787565 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:36.704817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f713844c-4fde-49bc-a5f0-07071b787565 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:36.710830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f713844c-4fde-49bc-a5f0-07071b787565 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:36.711544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f713844c-4fde-49bc-a5f0-07071b787565 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:36.712635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f713844c-4fde-49bc-a5f0-07071b787565 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:36.713255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f713844c-4fde-49bc-a5f0-07071b787565 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:36.715830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f713844c-4fde-49bc-a5f0-07071b787565 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:36.974426 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fcb8386f-ab27-4c6e-82a7-6dca4504b4c5 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1534 microversion: 2.1 time: 0.876363 Aug 27 05:01:36.979057 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1058/2083] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:36 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1534 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:36.984043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0635684c-7417-4e96-b4ff-fedffc3f9e13 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:36.984657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0635684c-7417-4e96-b4ff-fedffc3f9e13 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:37.002949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0635684c-7417-4e96-b4ff-fedffc3f9e13 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:37.010180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0635684c-7417-4e96-b4ff-fedffc3f9e13 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:37.010865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0635684c-7417-4e96-b4ff-fedffc3f9e13 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:37.011781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0635684c-7417-4e96-b4ff-fedffc3f9e13 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:37.012382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0635684c-7417-4e96-b4ff-fedffc3f9e13 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:37.012952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0635684c-7417-4e96-b4ff-fedffc3f9e13 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:37.509377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f713844c-4fde-49bc-a5f0-07071b787565 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:37.517590 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f713844c-4fde-49bc-a5f0-07071b787565 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 200 len: 1468 microversion: 2.1 time: 0.823668 Aug 27 05:01:37.523947 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1026/2084] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:36 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 1468 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:37.532325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1d8151de-746c-4d49-8b4c-89680cf1a93b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:37.533192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1d8151de-746c-4d49-8b4c-89680cf1a93b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:37.549421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d8151de-746c-4d49-8b4c-89680cf1a93b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:37.550395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d8151de-746c-4d49-8b4c-89680cf1a93b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:37.552811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d8151de-746c-4d49-8b4c-89680cf1a93b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:37.553843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d8151de-746c-4d49-8b4c-89680cf1a93b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:37.556566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d8151de-746c-4d49-8b4c-89680cf1a93b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:37.559182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d8151de-746c-4d49-8b4c-89680cf1a93b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:37.595240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0635684c-7417-4e96-b4ff-fedffc3f9e13 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:37.631275 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0635684c-7417-4e96-b4ff-fedffc3f9e13 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1314 microversion: 2.1 time: 0.650850 Aug 27 05:01:37.634592 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1059/2085] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:36 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:37.658379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c229ffef-0c47-470c-b638-964b1a1d6e3a req-a7f37428-13ab-4a2b-81b1-1298a4e80854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4292482-017f-412f-bcbe-4884b556aa5b", "name": "network-vif-deleted", "tag": "b2dc516c-713d-481e-96a0-a5df3dc90e8d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:37.686833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c229ffef-0c47-470c-b638-964b1a1d6e3a req-a7f37428-13ab-4a2b-81b1-1298a4e80854 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:37.687562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c229ffef-0c47-470c-b638-964b1a1d6e3a req-a7f37428-13ab-4a2b-81b1-1298a4e80854 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:37.688923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c229ffef-0c47-470c-b638-964b1a1d6e3a req-a7f37428-13ab-4a2b-81b1-1298a4e80854 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:37.704364 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c229ffef-0c47-470c-b638-964b1a1d6e3a req-a7f37428-13ab-4a2b-81b1-1298a4e80854 service nova] Creating event network-vif-deleted:b2dc516c-713d-481e-96a0-a5df3dc90e8d for instance d4292482-017f-412f-bcbe-4884b556aa5b on n-h1-820368-35 Aug 27 05:01:37.710876 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c229ffef-0c47-470c-b638-964b1a1d6e3a req-a7f37428-13ab-4a2b-81b1-1298a4e80854 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073403 Aug 27 05:01:37.713049 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1060/2086] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:37.883772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:38.021164 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1d8151de-746c-4d49-8b4c-89680cf1a93b tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1534 microversion: 2.1 time: 0.495578 Aug 27 05:01:38.022032 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1027/2087] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:37 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1534 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:38.045855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9094ed49-dff2-4b21-9bbb-d4cf4d88fc80 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:38.049871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9094ed49-dff2-4b21-9bbb-d4cf4d88fc80 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.051817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9094ed49-dff2-4b21-9bbb-d4cf4d88fc80 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.052293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9094ed49-dff2-4b21-9bbb-d4cf4d88fc80 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.053060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9094ed49-dff2-4b21-9bbb-d4cf4d88fc80 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.056172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9094ed49-dff2-4b21-9bbb-d4cf4d88fc80 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.056695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9094ed49-dff2-4b21-9bbb-d4cf4d88fc80 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.120793 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9094ed49-dff2-4b21-9bbb-d4cf4d88fc80 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.079684 Aug 27 05:01:38.124306 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1061/2088] 10.222.0.58 () {58 vars in 1176 bytes} [Sat Aug 27 05:01:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:38.137343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9777d7ab-85df-4fcc-a394-b2a047448588 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-820368-35", "block_migration": false, "disk_over_commit": false}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:38.140051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9777d7ab-85df-4fcc-a394-b2a047448588 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:38.152729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9777d7ab-85df-4fcc-a394-b2a047448588 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.153237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9777d7ab-85df-4fcc-a394-b2a047448588 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.153685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9777d7ab-85df-4fcc-a394-b2a047448588 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.154415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9777d7ab-85df-4fcc-a394-b2a047448588 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.154875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9777d7ab-85df-4fcc-a394-b2a047448588 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.155454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9777d7ab-85df-4fcc-a394-b2a047448588 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.213009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-9777d7ab-85df-4fcc-a394-b2a047448588 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lazy-loading 'flavor' on Instance uuid d25cb7fa-29c6-4d28-bd24-ecff7105f488 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:01:38.243466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9777d7ab-85df-4fcc-a394-b2a047448588 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Going to try to live migrate instance to n-h1-820368-35 {{(pid=128547) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 05:01:38.268926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-68a51c95-4457-425c-b0e0-072bbb952d0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:38.269970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68a51c95-4457-425c-b0e0-072bbb952d0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:38.283777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68a51c95-4457-425c-b0e0-072bbb952d0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.284286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68a51c95-4457-425c-b0e0-072bbb952d0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.284732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68a51c95-4457-425c-b0e0-072bbb952d0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.285442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68a51c95-4457-425c-b0e0-072bbb952d0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.293270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68a51c95-4457-425c-b0e0-072bbb952d0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.294002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68a51c95-4457-425c-b0e0-072bbb952d0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.346507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68a51c95-4457-425c-b0e0-072bbb952d0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:01:38.431059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:38.521781 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-68a51c95-4457-425c-b0e0-072bbb952d0e tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "DELETE /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 204 len: 0 microversion: 2.25 time: 0.258890 Aug 27 05:01:38.524757 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1062/2089] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:01:38 2022] DELETE /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:01:38.557529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:38.560332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:38.592652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.593350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.593808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.594567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.595049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.617573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.867831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:38.880539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:38.882298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:38.884469 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ec9751d-7db6-4b01-abe0-e02fabdafb88 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1549 microversion: 2.25 time: 0.353293 Aug 27 05:01:38.895382 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1063/2090] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:38 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1549 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:38.895382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:38.895382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: d4292482-017f-412f-bcbe-4884b556aa5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:38.905701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.908586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.909781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.910681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.911560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.912225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.930413 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] HTTP exception thrown: Instance d4292482-017f-412f-bcbe-4884b556aa5b could not be found. Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Request method failure captured: Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b HTTP/1.1 Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaTw86ov9bvkrcpan3Jq2vFAEPB9k5AvIxKyxjOjd9RxOd-roWFgp3linku-nfYpKEN29fuTxP2w64fEoW08-RBXKGhZEXscAbChEfRbqU3rJ8doJU7yV62Zv8fkbbZlMAMFJRJd1q13ngz8c4ONIzDm-yC5507Q4HzUTWHI47O5NM0 Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 6fd7543ea6e54136897717d844333ff2 Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1022925349 Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6fd7543ea6e54136897717d844333ff2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6fd7543ea6e54136897717d844333ff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fd7543ea6e54136897717d844333ff2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fd7543ea6e54136897717d844333ff2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1022925349 Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 6fd7543ea6e54136897717d844333ff2 Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1022925349 Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersAdminNegativeTestJSON-1022925349-project Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: dd34049995f544aa9a540062dedae56c Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1022925349-project Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance d4292482-017f-412f-bcbe-4884b556aa5b could not be found. Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd4292482-017f-412f-bcbe-4884b556aa5b'} Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4292482-017f-412f-bcbe-4884b556aa5b could not be found. Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4292482-017f-412f-bcbe-4884b556aa5b could not be found. Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:38.933234 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:38.938866 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:38.938866 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:38.938866 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:38.938866 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:38.938866 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:38.938866 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:38.938866 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4292482-017f-412f-bcbe-4884b556aa5b could not be found. Aug 27 05:01:38.938866 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:38.940689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Returning 404 to user: Instance d4292482-017f-412f-bcbe-4884b556aa5b could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:38.941839 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9bbd2c5-44f6-4d72-8e4d-3bed65aff74b tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b" status: 404 len: 111 microversion: 2.1 time: 0.053395 Aug 27 05:01:38.942443 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1064/2091] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:38 2022] GET /compute/v2.1/servers/d4292482-017f-412f-bcbe-4884b556aa5b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:38.949661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7b48ddd7-cee2-4c4d-a0f2-1f554fb09c03 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:38.950817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7b48ddd7-cee2-4c4d-a0f2-1f554fb09c03 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:38.962620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b48ddd7-cee2-4c4d-a0f2-1f554fb09c03 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.963701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b48ddd7-cee2-4c4d-a0f2-1f554fb09c03 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.964303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b48ddd7-cee2-4c4d-a0f2-1f554fb09c03 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.965179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b48ddd7-cee2-4c4d-a0f2-1f554fb09c03 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:38.966159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b48ddd7-cee2-4c4d-a0f2-1f554fb09c03 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:38.966773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b48ddd7-cee2-4c4d-a0f2-1f554fb09c03 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:39.184115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7b48ddd7-cee2-4c4d-a0f2-1f554fb09c03 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:39.194224 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7b48ddd7-cee2-4c4d-a0f2-1f554fb09c03 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1314 microversion: 2.1 time: 0.250016 Aug 27 05:01:39.195432 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1065/2092] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:38 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:39.207447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9cc16dd2-c789-4269-a8a1-948800992f89 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:39.207973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9cc16dd2-c789-4269-a8a1-948800992f89 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:39.216452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cc16dd2-c789-4269-a8a1-948800992f89 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:39.216947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cc16dd2-c789-4269-a8a1-948800992f89 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:39.217532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cc16dd2-c789-4269-a8a1-948800992f89 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:39.218409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cc16dd2-c789-4269-a8a1-948800992f89 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:39.218944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cc16dd2-c789-4269-a8a1-948800992f89 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:39.219544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9cc16dd2-c789-4269-a8a1-948800992f89 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:39.271341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9cc16dd2-c789-4269-a8a1-948800992f89 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:01:39.306822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:39.378235 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9cc16dd2-c789-4269-a8a1-948800992f89 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 204 len: 0 microversion: 2.1 time: 0.180404 Aug 27 05:01:39.379254 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1066/2093] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:01:39 2022] DELETE /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:01:39.389283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7284b35c-b042-44fb-8607-bcb811a01897 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:39.390980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7284b35c-b042-44fb-8607-bcb811a01897 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:39.397523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7284b35c-b042-44fb-8607-bcb811a01897 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:39.398007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7284b35c-b042-44fb-8607-bcb811a01897 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:39.398606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7284b35c-b042-44fb-8607-bcb811a01897 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:39.399524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7284b35c-b042-44fb-8607-bcb811a01897 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:39.400121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7284b35c-b042-44fb-8607-bcb811a01897 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:39.400851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7284b35c-b042-44fb-8607-bcb811a01897 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:39.562739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7284b35c-b042-44fb-8607-bcb811a01897 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:39.575729 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7284b35c-b042-44fb-8607-bcb811a01897 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1478 microversion: 2.1 time: 0.191679 Aug 27 05:01:39.579148 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1067/2094] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:39 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1478 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:39.912087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:39.913392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:39.920530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:39.921360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:39.922018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:39.923270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:39.923944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:39.924992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:40.048287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:40.067702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:40.075529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:40.077825 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5d2c6fe3-f381-4643-a918-9dbb5fdd9c67 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1507 microversion: 2.25 time: 0.169815 Aug 27 05:01:40.095108 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1068/2095] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:39 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:40.095108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c885cf44-dbf7-4be9-9200-9c3657da791c req-275764c5-3142-4039-b82d-1f4b87c58330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36549027-8a9f-4d92-8525-bdd6fa5ed50e", "name": "network-vif-deleted", "tag": "6db9659b-7f15-473d-b767-a63311e81850"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:40.106997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c885cf44-dbf7-4be9-9200-9c3657da791c req-275764c5-3142-4039-b82d-1f4b87c58330 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:40.107562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c885cf44-dbf7-4be9-9200-9c3657da791c req-275764c5-3142-4039-b82d-1f4b87c58330 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:40.107977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c885cf44-dbf7-4be9-9200-9c3657da791c req-275764c5-3142-4039-b82d-1f4b87c58330 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:40.123197 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c885cf44-dbf7-4be9-9200-9c3657da791c req-275764c5-3142-4039-b82d-1f4b87c58330 service nova] Creating event network-vif-deleted:6db9659b-7f15-473d-b767-a63311e81850 for instance 36549027-8a9f-4d92-8525-bdd6fa5ed50e on n-h1-820368-35 Aug 27 05:01:40.130443 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c885cf44-dbf7-4be9-9200-9c3657da791c req-275764c5-3142-4039-b82d-1f4b87c58330 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042130 Aug 27 05:01:40.131697 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1069/2096] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:40.152207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f3e32b4-e8ff-4e8c-b134-ca529f34796f tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:40.153112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f3e32b4-e8ff-4e8c-b134-ca529f34796f tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:40.161067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f3e32b4-e8ff-4e8c-b134-ca529f34796f tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:40.162009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f3e32b4-e8ff-4e8c-b134-ca529f34796f tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:40.162721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f3e32b4-e8ff-4e8c-b134-ca529f34796f tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:40.163659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f3e32b4-e8ff-4e8c-b134-ca529f34796f tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:40.164346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f3e32b4-e8ff-4e8c-b134-ca529f34796f tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:40.165059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f3e32b4-e8ff-4e8c-b134-ca529f34796f tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:40.201765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f3e32b4-e8ff-4e8c-b134-ca529f34796f tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:01:40.309885 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f3e32b4-e8ff-4e8c-b134-ca529f34796f tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 204 len: 0 microversion: 2.1 time: 0.176148 Aug 27 05:01:40.310480 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1070/2097] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:01:40 2022] DELETE /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:01:40.316515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ded8202-a5f1-4b26-9e2d-488b4b73ee42 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:40.317234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0ded8202-a5f1-4b26-9e2d-488b4b73ee42 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:40.325344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ded8202-a5f1-4b26-9e2d-488b4b73ee42 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:40.325929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ded8202-a5f1-4b26-9e2d-488b4b73ee42 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:40.326530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ded8202-a5f1-4b26-9e2d-488b4b73ee42 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:40.327625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ded8202-a5f1-4b26-9e2d-488b4b73ee42 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:40.328100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ded8202-a5f1-4b26-9e2d-488b4b73ee42 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:40.328924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ded8202-a5f1-4b26-9e2d-488b4b73ee42 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:40.757971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0ded8202-a5f1-4b26-9e2d-488b4b73ee42 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:40.796826 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ded8202-a5f1-4b26-9e2d-488b4b73ee42 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1314 microversion: 2.1 time: 0.485050 Aug 27 05:01:40.810013 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1071/2098] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:40 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:40.814904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-08409b00-7483-44d2-8f62-c9f51805563d tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:40.815589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-08409b00-7483-44d2-8f62-c9f51805563d tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:40.824247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08409b00-7483-44d2-8f62-c9f51805563d tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:40.824741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08409b00-7483-44d2-8f62-c9f51805563d tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:40.825180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08409b00-7483-44d2-8f62-c9f51805563d tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:40.825895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08409b00-7483-44d2-8f62-c9f51805563d tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:40.826349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08409b00-7483-44d2-8f62-c9f51805563d tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:40.826777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08409b00-7483-44d2-8f62-c9f51805563d tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:41.011359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-08409b00-7483-44d2-8f62-c9f51805563d tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:41.020652 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-08409b00-7483-44d2-8f62-c9f51805563d tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1663 microversion: 2.1 time: 0.221818 Aug 27 05:01:41.021719 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1072/2099] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:40 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1663 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:41.030765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8fa0d2c2-4560-40e2-9418-7127520cf645 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:41.031736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8fa0d2c2-4560-40e2-9418-7127520cf645 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:41.038932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa0d2c2-4560-40e2-9418-7127520cf645 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:41.040162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa0d2c2-4560-40e2-9418-7127520cf645 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:41.040873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa0d2c2-4560-40e2-9418-7127520cf645 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:41.042611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa0d2c2-4560-40e2-9418-7127520cf645 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:41.043811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa0d2c2-4560-40e2-9418-7127520cf645 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:41.056129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa0d2c2-4560-40e2-9418-7127520cf645 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:41.245933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8fa0d2c2-4560-40e2-9418-7127520cf645 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:41.257025 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8fa0d2c2-4560-40e2-9418-7127520cf645 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1478 microversion: 2.1 time: 0.233880 Aug 27 05:01:41.257671 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1073/2100] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:41 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1478 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:41.264016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:41.264875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:41.271595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:41.272250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:41.272846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:41.274087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:41.275285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:41.275736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:41.326976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:41.327852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:41.328636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:41.329244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lazy-loading 'fault' on Instance uuid 36549027-8a9f-4d92-8525-bdd6fa5ed50e {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:01:41.387508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:41.396641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:41.398156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:41.399766 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f41e97df-e595-48f3-aada-1ab7fd424ebc tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 200 len: 1352 microversion: 2.25 time: 0.141070 Aug 27 05:01:41.400477 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1074/2101] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:41 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 1352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:41.817928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2fa9a016-765f-47f2-9a86-91215f1ee745 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:41.818586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2fa9a016-765f-47f2-9a86-91215f1ee745 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:41.833180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2fa9a016-765f-47f2-9a86-91215f1ee745 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:41.839221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2fa9a016-765f-47f2-9a86-91215f1ee745 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:41.839802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2fa9a016-765f-47f2-9a86-91215f1ee745 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:41.840908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2fa9a016-765f-47f2-9a86-91215f1ee745 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:41.841649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2fa9a016-765f-47f2-9a86-91215f1ee745 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:41.844059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2fa9a016-765f-47f2-9a86-91215f1ee745 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:42.046008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2fa9a016-765f-47f2-9a86-91215f1ee745 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:42.056491 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2fa9a016-765f-47f2-9a86-91215f1ee745 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1314 microversion: 2.1 time: 0.242260 Aug 27 05:01:42.057069 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1075/2102] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:41 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:42.076225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-601b5958-b167-4ff9-a80d-94cf6f998d38 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:42.078191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-601b5958-b167-4ff9-a80d-94cf6f998d38 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:42.085750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:42.090227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-601b5958-b167-4ff9-a80d-94cf6f998d38 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:42.090717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-601b5958-b167-4ff9-a80d-94cf6f998d38 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:42.091182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-601b5958-b167-4ff9-a80d-94cf6f998d38 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:42.091903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-601b5958-b167-4ff9-a80d-94cf6f998d38 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:42.092360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-601b5958-b167-4ff9-a80d-94cf6f998d38 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:42.092804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-601b5958-b167-4ff9-a80d-94cf6f998d38 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:42.336952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-601b5958-b167-4ff9-a80d-94cf6f998d38 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:42.345555 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-601b5958-b167-4ff9-a80d-94cf6f998d38 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1663 microversion: 2.1 time: 0.286493 Aug 27 05:01:42.346231 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1076/2103] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:42 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1663 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:42.350944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b55bd562-c574-4c6e-a9b8-d4e1ffca086f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:42.351797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b55bd562-c574-4c6e-a9b8-d4e1ffca086f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:42.365480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55bd562-c574-4c6e-a9b8-d4e1ffca086f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:42.366303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55bd562-c574-4c6e-a9b8-d4e1ffca086f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:42.366819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55bd562-c574-4c6e-a9b8-d4e1ffca086f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:42.367647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55bd562-c574-4c6e-a9b8-d4e1ffca086f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:42.368736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55bd562-c574-4c6e-a9b8-d4e1ffca086f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:42.369550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55bd562-c574-4c6e-a9b8-d4e1ffca086f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:42.815811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b55bd562-c574-4c6e-a9b8-d4e1ffca086f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:42.825039 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b55bd562-c574-4c6e-a9b8-d4e1ffca086f tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1478 microversion: 2.1 time: 0.477343 Aug 27 05:01:42.841777 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1077/2104] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:42 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1478 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:42.847793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:42.848622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: 36549027-8a9f-4d92-8525-bdd6fa5ed50e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:42.869882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:42.870951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:42.872555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:42.873756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:42.875360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:42.880317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:42.902352 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] HTTP exception thrown: Instance 36549027-8a9f-4d92-8525-bdd6fa5ed50e could not be found. Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Request method failure captured: Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e HTTP/1.1 Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaL0kD74fFlji4BayTy6rNAk62Up0r0shWNUA_hDsDid_cu5nC_4SdKXv21GckDyUIA9YsEIT6SVinK8DsWo_p2MkDLQS_iXCB4qfYrSYH8yjwbMWZedy6EwIDt4HeRjlNOHnzkB2c_JLOS9x0R4wfAzTmLvfz2MQ_oNh_7qno0UmxE Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: f5c7422cdaca490aaffc4004f77d830c Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5c7422cdaca490aaffc4004f77d830c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: f5c7422cdaca490aaffc4004f77d830c Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-LiveAutoBlockMigrationV225Test-204101716-project Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: b7d4fe4aaf864bb58c162620c9948d89 Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-204101716-project Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 36549027-8a9f-4d92-8525-bdd6fa5ed50e could not be found. Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '36549027-8a9f-4d92-8525-bdd6fa5ed50e'} Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36549027-8a9f-4d92-8525-bdd6fa5ed50e could not be found. Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36549027-8a9f-4d92-8525-bdd6fa5ed50e could not be found. Aug 27 05:01:42.904230 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:42.908523 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:42.908523 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:42.908523 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:42.908523 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:42.908523 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:42.908523 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:42.908523 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:42.908523 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36549027-8a9f-4d92-8525-bdd6fa5ed50e could not be found. Aug 27 05:01:42.908523 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:42.910504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Returning 404 to user: Instance 36549027-8a9f-4d92-8525-bdd6fa5ed50e could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:42.913088 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9e3d86b2-bec9-4b62-8861-d5c7b327324f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e" status: 404 len: 111 microversion: 2.25 time: 0.069917 Aug 27 05:01:42.917476 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1078/2105] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:42 2022] GET /compute/v2.1/servers/36549027-8a9f-4d92-8525-bdd6fa5ed50e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:01:42.922511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b45080ad-5359-4662-acae-ce491c70e9cb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:42.923301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b45080ad-5359-4662-acae-ce491c70e9cb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:42.930144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45080ad-5359-4662-acae-ce491c70e9cb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:42.930684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45080ad-5359-4662-acae-ce491c70e9cb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:42.931401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45080ad-5359-4662-acae-ce491c70e9cb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:42.932129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45080ad-5359-4662-acae-ce491c70e9cb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:42.932584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45080ad-5359-4662-acae-ce491c70e9cb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:42.933011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45080ad-5359-4662-acae-ce491c70e9cb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:42.978684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b45080ad-5359-4662-acae-ce491c70e9cb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:01:43.146926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b45080ad-5359-4662-acae-ce491c70e9cb tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 204 len: 0 microversion: 2.25 time: 0.227650 Aug 27 05:01:43.153567 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1079/2106] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:01:42 2022] DELETE /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:01:43.162753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-58803b15-6e32-4ed7-a0b5-70988327754b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:43.167667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-58803b15-6e32-4ed7-a0b5-70988327754b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:43.179600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58803b15-6e32-4ed7-a0b5-70988327754b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:43.180350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58803b15-6e32-4ed7-a0b5-70988327754b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:43.181771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58803b15-6e32-4ed7-a0b5-70988327754b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:43.182920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58803b15-6e32-4ed7-a0b5-70988327754b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:43.183820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58803b15-6e32-4ed7-a0b5-70988327754b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:43.185161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58803b15-6e32-4ed7-a0b5-70988327754b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:43.219383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:43.435378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-58803b15-6e32-4ed7-a0b5-70988327754b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:43.448423 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-58803b15-6e32-4ed7-a0b5-70988327754b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1314 microversion: 2.1 time: 0.290728 Aug 27 05:01:43.459831 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1080/2107] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:43 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:43.467661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:43.468781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:43.481705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:43.497284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:43.498278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:43.499266 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9777d7ab-85df-4fcc-a394-b2a047448588 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488/action" status: 202 len: 0 microversion: 2.1 time: 5.367079 Aug 27 05:01:43.500144 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1028/2108] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:01:38 2022] POST /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488/action => generated 0 bytes in 5369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:01:43.503606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:43.503606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:43.503606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:43.510978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5c280f3a-0da4-4ae8-95e6-e7e3380dd794 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:43.516874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5c280f3a-0da4-4ae8-95e6-e7e3380dd794 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:43.533124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c280f3a-0da4-4ae8-95e6-e7e3380dd794 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:43.536550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c280f3a-0da4-4ae8-95e6-e7e3380dd794 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:43.538277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c280f3a-0da4-4ae8-95e6-e7e3380dd794 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:43.539686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c280f3a-0da4-4ae8-95e6-e7e3380dd794 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:43.541815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c280f3a-0da4-4ae8-95e6-e7e3380dd794 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:43.542485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c280f3a-0da4-4ae8-95e6-e7e3380dd794 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:43.817193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:43.833355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:43.834847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:43.836062 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a6463ab-2e30-4048-a7ff-75235049ac22 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1565 microversion: 2.25 time: 0.374546 Aug 27 05:01:43.852264 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1081/2109] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:43 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1565 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:43.860671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-69478e63-fc8b-4f95-b747-a3e4343da2a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:43.861712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-69478e63-fc8b-4f95-b747-a3e4343da2a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:43.868951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69478e63-fc8b-4f95-b747-a3e4343da2a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:43.869725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69478e63-fc8b-4f95-b747-a3e4343da2a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:43.870313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69478e63-fc8b-4f95-b747-a3e4343da2a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:43.871207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69478e63-fc8b-4f95-b747-a3e4343da2a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:43.871954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69478e63-fc8b-4f95-b747-a3e4343da2a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:43.872607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69478e63-fc8b-4f95-b747-a3e4343da2a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:44.441706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-69478e63-fc8b-4f95-b747-a3e4343da2a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:44.454044 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-69478e63-fc8b-4f95-b747-a3e4343da2a6 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.600488 Aug 27 05:01:44.459354 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1082/2110] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:43 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:44.468108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:44.469427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:44.485446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:44.486226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:44.486914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:44.488476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:44.489962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:44.490585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:44.611946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:44.612862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:44.613639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:44.614291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lazy-loading 'fault' on Instance uuid 2014233b-011e-4437-afd0-68fbecdb4158 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:01:44.637436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5c280f3a-0da4-4ae8-95e6-e7e3380dd794 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:44.663011 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5c280f3a-0da4-4ae8-95e6-e7e3380dd794 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1663 microversion: 2.1 time: 1.156515 Aug 27 05:01:44.677368 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1029/2111] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:43 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1663 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:44.677368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-fedfa854-da2c-43fc-8289-791cac712c0e req-92311d5c-6f80-498a-9aa6-ca94248c4f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2014233b-011e-4437-afd0-68fbecdb4158", "name": "network-vif-deleted", "tag": "a670b863-8ae2-4980-a727-da85dced66a8"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:44.691483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fedfa854-da2c-43fc-8289-791cac712c0e req-92311d5c-6f80-498a-9aa6-ca94248c4f2a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:44.691977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fedfa854-da2c-43fc-8289-791cac712c0e req-92311d5c-6f80-498a-9aa6-ca94248c4f2a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:44.692416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fedfa854-da2c-43fc-8289-791cac712c0e req-92311d5c-6f80-498a-9aa6-ca94248c4f2a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:44.707903 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-fedfa854-da2c-43fc-8289-791cac712c0e req-92311d5c-6f80-498a-9aa6-ca94248c4f2a service nova] Creating event network-vif-deleted:a670b863-8ae2-4980-a727-da85dced66a8 for instance 2014233b-011e-4437-afd0-68fbecdb4158 on n-h2-820368-35 Aug 27 05:01:44.715514 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-fedfa854-da2c-43fc-8289-791cac712c0e req-92311d5c-6f80-498a-9aa6-ca94248c4f2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045771 Aug 27 05:01:44.716463 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1030/2112] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:44.722352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-89b86240-b371-434a-b258-1e88ada1a451 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:44.723064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-89b86240-b371-434a-b258-1e88ada1a451 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:44.730171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b86240-b371-434a-b258-1e88ada1a451 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:44.730670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b86240-b371-434a-b258-1e88ada1a451 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:44.731139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b86240-b371-434a-b258-1e88ada1a451 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:44.731864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b86240-b371-434a-b258-1e88ada1a451 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:44.732323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b86240-b371-434a-b258-1e88ada1a451 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:44.732753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b86240-b371-434a-b258-1e88ada1a451 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:44.740991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd34049995f544aa9a540062dedae56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7543ea6e54136897717d844333ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:44.755004 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a1c726a2-e27f-4565-bebd-044de1c6bff8 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 200 len: 1312 microversion: 2.1 time: 0.293594 Aug 27 05:01:44.756345 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1083/2113] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:44 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:44.866093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:44.872311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:44.879659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:44.880473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:44.881156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:44.882355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:44.883022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:44.883737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:45.252376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-89b86240-b371-434a-b258-1e88ada1a451 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:45.256921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:45.270354 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-89b86240-b371-434a-b258-1e88ada1a451 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1314 microversion: 2.1 time: 0.552325 Aug 27 05:01:45.271249 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1031/2114] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:44 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:45.359976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:45.379909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:45.385213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:45.386737 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2f6d3f40-6b4e-4b92-ba14-e0cd4456d334 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1565 microversion: 2.25 time: 0.524547 Aug 27 05:01:45.390693 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1084/2115] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:44 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1565 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:45.482047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dca247aa-845f-4024-b7d6-814624d9c079 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:45.482709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dca247aa-845f-4024-b7d6-814624d9c079 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:45.494695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dca247aa-845f-4024-b7d6-814624d9c079 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:45.495122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dca247aa-845f-4024-b7d6-814624d9c079 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:45.497641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dca247aa-845f-4024-b7d6-814624d9c079 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:45.499050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dca247aa-845f-4024-b7d6-814624d9c079 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:45.502204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dca247aa-845f-4024-b7d6-814624d9c079 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:45.502945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dca247aa-845f-4024-b7d6-814624d9c079 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:45.696766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae47d874-b4ec-40f3-b6f1-5a75b4a3530e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:45.697580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae47d874-b4ec-40f3-b6f1-5a75b4a3530e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:45.719509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae47d874-b4ec-40f3-b6f1-5a75b4a3530e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:45.721216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae47d874-b4ec-40f3-b6f1-5a75b4a3530e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:45.721909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae47d874-b4ec-40f3-b6f1-5a75b4a3530e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:45.726451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae47d874-b4ec-40f3-b6f1-5a75b4a3530e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:45.727386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae47d874-b4ec-40f3-b6f1-5a75b4a3530e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:45.729596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae47d874-b4ec-40f3-b6f1-5a75b4a3530e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:45.891537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae47d874-b4ec-40f3-b6f1-5a75b4a3530e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:45.912610 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae47d874-b4ec-40f3-b6f1-5a75b4a3530e tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1596 microversion: 2.1 time: 0.226782 Aug 27 05:01:45.920922 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1085/2116] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:45 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1596 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:45.928889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-524bc99a-0dd4-4732-a22a-a9442d7388de req-7b07d21c-2e54-426b-a22e-aab104a9048c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57a38fc-e317-4555-bba4-f2cedd73562d", "name": "network-vif-deleted", "tag": "5f3f4146-89cf-410e-80ce-9aa915641be8"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:45.957056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-524bc99a-0dd4-4732-a22a-a9442d7388de req-7b07d21c-2e54-426b-a22e-aab104a9048c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:45.961911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-524bc99a-0dd4-4732-a22a-a9442d7388de req-7b07d21c-2e54-426b-a22e-aab104a9048c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:45.962774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-524bc99a-0dd4-4732-a22a-a9442d7388de req-7b07d21c-2e54-426b-a22e-aab104a9048c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:46.020492 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-524bc99a-0dd4-4732-a22a-a9442d7388de req-7b07d21c-2e54-426b-a22e-aab104a9048c service nova] Creating event network-vif-deleted:5f3f4146-89cf-410e-80ce-9aa915641be8 for instance b57a38fc-e317-4555-bba4-f2cedd73562d on n-h2-820368-35 Aug 27 05:01:46.035778 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-524bc99a-0dd4-4732-a22a-a9442d7388de req-7b07d21c-2e54-426b-a22e-aab104a9048c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106933 Aug 27 05:01:46.036624 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1086/2117] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:46.046315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:46.048268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] [instance: 2014233b-011e-4437-afd0-68fbecdb4158] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:46.065235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:46.068867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:46.069881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:46.072718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:46.075318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:46.078192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:46.108708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dca247aa-845f-4024-b7d6-814624d9c079 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:46.122704 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dca247aa-845f-4024-b7d6-814624d9c079 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.642720 Aug 27 05:01:46.135904 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1032/2118] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:45 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] HTTP exception thrown: Instance 2014233b-011e-4437-afd0-68fbecdb4158 could not be found. Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Request method failure captured: Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 HTTP/1.1 Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaTw86ov9bvkrcpan3Jq2vFAEPB9k5AvIxKyxjOjd9RxOd-roWFgp3linku-nfYpKEN29fuTxP2w64fEoW08-RBXKGhZEXscAbChEfRbqU3rJ8doJU7yV62Zv8fkbbZlMAMFJRJd1q13ngz8c4ONIzDm-yC5507Q4HzUTWHI47O5NM0 Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 6fd7543ea6e54136897717d844333ff2 Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1022925349 Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6fd7543ea6e54136897717d844333ff2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6fd7543ea6e54136897717d844333ff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fd7543ea6e54136897717d844333ff2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fd7543ea6e54136897717d844333ff2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1022925349 Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 6fd7543ea6e54136897717d844333ff2 Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1022925349 Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersAdminNegativeTestJSON-1022925349-project Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: dd34049995f544aa9a540062dedae56c Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1022925349-project Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 2014233b-011e-4437-afd0-68fbecdb4158 could not be found. Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2014233b-011e-4437-afd0-68fbecdb4158'} Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2014233b-011e-4437-afd0-68fbecdb4158 could not be found. Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:46.135991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2014233b-011e-4437-afd0-68fbecdb4158 could not be found. Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2014233b-011e-4437-afd0-68fbecdb4158 could not be found. Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] Returning 404 to user: Instance 2014233b-011e-4437-afd0-68fbecdb4158 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3c1e94e2-b47a-4fc5-8ead-f02f3472b475 tempest-ServersAdminNegativeTestJSON-1022925349 tempest-ServersAdminNegativeTestJSON-1022925349-project] 10.222.0.58 "GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158" status: 404 len: 111 microversion: 2.1 time: 0.100054 Aug 27 05:01:46.144753 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1087/2119] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:46 2022] GET /compute/v2.1/servers/2014233b-011e-4437-afd0-68fbecdb4158 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:46.171782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-04fd5efb-d3c0-45de-80cf-96e642d16570 req-31ccfc2f-2003-4c82-9c92-bf088df1506b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1041d0f9-34d3-4bed-b1fb-8a198135f234", "name": "network-vif-plugged", "status": "completed", "tag": "e423b874-4ad6-4501-bb4c-7947a4798049"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:46.197223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-04fd5efb-d3c0-45de-80cf-96e642d16570 req-31ccfc2f-2003-4c82-9c92-bf088df1506b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:46.197702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-04fd5efb-d3c0-45de-80cf-96e642d16570 req-31ccfc2f-2003-4c82-9c92-bf088df1506b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:46.205595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-04fd5efb-d3c0-45de-80cf-96e642d16570 req-31ccfc2f-2003-4c82-9c92-bf088df1506b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:46.238936 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-04fd5efb-d3c0-45de-80cf-96e642d16570 req-31ccfc2f-2003-4c82-9c92-bf088df1506b service nova] Creating event network-vif-plugged:e423b874-4ad6-4501-bb4c-7947a4798049 for instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 on n-h2-820368-35 Aug 27 05:01:46.259820 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-04fd5efb-d3c0-45de-80cf-96e642d16570 req-31ccfc2f-2003-4c82-9c92-bf088df1506b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129972 Aug 27 05:01:46.274738 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1033/2120] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:46.297469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24e5d880-12e4-42f2-863c-68a7e5ca2ea5 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:46.298596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-24e5d880-12e4-42f2-863c-68a7e5ca2ea5 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:46.309733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24e5d880-12e4-42f2-863c-68a7e5ca2ea5 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:46.310488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24e5d880-12e4-42f2-863c-68a7e5ca2ea5 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:46.311176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24e5d880-12e4-42f2-863c-68a7e5ca2ea5 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:46.315349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24e5d880-12e4-42f2-863c-68a7e5ca2ea5 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:46.316370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24e5d880-12e4-42f2-863c-68a7e5ca2ea5 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:46.317087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24e5d880-12e4-42f2-863c-68a7e5ca2ea5 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:46.415733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:46.416456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:46.427561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:46.429421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:46.429870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:46.433527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:46.434012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:46.435624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:46.541122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:46.542402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:46.543006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:46.543688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lazy-loading 'fault' on Instance uuid b57a38fc-e317-4555-bba4-f2cedd73562d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:01:46.953981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:46.976820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:46.980191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d4fe4aaf864bb58c162620c9948d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7422cdaca490aaffc4004f77d830c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:46.985738 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3b38a7c0-c770-4476-9ec6-4073b5627265 tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 200 len: 1352 microversion: 2.25 time: 0.574401 Aug 27 05:01:46.991365 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1034/2121] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:46 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 1352 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:47.007483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-24e5d880-12e4-42f2-863c-68a7e5ca2ea5 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:47.011498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-71767df3-afa6-4129-8ff7-6ee0263bd0d5 req-2fb1f58c-96f9-4b19-a771-3f758099c509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa8507d-68a8-41bb-95b8-7cae5c5e7216", "name": "network-vif-deleted", "tag": "251ac4eb-fa7e-4c6a-9b51-d6264fbc8ca4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:47.020488 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-24e5d880-12e4-42f2-863c-68a7e5ca2ea5 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1314 microversion: 2.1 time: 0.727407 Aug 27 05:01:47.032161 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1088/2122] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:46 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:47.042615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:47.043542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:47.057465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-71767df3-afa6-4129-8ff7-6ee0263bd0d5 req-2fb1f58c-96f9-4b19-a771-3f758099c509 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:47.060429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-71767df3-afa6-4129-8ff7-6ee0263bd0d5 req-2fb1f58c-96f9-4b19-a771-3f758099c509 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:47.071874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:47.072379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:47.072826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:47.077651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:47.079028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-71767df3-afa6-4129-8ff7-6ee0263bd0d5 req-2fb1f58c-96f9-4b19-a771-3f758099c509 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:47.083204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:47.084058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:47.170053 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-71767df3-afa6-4129-8ff7-6ee0263bd0d5 req-2fb1f58c-96f9-4b19-a771-3f758099c509 service nova] Creating event network-vif-deleted:251ac4eb-fa7e-4c6a-9b51-d6264fbc8ca4 for instance 7fa8507d-68a8-41bb-95b8-7cae5c5e7216 on n-h1-820368-35 Aug 27 05:01:47.190952 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-71767df3-afa6-4129-8ff7-6ee0263bd0d5 req-2fb1f58c-96f9-4b19-a771-3f758099c509 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195233 Aug 27 05:01:47.193333 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1035/2123] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:47.205791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:47.206258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:47.206706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:47.210520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-496e9a75-13b1-4d3e-bf39-afcad2597191 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:47.211564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lazy-loading 'fault' on Instance uuid 7fa8507d-68a8-41bb-95b8-7cae5c5e7216 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:01:47.213567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-496e9a75-13b1-4d3e-bf39-afcad2597191 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:47.229344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-496e9a75-13b1-4d3e-bf39-afcad2597191 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:47.235360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-496e9a75-13b1-4d3e-bf39-afcad2597191 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:47.236678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-496e9a75-13b1-4d3e-bf39-afcad2597191 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:47.238812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-496e9a75-13b1-4d3e-bf39-afcad2597191 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:47.240765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-496e9a75-13b1-4d3e-bf39-afcad2597191 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:47.242512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-496e9a75-13b1-4d3e-bf39-afcad2597191 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:47.318802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efec2d2acb54894b87d63ff5f2c8238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32eb94d0f645c8b93736aa9cbca4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:47.340724 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0b24684e-0889-42e6-85e5-1074f756d8d8 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 200 len: 1315 microversion: 2.1 time: 0.307026 Aug 27 05:01:47.341615 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1089/2124] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:47 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:47.497272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-496e9a75-13b1-4d3e-bf39-afcad2597191 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:47.517199 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-496e9a75-13b1-4d3e-bf39-afcad2597191 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.320757 Aug 27 05:01:47.520126 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1036/2125] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:47 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:48.019971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:48.020592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] [instance: b57a38fc-e317-4555-bba4-f2cedd73562d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:48.040205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:48.040888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:48.041402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:48.042281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:48.042759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:48.043665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:48.060254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a836b472-5e63-479e-89ae-7d3046cfc7cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:48.060916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a836b472-5e63-479e-89ae-7d3046cfc7cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:48.062178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] HTTP exception thrown: Instance b57a38fc-e317-4555-bba4-f2cedd73562d could not be found. Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Request method failure captured: Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d HTTP/1.1 Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaL0kD74fFlji4BayTy6rNAk62Up0r0shWNUA_hDsDid_cu5nC_4SdKXv21GckDyUIA9YsEIT6SVinK8DsWo_p2MkDLQS_iXCB4qfYrSYH8yjwbMWZedy6EwIDt4HeRjlNOHnzkB2c_JLOS9x0R4wfAzTmLvfz2MQ_oNh_7qno0UmxE Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: f5c7422cdaca490aaffc4004f77d830c Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5c7422cdaca490aaffc4004f77d830c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5c7422cdaca490aaffc4004f77d830c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: f5c7422cdaca490aaffc4004f77d830c Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-204101716 Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-LiveAutoBlockMigrationV225Test-204101716-project Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: b7d4fe4aaf864bb58c162620c9948d89 Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-204101716-project Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance b57a38fc-e317-4555-bba4-f2cedd73562d could not be found. Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'b57a38fc-e317-4555-bba4-f2cedd73562d'} Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57a38fc-e317-4555-bba4-f2cedd73562d could not be found. Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57a38fc-e317-4555-bba4-f2cedd73562d could not be found. Aug 27 05:01:48.064534 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:48.068941 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:48.068941 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:48.068941 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:48.068941 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:48.068941 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:48.068941 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:48.068941 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:48.068941 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57a38fc-e317-4555-bba4-f2cedd73562d could not be found. Aug 27 05:01:48.068941 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:48.070939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] Returning 404 to user: Instance b57a38fc-e317-4555-bba4-f2cedd73562d could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:48.072688 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9fc11ad7-37bb-4729-891f-a49bb2d29c1f tempest-LiveAutoBlockMigrationV225Test-204101716 tempest-LiveAutoBlockMigrationV225Test-204101716-project] 10.222.0.58 "GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d" status: 404 len: 111 microversion: 2.25 time: 0.058973 Aug 27 05:01:48.074139 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1090/2126] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:48 2022] GET /compute/v2.1/servers/b57a38fc-e317-4555-bba4-f2cedd73562d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:01:48.079963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a836b472-5e63-479e-89ae-7d3046cfc7cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:48.081024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a836b472-5e63-479e-89ae-7d3046cfc7cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:48.082834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a836b472-5e63-479e-89ae-7d3046cfc7cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:48.084569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a836b472-5e63-479e-89ae-7d3046cfc7cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:48.086606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a836b472-5e63-479e-89ae-7d3046cfc7cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:48.089340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a836b472-5e63-479e-89ae-7d3046cfc7cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:48.362531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:48.363452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] [instance: 7fa8507d-68a8-41bb-95b8-7cae5c5e7216] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:48.381345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:48.387452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:48.392245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:48.392702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:48.393481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:48.397568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:48.398091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:48.445849 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] HTTP exception thrown: Instance 7fa8507d-68a8-41bb-95b8-7cae5c5e7216 could not be found. Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Request method failure captured: Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 HTTP/1.1 Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaSx_7oN3BJV3F7hLJT51Yv_y7Z7p6Xfb1ze793WXGLNs8Finy4fwpkaxyD1pLdTbMn3c4N-GNGhq90qlWuqpIDTeUHjJRVJiU0bxeIk3Flmrokp306aueQFaVJmVU-75cFysK21naRxcmWEEfb4Dxiiub5L5_-ghYEjfV-7Ncxo2as Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 6f32eb94d0f645c8b93736aa9cbca4ac Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestFqdnHostnames-1977716470 Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f32eb94d0f645c8b93736aa9cbca4ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f32eb94d0f645c8b93736aa9cbca4ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f32eb94d0f645c8b93736aa9cbca4ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f32eb94d0f645c8b93736aa9cbca4ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestFqdnHostnames-1977716470 Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 6f32eb94d0f645c8b93736aa9cbca4ac Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1977716470 Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestFqdnHostnames-1977716470-project Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 4efec2d2acb54894b87d63ff5f2c8238 Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestFqdnHostnames-1977716470-project Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 7fa8507d-68a8-41bb-95b8-7cae5c5e7216 could not be found. Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '7fa8507d-68a8-41bb-95b8-7cae5c5e7216'} Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa8507d-68a8-41bb-95b8-7cae5c5e7216 could not be found. Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa8507d-68a8-41bb-95b8-7cae5c5e7216 could not be found. Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:48.450269 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:48.454599 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:48.454599 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:48.454599 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:48.454599 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:48.454599 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:48.454599 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa8507d-68a8-41bb-95b8-7cae5c5e7216 could not be found. Aug 27 05:01:48.454599 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:48.454599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Returning 404 to user: Instance 7fa8507d-68a8-41bb-95b8-7cae5c5e7216 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:48.454599 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8482c09e-fe4e-4fb4-8800-12c79e9fe9c3 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216" status: 404 len: 111 microversion: 2.1 time: 0.094809 Aug 27 05:01:48.459425 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1091/2127] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:48 2022] GET /compute/v2.1/servers/7fa8507d-68a8-41bb-95b8-7cae5c5e7216 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:01:48.472586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-69a9a1a4-ee16-45bb-8e15-d3c9ad14a322 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] Calling method '.version_select at 0x7fb56562a1f0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:48.517418 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-69a9a1a4-ee16-45bb-8e15-d3c9ad14a322 tempest-ServersTestFqdnHostnames-1977716470 tempest-ServersTestFqdnHostnames-1977716470-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-615069309" status: 202 len: 0 microversion: 2.1 time: 0.056113 Aug 27 05:01:48.519161 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1092/2128] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 05:01:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-615069309 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:01:48.548306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-84c38a2e-2051-4a36-a74c-46088a319dcb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:48.549728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a836b472-5e63-479e-89ae-7d3046cfc7cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:48.550561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-84c38a2e-2051-4a36-a74c-46088a319dcb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:48.564359 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a836b472-5e63-479e-89ae-7d3046cfc7cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1314 microversion: 2.1 time: 0.508396 Aug 27 05:01:48.566727 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1037/2129] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:48 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:48.576903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c38a2e-2051-4a36-a74c-46088a319dcb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:48.578922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c38a2e-2051-4a36-a74c-46088a319dcb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:48.580349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c38a2e-2051-4a36-a74c-46088a319dcb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:48.582664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c38a2e-2051-4a36-a74c-46088a319dcb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:48.586172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c38a2e-2051-4a36-a74c-46088a319dcb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:48.589763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c38a2e-2051-4a36-a74c-46088a319dcb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:49.267025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-84c38a2e-2051-4a36-a74c-46088a319dcb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:49.283121 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-84c38a2e-2051-4a36-a74c-46088a319dcb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.740310 Aug 27 05:01:49.289804 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1093/2130] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:48 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:49.589447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf81f608-d443-41c0-afae-56884054dfea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:49.590664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf81f608-d443-41c0-afae-56884054dfea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:49.600383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:49.604779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf81f608-d443-41c0-afae-56884054dfea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:49.609090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf81f608-d443-41c0-afae-56884054dfea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:49.609897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf81f608-d443-41c0-afae-56884054dfea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:49.611395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf81f608-d443-41c0-afae-56884054dfea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:49.612043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf81f608-d443-41c0-afae-56884054dfea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:49.612622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf81f608-d443-41c0-afae-56884054dfea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:50.052165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bf81f608-d443-41c0-afae-56884054dfea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:50.067451 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf81f608-d443-41c0-afae-56884054dfea tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1501 microversion: 2.1 time: 0.482745 Aug 27 05:01:50.070433 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1038/2131] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:49 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1501 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:50.092071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5120f14c-34da-4d58-8bea-ca65a4affe6b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:50.093978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5120f14c-34da-4d58-8bea-ca65a4affe6b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:50.104966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5120f14c-34da-4d58-8bea-ca65a4affe6b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:50.106882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5120f14c-34da-4d58-8bea-ca65a4affe6b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:50.108026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5120f14c-34da-4d58-8bea-ca65a4affe6b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:50.110686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5120f14c-34da-4d58-8bea-ca65a4affe6b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:50.115979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5120f14c-34da-4d58-8bea-ca65a4affe6b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:50.116600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5120f14c-34da-4d58-8bea-ca65a4affe6b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:50.173410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5120f14c-34da-4d58-8bea-ca65a4affe6b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:01:50.312208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e20ca6ad-5f64-4cb3-a6bf-268f14ec27a4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:50.312856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e20ca6ad-5f64-4cb3-a6bf-268f14ec27a4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:50.323072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e20ca6ad-5f64-4cb3-a6bf-268f14ec27a4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:50.323601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e20ca6ad-5f64-4cb3-a6bf-268f14ec27a4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:50.326752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e20ca6ad-5f64-4cb3-a6bf-268f14ec27a4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:50.330650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e20ca6ad-5f64-4cb3-a6bf-268f14ec27a4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:50.338982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e20ca6ad-5f64-4cb3-a6bf-268f14ec27a4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:50.339834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e20ca6ad-5f64-4cb3-a6bf-268f14ec27a4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:50.466750 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5120f14c-34da-4d58-8bea-ca65a4affe6b tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 204 len: 0 microversion: 2.1 time: 0.377481 Aug 27 05:01:50.474435 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1094/2132] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:01:50 2022] DELETE /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:01:50.483228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a8d4378f-9360-43a4-b292-1944427102cd tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:50.486089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a8d4378f-9360-43a4-b292-1944427102cd tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:50.493925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4378f-9360-43a4-b292-1944427102cd tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:50.495668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4378f-9360-43a4-b292-1944427102cd tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:50.499257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4378f-9360-43a4-b292-1944427102cd tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:50.499257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4378f-9360-43a4-b292-1944427102cd tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:50.499257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4378f-9360-43a4-b292-1944427102cd tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:50.499257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4378f-9360-43a4-b292-1944427102cd tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:50.762722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a8d4378f-9360-43a4-b292-1944427102cd tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:50.776255 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a8d4378f-9360-43a4-b292-1944427102cd tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1507 microversion: 2.1 time: 0.298704 Aug 27 05:01:50.777178 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1095/2133] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:50 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1507 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:51.163016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e20ca6ad-5f64-4cb3-a6bf-268f14ec27a4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:51.171924 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e20ca6ad-5f64-4cb3-a6bf-268f14ec27a4 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.863503 Aug 27 05:01:51.187683 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1039/2134] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:50 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:51.804971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-797a554e-115a-4883-86d4-f14b19a7b8cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:51.806138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-797a554e-115a-4883-86d4-f14b19a7b8cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:51.818302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-797a554e-115a-4883-86d4-f14b19a7b8cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:51.828115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-797a554e-115a-4883-86d4-f14b19a7b8cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:51.828944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-797a554e-115a-4883-86d4-f14b19a7b8cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:51.829871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-797a554e-115a-4883-86d4-f14b19a7b8cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:51.830600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-797a554e-115a-4883-86d4-f14b19a7b8cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:51.831250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-797a554e-115a-4883-86d4-f14b19a7b8cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:52.200778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b64678a-bef1-404f-be11-2caa1295e1d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:52.201394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b64678a-bef1-404f-be11-2caa1295e1d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:52.222151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b64678a-bef1-404f-be11-2caa1295e1d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:52.222756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b64678a-bef1-404f-be11-2caa1295e1d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:52.223246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b64678a-bef1-404f-be11-2caa1295e1d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:52.224003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b64678a-bef1-404f-be11-2caa1295e1d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:52.224466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b64678a-bef1-404f-be11-2caa1295e1d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:52.224893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b64678a-bef1-404f-be11-2caa1295e1d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:52.989324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-797a554e-115a-4883-86d4-f14b19a7b8cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:53.006273 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-797a554e-115a-4883-86d4-f14b19a7b8cf tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1507 microversion: 2.1 time: 1.211780 Aug 27 05:01:53.021530 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1096/2135] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:51 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1507 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:53.336525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b64678a-bef1-404f-be11-2caa1295e1d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:53.362899 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b64678a-bef1-404f-be11-2caa1295e1d8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 1.164976 Aug 27 05:01:53.370032 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1040/2136] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:52 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:54.029597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c37eddda-ea17-44a3-89fd-620f984b3036 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:54.031385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c37eddda-ea17-44a3-89fd-620f984b3036 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:54.052994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37eddda-ea17-44a3-89fd-620f984b3036 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:54.053525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37eddda-ea17-44a3-89fd-620f984b3036 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:54.057266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37eddda-ea17-44a3-89fd-620f984b3036 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:54.060680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37eddda-ea17-44a3-89fd-620f984b3036 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:54.061174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37eddda-ea17-44a3-89fd-620f984b3036 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:54.063451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c37eddda-ea17-44a3-89fd-620f984b3036 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:54.164122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2bb43eca-6869-491a-ad33-0d90a1389a99 req-58b8dd61-6cca-4bef-bb02-0e1e2e38c0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1041d0f9-34d3-4bed-b1fb-8a198135f234", "name": "network-vif-deleted", "tag": "e423b874-4ad6-4501-bb4c-7947a4798049"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:54.197338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2bb43eca-6869-491a-ad33-0d90a1389a99 req-58b8dd61-6cca-4bef-bb02-0e1e2e38c0bb service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:54.203836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2bb43eca-6869-491a-ad33-0d90a1389a99 req-58b8dd61-6cca-4bef-bb02-0e1e2e38c0bb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:54.204850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2bb43eca-6869-491a-ad33-0d90a1389a99 req-58b8dd61-6cca-4bef-bb02-0e1e2e38c0bb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:54.253624 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2bb43eca-6869-491a-ad33-0d90a1389a99 req-58b8dd61-6cca-4bef-bb02-0e1e2e38c0bb service nova] Creating event network-vif-deleted:e423b874-4ad6-4501-bb4c-7947a4798049 for instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 on n-h2-820368-35 Aug 27 05:01:54.273522 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2bb43eca-6869-491a-ad33-0d90a1389a99 req-58b8dd61-6cca-4bef-bb02-0e1e2e38c0bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113241 Aug 27 05:01:54.274181 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1041/2137] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:54.401155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6e38cb8b-7e4b-4be3-9105-74ce0d942934 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:54.401868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6e38cb8b-7e4b-4be3-9105-74ce0d942934 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:54.420505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e38cb8b-7e4b-4be3-9105-74ce0d942934 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:54.428696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e38cb8b-7e4b-4be3-9105-74ce0d942934 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:54.429369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e38cb8b-7e4b-4be3-9105-74ce0d942934 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:54.433929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e38cb8b-7e4b-4be3-9105-74ce0d942934 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:54.434582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e38cb8b-7e4b-4be3-9105-74ce0d942934 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:54.435231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e38cb8b-7e4b-4be3-9105-74ce0d942934 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:54.844653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c37eddda-ea17-44a3-89fd-620f984b3036 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b25148fe994d42a4b0a98ccbcf4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee77055a2a4ab19b6a5115dcbd97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:54.867437 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c37eddda-ea17-44a3-89fd-620f984b3036 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 200 len: 1465 microversion: 2.1 time: 0.842531 Aug 27 05:01:54.868094 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1097/2138] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:54 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 1465 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:55.370231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6e38cb8b-7e4b-4be3-9105-74ce0d942934 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:55.386540 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6e38cb8b-7e4b-4be3-9105-74ce0d942934 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.990006 Aug 27 05:01:55.391818 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1042/2139] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:54 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:55.897249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:55.897956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:55.911231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:55.916484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:55.917343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:55.918330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:55.919018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:55.919622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.002396 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] HTTP exception thrown: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Request method failure captured: Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 HTTP/1.1 Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaUlQt3kNvF-RXCury_pctl_5__HVa2HT2Eq4aNeerHFO3FrJngK5Vq7bpfYWGDhR_Dri5u-vc2wk8jlWLhcE6VTYQZopehYaAssxTxKq9xlrhMX1p6dwff4LO6YhBLxIfrn__p7PEtcl5q67ZHuHUC40rIYqAWbe-2H7_viwt_e2nA Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7ee77055a2a4ab19b6a5115dcbd97e7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 89b25148fe994d42a4b0a98ccbcf4b70 Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '1041d0f9-34d3-4bed-b1fb-8a198135f234'} Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.013767 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.017307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.017307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.017307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.017307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:56.017307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:56.017307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.017307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.017307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Returning 404 to user: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:56.017307 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6d85b58d-7f7f-460b-ac31-295cb50a7812 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 404 len: 111 microversion: 2.1 time: 0.122375 Aug 27 05:01:56.023264 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1098/2140] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:55 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:56.032515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1302087227", "metadata": {"image_type": "test"}}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:56.035216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:56.054925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.055531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.055927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.060650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.061232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.061687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.115834 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] HTTP exception thrown: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Request method failure captured: Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234/action HTTP/1.1 Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 112 Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaUlQt3kNvF-RXCury_pctl_5__HVa2HT2Eq4aNeerHFO3FrJngK5Vq7bpfYWGDhR_Dri5u-vc2wk8jlWLhcE6VTYQZopehYaAssxTxKq9xlrhMX1p6dwff4LO6YhBLxIfrn__p7PEtcl5q67ZHuHUC40rIYqAWbe-2H7_viwt_e2nA Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7ee77055a2a4ab19b6a5115dcbd97e7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 89b25148fe994d42a4b0a98ccbcf4b70 Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1302087227", "metadata": {"image_type": "test"}}} Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '1041d0f9-34d3-4bed-b1fb-8a198135f234', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1302087227', 'metadata': {'image_type': 'test'}}}} Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1339, in _action_create_image Aug 27 05:01:56.124000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.130521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Returning 404 to user: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:56.133200 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a820dddd-56e7-440f-be0c-fcdbf7d135fe tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "POST /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234/action" status: 404 len: 111 microversion: 2.1 time: 0.105021 Aug 27 05:01:56.134392 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1043/2141] 10.222.0.58 () {60 vars in 1279 bytes} [Sat Aug 27 05:01:56 2022] POST /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234/action => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:56.146863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6784c0c9-afec-4716-ae3b-e6733d545627 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1848675995", "metadata": {"image_type": "test"}}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:56.151423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6784c0c9-afec-4716-ae3b-e6733d545627 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Failed to fetch instance by id tempest-invalid-574097605 {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 05:01:56.152931 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-6784c0c9-afec-4716-ae3b-e6733d545627 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] HTTP exception thrown: Instance tempest-invalid-574097605 could not be found. Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6784c0c9-afec-4716-ae3b-e6733d545627 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Request method failure captured: Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/tempest-invalid-574097605/action HTTP/1.1 Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 112 Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaUlQt3kNvF-RXCury_pctl_5__HVa2HT2Eq4aNeerHFO3FrJngK5Vq7bpfYWGDhR_Dri5u-vc2wk8jlWLhcE6VTYQZopehYaAssxTxKq9xlrhMX1p6dwff4LO6YhBLxIfrn__p7PEtcl5q67ZHuHUC40rIYqAWbe-2H7_viwt_e2nA Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7ee77055a2a4ab19b6a5115dcbd97e7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 89b25148fe994d42a4b0a98ccbcf4b70 Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1848675995", "metadata": {"image_type": "test"}}} Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance tempest-invalid-574097605 could not be found. Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'tempest-invalid-574097605', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1848675995', 'metadata': {'image_type': 'test'}}}} Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-574097605 could not be found. Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1339, in _action_create_image Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:56.159118 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-574097605 could not be found. Aug 27 05:01:56.165465 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.165465 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.165465 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.165465 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.165465 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.165465 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.165465 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:56.165465 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:56.165465 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-574097605 could not be found. Aug 27 05:01:56.165465 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.166921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6784c0c9-afec-4716-ae3b-e6733d545627 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Returning 404 to user: Instance tempest-invalid-574097605 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:56.170370 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6784c0c9-afec-4716-ae3b-e6733d545627 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "POST /compute/v2.1/servers/tempest-invalid-574097605/action" status: 404 len: 100 microversion: 2.1 time: 0.028986 Aug 27 05:01:56.176523 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1099/2142] 10.222.0.58 () {60 vars in 1246 bytes} [Sat Aug 27 05:01:56 2022] POST /compute/v2.1/servers/tempest-invalid-574097605/action => generated 100 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:56.187434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-74b4ee88-eeed-466d-b5c0-931b14ba895d tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-123035933"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:56.190934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-74b4ee88-eeed-466d-b5c0-931b14ba895d tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 05:01:56.191521 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-74b4ee88-eeed-466d-b5c0-931b14ba895d tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-74b4ee88-eeed-466d-b5c0-931b14ba895d tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Request method failure captured: Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 56 Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaUlQt3kNvF-RXCury_pctl_5__HVa2HT2Eq4aNeerHFO3FrJngK5Vq7bpfYWGDhR_Dri5u-vc2wk8jlWLhcE6VTYQZopehYaAssxTxKq9xlrhMX1p6dwff4LO6YhBLxIfrn__p7PEtcl5q67ZHuHUC40rIYqAWbe-2H7_viwt_e2nA Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7ee77055a2a4ab19b6a5115dcbd97e7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 89b25148fe994d42a4b0a98ccbcf4b70 Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: {"createImage": {"name": "tempest-test-snap-123035933"}} Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-123035933'}}} Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1339, in _action_create_image Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 05:01:56.201846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.206163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.206163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.206163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.206163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.206163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.206163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:56.206163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:56.206163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 05:01:56.206163 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.208625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-74b4ee88-eeed-466d-b5c0-931b14ba895d tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:56.210670 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-74b4ee88-eeed-466d-b5c0-931b14ba895d tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.028221 Aug 27 05:01:56.223856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-806b982b-e8af-479b-abe8-c8cc916dd6ac tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-396861567"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:56.226351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-806b982b-e8af-479b-abe8-c8cc916dd6ac tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 05:01:56.227854 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1044/2143] 10.222.0.58 () {60 vars in 1275 bytes} [Sat Aug 27 05:01:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:56.228490 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-806b982b-e8af-479b-abe8-c8cc916dd6ac tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-806b982b-e8af-479b-abe8-c8cc916dd6ac tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Request method failure captured: Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 56 Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaUlQt3kNvF-RXCury_pctl_5__HVa2HT2Eq4aNeerHFO3FrJngK5Vq7bpfYWGDhR_Dri5u-vc2wk8jlWLhcE6VTYQZopehYaAssxTxKq9xlrhMX1p6dwff4LO6YhBLxIfrn__p7PEtcl5q67ZHuHUC40rIYqAWbe-2H7_viwt_e2nA Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7ee77055a2a4ab19b6a5115dcbd97e7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 89b25148fe994d42a4b0a98ccbcf4b70 Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: {"createImage": {"name": "tempest-test-snap-396861567"}} Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-396861567'}}} Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1339, in _action_create_image Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 05:01:56.233550 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.238171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.238171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.238171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.238171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.238171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.238171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:56.238171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:56.238171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 05:01:56.238171 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.242434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-806b982b-e8af-479b-abe8-c8cc916dd6ac tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:56.255628 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-806b982b-e8af-479b-abe8-c8cc916dd6ac tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.036818 Aug 27 05:01:56.264291 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1100/2144] 10.222.0.58 () {60 vars in 1281 bytes} [Sat Aug 27 05:01:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:01:56.282675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:56.283212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:56.317198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.317708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.318156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.332906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.333420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.333882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.393612 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] HTTP exception thrown: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Request method failure captured: Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 HTTP/1.1 Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaUlQt3kNvF-RXCury_pctl_5__HVa2HT2Eq4aNeerHFO3FrJngK5Vq7bpfYWGDhR_Dri5u-vc2wk8jlWLhcE6VTYQZopehYaAssxTxKq9xlrhMX1p6dwff4LO6YhBLxIfrn__p7PEtcl5q67ZHuHUC40rIYqAWbe-2H7_viwt_e2nA Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7ee77055a2a4ab19b6a5115dcbd97e7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 89b25148fe994d42a4b0a98ccbcf4b70 Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '1041d0f9-34d3-4bed-b1fb-8a198135f234'} Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:56.397236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.401575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Returning 404 to user: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:56.408435 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6ead8b1e-8e1e-4bf3-9666-7b4b36d0b973 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 404 len: 111 microversion: 2.1 time: 0.137905 Aug 27 05:01:56.408511 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1045/2145] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:01:56 2022] DELETE /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:56.416777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b22ad5e3-02b5-4847-95f9-fcc85fdf7476 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:56.417635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b22ad5e3-02b5-4847-95f9-fcc85fdf7476 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:56.427117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:56.434730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] [instance: 1041d0f9-34d3-4bed-b1fb-8a198135f234] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:56.443028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b22ad5e3-02b5-4847-95f9-fcc85fdf7476 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.444198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b22ad5e3-02b5-4847-95f9-fcc85fdf7476 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.448144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b22ad5e3-02b5-4847-95f9-fcc85fdf7476 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.451780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b22ad5e3-02b5-4847-95f9-fcc85fdf7476 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.453216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b22ad5e3-02b5-4847-95f9-fcc85fdf7476 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.455763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b22ad5e3-02b5-4847-95f9-fcc85fdf7476 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.475478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.476011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.476480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.479128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:56.486461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.486982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.488714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.554235 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] HTTP exception thrown: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Request method failure captured: Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 HTTP/1.1 Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaUlQt3kNvF-RXCury_pctl_5__HVa2HT2Eq4aNeerHFO3FrJngK5Vq7bpfYWGDhR_Dri5u-vc2wk8jlWLhcE6VTYQZopehYaAssxTxKq9xlrhMX1p6dwff4LO6YhBLxIfrn__p7PEtcl5q67ZHuHUC40rIYqAWbe-2H7_viwt_e2nA Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7ee77055a2a4ab19b6a5115dcbd97e7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7ee77055a2a4ab19b6a5115dcbd97e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d7ee77055a2a4ab19b6a5115dcbd97e7 Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1015712880 Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 89b25148fe994d42a4b0a98ccbcf4b70 Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesNegativeTestJSON-1015712880-project Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '1041d0f9-34d3-4bed-b1fb-8a198135f234'} Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:56.559546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.563307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:56.563307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:56.563307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:56.563307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:56.563307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:56.563307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. Aug 27 05:01:56.563307 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:01:56.563307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] Returning 404 to user: Instance 1041d0f9-34d3-4bed-b1fb-8a198135f234 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:56.564423 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-69f766b0-d829-4179-a3cb-36affc5dd257 tempest-ImagesNegativeTestJSON-1015712880 tempest-ImagesNegativeTestJSON-1015712880-project] 10.222.0.58 "GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234" status: 404 len: 111 microversion: 2.1 time: 0.141963 Aug 27 05:01:56.567400 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1046/2146] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:56 2022] GET /compute/v2.1/servers/1041d0f9-34d3-4bed-b1fb-8a198135f234 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:58.022049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b22ad5e3-02b5-4847-95f9-fcc85fdf7476 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:58.035222 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b22ad5e3-02b5-4847-95f9-fcc85fdf7476 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 1.620737 Aug 27 05:01:58.049804 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1101/2147] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:56 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:59.060139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e71cc58a-3b1f-4348-aeb1-ff46c07aa059 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:59.063524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e71cc58a-3b1f-4348-aeb1-ff46c07aa059 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:59.087563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e71cc58a-3b1f-4348-aeb1-ff46c07aa059 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:59.088563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e71cc58a-3b1f-4348-aeb1-ff46c07aa059 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:59.089291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e71cc58a-3b1f-4348-aeb1-ff46c07aa059 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:59.090898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e71cc58a-3b1f-4348-aeb1-ff46c07aa059 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:59.094260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e71cc58a-3b1f-4348-aeb1-ff46c07aa059 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:59.095304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e71cc58a-3b1f-4348-aeb1-ff46c07aa059 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:59.918489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e71cc58a-3b1f-4348-aeb1-ff46c07aa059 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:59.927698 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e71cc58a-3b1f-4348-aeb1-ff46c07aa059 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.874395 Aug 27 05:01:59.943657 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1047/2148] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:59 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:00.956333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-20b7861a-b414-4000-9929-c8619cc17b4e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:00.957822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-20b7861a-b414-4000-9929-c8619cc17b4e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:00.980136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b7861a-b414-4000-9929-c8619cc17b4e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:00.983049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b7861a-b414-4000-9929-c8619cc17b4e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:00.984583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b7861a-b414-4000-9929-c8619cc17b4e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:00.988623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b7861a-b414-4000-9929-c8619cc17b4e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:00.989307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b7861a-b414-4000-9929-c8619cc17b4e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:00.991197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b7861a-b414-4000-9929-c8619cc17b4e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:01.822013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-20b7861a-b414-4000-9929-c8619cc17b4e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:01.835210 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-20b7861a-b414-4000-9929-c8619cc17b4e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.883569 Aug 27 05:02:01.836344 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1102/2149] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:00 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:02.858783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e9d6b53f-2eca-469d-82d1-ffd991a7db8a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:02.868526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e9d6b53f-2eca-469d-82d1-ffd991a7db8a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:02.891556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9d6b53f-2eca-469d-82d1-ffd991a7db8a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:02.893592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9d6b53f-2eca-469d-82d1-ffd991a7db8a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:02.897281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9d6b53f-2eca-469d-82d1-ffd991a7db8a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:02.898332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9d6b53f-2eca-469d-82d1-ffd991a7db8a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:02.898982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9d6b53f-2eca-469d-82d1-ffd991a7db8a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:02.900209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9d6b53f-2eca-469d-82d1-ffd991a7db8a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:03.720690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e9d6b53f-2eca-469d-82d1-ffd991a7db8a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:03.729284 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e9d6b53f-2eca-469d-82d1-ffd991a7db8a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.875605 Aug 27 05:02:03.729869 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1048/2150] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:02 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:04.756514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-605bd26d-f536-4418-827a-6b2d60e2bf1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:04.758344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-605bd26d-f536-4418-827a-6b2d60e2bf1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:04.775648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-605bd26d-f536-4418-827a-6b2d60e2bf1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:04.777492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-605bd26d-f536-4418-827a-6b2d60e2bf1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:04.779608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-605bd26d-f536-4418-827a-6b2d60e2bf1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:04.782273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-605bd26d-f536-4418-827a-6b2d60e2bf1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:04.783044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-605bd26d-f536-4418-827a-6b2d60e2bf1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:04.784819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-605bd26d-f536-4418-827a-6b2d60e2bf1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:05.651690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-605bd26d-f536-4418-827a-6b2d60e2bf1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:05.663393 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-605bd26d-f536-4418-827a-6b2d60e2bf1b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.912738 Aug 27 05:02:05.674954 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1103/2151] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:04 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:06.697388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e2d5745-e878-430d-8ad3-84b3231d1089 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:06.698267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e2d5745-e878-430d-8ad3-84b3231d1089 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:06.711909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e2d5745-e878-430d-8ad3-84b3231d1089 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:06.719350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e2d5745-e878-430d-8ad3-84b3231d1089 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:06.719850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e2d5745-e878-430d-8ad3-84b3231d1089 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:06.722307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e2d5745-e878-430d-8ad3-84b3231d1089 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:06.722815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e2d5745-e878-430d-8ad3-84b3231d1089 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:06.723475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e2d5745-e878-430d-8ad3-84b3231d1089 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:06.934989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7b283538-4252-4323-b391-b554a7319b16 req-e7bf330c-1c74-4e80-967e-f14879204169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25cb7fa-29c6-4d28-bd24-ecff7105f488", "name": "network-vif-unplugged", "status": "completed", "tag": "940ba38f-dc68-41bd-b54d-beed96d7c9f6"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:06.948825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7b283538-4252-4323-b391-b554a7319b16 req-e7bf330c-1c74-4e80-967e-f14879204169 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:06.949751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7b283538-4252-4323-b391-b554a7319b16 req-e7bf330c-1c74-4e80-967e-f14879204169 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:06.950442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7b283538-4252-4323-b391-b554a7319b16 req-e7bf330c-1c74-4e80-967e-f14879204169 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:06.990754 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7b283538-4252-4323-b391-b554a7319b16 req-e7bf330c-1c74-4e80-967e-f14879204169 service nova] Creating event network-vif-unplugged:940ba38f-dc68-41bd-b54d-beed96d7c9f6 for instance d25cb7fa-29c6-4d28-bd24-ecff7105f488 on n-h2-820368-35 Aug 27 05:02:07.001057 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7b283538-4252-4323-b391-b554a7319b16 req-e7bf330c-1c74-4e80-967e-f14879204169 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070242 Aug 27 05:02:07.005179 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1104/2152] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:07.091426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e2d5745-e878-430d-8ad3-84b3231d1089 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:07.107607 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e2d5745-e878-430d-8ad3-84b3231d1089 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.408168 Aug 27 05:02:07.107607 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1049/2153] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:06 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:08.131040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c006769-5da9-4073-96e3-e1aab8125456 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:08.131937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c006769-5da9-4073-96e3-e1aab8125456 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:08.147462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c006769-5da9-4073-96e3-e1aab8125456 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:08.152455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c006769-5da9-4073-96e3-e1aab8125456 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:08.152982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c006769-5da9-4073-96e3-e1aab8125456 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:08.153774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c006769-5da9-4073-96e3-e1aab8125456 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:08.155469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c006769-5da9-4073-96e3-e1aab8125456 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:08.155927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c006769-5da9-4073-96e3-e1aab8125456 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:09.158055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3126a166-28a6-42ca-8071-e87c90572912 req-8857c4e5-d7af-4bfb-b050-2d48e31bb11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25cb7fa-29c6-4d28-bd24-ecff7105f488", "tag": "940ba38f-dc68-41bd-b54d-beed96d7c9f6"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:09.188524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3126a166-28a6-42ca-8071-e87c90572912 req-8857c4e5-d7af-4bfb-b050-2d48e31bb11a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:09.189024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3126a166-28a6-42ca-8071-e87c90572912 req-8857c4e5-d7af-4bfb-b050-2d48e31bb11a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:09.189466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3126a166-28a6-42ca-8071-e87c90572912 req-8857c4e5-d7af-4bfb-b050-2d48e31bb11a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:09.236438 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3126a166-28a6-42ca-8071-e87c90572912 req-8857c4e5-d7af-4bfb-b050-2d48e31bb11a service nova] Creating event network-changed:940ba38f-dc68-41bd-b54d-beed96d7c9f6 for instance d25cb7fa-29c6-4d28-bd24-ecff7105f488 on n-h2-820368-35 Aug 27 05:02:09.244304 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3126a166-28a6-42ca-8071-e87c90572912 req-8857c4e5-d7af-4bfb-b050-2d48e31bb11a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089278 Aug 27 05:02:09.245456 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1050/2154] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:02:09.497089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c006769-5da9-4073-96e3-e1aab8125456 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:09.511359 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c006769-5da9-4073-96e3-e1aab8125456 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 1.388869 Aug 27 05:02:09.533278 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1105/2155] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:08 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:10.547944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6f6b377-098c-4752-88a7-71c5ad263ede tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:10.548719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a6f6b377-098c-4752-88a7-71c5ad263ede tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:10.565058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6f6b377-098c-4752-88a7-71c5ad263ede tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:10.568758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6f6b377-098c-4752-88a7-71c5ad263ede tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:10.569437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6f6b377-098c-4752-88a7-71c5ad263ede tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:10.570397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6f6b377-098c-4752-88a7-71c5ad263ede tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:10.571993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6f6b377-098c-4752-88a7-71c5ad263ede tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:10.575139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6f6b377-098c-4752-88a7-71c5ad263ede tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:11.743538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a6f6b377-098c-4752-88a7-71c5ad263ede tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:11.756065 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a6f6b377-098c-4752-88a7-71c5ad263ede tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 1.218505 Aug 27 05:02:11.759077 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1051/2156] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:10 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:12.715400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-374656880", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:12.730277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:12.780998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c78e3453-5cc5-4169-96c8-6305b17291cf tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:12.782627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c78e3453-5cc5-4169-96c8-6305b17291cf tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:12.793993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78e3453-5cc5-4169-96c8-6305b17291cf tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:12.796524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78e3453-5cc5-4169-96c8-6305b17291cf tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:12.797647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78e3453-5cc5-4169-96c8-6305b17291cf tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:12.800980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78e3453-5cc5-4169-96c8-6305b17291cf tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:12.802787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78e3453-5cc5-4169-96c8-6305b17291cf tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:12.804855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78e3453-5cc5-4169-96c8-6305b17291cf tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:12.842705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:02:13.613318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:02:13.613741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:02:13.614224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:02:13.614621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:02:13.615031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:02:13.636343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:13.640162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:13.643506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:13.643506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:13.643506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:13.643506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:13.724345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Getting quotas for project c3b22db8ab87483daf2acf10c94950cc. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:02:13.740691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Getting quotas for user 16669649a1c345c9b1a8ab8d1e52012d and project c3b22db8ab87483daf2acf10c94950cc. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:02:13.775921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:02:13.779769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c78e3453-5cc5-4169-96c8-6305b17291cf tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:13.790106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:02:13.801233 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c78e3453-5cc5-4169-96c8-6305b17291cf tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 1.024258 Aug 27 05:02:13.810250 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1052/2157] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:12 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:13.916238 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-330388fe-e8b4-4e57-bc01-0f9dbf568041 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.612752 Aug 27 05:02:13.926602 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1106/2158] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:02:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:02:13.928801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df65f923-3179-4363-9d9e-682ac1d331c6 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:13.929628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-df65f923-3179-4363-9d9e-682ac1d331c6 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:14.195470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df65f923-3179-4363-9d9e-682ac1d331c6 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:14.210081 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df65f923-3179-4363-9d9e-682ac1d331c6 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1216 microversion: 2.1 time: 0.283345 Aug 27 05:02:14.211123 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1053/2159] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:13 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1216 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:14.229159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:14.229790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:14.253990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:14.255787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:14.262644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:14.263921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:14.265885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:14.266508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:14.763199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a1a30178-924a-4a09-bd02-46d9e40422f5 tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] Action: 'create', calling method: .version_select at 0x7fb565008790>, body: {"pool": null} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:14.830911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:14.851423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:14.856256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:14.862561 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f90dec1-9af8-4166-ac09-a82c98133db1 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2956 microversion: 2.42 time: 0.642069 Aug 27 05:02:14.887271 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1107/2160] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:14 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2956 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:14.901852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5148862b-1fdc-47d4-aa18-ee07ae1fbc70 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:14.912599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5148862b-1fdc-47d4-aa18-ee07ae1fbc70 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:14.932328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5148862b-1fdc-47d4-aa18-ee07ae1fbc70 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:14.932835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5148862b-1fdc-47d4-aa18-ee07ae1fbc70 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:14.934329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5148862b-1fdc-47d4-aa18-ee07ae1fbc70 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:14.937611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5148862b-1fdc-47d4-aa18-ee07ae1fbc70 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:14.939038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5148862b-1fdc-47d4-aa18-ee07ae1fbc70 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:14.939773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5148862b-1fdc-47d4-aa18-ee07ae1fbc70 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:15.429340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5148862b-1fdc-47d4-aa18-ee07ae1fbc70 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:15.443634 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5148862b-1fdc-47d4-aa18-ee07ae1fbc70 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 0.553310 Aug 27 05:02:15.444238 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1108/2161] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:14 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:15.456765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-247e37b9-57f0-48e3-8c98-68060f402dbf tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:15.466958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-247e37b9-57f0-48e3-8c98-68060f402dbf tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:15.486006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-247e37b9-57f0-48e3-8c98-68060f402dbf tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:15.486512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-247e37b9-57f0-48e3-8c98-68060f402dbf tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:15.495319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-247e37b9-57f0-48e3-8c98-68060f402dbf tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:15.496200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-247e37b9-57f0-48e3-8c98-68060f402dbf tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:15.496695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-247e37b9-57f0-48e3-8c98-68060f402dbf tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:15.497140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-247e37b9-57f0-48e3-8c98-68060f402dbf tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:15.721872 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-247e37b9-57f0-48e3-8c98-68060f402dbf tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.273037 Aug 27 05:02:15.722602 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1109/2162] 10.222.0.58 () {60 vars in 1316 bytes} [Sat Aug 27 05:02:15 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8/os-interface => generated 1831 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:15.732957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-adcbb2cf-c74e-4946-8968-0a4d6537b4b0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:15.732957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-adcbb2cf-c74e-4946-8968-0a4d6537b4b0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:15.751124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-adcbb2cf-c74e-4946-8968-0a4d6537b4b0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:15.754159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-adcbb2cf-c74e-4946-8968-0a4d6537b4b0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:15.754814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-adcbb2cf-c74e-4946-8968-0a4d6537b4b0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:15.759145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-adcbb2cf-c74e-4946-8968-0a4d6537b4b0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:15.760109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-adcbb2cf-c74e-4946-8968-0a4d6537b4b0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:15.761313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-adcbb2cf-c74e-4946-8968-0a4d6537b4b0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:16.492573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-adcbb2cf-c74e-4946-8968-0a4d6537b4b0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:16.514962 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-adcbb2cf-c74e-4946-8968-0a4d6537b4b0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1268 microversion: 2.1 time: 0.784400 Aug 27 05:02:16.520077 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1110/2163] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:15 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1268 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:16.547337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8abe0196-ac44-4ee2-a31b-fbe09603219f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:16.554797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8abe0196-ac44-4ee2-a31b-fbe09603219f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:16.588517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8abe0196-ac44-4ee2-a31b-fbe09603219f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:16.592391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8abe0196-ac44-4ee2-a31b-fbe09603219f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:16.596596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8abe0196-ac44-4ee2-a31b-fbe09603219f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:16.602363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8abe0196-ac44-4ee2-a31b-fbe09603219f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:16.605060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8abe0196-ac44-4ee2-a31b-fbe09603219f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:16.608044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8abe0196-ac44-4ee2-a31b-fbe09603219f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:17.726425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8abe0196-ac44-4ee2-a31b-fbe09603219f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:17.747794 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8abe0196-ac44-4ee2-a31b-fbe09603219f tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 1.219417 Aug 27 05:02:17.749579 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1111/2164] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:16 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:17.763966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5af6b5af-5601-4611-a6db-25c4bde29585 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:17.773646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5af6b5af-5601-4611-a6db-25c4bde29585 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:17.794450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af6b5af-5601-4611-a6db-25c4bde29585 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:17.798096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af6b5af-5601-4611-a6db-25c4bde29585 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:17.802029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af6b5af-5601-4611-a6db-25c4bde29585 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:17.804216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af6b5af-5601-4611-a6db-25c4bde29585 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:17.805997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af6b5af-5601-4611-a6db-25c4bde29585 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:17.807576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af6b5af-5601-4611-a6db-25c4bde29585 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:18.072118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5af6b5af-5601-4611-a6db-25c4bde29585 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:18.117628 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5af6b5af-5601-4611-a6db-25c4bde29585 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1274 microversion: 2.1 time: 0.359184 Aug 27 05:02:18.122608 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1112/2165] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:17 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1274 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:18.773458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5dd67cc-bd1c-475a-ad81-f3fa44c52d8e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:18.776891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c5dd67cc-bd1c-475a-ad81-f3fa44c52d8e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:18.797972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5dd67cc-bd1c-475a-ad81-f3fa44c52d8e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:18.803743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5dd67cc-bd1c-475a-ad81-f3fa44c52d8e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:18.808509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5dd67cc-bd1c-475a-ad81-f3fa44c52d8e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:18.809385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5dd67cc-bd1c-475a-ad81-f3fa44c52d8e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:18.809848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5dd67cc-bd1c-475a-ad81-f3fa44c52d8e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:18.810283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5dd67cc-bd1c-475a-ad81-f3fa44c52d8e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:20.285986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c5dd67cc-bd1c-475a-ad81-f3fa44c52d8e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:20.300355 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5dd67cc-bd1c-475a-ad81-f3fa44c52d8e tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 1.529858 Aug 27 05:02:20.302444 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1113/2166] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:18 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:20.317443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-21c7bee7-57e2-4174-a421-5f511cebb3ff tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:20.318296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-21c7bee7-57e2-4174-a421-5f511cebb3ff tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:20.337311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21c7bee7-57e2-4174-a421-5f511cebb3ff tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:20.339570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21c7bee7-57e2-4174-a421-5f511cebb3ff tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:20.340821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21c7bee7-57e2-4174-a421-5f511cebb3ff tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:20.343966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21c7bee7-57e2-4174-a421-5f511cebb3ff tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:20.345020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21c7bee7-57e2-4174-a421-5f511cebb3ff tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:20.349557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21c7bee7-57e2-4174-a421-5f511cebb3ff tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:20.379345 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a1a30178-924a-4a09-bd02-46d9e40422f5 tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.864836 Aug 27 05:02:20.381198 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1054/2167] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 05:02:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:02:20.393811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8ce73ce6-39a4-4de9-a1f2-35b83fd7df13 tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] Action: 'create', calling method: .version_select at 0x7fb5655db430>, body: {"pool": null} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:21.095190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-21c7bee7-57e2-4174-a421-5f511cebb3ff tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:21.114693 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-21c7bee7-57e2-4174-a421-5f511cebb3ff tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1274 microversion: 2.1 time: 0.809872 Aug 27 05:02:21.116693 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1114/2168] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:20 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1274 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:21.336276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-212daa88-cd74-43a7-873b-faa8521537ee tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:21.344232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-212daa88-cd74-43a7-873b-faa8521537ee tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:21.359318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212daa88-cd74-43a7-873b-faa8521537ee tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:21.359965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212daa88-cd74-43a7-873b-faa8521537ee tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:21.361898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212daa88-cd74-43a7-873b-faa8521537ee tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:21.362919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212daa88-cd74-43a7-873b-faa8521537ee tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:21.365138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212daa88-cd74-43a7-873b-faa8521537ee tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:21.366481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212daa88-cd74-43a7-873b-faa8521537ee tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:22.397596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-212daa88-cd74-43a7-873b-faa8521537ee tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:22.417036 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-212daa88-cd74-43a7-873b-faa8521537ee tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1391 microversion: 2.1 time: 1.083072 Aug 27 05:02:22.436299 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1115/2169] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:21 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1391 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:22.441978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ddd6e438-c176-4e26-a554-8e5f9ad989b8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:22.442951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ddd6e438-c176-4e26-a554-8e5f9ad989b8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:22.457223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddd6e438-c176-4e26-a554-8e5f9ad989b8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:22.460531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddd6e438-c176-4e26-a554-8e5f9ad989b8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:22.463495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddd6e438-c176-4e26-a554-8e5f9ad989b8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:22.464530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddd6e438-c176-4e26-a554-8e5f9ad989b8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:22.465238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddd6e438-c176-4e26-a554-8e5f9ad989b8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:22.468513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddd6e438-c176-4e26-a554-8e5f9ad989b8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:23.542723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ddd6e438-c176-4e26-a554-8e5f9ad989b8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:23.560926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ddd6e438-c176-4e26-a554-8e5f9ad989b8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1316 microversion: 2.1 time: 1.124145 Aug 27 05:02:23.565459 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1116/2170] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:22 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1316 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:23.582040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f981c8e-da62-4d4f-b522-4fb261d5833c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:23.587857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f981c8e-da62-4d4f-b522-4fb261d5833c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:23.613369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f981c8e-da62-4d4f-b522-4fb261d5833c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:23.616614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f981c8e-da62-4d4f-b522-4fb261d5833c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:23.620719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f981c8e-da62-4d4f-b522-4fb261d5833c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:23.621958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f981c8e-da62-4d4f-b522-4fb261d5833c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:23.624041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f981c8e-da62-4d4f-b522-4fb261d5833c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:23.628465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f981c8e-da62-4d4f-b522-4fb261d5833c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:23.690637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:23.757653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:23.796415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=94 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:23.957541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=31 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:24.200634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:24.476362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f981c8e-da62-4d4f-b522-4fb261d5833c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:24.494742 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f981c8e-da62-4d4f-b522-4fb261d5833c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1381 microversion: 2.1 time: 0.926881 Aug 27 05:02:24.511129 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1117/2171] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:23 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1381 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:24.521803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c098bcba-d1f3-41cd-b306-47b4e1562551 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '.version_select at 0x7fb565436ca0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:24.529284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c098bcba-d1f3-41cd-b306-47b4e1562551 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:24.529859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c098bcba-d1f3-41cd-b306-47b4e1562551 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:24.530242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c098bcba-d1f3-41cd-b306-47b4e1562551 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:24.572121 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c098bcba-d1f3-41cd-b306-47b4e1562551 tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.054374 Aug 27 05:02:24.581513 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1118/2172] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 05:02:24 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:24.600460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-61416fa9-8391-4c1b-9208-0b26353453bc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:24.603569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-61416fa9-8391-4c1b-9208-0b26353453bc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:24.630795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61416fa9-8391-4c1b-9208-0b26353453bc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:24.634762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61416fa9-8391-4c1b-9208-0b26353453bc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:24.635291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61416fa9-8391-4c1b-9208-0b26353453bc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:24.645906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61416fa9-8391-4c1b-9208-0b26353453bc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:24.651719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61416fa9-8391-4c1b-9208-0b26353453bc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:24.653895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61416fa9-8391-4c1b-9208-0b26353453bc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:25.640319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-61416fa9-8391-4c1b-9208-0b26353453bc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:25.657731 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-61416fa9-8391-4c1b-9208-0b26353453bc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1316 microversion: 2.1 time: 1.067808 Aug 27 05:02:25.687941 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1119/2173] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:24 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1316 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:25.699338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f4346723-1199-48f8-87dc-51d3082815ce tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:25.703860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f4346723-1199-48f8-87dc-51d3082815ce tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:25.717183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4346723-1199-48f8-87dc-51d3082815ce tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:25.721689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4346723-1199-48f8-87dc-51d3082815ce tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:25.722420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4346723-1199-48f8-87dc-51d3082815ce tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:25.723554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4346723-1199-48f8-87dc-51d3082815ce tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:25.726470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4346723-1199-48f8-87dc-51d3082815ce tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:25.727289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4346723-1199-48f8-87dc-51d3082815ce tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:25.739848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:26.441373 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f4346723-1199-48f8-87dc-51d3082815ce tempest-LiveMigrationTest-1789883779 tempest-LiveMigrationTest-1789883779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1534 microversion: 2.1 time: 0.748991 Aug 27 05:02:26.441969 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1120/2174] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:25 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1534 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:26.481713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b8beeff-e941-418c-894e-5d36b3f6cc89 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:26.482589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9b8beeff-e941-418c-894e-5d36b3f6cc89 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:26.491653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b8beeff-e941-418c-894e-5d36b3f6cc89 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:26.499577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b8beeff-e941-418c-894e-5d36b3f6cc89 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:26.500322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b8beeff-e941-418c-894e-5d36b3f6cc89 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:26.501250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b8beeff-e941-418c-894e-5d36b3f6cc89 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:26.502139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b8beeff-e941-418c-894e-5d36b3f6cc89 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:26.502880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b8beeff-e941-418c-894e-5d36b3f6cc89 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:26.585165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9b8beeff-e941-418c-894e-5d36b3f6cc89 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:02:26.778045 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9b8beeff-e941-418c-894e-5d36b3f6cc89 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 204 len: 0 microversion: 2.1 time: 0.303464 Aug 27 05:02:26.779042 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1121/2175] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:02:26 2022] DELETE /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:02:27.186554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1625822136", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:27.270195 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8ce73ce6-39a4-4de9-a1f2-35b83fd7df13 tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.880794 Aug 27 05:02:27.271117 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1055/2176] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 05:02:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:27.275895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9c193bc9-0c73-4709-b24b-88cce52a89c9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:27.277392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9c193bc9-0c73-4709-b24b-88cce52a89c9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:27.291203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c193bc9-0c73-4709-b24b-88cce52a89c9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:27.297356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c193bc9-0c73-4709-b24b-88cce52a89c9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:27.299176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c193bc9-0c73-4709-b24b-88cce52a89c9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:27.300539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c193bc9-0c73-4709-b24b-88cce52a89c9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:27.301593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c193bc9-0c73-4709-b24b-88cce52a89c9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:27.302133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c193bc9-0c73-4709-b24b-88cce52a89c9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:27.354096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:02:27.994119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9c193bc9-0c73-4709-b24b-88cce52a89c9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:28.002478 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9c193bc9-0c73-4709-b24b-88cce52a89c9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1316 microversion: 2.1 time: 0.729870 Aug 27 05:02:28.012035 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1056/2177] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:27 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:28.029553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6d4c7fd-b5be-4556-a25e-97285eec5fdb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:28.031955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a6d4c7fd-b5be-4556-a25e-97285eec5fdb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:28.052413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6d4c7fd-b5be-4556-a25e-97285eec5fdb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:28.053190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6d4c7fd-b5be-4556-a25e-97285eec5fdb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:28.053703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6d4c7fd-b5be-4556-a25e-97285eec5fdb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:28.054531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6d4c7fd-b5be-4556-a25e-97285eec5fdb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:28.055656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6d4c7fd-b5be-4556-a25e-97285eec5fdb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:28.056189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6d4c7fd-b5be-4556-a25e-97285eec5fdb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:28.118451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:02:28.124025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:02:28.124824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:02:28.125444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:02:28.126041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:02:28.139855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:28.141585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:28.142219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:28.143950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:28.145693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:28.146365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:28.172902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Getting quotas for project 170af42cbb5f42cb91d3047dede7583e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:02:28.180339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Getting quotas for user fdd3e55e6a2842d08aeca3432e872be6 and project 170af42cbb5f42cb91d3047dede7583e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:02:28.199597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:02:28.202492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:02:28.291489 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8ffa374-4e48-4c94-bba6-ec086d4c5558 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.510697 Aug 27 05:02:28.292468 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1122/2178] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:02:28.300124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a6d4c7fd-b5be-4556-a25e-97285eec5fdb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:28.309032 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a6d4c7fd-b5be-4556-a25e-97285eec5fdb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1387 microversion: 2.1 time: 0.293811 Aug 27 05:02:28.311451 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1057/2179] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:28 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1387 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:28.327871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aa913c61-15bc-4146-ba34-f65de5526b2c tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] Action: 'create', calling method: .version_select at 0x7fb565c3a550>, body: {"pool": null} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:28.469247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-cf237ffc-a042-4892-818e-1d74d164af0b req-e3a07bba-28b0-4e80-86a5-26def07fd8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e", "tag": "bafc5b86-279b-411c-9b1a-ae47f7108d43"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:28.482378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cf237ffc-a042-4892-818e-1d74d164af0b req-e3a07bba-28b0-4e80-86a5-26def07fd8a2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:28.482862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cf237ffc-a042-4892-818e-1d74d164af0b req-e3a07bba-28b0-4e80-86a5-26def07fd8a2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:28.488426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cf237ffc-a042-4892-818e-1d74d164af0b req-e3a07bba-28b0-4e80-86a5-26def07fd8a2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:28.513914 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-cf237ffc-a042-4892-818e-1d74d164af0b req-e3a07bba-28b0-4e80-86a5-26def07fd8a2 service nova] Creating event network-changed:bafc5b86-279b-411c-9b1a-ae47f7108d43 for instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e on n-h2-820368-35 Aug 27 05:02:28.519438 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-cf237ffc-a042-4892-818e-1d74d164af0b req-e3a07bba-28b0-4e80-86a5-26def07fd8a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225736 Aug 27 05:02:28.521209 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1123/2180] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:28.528109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-98b5b46d-bf3c-4dee-b6f3-da72bed09023 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:28.529060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-98b5b46d-bf3c-4dee-b6f3-da72bed09023 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:28.686599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-98b5b46d-bf3c-4dee-b6f3-da72bed09023 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:28.697896 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-98b5b46d-bf3c-4dee-b6f3-da72bed09023 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1219 microversion: 2.1 time: 0.175308 Aug 27 05:02:28.703677 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1124/2181] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:28 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1219 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:29.035517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c13c0caf-c105-44d6-954c-92718ea6020f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:29.036141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c13c0caf-c105-44d6-954c-92718ea6020f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:29.054365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c13c0caf-c105-44d6-954c-92718ea6020f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:29.055702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c13c0caf-c105-44d6-954c-92718ea6020f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:29.056430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c13c0caf-c105-44d6-954c-92718ea6020f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:29.057413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c13c0caf-c105-44d6-954c-92718ea6020f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:29.058116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c13c0caf-c105-44d6-954c-92718ea6020f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:29.058706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c13c0caf-c105-44d6-954c-92718ea6020f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:29.416026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c13c0caf-c105-44d6-954c-92718ea6020f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:29.424642 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c13c0caf-c105-44d6-954c-92718ea6020f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1316 microversion: 2.1 time: 0.392844 Aug 27 05:02:29.427841 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1125/2182] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:29 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:29.438306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0b8f8400-7a58-423b-a249-223be9534cf9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:29.443761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0b8f8400-7a58-423b-a249-223be9534cf9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:29.454512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b8f8400-7a58-423b-a249-223be9534cf9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:29.456732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b8f8400-7a58-423b-a249-223be9534cf9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:29.457504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b8f8400-7a58-423b-a249-223be9534cf9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:29.458431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b8f8400-7a58-423b-a249-223be9534cf9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:29.461259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b8f8400-7a58-423b-a249-223be9534cf9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:29.462439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b8f8400-7a58-423b-a249-223be9534cf9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:29.624199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0b8f8400-7a58-423b-a249-223be9534cf9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:29.644749 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0b8f8400-7a58-423b-a249-223be9534cf9 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1345 microversion: 2.1 time: 0.214968 Aug 27 05:02:29.645564 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1126/2183] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:29 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1345 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:29.725047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c939ccbb-4b87-409b-8d0a-63f179c3ed44 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:29.725995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c939ccbb-4b87-409b-8d0a-63f179c3ed44 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:29.737235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c939ccbb-4b87-409b-8d0a-63f179c3ed44 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:29.742771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c939ccbb-4b87-409b-8d0a-63f179c3ed44 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:29.744312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c939ccbb-4b87-409b-8d0a-63f179c3ed44 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:29.745279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c939ccbb-4b87-409b-8d0a-63f179c3ed44 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:29.746345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c939ccbb-4b87-409b-8d0a-63f179c3ed44 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:29.746998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c939ccbb-4b87-409b-8d0a-63f179c3ed44 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:30.578134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c939ccbb-4b87-409b-8d0a-63f179c3ed44 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:30.589409 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c939ccbb-4b87-409b-8d0a-63f179c3ed44 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1271 microversion: 2.1 time: 0.868290 Aug 27 05:02:30.603987 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1127/2184] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:29 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1271 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:30.726135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7c77b358-4b40-4f57-b9dc-8c5ba21153ce req-574068a8-f70b-44a1-951c-1b73bf4f42e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25cb7fa-29c6-4d28-bd24-ecff7105f488", "name": "network-vif-deleted", "tag": "940ba38f-dc68-41bd-b54d-beed96d7c9f6"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:30.740944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7c77b358-4b40-4f57-b9dc-8c5ba21153ce req-574068a8-f70b-44a1-951c-1b73bf4f42e4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:30.741606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7c77b358-4b40-4f57-b9dc-8c5ba21153ce req-574068a8-f70b-44a1-951c-1b73bf4f42e4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:30.742510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7c77b358-4b40-4f57-b9dc-8c5ba21153ce req-574068a8-f70b-44a1-951c-1b73bf4f42e4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:30.758504 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7c77b358-4b40-4f57-b9dc-8c5ba21153ce req-574068a8-f70b-44a1-951c-1b73bf4f42e4 service nova] Creating event network-vif-deleted:940ba38f-dc68-41bd-b54d-beed96d7c9f6 for instance d25cb7fa-29c6-4d28-bd24-ecff7105f488 on n-h1-820368-35 Aug 27 05:02:30.764900 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7c77b358-4b40-4f57-b9dc-8c5ba21153ce req-574068a8-f70b-44a1-951c-1b73bf4f42e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159484 Aug 27 05:02:30.766388 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1128/2185] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:30.774133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-795917a3-27b9-4441-87e6-edc239be8786 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:30.775361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-795917a3-27b9-4441-87e6-edc239be8786 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:30.792418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-795917a3-27b9-4441-87e6-edc239be8786 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:30.793272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-795917a3-27b9-4441-87e6-edc239be8786 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:30.793873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-795917a3-27b9-4441-87e6-edc239be8786 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:30.795073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-795917a3-27b9-4441-87e6-edc239be8786 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:30.795773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-795917a3-27b9-4441-87e6-edc239be8786 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:30.796516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-795917a3-27b9-4441-87e6-edc239be8786 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:31.486114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-795917a3-27b9-4441-87e6-edc239be8786 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:31.496647 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-795917a3-27b9-4441-87e6-edc239be8786 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1316 microversion: 2.1 time: 0.728432 Aug 27 05:02:31.500853 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1129/2186] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:30 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1316 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:31.511425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a729747e-ab31-4478-9e49-495400808ddc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:31.512552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a729747e-ab31-4478-9e49-495400808ddc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:31.526640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a729747e-ab31-4478-9e49-495400808ddc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:31.527657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a729747e-ab31-4478-9e49-495400808ddc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:31.529791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a729747e-ab31-4478-9e49-495400808ddc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:31.530963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a729747e-ab31-4478-9e49-495400808ddc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:31.532625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a729747e-ab31-4478-9e49-495400808ddc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:31.538709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a729747e-ab31-4478-9e49-495400808ddc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:31.673017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a729747e-ab31-4478-9e49-495400808ddc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:31.683367 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a729747e-ab31-4478-9e49-495400808ddc tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1184 microversion: 2.1 time: 0.180849 Aug 27 05:02:31.702288 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1130/2187] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:31 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1184 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:31.702288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-84c280e1-90f2-4eb1-971d-156578dafb2c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:31.702288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-84c280e1-90f2-4eb1-971d-156578dafb2c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:31.715925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c280e1-90f2-4eb1-971d-156578dafb2c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:31.716649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c280e1-90f2-4eb1-971d-156578dafb2c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:31.722471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c280e1-90f2-4eb1-971d-156578dafb2c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:31.723760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c280e1-90f2-4eb1-971d-156578dafb2c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:31.724172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c280e1-90f2-4eb1-971d-156578dafb2c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:31.724760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84c280e1-90f2-4eb1-971d-156578dafb2c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:31.895674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-84c280e1-90f2-4eb1-971d-156578dafb2c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:31.904044 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-84c280e1-90f2-4eb1-971d-156578dafb2c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1277 microversion: 2.1 time: 0.213162 Aug 27 05:02:31.908186 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1131/2188] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:31 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:32.097168 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aa913c61-15bc-4146-ba34-f65de5526b2c tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.782338 Aug 27 05:02:32.098492 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1058/2189] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 05:02:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:32.112329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b2dd1a34-afe9-4e90-a055-5ef6a6dfda7c tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] Action: 'create', calling method: .version_select at 0x7fb564c41430>, body: {"pool": null} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:32.525740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2b8b6a0-681f-4277-93e9-fea4a6768d8e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:32.528041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a2b8b6a0-681f-4277-93e9-fea4a6768d8e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:32.538718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2b8b6a0-681f-4277-93e9-fea4a6768d8e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:32.540251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2b8b6a0-681f-4277-93e9-fea4a6768d8e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:32.542074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2b8b6a0-681f-4277-93e9-fea4a6768d8e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:32.543313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2b8b6a0-681f-4277-93e9-fea4a6768d8e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:32.545156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2b8b6a0-681f-4277-93e9-fea4a6768d8e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:32.546393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2b8b6a0-681f-4277-93e9-fea4a6768d8e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:32.999129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a2b8b6a0-681f-4277-93e9-fea4a6768d8e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:33.019919 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2b8b6a0-681f-4277-93e9-fea4a6768d8e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1316 microversion: 2.1 time: 0.501426 Aug 27 05:02:33.036235 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1059/2190] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:32 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:33.050687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-030535e7-0ec3-4fbf-8c40-e86991197558 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:33.051881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-030535e7-0ec3-4fbf-8c40-e86991197558 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:33.078497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-030535e7-0ec3-4fbf-8c40-e86991197558 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:33.083531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-030535e7-0ec3-4fbf-8c40-e86991197558 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:33.084358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-030535e7-0ec3-4fbf-8c40-e86991197558 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:33.087896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-030535e7-0ec3-4fbf-8c40-e86991197558 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:33.088562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-030535e7-0ec3-4fbf-8c40-e86991197558 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:33.089021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-030535e7-0ec3-4fbf-8c40-e86991197558 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:33.291550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-030535e7-0ec3-4fbf-8c40-e86991197558 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:33.310919 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-030535e7-0ec3-4fbf-8c40-e86991197558 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1184 microversion: 2.1 time: 0.275141 Aug 27 05:02:33.320525 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1060/2191] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:33 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1184 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:33.348495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed280da0-ee82-4873-804e-815ca7c1d724 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:33.354447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed280da0-ee82-4873-804e-815ca7c1d724 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:33.393247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed280da0-ee82-4873-804e-815ca7c1d724 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:33.396096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed280da0-ee82-4873-804e-815ca7c1d724 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:33.397376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed280da0-ee82-4873-804e-815ca7c1d724 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:33.398293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed280da0-ee82-4873-804e-815ca7c1d724 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:33.400808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed280da0-ee82-4873-804e-815ca7c1d724 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:33.401488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed280da0-ee82-4873-804e-815ca7c1d724 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:33.698383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ed280da0-ee82-4873-804e-815ca7c1d724 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:33.711067 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed280da0-ee82-4873-804e-815ca7c1d724 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1277 microversion: 2.1 time: 0.386818 Aug 27 05:02:33.713395 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1061/2192] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:33 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1277 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:34.044074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-15426348-f269-4c87-a76f-80a75fd74569 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:34.044975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-15426348-f269-4c87-a76f-80a75fd74569 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:34.053863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15426348-f269-4c87-a76f-80a75fd74569 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:34.064800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15426348-f269-4c87-a76f-80a75fd74569 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:34.065475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15426348-f269-4c87-a76f-80a75fd74569 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:34.066421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15426348-f269-4c87-a76f-80a75fd74569 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:34.073907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15426348-f269-4c87-a76f-80a75fd74569 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:34.074627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15426348-f269-4c87-a76f-80a75fd74569 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:34.555878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-15426348-f269-4c87-a76f-80a75fd74569 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:34.583003 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-15426348-f269-4c87-a76f-80a75fd74569 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1316 microversion: 2.1 time: 0.543216 Aug 27 05:02:34.593048 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1062/2193] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:34 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:34.598961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e473a7b1-f4c7-405f-97ae-a9815e3e57e5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:34.608852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e473a7b1-f4c7-405f-97ae-a9815e3e57e5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:34.632179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e473a7b1-f4c7-405f-97ae-a9815e3e57e5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:34.632973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e473a7b1-f4c7-405f-97ae-a9815e3e57e5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:34.634024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e473a7b1-f4c7-405f-97ae-a9815e3e57e5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:34.634749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e473a7b1-f4c7-405f-97ae-a9815e3e57e5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:34.635245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e473a7b1-f4c7-405f-97ae-a9815e3e57e5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:34.636463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e473a7b1-f4c7-405f-97ae-a9815e3e57e5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:34.821792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e473a7b1-f4c7-405f-97ae-a9815e3e57e5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:34.835784 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e473a7b1-f4c7-405f-97ae-a9815e3e57e5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1184 microversion: 2.1 time: 0.240523 Aug 27 05:02:34.837032 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1063/2194] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:34 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1184 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:34.864766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec18586d-cd18-47ce-a305-dc5c703a85c7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:34.870514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec18586d-cd18-47ce-a305-dc5c703a85c7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:34.885798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec18586d-cd18-47ce-a305-dc5c703a85c7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:34.895573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec18586d-cd18-47ce-a305-dc5c703a85c7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:34.896054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec18586d-cd18-47ce-a305-dc5c703a85c7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:34.896829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec18586d-cd18-47ce-a305-dc5c703a85c7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:34.897293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec18586d-cd18-47ce-a305-dc5c703a85c7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:34.897725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec18586d-cd18-47ce-a305-dc5c703a85c7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:35.433192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ec18586d-cd18-47ce-a305-dc5c703a85c7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:35.444555 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec18586d-cd18-47ce-a305-dc5c703a85c7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1319 microversion: 2.1 time: 0.584966 Aug 27 05:02:35.446795 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1064/2195] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:34 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1319 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:35.615706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a77b16b4-8369-4985-96a4-c4cac677f691 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:35.617772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a77b16b4-8369-4985-96a4-c4cac677f691 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:35.637022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a77b16b4-8369-4985-96a4-c4cac677f691 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:35.637644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a77b16b4-8369-4985-96a4-c4cac677f691 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:35.638278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a77b16b4-8369-4985-96a4-c4cac677f691 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:35.641236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a77b16b4-8369-4985-96a4-c4cac677f691 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:35.645801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a77b16b4-8369-4985-96a4-c4cac677f691 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:35.646350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a77b16b4-8369-4985-96a4-c4cac677f691 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:36.125889 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b2dd1a34-afe9-4e90-a055-5ef6a6dfda7c tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.018330 Aug 27 05:02:36.127052 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1132/2196] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 05:02:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:02:36.133550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-34a8e967-0529-49a8-b440-0c8de33a47ba tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:36.134329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-34a8e967-0529-49a8-b440-0c8de33a47ba tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:36.148410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34a8e967-0529-49a8-b440-0c8de33a47ba tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:36.151721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34a8e967-0529-49a8-b440-0c8de33a47ba tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:36.153055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34a8e967-0529-49a8-b440-0c8de33a47ba tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:36.154635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34a8e967-0529-49a8-b440-0c8de33a47ba tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:36.156298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a77b16b4-8369-4985-96a4-c4cac677f691 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:36.156451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34a8e967-0529-49a8-b440-0c8de33a47ba tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:36.158425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34a8e967-0529-49a8-b440-0c8de33a47ba tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:36.165499 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a77b16b4-8369-4985-96a4-c4cac677f691 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1316 microversion: 2.1 time: 0.560616 Aug 27 05:02:36.166416 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1065/2197] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:35 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:36.337059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-34a8e967-0529-49a8-b440-0c8de33a47ba tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:36.354712 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-34a8e967-0529-49a8-b440-0c8de33a47ba tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1184 microversion: 2.1 time: 0.226189 Aug 27 05:02:36.356226 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1133/2198] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:36 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1184 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:36.368718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8b2dbb6-70cf-4cd5-b4f9-af3ab78581e1 tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] Calling method '.version_select at 0x7fb565ebbe50>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:36.506817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f6b6ec0b-60c1-4815-8070-e5637e09a869 req-d513d89e-2dab-498e-8666-284b73120a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e", "name": "network-vif-plugged", "status": "completed", "tag": "bafc5b86-279b-411c-9b1a-ae47f7108d43"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:36.518396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f6b6ec0b-60c1-4815-8070-e5637e09a869 req-d513d89e-2dab-498e-8666-284b73120a94 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:36.518940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f6b6ec0b-60c1-4815-8070-e5637e09a869 req-d513d89e-2dab-498e-8666-284b73120a94 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:36.519450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f6b6ec0b-60c1-4815-8070-e5637e09a869 req-d513d89e-2dab-498e-8666-284b73120a94 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:36.533192 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f6b6ec0b-60c1-4815-8070-e5637e09a869 req-d513d89e-2dab-498e-8666-284b73120a94 service nova] Creating event network-vif-plugged:bafc5b86-279b-411c-9b1a-ae47f7108d43 for instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e on n-h2-820368-35 Aug 27 05:02:36.538925 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f6b6ec0b-60c1-4815-8070-e5637e09a869 req-d513d89e-2dab-498e-8666-284b73120a94 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370878 Aug 27 05:02:36.540482 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1066/2199] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:36.547791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b4d3c7f-3f63-4926-9f33-f05ac608f82e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:36.548923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9b4d3c7f-3f63-4926-9f33-f05ac608f82e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:36.556895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b4d3c7f-3f63-4926-9f33-f05ac608f82e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:36.557636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b4d3c7f-3f63-4926-9f33-f05ac608f82e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:36.558388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b4d3c7f-3f63-4926-9f33-f05ac608f82e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:36.559338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b4d3c7f-3f63-4926-9f33-f05ac608f82e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:36.559996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b4d3c7f-3f63-4926-9f33-f05ac608f82e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:36.560611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b4d3c7f-3f63-4926-9f33-f05ac608f82e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:36.819354 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8b2dbb6-70cf-4cd5-b4f9-af3ab78581e1 tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/91efd48d-3458-4e5b-b345-5cbda9564dc3" status: 200 len: 141 microversion: 2.1 time: 0.461688 Aug 27 05:02:36.823155 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1134/2200] 10.222.0.58 () {58 vars in 1260 bytes} [Sat Aug 27 05:02:36 2022] GET /compute/v2.1/os-floating-ips/91efd48d-3458-4e5b-b345-5cbda9564dc3 => generated 141 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:36.837271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cf7b5136-d3f7-4c8c-b670-d9b1cfe5e6da tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] Calling method '.version_select at 0x7fb564ae8160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:37.491122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9b4d3c7f-3f63-4926-9f33-f05ac608f82e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:37.505664 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9b4d3c7f-3f63-4926-9f33-f05ac608f82e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1319 microversion: 2.1 time: 0.961506 Aug 27 05:02:37.506295 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1067/2201] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:36 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1319 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:37.532484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2bea7fb9-6ab4-4af3-b7f0-47595f872611 req-93d4f7bd-c88f-4dcd-85a0-8cda2d4a6677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10bdb977-4db9-4617-a264-fa34fdad10f2", "tag": "ac68a06a-80f4-423a-9041-3661dde5f027"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:37.573508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2bea7fb9-6ab4-4af3-b7f0-47595f872611 req-93d4f7bd-c88f-4dcd-85a0-8cda2d4a6677 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:37.573999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2bea7fb9-6ab4-4af3-b7f0-47595f872611 req-93d4f7bd-c88f-4dcd-85a0-8cda2d4a6677 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:37.582430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2bea7fb9-6ab4-4af3-b7f0-47595f872611 req-93d4f7bd-c88f-4dcd-85a0-8cda2d4a6677 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:37.629153 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2bea7fb9-6ab4-4af3-b7f0-47595f872611 req-93d4f7bd-c88f-4dcd-85a0-8cda2d4a6677 service nova] Creating event network-changed:ac68a06a-80f4-423a-9041-3661dde5f027 for instance 10bdb977-4db9-4617-a264-fa34fdad10f2 on n-h1-820368-35 Aug 27 05:02:37.638131 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2bea7fb9-6ab4-4af3-b7f0-47595f872611 req-93d4f7bd-c88f-4dcd-85a0-8cda2d4a6677 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130564 Aug 27 05:02:37.641408 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1068/2202] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:37.653725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7e92ac25-671c-4f88-801e-fda88ffd7fe7 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:37.657830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7e92ac25-671c-4f88-801e-fda88ffd7fe7 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:37.671710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e92ac25-671c-4f88-801e-fda88ffd7fe7 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:37.672231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e92ac25-671c-4f88-801e-fda88ffd7fe7 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:37.684350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e92ac25-671c-4f88-801e-fda88ffd7fe7 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:37.685147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e92ac25-671c-4f88-801e-fda88ffd7fe7 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:37.685632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e92ac25-671c-4f88-801e-fda88ffd7fe7 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:37.686074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e92ac25-671c-4f88-801e-fda88ffd7fe7 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:38.131895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7e92ac25-671c-4f88-801e-fda88ffd7fe7 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:38.142804 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7e92ac25-671c-4f88-801e-fda88ffd7fe7 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1316 microversion: 2.1 time: 0.500094 Aug 27 05:02:38.143437 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1069/2203] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:37 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1316 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:38.159696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:38.168439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6325caad-165a-45ef-bcec-3243c3955f0b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:38.171943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6325caad-165a-45ef-bcec-3243c3955f0b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:38.184206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6325caad-165a-45ef-bcec-3243c3955f0b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:38.185081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6325caad-165a-45ef-bcec-3243c3955f0b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:38.187854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6325caad-165a-45ef-bcec-3243c3955f0b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:38.188839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6325caad-165a-45ef-bcec-3243c3955f0b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:38.189679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6325caad-165a-45ef-bcec-3243c3955f0b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:38.191790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6325caad-165a-45ef-bcec-3243c3955f0b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:38.356994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6325caad-165a-45ef-bcec-3243c3955f0b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:38.378040 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6325caad-165a-45ef-bcec-3243c3955f0b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1184 microversion: 2.1 time: 0.217795 Aug 27 05:02:38.381506 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1070/2204] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:38 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1184 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:38.526166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6d863dd1-3f5c-41f0-9731-eedb7074ad50 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:38.527563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6d863dd1-3f5c-41f0-9731-eedb7074ad50 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:38.538845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d863dd1-3f5c-41f0-9731-eedb7074ad50 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:38.541895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d863dd1-3f5c-41f0-9731-eedb7074ad50 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:38.543125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d863dd1-3f5c-41f0-9731-eedb7074ad50 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:38.547223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d863dd1-3f5c-41f0-9731-eedb7074ad50 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:38.548243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d863dd1-3f5c-41f0-9731-eedb7074ad50 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:38.549465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6d863dd1-3f5c-41f0-9731-eedb7074ad50 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:38.691336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:39.020089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6d863dd1-3f5c-41f0-9731-eedb7074ad50 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:39.039751 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6d863dd1-3f5c-41f0-9731-eedb7074ad50 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1319 microversion: 2.1 time: 0.517701 Aug 27 05:02:39.040844 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1071/2205] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:38 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:39.166572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c6033eaf-6d13-44db-a2a8-dc5a74587d8c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:39.167824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c6033eaf-6d13-44db-a2a8-dc5a74587d8c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:39.183429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6033eaf-6d13-44db-a2a8-dc5a74587d8c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:39.184361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6033eaf-6d13-44db-a2a8-dc5a74587d8c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:39.185158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6033eaf-6d13-44db-a2a8-dc5a74587d8c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:39.188500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6033eaf-6d13-44db-a2a8-dc5a74587d8c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:39.189157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6033eaf-6d13-44db-a2a8-dc5a74587d8c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:39.189771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6033eaf-6d13-44db-a2a8-dc5a74587d8c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:39.605197 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cf7b5136-d3f7-4c8c-b670-d9b1cfe5e6da tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/91efd48d-3458-4e5b-b345-5cbda9564dc3" status: 202 len: 0 microversion: 2.1 time: 2.776259 Aug 27 05:02:39.606414 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1135/2206] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:02:36 2022] DELETE /compute/v2.1/os-floating-ips/91efd48d-3458-4e5b-b345-5cbda9564dc3 => generated 0 bytes in 2778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:02:39.616990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-86e38f7e-adaf-4f02-8e3c-9ade310bdfb0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:39.620378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-86e38f7e-adaf-4f02-8e3c-9ade310bdfb0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:39.638750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86e38f7e-adaf-4f02-8e3c-9ade310bdfb0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:39.639591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86e38f7e-adaf-4f02-8e3c-9ade310bdfb0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:39.643049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86e38f7e-adaf-4f02-8e3c-9ade310bdfb0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:39.644036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86e38f7e-adaf-4f02-8e3c-9ade310bdfb0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:39.644730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86e38f7e-adaf-4f02-8e3c-9ade310bdfb0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:39.645352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86e38f7e-adaf-4f02-8e3c-9ade310bdfb0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:39.707539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c6033eaf-6d13-44db-a2a8-dc5a74587d8c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:39.715858 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c6033eaf-6d13-44db-a2a8-dc5a74587d8c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1316 microversion: 2.1 time: 0.553489 Aug 27 05:02:39.729844 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1072/2207] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:39 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1316 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:39.747040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2c621f5a-16b9-4616-8565-1d336a50d7de tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] Calling method '.version_select at 0x7fb565926f70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:39.823504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-86e38f7e-adaf-4f02-8e3c-9ade310bdfb0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:39.844282 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-86e38f7e-adaf-4f02-8e3c-9ade310bdfb0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 200 len: 1184 microversion: 2.1 time: 0.235532 Aug 27 05:02:39.848213 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1136/2208] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:39 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 1184 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:40.052518 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2c621f5a-16b9-4616-8565-1d336a50d7de tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.311263 Aug 27 05:02:40.053338 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1073/2209] 10.222.0.58 () {58 vars in 1164 bytes} [Sat Aug 27 05:02:39 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:02:40.065905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-417c6611-823f-46d2-92ee-6bd380ba28eb tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] Calling method '.version_select at 0x7fb5657a73a0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:40.066874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e20d882-95e6-40cf-8d5d-ffc5081c378d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:40.067929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e20d882-95e6-40cf-8d5d-ffc5081c378d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:40.079052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e20d882-95e6-40cf-8d5d-ffc5081c378d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:40.079631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e20d882-95e6-40cf-8d5d-ffc5081c378d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:40.082129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e20d882-95e6-40cf-8d5d-ffc5081c378d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:40.082870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e20d882-95e6-40cf-8d5d-ffc5081c378d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:40.083359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e20d882-95e6-40cf-8d5d-ffc5081c378d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:40.083870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e20d882-95e6-40cf-8d5d-ffc5081c378d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:40.547918 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-417c6611-823f-46d2-92ee-6bd380ba28eb tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.486311 Aug 27 05:02:40.548779 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1074/2210] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 05:02:40 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:40.563255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9f3b1cae-4c12-4d5a-8da4-0afe6fdba647 tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] Calling method '.version_select at 0x7fb5696c2dc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:40.569386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e20d882-95e6-40cf-8d5d-ffc5081c378d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:40.589678 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e20d882-95e6-40cf-8d5d-ffc5081c378d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1319 microversion: 2.1 time: 0.527207 Aug 27 05:02:40.609186 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1137/2211] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:40 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:40.736490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-51c8cf4b-986c-4445-a8fa-c137ee7a4b1d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:40.737045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-51c8cf4b-986c-4445-a8fa-c137ee7a4b1d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:40.753837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51c8cf4b-986c-4445-a8fa-c137ee7a4b1d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:40.754339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51c8cf4b-986c-4445-a8fa-c137ee7a4b1d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:40.756343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51c8cf4b-986c-4445-a8fa-c137ee7a4b1d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:40.760193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51c8cf4b-986c-4445-a8fa-c137ee7a4b1d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:40.761933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51c8cf4b-986c-4445-a8fa-c137ee7a4b1d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:40.762540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51c8cf4b-986c-4445-a8fa-c137ee7a4b1d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:41.799705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-51c8cf4b-986c-4445-a8fa-c137ee7a4b1d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:41.811010 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-51c8cf4b-986c-4445-a8fa-c137ee7a4b1d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1466 microversion: 2.1 time: 1.078632 Aug 27 05:02:41.819513 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1138/2212] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:40 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1466 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:41.825513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:41.827802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: d25cb7fa-29c6-4d28-bd24-ecff7105f488] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:41.850812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:41.852816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:41.859425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:41.860485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:41.861212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:41.862410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:41.895073 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] HTTP exception thrown: Instance d25cb7fa-29c6-4d28-bd24-ecff7105f488 could not be found. Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Request method failure captured: Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 HTTP/1.1 Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaO8qiwdwrhgANbiMW2ysH0ctb13U5Z1_TCBj33ijkrWaSIDSNo5yF_nxmbFTTTg1eEPK1kwVatuatfn-2CgOGpYlMTyh6180kZ2cs5RAZIpAiO-gbQ1azVbAz241kTqQ6M0VWJtNg8H4ztjIdMzWn_vAqrXNt5R2D96fMJ7Tnqg03o Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: dd2736d36f16463c81a760e69e48fd28 Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-LiveMigrationTest-456567651 Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd2736d36f16463c81a760e69e48fd28", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-LiveMigrationTest-456567651 Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: dd2736d36f16463c81a760e69e48fd28 Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-LiveMigrationTest-456567651 Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-LiveMigrationTest-456567651-project Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 17c08abee58846229f9255f8d86f762a Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-LiveMigrationTest-456567651-project Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance d25cb7fa-29c6-4d28-bd24-ecff7105f488 could not be found. Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd25cb7fa-29c6-4d28-bd24-ecff7105f488'} Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25cb7fa-29c6-4d28-bd24-ecff7105f488 could not be found. Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25cb7fa-29c6-4d28-bd24-ecff7105f488 could not be found. Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:02:41.898728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:02:41.904857 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:02:41.904857 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:02:41.904857 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:02:41.904857 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:02:41.904857 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:02:41.904857 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25cb7fa-29c6-4d28-bd24-ecff7105f488 could not be found. Aug 27 05:02:41.904857 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:02:41.905958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Returning 404 to user: Instance d25cb7fa-29c6-4d28-bd24-ecff7105f488 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:02:41.908260 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d4ffefc1-d918-4e97-bc0e-66fbfe621cb8 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488" status: 404 len: 111 microversion: 2.1 time: 0.090467 Aug 27 05:02:41.911248 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1139/2213] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:41 2022] GET /compute/v2.1/servers/d25cb7fa-29c6-4d28-bd24-ecff7105f488 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:02:41.942593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-42185c1b-55b7-48db-936d-1337506d9691 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:41.944014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-42185c1b-55b7-48db-936d-1337506d9691 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:41.964492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42185c1b-55b7-48db-936d-1337506d9691 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:41.965123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42185c1b-55b7-48db-936d-1337506d9691 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:41.965573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42185c1b-55b7-48db-936d-1337506d9691 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:41.966307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42185c1b-55b7-48db-936d-1337506d9691 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:41.968645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42185c1b-55b7-48db-936d-1337506d9691 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:41.971305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42185c1b-55b7-48db-936d-1337506d9691 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:42.651201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-42185c1b-55b7-48db-936d-1337506d9691 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:42.660415 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-42185c1b-55b7-48db-936d-1337506d9691 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1319 microversion: 2.1 time: 0.746807 Aug 27 05:02:42.669457 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1140/2214] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:41 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1319 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:42.682781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-69bd0714-5f22-4898-9f98-2fb3d723628d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1975480649", "metadata": {"image_type": "test"}}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:42.686712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-69bd0714-5f22-4898-9f98-2fb3d723628d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:42.694159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69bd0714-5f22-4898-9f98-2fb3d723628d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:42.694990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69bd0714-5f22-4898-9f98-2fb3d723628d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:42.695714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69bd0714-5f22-4898-9f98-2fb3d723628d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:42.696790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69bd0714-5f22-4898-9f98-2fb3d723628d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:42.697555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69bd0714-5f22-4898-9f98-2fb3d723628d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:42.698199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69bd0714-5f22-4898-9f98-2fb3d723628d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:42.732607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:42.735973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:42.744876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-69bd0714-5f22-4898-9f98-2fb3d723628d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Getting quotas for project c3b22db8ab87483daf2acf10c94950cc. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:02:42.758412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-69bd0714-5f22-4898-9f98-2fb3d723628d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Getting quotas for user 16669649a1c345c9b1a8ab8d1e52012d and project c3b22db8ab87483daf2acf10c94950cc. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:02:43.299347 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-69bd0714-5f22-4898-9f98-2fb3d723628d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "POST /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e/action" status: 202 len: 0 microversion: 2.1 time: 0.624424 Aug 27 05:02:43.300914 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1141/2215] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:02:42 2022] POST /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 05:02:43.316225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e334d350-b162-41c4-9051-ab261eadbd32 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb564f6c1f0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:43.429996 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e334d350-b162-41c4-9051-ab261eadbd32 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.121894 Aug 27 05:02:43.431397 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1142/2216] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:43 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:43.473407 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9f3b1cae-4c12-4d5a-8da4-0afe6fdba647 tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/4063494c-61ac-4eab-82d5-8503b6e25a05" status: 202 len: 0 microversion: 2.1 time: 2.914447 Aug 27 05:02:43.473989 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1075/2217] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:02:40 2022] DELETE /compute/v2.1/os-floating-ips/4063494c-61ac-4eab-82d5-8503b6e25a05 => generated 0 bytes in 2916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:02:43.484941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3172183e-38d7-4ae6-a165-978066b91eef tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] Calling method '.version_select at 0x7fb565191e50>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:43.689905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c54facd1-f8f3-4b68-b408-de6454148795 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:43.690529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c54facd1-f8f3-4b68-b408-de6454148795 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:43.705520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54facd1-f8f3-4b68-b408-de6454148795 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:43.706032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54facd1-f8f3-4b68-b408-de6454148795 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:43.706479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54facd1-f8f3-4b68-b408-de6454148795 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:43.712869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54facd1-f8f3-4b68-b408-de6454148795 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:43.713378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54facd1-f8f3-4b68-b408-de6454148795 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:43.713830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54facd1-f8f3-4b68-b408-de6454148795 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:44.288364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c54facd1-f8f3-4b68-b408-de6454148795 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:44.300356 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c54facd1-f8f3-4b68-b408-de6454148795 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1319 microversion: 2.1 time: 0.614243 Aug 27 05:02:44.319043 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1076/2218] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:43 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1319 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:44.446198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c4cf414-fa6b-48da-8423-b9c0da4e39d8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb565008b80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:44.540190 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c4cf414-fa6b-48da-8423-b9c0da4e39d8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.097367 Aug 27 05:02:44.545703 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1077/2219] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:44 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:45.326634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b0d05c2b-60c8-46df-9dbd-71fde4db0710 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:45.327532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b0d05c2b-60c8-46df-9dbd-71fde4db0710 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:45.345581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0d05c2b-60c8-46df-9dbd-71fde4db0710 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:45.346851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0d05c2b-60c8-46df-9dbd-71fde4db0710 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:45.348557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0d05c2b-60c8-46df-9dbd-71fde4db0710 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:45.352247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0d05c2b-60c8-46df-9dbd-71fde4db0710 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:45.353190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0d05c2b-60c8-46df-9dbd-71fde4db0710 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:45.353815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0d05c2b-60c8-46df-9dbd-71fde4db0710 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:45.412271 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3172183e-38d7-4ae6-a165-978066b91eef tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/7f7f85af-e411-4613-823a-81a19f1e84ec" status: 202 len: 0 microversion: 2.1 time: 1.933594 Aug 27 05:02:45.412974 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1143/2220] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:02:43 2022] DELETE /compute/v2.1/os-floating-ips/7f7f85af-e411-4613-823a-81a19f1e84ec => generated 0 bytes in 1935 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:02:45.421386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5ddc22e-7917-46f4-9ef6-21b932bca673 tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] Calling method '.version_select at 0x7fb5654cc790>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:45.708006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b0d05c2b-60c8-46df-9dbd-71fde4db0710 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:45.712025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:45.724506 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b0d05c2b-60c8-46df-9dbd-71fde4db0710 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1319 microversion: 2.1 time: 0.403647 Aug 27 05:02:45.744478 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1078/2221] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:45 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:45.749830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-550b937a-146d-4c92-b743-9cd8a991f3df tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5650081f0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:45.841545 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-550b937a-146d-4c92-b743-9cd8a991f3df tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.095752 Aug 27 05:02:45.842306 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1079/2222] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:45 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:46.763152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-497b2fea-392c-4aba-aa3b-2ec5580676b7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:46.765424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-497b2fea-392c-4aba-aa3b-2ec5580676b7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:46.795486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-497b2fea-392c-4aba-aa3b-2ec5580676b7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.805638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-497b2fea-392c-4aba-aa3b-2ec5580676b7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.817325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-497b2fea-392c-4aba-aa3b-2ec5580676b7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.825296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-497b2fea-392c-4aba-aa3b-2ec5580676b7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.826047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-497b2fea-392c-4aba-aa3b-2ec5580676b7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.826780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-497b2fea-392c-4aba-aa3b-2ec5580676b7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:47.513612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-497b2fea-392c-4aba-aa3b-2ec5580676b7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:47.526853 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-497b2fea-392c-4aba-aa3b-2ec5580676b7 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1319 microversion: 2.1 time: 0.775644 Aug 27 05:02:47.543842 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1080/2223] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:46 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1319 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:47.551973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3312a11c-d7f1-4720-8d1e-4a47358b4f6d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb564fff280>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:47.651358 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3312a11c-d7f1-4720-8d1e-4a47358b4f6d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.103721 Aug 27 05:02:47.665822 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1081/2224] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:47 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:47.701367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c20cf958-4ed7-4e1d-b0c5-e99ab8ce731d req-d38d3fed-51ad-4202-a5c1-34baf9c66385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10bdb977-4db9-4617-a264-fa34fdad10f2", "name": "network-vif-plugged", "status": "completed", "tag": "ac68a06a-80f4-423a-9041-3661dde5f027"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:47.746168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c20cf958-4ed7-4e1d-b0c5-e99ab8ce731d req-d38d3fed-51ad-4202-a5c1-34baf9c66385 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:47.746481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c20cf958-4ed7-4e1d-b0c5-e99ab8ce731d req-d38d3fed-51ad-4202-a5c1-34baf9c66385 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:47.746930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c20cf958-4ed7-4e1d-b0c5-e99ab8ce731d req-d38d3fed-51ad-4202-a5c1-34baf9c66385 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:47.785812 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c20cf958-4ed7-4e1d-b0c5-e99ab8ce731d req-d38d3fed-51ad-4202-a5c1-34baf9c66385 service nova] Creating event network-vif-plugged:ac68a06a-80f4-423a-9041-3661dde5f027 for instance 10bdb977-4db9-4617-a264-fa34fdad10f2 on n-h1-820368-35 Aug 27 05:02:47.803488 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c20cf958-4ed7-4e1d-b0c5-e99ab8ce731d req-d38d3fed-51ad-4202-a5c1-34baf9c66385 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133349 Aug 27 05:02:47.805615 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1082/2225] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:48.101113 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5ddc22e-7917-46f4-9ef6-21b932bca673 tempest-FloatingIPDetailsTestJSON-1447226788 tempest-FloatingIPDetailsTestJSON-1447226788-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/6c69b20d-16c1-4359-a04e-45b6a2371d1e" status: 202 len: 0 microversion: 2.1 time: 2.683814 Aug 27 05:02:48.105326 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1144/2226] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:02:45 2022] DELETE /compute/v2.1/os-floating-ips/6c69b20d-16c1-4359-a04e-45b6a2371d1e => generated 0 bytes in 2689 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:02:48.558980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e053e8c3-fbf7-4e9c-898a-b5ceaa7f4f6c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:48.559758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e053e8c3-fbf7-4e9c-898a-b5ceaa7f4f6c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:48.578384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e053e8c3-fbf7-4e9c-898a-b5ceaa7f4f6c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:48.578923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e053e8c3-fbf7-4e9c-898a-b5ceaa7f4f6c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:48.584562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e053e8c3-fbf7-4e9c-898a-b5ceaa7f4f6c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:48.585760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e053e8c3-fbf7-4e9c-898a-b5ceaa7f4f6c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:48.586478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e053e8c3-fbf7-4e9c-898a-b5ceaa7f4f6c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:48.589996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e053e8c3-fbf7-4e9c-898a-b5ceaa7f4f6c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:48.681457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-084cd927-afba-4ef1-a404-f0fcdbd1dccb tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5652d0160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:48.875023 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-084cd927-afba-4ef1-a404-f0fcdbd1dccb tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.199448 Aug 27 05:02:48.878372 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1145/2227] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:48 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:49.286772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e053e8c3-fbf7-4e9c-898a-b5ceaa7f4f6c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:49.303276 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e053e8c3-fbf7-4e9c-898a-b5ceaa7f4f6c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1319 microversion: 2.1 time: 0.753619 Aug 27 05:02:49.316084 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1083/2228] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:48 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1319 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:49.908537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d45e9c2d-ad2f-4e20-85a8-d6062cbc714e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5651954c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:50.052394 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d45e9c2d-ad2f-4e20-85a8-d6062cbc714e tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.164244 Aug 27 05:02:50.053077 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1146/2229] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:49 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:50.174361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b11d41a-b80b-48ac-a423-4da0e14585c0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:50.174852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6b11d41a-b80b-48ac-a423-4da0e14585c0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:50.207047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b11d41a-b80b-48ac-a423-4da0e14585c0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:50.210834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b11d41a-b80b-48ac-a423-4da0e14585c0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:50.213087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b11d41a-b80b-48ac-a423-4da0e14585c0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:50.214038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b11d41a-b80b-48ac-a423-4da0e14585c0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:50.216610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b11d41a-b80b-48ac-a423-4da0e14585c0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:50.217517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b11d41a-b80b-48ac-a423-4da0e14585c0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:50.290919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6b11d41a-b80b-48ac-a423-4da0e14585c0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:02:50.301513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1bdeca34-9649-41e0-a117-597646297103 req-b41d0888-dd4a-4337-96d7-acfdd2c550cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e", "name": "network-vif-plugged", "status": "completed", "tag": "bafc5b86-279b-411c-9b1a-ae47f7108d43"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:50.331560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1bdeca34-9649-41e0-a117-597646297103 req-b41d0888-dd4a-4337-96d7-acfdd2c550cf service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:50.338061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1bdeca34-9649-41e0-a117-597646297103 req-b41d0888-dd4a-4337-96d7-acfdd2c550cf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:50.338517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1bdeca34-9649-41e0-a117-597646297103 req-b41d0888-dd4a-4337-96d7-acfdd2c550cf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:50.386602 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1bdeca34-9649-41e0-a117-597646297103 req-b41d0888-dd4a-4337-96d7-acfdd2c550cf service nova] Creating event network-vif-plugged:bafc5b86-279b-411c-9b1a-ae47f7108d43 for instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e on n-h2-820368-35 Aug 27 05:02:50.407291 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1bdeca34-9649-41e0-a117-597646297103 req-b41d0888-dd4a-4337-96d7-acfdd2c550cf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109576 Aug 27 05:02:50.415792 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1147/2230] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 05:02:50.422358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b81d7217-4563-4ca6-8ec0-469f9fbaecbc tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:50.442695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b81d7217-4563-4ca6-8ec0-469f9fbaecbc tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:50.455869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b81d7217-4563-4ca6-8ec0-469f9fbaecbc tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:50.457026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b81d7217-4563-4ca6-8ec0-469f9fbaecbc tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:50.457682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b81d7217-4563-4ca6-8ec0-469f9fbaecbc tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:50.471909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b81d7217-4563-4ca6-8ec0-469f9fbaecbc tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:50.472732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b81d7217-4563-4ca6-8ec0-469f9fbaecbc tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:50.473387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b81d7217-4563-4ca6-8ec0-469f9fbaecbc tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:50.551017 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b11d41a-b80b-48ac-a423-4da0e14585c0 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 204 len: 0 microversion: 2.1 time: 0.383684 Aug 27 05:02:50.556386 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1084/2231] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:02:50 2022] DELETE /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:02:50.566809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5e8322b9-332f-4e54-a9c9-00ee147afd38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:50.580171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5e8322b9-332f-4e54-a9c9-00ee147afd38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:50.613341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e8322b9-332f-4e54-a9c9-00ee147afd38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:50.613849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e8322b9-332f-4e54-a9c9-00ee147afd38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:50.614296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e8322b9-332f-4e54-a9c9-00ee147afd38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:50.615015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e8322b9-332f-4e54-a9c9-00ee147afd38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:50.615496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e8322b9-332f-4e54-a9c9-00ee147afd38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:50.615918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e8322b9-332f-4e54-a9c9-00ee147afd38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:50.887497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5e8322b9-332f-4e54-a9c9-00ee147afd38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:50.899450 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5e8322b9-332f-4e54-a9c9-00ee147afd38 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1664 microversion: 2.1 time: 0.338324 Aug 27 05:02:50.900226 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1085/2232] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:50 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1664 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:51.068672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-83d7ba1a-65e4-4ffc-a28d-613bd0533dc3 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb56509fdc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:51.087528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b81d7217-4563-4ca6-8ec0-469f9fbaecbc tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:51.114605 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b81d7217-4563-4ca6-8ec0-469f9fbaecbc tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1468 microversion: 2.1 time: 0.697188 Aug 27 05:02:51.115869 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1148/2233] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:50 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1468 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:51.183158 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-83d7ba1a-65e4-4ffc-a28d-613bd0533dc3 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.118921 Aug 27 05:02:51.184545 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1086/2234] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:51 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:51.741151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2111094175", "block_migration": true, "disk_over_commit": false}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:51.747696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:51.795940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.810343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.810842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.811732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.812103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.812531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.868927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lazy-loading 'flavor' on Instance uuid 10bdb977-4db9-4617-a264-fa34fdad10f2 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:02:51.894128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Going to try to live migrate instance to tempest-host-2111094175 {{(pid=128548) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 05:02:51.916761 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] HTTP exception thrown: Compute host tempest-host-2111094175 could not be found. Aug 27 05:02:51.922252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5c80ccd-6bdb-4500-9c64-5e3a86358780 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:51.922953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b5c80ccd-6bdb-4500-9c64-5e3a86358780 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Request method failure captured: Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2/action HTTP/1.1 Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 107 Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaViQ7gH6bjNyH6YOnAFUrShbrH1YnR01xNgLbwtDiQAIA0fU8WWQy7_h2wtgYUgL8w2y-5s666mUdnHIalUb0Pi-mduNeFvoFMIb0WD7IB56x8keq6AP9pWVRa6B1xHLdAziDGvIz8ALqTaSnefNcrhn384765QRbwB0BFC810Rr2E Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: a96b463468fe4c24937a32653cb2fbb8 Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-LiveMigrationNegativeTest-943115694 Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a96b463468fe4c24937a32653cb2fbb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a96b463468fe4c24937a32653cb2fbb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a96b463468fe4c24937a32653cb2fbb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a96b463468fe4c24937a32653cb2fbb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-LiveMigrationNegativeTest-943115694 Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: a96b463468fe4c24937a32653cb2fbb8 Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-943115694 Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-LiveMigrationNegativeTest-943115694-project-admin Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 8eec3d7c33d140b4994d059f5c6514e5 Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-LiveMigrationNegativeTest-943115694-project-admin Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: {"os-migrateLive": {"host": "tempest-host-2111094175", "block_migration": true, "disk_over_commit": false}} Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: exception: Compute host tempest-host-2111094175 could not be found. Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '10bdb977-4db9-4617-a264-fa34fdad10f2', 'body': {'os-migrateLive': {'host': 'tempest-host-2111094175', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 27 05:02:51.939502 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2111094175 could not be found. Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2111094175 could not be found. Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2111094175 could not be found. Aug 27 05:02:51.943968 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:02:51.948903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c80ccd-6bdb-4500-9c64-5e3a86358780 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.949039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Returning 400 to user: Compute host tempest-host-2111094175 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:02:51.949133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c80ccd-6bdb-4500-9c64-5e3a86358780 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.949133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c80ccd-6bdb-4500-9c64-5e3a86358780 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.949386 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3078cdb0-2a86-45ee-ba6a-70ed97a3dbca tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2/action" status: 400 len: 100 microversion: 2.1 time: 0.808251 Aug 27 05:02:51.949594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c80ccd-6bdb-4500-9c64-5e3a86358780 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.949735 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1149/2235] 10.222.0.58 () {60 vars in 1279 bytes} [Sat Aug 27 05:02:51 2022] POST /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2/action => generated 100 bytes in 810 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:02:51.951890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c80ccd-6bdb-4500-9c64-5e3a86358780 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.958465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d7f40123-a32c-4b02-8de1-b1ae3bf7ebd4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:51.959235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c80ccd-6bdb-4500-9c64-5e3a86358780 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.959368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d7f40123-a32c-4b02-8de1-b1ae3bf7ebd4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:51.972835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7f40123-a32c-4b02-8de1-b1ae3bf7ebd4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.974725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7f40123-a32c-4b02-8de1-b1ae3bf7ebd4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.975471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7f40123-a32c-4b02-8de1-b1ae3bf7ebd4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.976232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7f40123-a32c-4b02-8de1-b1ae3bf7ebd4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.979456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7f40123-a32c-4b02-8de1-b1ae3bf7ebd4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.980103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7f40123-a32c-4b02-8de1-b1ae3bf7ebd4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:53.052990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5c80ccd-6bdb-4500-9c64-5e3a86358780 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:53.082196 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5c80ccd-6bdb-4500-9c64-5e3a86358780 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 200 len: 1597 microversion: 2.1 time: 1.164425 Aug 27 05:02:53.083744 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1087/2236] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:51 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 1597 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:53.103297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fbd025f0-1261-4aab-a296-422f48ecc3d4 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5696c2e50>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:53.170705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d7f40123-a32c-4b02-8de1-b1ae3bf7ebd4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:53.186047 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d7f40123-a32c-4b02-8de1-b1ae3bf7ebd4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1468 microversion: 2.1 time: 1.232871 Aug 27 05:02:53.187205 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1150/2237] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:51 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1468 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:53.481230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1566449623", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:01.927788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:03.059509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:03.177933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:03.511312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=17 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:04.401286 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fbd025f0-1261-4aab-a296-422f48ecc3d4 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 11.313440 Aug 27 05:03:04.402213 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1088/2238] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:53 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 11318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:04.415929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:03:04.416491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-db5a2f0d-43ca-48da-9a57-3952bdb0be12 req-a6af01cd-0775-43ab-9478-16c9dd0c62c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2a6f90-d3c3-4741-b08c-ba80f635644d", "name": "network-vif-deleted", "tag": "c01490d9-89be-4dee-aa67-dfb553426cc3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:04.449506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-db5a2f0d-43ca-48da-9a57-3952bdb0be12 req-a6af01cd-0775-43ab-9478-16c9dd0c62c8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:04.449991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-db5a2f0d-43ca-48da-9a57-3952bdb0be12 req-a6af01cd-0775-43ab-9478-16c9dd0c62c8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:04.450434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-db5a2f0d-43ca-48da-9a57-3952bdb0be12 req-a6af01cd-0775-43ab-9478-16c9dd0c62c8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:04.500088 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-db5a2f0d-43ca-48da-9a57-3952bdb0be12 req-a6af01cd-0775-43ab-9478-16c9dd0c62c8 service nova] Creating event network-vif-deleted:c01490d9-89be-4dee-aa67-dfb553426cc3 for instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d on n-h1-820368-35 Aug 27 05:03:04.513158 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-db5a2f0d-43ca-48da-9a57-3952bdb0be12 req-a6af01cd-0775-43ab-9478-16c9dd0c62c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109606 Aug 27 05:03:04.514950 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1089/2239] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:04.539883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:04.540775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 9f2a6f90-d3c3-4741-b08c-ba80f635644d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:04.560675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:04.561167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:04.561620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:04.562355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:04.562822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:04.563367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:04.611763 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] HTTP exception thrown: Instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d could not be found. Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Request method failure captured: Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d HTTP/1.1 Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaO8qiwdwrhgANbiMW2ysH0ctb13U5Z1_TCBj33ijkrWaSIDSNo5yF_nxmbFTTTg1eEPK1kwVatuatfn-2CgOGpYlMTyh6180kZ2cs5RAZIpAiO-gbQ1azVbAz241kTqQ6M0VWJtNg8H4ztjIdMzWn_vAqrXNt5R2D96fMJ7Tnqg03o Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: dd2736d36f16463c81a760e69e48fd28 Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-LiveMigrationTest-456567651 Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd2736d36f16463c81a760e69e48fd28", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-LiveMigrationTest-456567651 Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: dd2736d36f16463c81a760e69e48fd28 Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-LiveMigrationTest-456567651 Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-LiveMigrationTest-456567651-project Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 17c08abee58846229f9255f8d86f762a Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-LiveMigrationTest-456567651-project Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d could not be found. Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '9f2a6f90-d3c3-4741-b08c-ba80f635644d'} Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d could not be found. Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d could not be found. Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:04.613477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:04.618534 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:04.618534 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:04.618534 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:04.618534 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:04.618534 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:04.618534 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d could not be found. Aug 27 05:03:04.618534 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:04.618534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Returning 404 to user: Instance 9f2a6f90-d3c3-4741-b08c-ba80f635644d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:04.618534 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a33fd422-54ba-4fe8-aaf3-dda726364ed3 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d" status: 404 len: 111 microversion: 2.1 time: 0.098837 Aug 27 05:03:04.618534 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1090/2240] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:04 2022] GET /compute/v2.1/servers/9f2a6f90-d3c3-4741-b08c-ba80f635644d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:04.645613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5416a4e-166b-4cae-9074-eebbaa1529ce tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '.version_select at 0x7fb5657a73a0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:04.699617 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5416a4e-166b-4cae-9074-eebbaa1529ce tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-241873685" status: 202 len: 0 microversion: 2.1 time: 0.073119 Aug 27 05:03:04.700810 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1091/2241] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 05:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-241873685 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:03:05.417076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-13d7d344-45d2-42d1-a772-ca0984259011 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5696c2c10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:05.525494 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-13d7d344-45d2-42d1-a772-ca0984259011 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.112528 Aug 27 05:03:05.541593 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1092/2242] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:05 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:05.576846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:03:05.577277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:03:05.577827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:03:05.578169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:03:05.578586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:03:05.602429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:05.602925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:05.605617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:05.607721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:05.608905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:05.609547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:05.642337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Getting quotas for project 170af42cbb5f42cb91d3047dede7583e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:03:05.666841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Getting quotas for user fdd3e55e6a2842d08aeca3432e872be6 and project 170af42cbb5f42cb91d3047dede7583e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:03:05.701645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:03:05.707262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:03:05.857185 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3d7e70b4-f1e0-43d5-9582-208c7a0b44cb tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.381612 Aug 27 05:03:05.863459 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1151/2243] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:02:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 12388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:03:05.871916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46c72de9-5acd-4264-8883-8f85796a1ff3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:05.872809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-46c72de9-5acd-4264-8883-8f85796a1ff3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:06.098694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46c72de9-5acd-4264-8883-8f85796a1ff3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:06.109016 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-46c72de9-5acd-4264-8883-8f85796a1ff3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1219 microversion: 2.1 time: 0.241425 Aug 27 05:03:06.113256 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1093/2244] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:05 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1219 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:06.554737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d38542c4-ebd9-41b6-aa16-fa1c30248606 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5650dc820>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:06.691732 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d38542c4-ebd9-41b6-aa16-fa1c30248606 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.141546 Aug 27 05:03:06.699028 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1152/2245] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:06 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:07.138205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-05d207da-1d80-4932-ab9d-3db443e3d0c3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:07.139815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-05d207da-1d80-4932-ab9d-3db443e3d0c3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:07.158006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d207da-1d80-4932-ab9d-3db443e3d0c3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:07.161064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d207da-1d80-4932-ab9d-3db443e3d0c3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:07.161942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d207da-1d80-4932-ab9d-3db443e3d0c3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:07.164790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d207da-1d80-4932-ab9d-3db443e3d0c3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:07.165465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d207da-1d80-4932-ab9d-3db443e3d0c3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:07.166065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d207da-1d80-4932-ab9d-3db443e3d0c3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:07.532942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-05d207da-1d80-4932-ab9d-3db443e3d0c3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:07.537161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b37787b3-f246-4340-8ad5-54a5a4fd8768 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:07.537674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b37787b3-f246-4340-8ad5-54a5a4fd8768 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:07.564958 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-05d207da-1d80-4932-ab9d-3db443e3d0c3 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1215 microversion: 2.1 time: 0.432165 Aug 27 05:03:07.567408 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1094/2246] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:07 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1215 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:07.570636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37787b3-f246-4340-8ad5-54a5a4fd8768 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:07.571580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37787b3-f246-4340-8ad5-54a5a4fd8768 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:07.572281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37787b3-f246-4340-8ad5-54a5a4fd8768 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:07.574692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37787b3-f246-4340-8ad5-54a5a4fd8768 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:07.575735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37787b3-f246-4340-8ad5-54a5a4fd8768 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:07.577747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37787b3-f246-4340-8ad5-54a5a4fd8768 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:07.662044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b37787b3-f246-4340-8ad5-54a5a4fd8768 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:03:07.710099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb9ed9dc-2e8d-4722-826e-b4baf38cfb23 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb565bde160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:07.849900 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb9ed9dc-2e8d-4722-826e-b4baf38cfb23 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.143919 Aug 27 05:03:07.850930 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1095/2247] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:07 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:07.975464 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b37787b3-f246-4340-8ad5-54a5a4fd8768 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 204 len: 0 microversion: 2.1 time: 0.443069 Aug 27 05:03:07.979631 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1153/2248] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:03:07 2022] DELETE /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:03:07.987881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4f44e878-0ccd-48e5-b3df-947d37b0f08b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:07.988519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4f44e878-0ccd-48e5-b3df-947d37b0f08b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:08.000621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f44e878-0ccd-48e5-b3df-947d37b0f08b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:08.002163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f44e878-0ccd-48e5-b3df-947d37b0f08b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:08.002643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f44e878-0ccd-48e5-b3df-947d37b0f08b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:08.005951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f44e878-0ccd-48e5-b3df-947d37b0f08b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:08.006438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f44e878-0ccd-48e5-b3df-947d37b0f08b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:08.008272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f44e878-0ccd-48e5-b3df-947d37b0f08b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:08.571539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4f44e878-0ccd-48e5-b3df-947d37b0f08b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:08.580821 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4f44e878-0ccd-48e5-b3df-947d37b0f08b tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1482 microversion: 2.1 time: 0.597487 Aug 27 05:03:08.591049 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1096/2249] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:07 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1482 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:08.604324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-366dc9b9-8594-4cd4-bf17-ee84a0713da6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:08.605348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-366dc9b9-8594-4cd4-bf17-ee84a0713da6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:08.629549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-366dc9b9-8594-4cd4-bf17-ee84a0713da6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:08.638637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-366dc9b9-8594-4cd4-bf17-ee84a0713da6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:08.642411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-366dc9b9-8594-4cd4-bf17-ee84a0713da6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:08.646621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-366dc9b9-8594-4cd4-bf17-ee84a0713da6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:08.651442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-366dc9b9-8594-4cd4-bf17-ee84a0713da6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:08.653887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-366dc9b9-8594-4cd4-bf17-ee84a0713da6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:08.890168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-34dd0351-412f-4354-89c7-3ac62ed6f838 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb56567cee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:09.007192 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-34dd0351-412f-4354-89c7-3ac62ed6f838 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.128712 Aug 27 05:03:09.010293 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1097/2250] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:08 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:09.270021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-366dc9b9-8594-4cd4-bf17-ee84a0713da6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:09.285437 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-366dc9b9-8594-4cd4-bf17-ee84a0713da6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1289 microversion: 2.1 time: 0.685166 Aug 27 05:03:09.294408 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1154/2251] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:08 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1289 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:09.610982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f313918c-a79d-49ab-87cc-5524d8868d60 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:09.612743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f313918c-a79d-49ab-87cc-5524d8868d60 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:09.634434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f313918c-a79d-49ab-87cc-5524d8868d60 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:09.635236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f313918c-a79d-49ab-87cc-5524d8868d60 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:09.639903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f313918c-a79d-49ab-87cc-5524d8868d60 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:09.642846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f313918c-a79d-49ab-87cc-5524d8868d60 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:09.643553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f313918c-a79d-49ab-87cc-5524d8868d60 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:09.645606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f313918c-a79d-49ab-87cc-5524d8868d60 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:10.025367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e50dbf99-5733-470b-87a3-056accbc3887 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb564f3e310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:10.143581 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e50dbf99-5733-470b-87a3-056accbc3887 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.122019 Aug 27 05:03:10.144836 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1155/2252] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:10 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:10.315309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7220a8d6-7bd3-4934-9d90-dc69479c6424 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:10.316591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7220a8d6-7bd3-4934-9d90-dc69479c6424 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:10.325838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7220a8d6-7bd3-4934-9d90-dc69479c6424 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:10.326635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7220a8d6-7bd3-4934-9d90-dc69479c6424 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:10.327317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7220a8d6-7bd3-4934-9d90-dc69479c6424 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:10.328225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7220a8d6-7bd3-4934-9d90-dc69479c6424 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:10.328890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7220a8d6-7bd3-4934-9d90-dc69479c6424 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:10.329504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7220a8d6-7bd3-4934-9d90-dc69479c6424 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:10.668417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f313918c-a79d-49ab-87cc-5524d8868d60 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:10.674387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7220a8d6-7bd3-4934-9d90-dc69479c6424 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:10.694893 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f313918c-a79d-49ab-87cc-5524d8868d60 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1482 microversion: 2.1 time: 1.088104 Aug 27 05:03:10.701794 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7220a8d6-7bd3-4934-9d90-dc69479c6424 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1277 microversion: 2.1 time: 0.390756 Aug 27 05:03:10.714068 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1098/2253] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:09 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1482 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:10.719208 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1156/2254] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:10 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1277 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:11.161177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4997a35f-1a33-4203-87ae-1c315b44efc5 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5650a40d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:11.228749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c5332b85-314b-42db-96c0-9edbab495785 req-793ed1f1-067e-4ff3-9173-a99fb75d1e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b37de1a-3cba-44f1-b297-7031a8831ce1", "name": "network-vif-deleted", "tag": "5e0e371f-d224-460c-af4d-acb183057d97"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:11.315353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c5332b85-314b-42db-96c0-9edbab495785 req-793ed1f1-067e-4ff3-9173-a99fb75d1e55 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:11.338416 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4997a35f-1a33-4203-87ae-1c315b44efc5 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.183458 Aug 27 05:03:11.339145 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1099/2255] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:11 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:11.345287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c5332b85-314b-42db-96c0-9edbab495785 req-793ed1f1-067e-4ff3-9173-a99fb75d1e55 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:11.346104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c5332b85-314b-42db-96c0-9edbab495785 req-793ed1f1-067e-4ff3-9173-a99fb75d1e55 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:11.391522 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c5332b85-314b-42db-96c0-9edbab495785 req-793ed1f1-067e-4ff3-9173-a99fb75d1e55 service nova] Creating event network-vif-deleted:5e0e371f-d224-460c-af4d-acb183057d97 for instance 5b37de1a-3cba-44f1-b297-7031a8831ce1 on n-h2-820368-35 Aug 27 05:03:11.439975 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c5332b85-314b-42db-96c0-9edbab495785 req-793ed1f1-067e-4ff3-9173-a99fb75d1e55 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215608 Aug 27 05:03:11.448739 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1157/2256] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:03:11.721250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:11.725455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:11.727889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6aa121c3-cd02-4cc6-b57d-2aea967e64f6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:11.728800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6aa121c3-cd02-4cc6-b57d-2aea967e64f6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:11.741154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6aa121c3-cd02-4cc6-b57d-2aea967e64f6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:11.742862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6aa121c3-cd02-4cc6-b57d-2aea967e64f6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:11.747111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6aa121c3-cd02-4cc6-b57d-2aea967e64f6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:11.748119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6aa121c3-cd02-4cc6-b57d-2aea967e64f6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:11.749414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6aa121c3-cd02-4cc6-b57d-2aea967e64f6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:11.750430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6aa121c3-cd02-4cc6-b57d-2aea967e64f6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:11.772999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:11.774405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:11.777413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:11.782558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:11.783490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:11.784184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:11.942179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:11.949311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:11.953883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:11.957768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lazy-loading 'fault' on Instance uuid 5b37de1a-3cba-44f1-b297-7031a8831ce1 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:03:12.928249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:12.956123 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-261d8165-8d3a-4634-bf8a-71aeb422350d tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 200 len: 1300 microversion: 2.1 time: 1.241794 Aug 27 05:03:12.987999 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1100/2257] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:11 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 1300 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:13.013941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a48999f-2d8a-45c4-bf0a-be80474b0e28 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb56567c550>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:13.098661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6aa121c3-cd02-4cc6-b57d-2aea967e64f6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:13.113680 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a48999f-2d8a-45c4-bf0a-be80474b0e28 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1422 microversion: 2.1 time: 0.123584 Aug 27 05:03:13.126318 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1101/2258] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:12 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1422 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:13.137306 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6aa121c3-cd02-4cc6-b57d-2aea967e64f6 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1319 microversion: 2.1 time: 1.414906 Aug 27 05:03:13.139457 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1158/2259] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:11 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1319 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:13.410610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-890706481", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "11d496fd-4b16-4935-bb52-9962a7e9cd7d"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:13.517319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] validate_networks() for [('11d496fd-4b16-4935-bb52-9962a7e9cd7d', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:03:13.904769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6b5f1772-3c8d-48e7-b61a-a29936210891 req-250bbb98-48fb-4714-b1c9-415a45aeec01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2fd5f8-fe60-409a-acca-30b6637bca2e", "tag": "f0fe11de-12c9-43b6-833d-c37fe506f890"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:13.950082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6b5f1772-3c8d-48e7-b61a-a29936210891 req-250bbb98-48fb-4714-b1c9-415a45aeec01 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:13.954485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6b5f1772-3c8d-48e7-b61a-a29936210891 req-250bbb98-48fb-4714-b1c9-415a45aeec01 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:13.968417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6b5f1772-3c8d-48e7-b61a-a29936210891 req-250bbb98-48fb-4714-b1c9-415a45aeec01 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:14.021402 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6b5f1772-3c8d-48e7-b61a-a29936210891 req-250bbb98-48fb-4714-b1c9-415a45aeec01 service nova] Creating event network-changed:f0fe11de-12c9-43b6-833d-c37fe506f890 for instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e on n-h2-820368-35 Aug 27 05:03:14.050024 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6b5f1772-3c8d-48e7-b61a-a29936210891 req-250bbb98-48fb-4714-b1c9-415a45aeec01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156143 Aug 27 05:03:14.061758 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1159/2260] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:14.075222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:14.078822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: 5b37de1a-3cba-44f1-b297-7031a8831ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:14.105056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:14.109592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:14.110875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:14.116158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:14.116887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:14.119395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:14.172911 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] HTTP exception thrown: Instance 5b37de1a-3cba-44f1-b297-7031a8831ce1 could not be found. Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Request method failure captured: Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 HTTP/1.1 Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaO8qiwdwrhgANbiMW2ysH0ctb13U5Z1_TCBj33ijkrWaSIDSNo5yF_nxmbFTTTg1eEPK1kwVatuatfn-2CgOGpYlMTyh6180kZ2cs5RAZIpAiO-gbQ1azVbAz241kTqQ6M0VWJtNg8H4ztjIdMzWn_vAqrXNt5R2D96fMJ7Tnqg03o Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: dd2736d36f16463c81a760e69e48fd28 Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-LiveMigrationTest-456567651 Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd2736d36f16463c81a760e69e48fd28", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-LiveMigrationTest-456567651 Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: dd2736d36f16463c81a760e69e48fd28 Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-LiveMigrationTest-456567651 Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-LiveMigrationTest-456567651-project Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 17c08abee58846229f9255f8d86f762a Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-LiveMigrationTest-456567651-project Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 5b37de1a-3cba-44f1-b297-7031a8831ce1 could not be found. Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '5b37de1a-3cba-44f1-b297-7031a8831ce1'} Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b37de1a-3cba-44f1-b297-7031a8831ce1 could not be found. Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b37de1a-3cba-44f1-b297-7031a8831ce1 could not be found. Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:14.176262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:14.180105 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:14.180105 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:14.180105 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:14.180105 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:14.180105 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:14.180105 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b37de1a-3cba-44f1-b297-7031a8831ce1 could not be found. Aug 27 05:03:14.180105 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:14.182926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Returning 404 to user: Instance 5b37de1a-3cba-44f1-b297-7031a8831ce1 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:14.184795 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6787740b-eff6-4339-8abe-a68fcba5d0df tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1" status: 404 len: 111 microversion: 2.1 time: 0.119070 Aug 27 05:03:14.185593 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1160/2261] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:14 2022] GET /compute/v2.1/servers/5b37de1a-3cba-44f1-b297-7031a8831ce1 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:14.197607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-924ba412-f2f4-4f74-9985-9792e65b0e1c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb564f734c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:14.814791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:03:14.815920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:03:14.816531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:03:14.816950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:03:14.817379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:03:14.834946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:14.835939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:14.838059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:14.839072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:14.839714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:14.840452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:14.881097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Getting quotas for project d8fa2042dc6a457fa50dcbf75e3a32ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:03:14.897607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Getting quotas for user 979e8da1534344fcb5a2be09631ea09c and project d8fa2042dc6a457fa50dcbf75e3a32ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:03:14.917943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:03:14.921430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:03:15.028266 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ce885597-1bb2-4740-a5a8-feb563f9795e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.900720 Aug 27 05:03:15.030583 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1102/2262] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:03:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:03:15.064240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-60b3159a-0c32-4eef-ba07-b8eb74e71510 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:15.067261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-60b3159a-0c32-4eef-ba07-b8eb74e71510 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:15.090750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3159a-0c32-4eef-ba07-b8eb74e71510 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:15.095872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3159a-0c32-4eef-ba07-b8eb74e71510 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:15.096659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3159a-0c32-4eef-ba07-b8eb74e71510 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:15.099280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3159a-0c32-4eef-ba07-b8eb74e71510 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:15.099988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3159a-0c32-4eef-ba07-b8eb74e71510 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:15.103977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3159a-0c32-4eef-ba07-b8eb74e71510 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:15.624944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:15.687325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-60b3159a-0c32-4eef-ba07-b8eb74e71510 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:15.688106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:15.714592 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-60b3159a-0c32-4eef-ba07-b8eb74e71510 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1319 microversion: 2.1 time: 0.679821 Aug 27 05:03:15.733519 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1103/2263] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:15 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1319 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:15.758698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9a264d0-5054-43f2-a5b6-88f69024e9fb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:15.761877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9a264d0-5054-43f2-a5b6-88f69024e9fb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:15.797075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a264d0-5054-43f2-a5b6-88f69024e9fb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:15.807871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a264d0-5054-43f2-a5b6-88f69024e9fb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:15.808467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a264d0-5054-43f2-a5b6-88f69024e9fb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:15.811844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a264d0-5054-43f2-a5b6-88f69024e9fb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:15.812340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a264d0-5054-43f2-a5b6-88f69024e9fb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:15.812780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a264d0-5054-43f2-a5b6-88f69024e9fb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:15.923962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9a264d0-5054-43f2-a5b6-88f69024e9fb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:03:16.204463 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9a264d0-5054-43f2-a5b6-88f69024e9fb tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 204 len: 0 microversion: 2.1 time: 0.463925 Aug 27 05:03:16.207143 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1104/2264] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:03:15 2022] DELETE /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:03:16.222279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c6b93df-5c8a-487c-aa81-3b64c8b4f0e7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:16.222931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c6b93df-5c8a-487c-aa81-3b64c8b4f0e7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:16.410717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c6b93df-5c8a-487c-aa81-3b64c8b4f0e7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:16.418632 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c6b93df-5c8a-487c-aa81-3b64c8b4f0e7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1207 microversion: 2.1 time: 0.212301 Aug 27 05:03:16.424116 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1105/2265] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:16 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1207 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:16.435702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-60b01f58-6ccd-4bcf-b2e1-403b23275c2a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:16.440904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-60b01f58-6ccd-4bcf-b2e1-403b23275c2a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:16.459425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b01f58-6ccd-4bcf-b2e1-403b23275c2a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:16.460065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b01f58-6ccd-4bcf-b2e1-403b23275c2a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:16.460521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b01f58-6ccd-4bcf-b2e1-403b23275c2a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:16.467602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b01f58-6ccd-4bcf-b2e1-403b23275c2a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:16.468439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b01f58-6ccd-4bcf-b2e1-403b23275c2a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:16.469797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b01f58-6ccd-4bcf-b2e1-403b23275c2a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:16.910067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-60b01f58-6ccd-4bcf-b2e1-403b23275c2a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:16.925862 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-60b01f58-6ccd-4bcf-b2e1-403b23275c2a tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1498 microversion: 2.1 time: 0.499790 Aug 27 05:03:16.927175 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1106/2266] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:16 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1498 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:16.943743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f52374b4-19d2-4e8f-966d-431ac3ab50de tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:16.944925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f52374b4-19d2-4e8f-966d-431ac3ab50de tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:16.959616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f52374b4-19d2-4e8f-966d-431ac3ab50de tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:16.961073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f52374b4-19d2-4e8f-966d-431ac3ab50de tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:16.961785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f52374b4-19d2-4e8f-966d-431ac3ab50de tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:16.965899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f52374b4-19d2-4e8f-966d-431ac3ab50de tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:16.967452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f52374b4-19d2-4e8f-966d-431ac3ab50de tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:16.969758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f52374b4-19d2-4e8f-966d-431ac3ab50de tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:17.301211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f52374b4-19d2-4e8f-966d-431ac3ab50de tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:17.316718 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f52374b4-19d2-4e8f-966d-431ac3ab50de tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1319 microversion: 2.1 time: 0.388239 Aug 27 05:03:17.345937 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1107/2267] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:16 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:17.442781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a52deb3-5ea7-473b-80d9-e08402fe1400 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:17.443422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a52deb3-5ea7-473b-80d9-e08402fe1400 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:17.463458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a52deb3-5ea7-473b-80d9-e08402fe1400 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:17.465541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a52deb3-5ea7-473b-80d9-e08402fe1400 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:17.466191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a52deb3-5ea7-473b-80d9-e08402fe1400 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:17.469440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a52deb3-5ea7-473b-80d9-e08402fe1400 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:17.470087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a52deb3-5ea7-473b-80d9-e08402fe1400 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:17.471180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a52deb3-5ea7-473b-80d9-e08402fe1400 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:17.595297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2a52deb3-5ea7-473b-80d9-e08402fe1400 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:17.624335 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a52deb3-5ea7-473b-80d9-e08402fe1400 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1259 microversion: 2.1 time: 0.179034 Aug 27 05:03:17.627343 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1108/2268] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:17 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:17.953713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5c181ca8-a9a7-44a2-864b-4d7a866a762c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:17.955177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5c181ca8-a9a7-44a2-864b-4d7a866a762c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:17.981266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c181ca8-a9a7-44a2-864b-4d7a866a762c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:17.986632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c181ca8-a9a7-44a2-864b-4d7a866a762c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:17.989467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c181ca8-a9a7-44a2-864b-4d7a866a762c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:17.990470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c181ca8-a9a7-44a2-864b-4d7a866a762c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:17.994774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c181ca8-a9a7-44a2-864b-4d7a866a762c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:17.998724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c181ca8-a9a7-44a2-864b-4d7a866a762c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:18.432612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5c181ca8-a9a7-44a2-864b-4d7a866a762c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:18.446927 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5c181ca8-a9a7-44a2-864b-4d7a866a762c tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1498 microversion: 2.1 time: 0.498305 Aug 27 05:03:18.449739 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1109/2269] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:17 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1498 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:18.467004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a8f35c35-756b-47d4-921f-6f230e67c672 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:18.468302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a8f35c35-756b-47d4-921f-6f230e67c672 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:18.475183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f35c35-756b-47d4-921f-6f230e67c672 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:18.477953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f35c35-756b-47d4-921f-6f230e67c672 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:18.478614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f35c35-756b-47d4-921f-6f230e67c672 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:18.481361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f35c35-756b-47d4-921f-6f230e67c672 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:18.481995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f35c35-756b-47d4-921f-6f230e67c672 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:18.483927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f35c35-756b-47d4-921f-6f230e67c672 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.010438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a8f35c35-756b-47d4-921f-6f230e67c672 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:19.025511 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a8f35c35-756b-47d4-921f-6f230e67c672 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1319 microversion: 2.1 time: 0.574388 Aug 27 05:03:19.029413 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1110/2270] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:18 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1319 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:19.090782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ddcfd9c1-3dff-4b80-905b-fd7a6cce38c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:19.091553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ddcfd9c1-3dff-4b80-905b-fd7a6cce38c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:19.107532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddcfd9c1-3dff-4b80-905b-fd7a6cce38c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.110787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddcfd9c1-3dff-4b80-905b-fd7a6cce38c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.113753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddcfd9c1-3dff-4b80-905b-fd7a6cce38c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.117146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddcfd9c1-3dff-4b80-905b-fd7a6cce38c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.117916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddcfd9c1-3dff-4b80-905b-fd7a6cce38c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.119152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddcfd9c1-3dff-4b80-905b-fd7a6cce38c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.283513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ddcfd9c1-3dff-4b80-905b-fd7a6cce38c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:19.296472 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ddcfd9c1-3dff-4b80-905b-fd7a6cce38c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1265 microversion: 2.1 time: 0.265841 Aug 27 05:03:19.345568 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1111/2271] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:19 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:19.358334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b3bb1a36-5c16-43bd-9e20-f4c4444fc5c1 req-1f62c423-74a2-4053-8e8d-ced1a5915599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a984e8-a342-45d3-80b7-f149773c4c19", "name": "network-vif-deleted", "tag": "4f37ae87-ac14-4a9c-adf4-091cf9796741"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:19.393499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b3bb1a36-5c16-43bd-9e20-f4c4444fc5c1 req-1f62c423-74a2-4053-8e8d-ced1a5915599 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.395516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b3bb1a36-5c16-43bd-9e20-f4c4444fc5c1 req-1f62c423-74a2-4053-8e8d-ced1a5915599 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.399922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b3bb1a36-5c16-43bd-9e20-f4c4444fc5c1 req-1f62c423-74a2-4053-8e8d-ced1a5915599 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.454831 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b3bb1a36-5c16-43bd-9e20-f4c4444fc5c1 req-1f62c423-74a2-4053-8e8d-ced1a5915599 service nova] Creating event network-vif-deleted:4f37ae87-ac14-4a9c-adf4-091cf9796741 for instance e6a984e8-a342-45d3-80b7-f149773c4c19 on n-h1-820368-35 Aug 27 05:03:19.471598 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b3bb1a36-5c16-43bd-9e20-f4c4444fc5c1 req-1f62c423-74a2-4053-8e8d-ced1a5915599 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124316 Aug 27 05:03:19.480037 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1112/2272] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:19.495528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:19.497899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:19.524193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.524994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.527783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.528930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.529626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.533309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.621067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.624328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.627025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.628973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lazy-loading 'fault' on Instance uuid e6a984e8-a342-45d3-80b7-f149773c4c19 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:03:20.324944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c08abee58846229f9255f8d86f762a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2736d36f16463c81a760e69e48fd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:20.336980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:20.345739 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf4e27d2-75a4-48b0-a048-883ef69110c5 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 200 len: 1300 microversion: 2.1 time: 0.860842 Aug 27 05:03:20.365468 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1113/2273] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:19 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 1300 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:20.381837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b0fdf12-3418-421c-bd98-3da9c13d9d72 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:20.383578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9b0fdf12-3418-421c-bd98-3da9c13d9d72 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:20.403424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b0fdf12-3418-421c-bd98-3da9c13d9d72 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:20.404285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b0fdf12-3418-421c-bd98-3da9c13d9d72 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:20.404969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b0fdf12-3418-421c-bd98-3da9c13d9d72 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:20.406960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b0fdf12-3418-421c-bd98-3da9c13d9d72 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:20.410681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b0fdf12-3418-421c-bd98-3da9c13d9d72 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:20.411904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b0fdf12-3418-421c-bd98-3da9c13d9d72 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:20.967468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9b0fdf12-3418-421c-bd98-3da9c13d9d72 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:20.975868 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9b0fdf12-3418-421c-bd98-3da9c13d9d72 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1319 microversion: 2.1 time: 0.609002 Aug 27 05:03:20.983146 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1114/2274] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:20 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1319 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:21.010182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a91efe01-8971-44dd-870f-2a85a1a4bfbf tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:21.011441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a91efe01-8971-44dd-870f-2a85a1a4bfbf tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:21.026801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a91efe01-8971-44dd-870f-2a85a1a4bfbf tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:21.027814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a91efe01-8971-44dd-870f-2a85a1a4bfbf tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:21.032100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a91efe01-8971-44dd-870f-2a85a1a4bfbf tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:21.034170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a91efe01-8971-44dd-870f-2a85a1a4bfbf tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:21.035160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a91efe01-8971-44dd-870f-2a85a1a4bfbf tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:21.038149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a91efe01-8971-44dd-870f-2a85a1a4bfbf tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:21.413015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a91efe01-8971-44dd-870f-2a85a1a4bfbf tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:21.423801 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a91efe01-8971-44dd-870f-2a85a1a4bfbf tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1307 microversion: 2.1 time: 0.424834 Aug 27 05:03:21.428905 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1115/2275] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:20 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:21.436528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:21.441875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] [instance: e6a984e8-a342-45d3-80b7-f149773c4c19] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:21.459922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:21.465555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:21.466244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:21.467497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:21.468165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:21.468825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:21.519294 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] HTTP exception thrown: Instance e6a984e8-a342-45d3-80b7-f149773c4c19 could not be found. Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Request method failure captured: Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 HTTP/1.1 Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaO8qiwdwrhgANbiMW2ysH0ctb13U5Z1_TCBj33ijkrWaSIDSNo5yF_nxmbFTTTg1eEPK1kwVatuatfn-2CgOGpYlMTyh6180kZ2cs5RAZIpAiO-gbQ1azVbAz241kTqQ6M0VWJtNg8H4ztjIdMzWn_vAqrXNt5R2D96fMJ7Tnqg03o Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: dd2736d36f16463c81a760e69e48fd28 Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-LiveMigrationTest-456567651 Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd2736d36f16463c81a760e69e48fd28", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd2736d36f16463c81a760e69e48fd28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-LiveMigrationTest-456567651 Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: dd2736d36f16463c81a760e69e48fd28 Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-LiveMigrationTest-456567651 Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-LiveMigrationTest-456567651-project Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 17c08abee58846229f9255f8d86f762a Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-LiveMigrationTest-456567651-project Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e6a984e8-a342-45d3-80b7-f149773c4c19 could not be found. Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e6a984e8-a342-45d3-80b7-f149773c4c19'} Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6a984e8-a342-45d3-80b7-f149773c4c19 could not be found. Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6a984e8-a342-45d3-80b7-f149773c4c19 could not be found. Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:21.527736 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:21.532997 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:21.532997 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:21.532997 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:21.532997 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:21.532997 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:21.532997 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6a984e8-a342-45d3-80b7-f149773c4c19 could not be found. Aug 27 05:03:21.532997 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:21.532997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] Returning 404 to user: Instance e6a984e8-a342-45d3-80b7-f149773c4c19 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:21.532997 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9077502e-55f9-4d0b-b01d-e6fe4cf96b01 tempest-LiveMigrationTest-456567651 tempest-LiveMigrationTest-456567651-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19" status: 404 len: 111 microversion: 2.1 time: 0.097379 Aug 27 05:03:21.532997 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1116/2276] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:21 2022] GET /compute/v2.1/servers/e6a984e8-a342-45d3-80b7-f149773c4c19 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:22.015126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a8ce7b06-7988-4ff2-a388-dcdb146abfa2 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:22.016657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a8ce7b06-7988-4ff2-a388-dcdb146abfa2 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:22.035629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8ce7b06-7988-4ff2-a388-dcdb146abfa2 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.036469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8ce7b06-7988-4ff2-a388-dcdb146abfa2 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.038070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8ce7b06-7988-4ff2-a388-dcdb146abfa2 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.040664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8ce7b06-7988-4ff2-a388-dcdb146abfa2 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.042784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8ce7b06-7988-4ff2-a388-dcdb146abfa2 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.043435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8ce7b06-7988-4ff2-a388-dcdb146abfa2 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.543216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a8ce7b06-7988-4ff2-a388-dcdb146abfa2 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:22.558384 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a8ce7b06-7988-4ff2-a388-dcdb146abfa2 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1319 microversion: 2.1 time: 0.545828 Aug 27 05:03:22.560566 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1117/2277] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:22 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:22.583603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5832980d-0f91-4b81-94ca-4fe9903b9b1d req-bad39a5d-3f48-4b1a-add7-b2ed36faf09a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cc590d-689d-46fe-8dc4-c011387de6e9", "tag": "5ee83f90-dbeb-4713-85dd-e6139e429832"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:22.606083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5832980d-0f91-4b81-94ca-4fe9903b9b1d req-bad39a5d-3f48-4b1a-add7-b2ed36faf09a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.606734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5832980d-0f91-4b81-94ca-4fe9903b9b1d req-bad39a5d-3f48-4b1a-add7-b2ed36faf09a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.607455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5832980d-0f91-4b81-94ca-4fe9903b9b1d req-bad39a5d-3f48-4b1a-add7-b2ed36faf09a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.628020 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5832980d-0f91-4b81-94ca-4fe9903b9b1d req-bad39a5d-3f48-4b1a-add7-b2ed36faf09a service nova] Creating event network-changed:5ee83f90-dbeb-4713-85dd-e6139e429832 for instance 38cc590d-689d-46fe-8dc4-c011387de6e9 on n-h1-820368-35 Aug 27 05:03:22.639419 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5832980d-0f91-4b81-94ca-4fe9903b9b1d req-bad39a5d-3f48-4b1a-add7-b2ed36faf09a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075476 Aug 27 05:03:22.640689 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1118/2278] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:22.649726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-11555835-c471-471c-8a85-e203d7b07eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:22.650541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-11555835-c471-471c-8a85-e203d7b07eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:22.662186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11555835-c471-471c-8a85-e203d7b07eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.662810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11555835-c471-471c-8a85-e203d7b07eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.663495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11555835-c471-471c-8a85-e203d7b07eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.664938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11555835-c471-471c-8a85-e203d7b07eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.665734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11555835-c471-471c-8a85-e203d7b07eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.666662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11555835-c471-471c-8a85-e203d7b07eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.767390 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-924ba412-f2f4-4f74-9985-9792e65b0e1c tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1431 microversion: 2.1 time: 8.580211 Aug 27 05:03:22.767982 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1161/2279] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:14 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1431 bytes in 8582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:22.789073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7290d650-4a2f-4c64-9f14-0747dc81d538 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5650dcca0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:22.877459 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7290d650-4a2f-4c64-9f14-0747dc81d538 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 200 len: 1431 microversion: 2.1 time: 0.098933 Aug 27 05:03:22.878896 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1162/2280] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:22 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 1431 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:22.903905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4025cce4-5c88-49c5-93bf-7b6797669e54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:22.904429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4025cce4-5c88-49c5-93bf-7b6797669e54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:22.919669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4025cce4-5c88-49c5-93bf-7b6797669e54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.920830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4025cce4-5c88-49c5-93bf-7b6797669e54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.921273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4025cce4-5c88-49c5-93bf-7b6797669e54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.927891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4025cce4-5c88-49c5-93bf-7b6797669e54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.931653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4025cce4-5c88-49c5-93bf-7b6797669e54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.932224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4025cce4-5c88-49c5-93bf-7b6797669e54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:23.056891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-11555835-c471-471c-8a85-e203d7b07eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:23.074420 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-11555835-c471-471c-8a85-e203d7b07eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1307 microversion: 2.1 time: 0.432314 Aug 27 05:03:23.080332 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1119/2281] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:22 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1307 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:23.287623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4025cce4-5c88-49c5-93bf-7b6797669e54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:23.301272 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4025cce4-5c88-49c5-93bf-7b6797669e54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1479 microversion: 2.1 time: 0.412414 Aug 27 05:03:23.303284 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1163/2282] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:22 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1479 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:23.582910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8b3712b-e7cd-4fdc-8f99-c0d7ecfdf420 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:23.583565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f8b3712b-e7cd-4fdc-8f99-c0d7ecfdf420 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:23.599562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b3712b-e7cd-4fdc-8f99-c0d7ecfdf420 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:23.600254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b3712b-e7cd-4fdc-8f99-c0d7ecfdf420 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:23.601090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b3712b-e7cd-4fdc-8f99-c0d7ecfdf420 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:23.602938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b3712b-e7cd-4fdc-8f99-c0d7ecfdf420 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:23.603446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b3712b-e7cd-4fdc-8f99-c0d7ecfdf420 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:23.603890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b3712b-e7cd-4fdc-8f99-c0d7ecfdf420 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:23.881499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f8b3712b-e7cd-4fdc-8f99-c0d7ecfdf420 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:23.894348 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8b3712b-e7cd-4fdc-8f99-c0d7ecfdf420 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1319 microversion: 2.1 time: 0.314037 Aug 27 05:03:23.896236 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1120/2283] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:23 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:24.100777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fcbb84ec-8d9e-4e58-a330-9a8fea21dafd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:24.102062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fcbb84ec-8d9e-4e58-a330-9a8fea21dafd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:24.117948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcbb84ec-8d9e-4e58-a330-9a8fea21dafd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:24.120405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcbb84ec-8d9e-4e58-a330-9a8fea21dafd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:24.123110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcbb84ec-8d9e-4e58-a330-9a8fea21dafd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:24.124273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcbb84ec-8d9e-4e58-a330-9a8fea21dafd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:24.124980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcbb84ec-8d9e-4e58-a330-9a8fea21dafd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:24.127514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcbb84ec-8d9e-4e58-a330-9a8fea21dafd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:24.306822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-06dd8785-c47a-4f3d-9db5-4059c837cdbd req-68f0b08d-c622-4762-b628-26263dfeae53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2fd5f8-fe60-409a-acca-30b6637bca2e", "name": "network-vif-plugged", "status": "completed", "tag": "f0fe11de-12c9-43b6-833d-c37fe506f890"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:24.330840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-06dd8785-c47a-4f3d-9db5-4059c837cdbd req-68f0b08d-c622-4762-b628-26263dfeae53 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:24.331381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-06dd8785-c47a-4f3d-9db5-4059c837cdbd req-68f0b08d-c622-4762-b628-26263dfeae53 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:24.333292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-06dd8785-c47a-4f3d-9db5-4059c837cdbd req-68f0b08d-c622-4762-b628-26263dfeae53 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:24.368220 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-06dd8785-c47a-4f3d-9db5-4059c837cdbd req-68f0b08d-c622-4762-b628-26263dfeae53 service nova] Creating event network-vif-plugged:f0fe11de-12c9-43b6-833d-c37fe506f890 for instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e on n-h2-820368-35 Aug 27 05:03:24.382744 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-06dd8785-c47a-4f3d-9db5-4059c837cdbd req-68f0b08d-c622-4762-b628-26263dfeae53 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079996 Aug 27 05:03:24.385698 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1121/2284] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:03:24.396829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-13e43cfb-482b-4dff-996a-fbb7c554e185 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:24.402698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-13e43cfb-482b-4dff-996a-fbb7c554e185 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:24.419832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13e43cfb-482b-4dff-996a-fbb7c554e185 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:24.420665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13e43cfb-482b-4dff-996a-fbb7c554e185 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:24.424464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13e43cfb-482b-4dff-996a-fbb7c554e185 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:24.425618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13e43cfb-482b-4dff-996a-fbb7c554e185 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:24.426700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13e43cfb-482b-4dff-996a-fbb7c554e185 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:24.427925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13e43cfb-482b-4dff-996a-fbb7c554e185 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:24.435670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fcbb84ec-8d9e-4e58-a330-9a8fea21dafd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:24.446873 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fcbb84ec-8d9e-4e58-a330-9a8fea21dafd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1307 microversion: 2.1 time: 0.350525 Aug 27 05:03:24.453341 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1164/2285] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:24 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1307 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:24.851536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:24.919575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-13e43cfb-482b-4dff-996a-fbb7c554e185 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:24.920805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ff8eea52-51e3-47e0-bb78-6d82c1c2f61c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:24.921766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ff8eea52-51e3-47e0-bb78-6d82c1c2f61c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:24.930060 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-13e43cfb-482b-4dff-996a-fbb7c554e185 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1466 microversion: 2.1 time: 0.542404 Aug 27 05:03:24.930367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff8eea52-51e3-47e0-bb78-6d82c1c2f61c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:24.931061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff8eea52-51e3-47e0-bb78-6d82c1c2f61c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:24.931617 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1122/2286] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:24 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1466 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:24.931966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff8eea52-51e3-47e0-bb78-6d82c1c2f61c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:24.932740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff8eea52-51e3-47e0-bb78-6d82c1c2f61c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:24.933264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff8eea52-51e3-47e0-bb78-6d82c1c2f61c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:24.933757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff8eea52-51e3-47e0-bb78-6d82c1c2f61c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:24.959454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8cc0fa58-5e76-445d-bf9f-5fd7f10d9016 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb56965eca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:25.027027 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8cc0fa58-5e76-445d-bf9f-5fd7f10d9016 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/596ae1e8-61a9-43bf-be37-48ea5ff9a76f" status: 200 len: 784 microversion: 2.1 time: 0.079035 Aug 27 05:03:25.028371 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1123/2287] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:24 2022] GET /compute/v2.1/images/596ae1e8-61a9-43bf-be37-48ea5ff9a76f => generated 784 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:25.041263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f1dacef7-7440-450b-b406-de946cb135e3 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:25.054055 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f1dacef7-7440-450b-b406-de946cb135e3 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015465 Aug 27 05:03:25.055434 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1124/2288] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:03:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:03:25.067729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-77f982b3-b816-4e31-bd6f-34029fca4d83 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5650220d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:25.172021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ff8eea52-51e3-47e0-bb78-6d82c1c2f61c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:25.188347 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ff8eea52-51e3-47e0-bb78-6d82c1c2f61c tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1319 microversion: 2.1 time: 0.271024 Aug 27 05:03:25.190200 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1165/2289] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:24 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:25.477982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-762455ae-a996-4a8f-a386-1fc30d761dba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:25.478615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-762455ae-a996-4a8f-a386-1fc30d761dba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:25.487554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-762455ae-a996-4a8f-a386-1fc30d761dba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:25.488065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-762455ae-a996-4a8f-a386-1fc30d761dba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:25.488510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-762455ae-a996-4a8f-a386-1fc30d761dba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:25.489232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-762455ae-a996-4a8f-a386-1fc30d761dba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:25.489691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-762455ae-a996-4a8f-a386-1fc30d761dba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:25.495021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-762455ae-a996-4a8f-a386-1fc30d761dba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.026501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-762455ae-a996-4a8f-a386-1fc30d761dba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:26.039910 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-762455ae-a996-4a8f-a386-1fc30d761dba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1307 microversion: 2.1 time: 0.563375 Aug 27 05:03:26.043009 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1166/2290] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:25 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1307 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:26.231491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78f2ebe3-b34b-459f-b6ef-690d88415c1e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:26.233531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-78f2ebe3-b34b-459f-b6ef-690d88415c1e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:26.244411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f2ebe3-b34b-459f-b6ef-690d88415c1e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.245349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f2ebe3-b34b-459f-b6ef-690d88415c1e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.246111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f2ebe3-b34b-459f-b6ef-690d88415c1e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.247039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f2ebe3-b34b-459f-b6ef-690d88415c1e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.247734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f2ebe3-b34b-459f-b6ef-690d88415c1e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.253130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f2ebe3-b34b-459f-b6ef-690d88415c1e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.417993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=10 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:26.460204 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-77f982b3-b816-4e31-bd6f-34029fca4d83 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "DELETE /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 204 len: 0 microversion: 2.1 time: 1.396937 Aug 27 05:03:26.461621 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1125/2291] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:25 2022] DELETE /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 0 bytes in 1399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:03:26.470182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7778ca69-83cd-4ce2-8584-dd92556ec4af tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5650228b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:26.511775 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-7778ca69-83cd-4ce2-8584-dd92556ec4af tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] HTTP exception thrown: Image not found. Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7778ca69-83cd-4ce2-8584-dd92556ec4af tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Request method failure captured: Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a HTTP/1.1 Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaVT_TdyMeIdYhDjmgJXr6LvEf4RAZW0Fl9dbLCXpSgQZoVixmA0RrHG2p4Zqx-yO7yrsW-QzOVJwrzeRSnDp6XDbn0Jm10KX2_VAuA0p-SRieSkaa3RywIVimFmy3ntqQWiL9IeYyqvxCYb7LuRP3oDHiIzvVsvM4Cd-iDGH5J7Oxg Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: c3b22db8ab87483daf2acf10c94950cc Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesOneServerTestJSON-952928916 Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c3b22db8ab87483daf2acf10c94950cc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c3b22db8ab87483daf2acf10c94950cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c3b22db8ab87483daf2acf10c94950cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c3b22db8ab87483daf2acf10c94950cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesOneServerTestJSON-952928916 Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: c3b22db8ab87483daf2acf10c94950cc Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-952928916 Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesOneServerTestJSON-952928916-project Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 16669649a1c345c9b1a8ab8d1e52012d Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesOneServerTestJSON-952928916-project Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: exception: Image not found. Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '5e1e1263-3373-4b7d-92d0-59adc8231c2a'} Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5e1e1263-3373-4b7d-92d0-59adc8231c2a Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 05:03:26.514233 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e1e1263-3373-4b7d-92d0-59adc8231c2a could not be found. Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7778ca69-83cd-4ce2-8584-dd92556ec4af tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Returning 404 to user: Image not found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7778ca69-83cd-4ce2-8584-dd92556ec4af tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 404 len: 62 microversion: 2.1 time: 0.049902 Aug 27 05:03:26.518458 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1126/2292] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:26 2022] GET /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 05:03:26.533644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3392b66d-8345-478b-9552-d858924ae7b9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1025773748"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:26.536234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3392b66d-8345-478b-9552-d858924ae7b9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:26.561372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3392b66d-8345-478b-9552-d858924ae7b9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.566637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3392b66d-8345-478b-9552-d858924ae7b9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.571749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3392b66d-8345-478b-9552-d858924ae7b9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.572778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3392b66d-8345-478b-9552-d858924ae7b9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.573761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3392b66d-8345-478b-9552-d858924ae7b9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.576989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3392b66d-8345-478b-9552-d858924ae7b9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.646101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-78f2ebe3-b34b-459f-b6ef-690d88415c1e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:26.669272 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-78f2ebe3-b34b-459f-b6ef-690d88415c1e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1319 microversion: 2.1 time: 0.458623 Aug 27 05:03:26.670225 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1167/2293] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:26 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:26.979682 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3392b66d-8345-478b-9552-d858924ae7b9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "POST /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e/action" status: 202 len: 0 microversion: 2.1 time: 0.449668 Aug 27 05:03:26.980325 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1127/2294] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:03:26 2022] POST /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 05:03:27.000555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ffed02d2-0af8-4405-8c9f-74a2b562fd9d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb56501a0d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:27.081681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0fac1006-061a-4c98-b9ef-f894717c7117 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:27.083177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0fac1006-061a-4c98-b9ef-f894717c7117 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:27.101475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fac1006-061a-4c98-b9ef-f894717c7117 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:27.102878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fac1006-061a-4c98-b9ef-f894717c7117 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:27.103677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fac1006-061a-4c98-b9ef-f894717c7117 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:27.108572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fac1006-061a-4c98-b9ef-f894717c7117 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:27.110016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fac1006-061a-4c98-b9ef-f894717c7117 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:27.113664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fac1006-061a-4c98-b9ef-f894717c7117 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:27.136725 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ffed02d2-0af8-4405-8c9f-74a2b562fd9d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.149657 Aug 27 05:03:27.145814 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1168/2295] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:26 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:27.416990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0fac1006-061a-4c98-b9ef-f894717c7117 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:27.429187 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0fac1006-061a-4c98-b9ef-f894717c7117 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1307 microversion: 2.1 time: 0.365500 Aug 27 05:03:27.435174 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1128/2296] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:27 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1307 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:27.694078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7c56d3e3-4938-4059-916e-a3e15cbcef7b tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:27.695520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7c56d3e3-4938-4059-916e-a3e15cbcef7b tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:27.703047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c56d3e3-4938-4059-916e-a3e15cbcef7b tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:27.703813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c56d3e3-4938-4059-916e-a3e15cbcef7b tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:27.704413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c56d3e3-4938-4059-916e-a3e15cbcef7b tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:27.705313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c56d3e3-4938-4059-916e-a3e15cbcef7b tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:27.705914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c56d3e3-4938-4059-916e-a3e15cbcef7b tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:27.706631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c56d3e3-4938-4059-916e-a3e15cbcef7b tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:27.908138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7c56d3e3-4938-4059-916e-a3e15cbcef7b tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:27.917938 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7c56d3e3-4938-4059-916e-a3e15cbcef7b tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1469 microversion: 2.1 time: 0.228749 Aug 27 05:03:27.920113 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1169/2297] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:27 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1469 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:27.940158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e03ed45-4d2b-454c-bae8-49f8ee0d1cb6 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:27.940782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e03ed45-4d2b-454c-bae8-49f8ee0d1cb6 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:27.947312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e03ed45-4d2b-454c-bae8-49f8ee0d1cb6 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:27.948069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e03ed45-4d2b-454c-bae8-49f8ee0d1cb6 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:27.948670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e03ed45-4d2b-454c-bae8-49f8ee0d1cb6 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:27.949540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e03ed45-4d2b-454c-bae8-49f8ee0d1cb6 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:27.950152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e03ed45-4d2b-454c-bae8-49f8ee0d1cb6 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:27.950727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e03ed45-4d2b-454c-bae8-49f8ee0d1cb6 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:28.006073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-8e03ed45-4d2b-454c-bae8-49f8ee0d1cb6 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lazy-loading 'flavor' on Instance uuid 1e2fd5f8-fe60-409a-acca-30b6637bca2e {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:03:28.146825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-15ea6a97-ecaf-404d-b039-bd38e647a8b0 req-e2dfd827-4da3-4b74-bee5-7c74f77c7ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e", "name": "network-vif-unplugged", "status": "completed", "tag": "bafc5b86-279b-411c-9b1a-ae47f7108d43"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:28.157728 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e03ed45-4d2b-454c-bae8-49f8ee0d1cb6 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e/action" status: 202 len: 0 microversion: 2.1 time: 0.203372 Aug 27 05:03:28.163235 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1129/2298] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:03:27 2022] POST /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:03:28.179908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5884f16c-d7f0-42fc-a47e-3b5d3cbbab54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5655da550>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:28.186074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-15ea6a97-ecaf-404d-b039-bd38e647a8b0 req-e2dfd827-4da3-4b74-bee5-7c74f77c7ba0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:28.188722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-15ea6a97-ecaf-404d-b039-bd38e647a8b0 req-e2dfd827-4da3-4b74-bee5-7c74f77c7ba0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:28.190566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-15ea6a97-ecaf-404d-b039-bd38e647a8b0 req-e2dfd827-4da3-4b74-bee5-7c74f77c7ba0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:28.223041 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-15ea6a97-ecaf-404d-b039-bd38e647a8b0 req-e2dfd827-4da3-4b74-bee5-7c74f77c7ba0 service nova] Creating event network-vif-unplugged:bafc5b86-279b-411c-9b1a-ae47f7108d43 for instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e on n-h2-820368-35 Aug 27 05:03:28.237395 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-15ea6a97-ecaf-404d-b039-bd38e647a8b0 req-e2dfd827-4da3-4b74-bee5-7c74f77c7ba0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095564 Aug 27 05:03:28.238642 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1170/2299] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:03:28.259169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-40cdc0b0-1c01-4326-b2a3-9ae30fca6fd8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:28.261956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-40cdc0b0-1c01-4326-b2a3-9ae30fca6fd8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:28.274820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40cdc0b0-1c01-4326-b2a3-9ae30fca6fd8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:28.288132 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5884f16c-d7f0-42fc-a47e-3b5d3cbbab54 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.118221 Aug 27 05:03:28.288132 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1130/2300] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:28 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:28.289084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40cdc0b0-1c01-4326-b2a3-9ae30fca6fd8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:28.289084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40cdc0b0-1c01-4326-b2a3-9ae30fca6fd8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:28.289084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40cdc0b0-1c01-4326-b2a3-9ae30fca6fd8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:28.289707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40cdc0b0-1c01-4326-b2a3-9ae30fca6fd8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:28.290001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40cdc0b0-1c01-4326-b2a3-9ae30fca6fd8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:28.459637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db3b27ba-2891-4de1-937d-3dd2d5671a68 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:28.461470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-db3b27ba-2891-4de1-937d-3dd2d5671a68 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:28.468950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3b27ba-2891-4de1-937d-3dd2d5671a68 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:28.469651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3b27ba-2891-4de1-937d-3dd2d5671a68 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:28.470284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3b27ba-2891-4de1-937d-3dd2d5671a68 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:28.471231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3b27ba-2891-4de1-937d-3dd2d5671a68 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:28.472129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3b27ba-2891-4de1-937d-3dd2d5671a68 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:28.473124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3b27ba-2891-4de1-937d-3dd2d5671a68 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:28.487430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-40cdc0b0-1c01-4326-b2a3-9ae30fca6fd8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:28.501340 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-40cdc0b0-1c01-4326-b2a3-9ae30fca6fd8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1477 microversion: 2.1 time: 0.260019 Aug 27 05:03:28.504280 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1171/2301] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:28 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:28.707953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-db3b27ba-2891-4de1-937d-3dd2d5671a68 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:28.723011 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db3b27ba-2891-4de1-937d-3dd2d5671a68 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1307 microversion: 2.1 time: 0.271113 Aug 27 05:03:28.738196 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1131/2302] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:28 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1307 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:29.305175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-160602f4-1c6d-443c-a19e-a699e2ffdd61 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb56501a3a0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:29.394581 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-160602f4-1c6d-443c-a19e-a699e2ffdd61 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.094063 Aug 27 05:03:29.395517 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1172/2303] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:29 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:29.527355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8de55bb7-54cc-4815-be4c-00da742a7a0a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:29.528797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8de55bb7-54cc-4815-be4c-00da742a7a0a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:29.533797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:29.547568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8de55bb7-54cc-4815-be4c-00da742a7a0a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.588714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8de55bb7-54cc-4815-be4c-00da742a7a0a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.590755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8de55bb7-54cc-4815-be4c-00da742a7a0a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.593332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8de55bb7-54cc-4815-be4c-00da742a7a0a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.595766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8de55bb7-54cc-4815-be4c-00da742a7a0a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.596368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8de55bb7-54cc-4815-be4c-00da742a7a0a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.745944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9569b39b-3a59-4e35-994b-ac9345434f00 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:29.754409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9569b39b-3a59-4e35-994b-ac9345434f00 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:29.766898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9569b39b-3a59-4e35-994b-ac9345434f00 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.779806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9569b39b-3a59-4e35-994b-ac9345434f00 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.780427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9569b39b-3a59-4e35-994b-ac9345434f00 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.781194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9569b39b-3a59-4e35-994b-ac9345434f00 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.781947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9569b39b-3a59-4e35-994b-ac9345434f00 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.783009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9569b39b-3a59-4e35-994b-ac9345434f00 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:30.547505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8de55bb7-54cc-4815-be4c-00da742a7a0a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:30.562978 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8de55bb7-54cc-4815-be4c-00da742a7a0a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1477 microversion: 2.1 time: 1.040185 Aug 27 05:03:30.566658 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1132/2304] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:29 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1477 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:30.577112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2396c969-7dea-428e-8df7-6ef9b2f119cb req-5d346879-c2a9-4d6f-80dc-fb8bf925cf78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cc590d-689d-46fe-8dc4-c011387de6e9", "name": "network-vif-plugged", "status": "completed", "tag": "5ee83f90-dbeb-4713-85dd-e6139e429832"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:30.613230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2396c969-7dea-428e-8df7-6ef9b2f119cb req-5d346879-c2a9-4d6f-80dc-fb8bf925cf78 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:30.615941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2396c969-7dea-428e-8df7-6ef9b2f119cb req-5d346879-c2a9-4d6f-80dc-fb8bf925cf78 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:30.618797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2396c969-7dea-428e-8df7-6ef9b2f119cb req-5d346879-c2a9-4d6f-80dc-fb8bf925cf78 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:30.648882 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2396c969-7dea-428e-8df7-6ef9b2f119cb req-5d346879-c2a9-4d6f-80dc-fb8bf925cf78 service nova] Creating event network-vif-plugged:5ee83f90-dbeb-4713-85dd-e6139e429832 for instance 38cc590d-689d-46fe-8dc4-c011387de6e9 on n-h1-820368-35 Aug 27 05:03:30.650161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9569b39b-3a59-4e35-994b-ac9345434f00 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:30.655961 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2396c969-7dea-428e-8df7-6ef9b2f119cb req-5d346879-c2a9-4d6f-80dc-fb8bf925cf78 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087795 Aug 27 05:03:30.657489 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1133/2305] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:30.663536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c3df9ca6-3495-4e50-9e99-bcd943c7d14d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb565026280>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:30.670504 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9569b39b-3a59-4e35-994b-ac9345434f00 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1307 microversion: 2.1 time: 0.927483 Aug 27 05:03:30.670888 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1173/2306] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:29 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1307 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:30.763957 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c3df9ca6-3495-4e50-9e99-bcd943c7d14d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.104993 Aug 27 05:03:30.769003 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1134/2307] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:30 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:31.593102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9d4fd9c8-7774-4f10-87bc-e39ca06b001a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:31.594202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9d4fd9c8-7774-4f10-87bc-e39ca06b001a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:31.629725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d4fd9c8-7774-4f10-87bc-e39ca06b001a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:31.630945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d4fd9c8-7774-4f10-87bc-e39ca06b001a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:31.632223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d4fd9c8-7774-4f10-87bc-e39ca06b001a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:31.634908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d4fd9c8-7774-4f10-87bc-e39ca06b001a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:31.635558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d4fd9c8-7774-4f10-87bc-e39ca06b001a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:31.637799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d4fd9c8-7774-4f10-87bc-e39ca06b001a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:31.692599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b3b024d5-4d97-4d21-9ee7-713fdf235085 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:31.694254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b3b024d5-4d97-4d21-9ee7-713fdf235085 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:31.702466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3b024d5-4d97-4d21-9ee7-713fdf235085 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:31.703249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3b024d5-4d97-4d21-9ee7-713fdf235085 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:31.704081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3b024d5-4d97-4d21-9ee7-713fdf235085 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:31.705009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3b024d5-4d97-4d21-9ee7-713fdf235085 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:31.706380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3b024d5-4d97-4d21-9ee7-713fdf235085 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:31.707575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3b024d5-4d97-4d21-9ee7-713fdf235085 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:32.066022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9d4fd9c8-7774-4f10-87bc-e39ca06b001a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:32.078691 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9d4fd9c8-7774-4f10-87bc-e39ca06b001a tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1460 microversion: 2.1 time: 0.495902 Aug 27 05:03:32.089022 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1174/2308] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:31 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1460 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:32.106287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-04c67b44-7ca1-48f1-b395-d04b92479767 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb564b309d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:32.165407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b3b024d5-4d97-4d21-9ee7-713fdf235085 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:32.173370 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-04c67b44-7ca1-48f1-b395-d04b92479767 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.081775 Aug 27 05:03:32.173955 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1175/2309] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:32 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:32.185122 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b3b024d5-4d97-4d21-9ee7-713fdf235085 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1307 microversion: 2.1 time: 0.496717 Aug 27 05:03:32.188160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3cd09f36-92a6-4f4f-a0de-00ee2965f921 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:32.188515 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1135/2310] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:31 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1307 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:32.197355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3cd09f36-92a6-4f4f-a0de-00ee2965f921 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:32.216464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cd09f36-92a6-4f4f-a0de-00ee2965f921 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:32.218320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cd09f36-92a6-4f4f-a0de-00ee2965f921 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:32.220548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cd09f36-92a6-4f4f-a0de-00ee2965f921 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:32.221598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cd09f36-92a6-4f4f-a0de-00ee2965f921 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:32.224371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cd09f36-92a6-4f4f-a0de-00ee2965f921 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:32.226130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3cd09f36-92a6-4f4f-a0de-00ee2965f921 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:32.251716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:33.196553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-25c4dc5a-d262-41fb-8684-f595bdd6a962 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5650221f0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:33.309433 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-25c4dc5a-d262-41fb-8684-f595bdd6a962 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.123361 Aug 27 05:03:33.310022 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1136/2311] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:33 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:33.326151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c25a8a10-f3ea-44d3-bb14-0076456ede43 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:33.327259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c25a8a10-f3ea-44d3-bb14-0076456ede43 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:33.356181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25a8a10-f3ea-44d3-bb14-0076456ede43 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.362027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25a8a10-f3ea-44d3-bb14-0076456ede43 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.362902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25a8a10-f3ea-44d3-bb14-0076456ede43 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.364824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25a8a10-f3ea-44d3-bb14-0076456ede43 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.369828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25a8a10-f3ea-44d3-bb14-0076456ede43 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.370035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25a8a10-f3ea-44d3-bb14-0076456ede43 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.398127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:33.460605 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3cd09f36-92a6-4f4f-a0de-00ee2965f921 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1613 microversion: 2.1 time: 1.282606 Aug 27 05:03:33.461194 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1176/2312] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:32 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1613 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:33.490099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8492a360-ed06-4b51-9fdd-9031269dbb5e tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:33.502860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8492a360-ed06-4b51-9fdd-9031269dbb5e tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.509081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8492a360-ed06-4b51-9fdd-9031269dbb5e tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.510207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8492a360-ed06-4b51-9fdd-9031269dbb5e tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.513176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8492a360-ed06-4b51-9fdd-9031269dbb5e tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.513537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8492a360-ed06-4b51-9fdd-9031269dbb5e tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.524245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8492a360-ed06-4b51-9fdd-9031269dbb5e tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.571587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:33.630954 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8492a360-ed06-4b51-9fdd-9031269dbb5e tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.153209 Aug 27 05:03:33.642671 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1177/2313] 10.222.0.58 () {58 vars in 1176 bytes} [Sat Aug 27 05:03:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:03:33.659436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-820368-35", "block_migration": true, "disk_over_commit": false}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:33.670689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:33.690361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.694899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.696573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.702367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.704678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.705449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.777167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Lazy-loading 'flavor' on Instance uuid 1e2fd5f8-fe60-409a-acca-30b6637bca2e {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:03:33.808058 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e while it is in vm_state suspended Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Request method failure captured: Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e/action HTTP/1.1 Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 98 Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaViQ7gH6bjNyH6YOnAFUrShbrH1YnR01xNgLbwtDiQAIA0fU8WWQy7_h2wtgYUgL8w2y-5s666mUdnHIalUb0Pi-mduNeFvoFMIb0WD7IB56x8keq6AP9pWVRa6B1xHLdAziDGvIz8ALqTaSnefNcrhn384765QRbwB0BFC810Rr2E Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: a96b463468fe4c24937a32653cb2fbb8 Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-LiveMigrationNegativeTest-943115694 Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a96b463468fe4c24937a32653cb2fbb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a96b463468fe4c24937a32653cb2fbb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a96b463468fe4c24937a32653cb2fbb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a96b463468fe4c24937a32653cb2fbb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-LiveMigrationNegativeTest-943115694 Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: a96b463468fe4c24937a32653cb2fbb8 Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-943115694 Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-LiveMigrationNegativeTest-943115694-project-admin Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 8eec3d7c33d140b4994d059f5c6514e5 Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-LiveMigrationNegativeTest-943115694-project-admin Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: {"os-migrateLive": {"host": "n-h1-820368-35", "block_migration": true, "disk_over_commit": false}} Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot 'os-migrateLive' instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e while it is in vm_state suspended Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '1e2fd5f8-fe60-409a-acca-30b6637bca2e', 'body': {'os-migrateLive': {'host': 'n-h1-820368-35', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:33.811008 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e while it is in vm_state suspended Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e while it is in vm_state suspended Aug 27 05:03:33.815402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:33.821020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e while it is in vm_state suspended {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:33.821907 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cce7c21d-f25b-4fb9-9753-b8de4a961c66 tempest-LiveMigrationNegativeTest-943115694 tempest-LiveMigrationNegativeTest-943115694-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e/action" status: 409 len: 155 microversion: 2.1 time: 0.178011 Aug 27 05:03:33.822499 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1178/2314] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:03:33 2022] POST /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e/action => generated 155 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:03:33.844654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d528db6-9e95-4e52-a053-6b168d9b45a8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:33.847710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d528db6-9e95-4e52-a053-6b168d9b45a8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:33.888368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d528db6-9e95-4e52-a053-6b168d9b45a8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.893219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d528db6-9e95-4e52-a053-6b168d9b45a8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.893844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d528db6-9e95-4e52-a053-6b168d9b45a8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.895447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d528db6-9e95-4e52-a053-6b168d9b45a8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.896732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d528db6-9e95-4e52-a053-6b168d9b45a8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.897884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d528db6-9e95-4e52-a053-6b168d9b45a8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.972122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d528db6-9e95-4e52-a053-6b168d9b45a8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:03:34.064063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c25a8a10-f3ea-44d3-bb14-0076456ede43 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:34.092985 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c25a8a10-f3ea-44d3-bb14-0076456ede43 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1487 microversion: 2.1 time: 0.771115 Aug 27 05:03:34.095063 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1137/2315] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:33 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1487 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:34.119132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29f72c74-682a-4d62-8f9e-c51421e7aa74 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:34.126236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-29f72c74-682a-4d62-8f9e-c51421e7aa74 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:34.154120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f72c74-682a-4d62-8f9e-c51421e7aa74 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:34.154621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f72c74-682a-4d62-8f9e-c51421e7aa74 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:34.155067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f72c74-682a-4d62-8f9e-c51421e7aa74 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:34.155818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f72c74-682a-4d62-8f9e-c51421e7aa74 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:34.156277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f72c74-682a-4d62-8f9e-c51421e7aa74 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:34.156706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f72c74-682a-4d62-8f9e-c51421e7aa74 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:34.191647 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d528db6-9e95-4e52-a053-6b168d9b45a8 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 204 len: 0 microversion: 2.1 time: 0.362501 Aug 27 05:03:34.192240 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1179/2316] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:03:33 2022] DELETE /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:03:34.204872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa7d392c-bf20-4001-9d27-6c28370fb16d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:34.205595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aa7d392c-bf20-4001-9d27-6c28370fb16d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:34.229908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa7d392c-bf20-4001-9d27-6c28370fb16d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:34.230424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa7d392c-bf20-4001-9d27-6c28370fb16d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:34.230865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa7d392c-bf20-4001-9d27-6c28370fb16d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:34.231603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa7d392c-bf20-4001-9d27-6c28370fb16d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:34.232060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa7d392c-bf20-4001-9d27-6c28370fb16d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:34.232484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa7d392c-bf20-4001-9d27-6c28370fb16d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:34.406909 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-29f72c74-682a-4d62-8f9e-c51421e7aa74 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "POST /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9/action" status: 202 len: 0 microversion: 2.1 time: 0.292590 Aug 27 05:03:34.408616 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1138/2317] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:03:34 2022] POST /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:03:34.416013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-958babcb-c822-448b-8c99-83d7b5699cca tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb56965daf0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:34.506535 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-958babcb-c822-448b-8c99-83d7b5699cca tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.096234 Aug 27 05:03:34.507155 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1139/2318] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:34 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:34.516945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f224342-8dc8-43cb-9b46-ae41ce1a156d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:34.519475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8f224342-8dc8-43cb-9b46-ae41ce1a156d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:34.532474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f224342-8dc8-43cb-9b46-ae41ce1a156d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:34.535584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f224342-8dc8-43cb-9b46-ae41ce1a156d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:34.536199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f224342-8dc8-43cb-9b46-ae41ce1a156d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:34.537100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f224342-8dc8-43cb-9b46-ae41ce1a156d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:34.537713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f224342-8dc8-43cb-9b46-ae41ce1a156d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:34.547868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f224342-8dc8-43cb-9b46-ae41ce1a156d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:34.599005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aa7d392c-bf20-4001-9d27-6c28370fb16d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:34.609191 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aa7d392c-bf20-4001-9d27-6c28370fb16d tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1466 microversion: 2.1 time: 0.408680 Aug 27 05:03:34.613135 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1180/2319] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:34 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1466 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:35.188918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8f224342-8dc8-43cb-9b46-ae41ce1a156d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:35.206964 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8f224342-8dc8-43cb-9b46-ae41ce1a156d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1492 microversion: 2.1 time: 0.698212 Aug 27 05:03:35.219151 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1140/2320] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:34 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1492 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:35.389626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bacfd30e-2dcc-4318-842a-309904ab7e0b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Action: 'create', calling method: .version_select at 0x7fb5654364c0>, body: {"keypair": {"name": "tempest-keypair-530238290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy4ml0nGTwUVCUDH40bJN0g5drGFOxlNDAESq2mj1Yv7aFgXII/JqaAE9dUdnC73XIBZrl+6DI/yA2oHNPkIr+hluqGy+P+H0druYyYZpLWFVwve+AJalK+fjlDhWh8Jw=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:35.432696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-a0c06534-0481-4246-9175-045bcb2b61df req-7df0aff7-5d08-49f8-9104-6edf48b2e982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e", "name": "network-vif-plugged", "status": "completed", "tag": "bafc5b86-279b-411c-9b1a-ae47f7108d43"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:35.449290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bacfd30e-2dcc-4318-842a-309904ab7e0b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Getting quotas for project dc337cfec67e4408bb9f110021b3f6b3. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:03:35.462178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a0c06534-0481-4246-9175-045bcb2b61df req-7df0aff7-5d08-49f8-9104-6edf48b2e982 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.466370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a0c06534-0481-4246-9175-045bcb2b61df req-7df0aff7-5d08-49f8-9104-6edf48b2e982 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.468547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a0c06534-0481-4246-9175-045bcb2b61df req-7df0aff7-5d08-49f8-9104-6edf48b2e982 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.472278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bacfd30e-2dcc-4318-842a-309904ab7e0b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Getting quotas for user 8e1d8d4c4b9f4d678029a02bc805e194 and project dc337cfec67e4408bb9f110021b3f6b3. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:03:35.522116 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-a0c06534-0481-4246-9175-045bcb2b61df req-7df0aff7-5d08-49f8-9104-6edf48b2e982 service nova] Creating event network-vif-plugged:bafc5b86-279b-411c-9b1a-ae47f7108d43 for instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e on n-h2-820368-35 Aug 27 05:03:35.530645 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-a0c06534-0481-4246-9175-045bcb2b61df req-7df0aff7-5d08-49f8-9104-6edf48b2e982 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102536 Aug 27 05:03:35.540763 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1141/2321] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:03:35.577468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7cb7e866-eaf3-42c5-8f28-33032325c052 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb56968c5e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:35.600798 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bacfd30e-2dcc-4318-842a-309904ab7e0b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.215148 Aug 27 05:03:35.602537 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1181/2322] 10.222.0.58 () {62 vars in 1200 bytes} [Sat Aug 27 05:03:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 218 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 05:03:35.631848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4601ed6f-6f39-4ff3-99dc-ec3474f0243f tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:35.632790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4601ed6f-6f39-4ff3-99dc-ec3474f0243f tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:35.666456 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7cb7e866-eaf3-42c5-8f28-33032325c052 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.124063 Aug 27 05:03:35.667150 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1142/2323] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:35 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:35.668260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4601ed6f-6f39-4ff3-99dc-ec3474f0243f tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.668771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4601ed6f-6f39-4ff3-99dc-ec3474f0243f tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.669338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4601ed6f-6f39-4ff3-99dc-ec3474f0243f tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.670078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4601ed6f-6f39-4ff3-99dc-ec3474f0243f tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.670535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4601ed6f-6f39-4ff3-99dc-ec3474f0243f tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.671186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4601ed6f-6f39-4ff3-99dc-ec3474f0243f tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.014052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4601ed6f-6f39-4ff3-99dc-ec3474f0243f tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:36.030246 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4601ed6f-6f39-4ff3-99dc-ec3474f0243f tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1466 microversion: 2.1 time: 0.402578 Aug 27 05:03:36.033353 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1182/2324] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:35 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1466 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:36.229441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba187aa0-92db-439e-865e-d873cab67b0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:36.230651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba187aa0-92db-439e-865e-d873cab67b0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:36.241304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba187aa0-92db-439e-865e-d873cab67b0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.243585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba187aa0-92db-439e-865e-d873cab67b0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.245780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba187aa0-92db-439e-865e-d873cab67b0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.246741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba187aa0-92db-439e-865e-d873cab67b0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.250866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba187aa0-92db-439e-865e-d873cab67b0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.252193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba187aa0-92db-439e-865e-d873cab67b0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.684773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8a65e9b4-24e3-4dda-932d-a4acd9f30703 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb564f8ab80>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:36.814894 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8a65e9b4-24e3-4dda-932d-a4acd9f30703 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.135496 Aug 27 05:03:36.817231 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1183/2325] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:36 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:37.053837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-76068bc5-f1d9-4313-be65-cc0c016ddf73 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:37.055060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-76068bc5-f1d9-4313-be65-cc0c016ddf73 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:37.070192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76068bc5-f1d9-4313-be65-cc0c016ddf73 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:37.071065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76068bc5-f1d9-4313-be65-cc0c016ddf73 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:37.071840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76068bc5-f1d9-4313-be65-cc0c016ddf73 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:37.073369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76068bc5-f1d9-4313-be65-cc0c016ddf73 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:37.074058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76068bc5-f1d9-4313-be65-cc0c016ddf73 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:37.075655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76068bc5-f1d9-4313-be65-cc0c016ddf73 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:37.515667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ba187aa0-92db-439e-865e-d873cab67b0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:37.530645 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba187aa0-92db-439e-865e-d873cab67b0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 200 len: 1472 microversion: 2.1 time: 1.305843 Aug 27 05:03:37.533595 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1143/2326] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:36 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 1472 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:37.555822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd039b3c-a00f-4da8-8fb2-8383615e51f7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1920372003"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:37.559512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd039b3c-a00f-4da8-8fb2-8383615e51f7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:37.577245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd039b3c-a00f-4da8-8fb2-8383615e51f7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:37.577837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd039b3c-a00f-4da8-8fb2-8383615e51f7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:37.578430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd039b3c-a00f-4da8-8fb2-8383615e51f7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:37.579323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd039b3c-a00f-4da8-8fb2-8383615e51f7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:37.579835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd039b3c-a00f-4da8-8fb2-8383615e51f7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:37.580335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd039b3c-a00f-4da8-8fb2-8383615e51f7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:38.070266 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd039b3c-a00f-4da8-8fb2-8383615e51f7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "POST /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9/action" status: 202 len: 0 microversion: 2.1 time: 0.518925 Aug 27 05:03:38.076798 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1144/2327] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:03:37 2022] POST /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 05:03:38.089502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5566204b-0741-47a3-b37b-4b2811fa68e8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5657a7040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:38.167937 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5566204b-0741-47a3-b37b-4b2811fa68e8 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.087408 Aug 27 05:03:38.168662 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1145/2328] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:38 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:38.175981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ad9828c-0596-4169-b54b-bb2c70316114 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56965db80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:38.178406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-76068bc5-f1d9-4313-be65-cc0c016ddf73 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:38.191187 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-76068bc5-f1d9-4313-be65-cc0c016ddf73 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1466 microversion: 2.1 time: 1.141637 Aug 27 05:03:38.195274 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1184/2329] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:37 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1466 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:38.270153 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3ad9828c-0596-4169-b54b-bb2c70316114 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.100308 Aug 27 05:03:38.270737 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1146/2330] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:38 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:38.707162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f6ba665f-60eb-4c4b-99d4-e8265e3c09ca req-71d306e1-4096-4abc-9dc3-5774c7a3c770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2fd5f8-fe60-409a-acca-30b6637bca2e", "name": "network-vif-deleted", "tag": "f0fe11de-12c9-43b6-833d-c37fe506f890"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:38.736208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f6ba665f-60eb-4c4b-99d4-e8265e3c09ca req-71d306e1-4096-4abc-9dc3-5774c7a3c770 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:38.740123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f6ba665f-60eb-4c4b-99d4-e8265e3c09ca req-71d306e1-4096-4abc-9dc3-5774c7a3c770 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:38.742029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f6ba665f-60eb-4c4b-99d4-e8265e3c09ca req-71d306e1-4096-4abc-9dc3-5774c7a3c770 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:38.770810 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f6ba665f-60eb-4c4b-99d4-e8265e3c09ca req-71d306e1-4096-4abc-9dc3-5774c7a3c770 service nova] Creating event network-vif-deleted:f0fe11de-12c9-43b6-833d-c37fe506f890 for instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e on n-h2-820368-35 Aug 27 05:03:38.786446 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f6ba665f-60eb-4c4b-99d4-e8265e3c09ca req-71d306e1-4096-4abc-9dc3-5774c7a3c770 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083980 Aug 27 05:03:38.788358 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1185/2331] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:39.186104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e7f0b4a-846a-4ed4-990d-59968cefc603 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb56968c8b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:39.215557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:39.220101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:39.249692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:39.251985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:39.255383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:39.256361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:39.256986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:39.258167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:39.287147 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e7f0b4a-846a-4ed4-990d-59968cefc603 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.105844 Aug 27 05:03:39.302050 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1147/2332] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:39 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:39.309841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-89163394-1c68-4a48-8b43-904fd1267354 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565004790>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:39.355732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:39.377002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:39.379766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:39.380502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lazy-loading 'fault' on Instance uuid 1e2fd5f8-fe60-409a-acca-30b6637bca2e {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:03:39.391708 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-89163394-1c68-4a48-8b43-904fd1267354 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.088082 Aug 27 05:03:39.392785 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1148/2333] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:39 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:39.435662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1352161818", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "65d280e5-70f6-459a-919f-a82290f278af"}, {"port": "623c7391-d404-4e59-8e53-dac73c18bbd3", "tag": "port-1"}, {"port": "870feaae-e12d-419a-80e6-29d9b508fb26", "tag": "port-2"}, {"uuid": "b4a12ce2-e490-401d-ba5a-4890e3cfb668", "tag": "net-1"}, {"uuid": "b4a12ce2-e490-401d-ba5a-4890e3cfb668"}, {"uuid": "31d1ce49-f75c-4968-843c-1e20a4786c6f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "31d1ce49-f75c-4968-843c-1e20a4786c6f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9d624632-eb3e-4705-adb6-8675bc5b7426", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a5b0b4d1-02d8-4d2b-8aee-38527a64a4f9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "32a79d6a-2d5b-4a62-89dc-6ed5cd66bfda", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--240618879"}], "key_name": "tempest-keypair-530238290", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:39.509120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:39.522673 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0113d41c-d7f0-408a-9b5f-c1e7b0b924be tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 200 len: 1309 microversion: 2.1 time: 0.312108 Aug 27 05:03:39.525882 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1186/2334] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:39 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 1309 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:39.671699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] validate_networks() for [('65d280e5-70f6-459a-919f-a82290f278af', None, None, None, None, None), (None, None, '623c7391-d404-4e59-8e53-dac73c18bbd3', None, None, None), (None, None, '870feaae-e12d-419a-80e6-29d9b508fb26', None, None, None), ('b4a12ce2-e490-401d-ba5a-4890e3cfb668', None, None, None, None, None), ('b4a12ce2-e490-401d-ba5a-4890e3cfb668', None, None, None, None, None), ('31d1ce49-f75c-4968-843c-1e20a4786c6f', '10.2.2.100', None, None, None, None), ('31d1ce49-f75c-4968-843c-1e20a4786c6f', '10.2.2.200', None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:03:40.305599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d82afa0-0268-4a5e-afde-ec4781749df6 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb564f8aa60>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:40.422042 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d82afa0-0268-4a5e-afde-ec4781749df6 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.119846 Aug 27 05:03:40.431975 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1187/2335] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:40 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:40.438898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb263cbc-1c5c-4039-9050-28844b6dd175 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb564f738b0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:40.524109 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb263cbc-1c5c-4039-9050-28844b6dd175 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.089842 Aug 27 05:03:40.525660 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1188/2336] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:40 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:40.546851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:40.547814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 1e2fd5f8-fe60-409a-acca-30b6637bca2e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:40.562971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.563669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.565765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:40.567967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.571001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.572326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:40.627308 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] HTTP exception thrown: Instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e could not be found. Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Request method failure captured: Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e HTTP/1.1 Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaVgf-AyksjgHrDgzyg4dlQEjxSPyUxoJCzpIArzrYIh70FpfeCKrdKyPnsZaiAd7z7ntJVSotOdeQkOOHVO2zGBxdFfKxdsDpFGpS7ragZT_I5WjpzFSgxPWA2BAKlqi9NQMJrlo7ou5yZinSk4bmUXpMEj_RWDc1rSvxh3pMhDaIg Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 170af42cbb5f42cb91d3047dede7583e Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-LiveMigrationNegativeTest-52335509 Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_170af42cbb5f42cb91d3047dede7583e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/170af42cbb5f42cb91d3047dede7583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/170af42cbb5f42cb91d3047dede7583e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/170af42cbb5f42cb91d3047dede7583e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-LiveMigrationNegativeTest-52335509 Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 170af42cbb5f42cb91d3047dede7583e Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-52335509 Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-LiveMigrationNegativeTest-52335509-project Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: fdd3e55e6a2842d08aeca3432e872be6 Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-LiveMigrationNegativeTest-52335509-project Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e could not be found. Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '1e2fd5f8-fe60-409a-acca-30b6637bca2e'} Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e could not be found. Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e could not be found. Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:40.629537 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:40.634867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:40.634867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:40.634867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:40.634867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:40.634867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:40.634867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e could not be found. Aug 27 05:03:40.634867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:03:40.651915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Returning 404 to user: Instance 1e2fd5f8-fe60-409a-acca-30b6637bca2e could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:40.653105 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd608807-122a-42e5-ba1d-739852dcd40e tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e" status: 404 len: 111 microversion: 2.1 time: 0.112233 Aug 27 05:03:40.654808 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1189/2337] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:40 2022] GET /compute/v2.1/servers/1e2fd5f8-fe60-409a-acca-30b6637bca2e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:40.666265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b018eb1a-1a35-4a0f-909a-0ef9681e7095 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:40.666983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b018eb1a-1a35-4a0f-909a-0ef9681e7095 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:40.680147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b018eb1a-1a35-4a0f-909a-0ef9681e7095 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.685681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b018eb1a-1a35-4a0f-909a-0ef9681e7095 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.686646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b018eb1a-1a35-4a0f-909a-0ef9681e7095 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:40.687684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b018eb1a-1a35-4a0f-909a-0ef9681e7095 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.689523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b018eb1a-1a35-4a0f-909a-0ef9681e7095 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.690198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b018eb1a-1a35-4a0f-909a-0ef9681e7095 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:40.739249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b018eb1a-1a35-4a0f-909a-0ef9681e7095 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:03:40.919661 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b018eb1a-1a35-4a0f-909a-0ef9681e7095 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 204 len: 0 microversion: 2.1 time: 0.259095 Aug 27 05:03:40.920362 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1190/2338] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:03:40 2022] DELETE /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:03:40.931879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60930c24-55fc-400f-9906-f1ee77738bb4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:40.932955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60930c24-55fc-400f-9906-f1ee77738bb4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:40.940044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60930c24-55fc-400f-9906-f1ee77738bb4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.940902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60930c24-55fc-400f-9906-f1ee77738bb4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.941689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60930c24-55fc-400f-9906-f1ee77738bb4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:40.942637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60930c24-55fc-400f-9906-f1ee77738bb4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.943295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60930c24-55fc-400f-9906-f1ee77738bb4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.943976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60930c24-55fc-400f-9906-f1ee77738bb4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:41.466844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-60930c24-55fc-400f-9906-f1ee77738bb4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:41.480600 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-60930c24-55fc-400f-9906-f1ee77738bb4 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1474 microversion: 2.1 time: 0.555631 Aug 27 05:03:41.482362 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1191/2339] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:40 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1474 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:41.493564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-922e50ce-3778-405a-aec3-b5cf55f0344f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb564f73940>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:41.588964 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-922e50ce-3778-405a-aec3-b5cf55f0344f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.101932 Aug 27 05:03:41.596725 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1192/2340] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:41 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:41.596725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-697e3fda-01c3-4dc7-8a31-fc79e0f81f55 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565191b80>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:41.697404 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-697e3fda-01c3-4dc7-8a31-fc79e0f81f55 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.105864 Aug 27 05:03:41.698092 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1193/2341] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:41 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:42.501830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-04395f5f-35ef-4cc8-bee3-a7db34334eb5 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:42.502564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-04395f5f-35ef-4cc8-bee3-a7db34334eb5 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:42.514397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04395f5f-35ef-4cc8-bee3-a7db34334eb5 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:42.520216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04395f5f-35ef-4cc8-bee3-a7db34334eb5 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:42.520925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04395f5f-35ef-4cc8-bee3-a7db34334eb5 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:42.521846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04395f5f-35ef-4cc8-bee3-a7db34334eb5 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:42.522466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04395f5f-35ef-4cc8-bee3-a7db34334eb5 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:42.523285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04395f5f-35ef-4cc8-bee3-a7db34334eb5 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:43.097034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04395f5f-35ef-4cc8-bee3-a7db34334eb5 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:43.109194 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-04395f5f-35ef-4cc8-bee3-a7db34334eb5 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1474 microversion: 2.1 time: 0.609000 Aug 27 05:03:43.111843 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1194/2342] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:42 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1474 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:43.125973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aca3bfab-ceaa-4cc6-a4bd-df7f413f3ccc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb5654368b0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:43.205892 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aca3bfab-ceaa-4cc6-a4bd-df7f413f3ccc tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.092083 Aug 27 05:03:43.206853 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1195/2343] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:43 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:43.219554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0fed0c2c-0d87-4cf2-8fcf-9934e2067594 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb564f8a550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:43.292953 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0fed0c2c-0d87-4cf2-8fcf-9934e2067594 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.084783 Aug 27 05:03:43.294640 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1196/2344] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:43 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:43.302715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-702a1298-065a-4145-b9da-980db7b81c81 req-0ba09b84-b5b4-4fe3-83e1-08b05b3cfc1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cc590d-689d-46fe-8dc4-c011387de6e9", "name": "network-vif-plugged", "status": "completed", "tag": "5ee83f90-dbeb-4713-85dd-e6139e429832"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:43.328910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-702a1298-065a-4145-b9da-980db7b81c81 req-0ba09b84-b5b4-4fe3-83e1-08b05b3cfc1e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:43.334760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-702a1298-065a-4145-b9da-980db7b81c81 req-0ba09b84-b5b4-4fe3-83e1-08b05b3cfc1e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:43.335546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-702a1298-065a-4145-b9da-980db7b81c81 req-0ba09b84-b5b4-4fe3-83e1-08b05b3cfc1e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:43.364146 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-702a1298-065a-4145-b9da-980db7b81c81 req-0ba09b84-b5b4-4fe3-83e1-08b05b3cfc1e service nova] Creating event network-vif-plugged:5ee83f90-dbeb-4713-85dd-e6139e429832 for instance 38cc590d-689d-46fe-8dc4-c011387de6e9 on n-h1-820368-35 Aug 27 05:03:43.388469 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-702a1298-065a-4145-b9da-980db7b81c81 req-0ba09b84-b5b4-4fe3-83e1-08b05b3cfc1e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090913 Aug 27 05:03:43.391575 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1197/2345] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:44.113363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:03:44.115694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:03:44.117824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:03:44.118596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:03:44.119239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:03:44.132853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b31c15c7-b459-4e2e-9149-d9c47c005b45 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:44.133572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b31c15c7-b459-4e2e-9149-d9c47c005b45 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:44.145729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:44.154201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b31c15c7-b459-4e2e-9149-d9c47c005b45 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:44.155137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b31c15c7-b459-4e2e-9149-d9c47c005b45 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:44.155782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b31c15c7-b459-4e2e-9149-d9c47c005b45 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:44.157215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b31c15c7-b459-4e2e-9149-d9c47c005b45 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:44.160333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b31c15c7-b459-4e2e-9149-d9c47c005b45 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:44.163493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:44.164411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b31c15c7-b459-4e2e-9149-d9c47c005b45 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:44.170805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:44.172528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:44.173903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:44.176390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:44.177781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:44.248377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Getting quotas for project dc337cfec67e4408bb9f110021b3f6b3. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:03:44.261939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Getting quotas for user 8e1d8d4c4b9f4d678029a02bc805e194 and project dc337cfec67e4408bb9f110021b3f6b3. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:03:44.498472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b31c15c7-b459-4e2e-9149-d9c47c005b45 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:44.514380 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b31c15c7-b459-4e2e-9149-d9c47c005b45 tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1474 microversion: 2.1 time: 0.384470 Aug 27 05:03:44.516610 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1198/2346] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:44 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1474 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:44.527158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ace96988-eebb-4fa2-b869-246d60aed6db tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb565413550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:44.626594 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ace96988-eebb-4fa2-b869-246d60aed6db tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.108876 Aug 27 05:03:44.628711 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1199/2347] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:44 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:44.653336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-903b0d09-30ff-49af-8c40-4731e5e2fc12 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb564f8aaf0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:44.738781 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-903b0d09-30ff-49af-8c40-4731e5e2fc12 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.104497 Aug 27 05:03:44.751362 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1200/2348] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:44 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:44.751581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:03:44.751581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9d624632-eb3e-4705-adb6-8675bc5b7426',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a5b0b4d1-02d8-4d2b-8aee-38527a64a4f9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32a79d6a-2d5b-4a62-89dc-6ed5cd66bfda',volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:03:45.540197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-96b759ff-bd50-43ca-afe8-714c3605c1ec tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:45.540847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-96b759ff-bd50-43ca-afe8-714c3605c1ec tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:45.548650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:45.569524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96b759ff-bd50-43ca-afe8-714c3605c1ec tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:45.570386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96b759ff-bd50-43ca-afe8-714c3605c1ec tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:45.571009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96b759ff-bd50-43ca-afe8-714c3605c1ec tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:45.572159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96b759ff-bd50-43ca-afe8-714c3605c1ec tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:45.573333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96b759ff-bd50-43ca-afe8-714c3605c1ec tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:45.577862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96b759ff-bd50-43ca-afe8-714c3605c1ec tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:45.855621 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5e0f1fc7-6b00-4ccc-8ee4-274743007c51 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 6.426896 Aug 27 05:03:45.866690 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1149/2349] 10.222.0.58 () {62 vars in 1189 bytes} [Sat Aug 27 05:03:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 6438 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 05:03:45.877362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-041145a2-b72c-4ff4-a4c9-7871019e28c0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb565004550>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:45.985494 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-041145a2-b72c-4ff4-a4c9-7871019e28c0 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.117578 Aug 27 05:03:45.997202 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1150/2350] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:45 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:46.014177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb489dda-cc0b-4e41-98b6-254e4cba93e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb569614c10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:46.069034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-96b759ff-bd50-43ca-afe8-714c3605c1ec tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd3e55e6a2842d08aeca3432e872be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170af42cbb5f42cb91d3047dede7583e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:46.084608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:46.088278 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-96b759ff-bd50-43ca-afe8-714c3605c1ec tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 200 len: 1474 microversion: 2.1 time: 0.554873 Aug 27 05:03:46.107529 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1201/2351] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:45 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 1474 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:46.152535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-494f12ff-f849-44de-bad9-65de3bd78c98 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:46.157211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-494f12ff-f849-44de-bad9-65de3bd78c98 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:46.170096 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb489dda-cc0b-4e41-98b6-254e4cba93e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.171170 Aug 27 05:03:46.176451 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1151/2352] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:45 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:46.192171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4eeb1e9a-8019-4783-8d1b-ca0516e6a491 req-849e5ada-b8ae-4d48-b179-fe13c8fd3b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10bdb977-4db9-4617-a264-fa34fdad10f2", "name": "network-vif-deleted", "tag": "ac68a06a-80f4-423a-9041-3661dde5f027"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:46.249840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4eeb1e9a-8019-4783-8d1b-ca0516e6a491 req-849e5ada-b8ae-4d48-b179-fe13c8fd3b5c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:46.257097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4eeb1e9a-8019-4783-8d1b-ca0516e6a491 req-849e5ada-b8ae-4d48-b179-fe13c8fd3b5c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:46.261467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4eeb1e9a-8019-4783-8d1b-ca0516e6a491 req-849e5ada-b8ae-4d48-b179-fe13c8fd3b5c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:46.308662 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4eeb1e9a-8019-4783-8d1b-ca0516e6a491 req-849e5ada-b8ae-4d48-b179-fe13c8fd3b5c service nova] Creating event network-vif-deleted:ac68a06a-80f4-423a-9041-3661dde5f027 for instance 10bdb977-4db9-4617-a264-fa34fdad10f2 on n-h1-820368-35 Aug 27 05:03:46.316311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-494f12ff-f849-44de-bad9-65de3bd78c98 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:46.327714 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4eeb1e9a-8019-4783-8d1b-ca0516e6a491 req-849e5ada-b8ae-4d48-b179-fe13c8fd3b5c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147091 Aug 27 05:03:46.329825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-494f12ff-f849-44de-bad9-65de3bd78c98 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:46.341664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-494f12ff-f849-44de-bad9-65de3bd78c98 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:46.351306 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-494f12ff-f849-44de-bad9-65de3bd78c98 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1285 microversion: 2.32 time: 0.242225 Aug 27 05:03:46.351963 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1202/2353] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:46 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:46.374814 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1152/2354] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:47.002376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6d30cc6c-5312-4a2f-8798-a8082bde7e76 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb569614dc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:47.118286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b6dd49fb-c987-4543-aaa2-663478d0cba3 tempest-NetworksTest-477420245 tempest-NetworksTest-477420245-project-admin] Calling method '.version_select at 0x7fb5652d04c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:47.306074 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6d30cc6c-5312-4a2f-8798-a8082bde7e76 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1427 microversion: 2.1 time: 0.309072 Aug 27 05:03:47.310921 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1153/2355] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:46 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1427 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:47.334824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:47.339117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] [instance: 10bdb977-4db9-4617-a264-fa34fdad10f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:47.359913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.364074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.366171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.367370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.370074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.374824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.419593 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] HTTP exception thrown: Instance 10bdb977-4db9-4617-a264-fa34fdad10f2 could not be found. Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Request method failure captured: Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 HTTP/1.1 Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaVgf-AyksjgHrDgzyg4dlQEjxSPyUxoJCzpIArzrYIh70FpfeCKrdKyPnsZaiAd7z7ntJVSotOdeQkOOHVO2zGBxdFfKxdsDpFGpS7ragZT_I5WjpzFSgxPWA2BAKlqi9NQMJrlo7ou5yZinSk4bmUXpMEj_RWDc1rSvxh3pMhDaIg Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 170af42cbb5f42cb91d3047dede7583e Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-LiveMigrationNegativeTest-52335509 Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_170af42cbb5f42cb91d3047dede7583e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/170af42cbb5f42cb91d3047dede7583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/170af42cbb5f42cb91d3047dede7583e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/170af42cbb5f42cb91d3047dede7583e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-LiveMigrationNegativeTest-52335509 Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 170af42cbb5f42cb91d3047dede7583e Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-52335509 Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-LiveMigrationNegativeTest-52335509-project Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: fdd3e55e6a2842d08aeca3432e872be6 Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-LiveMigrationNegativeTest-52335509-project Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 10bdb977-4db9-4617-a264-fa34fdad10f2 could not be found. Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '10bdb977-4db9-4617-a264-fa34fdad10f2'} Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10bdb977-4db9-4617-a264-fa34fdad10f2 could not be found. Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10bdb977-4db9-4617-a264-fa34fdad10f2 could not be found. Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:47.426806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:47.431843 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:47.431843 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:47.431843 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:47.431843 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:47.431843 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:47.431843 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10bdb977-4db9-4617-a264-fa34fdad10f2 could not be found. Aug 27 05:03:47.431843 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:03:47.431843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] Returning 404 to user: Instance 10bdb977-4db9-4617-a264-fa34fdad10f2 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:47.431843 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b3d2fc5d-6329-4791-8895-14ce455a22ee tempest-LiveMigrationNegativeTest-52335509 tempest-LiveMigrationNegativeTest-52335509-project] 10.222.0.58 "GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2" status: 404 len: 111 microversion: 2.1 time: 0.115680 Aug 27 05:03:47.431843 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1154/2356] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:47 2022] GET /compute/v2.1/servers/10bdb977-4db9-4617-a264-fa34fdad10f2 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:47.446281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b84da547-60c4-42fb-8144-6c9eb3336259 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5655dbaf0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:47.588814 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b6dd49fb-c987-4543-aaa2-663478d0cba3 tempest-NetworksTest-477420245 tempest-NetworksTest-477420245-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 8045 microversion: 2.1 time: 0.833010 Aug 27 05:03:47.589766 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1203/2357] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:03:46 2022] GET /compute/v2.1/os-networks => generated 8045 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:47.596314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:47.596937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:47.606530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.608046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.608907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.609959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.610579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.611650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.718703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:47.730835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:47.732863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:47.734709 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-330ee9ca-35e3-41ae-8dac-5f94a19395fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1519 microversion: 2.32 time: 0.142429 Aug 27 05:03:47.735992 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1204/2358] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:47 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1519 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:47.742586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-afb8e957-21a2-4d7f-b71c-0d4ef000b744 tempest-NetworksTest-477420245 tempest-NetworksTest-477420245-project-admin] Calling method '.version_select at 0x7fb565005700>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:47.908977 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-afb8e957-21a2-4d7f-b71c-0d4ef000b744 tempest-NetworksTest-477420245 tempest-NetworksTest-477420245-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks/7357b3fa-8561-40d7-8704-75e0551009fe" status: 200 len: 652 microversion: 2.1 time: 0.170620 Aug 27 05:03:47.909931 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1205/2359] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:03:47 2022] GET /compute/v2.1/os-networks/7357b3fa-8561-40d7-8704-75e0551009fe => generated 652 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:47.924868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa9ac15e-6274-41c8-8046-42beb9e6af03 tempest-NetworksTest-477420245 tempest-NetworksTest-477420245-project-admin] Calling method '.version_select at 0x7fb565413430>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:48.282474 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aa9ac15e-6274-41c8-8046-42beb9e6af03 tempest-NetworksTest-477420245 tempest-NetworksTest-477420245-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 8045 microversion: 2.1 time: 0.364609 Aug 27 05:03:48.287757 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1206/2360] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:03:47 2022] GET /compute/v2.1/os-networks => generated 8045 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:48.326730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-811c8c1c-821e-46cd-9b2d-d54fa6be0cf2 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb564f734c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:54.210773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:54.291592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:56.321085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:57.347755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:57.419636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:57.607504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:57.727457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:05.545362 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b84da547-60c4-42fb-8144-6c9eb3336259 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 18.112424 Aug 27 05:04:05.546726 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1155/2361] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:47 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 18114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:05.561971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:05.563585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:05.574572 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-811c8c1c-821e-46cd-9b2d-d54fa6be0cf2 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1436 microversion: 2.1 time: 17.253186 Aug 27 05:04:05.582131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:05.583506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:05.584265 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1207/2362] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:48 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1436 bytes in 17264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:05.586109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:05.587340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:05.589329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:05.590990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:06.074384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1004277305", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:06.230069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:04:06.336116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:06.352829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:06.361778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:06.365459 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6aeac9c1-1123-4e01-82fb-3297e0c27e47 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1886 microversion: 2.32 time: 0.817163 Aug 27 05:04:06.369225 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1156/2363] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:05 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1886 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:06.378484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-6f8636e5-4df8-4d44-8f18-299da67f3107 req-62aa92cb-f8af-41e8-b7ec-b805c1dc26de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "tag": "bd1cea64-a33a-4b9a-85cb-bf98ccbc4a5f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:06.399472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6f8636e5-4df8-4d44-8f18-299da67f3107 req-62aa92cb-f8af-41e8-b7ec-b805c1dc26de service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:06.399955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6f8636e5-4df8-4d44-8f18-299da67f3107 req-62aa92cb-f8af-41e8-b7ec-b805c1dc26de service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:06.400391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6f8636e5-4df8-4d44-8f18-299da67f3107 req-62aa92cb-f8af-41e8-b7ec-b805c1dc26de service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:06.419616 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-6f8636e5-4df8-4d44-8f18-299da67f3107 req-62aa92cb-f8af-41e8-b7ec-b805c1dc26de service nova] Creating event network-changed:bd1cea64-a33a-4b9a-85cb-bf98ccbc4a5f for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:04:06.425515 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-6f8636e5-4df8-4d44-8f18-299da67f3107 req-62aa92cb-f8af-41e8-b7ec-b805c1dc26de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054770 Aug 27 05:04:06.426840 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1157/2364] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:06.563309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df2db47d-0f87-4a33-a726-e38c29a652b4 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Action: 'create', calling method: .version_select at 0x7fb569614160>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLR+sbEdwvFkYg72YxQJX1GrlyrKJIR/rW2RK0+662D2xm0VAeY4wFs6D8MNHzcSPyb0yKCLMmZjyIMCyFw20PT4xf9s7/af+X88VUCRrqFWc27OREgw9e+mB01bv0A4JQ=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df2db47d-0f87-4a33-a726-e38c29a652b4 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Request method failure captured: Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 257 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXCWefe05or85v8MwOM1EsQ20OwUCgwsCfTr38xw-3oRnbo3_DP0h3T5gH9--OPNNx0dEBdyXFw7W30M55uSgCFDrolggjLk8GQf-q_xHSzvoZxVwEtKLV2PGXaJ2BV4c4IhuR5rSTl2fGTfhuOAPjcllV2U0P3NOjYOGGkXSaGcL8 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_720ec9ecc8fd47d983cdc2fee00f9ff5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLR+sbEdwvFkYg72YxQJX1GrlyrKJIR/rW2RK0+662D2xm0VAeY4wFs6D8MNHzcSPyb0yKCLMmZjyIMCyFw20PT4xf9s7/af+X88VUCRrqFWc27OREgw9e+mB01bv0A4JQ=="}} Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLR+sbEdwvFkYg72YxQJX1GrlyrKJIR/rW2RK0+662D2xm0VAeY4wFs6D8MNHzcSPyb0yKCLMmZjyIMCyFw20PT4xf9s7/af+X88VUCRrqFWc27OREgw9e+mB01bv0A4JQ=='}}} Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 27 05:04:06.575136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 05:04:06.580105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.584956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df2db47d-0f87-4a33-a726-e38c29a652b4 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:06.586747 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df2db47d-0f87-4a33-a726-e38c29a652b4 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.158057 Aug 27 05:04:06.587898 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1158/2365] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:04:06 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:04:06.594191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d63ad1ef-2c32-49c4-b20f-30e0b7d59d2d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb56965d5e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:06.669703 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d63ad1ef-2c32-49c4-b20f-30e0b7d59d2d tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 200 len: 1436 microversion: 2.1 time: 0.080485 Aug 27 05:04:06.670796 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1159/2366] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:06 2022] GET /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 1436 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:06.676988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-420c613c-055e-4e12-8a04-197423dfe791 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5655db0d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:06.737709 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-420c613c-055e-4e12-8a04-197423dfe791 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.065394 Aug 27 05:04:06.746765 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1160/2367] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:06 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:06.760220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-887804b1-9b0a-4bad-ae92-4cc6acfaedcd tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Action: 'create', calling method: .version_select at 0x7fb565037670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-818840097", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:06.817407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-887804b1-9b0a-4bad-ae92-4cc6acfaedcd tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Getting quotas for project 720ec9ecc8fd47d983cdc2fee00f9ff5. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:06.843673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-887804b1-9b0a-4bad-ae92-4cc6acfaedcd tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Getting quotas for user 15278f8d8b1d4f27b309c327540e0ef3 and project 720ec9ecc8fd47d983cdc2fee00f9ff5. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:06.896411 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-887804b1-9b0a-4bad-ae92-4cc6acfaedcd tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-887804b1-9b0a-4bad-ae92-4cc6acfaedcd tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Request method failure captured: Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 2166 Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXCWefe05or85v8MwOM1EsQ20OwUCgwsCfTr38xw-3oRnbo3_DP0h3T5gH9--OPNNx0dEBdyXFw7W30M55uSgCFDrolggjLk8GQf-q_xHSzvoZxVwEtKLV2PGXaJ2BV4c4IhuR5rSTl2fGTfhuOAPjcllV2U0P3NOjYOGGkXSaGcL8 Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_720ec9ecc8fd47d983cdc2fee00f9ff5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-818840097", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:04:06.920671 n-d-820368-35 devstack@n-api.service[128547]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-818840097', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:06.923400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:06.926498 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:06.930453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-887804b1-9b0a-4bad-ae92-4cc6acfaedcd tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:06.933662 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-887804b1-9b0a-4bad-ae92-4cc6acfaedcd tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.185430 Aug 27 05:04:06.939430 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1161/2368] 10.222.0.58 () {60 vars in 1160 bytes} [Sat Aug 27 05:04:06 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:06.945416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c60d56f2-9434-471e-91df-9eb902d15a6f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:06.949971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c60d56f2-9434-471e-91df-9eb902d15a6f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:06.965160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c60d56f2-9434-471e-91df-9eb902d15a6f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:06.967498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c60d56f2-9434-471e-91df-9eb902d15a6f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:06.970341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c60d56f2-9434-471e-91df-9eb902d15a6f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:06.973154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c60d56f2-9434-471e-91df-9eb902d15a6f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:06.973831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c60d56f2-9434-471e-91df-9eb902d15a6f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:06.974448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c60d56f2-9434-471e-91df-9eb902d15a6f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:07.244941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:04:07.245487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:04:07.246052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:04:07.246719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:04:07.247381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:04:07.263398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:07.266396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:07.267079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:07.268230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:07.269769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:07.270452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:07.336972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:07.347838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for user 58b3a6b755ba4d5f89899d3122ddc29d and project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:07.370152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:04:07.373002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:04:07.483036 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1efeb453-8726-45c5-8b79-fbf730501d59 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.897827 Aug 27 05:04:07.497330 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1208/2369] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:04:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:04:07.514186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-07a6878e-4727-476f-a965-f46addea0e40 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Action: 'create', calling method: .version_select at 0x7fb5650d9d30>, body: {"keypair": {"name": "tempest-keypair-941125783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaH16ySm8nRsKE/bqNBY+860VBLSHB9ulO9N6nBPzmJQdfkCzkA4sPTAqH4Xe0xdu+5SJaG9SeQsKHAkeNr++j00WaSXwUtU66zOFEwLndR8QS9z8HjsEv9Mn2r3+ZbDw=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:07.577530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-07a6878e-4727-476f-a965-f46addea0e40 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Getting quotas for project 720ec9ecc8fd47d983cdc2fee00f9ff5. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:07.597314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-07a6878e-4727-476f-a965-f46addea0e40 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Getting quotas for user 15278f8d8b1d4f27b309c327540e0ef3 and project 720ec9ecc8fd47d983cdc2fee00f9ff5. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:07.689741 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-07a6878e-4727-476f-a965-f46addea0e40 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.190934 Aug 27 05:04:07.691031 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1209/2370] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:04:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:07.697369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:07.703321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:07.724137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:07.728010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:07.728622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:07.729473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:07.730335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:07.751405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:07.767169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c60d56f2-9434-471e-91df-9eb902d15a6f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:07.776683 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c60d56f2-9434-471e-91df-9eb902d15a6f tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1466 microversion: 2.1 time: 0.835113 Aug 27 05:04:07.783894 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1162/2371] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:06 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1466 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:07.816828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-42cf94d5-d939-49fd-a3ed-1c83f11f4dd9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:07.817897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-42cf94d5-d939-49fd-a3ed-1c83f11f4dd9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:08.104571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-42cf94d5-d939-49fd-a3ed-1c83f11f4dd9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:08.124997 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-42cf94d5-d939-49fd-a3ed-1c83f11f4dd9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1213 microversion: 2.1 time: 0.339663 Aug 27 05:04:08.125928 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1163/2372] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:07 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1213 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:08.131080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3fc65867-56cf-490f-8f33-355f5162eecf tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Action: 'create', calling method: .version_select at 0x7fb569614280>, body: {"keypair": {"name": "tempest-keypair-941125783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK301/n5TdpckoyPJNTZZZeZ+vDHlYeR/eKxzv3uh54LMaKLNgIMLm1shGRS5WBcVVERF1lKeMGyeQPvmzvySRccI6R+BvaaCQPKEWOyp9SZck38mhVQoMBnB7Mg0rhfHw=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:08.169277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3fc65867-56cf-490f-8f33-355f5162eecf tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Getting quotas for project 720ec9ecc8fd47d983cdc2fee00f9ff5. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:08.183553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3fc65867-56cf-490f-8f33-355f5162eecf tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Getting quotas for user 15278f8d8b1d4f27b309c327540e0ef3 and project 720ec9ecc8fd47d983cdc2fee00f9ff5. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:08.232722 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-3fc65867-56cf-490f-8f33-355f5162eecf tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] HTTP exception thrown: Key pair 'tempest-keypair-941125783' already exists. Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3fc65867-56cf-490f-8f33-355f5162eecf tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Request method failure captured: Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 272 Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXCWefe05or85v8MwOM1EsQ20OwUCgwsCfTr38xw-3oRnbo3_DP0h3T5gH9--OPNNx0dEBdyXFw7W30M55uSgCFDrolggjLk8GQf-q_xHSzvoZxVwEtKLV2PGXaJ2BV4c4IhuR5rSTl2fGTfhuOAPjcllV2U0P3NOjYOGGkXSaGcL8 Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_720ec9ecc8fd47d983cdc2fee00f9ff5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: {"keypair": {"name": "tempest-keypair-941125783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK301/n5TdpckoyPJNTZZZeZ+vDHlYeR/eKxzv3uh54LMaKLNgIMLm1shGRS5WBcVVERF1lKeMGyeQPvmzvySRccI6R+BvaaCQPKEWOyp9SZck38mhVQoMBnB7Mg0rhfHw=="}} Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: exception: Key pair 'tempest-keypair-941125783' already exists. Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-941125783', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK301/n5TdpckoyPJNTZZZeZ+vDHlYeR/eKxzv3uh54LMaKLNgIMLm1shGRS5WBcVVERF1lKeMGyeQPvmzvySRccI6R+BvaaCQPKEWOyp9SZck38mhVQoMBnB7Mg0rhfHw=='}}} Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result.read() Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '15278f8d8b1d4f27b309c327540e0ef3-tempest-keypair-941125783' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 05:04:08.245488 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result.read() Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 05:04:08.249263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '15278f8d8b1d4f27b309c327540e0ef3-tempest-keypair-941125783' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 5, 4, 8, 220685), 'updated_at': None, 'name': 'tempest-keypair-941125783', 'user_id': '15278f8d8b1d4f27b309c327540e0ef3', 'fingerprint': '17:74:33:43:af:ac:ea:51:8a:af:98:9a:88:cb:1c:8f', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK301/n5TdpckoyPJNTZZZeZ+vDHlYeR/eKxzv3uh54LMaKLNgIMLm1shGRS5WBcVVERF1lKeMGyeQPvmzvySRccI6R+BvaaCQPKEWOyp9SZck38mhVQoMBnB7Mg0rhfHw==', 'type': 'ssh'}] Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi keypair.create() Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._create() Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-941125783' already exists. Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 27 05:04:08.253244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-941125783' already exists. Aug 27 05:04:08.263210 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.263210 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.263210 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.263210 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.263210 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:08.263210 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:08.263210 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:08.263210 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:08.263210 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-941125783' already exists. Aug 27 05:04:08.263210 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.267836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3fc65867-56cf-490f-8f33-355f5162eecf tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Returning 409 to user: Key pair 'tempest-keypair-941125783' already exists. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:08.269716 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3fc65867-56cf-490f-8f33-355f5162eecf tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.142308 Aug 27 05:04:08.270868 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1164/2373] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:04:08 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:04:08.277531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-184271ad-d2ce-490d-aa21-938ef6a3efc5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb569614e50>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:08.448669 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-184271ad-d2ce-490d-aa21-938ef6a3efc5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.176345 Aug 27 05:04:08.469478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:08.478378 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1165/2374] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:08 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:08.492009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e8456c2-840a-4b98-9a92-86400b0588a9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb569614160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:08.495015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:08.502488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:08.509152 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d0750931-d516-405c-96ef-14350ce81a68 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1886 microversion: 2.32 time: 0.812879 Aug 27 05:04:08.512096 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1210/2375] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:07 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1886 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:08.536240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-92811f52-fba0-4dc4-90eb-9c70608a5c6e tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Calling method '.version_select at 0x7fb565612ca0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:08.586168 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-92811f52-fba0-4dc4-90eb-9c70608a5c6e tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-941125783" status: 202 len: 0 microversion: 2.1 time: 0.069257 Aug 27 05:04:08.586812 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1211/2376] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 05:04:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-941125783 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:04:08.595557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-65ba710d-3c52-4434-a438-ce53829c29d6 req-da71663c-b61e-42fc-b324-65e3f8d4cddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "tag": "623c7391-d404-4e59-8e53-dac73c18bbd3"}, {"name": "network-changed", "server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "tag": "870feaae-e12d-419a-80e6-29d9b508fb26"}, {"name": "network-changed", "server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "tag": "54fa96c5-5e23-4d52-a8f5-1c2c79f49849"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:08.611473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-65ba710d-3c52-4434-a438-ce53829c29d6 req-da71663c-b61e-42fc-b324-65e3f8d4cddd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:08.611473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-65ba710d-3c52-4434-a438-ce53829c29d6 req-da71663c-b61e-42fc-b324-65e3f8d4cddd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:08.611473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-65ba710d-3c52-4434-a438-ce53829c29d6 req-da71663c-b61e-42fc-b324-65e3f8d4cddd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:08.626653 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-65ba710d-3c52-4434-a438-ce53829c29d6 req-da71663c-b61e-42fc-b324-65e3f8d4cddd service nova] Creating event network-changed:623c7391-d404-4e59-8e53-dac73c18bbd3 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:04:08.627922 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-65ba710d-3c52-4434-a438-ce53829c29d6 req-da71663c-b61e-42fc-b324-65e3f8d4cddd service nova] Creating event network-changed:870feaae-e12d-419a-80e6-29d9b508fb26 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:04:08.631493 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-65ba710d-3c52-4434-a438-ce53829c29d6 req-da71663c-b61e-42fc-b324-65e3f8d4cddd service nova] Creating event network-changed:54fa96c5-5e23-4d52-a8f5-1c2c79f49849 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:04:08.645233 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-65ba710d-3c52-4434-a438-ce53829c29d6 req-da71663c-b61e-42fc-b324-65e3f8d4cddd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.055916 Aug 27 05:04:08.660841 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1212/2377] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:08.676426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa534499-02c8-4fd5-a845-b0b6f03ad986 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Action: 'create', calling method: .version_select at 0x7fb564b27d30>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMDaWKoTBhh7YkKvQE8iR2D4dJxTGJUd2+nrw9HactDWQL6eXK5QLXOKmMk/1FqAJn4L0d17k5FpkVYg4m8e5iS42jV69/zWBsMQe+AztJnW+sypcfKGz6UKkgGl0c7Uw=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa534499-02c8-4fd5-a845-b0b6f03ad986 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Request method failure captured: Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 247 Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaXCWefe05or85v8MwOM1EsQ20OwUCgwsCfTr38xw-3oRnbo3_DP0h3T5gH9--OPNNx0dEBdyXFw7W30M55uSgCFDrolggjLk8GQf-q_xHSzvoZxVwEtKLV2PGXaJ2BV4c4IhuR5rSTl2fGTfhuOAPjcllV2U0P3NOjYOGGkXSaGcL8 Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_720ec9ecc8fd47d983cdc2fee00f9ff5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMDaWKoTBhh7YkKvQE8iR2D4dJxTGJUd2+nrw9HactDWQL6eXK5QLXOKmMk/1FqAJn4L0d17k5FpkVYg4m8e5iS42jV69/zWBsMQe+AztJnW+sypcfKGz6UKkgGl0c7Uw=="}} Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMDaWKoTBhh7YkKvQE8iR2D4dJxTGJUd2+nrw9HactDWQL6eXK5QLXOKmMk/1FqAJn4L0d17k5FpkVYg4m8e5iS42jV69/zWBsMQe+AztJnW+sypcfKGz6UKkgGl0c7Uw=='}}} Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi '' Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:04:08.684874 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 05:04:08.690855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.693247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa534499-02c8-4fd5-a845-b0b6f03ad986 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:08.694311 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aa534499-02c8-4fd5-a845-b0b6f03ad986 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.029647 Aug 27 05:04:08.696441 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1213/2378] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:04:08 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:04:08.708982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1aeb962-7b4b-43d7-9059-6641fc6453b1 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Action: 'create', calling method: .version_select at 0x7fb5697599d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-776034684", "public_key": " "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:08.734802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-a1aeb962-7b4b-43d7-9059-6641fc6453b1 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Getting quotas for project 720ec9ecc8fd47d983cdc2fee00f9ff5. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:08.742146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-a1aeb962-7b4b-43d7-9059-6641fc6453b1 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Getting quotas for user 15278f8d8b1d4f27b309c327540e0ef3 and project 720ec9ecc8fd47d983cdc2fee00f9ff5. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:08.789039 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-a1aeb962-7b4b-43d7-9059-6641fc6453b1 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1aeb962-7b4b-43d7-9059-6641fc6453b1 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Request method failure captured: Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 94 Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaXCWefe05or85v8MwOM1EsQ20OwUCgwsCfTr38xw-3oRnbo3_DP0h3T5gH9--OPNNx0dEBdyXFw7W30M55uSgCFDrolggjLk8GQf-q_xHSzvoZxVwEtKLV2PGXaJ2BV4c4IhuR5rSTl2fGTfhuOAPjcllV2U0P3NOjYOGGkXSaGcL8 Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_720ec9ecc8fd47d983cdc2fee00f9ff5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-776034684", "public_key": " "}} Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-776034684', 'public_key': ' '}}} Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.796467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:08.800869 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.804163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1aeb962-7b4b-43d7-9059-6641fc6453b1 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:08.806705 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a1aeb962-7b4b-43d7-9059-6641fc6453b1 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.103106 Aug 27 05:04:08.808052 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1214/2379] 10.222.0.58 () {60 vars in 1158 bytes} [Sat Aug 27 05:04:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:08.831663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-30b91b58-fac4-4449-add1-e78621579346 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Action: 'create', calling method: .version_select at 0x7fb564b27e50>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjTGzTlCYlfL3i7hzZ8vBFyluKM0JzlHME3pbnudkTyzDTiaJmZlDrRB+e0u6i5j8WYOFB9uYr3X9ysdzpBqKz55b9VUikaqf9la8ZoHJA/LxuFSjMIrKbligCt8JHpnA=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-30b91b58-fac4-4449-add1-e78621579346 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Request method failure captured: Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 507 Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaXCWefe05or85v8MwOM1EsQ20OwUCgwsCfTr38xw-3oRnbo3_DP0h3T5gH9--OPNNx0dEBdyXFw7W30M55uSgCFDrolggjLk8GQf-q_xHSzvoZxVwEtKLV2PGXaJ2BV4c4IhuR5rSTl2fGTfhuOAPjcllV2U0P3NOjYOGGkXSaGcL8 Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_720ec9ecc8fd47d983cdc2fee00f9ff5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjTGzTlCYlfL3i7hzZ8vBFyluKM0JzlHME3pbnudkTyzDTiaJmZlDrRB+e0u6i5j8WYOFB9uYr3X9ysdzpBqKz55b9VUikaqf9la8ZoHJA/LxuFSjMIrKbligCt8JHpnA=="}} Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjTGzTlCYlfL3i7hzZ8vBFyluKM0JzlHME3pbnudkTyzDTiaJmZlDrRB+e0u6i5j8WYOFB9uYr3X9ysdzpBqKz55b9VUikaqf9la8ZoHJA/LxuFSjMIrKbligCt8JHpnA=='}}} Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 05:04:08.837789 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 05:04:08.842296 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.847496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-30b91b58-fac4-4449-add1-e78621579346 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:08.849196 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-30b91b58-fac4-4449-add1-e78621579346 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.031868 Aug 27 05:04:08.850248 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1215/2380] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:04:08 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:04:08.862155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d4e00c76-91c0-4968-99d5-16d803679978 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Action: 'create', calling method: .version_select at 0x7fb5697598b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-633075089", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:08.921702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d4e00c76-91c0-4968-99d5-16d803679978 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Getting quotas for project 720ec9ecc8fd47d983cdc2fee00f9ff5. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:08.928553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d4e00c76-91c0-4968-99d5-16d803679978 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Getting quotas for user 15278f8d8b1d4f27b309c327540e0ef3 and project 720ec9ecc8fd47d983cdc2fee00f9ff5. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:08.953353 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d4e00c76-91c0-4968-99d5-16d803679978 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d4e00c76-91c0-4968-99d5-16d803679978 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Request method failure captured: Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 117 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaXCWefe05or85v8MwOM1EsQ20OwUCgwsCfTr38xw-3oRnbo3_DP0h3T5gH9--OPNNx0dEBdyXFw7W30M55uSgCFDrolggjLk8GQf-q_xHSzvoZxVwEtKLV2PGXaJ2BV4c4IhuR5rSTl2fGTfhuOAPjcllV2U0P3NOjYOGGkXSaGcL8 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_720ec9ecc8fd47d983cdc2fee00f9ff5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-633075089", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-633075089', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 05:04:08.955650 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 05:04:08.960887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:08.965329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d4e00c76-91c0-4968-99d5-16d803679978 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:08.967053 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d4e00c76-91c0-4968-99d5-16d803679978 tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.109546 Aug 27 05:04:08.969897 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1216/2381] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:04:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:08.981151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89194abd-7cd9-424e-99a1-c25369ce5b8f tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Calling method '.version_select at 0x7fb5650d9dc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:09.052350 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-89194abd-7cd9-424e-99a1-c25369ce5b8f tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-310359278 not found for user 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89194abd-7cd9-424e-99a1-c25369ce5b8f tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Request method failure captured: Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-310359278 HTTP/1.1 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaXCWefe05or85v8MwOM1EsQ20OwUCgwsCfTr38xw-3oRnbo3_DP0h3T5gH9--OPNNx0dEBdyXFw7W30M55uSgCFDrolggjLk8GQf-q_xHSzvoZxVwEtKLV2PGXaJ2BV4c4IhuR5rSTl2fGTfhuOAPjcllV2U0P3NOjYOGGkXSaGcL8 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_720ec9ecc8fd47d983cdc2fee00f9ff5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/720ec9ecc8fd47d983cdc2fee00f9ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 720ec9ecc8fd47d983cdc2fee00f9ff5 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-212524238 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-KeyPairsNegativeTestJSON-212524238-project Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: exception: Keypair tempest-keypair-non-existent-310359278 not found for user 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'tempest-keypair-non-existent-310359278'} Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-310359278 not found for user 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:09.057831 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-310359278 not found for user 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-310359278 not found for user 15278f8d8b1d4f27b309c327540e0ef3 Aug 27 05:04:09.062268 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:09.077161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89194abd-7cd9-424e-99a1-c25369ce5b8f tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] Returning 404 to user: Keypair tempest-keypair-non-existent-310359278 not found for user 15278f8d8b1d4f27b309c327540e0ef3 {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:09.079296 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89194abd-7cd9-424e-99a1-c25369ce5b8f tempest-KeyPairsNegativeTestJSON-212524238 tempest-KeyPairsNegativeTestJSON-212524238-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-310359278" status: 404 len: 144 microversion: 2.1 time: 0.104078 Aug 27 05:04:09.083622 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1217/2382] 10.222.0.58 () {58 vars in 1257 bytes} [Sat Aug 27 05:04:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-310359278 => generated 144 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:04:09.146832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d65af033-4147-4c44-8b62-40c4daa18283 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:09.148083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d65af033-4147-4c44-8b62-40c4daa18283 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:09.161783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d65af033-4147-4c44-8b62-40c4daa18283 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:09.164557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d65af033-4147-4c44-8b62-40c4daa18283 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:09.175864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d65af033-4147-4c44-8b62-40c4daa18283 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:09.176971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d65af033-4147-4c44-8b62-40c4daa18283 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:09.177898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d65af033-4147-4c44-8b62-40c4daa18283 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:09.180484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d65af033-4147-4c44-8b62-40c4daa18283 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:09.612430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d65af033-4147-4c44-8b62-40c4daa18283 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:09.640991 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d65af033-4147-4c44-8b62-40c4daa18283 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1209 microversion: 2.1 time: 0.495081 Aug 27 05:04:09.650231 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1218/2383] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:09 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1209 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:09.665814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e1d0d8b1-4957-4633-89ca-dd32314d83b9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb564b278b0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:10.395061 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e8456c2-840a-4b98-9a92-86400b0588a9 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "DELETE /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c" status: 204 len: 0 microversion: 2.1 time: 1.914905 Aug 27 05:04:10.396419 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1166/2384] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:08 2022] DELETE /compute/v2.1/images/5ba623bf-61a3-40f7-9260-407d76153d1c => generated 0 bytes in 1917 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:04:10.402657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:10.404078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:10.416760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:10.430397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:10.431423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:10.434062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:10.434804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:10.435467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:10.514349 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e1d0d8b1-4957-4633-89ca-dd32314d83b9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.862866 Aug 27 05:04:10.516535 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1219/2385] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:09 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:10.522516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d3899b0-eab6-49f5-9e8a-e44f0edd4839 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '.version_select at 0x7fb564f51ee0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:10.555666 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-2d3899b0-eab6-49f5-9e8a-e44f0edd4839 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] HTTP exception thrown: Image not found. Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d3899b0-eab6-49f5-9e8a-e44f0edd4839 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Request method failure captured: Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a HTTP/1.1 Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaVT_TdyMeIdYhDjmgJXr6LvEf4RAZW0Fl9dbLCXpSgQZoVixmA0RrHG2p4Zqx-yO7yrsW-QzOVJwrzeRSnDp6XDbn0Jm10KX2_VAuA0p-SRieSkaa3RywIVimFmy3ntqQWiL9IeYyqvxCYb7LuRP3oDHiIzvVsvM4Cd-iDGH5J7Oxg Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c3b22db8ab87483daf2acf10c94950cc Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesOneServerTestJSON-952928916 Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c3b22db8ab87483daf2acf10c94950cc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c3b22db8ab87483daf2acf10c94950cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c3b22db8ab87483daf2acf10c94950cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c3b22db8ab87483daf2acf10c94950cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesOneServerTestJSON-952928916 Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c3b22db8ab87483daf2acf10c94950cc Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-952928916 Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesOneServerTestJSON-952928916-project Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 16669649a1c345c9b1a8ab8d1e52012d Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesOneServerTestJSON-952928916-project Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: exception: Image not found. Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '5e1e1263-3373-4b7d-92d0-59adc8231c2a'} Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5e1e1263-3373-4b7d-92d0-59adc8231c2a to delete Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e1e1263-3373-4b7d-92d0-59adc8231c2a could not be found. Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:10.557475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d3899b0-eab6-49f5-9e8a-e44f0edd4839 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Returning 404 to user: Image not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d3899b0-eab6-49f5-9e8a-e44f0edd4839 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "DELETE /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a" status: 404 len: 62 microversion: 2.1 time: 0.041461 Aug 27 05:04:10.561626 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1220/2386] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:10 2022] DELETE /compute/v2.1/images/5e1e1263-3373-4b7d-92d0-59adc8231c2a => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:04:10.581796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-607ad6db-022a-4633-ad71-053f0255ef69 req-fac2963c-5357-4be4-af1c-e72008083709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e", "name": "network-vif-unplugged", "status": "completed", "tag": "bafc5b86-279b-411c-9b1a-ae47f7108d43"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:10.612803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-607ad6db-022a-4633-ad71-053f0255ef69 req-fac2963c-5357-4be4-af1c-e72008083709 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:10.614456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-607ad6db-022a-4633-ad71-053f0255ef69 req-fac2963c-5357-4be4-af1c-e72008083709 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:10.614897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-607ad6db-022a-4633-ad71-053f0255ef69 req-fac2963c-5357-4be4-af1c-e72008083709 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:10.646615 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-607ad6db-022a-4633-ad71-053f0255ef69 req-fac2963c-5357-4be4-af1c-e72008083709 service nova] Creating event network-vif-unplugged:bafc5b86-279b-411c-9b1a-ae47f7108d43 for instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e on n-h2-820368-35 Aug 27 05:04:10.661392 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-607ad6db-022a-4633-ad71-053f0255ef69 req-fac2963c-5357-4be4-af1c-e72008083709 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098321 Aug 27 05:04:10.662001 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1221/2387] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:10.676414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6b600e9b-3656-4816-b157-e2bea196e3ac tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:10.680494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6b600e9b-3656-4816-b157-e2bea196e3ac tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:10.695945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b600e9b-3656-4816-b157-e2bea196e3ac tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:10.698506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b600e9b-3656-4816-b157-e2bea196e3ac tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:10.699691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b600e9b-3656-4816-b157-e2bea196e3ac tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:10.702378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b600e9b-3656-4816-b157-e2bea196e3ac tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:10.704168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b600e9b-3656-4816-b157-e2bea196e3ac tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:10.705220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b600e9b-3656-4816-b157-e2bea196e3ac tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:10.805742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6b600e9b-3656-4816-b157-e2bea196e3ac tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:04:11.110871 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6b600e9b-3656-4816-b157-e2bea196e3ac tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 204 len: 0 microversion: 2.1 time: 0.447448 Aug 27 05:04:11.114642 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1222/2388] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:04:10 2022] DELETE /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:04:11.120304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ed86b283-69d5-4812-9ae9-6fa6aa27fbe5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:11.121022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ed86b283-69d5-4812-9ae9-6fa6aa27fbe5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:11.138907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed86b283-69d5-4812-9ae9-6fa6aa27fbe5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:11.139424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed86b283-69d5-4812-9ae9-6fa6aa27fbe5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:11.139869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed86b283-69d5-4812-9ae9-6fa6aa27fbe5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:11.140595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed86b283-69d5-4812-9ae9-6fa6aa27fbe5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:11.141053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed86b283-69d5-4812-9ae9-6fa6aa27fbe5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:11.141490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed86b283-69d5-4812-9ae9-6fa6aa27fbe5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:11.381696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ed86b283-69d5-4812-9ae9-6fa6aa27fbe5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:11.395368 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ed86b283-69d5-4812-9ae9-6fa6aa27fbe5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1271 microversion: 2.1 time: 0.279315 Aug 27 05:04:11.395959 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1223/2389] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:11 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:11.409931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88917eb0-c65b-4608-a544-f5e096d9c871 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:11.410933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-88917eb0-c65b-4608-a544-f5e096d9c871 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:11.422792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88917eb0-c65b-4608-a544-f5e096d9c871 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:11.423537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88917eb0-c65b-4608-a544-f5e096d9c871 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:11.424131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88917eb0-c65b-4608-a544-f5e096d9c871 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:11.429723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88917eb0-c65b-4608-a544-f5e096d9c871 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:11.430467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88917eb0-c65b-4608-a544-f5e096d9c871 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:11.431048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88917eb0-c65b-4608-a544-f5e096d9c871 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:12.761761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:12.783327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:12.788984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:12.790616 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-964d44fb-43fc-444b-aeed-db25b1938063 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1886 microversion: 2.32 time: 2.392768 Aug 27 05:04:12.792607 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1167/2390] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:10 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1886 bytes in 2395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:12.807411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9017aa28-e781-45c4-bd99-16b87e9e7369 req-04cfc1e5-b1cb-47ff-a0ae-72e7b91e5aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "tag": "a40e1272-53cc-4930-bec4-a342676c13f1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:12.834256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9017aa28-e781-45c4-bd99-16b87e9e7369 req-04cfc1e5-b1cb-47ff-a0ae-72e7b91e5aaa service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:12.836097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9017aa28-e781-45c4-bd99-16b87e9e7369 req-04cfc1e5-b1cb-47ff-a0ae-72e7b91e5aaa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:12.837302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9017aa28-e781-45c4-bd99-16b87e9e7369 req-04cfc1e5-b1cb-47ff-a0ae-72e7b91e5aaa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:12.900322 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9017aa28-e781-45c4-bd99-16b87e9e7369 req-04cfc1e5-b1cb-47ff-a0ae-72e7b91e5aaa service nova] Creating event network-changed:a40e1272-53cc-4930-bec4-a342676c13f1 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:04:12.923341 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9017aa28-e781-45c4-bd99-16b87e9e7369 req-04cfc1e5-b1cb-47ff-a0ae-72e7b91e5aaa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127212 Aug 27 05:04:12.927910 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1168/2391] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:12.933170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-64cf1fae-2105-4d02-946b-f75fa85c2b1f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb569614790>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:13.073705 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-64cf1fae-2105-4d02-946b-f75fa85c2b1f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.144440 Aug 27 05:04:13.074288 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1169/2392] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:12 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:13.079897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d4772587-a899-412f-8749-1374f896367f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:13.102894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d4772587-a899-412f-8749-1374f896367f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:13.141740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4772587-a899-412f-8749-1374f896367f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:13.142273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4772587-a899-412f-8749-1374f896367f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:13.142729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4772587-a899-412f-8749-1374f896367f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:13.143521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4772587-a899-412f-8749-1374f896367f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:13.143984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4772587-a899-412f-8749-1374f896367f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:13.144417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4772587-a899-412f-8749-1374f896367f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:13.309015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-88917eb0-c65b-4608-a544-f5e096d9c871 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:13.320457 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88917eb0-c65b-4608-a544-f5e096d9c871 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1472 microversion: 2.1 time: 1.923367 Aug 27 05:04:13.327654 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1224/2393] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:11 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1472 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:13.556808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d4772587-a899-412f-8749-1374f896367f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:13.572139 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d4772587-a899-412f-8749-1374f896367f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1313 microversion: 2.1 time: 0.495816 Aug 27 05:04:13.572974 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1170/2394] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:13 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:13.821070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:13.821716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:13.840124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:13.840622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:13.846808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:13.848834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:13.857871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:13.858702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:14.089084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-94fb0af0-4253-4fe3-9733-cb34f75a5a70 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56965d8b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:14.174498 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-94fb0af0-4253-4fe3-9733-cb34f75a5a70 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1412 microversion: 2.1 time: 0.089117 Aug 27 05:04:14.182342 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1171/2395] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:14 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:14.351534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-58d4adbe-6eb4-4c1d-9536-c0081dc20504 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:14.352265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-58d4adbe-6eb4-4c1d-9536-c0081dc20504 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:14.373045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58d4adbe-6eb4-4c1d-9536-c0081dc20504 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:14.373495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58d4adbe-6eb4-4c1d-9536-c0081dc20504 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:14.373944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58d4adbe-6eb4-4c1d-9536-c0081dc20504 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:14.374672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58d4adbe-6eb4-4c1d-9536-c0081dc20504 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:14.375174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58d4adbe-6eb4-4c1d-9536-c0081dc20504 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:14.375611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58d4adbe-6eb4-4c1d-9536-c0081dc20504 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:14.460714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:14.477261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:14.478717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:14.479941 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-40c173d7-91e9-43e8-bacd-c7c6ff46bf12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1886 microversion: 2.32 time: 0.663961 Aug 27 05:04:14.480509 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1225/2396] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:13 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1886 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:14.594372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5d224119-7659-46c2-a177-84e0d6ea14b3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:14.594994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5d224119-7659-46c2-a177-84e0d6ea14b3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:14.606112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d224119-7659-46c2-a177-84e0d6ea14b3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:14.606609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d224119-7659-46c2-a177-84e0d6ea14b3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:14.607048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d224119-7659-46c2-a177-84e0d6ea14b3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:14.607783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d224119-7659-46c2-a177-84e0d6ea14b3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:14.608240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d224119-7659-46c2-a177-84e0d6ea14b3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:14.608742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d224119-7659-46c2-a177-84e0d6ea14b3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:14.791239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-58d4adbe-6eb4-4c1d-9536-c0081dc20504 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:14.804688 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-58d4adbe-6eb4-4c1d-9536-c0081dc20504 tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1472 microversion: 2.1 time: 0.457655 Aug 27 05:04:14.805473 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1172/2397] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:14 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1472 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:14.956176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-151d9f79-101b-4b89-8f49-b2be9321edce req-90ef911b-531d-4b58-86b5-29fb2495a2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "tag": "5462e758-72dc-4c63-9751-fed9c3a9046c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:14.981513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-151d9f79-101b-4b89-8f49-b2be9321edce req-90ef911b-531d-4b58-86b5-29fb2495a2d0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:14.995927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-151d9f79-101b-4b89-8f49-b2be9321edce req-90ef911b-531d-4b58-86b5-29fb2495a2d0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:14.996691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-151d9f79-101b-4b89-8f49-b2be9321edce req-90ef911b-531d-4b58-86b5-29fb2495a2d0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:15.025221 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-151d9f79-101b-4b89-8f49-b2be9321edce req-90ef911b-531d-4b58-86b5-29fb2495a2d0 service nova] Creating event network-changed:5462e758-72dc-4c63-9751-fed9c3a9046c for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:04:15.036413 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-151d9f79-101b-4b89-8f49-b2be9321edce req-90ef911b-531d-4b58-86b5-29fb2495a2d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083758 Aug 27 05:04:15.037164 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1173/2398] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:15.111250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d224119-7659-46c2-a177-84e0d6ea14b3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:15.124414 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5d224119-7659-46c2-a177-84e0d6ea14b3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1313 microversion: 2.1 time: 0.534276 Aug 27 05:04:15.125038 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1226/2399] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:14 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:15.197903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-624817b4-0b57-48e0-ae2f-5babe600a5ed tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb569614b80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:15.304214 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-624817b4-0b57-48e0-ae2f-5babe600a5ed tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1421 microversion: 2.1 time: 0.117287 Aug 27 05:04:15.304989 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1174/2400] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:15 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:15.318706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-98a6b241-f3f4-417e-bd25-09d437ba7e2b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56968cca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:15.388251 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-98a6b241-f3f4-417e-bd25-09d437ba7e2b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 200 len: 1421 microversion: 2.1 time: 0.073621 Aug 27 05:04:15.391263 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1175/2401] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:15 2022] GET /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 1421 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:15.408183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-857ad046-6316-4307-9493-044ce54431e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56965dca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:15.471374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10139eca-a0e9-480f-87c6-631cf5df98c1 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Action: 'create', calling method: .version_select at 0x7fb5651954c0>, body: {"keypair": {"name": "tempest-keypair-1334739956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe0TupUybW+pZpF5BKqU3i+9gGGpFXmlaloyWCPU2nJXQLH1CNujMDzqkztPZBgWMCKUoT8kIjhFKuIXjTZMB2CiTcqZVNmE/KG5yNJ581sHYRhVlHZoP5JdblWun7F3g=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:15.507849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-10139eca-a0e9-480f-87c6-631cf5df98c1 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:15.514379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-10139eca-a0e9-480f-87c6-631cf5df98c1 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for user 24728c14d046483890d1917da3994d11 and project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:15.609822 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10139eca-a0e9-480f-87c6-631cf5df98c1 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.382567 Aug 27 05:04:15.610565 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1227/2402] 10.222.0.58 () {62 vars in 1199 bytes} [Sat Aug 27 05:04:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 384 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 05:04:15.615400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:15.616027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:15.640824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:15.641466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:15.641927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:15.642692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:15.643180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:15.643739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:16.125831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:16.146213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:16.152354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:16.158530 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad41213d-b353-4825-9914-855e6fc397b9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1886 microversion: 2.32 time: 0.546875 Aug 27 05:04:16.185321 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1228/2403] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:15 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1886 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:16.195065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-50e89a09-64c0-499a-b472-1f803b85d43e tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb564b9b820>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:16.239480 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-50e89a09-64c0-499a-b472-1f803b85d43e tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1334739956" status: 200 len: 513 microversion: 2.2 time: 0.053022 Aug 27 05:04:16.250909 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1229/2404] 10.222.0.58 () {60 vars in 1258 bytes} [Sat Aug 27 05:04:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1334739956 => generated 513 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:16.265016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:16.265562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:16.274505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:16.281984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:16.282987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:16.283962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:16.284630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:16.285764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:16.365346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:16.365860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:16.366354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:16.369615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lazy-loading 'fault' on Instance uuid dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:04:16.510797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16669649a1c345c9b1a8ab8d1e52012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b22db8ab87483daf2acf10c94950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:16.524264 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b9647afd-bfa6-4134-b1be-bca4f18bcedf tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 200 len: 1306 microversion: 2.1 time: 0.272141 Aug 27 05:04:16.525008 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1230/2405] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:16 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 1306 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:16.529388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-fee75ec3-5fee-45ae-903c-18f878d6e876 req-a285fcf3-5a30-4f4e-9f0b-8229b9dd1de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e", "name": "network-vif-deleted", "tag": "bafc5b86-279b-411c-9b1a-ae47f7108d43"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:16.547013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:16.566186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fee75ec3-5fee-45ae-903c-18f878d6e876 req-a285fcf3-5a30-4f4e-9f0b-8229b9dd1de5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:16.566668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fee75ec3-5fee-45ae-903c-18f878d6e876 req-a285fcf3-5a30-4f4e-9f0b-8229b9dd1de5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:16.567178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fee75ec3-5fee-45ae-903c-18f878d6e876 req-a285fcf3-5a30-4f4e-9f0b-8229b9dd1de5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:16.594199 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-fee75ec3-5fee-45ae-903c-18f878d6e876 req-a285fcf3-5a30-4f4e-9f0b-8229b9dd1de5 service nova] Creating event network-vif-deleted:bafc5b86-279b-411c-9b1a-ae47f7108d43 for instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e on n-h2-820368-35 Aug 27 05:04:16.604498 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-fee75ec3-5fee-45ae-903c-18f878d6e876 req-a285fcf3-5a30-4f4e-9f0b-8229b9dd1de5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078362 Aug 27 05:04:16.605105 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1231/2406] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:16.610722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-837682cc-1fe8-42fd-9f2a-a28a016518dd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:16.679883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-837682cc-1fe8-42fd-9f2a-a28a016518dd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:16.695684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-837682cc-1fe8-42fd-9f2a-a28a016518dd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:16.696181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-837682cc-1fe8-42fd-9f2a-a28a016518dd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:16.696624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-837682cc-1fe8-42fd-9f2a-a28a016518dd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:16.697344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-837682cc-1fe8-42fd-9f2a-a28a016518dd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:16.697806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-837682cc-1fe8-42fd-9f2a-a28a016518dd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:16.698241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-837682cc-1fe8-42fd-9f2a-a28a016518dd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:16.989378 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-857ad046-6316-4307-9493-044ce54431e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 204 len: 0 microversion: 2.1 time: 1.587235 Aug 27 05:04:16.989989 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1176/2407] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:15 2022] DELETE /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 0 bytes in 1589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:04:17.016443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a0432652-1950-4e46-ba70-24380825ea63 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb56968c790>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:17.062545 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a0432652-1950-4e46-ba70-24380825ea63 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334739956" status: 204 len: 0 microversion: 2.2 time: 0.071479 Aug 27 05:04:17.064147 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1177/2408] 10.222.0.58 () {60 vars in 1261 bytes} [Sat Aug 27 05:04:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334739956 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:04:17.090452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c8be7c41-32a1-4eaa-ab2f-ac757ce2eaeb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:17.091461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c8be7c41-32a1-4eaa-ab2f-ac757ce2eaeb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:17.110092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8be7c41-32a1-4eaa-ab2f-ac757ce2eaeb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:17.110846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8be7c41-32a1-4eaa-ab2f-ac757ce2eaeb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:17.112844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8be7c41-32a1-4eaa-ab2f-ac757ce2eaeb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:17.113799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8be7c41-32a1-4eaa-ab2f-ac757ce2eaeb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:17.125466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8be7c41-32a1-4eaa-ab2f-ac757ce2eaeb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:17.127947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8be7c41-32a1-4eaa-ab2f-ac757ce2eaeb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:17.191369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c8be7c41-32a1-4eaa-ab2f-ac757ce2eaeb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:04:17.307592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:17.333527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-837682cc-1fe8-42fd-9f2a-a28a016518dd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:17.386243 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-837682cc-1fe8-42fd-9f2a-a28a016518dd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1313 microversion: 2.1 time: 0.778855 Aug 27 05:04:17.386726 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c8be7c41-32a1-4eaa-ab2f-ac757ce2eaeb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 204 len: 0 microversion: 2.1 time: 0.306452 Aug 27 05:04:17.387687 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1232/2409] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:16 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1313 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:17.396990 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1178/2410] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:04:17 2022] DELETE /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:04:17.415258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f06a3d74-00be-44bd-ae9a-ab4cd743db88 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Action: 'create', calling method: .version_select at 0x7fb564b27310>, body: {"keypair": {"name": "tempest-keypair-1622920594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVO3nFhaj8cqShXOqg+wraihf23ZTcGjvz79rhOT8W5m2CRDFsld6sHSBflB0mBOwkPIfStFo7SvC9JMdHkuZsbqo/bwES/Xprt3MwQVzwmPGVHjMNTU+WTWMHow6tiFg=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:17.415960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0b1628d8-2329-416d-9c8e-cc9ed0fa69c6 req-5a82585b-9694-48d8-ae74-9eee9b8a0296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "tag": "c9039cae-1e09-4044-a9e0-b73c85febfdd"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:17.450238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0b1628d8-2329-416d-9c8e-cc9ed0fa69c6 req-5a82585b-9694-48d8-ae74-9eee9b8a0296 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:17.450882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0b1628d8-2329-416d-9c8e-cc9ed0fa69c6 req-5a82585b-9694-48d8-ae74-9eee9b8a0296 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:17.451597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0b1628d8-2329-416d-9c8e-cc9ed0fa69c6 req-5a82585b-9694-48d8-ae74-9eee9b8a0296 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:17.477343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f06a3d74-00be-44bd-ae9a-ab4cd743db88 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:17.498935 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0b1628d8-2329-416d-9c8e-cc9ed0fa69c6 req-5a82585b-9694-48d8-ae74-9eee9b8a0296 service nova] Creating event network-changed:c9039cae-1e09-4044-a9e0-b73c85febfdd for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:04:17.505509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f06a3d74-00be-44bd-ae9a-ab4cd743db88 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for user 24728c14d046483890d1917da3994d11 and project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:17.517064 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0b1628d8-2329-416d-9c8e-cc9ed0fa69c6 req-5a82585b-9694-48d8-ae74-9eee9b8a0296 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114931 Aug 27 05:04:17.521378 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1179/2411] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:17.530340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:17.531410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:17.543054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:17.543933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:17.544603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:17.555612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:17.562317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:17.564300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:17.594865 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f06a3d74-00be-44bd-ae9a-ab4cd743db88 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.194704 Aug 27 05:04:17.597442 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1233/2412] 10.222.0.58 () {62 vars in 1199 bytes} [Sat Aug 27 05:04:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 05:04:17.611330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b402b761-3143-44a7-99d5-609b83146f51 req-c9c8cc04-56e9-45b4-9f85-23cf3801f88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cc590d-689d-46fe-8dc4-c011387de6e9", "name": "network-vif-unplugged", "status": "completed", "tag": "5ee83f90-dbeb-4713-85dd-e6139e429832"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:17.638848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b402b761-3143-44a7-99d5-609b83146f51 req-c9c8cc04-56e9-45b4-9f85-23cf3801f88f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:17.641758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b402b761-3143-44a7-99d5-609b83146f51 req-c9c8cc04-56e9-45b4-9f85-23cf3801f88f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:17.642392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b402b761-3143-44a7-99d5-609b83146f51 req-c9c8cc04-56e9-45b4-9f85-23cf3801f88f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:17.675862 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b402b761-3143-44a7-99d5-609b83146f51 req-c9c8cc04-56e9-45b4-9f85-23cf3801f88f service nova] Creating event network-vif-unplugged:5ee83f90-dbeb-4713-85dd-e6139e429832 for instance 38cc590d-689d-46fe-8dc4-c011387de6e9 on n-h1-820368-35 Aug 27 05:04:17.688944 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b402b761-3143-44a7-99d5-609b83146f51 req-c9c8cc04-56e9-45b4-9f85-23cf3801f88f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089858 Aug 27 05:04:17.690399 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1234/2413] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:17.697332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:17.698301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] [instance: dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:17.717859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:17.718644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:17.719389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:17.725097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:17.726148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:17.726603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:17.757429 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] HTTP exception thrown: Instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e could not be found. Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Request method failure captured: Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e HTTP/1.1 Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaVT_TdyMeIdYhDjmgJXr6LvEf4RAZW0Fl9dbLCXpSgQZoVixmA0RrHG2p4Zqx-yO7yrsW-QzOVJwrzeRSnDp6XDbn0Jm10KX2_VAuA0p-SRieSkaa3RywIVimFmy3ntqQWiL9IeYyqvxCYb7LuRP3oDHiIzvVsvM4Cd-iDGH5J7Oxg Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: c3b22db8ab87483daf2acf10c94950cc Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesOneServerTestJSON-952928916 Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c3b22db8ab87483daf2acf10c94950cc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c3b22db8ab87483daf2acf10c94950cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c3b22db8ab87483daf2acf10c94950cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c3b22db8ab87483daf2acf10c94950cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesOneServerTestJSON-952928916 Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: c3b22db8ab87483daf2acf10c94950cc Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-952928916 Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesOneServerTestJSON-952928916-project Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 16669649a1c345c9b1a8ab8d1e52012d Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesOneServerTestJSON-952928916-project Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e could not be found. Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e'} Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e could not be found. Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e could not be found. Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:17.768197 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:17.776359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:17.776359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:17.776359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:17.776359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:17.776359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:17.776359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e could not be found. Aug 27 05:04:17.776359 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:04:17.776359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] Returning 404 to user: Instance dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:17.776359 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd6dcfc2-eb13-4209-a78f-0d3eac7f1b7b tempest-ImagesOneServerTestJSON-952928916 tempest-ImagesOneServerTestJSON-952928916-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e" status: 404 len: 111 microversion: 2.1 time: 0.072425 Aug 27 05:04:17.776359 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1235/2414] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:17 2022] GET /compute/v2.1/servers/dfcfa0b2-0c02-45b3-8ac8-66a2c0b9da6e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:04:17.778245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1439781006", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "11d496fd-4b16-4935-bb52-9962a7e9cd7d"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:17.860467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] validate_networks() for [('11d496fd-4b16-4935-bb52-9962a7e9cd7d', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:04:18.130244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:18.153315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:18.164915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:18.166375 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb765e55-527b-4869-be01-8e90921ec346 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1886 microversion: 2.32 time: 0.640425 Aug 27 05:04:18.167145 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1180/2415] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:17 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1886 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:18.172026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ff41e9f-8915-4cda-9ca2-ff999042de0e tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb569638d30>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:18.205739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=10 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:18.217866 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ff41e9f-8915-4cda-9ca2-ff999042de0e tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622920594" status: 204 len: 0 microversion: 2.2 time: 0.049502 Aug 27 05:04:18.218691 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1181/2416] 10.222.0.58 () {60 vars in 1261 bytes} [Sat Aug 27 05:04:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622920594 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:04:18.228218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a70c77f3-3a60-4e82-9517-6cba36449ef8 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Action: 'create', calling method: .version_select at 0x7fb56963d0d0>, body: {"keypair": {"name": "tempest-keypair-451366825", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:18.263194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a70c77f3-3a60-4e82-9517-6cba36449ef8 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:18.273528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a70c77f3-3a60-4e82-9517-6cba36449ef8 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for user 24728c14d046483890d1917da3994d11 and project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:18.338658 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a70c77f3-3a60-4e82-9517-6cba36449ef8 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.114593 Aug 27 05:04:18.339619 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1182/2417] 10.222.0.58 () {62 vars in 1199 bytes} [Sat Aug 27 05:04:18 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 05:04:18.349667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bc027bb3-5953-4ebd-9e76-cd6b29d802bf tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb56965d0d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:18.411079 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bc027bb3-5953-4ebd-9e76-cd6b29d802bf tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451366825" status: 204 len: 0 microversion: 2.2 time: 0.065294 Aug 27 05:04:18.411715 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1183/2418] 10.222.0.58 () {60 vars in 1258 bytes} [Sat Aug 27 05:04:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451366825 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:04:18.416467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-792e2eb5-a28a-450e-991e-2badffe86a7e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:18.417080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-792e2eb5-a28a-450e-991e-2badffe86a7e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:18.449863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792e2eb5-a28a-450e-991e-2badffe86a7e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:18.450745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792e2eb5-a28a-450e-991e-2badffe86a7e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:18.451368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792e2eb5-a28a-450e-991e-2badffe86a7e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:18.452670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792e2eb5-a28a-450e-991e-2badffe86a7e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:18.494279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792e2eb5-a28a-450e-991e-2badffe86a7e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:18.496794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792e2eb5-a28a-450e-991e-2badffe86a7e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:18.885639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-792e2eb5-a28a-450e-991e-2badffe86a7e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:18.898787 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-792e2eb5-a28a-450e-991e-2badffe86a7e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1313 microversion: 2.1 time: 0.483976 Aug 27 05:04:18.901128 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1184/2419] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:18 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:18.912279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d9110893-f98d-49a1-b581-b5b5f0d91e43 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Action: 'create', calling method: .version_select at 0x7fb565004550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-799971367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6mE3n9dnSyhGeJQpxy5JeOWOwrXd7aP+4wr6BD/rCByN08tlYSEx2i67PQ0day5PWcCQpTD4/lx3KFLH+mmAGAO6dGrC20ryRQMUBlQPsmUioiQ9z1CiLyYMy2ZHdULA=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:18.960760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-d9110893-f98d-49a1-b581-b5b5f0d91e43 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:18.976259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-d9110893-f98d-49a1-b581-b5b5f0d91e43 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for user 24728c14d046483890d1917da3994d11 and project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:19.033182 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d9110893-f98d-49a1-b581-b5b5f0d91e43 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.130659 Aug 27 05:04:19.033797 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1185/2420] 10.222.0.58 () {62 vars in 1199 bytes} [Sat Aug 27 05:04:18 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 05:04:19.040244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4784f342-a0a2-4eb9-85f1-d2639e083855 req-1112695c-88b4-4dca-a3ce-f8a15c7ae141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f131d54a-c71c-4d45-84f2-28576acda582", "tag": "c11fd666-9533-4ab6-8b6d-ca21e57491a1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:19.063197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4784f342-a0a2-4eb9-85f1-d2639e083855 req-1112695c-88b4-4dca-a3ce-f8a15c7ae141 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:19.065211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4784f342-a0a2-4eb9-85f1-d2639e083855 req-1112695c-88b4-4dca-a3ce-f8a15c7ae141 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:19.067251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4784f342-a0a2-4eb9-85f1-d2639e083855 req-1112695c-88b4-4dca-a3ce-f8a15c7ae141 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:19.074648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:04:19.075747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:04:19.076462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:04:19.077031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:04:19.077658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:04:19.096038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:19.096751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:19.097361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:19.098162 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4784f342-a0a2-4eb9-85f1-d2639e083855 req-1112695c-88b4-4dca-a3ce-f8a15c7ae141 service nova] Creating event network-changed:c11fd666-9533-4ab6-8b6d-ca21e57491a1 for instance f131d54a-c71c-4d45-84f2-28576acda582 on n-h1-820368-35 Aug 27 05:04:19.099122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:19.100344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:19.102609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:19.104683 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4784f342-a0a2-4eb9-85f1-d2639e083855 req-1112695c-88b4-4dca-a3ce-f8a15c7ae141 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069408 Aug 27 05:04:19.105432 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1186/2421] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:19.115545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-185d01ab-abaf-4c7e-8f8c-5a3b94c98e89 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Action: 'create', calling method: .version_select at 0x7fb56965d310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-150264290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVtC+c33U0TuYAsv4JcWpX09PD1oXW3cqKEHjkW4RTVZSin7SsYKSxONtbmBKonfHKW9BbklsAbhXed9aDUlrMC3RtKfihRIpXdEgu2tUvMLYIjAo3wr/FnJyQ9N7IoOw=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:19.148985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Getting quotas for project d8fa2042dc6a457fa50dcbf75e3a32ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:19.151493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-185d01ab-abaf-4c7e-8f8c-5a3b94c98e89 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:19.157149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:19.164118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Getting quotas for user 979e8da1534344fcb5a2be09631ea09c and project d8fa2042dc6a457fa50dcbf75e3a32ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:19.168862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-185d01ab-abaf-4c7e-8f8c-5a3b94c98e89 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for user 24728c14d046483890d1917da3994d11 and project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:19.198045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:04:19.208921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:04:19.237140 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-185d01ab-abaf-4c7e-8f8c-5a3b94c98e89 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.129605 Aug 27 05:04:19.238286 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1187/2422] 10.222.0.58 () {62 vars in 1199 bytes} [Sat Aug 27 05:04:19 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 05:04:19.263743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:19.267685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:19.284357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:19.285512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:19.287640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:19.290622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:19.291882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:19.293938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:19.349710 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4367c23f-75db-49f7-b715-4bd28315e627 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575523 Aug 27 05:04:19.350751 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1236/2423] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:04:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:04:19.364654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-301e59ff-1687-423a-9bad-ed66319f2718 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Action: 'create', calling method: .version_select at 0x7fb564b27ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1470038344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5eQkaCtOWOvFM2kMo0rytooNk5K/jFiSXh8JbX5kTFqZfDFA3VAE1mjx5i0Gm28bIpEycIRZ3S+YdilyqWYTEb2R6HQPWaitgL7SGL3SJIqtPBAlJM0V0xcnHRylrX5g=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:19.399287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-301e59ff-1687-423a-9bad-ed66319f2718 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:19.407258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-301e59ff-1687-423a-9bad-ed66319f2718 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for user 24728c14d046483890d1917da3994d11 and project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:19.442703 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-301e59ff-1687-423a-9bad-ed66319f2718 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.088798 Aug 27 05:04:19.444980 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1237/2424] 10.222.0.58 () {62 vars in 1199 bytes} [Sat Aug 27 05:04:19 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 05:04:19.451136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-beaa33bd-a9d8-4e17-b4c8-4f485ca2d049 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:19.452568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-beaa33bd-a9d8-4e17-b4c8-4f485ca2d049 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:19.695137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-beaa33bd-a9d8-4e17-b4c8-4f485ca2d049 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:19.703409 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-beaa33bd-a9d8-4e17-b4c8-4f485ca2d049 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1208 microversion: 2.1 time: 0.256774 Aug 27 05:04:19.707837 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1238/2425] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:19 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1208 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:19.716031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-db4ec7e2-8ca4-4bc8-90a2-350b7eaf4fda tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb564b65e50>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:19.729232 n-d-820368-35 devstack@n-api.service[128548]: WARNING oslo_db.sqlalchemy.utils [None req-db4ec7e2-8ca4-4bc8-90a2-350b7eaf4fda tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 05:04:19.744769 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-db4ec7e2-8ca4-4bc8-90a2-350b7eaf4fda tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.035552 Aug 27 05:04:19.751904 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1239/2426] 10.222.0.58 () {60 vars in 1177 bytes} [Sat Aug 27 05:04:19 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:19.762539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-612dde9a-c654-4ceb-bc5c-a2d58b0d8634 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb564b300d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:19.811446 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-612dde9a-c654-4ceb-bc5c-a2d58b0d8634 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1470038344" status: 204 len: 0 microversion: 2.2 time: 0.052638 Aug 27 05:04:19.815902 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1240/2427] 10.222.0.58 () {60 vars in 1321 bytes} [Sat Aug 27 05:04:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1470038344 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:04:19.828946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1658a8e1-ee68-4889-926d-5bfc188f03e6 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb569759ee0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:19.906686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:19.909933 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1658a8e1-ee68-4889-926d-5bfc188f03e6 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-150264290" status: 204 len: 0 microversion: 2.2 time: 0.087286 Aug 27 05:04:19.910839 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1241/2428] 10.222.0.58 () {60 vars in 1318 bytes} [Sat Aug 27 05:04:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-150264290 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:04:19.921323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5129b447-2ac6-4884-aa05-4dbffd9c0035 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb564b27670>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:19.922468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:19.924978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:19.941365 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a82676f6-459f-408c-9628-eef14a191aa0 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1886 microversion: 2.32 time: 0.676691 Aug 27 05:04:19.942595 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1188/2429] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:19 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1886 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:19.970116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-316c10b3-e0ff-40cf-b2fb-ef5b89adb5ba tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:19.972334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-316c10b3-e0ff-40cf-b2fb-ef5b89adb5ba tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:19.987717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-316c10b3-e0ff-40cf-b2fb-ef5b89adb5ba tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:19.988506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-316c10b3-e0ff-40cf-b2fb-ef5b89adb5ba tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:19.993780 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5129b447-2ac6-4884-aa05-4dbffd9c0035 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-799971367" status: 204 len: 0 microversion: 2.2 time: 0.071711 Aug 27 05:04:19.994085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-316c10b3-e0ff-40cf-b2fb-ef5b89adb5ba tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:19.995018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-316c10b3-e0ff-40cf-b2fb-ef5b89adb5ba tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:19.995770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-316c10b3-e0ff-40cf-b2fb-ef5b89adb5ba tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:19.996027 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1242/2430] 10.222.0.58 () {60 vars in 1318 bytes} [Sat Aug 27 05:04:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-799971367 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:04:19.996672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-316c10b3-e0ff-40cf-b2fb-ef5b89adb5ba tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:20.017775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ca08f1f-97cd-4cbe-8e75-ee74aab71f3e tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Action: 'create', calling method: .version_select at 0x7fb564ed55e0>, body: {"keypair": {"name": "tempest-keypair-1601856078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgbZh4I4iW8+/Gzp3fSyKWujgcDD43ll8+cGUIsWA15i6QDGlHZJsvzY5m46jKH84vIsb2pZAjFZXl9BgS5t8SZJcHc89bFzFR+K6azFxHRmSFg30SFjXyK3oYco3JwRQ=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:20.070038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0ca08f1f-97cd-4cbe-8e75-ee74aab71f3e tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:20.076947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0ca08f1f-97cd-4cbe-8e75-ee74aab71f3e tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for user 24728c14d046483890d1917da3994d11 and project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:20.121478 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ca08f1f-97cd-4cbe-8e75-ee74aab71f3e tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.117546 Aug 27 05:04:20.122861 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1243/2431] 10.222.0.58 () {62 vars in 1199 bytes} [Sat Aug 27 05:04:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 05:04:20.135809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cbe85301-f16e-4d17-b93b-8f69f22455b1 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb564f51dc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:20.157304 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cbe85301-f16e-4d17-b93b-8f69f22455b1 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1601856078" status: 200 len: 513 microversion: 2.2 time: 0.025700 Aug 27 05:04:20.159450 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1244/2432] 10.222.0.58 () {60 vars in 1258 bytes} [Sat Aug 27 05:04:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1601856078 => generated 513 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:04:20.181005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5d3804f-48b6-41b0-94bb-40dabce82e72 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb569759dc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:20.185631 n-d-820368-35 devstack@n-api.service[128548]: WARNING oslo_db.sqlalchemy.utils [None req-f5d3804f-48b6-41b0-94bb-40dabce82e72 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 05:04:20.201981 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5d3804f-48b6-41b0-94bb-40dabce82e72 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.035120 Aug 27 05:04:20.201981 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1245/2433] 10.222.0.58 () {60 vars in 1177 bytes} [Sat Aug 27 05:04:20 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:20.212011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-04a51e64-ef79-46b1-b8ba-847c56a86f54 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb564f3e0d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:20.237297 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-04a51e64-ef79-46b1-b8ba-847c56a86f54 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601856078" status: 204 len: 0 microversion: 2.2 time: 0.028672 Aug 27 05:04:20.238881 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1246/2434] 10.222.0.58 () {60 vars in 1261 bytes} [Sat Aug 27 05:04:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601856078 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:04:20.267618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c640c398-37b1-4a90-8fef-c44b9b539cbd tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Action: 'create', calling method: .version_select at 0x7fb564b9b9d0>, body: {"keypair": {"name": "tempest-keypair-1010472929", "type": "x509"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:20.323947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c640c398-37b1-4a90-8fef-c44b9b539cbd tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:20.337635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c640c398-37b1-4a90-8fef-c44b9b539cbd tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for user 24728c14d046483890d1917da3994d11 and project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:20.357048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.processutils [None req-c640c398-37b1-4a90-8fef-c44b9b539cbd tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpmh_2g04h/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmh_2g04h/temp.key -subj /CN=24728c14d046483890d1917da3994d11 -extensions v3_req_client {{(pid=128548) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 05:04:20.389107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-316c10b3-e0ff-40cf-b2fb-ef5b89adb5ba tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:20.404090 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-316c10b3-e0ff-40cf-b2fb-ef5b89adb5ba tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1313 microversion: 2.1 time: 0.458302 Aug 27 05:04:20.408052 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1189/2435] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:19 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:20.729246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d34ac6c5-c133-4683-86f9-ac7d92be701b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:20.729935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d34ac6c5-c133-4683-86f9-ac7d92be701b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:20.762492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d34ac6c5-c133-4683-86f9-ac7d92be701b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:20.763315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d34ac6c5-c133-4683-86f9-ac7d92be701b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:20.765661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d34ac6c5-c133-4683-86f9-ac7d92be701b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:20.772008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d34ac6c5-c133-4683-86f9-ac7d92be701b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:20.773655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d34ac6c5-c133-4683-86f9-ac7d92be701b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:20.775672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d34ac6c5-c133-4683-86f9-ac7d92be701b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:20.966525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.processutils [None req-c640c398-37b1-4a90-8fef-c44b9b539cbd tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpmh_2g04h/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmh_2g04h/temp.key -subj /CN=24728c14d046483890d1917da3994d11 -extensions v3_req_client" returned: 0 in 0.607s {{(pid=128548) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 05:04:20.969862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.processutils [None req-c640c398-37b1-4a90-8fef-c44b9b539cbd tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpmh_2g04h/temp.key -password pass: {{(pid=128548) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 05:04:20.976851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d34ac6c5-c133-4683-86f9-ac7d92be701b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:20.989765 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d34ac6c5-c133-4683-86f9-ac7d92be701b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1204 microversion: 2.1 time: 0.265095 Aug 27 05:04:20.990651 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1190/2436] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:20 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1204 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:20.999974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:21.003858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:21.015945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:21.016444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:21.018920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:21.021659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:21.022146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:21.023182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:21.064987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.processutils [None req-c640c398-37b1-4a90-8fef-c44b9b539cbd tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpmh_2g04h/temp.key -password pass:" returned: 0 in 0.095s {{(pid=128548) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 05:04:21.167530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:21.176885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c640c398-37b1-4a90-8fef-c44b9b539cbd tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:21.190488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c640c398-37b1-4a90-8fef-c44b9b539cbd tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Getting quotas for user 24728c14d046483890d1917da3994d11 and project 07e4901c8b6e48c9a8487af01cf84d32. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:21.236175 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c640c398-37b1-4a90-8fef-c44b9b539cbd tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.991632 Aug 27 05:04:21.237920 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1247/2437] 10.222.0.58 () {62 vars in 1198 bytes} [Sat Aug 27 05:04:20 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 994 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:04:21.259456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b1cee87d-19fc-477a-b0c5-a743cc036a82 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb5652d04c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:21.272877 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b1cee87d-19fc-477a-b0c5-a743cc036a82 tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1010472929" status: 200 len: 1534 microversion: 2.2 time: 0.027816 Aug 27 05:04:21.273937 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1248/2438] 10.222.0.58 () {60 vars in 1258 bytes} [Sat Aug 27 05:04:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1010472929 => generated 1534 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:21.289803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4dce3350-6454-44a8-b7e6-f0c1ef822efe tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb564b270d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:21.298876 n-d-820368-35 devstack@n-api.service[128548]: WARNING oslo_db.sqlalchemy.utils [None req-4dce3350-6454-44a8-b7e6-f0c1ef822efe tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 05:04:21.318298 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4dce3350-6454-44a8-b7e6-f0c1ef822efe tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.036981 Aug 27 05:04:21.321870 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1249/2439] 10.222.0.58 () {60 vars in 1177 bytes} [Sat Aug 27 05:04:21 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:21.333744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3d1d9603-2fb8-411e-a066-f4e3ad7c865a tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] Calling method '.version_select at 0x7fb564b659d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:21.383254 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3d1d9603-2fb8-411e-a066-f4e3ad7c865a tempest-KeyPairsV22TestJSON-2131847646 tempest-KeyPairsV22TestJSON-2131847646-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010472929" status: 204 len: 0 microversion: 2.2 time: 0.053601 Aug 27 05:04:21.385400 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1250/2440] 10.222.0.58 () {60 vars in 1261 bytes} [Sat Aug 27 05:04:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010472929 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:04:21.430411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2924d74c-18a5-4273-a7e7-5e64b3e80ddc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:21.431349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2924d74c-18a5-4273-a7e7-5e64b3e80ddc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:21.447096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2924d74c-18a5-4273-a7e7-5e64b3e80ddc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:21.450059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2924d74c-18a5-4273-a7e7-5e64b3e80ddc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:21.450679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2924d74c-18a5-4273-a7e7-5e64b3e80ddc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:21.451620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2924d74c-18a5-4273-a7e7-5e64b3e80ddc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:21.454808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2924d74c-18a5-4273-a7e7-5e64b3e80ddc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:21.457006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2924d74c-18a5-4273-a7e7-5e64b3e80ddc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:21.944651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:21.954216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:21.955714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:21.956896 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cb67e536-8412-46d2-844e-23874f85fd0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1886 microversion: 2.32 time: 0.964312 Aug 27 05:04:21.967453 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1191/2441] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:20 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1886 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:21.981066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2924d74c-18a5-4273-a7e7-5e64b3e80ddc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:21.993745 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2924d74c-18a5-4273-a7e7-5e64b3e80ddc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1313 microversion: 2.1 time: 0.568762 Aug 27 05:04:22.007794 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1251/2442] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:21 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:22.023485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e88b7289-7644-4ad5-8d13-071932938be6 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:22.024393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e88b7289-7644-4ad5-8d13-071932938be6 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:22.031862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e88b7289-7644-4ad5-8d13-071932938be6 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:22.032667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e88b7289-7644-4ad5-8d13-071932938be6 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:22.033408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e88b7289-7644-4ad5-8d13-071932938be6 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:22.034338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e88b7289-7644-4ad5-8d13-071932938be6 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:22.034985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e88b7289-7644-4ad5-8d13-071932938be6 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:22.036388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e88b7289-7644-4ad5-8d13-071932938be6 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:22.124571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e88b7289-7644-4ad5-8d13-071932938be6 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:22.136337 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e88b7289-7644-4ad5-8d13-071932938be6 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1266 microversion: 2.1 time: 0.126172 Aug 27 05:04:22.157212 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1192/2443] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:22 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:22.986464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:22.987764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:22.996755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:22.997674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:22.998863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:22.999860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:23.001120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:23.001821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:23.019266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a71f25dc-af1c-4375-95fc-00628f6b348b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:23.020886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a71f25dc-af1c-4375-95fc-00628f6b348b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:23.035620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a71f25dc-af1c-4375-95fc-00628f6b348b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:23.036277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a71f25dc-af1c-4375-95fc-00628f6b348b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:23.036816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a71f25dc-af1c-4375-95fc-00628f6b348b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:23.041158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a71f25dc-af1c-4375-95fc-00628f6b348b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:23.042200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a71f25dc-af1c-4375-95fc-00628f6b348b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:23.042745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a71f25dc-af1c-4375-95fc-00628f6b348b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:23.054752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:23.630460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a71f25dc-af1c-4375-95fc-00628f6b348b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:23.644800 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a71f25dc-af1c-4375-95fc-00628f6b348b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1313 microversion: 2.1 time: 0.629922 Aug 27 05:04:23.645414 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1193/2444] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:23 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:23.670401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4fad266e-afca-4707-bdb6-c983b3a2a1ba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:23.671334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4fad266e-afca-4707-bdb6-c983b3a2a1ba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:23.679336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fad266e-afca-4707-bdb6-c983b3a2a1ba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:23.679336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fad266e-afca-4707-bdb6-c983b3a2a1ba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:23.680709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fad266e-afca-4707-bdb6-c983b3a2a1ba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:23.681856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fad266e-afca-4707-bdb6-c983b3a2a1ba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:23.682484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fad266e-afca-4707-bdb6-c983b3a2a1ba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:23.683077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fad266e-afca-4707-bdb6-c983b3a2a1ba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:23.683674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:23.710565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:23.712250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:23.713477 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e613cecc-085b-45fe-83cc-c0411b087ead tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1886 microversion: 2.32 time: 0.731627 Aug 27 05:04:23.733717 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1252/2445] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:22 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1886 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:23.900892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4fad266e-afca-4707-bdb6-c983b3a2a1ba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:23.927523 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4fad266e-afca-4707-bdb6-c983b3a2a1ba tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1266 microversion: 2.1 time: 0.266375 Aug 27 05:04:23.963431 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1194/2446] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:23 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:24.097899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2e594f6f-28f2-455c-8fa4-93adcad0e954 req-7fb646c0-734d-4642-9aba-3a12193bf477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cc590d-689d-46fe-8dc4-c011387de6e9", "name": "network-vif-deleted", "tag": "5ee83f90-dbeb-4713-85dd-e6139e429832"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:24.140513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2e594f6f-28f2-455c-8fa4-93adcad0e954 req-7fb646c0-734d-4642-9aba-3a12193bf477 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.144051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2e594f6f-28f2-455c-8fa4-93adcad0e954 req-7fb646c0-734d-4642-9aba-3a12193bf477 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.145598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2e594f6f-28f2-455c-8fa4-93adcad0e954 req-7fb646c0-734d-4642-9aba-3a12193bf477 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:24.174899 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2e594f6f-28f2-455c-8fa4-93adcad0e954 req-7fb646c0-734d-4642-9aba-3a12193bf477 service nova] Creating event network-vif-deleted:5ee83f90-dbeb-4713-85dd-e6139e429832 for instance 38cc590d-689d-46fe-8dc4-c011387de6e9 on n-h1-820368-35 Aug 27 05:04:24.189369 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2e594f6f-28f2-455c-8fa4-93adcad0e954 req-7fb646c0-734d-4642-9aba-3a12193bf477 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093271 Aug 27 05:04:24.192186 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1195/2447] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:04:24.329903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e4499220-1192-4818-b52f-837758a60994 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:24.330484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e4499220-1192-4818-b52f-837758a60994 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:24.341232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4499220-1192-4818-b52f-837758a60994 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.345450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4499220-1192-4818-b52f-837758a60994 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.346022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4499220-1192-4818-b52f-837758a60994 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:24.347903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4499220-1192-4818-b52f-837758a60994 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.349814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4499220-1192-4818-b52f-837758a60994 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.350399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4499220-1192-4818-b52f-837758a60994 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:24.361987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:24.461648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e4499220-1192-4818-b52f-837758a60994 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:04:24.634178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e4499220-1192-4818-b52f-837758a60994 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 204 len: 0 microversion: 2.42 time: 0.898022 Aug 27 05:04:24.635155 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1253/2448] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:04:23 2022] DELETE /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 0 bytes in 901 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:04:24.644075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:24.645071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:24.657344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.661266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.662653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:24.663645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.666284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.666896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d33aa66d-2c0b-4e90-834b-0bf0141c13e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:24.667267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:24.667629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d33aa66d-2c0b-4e90-834b-0bf0141c13e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:24.679760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33aa66d-2c0b-4e90-834b-0bf0141c13e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.682630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33aa66d-2c0b-4e90-834b-0bf0141c13e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.682630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33aa66d-2c0b-4e90-834b-0bf0141c13e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:24.682630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33aa66d-2c0b-4e90-834b-0bf0141c13e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.682630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33aa66d-2c0b-4e90-834b-0bf0141c13e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.682630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d33aa66d-2c0b-4e90-834b-0bf0141c13e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:25.139133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.155355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.156488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.157921 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-17518d1a-572b-4b90-889f-7f3442282b61 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2962 microversion: 2.42 time: 0.518332 Aug 27 05:04:25.162799 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1196/2449] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:24 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2962 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:25.167865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:25.175412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:25.195789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:25.196467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:25.197234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:25.198267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:25.198884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:25.199493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:25.236666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d33aa66d-2c0b-4e90-834b-0bf0141c13e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.249935 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d33aa66d-2c0b-4e90-834b-0bf0141c13e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1313 microversion: 2.1 time: 0.585859 Aug 27 05:04:25.265305 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1254/2450] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:24 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1313 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:25.265305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c06d1e2-68b1-4da1-89d2-4b9d91d31621 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:25.265305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c06d1e2-68b1-4da1-89d2-4b9d91d31621 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:25.282782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c06d1e2-68b1-4da1-89d2-4b9d91d31621 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:25.283342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c06d1e2-68b1-4da1-89d2-4b9d91d31621 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:25.283788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c06d1e2-68b1-4da1-89d2-4b9d91d31621 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:25.284516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c06d1e2-68b1-4da1-89d2-4b9d91d31621 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:25.284976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c06d1e2-68b1-4da1-89d2-4b9d91d31621 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:25.285416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c06d1e2-68b1-4da1-89d2-4b9d91d31621 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:25.478116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6c06d1e2-68b1-4da1-89d2-4b9d91d31621 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.486242 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c06d1e2-68b1-4da1-89d2-4b9d91d31621 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1266 microversion: 2.1 time: 0.234122 Aug 27 05:04:25.505039 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1255/2451] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:25 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:25.513749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-36008b47-c240-4f58-adfb-0d8b160a52ac req-cf9a45c1-c1e7-44b4-a19a-9fe5aa3649dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f131d54a-c71c-4d45-84f2-28576acda582", "name": "network-vif-plugged", "status": "completed", "tag": "c11fd666-9533-4ab6-8b6d-ca21e57491a1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:25.546247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-36008b47-c240-4f58-adfb-0d8b160a52ac req-cf9a45c1-c1e7-44b4-a19a-9fe5aa3649dc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:25.549528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-36008b47-c240-4f58-adfb-0d8b160a52ac req-cf9a45c1-c1e7-44b4-a19a-9fe5aa3649dc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:25.550151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-36008b47-c240-4f58-adfb-0d8b160a52ac req-cf9a45c1-c1e7-44b4-a19a-9fe5aa3649dc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:25.575827 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-36008b47-c240-4f58-adfb-0d8b160a52ac req-cf9a45c1-c1e7-44b4-a19a-9fe5aa3649dc service nova] Creating event network-vif-plugged:c11fd666-9533-4ab6-8b6d-ca21e57491a1 for instance f131d54a-c71c-4d45-84f2-28576acda582 on n-h1-820368-35 Aug 27 05:04:25.588641 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-36008b47-c240-4f58-adfb-0d8b160a52ac req-cf9a45c1-c1e7-44b4-a19a-9fe5aa3649dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081779 Aug 27 05:04:25.595374 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1256/2452] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:25.610636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.623124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.624795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.626117 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0ca9b717-e4a8-4cda-970c-4aaf49023082 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1886 microversion: 2.32 time: 0.462073 Aug 27 05:04:25.627149 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1197/2453] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:25 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1886 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:26.200319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:26.202030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:26.220925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.221689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.223018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.224187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.226327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.227841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.271955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-647a6bb4-2209-452b-bbb1-3dcdec1e054b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:26.273138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-647a6bb4-2209-452b-bbb1-3dcdec1e054b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:26.288377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-647a6bb4-2209-452b-bbb1-3dcdec1e054b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.291901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-647a6bb4-2209-452b-bbb1-3dcdec1e054b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.292707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-647a6bb4-2209-452b-bbb1-3dcdec1e054b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.293628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-647a6bb4-2209-452b-bbb1-3dcdec1e054b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.297950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-647a6bb4-2209-452b-bbb1-3dcdec1e054b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.306225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-647a6bb4-2209-452b-bbb1-3dcdec1e054b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.673524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-647a6bb4-2209-452b-bbb1-3dcdec1e054b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:26.688553 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-647a6bb4-2209-452b-bbb1-3dcdec1e054b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1313 microversion: 2.1 time: 0.420360 Aug 27 05:04:26.695076 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1198/2454] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:26 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:26.707298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-342ff596-a6e0-40e6-ac26-b4cadbbd1f95 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:26.712391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-342ff596-a6e0-40e6-ac26-b4cadbbd1f95 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:26.736332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-342ff596-a6e0-40e6-ac26-b4cadbbd1f95 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.738849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-342ff596-a6e0-40e6-ac26-b4cadbbd1f95 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.740515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-342ff596-a6e0-40e6-ac26-b4cadbbd1f95 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.742251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-342ff596-a6e0-40e6-ac26-b4cadbbd1f95 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.743662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-342ff596-a6e0-40e6-ac26-b4cadbbd1f95 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.744420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-342ff596-a6e0-40e6-ac26-b4cadbbd1f95 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.854164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:26.872585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:26.888211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:26.888211 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f5e4cbb-e3f2-43bc-8540-472f010e1ae4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2962 microversion: 2.42 time: 0.682496 Aug 27 05:04:26.904343 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1257/2455] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:26 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2962 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:26.917739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:26.918373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:26.944741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.950953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.951691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.952467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.952953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.959071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:28.026904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:28.040033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:28.041590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:28.052651 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b464bf92-58ed-490c-8934-28669b3291a2 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1886 microversion: 2.32 time: 1.147010 Aug 27 05:04:28.053459 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1258/2456] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:26 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1886 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:28.063354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-342ff596-a6e0-40e6-ac26-b4cadbbd1f95 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:28.071255 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-342ff596-a6e0-40e6-ac26-b4cadbbd1f95 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1308 microversion: 2.1 time: 1.374749 Aug 27 05:04:28.071840 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1199/2457] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:26 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1308 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:28.089574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-37e7f235-9d8a-426e-b639-f7fea8af57e8 req-c1bc1419-8737-4445-aaa9-73bcb2f08d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e359f17-fa25-41b2-a570-f33bc74f53c4", "tag": "77bbdc0c-6ead-4e74-b3c1-521340163ee2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:28.127292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-37e7f235-9d8a-426e-b639-f7fea8af57e8 req-c1bc1419-8737-4445-aaa9-73bcb2f08d2b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:28.127805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-37e7f235-9d8a-426e-b639-f7fea8af57e8 req-c1bc1419-8737-4445-aaa9-73bcb2f08d2b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:28.137223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-37e7f235-9d8a-426e-b639-f7fea8af57e8 req-c1bc1419-8737-4445-aaa9-73bcb2f08d2b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:28.180640 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-37e7f235-9d8a-426e-b639-f7fea8af57e8 req-c1bc1419-8737-4445-aaa9-73bcb2f08d2b service nova] Creating event network-changed:77bbdc0c-6ead-4e74-b3c1-521340163ee2 for instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 on n-h2-820368-35 Aug 27 05:04:28.190277 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-37e7f235-9d8a-426e-b639-f7fea8af57e8 req-c1bc1419-8737-4445-aaa9-73bcb2f08d2b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116910 Aug 27 05:04:28.191066 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1200/2458] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:28.198047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-055e8cf4-2c46-4cba-92c1-8b32d9d8f087 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:28.198955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-055e8cf4-2c46-4cba-92c1-8b32d9d8f087 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:28.213781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-055e8cf4-2c46-4cba-92c1-8b32d9d8f087 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:28.214387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-055e8cf4-2c46-4cba-92c1-8b32d9d8f087 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:28.214838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-055e8cf4-2c46-4cba-92c1-8b32d9d8f087 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:28.215650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-055e8cf4-2c46-4cba-92c1-8b32d9d8f087 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:28.216085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-055e8cf4-2c46-4cba-92c1-8b32d9d8f087 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:28.216518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-055e8cf4-2c46-4cba-92c1-8b32d9d8f087 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:28.517754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-37fffb1e-5e18-4c01-9f04-5a2346772c26 tempest-AbsoluteLimitsTestJSON-437659856 tempest-AbsoluteLimitsTestJSON-437659856-project] Calling method '.version_select at 0x7fb5652d0af0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:28.536731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37fffb1e-5e18-4c01-9f04-5a2346772c26 tempest-AbsoluteLimitsTestJSON-437659856 tempest-AbsoluteLimitsTestJSON-437659856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:28.537494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37fffb1e-5e18-4c01-9f04-5a2346772c26 tempest-AbsoluteLimitsTestJSON-437659856 tempest-AbsoluteLimitsTestJSON-437659856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:28.538313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37fffb1e-5e18-4c01-9f04-5a2346772c26 tempest-AbsoluteLimitsTestJSON-437659856 tempest-AbsoluteLimitsTestJSON-437659856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:28.539319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37fffb1e-5e18-4c01-9f04-5a2346772c26 tempest-AbsoluteLimitsTestJSON-437659856 tempest-AbsoluteLimitsTestJSON-437659856-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:28.540630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37fffb1e-5e18-4c01-9f04-5a2346772c26 tempest-AbsoluteLimitsTestJSON-437659856 tempest-AbsoluteLimitsTestJSON-437659856-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:28.541889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37fffb1e-5e18-4c01-9f04-5a2346772c26 tempest-AbsoluteLimitsTestJSON-437659856 tempest-AbsoluteLimitsTestJSON-437659856-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:28.575399 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-37fffb1e-5e18-4c01-9f04-5a2346772c26 tempest-AbsoluteLimitsTestJSON-437659856 tempest-AbsoluteLimitsTestJSON-437659856-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.520466 Aug 27 05:04:28.576369 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1259/2459] 10.222.0.58 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:28 2022] GET /compute/v2.1/limits => generated 511 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:28.581603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:28.582527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:28.599281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:28.600123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:28.600812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:28.601894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:28.602582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:28.603683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:28.691207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-055e8cf4-2c46-4cba-92c1-8b32d9d8f087 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:28.708038 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-055e8cf4-2c46-4cba-92c1-8b32d9d8f087 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1313 microversion: 2.1 time: 0.515449 Aug 27 05:04:28.709233 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1201/2460] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:28 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:29.084449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:29.086285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:29.092888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:29.095693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:29.096146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:29.097038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:29.097521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:29.098018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:29.111601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:29.136432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:29.144018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:29.149160 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-31f29a44-b1ae-4ba2-ba39-70741cd8075c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2962 microversion: 2.42 time: 0.571526 Aug 27 05:04:29.163340 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1260/2461] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:28 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2962 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:29.171430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b87692a1-60eb-4c5f-a409-4c27c40ff02c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:29.172064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b87692a1-60eb-4c5f-a409-4c27c40ff02c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:29.196679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=12 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:29.199235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b87692a1-60eb-4c5f-a409-4c27c40ff02c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:29.199739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b87692a1-60eb-4c5f-a409-4c27c40ff02c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:29.200181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b87692a1-60eb-4c5f-a409-4c27c40ff02c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:29.200900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b87692a1-60eb-4c5f-a409-4c27c40ff02c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:29.201387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b87692a1-60eb-4c5f-a409-4c27c40ff02c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:29.201780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b87692a1-60eb-4c5f-a409-4c27c40ff02c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:30.074536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:30.097471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:30.098951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:30.113309 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e77d39fb-bb28-4958-bbfa-3e3edae81c3c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 1.034940 Aug 27 05:04:30.113930 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1202/2462] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:29 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:30.118602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e48c5457-3f19-46ef-a392-0493a6d83017 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:30.143405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b87692a1-60eb-4c5f-a409-4c27c40ff02c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:30.147892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e48c5457-3f19-46ef-a392-0493a6d83017 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:30.154937 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b87692a1-60eb-4c5f-a409-4c27c40ff02c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1308 microversion: 2.1 time: 0.999238 Aug 27 05:04:30.169168 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1261/2463] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:29 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1308 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:30.178595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e48c5457-3f19-46ef-a392-0493a6d83017 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:30.178595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e48c5457-3f19-46ef-a392-0493a6d83017 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:30.178595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e48c5457-3f19-46ef-a392-0493a6d83017 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:30.179016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:30.179140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e48c5457-3f19-46ef-a392-0493a6d83017 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:30.179285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e48c5457-3f19-46ef-a392-0493a6d83017 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:30.179467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:30.179723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e48c5457-3f19-46ef-a392-0493a6d83017 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:30.191901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:30.192417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:30.192864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:30.193596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:30.194090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:30.194528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:31.019067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e48c5457-3f19-46ef-a392-0493a6d83017 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:31.026959 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e48c5457-3f19-46ef-a392-0493a6d83017 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1462 microversion: 2.1 time: 0.912009 Aug 27 05:04:31.039755 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1203/2464] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:30 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1462 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:31.082666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:31.115228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:31.124861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:31.128509 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e2bab464-f14d-438a-98ac-6864a7e000a9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2962 microversion: 2.42 time: 0.954327 Aug 27 05:04:31.129141 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1262/2465] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:30 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2962 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:31.156260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:31.157053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:31.171127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:31.172797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:31.175512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:31.176347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:31.180534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:31.180534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:31.576630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1503cf12-bcc3-4f9b-841b-e7fa1bf27dcc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:31.577894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1503cf12-bcc3-4f9b-841b-e7fa1bf27dcc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:31.585810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503cf12-bcc3-4f9b-841b-e7fa1bf27dcc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:31.592190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503cf12-bcc3-4f9b-841b-e7fa1bf27dcc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:31.592810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503cf12-bcc3-4f9b-841b-e7fa1bf27dcc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:31.593894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503cf12-bcc3-4f9b-841b-e7fa1bf27dcc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:31.595270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503cf12-bcc3-4f9b-841b-e7fa1bf27dcc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:31.597899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503cf12-bcc3-4f9b-841b-e7fa1bf27dcc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:32.344043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:32.363320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:32.364874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:32.368570 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8c5a8861-42d6-4d59-8677-a6d985aef8bc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 1.228237 Aug 27 05:04:32.386167 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1263/2466] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:31 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:32.405664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-502ab509-9268-43fc-b495-e8513b2597a7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:32.406650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-502ab509-9268-43fc-b495-e8513b2597a7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:32.425934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-502ab509-9268-43fc-b495-e8513b2597a7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:32.425934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-502ab509-9268-43fc-b495-e8513b2597a7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:32.430199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-502ab509-9268-43fc-b495-e8513b2597a7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:32.431317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-502ab509-9268-43fc-b495-e8513b2597a7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:32.435031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-502ab509-9268-43fc-b495-e8513b2597a7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:32.436208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-502ab509-9268-43fc-b495-e8513b2597a7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:32.817452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-502ab509-9268-43fc-b495-e8513b2597a7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:32.834314 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-502ab509-9268-43fc-b495-e8513b2597a7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1308 microversion: 2.1 time: 0.445394 Aug 27 05:04:32.847941 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1264/2467] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:32 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:32.863523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f7312b7d-7010-437a-a1ab-6f87131192c6 req-3b26e328-5bd0-441e-9e73-106dcf268ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-unplugged", "status": "completed", "tag": "9ee1e1d7-0d6d-4cbb-b872-87f8a3941c0d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:32.891698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f7312b7d-7010-437a-a1ab-6f87131192c6 req-3b26e328-5bd0-441e-9e73-106dcf268ea5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:32.895059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f7312b7d-7010-437a-a1ab-6f87131192c6 req-3b26e328-5bd0-441e-9e73-106dcf268ea5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:32.895715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f7312b7d-7010-437a-a1ab-6f87131192c6 req-3b26e328-5bd0-441e-9e73-106dcf268ea5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:32.924277 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f7312b7d-7010-437a-a1ab-6f87131192c6 req-3b26e328-5bd0-441e-9e73-106dcf268ea5 service nova] Creating event network-vif-unplugged:9ee1e1d7-0d6d-4cbb-b872-87f8a3941c0d for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:04:32.937510 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f7312b7d-7010-437a-a1ab-6f87131192c6 req-3b26e328-5bd0-441e-9e73-106dcf268ea5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084169 Aug 27 05:04:32.940383 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1265/2468] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:32.952877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:32.954906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:32.972639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:32.976293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:32.976930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:32.979116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:32.980883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:32.981438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:33.158838 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1503cf12-bcc3-4f9b-841b-e7fa1bf27dcc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1615 microversion: 2.1 time: 2.094812 Aug 27 05:04:33.160234 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1204/2469] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:31 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1615 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:33.201318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:33.202439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:33.219544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:33.223387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:33.225671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:33.228974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:33.231006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:33.232908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:33.416897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:33.438819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:33.442526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:33.448565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-929b8b08-e2fe-41a7-b628-62e2c03a44da tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2941 microversion: 2.42 time: 0.499539 Aug 27 05:04:33.449923 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1266/2470] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:32 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2941 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:33.465135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:33.466410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:33.475983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:33.479298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:33.481830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:33.483714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:33.485423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:33.487171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:33.978016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:33.993623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b1577287646849e8aab81a29e1b1549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b38b3b27dd48a3934afc399c2ac11d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:33.993623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] [instance: f131d54a-c71c-4d45-84f2-28576acda582] flavor_id is None. Assuming migration. {{(pid=128547) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 05:04:33.994033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128547) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:04:33.996114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:33.999644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:34.003377 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-65fe0492-1ee3-4d5c-a89c-802f9386c229 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.550143 Aug 27 05:04:34.019485 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1267/2471] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:33 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:34.030071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1905abea-d795-4e73-9d66-bef421570ef5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:34.030887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1905abea-d795-4e73-9d66-bef421570ef5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:34.045991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1905abea-d795-4e73-9d66-bef421570ef5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:34.050184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1905abea-d795-4e73-9d66-bef421570ef5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:34.050965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1905abea-d795-4e73-9d66-bef421570ef5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:34.054883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1905abea-d795-4e73-9d66-bef421570ef5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:34.055571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1905abea-d795-4e73-9d66-bef421570ef5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:34.056172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1905abea-d795-4e73-9d66-bef421570ef5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:34.470036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1905abea-d795-4e73-9d66-bef421570ef5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:34.494038 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1905abea-d795-4e73-9d66-bef421570ef5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1308 microversion: 2.1 time: 0.467687 Aug 27 05:04:34.507154 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1268/2472] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:34 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:34.515552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:34.516558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:34.533619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:34.535335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:34.535819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:34.538968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:34.541826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:34.542295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:34.653607 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-104b2889-6010-48d6-b9d1-c14ed074b6ef tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582/action" status: 202 len: 0 microversion: 2.1 time: 1.471632 Aug 27 05:04:34.655430 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1205/2473] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:04:33 2022] POST /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582/action => generated 0 bytes in 1474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:04:34.664287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e8fcd57-acc7-4375-a7bf-086805253823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:34.665422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3e8fcd57-acc7-4375-a7bf-086805253823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:34.692690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e8fcd57-acc7-4375-a7bf-086805253823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:34.692690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e8fcd57-acc7-4375-a7bf-086805253823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:34.692690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e8fcd57-acc7-4375-a7bf-086805253823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:34.692690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e8fcd57-acc7-4375-a7bf-086805253823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:34.692690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e8fcd57-acc7-4375-a7bf-086805253823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:34.692690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e8fcd57-acc7-4375-a7bf-086805253823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:35.132413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3e8fcd57-acc7-4375-a7bf-086805253823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:35.141585 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e8fcd57-acc7-4375-a7bf-086805253823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1471 microversion: 2.1 time: 0.481804 Aug 27 05:04:35.148496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:35.156838 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1206/2474] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:34 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1471 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:35.160240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:35.164698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-eb65b655-4225-41c2-bdde-38c6b4d467cc req-0fd3890b-cec5-45a2-9dcf-fddec2ae525b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-unplugged", "status": "completed", "tag": "a3e1f4af-7721-488e-9bc6-44bc8d5333b2"}, {"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-unplugged", "status": "completed", "tag": "8ee889f7-e538-4a59-8fc2-12d001a2065d"}, {"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-unplugged", "status": "completed", "tag": "67b4bbaf-e037-4c0b-af94-cb28ae1b24f7"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:35.165895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:35.167396 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-effee3ea-09ef-4b3d-a970-773ef03d1f2a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2920 microversion: 2.42 time: 0.667960 Aug 27 05:04:35.179052 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1269/2475] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:34 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2920 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:35.184951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:35.185877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:35.203723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:35.204898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:35.207054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:35.207993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:35.210189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:35.210835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:35.215333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-eb65b655-4225-41c2-bdde-38c6b4d467cc req-0fd3890b-cec5-45a2-9dcf-fddec2ae525b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:35.215823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-eb65b655-4225-41c2-bdde-38c6b4d467cc req-0fd3890b-cec5-45a2-9dcf-fddec2ae525b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:35.216261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-eb65b655-4225-41c2-bdde-38c6b4d467cc req-0fd3890b-cec5-45a2-9dcf-fddec2ae525b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:35.254780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:35.262488 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-eb65b655-4225-41c2-bdde-38c6b4d467cc req-0fd3890b-cec5-45a2-9dcf-fddec2ae525b service nova] Creating event network-vif-unplugged:a3e1f4af-7721-488e-9bc6-44bc8d5333b2 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:04:35.263982 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-eb65b655-4225-41c2-bdde-38c6b4d467cc req-0fd3890b-cec5-45a2-9dcf-fddec2ae525b service nova] Creating event network-vif-unplugged:8ee889f7-e538-4a59-8fc2-12d001a2065d for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:04:35.266465 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-eb65b655-4225-41c2-bdde-38c6b4d467cc req-0fd3890b-cec5-45a2-9dcf-fddec2ae525b service nova] Creating event network-vif-unplugged:67b4bbaf-e037-4c0b-af94-cb28ae1b24f7 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:04:35.287365 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-eb65b655-4225-41c2-bdde-38c6b4d467cc req-0fd3890b-cec5-45a2-9dcf-fddec2ae525b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.129190 Aug 27 05:04:35.290835 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1207/2476] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:35.519668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3314eac6-f189-4aaa-8a84-7f485cede4a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:35.520375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3314eac6-f189-4aaa-8a84-7f485cede4a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:35.536768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3314eac6-f189-4aaa-8a84-7f485cede4a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:35.537260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3314eac6-f189-4aaa-8a84-7f485cede4a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:35.537750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3314eac6-f189-4aaa-8a84-7f485cede4a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:35.538977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3314eac6-f189-4aaa-8a84-7f485cede4a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:35.539485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3314eac6-f189-4aaa-8a84-7f485cede4a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:35.539909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3314eac6-f189-4aaa-8a84-7f485cede4a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:36.081743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:36.100315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:36.103789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:36.106224 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-615e7764-6c4b-4238-b730-af0440cfc3c4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.925869 Aug 27 05:04:36.106810 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1270/2477] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:35 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:36.117163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3314eac6-f189-4aaa-8a84-7f485cede4a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:36.129186 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3314eac6-f189-4aaa-8a84-7f485cede4a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1308 microversion: 2.1 time: 0.614610 Aug 27 05:04:36.133993 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1208/2478] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:35 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1308 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:36.181074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-85be6af9-bd23-4a94-b586-31e3f7f89020 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:36.182091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-85be6af9-bd23-4a94-b586-31e3f7f89020 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:36.193693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85be6af9-bd23-4a94-b586-31e3f7f89020 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:36.197841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85be6af9-bd23-4a94-b586-31e3f7f89020 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:36.198850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85be6af9-bd23-4a94-b586-31e3f7f89020 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:36.202415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85be6af9-bd23-4a94-b586-31e3f7f89020 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:36.203319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85be6af9-bd23-4a94-b586-31e3f7f89020 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:36.213660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:36.214567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:36.220767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85be6af9-bd23-4a94-b586-31e3f7f89020 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:36.232248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:36.233626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:36.238189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:36.243618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:36.244942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:36.247928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:36.793746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-85be6af9-bd23-4a94-b586-31e3f7f89020 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:36.815228 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-85be6af9-bd23-4a94-b586-31e3f7f89020 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1471 microversion: 2.1 time: 0.639606 Aug 27 05:04:36.815833 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1271/2479] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:36 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1471 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:36.858984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:36.883746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:36.890993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:36.896489 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-00916292-5cd2-4caa-b86e-3e953f18f3c9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2920 microversion: 2.42 time: 0.687528 Aug 27 05:04:36.900875 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1209/2480] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:36 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2920 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:37.130857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:37.131535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:37.139928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:37.140707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:37.141306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:37.146902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:37.149954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:37.150605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:37.154251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2e717c97-c175-42f5-8301-ddc0b10160c0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:37.154878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2e717c97-c175-42f5-8301-ddc0b10160c0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:37.162308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e717c97-c175-42f5-8301-ddc0b10160c0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:37.171330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e717c97-c175-42f5-8301-ddc0b10160c0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:37.171932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e717c97-c175-42f5-8301-ddc0b10160c0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:37.172705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e717c97-c175-42f5-8301-ddc0b10160c0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:37.173188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e717c97-c175-42f5-8301-ddc0b10160c0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:37.173624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e717c97-c175-42f5-8301-ddc0b10160c0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:37.178353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:38.191652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:38.207755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:38.213142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:38.217501 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-37c1a0b5-06f0-4a4c-931a-55b44eec3110 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 1.091486 Aug 27 05:04:38.242292 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1272/2481] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:37 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:38.251887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6b110408-1e89-4a71-959e-20d854f3a010 req-cbec0dbe-9119-4eab-b609-b7af206f5f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-unplugged", "status": "completed", "tag": "90a04fac-d169-4ae0-8392-e8d76b298cce"}, {"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-unplugged", "status": "completed", "tag": "923d4ac2-c734-4a1c-a214-b065712f9202"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:38.285929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6b110408-1e89-4a71-959e-20d854f3a010 req-cbec0dbe-9119-4eab-b609-b7af206f5f96 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:38.286711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6b110408-1e89-4a71-959e-20d854f3a010 req-cbec0dbe-9119-4eab-b609-b7af206f5f96 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:38.293323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6b110408-1e89-4a71-959e-20d854f3a010 req-cbec0dbe-9119-4eab-b609-b7af206f5f96 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:38.320764 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6b110408-1e89-4a71-959e-20d854f3a010 req-cbec0dbe-9119-4eab-b609-b7af206f5f96 service nova] Creating event network-vif-unplugged:90a04fac-d169-4ae0-8392-e8d76b298cce for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:04:38.329030 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6b110408-1e89-4a71-959e-20d854f3a010 req-cbec0dbe-9119-4eab-b609-b7af206f5f96 service nova] Creating event network-vif-unplugged:923d4ac2-c734-4a1c-a214-b065712f9202 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:04:38.345408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2e717c97-c175-42f5-8301-ddc0b10160c0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:38.348316 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6b110408-1e89-4a71-959e-20d854f3a010 req-cbec0dbe-9119-4eab-b609-b7af206f5f96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.108540 Aug 27 05:04:38.352399 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1273/2482] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:38.360078 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2e717c97-c175-42f5-8301-ddc0b10160c0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1308 microversion: 2.1 time: 1.209588 Aug 27 05:04:38.375125 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1210/2483] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:37 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1308 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:38.375125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:38.375125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:38.380223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ea15e5ef-697f-4f55-8904-a5a8dd122774 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:38.381914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ea15e5ef-697f-4f55-8904-a5a8dd122774 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:38.389039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:38.389620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:38.391667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:38.393667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea15e5ef-697f-4f55-8904-a5a8dd122774 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:38.394364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea15e5ef-697f-4f55-8904-a5a8dd122774 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:38.394978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea15e5ef-697f-4f55-8904-a5a8dd122774 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:38.395903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea15e5ef-697f-4f55-8904-a5a8dd122774 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:38.396760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea15e5ef-697f-4f55-8904-a5a8dd122774 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:38.397949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea15e5ef-697f-4f55-8904-a5a8dd122774 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:38.399304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:38.399926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:38.401101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:38.535185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=52 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:38.561871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:39.199464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ea15e5ef-697f-4f55-8904-a5a8dd122774 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:39.213190 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ea15e5ef-697f-4f55-8904-a5a8dd122774 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1471 microversion: 2.1 time: 0.858454 Aug 27 05:04:39.214021 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1274/2484] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:38 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1471 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:39.221308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-58ac7e34-32c0-4efb-99da-2e0a2fe529c5 req-d8db8f7e-3e1a-4873-9994-90dd2e886cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-deleted", "tag": "67b4bbaf-e037-4c0b-af94-cb28ae1b24f7"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:39.246070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:39.250663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-58ac7e34-32c0-4efb-99da-2e0a2fe529c5 req-d8db8f7e-3e1a-4873-9994-90dd2e886cfe service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:39.251320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-58ac7e34-32c0-4efb-99da-2e0a2fe529c5 req-d8db8f7e-3e1a-4873-9994-90dd2e886cfe service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:39.251759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-58ac7e34-32c0-4efb-99da-2e0a2fe529c5 req-d8db8f7e-3e1a-4873-9994-90dd2e886cfe service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:39.260298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:39.261698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:39.263677 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-79468f2a-7cc1-42cc-a1bf-4499d4eac7d8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2873 microversion: 2.42 time: 0.898193 Aug 27 05:04:39.265423 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1211/2485] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:38 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2873 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:39.278424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:39.279498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:39.281899 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-58ac7e34-32c0-4efb-99da-2e0a2fe529c5 req-d8db8f7e-3e1a-4873-9994-90dd2e886cfe service nova] Creating event network-vif-deleted:67b4bbaf-e037-4c0b-af94-cb28ae1b24f7 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:04:39.294201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:39.294993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:39.295683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:39.296623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:39.297399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:39.298037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:39.298996 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-58ac7e34-32c0-4efb-99da-2e0a2fe529c5 req-d8db8f7e-3e1a-4873-9994-90dd2e886cfe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081376 Aug 27 05:04:39.300022 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1275/2486] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:39.389149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1611bf11-3ee0-463f-97a7-e34a102c1a02 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:39.389886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1611bf11-3ee0-463f-97a7-e34a102c1a02 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:39.404986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1611bf11-3ee0-463f-97a7-e34a102c1a02 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:39.405782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1611bf11-3ee0-463f-97a7-e34a102c1a02 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:39.406400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1611bf11-3ee0-463f-97a7-e34a102c1a02 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:39.407365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1611bf11-3ee0-463f-97a7-e34a102c1a02 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:39.408366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1611bf11-3ee0-463f-97a7-e34a102c1a02 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:39.408959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1611bf11-3ee0-463f-97a7-e34a102c1a02 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:39.902491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:39.913628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:39.924745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:39.929478 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6f4ca09b-f756-4df8-8697-b65d7cda0696 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.662830 Aug 27 05:04:39.935548 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1212/2487] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:39 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:40.234916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a3ba0be9-c173-45f0-851c-f58b3d9929a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:40.235873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a3ba0be9-c173-45f0-851c-f58b3d9929a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:40.247923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ba0be9-c173-45f0-851c-f58b3d9929a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:40.248447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ba0be9-c173-45f0-851c-f58b3d9929a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:40.248889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ba0be9-c173-45f0-851c-f58b3d9929a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:40.249824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ba0be9-c173-45f0-851c-f58b3d9929a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:40.250588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ba0be9-c173-45f0-851c-f58b3d9929a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:40.251020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ba0be9-c173-45f0-851c-f58b3d9929a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:41.192888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1611bf11-3ee0-463f-97a7-e34a102c1a02 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:41.204385 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1611bf11-3ee0-463f-97a7-e34a102c1a02 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1308 microversion: 2.1 time: 1.819259 Aug 27 05:04:41.208012 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1276/2488] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:39 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1308 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:41.215991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:41.223074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:41.235829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:41.238188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:41.238636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:41.239777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:41.240244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:41.240664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:41.872029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:41.884082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:41.901315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:41.913805 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-33e45cc5-f18a-4d00-a74f-54e890da0d6b tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2712 microversion: 2.42 time: 0.704362 Aug 27 05:04:41.914682 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1277/2489] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:41 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2712 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:41.919795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c573d25d-ced4-4f46-a849-19476c9b4dd8 req-327b1283-310e-49c1-a5a7-cf3704e09831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e359f17-fa25-41b2-a570-f33bc74f53c4", "name": "network-vif-plugged", "status": "completed", "tag": "77bbdc0c-6ead-4e74-b3c1-521340163ee2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:41.939276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a3ba0be9-c173-45f0-851c-f58b3d9929a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:41.949127 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a3ba0be9-c173-45f0-851c-f58b3d9929a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1471 microversion: 2.1 time: 1.718664 Aug 27 05:04:41.966545 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1213/2490] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:40 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1471 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:41.988871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:41.992309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:41.992530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c573d25d-ced4-4f46-a849-19476c9b4dd8 req-327b1283-310e-49c1-a5a7-cf3704e09831 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:41.997017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c573d25d-ced4-4f46-a849-19476c9b4dd8 req-327b1283-310e-49c1-a5a7-cf3704e09831 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:41.997571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c573d25d-ced4-4f46-a849-19476c9b4dd8 req-327b1283-310e-49c1-a5a7-cf3704e09831 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.010345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.014638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.015286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.020700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.025937 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c573d25d-ced4-4f46-a849-19476c9b4dd8 req-327b1283-310e-49c1-a5a7-cf3704e09831 service nova] Creating event network-vif-plugged:77bbdc0c-6ead-4e74-b3c1-521340163ee2 for instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 on n-h2-820368-35 Aug 27 05:04:42.026303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.027936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.031873 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c573d25d-ced4-4f46-a849-19476c9b4dd8 req-327b1283-310e-49c1-a5a7-cf3704e09831 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115922 Aug 27 05:04:42.032883 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1278/2491] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:42.226294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88bb2fcc-313f-46a8-a679-b4d509a6623a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:42.227015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-88bb2fcc-313f-46a8-a679-b4d509a6623a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:42.245293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bb2fcc-313f-46a8-a679-b4d509a6623a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.245798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bb2fcc-313f-46a8-a679-b4d509a6623a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.246249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bb2fcc-313f-46a8-a679-b4d509a6623a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.247284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bb2fcc-313f-46a8-a679-b4d509a6623a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.247749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bb2fcc-313f-46a8-a679-b4d509a6623a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.248183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bb2fcc-313f-46a8-a679-b4d509a6623a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.457929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:42.497369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:42.498812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:42.514437 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aa99a63f-898d-4771-aaf6-03b67c0031b4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.546293 Aug 27 05:04:42.529733 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1214/2492] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:41 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:42.614036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-88bb2fcc-313f-46a8-a679-b4d509a6623a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:42.628557 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88bb2fcc-313f-46a8-a679-b4d509a6623a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1308 microversion: 2.1 time: 0.407511 Aug 27 05:04:42.633309 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1279/2493] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:42 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1308 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:42.906618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c315bb48-d733-427e-bb44-64eabd1a9604 req-d393f3e0-72b5-4fa9-a057-b5a7fc039d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-deleted", "tag": "8ee889f7-e538-4a59-8fc2-12d001a2065d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:42.929175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c315bb48-d733-427e-bb44-64eabd1a9604 req-d393f3e0-72b5-4fa9-a057-b5a7fc039d86 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.929670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c315bb48-d733-427e-bb44-64eabd1a9604 req-d393f3e0-72b5-4fa9-a057-b5a7fc039d86 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.930106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c315bb48-d733-427e-bb44-64eabd1a9604 req-d393f3e0-72b5-4fa9-a057-b5a7fc039d86 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.945691 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c315bb48-d733-427e-bb44-64eabd1a9604 req-d393f3e0-72b5-4fa9-a057-b5a7fc039d86 service nova] Creating event network-vif-deleted:8ee889f7-e538-4a59-8fc2-12d001a2065d for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:04:42.954296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:42.955411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:42.966931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.970423 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c315bb48-d733-427e-bb44-64eabd1a9604 req-d393f3e0-72b5-4fa9-a057-b5a7fc039d86 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075286 Aug 27 05:04:42.971674 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1215/2494] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:42.973549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.979559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57cc05a6-7bd0-4547-b11a-f86e7457f458 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:42.980546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-57cc05a6-7bd0-4547-b11a-f86e7457f458 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:42.981504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.983521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.984019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.984472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.988494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57cc05a6-7bd0-4547-b11a-f86e7457f458 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.991628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57cc05a6-7bd0-4547-b11a-f86e7457f458 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.992582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57cc05a6-7bd0-4547-b11a-f86e7457f458 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.993483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57cc05a6-7bd0-4547-b11a-f86e7457f458 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.994114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57cc05a6-7bd0-4547-b11a-f86e7457f458 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.994861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57cc05a6-7bd0-4547-b11a-f86e7457f458 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:43.839794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:43.852838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:43.862999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:43.866604 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f2d1dcff-6bca-4a5d-92e1-930e04b95c48 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2712 microversion: 2.42 time: 0.928724 Aug 27 05:04:43.875414 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1280/2495] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:42 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2712 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:43.889531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-03c07a70-ee69-457a-b73a-4c9eebee3f29 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Action: 'create', calling method: .version_select at 0x7fb5697470d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-81664297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVN1oLq6F8YqjtysGXB8ql1quOLIQ6Bcjd6WZqAyPHunSvHID0uXu5oYLHri1iXVPxLBjdImHp+gG2JRbTv1Zb5yRUbRO/vYpbBOLNd7oD4yr2reStOoP4ypuAyTahJlg=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:43.953099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-57cc05a6-7bd0-4547-b11a-f86e7457f458 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:43.966951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-03c07a70-ee69-457a-b73a-4c9eebee3f29 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for project 8855a07236c54efa89fcec7f944afd94. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:43.979613 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-57cc05a6-7bd0-4547-b11a-f86e7457f458 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1471 microversion: 2.1 time: 1.006459 Aug 27 05:04:43.985906 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1216/2496] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:42 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1471 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:44.000488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-03c07a70-ee69-457a-b73a-4c9eebee3f29 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for user bf8bd46b91cf4774af109507c7c4422a and project 8855a07236c54efa89fcec7f944afd94. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:44.005360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:44.008863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:44.033921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:44.035518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:44.037945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:44.039001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:44.040589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:44.045296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:44.094227 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-03c07a70-ee69-457a-b73a-4c9eebee3f29 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.215532 Aug 27 05:04:44.101307 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1281/2497] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:04:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:44.111579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3edff24b-1e85-4965-8d5a-fef1ae470ab1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:44.112233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3edff24b-1e85-4965-8d5a-fef1ae470ab1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:44.127180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3edff24b-1e85-4965-8d5a-fef1ae470ab1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:44.127675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3edff24b-1e85-4965-8d5a-fef1ae470ab1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:44.131152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3edff24b-1e85-4965-8d5a-fef1ae470ab1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:44.135433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3edff24b-1e85-4965-8d5a-fef1ae470ab1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:44.136112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3edff24b-1e85-4965-8d5a-fef1ae470ab1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:44.137975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3edff24b-1e85-4965-8d5a-fef1ae470ab1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:44.560942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3edff24b-1e85-4965-8d5a-fef1ae470ab1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:44.572617 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3edff24b-1e85-4965-8d5a-fef1ae470ab1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1308 microversion: 2.1 time: 0.472050 Aug 27 05:04:44.592482 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1282/2498] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:44 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1308 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:44.603939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:44.620980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:44.626792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:44.631229 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5acdeebe-e99a-4d66-9095-6f09d9cc4a12 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.639984 Aug 27 05:04:44.631854 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1217/2499] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:43 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:44.779533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eb784258-3383-4142-8a25-14c729778dcc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Action: 'create', calling method: .version_select at 0x7fb5696d8ee0>, body: {"keypair": {"name": "tempest-keypair-1473542625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaB/E7lXxmFizLBT9fur8pG8xT6nyK29Q36M34zJm0Cm2LHmIwNiwee2lg170JZDoaJ1hpPgT5jhQaT3e0nBcb6MhugAv7O7RMFhd/PGQZjij2gWTtForbqUtYsBuT3oQ=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:44.791404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:44.836049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-eb784258-3383-4142-8a25-14c729778dcc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Getting quotas for project 9ee9d20df2704adba4c1b551045bcf11. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:44.848363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-eb784258-3383-4142-8a25-14c729778dcc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Getting quotas for user 6ecba35400844155ad36602d50d11252 and project 9ee9d20df2704adba4c1b551045bcf11. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:44.902368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:44.903423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:44.919495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:44.920334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:44.921007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:44.922047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:44.923443 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eb784258-3383-4142-8a25-14c729778dcc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.329277 Aug 27 05:04:44.924138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:44.924408 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1283/2500] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:04:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:44.930397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:45.005897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-87185a7f-9df6-4c7b-8d11-d32973a51443 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:45.007606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-87185a7f-9df6-4c7b-8d11-d32973a51443 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:45.021304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87185a7f-9df6-4c7b-8d11-d32973a51443 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:45.022627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87185a7f-9df6-4c7b-8d11-d32973a51443 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:45.027779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87185a7f-9df6-4c7b-8d11-d32973a51443 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:45.029541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87185a7f-9df6-4c7b-8d11-d32973a51443 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:45.030797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87185a7f-9df6-4c7b-8d11-d32973a51443 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:45.032662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87185a7f-9df6-4c7b-8d11-d32973a51443 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:45.648357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:45.667263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:45.675774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:45.677081 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fbb39b25-3a0a-4cd8-89d3-853872e77699 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2508 microversion: 2.42 time: 0.779003 Aug 27 05:04:45.677638 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1218/2501] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:44 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2508 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:45.691064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e1ee46a2-3561-4428-899c-07f586acad52 req-53153f45-d276-4cdc-9ed4-06b45593217d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-deleted", "tag": "90a04fac-d169-4ae0-8392-e8d76b298cce"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:45.732095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e1ee46a2-3561-4428-899c-07f586acad52 req-53153f45-d276-4cdc-9ed4-06b45593217d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:45.732599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e1ee46a2-3561-4428-899c-07f586acad52 req-53153f45-d276-4cdc-9ed4-06b45593217d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:45.733036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e1ee46a2-3561-4428-899c-07f586acad52 req-53153f45-d276-4cdc-9ed4-06b45593217d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:45.793586 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e1ee46a2-3561-4428-899c-07f586acad52 req-53153f45-d276-4cdc-9ed4-06b45593217d service nova] Creating event network-vif-deleted:90a04fac-d169-4ae0-8392-e8d76b298cce for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:04:45.822893 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e1ee46a2-3561-4428-899c-07f586acad52 req-53153f45-d276-4cdc-9ed4-06b45593217d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135508 Aug 27 05:04:45.827356 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1219/2502] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:45.835969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eeaf0911-b88d-40af-b71f-0dab57e8ade9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:45.836673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eeaf0911-b88d-40af-b71f-0dab57e8ade9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:45.867805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeaf0911-b88d-40af-b71f-0dab57e8ade9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:45.870636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeaf0911-b88d-40af-b71f-0dab57e8ade9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:45.871293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeaf0911-b88d-40af-b71f-0dab57e8ade9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:45.873593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeaf0911-b88d-40af-b71f-0dab57e8ade9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:45.874075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeaf0911-b88d-40af-b71f-0dab57e8ade9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:45.874924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeaf0911-b88d-40af-b71f-0dab57e8ade9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:45.889975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-87185a7f-9df6-4c7b-8d11-d32973a51443 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:45.898803 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-87185a7f-9df6-4c7b-8d11-d32973a51443 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1476 microversion: 2.1 time: 0.896992 Aug 27 05:04:45.905994 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1284/2503] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:45 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1476 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:45.915768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:45.924702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:45.943217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:45.949099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:45.949549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:45.950301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:45.950759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:45.951216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:46.489517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:46.510263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:46.511973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:46.513341 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1451873c-f0c3-4af5-bdc9-29913bf87ce8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.606103 Aug 27 05:04:46.527759 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1285/2504] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:45 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:46.533683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eeaf0911-b88d-40af-b71f-0dab57e8ade9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:46.544999 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eeaf0911-b88d-40af-b71f-0dab57e8ade9 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1489 microversion: 2.1 time: 0.716084 Aug 27 05:04:46.545825 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1220/2505] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:45 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1489 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:46.579164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e875b769-287c-4a77-b7be-cf676b86cd23 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:46.587128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e875b769-287c-4a77-b7be-cf676b86cd23 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:46.587943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e875b769-287c-4a77-b7be-cf676b86cd23 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:46.588599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e875b769-287c-4a77-b7be-cf676b86cd23 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:46.703858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:46.705224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:46.709428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e875b769-287c-4a77-b7be-cf676b86cd23 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Going to try to stop instance {{(pid=128548) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:04:46.726231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:46.726922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:46.727751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:46.728646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:46.729284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:46.730018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:46.825472 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e875b769-287c-4a77-b7be-cf676b86cd23 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "POST /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4/action" status: 202 len: 0 microversion: 2.1 time: 0.261003 Aug 27 05:04:46.829038 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1286/2506] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:04:46 2022] POST /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:04:46.847472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb1818ad-c9c2-48c8-8203-79c06870ee85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:46.851709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cb1818ad-c9c2-48c8-8203-79c06870ee85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:46.876589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1818ad-c9c2-48c8-8203-79c06870ee85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:46.877320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1818ad-c9c2-48c8-8203-79c06870ee85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:46.877955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1818ad-c9c2-48c8-8203-79c06870ee85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:46.878933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1818ad-c9c2-48c8-8203-79c06870ee85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:46.879835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1818ad-c9c2-48c8-8203-79c06870ee85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:46.880694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1818ad-c9c2-48c8-8203-79c06870ee85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:47.541746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:47.569119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:47.571002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:47.576204 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d153a917-2226-48f1-856d-38526baeb514 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 2347 microversion: 2.42 time: 0.876286 Aug 27 05:04:47.577810 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1221/2507] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:46 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 2347 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:04:47.596674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ee0bbb41-4184-4417-9825-bdd217130eb9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:47.599489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ee0bbb41-4184-4417-9825-bdd217130eb9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:47.622763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee0bbb41-4184-4417-9825-bdd217130eb9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:47.623331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee0bbb41-4184-4417-9825-bdd217130eb9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:47.623749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee0bbb41-4184-4417-9825-bdd217130eb9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:47.624476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee0bbb41-4184-4417-9825-bdd217130eb9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:47.624941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee0bbb41-4184-4417-9825-bdd217130eb9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:47.625373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee0bbb41-4184-4417-9825-bdd217130eb9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:47.688920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb1818ad-c9c2-48c8-8203-79c06870ee85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:47.703704 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb1818ad-c9c2-48c8-8203-79c06870ee85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.866841 Aug 27 05:04:47.704333 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1287/2508] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:46 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:47.731112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:47.737797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:47.750192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:47.750759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:47.751310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:47.752832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:47.753314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:47.753845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:49.278980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ee0bbb41-4184-4417-9825-bdd217130eb9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:49.292253 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ee0bbb41-4184-4417-9825-bdd217130eb9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1476 microversion: 2.1 time: 1.707522 Aug 27 05:04:49.294457 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1222/2509] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:47 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1476 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:49.300886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-964d20ce-59a5-4a08-a699-bb90b0c01bd3 req-0792c45f-a168-43bd-8301-857bb2df88ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-deleted", "tag": "a3e1f4af-7721-488e-9bc6-44bc8d5333b2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:49.312742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:49.347615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-964d20ce-59a5-4a08-a699-bb90b0c01bd3 req-0792c45f-a168-43bd-8301-857bb2df88ee service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:49.348463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-964d20ce-59a5-4a08-a699-bb90b0c01bd3 req-0792c45f-a168-43bd-8301-857bb2df88ee service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:49.349063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-964d20ce-59a5-4a08-a699-bb90b0c01bd3 req-0792c45f-a168-43bd-8301-857bb2df88ee service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:49.403132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:49.404454 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-964d20ce-59a5-4a08-a699-bb90b0c01bd3 req-0792c45f-a168-43bd-8301-857bb2df88ee service nova] Creating event network-vif-deleted:a3e1f4af-7721-488e-9bc6-44bc8d5333b2 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:04:49.417088 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-964d20ce-59a5-4a08-a699-bb90b0c01bd3 req-0792c45f-a168-43bd-8301-857bb2df88ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121092 Aug 27 05:04:49.422373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:49.422578 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1223/2510] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:49.429086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:49.430324 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd2b06f5-d9bd-41cd-b33b-63af219acf1d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 1.706702 Aug 27 05:04:49.433038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:49.435520 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1288/2511] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:47 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:49.438142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:49.456704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad094de5-dd04-4fb9-b7af-e1cd5965dd18 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:49.460923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad094de5-dd04-4fb9-b7af-e1cd5965dd18 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:49.465970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:49.466617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:49.467134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:49.467886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:49.468344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:49.468773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:49.482698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad094de5-dd04-4fb9-b7af-e1cd5965dd18 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:49.485833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad094de5-dd04-4fb9-b7af-e1cd5965dd18 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:49.486580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad094de5-dd04-4fb9-b7af-e1cd5965dd18 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:49.488645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad094de5-dd04-4fb9-b7af-e1cd5965dd18 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:49.491581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad094de5-dd04-4fb9-b7af-e1cd5965dd18 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:49.492227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad094de5-dd04-4fb9-b7af-e1cd5965dd18 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:49.752530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:49.799272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:49.807603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:49.810146 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-90cda5ba-53d1-49ec-ab0f-a9a2d08dee84 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1987 microversion: 2.42 time: 0.386305 Aug 27 05:04:49.815645 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1224/2512] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:49 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1987 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:50.323689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-864a572a-2346-4291-a8d5-488ca6d50adf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:50.325614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-864a572a-2346-4291-a8d5-488ca6d50adf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:50.349524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-864a572a-2346-4291-a8d5-488ca6d50adf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:50.351846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-864a572a-2346-4291-a8d5-488ca6d50adf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:50.354082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-864a572a-2346-4291-a8d5-488ca6d50adf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:50.358217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-864a572a-2346-4291-a8d5-488ca6d50adf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:50.360763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-864a572a-2346-4291-a8d5-488ca6d50adf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:50.361468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-864a572a-2346-4291-a8d5-488ca6d50adf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:50.996896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad094de5-dd04-4fb9-b7af-e1cd5965dd18 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:51.006801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:51.012666 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad094de5-dd04-4fb9-b7af-e1cd5965dd18 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 1.573451 Aug 27 05:04:51.013340 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1289/2513] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:49 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:51.038437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:51.039337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:51.047499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:51.049108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:51.049777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:51.050827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:51.052247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:51.053045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:51.127806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-864a572a-2346-4291-a8d5-488ca6d50adf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:51.147538 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-864a572a-2346-4291-a8d5-488ca6d50adf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1476 microversion: 2.1 time: 0.825620 Aug 27 05:04:51.149947 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1225/2514] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:50 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1476 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:51.162718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:51.164314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:51.199662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:51.205304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:51.206836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:51.207703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:51.212666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:51.215422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:51.561676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:51.574656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:51.576339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:51.578202 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-34eef688-b326-4286-96b3-918223183aa6 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.427207 Aug 27 05:04:51.579153 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1226/2515] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:51 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:51.726009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-719486244", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "11b9ce7b-910c-4628-97fe-5e2c2147efa3"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:51.822941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] validate_networks() for [('11b9ce7b-910c-4628-97fe-5e2c2147efa3', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:04:52.038863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:52.061219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:52.064075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:52.065546 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c331603-0dad-4c0e-b647-3c64e1bc950d tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 1.031975 Aug 27 05:04:52.066638 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1290/2516] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:51 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:52.075073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-fa9d5165-cca2-449d-b11f-db406aeb94c3 req-a034eb34-37ee-42b5-bf8b-cff6cb8fdacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8", "name": "network-vif-deleted", "tag": "923d4ac2-c734-4a1c-a214-b065712f9202"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:52.092342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fa9d5165-cca2-449d-b11f-db406aeb94c3 req-a034eb34-37ee-42b5-bf8b-cff6cb8fdacd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:52.095638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fa9d5165-cca2-449d-b11f-db406aeb94c3 req-a034eb34-37ee-42b5-bf8b-cff6cb8fdacd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:52.097269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fa9d5165-cca2-449d-b11f-db406aeb94c3 req-a034eb34-37ee-42b5-bf8b-cff6cb8fdacd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:52.141246 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-fa9d5165-cca2-449d-b11f-db406aeb94c3 req-a034eb34-37ee-42b5-bf8b-cff6cb8fdacd service nova] Creating event network-vif-deleted:923d4ac2-c734-4a1c-a214-b065712f9202 for instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 on n-h1-820368-35 Aug 27 05:04:52.148441 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-fa9d5165-cca2-449d-b11f-db406aeb94c3 req-a034eb34-37ee-42b5-bf8b-cff6cb8fdacd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080104 Aug 27 05:04:52.149251 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1291/2517] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:52.163349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-271709080", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "b01a61ed-fa5a-48af-a66b-7cd197ac3684"}], "key_name": "tempest-TestNetworkBasicOps-81664297", "security_groups": [{"name": "tempest-secgroup-smoke-987741421"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:52.581207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] validate_networks() for [('b01a61ed-fa5a-48af-a66b-7cd197ac3684', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:04:53.104530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:04:53.105048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:04:53.105926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:04:53.106517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:04:53.107253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:04:53.120160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.120965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.121769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:53.123478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.124201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.124878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:53.147770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:53.155588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for user d3ae5460271c4f5291e6abb0e76cab17 and project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:53.170553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:04:53.179578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:04:53.267853 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-af29355f-da3c-4046-8826-24399110ea4a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.687199 Aug 27 05:04:53.268689 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1227/2518] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:04:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:04:53.277655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-908b3886-ad02-42c5-b1c4-026166edce6f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:53.278437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-908b3886-ad02-42c5-b1c4-026166edce6f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:53.290640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908b3886-ad02-42c5-b1c4-026166edce6f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.291873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908b3886-ad02-42c5-b1c4-026166edce6f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.292395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908b3886-ad02-42c5-b1c4-026166edce6f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:53.294216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908b3886-ad02-42c5-b1c4-026166edce6f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.294833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908b3886-ad02-42c5-b1c4-026166edce6f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.295374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-908b3886-ad02-42c5-b1c4-026166edce6f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:53.303128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:04:53.303593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:04:53.304194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:04:53.304597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:04:53.305029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:04:53.317905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.319457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.320091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:53.320987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.321622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.322768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:53.348346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for project 8855a07236c54efa89fcec7f944afd94. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:53.354727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for user bf8bd46b91cf4774af109507c7c4422a and project 8855a07236c54efa89fcec7f944afd94. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:53.371131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:04:53.375417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:04:53.468857 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5e3bcd9a-1b6d-435f-927d-ae95d7f617fe tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.312376 Aug 27 05:04:53.482458 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1292/2519] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:04:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:04:53.485727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-294cb278-ec34-41b5-99d3-8455caed174b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:53.492114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-294cb278-ec34-41b5-99d3-8455caed174b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:53.507675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-294cb278-ec34-41b5-99d3-8455caed174b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.508186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-294cb278-ec34-41b5-99d3-8455caed174b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.508638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-294cb278-ec34-41b5-99d3-8455caed174b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:53.509395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-294cb278-ec34-41b5-99d3-8455caed174b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.512716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-294cb278-ec34-41b5-99d3-8455caed174b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.513398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-294cb278-ec34-41b5-99d3-8455caed174b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:53.536695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-908b3886-ad02-42c5-b1c4-026166edce6f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:53.547974 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-908b3886-ad02-42c5-b1c4-026166edce6f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.277292 Aug 27 05:04:53.548759 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1228/2520] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:53 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:53.554437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:53.555060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:53.562930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.563863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.563863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:53.564599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.565059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.565563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:53.614893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:53.705813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:53.723726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:53.725772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:53.727111 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4df62872-04d4-471a-90fa-60cbadab181c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.177372 Aug 27 05:04:53.734689 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1229/2521] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:53 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:53.746675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-149533765", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "dee3dfc9-c658-4885-b0eb-49038aa8e64c"}], "security_groups": [{"name": "tempest-securitygroup--405532339"}], "key_name": "tempest-keypair-1473542625", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:53.890109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-294cb278-ec34-41b5-99d3-8455caed174b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:53.899406 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-294cb278-ec34-41b5-99d3-8455caed174b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1476 microversion: 2.1 time: 0.420695 Aug 27 05:04:53.900259 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1293/2522] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:53 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1476 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:53.915810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:53.916524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:53.932242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.932731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.933186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:53.933931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:53.936853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:53.937362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:54.025755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] validate_networks() for [('dee3dfc9-c658-4885-b0eb-49038aa8e64c', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:04:54.384202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:54.401043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:54.426428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:54.430705 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-04811c3a-fe64-40a0-be19-79951bbf4e15 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.529194 Aug 27 05:04:54.434759 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1294/2523] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:53 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:54.452950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c257069f-2e15-4428-b277-a7dcc6d47621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:54.453790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c257069f-2e15-4428-b277-a7dcc6d47621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:54.466438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c257069f-2e15-4428-b277-a7dcc6d47621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:54.466856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c257069f-2e15-4428-b277-a7dcc6d47621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:54.467392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c257069f-2e15-4428-b277-a7dcc6d47621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:54.473976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c257069f-2e15-4428-b277-a7dcc6d47621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:54.480167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c257069f-2e15-4428-b277-a7dcc6d47621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:54.480752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c257069f-2e15-4428-b277-a7dcc6d47621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:54.607976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c257069f-2e15-4428-b277-a7dcc6d47621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:54.626291 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c257069f-2e15-4428-b277-a7dcc6d47621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1210 microversion: 2.1 time: 0.190000 Aug 27 05:04:54.630898 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1295/2524] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:54 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1210 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:54.636435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3bbe098f-e557-4bb5-96af-b7f152bc7427 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:54.638251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3bbe098f-e557-4bb5-96af-b7f152bc7427 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:54.652196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bbe098f-e557-4bb5-96af-b7f152bc7427 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:54.653062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bbe098f-e557-4bb5-96af-b7f152bc7427 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:54.653735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bbe098f-e557-4bb5-96af-b7f152bc7427 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:54.654676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bbe098f-e557-4bb5-96af-b7f152bc7427 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:54.655375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bbe098f-e557-4bb5-96af-b7f152bc7427 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:54.664652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bbe098f-e557-4bb5-96af-b7f152bc7427 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:54.835176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3bbe098f-e557-4bb5-96af-b7f152bc7427 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:54.844910 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3bbe098f-e557-4bb5-96af-b7f152bc7427 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1250 microversion: 2.1 time: 0.212079 Aug 27 05:04:54.848112 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1296/2525] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:54 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1250 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:54.867282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-25e90693-99a6-4216-bc90-f1e088f38f2e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:54.867896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-25e90693-99a6-4216-bc90-f1e088f38f2e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:54.876336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25e90693-99a6-4216-bc90-f1e088f38f2e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:54.877855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25e90693-99a6-4216-bc90-f1e088f38f2e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:54.877855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25e90693-99a6-4216-bc90-f1e088f38f2e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:54.878400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25e90693-99a6-4216-bc90-f1e088f38f2e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:54.879202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25e90693-99a6-4216-bc90-f1e088f38f2e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:54.879969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25e90693-99a6-4216-bc90-f1e088f38f2e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:55.103727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-25e90693-99a6-4216-bc90-f1e088f38f2e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:55.116294 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-25e90693-99a6-4216-bc90-f1e088f38f2e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.253599 Aug 27 05:04:55.118568 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1297/2526] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:54 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:55.133633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:55.137241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:55.158708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:55.159249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:55.159698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:55.160421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:55.166909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:55.168194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:55.235411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Getting quotas for project 9ee9d20df2704adba4c1b551045bcf11. Resources: dict_keys(['metadata_items']) {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:55.256846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Getting quotas for user 6ecba35400844155ad36602d50d11252 and project 9ee9d20df2704adba4c1b551045bcf11. Resources: dict_keys(['metadata_items']) {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:55.308275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:04:55.309013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:04:55.309729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:04:55.310388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:04:55.311026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:04:55.320974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:55.324377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:55.325479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:55.327329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:55.328374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:55.329411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:55.329925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:55.340186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:55.341951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:55.344603 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b7a5fba8-01d5-43ed-ae81-b1c544efb9c4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.224780 Aug 27 05:04:55.358194 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1298/2527] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:55 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:55.363490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-162a3030-5107-4e69-8d82-a728413b5823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:55.364373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-162a3030-5107-4e69-8d82-a728413b5823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:55.371793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-162a3030-5107-4e69-8d82-a728413b5823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:55.372666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-162a3030-5107-4e69-8d82-a728413b5823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:55.373417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Getting quotas for project 9ee9d20df2704adba4c1b551045bcf11. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:55.374126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-162a3030-5107-4e69-8d82-a728413b5823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:55.375822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-162a3030-5107-4e69-8d82-a728413b5823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:55.376470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-162a3030-5107-4e69-8d82-a728413b5823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:55.377079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-162a3030-5107-4e69-8d82-a728413b5823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:55.390619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Getting quotas for user 6ecba35400844155ad36602d50d11252 and project 9ee9d20df2704adba4c1b551045bcf11. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:55.423975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:04:55.427873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:04:55.542702 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5a8290f8-db35-48f5-b1e1-c07706af7659 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.806610 Aug 27 05:04:55.543767 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1230/2528] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:04:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:04:55.549299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:55.563301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:55.597845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:55.598511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:55.599253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:55.600835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:55.601525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:55.602182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:55.622237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-162a3030-5107-4e69-8d82-a728413b5823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:55.632683 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-162a3030-5107-4e69-8d82-a728413b5823 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1476 microversion: 2.1 time: 0.273170 Aug 27 05:04:55.635004 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1299/2529] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:55 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1476 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:55.641606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b43d4a05-a4a4-4538-afab-14b29b15bad4 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:55.642504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b43d4a05-a4a4-4538-afab-14b29b15bad4 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:55.762314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b43d4a05-a4a4-4538-afab-14b29b15bad4 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:55.771015 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b43d4a05-a4a4-4538-afab-14b29b15bad4 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1277 microversion: 2.1 time: 0.134710 Aug 27 05:04:55.778043 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1300/2530] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:55 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:55.783065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c89179e3-4d8a-454c-84e8-bcfb39300c86 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:55.791246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c89179e3-4d8a-454c-84e8-bcfb39300c86 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:55.815301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c89179e3-4d8a-454c-84e8-bcfb39300c86 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:55.816071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c89179e3-4d8a-454c-84e8-bcfb39300c86 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:55.819704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c89179e3-4d8a-454c-84e8-bcfb39300c86 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:55.820846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c89179e3-4d8a-454c-84e8-bcfb39300c86 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:55.824260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c89179e3-4d8a-454c-84e8-bcfb39300c86 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:55.825128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c89179e3-4d8a-454c-84e8-bcfb39300c86 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.124526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c89179e3-4d8a-454c-84e8-bcfb39300c86 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.135570 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c89179e3-4d8a-454c-84e8-bcfb39300c86 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1272 microversion: 2.1 time: 0.356065 Aug 27 05:04:56.147678 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1301/2531] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:55 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1272 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:56.164064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d10e0b31-f79a-4d23-80be-7d1af6731430 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:56.165125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d10e0b31-f79a-4d23-80be-7d1af6731430 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:56.181436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d10e0b31-f79a-4d23-80be-7d1af6731430 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.184861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d10e0b31-f79a-4d23-80be-7d1af6731430 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.186005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d10e0b31-f79a-4d23-80be-7d1af6731430 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.189295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d10e0b31-f79a-4d23-80be-7d1af6731430 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.190103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d10e0b31-f79a-4d23-80be-7d1af6731430 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.190771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d10e0b31-f79a-4d23-80be-7d1af6731430 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.266437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.280459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.284182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.286465 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d86d530-7853-4b64-bb54-0463b24fff63 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.741411 Aug 27 05:04:56.302334 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1231/2532] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:55 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:56.307963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a3afd79-f2c8-4237-a508-f556c0f9c97b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:56.312171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a3afd79-f2c8-4237-a508-f556c0f9c97b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:56.326865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a3afd79-f2c8-4237-a508-f556c0f9c97b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.328766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a3afd79-f2c8-4237-a508-f556c0f9c97b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.329378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a3afd79-f2c8-4237-a508-f556c0f9c97b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.332153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a3afd79-f2c8-4237-a508-f556c0f9c97b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.333284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a3afd79-f2c8-4237-a508-f556c0f9c97b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.336629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a3afd79-f2c8-4237-a508-f556c0f9c97b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.349103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d10e0b31-f79a-4d23-80be-7d1af6731430 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.357707 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d10e0b31-f79a-4d23-80be-7d1af6731430 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1316 microversion: 2.1 time: 0.208550 Aug 27 05:04:56.358303 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1302/2533] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:56 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:56.385199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:56.385829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:56.399893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.400397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.400849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.401591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.402049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.406137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.536750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.547989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.549456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.550661 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a79bcd1c-068d-4b48-813e-5f24639e5f0f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.170180 Aug 27 05:04:56.551272 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1303/2534] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:56 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:04:56.642981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2a3afd79-f2c8-4237-a508-f556c0f9c97b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.654822 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a3afd79-f2c8-4237-a508-f556c0f9c97b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.350963 Aug 27 05:04:56.656041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fe659ded-c14d-4669-a302-81d3aaf6abf4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:56.656619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fe659ded-c14d-4669-a302-81d3aaf6abf4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:56.657057 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1232/2535] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:56 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:56.673659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe659ded-c14d-4669-a302-81d3aaf6abf4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.674262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe659ded-c14d-4669-a302-81d3aaf6abf4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.675046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe659ded-c14d-4669-a302-81d3aaf6abf4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.675810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe659ded-c14d-4669-a302-81d3aaf6abf4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.676268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe659ded-c14d-4669-a302-81d3aaf6abf4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.676750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe659ded-c14d-4669-a302-81d3aaf6abf4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.801554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e73d6298-7ec3-4dfc-93ba-6c8627dd904b tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:56.803945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e73d6298-7ec3-4dfc-93ba-6c8627dd904b tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:56.824200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e73d6298-7ec3-4dfc-93ba-6c8627dd904b tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.826091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e73d6298-7ec3-4dfc-93ba-6c8627dd904b tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.828096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e73d6298-7ec3-4dfc-93ba-6c8627dd904b tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.830323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e73d6298-7ec3-4dfc-93ba-6c8627dd904b tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.833259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e73d6298-7ec3-4dfc-93ba-6c8627dd904b tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.835813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e73d6298-7ec3-4dfc-93ba-6c8627dd904b tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.925590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fe659ded-c14d-4669-a302-81d3aaf6abf4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.937622 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fe659ded-c14d-4669-a302-81d3aaf6abf4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1476 microversion: 2.1 time: 0.285422 Aug 27 05:04:56.939784 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1304/2536] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:56 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1476 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:56.982906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e73d6298-7ec3-4dfc-93ba-6c8627dd904b tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.997435 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e73d6298-7ec3-4dfc-93ba-6c8627dd904b tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1281 microversion: 2.1 time: 0.200558 Aug 27 05:04:56.998328 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1233/2537] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:56 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1281 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:57.169830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f091466-981d-429b-8f21-d2ef00f3e708 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:57.170709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f091466-981d-429b-8f21-d2ef00f3e708 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:57.182100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f091466-981d-429b-8f21-d2ef00f3e708 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.182888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f091466-981d-429b-8f21-d2ef00f3e708 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.183399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f091466-981d-429b-8f21-d2ef00f3e708 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.184119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f091466-981d-429b-8f21-d2ef00f3e708 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.187707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f091466-981d-429b-8f21-d2ef00f3e708 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.188161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f091466-981d-429b-8f21-d2ef00f3e708 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.265978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f091466-981d-429b-8f21-d2ef00f3e708 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:57.275101 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f091466-981d-429b-8f21-d2ef00f3e708 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1272 microversion: 2.1 time: 0.109874 Aug 27 05:04:57.275931 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1305/2538] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:57 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:57.322330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:57.323737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:57.330239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.332738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.333382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.335375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.335696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.336132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.385198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cee63adf-b4ef-4c72-82de-4a211525bfd0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:57.386077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cee63adf-b4ef-4c72-82de-4a211525bfd0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:57.407994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cee63adf-b4ef-4c72-82de-4a211525bfd0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.421674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cee63adf-b4ef-4c72-82de-4a211525bfd0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.423369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cee63adf-b4ef-4c72-82de-4a211525bfd0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.424851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cee63adf-b4ef-4c72-82de-4a211525bfd0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.425714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cee63adf-b4ef-4c72-82de-4a211525bfd0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.427699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cee63adf-b4ef-4c72-82de-4a211525bfd0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.676749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cee63adf-b4ef-4c72-82de-4a211525bfd0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:57.685439 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cee63adf-b4ef-4c72-82de-4a211525bfd0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1304 microversion: 2.1 time: 0.305192 Aug 27 05:04:57.699885 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1306/2539] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:57 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1304 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:57.715509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:57.716390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:57.724235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.726762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.727682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.728643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.730550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.731597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.742440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:57.756539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:57.759842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:57.761729 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14fd0bd5-7fcd-4d5b-93aa-bceb98bf410c tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.449929 Aug 27 05:04:57.780007 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1234/2540] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:57 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:57.786070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4c700b69-b7f9-4236-bc68-d2f0e26fabf2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:57.789283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4c700b69-b7f9-4236-bc68-d2f0e26fabf2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:57.806599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c700b69-b7f9-4236-bc68-d2f0e26fabf2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.807459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c700b69-b7f9-4236-bc68-d2f0e26fabf2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.808631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c700b69-b7f9-4236-bc68-d2f0e26fabf2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.809622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c700b69-b7f9-4236-bc68-d2f0e26fabf2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.810296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c700b69-b7f9-4236-bc68-d2f0e26fabf2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.810418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:57.810995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c700b69-b7f9-4236-bc68-d2f0e26fabf2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.822575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:57.824185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:57.825687 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1121f433-89f1-4a06-b27b-335c65e74aa4 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.124572 Aug 27 05:04:57.826373 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1307/2541] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:57 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:57.962385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-57bd0a66-da6a-4c9d-be37-c0ab798b1314 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:57.963007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-57bd0a66-da6a-4c9d-be37-c0ab798b1314 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:57.975462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57bd0a66-da6a-4c9d-be37-c0ab798b1314 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.975462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57bd0a66-da6a-4c9d-be37-c0ab798b1314 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.976325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57bd0a66-da6a-4c9d-be37-c0ab798b1314 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.977048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57bd0a66-da6a-4c9d-be37-c0ab798b1314 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.977514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57bd0a66-da6a-4c9d-be37-c0ab798b1314 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.977943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57bd0a66-da6a-4c9d-be37-c0ab798b1314 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:58.014642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4c700b69-b7f9-4236-bc68-d2f0e26fabf2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:58.033287 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4c700b69-b7f9-4236-bc68-d2f0e26fabf2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.257332 Aug 27 05:04:58.034479 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1235/2542] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:57 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:58.040535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ff4c6915-f918-4438-9a32-7067af8d5f5f tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:58.041431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ff4c6915-f918-4438-9a32-7067af8d5f5f tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:58.052409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4c6915-f918-4438-9a32-7067af8d5f5f tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:58.053318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4c6915-f918-4438-9a32-7067af8d5f5f tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:58.053996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4c6915-f918-4438-9a32-7067af8d5f5f tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:58.055185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4c6915-f918-4438-9a32-7067af8d5f5f tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:58.055857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4c6915-f918-4438-9a32-7067af8d5f5f tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:58.059635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4c6915-f918-4438-9a32-7067af8d5f5f tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:58.244424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ff4c6915-f918-4438-9a32-7067af8d5f5f tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:58.264629 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ff4c6915-f918-4438-9a32-7067af8d5f5f tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1329 microversion: 2.1 time: 0.225844 Aug 27 05:04:58.265605 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1236/2543] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:58 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1329 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:58.300505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-83fadef4-583d-4328-be56-f3cd98fc4b4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:58.301372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-83fadef4-583d-4328-be56-f3cd98fc4b4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:58.312836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83fadef4-583d-4328-be56-f3cd98fc4b4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:58.313465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83fadef4-583d-4328-be56-f3cd98fc4b4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:58.314514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83fadef4-583d-4328-be56-f3cd98fc4b4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:58.318193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83fadef4-583d-4328-be56-f3cd98fc4b4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:58.319538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83fadef4-583d-4328-be56-f3cd98fc4b4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:58.320207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83fadef4-583d-4328-be56-f3cd98fc4b4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:58.334231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-57bd0a66-da6a-4c9d-be37-c0ab798b1314 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:58.343177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:58.348241 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-57bd0a66-da6a-4c9d-be37-c0ab798b1314 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1476 microversion: 2.1 time: 0.390317 Aug 27 05:04:58.364817 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1308/2544] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:57 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1476 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:58.546632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-83fadef4-583d-4328-be56-f3cd98fc4b4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:58.555467 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-83fadef4-583d-4328-be56-f3cd98fc4b4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1314 microversion: 2.1 time: 0.258789 Aug 27 05:04:58.556500 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1237/2545] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:58 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:58.723567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd8ae7e7-ec54-4e1a-a2d4-28bdf2d87a78 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:58.724459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd8ae7e7-ec54-4e1a-a2d4-28bdf2d87a78 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:58.732438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd8ae7e7-ec54-4e1a-a2d4-28bdf2d87a78 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:58.733080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd8ae7e7-ec54-4e1a-a2d4-28bdf2d87a78 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:58.733753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd8ae7e7-ec54-4e1a-a2d4-28bdf2d87a78 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:58.734741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd8ae7e7-ec54-4e1a-a2d4-28bdf2d87a78 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:58.735342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd8ae7e7-ec54-4e1a-a2d4-28bdf2d87a78 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:58.735836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd8ae7e7-ec54-4e1a-a2d4-28bdf2d87a78 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:58.786767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:58.787597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:58.797670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:58.798409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:58.798993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:58.799951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:58.800560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:58.801137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.021795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd8ae7e7-ec54-4e1a-a2d4-28bdf2d87a78 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.042696 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd8ae7e7-ec54-4e1a-a2d4-28bdf2d87a78 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1371 microversion: 2.1 time: 0.322946 Aug 27 05:04:59.062317 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1309/2546] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:58 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1371 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:59.063989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.072664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:59.073485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:59.076344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.078234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.079692 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cd98a42a-46cb-4331-a0be-f5cd46f98272 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.297262 Aug 27 05:04:59.080750 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1238/2547] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:58 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:59.085881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e6edb305-0d61-47ac-996d-8933f7c8d496 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:59.086723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e6edb305-0d61-47ac-996d-8933f7c8d496 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:59.088355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.089068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.089672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.091051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.091777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.092373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.094405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6edb305-0d61-47ac-996d-8933f7c8d496 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.094999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6edb305-0d61-47ac-996d-8933f7c8d496 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.095918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6edb305-0d61-47ac-996d-8933f7c8d496 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.096736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6edb305-0d61-47ac-996d-8933f7c8d496 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.097303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6edb305-0d61-47ac-996d-8933f7c8d496 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.099375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6edb305-0d61-47ac-996d-8933f7c8d496 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.170302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.182648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.185728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.187232 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2477a9fb-afd7-456d-944c-e7e07462f28c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.123543 Aug 27 05:04:59.189347 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1310/2548] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:59 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:59.271590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e6edb305-0d61-47ac-996d-8933f7c8d496 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.280841 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e6edb305-0d61-47ac-996d-8933f7c8d496 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.198538 Aug 27 05:04:59.288168 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1239/2549] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:59 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:59.288367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-64666734-60f3-485c-9921-50ccf76e2d79 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:59.288367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-64666734-60f3-485c-9921-50ccf76e2d79 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:59.299355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64666734-60f3-485c-9921-50ccf76e2d79 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.299945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64666734-60f3-485c-9921-50ccf76e2d79 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.300396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64666734-60f3-485c-9921-50ccf76e2d79 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.301130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64666734-60f3-485c-9921-50ccf76e2d79 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.301584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64666734-60f3-485c-9921-50ccf76e2d79 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.304142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64666734-60f3-485c-9921-50ccf76e2d79 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.378021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8655eac-de62-4030-8218-5b19bcdcaeff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:59.379800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8655eac-de62-4030-8218-5b19bcdcaeff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:59.389427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8655eac-de62-4030-8218-5b19bcdcaeff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.390293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8655eac-de62-4030-8218-5b19bcdcaeff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.390970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8655eac-de62-4030-8218-5b19bcdcaeff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.391897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8655eac-de62-4030-8218-5b19bcdcaeff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.396587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8655eac-de62-4030-8218-5b19bcdcaeff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.397592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8655eac-de62-4030-8218-5b19bcdcaeff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.422613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-64666734-60f3-485c-9921-50ccf76e2d79 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.437579 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-64666734-60f3-485c-9921-50ccf76e2d79 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1335 microversion: 2.1 time: 0.155091 Aug 27 05:04:59.438183 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1311/2550] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:59 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1335 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:59.581732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f99dcd4-1b8e-4523-b60f-3cde7d050578 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:59.582371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f99dcd4-1b8e-4523-b60f-3cde7d050578 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:59.598323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8655eac-de62-4030-8218-5b19bcdcaeff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.598864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f99dcd4-1b8e-4523-b60f-3cde7d050578 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.599353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f99dcd4-1b8e-4523-b60f-3cde7d050578 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.602557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f99dcd4-1b8e-4523-b60f-3cde7d050578 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.604956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f99dcd4-1b8e-4523-b60f-3cde7d050578 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.605485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f99dcd4-1b8e-4523-b60f-3cde7d050578 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.605935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f99dcd4-1b8e-4523-b60f-3cde7d050578 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.612417 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8655eac-de62-4030-8218-5b19bcdcaeff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1476 microversion: 2.1 time: 0.239818 Aug 27 05:04:59.616318 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1240/2551] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:59 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1476 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:59.795760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f99dcd4-1b8e-4523-b60f-3cde7d050578 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.806879 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f99dcd4-1b8e-4523-b60f-3cde7d050578 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1314 microversion: 2.1 time: 0.233018 Aug 27 05:04:59.807891 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1312/2552] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:59 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:00.071909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-16d6c0c1-51ef-482f-9d5b-d889ce4ec5aa tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:00.072668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-16d6c0c1-51ef-482f-9d5b-d889ce4ec5aa tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:00.079743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16d6c0c1-51ef-482f-9d5b-d889ce4ec5aa tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.080510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16d6c0c1-51ef-482f-9d5b-d889ce4ec5aa tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.081052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16d6c0c1-51ef-482f-9d5b-d889ce4ec5aa tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.081864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16d6c0c1-51ef-482f-9d5b-d889ce4ec5aa tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.082418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16d6c0c1-51ef-482f-9d5b-d889ce4ec5aa tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.082942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16d6c0c1-51ef-482f-9d5b-d889ce4ec5aa tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.112742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:00.112742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:00.122811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.123600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.124492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.125426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.126048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.126784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.411781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-16d6c0c1-51ef-482f-9d5b-d889ce4ec5aa tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:00.423319 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-16d6c0c1-51ef-482f-9d5b-d889ce4ec5aa tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1371 microversion: 2.1 time: 0.357193 Aug 27 05:05:00.436959 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1241/2553] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:00 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1371 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:00.444616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ff957c8c-ff10-4d42-ab93-0ffd6de99e3b req-0158021e-75c6-4f7b-99c2-4e0970cc9ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316a9750-f2aa-4432-bea7-760186f0a652", "tag": "1ff79ed0-4243-461b-a1be-38445ac36d07"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:00.465646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:00.467406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ff957c8c-ff10-4d42-ab93-0ffd6de99e3b req-0158021e-75c6-4f7b-99c2-4e0970cc9ba3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.467881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ff957c8c-ff10-4d42-ab93-0ffd6de99e3b req-0158021e-75c6-4f7b-99c2-4e0970cc9ba3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.469827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ff957c8c-ff10-4d42-ab93-0ffd6de99e3b req-0158021e-75c6-4f7b-99c2-4e0970cc9ba3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.480452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:00.482830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:00.484217 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a9074b49-a05a-4c9c-9564-ece71bd0caab tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.378055 Aug 27 05:05:00.485597 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1313/2554] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:00 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:00.489952 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ff957c8c-ff10-4d42-ab93-0ffd6de99e3b req-0158021e-75c6-4f7b-99c2-4e0970cc9ba3 service nova] Creating event network-changed:1ff79ed0-4243-461b-a1be-38445ac36d07 for instance 316a9750-f2aa-4432-bea7-760186f0a652 on n-h1-820368-35 Aug 27 05:05:00.490730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:00.491611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:00.500617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.501421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.502043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.503241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.503855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.504441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.508949 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ff957c8c-ff10-4d42-ab93-0ffd6de99e3b req-0158021e-75c6-4f7b-99c2-4e0970cc9ba3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068044 Aug 27 05:05:00.516624 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1242/2555] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:00.526138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3edf6b7f-5637-4389-95f9-c58b56380156 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:00.527169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3edf6b7f-5637-4389-95f9-c58b56380156 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:00.536501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3edf6b7f-5637-4389-95f9-c58b56380156 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.539615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3edf6b7f-5637-4389-95f9-c58b56380156 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.543625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3edf6b7f-5637-4389-95f9-c58b56380156 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.544531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3edf6b7f-5637-4389-95f9-c58b56380156 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.545138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3edf6b7f-5637-4389-95f9-c58b56380156 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.545657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3edf6b7f-5637-4389-95f9-c58b56380156 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.579928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:00.590555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:00.592112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:00.593340 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-484a972e-3568-4740-a76d-bae648abd3a0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.106616 Aug 27 05:05:00.610088 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1314/2556] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:00 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:00.625574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f12622e-fb8f-44ef-b96b-66184bb0170d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:00.626217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f12622e-fb8f-44ef-b96b-66184bb0170d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:00.657914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f12622e-fb8f-44ef-b96b-66184bb0170d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.658521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f12622e-fb8f-44ef-b96b-66184bb0170d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.658977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f12622e-fb8f-44ef-b96b-66184bb0170d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.659759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f12622e-fb8f-44ef-b96b-66184bb0170d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.660214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f12622e-fb8f-44ef-b96b-66184bb0170d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.660640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f12622e-fb8f-44ef-b96b-66184bb0170d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.822520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3edf6b7f-5637-4389-95f9-c58b56380156 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:00.837355 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3edf6b7f-5637-4389-95f9-c58b56380156 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.317962 Aug 27 05:05:00.840169 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1243/2557] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:00 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:00.846870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-55f7a25b-8dee-4856-adb7-e1c01a63bb4e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:00.869902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-55f7a25b-8dee-4856-adb7-e1c01a63bb4e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:00.885790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55f7a25b-8dee-4856-adb7-e1c01a63bb4e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.886584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55f7a25b-8dee-4856-adb7-e1c01a63bb4e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.887308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55f7a25b-8dee-4856-adb7-e1c01a63bb4e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.888355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55f7a25b-8dee-4856-adb7-e1c01a63bb4e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.889017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55f7a25b-8dee-4856-adb7-e1c01a63bb4e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.890731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55f7a25b-8dee-4856-adb7-e1c01a63bb4e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.898140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9f12622e-fb8f-44ef-b96b-66184bb0170d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:00.907129 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f12622e-fb8f-44ef-b96b-66184bb0170d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1402 microversion: 2.1 time: 0.295767 Aug 27 05:05:00.909275 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1315/2558] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:00 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1402 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:00.915862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0aaf380c-4205-4e2b-a2ad-dd3948937193 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:00.916987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0aaf380c-4205-4e2b-a2ad-dd3948937193 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:00.928622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0aaf380c-4205-4e2b-a2ad-dd3948937193 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.929109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0aaf380c-4205-4e2b-a2ad-dd3948937193 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.929546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0aaf380c-4205-4e2b-a2ad-dd3948937193 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.930260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0aaf380c-4205-4e2b-a2ad-dd3948937193 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.930712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0aaf380c-4205-4e2b-a2ad-dd3948937193 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.931288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0aaf380c-4205-4e2b-a2ad-dd3948937193 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:01.199224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-55f7a25b-8dee-4856-adb7-e1c01a63bb4e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:01.211257 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-55f7a25b-8dee-4856-adb7-e1c01a63bb4e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1476 microversion: 2.1 time: 0.369437 Aug 27 05:05:01.214045 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1244/2559] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:00 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1476 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:01.229151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0aaf380c-4205-4e2b-a2ad-dd3948937193 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:01.238035 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0aaf380c-4205-4e2b-a2ad-dd3948937193 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1314 microversion: 2.1 time: 0.327404 Aug 27 05:05:01.239505 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1316/2560] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:00 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:01.444635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-80061580-8394-4907-88cf-9e68e4826cdd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:01.445529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80061580-8394-4907-88cf-9e68e4826cdd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:01.452477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80061580-8394-4907-88cf-9e68e4826cdd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:01.453228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80061580-8394-4907-88cf-9e68e4826cdd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:01.453831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80061580-8394-4907-88cf-9e68e4826cdd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:01.454695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80061580-8394-4907-88cf-9e68e4826cdd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:01.455422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80061580-8394-4907-88cf-9e68e4826cdd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:01.455992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80061580-8394-4907-88cf-9e68e4826cdd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:01.514439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:01.515514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:01.526807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:01.527399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:01.527851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:01.528598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:01.529057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:01.531754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:01.862960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:01.894662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:01.898610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:01.902769 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-71295eae-b9b4-47a7-8611-d2b8909975d1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.392936 Aug 27 05:05:01.904164 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1317/2561] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:01 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:01.911139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:01.912235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:01.926832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:01.927749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:01.928386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:01.929828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:01.931385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:01.932374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:01.980302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-80061580-8394-4907-88cf-9e68e4826cdd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:01.992845 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-80061580-8394-4907-88cf-9e68e4826cdd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1371 microversion: 2.1 time: 0.551756 Aug 27 05:05:01.993916 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1245/2562] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:01 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1371 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:01.999156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b0827123-652b-467b-a09e-4d0038d13aa0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:02.000030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b0827123-652b-467b-a09e-4d0038d13aa0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:02.008085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0827123-652b-467b-a09e-4d0038d13aa0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:02.008783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0827123-652b-467b-a09e-4d0038d13aa0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:02.009394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0827123-652b-467b-a09e-4d0038d13aa0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:02.010447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0827123-652b-467b-a09e-4d0038d13aa0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:02.011222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0827123-652b-467b-a09e-4d0038d13aa0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:02.012008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0827123-652b-467b-a09e-4d0038d13aa0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:02.017722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:02.039028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:02.040696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:02.042062 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-37e532d3-e8eb-4740-925c-b3a7949cc7b9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.136436 Aug 27 05:05:02.042666 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1318/2563] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:01 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:02.054786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d40a7f78-fa66-4c3d-812c-0468c438746a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:02.055438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d40a7f78-fa66-4c3d-812c-0468c438746a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:02.058474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:02.069316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d40a7f78-fa66-4c3d-812c-0468c438746a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:02.075644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d40a7f78-fa66-4c3d-812c-0468c438746a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:02.080483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d40a7f78-fa66-4c3d-812c-0468c438746a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:02.082262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d40a7f78-fa66-4c3d-812c-0468c438746a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:02.083998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d40a7f78-fa66-4c3d-812c-0468c438746a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:02.085472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d40a7f78-fa66-4c3d-812c-0468c438746a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:02.687242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b0827123-652b-467b-a09e-4d0038d13aa0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:02.697622 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b0827123-652b-467b-a09e-4d0038d13aa0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.702395 Aug 27 05:05:02.699939 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1246/2564] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:01 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:02.716599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d40a7f78-fa66-4c3d-812c-0468c438746a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:02.717737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e1c9d731-d308-4c62-a75c-50301c556698 req-01393e4b-4ec6-40fc-bbd6-3d05b835f695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f131d54a-c71c-4d45-84f2-28576acda582", "name": "network-vif-unplugged", "status": "completed", "tag": "c11fd666-9533-4ab6-8b6d-ca21e57491a1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:02.725340 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d40a7f78-fa66-4c3d-812c-0468c438746a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1402 microversion: 2.1 time: 0.674512 Aug 27 05:05:02.726170 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1319/2565] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:02 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1402 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:02.730822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-32ba0cb4-0910-4939-ad92-e800cebe40ab tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:02.731662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-32ba0cb4-0910-4939-ad92-e800cebe40ab tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:02.738403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32ba0cb4-0910-4939-ad92-e800cebe40ab tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:02.739160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32ba0cb4-0910-4939-ad92-e800cebe40ab tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:02.739751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32ba0cb4-0910-4939-ad92-e800cebe40ab tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:02.740707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32ba0cb4-0910-4939-ad92-e800cebe40ab tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:02.741320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32ba0cb4-0910-4939-ad92-e800cebe40ab tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:02.741891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-32ba0cb4-0910-4939-ad92-e800cebe40ab tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:02.750091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e1c9d731-d308-4c62-a75c-50301c556698 req-01393e4b-4ec6-40fc-bbd6-3d05b835f695 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:02.751931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e1c9d731-d308-4c62-a75c-50301c556698 req-01393e4b-4ec6-40fc-bbd6-3d05b835f695 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:02.752526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e1c9d731-d308-4c62-a75c-50301c556698 req-01393e4b-4ec6-40fc-bbd6-3d05b835f695 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:02.766286 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e1c9d731-d308-4c62-a75c-50301c556698 req-01393e4b-4ec6-40fc-bbd6-3d05b835f695 service nova] Creating event network-vif-unplugged:c11fd666-9533-4ab6-8b6d-ca21e57491a1 for instance f131d54a-c71c-4d45-84f2-28576acda582 on n-h2-820368-35 Aug 27 05:05:02.772239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:02.776684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-e1c9d731-d308-4c62-a75c-50301c556698 req-01393e4b-4ec6-40fc-bbd6-3d05b835f695 service nova] Instance f131d54a-c71c-4d45-84f2-28576acda582 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:05:02.791187 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e1c9d731-d308-4c62-a75c-50301c556698 req-01393e4b-4ec6-40fc-bbd6-3d05b835f695 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088464 Aug 27 05:05:02.792424 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1247/2566] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:02.798948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-336e5b58-c9a0-4341-aa7c-f588c4940c6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:02.799854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-336e5b58-c9a0-4341-aa7c-f588c4940c6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:02.806975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-336e5b58-c9a0-4341-aa7c-f588c4940c6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:02.807876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-336e5b58-c9a0-4341-aa7c-f588c4940c6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:02.808470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-336e5b58-c9a0-4341-aa7c-f588c4940c6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:02.809459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-336e5b58-c9a0-4341-aa7c-f588c4940c6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:02.810071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-336e5b58-c9a0-4341-aa7c-f588c4940c6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:02.810655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-336e5b58-c9a0-4341-aa7c-f588c4940c6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.070072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-32ba0cb4-0910-4939-ad92-e800cebe40ab tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.078738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-336e5b58-c9a0-4341-aa7c-f588c4940c6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.079544 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-32ba0cb4-0910-4939-ad92-e800cebe40ab tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1475 microversion: 2.1 time: 0.352141 Aug 27 05:05:03.080287 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1320/2567] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:02 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1475 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:03.086472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-8782739e-3d76-4ba2-ac89-bb8150d5d617 req-7057623e-7479-4897-afba-627bbfcd3673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb77376-d3d6-410b-b281-9d39ea7ccd3d", "tag": "4f610486-0208-4b82-81fb-9e2a223fa0b1"}, {"name": "network-changed", "server_uuid": "6901dbce-5b17-416f-bf76-ae7a4649a06f", "tag": "a21208c8-c4ca-4667-9b01-17e15d6b7485"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:03.089379 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-336e5b58-c9a0-4341-aa7c-f588c4940c6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1314 microversion: 2.1 time: 0.295646 Aug 27 05:05:03.102728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8782739e-3d76-4ba2-ac89-bb8150d5d617 req-7057623e-7479-4897-afba-627bbfcd3673 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.103462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8782739e-3d76-4ba2-ac89-bb8150d5d617 req-7057623e-7479-4897-afba-627bbfcd3673 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.104065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8782739e-3d76-4ba2-ac89-bb8150d5d617 req-7057623e-7479-4897-afba-627bbfcd3673 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.105722 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1248/2568] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:02 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:03.111515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:03.113006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:03.117147 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-8782739e-3d76-4ba2-ac89-bb8150d5d617 req-7057623e-7479-4897-afba-627bbfcd3673 service nova] Creating event network-changed:4f610486-0208-4b82-81fb-9e2a223fa0b1 for instance afb77376-d3d6-410b-b281-9d39ea7ccd3d on n-h1-820368-35 Aug 27 05:05:03.117663 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-8782739e-3d76-4ba2-ac89-bb8150d5d617 req-7057623e-7479-4897-afba-627bbfcd3673 service nova] Creating event network-changed:a21208c8-c4ca-4667-9b01-17e15d6b7485 for instance 6901dbce-5b17-416f-bf76-ae7a4649a06f on n-h2-820368-35 Aug 27 05:05:03.122133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.122858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.123692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.125001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.125824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.126535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.128400 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-8782739e-3d76-4ba2-ac89-bb8150d5d617 req-7057623e-7479-4897-afba-627bbfcd3673 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046525 Aug 27 05:05:03.132667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1321/2569] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:03.138310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-25cfab00-a92e-406f-a54f-bf0fa1221e38 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:03.139017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-25cfab00-a92e-406f-a54f-bf0fa1221e38 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:03.145483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cfab00-a92e-406f-a54f-bf0fa1221e38 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.146119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cfab00-a92e-406f-a54f-bf0fa1221e38 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.147119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cfab00-a92e-406f-a54f-bf0fa1221e38 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.147830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cfab00-a92e-406f-a54f-bf0fa1221e38 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.148292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cfab00-a92e-406f-a54f-bf0fa1221e38 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.148724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cfab00-a92e-406f-a54f-bf0fa1221e38 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.336130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:03.422362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-25cfab00-a92e-406f-a54f-bf0fa1221e38 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.426392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.440756 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-25cfab00-a92e-406f-a54f-bf0fa1221e38 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1371 microversion: 2.1 time: 0.306762 Aug 27 05:05:03.441985 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1322/2570] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:03 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:03.442659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.444665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.446014 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5231c06d-a49e-45df-b646-d050b999dfa9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.339182 Aug 27 05:05:03.446914 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1249/2571] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:03 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:03.451711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9accc4d1-2677-49da-978c-e2f8850aed1b req-52620838-9666-49b7-8fdf-8d4df74b9f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-plugged", "status": "completed", "tag": "623c7391-d404-4e59-8e53-dac73c18bbd3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:03.456172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:03.462247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:03.464469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9accc4d1-2677-49da-978c-e2f8850aed1b req-52620838-9666-49b7-8fdf-8d4df74b9f6f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.464969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9accc4d1-2677-49da-978c-e2f8850aed1b req-52620838-9666-49b7-8fdf-8d4df74b9f6f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.465412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9accc4d1-2677-49da-978c-e2f8850aed1b req-52620838-9666-49b7-8fdf-8d4df74b9f6f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.470549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.471059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.471541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.472269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.473098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.473540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.482872 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9accc4d1-2677-49da-978c-e2f8850aed1b req-52620838-9666-49b7-8fdf-8d4df74b9f6f service nova] Creating event network-vif-plugged:623c7391-d404-4e59-8e53-dac73c18bbd3 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:05:03.492911 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9accc4d1-2677-49da-978c-e2f8850aed1b req-52620838-9666-49b7-8fdf-8d4df74b9f6f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044775 Aug 27 05:05:03.493615 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1250/2572] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:03.549546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.559018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.560527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.561834 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e44add1b-aa31-4b00-a1eb-74a922e838d9 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.118346 Aug 27 05:05:03.562361 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1323/2573] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:03 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:03.722344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ef892911-7392-4dc8-8454-30bf5ec27949 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:03.723783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ef892911-7392-4dc8-8454-30bf5ec27949 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:03.730325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef892911-7392-4dc8-8454-30bf5ec27949 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.730807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef892911-7392-4dc8-8454-30bf5ec27949 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.731295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef892911-7392-4dc8-8454-30bf5ec27949 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.732008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef892911-7392-4dc8-8454-30bf5ec27949 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.732476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef892911-7392-4dc8-8454-30bf5ec27949 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.732909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef892911-7392-4dc8-8454-30bf5ec27949 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.750041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa1307fd-0efa-4126-a953-722ab7a85a29 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:03.751286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aa1307fd-0efa-4126-a953-722ab7a85a29 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:03.760347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1307fd-0efa-4126-a953-722ab7a85a29 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.762789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1307fd-0efa-4126-a953-722ab7a85a29 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.764315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1307fd-0efa-4126-a953-722ab7a85a29 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.765205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1307fd-0efa-4126-a953-722ab7a85a29 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:03.766219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1307fd-0efa-4126-a953-722ab7a85a29 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:03.767047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1307fd-0efa-4126-a953-722ab7a85a29 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.951144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ef892911-7392-4dc8-8454-30bf5ec27949 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.960787 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ef892911-7392-4dc8-8454-30bf5ec27949 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.244220 Aug 27 05:05:03.962200 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1251/2574] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:03 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:03.972219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aa1307fd-0efa-4126-a953-722ab7a85a29 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.980407 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aa1307fd-0efa-4126-a953-722ab7a85a29 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1402 microversion: 2.1 time: 0.235665 Aug 27 05:05:03.981178 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1324/2575] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:03 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1402 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:04.103143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9030f5a7-1313-4204-9ec3-bc45096ef530 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:04.104842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9030f5a7-1313-4204-9ec3-bc45096ef530 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:04.116752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9030f5a7-1313-4204-9ec3-bc45096ef530 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.117634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9030f5a7-1313-4204-9ec3-bc45096ef530 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.118233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9030f5a7-1313-4204-9ec3-bc45096ef530 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.120621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9030f5a7-1313-4204-9ec3-bc45096ef530 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.124076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89dfccee-42ff-49bb-9032-b65af655c997 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:04.124932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9030f5a7-1313-4204-9ec3-bc45096ef530 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.125676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9030f5a7-1313-4204-9ec3-bc45096ef530 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.128645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89dfccee-42ff-49bb-9032-b65af655c997 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:04.147570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89dfccee-42ff-49bb-9032-b65af655c997 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.148108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89dfccee-42ff-49bb-9032-b65af655c997 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.148556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89dfccee-42ff-49bb-9032-b65af655c997 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.149289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89dfccee-42ff-49bb-9032-b65af655c997 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.149742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89dfccee-42ff-49bb-9032-b65af655c997 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.150173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89dfccee-42ff-49bb-9032-b65af655c997 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.357402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9030f5a7-1313-4204-9ec3-bc45096ef530 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:04.370072 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9030f5a7-1313-4204-9ec3-bc45096ef530 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1475 microversion: 2.1 time: 0.272069 Aug 27 05:05:04.371767 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1252/2576] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:04 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1475 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:04.394972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89dfccee-42ff-49bb-9032-b65af655c997 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:04.404805 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89dfccee-42ff-49bb-9032-b65af655c997 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1314 microversion: 2.1 time: 0.293303 Aug 27 05:05:04.405853 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1325/2577] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:04 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:04.464818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa9e601a-44f7-481e-a87a-78ca14d2d999 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:04.465971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fa9e601a-44f7-481e-a87a-78ca14d2d999 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:04.470290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:04.471301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:04.473690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa9e601a-44f7-481e-a87a-78ca14d2d999 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.474253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa9e601a-44f7-481e-a87a-78ca14d2d999 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.475362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa9e601a-44f7-481e-a87a-78ca14d2d999 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.476335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa9e601a-44f7-481e-a87a-78ca14d2d999 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.477322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa9e601a-44f7-481e-a87a-78ca14d2d999 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.477758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa9e601a-44f7-481e-a87a-78ca14d2d999 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.480371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.481465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.482108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.483827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.484326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.484940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.493356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:04.779833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fa9e601a-44f7-481e-a87a-78ca14d2d999 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:04.784811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:04.796205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:04.805178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:04.807016 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-463e07fc-cc42-45c8-be81-e2deac7fc62e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.341922 Aug 27 05:05:04.807920 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1326/2578] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:04 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:04.811978 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa9e601a-44f7-481e-a87a-78ca14d2d999 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1371 microversion: 2.1 time: 0.352737 Aug 27 05:05:04.813423 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1253/2579] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:04 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1371 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:04.814177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:04.814792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:04.820484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-d1de32ed-d586-4368-a812-8b18cfa57b00 req-c7122842-ae84-42ff-916e-4f565509899b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f131d54a-c71c-4d45-84f2-28576acda582", "tag": "c11fd666-9533-4ab6-8b6d-ca21e57491a1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:04.822595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.823115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.823592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.824891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.825539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.825978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.827845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:04.832039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d1de32ed-d586-4368-a812-8b18cfa57b00 req-c7122842-ae84-42ff-916e-4f565509899b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.832520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d1de32ed-d586-4368-a812-8b18cfa57b00 req-c7122842-ae84-42ff-916e-4f565509899b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.832956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d1de32ed-d586-4368-a812-8b18cfa57b00 req-c7122842-ae84-42ff-916e-4f565509899b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.849226 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-d1de32ed-d586-4368-a812-8b18cfa57b00 req-c7122842-ae84-42ff-916e-4f565509899b service nova] Creating event network-changed:c11fd666-9533-4ab6-8b6d-ca21e57491a1 for instance f131d54a-c71c-4d45-84f2-28576acda582 on n-h2-820368-35 Aug 27 05:05:04.855528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-d1de32ed-d586-4368-a812-8b18cfa57b00 req-c7122842-ae84-42ff-916e-4f565509899b service nova] Instance f131d54a-c71c-4d45-84f2-28576acda582 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:05:04.866893 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-d1de32ed-d586-4368-a812-8b18cfa57b00 req-c7122842-ae84-42ff-916e-4f565509899b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052269 Aug 27 05:05:04.867920 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1254/2580] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:04.902801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:04.913305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:04.914759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:04.915989 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-15147aff-ef28-40c0-83e0-5be8fab974bc tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.106596 Aug 27 05:05:04.916559 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1327/2581] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:04 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:04.987896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0af53c9-f0e6-43d3-bb63-e75640eb6b26 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:04.987896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e0af53c9-f0e6-43d3-bb63-e75640eb6b26 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:04.999568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0af53c9-f0e6-43d3-bb63-e75640eb6b26 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.000893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0af53c9-f0e6-43d3-bb63-e75640eb6b26 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.001568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0af53c9-f0e6-43d3-bb63-e75640eb6b26 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.002550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0af53c9-f0e6-43d3-bb63-e75640eb6b26 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.004428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0af53c9-f0e6-43d3-bb63-e75640eb6b26 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.005044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0af53c9-f0e6-43d3-bb63-e75640eb6b26 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.006785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8461325f-5f3c-4b4e-aebb-e612b16e3db9 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:05.007542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8461325f-5f3c-4b4e-aebb-e612b16e3db9 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:05.013788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8461325f-5f3c-4b4e-aebb-e612b16e3db9 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.014457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8461325f-5f3c-4b4e-aebb-e612b16e3db9 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.015008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8461325f-5f3c-4b4e-aebb-e612b16e3db9 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.015949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8461325f-5f3c-4b4e-aebb-e612b16e3db9 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.016510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8461325f-5f3c-4b4e-aebb-e612b16e3db9 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.017046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8461325f-5f3c-4b4e-aebb-e612b16e3db9 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.208007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e0af53c9-f0e6-43d3-bb63-e75640eb6b26 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:05.212971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8461325f-5f3c-4b4e-aebb-e612b16e3db9 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:05.216901 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e0af53c9-f0e6-43d3-bb63-e75640eb6b26 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.238617 Aug 27 05:05:05.217816 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1255/2582] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:04 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:05.221571 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8461325f-5f3c-4b4e-aebb-e612b16e3db9 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1402 microversion: 2.1 time: 0.221609 Aug 27 05:05:05.222270 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1328/2583] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:04 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1402 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:05.392816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad4bfaed-0e28-447c-a795-a1f38b5e8628 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:05.393850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ad4bfaed-0e28-447c-a795-a1f38b5e8628 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:05.397826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:05.402030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad4bfaed-0e28-447c-a795-a1f38b5e8628 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.402934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad4bfaed-0e28-447c-a795-a1f38b5e8628 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.403886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad4bfaed-0e28-447c-a795-a1f38b5e8628 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.404878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad4bfaed-0e28-447c-a795-a1f38b5e8628 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.405436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad4bfaed-0e28-447c-a795-a1f38b5e8628 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.405967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad4bfaed-0e28-447c-a795-a1f38b5e8628 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.409652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=16 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:05.431391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3af5dae4-1a2e-4512-b599-b1be0032f742 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:05.432521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3af5dae4-1a2e-4512-b599-b1be0032f742 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:05.440709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3af5dae4-1a2e-4512-b599-b1be0032f742 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.441498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3af5dae4-1a2e-4512-b599-b1be0032f742 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.442281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3af5dae4-1a2e-4512-b599-b1be0032f742 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.443520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3af5dae4-1a2e-4512-b599-b1be0032f742 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.444992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3af5dae4-1a2e-4512-b599-b1be0032f742 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.445615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3af5dae4-1a2e-4512-b599-b1be0032f742 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.621734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ad4bfaed-0e28-447c-a795-a1f38b5e8628 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:05.634422 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ad4bfaed-0e28-447c-a795-a1f38b5e8628 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1475 microversion: 2.1 time: 0.245440 Aug 27 05:05:05.635530 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1256/2584] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:05 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:05.641392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-05bd34ee-6dfa-457e-99cf-40f47e8a02e9 req-69b08459-fd66-4db9-85d7-9269105a3c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-plugged", "status": "completed", "tag": "54fa96c5-5e23-4d52-a8f5-1c2c79f49849"}, {"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-plugged", "status": "completed", "tag": "bd1cea64-a33a-4b9a-85cb-bf98ccbc4a5f"}, {"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-plugged", "status": "completed", "tag": "870feaae-e12d-419a-80e6-29d9b508fb26"}, {"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-plugged", "status": "completed", "tag": "5462e758-72dc-4c63-9751-fed9c3a9046c"}, {"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-plugged", "status": "completed", "tag": "a40e1272-53cc-4930-bec4-a342676c13f1"}, {"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-plugged", "status": "completed", "tag": "c9039cae-1e09-4044-a9e0-b73c85febfdd"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:05.654420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-05bd34ee-6dfa-457e-99cf-40f47e8a02e9 req-69b08459-fd66-4db9-85d7-9269105a3c7c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.654912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-05bd34ee-6dfa-457e-99cf-40f47e8a02e9 req-69b08459-fd66-4db9-85d7-9269105a3c7c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.655461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-05bd34ee-6dfa-457e-99cf-40f47e8a02e9 req-69b08459-fd66-4db9-85d7-9269105a3c7c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.671630 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-05bd34ee-6dfa-457e-99cf-40f47e8a02e9 req-69b08459-fd66-4db9-85d7-9269105a3c7c service nova] Creating event network-vif-plugged:54fa96c5-5e23-4d52-a8f5-1c2c79f49849 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:05:05.672152 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-05bd34ee-6dfa-457e-99cf-40f47e8a02e9 req-69b08459-fd66-4db9-85d7-9269105a3c7c service nova] Creating event network-vif-plugged:bd1cea64-a33a-4b9a-85cb-bf98ccbc4a5f for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:05:05.672663 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-05bd34ee-6dfa-457e-99cf-40f47e8a02e9 req-69b08459-fd66-4db9-85d7-9269105a3c7c service nova] Creating event network-vif-plugged:870feaae-e12d-419a-80e6-29d9b508fb26 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:05:05.673177 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-05bd34ee-6dfa-457e-99cf-40f47e8a02e9 req-69b08459-fd66-4db9-85d7-9269105a3c7c service nova] Creating event network-vif-plugged:5462e758-72dc-4c63-9751-fed9c3a9046c for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:05:05.673737 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-05bd34ee-6dfa-457e-99cf-40f47e8a02e9 req-69b08459-fd66-4db9-85d7-9269105a3c7c service nova] Creating event network-vif-plugged:a40e1272-53cc-4930-bec4-a342676c13f1 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:05:05.674487 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-05bd34ee-6dfa-457e-99cf-40f47e8a02e9 req-69b08459-fd66-4db9-85d7-9269105a3c7c service nova] Creating event network-vif-plugged:c9039cae-1e09-4044-a9e0-b73c85febfdd for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:05:05.681044 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-05bd34ee-6dfa-457e-99cf-40f47e8a02e9 req-69b08459-fd66-4db9-85d7-9269105a3c7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.044096 Aug 27 05:05:05.682021 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1257/2585] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:05.733054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3af5dae4-1a2e-4512-b599-b1be0032f742 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:05.741806 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3af5dae4-1a2e-4512-b599-b1be0032f742 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1314 microversion: 2.1 time: 0.319557 Aug 27 05:05:05.742906 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1329/2586] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:05 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:05.845285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=16 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:05.849569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:05.850344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:05.851922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ecf83421-9518-4da6-8c5c-d9ea62f54262 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:05.855172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ecf83421-9518-4da6-8c5c-d9ea62f54262 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:05.868720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.869312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.870119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.870906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.871462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.871961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.887860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecf83421-9518-4da6-8c5c-d9ea62f54262 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.889042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecf83421-9518-4da6-8c5c-d9ea62f54262 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.889510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecf83421-9518-4da6-8c5c-d9ea62f54262 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.890323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecf83421-9518-4da6-8c5c-d9ea62f54262 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.890796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecf83421-9518-4da6-8c5c-d9ea62f54262 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.891390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecf83421-9518-4da6-8c5c-d9ea62f54262 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.216720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ecf83421-9518-4da6-8c5c-d9ea62f54262 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.224707 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ecf83421-9518-4da6-8c5c-d9ea62f54262 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1371 microversion: 2.1 time: 0.380905 Aug 27 05:05:06.230080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.240057 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1258/2587] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:05 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1371 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:06.240199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.242411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.243869 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b4175c07-a312-4a67-b133-ac57011b5200 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.400082 Aug 27 05:05:06.244703 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1330/2588] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:05 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:05:06.245382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:06.245994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:06.249349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1457a0b4-f525-42e3-80ea-f0c7a2792ff4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:06.250081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1457a0b4-f525-42e3-80ea-f0c7a2792ff4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:06.252072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:06.252557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:06.252998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.253697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:06.254372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:06.254803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.258263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1457a0b4-f525-42e3-80ea-f0c7a2792ff4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:06.258855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1457a0b4-f525-42e3-80ea-f0c7a2792ff4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:06.260874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1457a0b4-f525-42e3-80ea-f0c7a2792ff4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.260874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1457a0b4-f525-42e3-80ea-f0c7a2792ff4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:06.260874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1457a0b4-f525-42e3-80ea-f0c7a2792ff4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:06.261190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1457a0b4-f525-42e3-80ea-f0c7a2792ff4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.324557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.335213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.337142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.338752 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-be4803ce-32f7-493b-887a-e7707aa6430a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.097190 Aug 27 05:05:06.347136 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1259/2589] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:06 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:06.347136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d5a1257-6d07-4cbe-a53d-83803e1c8ab6 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:06.347136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d5a1257-6d07-4cbe-a53d-83803e1c8ab6 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:06.355306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d5a1257-6d07-4cbe-a53d-83803e1c8ab6 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:06.355306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d5a1257-6d07-4cbe-a53d-83803e1c8ab6 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:06.355306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d5a1257-6d07-4cbe-a53d-83803e1c8ab6 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.355306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d5a1257-6d07-4cbe-a53d-83803e1c8ab6 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:06.355306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d5a1257-6d07-4cbe-a53d-83803e1c8ab6 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:06.355306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d5a1257-6d07-4cbe-a53d-83803e1c8ab6 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.523592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1457a0b4-f525-42e3-80ea-f0c7a2792ff4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.536619 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1457a0b4-f525-42e3-80ea-f0c7a2792ff4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.290837 Aug 27 05:05:06.539351 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1331/2590] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:06 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:06.616214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d5a1257-6d07-4cbe-a53d-83803e1c8ab6 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.624620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d5a1257-6d07-4cbe-a53d-83803e1c8ab6 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1402 microversion: 2.1 time: 0.283748 Aug 27 05:05:06.625432 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1260/2591] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:06 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1402 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:06.660591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8a780fa-98e3-4033-8822-ea078596941f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:06.661220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e8a780fa-98e3-4033-8822-ea078596941f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:06.667794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8a780fa-98e3-4033-8822-ea078596941f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:06.668441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8a780fa-98e3-4033-8822-ea078596941f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:06.668838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8a780fa-98e3-4033-8822-ea078596941f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.669550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8a780fa-98e3-4033-8822-ea078596941f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:06.670011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8a780fa-98e3-4033-8822-ea078596941f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:06.670442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8a780fa-98e3-4033-8822-ea078596941f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.763264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-15a27ae1-4114-4650-ad98-d743f9342d9b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:06.764043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-15a27ae1-4114-4650-ad98-d743f9342d9b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:06.771361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a27ae1-4114-4650-ad98-d743f9342d9b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:06.771858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a27ae1-4114-4650-ad98-d743f9342d9b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:06.772298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a27ae1-4114-4650-ad98-d743f9342d9b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.773070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a27ae1-4114-4650-ad98-d743f9342d9b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:06.773464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a27ae1-4114-4650-ad98-d743f9342d9b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:06.773893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a27ae1-4114-4650-ad98-d743f9342d9b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.818958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e8a780fa-98e3-4033-8822-ea078596941f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.828186 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e8a780fa-98e3-4033-8822-ea078596941f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1475 microversion: 2.1 time: 0.171393 Aug 27 05:05:06.842928 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1332/2592] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:06 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1475 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:06.963236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-15a27ae1-4114-4650-ad98-d743f9342d9b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.972433 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-15a27ae1-4114-4650-ad98-d743f9342d9b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1314 microversion: 2.1 time: 0.212881 Aug 27 05:05:06.973153 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1261/2593] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:06 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:07.248042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d2245d73-fdda-423f-8c0e-6094a45b17b3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:07.249293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d2245d73-fdda-423f-8c0e-6094a45b17b3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:07.265719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2245d73-fdda-423f-8c0e-6094a45b17b3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:07.266533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2245d73-fdda-423f-8c0e-6094a45b17b3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:07.280400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:07.281687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:07.292211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2245d73-fdda-423f-8c0e-6094a45b17b3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:07.293859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2245d73-fdda-423f-8c0e-6094a45b17b3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:07.294549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2245d73-fdda-423f-8c0e-6094a45b17b3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:07.295262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2245d73-fdda-423f-8c0e-6094a45b17b3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:07.301425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:07.302001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:07.302462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:07.303389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:07.303787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:07.304288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:07.852462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d2245d73-fdda-423f-8c0e-6094a45b17b3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:07.867639 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d2245d73-fdda-423f-8c0e-6094a45b17b3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1371 microversion: 2.1 time: 0.623969 Aug 27 05:05:07.870890 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1333/2594] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:07 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1371 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:07.885449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:07.887337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:07.906031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:07.907013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:07.907724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:07.910104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:07.912764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:07.913467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:07.975720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:07.984940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:07.993892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:07.996725 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df87818d-ea68-4d68-bd88-1c011cc0513b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.728904 Aug 27 05:05:07.999764 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1262/2595] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:07 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:08.006880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-003d284e-bc05-4918-a8f7-68f6b0543032 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:08.012102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-003d284e-bc05-4918-a8f7-68f6b0543032 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:08.025650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-003d284e-bc05-4918-a8f7-68f6b0543032 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.026437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-003d284e-bc05-4918-a8f7-68f6b0543032 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.027055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-003d284e-bc05-4918-a8f7-68f6b0543032 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.028000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-003d284e-bc05-4918-a8f7-68f6b0543032 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.031832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-003d284e-bc05-4918-a8f7-68f6b0543032 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.032481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-003d284e-bc05-4918-a8f7-68f6b0543032 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.034079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:08.050564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:08.052488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:08.054377 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-43ff3923-c67b-49f4-91cd-fee455b87898 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.180315 Aug 27 05:05:08.055040 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1334/2596] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:07 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:08.066599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fc324f55-cd20-43bb-aa87-6bf9ba62c9dc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:08.069424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fc324f55-cd20-43bb-aa87-6bf9ba62c9dc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:08.083810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc324f55-cd20-43bb-aa87-6bf9ba62c9dc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.086964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc324f55-cd20-43bb-aa87-6bf9ba62c9dc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.087656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc324f55-cd20-43bb-aa87-6bf9ba62c9dc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.088584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc324f55-cd20-43bb-aa87-6bf9ba62c9dc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.089212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc324f55-cd20-43bb-aa87-6bf9ba62c9dc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.089832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc324f55-cd20-43bb-aa87-6bf9ba62c9dc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.291213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-003d284e-bc05-4918-a8f7-68f6b0543032 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:08.312109 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-003d284e-bc05-4918-a8f7-68f6b0543032 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.310971 Aug 27 05:05:08.312988 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1263/2597] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:07 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:08.317938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1dd9317c-d5a5-4a10-9781-5a896416e377 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:08.318589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1dd9317c-d5a5-4a10-9781-5a896416e377 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:08.330880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dd9317c-d5a5-4a10-9781-5a896416e377 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.331414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dd9317c-d5a5-4a10-9781-5a896416e377 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.332080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dd9317c-d5a5-4a10-9781-5a896416e377 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.332985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dd9317c-d5a5-4a10-9781-5a896416e377 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.333611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dd9317c-d5a5-4a10-9781-5a896416e377 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.334774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dd9317c-d5a5-4a10-9781-5a896416e377 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.340362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fc324f55-cd20-43bb-aa87-6bf9ba62c9dc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:08.349684 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fc324f55-cd20-43bb-aa87-6bf9ba62c9dc tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1402 microversion: 2.1 time: 0.293481 Aug 27 05:05:08.365502 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1335/2598] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:08 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1402 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:08.365502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1fc755b6-4214-489d-a2cb-e3e7b44d1613 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:08.365502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1fc755b6-4214-489d-a2cb-e3e7b44d1613 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:08.375172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fc755b6-4214-489d-a2cb-e3e7b44d1613 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.376184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fc755b6-4214-489d-a2cb-e3e7b44d1613 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.376776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fc755b6-4214-489d-a2cb-e3e7b44d1613 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.377604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fc755b6-4214-489d-a2cb-e3e7b44d1613 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.378293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fc755b6-4214-489d-a2cb-e3e7b44d1613 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.378842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fc755b6-4214-489d-a2cb-e3e7b44d1613 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.620720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1dd9317c-d5a5-4a10-9781-5a896416e377 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:08.634187 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1dd9317c-d5a5-4a10-9781-5a896416e377 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1473 microversion: 2.1 time: 0.317620 Aug 27 05:05:08.634822 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1264/2599] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:08 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1473 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:08.661305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7d12e678-5b7e-435b-81e8-2504d4f17266 req-fa020d43-b57f-49d0-8faf-d70602a77aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316a9750-f2aa-4432-bea7-760186f0a652", "name": "network-vif-plugged", "status": "completed", "tag": "1ff79ed0-4243-461b-a1be-38445ac36d07"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:08.694029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7d12e678-5b7e-435b-81e8-2504d4f17266 req-fa020d43-b57f-49d0-8faf-d70602a77aa6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.694211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7d12e678-5b7e-435b-81e8-2504d4f17266 req-fa020d43-b57f-49d0-8faf-d70602a77aa6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.694644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7d12e678-5b7e-435b-81e8-2504d4f17266 req-fa020d43-b57f-49d0-8faf-d70602a77aa6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.704635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1fc755b6-4214-489d-a2cb-e3e7b44d1613 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:08.709935 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7d12e678-5b7e-435b-81e8-2504d4f17266 req-fa020d43-b57f-49d0-8faf-d70602a77aa6 service nova] Creating event network-vif-plugged:1ff79ed0-4243-461b-a1be-38445ac36d07 for instance 316a9750-f2aa-4432-bea7-760186f0a652 on n-h1-820368-35 Aug 27 05:05:08.715349 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7d12e678-5b7e-435b-81e8-2504d4f17266 req-fa020d43-b57f-49d0-8faf-d70602a77aa6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074887 Aug 27 05:05:08.716006 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1265/2600] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:08.719386 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1fc755b6-4214-489d-a2cb-e3e7b44d1613 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1314 microversion: 2.1 time: 0.366227 Aug 27 05:05:08.721409 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1336/2601] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:08 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:08.894459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f716f8a-0ee8-4204-9677-8025d4c78346 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:08.898081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8f716f8a-0ee8-4204-9677-8025d4c78346 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:08.914002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f716f8a-0ee8-4204-9677-8025d4c78346 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.917015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f716f8a-0ee8-4204-9677-8025d4c78346 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.917810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f716f8a-0ee8-4204-9677-8025d4c78346 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.918785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f716f8a-0ee8-4204-9677-8025d4c78346 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.920158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f716f8a-0ee8-4204-9677-8025d4c78346 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.922904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f716f8a-0ee8-4204-9677-8025d4c78346 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.023870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:09.024985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:09.039419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.040281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.042745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.043714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.045030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.047148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.270121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8f716f8a-0ee8-4204-9677-8025d4c78346 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.274788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:09.281054 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8f716f8a-0ee8-4204-9677-8025d4c78346 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1371 microversion: 2.1 time: 0.392501 Aug 27 05:05:09.281811 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1266/2602] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:08 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1371 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:09.286791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:09.287416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:09.294411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.294996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.295340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.296028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.296491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.296914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.324372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.335139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.337240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.338783 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5d4d9f6a-668d-4c70-8ac7-fdd73141e09f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.320395 Aug 27 05:05:09.339490 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1337/2603] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:09 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:09.357373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c05bb262-5154-4750-8650-a1e99ee923e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:09.358191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c05bb262-5154-4750-8650-a1e99ee923e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:09.366787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.369037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c05bb262-5154-4750-8650-a1e99ee923e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.369781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c05bb262-5154-4750-8650-a1e99ee923e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.371860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c05bb262-5154-4750-8650-a1e99ee923e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.373176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c05bb262-5154-4750-8650-a1e99ee923e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.374097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c05bb262-5154-4750-8650-a1e99ee923e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.374744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c05bb262-5154-4750-8650-a1e99ee923e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.377140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.378576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.379802 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a732161-062d-46e1-bb06-093669ceef3f tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.096916 Aug 27 05:05:09.384568 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1267/2604] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:09 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:09.389592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-002e550d-d64e-4607-b931-fd8c2aa63962 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:09.390301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-002e550d-d64e-4607-b931-fd8c2aa63962 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:09.398100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002e550d-d64e-4607-b931-fd8c2aa63962 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.398742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002e550d-d64e-4607-b931-fd8c2aa63962 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.399467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002e550d-d64e-4607-b931-fd8c2aa63962 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.400353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002e550d-d64e-4607-b931-fd8c2aa63962 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.400844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002e550d-d64e-4607-b931-fd8c2aa63962 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.401363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002e550d-d64e-4607-b931-fd8c2aa63962 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.586313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c05bb262-5154-4750-8650-a1e99ee923e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.593691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-002e550d-d64e-4607-b931-fd8c2aa63962 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.594569 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c05bb262-5154-4750-8650-a1e99ee923e2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.253371 Aug 27 05:05:09.595166 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1338/2605] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:09 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:09.602826 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-002e550d-d64e-4607-b931-fd8c2aa63962 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1402 microversion: 2.1 time: 0.217120 Aug 27 05:05:09.603513 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1268/2606] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:09 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1402 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:09.656169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d7dc6e49-4bfe-4bbf-b1b1-9cdcc996b552 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:09.656785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d7dc6e49-4bfe-4bbf-b1b1-9cdcc996b552 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:09.663323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7dc6e49-4bfe-4bbf-b1b1-9cdcc996b552 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.663806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7dc6e49-4bfe-4bbf-b1b1-9cdcc996b552 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.664237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7dc6e49-4bfe-4bbf-b1b1-9cdcc996b552 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.664929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7dc6e49-4bfe-4bbf-b1b1-9cdcc996b552 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.665377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7dc6e49-4bfe-4bbf-b1b1-9cdcc996b552 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.665799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7dc6e49-4bfe-4bbf-b1b1-9cdcc996b552 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.742487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-976ee841-e284-4bb7-b243-640f54f79678 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:09.743026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-976ee841-e284-4bb7-b243-640f54f79678 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:09.754963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-976ee841-e284-4bb7-b243-640f54f79678 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.755487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-976ee841-e284-4bb7-b243-640f54f79678 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.756230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-976ee841-e284-4bb7-b243-640f54f79678 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.756946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-976ee841-e284-4bb7-b243-640f54f79678 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:09.757404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-976ee841-e284-4bb7-b243-640f54f79678 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:09.757833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-976ee841-e284-4bb7-b243-640f54f79678 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.812545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d7dc6e49-4bfe-4bbf-b1b1-9cdcc996b552 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.822157 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d7dc6e49-4bfe-4bbf-b1b1-9cdcc996b552 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1473 microversion: 2.1 time: 0.169793 Aug 27 05:05:09.824119 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1339/2607] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:09 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1473 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:09.899994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-976ee841-e284-4bb7-b243-640f54f79678 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.908624 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-976ee841-e284-4bb7-b243-640f54f79678 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1314 microversion: 2.1 time: 0.170699 Aug 27 05:05:09.909630 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1269/2608] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:09 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:10.302142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c0eec5c-5044-459b-8b1a-777c54800397 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:10.302719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c0eec5c-5044-459b-8b1a-777c54800397 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:10.309308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c0eec5c-5044-459b-8b1a-777c54800397 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:10.309804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c0eec5c-5044-459b-8b1a-777c54800397 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:10.310245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c0eec5c-5044-459b-8b1a-777c54800397 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:10.310956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c0eec5c-5044-459b-8b1a-777c54800397 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:10.311467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c0eec5c-5044-459b-8b1a-777c54800397 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:10.311901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c0eec5c-5044-459b-8b1a-777c54800397 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:10.362356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:10.362958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:10.371308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:10.371899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:10.372537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:10.373505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:10.374609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:10.375297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:10.548991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6c0eec5c-5044-459b-8b1a-777c54800397 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:10.558380 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c0eec5c-5044-459b-8b1a-777c54800397 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1371 microversion: 2.1 time: 0.260314 Aug 27 05:05:10.573761 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1340/2609] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:10 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:10.580188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:10.597805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:10.618619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:10.621123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:10.626344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:10.627456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:10.628280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:10.628925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:10.750531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:10.767019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:10.769069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:10.771812 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8527941a-82c6-4517-9e42-cb0ab2ac4ac5 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1874 microversion: 2.32 time: 0.413529 Aug 27 05:05:10.772936 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1270/2610] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:10 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1874 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:05:10.778533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-08c51815-61fe-4392-b1d2-57e71c66489b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:10.779445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-08c51815-61fe-4392-b1d2-57e71c66489b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:10.786269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08c51815-61fe-4392-b1d2-57e71c66489b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:10.787129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08c51815-61fe-4392-b1d2-57e71c66489b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:10.787912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08c51815-61fe-4392-b1d2-57e71c66489b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:10.788956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08c51815-61fe-4392-b1d2-57e71c66489b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:10.789630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08c51815-61fe-4392-b1d2-57e71c66489b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:10.790275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08c51815-61fe-4392-b1d2-57e71c66489b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:10.800797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:10.813440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:10.815558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:10.816960 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2162efd5-b340-43ab-998d-38e2875158c2 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.242128 Aug 27 05:05:10.817716 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1341/2611] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:10 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:10.827289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02b4974b-2ec9-493a-9248-b3987ed98e2e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:10.828162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-02b4974b-2ec9-493a-9248-b3987ed98e2e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:10.848829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02b4974b-2ec9-493a-9248-b3987ed98e2e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:10.849605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02b4974b-2ec9-493a-9248-b3987ed98e2e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:10.849996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02b4974b-2ec9-493a-9248-b3987ed98e2e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:10.850803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02b4974b-2ec9-493a-9248-b3987ed98e2e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:10.851829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02b4974b-2ec9-493a-9248-b3987ed98e2e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:10.852335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02b4974b-2ec9-493a-9248-b3987ed98e2e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:10.978448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-08c51815-61fe-4392-b1d2-57e71c66489b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:10.987189 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-08c51815-61fe-4392-b1d2-57e71c66489b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.212506 Aug 27 05:05:10.999959 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1271/2612] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:10 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:11.008439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0ac3252b-169d-4aaa-9748-c264007f7430 req-3d4216d4-025f-4200-abdb-3715a6829bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb77376-d3d6-410b-b281-9d39ea7ccd3d", "name": "network-vif-plugged", "status": "completed", "tag": "4f610486-0208-4b82-81fb-9e2a223fa0b1"}, {"server_uuid": "6901dbce-5b17-416f-bf76-ae7a4649a06f", "name": "network-vif-plugged", "status": "completed", "tag": "a21208c8-c4ca-4667-9b01-17e15d6b7485"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:11.022279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0ac3252b-169d-4aaa-9748-c264007f7430 req-3d4216d4-025f-4200-abdb-3715a6829bc9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.023135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0ac3252b-169d-4aaa-9748-c264007f7430 req-3d4216d4-025f-4200-abdb-3715a6829bc9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.023799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0ac3252b-169d-4aaa-9748-c264007f7430 req-3d4216d4-025f-4200-abdb-3715a6829bc9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:11.037698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02b4974b-2ec9-493a-9248-b3987ed98e2e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:11.039746 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0ac3252b-169d-4aaa-9748-c264007f7430 req-3d4216d4-025f-4200-abdb-3715a6829bc9 service nova] Creating event network-vif-plugged:4f610486-0208-4b82-81fb-9e2a223fa0b1 for instance afb77376-d3d6-410b-b281-9d39ea7ccd3d on n-h1-820368-35 Aug 27 05:05:11.040645 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0ac3252b-169d-4aaa-9748-c264007f7430 req-3d4216d4-025f-4200-abdb-3715a6829bc9 service nova] Creating event network-vif-plugged:a21208c8-c4ca-4667-9b01-17e15d6b7485 for instance 6901dbce-5b17-416f-bf76-ae7a4649a06f on n-h2-820368-35 Aug 27 05:05:11.041953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:11.048293 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-02b4974b-2ec9-493a-9248-b3987ed98e2e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1402 microversion: 2.1 time: 0.228749 Aug 27 05:05:11.049699 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1342/2613] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:10 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1402 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:11.056447 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0ac3252b-169d-4aaa-9748-c264007f7430 req-3d4216d4-025f-4200-abdb-3715a6829bc9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054777 Aug 27 05:05:11.060063 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1272/2614] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:11.064837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5fb7d705-c305-45c1-a249-013896437bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:11.065463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5fb7d705-c305-45c1-a249-013896437bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:11.070323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-18a4e2a6-f945-4d52-9b37-8b8e19ace2ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:11.071360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-18a4e2a6-f945-4d52-9b37-8b8e19ace2ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:11.072794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb7d705-c305-45c1-a249-013896437bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.073300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb7d705-c305-45c1-a249-013896437bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.073806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb7d705-c305-45c1-a249-013896437bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:11.074769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb7d705-c305-45c1-a249-013896437bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.075426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb7d705-c305-45c1-a249-013896437bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.076014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fb7d705-c305-45c1-a249-013896437bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:11.079119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18a4e2a6-f945-4d52-9b37-8b8e19ace2ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.079867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18a4e2a6-f945-4d52-9b37-8b8e19ace2ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.080542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18a4e2a6-f945-4d52-9b37-8b8e19ace2ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:11.081468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18a4e2a6-f945-4d52-9b37-8b8e19ace2ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.082032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18a4e2a6-f945-4d52-9b37-8b8e19ace2ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.082562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18a4e2a6-f945-4d52-9b37-8b8e19ace2ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:11.433810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5fb7d705-c305-45c1-a249-013896437bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:11.446539 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5fb7d705-c305-45c1-a249-013896437bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1473 microversion: 2.1 time: 0.394979 Aug 27 05:05:11.447506 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1343/2615] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:11 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1473 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:11.454622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-18a4e2a6-f945-4d52-9b37-8b8e19ace2ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:11.469309 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-18a4e2a6-f945-4d52-9b37-8b8e19ace2ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1314 microversion: 2.1 time: 0.407107 Aug 27 05:05:11.470558 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1273/2616] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:11 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:11.582144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-624ea85d-161e-4c10-a039-68ec39bf961f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:11.582937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-624ea85d-161e-4c10-a039-68ec39bf961f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:11.590251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-624ea85d-161e-4c10-a039-68ec39bf961f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.590875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-624ea85d-161e-4c10-a039-68ec39bf961f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.592132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-624ea85d-161e-4c10-a039-68ec39bf961f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:11.596749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-624ea85d-161e-4c10-a039-68ec39bf961f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.598271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-624ea85d-161e-4c10-a039-68ec39bf961f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.599022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-624ea85d-161e-4c10-a039-68ec39bf961f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:11.798651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:11.799909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:11.806921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.807806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.808710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:11.809911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.810532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.811575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:11.856768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-624ea85d-161e-4c10-a039-68ec39bf961f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:11.864725 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-624ea85d-161e-4c10-a039-68ec39bf961f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1543 microversion: 2.1 time: 0.287488 Aug 27 05:05:11.865356 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1344/2617] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:11 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1543 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:11.870934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:11.871586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:11.877573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.878061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.878504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:11.879469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.880282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.881577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:11.998335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:12.008468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:12.010262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:12.011564 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d2e19aac-ae19-441a-a503-60ccc80e6e2c tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1604 microversion: 2.42 time: 0.145127 Aug 27 05:05:12.012345 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1345/2618] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:11 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1604 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:12.017691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2bbef532-95e1-4eec-ac60-42ca5cea1e12 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:12.018430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2bbef532-95e1-4eec-ac60-42ca5cea1e12 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:12.024639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bbef532-95e1-4eec-ac60-42ca5cea1e12 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.025246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bbef532-95e1-4eec-ac60-42ca5cea1e12 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.025795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bbef532-95e1-4eec-ac60-42ca5cea1e12 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.026597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bbef532-95e1-4eec-ac60-42ca5cea1e12 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.027234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bbef532-95e1-4eec-ac60-42ca5cea1e12 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.027774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bbef532-95e1-4eec-ac60-42ca5cea1e12 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.060532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:12.070439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:12.071937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:12.073248 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ad2e9d44-1c51-4e48-b4dd-5673328d6cf8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2829 microversion: 2.32 time: 0.280215 Aug 27 05:05:12.083124 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1274/2619] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:11 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2829 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:05:12.083124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c6a27cc3-dfda-4005-9862-049c51157eb5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:12.083124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c6a27cc3-dfda-4005-9862-049c51157eb5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:12.086168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a27cc3-dfda-4005-9862-049c51157eb5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.086844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a27cc3-dfda-4005-9862-049c51157eb5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.087471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a27cc3-dfda-4005-9862-049c51157eb5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.088326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a27cc3-dfda-4005-9862-049c51157eb5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.088947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a27cc3-dfda-4005-9862-049c51157eb5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.089585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a27cc3-dfda-4005-9862-049c51157eb5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.245248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2bbef532-95e1-4eec-ac60-42ca5cea1e12 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:12.254566 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2bbef532-95e1-4eec-ac60-42ca5cea1e12 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1543 microversion: 2.1 time: 0.240766 Aug 27 05:05:12.255365 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1346/2620] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:12 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1543 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:12.261106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f12cbab9-df4c-4edf-873e-b523c5a9f137 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:12.262123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f12cbab9-df4c-4edf-873e-b523c5a9f137 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:12.269723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12cbab9-df4c-4edf-873e-b523c5a9f137 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.270489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12cbab9-df4c-4edf-873e-b523c5a9f137 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.271164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12cbab9-df4c-4edf-873e-b523c5a9f137 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.272453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12cbab9-df4c-4edf-873e-b523c5a9f137 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.272920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12cbab9-df4c-4edf-873e-b523c5a9f137 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.273352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12cbab9-df4c-4edf-873e-b523c5a9f137 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.309512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c6a27cc3-dfda-4005-9862-049c51157eb5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:12.318941 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c6a27cc3-dfda-4005-9862-049c51157eb5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.244053 Aug 27 05:05:12.320762 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1275/2621] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:12 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:12.325742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-24d160aa-7c1f-4ad1-b08e-003242ea9fcc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:12.326243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-24d160aa-7c1f-4ad1-b08e-003242ea9fcc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:12.333088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d160aa-7c1f-4ad1-b08e-003242ea9fcc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.335162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d160aa-7c1f-4ad1-b08e-003242ea9fcc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.335789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d160aa-7c1f-4ad1-b08e-003242ea9fcc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.336668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d160aa-7c1f-4ad1-b08e-003242ea9fcc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.337287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d160aa-7c1f-4ad1-b08e-003242ea9fcc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.338058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24d160aa-7c1f-4ad1-b08e-003242ea9fcc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.526267 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-24d160aa-7c1f-4ad1-b08e-003242ea9fcc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.204163 Aug 27 05:05:12.528395 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1276/2622] 10.222.0.58 () {60 vars in 1316 bytes} [Sat Aug 27 05:05:12 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1/os-interface => generated 1832 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:12.533534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ea2b64a4-9fdf-411a-be88-af315fcb8039 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:12.535035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ea2b64a4-9fdf-411a-be88-af315fcb8039 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:12.542969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea2b64a4-9fdf-411a-be88-af315fcb8039 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.544084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea2b64a4-9fdf-411a-be88-af315fcb8039 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.544809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea2b64a4-9fdf-411a-be88-af315fcb8039 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.548154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea2b64a4-9fdf-411a-be88-af315fcb8039 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.549116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea2b64a4-9fdf-411a-be88-af315fcb8039 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.550225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea2b64a4-9fdf-411a-be88-af315fcb8039 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.623231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f12cbab9-df4c-4edf-873e-b523c5a9f137 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:12.642856 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f12cbab9-df4c-4edf-873e-b523c5a9f137 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1402 microversion: 2.1 time: 0.382473 Aug 27 05:05:12.656816 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1347/2623] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:12 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1402 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:12.666589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-809a8675-a554-4852-af9f-688dfeb389ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:12.668294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-809a8675-a554-4852-af9f-688dfeb389ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:12.678443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809a8675-a554-4852-af9f-688dfeb389ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.679131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809a8675-a554-4852-af9f-688dfeb389ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.679685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809a8675-a554-4852-af9f-688dfeb389ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.680719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809a8675-a554-4852-af9f-688dfeb389ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:12.681320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809a8675-a554-4852-af9f-688dfeb389ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:12.681888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809a8675-a554-4852-af9f-688dfeb389ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:13.157470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ea2b64a4-9fdf-411a-be88-af315fcb8039 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:13.161156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-809a8675-a554-4852-af9f-688dfeb389ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:13.170120 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ea2b64a4-9fdf-411a-be88-af315fcb8039 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1470 microversion: 2.1 time: 0.640286 Aug 27 05:05:13.170797 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1277/2624] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:12 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1470 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:13.172902 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-809a8675-a554-4852-af9f-688dfeb389ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1314 microversion: 2.1 time: 0.521092 Aug 27 05:05:13.174608 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1348/2625] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:12 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:13.193007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f40d1a7-812b-415b-b60c-c5dc97fb0dc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:13.194556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4f40d1a7-812b-415b-b60c-c5dc97fb0dc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:13.200833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:13.201461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:13.203026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f40d1a7-812b-415b-b60c-c5dc97fb0dc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:13.203742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f40d1a7-812b-415b-b60c-c5dc97fb0dc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:13.204185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f40d1a7-812b-415b-b60c-c5dc97fb0dc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:13.205070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f40d1a7-812b-415b-b60c-c5dc97fb0dc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:13.205692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f40d1a7-812b-415b-b60c-c5dc97fb0dc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:13.207527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f40d1a7-812b-415b-b60c-c5dc97fb0dc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:13.208867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:13.209674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:13.210325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:13.213328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:13.213802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:13.214239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:13.289087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:13.289584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:13.290023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:13.299549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lazy-loading 'fault' on Instance uuid 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:05:13.381892 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f40d1a7-812b-415b-b60c-c5dc97fb0dc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "POST /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582/action" status: 204 len: 0 microversion: 2.1 time: 0.192336 Aug 27 05:05:13.383106 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1349/2626] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:05:13 2022] POST /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582/action => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:05:13.398862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ccee8b4-d45b-4cc4-836d-a931ca067351 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:13.401142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ccee8b4-d45b-4cc4-836d-a931ca067351 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:13.421948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ccee8b4-d45b-4cc4-836d-a931ca067351 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:13.423965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ccee8b4-d45b-4cc4-836d-a931ca067351 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:13.424609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ccee8b4-d45b-4cc4-836d-a931ca067351 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:13.428737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ccee8b4-d45b-4cc4-836d-a931ca067351 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:13.429444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ccee8b4-d45b-4cc4-836d-a931ca067351 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:13.431482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ccee8b4-d45b-4cc4-836d-a931ca067351 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:13.875293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:13.884128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:13.885943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d0ae33c8651467ba9b736900f782a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dc24c6ca7475e8fc12b435cb84c63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:13.887459 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ef157cff-47ad-4a36-af0f-1bc126b95d17 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 200 len: 1371 microversion: 2.42 time: 0.715363 Aug 27 05:05:13.899522 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1278/2627] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:13 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 1371 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:13.909794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6c38647b-24f2-44ea-b72a-44d013aaa10e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:13.910713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6c38647b-24f2-44ea-b72a-44d013aaa10e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:13.917739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c38647b-24f2-44ea-b72a-44d013aaa10e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:13.918725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c38647b-24f2-44ea-b72a-44d013aaa10e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:13.919493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c38647b-24f2-44ea-b72a-44d013aaa10e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:13.920641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c38647b-24f2-44ea-b72a-44d013aaa10e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:13.921331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c38647b-24f2-44ea-b72a-44d013aaa10e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:13.921981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c38647b-24f2-44ea-b72a-44d013aaa10e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:14.262577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7ccee8b4-d45b-4cc4-836d-a931ca067351 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:14.277048 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ccee8b4-d45b-4cc4-836d-a931ca067351 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.890818 Aug 27 05:05:14.292013 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1350/2628] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:13 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:14.298586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-129997c7-1f7f-4db9-bbbc-f5e809ecb907 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:14.299624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-129997c7-1f7f-4db9-bbbc-f5e809ecb907 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:14.308101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-129997c7-1f7f-4db9-bbbc-f5e809ecb907 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:14.309392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-129997c7-1f7f-4db9-bbbc-f5e809ecb907 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:14.310824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-129997c7-1f7f-4db9-bbbc-f5e809ecb907 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:14.312412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-129997c7-1f7f-4db9-bbbc-f5e809ecb907 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:14.313124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-129997c7-1f7f-4db9-bbbc-f5e809ecb907 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:14.313665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-129997c7-1f7f-4db9-bbbc-f5e809ecb907 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:14.343220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6c38647b-24f2-44ea-b72a-44d013aaa10e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:14.367056 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6c38647b-24f2-44ea-b72a-44d013aaa10e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1470 microversion: 2.1 time: 0.466030 Aug 27 05:05:14.382948 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1279/2629] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:13 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1470 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:14.388200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-103aee60-36f1-404c-af3f-da2431efebe7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:14.395024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-103aee60-36f1-404c-af3f-da2431efebe7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:14.416565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-103aee60-36f1-404c-af3f-da2431efebe7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:14.417307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-103aee60-36f1-404c-af3f-da2431efebe7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:14.417928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-103aee60-36f1-404c-af3f-da2431efebe7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:14.418927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-103aee60-36f1-404c-af3f-da2431efebe7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:14.419595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-103aee60-36f1-404c-af3f-da2431efebe7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:14.420212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-103aee60-36f1-404c-af3f-da2431efebe7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:14.898110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-129997c7-1f7f-4db9-bbbc-f5e809ecb907 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:14.902589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-103aee60-36f1-404c-af3f-da2431efebe7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:14.913115 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-103aee60-36f1-404c-af3f-da2431efebe7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1501 microversion: 2.1 time: 0.528565 Aug 27 05:05:14.913719 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1280/2630] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:14 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1501 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:14.924846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-888686e7-c2f8-411b-a87c-93d29c3a7cb8 req-ee96b771-5928-4f00-bf15-216056759e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316a9750-f2aa-4432-bea7-760186f0a652", "tag": "1ff79ed0-4243-461b-a1be-38445ac36d07"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:14.933880 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-129997c7-1f7f-4db9-bbbc-f5e809ecb907 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1589 microversion: 2.1 time: 0.640277 Aug 27 05:05:14.935375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-888686e7-c2f8-411b-a87c-93d29c3a7cb8 req-ee96b771-5928-4f00-bf15-216056759e71 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:14.936052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-888686e7-c2f8-411b-a87c-93d29c3a7cb8 req-ee96b771-5928-4f00-bf15-216056759e71 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:14.936648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-888686e7-c2f8-411b-a87c-93d29c3a7cb8 req-ee96b771-5928-4f00-bf15-216056759e71 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:14.947009 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1351/2631] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:14 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1589 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:14.949340 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-888686e7-c2f8-411b-a87c-93d29c3a7cb8 req-ee96b771-5928-4f00-bf15-216056759e71 service nova] Creating event network-changed:1ff79ed0-4243-461b-a1be-38445ac36d07 for instance 316a9750-f2aa-4432-bea7-760186f0a652 on n-h1-820368-35 Aug 27 05:05:14.958884 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-888686e7-c2f8-411b-a87c-93d29c3a7cb8 req-ee96b771-5928-4f00-bf15-216056759e71 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043885 Aug 27 05:05:14.964367 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1281/2632] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:14.970912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:14.972266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:14.982151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:14.983151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:14.983897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:14.984934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:14.985160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dad52199-dd75-4a65-b20f-4d8e09689d6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:14.985841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dad52199-dd75-4a65-b20f-4d8e09689d6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:14.986093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:14.986785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.005577 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] HTTP exception thrown: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:15.006818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dad52199-dd75-4a65-b20f-4d8e09689d6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Request method failure captured: Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 HTTP/1.1 Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRaE73oZDFo-DSrrU1x1b7zPhBzN8XRegUl56NXUZLmvnsXqLyhE2KiwLjG4CoZfyOzuGsxM1lxbebjw4Qri2a9eNtP4xAoxvhC4cdLwnRmbuJRuOb_t72VxGpVTKiHfAmJojbceN9lbnomXoNM4VRwOMWwE9Py8QoQgF16l2zxGc8 Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 8a3dc24c6ca7475e8fc12b435cb84c63 Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1763723318 Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8a3dc24c6ca7475e8fc12b435cb84c63", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8a3dc24c6ca7475e8fc12b435cb84c63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8a3dc24c6ca7475e8fc12b435cb84c63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8a3dc24c6ca7475e8fc12b435cb84c63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1763723318 Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 8a3dc24c6ca7475e8fc12b435cb84c63 Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1763723318 Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TaggedBootDevicesTest_v242-1763723318-project Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 4d0ae33c8651467ba9b736900f782a7b Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1763723318-project Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8'} Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:05:15.009893 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:15.014292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:05:15.014292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:15.014292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:15.014292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:15.014292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:05:15.014292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:05:15.014292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:15.014292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:05:15.014826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dad52199-dd75-4a65-b20f-4d8e09689d6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.016459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Returning 404 to user: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:05:15.017661 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-65f2eb72-a0c7-41da-9892-91ce38e9c4b8 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 404 len: 111 microversion: 2.42 time: 0.069472 Aug 27 05:05:15.018110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dad52199-dd75-4a65-b20f-4d8e09689d6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.018976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dad52199-dd75-4a65-b20f-4d8e09689d6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.019664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dad52199-dd75-4a65-b20f-4d8e09689d6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.020351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dad52199-dd75-4a65-b20f-4d8e09689d6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.023643 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1352/2633] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:14 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:05:15.032693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d37f6b2a-e138-4220-9695-2919bf340eeb tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:15.034532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d37f6b2a-e138-4220-9695-2919bf340eeb tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:15.041639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d37f6b2a-e138-4220-9695-2919bf340eeb tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.042478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d37f6b2a-e138-4220-9695-2919bf340eeb tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.043261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d37f6b2a-e138-4220-9695-2919bf340eeb tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.044662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d37f6b2a-e138-4220-9695-2919bf340eeb tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.045350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d37f6b2a-e138-4220-9695-2919bf340eeb tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.046003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d37f6b2a-e138-4220-9695-2919bf340eeb tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.070950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dad52199-dd75-4a65-b20f-4d8e09689d6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:05:15.240665 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d37f6b2a-e138-4220-9695-2919bf340eeb tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.214752 Aug 27 05:05:15.242846 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1353/2634] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:05:15 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:15.248385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e35c9b65-de74-4880-a5ce-e4bcce0b9748 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '.version_select at 0x7fb56969c940>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:15.259539 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dad52199-dd75-4a65-b20f-4d8e09689d6f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 204 len: 0 microversion: 2.1 time: 0.290868 Aug 27 05:05:15.260559 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1282/2635] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:05:14 2022] DELETE /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:05:15.266704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ed8a5d85-1c7f-42fd-bf35-cb04435edf17 req-a95e86a0-c7dc-4c9e-805a-01a5ff274f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f131d54a-c71c-4d45-84f2-28576acda582", "name": "network-vif-plugged", "status": "completed", "tag": "c11fd666-9533-4ab6-8b6d-ca21e57491a1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:15.284955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ed8a5d85-1c7f-42fd-bf35-cb04435edf17 req-a95e86a0-c7dc-4c9e-805a-01a5ff274f02 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.285442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ed8a5d85-1c7f-42fd-bf35-cb04435edf17 req-a95e86a0-c7dc-4c9e-805a-01a5ff274f02 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.285881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ed8a5d85-1c7f-42fd-bf35-cb04435edf17 req-a95e86a0-c7dc-4c9e-805a-01a5ff274f02 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.290060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:15.317719 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ed8a5d85-1c7f-42fd-bf35-cb04435edf17 req-a95e86a0-c7dc-4c9e-805a-01a5ff274f02 service nova] Creating event network-vif-plugged:c11fd666-9533-4ab6-8b6d-ca21e57491a1 for instance f131d54a-c71c-4d45-84f2-28576acda582 on n-h2-820368-35 Aug 27 05:05:15.329426 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e35c9b65-de74-4880-a5ce-e4bcce0b9748 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203506146" status: 204 len: 0 microversion: 2.42 time: 0.085302 Aug 27 05:05:15.331158 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1354/2636] 10.222.0.58 () {60 vars in 1259 bytes} [Sat Aug 27 05:05:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203506146 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:05:15.335569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-ed8a5d85-1c7f-42fd-bf35-cb04435edf17 req-a95e86a0-c7dc-4c9e-805a-01a5ff274f02 service nova] Instance f131d54a-c71c-4d45-84f2-28576acda582 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:05:15.342055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e47543a-2d17-44cb-96cc-66bd52a22c9c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:15.344754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2e47543a-2d17-44cb-96cc-66bd52a22c9c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:15.357243 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ed8a5d85-1c7f-42fd-bf35-cb04435edf17 req-a95e86a0-c7dc-4c9e-805a-01a5ff274f02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095118 Aug 27 05:05:15.358742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e47543a-2d17-44cb-96cc-66bd52a22c9c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.359267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e47543a-2d17-44cb-96cc-66bd52a22c9c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.360281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e47543a-2d17-44cb-96cc-66bd52a22c9c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.361214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e47543a-2d17-44cb-96cc-66bd52a22c9c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.361910 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1283/2637] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:15.362447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e47543a-2d17-44cb-96cc-66bd52a22c9c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.362962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e47543a-2d17-44cb-96cc-66bd52a22c9c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.372115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a0681487-e69a-44b6-9fd3-a5284aadfba8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:15.372829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a0681487-e69a-44b6-9fd3-a5284aadfba8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:15.393966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0681487-e69a-44b6-9fd3-a5284aadfba8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.394485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0681487-e69a-44b6-9fd3-a5284aadfba8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.395730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0681487-e69a-44b6-9fd3-a5284aadfba8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.396491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0681487-e69a-44b6-9fd3-a5284aadfba8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.396949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0681487-e69a-44b6-9fd3-a5284aadfba8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.397376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0681487-e69a-44b6-9fd3-a5284aadfba8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.820594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2e47543a-2d17-44cb-96cc-66bd52a22c9c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:15.831959 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2e47543a-2d17-44cb-96cc-66bd52a22c9c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1507 microversion: 2.1 time: 0.498857 Aug 27 05:05:15.832995 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1355/2638] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:15 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1507 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:15.845164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8baa6063-c996-420d-854f-a327b7d58850 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:15.847599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8baa6063-c996-420d-854f-a327b7d58850 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:15.860268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a0681487-e69a-44b6-9fd3-a5284aadfba8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:15.863193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8baa6063-c996-420d-854f-a327b7d58850 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.867263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8baa6063-c996-420d-854f-a327b7d58850 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.871278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8baa6063-c996-420d-854f-a327b7d58850 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.871509 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a0681487-e69a-44b6-9fd3-a5284aadfba8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.504059 Aug 27 05:05:15.883145 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1284/2639] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:15 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:15.883354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8baa6063-c996-420d-854f-a327b7d58850 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.883354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8baa6063-c996-420d-854f-a327b7d58850 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.883354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8baa6063-c996-420d-854f-a327b7d58850 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.896246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-463be6ea-2a7b-4a1f-a2f2-6de9d812bfb1 req-ee3562d9-dbbb-4139-ac2e-cc49bf478051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "tag": "bd1cea64-a33a-4b9a-85cb-bf98ccbc4a5f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:15.909088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-463be6ea-2a7b-4a1f-a2f2-6de9d812bfb1 req-ee3562d9-dbbb-4139-ac2e-cc49bf478051 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:15.910349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-463be6ea-2a7b-4a1f-a2f2-6de9d812bfb1 req-ee3562d9-dbbb-4139-ac2e-cc49bf478051 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:15.910983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-463be6ea-2a7b-4a1f-a2f2-6de9d812bfb1 req-ee3562d9-dbbb-4139-ac2e-cc49bf478051 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:15.933282 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-463be6ea-2a7b-4a1f-a2f2-6de9d812bfb1 req-ee3562d9-dbbb-4139-ac2e-cc49bf478051 service nova] Creating event network-changed:bd1cea64-a33a-4b9a-85cb-bf98ccbc4a5f for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:05:15.940381 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-463be6ea-2a7b-4a1f-a2f2-6de9d812bfb1 req-ee3562d9-dbbb-4139-ac2e-cc49bf478051 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047970 Aug 27 05:05:15.941374 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1285/2640] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:16.441801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8baa6063-c996-420d-854f-a327b7d58850 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:16.454414 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8baa6063-c996-420d-854f-a327b7d58850 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1470 microversion: 2.1 time: 0.616461 Aug 27 05:05:16.457614 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1356/2641] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:15 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1470 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:16.855075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a354a87a-0eee-4a2f-b890-074cfed1bc1d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:16.855857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a354a87a-0eee-4a2f-b890-074cfed1bc1d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:16.867818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a354a87a-0eee-4a2f-b890-074cfed1bc1d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:16.868323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a354a87a-0eee-4a2f-b890-074cfed1bc1d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:16.868770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a354a87a-0eee-4a2f-b890-074cfed1bc1d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:16.874294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a354a87a-0eee-4a2f-b890-074cfed1bc1d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:16.879491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a354a87a-0eee-4a2f-b890-074cfed1bc1d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:16.880065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a354a87a-0eee-4a2f-b890-074cfed1bc1d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:16.892620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-93f34c03-a154-4680-a191-c1efb7860c4b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:16.894330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-93f34c03-a154-4680-a191-c1efb7860c4b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:16.905321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93f34c03-a154-4680-a191-c1efb7860c4b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:16.908623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93f34c03-a154-4680-a191-c1efb7860c4b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:16.909412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93f34c03-a154-4680-a191-c1efb7860c4b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:16.914281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93f34c03-a154-4680-a191-c1efb7860c4b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:16.914883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93f34c03-a154-4680-a191-c1efb7860c4b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:16.915536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93f34c03-a154-4680-a191-c1efb7860c4b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:17.297105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a354a87a-0eee-4a2f-b890-074cfed1bc1d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:17.320971 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a354a87a-0eee-4a2f-b890-074cfed1bc1d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1507 microversion: 2.1 time: 0.470612 Aug 27 05:05:17.328522 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1286/2642] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:16 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1507 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:17.373027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-93f34c03-a154-4680-a191-c1efb7860c4b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:17.381775 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-93f34c03-a154-4680-a191-c1efb7860c4b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1499 microversion: 2.1 time: 0.493078 Aug 27 05:05:17.392602 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1357/2643] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:16 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1499 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:17.479986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-862db465-8bf2-4de5-9ce3-acceee39fcbb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:17.480866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-862db465-8bf2-4de5-9ce3-acceee39fcbb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:17.488359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-862db465-8bf2-4de5-9ce3-acceee39fcbb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:17.489199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-862db465-8bf2-4de5-9ce3-acceee39fcbb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:17.489887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-862db465-8bf2-4de5-9ce3-acceee39fcbb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:17.490891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-862db465-8bf2-4de5-9ce3-acceee39fcbb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:17.491621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-862db465-8bf2-4de5-9ce3-acceee39fcbb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:17.492283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-862db465-8bf2-4de5-9ce3-acceee39fcbb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:17.728500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-862db465-8bf2-4de5-9ce3-acceee39fcbb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:17.739732 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-862db465-8bf2-4de5-9ce3-acceee39fcbb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1470 microversion: 2.1 time: 0.265612 Aug 27 05:05:17.741219 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1287/2644] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:17 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:18.357831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a163ad22-ed97-4243-a819-29b04fab4b6e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:18.358618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a163ad22-ed97-4243-a819-29b04fab4b6e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:18.371740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9f8c9548-2be3-4083-a069-2036da43653c tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:18.372587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9f8c9548-2be3-4083-a069-2036da43653c tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:18.386181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a163ad22-ed97-4243-a819-29b04fab4b6e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:18.386930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f8c9548-2be3-4083-a069-2036da43653c tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:18.387651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a163ad22-ed97-4243-a819-29b04fab4b6e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:18.388270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f8c9548-2be3-4083-a069-2036da43653c tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:18.388832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a163ad22-ed97-4243-a819-29b04fab4b6e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:18.389442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f8c9548-2be3-4083-a069-2036da43653c tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:18.390657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f8c9548-2be3-4083-a069-2036da43653c tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:18.391372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a163ad22-ed97-4243-a819-29b04fab4b6e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:18.391939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a163ad22-ed97-4243-a819-29b04fab4b6e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:18.392503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f8c9548-2be3-4083-a069-2036da43653c tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:18.393042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a163ad22-ed97-4243-a819-29b04fab4b6e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:18.393690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f8c9548-2be3-4083-a069-2036da43653c tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:18.711110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a163ad22-ed97-4243-a819-29b04fab4b6e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:18.747573 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a163ad22-ed97-4243-a819-29b04fab4b6e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 200 len: 1465 microversion: 2.1 time: 0.393240 Aug 27 05:05:18.750703 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1358/2645] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:18 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 1465 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:18.767439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-974f9a29-fa0b-4552-a867-b40ff61eb20e req-e6a2bb59-88da-45ed-84f8-a738c0fd7b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6901dbce-5b17-416f-bf76-ae7a4649a06f", "tag": "a21208c8-c4ca-4667-9b01-17e15d6b7485"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:18.799449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-974f9a29-fa0b-4552-a867-b40ff61eb20e req-e6a2bb59-88da-45ed-84f8-a738c0fd7b8e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:18.800359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-974f9a29-fa0b-4552-a867-b40ff61eb20e req-e6a2bb59-88da-45ed-84f8-a738c0fd7b8e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:18.803370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-974f9a29-fa0b-4552-a867-b40ff61eb20e req-e6a2bb59-88da-45ed-84f8-a738c0fd7b8e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:18.852449 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-974f9a29-fa0b-4552-a867-b40ff61eb20e req-e6a2bb59-88da-45ed-84f8-a738c0fd7b8e service nova] Creating event network-changed:a21208c8-c4ca-4667-9b01-17e15d6b7485 for instance 6901dbce-5b17-416f-bf76-ae7a4649a06f on n-h2-820368-35 Aug 27 05:05:18.860146 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-974f9a29-fa0b-4552-a867-b40ff61eb20e req-e6a2bb59-88da-45ed-84f8-a738c0fd7b8e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105489 Aug 27 05:05:18.862848 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1359/2646] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:18.868562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eaa96227-73ac-4197-819c-9df25d1a02b7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:18.869375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eaa96227-73ac-4197-819c-9df25d1a02b7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:18.878062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa96227-73ac-4197-819c-9df25d1a02b7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:18.878596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa96227-73ac-4197-819c-9df25d1a02b7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:18.879150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa96227-73ac-4197-819c-9df25d1a02b7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:18.879874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa96227-73ac-4197-819c-9df25d1a02b7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:18.880338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa96227-73ac-4197-819c-9df25d1a02b7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:18.881717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa96227-73ac-4197-819c-9df25d1a02b7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:18.944031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9f8c9548-2be3-4083-a069-2036da43653c tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:18.958200 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9f8c9548-2be3-4083-a069-2036da43653c tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1589 microversion: 2.1 time: 0.593328 Aug 27 05:05:18.960488 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1288/2647] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:18 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1589 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:18.972083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de90aac8-5778-4d38-8e5a-8b293a2deb1a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:18.973073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de90aac8-5778-4d38-8e5a-8b293a2deb1a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:18.984881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de90aac8-5778-4d38-8e5a-8b293a2deb1a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:18.985723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de90aac8-5778-4d38-8e5a-8b293a2deb1a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:18.987257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de90aac8-5778-4d38-8e5a-8b293a2deb1a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:18.989210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de90aac8-5778-4d38-8e5a-8b293a2deb1a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:18.990161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de90aac8-5778-4d38-8e5a-8b293a2deb1a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:18.990751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de90aac8-5778-4d38-8e5a-8b293a2deb1a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:19.731771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de90aac8-5778-4d38-8e5a-8b293a2deb1a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:19.747111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eaa96227-73ac-4197-819c-9df25d1a02b7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:19.751337 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de90aac8-5778-4d38-8e5a-8b293a2deb1a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1462 microversion: 2.1 time: 0.788308 Aug 27 05:05:19.753814 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1289/2648] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:18 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1462 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:19.758917 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eaa96227-73ac-4197-819c-9df25d1a02b7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 200 len: 1476 microversion: 2.1 time: 0.894733 Aug 27 05:05:19.759598 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1360/2649] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:18 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 1476 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:19.776321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-345316b8-3a9f-4e6d-8588-cae99e0a5201 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:19.777507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-345316b8-3a9f-4e6d-8588-cae99e0a5201 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:19.783783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345316b8-3a9f-4e6d-8588-cae99e0a5201 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:19.784277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345316b8-3a9f-4e6d-8588-cae99e0a5201 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:19.784717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345316b8-3a9f-4e6d-8588-cae99e0a5201 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:19.790010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:19.790633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:19.794112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345316b8-3a9f-4e6d-8588-cae99e0a5201 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:19.794604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345316b8-3a9f-4e6d-8588-cae99e0a5201 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:19.795049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345316b8-3a9f-4e6d-8588-cae99e0a5201 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:19.802121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:19.803868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:19.804550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:19.805727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:19.807221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:19.809789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:19.810282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:19.833376 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d HTTP/1.1 Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'afb77376-d3d6-410b-b281-9d39ea7ccd3d'} Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:19.835617 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:05:19.841412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:19.841412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:19.841412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:19.841412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:05:19.841412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:05:19.841412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:05:19.841412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:05:19.845941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:05:19.847145 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2dcda0ca-34d2-4932-82da-6b82d6524867 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 404 len: 111 microversion: 2.1 time: 0.078880 Aug 27 05:05:19.848233 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1290/2650] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:19 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:05:19.853259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d177323a-1dda-4108-8eeb-190af3c70fd8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-7619768"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:19.855960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d177323a-1dda-4108-8eeb-190af3c70fd8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:19.864917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d177323a-1dda-4108-8eeb-190af3c70fd8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:19.866025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d177323a-1dda-4108-8eeb-190af3c70fd8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:19.866541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d177323a-1dda-4108-8eeb-190af3c70fd8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:19.867940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d177323a-1dda-4108-8eeb-190af3c70fd8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:19.868477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d177323a-1dda-4108-8eeb-190af3c70fd8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:19.869102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d177323a-1dda-4108-8eeb-190af3c70fd8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:20.069775 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-345316b8-3a9f-4e6d-8588-cae99e0a5201 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1615 microversion: 2.1 time: 0.297845 Aug 27 05:05:20.071159 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1361/2651] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:19 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1615 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:20.077222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1178305837", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "11b9ce7b-910c-4628-97fe-5e2c2147efa3"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:20.131380 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d177323a-1dda-4108-8eeb-190af3c70fd8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "POST /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4/action" status: 202 len: 0 microversion: 2.1 time: 0.281141 Aug 27 05:05:20.138881 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1291/2652] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:05:19 2022] POST /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 05:05:20.146827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d4a9d4a-c50b-4753-bcf8-c087c4592c2f tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Calling method '.version_select at 0x7fb569548550>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:20.149881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] validate_networks() for [('11b9ce7b-910c-4628-97fe-5e2c2147efa3', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:05:20.150686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d4a9d4a-c50b-4753-bcf8-c087c4592c2f tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:20.151367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d4a9d4a-c50b-4753-bcf8-c087c4592c2f tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:20.152207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d4a9d4a-c50b-4753-bcf8-c087c4592c2f tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:20.162677 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d4a9d4a-c50b-4753-bcf8-c087c4592c2f tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.020887 Aug 27 05:05:20.165964 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1292/2653] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 05:05:20 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:20.171653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c103c02a-e8bb-46b2-8300-2e79009402fb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56965dee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:20.235362 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c103c02a-e8bb-46b2-8300-2e79009402fb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.064881 Aug 27 05:05:20.236045 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1293/2654] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:20 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:20.314270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1249365193", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:20.378003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:05:20.876296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:05:20.877533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:05:20.878183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:05:20.878762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:05:20.879372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:05:20.901116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:20.901623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:20.902070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:20.902813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:20.903325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:20.903819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:20.960528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:05:20.973500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for user 58b3a6b755ba4d5f89899d3122ddc29d and project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:05:21.004206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:05:21.007457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:05:21.069891 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-86b93c1f-ee2e-4942-a8b6-a9511ac0dd20 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761104 Aug 27 05:05:21.070965 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1294/2655] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:05:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:05:21.082249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f32aafc1-7b75-463e-82b6-e13851b613c0 req-c694ef1c-b34c-403d-aa28-dde776666e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb77376-d3d6-410b-b281-9d39ea7ccd3d", "name": "network-vif-deleted", "tag": "4f610486-0208-4b82-81fb-9e2a223fa0b1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:21.089740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:05:21.090422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:05:21.091122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:05:21.091714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:05:21.092245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:05:21.101482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:21.103924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:21.104750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:21.105424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:21.106427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:21.107288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:21.108153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:21.113026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f32aafc1-7b75-463e-82b6-e13851b613c0 req-c694ef1c-b34c-403d-aa28-dde776666e5e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:21.114008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f32aafc1-7b75-463e-82b6-e13851b613c0 req-c694ef1c-b34c-403d-aa28-dde776666e5e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:21.114644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f32aafc1-7b75-463e-82b6-e13851b613c0 req-c694ef1c-b34c-403d-aa28-dde776666e5e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:21.133836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:05:21.141679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for user d3ae5460271c4f5291e6abb0e76cab17 and project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:05:21.145659 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f32aafc1-7b75-463e-82b6-e13851b613c0 req-c694ef1c-b34c-403d-aa28-dde776666e5e service nova] Creating event network-vif-deleted:4f610486-0208-4b82-81fb-9e2a223fa0b1 for instance afb77376-d3d6-410b-b281-9d39ea7ccd3d on n-h1-820368-35 Aug 27 05:05:21.159293 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f32aafc1-7b75-463e-82b6-e13851b613c0 req-c694ef1c-b34c-403d-aa28-dde776666e5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086558 Aug 27 05:05:21.160538 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1295/2656] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:21.168516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-33e9a771-d88b-4208-8b39-a792ae0094ee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:21.170204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-33e9a771-d88b-4208-8b39-a792ae0094ee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:21.193752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:05:21.196201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:05:21.262768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:21.274485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-33e9a771-d88b-4208-8b39-a792ae0094ee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:21.284510 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-33e9a771-d88b-4208-8b39-a792ae0094ee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1213 microversion: 2.1 time: 0.121012 Aug 27 05:05:21.286299 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1296/2657] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:21 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:21.300563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ccfdfc1-ddb0-48fa-b340-5c1508d13255 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5696c25e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:21.373802 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f46d99b-6e5b-402b-887c-6c04bc285afa tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.301016 Aug 27 05:05:21.378987 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1362/2658] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:05:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:05:21.387111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-84a3219d-c696-49ff-9cf0-88abc3531df8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:21.387874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-84a3219d-c696-49ff-9cf0-88abc3531df8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:21.602716 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ccfdfc1-ddb0-48fa-b340-5c1508d13255 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.142943 Aug 27 05:05:21.602716 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1297/2659] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:21 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:21.608620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-84a3219d-c696-49ff-9cf0-88abc3531df8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:21.608620 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-84a3219d-c696-49ff-9cf0-88abc3531df8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1215 microversion: 2.1 time: 0.195357 Aug 27 05:05:21.608620 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1363/2660] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:21 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:22.309889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4755ffd-2151-4704-8714-48dc3e479910 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:22.310479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4755ffd-2151-4704-8714-48dc3e479910 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:22.317152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4755ffd-2151-4704-8714-48dc3e479910 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:22.318587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4755ffd-2151-4704-8714-48dc3e479910 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:22.319464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4755ffd-2151-4704-8714-48dc3e479910 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:22.320361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4755ffd-2151-4704-8714-48dc3e479910 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:22.320988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4755ffd-2151-4704-8714-48dc3e479910 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:22.321843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4755ffd-2151-4704-8714-48dc3e479910 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:22.440995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b4755ffd-2151-4704-8714-48dc3e479910 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:22.450511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-de1a553b-3568-416f-b25d-f6154ef5c294 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5696a4940>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:22.452657 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4755ffd-2151-4704-8714-48dc3e479910 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1217 microversion: 2.1 time: 0.146608 Aug 27 05:05:22.453775 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1298/2661] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:22 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:22.514819 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-de1a553b-3568-416f-b25d-f6154ef5c294 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.068942 Aug 27 05:05:22.516104 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1364/2662] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:22 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:22.603606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e52a4ce-8541-4435-947c-d36b5d398f06 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:22.604162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1e52a4ce-8541-4435-947c-d36b5d398f06 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:22.615926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e52a4ce-8541-4435-947c-d36b5d398f06 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:22.616430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e52a4ce-8541-4435-947c-d36b5d398f06 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:22.616877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e52a4ce-8541-4435-947c-d36b5d398f06 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:22.621388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e52a4ce-8541-4435-947c-d36b5d398f06 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:22.621973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e52a4ce-8541-4435-947c-d36b5d398f06 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:22.622903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e52a4ce-8541-4435-947c-d36b5d398f06 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:22.752170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1e52a4ce-8541-4435-947c-d36b5d398f06 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:22.766134 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e52a4ce-8541-4435-947c-d36b5d398f06 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1267 microversion: 2.1 time: 0.166667 Aug 27 05:05:22.774371 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1299/2663] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:22 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:23.120440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:23.121806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:23.132504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:23.133441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:23.134139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:23.135071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:23.135694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:23.136198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:23.154596 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] HTTP exception thrown: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Request method failure captured: Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 HTTP/1.1 Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaRaE73oZDFo-DSrrU1x1b7zPhBzN8XRegUl56NXUZLmvnsXqLyhE2KiwLjG4CoZfyOzuGsxM1lxbebjw4Qri2a9eNtP4xAoxvhC4cdLwnRmbuJRuOb_t72VxGpVTKiHfAmJojbceN9lbnomXoNM4VRwOMWwE9Py8QoQgF16l2zxGc8 Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 8a3dc24c6ca7475e8fc12b435cb84c63 Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1763723318 Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8a3dc24c6ca7475e8fc12b435cb84c63", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8a3dc24c6ca7475e8fc12b435cb84c63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8a3dc24c6ca7475e8fc12b435cb84c63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8a3dc24c6ca7475e8fc12b435cb84c63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1763723318 Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 8a3dc24c6ca7475e8fc12b435cb84c63 Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1763723318 Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TaggedBootDevicesTest_v242-1763723318-project Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 4d0ae33c8651467ba9b736900f782a7b Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1763723318-project Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8'} Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:05:23.156535 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Returning 404 to user: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-75aab5e4-4dbe-4e6a-90ff-4632b3c7fa7a tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 404 len: 111 microversion: 2.42 time: 0.052869 Aug 27 05:05:23.160843 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1365/2664] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:05:23 2022] DELETE /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:05:23.168505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:23.169851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] [instance: 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:23.176990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:23.178437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:23.179307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:23.180032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:23.180714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:23.181349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:23.197274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] HTTP exception thrown: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Request method failure captured: Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 HTTP/1.1 Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaRaE73oZDFo-DSrrU1x1b7zPhBzN8XRegUl56NXUZLmvnsXqLyhE2KiwLjG4CoZfyOzuGsxM1lxbebjw4Qri2a9eNtP4xAoxvhC4cdLwnRmbuJRuOb_t72VxGpVTKiHfAmJojbceN9lbnomXoNM4VRwOMWwE9Py8QoQgF16l2zxGc8 Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 8a3dc24c6ca7475e8fc12b435cb84c63 Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1763723318 Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8a3dc24c6ca7475e8fc12b435cb84c63", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8a3dc24c6ca7475e8fc12b435cb84c63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8a3dc24c6ca7475e8fc12b435cb84c63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8a3dc24c6ca7475e8fc12b435cb84c63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1763723318 Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 8a3dc24c6ca7475e8fc12b435cb84c63 Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1763723318 Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TaggedBootDevicesTest_v242-1763723318-project Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 4d0ae33c8651467ba9b736900f782a7b Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1763723318-project Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8'} Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:05:23.198776 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:23.202669 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:05:23.202669 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:23.202669 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:23.202669 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:23.202669 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:05:23.202669 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:05:23.202669 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. Aug 27 05:05:23.202669 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:05:23.202669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] Returning 404 to user: Instance 9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:05:23.202669 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-96547abc-0fcf-46d0-9a1b-5cd84d2eded0 tempest-TaggedBootDevicesTest_v242-1763723318 tempest-TaggedBootDevicesTest_v242-1763723318-project] 10.222.0.58 "GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8" status: 404 len: 111 microversion: 2.42 time: 0.035797 Aug 27 05:05:23.202669 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1300/2665] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:23 2022] GET /compute/v2.1/servers/9dbd27d4-22cd-4fc5-b0a1-6d3e3f92f4f8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:05:23.475986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a820b69a-4dc1-43f2-9db5-adb936c8ac13 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:23.476606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a820b69a-4dc1-43f2-9db5-adb936c8ac13 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:23.489552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a820b69a-4dc1-43f2-9db5-adb936c8ac13 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:23.490118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a820b69a-4dc1-43f2-9db5-adb936c8ac13 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:23.490548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a820b69a-4dc1-43f2-9db5-adb936c8ac13 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:23.496017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a820b69a-4dc1-43f2-9db5-adb936c8ac13 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:23.496596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a820b69a-4dc1-43f2-9db5-adb936c8ac13 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:23.497064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a820b69a-4dc1-43f2-9db5-adb936c8ac13 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:23.534003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d596ecc3-9845-41fb-a4eb-63fbc3b5bea5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56968cf70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:23.610710 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d596ecc3-9845-41fb-a4eb-63fbc3b5bea5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.080792 Aug 27 05:05:23.616979 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1301/2666] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:23 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:23.698166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a820b69a-4dc1-43f2-9db5-adb936c8ac13 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:23.707031 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a820b69a-4dc1-43f2-9db5-adb936c8ac13 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1273 microversion: 2.1 time: 0.235750 Aug 27 05:05:23.710653 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1366/2667] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:23 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:23.809040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c4226cd6-e392-47c7-8cf7-d3202c3c80e7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:23.809873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c4226cd6-e392-47c7-8cf7-d3202c3c80e7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:23.816483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4226cd6-e392-47c7-8cf7-d3202c3c80e7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:23.817238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4226cd6-e392-47c7-8cf7-d3202c3c80e7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:23.817885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4226cd6-e392-47c7-8cf7-d3202c3c80e7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:23.819357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4226cd6-e392-47c7-8cf7-d3202c3c80e7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:23.820890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4226cd6-e392-47c7-8cf7-d3202c3c80e7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:23.826542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4226cd6-e392-47c7-8cf7-d3202c3c80e7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:23.940545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4226cd6-e392-47c7-8cf7-d3202c3c80e7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:23.950527 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c4226cd6-e392-47c7-8cf7-d3202c3c80e7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1273 microversion: 2.1 time: 0.161022 Aug 27 05:05:23.951604 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1302/2668] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:23 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:24.629673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-22a8193a-6aa7-481e-9c2e-e5babae0c5ef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56961d280>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:24.703891 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-22a8193a-6aa7-481e-9c2e-e5babae0c5ef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.077870 Aug 27 05:05:24.705023 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1367/2669] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:24 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:24.731164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bc0c9260-0da5-4f49-bf32-5af4a07faa24 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:24.731802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bc0c9260-0da5-4f49-bf32-5af4a07faa24 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:24.740421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc0c9260-0da5-4f49-bf32-5af4a07faa24 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:24.740923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc0c9260-0da5-4f49-bf32-5af4a07faa24 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:24.741500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc0c9260-0da5-4f49-bf32-5af4a07faa24 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:24.742281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc0c9260-0da5-4f49-bf32-5af4a07faa24 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:24.743688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc0c9260-0da5-4f49-bf32-5af4a07faa24 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:24.744244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc0c9260-0da5-4f49-bf32-5af4a07faa24 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:24.852189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bc0c9260-0da5-4f49-bf32-5af4a07faa24 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:24.862269 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bc0c9260-0da5-4f49-bf32-5af4a07faa24 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1271 microversion: 2.1 time: 0.136235 Aug 27 05:05:24.863461 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1303/2670] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:24 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:24.973009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a8ad58f-fb9f-4448-b1d1-000a385bd162 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:24.973668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0a8ad58f-fb9f-4448-b1d1-000a385bd162 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:24.988270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a8ad58f-fb9f-4448-b1d1-000a385bd162 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:24.988771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a8ad58f-fb9f-4448-b1d1-000a385bd162 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:24.989214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a8ad58f-fb9f-4448-b1d1-000a385bd162 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:24.990474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a8ad58f-fb9f-4448-b1d1-000a385bd162 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:24.990933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a8ad58f-fb9f-4448-b1d1-000a385bd162 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:24.991399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a8ad58f-fb9f-4448-b1d1-000a385bd162 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:25.094220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0a8ad58f-fb9f-4448-b1d1-000a385bd162 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:25.104983 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a8ad58f-fb9f-4448-b1d1-000a385bd162 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1273 microversion: 2.1 time: 0.136275 Aug 27 05:05:25.106603 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1368/2671] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:24 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:25.226851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-6e1ac624-e862-4ce8-a955-2516be2e2ff4 req-a812ccf5-5460-4708-8de9-24fb7c053354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e359f17-fa25-41b2-a570-f33bc74f53c4", "name": "network-vif-plugged", "status": "completed", "tag": "77bbdc0c-6ead-4e74-b3c1-521340163ee2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:25.247471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6e1ac624-e862-4ce8-a955-2516be2e2ff4 req-a812ccf5-5460-4708-8de9-24fb7c053354 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:25.247955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6e1ac624-e862-4ce8-a955-2516be2e2ff4 req-a812ccf5-5460-4708-8de9-24fb7c053354 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:25.248389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6e1ac624-e862-4ce8-a955-2516be2e2ff4 req-a812ccf5-5460-4708-8de9-24fb7c053354 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:25.269495 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-6e1ac624-e862-4ce8-a955-2516be2e2ff4 req-a812ccf5-5460-4708-8de9-24fb7c053354 service nova] Creating event network-vif-plugged:77bbdc0c-6ead-4e74-b3c1-521340163ee2 for instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 on n-h2-820368-35 Aug 27 05:05:25.283262 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-6e1ac624-e862-4ce8-a955-2516be2e2ff4 req-a812ccf5-5460-4708-8de9-24fb7c053354 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060676 Aug 27 05:05:25.287860 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1304/2672] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:25.719843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c4e39423-f022-4cdb-afec-fed0c4527d85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56961d5e0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:25.773082 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c4e39423-f022-4cdb-afec-fed0c4527d85 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.057138 Aug 27 05:05:25.773656 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1369/2673] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:25 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:25.890161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-011bc1e6-ebb3-4237-a47e-3440bffbc96e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:25.890884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-011bc1e6-ebb3-4237-a47e-3440bffbc96e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:25.906463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011bc1e6-ebb3-4237-a47e-3440bffbc96e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:25.906959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011bc1e6-ebb3-4237-a47e-3440bffbc96e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:25.907445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011bc1e6-ebb3-4237-a47e-3440bffbc96e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:25.908357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011bc1e6-ebb3-4237-a47e-3440bffbc96e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:25.908973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011bc1e6-ebb3-4237-a47e-3440bffbc96e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:25.909578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011bc1e6-ebb3-4237-a47e-3440bffbc96e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:26.081310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-011bc1e6-ebb3-4237-a47e-3440bffbc96e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:26.090592 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-011bc1e6-ebb3-4237-a47e-3440bffbc96e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1313 microversion: 2.1 time: 0.209943 Aug 27 05:05:26.095133 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1305/2674] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:25 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:26.127826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9fe69efa-1d4b-4dbd-be3b-f17a9b94ec7c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:26.128890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9fe69efa-1d4b-4dbd-be3b-f17a9b94ec7c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:26.139000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fe69efa-1d4b-4dbd-be3b-f17a9b94ec7c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:26.140332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fe69efa-1d4b-4dbd-be3b-f17a9b94ec7c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:26.142146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fe69efa-1d4b-4dbd-be3b-f17a9b94ec7c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:26.143643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fe69efa-1d4b-4dbd-be3b-f17a9b94ec7c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:26.149602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fe69efa-1d4b-4dbd-be3b-f17a9b94ec7c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:26.150453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fe69efa-1d4b-4dbd-be3b-f17a9b94ec7c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:26.335479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9fe69efa-1d4b-4dbd-be3b-f17a9b94ec7c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:26.346454 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9fe69efa-1d4b-4dbd-be3b-f17a9b94ec7c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1315 microversion: 2.1 time: 0.222545 Aug 27 05:05:26.347765 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1370/2675] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:26 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:26.788533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7fa10819-c05d-4997-8caf-75b8b26fdb9e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56964f940>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:26.854870 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7fa10819-c05d-4997-8caf-75b8b26fdb9e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.070202 Aug 27 05:05:26.856450 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1306/2676] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:26 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:27.117590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1c5830fb-d90b-42cd-b45c-9b15757b68cd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:27.118800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1c5830fb-d90b-42cd-b45c-9b15757b68cd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:27.119565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d412c975-5743-454f-b7f5-d38b7a7beb43 req-7f783ab0-2f2b-46f7-85b6-77032498ffac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d651cd6-26b2-42d8-a902-a63b9e2031e0", "tag": "4c90b0b6-88ed-4bcd-9abd-4403f18530ec"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:27.133127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c5830fb-d90b-42cd-b45c-9b15757b68cd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:27.133989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c5830fb-d90b-42cd-b45c-9b15757b68cd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:27.134960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c5830fb-d90b-42cd-b45c-9b15757b68cd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:27.135879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c5830fb-d90b-42cd-b45c-9b15757b68cd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:27.136279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d412c975-5743-454f-b7f5-d38b7a7beb43 req-7f783ab0-2f2b-46f7-85b6-77032498ffac service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:27.136503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c5830fb-d90b-42cd-b45c-9b15757b68cd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:27.137093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c5830fb-d90b-42cd-b45c-9b15757b68cd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:27.138063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d412c975-5743-454f-b7f5-d38b7a7beb43 req-7f783ab0-2f2b-46f7-85b6-77032498ffac service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:27.139221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d412c975-5743-454f-b7f5-d38b7a7beb43 req-7f783ab0-2f2b-46f7-85b6-77032498ffac service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:27.167224 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d412c975-5743-454f-b7f5-d38b7a7beb43 req-7f783ab0-2f2b-46f7-85b6-77032498ffac service nova] Creating event network-changed:4c90b0b6-88ed-4bcd-9abd-4403f18530ec for instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 on n-h1-820368-35 Aug 27 05:05:27.173328 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d412c975-5743-454f-b7f5-d38b7a7beb43 req-7f783ab0-2f2b-46f7-85b6-77032498ffac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078292 Aug 27 05:05:27.174637 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1371/2677] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:27.370281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-758b2ab6-091f-4cc5-86dd-c0bc3e49de5b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:27.371790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-758b2ab6-091f-4cc5-86dd-c0bc3e49de5b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:27.400785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-758b2ab6-091f-4cc5-86dd-c0bc3e49de5b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:27.402411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-758b2ab6-091f-4cc5-86dd-c0bc3e49de5b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:27.403897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-758b2ab6-091f-4cc5-86dd-c0bc3e49de5b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:27.405031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-758b2ab6-091f-4cc5-86dd-c0bc3e49de5b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:27.405788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-758b2ab6-091f-4cc5-86dd-c0bc3e49de5b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:27.406040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1c5830fb-d90b-42cd-b45c-9b15757b68cd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:27.407815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-758b2ab6-091f-4cc5-86dd-c0bc3e49de5b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:27.416027 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1c5830fb-d90b-42cd-b45c-9b15757b68cd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1313 microversion: 2.1 time: 0.303051 Aug 27 05:05:27.417846 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1307/2678] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:27 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:27.591386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-758b2ab6-091f-4cc5-86dd-c0bc3e49de5b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:27.599065 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-758b2ab6-091f-4cc5-86dd-c0bc3e49de5b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1315 microversion: 2.1 time: 0.234257 Aug 27 05:05:27.611465 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1372/2679] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:27 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:27.871350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53653bbf-1129-456a-ab36-9702f5d3f7a2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5696c2a60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:27.930674 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-53653bbf-1129-456a-ab36-9702f5d3f7a2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.064533 Aug 27 05:05:27.931933 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1308/2680] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:27 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:28.438368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb456e36-9c20-4625-9396-fdf01e5839af tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:28.439761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cb456e36-9c20-4625-9396-fdf01e5839af tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:28.449367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb456e36-9c20-4625-9396-fdf01e5839af tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:28.450062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb456e36-9c20-4625-9396-fdf01e5839af tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:28.450668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb456e36-9c20-4625-9396-fdf01e5839af tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:28.451510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb456e36-9c20-4625-9396-fdf01e5839af tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:28.452174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb456e36-9c20-4625-9396-fdf01e5839af tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:28.452695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb456e36-9c20-4625-9396-fdf01e5839af tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:28.622704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-94db7d67-80a3-4284-bfc4-6db389a67702 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:28.623261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb456e36-9c20-4625-9396-fdf01e5839af tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:28.623790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-94db7d67-80a3-4284-bfc4-6db389a67702 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:28.632063 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb456e36-9c20-4625-9396-fdf01e5839af tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1313 microversion: 2.1 time: 0.197987 Aug 27 05:05:28.633396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94db7d67-80a3-4284-bfc4-6db389a67702 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:28.634000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94db7d67-80a3-4284-bfc4-6db389a67702 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:28.634845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94db7d67-80a3-4284-bfc4-6db389a67702 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:28.635598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94db7d67-80a3-4284-bfc4-6db389a67702 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:28.636054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94db7d67-80a3-4284-bfc4-6db389a67702 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:28.636957 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1373/2681] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:28 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:28.648002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94db7d67-80a3-4284-bfc4-6db389a67702 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:28.670804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:28.809088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-94db7d67-80a3-4284-bfc4-6db389a67702 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:28.817338 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-94db7d67-80a3-4284-bfc4-6db389a67702 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1315 microversion: 2.1 time: 0.199102 Aug 27 05:05:28.818052 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1309/2682] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:28 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:28.948441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-98d7e56d-9ede-4fe5-8a4c-78b8b5b848dc tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56966f670>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:29.003655 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-98d7e56d-9ede-4fe5-8a4c-78b8b5b848dc tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.062430 Aug 27 05:05:29.004893 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1374/2683] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:28 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:29.191683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1db60f47-3dca-423c-9e9a-25dd5165401d req-1576643c-61ef-4905-a172-c6107e153860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea714cda-ef28-4c42-9836-7dd70dcc4f4d", "tag": "ed467809-03cb-4e8b-bbb6-4b9ea233dca0"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:29.201976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1db60f47-3dca-423c-9e9a-25dd5165401d req-1576643c-61ef-4905-a172-c6107e153860 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:29.202465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1db60f47-3dca-423c-9e9a-25dd5165401d req-1576643c-61ef-4905-a172-c6107e153860 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:29.202894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1db60f47-3dca-423c-9e9a-25dd5165401d req-1576643c-61ef-4905-a172-c6107e153860 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:29.214477 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1db60f47-3dca-423c-9e9a-25dd5165401d req-1576643c-61ef-4905-a172-c6107e153860 service nova] Creating event network-changed:ed467809-03cb-4e8b-bbb6-4b9ea233dca0 for instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d on n-h1-820368-35 Aug 27 05:05:29.219252 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1db60f47-3dca-423c-9e9a-25dd5165401d req-1576643c-61ef-4905-a172-c6107e153860 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031280 Aug 27 05:05:29.219847 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1310/2684] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:29.660132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13fbc8ec-8c33-45be-9ba7-e9b09f5ff119 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:29.660749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-13fbc8ec-8c33-45be-9ba7-e9b09f5ff119 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:29.667622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fbc8ec-8c33-45be-9ba7-e9b09f5ff119 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:29.668119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fbc8ec-8c33-45be-9ba7-e9b09f5ff119 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:29.668563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fbc8ec-8c33-45be-9ba7-e9b09f5ff119 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:29.669389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fbc8ec-8c33-45be-9ba7-e9b09f5ff119 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:29.669850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fbc8ec-8c33-45be-9ba7-e9b09f5ff119 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:29.670282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fbc8ec-8c33-45be-9ba7-e9b09f5ff119 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:29.843613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-839724bd-1185-4804-a330-e788d14228bd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:29.844471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-839724bd-1185-4804-a330-e788d14228bd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:29.849334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13fbc8ec-8c33-45be-9ba7-e9b09f5ff119 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:29.859273 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-13fbc8ec-8c33-45be-9ba7-e9b09f5ff119 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1313 microversion: 2.1 time: 0.203356 Aug 27 05:05:29.861939 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1375/2685] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:29 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:29.864074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-839724bd-1185-4804-a330-e788d14228bd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:29.864890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-839724bd-1185-4804-a330-e788d14228bd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:29.865607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-839724bd-1185-4804-a330-e788d14228bd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:29.866546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-839724bd-1185-4804-a330-e788d14228bd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:29.867246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-839724bd-1185-4804-a330-e788d14228bd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:29.867895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-839724bd-1185-4804-a330-e788d14228bd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:30.019219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5e45d3be-1a91-4f8c-8f33-aad6da895a6a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56962bee0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:30.038259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-839724bd-1185-4804-a330-e788d14228bd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:30.049274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-839724bd-1185-4804-a330-e788d14228bd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1315 microversion: 2.1 time: 0.211726 Aug 27 05:05:30.050419 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1311/2686] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:29 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:30.118586 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5e45d3be-1a91-4f8c-8f33-aad6da895a6a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.103145 Aug 27 05:05:30.119857 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1376/2687] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:30 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:30.886400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8abf6518-2b46-43ab-b8f6-f4f914fcae98 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:30.887136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8abf6518-2b46-43ab-b8f6-f4f914fcae98 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:30.897097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8abf6518-2b46-43ab-b8f6-f4f914fcae98 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:30.897596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8abf6518-2b46-43ab-b8f6-f4f914fcae98 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:30.898201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8abf6518-2b46-43ab-b8f6-f4f914fcae98 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:30.898973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8abf6518-2b46-43ab-b8f6-f4f914fcae98 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:30.899669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8abf6518-2b46-43ab-b8f6-f4f914fcae98 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:30.900412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8abf6518-2b46-43ab-b8f6-f4f914fcae98 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:30.937612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:31.072781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aed5208f-a0f6-402e-86dd-7bada0a0c456 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:31.074182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aed5208f-a0f6-402e-86dd-7bada0a0c456 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:31.082048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed5208f-a0f6-402e-86dd-7bada0a0c456 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:31.082971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed5208f-a0f6-402e-86dd-7bada0a0c456 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:31.084432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed5208f-a0f6-402e-86dd-7bada0a0c456 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:31.085580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed5208f-a0f6-402e-86dd-7bada0a0c456 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:31.086828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed5208f-a0f6-402e-86dd-7bada0a0c456 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:31.087519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed5208f-a0f6-402e-86dd-7bada0a0c456 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:31.124404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:31.189135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8abf6518-2b46-43ab-b8f6-f4f914fcae98 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:31.213109 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8abf6518-2b46-43ab-b8f6-f4f914fcae98 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1313 microversion: 2.1 time: 0.332064 Aug 27 05:05:31.217951 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1312/2688] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:30 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:31.227743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b7ddc03-6610-4bbb-9362-81b8643e5952 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5695fb8b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:31.279620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:31.318468 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b7ddc03-6610-4bbb-9362-81b8643e5952 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.098965 Aug 27 05:05:31.328570 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1313/2689] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:31 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:31.426368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aed5208f-a0f6-402e-86dd-7bada0a0c456 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:31.435055 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aed5208f-a0f6-402e-86dd-7bada0a0c456 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1315 microversion: 2.1 time: 0.367456 Aug 27 05:05:31.435662 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1377/2690] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:31 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:32.241373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0cb2c0c0-e641-4e79-96b8-4e23201e939a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:32.242110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0cb2c0c0-e641-4e79-96b8-4e23201e939a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:32.255609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb2c0c0-e641-4e79-96b8-4e23201e939a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:32.259478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb2c0c0-e641-4e79-96b8-4e23201e939a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:32.259947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb2c0c0-e641-4e79-96b8-4e23201e939a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:32.261477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb2c0c0-e641-4e79-96b8-4e23201e939a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:32.262005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb2c0c0-e641-4e79-96b8-4e23201e939a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:32.262450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb2c0c0-e641-4e79-96b8-4e23201e939a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:32.335846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33ec64a6-7c95-4cdb-828d-fe2a91e78199 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56970d700>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:32.348387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:32.453186 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-33ec64a6-7c95-4cdb-828d-fe2a91e78199 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.121912 Aug 27 05:05:32.454423 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1378/2691] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:32 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:32.484273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc8c231a-9d2a-4544-bf6f-20eaac5a5cd8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:32.484911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dc8c231a-9d2a-4544-bf6f-20eaac5a5cd8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:32.501191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc8c231a-9d2a-4544-bf6f-20eaac5a5cd8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:32.502103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc8c231a-9d2a-4544-bf6f-20eaac5a5cd8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:32.503249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc8c231a-9d2a-4544-bf6f-20eaac5a5cd8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:32.504277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc8c231a-9d2a-4544-bf6f-20eaac5a5cd8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:32.504965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc8c231a-9d2a-4544-bf6f-20eaac5a5cd8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:32.505660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc8c231a-9d2a-4544-bf6f-20eaac5a5cd8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:32.591891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0cb2c0c0-e641-4e79-96b8-4e23201e939a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:32.601452 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0cb2c0c0-e641-4e79-96b8-4e23201e939a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1313 microversion: 2.1 time: 0.365680 Aug 27 05:05:32.620301 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1314/2692] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:32 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:32.779455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dc8c231a-9d2a-4544-bf6f-20eaac5a5cd8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:32.797296 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dc8c231a-9d2a-4544-bf6f-20eaac5a5cd8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1315 microversion: 2.1 time: 0.341379 Aug 27 05:05:32.800098 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1379/2693] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:32 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:33.470185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad094ed8-50c2-4868-800f-12f71523fbf1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb564a65940>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:33.562141 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ad094ed8-50c2-4868-800f-12f71523fbf1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.096769 Aug 27 05:05:33.572078 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1315/2694] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:33 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:33.626306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c24cddd1-8938-4181-9360-ec152c5c1ea0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:33.626940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c24cddd1-8938-4181-9360-ec152c5c1ea0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:33.634817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c24cddd1-8938-4181-9360-ec152c5c1ea0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:33.635350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c24cddd1-8938-4181-9360-ec152c5c1ea0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:33.635948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c24cddd1-8938-4181-9360-ec152c5c1ea0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:33.636844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c24cddd1-8938-4181-9360-ec152c5c1ea0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:33.637476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c24cddd1-8938-4181-9360-ec152c5c1ea0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:33.638070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c24cddd1-8938-4181-9360-ec152c5c1ea0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:33.823376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d70d2fa-9911-4e53-a4ee-a721a8afde4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:33.824070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d70d2fa-9911-4e53-a4ee-a721a8afde4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:33.841562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d70d2fa-9911-4e53-a4ee-a721a8afde4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:33.843606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d70d2fa-9911-4e53-a4ee-a721a8afde4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:33.844271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d70d2fa-9911-4e53-a4ee-a721a8afde4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:33.850705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d70d2fa-9911-4e53-a4ee-a721a8afde4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:33.851474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d70d2fa-9911-4e53-a4ee-a721a8afde4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:33.852082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d70d2fa-9911-4e53-a4ee-a721a8afde4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:33.909405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c24cddd1-8938-4181-9360-ec152c5c1ea0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:33.923320 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c24cddd1-8938-4181-9360-ec152c5c1ea0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1313 microversion: 2.1 time: 0.301266 Aug 27 05:05:33.932500 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1380/2695] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:33 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:34.089191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d70d2fa-9911-4e53-a4ee-a721a8afde4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:34.105670 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d70d2fa-9911-4e53-a4ee-a721a8afde4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1315 microversion: 2.1 time: 0.283249 Aug 27 05:05:34.105670 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1316/2696] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:33 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:34.570655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f85812cb-f4bb-4bb3-9d6d-d494f41c8a43 req-2ab303c1-2ada-4cd0-b74b-2610cfea042d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea714cda-ef28-4c42-9836-7dd70dcc4f4d", "name": "network-vif-plugged", "status": "completed", "tag": "ed467809-03cb-4e8b-bbb6-4b9ea233dca0"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:34.577982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0189fc17-7591-4130-8e53-4b35923c6754 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56965d790>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:34.653598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f85812cb-f4bb-4bb3-9d6d-d494f41c8a43 req-2ab303c1-2ada-4cd0-b74b-2610cfea042d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:34.654094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f85812cb-f4bb-4bb3-9d6d-d494f41c8a43 req-2ab303c1-2ada-4cd0-b74b-2610cfea042d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:34.654575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f85812cb-f4bb-4bb3-9d6d-d494f41c8a43 req-2ab303c1-2ada-4cd0-b74b-2610cfea042d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:34.669051 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0189fc17-7591-4130-8e53-4b35923c6754 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.095375 Aug 27 05:05:34.686841 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1317/2697] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:34 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:34.695973 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f85812cb-f4bb-4bb3-9d6d-d494f41c8a43 req-2ab303c1-2ada-4cd0-b74b-2610cfea042d service nova] Creating event network-vif-plugged:ed467809-03cb-4e8b-bbb6-4b9ea233dca0 for instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d on n-h1-820368-35 Aug 27 05:05:34.710028 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f85812cb-f4bb-4bb3-9d6d-d494f41c8a43 req-2ab303c1-2ada-4cd0-b74b-2610cfea042d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143398 Aug 27 05:05:34.715675 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1381/2698] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:34.955542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8da59a2b-a1dc-4c61-9405-4de277194373 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:34.956179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8da59a2b-a1dc-4c61-9405-4de277194373 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:34.974925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8da59a2b-a1dc-4c61-9405-4de277194373 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:34.985783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8da59a2b-a1dc-4c61-9405-4de277194373 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:34.987007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8da59a2b-a1dc-4c61-9405-4de277194373 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:34.989312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8da59a2b-a1dc-4c61-9405-4de277194373 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:34.992158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8da59a2b-a1dc-4c61-9405-4de277194373 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:34.992764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8da59a2b-a1dc-4c61-9405-4de277194373 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:35.126383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6e200eec-3062-4b21-a5a8-89e4707b2cae tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:35.131706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6e200eec-3062-4b21-a5a8-89e4707b2cae tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:35.145481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e200eec-3062-4b21-a5a8-89e4707b2cae tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:35.161903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e200eec-3062-4b21-a5a8-89e4707b2cae tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:35.170345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e200eec-3062-4b21-a5a8-89e4707b2cae tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:35.171465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e200eec-3062-4b21-a5a8-89e4707b2cae tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:35.172298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e200eec-3062-4b21-a5a8-89e4707b2cae tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:35.173117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e200eec-3062-4b21-a5a8-89e4707b2cae tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:35.243902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8da59a2b-a1dc-4c61-9405-4de277194373 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:35.254536 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8da59a2b-a1dc-4c61-9405-4de277194373 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1313 microversion: 2.1 time: 0.301116 Aug 27 05:05:35.272425 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1318/2699] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:34 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:35.414096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6e200eec-3062-4b21-a5a8-89e4707b2cae tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:35.422731 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6e200eec-3062-4b21-a5a8-89e4707b2cae tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1315 microversion: 2.1 time: 0.305237 Aug 27 05:05:35.423345 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1382/2700] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:35 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:35.693997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53dc5a38-4270-4c5f-9da0-e359036452ed tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565008b80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:35.801726 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-53dc5a38-4270-4c5f-9da0-e359036452ed tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.111635 Aug 27 05:05:35.803374 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1319/2701] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:35 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:36.277914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a9d314b-da9a-4a07-bf05-92f08d4f7440 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:36.278513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0a9d314b-da9a-4a07-bf05-92f08d4f7440 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:36.289129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a9d314b-da9a-4a07-bf05-92f08d4f7440 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:36.289629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a9d314b-da9a-4a07-bf05-92f08d4f7440 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:36.290079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a9d314b-da9a-4a07-bf05-92f08d4f7440 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:36.296798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a9d314b-da9a-4a07-bf05-92f08d4f7440 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:36.297641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a9d314b-da9a-4a07-bf05-92f08d4f7440 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:36.298238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a9d314b-da9a-4a07-bf05-92f08d4f7440 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:36.447301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3f32fd02-d6a0-4654-bb22-3ed23f80283e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:36.457076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3f32fd02-d6a0-4654-bb22-3ed23f80283e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:36.484703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f32fd02-d6a0-4654-bb22-3ed23f80283e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:36.485229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f32fd02-d6a0-4654-bb22-3ed23f80283e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:36.487826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f32fd02-d6a0-4654-bb22-3ed23f80283e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:36.488966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f32fd02-d6a0-4654-bb22-3ed23f80283e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:36.492147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f32fd02-d6a0-4654-bb22-3ed23f80283e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:36.492802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f32fd02-d6a0-4654-bb22-3ed23f80283e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:36.574994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0a9d314b-da9a-4a07-bf05-92f08d4f7440 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:36.585620 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a9d314b-da9a-4a07-bf05-92f08d4f7440 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1313 microversion: 2.1 time: 0.312123 Aug 27 05:05:36.604460 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1383/2702] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:36 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:36.734896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f5588a12-578a-4135-89a9-076aeff4e85c req-94d06896-82f1-4233-817e-156b97dca3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d651cd6-26b2-42d8-a902-a63b9e2031e0", "name": "network-vif-plugged", "status": "completed", "tag": "4c90b0b6-88ed-4bcd-9abd-4403f18530ec"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:36.757320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f32fd02-d6a0-4654-bb22-3ed23f80283e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:36.761504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f5588a12-578a-4135-89a9-076aeff4e85c req-94d06896-82f1-4233-817e-156b97dca3fe service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:36.762206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f5588a12-578a-4135-89a9-076aeff4e85c req-94d06896-82f1-4233-817e-156b97dca3fe service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:36.763795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f5588a12-578a-4135-89a9-076aeff4e85c req-94d06896-82f1-4233-817e-156b97dca3fe service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:36.781074 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3f32fd02-d6a0-4654-bb22-3ed23f80283e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1315 microversion: 2.1 time: 0.339810 Aug 27 05:05:36.795568 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1320/2703] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:36 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:36.821746 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f5588a12-578a-4135-89a9-076aeff4e85c req-94d06896-82f1-4233-817e-156b97dca3fe service nova] Creating event network-vif-plugged:4c90b0b6-88ed-4bcd-9abd-4403f18530ec for instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 on n-h1-820368-35 Aug 27 05:05:36.847832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8890c8f5-d542-4c33-8e64-7d1435776fc8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565008b80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:36.849844 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f5588a12-578a-4135-89a9-076aeff4e85c req-94d06896-82f1-4233-817e-156b97dca3fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122326 Aug 27 05:05:36.860667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1384/2704] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:05:36.945613 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8890c8f5-d542-4c33-8e64-7d1435776fc8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.101838 Aug 27 05:05:36.946208 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1321/2705] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:36 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:37.610391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8c7db3a-898b-4407-aed9-1a6527dcc0f7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:37.611148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8c7db3a-898b-4407-aed9-1a6527dcc0f7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:37.628653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c7db3a-898b-4407-aed9-1a6527dcc0f7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:37.629160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c7db3a-898b-4407-aed9-1a6527dcc0f7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:37.629610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c7db3a-898b-4407-aed9-1a6527dcc0f7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:37.630935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c7db3a-898b-4407-aed9-1a6527dcc0f7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:37.631833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c7db3a-898b-4407-aed9-1a6527dcc0f7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:37.632274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c7db3a-898b-4407-aed9-1a6527dcc0f7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:37.810190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a1116eb-8e15-426c-8424-8897481c36f8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:37.810574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6a1116eb-8e15-426c-8424-8897481c36f8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:37.826297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a1116eb-8e15-426c-8424-8897481c36f8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:37.826941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a1116eb-8e15-426c-8424-8897481c36f8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:37.830773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a1116eb-8e15-426c-8424-8897481c36f8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:37.846512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a1116eb-8e15-426c-8424-8897481c36f8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:37.847715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a1116eb-8e15-426c-8424-8897481c36f8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:37.849773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a1116eb-8e15-426c-8424-8897481c36f8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:37.872865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8c7db3a-898b-4407-aed9-1a6527dcc0f7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:37.896934 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8c7db3a-898b-4407-aed9-1a6527dcc0f7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1313 microversion: 2.1 time: 0.291819 Aug 27 05:05:37.900239 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1385/2706] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:37 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:37.963400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e96a7287-14c5-47b9-bc32-d192251104b3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56970db80>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:38.057266 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e96a7287-14c5-47b9-bc32-d192251104b3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.100407 Aug 27 05:05:38.058602 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1386/2707] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:37 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:38.183777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6a1116eb-8e15-426c-8424-8897481c36f8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:38.193589 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6a1116eb-8e15-426c-8424-8897481c36f8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1503 microversion: 2.1 time: 0.392077 Aug 27 05:05:38.217221 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1322/2708] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:37 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1503 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:38.923836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60cbf4cd-8535-4fe8-a7f8-67a2bd189587 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:38.925153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60cbf4cd-8535-4fe8-a7f8-67a2bd189587 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:38.943467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60cbf4cd-8535-4fe8-a7f8-67a2bd189587 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:38.944368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60cbf4cd-8535-4fe8-a7f8-67a2bd189587 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:38.946531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60cbf4cd-8535-4fe8-a7f8-67a2bd189587 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:38.947950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60cbf4cd-8535-4fe8-a7f8-67a2bd189587 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:38.951080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60cbf4cd-8535-4fe8-a7f8-67a2bd189587 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:38.951815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60cbf4cd-8535-4fe8-a7f8-67a2bd189587 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:39.075547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-03d7b930-bb4c-46a4-a35c-d1760b4fc2fe tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565008040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:39.150812 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-03d7b930-bb4c-46a4-a35c-d1760b4fc2fe tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.081174 Aug 27 05:05:39.178179 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1323/2709] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:39 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:39.254514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-60cbf4cd-8535-4fe8-a7f8-67a2bd189587 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:39.266893 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-60cbf4cd-8535-4fe8-a7f8-67a2bd189587 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1463 microversion: 2.1 time: 0.349080 Aug 27 05:05:39.268106 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1387/2710] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:38 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1463 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:39.292156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:39.295319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:39.336997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:39.338874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:39.341803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:39.344894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:39.346092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:39.347469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:39.484658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:39.493553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Old instance type m1.heat2, new instance type m1.heat {{(pid=128547) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:05:39.505305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:05:39.506299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:05:39.507781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:05:39.509495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:05:39.510010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:05:39.671913 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1c1c4c6-39a2-43df-b776-1d74e36f6317 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "POST /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0/action" status: 202 len: 0 microversion: 2.1 time: 0.384760 Aug 27 05:05:39.673394 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1324/2711] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:05:39 2022] POST /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:05:39.686268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-25674e4b-2b48-4021-8b67-f124db4eed3f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:39.689540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-25674e4b-2b48-4021-8b67-f124db4eed3f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:39.725568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25674e4b-2b48-4021-8b67-f124db4eed3f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:39.727259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25674e4b-2b48-4021-8b67-f124db4eed3f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:39.729263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25674e4b-2b48-4021-8b67-f124db4eed3f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:39.731130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25674e4b-2b48-4021-8b67-f124db4eed3f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:39.731927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25674e4b-2b48-4021-8b67-f124db4eed3f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:39.732371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25674e4b-2b48-4021-8b67-f124db4eed3f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:40.054966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-25674e4b-2b48-4021-8b67-f124db4eed3f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:40.066609 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-25674e4b-2b48-4021-8b67-f124db4eed3f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1472 microversion: 2.1 time: 0.386692 Aug 27 05:05:40.071043 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1388/2712] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:39 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:40.169657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b6e6da31-ca8e-4190-9936-110ff9fcc524 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565056430>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:40.279057 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b6e6da31-ca8e-4190-9936-110ff9fcc524 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.110162 Aug 27 05:05:40.283175 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1325/2713] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:40 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:41.088863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f3a299bc-c9a8-4b93-af8b-59441662bb66 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:41.090100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f3a299bc-c9a8-4b93-af8b-59441662bb66 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:41.110362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3a299bc-c9a8-4b93-af8b-59441662bb66 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:41.116183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3a299bc-c9a8-4b93-af8b-59441662bb66 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:41.117064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3a299bc-c9a8-4b93-af8b-59441662bb66 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:41.118219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3a299bc-c9a8-4b93-af8b-59441662bb66 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:41.118884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3a299bc-c9a8-4b93-af8b-59441662bb66 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:41.119628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3a299bc-c9a8-4b93-af8b-59441662bb66 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:41.125017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-28a93913-a892-413e-a885-8d18dbcac7d1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4977962c-f7aa-4990-938b-6fafb0ad784b"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:41.128110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-28a93913-a892-413e-a885-8d18dbcac7d1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:41.134941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28a93913-a892-413e-a885-8d18dbcac7d1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:41.135551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28a93913-a892-413e-a885-8d18dbcac7d1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:41.136087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28a93913-a892-413e-a885-8d18dbcac7d1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:41.136950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28a93913-a892-413e-a885-8d18dbcac7d1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:41.138126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28a93913-a892-413e-a885-8d18dbcac7d1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:41.138701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28a93913-a892-413e-a885-8d18dbcac7d1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:41.152857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:41.573801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f3a299bc-c9a8-4b93-af8b-59441662bb66 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:41.585872 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f3a299bc-c9a8-4b93-af8b-59441662bb66 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1472 microversion: 2.1 time: 0.501292 Aug 27 05:05:41.601032 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1389/2714] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:41 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1472 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:41.605737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ebd7a319-e990-4bc1-af09-bfbe48502b1c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56966fc10>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:41.681356 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ebd7a319-e990-4bc1-af09-bfbe48502b1c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.066665 Aug 27 05:05:41.684058 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1390/2715] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:41 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:42.055690 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-28a93913-a892-413e-a885-8d18dbcac7d1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.934863 Aug 27 05:05:42.067462 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1326/2716] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:05:41 2022] POST /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:05:42.619040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-540a2331-f7c3-41ad-8d02-445569da213b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:42.619535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-540a2331-f7c3-41ad-8d02-445569da213b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:42.651274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540a2331-f7c3-41ad-8d02-445569da213b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:42.661004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540a2331-f7c3-41ad-8d02-445569da213b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:42.664201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540a2331-f7c3-41ad-8d02-445569da213b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:42.665415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540a2331-f7c3-41ad-8d02-445569da213b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:42.666052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540a2331-f7c3-41ad-8d02-445569da213b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:42.671389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540a2331-f7c3-41ad-8d02-445569da213b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:42.701023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db637f4a-115f-4e05-a5b6-0aed08e3d81b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb564fd6ca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:42.774137 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db637f4a-115f-4e05-a5b6-0aed08e3d81b tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.078921 Aug 27 05:05:42.775312 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1327/2717] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:42 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:43.300156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-540a2331-f7c3-41ad-8d02-445569da213b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:43.317077 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-540a2331-f7c3-41ad-8d02-445569da213b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1472 microversion: 2.1 time: 0.700618 Aug 27 05:05:43.321689 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1391/2718] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:42 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1472 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:43.792859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9e001be5-e22c-4e6e-8f9d-3f15152b94c4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5655dac10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:43.866782 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9e001be5-e22c-4e6e-8f9d-3f15152b94c4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.077949 Aug 27 05:05:43.868106 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1328/2719] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:43 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:44.343533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-94ed6fa0-d9da-49cb-bf38-0cd804107e7a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:44.344790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-94ed6fa0-d9da-49cb-bf38-0cd804107e7a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:44.388182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94ed6fa0-d9da-49cb-bf38-0cd804107e7a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:44.396392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94ed6fa0-d9da-49cb-bf38-0cd804107e7a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:44.397147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94ed6fa0-d9da-49cb-bf38-0cd804107e7a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:44.398074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94ed6fa0-d9da-49cb-bf38-0cd804107e7a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:44.398700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94ed6fa0-d9da-49cb-bf38-0cd804107e7a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:44.401595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94ed6fa0-d9da-49cb-bf38-0cd804107e7a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:44.882719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b0548133-9ebf-4232-a68d-d684ee9a83f2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56968ca60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:44.949454 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b0548133-9ebf-4232-a68d-d684ee9a83f2 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.071187 Aug 27 05:05:44.950793 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1329/2720] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:44 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:45.352466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-94ed6fa0-d9da-49cb-bf38-0cd804107e7a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:45.364949 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-94ed6fa0-d9da-49cb-bf38-0cd804107e7a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1472 microversion: 2.1 time: 1.024405 Aug 27 05:05:45.367806 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1392/2721] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:44 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1472 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:45.965532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e156ccd4-8e70-4bf9-b1d4-fe2023a2451a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5655a8820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:46.045520 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e156ccd4-8e70-4bf9-b1d4-fe2023a2451a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.084658 Aug 27 05:05:46.046088 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1330/2722] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:45 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:46.388850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-313c91eb-e642-4f38-9d97-43d8cf0b1bb7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:46.389507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-313c91eb-e642-4f38-9d97-43d8cf0b1bb7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:46.401926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-313c91eb-e642-4f38-9d97-43d8cf0b1bb7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:46.402419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-313c91eb-e642-4f38-9d97-43d8cf0b1bb7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:46.402853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-313c91eb-e642-4f38-9d97-43d8cf0b1bb7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:46.405409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-313c91eb-e642-4f38-9d97-43d8cf0b1bb7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:46.406089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-313c91eb-e642-4f38-9d97-43d8cf0b1bb7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:46.411883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-313c91eb-e642-4f38-9d97-43d8cf0b1bb7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:47.062403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9f70962d-3e91-4bf9-9740-54a9ee271271 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56964f4c0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:47.109274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-313c91eb-e642-4f38-9d97-43d8cf0b1bb7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:47.125147 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-313c91eb-e642-4f38-9d97-43d8cf0b1bb7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.735868 Aug 27 05:05:47.126790 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1393/2723] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:46 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:47.167978 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9f70962d-3e91-4bf9-9740-54a9ee271271 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.110697 Aug 27 05:05:47.169097 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1331/2724] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:47 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:48.148058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ff38ea6b-2a4a-4259-ba00-3428747d8c50 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:48.150667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ff38ea6b-2a4a-4259-ba00-3428747d8c50 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:48.167319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff38ea6b-2a4a-4259-ba00-3428747d8c50 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:48.167950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff38ea6b-2a4a-4259-ba00-3428747d8c50 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:48.169448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff38ea6b-2a4a-4259-ba00-3428747d8c50 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:48.170820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff38ea6b-2a4a-4259-ba00-3428747d8c50 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:48.171488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff38ea6b-2a4a-4259-ba00-3428747d8c50 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:48.171986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff38ea6b-2a4a-4259-ba00-3428747d8c50 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:48.184634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-158ae436-4e54-4493-9ad4-9a7ba7dcb7ac tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56587cdc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:48.283718 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-158ae436-4e54-4493-9ad4-9a7ba7dcb7ac tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.103823 Aug 27 05:05:48.284578 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1332/2725] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:48 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:48.563804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ff38ea6b-2a4a-4259-ba00-3428747d8c50 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:48.566572 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ff38ea6b-2a4a-4259-ba00-3428747d8c50 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.418153 Aug 27 05:05:48.569629 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1394/2726] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:48 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:49.303048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fde1dcc6-dde2-4e40-82b9-f3443ac48ff1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565022430>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:49.389792 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fde1dcc6-dde2-4e40-82b9-f3443ac48ff1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1409 microversion: 2.1 time: 0.094162 Aug 27 05:05:49.390387 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1333/2727] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:49 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1409 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:49.591275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-91c1c8ff-9e79-4766-bba2-fe8a5b9550ff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:49.591910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-91c1c8ff-9e79-4766-bba2-fe8a5b9550ff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:49.607892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c1c8ff-9e79-4766-bba2-fe8a5b9550ff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:49.608394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c1c8ff-9e79-4766-bba2-fe8a5b9550ff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:49.608842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c1c8ff-9e79-4766-bba2-fe8a5b9550ff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:49.609569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c1c8ff-9e79-4766-bba2-fe8a5b9550ff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:49.610027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c1c8ff-9e79-4766-bba2-fe8a5b9550ff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:49.610719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c1c8ff-9e79-4766-bba2-fe8a5b9550ff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.086495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-91c1c8ff-9e79-4766-bba2-fe8a5b9550ff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:50.097579 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-91c1c8ff-9e79-4766-bba2-fe8a5b9550ff tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.509423 Aug 27 05:05:50.099716 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1395/2728] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:49 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:50.407051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-deb08af2-f9ba-44ab-a08e-6f6251625cf4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5655db820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:50.470865 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-deb08af2-f9ba-44ab-a08e-6f6251625cf4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1418 microversion: 2.1 time: 0.069075 Aug 27 05:05:50.472007 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1334/2729] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:50 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1418 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:50.485347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8fcf22bb-e98a-4345-9cdf-80ef8dd9c0b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56961ff70>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:50.538977 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8fcf22bb-e98a-4345-9cdf-80ef8dd9c0b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 200 len: 1418 microversion: 2.1 time: 0.057812 Aug 27 05:05:50.539983 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1396/2730] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:50 2022] GET /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 1418 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:50.561735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-706b52cc-7d25-48ed-85dc-717235b30449 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb564fd6160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:51.124461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-63ca1e2d-52cc-42f1-88be-9278fd47ebe7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:51.125092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-63ca1e2d-52cc-42f1-88be-9278fd47ebe7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:51.135480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=47 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:51.140855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63ca1e2d-52cc-42f1-88be-9278fd47ebe7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.141365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63ca1e2d-52cc-42f1-88be-9278fd47ebe7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.144604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63ca1e2d-52cc-42f1-88be-9278fd47ebe7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.147646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63ca1e2d-52cc-42f1-88be-9278fd47ebe7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.153175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63ca1e2d-52cc-42f1-88be-9278fd47ebe7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.154429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-63ca1e2d-52cc-42f1-88be-9278fd47ebe7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.472867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-63ca1e2d-52cc-42f1-88be-9278fd47ebe7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:51.486121 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-706b52cc-7d25-48ed-85dc-717235b30449 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 204 len: 0 microversion: 2.1 time: 0.936202 Aug 27 05:05:51.486713 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1335/2731] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:50 2022] DELETE /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 0 bytes in 938 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:05:51.496188 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-63ca1e2d-52cc-42f1-88be-9278fd47ebe7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.377895 Aug 27 05:05:51.497702 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1397/2732] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:51 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:51.505436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-450d511f-f89d-48a6-ba8d-6f9984a15a66 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:51.510354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c274b1a7-85c6-44c3-8039-774983e2414e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:51.511706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-450d511f-f89d-48a6-ba8d-6f9984a15a66 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:51.512284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c274b1a7-85c6-44c3-8039-774983e2414e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:51.518463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=55 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:51.530082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-450d511f-f89d-48a6-ba8d-6f9984a15a66 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.532305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c274b1a7-85c6-44c3-8039-774983e2414e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.532800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c274b1a7-85c6-44c3-8039-774983e2414e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.533243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c274b1a7-85c6-44c3-8039-774983e2414e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.533933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-450d511f-f89d-48a6-ba8d-6f9984a15a66 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.534435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-450d511f-f89d-48a6-ba8d-6f9984a15a66 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.535198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-450d511f-f89d-48a6-ba8d-6f9984a15a66 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.535668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-450d511f-f89d-48a6-ba8d-6f9984a15a66 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.536107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-450d511f-f89d-48a6-ba8d-6f9984a15a66 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.538971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c274b1a7-85c6-44c3-8039-774983e2414e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.539550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c274b1a7-85c6-44c3-8039-774983e2414e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.539999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c274b1a7-85c6-44c3-8039-774983e2414e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.605475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c274b1a7-85c6-44c3-8039-774983e2414e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:05:51.671821 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-450d511f-f89d-48a6-ba8d-6f9984a15a66 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "POST /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652/action" status: 200 len: 24569 microversion: 2.1 time: 0.183574 Aug 27 05:05:51.672999 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1336/2733] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:05:51 2022] POST /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652/action => generated 24569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:05:51.789170 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c274b1a7-85c6-44c3-8039-774983e2414e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 204 len: 0 microversion: 2.1 time: 0.289773 Aug 27 05:05:51.792332 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1398/2734] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:05:51 2022] DELETE /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:05:51.963860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-623831235", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "11d496fd-4b16-4935-bb52-9962a7e9cd7d"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:52.108775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] validate_networks() for [('11d496fd-4b16-4935-bb52-9962a7e9cd7d', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:05:52.523402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af80830b-1a71-477c-8ed8-be714237206f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:52.524706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-af80830b-1a71-477c-8ed8-be714237206f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:52.542856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af80830b-1a71-477c-8ed8-be714237206f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:52.546173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af80830b-1a71-477c-8ed8-be714237206f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:52.547425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af80830b-1a71-477c-8ed8-be714237206f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:52.549142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af80830b-1a71-477c-8ed8-be714237206f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:52.549507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af80830b-1a71-477c-8ed8-be714237206f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:52.549952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af80830b-1a71-477c-8ed8-be714237206f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.629234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af80830b-1a71-477c-8ed8-be714237206f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:53.645069 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af80830b-1a71-477c-8ed8-be714237206f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 1.126780 Aug 27 05:05:53.663564 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1399/2735] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:52 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:53.669502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d15afec3-7ef3-43bc-b84a-8d9167281e40 req-d72a4afa-a67c-4be6-a0ef-c1fbddb8c324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e359f17-fa25-41b2-a570-f33bc74f53c4", "name": "network-vif-unplugged", "status": "completed", "tag": "77bbdc0c-6ead-4e74-b3c1-521340163ee2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:53.683817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d15afec3-7ef3-43bc-b84a-8d9167281e40 req-d72a4afa-a67c-4be6-a0ef-c1fbddb8c324 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.685632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d15afec3-7ef3-43bc-b84a-8d9167281e40 req-d72a4afa-a67c-4be6-a0ef-c1fbddb8c324 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.686690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d15afec3-7ef3-43bc-b84a-8d9167281e40 req-d72a4afa-a67c-4be6-a0ef-c1fbddb8c324 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.700771 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d15afec3-7ef3-43bc-b84a-8d9167281e40 req-d72a4afa-a67c-4be6-a0ef-c1fbddb8c324 service nova] Creating event network-vif-unplugged:77bbdc0c-6ead-4e74-b3c1-521340163ee2 for instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 on n-h2-820368-35 Aug 27 05:05:53.710318 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d15afec3-7ef3-43bc-b84a-8d9167281e40 req-d72a4afa-a67c-4be6-a0ef-c1fbddb8c324 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045354 Aug 27 05:05:53.711398 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1400/2736] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:53.955012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:05:53.955784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:05:53.956377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:05:53.956901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:05:53.957558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:05:53.976564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.977209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.978044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.979638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.980283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.980900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:54.016362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Getting quotas for project d8fa2042dc6a457fa50dcbf75e3a32ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:05:54.024734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Getting quotas for user 979e8da1534344fcb5a2be09631ea09c and project d8fa2042dc6a457fa50dcbf75e3a32ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:05:54.043147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:05:54.046873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:05:54.117291 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f5eefbc-2b08-4e93-9aee-8199ebccebf5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.158799 Aug 27 05:05:54.118301 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1337/2737] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:05:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:05:54.130222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ddda2f52-fd5c-4ec2-af33-2387a7396486 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:54.130937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ddda2f52-fd5c-4ec2-af33-2387a7396486 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:54.234072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ddda2f52-fd5c-4ec2-af33-2387a7396486 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:54.242792 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ddda2f52-fd5c-4ec2-af33-2387a7396486 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1207 microversion: 2.1 time: 0.116981 Aug 27 05:05:54.244087 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1401/2738] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:54 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1207 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:54.670149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-329250e7-d951-4231-bd59-72c342451cb6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:54.671011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-329250e7-d951-4231-bd59-72c342451cb6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:54.687343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329250e7-d951-4231-bd59-72c342451cb6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:54.690691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329250e7-d951-4231-bd59-72c342451cb6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:54.691524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329250e7-d951-4231-bd59-72c342451cb6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:54.693425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329250e7-d951-4231-bd59-72c342451cb6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:54.694122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329250e7-d951-4231-bd59-72c342451cb6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:54.694626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-329250e7-d951-4231-bd59-72c342451cb6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:54.951733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d6c1adea-e683-4e1e-8e16-9a011e694464 req-9b15477b-15ff-4394-b29d-d9bc7fd39763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e359f17-fa25-41b2-a570-f33bc74f53c4", "name": "network-vif-deleted", "tag": "77bbdc0c-6ead-4e74-b3c1-521340163ee2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:54.993072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d6c1adea-e683-4e1e-8e16-9a011e694464 req-9b15477b-15ff-4394-b29d-d9bc7fd39763 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:55.001570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d6c1adea-e683-4e1e-8e16-9a011e694464 req-9b15477b-15ff-4394-b29d-d9bc7fd39763 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:55.002950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d6c1adea-e683-4e1e-8e16-9a011e694464 req-9b15477b-15ff-4394-b29d-d9bc7fd39763 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:55.053294 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d6c1adea-e683-4e1e-8e16-9a011e694464 req-9b15477b-15ff-4394-b29d-d9bc7fd39763 service nova] Creating event network-vif-deleted:77bbdc0c-6ead-4e74-b3c1-521340163ee2 for instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 on n-h2-820368-35 Aug 27 05:05:55.059751 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d6c1adea-e683-4e1e-8e16-9a011e694464 req-9b15477b-15ff-4394-b29d-d9bc7fd39763 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111882 Aug 27 05:05:55.062951 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1402/2739] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:55.151479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-329250e7-d951-4231-bd59-72c342451cb6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:55.170507 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-329250e7-d951-4231-bd59-72c342451cb6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.505518 Aug 27 05:05:55.172304 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1338/2740] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:54 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:55.269250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8ae81ef4-5a9d-481b-81dc-86f832afa76a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:55.271702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8ae81ef4-5a9d-481b-81dc-86f832afa76a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:55.286332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ae81ef4-5a9d-481b-81dc-86f832afa76a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:55.289673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ae81ef4-5a9d-481b-81dc-86f832afa76a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:55.290244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ae81ef4-5a9d-481b-81dc-86f832afa76a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:55.292046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ae81ef4-5a9d-481b-81dc-86f832afa76a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:55.296683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ae81ef4-5a9d-481b-81dc-86f832afa76a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:55.297452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ae81ef4-5a9d-481b-81dc-86f832afa76a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:55.432076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8ae81ef4-5a9d-481b-81dc-86f832afa76a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:55.441208 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8ae81ef4-5a9d-481b-81dc-86f832afa76a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1259 microversion: 2.1 time: 0.177750 Aug 27 05:05:55.442055 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1403/2741] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:55 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:56.194223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b83c9632-440d-4bf1-a30d-ef54fd3118de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:56.194890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b83c9632-440d-4bf1-a30d-ef54fd3118de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:56.203635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b83c9632-440d-4bf1-a30d-ef54fd3118de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:56.204131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b83c9632-440d-4bf1-a30d-ef54fd3118de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:56.204570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b83c9632-440d-4bf1-a30d-ef54fd3118de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:56.205284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b83c9632-440d-4bf1-a30d-ef54fd3118de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:56.205745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b83c9632-440d-4bf1-a30d-ef54fd3118de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:56.206176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b83c9632-440d-4bf1-a30d-ef54fd3118de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:56.359688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b83c9632-440d-4bf1-a30d-ef54fd3118de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:56.376100 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b83c9632-440d-4bf1-a30d-ef54fd3118de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.187099 Aug 27 05:05:56.377007 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1339/2742] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:56 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:56.469343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-827afef6-c45f-48cd-a3f4-d9d57ba008b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:56.469963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-827afef6-c45f-48cd-a3f4-d9d57ba008b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:56.482419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-827afef6-c45f-48cd-a3f4-d9d57ba008b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:56.483686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-827afef6-c45f-48cd-a3f4-d9d57ba008b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:56.484406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-827afef6-c45f-48cd-a3f4-d9d57ba008b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:56.485393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-827afef6-c45f-48cd-a3f4-d9d57ba008b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:56.486054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-827afef6-c45f-48cd-a3f4-d9d57ba008b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:56.486704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-827afef6-c45f-48cd-a3f4-d9d57ba008b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:56.570468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-827afef6-c45f-48cd-a3f4-d9d57ba008b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:56.586762 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-827afef6-c45f-48cd-a3f4-d9d57ba008b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1267 microversion: 2.1 time: 0.121973 Aug 27 05:05:56.588904 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1404/2743] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:56 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:57.399933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-17d197f8-9087-4dbe-8ef0-0cba074c6a08 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:57.400579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-17d197f8-9087-4dbe-8ef0-0cba074c6a08 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:57.418023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17d197f8-9087-4dbe-8ef0-0cba074c6a08 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:57.418984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17d197f8-9087-4dbe-8ef0-0cba074c6a08 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:57.419887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17d197f8-9087-4dbe-8ef0-0cba074c6a08 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:57.420975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17d197f8-9087-4dbe-8ef0-0cba074c6a08 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:57.421890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17d197f8-9087-4dbe-8ef0-0cba074c6a08 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:57.422551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17d197f8-9087-4dbe-8ef0-0cba074c6a08 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:57.620631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1ab070c9-325e-4014-89f1-8ec46ec77c42 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:57.623033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1ab070c9-325e-4014-89f1-8ec46ec77c42 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:57.634080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ab070c9-325e-4014-89f1-8ec46ec77c42 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:57.634918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ab070c9-325e-4014-89f1-8ec46ec77c42 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:57.635611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ab070c9-325e-4014-89f1-8ec46ec77c42 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:57.636537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ab070c9-325e-4014-89f1-8ec46ec77c42 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:57.638968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ab070c9-325e-4014-89f1-8ec46ec77c42 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:57.640083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ab070c9-325e-4014-89f1-8ec46ec77c42 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:57.923533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-17d197f8-9087-4dbe-8ef0-0cba074c6a08 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:57.942634 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-17d197f8-9087-4dbe-8ef0-0cba074c6a08 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.548460 Aug 27 05:05:57.943570 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1340/2744] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:57 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:58.013705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1ab070c9-325e-4014-89f1-8ec46ec77c42 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:58.027394 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1ab070c9-325e-4014-89f1-8ec46ec77c42 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1307 microversion: 2.1 time: 0.417981 Aug 27 05:05:58.028021 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1405/2745] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:57 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1307 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:58.425331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e36e29d9-2ed4-4fa7-92a0-4633eac0d094 req-fa3c563c-91c7-4fa5-aa1e-dfa454d4f3ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d757ef9d-8acc-4bfc-8c45-7de22ca35137", "tag": "56ad0552-0093-40fb-9e6f-7edf533a561e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:58.450433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e36e29d9-2ed4-4fa7-92a0-4633eac0d094 req-fa3c563c-91c7-4fa5-aa1e-dfa454d4f3ca service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:58.450979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e36e29d9-2ed4-4fa7-92a0-4633eac0d094 req-fa3c563c-91c7-4fa5-aa1e-dfa454d4f3ca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:58.451539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e36e29d9-2ed4-4fa7-92a0-4633eac0d094 req-fa3c563c-91c7-4fa5-aa1e-dfa454d4f3ca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:58.456444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:58.480535 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e36e29d9-2ed4-4fa7-92a0-4633eac0d094 req-fa3c563c-91c7-4fa5-aa1e-dfa454d4f3ca service nova] Creating event network-changed:56ad0552-0093-40fb-9e6f-7edf533a561e for instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 on n-h2-820368-35 Aug 27 05:05:58.493170 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e36e29d9-2ed4-4fa7-92a0-4633eac0d094 req-fa3c563c-91c7-4fa5-aa1e-dfa454d4f3ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073718 Aug 27 05:05:58.495269 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1341/2746] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:58.968988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-07a9ed51-3f4d-4d00-88e8-15b9c2350f94 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:58.969829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-07a9ed51-3f4d-4d00-88e8-15b9c2350f94 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:58.977156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07a9ed51-3f4d-4d00-88e8-15b9c2350f94 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:58.977705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07a9ed51-3f4d-4d00-88e8-15b9c2350f94 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:58.978210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07a9ed51-3f4d-4d00-88e8-15b9c2350f94 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:58.978969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07a9ed51-3f4d-4d00-88e8-15b9c2350f94 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:58.979451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07a9ed51-3f4d-4d00-88e8-15b9c2350f94 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:58.980306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07a9ed51-3f4d-4d00-88e8-15b9c2350f94 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:59.050733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-595f30b2-14f6-457c-a0ff-73557f66c701 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:59.052525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-595f30b2-14f6-457c-a0ff-73557f66c701 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:59.061991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595f30b2-14f6-457c-a0ff-73557f66c701 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:59.062849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595f30b2-14f6-457c-a0ff-73557f66c701 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:59.063574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595f30b2-14f6-457c-a0ff-73557f66c701 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:59.064514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595f30b2-14f6-457c-a0ff-73557f66c701 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:59.066970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595f30b2-14f6-457c-a0ff-73557f66c701 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:59.067745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-595f30b2-14f6-457c-a0ff-73557f66c701 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:59.242079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-07a9ed51-3f4d-4d00-88e8-15b9c2350f94 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:59.253211 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-07a9ed51-3f4d-4d00-88e8-15b9c2350f94 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.287572 Aug 27 05:05:59.253822 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1406/2747] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:58 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:59.317638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-595f30b2-14f6-457c-a0ff-73557f66c701 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:59.327616 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-595f30b2-14f6-457c-a0ff-73557f66c701 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1307 microversion: 2.1 time: 0.281738 Aug 27 05:05:59.328947 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1342/2748] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:59 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1307 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:00.059675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-262d9915-9aae-43cf-92a8-0844594d9680 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:00.060252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-262d9915-9aae-43cf-92a8-0844594d9680 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:00.068333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-262d9915-9aae-43cf-92a8-0844594d9680 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:00.068834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-262d9915-9aae-43cf-92a8-0844594d9680 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:00.069283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-262d9915-9aae-43cf-92a8-0844594d9680 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:00.070008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-262d9915-9aae-43cf-92a8-0844594d9680 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:00.070470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-262d9915-9aae-43cf-92a8-0844594d9680 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:00.071409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-262d9915-9aae-43cf-92a8-0844594d9680 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:00.112078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-262d9915-9aae-43cf-92a8-0844594d9680 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:06:00.173631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:00.279008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e5c5cc5-f09f-4926-aa9a-f57831560717 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:00.280467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e5c5cc5-f09f-4926-aa9a-f57831560717 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:00.295805 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-262d9915-9aae-43cf-92a8-0844594d9680 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 204 len: 0 microversion: 2.1 time: 0.240847 Aug 27 05:06:00.296760 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1407/2749] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:06:00 2022] DELETE /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:06:00.304887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e5c5cc5-f09f-4926-aa9a-f57831560717 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:00.306993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-115f02ff-9ab1-4ce3-9bdb-be35fe2da561 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:00.307780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-115f02ff-9ab1-4ce3-9bdb-be35fe2da561 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:00.308228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e5c5cc5-f09f-4926-aa9a-f57831560717 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:00.308892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e5c5cc5-f09f-4926-aa9a-f57831560717 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:00.309773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e5c5cc5-f09f-4926-aa9a-f57831560717 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:00.311622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e5c5cc5-f09f-4926-aa9a-f57831560717 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:00.312163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e5c5cc5-f09f-4926-aa9a-f57831560717 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:00.322701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-115f02ff-9ab1-4ce3-9bdb-be35fe2da561 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:00.324034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-115f02ff-9ab1-4ce3-9bdb-be35fe2da561 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:00.325151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-115f02ff-9ab1-4ce3-9bdb-be35fe2da561 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:00.326560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-115f02ff-9ab1-4ce3-9bdb-be35fe2da561 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:00.327488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-115f02ff-9ab1-4ce3-9bdb-be35fe2da561 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:00.328103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-115f02ff-9ab1-4ce3-9bdb-be35fe2da561 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:00.638708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-115f02ff-9ab1-4ce3-9bdb-be35fe2da561 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:00.648314 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-115f02ff-9ab1-4ce3-9bdb-be35fe2da561 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1555 microversion: 2.1 time: 0.346410 Aug 27 05:06:00.654785 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1408/2750] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:00 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1555 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:00.667445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a48bee86-3a59-4202-b399-af17ab4e4788 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:00.668308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a48bee86-3a59-4202-b399-af17ab4e4788 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:00.683934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a48bee86-3a59-4202-b399-af17ab4e4788 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:00.684739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a48bee86-3a59-4202-b399-af17ab4e4788 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:00.685373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a48bee86-3a59-4202-b399-af17ab4e4788 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:00.686281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a48bee86-3a59-4202-b399-af17ab4e4788 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:00.686885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a48bee86-3a59-4202-b399-af17ab4e4788 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:00.695418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a48bee86-3a59-4202-b399-af17ab4e4788 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:00.725365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e5c5cc5-f09f-4926-aa9a-f57831560717 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:00.735784 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e5c5cc5-f09f-4926-aa9a-f57831560717 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.462745 Aug 27 05:06:00.737191 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1343/2751] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:00 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:00.918464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a48bee86-3a59-4202-b399-af17ab4e4788 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:00.928266 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a48bee86-3a59-4202-b399-af17ab4e4788 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1307 microversion: 2.1 time: 0.271706 Aug 27 05:06:00.930719 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1409/2752] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:00 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1307 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:01.675704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29abff71-1d08-449a-942a-5a1e4083512b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:01.676328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-29abff71-1d08-449a-942a-5a1e4083512b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:01.688246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29abff71-1d08-449a-942a-5a1e4083512b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:01.693147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29abff71-1d08-449a-942a-5a1e4083512b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:01.696538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29abff71-1d08-449a-942a-5a1e4083512b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:01.697539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29abff71-1d08-449a-942a-5a1e4083512b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:01.698185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29abff71-1d08-449a-942a-5a1e4083512b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:01.698787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29abff71-1d08-449a-942a-5a1e4083512b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:01.762520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d7126720-467b-4ff9-b9ff-b145b440c425 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:01.763146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d7126720-467b-4ff9-b9ff-b145b440c425 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:01.782849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7126720-467b-4ff9-b9ff-b145b440c425 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:01.783433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7126720-467b-4ff9-b9ff-b145b440c425 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:01.783881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7126720-467b-4ff9-b9ff-b145b440c425 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:01.784613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7126720-467b-4ff9-b9ff-b145b440c425 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:01.785070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7126720-467b-4ff9-b9ff-b145b440c425 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:01.785506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7126720-467b-4ff9-b9ff-b145b440c425 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:02.039789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-29abff71-1d08-449a-942a-5a1e4083512b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:02.050757 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-29abff71-1d08-449a-942a-5a1e4083512b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1555 microversion: 2.1 time: 0.378255 Aug 27 05:06:02.064822 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1344/2753] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:01 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1555 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:02.072009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4d832ae-a5c2-4aa7-bd75-d04aa4841ca7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:02.072888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4d832ae-a5c2-4aa7-bd75-d04aa4841ca7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:02.089278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4d832ae-a5c2-4aa7-bd75-d04aa4841ca7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:02.090888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4d832ae-a5c2-4aa7-bd75-d04aa4841ca7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:02.091537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4d832ae-a5c2-4aa7-bd75-d04aa4841ca7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:02.092467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4d832ae-a5c2-4aa7-bd75-d04aa4841ca7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:02.093086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4d832ae-a5c2-4aa7-bd75-d04aa4841ca7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:02.093678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4d832ae-a5c2-4aa7-bd75-d04aa4841ca7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:02.122497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d7126720-467b-4ff9-b9ff-b145b440c425 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:02.134262 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d7126720-467b-4ff9-b9ff-b145b440c425 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.375155 Aug 27 05:06:02.137837 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1410/2754] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:01 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:02.389584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b4d832ae-a5c2-4aa7-bd75-d04aa4841ca7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:02.399404 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4d832ae-a5c2-4aa7-bd75-d04aa4841ca7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1307 microversion: 2.1 time: 0.333167 Aug 27 05:06:02.399996 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1345/2755] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:02 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1307 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:03.082196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-efb42c25-803b-45bc-85ea-a713814ddc3c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:03.084284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-efb42c25-803b-45bc-85ea-a713814ddc3c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:03.099944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efb42c25-803b-45bc-85ea-a713814ddc3c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:03.105092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efb42c25-803b-45bc-85ea-a713814ddc3c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:03.107072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efb42c25-803b-45bc-85ea-a713814ddc3c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:03.108144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efb42c25-803b-45bc-85ea-a713814ddc3c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:03.111115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efb42c25-803b-45bc-85ea-a713814ddc3c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:03.111932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efb42c25-803b-45bc-85ea-a713814ddc3c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:03.163904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-033f92a7-32a1-4eb9-b37b-71dc6b72dcd8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:03.165152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-033f92a7-32a1-4eb9-b37b-71dc6b72dcd8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:03.187148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-033f92a7-32a1-4eb9-b37b-71dc6b72dcd8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:03.190059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-033f92a7-32a1-4eb9-b37b-71dc6b72dcd8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:03.194806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-033f92a7-32a1-4eb9-b37b-71dc6b72dcd8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:03.196812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-033f92a7-32a1-4eb9-b37b-71dc6b72dcd8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:03.198164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-033f92a7-32a1-4eb9-b37b-71dc6b72dcd8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:03.203388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-033f92a7-32a1-4eb9-b37b-71dc6b72dcd8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:03.554601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-efb42c25-803b-45bc-85ea-a713814ddc3c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:03.566753 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-efb42c25-803b-45bc-85ea-a713814ddc3c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1555 microversion: 2.1 time: 0.490423 Aug 27 05:06:03.569174 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1411/2756] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:03 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1555 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:03.587746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-474c5638-cbe8-49bd-8ba5-bd22e6915c59 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:03.588535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-474c5638-cbe8-49bd-8ba5-bd22e6915c59 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:03.600948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-033f92a7-32a1-4eb9-b37b-71dc6b72dcd8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:03.608672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474c5638-cbe8-49bd-8ba5-bd22e6915c59 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:03.610859 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-033f92a7-32a1-4eb9-b37b-71dc6b72dcd8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.452939 Aug 27 05:06:03.613138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474c5638-cbe8-49bd-8ba5-bd22e6915c59 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:03.616338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474c5638-cbe8-49bd-8ba5-bd22e6915c59 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:03.616793 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1346/2757] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:03 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:03.617621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474c5638-cbe8-49bd-8ba5-bd22e6915c59 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:03.618339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474c5638-cbe8-49bd-8ba5-bd22e6915c59 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:03.627810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474c5638-cbe8-49bd-8ba5-bd22e6915c59 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:03.853682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-474c5638-cbe8-49bd-8ba5-bd22e6915c59 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:03.862714 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-474c5638-cbe8-49bd-8ba5-bd22e6915c59 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1307 microversion: 2.1 time: 0.287621 Aug 27 05:06:03.863875 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1412/2758] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:03 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1307 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:04.419003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3990459c-94db-458f-808c-ca0b451c3c5d req-be257f9c-26da-4556-88de-7eed40e02dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea714cda-ef28-4c42-9836-7dd70dcc4f4d", "name": "network-vif-deleted", "tag": "ed467809-03cb-4e8b-bbb6-4b9ea233dca0"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:04.428019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:04.429502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:04.433311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3990459c-94db-458f-808c-ca0b451c3c5d req-be257f9c-26da-4556-88de-7eed40e02dbc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:04.434001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3990459c-94db-458f-808c-ca0b451c3c5d req-be257f9c-26da-4556-88de-7eed40e02dbc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:04.434631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3990459c-94db-458f-808c-ca0b451c3c5d req-be257f9c-26da-4556-88de-7eed40e02dbc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:04.466168 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3990459c-94db-458f-808c-ca0b451c3c5d req-be257f9c-26da-4556-88de-7eed40e02dbc service nova] Creating event network-vif-deleted:ed467809-03cb-4e8b-bbb6-4b9ea233dca0 for instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d on n-h1-820368-35 Aug 27 05:06:04.481233 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3990459c-94db-458f-808c-ca0b451c3c5d req-be257f9c-26da-4556-88de-7eed40e02dbc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066020 Aug 27 05:06:04.482142 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1347/2759] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:04.590863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-74dec2da-491e-4212-83af-64d0f882b189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:04.591494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-74dec2da-491e-4212-83af-64d0f882b189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:04.594045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:04.615590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74dec2da-491e-4212-83af-64d0f882b189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:04.616069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74dec2da-491e-4212-83af-64d0f882b189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:04.616694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74dec2da-491e-4212-83af-64d0f882b189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:04.617623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74dec2da-491e-4212-83af-64d0f882b189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:04.618256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74dec2da-491e-4212-83af-64d0f882b189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:04.618847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74dec2da-491e-4212-83af-64d0f882b189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:04.640477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-20fb2c70-81d6-465c-a8ee-414ccc552139 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:04.641201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-20fb2c70-81d6-465c-a8ee-414ccc552139 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:04.665722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20fb2c70-81d6-465c-a8ee-414ccc552139 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:04.666461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20fb2c70-81d6-465c-a8ee-414ccc552139 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:04.667604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20fb2c70-81d6-465c-a8ee-414ccc552139 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:04.668933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20fb2c70-81d6-465c-a8ee-414ccc552139 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:04.675884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20fb2c70-81d6-465c-a8ee-414ccc552139 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:04.676410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20fb2c70-81d6-465c-a8ee-414ccc552139 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:04.810542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-74dec2da-491e-4212-83af-64d0f882b189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:04.820759 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-74dec2da-491e-4212-83af-64d0f882b189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1346 microversion: 2.1 time: 0.233915 Aug 27 05:06:04.821401 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1413/2760] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:04 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1346 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:04.885272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-600d3b12-1e6d-493e-bdbb-8d9644172899 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:04.886113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-600d3b12-1e6d-493e-bdbb-8d9644172899 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:04.902775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600d3b12-1e6d-493e-bdbb-8d9644172899 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:04.903320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600d3b12-1e6d-493e-bdbb-8d9644172899 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:04.903766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600d3b12-1e6d-493e-bdbb-8d9644172899 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:04.904485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600d3b12-1e6d-493e-bdbb-8d9644172899 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:04.904945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600d3b12-1e6d-493e-bdbb-8d9644172899 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:04.905393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-600d3b12-1e6d-493e-bdbb-8d9644172899 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:05.030325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-20fb2c70-81d6-465c-a8ee-414ccc552139 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:05.053499 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-20fb2c70-81d6-465c-a8ee-414ccc552139 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.415416 Aug 27 05:06:05.054404 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1348/2761] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:04 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:05.212843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-600d3b12-1e6d-493e-bdbb-8d9644172899 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:05.229185 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-600d3b12-1e6d-493e-bdbb-8d9644172899 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1307 microversion: 2.1 time: 0.347318 Aug 27 05:06:05.230514 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1414/2762] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:04 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1307 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:05.843256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ae947996-a2f4-40bd-ac58-fd2cc34ac56b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:05.844529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ae947996-a2f4-40bd-ac58-fd2cc34ac56b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:05.866579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae947996-a2f4-40bd-ac58-fd2cc34ac56b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:05.868046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae947996-a2f4-40bd-ac58-fd2cc34ac56b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:05.868768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae947996-a2f4-40bd-ac58-fd2cc34ac56b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:05.869779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae947996-a2f4-40bd-ac58-fd2cc34ac56b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:05.871121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae947996-a2f4-40bd-ac58-fd2cc34ac56b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:05.872289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae947996-a2f4-40bd-ac58-fd2cc34ac56b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:06.007334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae947996-a2f4-40bd-ac58-fd2cc34ac56b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:06.019593 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ae947996-a2f4-40bd-ac58-fd2cc34ac56b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1346 microversion: 2.1 time: 0.181446 Aug 27 05:06:06.024014 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1349/2763] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:05 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:06.079630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8622fc1c-b35d-4d80-82b6-2bd4c30a138d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:06.080939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8622fc1c-b35d-4d80-82b6-2bd4c30a138d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:06.089904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8622fc1c-b35d-4d80-82b6-2bd4c30a138d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:06.090633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8622fc1c-b35d-4d80-82b6-2bd4c30a138d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:06.091262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8622fc1c-b35d-4d80-82b6-2bd4c30a138d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:06.092148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8622fc1c-b35d-4d80-82b6-2bd4c30a138d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:06.092754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8622fc1c-b35d-4d80-82b6-2bd4c30a138d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:06.093549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8622fc1c-b35d-4d80-82b6-2bd4c30a138d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:06.258781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e35978e5-dc3d-4e74-b9c7-078dd3246918 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:06.259648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e35978e5-dc3d-4e74-b9c7-078dd3246918 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:06.272532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e35978e5-dc3d-4e74-b9c7-078dd3246918 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:06.274455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e35978e5-dc3d-4e74-b9c7-078dd3246918 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:06.274912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e35978e5-dc3d-4e74-b9c7-078dd3246918 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:06.275683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e35978e5-dc3d-4e74-b9c7-078dd3246918 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:06.279002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e35978e5-dc3d-4e74-b9c7-078dd3246918 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:06.282500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e35978e5-dc3d-4e74-b9c7-078dd3246918 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:06.620240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8622fc1c-b35d-4d80-82b6-2bd4c30a138d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:06.632021 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8622fc1c-b35d-4d80-82b6-2bd4c30a138d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.557126 Aug 27 05:06:06.635285 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1415/2764] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:06 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:06.685565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-ac2c9b25-8995-4dad-b2d9-dbdf271da861 req-00657c8c-154e-49f5-ae8c-171c8a70f5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d757ef9d-8acc-4bfc-8c45-7de22ca35137", "name": "network-vif-plugged", "status": "completed", "tag": "56ad0552-0093-40fb-9e6f-7edf533a561e"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:06.707775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ac2c9b25-8995-4dad-b2d9-dbdf271da861 req-00657c8c-154e-49f5-ae8c-171c8a70f5ef service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:06.711051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ac2c9b25-8995-4dad-b2d9-dbdf271da861 req-00657c8c-154e-49f5-ae8c-171c8a70f5ef service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:06.711851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ac2c9b25-8995-4dad-b2d9-dbdf271da861 req-00657c8c-154e-49f5-ae8c-171c8a70f5ef service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:06.742470 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-ac2c9b25-8995-4dad-b2d9-dbdf271da861 req-00657c8c-154e-49f5-ae8c-171c8a70f5ef service nova] Creating event network-vif-plugged:56ad0552-0093-40fb-9e6f-7edf533a561e for instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 on n-h2-820368-35 Aug 27 05:06:06.758169 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-ac2c9b25-8995-4dad-b2d9-dbdf271da861 req-00657c8c-154e-49f5-ae8c-171c8a70f5ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076930 Aug 27 05:06:06.761931 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1416/2765] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:06:07.048344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-627d6aef-88bb-4137-8a96-740fd3a35ad1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:07.049221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-627d6aef-88bb-4137-8a96-740fd3a35ad1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:07.072415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-627d6aef-88bb-4137-8a96-740fd3a35ad1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:07.073189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-627d6aef-88bb-4137-8a96-740fd3a35ad1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:07.075007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-627d6aef-88bb-4137-8a96-740fd3a35ad1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:07.079107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-627d6aef-88bb-4137-8a96-740fd3a35ad1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:07.079928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-627d6aef-88bb-4137-8a96-740fd3a35ad1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:07.083962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-627d6aef-88bb-4137-8a96-740fd3a35ad1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:07.528525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-627d6aef-88bb-4137-8a96-740fd3a35ad1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:07.544986 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-627d6aef-88bb-4137-8a96-740fd3a35ad1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1346 microversion: 2.1 time: 0.499295 Aug 27 05:06:07.546502 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1417/2766] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:07 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1346 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:07.549790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e35978e5-dc3d-4e74-b9c7-078dd3246918 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:07.558859 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e35978e5-dc3d-4e74-b9c7-078dd3246918 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1307 microversion: 2.1 time: 1.310837 Aug 27 05:06:07.563556 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1350/2767] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:06 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1307 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:07.654300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cf5a2b55-a594-480c-9894-26b9d7808dd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:07.655455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cf5a2b55-a594-480c-9894-26b9d7808dd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:07.668491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf5a2b55-a594-480c-9894-26b9d7808dd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:07.669346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf5a2b55-a594-480c-9894-26b9d7808dd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:07.671470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf5a2b55-a594-480c-9894-26b9d7808dd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:07.673268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf5a2b55-a594-480c-9894-26b9d7808dd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:07.675743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf5a2b55-a594-480c-9894-26b9d7808dd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:07.676356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf5a2b55-a594-480c-9894-26b9d7808dd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:08.030766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cf5a2b55-a594-480c-9894-26b9d7808dd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:08.043195 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cf5a2b55-a594-480c-9894-26b9d7808dd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.390860 Aug 27 05:06:08.057949 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1418/2768] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:07 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:08.568027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cb3e312e-4a8d-49a7-9dad-acdd99f2350f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:08.568861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cb3e312e-4a8d-49a7-9dad-acdd99f2350f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:08.582329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-971f17a8-819e-416a-b8db-e031c8eba445 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:08.584913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-971f17a8-819e-416a-b8db-e031c8eba445 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:08.597377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-971f17a8-819e-416a-b8db-e031c8eba445 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:08.599842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-971f17a8-819e-416a-b8db-e031c8eba445 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:08.601682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-971f17a8-819e-416a-b8db-e031c8eba445 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:08.602604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-971f17a8-819e-416a-b8db-e031c8eba445 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:08.605868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb3e312e-4a8d-49a7-9dad-acdd99f2350f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:08.606172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-971f17a8-819e-416a-b8db-e031c8eba445 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:08.606818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-971f17a8-819e-416a-b8db-e031c8eba445 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:08.608663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb3e312e-4a8d-49a7-9dad-acdd99f2350f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:08.611190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb3e312e-4a8d-49a7-9dad-acdd99f2350f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:08.618433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb3e312e-4a8d-49a7-9dad-acdd99f2350f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:08.619187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb3e312e-4a8d-49a7-9dad-acdd99f2350f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:08.621452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb3e312e-4a8d-49a7-9dad-acdd99f2350f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:08.962563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cb3e312e-4a8d-49a7-9dad-acdd99f2350f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:08.977710 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cb3e312e-4a8d-49a7-9dad-acdd99f2350f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1346 microversion: 2.1 time: 0.415576 Aug 27 05:06:08.984652 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1351/2769] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:08 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1346 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:09.002761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:09.003441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:09.021273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:09.022075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:09.022888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:09.024841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:09.025654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:09.026954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:09.105545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-971f17a8-819e-416a-b8db-e031c8eba445 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:09.114474 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-971f17a8-819e-416a-b8db-e031c8eba445 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1307 microversion: 2.1 time: 0.535846 Aug 27 05:06:09.125028 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1419/2770] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:08 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1307 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:09.130054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3df54836-8b99-47a4-b116-42bcac034972 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:09.157304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3df54836-8b99-47a4-b116-42bcac034972 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:09.165728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3df54836-8b99-47a4-b116-42bcac034972 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:09.166465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3df54836-8b99-47a4-b116-42bcac034972 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:09.167213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3df54836-8b99-47a4-b116-42bcac034972 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:09.168012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3df54836-8b99-47a4-b116-42bcac034972 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:09.179619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3df54836-8b99-47a4-b116-42bcac034972 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:09.180248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3df54836-8b99-47a4-b116-42bcac034972 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:09.714863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:09.733681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:09.739605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:09.749328 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7e5aa42c-2e01-4a70-9c2e-887f05c03bf1 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2948 microversion: 2.32 time: 0.758988 Aug 27 05:06:09.750185 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1352/2771] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:08 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2948 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:09.776374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b7f4ccc6-963d-45c5-9de2-661c3376f06a tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:09.777298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b7f4ccc6-963d-45c5-9de2-661c3376f06a tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:09.792042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f4ccc6-963d-45c5-9de2-661c3376f06a tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:09.793232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f4ccc6-963d-45c5-9de2-661c3376f06a tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:09.793904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f4ccc6-963d-45c5-9de2-661c3376f06a tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:09.794882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f4ccc6-963d-45c5-9de2-661c3376f06a tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:09.795619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f4ccc6-963d-45c5-9de2-661c3376f06a tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:09.796298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f4ccc6-963d-45c5-9de2-661c3376f06a tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:09.809145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3df54836-8b99-47a4-b116-42bcac034972 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:09.818420 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3df54836-8b99-47a4-b116-42bcac034972 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.692014 Aug 27 05:06:09.823826 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1420/2772] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:09 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:10.006835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e6e5b7f0-bf48-4e55-aa59-34816a4bbc48 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:10.007755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e6e5b7f0-bf48-4e55-aa59-34816a4bbc48 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:10.016421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6e5b7f0-bf48-4e55-aa59-34816a4bbc48 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.017883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6e5b7f0-bf48-4e55-aa59-34816a4bbc48 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.018646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6e5b7f0-bf48-4e55-aa59-34816a4bbc48 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:10.020216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6e5b7f0-bf48-4e55-aa59-34816a4bbc48 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.021014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6e5b7f0-bf48-4e55-aa59-34816a4bbc48 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.021847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6e5b7f0-bf48-4e55-aa59-34816a4bbc48 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:10.078181 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b7f4ccc6-963d-45c5-9de2-661c3376f06a tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.306221 Aug 27 05:06:10.078790 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1353/2773] 10.222.0.58 () {60 vars in 1316 bytes} [Sat Aug 27 05:06:09 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1/os-interface => generated 1832 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:06:10.148321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9a602fb-06e2-41fa-b4f8-58cc9f57d07e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:10.149255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9a602fb-06e2-41fa-b4f8-58cc9f57d07e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:10.158660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a602fb-06e2-41fa-b4f8-58cc9f57d07e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.167969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a602fb-06e2-41fa-b4f8-58cc9f57d07e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.168701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a602fb-06e2-41fa-b4f8-58cc9f57d07e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:10.169755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a602fb-06e2-41fa-b4f8-58cc9f57d07e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.170399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a602fb-06e2-41fa-b4f8-58cc9f57d07e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.173705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a602fb-06e2-41fa-b4f8-58cc9f57d07e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:10.224440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e6e5b7f0-bf48-4e55-aa59-34816a4bbc48 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:10.241177 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e6e5b7f0-bf48-4e55-aa59-34816a4bbc48 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1346 microversion: 2.1 time: 0.238114 Aug 27 05:06:10.243533 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1421/2774] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:09 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1346 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:10.478028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f9a602fb-06e2-41fa-b4f8-58cc9f57d07e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:10.492204 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9a602fb-06e2-41fa-b4f8-58cc9f57d07e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1487 microversion: 2.1 time: 0.346682 Aug 27 05:06:10.512131 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1354/2775] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:10 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1487 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:10.526396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9238940d-d9de-4c1d-a61a-947b22a6a5af tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:10.526961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9238940d-d9de-4c1d-a61a-947b22a6a5af tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:10.540299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9238940d-d9de-4c1d-a61a-947b22a6a5af tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.540802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9238940d-d9de-4c1d-a61a-947b22a6a5af tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.541246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9238940d-d9de-4c1d-a61a-947b22a6a5af tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:10.542266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9238940d-d9de-4c1d-a61a-947b22a6a5af tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.543701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9238940d-d9de-4c1d-a61a-947b22a6a5af tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.544450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9238940d-d9de-4c1d-a61a-947b22a6a5af tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:10.584796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-9238940d-d9de-4c1d-a61a-947b22a6a5af tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lazy-loading 'flavor' on Instance uuid d757ef9d-8acc-4bfc-8c45-7de22ca35137 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:06:10.691009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:10.720084 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9238940d-d9de-4c1d-a61a-947b22a6a5af tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "POST /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137/action" status: 202 len: 0 microversion: 2.1 time: 0.200771 Aug 27 05:06:10.721124 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1422/2776] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:06:10 2022] POST /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:06:10.730126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-149ef770-4acc-4b70-8e70-384dbe41e611 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:10.731448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-149ef770-4acc-4b70-8e70-384dbe41e611 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:10.738935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-149ef770-4acc-4b70-8e70-384dbe41e611 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.746652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-149ef770-4acc-4b70-8e70-384dbe41e611 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.747882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-149ef770-4acc-4b70-8e70-384dbe41e611 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:10.748868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-149ef770-4acc-4b70-8e70-384dbe41e611 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.749535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-149ef770-4acc-4b70-8e70-384dbe41e611 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.750187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-149ef770-4acc-4b70-8e70-384dbe41e611 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:10.848011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d1e3e3a-754c-47f0-8c08-4353be9b97a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:10.850177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d1e3e3a-754c-47f0-8c08-4353be9b97a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:10.857535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1e3e3a-754c-47f0-8c08-4353be9b97a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.858149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1e3e3a-754c-47f0-8c08-4353be9b97a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.858594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1e3e3a-754c-47f0-8c08-4353be9b97a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:10.859660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1e3e3a-754c-47f0-8c08-4353be9b97a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.860175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1e3e3a-754c-47f0-8c08-4353be9b97a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.861010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1e3e3a-754c-47f0-8c08-4353be9b97a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:11.040525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-149ef770-4acc-4b70-8e70-384dbe41e611 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:11.054604 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-149ef770-4acc-4b70-8e70-384dbe41e611 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1495 microversion: 2.1 time: 0.328321 Aug 27 05:06:11.068029 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1355/2777] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:10 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1495 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:11.209767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8d1e3e3a-754c-47f0-8c08-4353be9b97a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:11.221843 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d1e3e3a-754c-47f0-8c08-4353be9b97a9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1477 microversion: 2.1 time: 0.379514 Aug 27 05:06:11.222899 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1423/2778] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:10 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1477 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:11.271353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-315afd05-eef3-4e08-91d6-1b7a966174c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:11.272302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-315afd05-eef3-4e08-91d6-1b7a966174c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:11.279948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-315afd05-eef3-4e08-91d6-1b7a966174c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:11.280923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-315afd05-eef3-4e08-91d6-1b7a966174c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:11.281757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-315afd05-eef3-4e08-91d6-1b7a966174c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:11.282803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-315afd05-eef3-4e08-91d6-1b7a966174c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:11.284603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-315afd05-eef3-4e08-91d6-1b7a966174c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:11.285357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-315afd05-eef3-4e08-91d6-1b7a966174c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:11.389040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-315afd05-eef3-4e08-91d6-1b7a966174c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:11.404015 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-315afd05-eef3-4e08-91d6-1b7a966174c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1346 microversion: 2.1 time: 0.139212 Aug 27 05:06:11.407601 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1356/2779] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:11 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1346 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:12.079509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e504e866-31ac-43dd-ab9e-63da995ea669 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:12.081983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e504e866-31ac-43dd-ab9e-63da995ea669 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:12.095209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e504e866-31ac-43dd-ab9e-63da995ea669 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:12.099003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e504e866-31ac-43dd-ab9e-63da995ea669 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:12.099976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e504e866-31ac-43dd-ab9e-63da995ea669 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:12.100923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e504e866-31ac-43dd-ab9e-63da995ea669 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:12.101631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e504e866-31ac-43dd-ab9e-63da995ea669 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:12.102307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e504e866-31ac-43dd-ab9e-63da995ea669 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:12.413272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1885871052", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "d259db6b-8c88-47d9-b483-538bd276c9e3"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:12.424767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e504e866-31ac-43dd-ab9e-63da995ea669 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:12.442006 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e504e866-31ac-43dd-ab9e-63da995ea669 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 200 len: 1478 microversion: 2.1 time: 0.366757 Aug 27 05:06:12.445340 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1357/2780] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:12 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 1478 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:12.464361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b72472dc-0100-44f0-a9d9-e644b50a1537 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:12.465647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b72472dc-0100-44f0-a9d9-e644b50a1537 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:12.481425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b72472dc-0100-44f0-a9d9-e644b50a1537 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:12.482653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b72472dc-0100-44f0-a9d9-e644b50a1537 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:12.483568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b72472dc-0100-44f0-a9d9-e644b50a1537 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:12.485897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b72472dc-0100-44f0-a9d9-e644b50a1537 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:12.486598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b72472dc-0100-44f0-a9d9-e644b50a1537 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:12.487293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b72472dc-0100-44f0-a9d9-e644b50a1537 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:12.528535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] validate_networks() for [('d259db6b-8c88-47d9-b483-538bd276c9e3', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:06:12.965144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b72472dc-0100-44f0-a9d9-e644b50a1537 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:12.974516 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b72472dc-0100-44f0-a9d9-e644b50a1537 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1476 microversion: 2.1 time: 0.527907 Aug 27 05:06:12.978834 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1358/2781] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:12 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1476 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:12.988529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:12.990108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:13.006417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:13.007226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:13.009368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:13.010074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:13.011639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:13.012181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:13.037666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:13.060228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:13.060985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:13.061740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:13.064783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lazy-loading 'fault' on Instance uuid ea714cda-ef28-4c42-9836-7dd70dcc4f4d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:06:13.174413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:13.187274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-873e20c3-f013-4c4c-b310-35c13723c623 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 200 len: 1305 microversion: 2.1 time: 0.206684 Aug 27 05:06:13.188919 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1359/2782] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:12 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 1305 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:13.205850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-840b85bc-018a-4048-929d-29b0690492b8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1716167626"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:13.210280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-840b85bc-018a-4048-929d-29b0690492b8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:13.216986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840b85bc-018a-4048-929d-29b0690492b8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:13.217721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840b85bc-018a-4048-929d-29b0690492b8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:13.218318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840b85bc-018a-4048-929d-29b0690492b8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:13.219205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840b85bc-018a-4048-929d-29b0690492b8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:13.219810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840b85bc-018a-4048-929d-29b0690492b8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:13.220390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840b85bc-018a-4048-929d-29b0690492b8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:13.546337 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-840b85bc-018a-4048-929d-29b0690492b8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "POST /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137/action" status: 202 len: 0 microversion: 2.1 time: 0.354805 Aug 27 05:06:13.547505 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1360/2783] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:06:13 2022] POST /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 05:06:13.564034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2fa816bf-f0f2-4bbb-9618-5e2f2cb958d7 req-df8d7331-8f3f-466a-8b68-3e00309cb1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d651cd6-26b2-42d8-a902-a63b9e2031e0", "name": "network-vif-unplugged", "status": "completed", "tag": "4c90b0b6-88ed-4bcd-9abd-4403f18530ec"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:13.580634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2fa816bf-f0f2-4bbb-9618-5e2f2cb958d7 req-df8d7331-8f3f-466a-8b68-3e00309cb1db service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:13.581640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2fa816bf-f0f2-4bbb-9618-5e2f2cb958d7 req-df8d7331-8f3f-466a-8b68-3e00309cb1db service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:13.582306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2fa816bf-f0f2-4bbb-9618-5e2f2cb958d7 req-df8d7331-8f3f-466a-8b68-3e00309cb1db service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:13.610088 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2fa816bf-f0f2-4bbb-9618-5e2f2cb958d7 req-df8d7331-8f3f-466a-8b68-3e00309cb1db service nova] Creating event network-vif-unplugged:4c90b0b6-88ed-4bcd-9abd-4403f18530ec for instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 on n-h2-820368-35 Aug 27 05:06:13.619007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-2fa816bf-f0f2-4bbb-9618-5e2f2cb958d7 req-df8d7331-8f3f-466a-8b68-3e00309cb1db service nova] Instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:06:13.638394 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2fa816bf-f0f2-4bbb-9618-5e2f2cb958d7 req-df8d7331-8f3f-466a-8b68-3e00309cb1db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088973 Aug 27 05:06:13.639744 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1361/2784] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:13.649404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-94034c02-541a-4994-850e-513431b32fd1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565962670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:13.717949 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-94034c02-541a-4994-850e-513431b32fd1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.074157 Aug 27 05:06:13.718795 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1362/2785] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:13 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:13.753347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:06:13.755125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:06:13.755836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:06:13.756471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:06:13.757373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:06:13.797796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:13.799121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:13.799732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:13.801585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:13.802228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:13.802991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:13.837394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Getting quotas for project b2cf39cba97b40cda2251f542747a8bb. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:13.844679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Getting quotas for user 332e9244f13f4bc7b6f981991c5b15f5 and project b2cf39cba97b40cda2251f542747a8bb. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:13.861304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:06:13.865031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:06:13.935783 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ac1abecc-9e10-47ff-a721-667aaf2af795 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.866769 Aug 27 05:06:13.937326 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1424/2786] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:06:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:06:13.948897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0b8ed1f9-a6e7-4a55-8be5-3286ba8a5064 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:13.950099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0b8ed1f9-a6e7-4a55-8be5-3286ba8a5064 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:14.001404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-04a0728c-ce19-4b1e-aff3-95d4e66c7f2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:14.002023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-04a0728c-ce19-4b1e-aff3-95d4e66c7f2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:14.017113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04a0728c-ce19-4b1e-aff3-95d4e66c7f2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:14.017435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04a0728c-ce19-4b1e-aff3-95d4e66c7f2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:14.017882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04a0728c-ce19-4b1e-aff3-95d4e66c7f2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:14.020805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04a0728c-ce19-4b1e-aff3-95d4e66c7f2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:14.021297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04a0728c-ce19-4b1e-aff3-95d4e66c7f2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:14.024368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04a0728c-ce19-4b1e-aff3-95d4e66c7f2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:14.069859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0b8ed1f9-a6e7-4a55-8be5-3286ba8a5064 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:14.081771 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0b8ed1f9-a6e7-4a55-8be5-3286ba8a5064 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1228 microversion: 2.1 time: 0.135341 Aug 27 05:06:14.082618 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1363/2787] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:13 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1228 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:14.210407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:14.211079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:14.226365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:14.226856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:14.227327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:14.228036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:14.228707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:14.229460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:14.245596 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d HTTP/1.1 Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'ea714cda-ef28-4c42-9836-7dd70dcc4f4d'} Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:14.247502 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:14.252685 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:14.252685 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:14.252685 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:14.252685 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:06:14.252685 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:06:14.252685 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:06:14.252685 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:14.254911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:06:14.255960 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eacdabd5-9a42-44de-84e4-0ef5e55cb2c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 404 len: 111 microversion: 2.1 time: 0.050048 Aug 27 05:06:14.257776 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1364/2788] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:14 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:06:14.402635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04a0728c-ce19-4b1e-aff3-95d4e66c7f2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:14.415312 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-04a0728c-ce19-4b1e-aff3-95d4e66c7f2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1476 microversion: 2.1 time: 0.417660 Aug 27 05:06:14.415926 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1425/2789] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:13 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1476 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:14.483502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:14.483502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:14.490151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:14.490653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:14.491132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:14.491837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:14.492293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:14.492717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:14.517385 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d/os-volume_attachments HTTP/1.1 Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'server_id': 'ea714cda-ef28-4c42-9836-7dd70dcc4f4d'} Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:06:14.519209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:14.524106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:06:14.525648 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1f4de201-7fa4-4e6a-bece-b4a03f214aa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057610 Aug 27 05:06:14.526552 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1365/2790] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:06:14 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:06:14.734289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f67ccbf6-f82c-41af-9754-00d079aa2070 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56968c040>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:14.784941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-795931651", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "11b9ce7b-910c-4628-97fe-5e2c2147efa3"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:14.833668 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f67ccbf6-f82c-41af-9754-00d079aa2070 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.103032 Aug 27 05:06:14.835040 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1426/2791] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:14 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:14.886760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] validate_networks() for [('11b9ce7b-910c-4628-97fe-5e2c2147efa3', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:06:15.108212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-74944161-1ae7-4a02-a3ef-ab68a4b45460 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:15.109187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-74944161-1ae7-4a02-a3ef-ab68a4b45460 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:15.126000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74944161-1ae7-4a02-a3ef-ab68a4b45460 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:15.127605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74944161-1ae7-4a02-a3ef-ab68a4b45460 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:15.128107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74944161-1ae7-4a02-a3ef-ab68a4b45460 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:15.128857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74944161-1ae7-4a02-a3ef-ab68a4b45460 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:15.130024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74944161-1ae7-4a02-a3ef-ab68a4b45460 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:15.130481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74944161-1ae7-4a02-a3ef-ab68a4b45460 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:15.691923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-74944161-1ae7-4a02-a3ef-ab68a4b45460 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:15.701062 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-74944161-1ae7-4a02-a3ef-ab68a4b45460 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1224 microversion: 2.1 time: 0.598461 Aug 27 05:06:15.704691 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1427/2792] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:15 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1224 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:15.713307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3a5d3b0a-1d45-436f-a310-1bedd063b6c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:15.713933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3a5d3b0a-1d45-436f-a310-1bedd063b6c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:15.741059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5d3b0a-1d45-436f-a310-1bedd063b6c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:15.745868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5d3b0a-1d45-436f-a310-1bedd063b6c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:15.746568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5d3b0a-1d45-436f-a310-1bedd063b6c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:15.747543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5d3b0a-1d45-436f-a310-1bedd063b6c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:15.748862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5d3b0a-1d45-436f-a310-1bedd063b6c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:15.749612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5d3b0a-1d45-436f-a310-1bedd063b6c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:15.934171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:06:15.934764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:06:15.935255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:06:15.935727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:06:15.936319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:06:15.950125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:15.952075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:15.952603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:15.953498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:15.954223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:15.954838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:15.990524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:15.997673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for user d3ae5460271c4f5291e6abb0e76cab17 and project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:16.014392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:06:16.017279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e88738cd-c485-44af-aeb4-57eb2d09b00a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:06:16.078549 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-00b72be7-47c3-4649-83f5-189c64384158 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300347 Aug 27 05:06:16.079959 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1366/2793] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:06:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:06:16.080089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3a5d3b0a-1d45-436f-a310-1bedd063b6c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:16.088923 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3a5d3b0a-1d45-436f-a310-1bedd063b6c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1474 microversion: 2.1 time: 0.382936 Aug 27 05:06:16.091644 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1428/2794] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:15 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1474 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:16.105894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-59da077a-f685-4c7a-97a6-ab0cc258f114 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5695e3700>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:16.107340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3ff0dba2-8be3-4cf8-ae42-777fd422e672 req-8db5712c-fe15-448e-801e-be9062e442ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d651cd6-26b2-42d8-a902-a63b9e2031e0", "tag": "4c90b0b6-88ed-4bcd-9abd-4403f18530ec"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:16.125483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3ff0dba2-8be3-4cf8-ae42-777fd422e672 req-8db5712c-fe15-448e-801e-be9062e442ca service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:16.125974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3ff0dba2-8be3-4cf8-ae42-777fd422e672 req-8db5712c-fe15-448e-801e-be9062e442ca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:16.126562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3ff0dba2-8be3-4cf8-ae42-777fd422e672 req-8db5712c-fe15-448e-801e-be9062e442ca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:16.140573 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3ff0dba2-8be3-4cf8-ae42-777fd422e672 req-8db5712c-fe15-448e-801e-be9062e442ca service nova] Creating event network-changed:4c90b0b6-88ed-4bcd-9abd-4403f18530ec for instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 on n-h2-820368-35 Aug 27 05:06:16.148829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-3ff0dba2-8be3-4cf8-ae42-777fd422e672 req-8db5712c-fe15-448e-801e-be9062e442ca service nova] Instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:06:16.166456 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3ff0dba2-8be3-4cf8-ae42-777fd422e672 req-8db5712c-fe15-448e-801e-be9062e442ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084179 Aug 27 05:06:16.172178 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1367/2795] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:16.173656 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-59da077a-f685-4c7a-97a6-ab0cc258f114 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.079947 Aug 27 05:06:16.178926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e2812acc-f8b7-49a0-8ae1-eaae474e51c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:16.180404 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1429/2796] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:16 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:16.188798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e2812acc-f8b7-49a0-8ae1-eaae474e51c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e88738cd-c485-44af-aeb4-57eb2d09b00a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:16.274779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e2812acc-f8b7-49a0-8ae1-eaae474e51c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:16.282836 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e2812acc-f8b7-49a0-8ae1-eaae474e51c2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a" status: 200 len: 1214 microversion: 2.1 time: 0.109187 Aug 27 05:06:16.287461 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1368/2797] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:16 2022] GET /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:16.305305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae30a238-2c9f-4688-bda3-3b322de959b4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:16.306078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae30a238-2c9f-4688-bda3-3b322de959b4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e88738cd-c485-44af-aeb4-57eb2d09b00a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:16.367623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae30a238-2c9f-4688-bda3-3b322de959b4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e88738cd-c485-44af-aeb4-57eb2d09b00a] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:06:16.635222 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.compute.api [None req-ae30a238-2c9f-4688-bda3-3b322de959b4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e88738cd-c485-44af-aeb4-57eb2d09b00a] Instance Mapping does not exist while attempting local delete cleanup. Aug 27 05:06:16.636778 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae30a238-2c9f-4688-bda3-3b322de959b4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a" status: 204 len: 0 microversion: 2.1 time: 0.338120 Aug 27 05:06:16.638006 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1430/2798] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:06:16 2022] DELETE /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:06:16.651661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6d42b3a6-f72c-4ea7-b20a-d416f6c72dab tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:16.652344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6d42b3a6-f72c-4ea7-b20a-d416f6c72dab tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e88738cd-c485-44af-aeb4-57eb2d09b00a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:16.656482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:16.668040 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-6d42b3a6-f72c-4ea7-b20a-d416f6c72dab tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6d42b3a6-f72c-4ea7-b20a-d416f6c72dab tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a HTTP/1.1 Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e88738cd-c485-44af-aeb4-57eb2d09b00a'} Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:16.670222 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:16.676725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:16.676725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:06:16.676725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:06:16.676725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:06:16.676725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:16.678389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6d42b3a6-f72c-4ea7-b20a-d416f6c72dab tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:06:16.680151 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6d42b3a6-f72c-4ea7-b20a-d416f6c72dab tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a" status: 404 len: 111 microversion: 2.1 time: 0.036458 Aug 27 05:06:16.683254 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1369/2799] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:16 2022] GET /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:06:16.724444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-914a721c-37bc-43a2-b9b9-ea0f5f2c6890 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:16.725220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-914a721c-37bc-43a2-b9b9-ea0f5f2c6890 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:16.727623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:16.741889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-914a721c-37bc-43a2-b9b9-ea0f5f2c6890 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:16.745770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-914a721c-37bc-43a2-b9b9-ea0f5f2c6890 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:16.746441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-914a721c-37bc-43a2-b9b9-ea0f5f2c6890 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:16.747444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-914a721c-37bc-43a2-b9b9-ea0f5f2c6890 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:16.748175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-914a721c-37bc-43a2-b9b9-ea0f5f2c6890 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:16.748727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-914a721c-37bc-43a2-b9b9-ea0f5f2c6890 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:16.762500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1432067991", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "11b9ce7b-910c-4628-97fe-5e2c2147efa3"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:16.834752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] validate_networks() for [('11b9ce7b-910c-4628-97fe-5e2c2147efa3', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:06:16.835217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-914a721c-37bc-43a2-b9b9-ea0f5f2c6890 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:16.844963 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-914a721c-37bc-43a2-b9b9-ea0f5f2c6890 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1286 microversion: 2.1 time: 0.126628 Aug 27 05:06:16.860283 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1431/2800] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:16 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:17.117499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-66fc7237-e360-421b-8f40-b9f82a66f2f2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:17.119518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-66fc7237-e360-421b-8f40-b9f82a66f2f2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:17.128780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66fc7237-e360-421b-8f40-b9f82a66f2f2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:17.129677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66fc7237-e360-421b-8f40-b9f82a66f2f2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:17.130981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66fc7237-e360-421b-8f40-b9f82a66f2f2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:17.132336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66fc7237-e360-421b-8f40-b9f82a66f2f2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:17.133109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66fc7237-e360-421b-8f40-b9f82a66f2f2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:17.134493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66fc7237-e360-421b-8f40-b9f82a66f2f2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:17.357206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:06:17.357699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:06:17.358139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:06:17.358558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:06:17.358981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:06:17.372119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:17.372535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:17.373040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:17.373725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:17.374165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:17.374609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:17.429452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:17.434031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66fc7237-e360-421b-8f40-b9f82a66f2f2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:17.443334 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-66fc7237-e360-421b-8f40-b9f82a66f2f2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1474 microversion: 2.1 time: 0.332154 Aug 27 05:06:17.457209 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1432/2801] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:17 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1474 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:17.460525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for user d3ae5460271c4f5291e6abb0e76cab17 and project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:17.465750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-622da21f-198c-4de1-b19d-ae078982a125 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5695e1c10>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:17.490828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:06:17.493469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:06:17.529970 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-622da21f-198c-4de1-b19d-ae078982a125 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.070861 Aug 27 05:06:17.530556 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1433/2802] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:17 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:17.581580 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0296ad57-b6cf-434e-84e8-3b5123e17c8b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823306 Aug 27 05:06:17.589651 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1370/2803] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:06:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:06:17.594046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aaa75c7e-e7c3-4760-98bd-47632f6adc9d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:17.594787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aaa75c7e-e7c3-4760-98bd-47632f6adc9d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:17.680470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aaa75c7e-e7c3-4760-98bd-47632f6adc9d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:17.688945 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aaa75c7e-e7c3-4760-98bd-47632f6adc9d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1215 microversion: 2.1 time: 0.098897 Aug 27 05:06:17.704240 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1434/2804] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:17 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:17.866443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-725ff8bb-c1d8-428a-94d8-36f0b88e3eb3 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:17.868178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-725ff8bb-c1d8-428a-94d8-36f0b88e3eb3 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:17.876051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-725ff8bb-c1d8-428a-94d8-36f0b88e3eb3 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:17.876843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-725ff8bb-c1d8-428a-94d8-36f0b88e3eb3 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:17.877496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-725ff8bb-c1d8-428a-94d8-36f0b88e3eb3 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:17.878679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-725ff8bb-c1d8-428a-94d8-36f0b88e3eb3 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:17.879917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-725ff8bb-c1d8-428a-94d8-36f0b88e3eb3 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:17.880646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-725ff8bb-c1d8-428a-94d8-36f0b88e3eb3 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:18.072643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-725ff8bb-c1d8-428a-94d8-36f0b88e3eb3 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:18.083866 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-725ff8bb-c1d8-428a-94d8-36f0b88e3eb3 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1328 microversion: 2.1 time: 0.221765 Aug 27 05:06:18.103267 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1371/2805] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:17 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1328 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:18.195444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7f674352-b8f5-4b7a-b94f-bc98a6f85abc req-052a88ec-8db0-4f52-a813-5038228d7839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5e13a6-827c-4445-9982-fc6e176f9932", "tag": "c2a9ea0d-f65e-427e-99b6-73e1ef73539b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:18.214025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7f674352-b8f5-4b7a-b94f-bc98a6f85abc req-052a88ec-8db0-4f52-a813-5038228d7839 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:18.215662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7f674352-b8f5-4b7a-b94f-bc98a6f85abc req-052a88ec-8db0-4f52-a813-5038228d7839 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:18.216454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7f674352-b8f5-4b7a-b94f-bc98a6f85abc req-052a88ec-8db0-4f52-a813-5038228d7839 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:18.245150 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7f674352-b8f5-4b7a-b94f-bc98a6f85abc req-052a88ec-8db0-4f52-a813-5038228d7839 service nova] Creating event network-changed:c2a9ea0d-f65e-427e-99b6-73e1ef73539b for instance 7b5e13a6-827c-4445-9982-fc6e176f9932 on n-h1-820368-35 Aug 27 05:06:18.254773 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7f674352-b8f5-4b7a-b94f-bc98a6f85abc req-052a88ec-8db0-4f52-a813-5038228d7839 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065428 Aug 27 05:06:18.255437 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1435/2806] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:06:18.465005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-20f57de5-69d8-4994-8e9c-ebf80c5dc003 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:18.465780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-20f57de5-69d8-4994-8e9c-ebf80c5dc003 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:18.491151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20f57de5-69d8-4994-8e9c-ebf80c5dc003 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:18.491699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20f57de5-69d8-4994-8e9c-ebf80c5dc003 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:18.492288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20f57de5-69d8-4994-8e9c-ebf80c5dc003 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:18.493086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20f57de5-69d8-4994-8e9c-ebf80c5dc003 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:18.493556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20f57de5-69d8-4994-8e9c-ebf80c5dc003 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:18.493996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20f57de5-69d8-4994-8e9c-ebf80c5dc003 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:18.545893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-05829af5-216b-4722-a1d2-ce0960a8a0c1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56968cf70>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:18.626305 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-05829af5-216b-4722-a1d2-ce0960a8a0c1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.084478 Aug 27 05:06:18.627325 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1436/2807] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:18 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:18.671309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-20f57de5-69d8-4994-8e9c-ebf80c5dc003 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:18.680185 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-20f57de5-69d8-4994-8e9c-ebf80c5dc003 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1474 microversion: 2.1 time: 0.219289 Aug 27 05:06:18.682770 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1372/2808] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:18 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1474 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:18.711588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6cfc6534-d064-4330-96e7-f443d26f7ca3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:18.713673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6cfc6534-d064-4330-96e7-f443d26f7ca3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:18.721435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cfc6534-d064-4330-96e7-f443d26f7ca3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:18.723946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cfc6534-d064-4330-96e7-f443d26f7ca3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:18.724409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cfc6534-d064-4330-96e7-f443d26f7ca3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:18.725144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cfc6534-d064-4330-96e7-f443d26f7ca3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:18.725608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cfc6534-d064-4330-96e7-f443d26f7ca3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:18.726041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cfc6534-d064-4330-96e7-f443d26f7ca3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:18.802018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6cfc6534-d064-4330-96e7-f443d26f7ca3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:18.810231 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6cfc6534-d064-4330-96e7-f443d26f7ca3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1219 microversion: 2.1 time: 0.103806 Aug 27 05:06:18.810816 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1437/2809] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:18 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:19.105376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-068b562e-2782-405f-bca1-ad12a90086f5 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:19.106016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-068b562e-2782-405f-bca1-ad12a90086f5 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:19.112850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-068b562e-2782-405f-bca1-ad12a90086f5 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:19.113626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-068b562e-2782-405f-bca1-ad12a90086f5 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:19.114776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-068b562e-2782-405f-bca1-ad12a90086f5 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:19.115529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-068b562e-2782-405f-bca1-ad12a90086f5 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:19.115985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-068b562e-2782-405f-bca1-ad12a90086f5 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:19.116418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-068b562e-2782-405f-bca1-ad12a90086f5 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:19.252665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-068b562e-2782-405f-bca1-ad12a90086f5 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:19.262905 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-068b562e-2782-405f-bca1-ad12a90086f5 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1328 microversion: 2.1 time: 0.161654 Aug 27 05:06:19.263910 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1373/2810] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:19 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1328 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:19.641953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aae37313-e114-4da5-97bd-31a509f58155 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5696d8dc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:19.689385 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aae37313-e114-4da5-97bd-31a509f58155 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.051292 Aug 27 05:06:19.689979 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1438/2811] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:19 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:19.704390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ffe42c3-0356-43b8-9591-f52d1e74f5db tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:19.705713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4ffe42c3-0356-43b8-9591-f52d1e74f5db tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:19.714588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ffe42c3-0356-43b8-9591-f52d1e74f5db tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:19.715563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ffe42c3-0356-43b8-9591-f52d1e74f5db tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:19.716232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ffe42c3-0356-43b8-9591-f52d1e74f5db tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:19.717412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ffe42c3-0356-43b8-9591-f52d1e74f5db tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:19.718149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ffe42c3-0356-43b8-9591-f52d1e74f5db tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:19.718805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ffe42c3-0356-43b8-9591-f52d1e74f5db tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:19.831913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78d7904d-3080-441e-8c2b-743c87334267 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:19.833321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-78d7904d-3080-441e-8c2b-743c87334267 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:19.853798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78d7904d-3080-441e-8c2b-743c87334267 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:19.855120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78d7904d-3080-441e-8c2b-743c87334267 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:19.855759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78d7904d-3080-441e-8c2b-743c87334267 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:19.856492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78d7904d-3080-441e-8c2b-743c87334267 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:19.857423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78d7904d-3080-441e-8c2b-743c87334267 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:19.858175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78d7904d-3080-441e-8c2b-743c87334267 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:20.023992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-78d7904d-3080-441e-8c2b-743c87334267 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:20.032981 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-78d7904d-3080-441e-8c2b-743c87334267 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1267 microversion: 2.1 time: 0.205791 Aug 27 05:06:20.033845 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1439/2812] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:19 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:20.055980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ffe42c3-0356-43b8-9591-f52d1e74f5db tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:20.064990 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ffe42c3-0356-43b8-9591-f52d1e74f5db tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1474 microversion: 2.1 time: 0.365053 Aug 27 05:06:20.065660 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1374/2813] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:19 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1474 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:20.288126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fa9fff9c-404f-4fbe-ab47-769169dbecc2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:20.288947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fa9fff9c-404f-4fbe-ab47-769169dbecc2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:20.297707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa9fff9c-404f-4fbe-ab47-769169dbecc2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:20.298436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa9fff9c-404f-4fbe-ab47-769169dbecc2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:20.299071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa9fff9c-404f-4fbe-ab47-769169dbecc2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:20.300533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa9fff9c-404f-4fbe-ab47-769169dbecc2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:20.301186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa9fff9c-404f-4fbe-ab47-769169dbecc2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:20.302116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa9fff9c-404f-4fbe-ab47-769169dbecc2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:20.470930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8b423ebc-4ca8-461e-b64b-8a8363b64153 req-77f64ba0-c8d3-4e69-b787-849c695c6dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d757ef9d-8acc-4bfc-8c45-7de22ca35137", "name": "network-vif-plugged", "status": "completed", "tag": "56ad0552-0093-40fb-9e6f-7edf533a561e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:20.493733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8b423ebc-4ca8-461e-b64b-8a8363b64153 req-77f64ba0-c8d3-4e69-b787-849c695c6dfa service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:20.494490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8b423ebc-4ca8-461e-b64b-8a8363b64153 req-77f64ba0-c8d3-4e69-b787-849c695c6dfa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:20.495918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8b423ebc-4ca8-461e-b64b-8a8363b64153 req-77f64ba0-c8d3-4e69-b787-849c695c6dfa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:20.517593 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8b423ebc-4ca8-461e-b64b-8a8363b64153 req-77f64ba0-c8d3-4e69-b787-849c695c6dfa service nova] Creating event network-vif-plugged:56ad0552-0093-40fb-9e6f-7edf533a561e for instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 on n-h2-820368-35 Aug 27 05:06:20.540013 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8b423ebc-4ca8-461e-b64b-8a8363b64153 req-77f64ba0-c8d3-4e69-b787-849c695c6dfa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065636 Aug 27 05:06:20.542436 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1375/2814] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:06:20.592952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fa9fff9c-404f-4fbe-ab47-769169dbecc2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:20.629984 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fa9fff9c-404f-4fbe-ab47-769169dbecc2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1328 microversion: 2.1 time: 0.349346 Aug 27 05:06:20.642214 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1440/2815] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:20 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1328 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:20.705865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c29f01bc-cc99-4cfd-8884-2aee34e64fdc tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565783940>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:20.752717 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c29f01bc-cc99-4cfd-8884-2aee34e64fdc tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.051313 Aug 27 05:06:20.753290 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1376/2816] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:20 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:21.055058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ed44486a-8034-4cd4-9ab3-106005821b8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:21.056499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ed44486a-8034-4cd4-9ab3-106005821b8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:21.066039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed44486a-8034-4cd4-9ab3-106005821b8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.067251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed44486a-8034-4cd4-9ab3-106005821b8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.067917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed44486a-8034-4cd4-9ab3-106005821b8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.070221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed44486a-8034-4cd4-9ab3-106005821b8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.071498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed44486a-8034-4cd4-9ab3-106005821b8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.071950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed44486a-8034-4cd4-9ab3-106005821b8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.087476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-874ef22f-e519-437f-bcbb-4463392e1623 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:21.089894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-874ef22f-e519-437f-bcbb-4463392e1623 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:21.112457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-874ef22f-e519-437f-bcbb-4463392e1623 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.115665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-874ef22f-e519-437f-bcbb-4463392e1623 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.117218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-874ef22f-e519-437f-bcbb-4463392e1623 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.119442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-874ef22f-e519-437f-bcbb-4463392e1623 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.121318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-874ef22f-e519-437f-bcbb-4463392e1623 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.123477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-874ef22f-e519-437f-bcbb-4463392e1623 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.222476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ed44486a-8034-4cd4-9ab3-106005821b8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:21.232532 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ed44486a-8034-4cd4-9ab3-106005821b8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1273 microversion: 2.1 time: 0.182416 Aug 27 05:06:21.233805 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1441/2817] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:21 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:21.337876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-874ef22f-e519-437f-bcbb-4463392e1623 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:21.355473 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-874ef22f-e519-437f-bcbb-4463392e1623 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1471 microversion: 2.1 time: 0.273413 Aug 27 05:06:21.356497 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1377/2818] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:21 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1471 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:21.382734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0034b79-6580-45b7-a156-3fa787943656 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:21.383322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c0034b79-6580-45b7-a156-3fa787943656 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:21.389480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0034b79-6580-45b7-a156-3fa787943656 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.389976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0034b79-6580-45b7-a156-3fa787943656 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.390481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0034b79-6580-45b7-a156-3fa787943656 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.391136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0034b79-6580-45b7-a156-3fa787943656 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.392318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0034b79-6580-45b7-a156-3fa787943656 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.392894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0034b79-6580-45b7-a156-3fa787943656 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.457939 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c0034b79-6580-45b7-a156-3fa787943656 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "POST /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0/action" status: 204 len: 0 microversion: 2.1 time: 0.078762 Aug 27 05:06:21.458688 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1442/2819] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:06:21 2022] POST /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:06:21.472163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-61087073-faf6-4d43-9cff-0d2f4c144818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:21.472795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-61087073-faf6-4d43-9cff-0d2f4c144818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:21.488501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61087073-faf6-4d43-9cff-0d2f4c144818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.489044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61087073-faf6-4d43-9cff-0d2f4c144818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.489487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61087073-faf6-4d43-9cff-0d2f4c144818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.490218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61087073-faf6-4d43-9cff-0d2f4c144818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.490958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61087073-faf6-4d43-9cff-0d2f4c144818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.492796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61087073-faf6-4d43-9cff-0d2f4c144818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.653821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-61087073-faf6-4d43-9cff-0d2f4c144818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:21.663254 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-61087073-faf6-4d43-9cff-0d2f4c144818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1471 microversion: 2.1 time: 0.199760 Aug 27 05:06:21.663758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d808c6f5-291a-4dcf-a16e-c9145bf67205 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:21.664281 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1378/2820] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:21 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:21.665505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d808c6f5-291a-4dcf-a16e-c9145bf67205 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:21.672870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d808c6f5-291a-4dcf-a16e-c9145bf67205 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.673880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d808c6f5-291a-4dcf-a16e-c9145bf67205 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.674546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d808c6f5-291a-4dcf-a16e-c9145bf67205 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.675555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d808c6f5-291a-4dcf-a16e-c9145bf67205 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.676283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d808c6f5-291a-4dcf-a16e-c9145bf67205 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.676943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d808c6f5-291a-4dcf-a16e-c9145bf67205 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.772773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ba008a7-9aaa-4c81-86fd-b207ecb38cbb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565797310>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:21.839706 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ba008a7-9aaa-4c81-86fd-b207ecb38cbb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.074665 Aug 27 05:06:21.841249 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1379/2821] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:21 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:21.858146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d808c6f5-291a-4dcf-a16e-c9145bf67205 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:21.867381 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d808c6f5-291a-4dcf-a16e-c9145bf67205 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1328 microversion: 2.1 time: 0.212535 Aug 27 05:06:21.868159 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1443/2822] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:21 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1328 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:22.254548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1abbff5-055a-46f2-b0e2-d4260b1b1855 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:22.255801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1abbff5-055a-46f2-b0e2-d4260b1b1855 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:22.263541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1abbff5-055a-46f2-b0e2-d4260b1b1855 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:22.264307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1abbff5-055a-46f2-b0e2-d4260b1b1855 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:22.264960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1abbff5-055a-46f2-b0e2-d4260b1b1855 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:22.266149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1abbff5-055a-46f2-b0e2-d4260b1b1855 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:22.266820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1abbff5-055a-46f2-b0e2-d4260b1b1855 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:22.267657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1abbff5-055a-46f2-b0e2-d4260b1b1855 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:22.444045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1abbff5-055a-46f2-b0e2-d4260b1b1855 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:22.453081 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1abbff5-055a-46f2-b0e2-d4260b1b1855 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1315 microversion: 2.1 time: 0.202476 Aug 27 05:06:22.463755 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1380/2823] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:22 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:22.684715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-440bb22d-2473-4669-8014-fe04576d202a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:22.685516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-440bb22d-2473-4669-8014-fe04576d202a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:22.695681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-440bb22d-2473-4669-8014-fe04576d202a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:22.696039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-440bb22d-2473-4669-8014-fe04576d202a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:22.696548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-440bb22d-2473-4669-8014-fe04576d202a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:22.697364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-440bb22d-2473-4669-8014-fe04576d202a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:22.697969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-440bb22d-2473-4669-8014-fe04576d202a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:22.698711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-440bb22d-2473-4669-8014-fe04576d202a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:22.854896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0bd43153-eabd-4d68-b130-16723c633b2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5657975e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:22.862288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-440bb22d-2473-4669-8014-fe04576d202a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:22.873024 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-440bb22d-2473-4669-8014-fe04576d202a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1471 microversion: 2.1 time: 0.192167 Aug 27 05:06:22.874357 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1444/2824] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:22 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:22.889674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae1c4072-ec8d-4f13-b0f6-8e7e405c42d2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:22.890918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae1c4072-ec8d-4f13-b0f6-8e7e405c42d2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:22.899276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae1c4072-ec8d-4f13-b0f6-8e7e405c42d2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:22.900641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae1c4072-ec8d-4f13-b0f6-8e7e405c42d2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:22.901378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae1c4072-ec8d-4f13-b0f6-8e7e405c42d2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:22.902906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae1c4072-ec8d-4f13-b0f6-8e7e405c42d2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:22.903717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae1c4072-ec8d-4f13-b0f6-8e7e405c42d2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:22.904970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae1c4072-ec8d-4f13-b0f6-8e7e405c42d2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:22.948424 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0bd43153-eabd-4d68-b130-16723c633b2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.097752 Aug 27 05:06:22.955757 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1381/2825] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:22 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:23.024190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8137dc6c-9f8c-4cff-8798-4e4ed4885701 req-cf86b55c-d452-48b9-b1c7-9bf6705aec72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d651cd6-26b2-42d8-a902-a63b9e2031e0", "name": "network-vif-plugged", "status": "completed", "tag": "4c90b0b6-88ed-4bcd-9abd-4403f18530ec"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:23.045764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8137dc6c-9f8c-4cff-8798-4e4ed4885701 req-cf86b55c-d452-48b9-b1c7-9bf6705aec72 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:23.047724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8137dc6c-9f8c-4cff-8798-4e4ed4885701 req-cf86b55c-d452-48b9-b1c7-9bf6705aec72 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:23.048174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8137dc6c-9f8c-4cff-8798-4e4ed4885701 req-cf86b55c-d452-48b9-b1c7-9bf6705aec72 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:23.075529 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8137dc6c-9f8c-4cff-8798-4e4ed4885701 req-cf86b55c-d452-48b9-b1c7-9bf6705aec72 service nova] Creating event network-vif-plugged:4c90b0b6-88ed-4bcd-9abd-4403f18530ec for instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 on n-h2-820368-35 Aug 27 05:06:23.095734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-8137dc6c-9f8c-4cff-8798-4e4ed4885701 req-cf86b55c-d452-48b9-b1c7-9bf6705aec72 service nova] Instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:06:23.118317 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8137dc6c-9f8c-4cff-8798-4e4ed4885701 req-cf86b55c-d452-48b9-b1c7-9bf6705aec72 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098660 Aug 27 05:06:23.119256 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1382/2826] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:06:23.140101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae1c4072-ec8d-4f13-b0f6-8e7e405c42d2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:23.149205 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae1c4072-ec8d-4f13-b0f6-8e7e405c42d2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1328 microversion: 2.1 time: 0.263918 Aug 27 05:06:23.150510 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1445/2827] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:22 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1328 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:23.311654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e73af20d-2975-439e-8e20-d7591e03bdac req-2ad38860-5a1d-4c72-ba4d-6e937616a1bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5444757-a4f6-468b-b13c-09adffde5530", "tag": "e944f223-d71a-4dfc-9a1d-92e8a415f242"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:23.335241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e73af20d-2975-439e-8e20-d7591e03bdac req-2ad38860-5a1d-4c72-ba4d-6e937616a1bb service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:23.335972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e73af20d-2975-439e-8e20-d7591e03bdac req-2ad38860-5a1d-4c72-ba4d-6e937616a1bb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:23.336638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e73af20d-2975-439e-8e20-d7591e03bdac req-2ad38860-5a1d-4c72-ba4d-6e937616a1bb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:23.352056 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e73af20d-2975-439e-8e20-d7591e03bdac req-2ad38860-5a1d-4c72-ba4d-6e937616a1bb service nova] Creating event network-changed:e944f223-d71a-4dfc-9a1d-92e8a415f242 for instance b5444757-a4f6-468b-b13c-09adffde5530 on n-h2-820368-35 Aug 27 05:06:23.363451 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e73af20d-2975-439e-8e20-d7591e03bdac req-2ad38860-5a1d-4c72-ba4d-6e937616a1bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064735 Aug 27 05:06:23.366152 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1383/2828] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:23.475392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bdf99467-4305-4d69-894a-4914e80bfd63 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:23.476745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bdf99467-4305-4d69-894a-4914e80bfd63 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:23.483306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdf99467-4305-4d69-894a-4914e80bfd63 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:23.483809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdf99467-4305-4d69-894a-4914e80bfd63 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:23.484246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdf99467-4305-4d69-894a-4914e80bfd63 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:23.484938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdf99467-4305-4d69-894a-4914e80bfd63 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:23.485389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdf99467-4305-4d69-894a-4914e80bfd63 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:23.485811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdf99467-4305-4d69-894a-4914e80bfd63 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:23.492188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:23.633895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bdf99467-4305-4d69-894a-4914e80bfd63 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:23.642131 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bdf99467-4305-4d69-894a-4914e80bfd63 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1315 microversion: 2.1 time: 0.170679 Aug 27 05:06:23.642651 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1446/2829] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:23 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:23.896291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-56dfaf73-eb0d-4b56-b8c9-a251be51d677 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:23.897226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-56dfaf73-eb0d-4b56-b8c9-a251be51d677 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:23.906288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56dfaf73-eb0d-4b56-b8c9-a251be51d677 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:23.907183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56dfaf73-eb0d-4b56-b8c9-a251be51d677 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:23.908029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56dfaf73-eb0d-4b56-b8c9-a251be51d677 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:23.908815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56dfaf73-eb0d-4b56-b8c9-a251be51d677 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:23.909406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56dfaf73-eb0d-4b56-b8c9-a251be51d677 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:23.909885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56dfaf73-eb0d-4b56-b8c9-a251be51d677 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:23.964536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-31543010-7708-4d59-a229-ce16f2a540a3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56969cc10>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:23.978704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:24.021964 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-31543010-7708-4d59-a229-ce16f2a540a3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.062486 Aug 27 05:06:24.023424 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1447/2830] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:23 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:24.076433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-56dfaf73-eb0d-4b56-b8c9-a251be51d677 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:24.084987 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-56dfaf73-eb0d-4b56-b8c9-a251be51d677 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1463 microversion: 2.1 time: 0.193737 Aug 27 05:06:24.085599 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1384/2831] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:23 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1463 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:24.106262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-83f4b5e2-ed06-4ebf-9b7e-fce0cb256c76 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:24.106906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-83f4b5e2-ed06-4ebf-9b7e-fce0cb256c76 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:24.113797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f4b5e2-ed06-4ebf-9b7e-fce0cb256c76 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:24.114279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f4b5e2-ed06-4ebf-9b7e-fce0cb256c76 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:24.114714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f4b5e2-ed06-4ebf-9b7e-fce0cb256c76 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:24.115494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f4b5e2-ed06-4ebf-9b7e-fce0cb256c76 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:24.115953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f4b5e2-ed06-4ebf-9b7e-fce0cb256c76 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:24.116377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f4b5e2-ed06-4ebf-9b7e-fce0cb256c76 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:24.170010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c6e6fcd-e400-417a-a783-8ce715d4a01e tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:24.170636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c6e6fcd-e400-417a-a783-8ce715d4a01e tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:24.176859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6e6fcd-e400-417a-a783-8ce715d4a01e tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:24.177404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6e6fcd-e400-417a-a783-8ce715d4a01e tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:24.178070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6e6fcd-e400-417a-a783-8ce715d4a01e tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:24.178951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6e6fcd-e400-417a-a783-8ce715d4a01e tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:24.179596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6e6fcd-e400-417a-a783-8ce715d4a01e tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:24.180194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6e6fcd-e400-417a-a783-8ce715d4a01e tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:24.309445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-83f4b5e2-ed06-4ebf-9b7e-fce0cb256c76 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:24.324497 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-83f4b5e2-ed06-4ebf-9b7e-fce0cb256c76 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1463 microversion: 2.1 time: 0.221910 Aug 27 05:06:24.336694 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1448/2832] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:24 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1463 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:24.351222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eb749148-82a4-4e2c-910a-c304bbc9acdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Action: 'create', calling method: .version_select at 0x7fb5695d0af0>, body: {"keypair": {"name": "tempest-keypair-1955645992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXoe5ynxTmjnRD0SP+3X1B7HCVJsIfQN/zRp8obDKorwAsQmPL+LQN7rlWUH1WMxxWOQEFu7AkoFvoAXYMsAco8tZI8z2EfAISQH0z8hkIPX87LQ+Qk5BlC0JNHBPwkRw=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:24.362483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c6e6fcd-e400-417a-a783-8ce715d4a01e tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:24.371754 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c6e6fcd-e400-417a-a783-8ce715d4a01e tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1328 microversion: 2.1 time: 0.205696 Aug 27 05:06:24.374845 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1385/2833] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:24 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1328 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:24.387277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-eb749148-82a4-4e2c-910a-c304bbc9acdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:24.387277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-eb749148-82a4-4e2c-910a-c304bbc9acdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for user 58b3a6b755ba4d5f89899d3122ddc29d and project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:24.413045 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eb749148-82a4-4e2c-910a-c304bbc9acdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067670 Aug 27 05:06:24.419164 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1449/2834] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:06:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:24.664574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4b48c899-b118-45da-bb63-f223c0e0bfa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:24.665418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4b48c899-b118-45da-bb63-f223c0e0bfa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:24.671928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b48c899-b118-45da-bb63-f223c0e0bfa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:24.672548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b48c899-b118-45da-bb63-f223c0e0bfa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:24.673188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b48c899-b118-45da-bb63-f223c0e0bfa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:24.674052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b48c899-b118-45da-bb63-f223c0e0bfa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:24.674544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b48c899-b118-45da-bb63-f223c0e0bfa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:24.675208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b48c899-b118-45da-bb63-f223c0e0bfa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:24.709477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:24.900275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4b48c899-b118-45da-bb63-f223c0e0bfa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:24.918144 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4b48c899-b118-45da-bb63-f223c0e0bfa4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1315 microversion: 2.1 time: 0.257922 Aug 27 05:06:24.919482 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1386/2835] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:24 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:25.037975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c75632a4-20c5-43c1-8f2b-5ec91d571d3d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56962e550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:25.097688 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c75632a4-20c5-43c1-8f2b-5ec91d571d3d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.064449 Aug 27 05:06:25.103226 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1450/2836] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:25 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:25.396996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-85580cc4-8c66-4b35-8f7a-74732ecba51d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:25.402623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-85580cc4-8c66-4b35-8f7a-74732ecba51d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:25.410083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85580cc4-8c66-4b35-8f7a-74732ecba51d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:25.411181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85580cc4-8c66-4b35-8f7a-74732ecba51d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:25.412077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85580cc4-8c66-4b35-8f7a-74732ecba51d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:25.412872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85580cc4-8c66-4b35-8f7a-74732ecba51d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:25.413572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85580cc4-8c66-4b35-8f7a-74732ecba51d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:25.414073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85580cc4-8c66-4b35-8f7a-74732ecba51d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:25.563245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-85580cc4-8c66-4b35-8f7a-74732ecba51d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:25.573086 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-85580cc4-8c66-4b35-8f7a-74732ecba51d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1328 microversion: 2.1 time: 0.181168 Aug 27 05:06:25.574004 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1387/2837] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:25 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1328 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:25.810670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d902479b-68d5-47e4-922d-a3ca784bf45e tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Calling method '.version_select at 0x7fb56955fee0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:25.814076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d902479b-68d5-47e4-922d-a3ca784bf45e tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:25.814569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d902479b-68d5-47e4-922d-a3ca784bf45e tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:25.815017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d902479b-68d5-47e4-922d-a3ca784bf45e tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:25.825478 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d902479b-68d5-47e4-922d-a3ca784bf45e tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.019472 Aug 27 05:06:25.826081 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1451/2838] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 05:06:25 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:25.847584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7e2db1ee-308f-442d-a668-7a9d6d0161ee tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:25.854830 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7e2db1ee-308f-442d-a668-7a9d6d0161ee tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010945 Aug 27 05:06:25.855441 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1388/2839] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:06:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:25.867505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-782b32e0-2d53-4060-9f91-a8f2f4cfd841 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2065515227", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:25.890000 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-782b32e0-2d53-4060-9f91-a8f2f4cfd841 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.026989 Aug 27 05:06:25.890589 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1452/2840] 10.222.0.58 () {60 vars in 1146 bytes} [Sat Aug 27 05:06:25 2022] POST /compute/v2.1/flavors => generated 499 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:25.901836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa138295-942d-4465-8cac-f2139fd4a2ec tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:25.910405 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa138295-942d-4465-8cac-f2139fd4a2ec tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012288 Aug 27 05:06:25.911169 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1389/2841] 10.222.0.58 () {58 vars in 1182 bytes} [Sat Aug 27 05:06:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:06:25.942718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-03932290-1750-4930-b35e-bc77e393926a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:25.943371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-03932290-1750-4930-b35e-bc77e393926a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:25.949426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03932290-1750-4930-b35e-bc77e393926a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:25.949903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03932290-1750-4930-b35e-bc77e393926a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:25.950339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03932290-1750-4930-b35e-bc77e393926a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:25.951032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03932290-1750-4930-b35e-bc77e393926a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:25.951516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03932290-1750-4930-b35e-bc77e393926a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:25.951943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03932290-1750-4930-b35e-bc77e393926a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:26.021789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-238543264", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "f866ad4a-7ec5-4045-8699-bdeff6744445"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:26.079119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:06:26.103442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-03932290-1750-4930-b35e-bc77e393926a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:26.111458 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-03932290-1750-4930-b35e-bc77e393926a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1315 microversion: 2.1 time: 0.173236 Aug 27 05:06:26.112459 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1453/2842] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:25 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:26.117705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c872fef8-5967-4778-81f1-5b7591266884 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56953db80>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:26.166325 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c872fef8-5967-4778-81f1-5b7591266884 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.052609 Aug 27 05:06:26.167030 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1454/2843] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:26 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:26.320877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:06:26.323653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:06:26.324167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:06:26.324591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:06:26.325030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:06:26.334692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:26.335828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:26.336284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:26.337025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:26.337490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:26.337928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:26.356182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:26.362181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for user 58b3a6b755ba4d5f89899d3122ddc29d and project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:26.376378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:06:26.378839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:06:26.390263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d5498de6-cbd3-4894-8a8a-7f21e3504ef5 req-5c04c744-de4e-416c-baac-6340c81db8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5e13a6-827c-4445-9982-fc6e176f9932", "name": "network-vif-plugged", "status": "completed", "tag": "c2a9ea0d-f65e-427e-99b6-73e1ef73539b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:26.401162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d5498de6-cbd3-4894-8a8a-7f21e3504ef5 req-5c04c744-de4e-416c-baac-6340c81db8e1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:26.402063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d5498de6-cbd3-4894-8a8a-7f21e3504ef5 req-5c04c744-de4e-416c-baac-6340c81db8e1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:26.402660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d5498de6-cbd3-4894-8a8a-7f21e3504ef5 req-5c04c744-de4e-416c-baac-6340c81db8e1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:26.421059 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d5498de6-cbd3-4894-8a8a-7f21e3504ef5 req-5c04c744-de4e-416c-baac-6340c81db8e1 service nova] Creating event network-vif-plugged:c2a9ea0d-f65e-427e-99b6-73e1ef73539b for instance 7b5e13a6-827c-4445-9982-fc6e176f9932 on n-h1-820368-35 Aug 27 05:06:26.425920 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d5498de6-cbd3-4894-8a8a-7f21e3504ef5 req-5c04c744-de4e-416c-baac-6340c81db8e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039315 Aug 27 05:06:26.427073 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1455/2844] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:06:26.435769 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3050ce42-a763-4738-8b1d-7d597057dc93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.417982 Aug 27 05:06:26.436732 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1390/2845] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:06:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:06:26.449812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e4d4c797-bf7e-4964-9ba0-f8660942a8a3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:26.451020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e4d4c797-bf7e-4964-9ba0-f8660942a8a3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:26.514987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e4d4c797-bf7e-4964-9ba0-f8660942a8a3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:26.527001 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e4d4c797-bf7e-4964-9ba0-f8660942a8a3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1278 microversion: 2.1 time: 0.081325 Aug 27 05:06:26.541515 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1456/2846] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:26 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:26.593934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7532a7b2-2a89-45aa-a503-887b5fc3c603 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:26.594548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7532a7b2-2a89-45aa-a503-887b5fc3c603 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:26.601333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7532a7b2-2a89-45aa-a503-887b5fc3c603 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:26.601821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7532a7b2-2a89-45aa-a503-887b5fc3c603 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:26.602258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7532a7b2-2a89-45aa-a503-887b5fc3c603 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:26.602959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7532a7b2-2a89-45aa-a503-887b5fc3c603 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:26.603433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7532a7b2-2a89-45aa-a503-887b5fc3c603 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:26.604053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7532a7b2-2a89-45aa-a503-887b5fc3c603 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:26.757702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7532a7b2-2a89-45aa-a503-887b5fc3c603 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:26.774496 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7532a7b2-2a89-45aa-a503-887b5fc3c603 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1328 microversion: 2.1 time: 0.184284 Aug 27 05:06:26.775136 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1391/2847] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:26 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1328 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:27.133831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce6bdb3e-0f5d-4f00-849e-8fc51934baf8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:27.134479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ce6bdb3e-0f5d-4f00-849e-8fc51934baf8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:27.142581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce6bdb3e-0f5d-4f00-849e-8fc51934baf8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:27.143034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce6bdb3e-0f5d-4f00-849e-8fc51934baf8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:27.143545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce6bdb3e-0f5d-4f00-849e-8fc51934baf8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:27.144298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce6bdb3e-0f5d-4f00-849e-8fc51934baf8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:27.144810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce6bdb3e-0f5d-4f00-849e-8fc51934baf8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:27.145241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce6bdb3e-0f5d-4f00-849e-8fc51934baf8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:27.181780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d81b11b-8f25-465a-88af-bd6eb1dfcf0d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565b315e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:27.228857 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d81b11b-8f25-465a-88af-bd6eb1dfcf0d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.050826 Aug 27 05:06:27.229440 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1392/2848] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:27 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:27.276151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce6bdb3e-0f5d-4f00-849e-8fc51934baf8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:27.283802 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce6bdb3e-0f5d-4f00-849e-8fc51934baf8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1315 microversion: 2.1 time: 0.154866 Aug 27 05:06:27.284363 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1457/2849] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:27 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:27.549269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-31a6fea3-9bd0-407d-bb3c-b4386b351f9a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:27.550410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-31a6fea3-9bd0-407d-bb3c-b4386b351f9a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:27.558732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a6fea3-9bd0-407d-bb3c-b4386b351f9a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:27.559467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a6fea3-9bd0-407d-bb3c-b4386b351f9a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:27.559894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a6fea3-9bd0-407d-bb3c-b4386b351f9a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:27.560734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a6fea3-9bd0-407d-bb3c-b4386b351f9a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:27.561381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a6fea3-9bd0-407d-bb3c-b4386b351f9a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:27.561845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a6fea3-9bd0-407d-bb3c-b4386b351f9a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:27.628123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-31a6fea3-9bd0-407d-bb3c-b4386b351f9a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:27.639782 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-31a6fea3-9bd0-407d-bb3c-b4386b351f9a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1274 microversion: 2.1 time: 0.094615 Aug 27 05:06:27.640531 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1393/2850] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:27 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:27.801786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ba41d4d4-705b-4ea7-881a-69a5c2e325e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:27.806619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ba41d4d4-705b-4ea7-881a-69a5c2e325e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:27.821982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba41d4d4-705b-4ea7-881a-69a5c2e325e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:27.822503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba41d4d4-705b-4ea7-881a-69a5c2e325e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:27.822956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba41d4d4-705b-4ea7-881a-69a5c2e325e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:27.825937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba41d4d4-705b-4ea7-881a-69a5c2e325e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:27.826489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba41d4d4-705b-4ea7-881a-69a5c2e325e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:27.826839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba41d4d4-705b-4ea7-881a-69a5c2e325e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:27.977496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ba41d4d4-705b-4ea7-881a-69a5c2e325e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:27.985628 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ba41d4d4-705b-4ea7-881a-69a5c2e325e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1328 microversion: 2.1 time: 0.193786 Aug 27 05:06:27.986210 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1458/2851] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:27 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1328 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:28.243689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9d09aae1-951c-4627-9e25-59f091af2354 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb569548040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:28.291670 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9d09aae1-951c-4627-9e25-59f091af2354 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.051804 Aug 27 05:06:28.292453 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1394/2852] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:28 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:28.305707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-874bd42a-1ce0-46d0-b033-405c6ca34ca1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:28.306377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-874bd42a-1ce0-46d0-b033-405c6ca34ca1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:28.313407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-874bd42a-1ce0-46d0-b033-405c6ca34ca1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:28.313893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-874bd42a-1ce0-46d0-b033-405c6ca34ca1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:28.314335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-874bd42a-1ce0-46d0-b033-405c6ca34ca1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:28.315063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-874bd42a-1ce0-46d0-b033-405c6ca34ca1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:28.315568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-874bd42a-1ce0-46d0-b033-405c6ca34ca1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:28.315990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-874bd42a-1ce0-46d0-b033-405c6ca34ca1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:28.477583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-874bd42a-1ce0-46d0-b033-405c6ca34ca1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:28.488660 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-874bd42a-1ce0-46d0-b033-405c6ca34ca1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1315 microversion: 2.1 time: 0.186714 Aug 27 05:06:28.489401 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1459/2853] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:28 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:28.662800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-26b265b9-a7d1-4cec-b2d9-54304b54b6d4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:28.663732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-26b265b9-a7d1-4cec-b2d9-54304b54b6d4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:28.673089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26b265b9-a7d1-4cec-b2d9-54304b54b6d4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:28.673618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26b265b9-a7d1-4cec-b2d9-54304b54b6d4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:28.674027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26b265b9-a7d1-4cec-b2d9-54304b54b6d4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:28.674748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26b265b9-a7d1-4cec-b2d9-54304b54b6d4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:28.675240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26b265b9-a7d1-4cec-b2d9-54304b54b6d4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:28.675694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26b265b9-a7d1-4cec-b2d9-54304b54b6d4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:28.742100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-26b265b9-a7d1-4cec-b2d9-54304b54b6d4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:28.751042 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-26b265b9-a7d1-4cec-b2d9-54304b54b6d4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1336 microversion: 2.1 time: 0.093911 Aug 27 05:06:28.765818 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1395/2854] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:28 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:29.005834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-528cc964-abad-43a9-9505-84daee1aad4f tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:29.006729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-528cc964-abad-43a9-9505-84daee1aad4f tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:29.013354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528cc964-abad-43a9-9505-84daee1aad4f tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.013838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528cc964-abad-43a9-9505-84daee1aad4f tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.014275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528cc964-abad-43a9-9505-84daee1aad4f tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.014969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528cc964-abad-43a9-9505-84daee1aad4f tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.015466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528cc964-abad-43a9-9505-84daee1aad4f tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.015891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528cc964-abad-43a9-9505-84daee1aad4f tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.161681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-528cc964-abad-43a9-9505-84daee1aad4f tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:29.169867 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-528cc964-abad-43a9-9505-84daee1aad4f tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1528 microversion: 2.1 time: 0.167908 Aug 27 05:06:29.171419 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1460/2855] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:29 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1528 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:29.192067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-feffc14b-c8fa-4be3-a845-3ef447ba6422 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:29.194050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-feffc14b-c8fa-4be3-a845-3ef447ba6422 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:29.201335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feffc14b-c8fa-4be3-a845-3ef447ba6422 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.202191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feffc14b-c8fa-4be3-a845-3ef447ba6422 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.202778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feffc14b-c8fa-4be3-a845-3ef447ba6422 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.203622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feffc14b-c8fa-4be3-a845-3ef447ba6422 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.204199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feffc14b-c8fa-4be3-a845-3ef447ba6422 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.204729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feffc14b-c8fa-4be3-a845-3ef447ba6422 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.307831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2171b525-e2af-4fd3-974e-a6aeee5b43eb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56957d940>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:29.369805 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2171b525-e2af-4fd3-974e-a6aeee5b43eb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.065573 Aug 27 05:06:29.370426 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1461/2856] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:29 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:29.386732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-feffc14b-c8fa-4be3-a845-3ef447ba6422 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:29.397165 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-feffc14b-c8fa-4be3-a845-3ef447ba6422 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1528 microversion: 2.1 time: 0.209094 Aug 27 05:06:29.398417 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1396/2857] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:29 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1528 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:29.492644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:29.493245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:29.500853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.501455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.501963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.502777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.503283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.503979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.509991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c5d672ec-e2a0-4f3f-9726-00e17bc0a815 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:29.514004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c5d672ec-e2a0-4f3f-9726-00e17bc0a815 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:29.518964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5d672ec-e2a0-4f3f-9726-00e17bc0a815 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.520280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5d672ec-e2a0-4f3f-9726-00e17bc0a815 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.521150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5d672ec-e2a0-4f3f-9726-00e17bc0a815 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.522019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5d672ec-e2a0-4f3f-9726-00e17bc0a815 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.523008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5d672ec-e2a0-4f3f-9726-00e17bc0a815 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.523565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5d672ec-e2a0-4f3f-9726-00e17bc0a815 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.524333 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] HTTP exception thrown: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Request method failure captured: Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 HTTP/1.1 Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaZDxlECk5m8kPgggMYamBvmYVfWWPwHaO7KISAk-TcEwyOiX_F-6tF_ycQ9u-0INJoYPMAwssa_fJKE1ioAUmnAajA5tJBTG7wz0WjiUSxQVo-E4CIafLNcXkBGaX_40mOzzIezwPP7yO9FtdbNH9PfTr0ntJr9zJ-R08DBJ6Y7vRA Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e3bf4e34cb5f4994988a062e58ef8359 Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-562682967 Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e3bf4e34cb5f4994988a062e58ef8359", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e3bf4e34cb5f4994988a062e58ef8359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e3bf4e34cb5f4994988a062e58ef8359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e3bf4e34cb5f4994988a062e58ef8359"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-562682967 Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e3bf4e34cb5f4994988a062e58ef8359 Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-562682967 Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestMultiTenantJSON-562682967-project Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: f5a86e79c0ee4efc91f5976499390f7e Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-562682967-project Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '7b5e13a6-827c-4445-9982-fc6e176f9932'} Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:06:29.526020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Returning 404 to user: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-414d19a2-c4f8-48a8-831b-f29ec42a272d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 404 len: 111 microversion: 2.1 time: 0.113075 Aug 27 05:06:29.531991 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1462/2858] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:06:29 2022] DELETE /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:06:29.537357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a0c48ed-e219-434a-810c-8c1fa579d8e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:29.537980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7a0c48ed-e219-434a-810c-8c1fa579d8e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:29.544280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a0c48ed-e219-434a-810c-8c1fa579d8e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.544844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a0c48ed-e219-434a-810c-8c1fa579d8e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.545271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a0c48ed-e219-434a-810c-8c1fa579d8e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.546073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a0c48ed-e219-434a-810c-8c1fa579d8e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.546569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a0c48ed-e219-434a-810c-8c1fa579d8e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.547198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a0c48ed-e219-434a-810c-8c1fa579d8e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.761697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c5d672ec-e2a0-4f3f-9726-00e17bc0a815 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:29.764231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7a0c48ed-e219-434a-810c-8c1fa579d8e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:29.776121 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a0c48ed-e219-434a-810c-8c1fa579d8e6 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1528 microversion: 2.1 time: 0.242773 Aug 27 05:06:29.792233 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1463/2859] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:29 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1528 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:29.793982 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c5d672ec-e2a0-4f3f-9726-00e17bc0a815 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1315 microversion: 2.1 time: 0.286973 Aug 27 05:06:29.796085 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1397/2860] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:29 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:29.809900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b29ccee-fdf1-446a-9310-66e3d42dd48b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:29.814359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3b29ccee-fdf1-446a-9310-66e3d42dd48b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:29.838111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b29ccee-fdf1-446a-9310-66e3d42dd48b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.838540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Action: 'update', calling method: >, body: {"server": {"name": "7b5e13a6-827c-4445-9982-fc6e176f9932_new"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:29.839208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b29ccee-fdf1-446a-9310-66e3d42dd48b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.839854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b29ccee-fdf1-446a-9310-66e3d42dd48b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.842975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b29ccee-fdf1-446a-9310-66e3d42dd48b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.846288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b29ccee-fdf1-446a-9310-66e3d42dd48b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.847157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b29ccee-fdf1-446a-9310-66e3d42dd48b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.847486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:29.866338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.872768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.877619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.878438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.881318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.881714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.934380 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] HTTP exception thrown: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Request method failure captured: Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: request: PUT /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 HTTP/1.1 Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 64 Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaZDxlECk5m8kPgggMYamBvmYVfWWPwHaO7KISAk-TcEwyOiX_F-6tF_ycQ9u-0INJoYPMAwssa_fJKE1ioAUmnAajA5tJBTG7wz0WjiUSxQVo-E4CIafLNcXkBGaX_40mOzzIezwPP7yO9FtdbNH9PfTr0ntJr9zJ-R08DBJ6Y7vRA Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e3bf4e34cb5f4994988a062e58ef8359 Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-562682967 Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e3bf4e34cb5f4994988a062e58ef8359", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e3bf4e34cb5f4994988a062e58ef8359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e3bf4e34cb5f4994988a062e58ef8359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e3bf4e34cb5f4994988a062e58ef8359"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-562682967 Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e3bf4e34cb5f4994988a062e58ef8359 Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-562682967 Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestMultiTenantJSON-562682967-project Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: f5a86e79c0ee4efc91f5976499390f7e Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-562682967-project Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "7b5e13a6-827c-4445-9982-fc6e176f9932_new"}} Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '7b5e13a6-827c-4445-9982-fc6e176f9932', 'body': {'server': {'name': '7b5e13a6-827c-4445-9982-fc6e176f9932_new'}}} Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:06:29.938453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 916, in update Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:29.943640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:29.946621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] Returning 404 to user: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:06:29.947668 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-66e35361-0672-4d1b-93d8-16634e8a371d tempest-ServersNegativeTestMultiTenantJSON-562682967 tempest-ServersNegativeTestMultiTenantJSON-562682967-project] 10.222.0.58 "PUT /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 404 len: 111 microversion: 2.1 time: 0.136424 Aug 27 05:06:29.948685 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1398/2861] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:06:29 2022] PUT /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:06:29.957293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ee62f42c-61ab-4486-ab4c-92a653022fac tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:29.957802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ee62f42c-61ab-4486-ab4c-92a653022fac tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:29.973526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee62f42c-61ab-4486-ab4c-92a653022fac tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.977578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee62f42c-61ab-4486-ab4c-92a653022fac tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.978244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee62f42c-61ab-4486-ab4c-92a653022fac tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.979193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee62f42c-61ab-4486-ab4c-92a653022fac tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.979814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee62f42c-61ab-4486-ab4c-92a653022fac tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.980634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee62f42c-61ab-4486-ab4c-92a653022fac tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:30.034795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ee62f42c-61ab-4486-ab4c-92a653022fac tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:06:30.097386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3b29ccee-fdf1-446a-9310-66e3d42dd48b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:30.107857 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3b29ccee-fdf1-446a-9310-66e3d42dd48b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1378 microversion: 2.1 time: 0.314180 Aug 27 05:06:30.108660 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1464/2862] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:29 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1378 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:30.203598 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ee62f42c-61ab-4486-ab4c-92a653022fac tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 204 len: 0 microversion: 2.1 time: 0.249154 Aug 27 05:06:30.205032 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1399/2863] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:06:29 2022] DELETE /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:06:30.215573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7fc6ab44-ca83-4c46-9328-97bc5725c296 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:30.216690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7fc6ab44-ca83-4c46-9328-97bc5725c296 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:30.227333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fc6ab44-ca83-4c46-9328-97bc5725c296 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:30.228056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fc6ab44-ca83-4c46-9328-97bc5725c296 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:30.228661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fc6ab44-ca83-4c46-9328-97bc5725c296 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:30.230485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fc6ab44-ca83-4c46-9328-97bc5725c296 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:30.232345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fc6ab44-ca83-4c46-9328-97bc5725c296 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:30.233311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fc6ab44-ca83-4c46-9328-97bc5725c296 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:30.386521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f6e6d00-d35d-4f39-aa8b-5fb370b33c22 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5655f39d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:30.424128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7fc6ab44-ca83-4c46-9328-97bc5725c296 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:30.433534 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7fc6ab44-ca83-4c46-9328-97bc5725c296 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1534 microversion: 2.1 time: 0.223423 Aug 27 05:06:30.434110 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1465/2864] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:30 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1534 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:30.458281 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f6e6d00-d35d-4f39-aa8b-5fb370b33c22 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.075936 Aug 27 05:06:30.459768 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1400/2865] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:30 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:30.837514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-82d029c4-291e-4374-8e74-0f6384d4c4c7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:30.838964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-fd79268d-d28a-4751-af1a-8c8a6fa85515 req-b510197c-b6cd-405a-a0c0-cd3841419d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26820abc-803a-4050-88be-17a76d7164ff", "tag": "2990c3ed-258d-4779-8447-1c23744cef1b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:30.839963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-82d029c4-291e-4374-8e74-0f6384d4c4c7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:30.865918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82d029c4-291e-4374-8e74-0f6384d4c4c7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:30.873771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fd79268d-d28a-4751-af1a-8c8a6fa85515 req-b510197c-b6cd-405a-a0c0-cd3841419d8f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:30.875713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82d029c4-291e-4374-8e74-0f6384d4c4c7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:30.875958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fd79268d-d28a-4751-af1a-8c8a6fa85515 req-b510197c-b6cd-405a-a0c0-cd3841419d8f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:30.876821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fd79268d-d28a-4751-af1a-8c8a6fa85515 req-b510197c-b6cd-405a-a0c0-cd3841419d8f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:30.878227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82d029c4-291e-4374-8e74-0f6384d4c4c7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:30.881052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82d029c4-291e-4374-8e74-0f6384d4c4c7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:30.881610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82d029c4-291e-4374-8e74-0f6384d4c4c7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:30.882302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82d029c4-291e-4374-8e74-0f6384d4c4c7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:30.904775 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-fd79268d-d28a-4751-af1a-8c8a6fa85515 req-b510197c-b6cd-405a-a0c0-cd3841419d8f service nova] Creating event network-changed:2990c3ed-258d-4779-8447-1c23744cef1b for instance 26820abc-803a-4050-88be-17a76d7164ff on n-h1-820368-35 Aug 27 05:06:30.920633 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-fd79268d-d28a-4751-af1a-8c8a6fa85515 req-b510197c-b6cd-405a-a0c0-cd3841419d8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092229 Aug 27 05:06:30.925459 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1401/2866] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:31.094036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-82d029c4-291e-4374-8e74-0f6384d4c4c7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:31.111428 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-82d029c4-291e-4374-8e74-0f6384d4c4c7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1315 microversion: 2.1 time: 0.291081 Aug 27 05:06:31.114173 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1466/2867] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:30 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:31.134556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d31df9e-67e5-4668-96e3-a9e3b83b165c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:31.135230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3d31df9e-67e5-4668-96e3-a9e3b83b165c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:31.148175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d31df9e-67e5-4668-96e3-a9e3b83b165c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:31.149013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d31df9e-67e5-4668-96e3-a9e3b83b165c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:31.149667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d31df9e-67e5-4668-96e3-a9e3b83b165c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:31.150633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d31df9e-67e5-4668-96e3-a9e3b83b165c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:31.151350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d31df9e-67e5-4668-96e3-a9e3b83b165c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:31.152005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d31df9e-67e5-4668-96e3-a9e3b83b165c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:31.217854 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:06:31.218289 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 05:06:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff (ip 10.222.0.58) !!! Aug 27 05:06:31.385362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d31df9e-67e5-4668-96e3-a9e3b83b165c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:31.399394 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d31df9e-67e5-4668-96e3-a9e3b83b165c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1378 microversion: 2.1 time: 0.270447 Aug 27 05:06:31.401736 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1402/2868] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:31 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1378 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:31.457028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c29d80fd-8aef-4686-bc19-209cf79fcecf tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:31.458392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c29d80fd-8aef-4686-bc19-209cf79fcecf tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:31.473845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6109a674-92c5-481c-8c0a-697e9318fd0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565bdec10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:31.480125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c29d80fd-8aef-4686-bc19-209cf79fcecf tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:31.481937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c29d80fd-8aef-4686-bc19-209cf79fcecf tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:31.485936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c29d80fd-8aef-4686-bc19-209cf79fcecf tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:31.487830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c29d80fd-8aef-4686-bc19-209cf79fcecf tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:31.489335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c29d80fd-8aef-4686-bc19-209cf79fcecf tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:31.489937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c29d80fd-8aef-4686-bc19-209cf79fcecf tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:31.569761 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6109a674-92c5-481c-8c0a-697e9318fd0e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.100463 Aug 27 05:06:31.584145 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1403/2869] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:31 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:31.733331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c29d80fd-8aef-4686-bc19-209cf79fcecf tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:31.751660 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c29d80fd-8aef-4686-bc19-209cf79fcecf tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1534 microversion: 2.1 time: 0.298779 Aug 27 05:06:31.767428 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1467/2870] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:31 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1534 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:32.144707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6109a25f-afc0-46b7-9a4a-207023d68fe8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:32.145785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6109a25f-afc0-46b7-9a4a-207023d68fe8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:32.152745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6109a25f-afc0-46b7-9a4a-207023d68fe8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:32.154095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6109a25f-afc0-46b7-9a4a-207023d68fe8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:32.154782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6109a25f-afc0-46b7-9a4a-207023d68fe8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:32.155878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6109a25f-afc0-46b7-9a4a-207023d68fe8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:32.156508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6109a25f-afc0-46b7-9a4a-207023d68fe8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:32.157104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6109a25f-afc0-46b7-9a4a-207023d68fe8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:32.322715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6109a25f-afc0-46b7-9a4a-207023d68fe8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:32.330394 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6109a25f-afc0-46b7-9a4a-207023d68fe8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1315 microversion: 2.1 time: 0.193252 Aug 27 05:06:32.332735 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1404/2871] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:32 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:32.425978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7fd8561c-5d77-47dd-95bd-7d90d57cf8b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:32.427571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7fd8561c-5d77-47dd-95bd-7d90d57cf8b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:32.443797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fd8561c-5d77-47dd-95bd-7d90d57cf8b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:32.444579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fd8561c-5d77-47dd-95bd-7d90d57cf8b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:32.445570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fd8561c-5d77-47dd-95bd-7d90d57cf8b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:32.446715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fd8561c-5d77-47dd-95bd-7d90d57cf8b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:32.447777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fd8561c-5d77-47dd-95bd-7d90d57cf8b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:32.448221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fd8561c-5d77-47dd-95bd-7d90d57cf8b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:32.590620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b7c3e8e4-7ed4-47e3-867c-0c9905613989 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5650225e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:32.666982 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b7c3e8e4-7ed4-47e3-867c-0c9905613989 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.080353 Aug 27 05:06:32.668313 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1405/2872] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:32 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:32.684341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7fd8561c-5d77-47dd-95bd-7d90d57cf8b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:32.696707 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7fd8561c-5d77-47dd-95bd-7d90d57cf8b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1378 microversion: 2.1 time: 0.276481 Aug 27 05:06:32.697634 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1468/2873] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:32 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1378 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:32.775800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd1e4451-91f1-4da8-9f7f-1c724061bac4 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:32.776808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd1e4451-91f1-4da8-9f7f-1c724061bac4 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:32.795812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd1e4451-91f1-4da8-9f7f-1c724061bac4 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:32.796327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd1e4451-91f1-4da8-9f7f-1c724061bac4 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:32.796779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd1e4451-91f1-4da8-9f7f-1c724061bac4 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:32.797535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd1e4451-91f1-4da8-9f7f-1c724061bac4 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:32.803772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd1e4451-91f1-4da8-9f7f-1c724061bac4 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:32.806637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd1e4451-91f1-4da8-9f7f-1c724061bac4 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:32.919031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dd1e4451-91f1-4da8-9f7f-1c724061bac4 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:32.930550 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd1e4451-91f1-4da8-9f7f-1c724061bac4 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1492 microversion: 2.1 time: 0.160497 Aug 27 05:06:32.931683 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1406/2874] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:32 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1492 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:32.961857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6be48278-dd35-47ea-bf9a-efd3f4bc95c8 req-2d54d92c-a25c-4318-9249-f733243659dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5e13a6-827c-4445-9982-fc6e176f9932", "name": "network-vif-deleted", "tag": "c2a9ea0d-f65e-427e-99b6-73e1ef73539b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:32.979698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6be48278-dd35-47ea-bf9a-efd3f4bc95c8 req-2d54d92c-a25c-4318-9249-f733243659dc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:32.981374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6be48278-dd35-47ea-bf9a-efd3f4bc95c8 req-2d54d92c-a25c-4318-9249-f733243659dc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:32.982077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6be48278-dd35-47ea-bf9a-efd3f4bc95c8 req-2d54d92c-a25c-4318-9249-f733243659dc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:33.000259 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6be48278-dd35-47ea-bf9a-efd3f4bc95c8 req-2d54d92c-a25c-4318-9249-f733243659dc service nova] Creating event network-vif-deleted:c2a9ea0d-f65e-427e-99b6-73e1ef73539b for instance 7b5e13a6-827c-4445-9982-fc6e176f9932 on n-h1-820368-35 Aug 27 05:06:33.009174 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6be48278-dd35-47ea-bf9a-efd3f4bc95c8 req-2d54d92c-a25c-4318-9249-f733243659dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054926 Aug 27 05:06:33.012643 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1469/2875] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:33.357767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9d3d73c0-e137-496c-82df-0789a2f2c06e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:33.358591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9d3d73c0-e137-496c-82df-0789a2f2c06e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:33.375746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d3d73c0-e137-496c-82df-0789a2f2c06e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:33.376262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d3d73c0-e137-496c-82df-0789a2f2c06e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:33.376705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d3d73c0-e137-496c-82df-0789a2f2c06e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:33.380433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d3d73c0-e137-496c-82df-0789a2f2c06e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:33.382505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d3d73c0-e137-496c-82df-0789a2f2c06e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:33.387691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d3d73c0-e137-496c-82df-0789a2f2c06e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:33.606202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9d3d73c0-e137-496c-82df-0789a2f2c06e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:33.618297 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9d3d73c0-e137-496c-82df-0789a2f2c06e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1315 microversion: 2.1 time: 0.266064 Aug 27 05:06:33.619665 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1407/2876] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:33 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:33.674885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c253599d-c11d-42ae-9b66-531dc1d0447e req-d56a5630-f27a-44e3-ba66-a0a364cd0b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5444757-a4f6-468b-b13c-09adffde5530", "name": "network-vif-plugged", "status": "completed", "tag": "e944f223-d71a-4dfc-9a1d-92e8a415f242"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:33.682763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eabd9cc6-fb8e-4162-ac80-2776ad55012c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5656b0c10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:33.741671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c253599d-c11d-42ae-9b66-531dc1d0447e req-d56a5630-f27a-44e3-ba66-a0a364cd0b19 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:33.742719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c253599d-c11d-42ae-9b66-531dc1d0447e req-d56a5630-f27a-44e3-ba66-a0a364cd0b19 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:33.743418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c253599d-c11d-42ae-9b66-531dc1d0447e req-d56a5630-f27a-44e3-ba66-a0a364cd0b19 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:33.759276 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c253599d-c11d-42ae-9b66-531dc1d0447e req-d56a5630-f27a-44e3-ba66-a0a364cd0b19 service nova] Creating event network-vif-plugged:e944f223-d71a-4dfc-9a1d-92e8a415f242 for instance b5444757-a4f6-468b-b13c-09adffde5530 on n-h2-820368-35 Aug 27 05:06:33.767027 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c253599d-c11d-42ae-9b66-531dc1d0447e req-d56a5630-f27a-44e3-ba66-a0a364cd0b19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097690 Aug 27 05:06:33.772578 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1470/2877] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:33.774587 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eabd9cc6-fb8e-4162-ac80-2776ad55012c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.095952 Aug 27 05:06:33.776253 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1408/2878] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:33 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:33.785927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5b3b894a-629d-4d6b-9f3b-68989125d3b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:33.787024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5b3b894a-629d-4d6b-9f3b-68989125d3b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:33.794025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3b894a-629d-4d6b-9f3b-68989125d3b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:33.794662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3b894a-629d-4d6b-9f3b-68989125d3b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:33.795258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3b894a-629d-4d6b-9f3b-68989125d3b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:33.796084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3b894a-629d-4d6b-9f3b-68989125d3b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:33.796664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3b894a-629d-4d6b-9f3b-68989125d3b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:33.797191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3b894a-629d-4d6b-9f3b-68989125d3b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:33.956776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:33.960728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:33.972983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:33.976553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:33.977678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:33.978697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:33.979487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:33.980148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:34.025545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:34.026480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:34.027190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:34.027999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lazy-loading 'fault' on Instance uuid 7b5e13a6-827c-4445-9982-fc6e176f9932 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:06:34.091905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:34.108301 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-20d4f1c1-4fb6-46d7-a898-d4596cf7f94d tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1318 microversion: 2.1 time: 0.156182 Aug 27 05:06:34.121790 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1409/2879] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:33 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:34.185071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5b3b894a-629d-4d6b-9f3b-68989125d3b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:34.197133 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5b3b894a-629d-4d6b-9f3b-68989125d3b1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1378 microversion: 2.1 time: 0.423080 Aug 27 05:06:34.197724 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1471/2880] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:33 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1378 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:34.650189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab49a2bd-8664-47ee-854a-4c2ffcf2e2e5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:34.650809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ab49a2bd-8664-47ee-854a-4c2ffcf2e2e5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:34.666586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:34.673256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab49a2bd-8664-47ee-854a-4c2ffcf2e2e5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:34.674596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab49a2bd-8664-47ee-854a-4c2ffcf2e2e5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:34.675309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab49a2bd-8664-47ee-854a-4c2ffcf2e2e5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:34.676612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab49a2bd-8664-47ee-854a-4c2ffcf2e2e5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:34.677302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab49a2bd-8664-47ee-854a-4c2ffcf2e2e5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:34.677949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab49a2bd-8664-47ee-854a-4c2ffcf2e2e5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:34.790392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3fa300e-2d6c-443a-8f1a-15e3ed966469 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56953d3a0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:34.854223 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a3fa300e-2d6c-443a-8f1a-15e3ed966469 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.067737 Aug 27 05:06:34.854812 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1472/2881] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:34 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:34.924508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ab49a2bd-8664-47ee-854a-4c2ffcf2e2e5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:34.933487 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ab49a2bd-8664-47ee-854a-4c2ffcf2e2e5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1315 microversion: 2.1 time: 0.289729 Aug 27 05:06:34.940104 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1410/2882] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:34 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:35.130896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:35.134123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:35.148955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:35.149532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:35.150299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:35.151074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:35.151618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:35.152113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:35.188879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:35.190143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:35.190855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:35.191357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lazy-loading 'fault' on Instance uuid 7b5e13a6-827c-4445-9982-fc6e176f9932 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:06:35.218157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-11e4f159-2421-4c39-9fcf-f06743f428e1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:35.218975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-11e4f159-2421-4c39-9fcf-f06743f428e1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:35.226726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11e4f159-2421-4c39-9fcf-f06743f428e1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:35.227522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11e4f159-2421-4c39-9fcf-f06743f428e1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:35.228045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11e4f159-2421-4c39-9fcf-f06743f428e1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:35.228858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11e4f159-2421-4c39-9fcf-f06743f428e1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:35.229528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11e4f159-2421-4c39-9fcf-f06743f428e1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:35.230203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11e4f159-2421-4c39-9fcf-f06743f428e1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:35.239074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332e9244f13f4bc7b6f981991c5b15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2cf39cba97b40cda2251f542747a8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:35.242897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:35.249146 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-73e5dba1-96c9-4561-9d1a-d4c853335bd0 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 200 len: 1318 microversion: 2.1 time: 0.123372 Aug 27 05:06:35.249826 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1473/2883] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:35 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 1318 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:35.260431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:35.462208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-11e4f159-2421-4c39-9fcf-f06743f428e1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:35.471143 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-11e4f159-2421-4c39-9fcf-f06743f428e1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1378 microversion: 2.1 time: 0.257081 Aug 27 05:06:35.472058 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1411/2884] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:35 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1378 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:35.875394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd500fb0-a10d-4aa8-924c-5992a0aec878 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56962eca0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:35.961617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-813e70b1-ae71-42d1-b577-a13f2fcf74c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:35.964089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-813e70b1-ae71-42d1-b577-a13f2fcf74c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:35.965181 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd500fb0-a10d-4aa8-924c-5992a0aec878 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.099588 Aug 27 05:06:35.967535 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1474/2885] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:35 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:35.992461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-813e70b1-ae71-42d1-b577-a13f2fcf74c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:35.992989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-813e70b1-ae71-42d1-b577-a13f2fcf74c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:35.998655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-813e70b1-ae71-42d1-b577-a13f2fcf74c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:35.999903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-813e70b1-ae71-42d1-b577-a13f2fcf74c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.000606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-813e70b1-ae71-42d1-b577-a13f2fcf74c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.001230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-813e70b1-ae71-42d1-b577-a13f2fcf74c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.273250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:36.285183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] [instance: 7b5e13a6-827c-4445-9982-fc6e176f9932] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:36.345780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:36.360495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.361094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.361607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.362361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.362734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.363191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.369116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=22 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:36.392240 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] HTTP exception thrown: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Request method failure captured: Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 HTTP/1.1 Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaY5RU0YzPagEK6IWwGDd7s4pFqP-X5KCkTXh5wnZifZvij20nVie7t4AGcQ9JkTRyu9yOWhv8ehToHJ2muHx__8JLf6oFTKWO_FYzaVxYRey2crBoLD9xGHuPIac2gUG90Mdlsn8ZRLVJYgKklCug-q6hoR4a6y9hRPWWnYzDP5pBs Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: b2cf39cba97b40cda2251f542747a8bb Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-669301036 Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b2cf39cba97b40cda2251f542747a8bb", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b2cf39cba97b40cda2251f542747a8bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2cf39cba97b40cda2251f542747a8bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2cf39cba97b40cda2251f542747a8bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-669301036 Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: b2cf39cba97b40cda2251f542747a8bb Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-669301036 Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestMultiTenantJSON-669301036-project Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 332e9244f13f4bc7b6f981991c5b15f5 Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-669301036-project Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '7b5e13a6-827c-4445-9982-fc6e176f9932'} Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:36.393910 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:06:36.400897 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:36.400897 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:06:36.400897 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:36.400897 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:36.400897 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:36.400897 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:06:36.400897 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:06:36.400897 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. Aug 27 05:06:36.400897 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:06:36.400897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] Returning 404 to user: Instance 7b5e13a6-827c-4445-9982-fc6e176f9932 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:06:36.400897 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7e51229f-657f-4f68-bba4-e2842a461cd2 tempest-ServersNegativeTestMultiTenantJSON-669301036 tempest-ServersNegativeTestMultiTenantJSON-669301036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932" status: 404 len: 111 microversion: 2.1 time: 0.126463 Aug 27 05:06:36.415632 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1475/2886] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:36 2022] GET /compute/v2.1/servers/7b5e13a6-827c-4445-9982-fc6e176f9932 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:06:36.499849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-19767b24-55c6-4fe0-a87a-7458a15f78fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:36.500904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-19767b24-55c6-4fe0-a87a-7458a15f78fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:36.509967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19767b24-55c6-4fe0-a87a-7458a15f78fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.514460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19767b24-55c6-4fe0-a87a-7458a15f78fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.515259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19767b24-55c6-4fe0-a87a-7458a15f78fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.516310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19767b24-55c6-4fe0-a87a-7458a15f78fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.517143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19767b24-55c6-4fe0-a87a-7458a15f78fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.518377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19767b24-55c6-4fe0-a87a-7458a15f78fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.519114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=16 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:36.567937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-813e70b1-ae71-42d1-b577-a13f2fcf74c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:36.576395 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-813e70b1-ae71-42d1-b577-a13f2fcf74c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1503 microversion: 2.1 time: 0.623547 Aug 27 05:06:36.584569 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1412/2887] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:35 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1503 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:36.603213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0dd1ba9e-d095-4873-b10b-76f81a5f3cb1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:36.603964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0dd1ba9e-d095-4873-b10b-76f81a5f3cb1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:36.611621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dd1ba9e-d095-4873-b10b-76f81a5f3cb1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.612116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dd1ba9e-d095-4873-b10b-76f81a5f3cb1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.612554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dd1ba9e-d095-4873-b10b-76f81a5f3cb1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.613886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dd1ba9e-d095-4873-b10b-76f81a5f3cb1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.614355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dd1ba9e-d095-4873-b10b-76f81a5f3cb1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.614782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dd1ba9e-d095-4873-b10b-76f81a5f3cb1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.764681 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0dd1ba9e-d095-4873-b10b-76f81a5f3cb1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530/action" status: 202 len: 0 microversion: 2.1 time: 0.166147 Aug 27 05:06:36.769576 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1413/2888] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:06:36 2022] POST /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:06:36.784231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ca5ebe9-ba97-4dc6-9205-aa7455c31d17 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:36.784492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4ca5ebe9-ba97-4dc6-9205-aa7455c31d17 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:36.808834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca5ebe9-ba97-4dc6-9205-aa7455c31d17 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.809697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca5ebe9-ba97-4dc6-9205-aa7455c31d17 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.810930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca5ebe9-ba97-4dc6-9205-aa7455c31d17 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.811971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca5ebe9-ba97-4dc6-9205-aa7455c31d17 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.812433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca5ebe9-ba97-4dc6-9205-aa7455c31d17 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.812866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca5ebe9-ba97-4dc6-9205-aa7455c31d17 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.928118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-19767b24-55c6-4fe0-a87a-7458a15f78fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:36.955057 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-19767b24-55c6-4fe0-a87a-7458a15f78fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1378 microversion: 2.1 time: 0.461156 Aug 27 05:06:36.962605 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1476/2889] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:36 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1378 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:36.995552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c3c28166-90bb-49da-b717-a0c6a63fef1a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56955f310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:37.102556 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c3c28166-90bb-49da-b717-a0c6a63fef1a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.116860 Aug 27 05:06:37.103413 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1477/2890] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:36 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:37.448366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ea99ad2-07f7-452f-8c7d-5d0a288e7931 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Action: 'create', calling method: .version_select at 0x7fb56957d8b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1262306109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0d/lReDFjFfWkkSHOhCCBAE5SibFeNTlm1MbJBr5Lkf5FFpo+Kumzf7rwvxiBkJOAPpjheQV5Gy+uAHsDlETkcPpmJiZA+hh7GKzTfRae7Df3x6u1IPAlbJfiKRjM/gA=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:37.481830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ca5ebe9-ba97-4dc6-9205-aa7455c31d17 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:37.492512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-7ea99ad2-07f7-452f-8c7d-5d0a288e7931 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for project 8855a07236c54efa89fcec7f944afd94. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:37.510593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-7ea99ad2-07f7-452f-8c7d-5d0a288e7931 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for user bf8bd46b91cf4774af109507c7c4422a and project 8855a07236c54efa89fcec7f944afd94. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:37.511760 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ca5ebe9-ba97-4dc6-9205-aa7455c31d17 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1508 microversion: 2.1 time: 0.740469 Aug 27 05:06:37.523342 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1414/2891] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:36 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1508 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:37.554506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:37.568201 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ea99ad2-07f7-452f-8c7d-5d0a288e7931 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.124091 Aug 27 05:06:37.574180 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1478/2892] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:06:37 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:37.985433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bc6fee81-fdbe-448c-836c-93002b9e209b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:37.986339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bc6fee81-fdbe-448c-836c-93002b9e209b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:37.998415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc6fee81-fdbe-448c-836c-93002b9e209b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:38.000386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc6fee81-fdbe-448c-836c-93002b9e209b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:38.001072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc6fee81-fdbe-448c-836c-93002b9e209b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:38.002554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc6fee81-fdbe-448c-836c-93002b9e209b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:38.003482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc6fee81-fdbe-448c-836c-93002b9e209b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:38.004788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc6fee81-fdbe-448c-836c-93002b9e209b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:38.121852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2c71dea2-c287-49e8-8b5d-6a59c2971a10 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56957d3a0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:38.206305 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2c71dea2-c287-49e8-8b5d-6a59c2971a10 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.089811 Aug 27 05:06:38.214096 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1479/2893] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:38 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:38.534295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6afe98c6-7cde-4030-95eb-134fc04ac64a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:38.535796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6afe98c6-7cde-4030-95eb-134fc04ac64a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:38.545361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6afe98c6-7cde-4030-95eb-134fc04ac64a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:38.545864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6afe98c6-7cde-4030-95eb-134fc04ac64a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:38.546309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6afe98c6-7cde-4030-95eb-134fc04ac64a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:38.553786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6afe98c6-7cde-4030-95eb-134fc04ac64a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:38.554332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6afe98c6-7cde-4030-95eb-134fc04ac64a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:38.555281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6afe98c6-7cde-4030-95eb-134fc04ac64a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.588248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bc6fee81-fdbe-448c-836c-93002b9e209b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:39.611941 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bc6fee81-fdbe-448c-836c-93002b9e209b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1378 microversion: 2.1 time: 1.631170 Aug 27 05:06:39.615583 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1415/2894] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:37 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1378 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:39.637420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-735e07f0-7f4a-49e3-8cd7-9404fe0fd6b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56517f670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:39.688663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6afe98c6-7cde-4030-95eb-134fc04ac64a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:39.702754 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6afe98c6-7cde-4030-95eb-134fc04ac64a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1488 microversion: 2.1 time: 1.172693 Aug 27 05:06:39.718606 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1480/2895] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:38 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1488 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:39.720256 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-735e07f0-7f4a-49e3-8cd7-9404fe0fd6b5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.103310 Aug 27 05:06:39.724485 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1416/2896] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:39 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:39.749973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-18b36a55-3b03-46bb-aea3-45806d2e1737 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:39.750475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-18b36a55-3b03-46bb-aea3-45806d2e1737 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:39.762065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b36a55-3b03-46bb-aea3-45806d2e1737 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.762847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b36a55-3b03-46bb-aea3-45806d2e1737 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.763496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b36a55-3b03-46bb-aea3-45806d2e1737 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.764411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b36a55-3b03-46bb-aea3-45806d2e1737 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.765042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b36a55-3b03-46bb-aea3-45806d2e1737 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.765633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b36a55-3b03-46bb-aea3-45806d2e1737 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.845220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-18b36a55-3b03-46bb-aea3-45806d2e1737 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:06:40.079743 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-18b36a55-3b03-46bb-aea3-45806d2e1737 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 204 len: 0 microversion: 2.1 time: 0.333254 Aug 27 05:06:40.081245 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1481/2897] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:06:39 2022] DELETE /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:06:40.094632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0054dd89-7571-4810-8d71-e309723118ce tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:40.095291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0054dd89-7571-4810-8d71-e309723118ce tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:40.141883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0054dd89-7571-4810-8d71-e309723118ce tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:40.142639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0054dd89-7571-4810-8d71-e309723118ce tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:40.143958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0054dd89-7571-4810-8d71-e309723118ce tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:40.148751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0054dd89-7571-4810-8d71-e309723118ce tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:40.151193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0054dd89-7571-4810-8d71-e309723118ce tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:40.152196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0054dd89-7571-4810-8d71-e309723118ce tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:40.640532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4a609e8a-9d6a-4ad5-87cb-3979bd2307f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:40.642247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4a609e8a-9d6a-4ad5-87cb-3979bd2307f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:40.662577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0054dd89-7571-4810-8d71-e309723118ce tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:40.669982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a609e8a-9d6a-4ad5-87cb-3979bd2307f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:40.676316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a609e8a-9d6a-4ad5-87cb-3979bd2307f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:40.679739 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0054dd89-7571-4810-8d71-e309723118ce tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1494 microversion: 2.1 time: 0.592960 Aug 27 05:06:40.679970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a609e8a-9d6a-4ad5-87cb-3979bd2307f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:40.680863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a609e8a-9d6a-4ad5-87cb-3979bd2307f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:40.681584 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1417/2898] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:40 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1494 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:40.682815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a609e8a-9d6a-4ad5-87cb-3979bd2307f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:40.684632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a609e8a-9d6a-4ad5-87cb-3979bd2307f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:40.749903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1b678315-1135-4540-a493-0a487453cf2c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56517f700>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:40.858847 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1b678315-1135-4540-a493-0a487453cf2c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.114585 Aug 27 05:06:40.859595 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1418/2899] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:40 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:41.126858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4a609e8a-9d6a-4ad5-87cb-3979bd2307f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:41.135596 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4a609e8a-9d6a-4ad5-87cb-3979bd2307f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1378 microversion: 2.1 time: 0.501144 Aug 27 05:06:41.136184 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1482/2900] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:40 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1378 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:41.288334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-bc3da4a7-98ec-435e-b845-f006eb720a5e req-b78995db-921d-4456-bb1e-6aa08dcc77d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26820abc-803a-4050-88be-17a76d7164ff", "name": "network-vif-plugged", "status": "completed", "tag": "2990c3ed-258d-4779-8447-1c23744cef1b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:41.313777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bc3da4a7-98ec-435e-b845-f006eb720a5e req-b78995db-921d-4456-bb1e-6aa08dcc77d1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:41.314439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bc3da4a7-98ec-435e-b845-f006eb720a5e req-b78995db-921d-4456-bb1e-6aa08dcc77d1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:41.315110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bc3da4a7-98ec-435e-b845-f006eb720a5e req-b78995db-921d-4456-bb1e-6aa08dcc77d1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:41.338382 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-bc3da4a7-98ec-435e-b845-f006eb720a5e req-b78995db-921d-4456-bb1e-6aa08dcc77d1 service nova] Creating event network-vif-plugged:2990c3ed-258d-4779-8447-1c23744cef1b for instance 26820abc-803a-4050-88be-17a76d7164ff on n-h1-820368-35 Aug 27 05:06:41.355294 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-bc3da4a7-98ec-435e-b845-f006eb720a5e req-b78995db-921d-4456-bb1e-6aa08dcc77d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071002 Aug 27 05:06:41.360152 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1419/2901] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:41.361485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1018616536", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "d172a722-4d8b-4df9-a116-941548a3cde1"}], "key_name": "tempest-TestNetworkBasicOps-1262306109", "security_groups": [{"name": "tempest-secgroup-smoke-1162239869"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:41.710474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0236128f-57d9-41d9-bd2a-e8bd25414785 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:41.711274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0236128f-57d9-41d9-bd2a-e8bd25414785 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:41.732511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0236128f-57d9-41d9-bd2a-e8bd25414785 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:41.733021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0236128f-57d9-41d9-bd2a-e8bd25414785 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:41.733651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0236128f-57d9-41d9-bd2a-e8bd25414785 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:41.734202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0236128f-57d9-41d9-bd2a-e8bd25414785 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:41.734667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0236128f-57d9-41d9-bd2a-e8bd25414785 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:41.735149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0236128f-57d9-41d9-bd2a-e8bd25414785 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:42.220356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] validate_networks() for [('d172a722-4d8b-4df9-a116-941548a3cde1', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:06:42.470743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0236128f-57d9-41d9-bd2a-e8bd25414785 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:42.482062 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0236128f-57d9-41d9-bd2a-e8bd25414785 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1494 microversion: 2.1 time: 0.780458 Aug 27 05:06:42.482645 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1420/2902] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:41 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1494 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:42.510645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-05a24b4d-e785-4fd8-9d67-4f84e5e9b1c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56517fdc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:42.859489 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-05a24b4d-e785-4fd8-9d67-4f84e5e9b1c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.366780 Aug 27 05:06:42.861591 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1421/2903] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:42 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:42.868656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d149ca3a-e299-4263-81fc-932c7131601e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:42.869514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d149ca3a-e299-4263-81fc-932c7131601e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:42.876583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d149ca3a-e299-4263-81fc-932c7131601e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:42.877347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d149ca3a-e299-4263-81fc-932c7131601e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:42.877961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d149ca3a-e299-4263-81fc-932c7131601e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:42.878892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d149ca3a-e299-4263-81fc-932c7131601e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:42.879537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d149ca3a-e299-4263-81fc-932c7131601e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:42.880123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d149ca3a-e299-4263-81fc-932c7131601e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.252764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d149ca3a-e299-4263-81fc-932c7131601e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:43.266596 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d149ca3a-e299-4263-81fc-932c7131601e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1378 microversion: 2.1 time: 0.401513 Aug 27 05:06:43.270508 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1422/2904] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:42 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1378 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:43.506575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:06:43.508930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:06:43.509577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7a554438-1662-4678-8b83-319b087b6ed0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:43.509853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:06:43.510385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:06:43.510812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7a554438-1662-4678-8b83-319b087b6ed0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:43.511007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:06:43.526091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a554438-1662-4678-8b83-319b087b6ed0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.527015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a554438-1662-4678-8b83-319b087b6ed0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.527748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a554438-1662-4678-8b83-319b087b6ed0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.528712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a554438-1662-4678-8b83-319b087b6ed0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.529393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a554438-1662-4678-8b83-319b087b6ed0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.532468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a554438-1662-4678-8b83-319b087b6ed0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.550469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.556030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.561896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.562856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.566940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.572927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.651946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for project 8855a07236c54efa89fcec7f944afd94. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:43.660976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for user bf8bd46b91cf4774af109507c7c4422a and project 8855a07236c54efa89fcec7f944afd94. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:43.686525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:06:43.690007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:06:43.760072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7a554438-1662-4678-8b83-319b087b6ed0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:43.774486 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7a554438-1662-4678-8b83-319b087b6ed0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1452 microversion: 2.1 time: 0.264046 Aug 27 05:06:43.777452 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1423/2905] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:43 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1452 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:43.878574 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c94ad7d-4bfd-433c-85de-b5c0434279e7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.525242 Aug 27 05:06:43.882690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d3257334-8df1-4597-a048-d44c8c1d3eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56517f0d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:43.887433 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1483/2906] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:06:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 2533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:06:43.915347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6bf9d4b5-683c-4b74-816e-050e9dba871a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:43.931758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6bf9d4b5-683c-4b74-816e-050e9dba871a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:43.993470 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d3257334-8df1-4597-a048-d44c8c1d3eef tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.120511 Aug 27 05:06:44.010236 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1424/2907] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:43 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:44.016742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9b8bef03-2f53-4e07-8da1-4aed760f3cbb req-b25e5949-4653-4192-b0cd-1d088c75f65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5444757-a4f6-468b-b13c-09adffde5530", "name": "network-vif-deleted", "tag": "e944f223-d71a-4dfc-9a1d-92e8a415f242"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:44.056601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9b8bef03-2f53-4e07-8da1-4aed760f3cbb req-b25e5949-4653-4192-b0cd-1d088c75f65c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.057221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9b8bef03-2f53-4e07-8da1-4aed760f3cbb req-b25e5949-4653-4192-b0cd-1d088c75f65c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.083871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9b8bef03-2f53-4e07-8da1-4aed760f3cbb req-b25e5949-4653-4192-b0cd-1d088c75f65c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.134647 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9b8bef03-2f53-4e07-8da1-4aed760f3cbb req-b25e5949-4653-4192-b0cd-1d088c75f65c service nova] Creating event network-vif-deleted:e944f223-d71a-4dfc-9a1d-92e8a415f242 for instance b5444757-a4f6-468b-b13c-09adffde5530 on n-h2-820368-35 Aug 27 05:06:44.160812 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9b8bef03-2f53-4e07-8da1-4aed760f3cbb req-b25e5949-4653-4192-b0cd-1d088c75f65c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147910 Aug 27 05:06:44.161615 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1425/2908] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:44.163707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6bf9d4b5-683c-4b74-816e-050e9dba871a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:44.172448 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6bf9d4b5-683c-4b74-816e-050e9dba871a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1249 microversion: 2.1 time: 0.280603 Aug 27 05:06:44.177092 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1484/2909] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:43 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1249 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:44.300494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-322ad8f5-15a9-4cea-84fc-8086bded05b7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:44.301364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-322ad8f5-15a9-4cea-84fc-8086bded05b7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:44.311013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322ad8f5-15a9-4cea-84fc-8086bded05b7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.317840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322ad8f5-15a9-4cea-84fc-8086bded05b7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.318594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322ad8f5-15a9-4cea-84fc-8086bded05b7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.321713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322ad8f5-15a9-4cea-84fc-8086bded05b7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.322672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322ad8f5-15a9-4cea-84fc-8086bded05b7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.324480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-322ad8f5-15a9-4cea-84fc-8086bded05b7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.711787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-322ad8f5-15a9-4cea-84fc-8086bded05b7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:44.741238 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-322ad8f5-15a9-4cea-84fc-8086bded05b7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1528 microversion: 2.1 time: 0.453907 Aug 27 05:06:44.742158 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1426/2910] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:44 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1528 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:44.766601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fbdc0626-0c8e-4649-b96e-1f51bb36eaee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:44.767518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fbdc0626-0c8e-4649-b96e-1f51bb36eaee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:44.778893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbdc0626-0c8e-4649-b96e-1f51bb36eaee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.779732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbdc0626-0c8e-4649-b96e-1f51bb36eaee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.792104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbdc0626-0c8e-4649-b96e-1f51bb36eaee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.793437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbdc0626-0c8e-4649-b96e-1f51bb36eaee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.794318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbdc0626-0c8e-4649-b96e-1f51bb36eaee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.794914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbdc0626-0c8e-4649-b96e-1f51bb36eaee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.797643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:44.798865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:44.810774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.813061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.814320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.819776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.820500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.822952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.935419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.939795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.940484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.941201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lazy-loading 'fault' on Instance uuid b5444757-a4f6-468b-b13c-09adffde5530 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:06:45.256864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:45.267436 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a1e1b6f-156a-42f1-b238-a0d44cef251c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 200 len: 1305 microversion: 2.1 time: 0.473441 Aug 27 05:06:45.274120 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1427/2911] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:44 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 1305 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:45.323488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e55ab49-63a0-4b1d-9b81-e2f6bc1932ab tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5655c2820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:45.337489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fbdc0626-0c8e-4649-b96e-1f51bb36eaee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:45.347371 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fbdc0626-0c8e-4649-b96e-1f51bb36eaee tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1528 microversion: 2.1 time: 0.585172 Aug 27 05:06:45.350471 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1485/2912] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:44 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1528 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:45.355517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7060976a-dc0f-449d-9d8b-a2484e308712 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:45.363444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7060976a-dc0f-449d-9d8b-a2484e308712 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:45.375420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7060976a-dc0f-449d-9d8b-a2484e308712 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:45.379411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7060976a-dc0f-449d-9d8b-a2484e308712 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:45.382504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7060976a-dc0f-449d-9d8b-a2484e308712 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:45.383474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7060976a-dc0f-449d-9d8b-a2484e308712 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:45.387006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7060976a-dc0f-449d-9d8b-a2484e308712 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:45.387680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7060976a-dc0f-449d-9d8b-a2484e308712 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:45.470588 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e55ab49-63a0-4b1d-9b81-e2f6bc1932ab tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.193490 Aug 27 05:06:45.471284 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1428/2913] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:45 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:45.476779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d1975ff-ee55-4bc5-91a1-15f2c326ffb0 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:45.544620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d1975ff-ee55-4bc5-91a1-15f2c326ffb0 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/f866ad4a-7ec5-4045-8699-bdeff6744445" status: 202 len: 0 microversion: 2.1 time: 0.071793 Aug 27 05:06:45.545750 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1429/2914] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:06:45 2022] DELETE /compute/v2.1/flavors/f866ad4a-7ec5-4045-8699-bdeff6744445 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:06:45.554015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bd4ea580-e050-4b25-a12e-ecc099cd63e4 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:45.577684 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bd4ea580-e050-4b25-a12e-ecc099cd63e4 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027297 Aug 27 05:06:45.592381 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1430/2915] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 05:06:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:45.598021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:45.601426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:45.608469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:45.609332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:45.610004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:45.610948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:45.611691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:45.612545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:45.654924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:45.662790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Old instance type tempest-test_resize_flavor_-2065515227, new instance type m1.heat {{(pid=128547) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:06:45.674248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:06:45.674908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:06:45.675639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:06:45.676298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:06:45.677871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:06:45.862625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7060976a-dc0f-449d-9d8b-a2484e308712 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:45.872111 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7060976a-dc0f-449d-9d8b-a2484e308712 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1253 microversion: 2.1 time: 0.520309 Aug 27 05:06:45.878307 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1486/2916] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:45 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1253 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:45.899446 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3a9d12ec-c081-41d8-b288-b285553ad92b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "POST /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff/action" status: 202 len: 0 microversion: 2.1 time: 0.305190 Aug 27 05:06:45.903028 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1431/2917] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:06:45 2022] POST /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:06:45.909025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10c32f26-e580-48b0-95bb-397720ab99b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:45.910461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-10c32f26-e580-48b0-95bb-397720ab99b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:45.922472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c32f26-e580-48b0-95bb-397720ab99b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:45.924669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c32f26-e580-48b0-95bb-397720ab99b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:45.927650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c32f26-e580-48b0-95bb-397720ab99b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:45.930061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c32f26-e580-48b0-95bb-397720ab99b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:45.931519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c32f26-e580-48b0-95bb-397720ab99b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:45.933960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c32f26-e580-48b0-95bb-397720ab99b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:46.348180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:46.354589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:46.411770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:46.414733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:46.417330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:46.420662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10c32f26-e580-48b0-95bb-397720ab99b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:46.421632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:46.426797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:46.427685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:46.432974 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10c32f26-e580-48b0-95bb-397720ab99b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1537 microversion: 2.1 time: 0.528149 Aug 27 05:06:46.443439 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1487/2918] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:45 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1537 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:46.486689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-98feca94-6358-4857-9250-78ac04e392d4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56968ce50>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:46.496021 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 HTTP/1.1 Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'b5444757-a4f6-468b-b13c-09adffde5530'} Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:46.496948 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:46.501996 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:46.501996 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:46.501996 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:46.501996 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:06:46.501996 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:06:46.501996 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:06:46.501996 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:06:46.501996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:06:46.501996 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7e4b4938-dcde-4c38-82e3-0f5caf041530 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 404 len: 111 microversion: 2.1 time: 0.173963 Aug 27 05:06:46.501996 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1432/2919] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:46 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:06:46.616213 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-98feca94-6358-4857-9250-78ac04e392d4 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.134254 Aug 27 05:06:46.624377 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1488/2920] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:46 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:46.627768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-320598533", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "11b9ce7b-910c-4628-97fe-5e2c2147efa3"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:46.773837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] validate_networks() for [('11b9ce7b-910c-4628-97fe-5e2c2147efa3', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:06:46.893500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6645b93b-6992-4ff3-8739-a243aff938ef tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:46.895288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6645b93b-6992-4ff3-8739-a243aff938ef tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:46.914951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6645b93b-6992-4ff3-8739-a243aff938ef tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:46.915451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6645b93b-6992-4ff3-8739-a243aff938ef tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:46.916039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6645b93b-6992-4ff3-8739-a243aff938ef tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:46.922218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6645b93b-6992-4ff3-8739-a243aff938ef tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:46.922715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6645b93b-6992-4ff3-8739-a243aff938ef tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:46.923185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6645b93b-6992-4ff3-8739-a243aff938ef tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:47.058431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6645b93b-6992-4ff3-8739-a243aff938ef tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:47.068026 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6645b93b-6992-4ff3-8739-a243aff938ef tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1309 microversion: 2.1 time: 0.178546 Aug 27 05:06:47.079984 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1489/2921] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:46 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:47.468830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d6965ce-9924-4173-9e07-1f4130d35c4c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:47.469757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0d6965ce-9924-4173-9e07-1f4130d35c4c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:47.486426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6965ce-9924-4173-9e07-1f4130d35c4c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:47.486932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6965ce-9924-4173-9e07-1f4130d35c4c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:47.487427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6965ce-9924-4173-9e07-1f4130d35c4c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:47.488742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6965ce-9924-4173-9e07-1f4130d35c4c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:47.489199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6965ce-9924-4173-9e07-1f4130d35c4c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:47.515319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6965ce-9924-4173-9e07-1f4130d35c4c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:47.657251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:06:47.659513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:06:47.661256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:06:47.662680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:06:47.664074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:06:47.684889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:47.686632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:47.687125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:47.687884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:47.688349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:47.688785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:47.738845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:47.750087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for user d3ae5460271c4f5291e6abb0e76cab17 and project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:47.812773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d6965ce-9924-4173-9e07-1f4130d35c4c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:47.822448 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0d6965ce-9924-4173-9e07-1f4130d35c4c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1537 microversion: 2.1 time: 0.370034 Aug 27 05:06:47.823777 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1490/2922] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:47 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1537 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:47.829650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:06:47.830606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ad51bbe-89ab-468f-bfad-b94eb6aa5a53 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5696d8dc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:47.833043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:06:47.906173 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c5fd02fb-bd99-4654-924e-0350ec393b25 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.282302 Aug 27 05:06:47.908636 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1433/2923] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:06:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:06:47.921506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1442b918-bbf8-43be-a674-7eed619e1e41 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:47.922368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1442b918-bbf8-43be-a674-7eed619e1e41 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:47.931698 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ad51bbe-89ab-468f-bfad-b94eb6aa5a53 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.106427 Aug 27 05:06:47.940288 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1491/2924] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:47 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:48.080112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1442b918-bbf8-43be-a674-7eed619e1e41 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:48.093187 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1442b918-bbf8-43be-a674-7eed619e1e41 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1214 microversion: 2.1 time: 0.179211 Aug 27 05:06:48.097261 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1434/2925] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:47 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:48.100824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e12fc42b-d03f-4b08-a1cb-03871659c70a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:48.101577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e12fc42b-d03f-4b08-a1cb-03871659c70a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:48.117146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12fc42b-d03f-4b08-a1cb-03871659c70a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:48.125106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12fc42b-d03f-4b08-a1cb-03871659c70a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:48.125746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12fc42b-d03f-4b08-a1cb-03871659c70a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:48.126797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12fc42b-d03f-4b08-a1cb-03871659c70a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:48.127249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12fc42b-d03f-4b08-a1cb-03871659c70a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:48.127912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12fc42b-d03f-4b08-a1cb-03871659c70a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:48.276542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e12fc42b-d03f-4b08-a1cb-03871659c70a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:48.285495 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e12fc42b-d03f-4b08-a1cb-03871659c70a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1307 microversion: 2.1 time: 0.188713 Aug 27 05:06:48.293021 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1492/2926] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:48 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1307 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:48.850144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e7abb3b-adce-4ab0-a2af-1ac474992065 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:48.852672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1e7abb3b-adce-4ab0-a2af-1ac474992065 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:48.868158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7abb3b-adce-4ab0-a2af-1ac474992065 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:48.870132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7abb3b-adce-4ab0-a2af-1ac474992065 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:48.873930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7abb3b-adce-4ab0-a2af-1ac474992065 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:48.874732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7abb3b-adce-4ab0-a2af-1ac474992065 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:48.875309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7abb3b-adce-4ab0-a2af-1ac474992065 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:48.875763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7abb3b-adce-4ab0-a2af-1ac474992065 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:48.949246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-44bb42a3-35f6-440c-8dac-114ca5fead49 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5645864c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:49.022694 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-44bb42a3-35f6-440c-8dac-114ca5fead49 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1438 microversion: 2.1 time: 0.078212 Aug 27 05:06:49.025643 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1493/2927] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:48 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1438 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:49.121317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-61f9bf67-f620-44a3-9700-200cb2e061c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:49.122876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-61f9bf67-f620-44a3-9700-200cb2e061c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:49.133080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61f9bf67-f620-44a3-9700-200cb2e061c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:49.133911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61f9bf67-f620-44a3-9700-200cb2e061c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:49.135066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61f9bf67-f620-44a3-9700-200cb2e061c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:49.136227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61f9bf67-f620-44a3-9700-200cb2e061c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:49.139280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61f9bf67-f620-44a3-9700-200cb2e061c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:49.140470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61f9bf67-f620-44a3-9700-200cb2e061c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:49.274582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-61f9bf67-f620-44a3-9700-200cb2e061c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:49.289333 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-61f9bf67-f620-44a3-9700-200cb2e061c5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1218 microversion: 2.1 time: 0.176842 Aug 27 05:06:49.295348 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1494/2928] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:49 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:49.322789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1e7abb3b-adce-4ab0-a2af-1ac474992065 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:49.334605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:49.334920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5c156b5-6620-4086-af81-713e2e367d53 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:49.335964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e5c156b5-6620-4086-af81-713e2e367d53 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:49.353898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5c156b5-6620-4086-af81-713e2e367d53 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:49.353898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5c156b5-6620-4086-af81-713e2e367d53 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:49.354095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5c156b5-6620-4086-af81-713e2e367d53 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:49.354829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5c156b5-6620-4086-af81-713e2e367d53 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:49.356406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5c156b5-6620-4086-af81-713e2e367d53 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:49.359013 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e7abb3b-adce-4ab0-a2af-1ac474992065 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1537 microversion: 2.1 time: 0.513847 Aug 27 05:06:49.360025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5c156b5-6620-4086-af81-713e2e367d53 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:49.361002 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1435/2929] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:48 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1537 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:49.518137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e5c156b5-6620-4086-af81-713e2e367d53 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:49.533739 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e5c156b5-6620-4086-af81-713e2e367d53 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1307 microversion: 2.1 time: 0.219913 Aug 27 05:06:49.547515 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1495/2930] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:49 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1307 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:50.039360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9e745d09-8f89-484e-a55c-6cf640c44a55 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5652e1c10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:50.136934 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9e745d09-8f89-484e-a55c-6cf640c44a55 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1447 microversion: 2.1 time: 0.100963 Aug 27 05:06:50.137969 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1436/2931] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:50 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:50.151678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fe7e454e-4fda-41ef-84e1-dc0aa4c1b7c8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5645829d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:50.204413 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fe7e454e-4fda-41ef-84e1-dc0aa4c1b7c8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 200 len: 1447 microversion: 2.1 time: 0.056575 Aug 27 05:06:50.205314 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1496/2932] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:50 2022] GET /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 1447 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:50.219228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5bcb31e2-fafe-423b-a8d0-87a91b9282bb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5652de280>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:50.326711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-085dffbf-51af-41c0-ad8b-5f071104a372 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:50.328885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-085dffbf-51af-41c0-ad8b-5f071104a372 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:50.352992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085dffbf-51af-41c0-ad8b-5f071104a372 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:50.354684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085dffbf-51af-41c0-ad8b-5f071104a372 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:50.355394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085dffbf-51af-41c0-ad8b-5f071104a372 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:50.356332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085dffbf-51af-41c0-ad8b-5f071104a372 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:50.356968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085dffbf-51af-41c0-ad8b-5f071104a372 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:50.357763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-085dffbf-51af-41c0-ad8b-5f071104a372 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:50.473818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-085dffbf-51af-41c0-ad8b-5f071104a372 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:50.491462 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-085dffbf-51af-41c0-ad8b-5f071104a372 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1274 microversion: 2.1 time: 0.177241 Aug 27 05:06:50.507857 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1497/2933] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:50 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:50.515337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-175e8a05-9f4f-4470-bf16-8a9a0c3a1ca7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:50.518309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-175e8a05-9f4f-4470-bf16-8a9a0c3a1ca7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:50.526328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-175e8a05-9f4f-4470-bf16-8a9a0c3a1ca7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:50.527406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-175e8a05-9f4f-4470-bf16-8a9a0c3a1ca7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:50.528014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-175e8a05-9f4f-4470-bf16-8a9a0c3a1ca7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:50.529030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-175e8a05-9f4f-4470-bf16-8a9a0c3a1ca7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:50.529663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-175e8a05-9f4f-4470-bf16-8a9a0c3a1ca7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:50.530263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-175e8a05-9f4f-4470-bf16-8a9a0c3a1ca7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:50.735379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-175e8a05-9f4f-4470-bf16-8a9a0c3a1ca7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:50.752675 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-175e8a05-9f4f-4470-bf16-8a9a0c3a1ca7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1537 microversion: 2.1 time: 0.243267 Aug 27 05:06:50.756069 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1498/2934] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:50 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1537 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:50.762709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce384b7a-1c51-4e47-bf16-e52166621d7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:50.763532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ce384b7a-1c51-4e47-bf16-e52166621d7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:50.774513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce384b7a-1c51-4e47-bf16-e52166621d7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:50.775701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce384b7a-1c51-4e47-bf16-e52166621d7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:50.776115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce384b7a-1c51-4e47-bf16-e52166621d7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:50.776896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce384b7a-1c51-4e47-bf16-e52166621d7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:50.777298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce384b7a-1c51-4e47-bf16-e52166621d7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:50.777727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce384b7a-1c51-4e47-bf16-e52166621d7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:50.792679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:50.982308 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5bcb31e2-fafe-423b-a8d0-87a91b9282bb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 204 len: 0 microversion: 2.1 time: 0.767207 Aug 27 05:06:50.982883 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1437/2935] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:50 2022] DELETE /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:06:50.992267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-060ebe7e-0f9a-435a-836a-d7ec5215fa4f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:50.992918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-060ebe7e-0f9a-435a-836a-d7ec5215fa4f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:51.004062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-060ebe7e-0f9a-435a-836a-d7ec5215fa4f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:51.004856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-060ebe7e-0f9a-435a-836a-d7ec5215fa4f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:51.005545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-060ebe7e-0f9a-435a-836a-d7ec5215fa4f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:51.006501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-060ebe7e-0f9a-435a-836a-d7ec5215fa4f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:51.007608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-060ebe7e-0f9a-435a-836a-d7ec5215fa4f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:51.009153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-060ebe7e-0f9a-435a-836a-d7ec5215fa4f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:51.021956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce384b7a-1c51-4e47-bf16-e52166621d7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:51.041183 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce384b7a-1c51-4e47-bf16-e52166621d7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.280894 Aug 27 05:06:51.051126 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1499/2936] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:50 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:51.062201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-060ebe7e-0f9a-435a-836a-d7ec5215fa4f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:06:51.164464 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-060ebe7e-0f9a-435a-836a-d7ec5215fa4f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 204 len: 0 microversion: 2.1 time: 0.176703 Aug 27 05:06:51.166245 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1438/2937] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:06:50 2022] DELETE /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:06:51.290493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-912370704", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "11d496fd-4b16-4935-bb52-9962a7e9cd7d"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:51.348236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] validate_networks() for [('11d496fd-4b16-4935-bb52-9962a7e9cd7d', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:06:51.516647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f1b1db4-8ca3-45d2-a580-ba2620623540 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:51.517818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0f1b1db4-8ca3-45d2-a580-ba2620623540 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:51.525519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f1b1db4-8ca3-45d2-a580-ba2620623540 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:51.526283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f1b1db4-8ca3-45d2-a580-ba2620623540 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:51.526929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f1b1db4-8ca3-45d2-a580-ba2620623540 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:51.528906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f1b1db4-8ca3-45d2-a580-ba2620623540 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:51.529788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f1b1db4-8ca3-45d2-a580-ba2620623540 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:51.530432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f1b1db4-8ca3-45d2-a580-ba2620623540 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:51.650492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0f1b1db4-8ca3-45d2-a580-ba2620623540 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:51.661734 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f1b1db4-8ca3-45d2-a580-ba2620623540 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1272 microversion: 2.1 time: 0.149468 Aug 27 05:06:51.662875 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1439/2938] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:51 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:51.782193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-36fe84a3-6baa-45af-b127-b81141771ac6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:51.782816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-36fe84a3-6baa-45af-b127-b81141771ac6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:51.815310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36fe84a3-6baa-45af-b127-b81141771ac6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:51.815914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36fe84a3-6baa-45af-b127-b81141771ac6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:51.816417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36fe84a3-6baa-45af-b127-b81141771ac6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:51.819351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36fe84a3-6baa-45af-b127-b81141771ac6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:51.820190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36fe84a3-6baa-45af-b127-b81141771ac6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:51.820818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36fe84a3-6baa-45af-b127-b81141771ac6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:51.869606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:06:51.870414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:06:51.871051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:06:51.871638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:06:51.872212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:06:51.887672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:51.888163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:51.888601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:51.889324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:51.889773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:51.890194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:51.923853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Getting quotas for project d8fa2042dc6a457fa50dcbf75e3a32ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:51.935684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Getting quotas for user 979e8da1534344fcb5a2be09631ea09c and project d8fa2042dc6a457fa50dcbf75e3a32ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:51.956118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:06:51.959933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:06:52.018927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-36fe84a3-6baa-45af-b127-b81141771ac6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:52.029354 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-36fe84a3-6baa-45af-b127-b81141771ac6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1537 microversion: 2.1 time: 0.251188 Aug 27 05:06:52.035585 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1440/2939] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:51 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:52.037114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7b898732-22e7-40c5-9302-726e8260631d req-aa6cd448-4f47-44a8-baca-257c4a81c940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42593098-eb8a-4bb6-8a33-59ba5a5b1862", "tag": "0e9da397-9c51-4b2f-bca1-2807c2e3c7ac"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:52.048502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7b898732-22e7-40c5-9302-726e8260631d req-aa6cd448-4f47-44a8-baca-257c4a81c940 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:52.049261 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-37f2ef9e-365d-4519-a0f0-395ae7e5f047 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762522 Aug 27 05:06:52.050478 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1500/2940] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:06:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:06:52.062390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5cd5bf66-f71f-4581-8d7e-ece4ccc32d8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:52.063039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5cd5bf66-f71f-4581-8d7e-ece4ccc32d8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:52.063586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7b898732-22e7-40c5-9302-726e8260631d req-aa6cd448-4f47-44a8-baca-257c4a81c940 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:52.064337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7b898732-22e7-40c5-9302-726e8260631d req-aa6cd448-4f47-44a8-baca-257c4a81c940 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:52.081514 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7b898732-22e7-40c5-9302-726e8260631d req-aa6cd448-4f47-44a8-baca-257c4a81c940 service nova] Creating event network-changed:0e9da397-9c51-4b2f-bca1-2807c2e3c7ac for instance 42593098-eb8a-4bb6-8a33-59ba5a5b1862 on n-h2-820368-35 Aug 27 05:06:52.089722 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7b898732-22e7-40c5-9302-726e8260631d req-aa6cd448-4f47-44a8-baca-257c4a81c940 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058203 Aug 27 05:06:52.090690 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1441/2941] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:52.096034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-065a640e-a462-4eee-a758-5315b033fa64 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:52.096742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-065a640e-a462-4eee-a758-5315b033fa64 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:52.116998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a640e-a462-4eee-a758-5315b033fa64 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:52.117498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a640e-a462-4eee-a758-5315b033fa64 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:52.117945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a640e-a462-4eee-a758-5315b033fa64 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:52.118670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a640e-a462-4eee-a758-5315b033fa64 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:52.119160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a640e-a462-4eee-a758-5315b033fa64 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:52.119591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-065a640e-a462-4eee-a758-5315b033fa64 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:52.139075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5cd5bf66-f71f-4581-8d7e-ece4ccc32d8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:52.148917 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5cd5bf66-f71f-4581-8d7e-ece4ccc32d8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1207 microversion: 2.1 time: 0.090333 Aug 27 05:06:52.151283 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1501/2942] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:52 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1207 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:52.685653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0c5071b1-b290-44f8-bc4d-4886ea80a944 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:52.687396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c5071b1-b290-44f8-bc4d-4886ea80a944 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:52.706447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c5071b1-b290-44f8-bc4d-4886ea80a944 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:52.707836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c5071b1-b290-44f8-bc4d-4886ea80a944 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:52.708376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c5071b1-b290-44f8-bc4d-4886ea80a944 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:52.709184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c5071b1-b290-44f8-bc4d-4886ea80a944 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:52.709828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c5071b1-b290-44f8-bc4d-4886ea80a944 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:52.710879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c5071b1-b290-44f8-bc4d-4886ea80a944 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:52.883370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-065a640e-a462-4eee-a758-5315b033fa64 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:52.899531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0c5071b1-b290-44f8-bc4d-4886ea80a944 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:52.910622 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-065a640e-a462-4eee-a758-5315b033fa64 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.804168 Aug 27 05:06:52.911802 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1442/2943] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:52 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:52.913843 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0c5071b1-b290-44f8-bc4d-4886ea80a944 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1272 microversion: 2.1 time: 0.232294 Aug 27 05:06:52.914718 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1502/2944] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:52 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:53.055237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-60221ef8-ab78-4845-a77f-520a16860107 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:53.056358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-60221ef8-ab78-4845-a77f-520a16860107 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:53.073808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60221ef8-ab78-4845-a77f-520a16860107 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:53.075777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60221ef8-ab78-4845-a77f-520a16860107 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:53.079308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60221ef8-ab78-4845-a77f-520a16860107 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:53.081043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60221ef8-ab78-4845-a77f-520a16860107 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:53.081967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60221ef8-ab78-4845-a77f-520a16860107 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:53.083154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60221ef8-ab78-4845-a77f-520a16860107 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:53.173181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f243f776-5062-418a-bb4f-d56fa05247e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:53.174635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f243f776-5062-418a-bb4f-d56fa05247e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:53.196681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f243f776-5062-418a-bb4f-d56fa05247e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:53.203749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f243f776-5062-418a-bb4f-d56fa05247e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:53.205337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f243f776-5062-418a-bb4f-d56fa05247e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:53.205719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f243f776-5062-418a-bb4f-d56fa05247e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:53.206563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f243f776-5062-418a-bb4f-d56fa05247e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:53.207931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f243f776-5062-418a-bb4f-d56fa05247e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:53.347648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f243f776-5062-418a-bb4f-d56fa05247e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:53.357907 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f243f776-5062-418a-bb4f-d56fa05247e5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1203 microversion: 2.1 time: 0.189382 Aug 27 05:06:53.362436 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1503/2945] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:53 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1203 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:53.431974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-60221ef8-ab78-4845-a77f-520a16860107 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:53.443572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-60221ef8-ab78-4845-a77f-520a16860107 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.395447 Aug 27 05:06:53.444544 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1443/2946] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:53 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:53.938009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-730c456c-bcd8-445b-b23d-83f77748dea3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:53.939497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-730c456c-bcd8-445b-b23d-83f77748dea3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:53.942129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-635437df-54ab-4e2d-9aea-612cb42fb044 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:53.942772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-635437df-54ab-4e2d-9aea-612cb42fb044 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:53.954703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-635437df-54ab-4e2d-9aea-612cb42fb044 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:53.955235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-635437df-54ab-4e2d-9aea-612cb42fb044 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:53.955681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-635437df-54ab-4e2d-9aea-612cb42fb044 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:53.956128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-730c456c-bcd8-445b-b23d-83f77748dea3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:53.956407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-635437df-54ab-4e2d-9aea-612cb42fb044 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:53.957570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-635437df-54ab-4e2d-9aea-612cb42fb044 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:53.959764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-635437df-54ab-4e2d-9aea-612cb42fb044 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:53.961295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-730c456c-bcd8-445b-b23d-83f77748dea3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:53.961955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-730c456c-bcd8-445b-b23d-83f77748dea3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:53.963380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-730c456c-bcd8-445b-b23d-83f77748dea3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:53.966698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-730c456c-bcd8-445b-b23d-83f77748dea3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:53.968237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-730c456c-bcd8-445b-b23d-83f77748dea3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:54.450552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-730c456c-bcd8-445b-b23d-83f77748dea3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:54.465691 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-730c456c-bcd8-445b-b23d-83f77748dea3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1314 microversion: 2.1 time: 0.532297 Aug 27 05:06:54.466862 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1504/2947] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:53 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:54.481410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9f8924d-3806-477a-94c0-1035acc6b0ad tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:54.483328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c9f8924d-3806-477a-94c0-1035acc6b0ad tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:54.491748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-635437df-54ab-4e2d-9aea-612cb42fb044 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:54.500679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9f8924d-3806-477a-94c0-1035acc6b0ad tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:54.501067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9f8924d-3806-477a-94c0-1035acc6b0ad tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:54.501977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9f8924d-3806-477a-94c0-1035acc6b0ad tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:54.502408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9f8924d-3806-477a-94c0-1035acc6b0ad tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:54.502749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9f8924d-3806-477a-94c0-1035acc6b0ad tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:54.503076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9f8924d-3806-477a-94c0-1035acc6b0ad tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:54.511697 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-635437df-54ab-4e2d-9aea-612cb42fb044 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.571122 Aug 27 05:06:54.523528 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1444/2948] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:53 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:54.527770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22bfc57e-baba-48d6-b296-3bec54cd3ca1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:54.542475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22bfc57e-baba-48d6-b296-3bec54cd3ca1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:54.557420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22bfc57e-baba-48d6-b296-3bec54cd3ca1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:54.558168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22bfc57e-baba-48d6-b296-3bec54cd3ca1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:54.558980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22bfc57e-baba-48d6-b296-3bec54cd3ca1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:54.559970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22bfc57e-baba-48d6-b296-3bec54cd3ca1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:54.560751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22bfc57e-baba-48d6-b296-3bec54cd3ca1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:54.572578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22bfc57e-baba-48d6-b296-3bec54cd3ca1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:54.744185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c9f8924d-3806-477a-94c0-1035acc6b0ad tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:54.767798 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c9f8924d-3806-477a-94c0-1035acc6b0ad tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1259 microversion: 2.1 time: 0.299150 Aug 27 05:06:54.795431 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1505/2949] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:54 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1259 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:55.029063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-22bfc57e-baba-48d6-b296-3bec54cd3ca1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:55.037608 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22bfc57e-baba-48d6-b296-3bec54cd3ca1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.518990 Aug 27 05:06:55.038285 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1445/2950] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:54 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:55.145001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-32f6248d-3f3b-41aa-a787-6463e095f5c3 req-f6fb252b-4ef9-4e6e-afe9-5c6a1e965360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d757ef9d-8acc-4bfc-8c45-7de22ca35137", "name": "network-vif-deleted", "tag": "56ad0552-0093-40fb-9e6f-7edf533a561e"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:55.193787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-32f6248d-3f3b-41aa-a787-6463e095f5c3 req-f6fb252b-4ef9-4e6e-afe9-5c6a1e965360 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:55.194419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-32f6248d-3f3b-41aa-a787-6463e095f5c3 req-f6fb252b-4ef9-4e6e-afe9-5c6a1e965360 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:55.194872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-32f6248d-3f3b-41aa-a787-6463e095f5c3 req-f6fb252b-4ef9-4e6e-afe9-5c6a1e965360 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:55.224453 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-32f6248d-3f3b-41aa-a787-6463e095f5c3 req-f6fb252b-4ef9-4e6e-afe9-5c6a1e965360 service nova] Creating event network-vif-deleted:56ad0552-0093-40fb-9e6f-7edf533a561e for instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 on n-h2-820368-35 Aug 27 05:06:55.237219 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-32f6248d-3f3b-41aa-a787-6463e095f5c3 req-f6fb252b-4ef9-4e6e-afe9-5c6a1e965360 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101483 Aug 27 05:06:55.243279 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1506/2951] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:55.491697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a13af6eb-a605-4260-b394-ff9a3273e22c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:55.492658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a13af6eb-a605-4260-b394-ff9a3273e22c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:55.510633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a13af6eb-a605-4260-b394-ff9a3273e22c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:55.513066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a13af6eb-a605-4260-b394-ff9a3273e22c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:55.513600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a13af6eb-a605-4260-b394-ff9a3273e22c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:55.516963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a13af6eb-a605-4260-b394-ff9a3273e22c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:55.518526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a13af6eb-a605-4260-b394-ff9a3273e22c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:55.518956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a13af6eb-a605-4260-b394-ff9a3273e22c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:55.538763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a28073d4-7c51-4d08-86f4-da24a340c5b0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:55.556902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a28073d4-7c51-4d08-86f4-da24a340c5b0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:55.584699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a28073d4-7c51-4d08-86f4-da24a340c5b0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:55.585579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a28073d4-7c51-4d08-86f4-da24a340c5b0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:55.586141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a28073d4-7c51-4d08-86f4-da24a340c5b0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:55.587002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a28073d4-7c51-4d08-86f4-da24a340c5b0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:55.588705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a28073d4-7c51-4d08-86f4-da24a340c5b0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:55.592046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a28073d4-7c51-4d08-86f4-da24a340c5b0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:55.956043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a13af6eb-a605-4260-b394-ff9a3273e22c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:55.969247 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a13af6eb-a605-4260-b394-ff9a3273e22c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1314 microversion: 2.1 time: 0.480867 Aug 27 05:06:55.969247 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1446/2952] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:55 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:55.986707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-abf91412-2aea-4676-a069-9c067e2e0a8e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:55.987719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-abf91412-2aea-4676-a069-9c067e2e0a8e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:55.995994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abf91412-2aea-4676-a069-9c067e2e0a8e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:55.996913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abf91412-2aea-4676-a069-9c067e2e0a8e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:55.997516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abf91412-2aea-4676-a069-9c067e2e0a8e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:55.998303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abf91412-2aea-4676-a069-9c067e2e0a8e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:55.998767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abf91412-2aea-4676-a069-9c067e2e0a8e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:55.999317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abf91412-2aea-4676-a069-9c067e2e0a8e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:56.031678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a28073d4-7c51-4d08-86f4-da24a340c5b0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:56.044489 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a28073d4-7c51-4d08-86f4-da24a340c5b0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.511735 Aug 27 05:06:56.058712 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1507/2953] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:55 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:56.068562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-148ee0ac-8405-4842-ba33-a06962094a0b req-7686302f-4545-459e-b6f1-5231a244f24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "780d1d8c-aaf6-4d22-b37a-b48a881f9d77", "tag": "a4069830-52de-48c2-90d4-5c1ba86d69a4"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:56.092340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-148ee0ac-8405-4842-ba33-a06962094a0b req-7686302f-4545-459e-b6f1-5231a244f24a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:56.095170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-148ee0ac-8405-4842-ba33-a06962094a0b req-7686302f-4545-459e-b6f1-5231a244f24a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:56.095700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-148ee0ac-8405-4842-ba33-a06962094a0b req-7686302f-4545-459e-b6f1-5231a244f24a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:56.130685 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-148ee0ac-8405-4842-ba33-a06962094a0b req-7686302f-4545-459e-b6f1-5231a244f24a service nova] Creating event network-changed:a4069830-52de-48c2-90d4-5c1ba86d69a4 for instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 on n-h1-820368-35 Aug 27 05:06:56.143897 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-148ee0ac-8405-4842-ba33-a06962094a0b req-7686302f-4545-459e-b6f1-5231a244f24a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083786 Aug 27 05:06:56.144973 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1508/2954] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:56.147739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-abf91412-2aea-4676-a069-9c067e2e0a8e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:56.150228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-84d53827-01e2-4a0a-aeb1-8ec7f4d66466 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:56.151118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-84d53827-01e2-4a0a-aeb1-8ec7f4d66466 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:56.160786 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-abf91412-2aea-4676-a069-9c067e2e0a8e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1265 microversion: 2.1 time: 0.177590 Aug 27 05:06:56.162409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d53827-01e2-4a0a-aeb1-8ec7f4d66466 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:56.170893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d53827-01e2-4a0a-aeb1-8ec7f4d66466 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:56.171562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d53827-01e2-4a0a-aeb1-8ec7f4d66466 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:56.172507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d53827-01e2-4a0a-aeb1-8ec7f4d66466 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:56.173151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d53827-01e2-4a0a-aeb1-8ec7f4d66466 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:56.173740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d53827-01e2-4a0a-aeb1-8ec7f4d66466 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:56.179316 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1447/2955] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:55 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:56.651625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-84d53827-01e2-4a0a-aeb1-8ec7f4d66466 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:56.663369 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-84d53827-01e2-4a0a-aeb1-8ec7f4d66466 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.516620 Aug 27 05:06:56.678136 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1509/2956] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:56 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:56.989816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c743e1db-293e-4abc-bd81-989117d2d7f9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:56.990726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c743e1db-293e-4abc-bd81-989117d2d7f9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:56.998509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c743e1db-293e-4abc-bd81-989117d2d7f9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:57.004616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c743e1db-293e-4abc-bd81-989117d2d7f9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:57.005075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c743e1db-293e-4abc-bd81-989117d2d7f9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:57.005818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c743e1db-293e-4abc-bd81-989117d2d7f9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:57.006276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c743e1db-293e-4abc-bd81-989117d2d7f9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:57.006705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c743e1db-293e-4abc-bd81-989117d2d7f9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:57.070468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8a7983ff-f3fc-4922-87cc-6a20123060ed tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:57.071114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8a7983ff-f3fc-4922-87cc-6a20123060ed tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:57.093695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7983ff-f3fc-4922-87cc-6a20123060ed tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:57.096925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7983ff-f3fc-4922-87cc-6a20123060ed tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:57.098925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7983ff-f3fc-4922-87cc-6a20123060ed tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:57.100859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7983ff-f3fc-4922-87cc-6a20123060ed tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:57.108094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7983ff-f3fc-4922-87cc-6a20123060ed tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:57.109035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7983ff-f3fc-4922-87cc-6a20123060ed tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:57.248225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c743e1db-293e-4abc-bd81-989117d2d7f9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:57.264529 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c743e1db-293e-4abc-bd81-989117d2d7f9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1314 microversion: 2.1 time: 0.279727 Aug 27 05:06:57.265406 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1448/2957] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:56 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:57.270850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-98d1d4e6-830d-480c-accb-4dfdba2530cb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:57.271938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-98d1d4e6-830d-480c-accb-4dfdba2530cb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:57.282037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98d1d4e6-830d-480c-accb-4dfdba2530cb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:57.283157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98d1d4e6-830d-480c-accb-4dfdba2530cb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:57.283462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98d1d4e6-830d-480c-accb-4dfdba2530cb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:57.284641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98d1d4e6-830d-480c-accb-4dfdba2530cb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:57.285344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98d1d4e6-830d-480c-accb-4dfdba2530cb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:57.286130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98d1d4e6-830d-480c-accb-4dfdba2530cb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:57.402107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8a7983ff-f3fc-4922-87cc-6a20123060ed tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:57.421201 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8a7983ff-f3fc-4922-87cc-6a20123060ed tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.357645 Aug 27 05:06:57.427540 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1510/2958] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:57 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:57.500120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-98d1d4e6-830d-480c-accb-4dfdba2530cb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:57.511400 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-98d1d4e6-830d-480c-accb-4dfdba2530cb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1307 microversion: 2.1 time: 0.244390 Aug 27 05:06:57.511929 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1449/2959] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:57 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1307 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:57.684629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c1296a0-ee64-44d7-bdf4-02a6c237fee5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:57.685254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c1296a0-ee64-44d7-bdf4-02a6c237fee5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:57.692198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1296a0-ee64-44d7-bdf4-02a6c237fee5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:57.692777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1296a0-ee64-44d7-bdf4-02a6c237fee5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:57.693287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1296a0-ee64-44d7-bdf4-02a6c237fee5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:57.694079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1296a0-ee64-44d7-bdf4-02a6c237fee5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:57.694603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1296a0-ee64-44d7-bdf4-02a6c237fee5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:57.695119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1296a0-ee64-44d7-bdf4-02a6c237fee5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:57.896822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c1296a0-ee64-44d7-bdf4-02a6c237fee5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:57.905916 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c1296a0-ee64-44d7-bdf4-02a6c237fee5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.225248 Aug 27 05:06:57.906711 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1511/2960] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:57 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:58.285620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c1356693-ef18-49ca-a4d3-eaa46bb66175 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:58.286446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c1356693-ef18-49ca-a4d3-eaa46bb66175 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:58.291806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:58.293984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:58.296692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1356693-ef18-49ca-a4d3-eaa46bb66175 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:58.297420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1356693-ef18-49ca-a4d3-eaa46bb66175 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:58.297789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1356693-ef18-49ca-a4d3-eaa46bb66175 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:58.298909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1356693-ef18-49ca-a4d3-eaa46bb66175 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:58.299582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1356693-ef18-49ca-a4d3-eaa46bb66175 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:58.300143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1356693-ef18-49ca-a4d3-eaa46bb66175 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:58.447958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:58.449208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:58.456184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:58.456522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:58.457857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:58.458983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:58.459662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:58.460679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:58.469454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1356693-ef18-49ca-a4d3-eaa46bb66175 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:58.484674 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c1356693-ef18-49ca-a4d3-eaa46bb66175 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1314 microversion: 2.1 time: 0.202875 Aug 27 05:06:58.487162 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1450/2961] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:58 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:58.533094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:58.533094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:58.534726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:58.540065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:58.540565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:58.541007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:58.542605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:58.543181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:58.543819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:58.666747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:58.676307 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.232023 Aug 27 05:06:58.677346 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1512/2962] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:58 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:58.736270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:58.746084 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1307 microversion: 2.1 time: 0.217654 Aug 27 05:06:58.747040 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1451/2963] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:58 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:58.807144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:58.808207 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001607 Aug 27 05:06:58.808551 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1513/2964] 10.222.0.58 () {56 vars in 886 bytes} [Sat Aug 27 05:06:58 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 05:06:58.817741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:58.819262 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001753 Aug 27 05:06:58.819495 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1452/2965] 10.222.0.58 () {54 vars in 1035 bytes} [Sat Aug 27 05:06:58 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 27 05:06:58.827405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:58.828744 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-678d9b33-47e6-4fcf-b404-73effc4e36b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002316 Aug 27 05:06:58.829192 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1514/2966] 10.222.0.58 () {54 vars in 1041 bytes} [Sat Aug 27 05:06:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:58.837584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:58.838588 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fce24d89-a822-4b23-a817-89e7842de2d7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001391 Aug 27 05:06:58.838925 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1453/2967] 10.222.0.58 () {56 vars in 886 bytes} [Sat Aug 27 05:06:58 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 05:06:58.930240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-961eb6a8-9d1c-4cf1-84eb-0bd16cfcbfd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:58.931385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-961eb6a8-9d1c-4cf1-84eb-0bd16cfcbfd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:58.933666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:58.941558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-961eb6a8-9d1c-4cf1-84eb-0bd16cfcbfd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:58.942820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-961eb6a8-9d1c-4cf1-84eb-0bd16cfcbfd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:58.943372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-961eb6a8-9d1c-4cf1-84eb-0bd16cfcbfd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:58.944119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-961eb6a8-9d1c-4cf1-84eb-0bd16cfcbfd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:58.944597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-961eb6a8-9d1c-4cf1-84eb-0bd16cfcbfd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:58.945475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-961eb6a8-9d1c-4cf1-84eb-0bd16cfcbfd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:59.098125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-961eb6a8-9d1c-4cf1-84eb-0bd16cfcbfd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:59.106738 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-961eb6a8-9d1c-4cf1-84eb-0bd16cfcbfd0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.181571 Aug 27 05:06:59.107366 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1515/2968] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:58 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:59.506150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2253f50c-915e-419a-be82-42e6e642ffa0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:59.507880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2253f50c-915e-419a-be82-42e6e642ffa0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:59.518698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2253f50c-915e-419a-be82-42e6e642ffa0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:59.522153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2253f50c-915e-419a-be82-42e6e642ffa0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:59.522714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2253f50c-915e-419a-be82-42e6e642ffa0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:59.526161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2253f50c-915e-419a-be82-42e6e642ffa0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:59.527030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2253f50c-915e-419a-be82-42e6e642ffa0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:59.527803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2253f50c-915e-419a-be82-42e6e642ffa0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:59.697981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e388ba4-c13f-4132-a124-7517c74fbcc0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:59.699637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9e388ba4-c13f-4132-a124-7517c74fbcc0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:59.707181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e388ba4-c13f-4132-a124-7517c74fbcc0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:59.707419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2253f50c-915e-419a-be82-42e6e642ffa0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:59.708095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e388ba4-c13f-4132-a124-7517c74fbcc0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:59.708811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e388ba4-c13f-4132-a124-7517c74fbcc0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:59.709893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e388ba4-c13f-4132-a124-7517c74fbcc0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:59.710511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e388ba4-c13f-4132-a124-7517c74fbcc0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:59.711192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e388ba4-c13f-4132-a124-7517c74fbcc0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:59.732073 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2253f50c-915e-419a-be82-42e6e642ffa0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1314 microversion: 2.1 time: 0.229870 Aug 27 05:06:59.735020 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1454/2969] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:59 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:59.778420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0afaf96d-45e1-4289-a070-cd74a722601c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:59.781134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0afaf96d-45e1-4289-a070-cd74a722601c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:59.800312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0afaf96d-45e1-4289-a070-cd74a722601c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:59.801082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0afaf96d-45e1-4289-a070-cd74a722601c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:59.801753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0afaf96d-45e1-4289-a070-cd74a722601c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:59.802697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0afaf96d-45e1-4289-a070-cd74a722601c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:59.810517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0afaf96d-45e1-4289-a070-cd74a722601c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:59.811292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0afaf96d-45e1-4289-a070-cd74a722601c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:59.848863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:59.940551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9e388ba4-c13f-4132-a124-7517c74fbcc0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:59.954186 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9e388ba4-c13f-4132-a124-7517c74fbcc0 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.260096 Aug 27 05:06:59.960905 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1516/2970] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:59 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:00.130792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1793122f-836f-42f7-b2ce-0343ed869226 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:00.131515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1793122f-836f-42f7-b2ce-0343ed869226 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:00.143706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1793122f-836f-42f7-b2ce-0343ed869226 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:00.144490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1793122f-836f-42f7-b2ce-0343ed869226 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:00.146650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1793122f-836f-42f7-b2ce-0343ed869226 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:00.147587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1793122f-836f-42f7-b2ce-0343ed869226 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:00.150093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1793122f-836f-42f7-b2ce-0343ed869226 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:00.151771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1793122f-836f-42f7-b2ce-0343ed869226 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:00.152374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0afaf96d-45e1-4289-a070-cd74a722601c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:00.160413 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0afaf96d-45e1-4289-a070-cd74a722601c tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1307 microversion: 2.1 time: 0.394827 Aug 27 05:07:00.162024 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1455/2971] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:59 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1307 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:00.319007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1793122f-836f-42f7-b2ce-0343ed869226 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:00.328330 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1793122f-836f-42f7-b2ce-0343ed869226 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.202695 Aug 27 05:07:00.332831 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1517/2972] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:00 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:00.679828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5cd16938-a424-46d3-8b8d-beacf5df2365 req-c2fe4075-8f1a-49ad-9dc9-0661c39e6ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e226f8ab-6c0c-4500-b810-80bb36601f5b", "tag": "7bb87706-af92-4d10-8319-3f035621da01"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:00.691328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5cd16938-a424-46d3-8b8d-beacf5df2365 req-c2fe4075-8f1a-49ad-9dc9-0661c39e6ff7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:00.692195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5cd16938-a424-46d3-8b8d-beacf5df2365 req-c2fe4075-8f1a-49ad-9dc9-0661c39e6ff7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:00.693309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5cd16938-a424-46d3-8b8d-beacf5df2365 req-c2fe4075-8f1a-49ad-9dc9-0661c39e6ff7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:00.706226 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5cd16938-a424-46d3-8b8d-beacf5df2365 req-c2fe4075-8f1a-49ad-9dc9-0661c39e6ff7 service nova] Creating event network-changed:7bb87706-af92-4d10-8319-3f035621da01 for instance e226f8ab-6c0c-4500-b810-80bb36601f5b on n-h2-820368-35 Aug 27 05:07:00.712750 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5cd16938-a424-46d3-8b8d-beacf5df2365 req-c2fe4075-8f1a-49ad-9dc9-0661c39e6ff7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037973 Aug 27 05:07:00.713696 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1456/2973] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:00.756583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b1e950ed-a2c0-4bcc-ab2b-3c5483099e33 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:00.758129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b1e950ed-a2c0-4bcc-ab2b-3c5483099e33 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:00.768397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1e950ed-a2c0-4bcc-ab2b-3c5483099e33 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:00.769236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1e950ed-a2c0-4bcc-ab2b-3c5483099e33 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:00.769888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1e950ed-a2c0-4bcc-ab2b-3c5483099e33 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:00.771063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1e950ed-a2c0-4bcc-ab2b-3c5483099e33 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:00.771763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1e950ed-a2c0-4bcc-ab2b-3c5483099e33 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:00.772342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1e950ed-a2c0-4bcc-ab2b-3c5483099e33 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:00.978746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b1e950ed-a2c0-4bcc-ab2b-3c5483099e33 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:00.982140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-04568aab-a1a1-4aeb-a62e-267c08f2d3e1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:00.983514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-04568aab-a1a1-4aeb-a62e-267c08f2d3e1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:00.990538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04568aab-a1a1-4aeb-a62e-267c08f2d3e1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:00.993290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04568aab-a1a1-4aeb-a62e-267c08f2d3e1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:00.993744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04568aab-a1a1-4aeb-a62e-267c08f2d3e1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:00.994053 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b1e950ed-a2c0-4bcc-ab2b-3c5483099e33 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1314 microversion: 2.1 time: 0.238758 Aug 27 05:07:00.995374 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1518/2974] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:00 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:00.999949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04568aab-a1a1-4aeb-a62e-267c08f2d3e1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.000454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04568aab-a1a1-4aeb-a62e-267c08f2d3e1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.000902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04568aab-a1a1-4aeb-a62e-267c08f2d3e1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:01.182436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4916068d-e59b-45b4-9cfc-e2a6dca48682 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:01.183072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4916068d-e59b-45b4-9cfc-e2a6dca48682 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:01.190596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4916068d-e59b-45b4-9cfc-e2a6dca48682 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.191054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4916068d-e59b-45b4-9cfc-e2a6dca48682 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.191526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4916068d-e59b-45b4-9cfc-e2a6dca48682 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:01.192303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4916068d-e59b-45b4-9cfc-e2a6dca48682 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.192770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4916068d-e59b-45b4-9cfc-e2a6dca48682 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.193205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4916068d-e59b-45b4-9cfc-e2a6dca48682 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:01.480391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-04568aab-a1a1-4aeb-a62e-267c08f2d3e1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:01.492041 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-04568aab-a1a1-4aeb-a62e-267c08f2d3e1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.514290 Aug 27 05:07:01.492631 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1457/2975] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:00 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:01.497908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a5cd856d-1810-4ac5-b678-4e1ad1626d55 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:01.498523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a5cd856d-1810-4ac5-b678-4e1ad1626d55 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:01.517572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5cd856d-1810-4ac5-b678-4e1ad1626d55 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.523784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5cd856d-1810-4ac5-b678-4e1ad1626d55 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.524458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5cd856d-1810-4ac5-b678-4e1ad1626d55 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:01.525394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5cd856d-1810-4ac5-b678-4e1ad1626d55 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.526024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5cd856d-1810-4ac5-b678-4e1ad1626d55 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.526649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5cd856d-1810-4ac5-b678-4e1ad1626d55 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:01.535319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4916068d-e59b-45b4-9cfc-e2a6dca48682 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:01.544723 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4916068d-e59b-45b4-9cfc-e2a6dca48682 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1307 microversion: 2.1 time: 0.367734 Aug 27 05:07:01.547991 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1519/2976] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:01 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1307 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:01.718498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a5cd856d-1810-4ac5-b678-4e1ad1626d55 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:01.727437 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a5cd856d-1810-4ac5-b678-4e1ad1626d55 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.233700 Aug 27 05:07:01.728297 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1458/2977] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:01 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:01.752272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e1a06708-bc04-42d6-bed3-34e775f951be tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:01.758514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e1a06708-bc04-42d6-bed3-34e775f951be tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:01.759466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e1a06708-bc04-42d6-bed3-34e775f951be tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Searching by: {'deleted': False, 'project_id': '9ee9d20df2704adba4c1b551045bcf11'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:07:01.766815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1a06708-bc04-42d6-bed3-34e775f951be tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.767374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1a06708-bc04-42d6-bed3-34e775f951be tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.768415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1a06708-bc04-42d6-bed3-34e775f951be tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:01.769812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1a06708-bc04-42d6-bed3-34e775f951be tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.770977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1a06708-bc04-42d6-bed3-34e775f951be tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.771641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1a06708-bc04-42d6-bed3-34e775f951be tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:01.804777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-e1a06708-bc04-42d6-bed3-34e775f951be tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:07:01.822677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:01.842815 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e1a06708-bc04-42d6-bed3-34e775f951be tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.095794 Aug 27 05:07:01.860358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:01.865923 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1520/2978] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 05:07:01 2022] GET /compute/v2.1/servers => generated 339 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:01.867816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:01.868857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Searching by: {'deleted': False, 'project_id': '9ee9d20df2704adba4c1b551045bcf11'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:07:01.874824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.875581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.876247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:01.877315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.877979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.879419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.002842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:07:02.014935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8725c1e-440e-451f-b1df-f69537d527a9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:02.016122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8725c1e-440e-451f-b1df-f69537d527a9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:02.024809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8725c1e-440e-451f-b1df-f69537d527a9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.025941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8725c1e-440e-451f-b1df-f69537d527a9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.026498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8725c1e-440e-451f-b1df-f69537d527a9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.027481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8725c1e-440e-451f-b1df-f69537d527a9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.028174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8725c1e-440e-451f-b1df-f69537d527a9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.028837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8725c1e-440e-451f-b1df-f69537d527a9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.092757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:02.100613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.101101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.101545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.146933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=20 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:02.465988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d8725c1e-440e-451f-b1df-f69537d527a9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:02.475970 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-455e24c6-28dd-44cd-9748-8c85cf5e0b33 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.621002 Aug 27 05:07:02.476571 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1459/2979] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 05:07:01 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:02.477861 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8725c1e-440e-451f-b1df-f69537d527a9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1314 microversion: 2.1 time: 0.466464 Aug 27 05:07:02.478918 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1521/2980] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:02 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:02.498948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-13e30a40-a5a4-47d5-b7fa-f62a8c1d7054 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:02.513846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-557b6bb7-2ed7-4c5f-a51c-92ac1cdafa2e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:02.514484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-557b6bb7-2ed7-4c5f-a51c-92ac1cdafa2e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:02.528247 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-13e30a40-a5a4-47d5-b7fa-f62a8c1d7054 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033451 Aug 27 05:07:02.529864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-557b6bb7-2ed7-4c5f-a51c-92ac1cdafa2e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.530607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-557b6bb7-2ed7-4c5f-a51c-92ac1cdafa2e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.532288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-557b6bb7-2ed7-4c5f-a51c-92ac1cdafa2e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.535135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-557b6bb7-2ed7-4c5f-a51c-92ac1cdafa2e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.535855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-557b6bb7-2ed7-4c5f-a51c-92ac1cdafa2e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.536057 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1460/2981] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:07:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:02.536644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-557b6bb7-2ed7-4c5f-a51c-92ac1cdafa2e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.570246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-963910f0-60af-4492-9bca-85ca18b18b96 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:02.571163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-963910f0-60af-4492-9bca-85ca18b18b96 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:02.579926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-963910f0-60af-4492-9bca-85ca18b18b96 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.580682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-963910f0-60af-4492-9bca-85ca18b18b96 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.581296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-963910f0-60af-4492-9bca-85ca18b18b96 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.583656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-963910f0-60af-4492-9bca-85ca18b18b96 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.584296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-963910f0-60af-4492-9bca-85ca18b18b96 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.585135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-963910f0-60af-4492-9bca-85ca18b18b96 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.862236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-557b6bb7-2ed7-4c5f-a51c-92ac1cdafa2e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:02.874726 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-557b6bb7-2ed7-4c5f-a51c-92ac1cdafa2e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.364646 Aug 27 05:07:02.876657 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1522/2982] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:02 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:02.883821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9201dcaf-c0cb-4b64-9e9d-9ecc3f42eb9b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:02.884824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9201dcaf-c0cb-4b64-9e9d-9ecc3f42eb9b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:02.895793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9201dcaf-c0cb-4b64-9e9d-9ecc3f42eb9b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.896618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9201dcaf-c0cb-4b64-9e9d-9ecc3f42eb9b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.897393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9201dcaf-c0cb-4b64-9e9d-9ecc3f42eb9b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.898824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9201dcaf-c0cb-4b64-9e9d-9ecc3f42eb9b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.899742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9201dcaf-c0cb-4b64-9e9d-9ecc3f42eb9b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.900406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9201dcaf-c0cb-4b64-9e9d-9ecc3f42eb9b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.916608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-963910f0-60af-4492-9bca-85ca18b18b96 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:02.926095 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-963910f0-60af-4492-9bca-85ca18b18b96 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1307 microversion: 2.1 time: 0.360177 Aug 27 05:07:02.926688 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1461/2983] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:02 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1307 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:02.960148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-251bf62e-ea5c-4123-b83e-d71ec50b48f1 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:02.961034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-251bf62e-ea5c-4123-b83e-d71ec50b48f1 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:02.972288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-251bf62e-ea5c-4123-b83e-d71ec50b48f1 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.973462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-251bf62e-ea5c-4123-b83e-d71ec50b48f1 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.975736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-251bf62e-ea5c-4123-b83e-d71ec50b48f1 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.977026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-251bf62e-ea5c-4123-b83e-d71ec50b48f1 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.977722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-251bf62e-ea5c-4123-b83e-d71ec50b48f1 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.981995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-251bf62e-ea5c-4123-b83e-d71ec50b48f1 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:03.020559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-251bf62e-ea5c-4123-b83e-d71ec50b48f1 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:07:03.163808 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-251bf62e-ea5c-4123-b83e-d71ec50b48f1 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 204 len: 0 microversion: 2.1 time: 0.210913 Aug 27 05:07:03.167957 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1462/2984] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:07:02 2022] DELETE /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:07:03.175924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b0ba45da-3392-4ba7-a91b-9a2116bd514a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:03.177274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b0ba45da-3392-4ba7-a91b-9a2116bd514a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:03.185562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0ba45da-3392-4ba7-a91b-9a2116bd514a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:03.186071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0ba45da-3392-4ba7-a91b-9a2116bd514a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:03.186525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0ba45da-3392-4ba7-a91b-9a2116bd514a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:03.187269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0ba45da-3392-4ba7-a91b-9a2116bd514a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:03.187748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0ba45da-3392-4ba7-a91b-9a2116bd514a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:03.188531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0ba45da-3392-4ba7-a91b-9a2116bd514a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:03.256855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9201dcaf-c0cb-4b64-9e9d-9ecc3f42eb9b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:03.292283 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9201dcaf-c0cb-4b64-9e9d-9ecc3f42eb9b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.410155 Aug 27 05:07:03.293894 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1523/2985] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:02 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:03.476821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b0ba45da-3392-4ba7-a91b-9a2116bd514a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:03.491248 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b0ba45da-3392-4ba7-a91b-9a2116bd514a tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1714 microversion: 2.1 time: 0.317392 Aug 27 05:07:03.492559 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1463/2986] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:03 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1714 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:03.499130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e9a0374b-59a1-45cb-9656-2d81168dec2e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:03.509390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-fcdefccc-625f-43a5-93d8-e16e0c3b570a req-ba8bf66a-3d3f-479d-8d26-2fd359d08fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780d1d8c-aaf6-4d22-b37a-b48a881f9d77", "name": "network-vif-plugged", "status": "completed", "tag": "a4069830-52de-48c2-90d4-5c1ba86d69a4"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:03.523042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e9a0374b-59a1-45cb-9656-2d81168dec2e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:03.530760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fcdefccc-625f-43a5-93d8-e16e0c3b570a req-ba8bf66a-3d3f-479d-8d26-2fd359d08fa7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:03.533896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fcdefccc-625f-43a5-93d8-e16e0c3b570a req-ba8bf66a-3d3f-479d-8d26-2fd359d08fa7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:03.535659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fcdefccc-625f-43a5-93d8-e16e0c3b570a req-ba8bf66a-3d3f-479d-8d26-2fd359d08fa7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:03.536709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a0374b-59a1-45cb-9656-2d81168dec2e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:03.537496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a0374b-59a1-45cb-9656-2d81168dec2e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:03.538175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a0374b-59a1-45cb-9656-2d81168dec2e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:03.539914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a0374b-59a1-45cb-9656-2d81168dec2e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:03.540761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a0374b-59a1-45cb-9656-2d81168dec2e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:03.541530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9a0374b-59a1-45cb-9656-2d81168dec2e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:03.555464 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-fcdefccc-625f-43a5-93d8-e16e0c3b570a req-ba8bf66a-3d3f-479d-8d26-2fd359d08fa7 service nova] Creating event network-vif-plugged:a4069830-52de-48c2-90d4-5c1ba86d69a4 for instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 on n-h1-820368-35 Aug 27 05:07:03.564655 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-fcdefccc-625f-43a5-93d8-e16e0c3b570a req-ba8bf66a-3d3f-479d-8d26-2fd359d08fa7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072768 Aug 27 05:07:03.565995 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1524/2987] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:07:03.872987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e9a0374b-59a1-45cb-9656-2d81168dec2e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:03.883274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e9a0374b-59a1-45cb-9656-2d81168dec2e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1314 microversion: 2.1 time: 0.387784 Aug 27 05:07:03.884332 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1464/2988] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:03 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:03.899624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-796aaa7e-569e-418f-af0b-ff74743a164a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:03.901139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-796aaa7e-569e-418f-af0b-ff74743a164a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:03.912078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-796aaa7e-569e-418f-af0b-ff74743a164a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:03.913510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-796aaa7e-569e-418f-af0b-ff74743a164a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:03.914159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-796aaa7e-569e-418f-af0b-ff74743a164a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:03.915066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-796aaa7e-569e-418f-af0b-ff74743a164a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:03.916673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-796aaa7e-569e-418f-af0b-ff74743a164a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:03.917705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-796aaa7e-569e-418f-af0b-ff74743a164a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:03.955500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8467832c-69df-4065-a88b-00b3aae8f2c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:03.957904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8467832c-69df-4065-a88b-00b3aae8f2c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:03.965026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8467832c-69df-4065-a88b-00b3aae8f2c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:03.965783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8467832c-69df-4065-a88b-00b3aae8f2c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:03.967955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8467832c-69df-4065-a88b-00b3aae8f2c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:03.968931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8467832c-69df-4065-a88b-00b3aae8f2c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:03.973593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8467832c-69df-4065-a88b-00b3aae8f2c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:03.974248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8467832c-69df-4065-a88b-00b3aae8f2c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:04.818038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-796aaa7e-569e-418f-af0b-ff74743a164a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:04.836028 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-796aaa7e-569e-418f-af0b-ff74743a164a tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.942818 Aug 27 05:07:04.847150 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1525/2989] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:03 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:04.851505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3dc20e6f-236e-4380-8296-86241733c56c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:04.852463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3dc20e6f-236e-4380-8296-86241733c56c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:04.859666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3dc20e6f-236e-4380-8296-86241733c56c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:04.860411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3dc20e6f-236e-4380-8296-86241733c56c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:04.861052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3dc20e6f-236e-4380-8296-86241733c56c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:04.861969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3dc20e6f-236e-4380-8296-86241733c56c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:04.863163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3dc20e6f-236e-4380-8296-86241733c56c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:04.863863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3dc20e6f-236e-4380-8296-86241733c56c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:04.895793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8467832c-69df-4065-a88b-00b3aae8f2c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:04.905104 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8467832c-69df-4065-a88b-00b3aae8f2c5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1307 microversion: 2.1 time: 0.957987 Aug 27 05:07:04.920332 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1465/2990] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:03 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1307 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:04.929455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0628c143-06b2-498b-956a-63546034d822 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:04.930095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0628c143-06b2-498b-956a-63546034d822 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:04.936698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0628c143-06b2-498b-956a-63546034d822 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:04.937213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0628c143-06b2-498b-956a-63546034d822 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:04.937665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0628c143-06b2-498b-956a-63546034d822 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:04.938389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0628c143-06b2-498b-956a-63546034d822 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:04.938848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0628c143-06b2-498b-956a-63546034d822 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:04.939313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0628c143-06b2-498b-956a-63546034d822 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:05.216109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0628c143-06b2-498b-956a-63546034d822 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:05.225999 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0628c143-06b2-498b-956a-63546034d822 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1714 microversion: 2.1 time: 0.301154 Aug 27 05:07:05.226676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3dc20e6f-236e-4380-8296-86241733c56c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:05.241456 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1466/2991] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:04 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1714 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:05.247658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82fc2952-c3d4-4b16-856e-7f66cff1b106 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:05.248564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-82fc2952-c3d4-4b16-856e-7f66cff1b106 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:05.249530 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3dc20e6f-236e-4380-8296-86241733c56c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.411225 Aug 27 05:07:05.251286 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1526/2992] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:04 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:05.255470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82fc2952-c3d4-4b16-856e-7f66cff1b106 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:05.255968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82fc2952-c3d4-4b16-856e-7f66cff1b106 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:05.256405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82fc2952-c3d4-4b16-856e-7f66cff1b106 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:05.257563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82fc2952-c3d4-4b16-856e-7f66cff1b106 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:05.258020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82fc2952-c3d4-4b16-856e-7f66cff1b106 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:05.258617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82fc2952-c3d4-4b16-856e-7f66cff1b106 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:05.497329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-82fc2952-c3d4-4b16-856e-7f66cff1b106 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:05.517042 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-82fc2952-c3d4-4b16-856e-7f66cff1b106 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1314 microversion: 2.1 time: 0.274126 Aug 27 05:07:05.517924 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1467/2993] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:05 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:05.864906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f8b2d198-304e-4cb3-8c16-d53418b71b7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:05.865972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f8b2d198-304e-4cb3-8c16-d53418b71b7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:05.873526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8b2d198-304e-4cb3-8c16-d53418b71b7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:05.874303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8b2d198-304e-4cb3-8c16-d53418b71b7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:05.875115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8b2d198-304e-4cb3-8c16-d53418b71b7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:05.876084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8b2d198-304e-4cb3-8c16-d53418b71b7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:05.876728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8b2d198-304e-4cb3-8c16-d53418b71b7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:05.877469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8b2d198-304e-4cb3-8c16-d53418b71b7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:05.897468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e348a10b-d070-434c-8384-cfc2dded0755 req-6a495aa9-39bd-49d1-96c2-855551a9644a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42593098-eb8a-4bb6-8a33-59ba5a5b1862", "name": "network-vif-plugged", "status": "completed", "tag": "0e9da397-9c51-4b2f-bca1-2807c2e3c7ac"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:05.909738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e348a10b-d070-434c-8384-cfc2dded0755 req-6a495aa9-39bd-49d1-96c2-855551a9644a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:05.910526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e348a10b-d070-434c-8384-cfc2dded0755 req-6a495aa9-39bd-49d1-96c2-855551a9644a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:05.911207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e348a10b-d070-434c-8384-cfc2dded0755 req-6a495aa9-39bd-49d1-96c2-855551a9644a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:05.924823 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e348a10b-d070-434c-8384-cfc2dded0755 req-6a495aa9-39bd-49d1-96c2-855551a9644a service nova] Creating event network-vif-plugged:0e9da397-9c51-4b2f-bca1-2807c2e3c7ac for instance 42593098-eb8a-4bb6-8a33-59ba5a5b1862 on n-h2-820368-35 Aug 27 05:07:05.930386 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e348a10b-d070-434c-8384-cfc2dded0755 req-6a495aa9-39bd-49d1-96c2-855551a9644a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039358 Aug 27 05:07:05.931691 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1468/2994] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:05.937557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-278cd3f5-0dd6-43d0-be29-814ee9b8fa56 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:05.938462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-278cd3f5-0dd6-43d0-be29-814ee9b8fa56 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:05.945584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-278cd3f5-0dd6-43d0-be29-814ee9b8fa56 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:05.946362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-278cd3f5-0dd6-43d0-be29-814ee9b8fa56 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:05.947058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-278cd3f5-0dd6-43d0-be29-814ee9b8fa56 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:05.948036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-278cd3f5-0dd6-43d0-be29-814ee9b8fa56 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:05.948701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-278cd3f5-0dd6-43d0-be29-814ee9b8fa56 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:05.949402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-278cd3f5-0dd6-43d0-be29-814ee9b8fa56 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:06.233817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f8b2d198-304e-4cb3-8c16-d53418b71b7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:06.246005 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f8b2d198-304e-4cb3-8c16-d53418b71b7e tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.387513 Aug 27 05:07:06.248022 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1527/2995] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:05 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:06.265568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-278cd3f5-0dd6-43d0-be29-814ee9b8fa56 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:06.280783 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-278cd3f5-0dd6-43d0-be29-814ee9b8fa56 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1307 microversion: 2.1 time: 0.343776 Aug 27 05:07:06.281941 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1469/2996] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:05 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1307 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:06.299779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ba2e371-7fd0-492c-86b6-4989e24daa62 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:06.301213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ba2e371-7fd0-492c-86b6-4989e24daa62 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:06.306260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-24b155c3-4c2c-4dd0-b2bb-747e5e2edefc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:06.307458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-24b155c3-4c2c-4dd0-b2bb-747e5e2edefc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:06.312507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ba2e371-7fd0-492c-86b6-4989e24daa62 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:06.314571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ba2e371-7fd0-492c-86b6-4989e24daa62 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:06.316350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ba2e371-7fd0-492c-86b6-4989e24daa62 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:06.320047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ba2e371-7fd0-492c-86b6-4989e24daa62 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:06.320729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ba2e371-7fd0-492c-86b6-4989e24daa62 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:06.322523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ba2e371-7fd0-492c-86b6-4989e24daa62 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:06.323844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24b155c3-4c2c-4dd0-b2bb-747e5e2edefc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:06.324537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24b155c3-4c2c-4dd0-b2bb-747e5e2edefc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:06.325951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24b155c3-4c2c-4dd0-b2bb-747e5e2edefc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:06.326859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24b155c3-4c2c-4dd0-b2bb-747e5e2edefc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:06.330794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24b155c3-4c2c-4dd0-b2bb-747e5e2edefc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:06.331626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24b155c3-4c2c-4dd0-b2bb-747e5e2edefc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:06.811857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7ba2e371-7fd0-492c-86b6-4989e24daa62 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:06.818120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-24b155c3-4c2c-4dd0-b2bb-747e5e2edefc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:06.821816 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ba2e371-7fd0-492c-86b6-4989e24daa62 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1714 microversion: 2.1 time: 0.544244 Aug 27 05:07:06.822650 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1528/2997] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:06 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1714 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:06.828516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb7dfd33-b7e8-476a-8f0e-263fd4c5d9ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:06.829411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cb7dfd33-b7e8-476a-8f0e-263fd4c5d9ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:06.837920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7dfd33-b7e8-476a-8f0e-263fd4c5d9ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:06.839400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7dfd33-b7e8-476a-8f0e-263fd4c5d9ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:06.840052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7dfd33-b7e8-476a-8f0e-263fd4c5d9ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:06.841289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7dfd33-b7e8-476a-8f0e-263fd4c5d9ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:06.841890 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-24b155c3-4c2c-4dd0-b2bb-747e5e2edefc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.545624 Aug 27 05:07:06.842368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7dfd33-b7e8-476a-8f0e-263fd4c5d9ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:06.842708 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1470/2998] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:06 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:06.843468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7dfd33-b7e8-476a-8f0e-263fd4c5d9ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:07.241059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb7dfd33-b7e8-476a-8f0e-263fd4c5d9ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:07.250203 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb7dfd33-b7e8-476a-8f0e-263fd4c5d9ff tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1502 microversion: 2.1 time: 0.426276 Aug 27 05:07:07.266927 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1529/2999] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:06 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1502 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:07.280188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7c3279a2-3cfb-4318-9d3c-56ca58ea0b26 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:07.280838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7c3279a2-3cfb-4318-9d3c-56ca58ea0b26 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:07.287002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c3279a2-3cfb-4318-9d3c-56ca58ea0b26 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:07.287804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c3279a2-3cfb-4318-9d3c-56ca58ea0b26 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:07.288606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c3279a2-3cfb-4318-9d3c-56ca58ea0b26 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:07.289069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-254f2050-a121-4faf-a3f6-b3c1bfb32f6c tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:07.289827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-254f2050-a121-4faf-a3f6-b3c1bfb32f6c tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:07.290219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c3279a2-3cfb-4318-9d3c-56ca58ea0b26 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:07.290851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c3279a2-3cfb-4318-9d3c-56ca58ea0b26 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:07.291474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c3279a2-3cfb-4318-9d3c-56ca58ea0b26 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:07.298630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-254f2050-a121-4faf-a3f6-b3c1bfb32f6c tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:07.299382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-254f2050-a121-4faf-a3f6-b3c1bfb32f6c tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:07.300117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-254f2050-a121-4faf-a3f6-b3c1bfb32f6c tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:07.301098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-254f2050-a121-4faf-a3f6-b3c1bfb32f6c tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:07.301761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-254f2050-a121-4faf-a3f6-b3c1bfb32f6c tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:07.302393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-254f2050-a121-4faf-a3f6-b3c1bfb32f6c tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:07.345446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-7c3279a2-3cfb-4318-9d3c-56ca58ea0b26 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lazy-loading 'flavor' on Instance uuid 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:07:07.730684 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7c3279a2-3cfb-4318-9d3c-56ca58ea0b26 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77/action" status: 202 len: 0 microversion: 2.1 time: 0.454111 Aug 27 05:07:07.733379 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1530/3000] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:07:07 2022] POST /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:07:07.750137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-254f2050-a121-4faf-a3f6-b3c1bfb32f6c tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:07.766567 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-254f2050-a121-4faf-a3f6-b3c1bfb32f6c tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1375 microversion: 2.1 time: 0.492891 Aug 27 05:07:07.767853 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1471/3001] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:07 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1375 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:07.773486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-49588d38-eda2-4de4-8e78-0941788a0f83 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:07.774984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-49588d38-eda2-4de4-8e78-0941788a0f83 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:07.783403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db3e0785-2bf6-40ad-a160-a34c54eb46b2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:07.784433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-db3e0785-2bf6-40ad-a160-a34c54eb46b2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:07.792770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49588d38-eda2-4de4-8e78-0941788a0f83 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:07.794732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3e0785-2bf6-40ad-a160-a34c54eb46b2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:07.797735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3e0785-2bf6-40ad-a160-a34c54eb46b2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:07.801687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3e0785-2bf6-40ad-a160-a34c54eb46b2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:07.802335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49588d38-eda2-4de4-8e78-0941788a0f83 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:07.802850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3e0785-2bf6-40ad-a160-a34c54eb46b2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:07.803458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3e0785-2bf6-40ad-a160-a34c54eb46b2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:07.803998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db3e0785-2bf6-40ad-a160-a34c54eb46b2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:07.804140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49588d38-eda2-4de4-8e78-0941788a0f83 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:07.805422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49588d38-eda2-4de4-8e78-0941788a0f83 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:07.819577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49588d38-eda2-4de4-8e78-0941788a0f83 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:07.820638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49588d38-eda2-4de4-8e78-0941788a0f83 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:07.823862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:08.353213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-db3e0785-2bf6-40ad-a160-a34c54eb46b2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:08.365155 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db3e0785-2bf6-40ad-a160-a34c54eb46b2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.593016 Aug 27 05:07:08.367311 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1472/3002] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:07 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:08.379046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c0d1add8-4a70-4fec-9093-0709c50a394e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:08.380093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c0d1add8-4a70-4fec-9093-0709c50a394e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:08.398006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0d1add8-4a70-4fec-9093-0709c50a394e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:08.399233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0d1add8-4a70-4fec-9093-0709c50a394e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:08.400154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-49588d38-eda2-4de4-8e78-0941788a0f83 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:08.401040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0d1add8-4a70-4fec-9093-0709c50a394e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:08.402409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0d1add8-4a70-4fec-9093-0709c50a394e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:08.404153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0d1add8-4a70-4fec-9093-0709c50a394e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:08.405590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0d1add8-4a70-4fec-9093-0709c50a394e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:08.415130 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-49588d38-eda2-4de4-8e78-0941788a0f83 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1307 microversion: 2.1 time: 0.676216 Aug 27 05:07:08.419252 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1531/3003] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:07 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1307 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:08.436350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-29e2eaa3-733c-45ee-af0c-a64d791dba7f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:08.437419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-29e2eaa3-733c-45ee-af0c-a64d791dba7f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:08.449509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e2eaa3-733c-45ee-af0c-a64d791dba7f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:08.450347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e2eaa3-733c-45ee-af0c-a64d791dba7f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:08.450854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e2eaa3-733c-45ee-af0c-a64d791dba7f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:08.453961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e2eaa3-733c-45ee-af0c-a64d791dba7f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:08.454601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e2eaa3-733c-45ee-af0c-a64d791dba7f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:08.455180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29e2eaa3-733c-45ee-af0c-a64d791dba7f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:08.761486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c0d1add8-4a70-4fec-9093-0709c50a394e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:08.776385 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c0d1add8-4a70-4fec-9093-0709c50a394e tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1714 microversion: 2.1 time: 0.403225 Aug 27 05:07:08.777338 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1473/3004] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:08 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1714 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:08.795958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-43fcd605-b9cc-4b14-908f-5e8f83e403b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:08.798195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-43fcd605-b9cc-4b14-908f-5e8f83e403b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:08.812800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43fcd605-b9cc-4b14-908f-5e8f83e403b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:08.812909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43fcd605-b9cc-4b14-908f-5e8f83e403b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:08.816748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43fcd605-b9cc-4b14-908f-5e8f83e403b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:08.818419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43fcd605-b9cc-4b14-908f-5e8f83e403b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:08.818913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43fcd605-b9cc-4b14-908f-5e8f83e403b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:08.819455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43fcd605-b9cc-4b14-908f-5e8f83e403b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:08.890644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-29e2eaa3-733c-45ee-af0c-a64d791dba7f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:08.907631 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-29e2eaa3-733c-45ee-af0c-a64d791dba7f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.486962 Aug 27 05:07:08.908801 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1532/3005] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:08 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:09.179922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-43fcd605-b9cc-4b14-908f-5e8f83e403b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:09.191814 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-43fcd605-b9cc-4b14-908f-5e8f83e403b6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1548 microversion: 2.1 time: 0.399457 Aug 27 05:07:09.192632 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1474/3006] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:08 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1548 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:09.221273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13fac2e8-68e1-4da5-8e90-7616f9d1891b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:09.222248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-13fac2e8-68e1-4da5-8e90-7616f9d1891b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:09.229256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fac2e8-68e1-4da5-8e90-7616f9d1891b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:09.230270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fac2e8-68e1-4da5-8e90-7616f9d1891b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:09.230885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fac2e8-68e1-4da5-8e90-7616f9d1891b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:09.231719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fac2e8-68e1-4da5-8e90-7616f9d1891b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:09.232086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fac2e8-68e1-4da5-8e90-7616f9d1891b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:09.232509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13fac2e8-68e1-4da5-8e90-7616f9d1891b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:09.426842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13fac2e8-68e1-4da5-8e90-7616f9d1891b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:09.439625 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-13fac2e8-68e1-4da5-8e90-7616f9d1891b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1548 microversion: 2.1 time: 0.224895 Aug 27 05:07:09.441604 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1533/3007] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:09 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1548 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:09.446723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fc88af0b-fb8a-4d40-85be-edb4842d2d32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:09.447583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fc88af0b-fb8a-4d40-85be-edb4842d2d32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:09.469634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc88af0b-fb8a-4d40-85be-edb4842d2d32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:09.470158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc88af0b-fb8a-4d40-85be-edb4842d2d32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:09.470605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc88af0b-fb8a-4d40-85be-edb4842d2d32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:09.477649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc88af0b-fb8a-4d40-85be-edb4842d2d32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:09.478251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc88af0b-fb8a-4d40-85be-edb4842d2d32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:09.480436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc88af0b-fb8a-4d40-85be-edb4842d2d32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:09.750123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-09ca7529-5679-43a1-be99-50f59f02fe6d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Action: 'create', calling method: .version_select at 0x7fb5650221f0>, body: {"keypair": {"name": "tempest-keypair-97754129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFZVIplj0aWNJmQczWQkN7pKwEHs1ocEoahjGy+i3uFaADRS5O3SAcajkddHLlul5H1qzp5ygFnizG1TRGYJMy/CFxubUPbusjKyVHTstZtZ/RVID4go1E6vJxiayGJ6g=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:09.795496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-09ca7529-5679-43a1-be99-50f59f02fe6d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Getting quotas for project cba630546e34472498c6e180a3ec2849. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:07:09.809226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-09ca7529-5679-43a1-be99-50f59f02fe6d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Getting quotas for user 14ad24b744324d3e856a64b4c4979e8a and project cba630546e34472498c6e180a3ec2849. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:07:09.879647 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-09ca7529-5679-43a1-be99-50f59f02fe6d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.524022 Aug 27 05:07:09.885018 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1475/3008] 10.222.0.58 () {62 vars in 1200 bytes} [Sat Aug 27 05:07:09 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 530 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 27 05:07:09.901418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-85182051-394d-48cc-a4c7-37eb690f6522 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:09.902119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-85182051-394d-48cc-a4c7-37eb690f6522 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:09.917116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fc88af0b-fb8a-4d40-85be-edb4842d2d32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:09.947398 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fc88af0b-fb8a-4d40-85be-edb4842d2d32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.500938 Aug 27 05:07:09.949833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85182051-394d-48cc-a4c7-37eb690f6522 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:09.950316 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1534/3009] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:09 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:09.950438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85182051-394d-48cc-a4c7-37eb690f6522 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:09.950756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85182051-394d-48cc-a4c7-37eb690f6522 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:09.960792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85182051-394d-48cc-a4c7-37eb690f6522 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:09.961413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85182051-394d-48cc-a4c7-37eb690f6522 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:09.961865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85182051-394d-48cc-a4c7-37eb690f6522 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:09.974273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-3a9946d8-c041-434a-84fa-9bccb7d58049 req-7a9328bc-f7e6-4a53-ada1-214e5c24b4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6901dbce-5b17-416f-bf76-ae7a4649a06f", "name": "network-vif-deleted", "tag": "a21208c8-c4ca-4667-9b01-17e15d6b7485"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:10.010813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3a9946d8-c041-434a-84fa-9bccb7d58049 req-7a9328bc-f7e6-4a53-ada1-214e5c24b4f8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:10.011910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3a9946d8-c041-434a-84fa-9bccb7d58049 req-7a9328bc-f7e6-4a53-ada1-214e5c24b4f8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:10.012571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3a9946d8-c041-434a-84fa-9bccb7d58049 req-7a9328bc-f7e6-4a53-ada1-214e5c24b4f8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:10.028097 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-3a9946d8-c041-434a-84fa-9bccb7d58049 req-7a9328bc-f7e6-4a53-ada1-214e5c24b4f8 service nova] Creating event network-vif-deleted:a21208c8-c4ca-4667-9b01-17e15d6b7485 for instance 6901dbce-5b17-416f-bf76-ae7a4649a06f on n-h2-820368-35 Aug 27 05:07:10.033815 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-3a9946d8-c041-434a-84fa-9bccb7d58049 req-7a9328bc-f7e6-4a53-ada1-214e5c24b4f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081800 Aug 27 05:07:10.035667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1535/3010] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:10.040995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:10.041702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:10.048170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:10.048880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:10.049488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:10.050429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:10.051049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:10.052462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:10.089464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:10.116565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:10.117377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:10.118007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:10.119165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lazy-loading 'fault' on Instance uuid 6901dbce-5b17-416f-bf76-ae7a4649a06f {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:07:10.237286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecba35400844155ad36602d50d11252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9d20df2704adba4c1b551045bcf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:10.255418 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0d675991-a8de-4d62-b5b1-9aee74fba0fe tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 200 len: 1367 microversion: 2.1 time: 0.218144 Aug 27 05:07:10.281884 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1536/3011] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:10 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:10.301235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ebce5635-84b3-4e1d-88e7-c8b93d11f708 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:10.301871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ebce5635-84b3-4e1d-88e7-c8b93d11f708 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:10.309727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebce5635-84b3-4e1d-88e7-c8b93d11f708 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:10.310722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebce5635-84b3-4e1d-88e7-c8b93d11f708 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:10.311439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebce5635-84b3-4e1d-88e7-c8b93d11f708 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:10.312344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebce5635-84b3-4e1d-88e7-c8b93d11f708 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:10.312997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebce5635-84b3-4e1d-88e7-c8b93d11f708 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:10.313589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebce5635-84b3-4e1d-88e7-c8b93d11f708 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:10.432371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-85182051-394d-48cc-a4c7-37eb690f6522 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:10.442223 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-85182051-394d-48cc-a4c7-37eb690f6522 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1307 microversion: 2.1 time: 0.555870 Aug 27 05:07:10.460521 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1476/3012] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:09 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1307 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:10.554053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ebce5635-84b3-4e1d-88e7-c8b93d11f708 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:10.567344 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ebce5635-84b3-4e1d-88e7-c8b93d11f708 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.267573 Aug 27 05:07:10.568634 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1537/3013] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:10 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:10.978140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2ae829c2-5336-40d7-99f9-0c445c4e7489 req-50e928ba-9a3a-48eb-8cd4-eaa6100237fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e226f8ab-6c0c-4500-b810-80bb36601f5b", "name": "network-vif-plugged", "status": "completed", "tag": "7bb87706-af92-4d10-8319-3f035621da01"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:10.979438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0000c800-a490-48d8-8b52-2a4e0ec4cba3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:10.983232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0000c800-a490-48d8-8b52-2a4e0ec4cba3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:11.006740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0000c800-a490-48d8-8b52-2a4e0ec4cba3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:11.015342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0000c800-a490-48d8-8b52-2a4e0ec4cba3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:11.017715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0000c800-a490-48d8-8b52-2a4e0ec4cba3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:11.019775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0000c800-a490-48d8-8b52-2a4e0ec4cba3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:11.023833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0000c800-a490-48d8-8b52-2a4e0ec4cba3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:11.024331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2ae829c2-5336-40d7-99f9-0c445c4e7489 req-50e928ba-9a3a-48eb-8cd4-eaa6100237fa service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:11.025394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2ae829c2-5336-40d7-99f9-0c445c4e7489 req-50e928ba-9a3a-48eb-8cd4-eaa6100237fa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:11.025967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0000c800-a490-48d8-8b52-2a4e0ec4cba3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:11.027292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2ae829c2-5336-40d7-99f9-0c445c4e7489 req-50e928ba-9a3a-48eb-8cd4-eaa6100237fa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:11.078453 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2ae829c2-5336-40d7-99f9-0c445c4e7489 req-50e928ba-9a3a-48eb-8cd4-eaa6100237fa service nova] Creating event network-vif-plugged:7bb87706-af92-4d10-8319-3f035621da01 for instance e226f8ab-6c0c-4500-b810-80bb36601f5b on n-h2-820368-35 Aug 27 05:07:11.103602 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2ae829c2-5336-40d7-99f9-0c445c4e7489 req-50e928ba-9a3a-48eb-8cd4-eaa6100237fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132224 Aug 27 05:07:11.106312 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1477/3014] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:11.307570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:11.308731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] [instance: 6901dbce-5b17-416f-bf76-ae7a4649a06f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:11.317197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:11.318033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:11.318700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:11.320656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:11.321406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:11.322246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:11.351956 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] HTTP exception thrown: Instance 6901dbce-5b17-416f-bf76-ae7a4649a06f could not be found. Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Request method failure captured: Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f HTTP/1.1 Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXrELFeHR-0Jr0uRvBLQhIh6c4s870FbbkXV_9S2VDssBz4CSacffAfd04wMBUGzhQHs_ahwQEAeeR8QP9DRZntrxCpSYv3pSPEkeKSwJaDojbjuOYtRfQQigaUqiQLhPrPm5GfWm6l0RZiPsSBCn2iWt1fLGZxHH7bSrg1vSgdEAg Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 9ee9d20df2704adba4c1b551045bcf11 Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestManualDisk-483380257 Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9ee9d20df2704adba4c1b551045bcf11", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9ee9d20df2704adba4c1b551045bcf11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ee9d20df2704adba4c1b551045bcf11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ee9d20df2704adba4c1b551045bcf11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestManualDisk-483380257 Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 9ee9d20df2704adba4c1b551045bcf11 Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestManualDisk-483380257 Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestManualDisk-483380257-project Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6ecba35400844155ad36602d50d11252 Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestManualDisk-483380257-project Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 6901dbce-5b17-416f-bf76-ae7a4649a06f could not be found. Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '6901dbce-5b17-416f-bf76-ae7a4649a06f'} Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6901dbce-5b17-416f-bf76-ae7a4649a06f could not be found. Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6901dbce-5b17-416f-bf76-ae7a4649a06f could not be found. Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:11.354957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:11.360639 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:11.360639 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:11.360639 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:11.360639 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:11.360639 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:11.360639 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6901dbce-5b17-416f-bf76-ae7a4649a06f could not be found. Aug 27 05:07:11.360639 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:11.364585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Returning 404 to user: Instance 6901dbce-5b17-416f-bf76-ae7a4649a06f could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:11.366764 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-51fc257e-17bd-4d44-b35b-8cdc3e46cdd0 tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f" status: 404 len: 111 microversion: 2.1 time: 0.066627 Aug 27 05:07:11.367978 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1478/3015] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:11 2022] GET /compute/v2.1/servers/6901dbce-5b17-416f-bf76-ae7a4649a06f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:07:11.383407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-534b0354-e0c0-4b4f-97a7-4978d70f181d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] Calling method '.version_select at 0x7fb565037820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:11.436216 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-534b0354-e0c0-4b4f-97a7-4978d70f181d tempest-ServersTestManualDisk-483380257 tempest-ServersTestManualDisk-483380257-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473542625" status: 202 len: 0 microversion: 2.1 time: 0.063006 Aug 27 05:07:11.437604 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1479/3016] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 05:07:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473542625 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:07:11.474262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-13a3a492-a7bd-4c98-b13d-60bde0ab7fde tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:11.475121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-13a3a492-a7bd-4c98-b13d-60bde0ab7fde tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:11.489466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13a3a492-a7bd-4c98-b13d-60bde0ab7fde tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:11.490720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13a3a492-a7bd-4c98-b13d-60bde0ab7fde tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:11.493332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13a3a492-a7bd-4c98-b13d-60bde0ab7fde tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:11.494734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13a3a492-a7bd-4c98-b13d-60bde0ab7fde tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:11.495599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13a3a492-a7bd-4c98-b13d-60bde0ab7fde tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:11.497503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-13a3a492-a7bd-4c98-b13d-60bde0ab7fde tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:11.788064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:11.931621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:12.284400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-13a3a492-a7bd-4c98-b13d-60bde0ab7fde tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:12.296836 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-13a3a492-a7bd-4c98-b13d-60bde0ab7fde tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1307 microversion: 2.1 time: 0.827783 Aug 27 05:07:12.298937 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1480/3017] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:11 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1307 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:12.305957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d69f5705-e850-4c91-b53a-2f075b4c9047 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:12.306800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d69f5705-e850-4c91-b53a-2f075b4c9047 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:12.320442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0000c800-a490-48d8-8b52-2a4e0ec4cba3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:12.333265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d69f5705-e850-4c91-b53a-2f075b4c9047 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:12.333768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d69f5705-e850-4c91-b53a-2f075b4c9047 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:12.334209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d69f5705-e850-4c91-b53a-2f075b4c9047 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:12.334943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d69f5705-e850-4c91-b53a-2f075b4c9047 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:12.335406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d69f5705-e850-4c91-b53a-2f075b4c9047 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:12.335737 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0000c800-a490-48d8-8b52-2a4e0ec4cba3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 1.365862 Aug 27 05:07:12.335885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d69f5705-e850-4c91-b53a-2f075b4c9047 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:12.337319 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1538/3018] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:10 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:12.531300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-117227659", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26693bae-61f8-4132-bd2b-dd87b033168d"}], "security_groups": [{"name": "tempest-securitygroup--1167569937"}], "key_name": "tempest-keypair-97754129", "user_data": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:12.772789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d69f5705-e850-4c91-b53a-2f075b4c9047 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:12.786788 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d69f5705-e850-4c91-b53a-2f075b4c9047 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1542 microversion: 2.1 time: 0.485948 Aug 27 05:07:12.787979 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1481/3019] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:12 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1542 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:12.838676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] validate_networks() for [('26693bae-61f8-4132-bd2b-dd87b033168d', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:07:13.320246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-02d9a3df-96da-484a-b0d8-a01f09589d15 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:13.321496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-02d9a3df-96da-484a-b0d8-a01f09589d15 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:13.330831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d9a3df-96da-484a-b0d8-a01f09589d15 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:13.344192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d9a3df-96da-484a-b0d8-a01f09589d15 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:13.344947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d9a3df-96da-484a-b0d8-a01f09589d15 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:13.346412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d9a3df-96da-484a-b0d8-a01f09589d15 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:13.347607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d9a3df-96da-484a-b0d8-a01f09589d15 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:13.350282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d9a3df-96da-484a-b0d8-a01f09589d15 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:13.805201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02d9a3df-96da-484a-b0d8-a01f09589d15 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:13.817581 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-02d9a3df-96da-484a-b0d8-a01f09589d15 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1307 microversion: 2.1 time: 0.500390 Aug 27 05:07:13.818206 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1482/3020] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:13 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1307 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:13.842684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-282f759c-7dc0-4648-86f3-f19c9ad1f009 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:13.851321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-282f759c-7dc0-4648-86f3-f19c9ad1f009 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:13.862356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-282f759c-7dc0-4648-86f3-f19c9ad1f009 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:13.862955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-282f759c-7dc0-4648-86f3-f19c9ad1f009 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:13.863434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-282f759c-7dc0-4648-86f3-f19c9ad1f009 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:13.864166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-282f759c-7dc0-4648-86f3-f19c9ad1f009 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:13.869256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-282f759c-7dc0-4648-86f3-f19c9ad1f009 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:13.869963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-282f759c-7dc0-4648-86f3-f19c9ad1f009 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:14.045112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:07:14.046087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:07:14.048189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:07:14.048329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:07:14.048764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:07:14.090259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:14.090759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:14.092516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:14.093904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:14.094390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:14.094838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:14.153696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Getting quotas for project cba630546e34472498c6e180a3ec2849. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:07:14.174501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Getting quotas for user 14ad24b744324d3e856a64b4c4979e8a and project cba630546e34472498c6e180a3ec2849. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:07:14.193968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:07:14.196940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:07:14.232639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-282f759c-7dc0-4648-86f3-f19c9ad1f009 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:14.242575 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-282f759c-7dc0-4648-86f3-f19c9ad1f009 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.422148 Aug 27 05:07:14.245991 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1483/3021] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:13 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:14.251305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b495af8-51d6-42c9-a6db-c5160f1e602b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:14.252658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b495af8-51d6-42c9-a6db-c5160f1e602b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:14.260954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b495af8-51d6-42c9-a6db-c5160f1e602b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:14.261877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b495af8-51d6-42c9-a6db-c5160f1e602b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:14.262528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b495af8-51d6-42c9-a6db-c5160f1e602b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:14.263526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b495af8-51d6-42c9-a6db-c5160f1e602b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:14.264208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b495af8-51d6-42c9-a6db-c5160f1e602b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:14.264978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b495af8-51d6-42c9-a6db-c5160f1e602b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:14.331023 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-954c6d23-d3bc-4223-9546-a1ae8f8489dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.804513 Aug 27 05:07:14.335533 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1539/3022] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 05:07:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 05:07:14.343921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-57c738ba-973f-460a-acd5-54de72d1ed01 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:14.344831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-57c738ba-973f-460a-acd5-54de72d1ed01 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:14.452610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-57c738ba-973f-460a-acd5-54de72d1ed01 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:14.466440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-57c738ba-973f-460a-acd5-54de72d1ed01 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:14.469666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-57c738ba-973f-460a-acd5-54de72d1ed01 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:14.471870 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-57c738ba-973f-460a-acd5-54de72d1ed01 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1279 microversion: 2.20 time: 0.132165 Aug 27 05:07:14.473477 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1540/3023] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:14 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:14.731329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b495af8-51d6-42c9-a6db-c5160f1e602b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:14.745758 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b495af8-51d6-42c9-a6db-c5160f1e602b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1541 microversion: 2.1 time: 0.497851 Aug 27 05:07:14.746640 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1484/3024] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:14 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1541 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:14.845673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-98ac3fde-a88a-41f5-9237-e1a4e420cdae tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:14.846452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-98ac3fde-a88a-41f5-9237-e1a4e420cdae tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:14.860680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98ac3fde-a88a-41f5-9237-e1a4e420cdae tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:14.864717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98ac3fde-a88a-41f5-9237-e1a4e420cdae tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:14.865739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98ac3fde-a88a-41f5-9237-e1a4e420cdae tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:14.867449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98ac3fde-a88a-41f5-9237-e1a4e420cdae tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:14.870070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98ac3fde-a88a-41f5-9237-e1a4e420cdae tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:14.872968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98ac3fde-a88a-41f5-9237-e1a4e420cdae tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:15.270454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c32d5c81-707b-4d06-b14c-88f9b45f5b34 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:15.273776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c32d5c81-707b-4d06-b14c-88f9b45f5b34 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:15.279822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-98ac3fde-a88a-41f5-9237-e1a4e420cdae tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:15.286739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c32d5c81-707b-4d06-b14c-88f9b45f5b34 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:15.287231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c32d5c81-707b-4d06-b14c-88f9b45f5b34 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:15.291750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c32d5c81-707b-4d06-b14c-88f9b45f5b34 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:15.292786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c32d5c81-707b-4d06-b14c-88f9b45f5b34 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:15.293434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c32d5c81-707b-4d06-b14c-88f9b45f5b34 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:15.294067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c32d5c81-707b-4d06-b14c-88f9b45f5b34 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:15.294585 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-98ac3fde-a88a-41f5-9237-e1a4e420cdae tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1488 microversion: 2.1 time: 0.454375 Aug 27 05:07:15.297842 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1541/3025] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:14 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1488 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:15.324327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-79fa9b99-56db-4606-907a-5937335b80bb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1044374617"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:15.328723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-79fa9b99-56db-4606-907a-5937335b80bb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:15.338851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79fa9b99-56db-4606-907a-5937335b80bb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:15.339803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79fa9b99-56db-4606-907a-5937335b80bb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:15.340435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79fa9b99-56db-4606-907a-5937335b80bb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:15.341328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79fa9b99-56db-4606-907a-5937335b80bb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:15.344322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79fa9b99-56db-4606-907a-5937335b80bb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:15.344946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79fa9b99-56db-4606-907a-5937335b80bb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:15.723162 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-79fa9b99-56db-4606-907a-5937335b80bb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "POST /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b/action" status: 202 len: 0 microversion: 2.1 time: 0.400633 Aug 27 05:07:15.741992 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1542/3026] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:07:15 2022] POST /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 05:07:15.755474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:15.756711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:15.776322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:15.777134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:15.777797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:15.779969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:15.782263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:15.782980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:15.917532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:15.927268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c32d5c81-707b-4d06-b14c-88f9b45f5b34 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:15.964613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:15.968643 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c32d5c81-707b-4d06-b14c-88f9b45f5b34 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.697084 Aug 27 05:07:15.971042 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1485/3027] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:15 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:15.972553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:15.981035 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5a2640a7-58b5-4dfd-8849-ca7c3a100d82 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1331 microversion: 2.20 time: 0.235433 Aug 27 05:07:15.982058 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1543/3028] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:15 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1331 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:15.990045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a1540613-0da8-44a4-9c9e-877390a029fa tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5655f3f70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:16.005654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f584eac0-1718-4021-b66d-cc81eb1419aa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:16.007914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f584eac0-1718-4021-b66d-cc81eb1419aa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:16.021460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f584eac0-1718-4021-b66d-cc81eb1419aa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:16.022211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f584eac0-1718-4021-b66d-cc81eb1419aa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:16.022823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f584eac0-1718-4021-b66d-cc81eb1419aa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:16.024597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f584eac0-1718-4021-b66d-cc81eb1419aa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:16.025387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f584eac0-1718-4021-b66d-cc81eb1419aa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:16.025986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f584eac0-1718-4021-b66d-cc81eb1419aa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:16.108713 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a1540613-0da8-44a4-9c9e-877390a029fa tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f" status: 200 len: 1412 microversion: 2.1 time: 0.134392 Aug 27 05:07:16.122671 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1486/3029] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:15 2022] GET /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f => generated 1412 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:16.132946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7f6ceeef-6473-4839-b445-b6ea14d1bd61 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb569516d30>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:16.200809 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7f6ceeef-6473-4839-b445-b6ea14d1bd61 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f" status: 200 len: 1412 microversion: 2.1 time: 0.076783 Aug 27 05:07:16.201400 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1487/3030] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:16 2022] GET /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:16.218873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1c593ea-4ff4-48f2-bab3-9d40abe860a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5650dcd30>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:16.460007 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1c593ea-4ff4-48f2-bab3-9d40abe860a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f" status: 204 len: 0 microversion: 2.1 time: 0.248142 Aug 27 05:07:16.460700 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1488/3031] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:16 2022] DELETE /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:07:16.468901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-717ff368-403d-403e-baed-58f7eb456818 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb569516670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:16.513230 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-717ff368-403d-403e-baed-58f7eb456818 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Image not found. Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-717ff368-403d-403e-baed-58f7eb456818 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f HTTP/1.1 Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: exception: Image not found. Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '814cf6b8-8d8f-4759-852a-8bb197c1ed8f'} Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 814cf6b8-8d8f-4759-852a-8bb197c1ed8f Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 05:07:16.516118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 814cf6b8-8d8f-4759-852a-8bb197c1ed8f could not be found. Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 05:07:16.521806 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:16.530197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-717ff368-403d-403e-baed-58f7eb456818 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Image not found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:16.532730 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-717ff368-403d-403e-baed-58f7eb456818 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f" status: 404 len: 62 microversion: 2.1 time: 0.066410 Aug 27 05:07:16.538816 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1489/3032] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:16 2022] GET /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 05:07:16.554576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b862d50-8465-496c-bc83-da307427f36e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:16.558799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8b862d50-8465-496c-bc83-da307427f36e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:16.572078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b862d50-8465-496c-bc83-da307427f36e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:16.573265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b862d50-8465-496c-bc83-da307427f36e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:16.574068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b862d50-8465-496c-bc83-da307427f36e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:16.588112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b862d50-8465-496c-bc83-da307427f36e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:16.590603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b862d50-8465-496c-bc83-da307427f36e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:16.591468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b862d50-8465-496c-bc83-da307427f36e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:16.956842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f584eac0-1718-4021-b66d-cc81eb1419aa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:16.973828 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f584eac0-1718-4021-b66d-cc81eb1419aa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1541 microversion: 2.1 time: 0.986756 Aug 27 05:07:16.976054 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1544/3033] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:15 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1541 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:17.005656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ba51c354-3f0e-4e0e-b8ce-d452ddb11b66 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:17.008073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ba51c354-3f0e-4e0e-b8ce-d452ddb11b66 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:17.017139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba51c354-3f0e-4e0e-b8ce-d452ddb11b66 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:17.018152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba51c354-3f0e-4e0e-b8ce-d452ddb11b66 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:17.019452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba51c354-3f0e-4e0e-b8ce-d452ddb11b66 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:17.020563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba51c354-3f0e-4e0e-b8ce-d452ddb11b66 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:17.021418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba51c354-3f0e-4e0e-b8ce-d452ddb11b66 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:17.022051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba51c354-3f0e-4e0e-b8ce-d452ddb11b66 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:17.059015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b862d50-8465-496c-bc83-da307427f36e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:17.095234 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b862d50-8465-496c-bc83-da307427f36e tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1500 microversion: 2.1 time: 0.549711 Aug 27 05:07:17.095926 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1490/3034] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:16 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1500 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:17.122343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:17.123227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:17.142574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:17.143106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:17.143666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:17.144925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:17.145395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:17.145834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:17.266307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ba51c354-3f0e-4e0e-b8ce-d452ddb11b66 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:17.276452 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ba51c354-3f0e-4e0e-b8ce-d452ddb11b66 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.288348 Aug 27 05:07:17.282696 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1545/3035] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:16 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:17.311286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:17.326576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:17.335995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-26cf1a3b-17cd-4efb-b828-ee96f827a1ed req-81eab79a-56bb-4c15-9c2a-ab6589faa09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26820abc-803a-4050-88be-17a76d7164ff", "name": "network-vif-unplugged", "status": "completed", "tag": "2990c3ed-258d-4779-8447-1c23744cef1b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:17.344891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:17.353462 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e7d351be-a5e9-4468-8fcb-6b4a59d27991 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1339 microversion: 2.20 time: 0.253237 Aug 27 05:07:17.354105 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1491/3036] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:17 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1339 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:17.379671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26cf1a3b-17cd-4efb-b828-ee96f827a1ed req-81eab79a-56bb-4c15-9c2a-ab6589faa09e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:17.380363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26cf1a3b-17cd-4efb-b828-ee96f827a1ed req-81eab79a-56bb-4c15-9c2a-ab6589faa09e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:17.381723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26cf1a3b-17cd-4efb-b828-ee96f827a1ed req-81eab79a-56bb-4c15-9c2a-ab6589faa09e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:17.402904 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-26cf1a3b-17cd-4efb-b828-ee96f827a1ed req-81eab79a-56bb-4c15-9c2a-ab6589faa09e service nova] Creating event network-vif-unplugged:2990c3ed-258d-4779-8447-1c23744cef1b for instance 26820abc-803a-4050-88be-17a76d7164ff on n-h1-820368-35 Aug 27 05:07:17.410815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-26cf1a3b-17cd-4efb-b828-ee96f827a1ed req-81eab79a-56bb-4c15-9c2a-ab6589faa09e service nova] Instance 26820abc-803a-4050-88be-17a76d7164ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:07:17.420345 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-26cf1a3b-17cd-4efb-b828-ee96f827a1ed req-81eab79a-56bb-4c15-9c2a-ab6589faa09e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089856 Aug 27 05:07:17.421989 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1546/3037] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:18.001693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6c05a375-bf81-41ea-921e-0670d51c5055 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:18.002504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6c05a375-bf81-41ea-921e-0670d51c5055 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:18.021540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c05a375-bf81-41ea-921e-0670d51c5055 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:18.022303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c05a375-bf81-41ea-921e-0670d51c5055 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:18.022930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c05a375-bf81-41ea-921e-0670d51c5055 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:18.023839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c05a375-bf81-41ea-921e-0670d51c5055 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:18.024505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c05a375-bf81-41ea-921e-0670d51c5055 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:18.025404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c05a375-bf81-41ea-921e-0670d51c5055 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:18.121640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8084a2e-b5a2-4535-97f3-dcdbaf9c6ecb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:18.122357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8084a2e-b5a2-4535-97f3-dcdbaf9c6ecb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:18.139014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8084a2e-b5a2-4535-97f3-dcdbaf9c6ecb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:18.139859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8084a2e-b5a2-4535-97f3-dcdbaf9c6ecb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:18.140612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8084a2e-b5a2-4535-97f3-dcdbaf9c6ecb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:18.141349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8084a2e-b5a2-4535-97f3-dcdbaf9c6ecb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:18.141817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8084a2e-b5a2-4535-97f3-dcdbaf9c6ecb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:18.142259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8084a2e-b5a2-4535-97f3-dcdbaf9c6ecb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:18.338120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6c05a375-bf81-41ea-921e-0670d51c5055 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:18.356620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6c05a375-bf81-41ea-921e-0670d51c5055 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1473 microversion: 2.1 time: 0.360414 Aug 27 05:07:18.370292 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1492/3038] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:17 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1473 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:18.370292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0e7ff614-4879-4bf1-b87d-7b70e4ed5bde tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:18.370292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0e7ff614-4879-4bf1-b87d-7b70e4ed5bde tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:18.388565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e7ff614-4879-4bf1-b87d-7b70e4ed5bde tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:18.390409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e7ff614-4879-4bf1-b87d-7b70e4ed5bde tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:18.392543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e7ff614-4879-4bf1-b87d-7b70e4ed5bde tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:18.394496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e7ff614-4879-4bf1-b87d-7b70e4ed5bde tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:18.395365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e7ff614-4879-4bf1-b87d-7b70e4ed5bde tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:18.396022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e7ff614-4879-4bf1-b87d-7b70e4ed5bde tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:18.548300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8084a2e-b5a2-4535-97f3-dcdbaf9c6ecb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:18.563237 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8084a2e-b5a2-4535-97f3-dcdbaf9c6ecb tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1500 microversion: 2.1 time: 0.446723 Aug 27 05:07:18.564463 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1547/3039] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:18 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1500 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:18.575949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:18.576853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:18.595856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:18.596138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:18.596818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:18.597780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:18.598414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:18.599040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:18.697894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:18.707932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:18.709383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:18.710927 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-239307f9-72fe-44ac-9c84-d5545a8177d6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1339 microversion: 2.20 time: 0.145108 Aug 27 05:07:18.727164 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1548/3040] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:18 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1339 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:18.787763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0e7ff614-4879-4bf1-b87d-7b70e4ed5bde tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:18.805099 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0e7ff614-4879-4bf1-b87d-7b70e4ed5bde tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.446375 Aug 27 05:07:18.811353 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1493/3041] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:18 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:19.383885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-64bac593-6b3f-4282-be63-1442754576e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:19.383885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-64bac593-6b3f-4282-be63-1442754576e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:19.395843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64bac593-6b3f-4282-be63-1442754576e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:19.397531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64bac593-6b3f-4282-be63-1442754576e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:19.399470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64bac593-6b3f-4282-be63-1442754576e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:19.400219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64bac593-6b3f-4282-be63-1442754576e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:19.402900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64bac593-6b3f-4282-be63-1442754576e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:19.405095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64bac593-6b3f-4282-be63-1442754576e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:19.588318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d53c0aad-f116-462f-9545-7786244924a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:19.590025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d53c0aad-f116-462f-9545-7786244924a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:19.603407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d53c0aad-f116-462f-9545-7786244924a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:19.606478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d53c0aad-f116-462f-9545-7786244924a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:19.606932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d53c0aad-f116-462f-9545-7786244924a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:19.607755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d53c0aad-f116-462f-9545-7786244924a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:19.608219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d53c0aad-f116-462f-9545-7786244924a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:19.608658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d53c0aad-f116-462f-9545-7786244924a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:19.698232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-64bac593-6b3f-4282-be63-1442754576e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:19.710425 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-64bac593-6b3f-4282-be63-1442754576e3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1473 microversion: 2.1 time: 0.336143 Aug 27 05:07:19.711052 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1549/3042] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:19 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:19.739667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:19.740338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:19.746687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:19.747228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:19.747680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:19.748397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:19.749610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:19.750244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:19.832842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:19.853689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:19.866811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:19.870112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:19.871571 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2e761b8f-98c9-48b9-a83e-24e8bf599115 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1339 microversion: 2.20 time: 0.140453 Aug 27 05:07:19.894700 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1550/3043] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:19 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1339 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:19.903937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d53c0aad-f116-462f-9545-7786244924a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:19.915423 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d53c0aad-f116-462f-9545-7786244924a8 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1506 microversion: 2.1 time: 0.330924 Aug 27 05:07:19.916291 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1494/3044] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:19 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:19.938331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-df899e55-bdf5-417f-a436-3fa5d882ec05 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:19.939048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-df899e55-bdf5-417f-a436-3fa5d882ec05 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:19.946884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df899e55-bdf5-417f-a436-3fa5d882ec05 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:19.947778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df899e55-bdf5-417f-a436-3fa5d882ec05 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:19.948381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df899e55-bdf5-417f-a436-3fa5d882ec05 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:19.949084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df899e55-bdf5-417f-a436-3fa5d882ec05 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:19.949714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df899e55-bdf5-417f-a436-3fa5d882ec05 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:19.950371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df899e55-bdf5-417f-a436-3fa5d882ec05 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:20.145300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-df899e55-bdf5-417f-a436-3fa5d882ec05 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:20.155335 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-df899e55-bdf5-417f-a436-3fa5d882ec05 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.255193 Aug 27 05:07:20.155946 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1551/3045] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:19 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:20.734847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c37118f2-3cd1-4347-ba6a-bbfccd8c223c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:20.736286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c37118f2-3cd1-4347-ba6a-bbfccd8c223c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:20.748450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c37118f2-3cd1-4347-ba6a-bbfccd8c223c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:20.749530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c37118f2-3cd1-4347-ba6a-bbfccd8c223c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:20.750488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c37118f2-3cd1-4347-ba6a-bbfccd8c223c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:20.751472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c37118f2-3cd1-4347-ba6a-bbfccd8c223c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:20.752421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c37118f2-3cd1-4347-ba6a-bbfccd8c223c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:20.753760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c37118f2-3cd1-4347-ba6a-bbfccd8c223c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:20.901288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:20.902862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:20.921994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:20.924368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:20.929854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:20.933630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:20.935477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:20.935934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.067358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c37118f2-3cd1-4347-ba6a-bbfccd8c223c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:21.083757 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c37118f2-3cd1-4347-ba6a-bbfccd8c223c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1470 microversion: 2.1 time: 0.347858 Aug 27 05:07:21.084421 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1495/3046] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:20 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:21.096137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a3ea4308-e831-4047-9703-16d4363684de tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:21.096137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a3ea4308-e831-4047-9703-16d4363684de tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:21.112971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ea4308-e831-4047-9703-16d4363684de tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.113477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ea4308-e831-4047-9703-16d4363684de tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.113946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ea4308-e831-4047-9703-16d4363684de tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.114645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ea4308-e831-4047-9703-16d4363684de tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.115121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ea4308-e831-4047-9703-16d4363684de tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.115556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3ea4308-e831-4047-9703-16d4363684de tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.133866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:21.158179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:21.171281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:21.176950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:21.193060 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1b473772-d6fb-4941-a901-973188e7f08a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1337 microversion: 2.20 time: 0.284549 Aug 27 05:07:21.195400 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1552/3047] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:20 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1337 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:07:21.207379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:21.211012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:21.224668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.226342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.228255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.229636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.230519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.232237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.292955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:21.374664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.375878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.376612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.378605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a3ea4308-e831-4047-9703-16d4363684de tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:21.379370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.380207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.380862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.389854 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a3ea4308-e831-4047-9703-16d4363684de tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1506 microversion: 2.1 time: 0.299550 Aug 27 05:07:21.390471 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1496/3048] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:21 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:21.409229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-56a179fe-3dac-498c-bc25-64a8c1baeb14 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:21.410096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-56a179fe-3dac-498c-bc25-64a8c1baeb14 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:21.412055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:21.429654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:21.432881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'cores', 'ram'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:07:21.440941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56a179fe-3dac-498c-bc25-64a8c1baeb14 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.442109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56a179fe-3dac-498c-bc25-64a8c1baeb14 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.442436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56a179fe-3dac-498c-bc25-64a8c1baeb14 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.443209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56a179fe-3dac-498c-bc25-64a8c1baeb14 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.443675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56a179fe-3dac-498c-bc25-64a8c1baeb14 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.444105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56a179fe-3dac-498c-bc25-64a8c1baeb14 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.451724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for user 58b3a6b755ba4d5f89899d3122ddc29d and project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'cores', 'ram'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:07:21.740554 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-11b71411-6f6c-4571-9718-57800567ff87 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "POST /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff/action" status: 202 len: 0 microversion: 2.1 time: 0.541480 Aug 27 05:07:21.747936 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1553/3049] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:07:21 2022] POST /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:07:21.769656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-260257e8-8166-4507-8e3e-e49c69a93836 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:21.775893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-260257e8-8166-4507-8e3e-e49c69a93836 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:21.779466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-56a179fe-3dac-498c-bc25-64a8c1baeb14 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:21.790317 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-56a179fe-3dac-498c-bc25-64a8c1baeb14 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.398792 Aug 27 05:07:21.791371 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1497/3050] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:21 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:21.797560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260257e8-8166-4507-8e3e-e49c69a93836 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.798362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260257e8-8166-4507-8e3e-e49c69a93836 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.799016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260257e8-8166-4507-8e3e-e49c69a93836 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.800851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260257e8-8166-4507-8e3e-e49c69a93836 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.801598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260257e8-8166-4507-8e3e-e49c69a93836 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.802202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260257e8-8166-4507-8e3e-e49c69a93836 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:22.107275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-260257e8-8166-4507-8e3e-e49c69a93836 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:22.122962 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-260257e8-8166-4507-8e3e-e49c69a93836 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1469 microversion: 2.1 time: 0.363580 Aug 27 05:07:22.124159 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1554/3051] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:21 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:22.220388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:22.221006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:22.230756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:22.231373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:22.239418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:22.239537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:22.240008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:22.252248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:22.413525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4c42214d-cbd8-4b35-9ca2-4be921e0a223 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:22.414142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4c42214d-cbd8-4b35-9ca2-4be921e0a223 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:22.425263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c42214d-cbd8-4b35-9ca2-4be921e0a223 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:22.426374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c42214d-cbd8-4b35-9ca2-4be921e0a223 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:22.428539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c42214d-cbd8-4b35-9ca2-4be921e0a223 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:22.429500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c42214d-cbd8-4b35-9ca2-4be921e0a223 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:22.430194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c42214d-cbd8-4b35-9ca2-4be921e0a223 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:22.432045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c42214d-cbd8-4b35-9ca2-4be921e0a223 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:22.495227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:22.516343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:22.518148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:22.520099 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7dfa4968-34dd-472f-8657-4a47d12510a4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1405 microversion: 2.20 time: 0.303725 Aug 27 05:07:22.520887 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1498/3052] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:22 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:22.602896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f1e31b24-7b34-4bb4-b2a3-9455a1dce920 req-bbb040d2-53f5-447a-a4b3-0dc0b053a367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e226f8ab-6c0c-4500-b810-80bb36601f5b", "name": "network-vif-plugged", "status": "completed", "tag": "7bb87706-af92-4d10-8319-3f035621da01"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:22.618720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f1e31b24-7b34-4bb4-b2a3-9455a1dce920 req-bbb040d2-53f5-447a-a4b3-0dc0b053a367 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:22.619545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f1e31b24-7b34-4bb4-b2a3-9455a1dce920 req-bbb040d2-53f5-447a-a4b3-0dc0b053a367 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:22.620146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f1e31b24-7b34-4bb4-b2a3-9455a1dce920 req-bbb040d2-53f5-447a-a4b3-0dc0b053a367 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:22.640420 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f1e31b24-7b34-4bb4-b2a3-9455a1dce920 req-bbb040d2-53f5-447a-a4b3-0dc0b053a367 service nova] Creating event network-vif-plugged:7bb87706-af92-4d10-8319-3f035621da01 for instance e226f8ab-6c0c-4500-b810-80bb36601f5b on n-h2-820368-35 Aug 27 05:07:22.648013 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f1e31b24-7b34-4bb4-b2a3-9455a1dce920 req-bbb040d2-53f5-447a-a4b3-0dc0b053a367 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049668 Aug 27 05:07:22.649088 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1499/3053] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:07:22.701021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4c42214d-cbd8-4b35-9ca2-4be921e0a223 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:22.716692 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4c42214d-cbd8-4b35-9ca2-4be921e0a223 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1506 microversion: 2.1 time: 0.308303 Aug 27 05:07:22.717422 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1555/3054] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:22 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:22.818634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9c4bc57f-1cd9-45f1-b705-87a91a4ef85f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:22.820100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9c4bc57f-1cd9-45f1-b705-87a91a4ef85f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:22.831658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c4bc57f-1cd9-45f1-b705-87a91a4ef85f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:22.832441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c4bc57f-1cd9-45f1-b705-87a91a4ef85f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:22.833093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c4bc57f-1cd9-45f1-b705-87a91a4ef85f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:22.834267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c4bc57f-1cd9-45f1-b705-87a91a4ef85f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:22.835027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c4bc57f-1cd9-45f1-b705-87a91a4ef85f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:22.836618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c4bc57f-1cd9-45f1-b705-87a91a4ef85f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:23.120534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9c4bc57f-1cd9-45f1-b705-87a91a4ef85f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:23.130269 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9c4bc57f-1cd9-45f1-b705-87a91a4ef85f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.317817 Aug 27 05:07:23.130864 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1500/3055] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:22 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:23.150141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ef5bc3d4-130b-48b7-ba3c-ae850a714306 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:23.151838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ef5bc3d4-130b-48b7-ba3c-ae850a714306 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:23.160750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef5bc3d4-130b-48b7-ba3c-ae850a714306 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:23.161944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef5bc3d4-130b-48b7-ba3c-ae850a714306 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:23.162590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef5bc3d4-130b-48b7-ba3c-ae850a714306 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:23.164235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef5bc3d4-130b-48b7-ba3c-ae850a714306 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:23.164870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef5bc3d4-130b-48b7-ba3c-ae850a714306 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:23.165868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef5bc3d4-130b-48b7-ba3c-ae850a714306 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:23.356586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ef5bc3d4-130b-48b7-ba3c-ae850a714306 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:23.365489 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ef5bc3d4-130b-48b7-ba3c-ae850a714306 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1469 microversion: 2.1 time: 0.221066 Aug 27 05:07:23.366095 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1556/3056] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:23 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1469 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:23.553259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:23.554889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:23.563838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:23.565023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:23.566155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:23.567139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:23.571158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:23.577324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:23.729298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:23.739233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-53e97906-6ecd-4e06-b83b-5bf340a41f52 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:23.740163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-53e97906-6ecd-4e06-b83b-5bf340a41f52 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:23.740596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:23.742222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:23.743675 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-80231108-a449-4f69-953f-4b1774625080 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1405 microversion: 2.20 time: 0.201752 Aug 27 05:07:23.756533 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1501/3057] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:23 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:23.763494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53e97906-6ecd-4e06-b83b-5bf340a41f52 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:23.764479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53e97906-6ecd-4e06-b83b-5bf340a41f52 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:23.767849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53e97906-6ecd-4e06-b83b-5bf340a41f52 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:23.771716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53e97906-6ecd-4e06-b83b-5bf340a41f52 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:23.772296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53e97906-6ecd-4e06-b83b-5bf340a41f52 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:23.772837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53e97906-6ecd-4e06-b83b-5bf340a41f52 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:23.934215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-189c5f07-cc47-476d-8d77-173af00f531a req-959a2ccb-25f4-4718-8301-369aa8704848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcbd54c-7e88-44d7-ad7b-be669acb1c7c", "tag": "e1cc65c6-b976-41c9-a889-d9270df2c63d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:23.953987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-53e97906-6ecd-4e06-b83b-5bf340a41f52 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:23.963742 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-53e97906-6ecd-4e06-b83b-5bf340a41f52 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1506 microversion: 2.1 time: 0.229304 Aug 27 05:07:23.964341 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1557/3058] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:23 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:23.968697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-189c5f07-cc47-476d-8d77-173af00f531a req-959a2ccb-25f4-4718-8301-369aa8704848 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:23.969182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-189c5f07-cc47-476d-8d77-173af00f531a req-959a2ccb-25f4-4718-8301-369aa8704848 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:23.969815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-189c5f07-cc47-476d-8d77-173af00f531a req-959a2ccb-25f4-4718-8301-369aa8704848 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:23.986061 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-189c5f07-cc47-476d-8d77-173af00f531a req-959a2ccb-25f4-4718-8301-369aa8704848 service nova] Creating event network-changed:e1cc65c6-b976-41c9-a889-d9270df2c63d for instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c on n-h1-820368-35 Aug 27 05:07:23.992035 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-189c5f07-cc47-476d-8d77-173af00f531a req-959a2ccb-25f4-4718-8301-369aa8704848 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063184 Aug 27 05:07:23.992926 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1502/3059] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:07:24.153076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-157ac41c-5e47-4fe7-bc2d-2177f4d41296 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:24.153823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-157ac41c-5e47-4fe7-bc2d-2177f4d41296 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:24.162477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-157ac41c-5e47-4fe7-bc2d-2177f4d41296 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.162977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-157ac41c-5e47-4fe7-bc2d-2177f4d41296 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.163833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-157ac41c-5e47-4fe7-bc2d-2177f4d41296 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.164747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-157ac41c-5e47-4fe7-bc2d-2177f4d41296 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.165460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-157ac41c-5e47-4fe7-bc2d-2177f4d41296 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.166065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-157ac41c-5e47-4fe7-bc2d-2177f4d41296 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.324328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-157ac41c-5e47-4fe7-bc2d-2177f4d41296 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:24.334272 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-157ac41c-5e47-4fe7-bc2d-2177f4d41296 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.185774 Aug 27 05:07:24.335202 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1558/3060] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:24 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:24.388750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-603e0ae4-cabe-4836-8a9f-9a75b157f5fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:24.389463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-603e0ae4-cabe-4836-8a9f-9a75b157f5fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:24.396162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-603e0ae4-cabe-4836-8a9f-9a75b157f5fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.396657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-603e0ae4-cabe-4836-8a9f-9a75b157f5fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.397099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-603e0ae4-cabe-4836-8a9f-9a75b157f5fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.397814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-603e0ae4-cabe-4836-8a9f-9a75b157f5fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.398276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-603e0ae4-cabe-4836-8a9f-9a75b157f5fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.398860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-603e0ae4-cabe-4836-8a9f-9a75b157f5fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.563421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-603e0ae4-cabe-4836-8a9f-9a75b157f5fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:24.571596 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-603e0ae4-cabe-4836-8a9f-9a75b157f5fb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1469 microversion: 2.1 time: 0.187361 Aug 27 05:07:24.573284 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1503/3061] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:24 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:24.682919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-2aeb55f1-4da6-4d3a-93b5-7f360c9982ff req-0d6ce0fc-5b07-45bd-9cd3-5176a91f5f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26820abc-803a-4050-88be-17a76d7164ff", "name": "network-vif-plugged", "status": "completed", "tag": "2990c3ed-258d-4779-8447-1c23744cef1b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:24.693713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:24.703612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2aeb55f1-4da6-4d3a-93b5-7f360c9982ff req-0d6ce0fc-5b07-45bd-9cd3-5176a91f5f28 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.704528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2aeb55f1-4da6-4d3a-93b5-7f360c9982ff req-0d6ce0fc-5b07-45bd-9cd3-5176a91f5f28 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.705202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2aeb55f1-4da6-4d3a-93b5-7f360c9982ff req-0d6ce0fc-5b07-45bd-9cd3-5176a91f5f28 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.721102 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-2aeb55f1-4da6-4d3a-93b5-7f360c9982ff req-0d6ce0fc-5b07-45bd-9cd3-5176a91f5f28 service nova] Creating event network-vif-plugged:2990c3ed-258d-4779-8447-1c23744cef1b for instance 26820abc-803a-4050-88be-17a76d7164ff on n-h1-820368-35 Aug 27 05:07:24.731739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-2aeb55f1-4da6-4d3a-93b5-7f360c9982ff req-0d6ce0fc-5b07-45bd-9cd3-5176a91f5f28 service nova] Instance 26820abc-803a-4050-88be-17a76d7164ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:07:24.740656 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-2aeb55f1-4da6-4d3a-93b5-7f360c9982ff req-0d6ce0fc-5b07-45bd-9cd3-5176a91f5f28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060989 Aug 27 05:07:24.741670 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1559/3062] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:24.768886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:24.770088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:24.776555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.777356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.778034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.778817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.779541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.780215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.950503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:24.959571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:24.961805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:24.963313 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-71e1217f-21b1-4523-8bfb-08a54f6ce0db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1405 microversion: 2.20 time: 0.198852 Aug 27 05:07:24.964123 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1504/3063] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:24 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:24.992486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-68f84370-e232-4de0-b796-84447490c0a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:24.998333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68f84370-e232-4de0-b796-84447490c0a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:25.011470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68f84370-e232-4de0-b796-84447490c0a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:25.012332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68f84370-e232-4de0-b796-84447490c0a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:25.012998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68f84370-e232-4de0-b796-84447490c0a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:25.013899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68f84370-e232-4de0-b796-84447490c0a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:25.014533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68f84370-e232-4de0-b796-84447490c0a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:25.015142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68f84370-e232-4de0-b796-84447490c0a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:25.240176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-68f84370-e232-4de0-b796-84447490c0a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:25.250769 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-68f84370-e232-4de0-b796-84447490c0a5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1506 microversion: 2.1 time: 0.263333 Aug 27 05:07:25.251412 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1560/3064] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:24 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:25.359857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22b7e85f-3885-435c-83c2-601486d7e1ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:25.360895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22b7e85f-3885-435c-83c2-601486d7e1ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:25.370876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22b7e85f-3885-435c-83c2-601486d7e1ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:25.371780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22b7e85f-3885-435c-83c2-601486d7e1ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:25.372586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22b7e85f-3885-435c-83c2-601486d7e1ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:25.373610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22b7e85f-3885-435c-83c2-601486d7e1ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:25.374277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22b7e85f-3885-435c-83c2-601486d7e1ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:25.374908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22b7e85f-3885-435c-83c2-601486d7e1ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:25.560652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-22b7e85f-3885-435c-83c2-601486d7e1ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:25.573229 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22b7e85f-3885-435c-83c2-601486d7e1ed tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.217280 Aug 27 05:07:25.574343 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1505/3065] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:25 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:25.597549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-260dd0a9-f5ab-44c9-bf45-aca3aa6f41b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:25.598180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-260dd0a9-f5ab-44c9-bf45-aca3aa6f41b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:25.608509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260dd0a9-f5ab-44c9-bf45-aca3aa6f41b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:25.611691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260dd0a9-f5ab-44c9-bf45-aca3aa6f41b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:25.617354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260dd0a9-f5ab-44c9-bf45-aca3aa6f41b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:25.620536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260dd0a9-f5ab-44c9-bf45-aca3aa6f41b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:25.623711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260dd0a9-f5ab-44c9-bf45-aca3aa6f41b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:25.624525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-260dd0a9-f5ab-44c9-bf45-aca3aa6f41b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:25.876441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-260dd0a9-f5ab-44c9-bf45-aca3aa6f41b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:25.887732 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-260dd0a9-f5ab-44c9-bf45-aca3aa6f41b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1469 microversion: 2.1 time: 0.296856 Aug 27 05:07:25.890659 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1561/3066] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:25 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1469 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:25.988187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:25.988991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:26.010733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.011992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.012530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.013371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.013913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.014412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.231235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:26.244515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:26.246214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:26.247486 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-349bbce9-ca64-4618-a13b-767c31ad9b88 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1405 microversion: 2.20 time: 0.265305 Aug 27 05:07:26.248318 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1506/3067] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:25 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:26.279839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8adcdee7-3178-48a9-8145-69ed720445e0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:26.281018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8adcdee7-3178-48a9-8145-69ed720445e0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:26.290234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adcdee7-3178-48a9-8145-69ed720445e0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.291029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adcdee7-3178-48a9-8145-69ed720445e0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.293186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adcdee7-3178-48a9-8145-69ed720445e0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.296280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adcdee7-3178-48a9-8145-69ed720445e0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.298335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adcdee7-3178-48a9-8145-69ed720445e0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.300434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adcdee7-3178-48a9-8145-69ed720445e0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.535865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8adcdee7-3178-48a9-8145-69ed720445e0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:26.547565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8adcdee7-3178-48a9-8145-69ed720445e0 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1488 microversion: 2.1 time: 0.276872 Aug 27 05:07:26.552114 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1562/3068] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:26 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1488 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:26.571671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8de0d61-b2d7-4e1a-bf7b-2ec793ba1c27 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:26.572162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e8de0d61-b2d7-4e1a-bf7b-2ec793ba1c27 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:26.585175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8de0d61-b2d7-4e1a-bf7b-2ec793ba1c27 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.587756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8de0d61-b2d7-4e1a-bf7b-2ec793ba1c27 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.591457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8de0d61-b2d7-4e1a-bf7b-2ec793ba1c27 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.591457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8de0d61-b2d7-4e1a-bf7b-2ec793ba1c27 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.591457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8de0d61-b2d7-4e1a-bf7b-2ec793ba1c27 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.591457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8de0d61-b2d7-4e1a-bf7b-2ec793ba1c27 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.599227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7efb33f5-8614-442a-ad85-6c427911adb6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:26.600706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7efb33f5-8614-442a-ad85-6c427911adb6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:26.607689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7efb33f5-8614-442a-ad85-6c427911adb6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.608487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7efb33f5-8614-442a-ad85-6c427911adb6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.609196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7efb33f5-8614-442a-ad85-6c427911adb6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.610227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7efb33f5-8614-442a-ad85-6c427911adb6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.611078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7efb33f5-8614-442a-ad85-6c427911adb6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.612193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7efb33f5-8614-442a-ad85-6c427911adb6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.660359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e8de0d61-b2d7-4e1a-bf7b-2ec793ba1c27 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:07:26.854073 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e8de0d61-b2d7-4e1a-bf7b-2ec793ba1c27 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 204 len: 0 microversion: 2.1 time: 0.285975 Aug 27 05:07:26.855331 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1507/3069] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:07:26 2022] DELETE /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:07:26.869345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-514235af-83fb-48a8-bd64-7ccfc0a05888 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb56509f3a0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:26.918188 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-514235af-83fb-48a8-bd64-7ccfc0a05888 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Image not found. Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-514235af-83fb-48a8-bd64-7ccfc0a05888 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f HTTP/1.1 Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: exception: Image not found. Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '814cf6b8-8d8f-4759-852a-8bb197c1ed8f'} Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 814cf6b8-8d8f-4759-852a-8bb197c1ed8f to delete Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 814cf6b8-8d8f-4759-852a-8bb197c1ed8f could not be found. Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:26.920322 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 05:07:26.925934 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:26.929262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-514235af-83fb-48a8-bd64-7ccfc0a05888 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Image not found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:26.930316 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-514235af-83fb-48a8-bd64-7ccfc0a05888 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f" status: 404 len: 62 microversion: 2.1 time: 0.065871 Aug 27 05:07:26.931391 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1508/3070] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:26 2022] DELETE /compute/v2.1/images/814cf6b8-8d8f-4759-852a-8bb197c1ed8f => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:07:26.939212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-698bdc93-cdd8-4b3d-bf7a-e4f6af62b9fd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:26.940893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-698bdc93-cdd8-4b3d-bf7a-e4f6af62b9fd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:26.959677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-698bdc93-cdd8-4b3d-bf7a-e4f6af62b9fd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.960260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-698bdc93-cdd8-4b3d-bf7a-e4f6af62b9fd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.960773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-698bdc93-cdd8-4b3d-bf7a-e4f6af62b9fd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.961554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-698bdc93-cdd8-4b3d-bf7a-e4f6af62b9fd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.963691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-698bdc93-cdd8-4b3d-bf7a-e4f6af62b9fd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.964398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-698bdc93-cdd8-4b3d-bf7a-e4f6af62b9fd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:27.027537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7efb33f5-8614-442a-ad85-6c427911adb6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:27.039672 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7efb33f5-8614-442a-ad85-6c427911adb6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.445625 Aug 27 05:07:27.051626 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1563/3071] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:26 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:27.057064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-39852819-b156-436e-9c08-541c307b7209 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:27.059865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-39852819-b156-436e-9c08-541c307b7209 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:27.074273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39852819-b156-436e-9c08-541c307b7209 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:27.080573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39852819-b156-436e-9c08-541c307b7209 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:27.081898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39852819-b156-436e-9c08-541c307b7209 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:27.082833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39852819-b156-436e-9c08-541c307b7209 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:27.083507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39852819-b156-436e-9c08-541c307b7209 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:27.086217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39852819-b156-436e-9c08-541c307b7209 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:27.175486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-39852819-b156-436e-9c08-541c307b7209 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:07:27.302724 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.compute.api [None req-39852819-b156-436e-9c08-541c307b7209 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Instance is already in deleting state, ignoring this request Aug 27 05:07:27.304815 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-39852819-b156-436e-9c08-541c307b7209 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 204 len: 0 microversion: 2.1 time: 0.251942 Aug 27 05:07:27.305705 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1564/3072] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:07:27 2022] DELETE /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:07:27.313368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:27.314225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:27.322141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:27.322857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:27.323569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:27.324552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:27.325277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:27.326017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:27.463981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-698bdc93-cdd8-4b3d-bf7a-e4f6af62b9fd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:27.480157 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-698bdc93-cdd8-4b3d-bf7a-e4f6af62b9fd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1535 microversion: 2.1 time: 0.547085 Aug 27 05:07:27.481010 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1509/3073] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:26 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1535 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:27.485778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d23b8869-3d70-4d64-b692-e61e01c2ff2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:27.486604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d23b8869-3d70-4d64-b692-e61e01c2ff2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:27.500401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d23b8869-3d70-4d64-b692-e61e01c2ff2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:27.501151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d23b8869-3d70-4d64-b692-e61e01c2ff2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:27.501765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d23b8869-3d70-4d64-b692-e61e01c2ff2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:27.505306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d23b8869-3d70-4d64-b692-e61e01c2ff2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:27.506146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d23b8869-3d70-4d64-b692-e61e01c2ff2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:27.506805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d23b8869-3d70-4d64-b692-e61e01c2ff2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:27.771788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:27.792850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:27.797601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:27.799895 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-435dc134-963b-4b5b-b32a-e9de75112ab1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1405 microversion: 2.20 time: 0.492018 Aug 27 05:07:27.802052 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1565/3074] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:27 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1405 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:27.883154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d23b8869-3d70-4d64-b692-e61e01c2ff2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:27.904838 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d23b8869-3d70-4d64-b692-e61e01c2ff2d tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1494 microversion: 2.1 time: 0.421609 Aug 27 05:07:27.922349 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1510/3075] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:27 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1494 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:28.069595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1153dc6a-aba4-4971-a49f-7aa8cbd48ac7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:28.070527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1153dc6a-aba4-4971-a49f-7aa8cbd48ac7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:28.076902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1153dc6a-aba4-4971-a49f-7aa8cbd48ac7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:28.077655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1153dc6a-aba4-4971-a49f-7aa8cbd48ac7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:28.078270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1153dc6a-aba4-4971-a49f-7aa8cbd48ac7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:28.079182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1153dc6a-aba4-4971-a49f-7aa8cbd48ac7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:28.079823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1153dc6a-aba4-4971-a49f-7aa8cbd48ac7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:28.080264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1153dc6a-aba4-4971-a49f-7aa8cbd48ac7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:28.084939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:28.333640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1153dc6a-aba4-4971-a49f-7aa8cbd48ac7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:28.341819 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1153dc6a-aba4-4971-a49f-7aa8cbd48ac7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.276617 Aug 27 05:07:28.355421 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1566/3076] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:28 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:28.479235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c190aed7-289e-43a4-8593-27ebc4f7b65d req-42df1e76-3703-4e4b-bae4-15aa1e139c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e226f8ab-6c0c-4500-b810-80bb36601f5b", "name": "network-vif-unplugged", "status": "completed", "tag": "7bb87706-af92-4d10-8319-3f035621da01"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:28.495478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c190aed7-289e-43a4-8593-27ebc4f7b65d req-42df1e76-3703-4e4b-bae4-15aa1e139c6c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:28.496171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c190aed7-289e-43a4-8593-27ebc4f7b65d req-42df1e76-3703-4e4b-bae4-15aa1e139c6c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:28.496605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c190aed7-289e-43a4-8593-27ebc4f7b65d req-42df1e76-3703-4e4b-bae4-15aa1e139c6c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:28.505134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b61b93e9-6b4b-4e77-80b6-fd3e7fc5c38c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:28.506286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b61b93e9-6b4b-4e77-80b6-fd3e7fc5c38c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:28.511261 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c190aed7-289e-43a4-8593-27ebc4f7b65d req-42df1e76-3703-4e4b-bae4-15aa1e139c6c service nova] Creating event network-vif-unplugged:7bb87706-af92-4d10-8319-3f035621da01 for instance e226f8ab-6c0c-4500-b810-80bb36601f5b on n-h2-820368-35 Aug 27 05:07:28.516754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b61b93e9-6b4b-4e77-80b6-fd3e7fc5c38c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:28.517800 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c190aed7-289e-43a4-8593-27ebc4f7b65d req-42df1e76-3703-4e4b-bae4-15aa1e139c6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048831 Aug 27 05:07:28.519656 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1511/3077] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:28.526381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b61b93e9-6b4b-4e77-80b6-fd3e7fc5c38c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:28.527117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b61b93e9-6b4b-4e77-80b6-fd3e7fc5c38c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:28.528171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b61b93e9-6b4b-4e77-80b6-fd3e7fc5c38c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:28.528920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b61b93e9-6b4b-4e77-80b6-fd3e7fc5c38c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:28.529707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b61b93e9-6b4b-4e77-80b6-fd3e7fc5c38c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:28.837447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:28.838167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:28.850356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:28.850869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:28.851342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:28.852064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:28.852522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:28.852955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.051174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b61b93e9-6b4b-4e77-80b6-fd3e7fc5c38c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:29.072015 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b61b93e9-6b4b-4e77-80b6-fd3e7fc5c38c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1535 microversion: 2.1 time: 0.572765 Aug 27 05:07:29.073019 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1567/3078] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:28 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1535 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:29.078180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-acf87bcf-f669-45b6-89c8-93bdf9f80ae5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:29.079111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-acf87bcf-f669-45b6-89c8-93bdf9f80ae5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:29.088523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acf87bcf-f669-45b6-89c8-93bdf9f80ae5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:29.089959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acf87bcf-f669-45b6-89c8-93bdf9f80ae5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:29.091583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acf87bcf-f669-45b6-89c8-93bdf9f80ae5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.092950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acf87bcf-f669-45b6-89c8-93bdf9f80ae5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:29.103230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acf87bcf-f669-45b6-89c8-93bdf9f80ae5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:29.104024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acf87bcf-f669-45b6-89c8-93bdf9f80ae5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.241692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:29.261333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:29.267558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:29.274638 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-46bc89c9-15af-4d22-b7cf-fd163a78c83d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1405 microversion: 2.20 time: 0.446777 Aug 27 05:07:29.285911 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1512/3079] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:28 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:29.364923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6914bcc9-cfee-42d2-bd06-05aeefd58852 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:29.365775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6914bcc9-cfee-42d2-bd06-05aeefd58852 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:29.378570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6914bcc9-cfee-42d2-bd06-05aeefd58852 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:29.379576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6914bcc9-cfee-42d2-bd06-05aeefd58852 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:29.380266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6914bcc9-cfee-42d2-bd06-05aeefd58852 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.383531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6914bcc9-cfee-42d2-bd06-05aeefd58852 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:29.384020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6914bcc9-cfee-42d2-bd06-05aeefd58852 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:29.384508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6914bcc9-cfee-42d2-bd06-05aeefd58852 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.416433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-acf87bcf-f669-45b6-89c8-93bdf9f80ae5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:29.428292 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-acf87bcf-f669-45b6-89c8-93bdf9f80ae5 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1494 microversion: 2.1 time: 0.353472 Aug 27 05:07:29.429913 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1568/3080] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:29 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1494 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:29.799449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6914bcc9-cfee-42d2-bd06-05aeefd58852 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:29.810250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1fb6d547-9b9e-4f72-876e-080136c25593 req-dcc00b25-60fc-42f9-a1ff-08157c3ec8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e226f8ab-6c0c-4500-b810-80bb36601f5b", "name": "network-vif-deleted", "tag": "7bb87706-af92-4d10-8319-3f035621da01"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:29.833780 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6914bcc9-cfee-42d2-bd06-05aeefd58852 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.467616 Aug 27 05:07:29.848506 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1513/3081] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:29 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:29.875782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1fb6d547-9b9e-4f72-876e-080136c25593 req-dcc00b25-60fc-42f9-a1ff-08157c3ec8e3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:29.876630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1fb6d547-9b9e-4f72-876e-080136c25593 req-dcc00b25-60fc-42f9-a1ff-08157c3ec8e3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:29.878038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1fb6d547-9b9e-4f72-876e-080136c25593 req-dcc00b25-60fc-42f9-a1ff-08157c3ec8e3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.917530 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1fb6d547-9b9e-4f72-876e-080136c25593 req-dcc00b25-60fc-42f9-a1ff-08157c3ec8e3 service nova] Creating event network-vif-deleted:7bb87706-af92-4d10-8319-3f035621da01 for instance e226f8ab-6c0c-4500-b810-80bb36601f5b on n-h2-820368-35 Aug 27 05:07:29.933557 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1fb6d547-9b9e-4f72-876e-080136c25593 req-dcc00b25-60fc-42f9-a1ff-08157c3ec8e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154987 Aug 27 05:07:29.934601 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1569/3082] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:30.096695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-619b6d4b-3b10-4910-a93a-fe27ce7878e8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:30.097734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-619b6d4b-3b10-4910-a93a-fe27ce7878e8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:30.114164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-619b6d4b-3b10-4910-a93a-fe27ce7878e8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.118623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-619b6d4b-3b10-4910-a93a-fe27ce7878e8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.120676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-619b6d4b-3b10-4910-a93a-fe27ce7878e8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.131537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-619b6d4b-3b10-4910-a93a-fe27ce7878e8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.132192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-619b6d4b-3b10-4910-a93a-fe27ce7878e8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.133292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-619b6d4b-3b10-4910-a93a-fe27ce7878e8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.139240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:30.307650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:30.308553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:30.332424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.339878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.341006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.341978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.342717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.345435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.353494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-619b6d4b-3b10-4910-a93a-fe27ce7878e8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:30.364070 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-619b6d4b-3b10-4910-a93a-fe27ce7878e8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1535 microversion: 2.1 time: 0.273105 Aug 27 05:07:30.377561 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1514/3083] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:30 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1535 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:30.450669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:30.451766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:30.461610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.464983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.465439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.466180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.466644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.467074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.530258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.531070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.532243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.532824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lazy-loading 'fault' on Instance uuid e226f8ab-6c0c-4500-b810-80bb36601f5b {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:07:30.597767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979e8da1534344fcb5a2be09631ea09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fa2042dc6a457fa50dcbf75e3a32ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:30.605950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:30.607172 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14c06494-e58c-466c-9bb2-d79469ab5d79 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 200 len: 1297 microversion: 2.1 time: 0.160389 Aug 27 05:07:30.608844 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1515/3084] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:30 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 1297 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:30.625626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:30.637685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:30.640701 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-341cadcc-9d84-4668-a42e-18a05116b503 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1405 microversion: 2.20 time: 0.343550 Aug 27 05:07:30.644228 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1570/3085] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:30 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1405 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:30.804572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1321650398", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "f18aa970-b686-41d4-aaff-8dbf2342f93b"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:30.869195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ea3b6236-e04f-4ded-82bf-244ee7388ee0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:30.869760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] validate_networks() for [('f18aa970-b686-41d4-aaff-8dbf2342f93b', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:07:30.869903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ea3b6236-e04f-4ded-82bf-244ee7388ee0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:30.876603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea3b6236-e04f-4ded-82bf-244ee7388ee0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.877353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea3b6236-e04f-4ded-82bf-244ee7388ee0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.878556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea3b6236-e04f-4ded-82bf-244ee7388ee0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.879478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea3b6236-e04f-4ded-82bf-244ee7388ee0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.880103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea3b6236-e04f-4ded-82bf-244ee7388ee0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.880701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea3b6236-e04f-4ded-82bf-244ee7388ee0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.084272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ea3b6236-e04f-4ded-82bf-244ee7388ee0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:31.092224 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ea3b6236-e04f-4ded-82bf-244ee7388ee0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.226963 Aug 27 05:07:31.108142 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1571/3086] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:30 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:31.354659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:07:31.355389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:07:31.356848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:07:31.357468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:07:31.358219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:07:31.372775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.373384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.373910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.374732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.375471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.376506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.386113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-44d10646-cce9-4d97-b36f-6fc91c458205 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:31.387025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-44d10646-cce9-4d97-b36f-6fc91c458205 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:31.394840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44d10646-cce9-4d97-b36f-6fc91c458205 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.396901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44d10646-cce9-4d97-b36f-6fc91c458205 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.397574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44d10646-cce9-4d97-b36f-6fc91c458205 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.398821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44d10646-cce9-4d97-b36f-6fc91c458205 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.399776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44d10646-cce9-4d97-b36f-6fc91c458205 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.400488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44d10646-cce9-4d97-b36f-6fc91c458205 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.404095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Getting quotas for project 5ac87eec90574e4db5dbdc5a41893c46. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:07:31.414970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Getting quotas for user 21eaf7b9d34c453a931c1b4c4131653d and project 5ac87eec90574e4db5dbdc5a41893c46. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:07:31.421676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=5 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:31.433216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:07:31.436946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:07:31.503658 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-88ac2cb5-72d7-4799-8e73-f70b01931280 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893221 Aug 27 05:07:31.505082 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1516/3087] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:07:31.523922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ea300ae1-7877-48b6-be4e-0e4fcd67a6d0 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:31.524805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ea300ae1-7877-48b6-be4e-0e4fcd67a6d0 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:31.664933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ea300ae1-7877-48b6-be4e-0e4fcd67a6d0 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:31.672184 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ea300ae1-7877-48b6-be4e-0e4fcd67a6d0 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1217 microversion: 2.1 time: 0.156368 Aug 27 05:07:31.673079 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1517/3088] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:31 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:31.684654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c4260968-d1b4-4eef-bcec-8cfe3774ee47 req-c5e6910d-0c44-4230-8fba-4169aae035b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26820abc-803a-4050-88be-17a76d7164ff", "name": "network-vif-unplugged", "status": "completed", "tag": "2990c3ed-258d-4779-8447-1c23744cef1b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:31.686385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-44d10646-cce9-4d97-b36f-6fc91c458205 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:31.696128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c4260968-d1b4-4eef-bcec-8cfe3774ee47 req-c5e6910d-0c44-4230-8fba-4169aae035b7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.696609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c4260968-d1b4-4eef-bcec-8cfe3774ee47 req-c5e6910d-0c44-4230-8fba-4169aae035b7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.697041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c4260968-d1b4-4eef-bcec-8cfe3774ee47 req-c5e6910d-0c44-4230-8fba-4169aae035b7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.706505 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-44d10646-cce9-4d97-b36f-6fc91c458205 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1535 microversion: 2.1 time: 0.324615 Aug 27 05:07:31.711267 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1572/3089] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:31 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1535 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:31.716594 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c4260968-d1b4-4eef-bcec-8cfe3774ee47 req-c5e6910d-0c44-4230-8fba-4169aae035b7 service nova] Creating event network-vif-unplugged:2990c3ed-258d-4779-8447-1c23744cef1b for instance 26820abc-803a-4050-88be-17a76d7164ff on n-h1-820368-35 Aug 27 05:07:31.720979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:31.723818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: e226f8ab-6c0c-4500-b810-80bb36601f5b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:31.724012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-c4260968-d1b4-4eef-bcec-8cfe3774ee47 req-c5e6910d-0c44-4230-8fba-4169aae035b7 service nova] Instance 26820abc-803a-4050-88be-17a76d7164ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:07:31.732215 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c4260968-d1b4-4eef-bcec-8cfe3774ee47 req-c5e6910d-0c44-4230-8fba-4169aae035b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057131 Aug 27 05:07:31.732956 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1518/3090] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:31.736571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.737116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.737566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.738290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.738744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.742045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:31.743154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:31.745832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.753404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.754255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.756161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.756997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.757976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.758540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.793156 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Instance e226f8ab-6c0c-4500-b810-80bb36601f5b could not be found. Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b HTTP/1.1 Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance e226f8ab-6c0c-4500-b810-80bb36601f5b could not be found. Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e226f8ab-6c0c-4500-b810-80bb36601f5b'} Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e226f8ab-6c0c-4500-b810-80bb36601f5b could not be found. Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e226f8ab-6c0c-4500-b810-80bb36601f5b could not be found. Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.803904 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.810457 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:31.810457 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:31.810457 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:31.810457 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:31.810457 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e226f8ab-6c0c-4500-b810-80bb36601f5b could not be found. Aug 27 05:07:31.810457 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.810457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Instance e226f8ab-6c0c-4500-b810-80bb36601f5b could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:31.810457 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3f240080-27df-4fb6-a100-062ac214cf84 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b" status: 404 len: 111 microversion: 2.1 time: 0.092889 Aug 27 05:07:31.810457 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1573/3091] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:31 2022] GET /compute/v2.1/servers/e226f8ab-6c0c-4500-b810-80bb36601f5b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:07:31.816097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d382f6a7-c6e6-4819-95a7-0c0c850656b1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb564b9bee0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:31.855201 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d382f6a7-c6e6-4819-95a7-0c0c850656b1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Image not found. Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d382f6a7-c6e6-4819-95a7-0c0c850656b1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 HTTP/1.1 Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: exception: Image not found. Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '034d24b8-4edf-4898-b7e1-47467f32b5b1'} Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 034d24b8-4edf-4898-b7e1-47467f32b5b1 to delete Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 034d24b8-4edf-4898-b7e1-47467f32b5b1 could not be found. Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.856674 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d382f6a7-c6e6-4819-95a7-0c0c850656b1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Image not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d382f6a7-c6e6-4819-95a7-0c0c850656b1 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1" status: 404 len: 62 microversion: 2.1 time: 0.046240 Aug 27 05:07:31.861942 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1574/3092] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:31 2022] DELETE /compute/v2.1/images/034d24b8-4edf-4898-b7e1-47467f32b5b1 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 05:07:31.866719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:31.867122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:31.888373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.888870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.889310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.890014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.890470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.890937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.905502 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 HTTP/1.1 Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd757ef9d-8acc-4bfc-8c45-7de22ca35137'} Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:31.907166 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:31.913021 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6ab406f2-94cd-4995-999e-a7b84b1b85f3 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 404 len: 111 microversion: 2.1 time: 0.046000 Aug 27 05:07:31.914055 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1575/3093] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:07:31 2022] DELETE /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:07:31.919050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:31.919610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: d757ef9d-8acc-4bfc-8c45-7de22ca35137] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:31.926897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.927437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.928585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.930083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.930571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.932632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.964309 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 HTTP/1.1 Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd757ef9d-8acc-4bfc-8c45-7de22ca35137'} Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.966011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:31.975442 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:31.975442 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:31.975442 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:31.975442 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:31.975442 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. Aug 27 05:07:31.975442 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:31.975442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Instance d757ef9d-8acc-4bfc-8c45-7de22ca35137 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:31.975442 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-75a975db-d776-4fd8-8b92-52c6f524528f tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137" status: 404 len: 111 microversion: 2.1 time: 0.052880 Aug 27 05:07:31.976869 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1576/3094] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:31 2022] GET /compute/v2.1/servers/d757ef9d-8acc-4bfc-8c45-7de22ca35137 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:07:31.982139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-add91e1b-fb4a-4fc5-85d7-6f9d93f7af01 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb5696219d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:32.001611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:32.011854 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-add91e1b-fb4a-4fc5-85d7-6f9d93f7af01 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Image not found. Aug 27 05:07:32.013471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:32.015375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-add91e1b-fb4a-4fc5-85d7-6f9d93f7af01 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 HTTP/1.1 Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: exception: Image not found. Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '207479bf-1eec-44f2-973f-65038234b852'} Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 207479bf-1eec-44f2-973f-65038234b852 to delete Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 207479bf-1eec-44f2-973f-65038234b852 could not be found. Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.016183 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.025209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-add91e1b-fb4a-4fc5-85d7-6f9d93f7af01 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Image not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:32.028711 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-befd9c40-5e31-49a3-b8fe-b54d9a3e5238 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1405 microversion: 2.20 time: 0.285144 Aug 27 05:07:32.028711 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1519/3095] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:31 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1405 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:32.029039 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-add91e1b-fb4a-4fc5-85d7-6f9d93f7af01 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852" status: 404 len: 62 microversion: 2.1 time: 0.039868 Aug 27 05:07:32.029039 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1577/3096] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:31 2022] DELETE /compute/v2.1/images/207479bf-1eec-44f2-973f-65038234b852 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:07:32.045697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:32.046525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:32.053881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.054394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.054841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.055848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.056289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.056720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.077019 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 HTTP/1.1 Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '8e359f17-fa25-41b2-a570-f33bc74f53c4'} Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:32.078821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b8c73b6-4fb0-474e-acfa-c03f180f0ae7 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 404 len: 111 microversion: 2.1 time: 0.040509 Aug 27 05:07:32.084872 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1520/3097] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:07:32 2022] DELETE /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:07:32.089769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:32.090394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 8e359f17-fa25-41b2-a570-f33bc74f53c4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:32.098000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.098417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.098856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.099599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.100057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.100488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.114227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-196e875b-4c01-46e7-875b-05e7de63b29b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:32.114921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-196e875b-4c01-46e7-875b-05e7de63b29b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:32.126102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-196e875b-4c01-46e7-875b-05e7de63b29b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.129130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-196e875b-4c01-46e7-875b-05e7de63b29b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.130384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-196e875b-4c01-46e7-875b-05e7de63b29b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.132317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-196e875b-4c01-46e7-875b-05e7de63b29b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.134326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-196e875b-4c01-46e7-875b-05e7de63b29b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.135010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-196e875b-4c01-46e7-875b-05e7de63b29b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.136116 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 HTTP/1.1 Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '8e359f17-fa25-41b2-a570-f33bc74f53c4'} Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.139832 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.145842 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.145842 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.145842 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:32.145842 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:32.145842 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. Aug 27 05:07:32.145842 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.148845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Instance 8e359f17-fa25-41b2-a570-f33bc74f53c4 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:32.148845 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-54153127-fda3-444b-89c5-4ec7ed168fbd tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4" status: 404 len: 111 microversion: 2.1 time: 0.063030 Aug 27 05:07:32.152056 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1578/3098] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:32 2022] GET /compute/v2.1/servers/8e359f17-fa25-41b2-a570-f33bc74f53c4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:07:32.165446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f997b170-f5ce-4eed-b563-c975dfc90100 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '.version_select at 0x7fb565ebb550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:32.194347 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f997b170-f5ce-4eed-b563-c975dfc90100 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Image not found. Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f997b170-f5ce-4eed-b563-c975dfc90100 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e HTTP/1.1 Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: exception: Image not found. Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e'} Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e to delete Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e could not be found. Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.196385 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 05:07:32.201754 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.206502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f997b170-f5ce-4eed-b563-c975dfc90100 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Image not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:32.206502 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f997b170-f5ce-4eed-b563-c975dfc90100 tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e" status: 404 len: 62 microversion: 2.1 time: 0.049103 Aug 27 05:07:32.206502 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1579/3099] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:32 2022] DELETE /compute/v2.1/images/fd4dfb37-1ab2-4417-b5fa-dc3a0d523b9e => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:07:32.216054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:32.217448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:32.235831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.236501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.238163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.239140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.239884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.240620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.259564 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 HTTP/1.1 Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '38cc590d-689d-46fe-8dc4-c011387de6e9'} Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:32.261704 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. Aug 27 05:07:32.266396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.266396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.266396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.266396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.266396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.266396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.266396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:32.266396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:32.266396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. Aug 27 05:07:32.266396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.270027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:32.272599 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1c706b5f-e1be-4b06-bed1-e35001f70fee tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 404 len: 111 microversion: 2.1 time: 0.061636 Aug 27 05:07:32.273669 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1580/3100] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:07:32 2022] DELETE /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:07:32.288097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:32.289923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] [instance: 38cc590d-689d-46fe-8dc4-c011387de6e9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:32.300855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.301580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.302675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.303646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.304302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.304951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.328631 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] HTTP exception thrown: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Request method failure captured: Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 HTTP/1.1 Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaWQlFComJRsDZYRrcseEmsb7t1JzRBB22Lt5PbWpicwWSC-bSeAZTmaGWKn_m-nmBy3qtqNKlf15BhKeOBBuQlZc-8EixwDF39Xbj81ZInj6oauot4_TlkBMbTZLxu-4iz8SwXmaW2zqq_CiiOo969shltpHlfvudlIXBpI7atLGM4 Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8fa2042dc6a457fa50dcbf75e3a32ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8fa2042dc6a457fa50dcbf75e3a32ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d8fa2042dc6a457fa50dcbf75e3a32ac Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesTestJSON-527127737 Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 979e8da1534344fcb5a2be09631ea09c Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesTestJSON-527127737-project Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '38cc590d-689d-46fe-8dc4-c011387de6e9'} Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.332114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:32.337584 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:32.337584 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:32.337584 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:32.337584 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:32.337584 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. Aug 27 05:07:32.337584 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:32.339272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] Returning 404 to user: Instance 38cc590d-689d-46fe-8dc4-c011387de6e9 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:32.340642 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-997dea05-2f5f-415a-868d-e9ed3285fa8a tempest-ImagesTestJSON-527127737 tempest-ImagesTestJSON-527127737-project] 10.222.0.58 "GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9" status: 404 len: 111 microversion: 2.1 time: 0.060570 Aug 27 05:07:32.341791 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1581/3101] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:32 2022] GET /compute/v2.1/servers/38cc590d-689d-46fe-8dc4-c011387de6e9 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:07:32.392978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-196e875b-4c01-46e7-875b-05e7de63b29b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:32.402504 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-196e875b-4c01-46e7-875b-05e7de63b29b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.292434 Aug 27 05:07:32.404376 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1521/3102] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:32 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:32.693289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5fe2324-b419-4b9f-ad1a-a5263ad46913 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:32.693918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f5fe2324-b419-4b9f-ad1a-a5263ad46913 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:32.707120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5fe2324-b419-4b9f-ad1a-a5263ad46913 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.708259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5fe2324-b419-4b9f-ad1a-a5263ad46913 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.709364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5fe2324-b419-4b9f-ad1a-a5263ad46913 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.710485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5fe2324-b419-4b9f-ad1a-a5263ad46913 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.711249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5fe2324-b419-4b9f-ad1a-a5263ad46913 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.711913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5fe2324-b419-4b9f-ad1a-a5263ad46913 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.728651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-129c7366-1ddc-4902-b9cd-fc1c49d132d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:32.729282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-129c7366-1ddc-4902-b9cd-fc1c49d132d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:32.743045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-129c7366-1ddc-4902-b9cd-fc1c49d132d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.745059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-129c7366-1ddc-4902-b9cd-fc1c49d132d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.750407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-129c7366-1ddc-4902-b9cd-fc1c49d132d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.751499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-129c7366-1ddc-4902-b9cd-fc1c49d132d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:32.752002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-129c7366-1ddc-4902-b9cd-fc1c49d132d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:32.753641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-129c7366-1ddc-4902-b9cd-fc1c49d132d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.805654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f5fe2324-b419-4b9f-ad1a-a5263ad46913 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:32.823142 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5fe2324-b419-4b9f-ad1a-a5263ad46913 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1269 microversion: 2.1 time: 0.131213 Aug 27 05:07:32.823901 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1582/3103] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:32 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1269 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:33.044108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:33.044745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:33.059562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-129c7366-1ddc-4902-b9cd-fc1c49d132d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:33.070044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:33.073639 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-129c7366-1ddc-4902-b9cd-fc1c49d132d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1535 microversion: 2.1 time: 0.348813 Aug 27 05:07:33.074220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:33.075729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:33.076762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:33.077203 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1522/3104] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:32 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1535 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:33.077881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:33.078329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:33.339405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:33.357669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:33.374618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:33.378967 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5b695a5-a1bb-40f2-8f3f-1591963c34ad tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1405 microversion: 2.20 time: 0.339401 Aug 27 05:07:33.393585 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1583/3105] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:33 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1405 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:33.425417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-05a57966-fa24-42bf-8108-f97cf9e10251 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:33.426192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-05a57966-fa24-42bf-8108-f97cf9e10251 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:33.438550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05a57966-fa24-42bf-8108-f97cf9e10251 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:33.439413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05a57966-fa24-42bf-8108-f97cf9e10251 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:33.440134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05a57966-fa24-42bf-8108-f97cf9e10251 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:33.441465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05a57966-fa24-42bf-8108-f97cf9e10251 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:33.442164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05a57966-fa24-42bf-8108-f97cf9e10251 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:33.443046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05a57966-fa24-42bf-8108-f97cf9e10251 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:33.782926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-05a57966-fa24-42bf-8108-f97cf9e10251 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:33.792188 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-05a57966-fa24-42bf-8108-f97cf9e10251 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.371912 Aug 27 05:07:33.798517 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1523/3106] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:33 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:33.844176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cf3414c3-0aaa-4e0e-a865-f05e1cedca7b tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:33.844817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cf3414c3-0aaa-4e0e-a865-f05e1cedca7b tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:33.857490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf3414c3-0aaa-4e0e-a865-f05e1cedca7b tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:33.858003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf3414c3-0aaa-4e0e-a865-f05e1cedca7b tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:33.858447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf3414c3-0aaa-4e0e-a865-f05e1cedca7b tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:33.859197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf3414c3-0aaa-4e0e-a865-f05e1cedca7b tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:33.862941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf3414c3-0aaa-4e0e-a865-f05e1cedca7b tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:33.865461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf3414c3-0aaa-4e0e-a865-f05e1cedca7b tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:33.999287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cf3414c3-0aaa-4e0e-a865-f05e1cedca7b tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:34.013890 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cf3414c3-0aaa-4e0e-a865-f05e1cedca7b tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1275 microversion: 2.1 time: 0.173437 Aug 27 05:07:34.027052 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1584/3107] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:33 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:34.104540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-383b9814-4d9e-4aed-aaa7-28ada9ad765c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:34.120836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-383b9814-4d9e-4aed-aaa7-28ada9ad765c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:34.146192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-383b9814-4d9e-4aed-aaa7-28ada9ad765c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.151537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-383b9814-4d9e-4aed-aaa7-28ada9ad765c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.152619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-383b9814-4d9e-4aed-aaa7-28ada9ad765c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:34.153683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-383b9814-4d9e-4aed-aaa7-28ada9ad765c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.155385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-383b9814-4d9e-4aed-aaa7-28ada9ad765c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.156997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-383b9814-4d9e-4aed-aaa7-28ada9ad765c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:34.410695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:34.411945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:34.424981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.425626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.432407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:34.435435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.436107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.444049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:34.553105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-383b9814-4d9e-4aed-aaa7-28ada9ad765c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:34.572648 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-383b9814-4d9e-4aed-aaa7-28ada9ad765c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1535 microversion: 2.1 time: 0.478469 Aug 27 05:07:34.574825 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1524/3108] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:34 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1535 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:34.811836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:34.821640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-109ade53-cc5f-4719-a927-0f2d9fc25a4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:34.822108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:34.822648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-109ade53-cc5f-4719-a927-0f2d9fc25a4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:34.823967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:34.833041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-109ade53-cc5f-4719-a927-0f2d9fc25a4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.834506 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7de199c7-1d07-4603-8f27-f3c4e2c006d7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1405 microversion: 2.20 time: 0.428388 Aug 27 05:07:34.835072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-109ade53-cc5f-4719-a927-0f2d9fc25a4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.835585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-109ade53-cc5f-4719-a927-0f2d9fc25a4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:34.839289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-109ade53-cc5f-4719-a927-0f2d9fc25a4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.840103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-109ade53-cc5f-4719-a927-0f2d9fc25a4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.840726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-109ade53-cc5f-4719-a927-0f2d9fc25a4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:34.850336 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1585/3109] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:34 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:07:35.035391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9ac4099a-fa71-4527-a101-ef59b240e1fd tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:35.036221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9ac4099a-fa71-4527-a101-ef59b240e1fd tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:35.048181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac4099a-fa71-4527-a101-ef59b240e1fd tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:35.051901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac4099a-fa71-4527-a101-ef59b240e1fd tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:35.052561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac4099a-fa71-4527-a101-ef59b240e1fd tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:35.056077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac4099a-fa71-4527-a101-ef59b240e1fd tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:35.056750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac4099a-fa71-4527-a101-ef59b240e1fd tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:35.057380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac4099a-fa71-4527-a101-ef59b240e1fd tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:35.121824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-109ade53-cc5f-4719-a927-0f2d9fc25a4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:35.131600 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-109ade53-cc5f-4719-a927-0f2d9fc25a4c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.314569 Aug 27 05:07:35.134803 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1525/3110] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:34 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:35.181901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ac4099a-fa71-4527-a101-ef59b240e1fd tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:35.190922 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9ac4099a-fa71-4527-a101-ef59b240e1fd tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1275 microversion: 2.1 time: 0.159932 Aug 27 05:07:35.192187 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1586/3111] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:35 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:35.251505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8b6df7c0-f80b-4bf9-b774-bb2c77b0cac8 req-19b477b0-74d5-47c1-8747-bc12a3fad608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcbd54c-7e88-44d7-ad7b-be669acb1c7c", "name": "network-vif-plugged", "status": "completed", "tag": "e1cc65c6-b976-41c9-a889-d9270df2c63d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:35.264551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8b6df7c0-f80b-4bf9-b774-bb2c77b0cac8 req-19b477b0-74d5-47c1-8747-bc12a3fad608 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:35.268699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8b6df7c0-f80b-4bf9-b774-bb2c77b0cac8 req-19b477b0-74d5-47c1-8747-bc12a3fad608 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:35.269608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8b6df7c0-f80b-4bf9-b774-bb2c77b0cac8 req-19b477b0-74d5-47c1-8747-bc12a3fad608 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:35.296092 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8b6df7c0-f80b-4bf9-b774-bb2c77b0cac8 req-19b477b0-74d5-47c1-8747-bc12a3fad608 service nova] Creating event network-vif-plugged:e1cc65c6-b976-41c9-a889-d9270df2c63d for instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c on n-h1-820368-35 Aug 27 05:07:35.302355 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8b6df7c0-f80b-4bf9-b774-bb2c77b0cac8 req-19b477b0-74d5-47c1-8747-bc12a3fad608 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054904 Aug 27 05:07:35.303604 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1526/3112] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:35.602547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1bbf79f2-5192-4883-97c5-dea6cab3d177 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:35.603552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1bbf79f2-5192-4883-97c5-dea6cab3d177 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:35.612695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bbf79f2-5192-4883-97c5-dea6cab3d177 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:35.613406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bbf79f2-5192-4883-97c5-dea6cab3d177 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:35.614242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bbf79f2-5192-4883-97c5-dea6cab3d177 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:35.615952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bbf79f2-5192-4883-97c5-dea6cab3d177 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:35.616963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bbf79f2-5192-4883-97c5-dea6cab3d177 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:35.617698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1bbf79f2-5192-4883-97c5-dea6cab3d177 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:35.811790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1bbf79f2-5192-4883-97c5-dea6cab3d177 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:35.828021 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1bbf79f2-5192-4883-97c5-dea6cab3d177 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1528 microversion: 2.1 time: 0.228919 Aug 27 05:07:35.828930 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1587/3113] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:35 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1528 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:35.859256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:35.860760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:35.863442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-59deaf2b-96c5-411e-973e-9b7cd48d74df tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:35.865961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-59deaf2b-96c5-411e-973e-9b7cd48d74df tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:35.878917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:35.879477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:35.882227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59deaf2b-96c5-411e-973e-9b7cd48d74df tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:35.883859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:35.885032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59deaf2b-96c5-411e-973e-9b7cd48d74df tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:35.885644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:35.886344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59deaf2b-96c5-411e-973e-9b7cd48d74df tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:35.887020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59deaf2b-96c5-411e-973e-9b7cd48d74df tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:35.887696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:35.888889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:35.892363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59deaf2b-96c5-411e-973e-9b7cd48d74df tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:35.893967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59deaf2b-96c5-411e-973e-9b7cd48d74df tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:36.868892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:36.883343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-59deaf2b-96c5-411e-973e-9b7cd48d74df tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:36.891705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:36.901914 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-59deaf2b-96c5-411e-973e-9b7cd48d74df tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1528 microversion: 2.1 time: 1.055725 Aug 27 05:07:36.904178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:36.915113 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1527/3114] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:35 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1528 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:36.915319 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-21f99fe2-94e8-49f5-a799-7d6d850011da tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1405 microversion: 2.20 time: 1.052280 Aug 27 05:07:36.915319 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1588/3115] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:35 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1405 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:07:36.915319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6e48eaea-bf93-445b-8659-4dbdc5de7ef5 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:36.915319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6e48eaea-bf93-445b-8659-4dbdc5de7ef5 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:36.929740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1533aa0a-2f4b-4521-9b3c-9b8d7c051c8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:36.932287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1533aa0a-2f4b-4521-9b3c-9b8d7c051c8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:36.933861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e48eaea-bf93-445b-8659-4dbdc5de7ef5 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:36.934372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e48eaea-bf93-445b-8659-4dbdc5de7ef5 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:36.934819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e48eaea-bf93-445b-8659-4dbdc5de7ef5 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:36.935576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e48eaea-bf93-445b-8659-4dbdc5de7ef5 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:36.936042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e48eaea-bf93-445b-8659-4dbdc5de7ef5 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:36.936479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e48eaea-bf93-445b-8659-4dbdc5de7ef5 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:36.948934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1533aa0a-2f4b-4521-9b3c-9b8d7c051c8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:36.950331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1533aa0a-2f4b-4521-9b3c-9b8d7c051c8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:36.952186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1533aa0a-2f4b-4521-9b3c-9b8d7c051c8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:36.953907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1533aa0a-2f4b-4521-9b3c-9b8d7c051c8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:36.954549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1533aa0a-2f4b-4521-9b3c-9b8d7c051c8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:36.957122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1533aa0a-2f4b-4521-9b3c-9b8d7c051c8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:37.293455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6e48eaea-bf93-445b-8659-4dbdc5de7ef5 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:37.305580 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6e48eaea-bf93-445b-8659-4dbdc5de7ef5 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1317 microversion: 2.1 time: 0.395449 Aug 27 05:07:37.318954 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1589/3116] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:36 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:37.324564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-320ea8be-5493-4a76-b739-57b1c77769dc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:37.340589 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-320ea8be-5493-4a76-b739-57b1c77769dc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] HTTP exception thrown: Flavor f866ad4a-7ec5-4045-8699-bdeff6744445 could not be found. Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-320ea8be-5493-4a76-b739-57b1c77769dc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Request method failure captured: Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/flavors/f866ad4a-7ec5-4045-8699-bdeff6744445 HTTP/1.1 Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaW7D_b4qEIopbeQQ9M7EfXHBD7h36yjVd8XF3UaU8rUlG0-D5w7naKUgg-08R10qOtCd3WQPOnVYPGHaLyQ4seqRIZfdGQ1gt1H2hf9h1n84HfBTbcL9P4D1_Jn2m1Q_CzGDySKM0gh_g8GFNzijavFJSktMDpfOXbrnjYrgxAHJH0 Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 46b38b3b27dd48a3934afc399c2ac11d Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-MigrationsAdminTest-328741462 Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_46b38b3b27dd48a3934afc399c2ac11d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/46b38b3b27dd48a3934afc399c2ac11d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/46b38b3b27dd48a3934afc399c2ac11d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/46b38b3b27dd48a3934afc399c2ac11d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-MigrationsAdminTest-328741462 Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 46b38b3b27dd48a3934afc399c2ac11d Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-MigrationsAdminTest-328741462 Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-MigrationsAdminTest-328741462-project-admin Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: b1577287646849e8aab81a29e1b1549b Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-MigrationsAdminTest-328741462-project-admin Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: exception: Flavor f866ad4a-7ec5-4045-8699-bdeff6744445 could not be found. Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'f866ad4a-7ec5-4045-8699-bdeff6744445'} Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f866ad4a-7ec5-4045-8699-bdeff6744445 could not be found. Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor f866ad4a-7ec5-4045-8699-bdeff6744445 could not be found. Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:37.353764 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:37.368382 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:37.368382 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:37.368382 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:37.368382 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:37.368382 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:37.368382 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:37.368382 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f866ad4a-7ec5-4045-8699-bdeff6744445 could not be found. Aug 27 05:07:37.368382 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:07:37.368382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-320ea8be-5493-4a76-b739-57b1c77769dc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Returning 404 to user: Flavor f866ad4a-7ec5-4045-8699-bdeff6744445 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:37.368382 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-320ea8be-5493-4a76-b739-57b1c77769dc tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/f866ad4a-7ec5-4045-8699-bdeff6744445" status: 404 len: 109 microversion: 2.1 time: 0.041739 Aug 27 05:07:37.368382 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1590/3117] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:07:37 2022] DELETE /compute/v2.1/flavors/f866ad4a-7ec5-4045-8699-bdeff6744445 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:07:37.548489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-792e59c6-414b-4141-aab1-5458b49a3194 req-75e5fb34-571b-4384-bed7-dfa609f941d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44343fc-7c5a-46ab-9e82-d3a53c84db32", "tag": "77c2a8a3-c2c8-4e20-bbed-1ff085255d80"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:37.575857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-792e59c6-414b-4141-aab1-5458b49a3194 req-75e5fb34-571b-4384-bed7-dfa609f941d0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:37.577426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-792e59c6-414b-4141-aab1-5458b49a3194 req-75e5fb34-571b-4384-bed7-dfa609f941d0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:37.577904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-792e59c6-414b-4141-aab1-5458b49a3194 req-75e5fb34-571b-4384-bed7-dfa609f941d0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:37.591272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1533aa0a-2f4b-4521-9b3c-9b8d7c051c8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:37.605897 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1533aa0a-2f4b-4521-9b3c-9b8d7c051c8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.696873 Aug 27 05:07:37.606126 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-792e59c6-414b-4141-aab1-5458b49a3194 req-75e5fb34-571b-4384-bed7-dfa609f941d0 service nova] Creating event network-changed:77c2a8a3-c2c8-4e20-bbed-1ff085255d80 for instance b44343fc-7c5a-46ab-9e82-d3a53c84db32 on n-h2-820368-35 Aug 27 05:07:37.606927 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1528/3118] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:36 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:37.653890 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-792e59c6-414b-4141-aab1-5458b49a3194 req-75e5fb34-571b-4384-bed7-dfa609f941d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295747 Aug 27 05:07:37.657243 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1591/3119] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:37.676944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-401928312", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:37.774927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0c4b7cb6-666f-41dd-8daf-ee1d170c9108 req-59927b67-96ee-470d-b408-70d7efe16fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26820abc-803a-4050-88be-17a76d7164ff", "name": "network-vif-plugged", "status": "completed", "tag": "2990c3ed-258d-4779-8447-1c23744cef1b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:37.783040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:07:37.815528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c4b7cb6-666f-41dd-8daf-ee1d170c9108 req-59927b67-96ee-470d-b408-70d7efe16fcf service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:37.816793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c4b7cb6-666f-41dd-8daf-ee1d170c9108 req-59927b67-96ee-470d-b408-70d7efe16fcf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:37.818481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c4b7cb6-666f-41dd-8daf-ee1d170c9108 req-59927b67-96ee-470d-b408-70d7efe16fcf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:37.849661 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0c4b7cb6-666f-41dd-8daf-ee1d170c9108 req-59927b67-96ee-470d-b408-70d7efe16fcf service nova] Creating event network-vif-plugged:2990c3ed-258d-4779-8447-1c23744cef1b for instance 26820abc-803a-4050-88be-17a76d7164ff on n-h1-820368-35 Aug 27 05:07:37.864913 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0c4b7cb6-666f-41dd-8daf-ee1d170c9108 req-59927b67-96ee-470d-b408-70d7efe16fcf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256402 Aug 27 05:07:37.865707 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1529/3120] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:37.934257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:37.935015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:37.949705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:37.950200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:37.950638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:37.955368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:37.958974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:37.960598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:38.305542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:07:38.308769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:07:38.309967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:07:38.310694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:07:38.311313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:07:38.323167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:38.324075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:38.324679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:38.325648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:38.326279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:38.327806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:38.344166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:38.358712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:07:38.366321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Getting quotas for user 58b3a6b755ba4d5f89899d3122ddc29d and project a39f432b94f846faafa73bf3c7db6f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:07:38.382410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:07:38.385377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:07:38.436961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:38.454162 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-73234e45-143c-4e69-92f8-38b356b95ff7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795388 Aug 27 05:07:38.455136 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1592/3121] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:07:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:07:38.462934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-19f0ea23-0062-4886-a1ca-f25d56e44a40 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:38.464057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-19f0ea23-0062-4886-a1ca-f25d56e44a40 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:38.466296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:38.467004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:38.472744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19f0ea23-0062-4886-a1ca-f25d56e44a40 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:38.473260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19f0ea23-0062-4886-a1ca-f25d56e44a40 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:38.473686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19f0ea23-0062-4886-a1ca-f25d56e44a40 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:38.474299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:38.474525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19f0ea23-0062-4886-a1ca-f25d56e44a40 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:38.474982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19f0ea23-0062-4886-a1ca-f25d56e44a40 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:38.475443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19f0ea23-0062-4886-a1ca-f25d56e44a40 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:38.479221 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fc6dbafd-411e-4ce1-879d-c0ae1f8dfc66 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1597 microversion: 2.20 time: 0.549326 Aug 27 05:07:38.481876 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1530/3122] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:37 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1597 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:07:38.488579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5a2d321f-acee-4675-8d77-69a63c0cae19 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:38.493824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5a2d321f-acee-4675-8d77-69a63c0cae19 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:38.610827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5a2d321f-acee-4675-8d77-69a63c0cae19 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:38.630524 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5a2d321f-acee-4675-8d77-69a63c0cae19 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1212 microversion: 2.1 time: 0.142372 Aug 27 05:07:38.634730 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1531/3123] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:38 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1212 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:38.658089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a160a61c-680f-434c-b374-4fc81f0bfc71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:38.658607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a160a61c-680f-434c-b374-4fc81f0bfc71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:38.676721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a160a61c-680f-434c-b374-4fc81f0bfc71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:38.677221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a160a61c-680f-434c-b374-4fc81f0bfc71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:38.677661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a160a61c-680f-434c-b374-4fc81f0bfc71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:38.678375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a160a61c-680f-434c-b374-4fc81f0bfc71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:38.680496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a160a61c-680f-434c-b374-4fc81f0bfc71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:38.681137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a160a61c-680f-434c-b374-4fc81f0bfc71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:38.840389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-19f0ea23-0062-4886-a1ca-f25d56e44a40 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:38.855755 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-19f0ea23-0062-4886-a1ca-f25d56e44a40 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1317 microversion: 2.1 time: 0.399587 Aug 27 05:07:38.867125 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1593/3124] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:38 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:38.867125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a71fbab-1356-48cd-9f19-5f590b454620 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:38.867125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a71fbab-1356-48cd-9f19-5f590b454620 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:38.869731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a71fbab-1356-48cd-9f19-5f590b454620 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:38.869731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a71fbab-1356-48cd-9f19-5f590b454620 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:38.869731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a71fbab-1356-48cd-9f19-5f590b454620 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:38.869731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a71fbab-1356-48cd-9f19-5f590b454620 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:38.870106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a71fbab-1356-48cd-9f19-5f590b454620 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:38.870484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a71fbab-1356-48cd-9f19-5f590b454620 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:38.905960 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a160a61c-680f-434c-b374-4fc81f0bfc71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.269874 Aug 27 05:07:38.906874 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1532/3125] 10.222.0.58 () {60 vars in 1316 bytes} [Sat Aug 27 05:07:38 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:07:39.150224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1a71fbab-1356-48cd-9f19-5f590b454620 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:39.162046 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a71fbab-1356-48cd-9f19-5f590b454620 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.304199 Aug 27 05:07:39.167753 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1594/3126] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:38 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:39.653282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a5fcdd49-c155-4bc5-9a2a-3e841fee4688 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:39.654535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a5fcdd49-c155-4bc5-9a2a-3e841fee4688 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:39.672041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5fcdd49-c155-4bc5-9a2a-3e841fee4688 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:39.672551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5fcdd49-c155-4bc5-9a2a-3e841fee4688 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:39.673012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5fcdd49-c155-4bc5-9a2a-3e841fee4688 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:39.679287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5fcdd49-c155-4bc5-9a2a-3e841fee4688 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:39.679999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5fcdd49-c155-4bc5-9a2a-3e841fee4688 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:39.680645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5fcdd49-c155-4bc5-9a2a-3e841fee4688 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:39.877722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d2a560e9-f530-4d5e-9d08-843bd547204a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:39.879268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d2a560e9-f530-4d5e-9d08-843bd547204a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:39.900423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a5fcdd49-c155-4bc5-9a2a-3e841fee4688 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:39.900979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a560e9-f530-4d5e-9d08-843bd547204a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:39.901484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a560e9-f530-4d5e-9d08-843bd547204a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:39.901928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a560e9-f530-4d5e-9d08-843bd547204a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:39.902651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a560e9-f530-4d5e-9d08-843bd547204a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:39.904088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a560e9-f530-4d5e-9d08-843bd547204a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:39.904533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2a560e9-f530-4d5e-9d08-843bd547204a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:39.913438 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a5fcdd49-c155-4bc5-9a2a-3e841fee4688 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1216 microversion: 2.1 time: 0.263949 Aug 27 05:07:39.914825 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1533/3127] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:39 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1216 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:40.185334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ddf91037-5dc7-407d-bb70-ddba2048e829 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:40.186209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ddf91037-5dc7-407d-bb70-ddba2048e829 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:40.195595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf91037-5dc7-407d-bb70-ddba2048e829 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:40.197171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf91037-5dc7-407d-bb70-ddba2048e829 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:40.197518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf91037-5dc7-407d-bb70-ddba2048e829 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:40.198714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf91037-5dc7-407d-bb70-ddba2048e829 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:40.200046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf91037-5dc7-407d-bb70-ddba2048e829 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:40.200738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf91037-5dc7-407d-bb70-ddba2048e829 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:40.244657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d2a560e9-f530-4d5e-9d08-843bd547204a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:40.267612 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d2a560e9-f530-4d5e-9d08-843bd547204a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1317 microversion: 2.1 time: 0.392856 Aug 27 05:07:40.271821 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1595/3128] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:39 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:40.563321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7174c52d-0a2f-49c3-b936-29bd831f98aa req-dffe3cf2-42bc-4b06-a4f8-3058a810784b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcbd54c-7e88-44d7-ad7b-be669acb1c7c", "tag": "e1cc65c6-b976-41c9-a889-d9270df2c63d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:40.575297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ddf91037-5dc7-407d-bb70-ddba2048e829 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:40.582121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7174c52d-0a2f-49c3-b936-29bd831f98aa req-dffe3cf2-42bc-4b06-a4f8-3058a810784b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:40.586809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7174c52d-0a2f-49c3-b936-29bd831f98aa req-dffe3cf2-42bc-4b06-a4f8-3058a810784b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:40.589053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7174c52d-0a2f-49c3-b936-29bd831f98aa req-dffe3cf2-42bc-4b06-a4f8-3058a810784b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:40.590327 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ddf91037-5dc7-407d-bb70-ddba2048e829 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1508 microversion: 2.1 time: 0.409172 Aug 27 05:07:40.597217 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1534/3129] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:40 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1508 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:40.630926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7174c52d-0a2f-49c3-b936-29bd831f98aa req-dffe3cf2-42bc-4b06-a4f8-3058a810784b service nova] Creating event network-changed:e1cc65c6-b976-41c9-a889-d9270df2c63d for instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c on n-h1-820368-35 Aug 27 05:07:40.644622 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7174c52d-0a2f-49c3-b936-29bd831f98aa req-dffe3cf2-42bc-4b06-a4f8-3058a810784b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084071 Aug 27 05:07:40.647680 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1596/3130] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:07:40.936055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-18cb6624-c148-48ea-b029-f9ccd2cc24c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:40.936708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-18cb6624-c148-48ea-b029-f9ccd2cc24c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:40.957086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:40.960129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18cb6624-c148-48ea-b029-f9ccd2cc24c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:40.962506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18cb6624-c148-48ea-b029-f9ccd2cc24c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:40.965331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18cb6624-c148-48ea-b029-f9ccd2cc24c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:40.966611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18cb6624-c148-48ea-b029-f9ccd2cc24c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:40.967284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18cb6624-c148-48ea-b029-f9ccd2cc24c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:40.968270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18cb6624-c148-48ea-b029-f9ccd2cc24c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:41.053578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-18cb6624-c148-48ea-b029-f9ccd2cc24c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:41.058375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:41.065656 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-18cb6624-c148-48ea-b029-f9ccd2cc24c2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1216 microversion: 2.1 time: 0.135270 Aug 27 05:07:41.066814 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1535/3131] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:40 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1216 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:41.290719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-421b9375-7ad0-4827-a70e-d88bead208f2 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:41.292148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-421b9375-7ad0-4827-a70e-d88bead208f2 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:41.307603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421b9375-7ad0-4827-a70e-d88bead208f2 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:41.311318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421b9375-7ad0-4827-a70e-d88bead208f2 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:41.312094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421b9375-7ad0-4827-a70e-d88bead208f2 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:41.317444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421b9375-7ad0-4827-a70e-d88bead208f2 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:41.318389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421b9375-7ad0-4827-a70e-d88bead208f2 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:41.318997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-421b9375-7ad0-4827-a70e-d88bead208f2 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:41.618387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d4ab7ee6-1ad7-4c13-93db-93514f2c30a6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:41.619107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d4ab7ee6-1ad7-4c13-93db-93514f2c30a6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:41.621398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:41.624034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-421b9375-7ad0-4827-a70e-d88bead208f2 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:41.637421 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-421b9375-7ad0-4827-a70e-d88bead208f2 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1317 microversion: 2.1 time: 0.352290 Aug 27 05:07:41.638676 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1597/3132] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:41 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:41.649977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4ab7ee6-1ad7-4c13-93db-93514f2c30a6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:41.655123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4ab7ee6-1ad7-4c13-93db-93514f2c30a6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:41.656300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4ab7ee6-1ad7-4c13-93db-93514f2c30a6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:41.658566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4ab7ee6-1ad7-4c13-93db-93514f2c30a6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:41.660393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4ab7ee6-1ad7-4c13-93db-93514f2c30a6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:41.661573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4ab7ee6-1ad7-4c13-93db-93514f2c30a6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:41.985061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d4ab7ee6-1ad7-4c13-93db-93514f2c30a6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:41.997330 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d4ab7ee6-1ad7-4c13-93db-93514f2c30a6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1529 microversion: 2.1 time: 0.382049 Aug 27 05:07:41.999926 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1536/3133] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:41 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1529 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:42.088824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1c67d22a-9f7e-449d-968b-6188a832011e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:42.089853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1c67d22a-9f7e-449d-968b-6188a832011e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:42.097170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c67d22a-9f7e-449d-968b-6188a832011e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:42.098807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c67d22a-9f7e-449d-968b-6188a832011e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:42.099990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c67d22a-9f7e-449d-968b-6188a832011e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:42.101815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c67d22a-9f7e-449d-968b-6188a832011e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:42.102492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c67d22a-9f7e-449d-968b-6188a832011e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:42.103116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c67d22a-9f7e-449d-968b-6188a832011e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:42.184519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1c67d22a-9f7e-449d-968b-6188a832011e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:42.200625 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1c67d22a-9f7e-449d-968b-6188a832011e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1208 microversion: 2.1 time: 0.116644 Aug 27 05:07:42.201808 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1598/3134] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:42 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1208 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:42.456017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e84c7f6-7796-4c93-b59e-03751ae1bc75 tempest-ListImagesTestJSON-1615042076 tempest-ListImagesTestJSON-1615042076-project] Calling method '.version_select at 0x7fb564904310>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:42.506035 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e84c7f6-7796-4c93-b59e-03751ae1bc75 tempest-ListImagesTestJSON-1615042076 tempest-ListImagesTestJSON-1615042076-project] 10.222.0.58 "GET /compute/v2.1/images/596ae1e8-61a9-43bf-be37-48ea5ff9a76f" status: 200 len: 784 microversion: 2.1 time: 0.196093 Aug 27 05:07:42.506700 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1537/3135] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:42 2022] GET /compute/v2.1/images/596ae1e8-61a9-43bf-be37-48ea5ff9a76f => generated 784 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:42.521783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f8a53f0-0507-4659-bb27-6655bd85753d tempest-ListImagesTestJSON-1615042076 tempest-ListImagesTestJSON-1615042076-project] Calling method '.version_select at 0x7fb5696d8310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:42.585003 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1f8a53f0-0507-4659-bb27-6655bd85753d tempest-ListImagesTestJSON-1615042076 tempest-ListImagesTestJSON-1615042076-project] 10.222.0.58 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.066931 Aug 27 05:07:42.585874 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1599/3136] 10.222.0.58 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:42 2022] GET /compute/v2.1/images => generated 445 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:42.600249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fcf4f31c-3d3e-4240-97f6-888350d40862 tempest-ListImagesTestJSON-1615042076 tempest-ListImagesTestJSON-1615042076-project] Calling method '.version_select at 0x7fb5652de790>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:42.665053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a6588339-5b3d-498a-b22c-c45617b3fa47 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:42.665959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a6588339-5b3d-498a-b22c-c45617b3fa47 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:42.679468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6588339-5b3d-498a-b22c-c45617b3fa47 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:42.679980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6588339-5b3d-498a-b22c-c45617b3fa47 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:42.680432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6588339-5b3d-498a-b22c-c45617b3fa47 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:42.681150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6588339-5b3d-498a-b22c-c45617b3fa47 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:42.681666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6588339-5b3d-498a-b22c-c45617b3fa47 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:42.682026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6588339-5b3d-498a-b22c-c45617b3fa47 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:42.691660 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fcf4f31c-3d3e-4240-97f6-888350d40862 tempest-ListImagesTestJSON-1615042076 tempest-ListImagesTestJSON-1615042076-project] 10.222.0.58 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.095518 Aug 27 05:07:42.695138 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1538/3137] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 05:07:42 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:42.855877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a6588339-5b3d-498a-b22c-c45617b3fa47 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:42.864366 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a6588339-5b3d-498a-b22c-c45617b3fa47 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1317 microversion: 2.1 time: 0.203671 Aug 27 05:07:42.864950 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1600/3138] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:42 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:43.025699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6433de59-4589-4db3-897d-10750ce35431 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:43.026608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6433de59-4589-4db3-897d-10750ce35431 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:43.034486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6433de59-4589-4db3-897d-10750ce35431 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:43.034982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6433de59-4589-4db3-897d-10750ce35431 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:43.035454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6433de59-4589-4db3-897d-10750ce35431 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:43.036167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6433de59-4589-4db3-897d-10750ce35431 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:43.036688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6433de59-4589-4db3-897d-10750ce35431 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:43.037049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6433de59-4589-4db3-897d-10750ce35431 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:43.222543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7c535f03-6840-4a6e-a1cb-b26853f6dc27 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:43.223191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7c535f03-6840-4a6e-a1cb-b26853f6dc27 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:43.234712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c535f03-6840-4a6e-a1cb-b26853f6dc27 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:43.235465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c535f03-6840-4a6e-a1cb-b26853f6dc27 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:43.236260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c535f03-6840-4a6e-a1cb-b26853f6dc27 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:43.237192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c535f03-6840-4a6e-a1cb-b26853f6dc27 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:43.237815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c535f03-6840-4a6e-a1cb-b26853f6dc27 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:43.252981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c535f03-6840-4a6e-a1cb-b26853f6dc27 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:43.276704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6433de59-4589-4db3-897d-10750ce35431 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:43.295665 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6433de59-4589-4db3-897d-10750ce35431 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1529 microversion: 2.1 time: 0.274019 Aug 27 05:07:43.299726 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1539/3139] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:43 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1529 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:43.375268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7c535f03-6840-4a6e-a1cb-b26853f6dc27 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:43.390571 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7c535f03-6840-4a6e-a1cb-b26853f6dc27 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1282 microversion: 2.1 time: 0.172144 Aug 27 05:07:43.391703 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1601/3140] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:43 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:43.886480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d5e84bc-4c5d-492b-ac42-0c9e30d58023 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:43.887460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d5e84bc-4c5d-492b-ac42-0c9e30d58023 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:43.894528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5e84bc-4c5d-492b-ac42-0c9e30d58023 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:43.901075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5e84bc-4c5d-492b-ac42-0c9e30d58023 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:43.901881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5e84bc-4c5d-492b-ac42-0c9e30d58023 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:43.903603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5e84bc-4c5d-492b-ac42-0c9e30d58023 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:43.904372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5e84bc-4c5d-492b-ac42-0c9e30d58023 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:43.905469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5e84bc-4c5d-492b-ac42-0c9e30d58023 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:44.153615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d5e84bc-4c5d-492b-ac42-0c9e30d58023 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:44.172902 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d5e84bc-4c5d-492b-ac42-0c9e30d58023 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1317 microversion: 2.1 time: 0.292102 Aug 27 05:07:44.175186 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1540/3141] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:43 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:44.318096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e4329664-de0c-4edf-8220-c89e078e0502 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:44.319393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e4329664-de0c-4edf-8220-c89e078e0502 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:44.327843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4329664-de0c-4edf-8220-c89e078e0502 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:44.328807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4329664-de0c-4edf-8220-c89e078e0502 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:44.329426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4329664-de0c-4edf-8220-c89e078e0502 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:44.332779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4329664-de0c-4edf-8220-c89e078e0502 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:44.333647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4329664-de0c-4edf-8220-c89e078e0502 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:44.334270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4329664-de0c-4edf-8220-c89e078e0502 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:44.421552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fc9e588d-4fa2-43a3-8e2b-bdc6d12ba19b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:44.422452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fc9e588d-4fa2-43a3-8e2b-bdc6d12ba19b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:44.430258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc9e588d-4fa2-43a3-8e2b-bdc6d12ba19b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:44.431278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc9e588d-4fa2-43a3-8e2b-bdc6d12ba19b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:44.431893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc9e588d-4fa2-43a3-8e2b-bdc6d12ba19b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:44.432978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc9e588d-4fa2-43a3-8e2b-bdc6d12ba19b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:44.433607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc9e588d-4fa2-43a3-8e2b-bdc6d12ba19b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:44.434211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc9e588d-4fa2-43a3-8e2b-bdc6d12ba19b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:44.651567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fc9e588d-4fa2-43a3-8e2b-bdc6d12ba19b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:44.656904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e4329664-de0c-4edf-8220-c89e078e0502 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:44.668525 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e4329664-de0c-4edf-8220-c89e078e0502 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1529 microversion: 2.1 time: 0.355355 Aug 27 05:07:44.669971 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1602/3142] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:44 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1529 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:44.673514 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fc9e588d-4fa2-43a3-8e2b-bdc6d12ba19b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1312 microversion: 2.1 time: 0.256318 Aug 27 05:07:44.675923 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1541/3143] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:44 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:44.869796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5be15ec7-9726-4b77-b8b6-a92ccd5ddeb9 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Calling method '.version_select at 0x7fb56974f790>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:44.885509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be15ec7-9726-4b77-b8b6-a92ccd5ddeb9 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:44.886766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be15ec7-9726-4b77-b8b6-a92ccd5ddeb9 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:44.886899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be15ec7-9726-4b77-b8b6-a92ccd5ddeb9 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:44.888249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be15ec7-9726-4b77-b8b6-a92ccd5ddeb9 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:44.888940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be15ec7-9726-4b77-b8b6-a92ccd5ddeb9 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:44.889792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be15ec7-9726-4b77-b8b6-a92ccd5ddeb9 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:44.917366 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5be15ec7-9726-4b77-b8b6-a92ccd5ddeb9 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.245953 Aug 27 05:07:44.918713 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1603/3144] 10.222.0.58 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:44 2022] GET /compute/v2.1/limits => generated 511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:44.980818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad1cd45f-5318-4fea-b81f-18102cedc8e4 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-322712649", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:45.059128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-ad1cd45f-5318-4fea-b81f-18102cedc8e4 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:07:45.196804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-74f04e1f-782e-4d85-bd86-535e8bd582d3 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:45.197470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-74f04e1f-782e-4d85-bd86-535e8bd582d3 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:45.209080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74f04e1f-782e-4d85-bd86-535e8bd582d3 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:45.211274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74f04e1f-782e-4d85-bd86-535e8bd582d3 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:45.211949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74f04e1f-782e-4d85-bd86-535e8bd582d3 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:45.212717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74f04e1f-782e-4d85-bd86-535e8bd582d3 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:45.213277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74f04e1f-782e-4d85-bd86-535e8bd582d3 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:45.213711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74f04e1f-782e-4d85-bd86-535e8bd582d3 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:45.455872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ad1cd45f-5318-4fea-b81f-18102cedc8e4 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Getting quotas for project 677f6230028745c7bd771dc0b836bb71. Resources: dict_keys(['metadata_items']) {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:07:45.462604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ad1cd45f-5318-4fea-b81f-18102cedc8e4 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Getting quotas for user 8fa80682c6aa48e49c35373f5a4809fe and project 677f6230028745c7bd771dc0b836bb71. Resources: dict_keys(['metadata_items']) {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:07:45.476511 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-ad1cd45f-5318-4fea-b81f-18102cedc8e4 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad1cd45f-5318-4fea-b81f-18102cedc8e4 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Request method failure captured: Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 1751 Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaagasXaexDwEmuV10VY5f8RXvRa2VDDz4j0uQzSZPOD23WaM2J3K5F0ZgoEgCPCBOHsAd7Bor5G0mjWzfRImhWfn_OLRN4t6vnPO9JSATIm9Qn06sley59S1HXKSG7krU15ow3l8M6kaaLJKH56D-CLN8TnNzSpH_a67KZrKlY0uCE Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 677f6230028745c7bd771dc0b836bb71 Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2038968048 Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_677f6230028745c7bd771dc0b836bb71", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/677f6230028745c7bd771dc0b836bb71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/677f6230028745c7bd771dc0b836bb71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/677f6230028745c7bd771dc0b836bb71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2038968048 Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 677f6230028745c7bd771dc0b836bb71 Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2038968048 Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 8fa80682c6aa48e49c35373f5a4809fe Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-322712649", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:07:45.478795 n-d-820368-35 devstack@n-api.service[128547]: exception: Maximum number of metadata items exceeds 128 Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-322712649', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:07:45.481994 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad1cd45f-5318-4fea-b81f-18102cedc8e4 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ad1cd45f-5318-4fea-b81f-18102cedc8e4 tempest-AbsoluteLimitsNegativeTestJSON-2038968048 tempest-AbsoluteLimitsNegativeTestJSON-2038968048-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.507481 Aug 27 05:07:45.491980 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1542/3145] 10.222.0.58 () {60 vars in 1148 bytes} [Sat Aug 27 05:07:44 2022] POST /compute/v2.1/servers => generated 87 bytes in 510 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:07:45.495968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8d4c508e-71b4-44e0-b2f1-c252a86f3fc6 req-f80b5cf6-47a9-493f-9819-41aee8a497aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea", "tag": "856e3225-e60e-4434-b63d-6d6e70bf7364"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:45.496705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-74f04e1f-782e-4d85-bd86-535e8bd582d3 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:45.504780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8d4c508e-71b4-44e0-b2f1-c252a86f3fc6 req-f80b5cf6-47a9-493f-9819-41aee8a497aa service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:45.505259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8d4c508e-71b4-44e0-b2f1-c252a86f3fc6 req-f80b5cf6-47a9-493f-9819-41aee8a497aa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:45.505816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8d4c508e-71b4-44e0-b2f1-c252a86f3fc6 req-f80b5cf6-47a9-493f-9819-41aee8a497aa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:45.510811 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-74f04e1f-782e-4d85-bd86-535e8bd582d3 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1317 microversion: 2.1 time: 0.318405 Aug 27 05:07:45.511446 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1604/3146] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:45 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:45.525710 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8d4c508e-71b4-44e0-b2f1-c252a86f3fc6 req-f80b5cf6-47a9-493f-9819-41aee8a497aa service nova] Creating event network-changed:856e3225-e60e-4434-b63d-6d6e70bf7364 for instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea on n-h2-820368-35 Aug 27 05:07:45.532127 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8d4c508e-71b4-44e0-b2f1-c252a86f3fc6 req-f80b5cf6-47a9-493f-9819-41aee8a497aa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043678 Aug 27 05:07:45.534079 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1543/3147] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:45.690665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-31411a0b-e944-4089-9190-65edb68733a5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:45.691487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-31411a0b-e944-4089-9190-65edb68733a5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:45.697379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a982d181-00b1-4a92-b3af-16444aaecc8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:45.698074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a982d181-00b1-4a92-b3af-16444aaecc8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:45.699273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31411a0b-e944-4089-9190-65edb68733a5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:45.699947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31411a0b-e944-4089-9190-65edb68733a5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:45.700399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31411a0b-e944-4089-9190-65edb68733a5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:45.701105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31411a0b-e944-4089-9190-65edb68733a5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:45.701737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31411a0b-e944-4089-9190-65edb68733a5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:45.702172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31411a0b-e944-4089-9190-65edb68733a5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:45.714784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a982d181-00b1-4a92-b3af-16444aaecc8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:45.715327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a982d181-00b1-4a92-b3af-16444aaecc8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:45.715986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a982d181-00b1-4a92-b3af-16444aaecc8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:45.716879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a982d181-00b1-4a92-b3af-16444aaecc8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:45.717506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a982d181-00b1-4a92-b3af-16444aaecc8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:45.718109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a982d181-00b1-4a92-b3af-16444aaecc8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:45.990554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-31411a0b-e944-4089-9190-65edb68733a5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:45.998807 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-31411a0b-e944-4089-9190-65edb68733a5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1529 microversion: 2.1 time: 0.312702 Aug 27 05:07:46.019245 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1605/3148] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:45 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1529 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:46.022699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a982d181-00b1-4a92-b3af-16444aaecc8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:46.031041 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a982d181-00b1-4a92-b3af-16444aaecc8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1312 microversion: 2.1 time: 0.337844 Aug 27 05:07:46.040407 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1544/3149] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:45 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1312 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:46.536110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-244aba07-1f22-4cf5-8f09-af9bdc598d78 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:46.536110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-244aba07-1f22-4cf5-8f09-af9bdc598d78 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:46.545910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244aba07-1f22-4cf5-8f09-af9bdc598d78 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:46.546406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244aba07-1f22-4cf5-8f09-af9bdc598d78 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:46.546855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244aba07-1f22-4cf5-8f09-af9bdc598d78 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:46.547601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244aba07-1f22-4cf5-8f09-af9bdc598d78 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:46.548062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244aba07-1f22-4cf5-8f09-af9bdc598d78 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:46.548501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244aba07-1f22-4cf5-8f09-af9bdc598d78 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:46.696203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-d7c3bb67-adbf-4ee7-aeb6-3d3cc921aafa req-0b0bc1c1-4bb0-427a-a3ef-a21eec3713ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780d1d8c-aaf6-4d22-b37a-b48a881f9d77", "name": "network-vif-plugged", "status": "completed", "tag": "a4069830-52de-48c2-90d4-5c1ba86d69a4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:46.715772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d7c3bb67-adbf-4ee7-aeb6-3d3cc921aafa req-0b0bc1c1-4bb0-427a-a3ef-a21eec3713ef service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:46.716368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d7c3bb67-adbf-4ee7-aeb6-3d3cc921aafa req-0b0bc1c1-4bb0-427a-a3ef-a21eec3713ef service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:46.716915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d7c3bb67-adbf-4ee7-aeb6-3d3cc921aafa req-0b0bc1c1-4bb0-427a-a3ef-a21eec3713ef service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:46.726693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-244aba07-1f22-4cf5-8f09-af9bdc598d78 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:46.735509 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-244aba07-1f22-4cf5-8f09-af9bdc598d78 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1317 microversion: 2.1 time: 0.204233 Aug 27 05:07:46.738591 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1606/3150] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:46 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:46.754990 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-d7c3bb67-adbf-4ee7-aeb6-3d3cc921aafa req-0b0bc1c1-4bb0-427a-a3ef-a21eec3713ef service nova] Creating event network-vif-plugged:a4069830-52de-48c2-90d4-5c1ba86d69a4 for instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 on n-h1-820368-35 Aug 27 05:07:46.762954 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-d7c3bb67-adbf-4ee7-aeb6-3d3cc921aafa req-0b0bc1c1-4bb0-427a-a3ef-a21eec3713ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070589 Aug 27 05:07:46.764403 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1545/3151] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:07:47.025122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5453cac5-0396-4a3d-bf06-f2ece0760c0f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:47.025752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5453cac5-0396-4a3d-bf06-f2ece0760c0f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:47.033194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5453cac5-0396-4a3d-bf06-f2ece0760c0f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.034233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5453cac5-0396-4a3d-bf06-f2ece0760c0f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.034866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5453cac5-0396-4a3d-bf06-f2ece0760c0f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.035663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5453cac5-0396-4a3d-bf06-f2ece0760c0f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.036077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5453cac5-0396-4a3d-bf06-f2ece0760c0f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.036514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5453cac5-0396-4a3d-bf06-f2ece0760c0f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.054576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2d0a5ce2-90a9-45d9-b925-37dd75ac7dae tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:47.056851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2d0a5ce2-90a9-45d9-b925-37dd75ac7dae tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:47.066621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d0a5ce2-90a9-45d9-b925-37dd75ac7dae tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.067282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d0a5ce2-90a9-45d9-b925-37dd75ac7dae tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.067835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d0a5ce2-90a9-45d9-b925-37dd75ac7dae tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.068607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d0a5ce2-90a9-45d9-b925-37dd75ac7dae tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.069320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d0a5ce2-90a9-45d9-b925-37dd75ac7dae tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.069814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d0a5ce2-90a9-45d9-b925-37dd75ac7dae tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.272408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5453cac5-0396-4a3d-bf06-f2ece0760c0f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:47.280741 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5453cac5-0396-4a3d-bf06-f2ece0760c0f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1529 microversion: 2.1 time: 0.259420 Aug 27 05:07:47.281852 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1607/3152] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:47 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1529 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:47.310309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2d0a5ce2-90a9-45d9-b925-37dd75ac7dae tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:47.320283 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2d0a5ce2-90a9-45d9-b925-37dd75ac7dae tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1312 microversion: 2.1 time: 0.271183 Aug 27 05:07:47.321616 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1546/3153] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:47 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1312 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:47.577652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1608337843", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "9d336da5-0dff-4839-91a6-65c81c8c07a9"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:47.633572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] validate_networks() for [('9d336da5-0dff-4839-91a6-65c81c8c07a9', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:07:47.759353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-255c9fce-c0d5-4505-ae1e-60649b57b033 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:47.760866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-255c9fce-c0d5-4505-ae1e-60649b57b033 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:47.771352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255c9fce-c0d5-4505-ae1e-60649b57b033 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.772253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255c9fce-c0d5-4505-ae1e-60649b57b033 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.772756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255c9fce-c0d5-4505-ae1e-60649b57b033 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.774323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255c9fce-c0d5-4505-ae1e-60649b57b033 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.774804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255c9fce-c0d5-4505-ae1e-60649b57b033 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.776109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-255c9fce-c0d5-4505-ae1e-60649b57b033 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:48.086454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-255c9fce-c0d5-4505-ae1e-60649b57b033 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:48.095112 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-255c9fce-c0d5-4505-ae1e-60649b57b033 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1317 microversion: 2.1 time: 0.340399 Aug 27 05:07:48.095687 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1547/3154] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:47 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:48.310388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cc880d43-4e66-4a0f-a1d0-6f94fb24e3de tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:48.311080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cc880d43-4e66-4a0f-a1d0-6f94fb24e3de tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:48.317778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc880d43-4e66-4a0f-a1d0-6f94fb24e3de tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:48.318290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc880d43-4e66-4a0f-a1d0-6f94fb24e3de tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:48.318983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc880d43-4e66-4a0f-a1d0-6f94fb24e3de tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:48.319889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc880d43-4e66-4a0f-a1d0-6f94fb24e3de tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:48.320464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc880d43-4e66-4a0f-a1d0-6f94fb24e3de tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:48.320912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc880d43-4e66-4a0f-a1d0-6f94fb24e3de tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:48.328127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:07:48.328946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:07:48.329513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:07:48.330029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:07:48.330647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:07:48.342162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:48.342848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:48.343388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:48.344319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:48.344802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:48.345366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:48.366870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Getting quotas for project a52a4949c7c74e60b345a30ffb6fd495. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:07:48.373007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Getting quotas for user 0041a7908e8141c6be225f5e8769bfb2 and project a52a4949c7c74e60b345a30ffb6fd495. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:07:48.403757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:07:48.406441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:07:48.470594 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ed8409fa-d2db-4632-81e7-0c1dea11a627 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896436 Aug 27 05:07:48.479105 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1608/3155] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:07:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:07:48.488217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a6f9fe90-65f0-4611-bdce-16e09139244c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:48.489298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a6f9fe90-65f0-4611-bdce-16e09139244c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:48.499886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6f9fe90-65f0-4611-bdce-16e09139244c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:48.501003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6f9fe90-65f0-4611-bdce-16e09139244c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:48.503110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6f9fe90-65f0-4611-bdce-16e09139244c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:48.505330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6f9fe90-65f0-4611-bdce-16e09139244c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:48.506594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6f9fe90-65f0-4611-bdce-16e09139244c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:48.507263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6f9fe90-65f0-4611-bdce-16e09139244c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:48.523009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cc880d43-4e66-4a0f-a1d0-6f94fb24e3de tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:48.537842 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cc880d43-4e66-4a0f-a1d0-6f94fb24e3de tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1529 microversion: 2.1 time: 0.231171 Aug 27 05:07:48.547672 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1548/3156] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:48 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1529 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:48.559789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c04ea091-8e6c-4b7a-bd85-fb47f6d60259 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:48.560774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c04ea091-8e6c-4b7a-bd85-fb47f6d60259 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:48.677141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c04ea091-8e6c-4b7a-bd85-fb47f6d60259 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:48.687360 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c04ea091-8e6c-4b7a-bd85-fb47f6d60259 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1214 microversion: 2.1 time: 0.138492 Aug 27 05:07:48.690223 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1549/3157] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:48 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:48.805848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-16a84a17-a5a5-4674-9194-494609487951 req-6beb076f-a967-46db-b687-5af8b6f4dff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44343fc-7c5a-46ab-9e82-d3a53c84db32", "name": "network-vif-plugged", "status": "completed", "tag": "77c2a8a3-c2c8-4e20-bbed-1ff085255d80"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:48.835343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-16a84a17-a5a5-4674-9194-494609487951 req-6beb076f-a967-46db-b687-5af8b6f4dff6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:48.848418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-16a84a17-a5a5-4674-9194-494609487951 req-6beb076f-a967-46db-b687-5af8b6f4dff6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:48.848418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-16a84a17-a5a5-4674-9194-494609487951 req-6beb076f-a967-46db-b687-5af8b6f4dff6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:48.871559 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-16a84a17-a5a5-4674-9194-494609487951 req-6beb076f-a967-46db-b687-5af8b6f4dff6 service nova] Creating event network-vif-plugged:77c2a8a3-c2c8-4e20-bbed-1ff085255d80 for instance b44343fc-7c5a-46ab-9e82-d3a53c84db32 on n-h2-820368-35 Aug 27 05:07:48.886760 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-16a84a17-a5a5-4674-9194-494609487951 req-6beb076f-a967-46db-b687-5af8b6f4dff6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085920 Aug 27 05:07:48.887910 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1550/3158] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:49.119408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d2180bc8-910e-4216-902b-69da1e189a6c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:49.120118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d2180bc8-910e-4216-902b-69da1e189a6c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:49.140834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2180bc8-910e-4216-902b-69da1e189a6c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:49.141332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2180bc8-910e-4216-902b-69da1e189a6c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:49.141773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2180bc8-910e-4216-902b-69da1e189a6c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:49.142495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2180bc8-910e-4216-902b-69da1e189a6c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:49.143559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2180bc8-910e-4216-902b-69da1e189a6c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:49.143953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2180bc8-910e-4216-902b-69da1e189a6c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:49.347436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a6f9fe90-65f0-4611-bdce-16e09139244c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:49.356436 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a6f9fe90-65f0-4611-bdce-16e09139244c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1312 microversion: 2.1 time: 0.875680 Aug 27 05:07:49.359686 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1609/3159] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:48 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1312 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:49.505951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d2180bc8-910e-4216-902b-69da1e189a6c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:49.515791 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d2180bc8-910e-4216-902b-69da1e189a6c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1317 microversion: 2.1 time: 0.403012 Aug 27 05:07:49.517487 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1551/3160] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:49 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:49.561723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ec733ec-97f3-4768-8410-4bcd6940fae0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:49.562818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0ec733ec-97f3-4768-8410-4bcd6940fae0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:49.577221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ec733ec-97f3-4768-8410-4bcd6940fae0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:49.577791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ec733ec-97f3-4768-8410-4bcd6940fae0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:49.578260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ec733ec-97f3-4768-8410-4bcd6940fae0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:49.579014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ec733ec-97f3-4768-8410-4bcd6940fae0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:49.584786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ec733ec-97f3-4768-8410-4bcd6940fae0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:49.585482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ec733ec-97f3-4768-8410-4bcd6940fae0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:49.709845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-072a9aab-00a2-4c9c-a885-5b91be3d5bc8 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:49.710801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-072a9aab-00a2-4c9c-a885-5b91be3d5bc8 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:49.721406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-072a9aab-00a2-4c9c-a885-5b91be3d5bc8 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:49.722193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-072a9aab-00a2-4c9c-a885-5b91be3d5bc8 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:49.723256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-072a9aab-00a2-4c9c-a885-5b91be3d5bc8 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:49.724153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-072a9aab-00a2-4c9c-a885-5b91be3d5bc8 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:49.726174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-072a9aab-00a2-4c9c-a885-5b91be3d5bc8 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:49.728083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-072a9aab-00a2-4c9c-a885-5b91be3d5bc8 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:49.912997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-072a9aab-00a2-4c9c-a885-5b91be3d5bc8 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:49.926174 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-072a9aab-00a2-4c9c-a885-5b91be3d5bc8 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1266 microversion: 2.1 time: 0.220069 Aug 27 05:07:49.927007 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1552/3161] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:49 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:49.949010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0ec733ec-97f3-4768-8410-4bcd6940fae0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:49.960946 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ec733ec-97f3-4768-8410-4bcd6940fae0 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1524 microversion: 2.1 time: 0.403770 Aug 27 05:07:49.962147 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1610/3162] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:49 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1524 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:50.391741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d01f5203-3bf5-4292-98a8-ae969f45af8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:50.392373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d01f5203-3bf5-4292-98a8-ae969f45af8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:50.401520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d01f5203-3bf5-4292-98a8-ae969f45af8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:50.402315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d01f5203-3bf5-4292-98a8-ae969f45af8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:50.402939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d01f5203-3bf5-4292-98a8-ae969f45af8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:50.403956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d01f5203-3bf5-4292-98a8-ae969f45af8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:50.405162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d01f5203-3bf5-4292-98a8-ae969f45af8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:50.405791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d01f5203-3bf5-4292-98a8-ae969f45af8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:50.539067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-008ba676-cac0-45bd-aff9-76635feee216 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:50.540729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-008ba676-cac0-45bd-aff9-76635feee216 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:50.560988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-008ba676-cac0-45bd-aff9-76635feee216 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:50.567549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-008ba676-cac0-45bd-aff9-76635feee216 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:50.568768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-008ba676-cac0-45bd-aff9-76635feee216 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:50.569980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-008ba676-cac0-45bd-aff9-76635feee216 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:50.570453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-008ba676-cac0-45bd-aff9-76635feee216 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:50.571073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-008ba676-cac0-45bd-aff9-76635feee216 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:50.647586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d01f5203-3bf5-4292-98a8-ae969f45af8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:50.659433 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d01f5203-3bf5-4292-98a8-ae969f45af8e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1312 microversion: 2.1 time: 0.280293 Aug 27 05:07:50.660655 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1553/3163] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:50 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1312 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:50.852244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-008ba676-cac0-45bd-aff9-76635feee216 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:50.866566 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-008ba676-cac0-45bd-aff9-76635feee216 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1317 microversion: 2.1 time: 0.328122 Aug 27 05:07:50.884872 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1611/3164] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:50 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:50.951490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f19a04e7-8a3c-45e7-8d99-8686d6a6fb6a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:50.952901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f19a04e7-8a3c-45e7-8d99-8686d6a6fb6a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:50.984317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13d7f4b8-160d-4adf-9a5e-b3e2087c65cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:50.985272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-13d7f4b8-160d-4adf-9a5e-b3e2087c65cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:50.991159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19a04e7-8a3c-45e7-8d99-8686d6a6fb6a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:50.992318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19a04e7-8a3c-45e7-8d99-8686d6a6fb6a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:51.007428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19a04e7-8a3c-45e7-8d99-8686d6a6fb6a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:51.011853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19a04e7-8a3c-45e7-8d99-8686d6a6fb6a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:51.013778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19a04e7-8a3c-45e7-8d99-8686d6a6fb6a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:51.015640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19a04e7-8a3c-45e7-8d99-8686d6a6fb6a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:51.015930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13d7f4b8-160d-4adf-9a5e-b3e2087c65cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:51.018976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13d7f4b8-160d-4adf-9a5e-b3e2087c65cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:51.020067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13d7f4b8-160d-4adf-9a5e-b3e2087c65cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:51.028055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13d7f4b8-160d-4adf-9a5e-b3e2087c65cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:51.035341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13d7f4b8-160d-4adf-9a5e-b3e2087c65cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:51.036147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13d7f4b8-160d-4adf-9a5e-b3e2087c65cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:51.144853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:51.315973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f19a04e7-8a3c-45e7-8d99-8686d6a6fb6a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:51.325008 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f19a04e7-8a3c-45e7-8d99-8686d6a6fb6a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1266 microversion: 2.1 time: 0.379014 Aug 27 05:07:51.325605 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1554/3165] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:50 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1266 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:51.378200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13d7f4b8-160d-4adf-9a5e-b3e2087c65cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:51.412889 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-13d7f4b8-160d-4adf-9a5e-b3e2087c65cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1524 microversion: 2.1 time: 0.431375 Aug 27 05:07:51.431946 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1612/3166] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:50 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1524 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:51.682159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9ad0e076-9474-44d2-84c4-7e06cf07208a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:51.682782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9ad0e076-9474-44d2-84c4-7e06cf07208a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:51.696484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ad0e076-9474-44d2-84c4-7e06cf07208a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:51.697047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ad0e076-9474-44d2-84c4-7e06cf07208a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:51.697707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ad0e076-9474-44d2-84c4-7e06cf07208a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:51.699344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ad0e076-9474-44d2-84c4-7e06cf07208a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:51.700593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ad0e076-9474-44d2-84c4-7e06cf07208a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:51.703701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ad0e076-9474-44d2-84c4-7e06cf07208a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:51.898414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7bb111ba-7092-494e-8678-912103a84845 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:51.899288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7bb111ba-7092-494e-8678-912103a84845 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:51.911238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb111ba-7092-494e-8678-912103a84845 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:51.927358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb111ba-7092-494e-8678-912103a84845 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:51.931191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb111ba-7092-494e-8678-912103a84845 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:51.932379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb111ba-7092-494e-8678-912103a84845 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:51.935706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb111ba-7092-494e-8678-912103a84845 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:51.937080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7bb111ba-7092-494e-8678-912103a84845 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.012659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9ad0e076-9474-44d2-84c4-7e06cf07208a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:52.024978 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9ad0e076-9474-44d2-84c4-7e06cf07208a tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1312 microversion: 2.1 time: 0.347343 Aug 27 05:07:52.031106 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1555/3167] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:51 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:52.182375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7bb111ba-7092-494e-8678-912103a84845 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:52.214402 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7bb111ba-7092-494e-8678-912103a84845 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1506 microversion: 2.1 time: 0.323421 Aug 27 05:07:52.215149 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1613/3168] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:51 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:52.237359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7a941cca-f907-441e-a9ae-c8796a2bb769 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:52.238392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7a941cca-f907-441e-a9ae-c8796a2bb769 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:52.245470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a941cca-f907-441e-a9ae-c8796a2bb769 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.246445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a941cca-f907-441e-a9ae-c8796a2bb769 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.247196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a941cca-f907-441e-a9ae-c8796a2bb769 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.248290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a941cca-f907-441e-a9ae-c8796a2bb769 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.248977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a941cca-f907-441e-a9ae-c8796a2bb769 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.249634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a941cca-f907-441e-a9ae-c8796a2bb769 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.288050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7a941cca-f907-441e-a9ae-c8796a2bb769 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:52.289558 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7a941cca-f907-441e-a9ae-c8796a2bb769 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32/os-instance-actions/req-88ac2cb5-72d7-4799-8e73-f70b01931280" status: 200 len: 313 microversion: 2.1 time: 0.056563 Aug 27 05:07:52.290766 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1556/3169] 10.222.0.58 () {58 vars in 1419 bytes} [Sat Aug 27 05:07:52 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32/os-instance-actions/req-88ac2cb5-72d7-4799-8e73-f70b01931280 => generated 313 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:52.306220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2350baf2-4ffa-4340-87b6-ab1b407b0f99 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:52.308739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2350baf2-4ffa-4340-87b6-ab1b407b0f99 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:52.315375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2350baf2-4ffa-4340-87b6-ab1b407b0f99 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.316183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2350baf2-4ffa-4340-87b6-ab1b407b0f99 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.316828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2350baf2-4ffa-4340-87b6-ab1b407b0f99 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.317760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2350baf2-4ffa-4340-87b6-ab1b407b0f99 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.318426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2350baf2-4ffa-4340-87b6-ab1b407b0f99 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.319059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2350baf2-4ffa-4340-87b6-ab1b407b0f99 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.347903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9f848c11-0609-462a-b133-59ab344e74e5 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:52.348898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9f848c11-0609-462a-b133-59ab344e74e5 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:52.359047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f848c11-0609-462a-b133-59ab344e74e5 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.359512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f848c11-0609-462a-b133-59ab344e74e5 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.360145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f848c11-0609-462a-b133-59ab344e74e5 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.361145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f848c11-0609-462a-b133-59ab344e74e5 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.362502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f848c11-0609-462a-b133-59ab344e74e5 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.363265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f848c11-0609-462a-b133-59ab344e74e5 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.479310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9f848c11-0609-462a-b133-59ab344e74e5 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:52.491273 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9f848c11-0609-462a-b133-59ab344e74e5 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1272 microversion: 2.1 time: 0.148272 Aug 27 05:07:52.503491 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2350baf2-4ffa-4340-87b6-ab1b407b0f99 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "POST /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32/action" status: 202 len: 0 microversion: 2.1 time: 0.199318 Aug 27 05:07:52.503491 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1614/3170] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:07:52 2022] POST /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:07:52.504842 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1557/3171] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:52 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:52.517705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-81a866ec-3510-43a9-a2e6-896f11af5110 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:52.518839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba1a4522-e350-407f-9c78-11fa7c00ffe9 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:52.519328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-81a866ec-3510-43a9-a2e6-896f11af5110 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:52.519957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba1a4522-e350-407f-9c78-11fa7c00ffe9 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:52.533042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81a866ec-3510-43a9-a2e6-896f11af5110 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.534618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81a866ec-3510-43a9-a2e6-896f11af5110 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.535224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81a866ec-3510-43a9-a2e6-896f11af5110 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.536492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81a866ec-3510-43a9-a2e6-896f11af5110 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.537059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba1a4522-e350-407f-9c78-11fa7c00ffe9 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.537704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba1a4522-e350-407f-9c78-11fa7c00ffe9 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.538158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba1a4522-e350-407f-9c78-11fa7c00ffe9 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.539650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba1a4522-e350-407f-9c78-11fa7c00ffe9 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.540631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba1a4522-e350-407f-9c78-11fa7c00ffe9 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.540760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba1a4522-e350-407f-9c78-11fa7c00ffe9 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.541329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81a866ec-3510-43a9-a2e6-896f11af5110 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.542060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81a866ec-3510-43a9-a2e6-896f11af5110 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.577319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:52.903447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-81a866ec-3510-43a9-a2e6-896f11af5110 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:52.923998 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-81a866ec-3510-43a9-a2e6-896f11af5110 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1524 microversion: 2.1 time: 0.417224 Aug 27 05:07:52.925707 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1615/3172] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:52 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1524 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:52.933893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-8a2dff54-ac5d-4814-96ae-11bf4c47dcee req-d236cebd-c66b-492c-94ee-506ff83c6591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea", "name": "network-vif-plugged", "status": "completed", "tag": "856e3225-e60e-4434-b63d-6d6e70bf7364"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:52.943966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ba1a4522-e350-407f-9c78-11fa7c00ffe9 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:52.946834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8a2dff54-ac5d-4814-96ae-11bf4c47dcee req-d236cebd-c66b-492c-94ee-506ff83c6591 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.947566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8a2dff54-ac5d-4814-96ae-11bf4c47dcee req-d236cebd-c66b-492c-94ee-506ff83c6591 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.948222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8a2dff54-ac5d-4814-96ae-11bf4c47dcee req-d236cebd-c66b-492c-94ee-506ff83c6591 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.957077 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba1a4522-e350-407f-9c78-11fa7c00ffe9 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1508 microversion: 2.1 time: 0.446355 Aug 27 05:07:52.958645 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1558/3173] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:52 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1508 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:52.972863 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-8a2dff54-ac5d-4814-96ae-11bf4c47dcee req-d236cebd-c66b-492c-94ee-506ff83c6591 service nova] Creating event network-vif-plugged:856e3225-e60e-4434-b63d-6d6e70bf7364 for instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea on n-h2-820368-35 Aug 27 05:07:52.979002 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-8a2dff54-ac5d-4814-96ae-11bf4c47dcee req-d236cebd-c66b-492c-94ee-506ff83c6591 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051809 Aug 27 05:07:52.980184 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1616/3174] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:53.060465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-433a8d7f-14eb-4219-8583-44ae54954cdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:53.061098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-433a8d7f-14eb-4219-8583-44ae54954cdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:53.069871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433a8d7f-14eb-4219-8583-44ae54954cdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:53.070369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433a8d7f-14eb-4219-8583-44ae54954cdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:53.073245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433a8d7f-14eb-4219-8583-44ae54954cdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:53.074229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433a8d7f-14eb-4219-8583-44ae54954cdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:53.074856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433a8d7f-14eb-4219-8583-44ae54954cdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:53.076156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433a8d7f-14eb-4219-8583-44ae54954cdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:53.308159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-433a8d7f-14eb-4219-8583-44ae54954cdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:53.317894 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-433a8d7f-14eb-4219-8583-44ae54954cdd tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1312 microversion: 2.1 time: 0.263867 Aug 27 05:07:53.335198 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1559/3175] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:53 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:53.520013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cd20ba2c-a8c3-4a96-8a29-d3c86e4e82de tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:53.528459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cd20ba2c-a8c3-4a96-8a29-d3c86e4e82de tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:53.556079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd20ba2c-a8c3-4a96-8a29-d3c86e4e82de tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:53.560708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd20ba2c-a8c3-4a96-8a29-d3c86e4e82de tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:53.561450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd20ba2c-a8c3-4a96-8a29-d3c86e4e82de tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:53.563260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd20ba2c-a8c3-4a96-8a29-d3c86e4e82de tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:53.563969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd20ba2c-a8c3-4a96-8a29-d3c86e4e82de tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:53.566853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd20ba2c-a8c3-4a96-8a29-d3c86e4e82de tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:53.836960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cd20ba2c-a8c3-4a96-8a29-d3c86e4e82de tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:53.851416 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cd20ba2c-a8c3-4a96-8a29-d3c86e4e82de tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1272 microversion: 2.1 time: 0.339308 Aug 27 05:07:53.852219 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1617/3176] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:53 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1272 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:53.946774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e3bd20d-f1fb-4eae-9d17-a25f055b8f29 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:53.947859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e3bd20d-f1fb-4eae-9d17-a25f055b8f29 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:53.962959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e3bd20d-f1fb-4eae-9d17-a25f055b8f29 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:53.971605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e3bd20d-f1fb-4eae-9d17-a25f055b8f29 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:53.974609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e3bd20d-f1fb-4eae-9d17-a25f055b8f29 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:53.975706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e3bd20d-f1fb-4eae-9d17-a25f055b8f29 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:53.976410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e3bd20d-f1fb-4eae-9d17-a25f055b8f29 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:53.979141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e3bd20d-f1fb-4eae-9d17-a25f055b8f29 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:53.979915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4d36f0c3-4cc7-46ed-b8a4-3c1f3027a507 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:53.980543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4d36f0c3-4cc7-46ed-b8a4-3c1f3027a507 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:53.992071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d36f0c3-4cc7-46ed-b8a4-3c1f3027a507 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:53.992566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d36f0c3-4cc7-46ed-b8a4-3c1f3027a507 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:53.994738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d36f0c3-4cc7-46ed-b8a4-3c1f3027a507 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:53.998361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d36f0c3-4cc7-46ed-b8a4-3c1f3027a507 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:54.001214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d36f0c3-4cc7-46ed-b8a4-3c1f3027a507 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:54.002158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d36f0c3-4cc7-46ed-b8a4-3c1f3027a507 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:54.457984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4d36f0c3-4cc7-46ed-b8a4-3c1f3027a507 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:54.477198 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4d36f0c3-4cc7-46ed-b8a4-3c1f3027a507 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1508 microversion: 2.1 time: 0.501135 Aug 27 05:07:54.490671 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1618/3177] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:53 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:54.495166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-422dd568-d198-4121-82da-e12198b5f0fc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:54.495797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-422dd568-d198-4121-82da-e12198b5f0fc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:54.510992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-422dd568-d198-4121-82da-e12198b5f0fc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:54.511537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-422dd568-d198-4121-82da-e12198b5f0fc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:54.511984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-422dd568-d198-4121-82da-e12198b5f0fc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:54.512702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-422dd568-d198-4121-82da-e12198b5f0fc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:54.513163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-422dd568-d198-4121-82da-e12198b5f0fc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:54.513595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-422dd568-d198-4121-82da-e12198b5f0fc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:54.553062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e3bd20d-f1fb-4eae-9d17-a25f055b8f29 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:54.570047 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e3bd20d-f1fb-4eae-9d17-a25f055b8f29 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1524 microversion: 2.1 time: 0.627812 Aug 27 05:07:54.575993 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1560/3178] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:53 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1524 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:54.872694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-096940ac-3e7c-4815-ac60-a1aa35ce980e tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:54.873487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-096940ac-3e7c-4815-ac60-a1aa35ce980e tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:54.898047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096940ac-3e7c-4815-ac60-a1aa35ce980e tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:54.904559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096940ac-3e7c-4815-ac60-a1aa35ce980e tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:54.910159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096940ac-3e7c-4815-ac60-a1aa35ce980e tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:54.913148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096940ac-3e7c-4815-ac60-a1aa35ce980e tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:54.929893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096940ac-3e7c-4815-ac60-a1aa35ce980e tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:54.931401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096940ac-3e7c-4815-ac60-a1aa35ce980e tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:55.915031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-422dd568-d198-4121-82da-e12198b5f0fc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:55.925818 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-422dd568-d198-4121-82da-e12198b5f0fc tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1312 microversion: 2.1 time: 1.446507 Aug 27 05:07:55.926385 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1619/3179] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:54 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1312 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:55.938336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-232b84ac-d0d3-42c9-b1de-1a3f903e5e0a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:55.938883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-232b84ac-d0d3-42c9-b1de-1a3f903e5e0a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:55.964086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b84ac-d0d3-42c9-b1de-1a3f903e5e0a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:55.965359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b84ac-d0d3-42c9-b1de-1a3f903e5e0a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:55.966566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b84ac-d0d3-42c9-b1de-1a3f903e5e0a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:55.967366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b84ac-d0d3-42c9-b1de-1a3f903e5e0a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:55.967836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b84ac-d0d3-42c9-b1de-1a3f903e5e0a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:55.968270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b84ac-d0d3-42c9-b1de-1a3f903e5e0a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:56.079585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-096940ac-3e7c-4815-ac60-a1aa35ce980e tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:56.100027 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-096940ac-3e7c-4815-ac60-a1aa35ce980e tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1314 microversion: 2.1 time: 1.231178 Aug 27 05:07:56.101433 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1561/3180] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:54 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1314 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:56.116480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3cffb7b9-b0e3-4b20-b1e4-14ca0549dbdb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:56.118177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3cffb7b9-b0e3-4b20-b1e4-14ca0549dbdb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:56.136760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffb7b9-b0e3-4b20-b1e4-14ca0549dbdb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:56.137679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffb7b9-b0e3-4b20-b1e4-14ca0549dbdb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:56.138447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffb7b9-b0e3-4b20-b1e4-14ca0549dbdb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:56.139824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffb7b9-b0e3-4b20-b1e4-14ca0549dbdb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:56.140514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffb7b9-b0e3-4b20-b1e4-14ca0549dbdb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:56.141261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cffb7b9-b0e3-4b20-b1e4-14ca0549dbdb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:56.636632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-232b84ac-d0d3-42c9-b1de-1a3f903e5e0a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:56.654423 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-232b84ac-d0d3-42c9-b1de-1a3f903e5e0a tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1506 microversion: 2.1 time: 0.723498 Aug 27 05:07:56.655347 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1620/3181] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:55 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1506 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:56.675788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6c92ace3-f132-4dfe-97ce-d33f4badb4a3 req-09e27f0f-c212-45c8-a49e-52d4b5d67f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90344fdd-65fb-471a-ac62-b816bf3936b2", "tag": "19c7fe58-2cb0-4b71-bef6-9dafff9de477"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:56.703961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6c92ace3-f132-4dfe-97ce-d33f4badb4a3 req-09e27f0f-c212-45c8-a49e-52d4b5d67f9c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:56.706040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6c92ace3-f132-4dfe-97ce-d33f4badb4a3 req-09e27f0f-c212-45c8-a49e-52d4b5d67f9c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:56.708255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6c92ace3-f132-4dfe-97ce-d33f4badb4a3 req-09e27f0f-c212-45c8-a49e-52d4b5d67f9c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:56.742770 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6c92ace3-f132-4dfe-97ce-d33f4badb4a3 req-09e27f0f-c212-45c8-a49e-52d4b5d67f9c service nova] Creating event network-changed:19c7fe58-2cb0-4b71-bef6-9dafff9de477 for instance 90344fdd-65fb-471a-ac62-b816bf3936b2 on n-h2-820368-35 Aug 27 05:07:56.768490 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6c92ace3-f132-4dfe-97ce-d33f4badb4a3 req-09e27f0f-c212-45c8-a49e-52d4b5d67f9c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110966 Aug 27 05:07:56.774850 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1621/3182] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:56.787958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd93ab20-72d5-4ce7-baaa-7e43375db53d tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '.version_select at 0x7fb569698f70>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:56.790748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd93ab20-72d5-4ce7-baaa-7e43375db53d tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:56.803985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd93ab20-72d5-4ce7-baaa-7e43375db53d tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:56.804905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd93ab20-72d5-4ce7-baaa-7e43375db53d tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:56.805330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd93ab20-72d5-4ce7-baaa-7e43375db53d tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:56.807721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd93ab20-72d5-4ce7-baaa-7e43375db53d tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:56.808860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd93ab20-72d5-4ce7-baaa-7e43375db53d tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:56.809474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd93ab20-72d5-4ce7-baaa-7e43375db53d tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:56.869334 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd93ab20-72d5-4ce7-baaa-7e43375db53d tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.092134 Aug 27 05:07:56.870218 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1622/3183] 10.222.0.58 () {58 vars in 1296 bytes} [Sat Aug 27 05:07:56 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32/os-instance-actions => generated 611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:56.885647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-11bdf80c-9f64-4356-8f12-e18277afad6e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:56.887599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-11bdf80c-9f64-4356-8f12-e18277afad6e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:56.897914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11bdf80c-9f64-4356-8f12-e18277afad6e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:56.898633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11bdf80c-9f64-4356-8f12-e18277afad6e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:56.899285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11bdf80c-9f64-4356-8f12-e18277afad6e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:56.900188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11bdf80c-9f64-4356-8f12-e18277afad6e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:56.900842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11bdf80c-9f64-4356-8f12-e18277afad6e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:56.901450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11bdf80c-9f64-4356-8f12-e18277afad6e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:56.947827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-11bdf80c-9f64-4356-8f12-e18277afad6e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:07:57.058334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3cffb7b9-b0e3-4b20-b1e4-14ca0549dbdb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:57.062658 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-11bdf80c-9f64-4356-8f12-e18277afad6e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 204 len: 0 microversion: 2.1 time: 0.181921 Aug 27 05:07:57.065801 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1623/3184] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:07:56 2022] DELETE /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:07:57.069608 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3cffb7b9-b0e3-4b20-b1e4-14ca0549dbdb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1524 microversion: 2.1 time: 0.965995 Aug 27 05:07:57.070190 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1562/3185] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:56 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1524 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:57.079217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a5f8147e-00dc-458d-955a-b96fec66f09b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:57.079982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a5f8147e-00dc-458d-955a-b96fec66f09b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:57.081058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-488218c2-1032-408c-ae50-a37a9b6f5224 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:57.082182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-488218c2-1032-408c-ae50-a37a9b6f5224 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:57.094627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-488218c2-1032-408c-ae50-a37a9b6f5224 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:57.095404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-488218c2-1032-408c-ae50-a37a9b6f5224 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:57.096067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-488218c2-1032-408c-ae50-a37a9b6f5224 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:57.097613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-488218c2-1032-408c-ae50-a37a9b6f5224 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:57.098855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5f8147e-00dc-458d-955a-b96fec66f09b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:57.099194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-488218c2-1032-408c-ae50-a37a9b6f5224 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:57.099823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-488218c2-1032-408c-ae50-a37a9b6f5224 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:57.101648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5f8147e-00dc-458d-955a-b96fec66f09b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:57.103154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5f8147e-00dc-458d-955a-b96fec66f09b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:57.105215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5f8147e-00dc-458d-955a-b96fec66f09b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:57.106564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5f8147e-00dc-458d-955a-b96fec66f09b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:57.108538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5f8147e-00dc-458d-955a-b96fec66f09b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:58.073831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-488218c2-1032-408c-ae50-a37a9b6f5224 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:58.091055 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-488218c2-1032-408c-ae50-a37a9b6f5224 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1512 microversion: 2.1 time: 1.018054 Aug 27 05:07:58.093902 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1563/3186] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:57 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1512 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:58.103802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8aca1e47-75fd-4ff1-a86d-4f073d226635 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:58.104871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8aca1e47-75fd-4ff1-a86d-4f073d226635 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:58.118924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aca1e47-75fd-4ff1-a86d-4f073d226635 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:58.119749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aca1e47-75fd-4ff1-a86d-4f073d226635 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:58.121141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aca1e47-75fd-4ff1-a86d-4f073d226635 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:58.122184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aca1e47-75fd-4ff1-a86d-4f073d226635 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:58.123378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aca1e47-75fd-4ff1-a86d-4f073d226635 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:58.124934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8aca1e47-75fd-4ff1-a86d-4f073d226635 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:58.185964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a5f8147e-00dc-458d-955a-b96fec66f09b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:58.197536 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a5f8147e-00dc-458d-955a-b96fec66f09b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1461 microversion: 2.1 time: 1.127475 Aug 27 05:07:58.213161 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1624/3187] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:57 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1461 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:58.224977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-856dd3d9-8645-44ab-8c4b-4e74bba57eb3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:58.225855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-856dd3d9-8645-44ab-8c4b-4e74bba57eb3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:58.232531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-856dd3d9-8645-44ab-8c4b-4e74bba57eb3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:58.233316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-856dd3d9-8645-44ab-8c4b-4e74bba57eb3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:58.233947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-856dd3d9-8645-44ab-8c4b-4e74bba57eb3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:58.234941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-856dd3d9-8645-44ab-8c4b-4e74bba57eb3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:58.235617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-856dd3d9-8645-44ab-8c4b-4e74bba57eb3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:58.236055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-856dd3d9-8645-44ab-8c4b-4e74bba57eb3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:58.355832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:58.381016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=14 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:58.520869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8aca1e47-75fd-4ff1-a86d-4f073d226635 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:58.533632 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8aca1e47-75fd-4ff1-a86d-4f073d226635 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1314 microversion: 2.1 time: 0.438325 Aug 27 05:07:58.548996 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1564/3188] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:58 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:58.556453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b001120b-0315-4e5d-b035-d1e3e08fb149 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:58.558128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b001120b-0315-4e5d-b035-d1e3e08fb149 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:58.567250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b001120b-0315-4e5d-b035-d1e3e08fb149 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:58.568041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b001120b-0315-4e5d-b035-d1e3e08fb149 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:58.569049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b001120b-0315-4e5d-b035-d1e3e08fb149 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:58.569964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b001120b-0315-4e5d-b035-d1e3e08fb149 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:58.570690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b001120b-0315-4e5d-b035-d1e3e08fb149 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:58.572554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b001120b-0315-4e5d-b035-d1e3e08fb149 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:58.581497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-856dd3d9-8645-44ab-8c4b-4e74bba57eb3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:58.592627 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-856dd3d9-8645-44ab-8c4b-4e74bba57eb3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1524 microversion: 2.1 time: 0.377885 Aug 27 05:07:58.594425 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1625/3189] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:58 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1524 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:58.683698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=16 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:58.853501 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b001120b-0315-4e5d-b035-d1e3e08fb149 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1614 microversion: 2.1 time: 0.302995 Aug 27 05:07:58.856348 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1565/3190] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:58 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1614 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:58.883902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:58.884605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:58.897198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:58.897846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:58.898362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:58.902728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:58.904737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:58.905275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:58.967561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b1577287646849e8aab81a29e1b1549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b38b3b27dd48a3934afc399c2ac11d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:58.971362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] flavor_id is None. Assuming migration. {{(pid=128547) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 05:07:58.971989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128547) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:07:58.974308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2309bef5-a775-4232-93c5-99d83e9c9c58 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb564f8aa60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1808134135", "description": "tempest-description-805925924"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:59.200672 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3c7f2d7b-65d2-4821-9094-8d48526e2436 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea/action" status: 202 len: 0 microversion: 2.1 time: 0.323501 Aug 27 05:07:59.206202 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1566/3191] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:07:58 2022] POST /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:07:59.214613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-292f44f8-dfdb-48e4-909b-38d50691bb2c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:59.215533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-292f44f8-dfdb-48e4-909b-38d50691bb2c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:59.222714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-292f44f8-dfdb-48e4-909b-38d50691bb2c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:59.223551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-292f44f8-dfdb-48e4-909b-38d50691bb2c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:59.224188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-292f44f8-dfdb-48e4-909b-38d50691bb2c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:59.225272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-292f44f8-dfdb-48e4-909b-38d50691bb2c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:59.226014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-292f44f8-dfdb-48e4-909b-38d50691bb2c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:59.226613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-292f44f8-dfdb-48e4-909b-38d50691bb2c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:59.593757 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2309bef5-a775-4232-93c5-99d83e9c9c58 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.883149 Aug 27 05:07:59.615458 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1626/3192] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:07:58 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:59.625911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e12c2736-223f-456e-9508-a8aa6e4a5ed4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:59.626850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e12c2736-223f-456e-9508-a8aa6e4a5ed4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:59.650495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12c2736-223f-456e-9508-a8aa6e4a5ed4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:59.665509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12c2736-223f-456e-9508-a8aa6e4a5ed4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:59.668888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12c2736-223f-456e-9508-a8aa6e4a5ed4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:59.671749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12c2736-223f-456e-9508-a8aa6e4a5ed4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:59.674470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12c2736-223f-456e-9508-a8aa6e4a5ed4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:59.675137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e12c2736-223f-456e-9508-a8aa6e4a5ed4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:00.061763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-292f44f8-dfdb-48e4-909b-38d50691bb2c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:00.078562 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-292f44f8-dfdb-48e4-909b-38d50691bb2c tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1512 microversion: 2.1 time: 0.870738 Aug 27 05:08:00.082116 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1567/3193] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:59 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1512 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:00.089868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ff4cf289-029a-4308-9666-e40f307807b7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:00.090888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ff4cf289-029a-4308-9666-e40f307807b7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:00.114932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4cf289-029a-4308-9666-e40f307807b7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:00.115632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4cf289-029a-4308-9666-e40f307807b7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:00.116201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4cf289-029a-4308-9666-e40f307807b7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:00.118008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4cf289-029a-4308-9666-e40f307807b7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:00.121804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4cf289-029a-4308-9666-e40f307807b7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:00.122362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff4cf289-029a-4308-9666-e40f307807b7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:00.210856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e12c2736-223f-456e-9508-a8aa6e4a5ed4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:00.223373 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e12c2736-223f-456e-9508-a8aa6e4a5ed4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1470 microversion: 2.1 time: 0.606417 Aug 27 05:08:00.224370 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1627/3194] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:59 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1470 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:00.233693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24bba38b-6d4c-40a8-acca-c4ced18e7f9b tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb564ed5550>, body: {"security_group_rule": {"parent_group_id": "0c8f7fb5-3dda-4d7c-aa83-a31a786708f7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:00.502215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ff4cf289-029a-4308-9666-e40f307807b7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:00.522767 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ff4cf289-029a-4308-9666-e40f307807b7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1314 microversion: 2.1 time: 0.439197 Aug 27 05:08:00.537581 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1568/3195] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:00 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:00.552322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c25dd11c-76f4-4d3f-abef-b9693b28156b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:00.555035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c25dd11c-76f4-4d3f-abef-b9693b28156b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:00.576202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25dd11c-76f4-4d3f-abef-b9693b28156b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:00.580513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25dd11c-76f4-4d3f-abef-b9693b28156b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:00.581964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25dd11c-76f4-4d3f-abef-b9693b28156b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:00.585663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25dd11c-76f4-4d3f-abef-b9693b28156b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:00.586586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25dd11c-76f4-4d3f-abef-b9693b28156b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:00.587166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c25dd11c-76f4-4d3f-abef-b9693b28156b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:00.911599 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-24bba38b-6d4c-40a8-acca-c4ced18e7f9b tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.685833 Aug 27 05:08:00.912676 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1628/3196] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:08:00 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:00.921357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc11582e-9949-4833-b1e3-12025e5cb61d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:00.924889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dc11582e-9949-4833-b1e3-12025e5cb61d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:00.942464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc11582e-9949-4833-b1e3-12025e5cb61d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:00.943060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc11582e-9949-4833-b1e3-12025e5cb61d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:00.943598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc11582e-9949-4833-b1e3-12025e5cb61d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:00.944402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc11582e-9949-4833-b1e3-12025e5cb61d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:00.944941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc11582e-9949-4833-b1e3-12025e5cb61d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:00.945499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc11582e-9949-4833-b1e3-12025e5cb61d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:00.999575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c25dd11c-76f4-4d3f-abef-b9693b28156b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:01.021291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dc11582e-9949-4833-b1e3-12025e5cb61d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:08:01.028627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:01.035656 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c25dd11c-76f4-4d3f-abef-b9693b28156b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1524 microversion: 2.1 time: 0.496495 Aug 27 05:08:01.037042 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1569/3197] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:00 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1524 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:01.042005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d7e27e80-73d0-419a-ad7f-01d1ab4ffe16 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb569516c10>, body: {"security_group_rule": {"parent_group_id": "0c8f7fb5-3dda-4d7c-aa83-a31a786708f7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:01.143374 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-d7e27e80-73d0-419a-ad7f-01d1ab4ffe16 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] HTTP exception thrown: This rule already exists in group 0c8f7fb5-3dda-4d7c-aa83-a31a786708f7 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d7e27e80-73d0-419a-ad7f-01d1ab4ffe16 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Request method failure captured: Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 138 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaauket3j4YULLPGT9oVCdpN3O_St8ZZYa3e7t3HonzbGvrv8nDQ7TZ8N9I5l2QuUJH70SLH-crlOFRpHbauuXUWd9AI1eDWYGXoXNbDdUA5wKCAAP0_Fszj6CoTKTUjqYFNnXV9_Bn9Zm-GjyuWc4NXYJxJtLf1XaytuF42bVBEBK4 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58bb202837ad4f48a0d1f69feb808b3c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 51df09dfbbd54685ad2d7f6386970c87 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: {"security_group_rule": {"parent_group_id": "0c8f7fb5-3dda-4d7c-aa83-a31a786708f7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: exception: This rule already exists in group 0c8f7fb5-3dda-4d7c-aa83-a31a786708f7 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0c8f7fb5-3dda-4d7c-aa83-a31a786708f7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 0c8f7fb5-3dda-4d7c-aa83-a31a786708f7 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 0c8f7fb5-3dda-4d7c-aa83-a31a786708f7 Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:01.164332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:01.172427 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:01.172427 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:01.172427 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 0c8f7fb5-3dda-4d7c-aa83-a31a786708f7 Aug 27 05:08:01.172427 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:01.176171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d7e27e80-73d0-419a-ad7f-01d1ab4ffe16 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Returning 400 to user: This rule already exists in group 0c8f7fb5-3dda-4d7c-aa83-a31a786708f7 {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:01.177186 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d7e27e80-73d0-419a-ad7f-01d1ab4ffe16 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.138916 Aug 27 05:08:01.178153 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1570/3198] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:08:01 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:08:01.190326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df67e8d5-95c8-4d85-9b57-c16c7393eb90 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:01.191008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-df67e8d5-95c8-4d85-9b57-c16c7393eb90 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:01.231491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df67e8d5-95c8-4d85-9b57-c16c7393eb90 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:01.231997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df67e8d5-95c8-4d85-9b57-c16c7393eb90 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:01.232435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df67e8d5-95c8-4d85-9b57-c16c7393eb90 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:01.233164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df67e8d5-95c8-4d85-9b57-c16c7393eb90 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:01.233630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df67e8d5-95c8-4d85-9b57-c16c7393eb90 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:01.234082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df67e8d5-95c8-4d85-9b57-c16c7393eb90 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:01.256651 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dc11582e-9949-4833-b1e3-12025e5cb61d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "DELETE /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 204 len: 0 microversion: 2.1 time: 0.342601 Aug 27 05:08:01.261045 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1629/3199] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:08:00 2022] DELETE /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:08:01.271365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-420bc7be-0402-4c36-9b62-c7abd84a4d4b tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Calling method '.version_select at 0x7fb564b27f70>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:01.553099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df67e8d5-95c8-4d85-9b57-c16c7393eb90 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:01.562465 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df67e8d5-95c8-4d85-9b57-c16c7393eb90 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1512 microversion: 2.1 time: 0.383469 Aug 27 05:08:01.566365 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1571/3200] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:01 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:01.592785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7bbe2fff-8f2c-4ff6-8f56-5a4e74a5dd28 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:01.594276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7bbe2fff-8f2c-4ff6-8f56-5a4e74a5dd28 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:01.610008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fff-8f2c-4ff6-8f56-5a4e74a5dd28 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:01.610826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fff-8f2c-4ff6-8f56-5a4e74a5dd28 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:01.611563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fff-8f2c-4ff6-8f56-5a4e74a5dd28 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:01.614295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fff-8f2c-4ff6-8f56-5a4e74a5dd28 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:01.617913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fff-8f2c-4ff6-8f56-5a4e74a5dd28 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:01.618795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fff-8f2c-4ff6-8f56-5a4e74a5dd28 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:01.786188 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-420bc7be-0402-4c36-9b62-c7abd84a4d4b tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/4f8c8700-64de-4b48-a41b-49ee9d5d1f47" status: 202 len: 0 microversion: 2.1 time: 0.523681 Aug 27 05:08:01.787188 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1630/3201] 10.222.0.58 () {58 vars in 1287 bytes} [Sat Aug 27 05:08:01 2022] DELETE /compute/v2.1/os-security-group-rules/4f8c8700-64de-4b48-a41b-49ee9d5d1f47 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:08:01.792825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-91844e7d-4038-4a5e-89fe-0d65937ed5cc tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:01.800168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-91844e7d-4038-4a5e-89fe-0d65937ed5cc tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:01.832644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91844e7d-4038-4a5e-89fe-0d65937ed5cc tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:01.833517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91844e7d-4038-4a5e-89fe-0d65937ed5cc tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:01.834656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91844e7d-4038-4a5e-89fe-0d65937ed5cc tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:01.835641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91844e7d-4038-4a5e-89fe-0d65937ed5cc tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:01.836329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91844e7d-4038-4a5e-89fe-0d65937ed5cc tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:01.840263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91844e7d-4038-4a5e-89fe-0d65937ed5cc tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:01.921397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7bbe2fff-8f2c-4ff6-8f56-5a4e74a5dd28 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:01.941755 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7bbe2fff-8f2c-4ff6-8f56-5a4e74a5dd28 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1470 microversion: 2.1 time: 0.360195 Aug 27 05:08:01.945127 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1572/3202] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:01 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1470 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:01.952774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a9222e92-1d9e-41e9-a5a9-4ec83bce14ef tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:01.954735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a9222e92-1d9e-41e9-a5a9-4ec83bce14ef tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:01.974486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9222e92-1d9e-41e9-a5a9-4ec83bce14ef tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:01.979455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9222e92-1d9e-41e9-a5a9-4ec83bce14ef tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:01.980675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9222e92-1d9e-41e9-a5a9-4ec83bce14ef tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:01.981721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9222e92-1d9e-41e9-a5a9-4ec83bce14ef tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:01.983509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9222e92-1d9e-41e9-a5a9-4ec83bce14ef tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:01.985327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9222e92-1d9e-41e9-a5a9-4ec83bce14ef tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:02.506911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-91844e7d-4038-4a5e-89fe-0d65937ed5cc tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:02.519890 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-91844e7d-4038-4a5e-89fe-0d65937ed5cc tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1554 microversion: 2.1 time: 0.731277 Aug 27 05:08:02.531374 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1631/3203] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:01 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1554 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:02.531501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a9222e92-1d9e-41e9-a5a9-4ec83bce14ef tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:02.531613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9e8111e-3fe7-4b9e-a149-511a65b53be2 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb564f8a9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-707759423", "description": "tempest-description-442697204"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:02.543333 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a9222e92-1d9e-41e9-a5a9-4ec83bce14ef tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1314 microversion: 2.1 time: 0.596858 Aug 27 05:08:02.543967 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1573/3204] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:01 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:02.563389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ea5ee81e-e91e-48f1-98f8-9dceb6729621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:02.564084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ea5ee81e-e91e-48f1-98f8-9dceb6729621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:02.574459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea5ee81e-e91e-48f1-98f8-9dceb6729621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:02.575791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea5ee81e-e91e-48f1-98f8-9dceb6729621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:02.576630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea5ee81e-e91e-48f1-98f8-9dceb6729621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:02.579279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea5ee81e-e91e-48f1-98f8-9dceb6729621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:02.583949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea5ee81e-e91e-48f1-98f8-9dceb6729621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:02.584877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea5ee81e-e91e-48f1-98f8-9dceb6729621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:02.621370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:02.864190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ea5ee81e-e91e-48f1-98f8-9dceb6729621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:02.872912 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ea5ee81e-e91e-48f1-98f8-9dceb6729621 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1524 microversion: 2.1 time: 0.327868 Aug 27 05:08:02.873496 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1574/3205] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:02 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1524 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:02.889924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c0dbae15-c501-4097-a192-4cac56d8401e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:02.890581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c0dbae15-c501-4097-a192-4cac56d8401e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:02.921864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dbae15-c501-4097-a192-4cac56d8401e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:02.922370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dbae15-c501-4097-a192-4cac56d8401e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:02.922819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dbae15-c501-4097-a192-4cac56d8401e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:02.923614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dbae15-c501-4097-a192-4cac56d8401e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:02.924078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dbae15-c501-4097-a192-4cac56d8401e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:02.924506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0dbae15-c501-4097-a192-4cac56d8401e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:02.927762 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c9e8111e-3fe7-4b9e-a149-511a65b53be2 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.401268 Aug 27 05:08:02.928547 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1632/3206] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:08:02 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:02.941633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0aef675-c1ac-44db-9c9a-1fba3d702f6a tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb56500b9d0>, body: {"security_group_rule": {"parent_group_id": "4c67be4d-f53f-449a-9ab0-dd4c4df61932", "ip_protocol": "tcp", "from_port": 2141141384, "to_port": 22}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:03.012541 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c0aef675-c1ac-44db-9c9a-1fba3d702f6a tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] HTTP exception thrown: Invalid port range 2141141384:22. Former value cannot be greater than the later Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0aef675-c1ac-44db-9c9a-1fba3d702f6a tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Request method failure captured: Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 146 Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaauket3j4YULLPGT9oVCdpN3O_St8ZZYa3e7t3HonzbGvrv8nDQ7TZ8N9I5l2QuUJH70SLH-crlOFRpHbauuXUWd9AI1eDWYGXoXNbDdUA5wKCAAP0_Fszj6CoTKTUjqYFNnXV9_Bn9Zm-GjyuWc4NXYJxJtLf1XaytuF42bVBEBK4 Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58bb202837ad4f48a0d1f69feb808b3c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 51df09dfbbd54685ad2d7f6386970c87 Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: {"security_group_rule": {"parent_group_id": "4c67be4d-f53f-449a-9ab0-dd4c4df61932", "ip_protocol": "tcp", "from_port": 2141141384, "to_port": 22}} Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid port range 2141141384:22. Former value cannot be greater than the later Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4c67be4d-f53f-449a-9ab0-dd4c4df61932', 'ip_protocol': 'tcp', 'from_port': 2141141384, 'to_port': 22}}} Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2141141384:22. Former value cannot be greater than the later Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2141141384:22. Former value cannot be greater than the later Aug 27 05:08:03.016174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:03.022213 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:03.022213 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:03.022213 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:03.022213 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:03.022213 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:03.022213 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:03.022213 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:03.022213 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2141141384:22. Former value cannot be greater than the later Aug 27 05:08:03.022213 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:03.026519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0aef675-c1ac-44db-9c9a-1fba3d702f6a tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Returning 400 to user: Invalid port range 2141141384:22. Former value cannot be greater than the later {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:03.026519 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c0aef675-c1ac-44db-9c9a-1fba3d702f6a tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.088985 Aug 27 05:08:03.027115 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1633/3207] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:08:02 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:08:03.044261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6bb9981f-f3db-4827-9d5c-b5f87ca8730b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:03.045844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6bb9981f-f3db-4827-9d5c-b5f87ca8730b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:03.058792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:03.069162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bb9981f-f3db-4827-9d5c-b5f87ca8730b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:03.074953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bb9981f-f3db-4827-9d5c-b5f87ca8730b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:03.076842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bb9981f-f3db-4827-9d5c-b5f87ca8730b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:03.077811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bb9981f-f3db-4827-9d5c-b5f87ca8730b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:03.078455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bb9981f-f3db-4827-9d5c-b5f87ca8730b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:03.081227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6bb9981f-f3db-4827-9d5c-b5f87ca8730b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:03.192198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c0dbae15-c501-4097-a192-4cac56d8401e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:03.201060 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c0dbae15-c501-4097-a192-4cac56d8401e tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1512 microversion: 2.1 time: 0.326537 Aug 27 05:08:03.201903 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1575/3208] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:02 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:03.211271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aca78e70-edaf-4833-b0e0-05cfb46a5577 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb564904d30>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1480263623", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:03.214431 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-aca78e70-edaf-4833-b0e0-05cfb46a5577 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] HTTP exception thrown: Security group id should be uuid Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aca78e70-edaf-4833-b0e0-05cfb46a5577 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Request method failure captured: Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 131 Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaauket3j4YULLPGT9oVCdpN3O_St8ZZYa3e7t3HonzbGvrv8nDQ7TZ8N9I5l2QuUJH70SLH-crlOFRpHbauuXUWd9AI1eDWYGXoXNbDdUA5wKCAAP0_Fszj6CoTKTUjqYFNnXV9_Bn9Zm-GjyuWc4NXYJxJtLf1XaytuF42bVBEBK4 Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58bb202837ad4f48a0d1f69feb808b3c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 51df09dfbbd54685ad2d7f6386970c87 Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1480263623", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: exception: Security group id should be uuid Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1480263623', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:03.216393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:03.223123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 27 05:08:03.223123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:03.228506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aca78e70-edaf-4833-b0e0-05cfb46a5577 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Returning 400 to user: Security group id should be uuid {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:03.229471 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aca78e70-edaf-4833-b0e0-05cfb46a5577 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.026121 Aug 27 05:08:03.240637 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1576/3209] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:08:03 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 05:08:03.246732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-88b552ad-00d9-4f95-9162-42c0c37c3107 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb56512c280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-76054650", "description": "tempest-description-1924942479"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:03.317614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6bb9981f-f3db-4827-9d5c-b5f87ca8730b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:03.331630 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6bb9981f-f3db-4827-9d5c-b5f87ca8730b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1470 microversion: 2.1 time: 0.302831 Aug 27 05:08:03.332169 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1634/3210] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:03 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1470 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:03.555550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2f1a316e-69b5-42b6-b69f-eeb96d7fbf19 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:03.556821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2f1a316e-69b5-42b6-b69f-eeb96d7fbf19 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:03.574838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f1a316e-69b5-42b6-b69f-eeb96d7fbf19 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:03.580734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f1a316e-69b5-42b6-b69f-eeb96d7fbf19 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:03.582047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f1a316e-69b5-42b6-b69f-eeb96d7fbf19 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:03.584454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f1a316e-69b5-42b6-b69f-eeb96d7fbf19 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:03.587075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f1a316e-69b5-42b6-b69f-eeb96d7fbf19 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:03.588423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f1a316e-69b5-42b6-b69f-eeb96d7fbf19 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:03.595316 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-88b552ad-00d9-4f95-9162-42c0c37c3107 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.353492 Aug 27 05:08:03.597000 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1577/3211] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:08:03 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:03.601872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e7805525-9fbc-409f-b68d-4c5f7bc29e75 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:03.602692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e7805525-9fbc-409f-b68d-4c5f7bc29e75 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:03.631436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7805525-9fbc-409f-b68d-4c5f7bc29e75 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:03.635469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7805525-9fbc-409f-b68d-4c5f7bc29e75 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:03.636159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7805525-9fbc-409f-b68d-4c5f7bc29e75 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:03.638890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7805525-9fbc-409f-b68d-4c5f7bc29e75 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:03.648018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7805525-9fbc-409f-b68d-4c5f7bc29e75 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:03.648911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7805525-9fbc-409f-b68d-4c5f7bc29e75 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:03.978015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2f1a316e-69b5-42b6-b69f-eeb96d7fbf19 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:03.988369 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2f1a316e-69b5-42b6-b69f-eeb96d7fbf19 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1554 microversion: 2.1 time: 0.446123 Aug 27 05:08:04.005555 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1635/3212] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:03 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1554 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:04.011648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f04fff45-2eec-48dd-92d4-20c9d766b5ed tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb564f73e50>, body: {"security_group_rule": {"parent_group_id": "95f799c4-101c-4afb-a078-ed64bff845a8", "ip_protocol": "tempest-999-810554067", "from_port": 22, "to_port": 22}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:04.027733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e7805525-9fbc-409f-b68d-4c5f7bc29e75 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:04.039670 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e7805525-9fbc-409f-b68d-4c5f7bc29e75 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1314 microversion: 2.1 time: 0.441309 Aug 27 05:08:04.054068 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1578/3213] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:03 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:04.058801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2c578fb0-a114-4f87-bd2c-1be6dbfb906b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:04.059752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2c578fb0-a114-4f87-bd2c-1be6dbfb906b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:04.066948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c578fb0-a114-4f87-bd2c-1be6dbfb906b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:04.067755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c578fb0-a114-4f87-bd2c-1be6dbfb906b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:04.068445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c578fb0-a114-4f87-bd2c-1be6dbfb906b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:04.069499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c578fb0-a114-4f87-bd2c-1be6dbfb906b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:04.070182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c578fb0-a114-4f87-bd2c-1be6dbfb906b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:04.070838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c578fb0-a114-4f87-bd2c-1be6dbfb906b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:04.192176 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f04fff45-2eec-48dd-92d4-20c9d766b5ed tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] HTTP exception thrown: Invalid IP protocol tempest-999-810554067. Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f04fff45-2eec-48dd-92d4-20c9d766b5ed tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Request method failure captured: Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 156 Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaauket3j4YULLPGT9oVCdpN3O_St8ZZYa3e7t3HonzbGvrv8nDQ7TZ8N9I5l2QuUJH70SLH-crlOFRpHbauuXUWd9AI1eDWYGXoXNbDdUA5wKCAAP0_Fszj6CoTKTUjqYFNnXV9_Bn9Zm-GjyuWc4NXYJxJtLf1XaytuF42bVBEBK4 Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58bb202837ad4f48a0d1f69feb808b3c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 51df09dfbbd54685ad2d7f6386970c87 Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: {"security_group_rule": {"parent_group_id": "95f799c4-101c-4afb-a078-ed64bff845a8", "ip_protocol": "tempest-999-810554067", "from_port": 22, "to_port": 22}} Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid IP protocol tempest-999-810554067. Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'security_group_rule': {'parent_group_id': '95f799c4-101c-4afb-a078-ed64bff845a8', 'ip_protocol': 'tempest-999-810554067', 'from_port': 22, 'to_port': 22}}} Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-810554067. Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-810554067. Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:04.195104 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:04.202249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:04.202249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:04.202249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:04.202249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:04.202249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:04.202249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:04.202249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-810554067. Aug 27 05:08:04.202249 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:04.205616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f04fff45-2eec-48dd-92d4-20c9d766b5ed tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Returning 400 to user: Invalid IP protocol tempest-999-810554067. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:04.206890 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f04fff45-2eec-48dd-92d4-20c9d766b5ed tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.199945 Aug 27 05:08:04.207745 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1636/3214] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:08:04 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 05:08:04.219412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-59d6a80a-47ce-43c8-a69a-4a04d1be8e7b tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb56500b430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1108248086", "description": "tempest-description-2063202384"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:04.319624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2c578fb0-a114-4f87-bd2c-1be6dbfb906b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:04.328174 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2c578fb0-a114-4f87-bd2c-1be6dbfb906b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1524 microversion: 2.1 time: 0.272964 Aug 27 05:08:04.333022 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1579/3215] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:04 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1524 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:04.343849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-735ec0c0-2824-49d5-89fd-d74b1e060668 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:04.344739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-735ec0c0-2824-49d5-89fd-d74b1e060668 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:04.357545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735ec0c0-2824-49d5-89fd-d74b1e060668 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:04.358832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735ec0c0-2824-49d5-89fd-d74b1e060668 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:04.359543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735ec0c0-2824-49d5-89fd-d74b1e060668 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:04.361005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735ec0c0-2824-49d5-89fd-d74b1e060668 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:04.361725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735ec0c0-2824-49d5-89fd-d74b1e060668 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:04.362420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735ec0c0-2824-49d5-89fd-d74b1e060668 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:04.507510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-735ec0c0-2824-49d5-89fd-d74b1e060668 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:04.525012 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-735ec0c0-2824-49d5-89fd-d74b1e060668 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1470 microversion: 2.1 time: 0.184350 Aug 27 05:08:04.525773 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1580/3216] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:04 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:04.530735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c9435221-60ea-42c1-9032-0545d5bafada tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:04.537781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c9435221-60ea-42c1-9032-0545d5bafada tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:04.554813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9435221-60ea-42c1-9032-0545d5bafada tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:04.555597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9435221-60ea-42c1-9032-0545d5bafada tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:04.556269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9435221-60ea-42c1-9032-0545d5bafada tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:04.557209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9435221-60ea-42c1-9032-0545d5bafada tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:04.557822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9435221-60ea-42c1-9032-0545d5bafada tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:04.558402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9435221-60ea-42c1-9032-0545d5bafada tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:04.744078 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-59d6a80a-47ce-43c8-a69a-4a04d1be8e7b tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.531032 Aug 27 05:08:04.745011 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1637/3217] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:08:04 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:04.871927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1cb3192a-9658-4295-afb4-b78e8a3f19e4 req-a1506f2b-736e-4a1a-a907-f4c2c4565674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44343fc-7c5a-46ab-9e82-d3a53c84db32", "name": "network-vif-deleted", "tag": "77c2a8a3-c2c8-4e20-bbed-1ff085255d80"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:04.891884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1cb3192a-9658-4295-afb4-b78e8a3f19e4 req-a1506f2b-736e-4a1a-a907-f4c2c4565674 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:04.895849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1cb3192a-9658-4295-afb4-b78e8a3f19e4 req-a1506f2b-736e-4a1a-a907-f4c2c4565674 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:04.896546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1cb3192a-9658-4295-afb4-b78e8a3f19e4 req-a1506f2b-736e-4a1a-a907-f4c2c4565674 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:04.937688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c9435221-60ea-42c1-9032-0545d5bafada tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:04.938230 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1cb3192a-9658-4295-afb4-b78e8a3f19e4 req-a1506f2b-736e-4a1a-a907-f4c2c4565674 service nova] Creating event network-vif-deleted:77c2a8a3-c2c8-4e20-bbed-1ff085255d80 for instance b44343fc-7c5a-46ab-9e82-d3a53c84db32 on n-h2-820368-35 Aug 27 05:08:04.944356 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1cb3192a-9658-4295-afb4-b78e8a3f19e4 req-a1506f2b-736e-4a1a-a907-f4c2c4565674 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197930 Aug 27 05:08:04.945363 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1638/3218] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:04.952570 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c9435221-60ea-42c1-9032-0545d5bafada tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1470 microversion: 2.1 time: 0.425624 Aug 27 05:08:04.957532 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1581/3219] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:04 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1470 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:04.971359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-43924b66-8872-42aa-8ee2-db9d5f97a8ea tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb56501a670>, body: {"security_group_rule": {"parent_group_id": "94a1b2d4-a0b4-4926-883e-dc0695ae02e8", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:05.011486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82ea52db-4357-48a4-8ee8-83085b04ba65 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:05.012484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-82ea52db-4357-48a4-8ee8-83085b04ba65 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:05.027421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82ea52db-4357-48a4-8ee8-83085b04ba65 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:05.027934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82ea52db-4357-48a4-8ee8-83085b04ba65 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:05.028375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82ea52db-4357-48a4-8ee8-83085b04ba65 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:05.029319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82ea52db-4357-48a4-8ee8-83085b04ba65 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:05.029786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82ea52db-4357-48a4-8ee8-83085b04ba65 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:05.030222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82ea52db-4357-48a4-8ee8-83085b04ba65 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:05.039733 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-43924b66-8872-42aa-8ee2-db9d5f97a8ea tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-43924b66-8872-42aa-8ee2-db9d5f97a8ea tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Request method failure captured: Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 138 Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaauket3j4YULLPGT9oVCdpN3O_St8ZZYa3e7t3HonzbGvrv8nDQ7TZ8N9I5l2QuUJH70SLH-crlOFRpHbauuXUWd9AI1eDWYGXoXNbDdUA5wKCAAP0_Fszj6CoTKTUjqYFNnXV9_Bn9Zm-GjyuWc4NXYJxJtLf1XaytuF42bVBEBK4 Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58bb202837ad4f48a0d1f69feb808b3c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 51df09dfbbd54685ad2d7f6386970c87 Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: {"security_group_rule": {"parent_group_id": "94a1b2d4-a0b4-4926-883e-dc0695ae02e8", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'security_group_rule': {'parent_group_id': '94a1b2d4-a0b4-4926-883e-dc0695ae02e8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 05:08:05.043611 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:05.049912 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:05.049912 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:05.049912 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:05.049912 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:05.049912 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:05.049912 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:05.049912 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:05.049912 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 05:08:05.049912 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:05.052469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-43924b66-8872-42aa-8ee2-db9d5f97a8ea tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:05.053625 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-43924b66-8872-42aa-8ee2-db9d5f97a8ea tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.099112 Aug 27 05:08:05.060689 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1639/3220] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:08:04 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:08:05.068769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01ff7a6d-98cc-41e8-bfe4-b9e6f6590af0 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:05.070394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-01ff7a6d-98cc-41e8-bfe4-b9e6f6590af0 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:05.084938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ff7a6d-98cc-41e8-bfe4-b9e6f6590af0 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:05.085940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ff7a6d-98cc-41e8-bfe4-b9e6f6590af0 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:05.086631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ff7a6d-98cc-41e8-bfe4-b9e6f6590af0 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:05.087598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ff7a6d-98cc-41e8-bfe4-b9e6f6590af0 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:05.088257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ff7a6d-98cc-41e8-bfe4-b9e6f6590af0 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:05.088986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ff7a6d-98cc-41e8-bfe4-b9e6f6590af0 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:05.356798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-82ea52db-4357-48a4-8ee8-83085b04ba65 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:05.368934 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-82ea52db-4357-48a4-8ee8-83085b04ba65 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1554 microversion: 2.1 time: 0.360233 Aug 27 05:08:05.382609 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1582/3221] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:05 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1554 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:05.391836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d9ee1b7-cedf-4b4c-a03b-ef33d14ecfa3 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb56490d790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-718828946", "description": "tempest-description-1490330994"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:05.417613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-01ff7a6d-98cc-41e8-bfe4-b9e6f6590af0 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:05.434436 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01ff7a6d-98cc-41e8-bfe4-b9e6f6590af0 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1314 microversion: 2.1 time: 0.371679 Aug 27 05:08:05.454077 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1640/3222] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:05 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:05.460781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ae40518-c8b5-46a5-998b-e418a1cae45a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:05.461892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ae40518-c8b5-46a5-998b-e418a1cae45a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:05.471488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae40518-c8b5-46a5-998b-e418a1cae45a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:05.472377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae40518-c8b5-46a5-998b-e418a1cae45a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:05.473011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae40518-c8b5-46a5-998b-e418a1cae45a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:05.473970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae40518-c8b5-46a5-998b-e418a1cae45a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:05.474600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae40518-c8b5-46a5-998b-e418a1cae45a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:05.475259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae40518-c8b5-46a5-998b-e418a1cae45a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:05.881564 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d9ee1b7-cedf-4b4c-a03b-ef33d14ecfa3 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.497397 Aug 27 05:08:05.882159 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1583/3223] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:08:05 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:05.897528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3b22ac49-c7a8-4660-a71e-32eaf7644a98 req-7ce2950f-c206-49ee-868b-3e6c98f3b4cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42593098-eb8a-4bb6-8a33-59ba5a5b1862", "name": "network-vif-deleted", "tag": "0e9da397-9c51-4b2f-bca1-2807c2e3c7ac"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:05.931461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3b22ac49-c7a8-4660-a71e-32eaf7644a98 req-7ce2950f-c206-49ee-868b-3e6c98f3b4cc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:05.931947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3b22ac49-c7a8-4660-a71e-32eaf7644a98 req-7ce2950f-c206-49ee-868b-3e6c98f3b4cc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:05.932381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3b22ac49-c7a8-4660-a71e-32eaf7644a98 req-7ce2950f-c206-49ee-868b-3e6c98f3b4cc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:05.941883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ae40518-c8b5-46a5-998b-e418a1cae45a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:05.953724 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ae40518-c8b5-46a5-998b-e418a1cae45a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1524 microversion: 2.1 time: 0.494598 Aug 27 05:08:05.969723 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1641/3224] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:05 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1524 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:05.975342 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3b22ac49-c7a8-4660-a71e-32eaf7644a98 req-7ce2950f-c206-49ee-868b-3e6c98f3b4cc service nova] Creating event network-vif-deleted:0e9da397-9c51-4b2f-bca1-2807c2e3c7ac for instance 42593098-eb8a-4bb6-8a33-59ba5a5b1862 on n-h2-820368-35 Aug 27 05:08:05.982319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:05.982929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:05.992077 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3b22ac49-c7a8-4660-a71e-32eaf7644a98 req-7ce2950f-c206-49ee-868b-3e6c98f3b4cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093950 Aug 27 05:08:05.994901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:05.998219 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1584/3225] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:06.012691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1d016801-16ba-4218-bd91-7221e22293a2 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb5649704c0>, body: {"security_group_rule": {"parent_group_id": "0fee8428-3dc3-428a-bac4-ab40197e12e2", "ip_protocol": "tcp", "from_port": 22, "to_port": 1681581887}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:06.021056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.021661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.022453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.022928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.023383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.108567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.109207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.109890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.110423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lazy-loading 'fault' on Instance uuid b44343fc-7c5a-46ab-9e82-d3a53c84db32 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:08:06.115882 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-1d016801-16ba-4218-bd91-7221e22293a2 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] HTTP exception thrown: Invalid port range 22:1681581887. Valid TCP ports should be between 1-65535 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1d016801-16ba-4218-bd91-7221e22293a2 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Request method failure captured: Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 146 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaauket3j4YULLPGT9oVCdpN3O_St8ZZYa3e7t3HonzbGvrv8nDQ7TZ8N9I5l2QuUJH70SLH-crlOFRpHbauuXUWd9AI1eDWYGXoXNbDdUA5wKCAAP0_Fszj6CoTKTUjqYFNnXV9_Bn9Zm-GjyuWc4NXYJxJtLf1XaytuF42bVBEBK4 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58bb202837ad4f48a0d1f69feb808b3c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 51df09dfbbd54685ad2d7f6386970c87 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: {"security_group_rule": {"parent_group_id": "0fee8428-3dc3-428a-bac4-ab40197e12e2", "ip_protocol": "tcp", "from_port": 22, "to_port": 1681581887}} Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid port range 22:1681581887. Valid TCP ports should be between 1-65535 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0fee8428-3dc3-428a-bac4-ab40197e12e2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1681581887}}} Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1681581887. Valid TCP ports should be between 1-65535 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1681581887. Valid TCP ports should be between 1-65535 Aug 27 05:08:06.117970 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.123034 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:06.123034 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.123034 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:06.123034 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:06.123034 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:06.123034 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:06.123034 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:06.123034 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1681581887. Valid TCP ports should be between 1-65535 Aug 27 05:08:06.123034 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.124482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1d016801-16ba-4218-bd91-7221e22293a2 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Returning 400 to user: Invalid port range 22:1681581887. Valid TCP ports should be between 1-65535 {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:06.125498 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1d016801-16ba-4218-bd91-7221e22293a2 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.125506 Aug 27 05:08:06.131230 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1585/3226] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:08:05 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:08:06.139222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-da8d0d8c-0d9f-4b2d-aa1d-ab8f7a34d87a req-bdce2c35-baac-4b85-af8d-c6c68baa182d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90344fdd-65fb-471a-ac62-b816bf3936b2", "name": "network-vif-plugged", "status": "completed", "tag": "19c7fe58-2cb0-4b71-bef6-9dafff9de477"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:06.145873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:06.153376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-da8d0d8c-0d9f-4b2d-aa1d-ab8f7a34d87a req-bdce2c35-baac-4b85-af8d-c6c68baa182d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.153864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-da8d0d8c-0d9f-4b2d-aa1d-ab8f7a34d87a req-bdce2c35-baac-4b85-af8d-c6c68baa182d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.154304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-da8d0d8c-0d9f-4b2d-aa1d-ab8f7a34d87a req-bdce2c35-baac-4b85-af8d-c6c68baa182d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.169438 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-da8d0d8c-0d9f-4b2d-aa1d-ab8f7a34d87a req-bdce2c35-baac-4b85-af8d-c6c68baa182d service nova] Creating event network-vif-plugged:19c7fe58-2cb0-4b71-bef6-9dafff9de477 for instance 90344fdd-65fb-471a-ac62-b816bf3936b2 on n-h2-820368-35 Aug 27 05:08:06.183707 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-da8d0d8c-0d9f-4b2d-aa1d-ab8f7a34d87a req-bdce2c35-baac-4b85-af8d-c6c68baa182d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050726 Aug 27 05:08:06.184933 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1586/3227] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:06.187124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21eaf7b9d34c453a931c1b4c4131653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac87eec90574e4db5dbdc5a41893c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:06.196651 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4300be81-a617-4e5f-acfa-c7a558578708 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 200 len: 1307 microversion: 2.1 time: 0.225094 Aug 27 05:08:06.197618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-03a9b3b7-a6b0-46dc-9700-87202dbd24b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:06.198664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-03a9b3b7-a6b0-46dc-9700-87202dbd24b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:06.199437 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1642/3228] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:05 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:06.208386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03a9b3b7-a6b0-46dc-9700-87202dbd24b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.208885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03a9b3b7-a6b0-46dc-9700-87202dbd24b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.209322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03a9b3b7-a6b0-46dc-9700-87202dbd24b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.210395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03a9b3b7-a6b0-46dc-9700-87202dbd24b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.210872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03a9b3b7-a6b0-46dc-9700-87202dbd24b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.211330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-03a9b3b7-a6b0-46dc-9700-87202dbd24b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.215903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f59746af-d878-4760-a808-d20afd1ca316 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Action: 'create', calling method: .version_select at 0x7fb564f51310>, body: {"security_group_rule": {"parent_group_id": "661ec3eb-c33a-467a-aeed-6ad7334f9504", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:06.255517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-f59746af-d878-4760-a808-d20afd1ca316 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 661ec3eb-c33a-467a-aeed-6ad7334f9504 does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:08:06.256343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-f59746af-d878-4760-a808-d20afd1ca316 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Neutron security group 661ec3eb-c33a-467a-aeed-6ad7334f9504 not found {{(pid=128548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:08:06.257000 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f59746af-d878-4760-a808-d20afd1ca316 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] HTTP exception thrown: Security group 661ec3eb-c33a-467a-aeed-6ad7334f9504 does not exist Aug 27 05:08:06.257000 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-d0ae2ca3-1fca-4c0a-adf8-75b0b5d8b2c3'] Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f59746af-d878-4760-a808-d20afd1ca316 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Request method failure captured: Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 138 Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaauket3j4YULLPGT9oVCdpN3O_St8ZZYa3e7t3HonzbGvrv8nDQ7TZ8N9I5l2QuUJH70SLH-crlOFRpHbauuXUWd9AI1eDWYGXoXNbDdUA5wKCAAP0_Fszj6CoTKTUjqYFNnXV9_Bn9Zm-GjyuWc4NXYJxJtLf1XaytuF42bVBEBK4 Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58bb202837ad4f48a0d1f69feb808b3c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 51df09dfbbd54685ad2d7f6386970c87 Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: {"security_group_rule": {"parent_group_id": "661ec3eb-c33a-467a-aeed-6ad7334f9504", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group 661ec3eb-c33a-467a-aeed-6ad7334f9504 does not exist Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-d0ae2ca3-1fca-4c0a-adf8-75b0b5d8b2c3'] Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'security_group_rule': {'parent_group_id': '661ec3eb-c33a-467a-aeed-6ad7334f9504', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:08:06.259765 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 661ec3eb-c33a-467a-aeed-6ad7334f9504 does not exist Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0ae2ca3-1fca-4c0a-adf8-75b0b5d8b2c3'] Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 661ec3eb-c33a-467a-aeed-6ad7334f9504 does not exist Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0ae2ca3-1fca-4c0a-adf8-75b0b5d8b2c3'] Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 661ec3eb-c33a-467a-aeed-6ad7334f9504 does not exist Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0ae2ca3-1fca-4c0a-adf8-75b0b5d8b2c3'] Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 661ec3eb-c33a-467a-aeed-6ad7334f9504 does not exist Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0ae2ca3-1fca-4c0a-adf8-75b0b5d8b2c3'] Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f59746af-d878-4760-a808-d20afd1ca316 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Returning 404 to user: Security group 661ec3eb-c33a-467a-aeed-6ad7334f9504 does not exist Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-d0ae2ca3-1fca-4c0a-adf8-75b0b5d8b2c3'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:06.267957 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f59746af-d878-4760-a808-d20afd1ca316 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.066763 Aug 27 05:08:06.276258 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1643/3229] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:08:06 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:06.289435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ecb7d58c-6ef5-4ccd-873f-063e587096e9 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Calling method '.version_select at 0x7fb56500b160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:06.334808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-ecb7d58c-6ef5-4ccd-873f-063e587096e9 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 790ff456-95f0-4312-99fd-a2fc35e85e0d does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:08:06.335831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-ecb7d58c-6ef5-4ccd-873f-063e587096e9 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Neutron security group rule 790ff456-95f0-4312-99fd-a2fc35e85e0d not found {{(pid=128548) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 27 05:08:06.336630 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-ecb7d58c-6ef5-4ccd-873f-063e587096e9 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] HTTP exception thrown: Security group rule 790ff456-95f0-4312-99fd-a2fc35e85e0d does not exist Aug 27 05:08:06.336630 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-e1330dd7-f20a-49c3-bb3f-a13fcc9d381a'] Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ecb7d58c-6ef5-4ccd-873f-063e587096e9 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Request method failure captured: Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-security-group-rules/790ff456-95f0-4312-99fd-a2fc35e85e0d HTTP/1.1 Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaauket3j4YULLPGT9oVCdpN3O_St8ZZYa3e7t3HonzbGvrv8nDQ7TZ8N9I5l2QuUJH70SLH-crlOFRpHbauuXUWd9AI1eDWYGXoXNbDdUA5wKCAAP0_Fszj6CoTKTUjqYFNnXV9_Bn9Zm-GjyuWc4NXYJxJtLf1XaytuF42bVBEBK4 Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58bb202837ad4f48a0d1f69feb808b3c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58bb202837ad4f48a0d1f69feb808b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 58bb202837ad4f48a0d1f69feb808b3c Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329 Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 51df09dfbbd54685ad2d7f6386970c87 Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-757732329-project Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group rule 790ff456-95f0-4312-99fd-a2fc35e85e0d does not exist Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-e1330dd7-f20a-49c3-bb3f-a13fcc9d381a'] Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '790ff456-95f0-4312-99fd-a2fc35e85e0d'} Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:08:06.343580 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 790ff456-95f0-4312-99fd-a2fc35e85e0d does not exist Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1330dd7-f20a-49c3-bb3f-a13fcc9d381a'] Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 790ff456-95f0-4312-99fd-a2fc35e85e0d does not exist Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1330dd7-f20a-49c3-bb3f-a13fcc9d381a'] Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 790ff456-95f0-4312-99fd-a2fc35e85e0d does not exist Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1330dd7-f20a-49c3-bb3f-a13fcc9d381a'] Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 790ff456-95f0-4312-99fd-a2fc35e85e0d does not exist Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1330dd7-f20a-49c3-bb3f-a13fcc9d381a'] Aug 27 05:08:06.348781 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:06.354042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ecb7d58c-6ef5-4ccd-873f-063e587096e9 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Returning 404 to user: Security group rule 790ff456-95f0-4312-99fd-a2fc35e85e0d does not exist Aug 27 05:08:06.354042 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-e1330dd7-f20a-49c3-bb3f-a13fcc9d381a'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:06.355293 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ecb7d58c-6ef5-4ccd-873f-063e587096e9 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/790ff456-95f0-4312-99fd-a2fc35e85e0d" status: 404 len: 199 microversion: 2.1 time: 0.081355 Aug 27 05:08:06.356423 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1644/3230] 10.222.0.58 () {58 vars in 1287 bytes} [Sat Aug 27 05:08:06 2022] DELETE /compute/v2.1/os-security-group-rules/790ff456-95f0-4312-99fd-a2fc35e85e0d => generated 199 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:06.372174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc4beecb-95cc-436c-9b21-850defa2eedf tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Calling method '.version_select at 0x7fb56501af70>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:06.460520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-03a9b3b7-a6b0-46dc-9700-87202dbd24b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:06.479003 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-03a9b3b7-a6b0-46dc-9700-87202dbd24b0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.292599 Aug 27 05:08:06.491280 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1587/3231] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:06 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:06.491280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:06.491280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:06.500832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.501642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.502262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.502977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.509999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.510571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.551144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.551144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.551144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.551144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lazy-loading 'fault' on Instance uuid 42593098-eb8a-4bb6-8a33-59ba5a5b1862 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:08:06.610850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:06.627770 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a10746b5-bfa7-4c26-b4c8-a9cedfc512a3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 200 len: 1339 microversion: 2.1 time: 0.146884 Aug 27 05:08:06.628416 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1588/3232] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:06 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 1339 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:06.633440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dfdd741b-a901-4223-a537-0bb2a4bec658 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:06.634060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dfdd741b-a901-4223-a537-0bb2a4bec658 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:06.657201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfdd741b-a901-4223-a537-0bb2a4bec658 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.658630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfdd741b-a901-4223-a537-0bb2a4bec658 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.659322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfdd741b-a901-4223-a537-0bb2a4bec658 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.660337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfdd741b-a901-4223-a537-0bb2a4bec658 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.660993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfdd741b-a901-4223-a537-0bb2a4bec658 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.661435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfdd741b-a901-4223-a537-0bb2a4bec658 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.724241 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dc4beecb-95cc-436c-9b21-850defa2eedf tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/0fee8428-3dc3-428a-bac4-ab40197e12e2" status: 202 len: 0 microversion: 2.1 time: 0.357974 Aug 27 05:08:06.728034 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1645/3233] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:08:06 2022] DELETE /compute/v2.1/os-security-groups/0fee8428-3dc3-428a-bac4-ab40197e12e2 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:08:06.733422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6409ccf9-0c84-4002-b1d6-8256e1df461e tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Calling method '.version_select at 0x7fb564f514c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:06.964916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dfdd741b-a901-4223-a537-0bb2a4bec658 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:06.974373 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dfdd741b-a901-4223-a537-0bb2a4bec658 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1314 microversion: 2.1 time: 0.344923 Aug 27 05:08:06.988105 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1589/3234] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:06 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:07.001376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65a569f0-eb81-41d4-8d84-6d20229b9577 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:07.002061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-65a569f0-eb81-41d4-8d84-6d20229b9577 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:07.009904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65a569f0-eb81-41d4-8d84-6d20229b9577 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.010425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65a569f0-eb81-41d4-8d84-6d20229b9577 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.011135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65a569f0-eb81-41d4-8d84-6d20229b9577 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.011597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65a569f0-eb81-41d4-8d84-6d20229b9577 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.012047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65a569f0-eb81-41d4-8d84-6d20229b9577 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.012470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65a569f0-eb81-41d4-8d84-6d20229b9577 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.105018 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6409ccf9-0c84-4002-b1d6-8256e1df461e tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/94a1b2d4-a0b4-4926-883e-dc0695ae02e8" status: 202 len: 0 microversion: 2.1 time: 0.375411 Aug 27 05:08:07.105653 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1646/3235] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:08:06 2022] DELETE /compute/v2.1/os-security-groups/94a1b2d4-a0b4-4926-883e-dc0695ae02e8 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:08:07.116066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bc268eb3-5ad8-4a21-9282-8d7638bbf994 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Calling method '.version_select at 0x7fb564f73310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:07.216596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-65a569f0-eb81-41d4-8d84-6d20229b9577 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:07.225194 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-65a569f0-eb81-41d4-8d84-6d20229b9577 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1524 microversion: 2.1 time: 0.233177 Aug 27 05:08:07.225759 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1590/3236] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:06 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1524 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:07.230606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:07.231244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] [instance: b44343fc-7c5a-46ab-9e82-d3a53c84db32] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:07.236925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.237411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.237845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.238537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.239059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.239713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.253590 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] HTTP exception thrown: Instance b44343fc-7c5a-46ab-9e82-d3a53c84db32 could not be found. Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Request method failure captured: Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 HTTP/1.1 Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaaSGWXDpgCe-AI62kT1Z4-R8XZWCFpD-yzeAnKp98H1EOMG3yXFy1fAPDQVcUT4SFWVQBUBq7EgqXrb9eW9N8eZYVBtucVDi_gatPDI1OjaR9MrRmZVUKCy_Nv9Um1yXHLywJIaVPVca0GgAos2Eo4o0EMxeZGIG3kKFYTs5iEWqus Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 5ac87eec90574e4db5dbdc5a41893c46 Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-InstanceActionsTestJSON-619097408 Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ac87eec90574e4db5dbdc5a41893c46", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ac87eec90574e4db5dbdc5a41893c46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ac87eec90574e4db5dbdc5a41893c46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ac87eec90574e4db5dbdc5a41893c46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-InstanceActionsTestJSON-619097408 Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 5ac87eec90574e4db5dbdc5a41893c46 Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-InstanceActionsTestJSON-619097408 Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-InstanceActionsTestJSON-619097408-project Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 21eaf7b9d34c453a931c1b4c4131653d Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-InstanceActionsTestJSON-619097408-project Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance b44343fc-7c5a-46ab-9e82-d3a53c84db32 could not be found. Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'b44343fc-7c5a-46ab-9e82-d3a53c84db32'} Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44343fc-7c5a-46ab-9e82-d3a53c84db32 could not be found. Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44343fc-7c5a-46ab-9e82-d3a53c84db32 could not be found. Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:07.255267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:07.260940 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:07.260940 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:07.260940 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:07.260940 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:07.260940 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:07.260940 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44343fc-7c5a-46ab-9e82-d3a53c84db32 could not be found. Aug 27 05:08:07.260940 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:07.260940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] Returning 404 to user: Instance b44343fc-7c5a-46ab-9e82-d3a53c84db32 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:07.260940 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9c1b7751-3331-4f8d-9067-bd67fdb2a4d1 tempest-InstanceActionsTestJSON-619097408 tempest-InstanceActionsTestJSON-619097408-project] 10.222.0.58 "GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32" status: 404 len: 111 microversion: 2.1 time: 0.029727 Aug 27 05:08:07.260940 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1591/3237] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:07 2022] GET /compute/v2.1/servers/b44343fc-7c5a-46ab-9e82-d3a53c84db32 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:07.331359 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bc268eb3-5ad8-4a21-9282-8d7638bbf994 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/95f799c4-101c-4afb-a078-ed64bff845a8" status: 202 len: 0 microversion: 2.1 time: 0.219307 Aug 27 05:08:07.332051 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1647/3238] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:08:07 2022] DELETE /compute/v2.1/os-security-groups/95f799c4-101c-4afb-a078-ed64bff845a8 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:08:07.340193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-66d12ce9-0dbb-4dca-bc5c-407a1b2c8170 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Calling method '.version_select at 0x7fb56512cee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:07.505687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9a67f6e8-deba-435c-a472-1c2fa373eef5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:07.506320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9a67f6e8-deba-435c-a472-1c2fa373eef5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:07.513679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a67f6e8-deba-435c-a472-1c2fa373eef5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.514178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a67f6e8-deba-435c-a472-1c2fa373eef5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.514619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a67f6e8-deba-435c-a472-1c2fa373eef5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.515573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a67f6e8-deba-435c-a472-1c2fa373eef5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.516218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a67f6e8-deba-435c-a472-1c2fa373eef5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.516656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a67f6e8-deba-435c-a472-1c2fa373eef5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.542157 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-66d12ce9-0dbb-4dca-bc5c-407a1b2c8170 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/4c67be4d-f53f-449a-9ab0-dd4c4df61932" status: 202 len: 0 microversion: 2.1 time: 0.204774 Aug 27 05:08:07.544182 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1592/3239] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:08:07 2022] DELETE /compute/v2.1/os-security-groups/4c67be4d-f53f-449a-9ab0-dd4c4df61932 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:08:07.559510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d473b148-73db-4c25-8712-8bc7de2cf6c8 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] Calling method '.version_select at 0x7fb564904dc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:07.738580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9a67f6e8-deba-435c-a472-1c2fa373eef5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:07.747208 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9a67f6e8-deba-435c-a472-1c2fa373eef5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.245928 Aug 27 05:08:07.749698 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1648/3240] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:07 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:07.754997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:07.755647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 42593098-eb8a-4bb6-8a33-59ba5a5b1862] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:07.764071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.764574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.765021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.765736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.766197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.766631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.787528 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] HTTP exception thrown: Instance 42593098-eb8a-4bb6-8a33-59ba5a5b1862 could not be found. Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Request method failure captured: Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 HTTP/1.1 Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaXQAsB2XQRlEqN77yMjRdnxICdaUvx6aP-hcZhMjA1lQrSkOUf-2PDotZlnHuVaSViuVVQmGWkusSlpeFvcQztnOYnTvckKqFy1eNapeLUENE8eCZ_V2GMGXqynlCiHGRNLoU4zJ2OE1t9a_J-SZPHQ25ZNK3M6X1I9WG2wrZWVomI Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 8855a07236c54efa89fcec7f944afd94 Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestNetworkBasicOps-2034116476 Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8855a07236c54efa89fcec7f944afd94", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8855a07236c54efa89fcec7f944afd94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8855a07236c54efa89fcec7f944afd94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8855a07236c54efa89fcec7f944afd94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestNetworkBasicOps-2034116476 Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 8855a07236c54efa89fcec7f944afd94 Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestNetworkBasicOps-2034116476 Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestNetworkBasicOps-2034116476-project Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: bf8bd46b91cf4774af109507c7c4422a Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestNetworkBasicOps-2034116476-project Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 42593098-eb8a-4bb6-8a33-59ba5a5b1862 could not be found. Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '42593098-eb8a-4bb6-8a33-59ba5a5b1862'} Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42593098-eb8a-4bb6-8a33-59ba5a5b1862 could not be found. Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42593098-eb8a-4bb6-8a33-59ba5a5b1862 could not be found. Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:07.789698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:07.795331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:07.795331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:07.795331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:07.795331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:07.795331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:07.795331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42593098-eb8a-4bb6-8a33-59ba5a5b1862 could not be found. Aug 27 05:08:07.795331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:07.795331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Returning 404 to user: Instance 42593098-eb8a-4bb6-8a33-59ba5a5b1862 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:07.795331 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dc252bc7-3e29-4eb4-bad6-15c352f5e386 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862" status: 404 len: 111 microversion: 2.1 time: 0.040473 Aug 27 05:08:07.795331 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1649/3241] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:07 2022] GET /compute/v2.1/servers/42593098-eb8a-4bb6-8a33-59ba5a5b1862 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:07.840345 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d473b148-73db-4c25-8712-8bc7de2cf6c8 tempest-SecurityGroupRulesNegativeTestJSON-757732329 tempest-SecurityGroupRulesNegativeTestJSON-757732329-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/0c8f7fb5-3dda-4d7c-aa83-a31a786708f7" status: 202 len: 0 microversion: 2.1 time: 0.291774 Aug 27 05:08:07.841347 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1593/3242] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:08:07 2022] DELETE /compute/v2.1/os-security-groups/0c8f7fb5-3dda-4d7c-aa83-a31a786708f7 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:08:07.995071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-232b36dc-665c-4900-9422-8cd425ef4a35 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:07.995813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-232b36dc-665c-4900-9422-8cd425ef4a35 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:08.002796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b36dc-665c-4900-9422-8cd425ef4a35 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:08.003439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b36dc-665c-4900-9422-8cd425ef4a35 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:08.004008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b36dc-665c-4900-9422-8cd425ef4a35 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:08.004800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b36dc-665c-4900-9422-8cd425ef4a35 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:08.005341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b36dc-665c-4900-9422-8cd425ef4a35 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:08.005845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-232b36dc-665c-4900-9422-8cd425ef4a35 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:08.147892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-232b36dc-665c-4900-9422-8cd425ef4a35 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:08.155867 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-232b36dc-665c-4900-9422-8cd425ef4a35 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1314 microversion: 2.1 time: 0.165068 Aug 27 05:08:08.156768 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1650/3243] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:07 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:08.246227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ff938581-a360-4456-96e3-f546c17b0164 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:08.247937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ff938581-a360-4456-96e3-f546c17b0164 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:08.256372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff938581-a360-4456-96e3-f546c17b0164 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:08.256955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff938581-a360-4456-96e3-f546c17b0164 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:08.258112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff938581-a360-4456-96e3-f546c17b0164 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:08.258906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff938581-a360-4456-96e3-f546c17b0164 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:08.259463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff938581-a360-4456-96e3-f546c17b0164 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:08.260031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff938581-a360-4456-96e3-f546c17b0164 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:08.394294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cf578b4d-e19e-4130-bcd2-3a6804db951b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '.version_select at 0x7fb564f73790>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:08.397431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ff938581-a360-4456-96e3-f546c17b0164 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:08.409243 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ff938581-a360-4456-96e3-f546c17b0164 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1506 microversion: 2.1 time: 0.167201 Aug 27 05:08:08.423614 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1594/3244] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:08 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:08.442321 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cf578b4d-e19e-4130-bcd2-3a6804db951b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1262306109" status: 202 len: 0 microversion: 2.1 time: 0.057909 Aug 27 05:08:08.444173 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1651/3245] 10.222.0.58 () {58 vars in 1257 bytes} [Sat Aug 27 05:08:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1262306109 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:08:08.772782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-25138ec8-dca5-4fc7-8130-d253d74f8518 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:08.774287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25138ec8-dca5-4fc7-8130-d253d74f8518 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:08.785214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25138ec8-dca5-4fc7-8130-d253d74f8518 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:08.786116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25138ec8-dca5-4fc7-8130-d253d74f8518 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:08.786808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25138ec8-dca5-4fc7-8130-d253d74f8518 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:08.790865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25138ec8-dca5-4fc7-8130-d253d74f8518 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:08.791494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25138ec8-dca5-4fc7-8130-d253d74f8518 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:08.792042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25138ec8-dca5-4fc7-8130-d253d74f8518 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:09.075028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-25138ec8-dca5-4fc7-8130-d253d74f8518 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:09.092081 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-25138ec8-dca5-4fc7-8130-d253d74f8518 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.326205 Aug 27 05:08:09.093412 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1595/3246] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:08 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:09.178148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aeb72ef4-07b8-4d06-b5e7-e062b9ee8102 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:09.178924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aeb72ef4-07b8-4d06-b5e7-e062b9ee8102 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:09.192581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeb72ef4-07b8-4d06-b5e7-e062b9ee8102 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:09.193118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeb72ef4-07b8-4d06-b5e7-e062b9ee8102 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:09.193571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeb72ef4-07b8-4d06-b5e7-e062b9ee8102 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:09.194770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeb72ef4-07b8-4d06-b5e7-e062b9ee8102 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:09.195489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeb72ef4-07b8-4d06-b5e7-e062b9ee8102 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:09.195927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeb72ef4-07b8-4d06-b5e7-e062b9ee8102 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:09.434844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0e88872-1d6d-4465-8910-4e0333492093 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:09.436600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e0e88872-1d6d-4465-8910-4e0333492093 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:09.447021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aeb72ef4-07b8-4d06-b5e7-e062b9ee8102 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:09.451988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0e88872-1d6d-4465-8910-4e0333492093 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:09.452958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0e88872-1d6d-4465-8910-4e0333492093 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:09.453651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0e88872-1d6d-4465-8910-4e0333492093 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:09.454385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0e88872-1d6d-4465-8910-4e0333492093 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:09.455571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0e88872-1d6d-4465-8910-4e0333492093 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:09.456002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0e88872-1d6d-4465-8910-4e0333492093 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:09.464628 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aeb72ef4-07b8-4d06-b5e7-e062b9ee8102 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1499 microversion: 2.1 time: 0.290372 Aug 27 05:08:09.465229 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1652/3247] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:09 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1499 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:09.714486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e0e88872-1d6d-4465-8910-4e0333492093 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:09.726423 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e0e88872-1d6d-4465-8910-4e0333492093 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1506 microversion: 2.1 time: 0.298077 Aug 27 05:08:09.732840 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1596/3248] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:09 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:10.001270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ede2459-9059-4e90-84e4-282de8b0c8cb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:10.002338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ede2459-9059-4e90-84e4-282de8b0c8cb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:10.009591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ede2459-9059-4e90-84e4-282de8b0c8cb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:10.010253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ede2459-9059-4e90-84e4-282de8b0c8cb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:10.010690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ede2459-9059-4e90-84e4-282de8b0c8cb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:10.011434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ede2459-9059-4e90-84e4-282de8b0c8cb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:10.011889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ede2459-9059-4e90-84e4-282de8b0c8cb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:10.012315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ede2459-9059-4e90-84e4-282de8b0c8cb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:10.039474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ede2459-9059-4e90-84e4-282de8b0c8cb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:08:10.115201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bc7969d8-5bce-4040-b5cc-3da05e65829c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:10.116317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bc7969d8-5bce-4040-b5cc-3da05e65829c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:10.130248 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ede2459-9059-4e90-84e4-282de8b0c8cb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 204 len: 0 microversion: 2.1 time: 0.132809 Aug 27 05:08:10.131002 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1653/3249] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:08:09 2022] DELETE /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:08:10.137766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7969d8-5bce-4040-b5cc-3da05e65829c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:10.138383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7969d8-5bce-4040-b5cc-3da05e65829c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:10.138806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7969d8-5bce-4040-b5cc-3da05e65829c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:10.139705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7969d8-5bce-4040-b5cc-3da05e65829c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:10.140223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7969d8-5bce-4040-b5cc-3da05e65829c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:10.141463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7f193a72-1af5-4b28-80ca-39c78cf97307 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:10.143051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7f193a72-1af5-4b28-80ca-39c78cf97307 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:10.143225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc7969d8-5bce-4040-b5cc-3da05e65829c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:10.152806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f193a72-1af5-4b28-80ca-39c78cf97307 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:10.153455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f193a72-1af5-4b28-80ca-39c78cf97307 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:10.153999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f193a72-1af5-4b28-80ca-39c78cf97307 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:10.154824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f193a72-1af5-4b28-80ca-39c78cf97307 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:10.155414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f193a72-1af5-4b28-80ca-39c78cf97307 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:10.155954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f193a72-1af5-4b28-80ca-39c78cf97307 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:10.354199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bc7969d8-5bce-4040-b5cc-3da05e65829c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:10.363978 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bc7969d8-5bce-4040-b5cc-3da05e65829c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.254013 Aug 27 05:08:10.364911 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1597/3250] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:10 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:10.370158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7f193a72-1af5-4b28-80ca-39c78cf97307 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:10.378320 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7f193a72-1af5-4b28-80ca-39c78cf97307 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1505 microversion: 2.1 time: 0.242269 Aug 27 05:08:10.378894 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1654/3251] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:10 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:10.730828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c30b87a9-249c-4069-9a16-c96965c521a7 req-6d8d0404-0923-4f76-aa70-84ba8d78c97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780d1d8c-aaf6-4d22-b37a-b48a881f9d77", "name": "network-vif-unplugged", "status": "completed", "tag": "a4069830-52de-48c2-90d4-5c1ba86d69a4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:10.752918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-984f201d-bb50-4a0e-ae68-67d159adbfda tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:10.754059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-984f201d-bb50-4a0e-ae68-67d159adbfda tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:10.762358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c30b87a9-249c-4069-9a16-c96965c521a7 req-6d8d0404-0923-4f76-aa70-84ba8d78c97b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:10.765308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-984f201d-bb50-4a0e-ae68-67d159adbfda tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:10.766760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c30b87a9-249c-4069-9a16-c96965c521a7 req-6d8d0404-0923-4f76-aa70-84ba8d78c97b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:10.767767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-984f201d-bb50-4a0e-ae68-67d159adbfda tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:10.768971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c30b87a9-249c-4069-9a16-c96965c521a7 req-6d8d0404-0923-4f76-aa70-84ba8d78c97b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:10.769913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-984f201d-bb50-4a0e-ae68-67d159adbfda tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:10.771904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-984f201d-bb50-4a0e-ae68-67d159adbfda tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:10.775224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-984f201d-bb50-4a0e-ae68-67d159adbfda tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:10.775781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-984f201d-bb50-4a0e-ae68-67d159adbfda tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:10.806472 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c30b87a9-249c-4069-9a16-c96965c521a7 req-6d8d0404-0923-4f76-aa70-84ba8d78c97b service nova] Creating event network-vif-unplugged:a4069830-52de-48c2-90d4-5c1ba86d69a4 for instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 on n-h1-820368-35 Aug 27 05:08:10.811540 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c30b87a9-249c-4069-9a16-c96965c521a7 req-6d8d0404-0923-4f76-aa70-84ba8d78c97b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086123 Aug 27 05:08:10.812582 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1598/3252] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:11.176124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-984f201d-bb50-4a0e-ae68-67d159adbfda tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:11.185385 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-984f201d-bb50-4a0e-ae68-67d159adbfda tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1506 microversion: 2.1 time: 0.436378 Aug 27 05:08:11.185965 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1655/3253] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:10 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:11.387562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4c10300e-3122-4ac2-86d2-241416ceef02 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:11.388309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4c10300e-3122-4ac2-86d2-241416ceef02 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:11.399399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6dc1b254-f597-49c7-aabb-7d4894afaaf7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:11.400818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6dc1b254-f597-49c7-aabb-7d4894afaaf7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:11.401573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c10300e-3122-4ac2-86d2-241416ceef02 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:11.402076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c10300e-3122-4ac2-86d2-241416ceef02 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:11.402521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c10300e-3122-4ac2-86d2-241416ceef02 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:11.404667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c10300e-3122-4ac2-86d2-241416ceef02 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:11.406154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c10300e-3122-4ac2-86d2-241416ceef02 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:11.406597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c10300e-3122-4ac2-86d2-241416ceef02 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:11.412440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dc1b254-f597-49c7-aabb-7d4894afaaf7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:11.416492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dc1b254-f597-49c7-aabb-7d4894afaaf7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:11.417163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dc1b254-f597-49c7-aabb-7d4894afaaf7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:11.418081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dc1b254-f597-49c7-aabb-7d4894afaaf7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:11.420662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dc1b254-f597-49c7-aabb-7d4894afaaf7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:11.421972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dc1b254-f597-49c7-aabb-7d4894afaaf7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:11.451241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:11.453824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:11.818032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4c10300e-3122-4ac2-86d2-241416ceef02 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:11.828627 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4c10300e-3122-4ac2-86d2-241416ceef02 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.446774 Aug 27 05:08:11.832660 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1599/3254] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:11 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:11.841595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6dc1b254-f597-49c7-aabb-7d4894afaaf7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:11.850454 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6dc1b254-f597-49c7-aabb-7d4894afaaf7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1505 microversion: 2.1 time: 0.454966 Aug 27 05:08:11.856416 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1656/3255] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:11 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:12.208586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1550a3d-9036-44ea-ae47-81e9eb36d160 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:12.209425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d1550a3d-9036-44ea-ae47-81e9eb36d160 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:12.219705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1550a3d-9036-44ea-ae47-81e9eb36d160 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:12.223692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1550a3d-9036-44ea-ae47-81e9eb36d160 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:12.224481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1550a3d-9036-44ea-ae47-81e9eb36d160 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:12.226335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1550a3d-9036-44ea-ae47-81e9eb36d160 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:12.228694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1550a3d-9036-44ea-ae47-81e9eb36d160 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:12.229390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1550a3d-9036-44ea-ae47-81e9eb36d160 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:12.420716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-090ccab7-5a3c-4f70-b938-1e16c1e03c26 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:12.421456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-090ccab7-5a3c-4f70-b938-1e16c1e03c26 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:12.434244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-090ccab7-5a3c-4f70-b938-1e16c1e03c26 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:12.434753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-090ccab7-5a3c-4f70-b938-1e16c1e03c26 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:12.435285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-090ccab7-5a3c-4f70-b938-1e16c1e03c26 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:12.436136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-090ccab7-5a3c-4f70-b938-1e16c1e03c26 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:12.436597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-090ccab7-5a3c-4f70-b938-1e16c1e03c26 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:12.437029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-090ccab7-5a3c-4f70-b938-1e16c1e03c26 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:12.503775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-090ccab7-5a3c-4f70-b938-1e16c1e03c26 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:08:12.659380 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-090ccab7-5a3c-4f70-b938-1e16c1e03c26 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "DELETE /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 204 len: 0 microversion: 2.1 time: 0.242435 Aug 27 05:08:12.660469 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1657/3256] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:08:12 2022] DELETE /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:08:12.680469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5d0290ac-d7e7-4f92-971f-216d368b0662 req-07800aa5-38df-4d4a-9478-d7359f86c881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316a9750-f2aa-4432-bea7-760186f0a652", "tag": "1ff79ed0-4243-461b-a1be-38445ac36d07"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:12.691186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5d0290ac-d7e7-4f92-971f-216d368b0662 req-07800aa5-38df-4d4a-9478-d7359f86c881 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:12.691923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5d0290ac-d7e7-4f92-971f-216d368b0662 req-07800aa5-38df-4d4a-9478-d7359f86c881 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:12.692564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5d0290ac-d7e7-4f92-971f-216d368b0662 req-07800aa5-38df-4d4a-9478-d7359f86c881 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:12.716678 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-5d0290ac-d7e7-4f92-971f-216d368b0662 req-07800aa5-38df-4d4a-9478-d7359f86c881 service nova] Creating event network-changed:1ff79ed0-4243-461b-a1be-38445ac36d07 for instance 316a9750-f2aa-4432-bea7-760186f0a652 on n-h1-820368-35 Aug 27 05:08:12.723368 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5d0290ac-d7e7-4f92-971f-216d368b0662 req-07800aa5-38df-4d4a-9478-d7359f86c881 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061093 Aug 27 05:08:12.724531 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1658/3257] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:12.731353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af3fd27a-1826-4446-8db9-b9d9f8929ae8 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:12.731353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-af3fd27a-1826-4446-8db9-b9d9f8929ae8 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:12.741021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af3fd27a-1826-4446-8db9-b9d9f8929ae8 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:12.741815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af3fd27a-1826-4446-8db9-b9d9f8929ae8 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:12.742492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af3fd27a-1826-4446-8db9-b9d9f8929ae8 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:12.743407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af3fd27a-1826-4446-8db9-b9d9f8929ae8 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:12.744024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af3fd27a-1826-4446-8db9-b9d9f8929ae8 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:12.744613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af3fd27a-1826-4446-8db9-b9d9f8929ae8 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:12.976923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d1550a3d-9036-44ea-ae47-81e9eb36d160 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:12.989425 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1550a3d-9036-44ea-ae47-81e9eb36d160 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 200 len: 1449 microversion: 2.1 time: 0.786257 Aug 27 05:08:13.005272 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1600/3258] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:12 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 1449 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:13.005272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3563ac02-f442-43e8-8415-88619acddbf1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:13.005272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3563ac02-f442-43e8-8415-88619acddbf1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:13.016233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3563ac02-f442-43e8-8415-88619acddbf1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:13.017004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3563ac02-f442-43e8-8415-88619acddbf1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:13.017457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3563ac02-f442-43e8-8415-88619acddbf1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:13.018176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3563ac02-f442-43e8-8415-88619acddbf1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:13.018637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3563ac02-f442-43e8-8415-88619acddbf1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:13.019071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3563ac02-f442-43e8-8415-88619acddbf1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:13.114409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af3fd27a-1826-4446-8db9-b9d9f8929ae8 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:13.125244 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af3fd27a-1826-4446-8db9-b9d9f8929ae8 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1668 microversion: 2.1 time: 0.399328 Aug 27 05:08:13.126206 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1659/3259] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:12 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1668 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:13.141635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d63aa773-810f-4f25-89e1-0611b2a56f9a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:13.142669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d63aa773-810f-4f25-89e1-0611b2a56f9a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:13.149574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d63aa773-810f-4f25-89e1-0611b2a56f9a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:13.150323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d63aa773-810f-4f25-89e1-0611b2a56f9a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:13.150994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d63aa773-810f-4f25-89e1-0611b2a56f9a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:13.152038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d63aa773-810f-4f25-89e1-0611b2a56f9a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:13.152731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d63aa773-810f-4f25-89e1-0611b2a56f9a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:13.153444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d63aa773-810f-4f25-89e1-0611b2a56f9a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:13.386295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3563ac02-f442-43e8-8415-88619acddbf1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:13.395242 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3563ac02-f442-43e8-8415-88619acddbf1 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.401577 Aug 27 05:08:13.396813 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1601/3260] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:12 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:13.402367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:13.406653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:13.414032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d63aa773-810f-4f25-89e1-0611b2a56f9a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:13.430813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:13.431724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:13.433670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:13.435352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:13.435352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:13.437054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:13.446136 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d63aa773-810f-4f25-89e1-0611b2a56f9a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 200 len: 1505 microversion: 2.1 time: 0.305138 Aug 27 05:08:13.460208 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1660/3261] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:13 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:13.486483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:08:13.494464 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.compute.api [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Working on deleting snapshot f36032f2-7dca-448c-bde5-e2e07cd7f173 from shelved instance... Aug 27 05:08:14.148841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4c2122d7-e5f2-45e3-9e1d-d9e125ee2eb6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:14.149470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4c2122d7-e5f2-45e3-9e1d-d9e125ee2eb6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:14.172778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c2122d7-e5f2-45e3-9e1d-d9e125ee2eb6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:14.173311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c2122d7-e5f2-45e3-9e1d-d9e125ee2eb6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:14.173760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c2122d7-e5f2-45e3-9e1d-d9e125ee2eb6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:14.174489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c2122d7-e5f2-45e3-9e1d-d9e125ee2eb6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:14.174953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c2122d7-e5f2-45e3-9e1d-d9e125ee2eb6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:14.175421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c2122d7-e5f2-45e3-9e1d-d9e125ee2eb6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:14.399507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Doing local delete in cell ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) {{(pid=128547) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 05:08:14.401931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:14.402647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:14.403452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:14.404106 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.compute.api [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 05:08:14.424452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] deallocate_for_instance() {{(pid=128547) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 05:08:14.693762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4c2122d7-e5f2-45e3-9e1d-d9e125ee2eb6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:14.701968 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4c2122d7-e5f2-45e3-9e1d-d9e125ee2eb6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1668 microversion: 2.1 time: 0.557040 Aug 27 05:08:14.702544 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1661/3262] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:14 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1668 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:14.708238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-173085ec-2be7-4f26-b59f-05cd3d916ece tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:14.709066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-173085ec-2be7-4f26-b59f-05cd3d916ece tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:14.717817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-173085ec-2be7-4f26-b59f-05cd3d916ece tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:14.718322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-173085ec-2be7-4f26-b59f-05cd3d916ece tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:14.718764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-173085ec-2be7-4f26-b59f-05cd3d916ece tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:14.719516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-173085ec-2be7-4f26-b59f-05cd3d916ece tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:14.719973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-173085ec-2be7-4f26-b59f-05cd3d916ece tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:14.721126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-173085ec-2be7-4f26-b59f-05cd3d916ece tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:15.027692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-173085ec-2be7-4f26-b59f-05cd3d916ece tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:15.041846 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-173085ec-2be7-4f26-b59f-05cd3d916ece tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.337972 Aug 27 05:08:15.042909 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1662/3263] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:14 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:15.051972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:15.052928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 90344fdd-65fb-471a-ac62-b816bf3936b2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:15.060649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:15.061521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:15.062360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:15.063198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:15.063827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:15.064489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:15.092998 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] HTTP exception thrown: Instance 90344fdd-65fb-471a-ac62-b816bf3936b2 could not be found. Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Request method failure captured: Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 HTTP/1.1 Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaah1jF5G26RDObT9VCTmvazQ0ftcIufmOiOTQ2BKX0ZH7gBNRf0yo9DyA2N9-RRqMSDpnBdRsQf-YE3nCILz4NvTqzMfEzPpd9CHD1bjhPDXOjvtgKEZOoanzwzQVX3GZ6FH8w2Pbjg1k1GmvuhEH57SiexQqeLtUuQ3mvi0dbYOCM Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: a52a4949c7c74e60b345a30ffb6fd495 Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesActionsTest-1524314651 Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a52a4949c7c74e60b345a30ffb6fd495", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a52a4949c7c74e60b345a30ffb6fd495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a52a4949c7c74e60b345a30ffb6fd495"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a52a4949c7c74e60b345a30ffb6fd495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesActionsTest-1524314651 Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: a52a4949c7c74e60b345a30ffb6fd495 Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesActionsTest-1524314651 Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesActionsTest-1524314651-project Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 0041a7908e8141c6be225f5e8769bfb2 Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesActionsTest-1524314651-project Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 90344fdd-65fb-471a-ac62-b816bf3936b2 could not be found. Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '90344fdd-65fb-471a-ac62-b816bf3936b2'} Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90344fdd-65fb-471a-ac62-b816bf3936b2 could not be found. Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90344fdd-65fb-471a-ac62-b816bf3936b2 could not be found. Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:15.097244 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:15.102571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:15.102571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:15.102571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:15.102571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:15.102571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:15.102571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90344fdd-65fb-471a-ac62-b816bf3936b2 could not be found. Aug 27 05:08:15.102571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:15.102571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Returning 404 to user: Instance 90344fdd-65fb-471a-ac62-b816bf3936b2 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:15.104016 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8c7757ea-fe15-4199-8e90-56f141311774 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2" status: 404 len: 111 microversion: 2.1 time: 0.059634 Aug 27 05:08:15.113653 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1663/3264] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:15 2022] GET /compute/v2.1/servers/90344fdd-65fb-471a-ac62-b816bf3936b2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:15.286393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d24ac436-d4c8-485a-ad25-07c279c108bb tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:15.286920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d24ac436-d4c8-485a-ad25-07c279c108bb tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:15.297710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d24ac436-d4c8-485a-ad25-07c279c108bb tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:15.303046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d24ac436-d4c8-485a-ad25-07c279c108bb tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:15.303537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d24ac436-d4c8-485a-ad25-07c279c108bb tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:15.304445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d24ac436-d4c8-485a-ad25-07c279c108bb tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:15.304768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d24ac436-d4c8-485a-ad25-07c279c108bb tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:15.305238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d24ac436-d4c8-485a-ad25-07c279c108bb tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:15.354013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d24ac436-d4c8-485a-ad25-07c279c108bb tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:08:15.388677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Updating instance_info_cache with network_info: [] {{(pid=128547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 05:08:15.545307 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d24ac436-d4c8-485a-ad25-07c279c108bb tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 204 len: 0 microversion: 2.32 time: 0.439521 Aug 27 05:08:15.546073 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1664/3265] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:08:15 2022] DELETE /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:08:15.560169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1dbbed8e-da15-44bf-bfa6-e36ed0c3977f req-fecad583-6ead-4e67-9b01-e5bf13df62d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90344fdd-65fb-471a-ac62-b816bf3936b2", "name": "network-vif-deleted", "tag": "19c7fe58-2cb0-4b71-bef6-9dafff9de477"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:15.582996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1dbbed8e-da15-44bf-bfa6-e36ed0c3977f req-fecad583-6ead-4e67-9b01-e5bf13df62d1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:15.584039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1dbbed8e-da15-44bf-bfa6-e36ed0c3977f req-fecad583-6ead-4e67-9b01-e5bf13df62d1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:15.584826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1dbbed8e-da15-44bf-bfa6-e36ed0c3977f req-fecad583-6ead-4e67-9b01-e5bf13df62d1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:15.600178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1dbbed8e-da15-44bf-bfa6-e36ed0c3977f req-fecad583-6ead-4e67-9b01-e5bf13df62d1 service nova] Creating event network-vif-deleted:19c7fe58-2cb0-4b71-bef6-9dafff9de477 for instance 90344fdd-65fb-471a-ac62-b816bf3936b2 on n-h2-820368-35 Aug 27 05:08:15.607017 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1dbbed8e-da15-44bf-bfa6-e36ed0c3977f req-fecad583-6ead-4e67-9b01-e5bf13df62d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055395 Aug 27 05:08:15.608157 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1665/3266] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:15.615472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-962599112", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "9d336da5-0dff-4839-91a6-65c81c8c07a9"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:15.725981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] validate_networks() for [('9d336da5-0dff-4839-91a6-65c81c8c07a9', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:08:15.763624 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-80de91a2-9a01-49e3-95cd-79728bb1f20a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 204 len: 0 microversion: 2.1 time: 2.364957 Aug 27 05:08:15.764854 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1602/3267] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:08:13 2022] DELETE /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 0 bytes in 2367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:08:15.772313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c3d12a6d-ca50-4e4c-a7ae-3663ebce0e48 req-b23648ee-eb86-4173-aa99-30e9568930b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780d1d8c-aaf6-4d22-b37a-b48a881f9d77", "name": "network-vif-deleted", "tag": "a4069830-52de-48c2-90d4-5c1ba86d69a4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:15.795756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c3d12a6d-ca50-4e4c-a7ae-3663ebce0e48 req-b23648ee-eb86-4173-aa99-30e9568930b2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:15.796246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c3d12a6d-ca50-4e4c-a7ae-3663ebce0e48 req-b23648ee-eb86-4173-aa99-30e9568930b2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:15.796672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c3d12a6d-ca50-4e4c-a7ae-3663ebce0e48 req-b23648ee-eb86-4173-aa99-30e9568930b2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:15.818306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.compute.server_external_events [req-c3d12a6d-ca50-4e4c-a7ae-3663ebce0e48 req-b23648ee-eb86-4173-aa99-30e9568930b2 service nova] Unable to find a host for instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77. Dropping event network-vif-deleted {{(pid=128547) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 05:08:15.819231 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c3d12a6d-ca50-4e4c-a7ae-3663ebce0e48 req-b23648ee-eb86-4173-aa99-30e9568930b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.053408 Aug 27 05:08:15.820379 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1603/3268] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 05:08:15.825460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:15.826077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:15.833201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:15.833724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:15.834150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:15.835028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:15.835704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:15.836136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:16.159868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:16.174032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:16.176178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:16.178110 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b1604269-efa8-4e17-8269-6ceadf9b0e4b tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2954 microversion: 2.32 time: 0.356599 Aug 27 05:08:16.179755 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1604/3269] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:15 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2954 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:16.185009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf1d2ee2-3107-4e3c-854a-2994688203f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:16.185919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf1d2ee2-3107-4e3c-854a-2994688203f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:16.192693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1d2ee2-3107-4e3c-854a-2994688203f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:16.193743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1d2ee2-3107-4e3c-854a-2994688203f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:16.194422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1d2ee2-3107-4e3c-854a-2994688203f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:16.202793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1d2ee2-3107-4e3c-854a-2994688203f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:16.205289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1d2ee2-3107-4e3c-854a-2994688203f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:16.206045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1d2ee2-3107-4e3c-854a-2994688203f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:16.322345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bf1d2ee2-3107-4e3c-854a-2994688203f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:16.332303 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf1d2ee2-3107-4e3c-854a-2994688203f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 200 len: 1482 microversion: 2.1 time: 0.151162 Aug 27 05:08:16.347382 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1605/3270] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:16 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 1482 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:16.354441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:16.355532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:16.363195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:16.364336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:08:16.364499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:16.364762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:08:16.365238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:08:16.365399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:16.365954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:08:16.366541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:08:16.366869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:16.367635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:16.368289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:16.395523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:16.395936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:16.396402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:16.397162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:16.397631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:16.398073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:16.405654 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 HTTP/1.1 Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '780d1d8c-aaf6-4d22-b37a-b48a881f9d77'} Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:16.407370 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:16.413341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:16.413341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:16.413341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:16.413341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:16.413341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:16.413341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:08:16.413341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:16.413341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:16.413341 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7f3bd798-3536-49b4-a313-db154a749029 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 404 len: 111 microversion: 2.1 time: 0.059878 Aug 27 05:08:16.415200 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1606/3271] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:16 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:16.420954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-346eeff4-fe71-4f90-88c4-2eb20c2f8bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:16.424622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-346eeff4-fe71-4f90-88c4-2eb20c2f8bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:16.442715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-346eeff4-fe71-4f90-88c4-2eb20c2f8bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:16.443738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-346eeff4-fe71-4f90-88c4-2eb20c2f8bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:16.444393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-346eeff4-fe71-4f90-88c4-2eb20c2f8bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:16.445386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-346eeff4-fe71-4f90-88c4-2eb20c2f8bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:16.446743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-346eeff4-fe71-4f90-88c4-2eb20c2f8bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:16.447825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-346eeff4-fe71-4f90-88c4-2eb20c2f8bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:16.448547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Getting quotas for project a52a4949c7c74e60b345a30ffb6fd495. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:08:16.456826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Getting quotas for user 0041a7908e8141c6be225f5e8769bfb2 and project a52a4949c7c74e60b345a30ffb6fd495. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:08:16.491471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:08:16.494635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:08:16.569677 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae57175e-a179-4742-aae3-efe2659a878b tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959639 Aug 27 05:08:16.576273 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1666/3272] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:08:16.588396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1eb6f957-4de2-45fc-8670-15368d29a9ea tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:16.589046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1eb6f957-4de2-45fc-8670-15368d29a9ea tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:16.681578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-346eeff4-fe71-4f90-88c4-2eb20c2f8bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:16.705809 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-346eeff4-fe71-4f90-88c4-2eb20c2f8bda tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.289082 Aug 27 05:08:16.706919 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1607/3273] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:16 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:16.812606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1eb6f957-4de2-45fc-8670-15368d29a9ea tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:16.830279 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1eb6f957-4de2-45fc-8670-15368d29a9ea tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1213 microversion: 2.1 time: 0.251248 Aug 27 05:08:16.843560 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1667/3274] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:16 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1213 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:16.906067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2061533563", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "11b9ce7b-910c-4628-97fe-5e2c2147efa3"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:16.994434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] validate_networks() for [('11b9ce7b-910c-4628-97fe-5e2c2147efa3', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:08:17.204175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:17.205678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:17.219864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:17.236642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:17.237279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:17.238204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:17.238876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:17.239529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:17.865633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:17.878842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:17.880339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:17.883620 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1b1101d0-3f41-4c14-b832-014c667feff7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2954 microversion: 2.32 time: 0.683339 Aug 27 05:08:17.884189 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1668/3275] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:17 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2954 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:08:17.915261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:17.916050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: 316a9750-f2aa-4432-bea7-760186f0a652] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:17.923344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:17.923845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:17.924295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:17.929297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:17.929856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:17.930314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:17.950501 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] HTTP exception thrown: Instance 316a9750-f2aa-4432-bea7-760186f0a652 could not be found. Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Request method failure captured: Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 HTTP/1.1 Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaXQAsB2XQRlEqN77yMjRdnxICdaUvx6aP-hcZhMjA1lQrSkOUf-2PDotZlnHuVaSViuVVQmGWkusSlpeFvcQztnOYnTvckKqFy1eNapeLUENE8eCZ_V2GMGXqynlCiHGRNLoU4zJ2OE1t9a_J-SZPHQ25ZNK3M6X1I9WG2wrZWVomI Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 8855a07236c54efa89fcec7f944afd94 Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestNetworkBasicOps-2034116476 Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8855a07236c54efa89fcec7f944afd94", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8855a07236c54efa89fcec7f944afd94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8855a07236c54efa89fcec7f944afd94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8855a07236c54efa89fcec7f944afd94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestNetworkBasicOps-2034116476 Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 8855a07236c54efa89fcec7f944afd94 Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestNetworkBasicOps-2034116476 Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestNetworkBasicOps-2034116476-project Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: bf8bd46b91cf4774af109507c7c4422a Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestNetworkBasicOps-2034116476-project Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 316a9750-f2aa-4432-bea7-760186f0a652 could not be found. Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '316a9750-f2aa-4432-bea7-760186f0a652'} Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 316a9750-f2aa-4432-bea7-760186f0a652 could not be found. Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 316a9750-f2aa-4432-bea7-760186f0a652 could not be found. Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:17.952233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:17.958000 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:17.958000 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:17.958000 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:17.958000 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:17.958000 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:17.958000 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 316a9750-f2aa-4432-bea7-760186f0a652 could not be found. Aug 27 05:08:17.958000 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:17.959632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Returning 404 to user: Instance 316a9750-f2aa-4432-bea7-760186f0a652 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:17.960681 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a3fb55da-20b6-4cb9-85e0-9452941407e6 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652" status: 404 len: 111 microversion: 2.1 time: 0.056824 Aug 27 05:08:17.961762 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1669/3276] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:17 2022] GET /compute/v2.1/servers/316a9750-f2aa-4432-bea7-760186f0a652 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:17.968088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-8a4aac23-1518-4c91-abd0-71dcef2efd47 req-10189fba-80be-4cec-9c6f-029956982b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316a9750-f2aa-4432-bea7-760186f0a652", "name": "network-vif-deleted", "tag": "1ff79ed0-4243-461b-a1be-38445ac36d07"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:17.983727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8a4aac23-1518-4c91-abd0-71dcef2efd47 req-10189fba-80be-4cec-9c6f-029956982b94 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:17.984761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8a4aac23-1518-4c91-abd0-71dcef2efd47 req-10189fba-80be-4cec-9c6f-029956982b94 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:17.985417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8a4aac23-1518-4c91-abd0-71dcef2efd47 req-10189fba-80be-4cec-9c6f-029956982b94 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:17.991307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:08:17.991840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:08:17.992376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:08:17.993132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:08:17.993695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:08:18.001797 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-8a4aac23-1518-4c91-abd0-71dcef2efd47 req-10189fba-80be-4cec-9c6f-029956982b94 service nova] Creating event network-vif-deleted:1ff79ed0-4243-461b-a1be-38445ac36d07 for instance 316a9750-f2aa-4432-bea7-760186f0a652 on n-h1-820368-35 Aug 27 05:08:18.010685 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-8a4aac23-1518-4c91-abd0-71dcef2efd47 req-10189fba-80be-4cec-9c6f-029956982b94 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045976 Aug 27 05:08:18.011828 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1670/3277] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:18.018370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:18.019561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-99f3dae8-0a4f-48db-b412-36ac47abff2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:18.021233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-99f3dae8-0a4f-48db-b412-36ac47abff2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:18.023474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:18.029186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3dae8-0a4f-48db-b412-36ac47abff2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:18.029691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:18.030199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3dae8-0a4f-48db-b412-36ac47abff2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:18.030814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3dae8-0a4f-48db-b412-36ac47abff2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:18.030949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:18.031541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:18.032058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3dae8-0a4f-48db-b412-36ac47abff2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:18.032193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:18.032828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3dae8-0a4f-48db-b412-36ac47abff2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:18.033567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3dae8-0a4f-48db-b412-36ac47abff2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:18.066131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:08:18.075061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for user d3ae5460271c4f5291e6abb0e76cab17 and project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:08:18.114090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:08:18.124931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:08:18.244629 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3fa09495-53d0-43ae-8f76-421d00678f8d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.344098 Aug 27 05:08:18.247383 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1608/3278] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:08:18.266771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b9999a0d-bef2-438a-81e7-4c32959966b4 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:18.268674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b9999a0d-bef2-438a-81e7-4c32959966b4 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:18.311427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-99f3dae8-0a4f-48db-b412-36ac47abff2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:18.319653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9999a0d-bef2-438a-81e7-4c32959966b4 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:18.320688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9999a0d-bef2-438a-81e7-4c32959966b4 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:18.321295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9999a0d-bef2-438a-81e7-4c32959966b4 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:18.322330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9999a0d-bef2-438a-81e7-4c32959966b4 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:18.323470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9999a0d-bef2-438a-81e7-4c32959966b4 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:18.324064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9999a0d-bef2-438a-81e7-4c32959966b4 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:18.335869 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-99f3dae8-0a4f-48db-b412-36ac47abff2b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.322469 Aug 27 05:08:18.352807 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1671/3279] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:18 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:18.368743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7c4b6684-2168-4d0e-90b3-43ee1b238a59 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:18.371710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7c4b6684-2168-4d0e-90b3-43ee1b238a59 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:18.397797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:18.445155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b9999a0d-bef2-438a-81e7-4c32959966b4 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:18.480379 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b9999a0d-bef2-438a-81e7-4c32959966b4 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1273 microversion: 2.1 time: 0.230252 Aug 27 05:08:18.498567 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1609/3280] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:18 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:18.505973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5efeac26-c2cb-461a-a1f7-3dfe2b0da7e2 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '.version_select at 0x7fb5648a71f0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:18.549992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7c4b6684-2168-4d0e-90b3-43ee1b238a59 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:18.562302 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7c4b6684-2168-4d0e-90b3-43ee1b238a59 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1215 microversion: 2.1 time: 0.206402 Aug 27 05:08:18.565375 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1672/3281] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:18 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1215 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:18.586076 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5efeac26-c2cb-461a-a1f7-3dfe2b0da7e2 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-81664297" status: 202 len: 0 microversion: 2.1 time: 0.085982 Aug 27 05:08:18.586666 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1610/3282] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 05:08:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-81664297 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:08:18.910117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:18.910731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:18.926785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:18.927320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:18.927762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:18.928480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:18.928943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:18.929461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:19.227791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:19.238784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:19.240611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:19.242754 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8db0eeec-c78f-40f0-a6b3-2735aeccf179 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2954 microversion: 2.32 time: 0.336933 Aug 27 05:08:19.243881 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1673/3283] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:18 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2954 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:19.365248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d519edb1-a185-4ebe-a93a-30310236d2f4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:19.367187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d519edb1-a185-4ebe-a93a-30310236d2f4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:19.378177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d519edb1-a185-4ebe-a93a-30310236d2f4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:19.379391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d519edb1-a185-4ebe-a93a-30310236d2f4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:19.380136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d519edb1-a185-4ebe-a93a-30310236d2f4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:19.381678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d519edb1-a185-4ebe-a93a-30310236d2f4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:19.383649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d519edb1-a185-4ebe-a93a-30310236d2f4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:19.384427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d519edb1-a185-4ebe-a93a-30310236d2f4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:19.519362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9fcd46d4-8fd6-4a6d-ac15-cee9a59ff3d6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:19.520873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9fcd46d4-8fd6-4a6d-ac15-cee9a59ff3d6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:19.529818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcd46d4-8fd6-4a6d-ac15-cee9a59ff3d6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:19.530413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcd46d4-8fd6-4a6d-ac15-cee9a59ff3d6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:19.531728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcd46d4-8fd6-4a6d-ac15-cee9a59ff3d6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:19.532551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcd46d4-8fd6-4a6d-ac15-cee9a59ff3d6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:19.533217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcd46d4-8fd6-4a6d-ac15-cee9a59ff3d6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:19.533910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcd46d4-8fd6-4a6d-ac15-cee9a59ff3d6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:19.670444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9fcd46d4-8fd6-4a6d-ac15-cee9a59ff3d6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:19.680027 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9fcd46d4-8fd6-4a6d-ac15-cee9a59ff3d6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1271 microversion: 2.1 time: 0.166957 Aug 27 05:08:19.680552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d519edb1-a185-4ebe-a93a-30310236d2f4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:19.681440 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1674/3284] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:19 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:19.686631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d81839d5-6b57-42aa-bad3-e111450eab8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:19.687505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d81839d5-6b57-42aa-bad3-e111450eab8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:19.695051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d81839d5-6b57-42aa-bad3-e111450eab8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:19.695922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d81839d5-6b57-42aa-bad3-e111450eab8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:19.696740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d81839d5-6b57-42aa-bad3-e111450eab8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:19.697835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d81839d5-6b57-42aa-bad3-e111450eab8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:19.698633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d81839d5-6b57-42aa-bad3-e111450eab8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:19.699497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d81839d5-6b57-42aa-bad3-e111450eab8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:19.711561 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d519edb1-a185-4ebe-a93a-30310236d2f4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.352471 Aug 27 05:08:19.725702 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1611/3285] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:19 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:19.741611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:19.832150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d81839d5-6b57-42aa-bad3-e111450eab8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:19.843336 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d81839d5-6b57-42aa-bad3-e111450eab8e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1267 microversion: 2.1 time: 0.159928 Aug 27 05:08:19.844606 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1675/3286] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:19 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:20.279620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:20.280386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:20.287936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:20.288774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:20.289490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:20.290430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:20.291237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:20.291885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:20.696553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:20.702583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-390debfb-33d3-4296-9bb2-c0f9ff31e933 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:20.703241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-390debfb-33d3-4296-9bb2-c0f9ff31e933 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:20.703487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:20.714591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:20.723865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390debfb-33d3-4296-9bb2-c0f9ff31e933 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:20.724717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390debfb-33d3-4296-9bb2-c0f9ff31e933 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:20.725355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390debfb-33d3-4296-9bb2-c0f9ff31e933 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:20.726345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390debfb-33d3-4296-9bb2-c0f9ff31e933 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:20.726488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:20.727164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390debfb-33d3-4296-9bb2-c0f9ff31e933 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:20.727800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390debfb-33d3-4296-9bb2-c0f9ff31e933 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:20.731199 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ade31f36-bc6d-4c09-8f8b-569401f1a267 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2954 microversion: 2.32 time: 0.453871 Aug 27 05:08:20.733959 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1612/3287] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:20 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2954 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:20.754814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-930f3742-5b0a-41be-8bb8-7274818089b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:20.755530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-930f3742-5b0a-41be-8bb8-7274818089b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:20.771705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930f3742-5b0a-41be-8bb8-7274818089b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:20.781341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930f3742-5b0a-41be-8bb8-7274818089b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:20.784910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930f3742-5b0a-41be-8bb8-7274818089b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:20.786012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930f3742-5b0a-41be-8bb8-7274818089b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:20.787891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930f3742-5b0a-41be-8bb8-7274818089b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:20.788668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930f3742-5b0a-41be-8bb8-7274818089b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:21.280977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-390debfb-33d3-4296-9bb2-c0f9ff31e933 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:21.305407 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-390debfb-33d3-4296-9bb2-c0f9ff31e933 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1313 microversion: 2.1 time: 0.602084 Aug 27 05:08:21.307212 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1676/3288] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:20 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:21.328351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-add17c93-77a7-4291-88d7-fce3aabc9394 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:21.329943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-add17c93-77a7-4291-88d7-fce3aabc9394 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:21.338198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-add17c93-77a7-4291-88d7-fce3aabc9394 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:21.339003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-add17c93-77a7-4291-88d7-fce3aabc9394 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:21.340267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-add17c93-77a7-4291-88d7-fce3aabc9394 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:21.341209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-add17c93-77a7-4291-88d7-fce3aabc9394 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:21.341878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-add17c93-77a7-4291-88d7-fce3aabc9394 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:21.342700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-add17c93-77a7-4291-88d7-fce3aabc9394 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:21.373725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-930f3742-5b0a-41be-8bb8-7274818089b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:21.405306 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-930f3742-5b0a-41be-8bb8-7274818089b6 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.668087 Aug 27 05:08:21.409498 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1613/3289] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:20 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:21.523608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-add17c93-77a7-4291-88d7-fce3aabc9394 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:21.536395 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-add17c93-77a7-4291-88d7-fce3aabc9394 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1273 microversion: 2.1 time: 0.227548 Aug 27 05:08:21.537622 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1677/3290] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:21 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:21.764672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:21.765515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:21.784303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:21.784962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:21.785790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:21.786627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:21.799912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:21.800654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.327589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9fcc7f34-6dff-4132-9c0e-aab79f3c04c6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:22.328775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9fcc7f34-6dff-4132-9c0e-aab79f3c04c6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:22.337034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc7f34-6dff-4132-9c0e-aab79f3c04c6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.337760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc7f34-6dff-4132-9c0e-aab79f3c04c6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.338417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc7f34-6dff-4132-9c0e-aab79f3c04c6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.339342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc7f34-6dff-4132-9c0e-aab79f3c04c6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.340189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc7f34-6dff-4132-9c0e-aab79f3c04c6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.340800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fcc7f34-6dff-4132-9c0e-aab79f3c04c6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.526197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:22.537811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:22.540188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:22.541763 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-48c0cedd-faa1-4bbe-8271-3c7d2930c27f tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2954 microversion: 2.32 time: 0.781357 Aug 27 05:08:22.565297 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1614/3291] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:21 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2954 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:22.580938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-58b183b2-6a87-4782-aed1-59a91ecf594c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:22.581742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-58b183b2-6a87-4782-aed1-59a91ecf594c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:22.594343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58b183b2-6a87-4782-aed1-59a91ecf594c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.595079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58b183b2-6a87-4782-aed1-59a91ecf594c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.595594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58b183b2-6a87-4782-aed1-59a91ecf594c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.596528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58b183b2-6a87-4782-aed1-59a91ecf594c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.596993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58b183b2-6a87-4782-aed1-59a91ecf594c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.597505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58b183b2-6a87-4782-aed1-59a91ecf594c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.831362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9fcc7f34-6dff-4132-9c0e-aab79f3c04c6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:22.845828 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9fcc7f34-6dff-4132-9c0e-aab79f3c04c6 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1313 microversion: 2.1 time: 0.522352 Aug 27 05:08:22.846425 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1678/3292] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:22 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:22.862214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-816f4420-d70b-4d79-af6a-f650faca9286 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:22.863605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-816f4420-d70b-4d79-af6a-f650faca9286 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:22.874348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-816f4420-d70b-4d79-af6a-f650faca9286 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.875044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-816f4420-d70b-4d79-af6a-f650faca9286 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.875694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-816f4420-d70b-4d79-af6a-f650faca9286 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.877425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-816f4420-d70b-4d79-af6a-f650faca9286 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.878055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-816f4420-d70b-4d79-af6a-f650faca9286 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.878677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-816f4420-d70b-4d79-af6a-f650faca9286 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.955002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-58b183b2-6a87-4782-aed1-59a91ecf594c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:22.965674 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-58b183b2-6a87-4782-aed1-59a91ecf594c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.397540 Aug 27 05:08:22.966825 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1615/3293] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:22 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:22.983659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-816f4420-d70b-4d79-af6a-f650faca9286 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:22.993807 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-816f4420-d70b-4d79-af6a-f650faca9286 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1273 microversion: 2.1 time: 0.146222 Aug 27 05:08:22.996825 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1679/3294] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:22 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:23.568886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:23.569824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:23.583426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:23.596969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:23.597427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:23.598195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:23.598650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:23.599444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:23.868434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9b02611-939d-4f8f-872d-a95ebbbd1051 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:23.869055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9b02611-939d-4f8f-872d-a95ebbbd1051 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:23.899178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b02611-939d-4f8f-872d-a95ebbbd1051 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:23.899593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b02611-939d-4f8f-872d-a95ebbbd1051 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:23.900541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b02611-939d-4f8f-872d-a95ebbbd1051 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:23.901619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b02611-939d-4f8f-872d-a95ebbbd1051 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:23.902426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b02611-939d-4f8f-872d-a95ebbbd1051 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:23.903221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b02611-939d-4f8f-872d-a95ebbbd1051 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:24.669846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:24.687984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:24.692727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:24.698981 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3963ac23-61f7-4c4c-8871-348e39323348 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2933 microversion: 2.32 time: 1.135311 Aug 27 05:08:24.700691 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1616/3295] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:23 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2933 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:24.728817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d74c314-d61d-4af0-91b9-c6605d8562f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:24.730011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d74c314-d61d-4af0-91b9-c6605d8562f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:24.743737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d74c314-d61d-4af0-91b9-c6605d8562f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:24.747713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d74c314-d61d-4af0-91b9-c6605d8562f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:24.749119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d74c314-d61d-4af0-91b9-c6605d8562f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:24.750254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d74c314-d61d-4af0-91b9-c6605d8562f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:24.751634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d74c314-d61d-4af0-91b9-c6605d8562f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:24.752539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d74c314-d61d-4af0-91b9-c6605d8562f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:24.925548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f9b02611-939d-4f8f-872d-a95ebbbd1051 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:24.943926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9b02611-939d-4f8f-872d-a95ebbbd1051 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1313 microversion: 2.1 time: 1.079548 Aug 27 05:08:24.944790 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1680/3296] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:23 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1313 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:24.961058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5902091-6ff3-4162-a90c-85f3f549dd0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:24.961700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f5902091-6ff3-4162-a90c-85f3f549dd0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:24.968487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5902091-6ff3-4162-a90c-85f3f549dd0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:24.968996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5902091-6ff3-4162-a90c-85f3f549dd0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:24.969443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5902091-6ff3-4162-a90c-85f3f549dd0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:24.970195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5902091-6ff3-4162-a90c-85f3f549dd0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:24.978434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5902091-6ff3-4162-a90c-85f3f549dd0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:24.979151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5902091-6ff3-4162-a90c-85f3f549dd0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:25.545338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d74c314-d61d-4af0-91b9-c6605d8562f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:25.554164 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d74c314-d61d-4af0-91b9-c6605d8562f8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.849513 Aug 27 05:08:25.567567 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1617/3297] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:24 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:25.573859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5b0da97c-d6cc-4110-851f-e7a012bdc7e5 req-d7071e34-0366-4bc9-920b-b045458a0957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-unplugged", "status": "completed", "tag": "54fa96c5-5e23-4d52-a8f5-1c2c79f49849"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:25.585381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5b0da97c-d6cc-4110-851f-e7a012bdc7e5 req-d7071e34-0366-4bc9-920b-b045458a0957 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:25.586199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5b0da97c-d6cc-4110-851f-e7a012bdc7e5 req-d7071e34-0366-4bc9-920b-b045458a0957 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:25.586816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5b0da97c-d6cc-4110-851f-e7a012bdc7e5 req-d7071e34-0366-4bc9-920b-b045458a0957 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:25.603444 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5b0da97c-d6cc-4110-851f-e7a012bdc7e5 req-d7071e34-0366-4bc9-920b-b045458a0957 service nova] Creating event network-vif-unplugged:54fa96c5-5e23-4d52-a8f5-1c2c79f49849 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:08:25.621434 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5b0da97c-d6cc-4110-851f-e7a012bdc7e5 req-d7071e34-0366-4bc9-920b-b045458a0957 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051623 Aug 27 05:08:25.621852 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1618/3298] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:25.626974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-808fd6bc-30fc-4fb1-a431-edc2fe90e5c9 req-ab30132b-69ef-421c-a42f-3f76f7d5a705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280517c9-191f-47fc-9fd3-4d54372bac54", "tag": "a07ccbfe-811c-44a6-a1f6-f6533c850ed8"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:25.647411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-808fd6bc-30fc-4fb1-a431-edc2fe90e5c9 req-ab30132b-69ef-421c-a42f-3f76f7d5a705 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:25.648391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-808fd6bc-30fc-4fb1-a431-edc2fe90e5c9 req-ab30132b-69ef-421c-a42f-3f76f7d5a705 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:25.649624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-808fd6bc-30fc-4fb1-a431-edc2fe90e5c9 req-ab30132b-69ef-421c-a42f-3f76f7d5a705 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:25.662779 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-808fd6bc-30fc-4fb1-a431-edc2fe90e5c9 req-ab30132b-69ef-421c-a42f-3f76f7d5a705 service nova] Creating event network-changed:a07ccbfe-811c-44a6-a1f6-f6533c850ed8 for instance 280517c9-191f-47fc-9fd3-4d54372bac54 on n-h1-820368-35 Aug 27 05:08:25.680979 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-808fd6bc-30fc-4fb1-a431-edc2fe90e5c9 req-ab30132b-69ef-421c-a42f-3f76f7d5a705 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057690 Aug 27 05:08:25.681566 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1619/3299] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:25.682627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f5902091-6ff3-4162-a90c-85f3f549dd0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:25.711806 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5902091-6ff3-4162-a90c-85f3f549dd0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1315 microversion: 2.1 time: 0.765509 Aug 27 05:08:25.736763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:25.737700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:25.742880 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1681/3300] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:24 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1315 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:25.749722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:25.750680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:25.751414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:25.752350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:25.757000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:25.757792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:25.968529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b18c4c0-3d80-4fb0-b8b1-70b9c19d5142 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:25.971045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9b18c4c0-3d80-4fb0-b8b1-70b9c19d5142 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:25.982766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b18c4c0-3d80-4fb0-b8b1-70b9c19d5142 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:25.984951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b18c4c0-3d80-4fb0-b8b1-70b9c19d5142 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:25.986506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b18c4c0-3d80-4fb0-b8b1-70b9c19d5142 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:25.987487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b18c4c0-3d80-4fb0-b8b1-70b9c19d5142 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:25.989589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b18c4c0-3d80-4fb0-b8b1-70b9c19d5142 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:25.990577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b18c4c0-3d80-4fb0-b8b1-70b9c19d5142 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:26.200369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:26.225104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:26.228294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:26.230132 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-443505a6-4041-4e1a-988c-8e17ebdddaf7 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2912 microversion: 2.32 time: 0.498986 Aug 27 05:08:26.243169 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1620/3301] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:25 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2912 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:26.360742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9b18c4c0-3d80-4fb0-b8b1-70b9c19d5142 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:26.371811 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9b18c4c0-3d80-4fb0-b8b1-70b9c19d5142 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1313 microversion: 2.1 time: 0.410772 Aug 27 05:08:26.386169 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1682/3302] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:25 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:26.577835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dcdb7983-306c-419f-bca1-173b62563cac tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:26.578763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dcdb7983-306c-419f-bca1-173b62563cac tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:26.595989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcdb7983-306c-419f-bca1-173b62563cac tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:26.596825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcdb7983-306c-419f-bca1-173b62563cac tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:26.597767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcdb7983-306c-419f-bca1-173b62563cac tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:26.617911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcdb7983-306c-419f-bca1-173b62563cac tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:26.619708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcdb7983-306c-419f-bca1-173b62563cac tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:26.620734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcdb7983-306c-419f-bca1-173b62563cac tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:26.742096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0db83c52-233e-4978-9c11-d1f3356c13bb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:26.742937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0db83c52-233e-4978-9c11-d1f3356c13bb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:26.748573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:26.753997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0db83c52-233e-4978-9c11-d1f3356c13bb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:26.756567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0db83c52-233e-4978-9c11-d1f3356c13bb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:26.757636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0db83c52-233e-4978-9c11-d1f3356c13bb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:26.759127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0db83c52-233e-4978-9c11-d1f3356c13bb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:26.759808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0db83c52-233e-4978-9c11-d1f3356c13bb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:26.760513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0db83c52-233e-4978-9c11-d1f3356c13bb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:27.024556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dcdb7983-306c-419f-bca1-173b62563cac tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:27.042146 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dcdb7983-306c-419f-bca1-173b62563cac tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.467524 Aug 27 05:08:27.043901 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1621/3303] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:26 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:27.193772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0db83c52-233e-4978-9c11-d1f3356c13bb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:27.206545 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0db83c52-233e-4978-9c11-d1f3356c13bb tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1315 microversion: 2.1 time: 0.465584 Aug 27 05:08:27.209821 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1683/3304] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:26 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:27.257864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:27.258802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:27.272948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:27.273627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:27.274267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:27.275234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:27.275798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:27.276389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:27.395807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c4548c55-b008-420a-93de-2c8ab3eade22 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:27.396651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c4548c55-b008-420a-93de-2c8ab3eade22 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:27.404981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4548c55-b008-420a-93de-2c8ab3eade22 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:27.413036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4548c55-b008-420a-93de-2c8ab3eade22 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:27.413697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4548c55-b008-420a-93de-2c8ab3eade22 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:27.414651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4548c55-b008-420a-93de-2c8ab3eade22 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:27.415419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4548c55-b008-420a-93de-2c8ab3eade22 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:27.416030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4548c55-b008-420a-93de-2c8ab3eade22 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:28.053178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:28.093569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:28.103224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:28.110462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:28.114627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:28.118987 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bfa364fa-7a6e-42e6-9fa0-76bcae671183 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2866 microversion: 2.32 time: 0.864971 Aug 27 05:08:28.122971 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1622/3305] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:27 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2866 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:28.134914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-317523d2-d5b5-42ab-b62f-499b930d7b02 req-d431e1e7-cb95-4616-86e7-99b5964f8f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-unplugged", "status": "completed", "tag": "bd1cea64-a33a-4b9a-85cb-bf98ccbc4a5f"}, {"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-unplugged", "status": "completed", "tag": "5462e758-72dc-4c63-9751-fed9c3a9046c"}, {"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-unplugged", "status": "completed", "tag": "a40e1272-53cc-4930-bec4-a342676c13f1"}, {"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-unplugged", "status": "completed", "tag": "c9039cae-1e09-4044-a9e0-b73c85febfdd"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:28.154535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-317523d2-d5b5-42ab-b62f-499b930d7b02 req-d431e1e7-cb95-4616-86e7-99b5964f8f29 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:28.155485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-317523d2-d5b5-42ab-b62f-499b930d7b02 req-d431e1e7-cb95-4616-86e7-99b5964f8f29 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:28.156401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-317523d2-d5b5-42ab-b62f-499b930d7b02 req-d431e1e7-cb95-4616-86e7-99b5964f8f29 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:28.174016 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-317523d2-d5b5-42ab-b62f-499b930d7b02 req-d431e1e7-cb95-4616-86e7-99b5964f8f29 service nova] Creating event network-vif-unplugged:bd1cea64-a33a-4b9a-85cb-bf98ccbc4a5f for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:08:28.174975 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-317523d2-d5b5-42ab-b62f-499b930d7b02 req-d431e1e7-cb95-4616-86e7-99b5964f8f29 service nova] Creating event network-vif-unplugged:5462e758-72dc-4c63-9751-fed9c3a9046c for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:08:28.175909 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-317523d2-d5b5-42ab-b62f-499b930d7b02 req-d431e1e7-cb95-4616-86e7-99b5964f8f29 service nova] Creating event network-vif-unplugged:a40e1272-53cc-4930-bec4-a342676c13f1 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:08:28.176949 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-317523d2-d5b5-42ab-b62f-499b930d7b02 req-d431e1e7-cb95-4616-86e7-99b5964f8f29 service nova] Creating event network-vif-unplugged:c9039cae-1e09-4044-a9e0-b73c85febfdd for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:08:28.185367 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-317523d2-d5b5-42ab-b62f-499b930d7b02 req-d431e1e7-cb95-4616-86e7-99b5964f8f29 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.060655 Aug 27 05:08:28.186986 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1623/3306] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:28.193759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b08683e3-59e6-4ca2-a26a-d0fea15ec72b req-4069195a-1700-4e81-adbd-b19dc99557c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-deleted", "tag": "5462e758-72dc-4c63-9751-fed9c3a9046c"}, {"name": "network-changed", "server_uuid": "47a32c7b-9f76-488f-a8f4-06d89c55fe43", "tag": "92f60212-a478-43d9-9fbc-ff178cf2bc89"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:28.210821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b08683e3-59e6-4ca2-a26a-d0fea15ec72b req-4069195a-1700-4e81-adbd-b19dc99557c6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:28.211858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b08683e3-59e6-4ca2-a26a-d0fea15ec72b req-4069195a-1700-4e81-adbd-b19dc99557c6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:28.212582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b08683e3-59e6-4ca2-a26a-d0fea15ec72b req-4069195a-1700-4e81-adbd-b19dc99557c6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:28.234876 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b08683e3-59e6-4ca2-a26a-d0fea15ec72b req-4069195a-1700-4e81-adbd-b19dc99557c6 service nova] Creating event network-vif-deleted:5462e758-72dc-4c63-9751-fed9c3a9046c for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:08:28.235934 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b08683e3-59e6-4ca2-a26a-d0fea15ec72b req-4069195a-1700-4e81-adbd-b19dc99557c6 service nova] Creating event network-changed:92f60212-a478-43d9-9fbc-ff178cf2bc89 for instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 on n-h2-820368-35 Aug 27 05:08:28.246280 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b08683e3-59e6-4ca2-a26a-d0fea15ec72b req-4069195a-1700-4e81-adbd-b19dc99557c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056879 Aug 27 05:08:28.247874 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1624/3307] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:28.254622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5dea1e2a-5602-42ab-b59e-3746197feb9c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:28.255918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5dea1e2a-5602-42ab-b59e-3746197feb9c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:28.263185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:28.266704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dea1e2a-5602-42ab-b59e-3746197feb9c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:28.268193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dea1e2a-5602-42ab-b59e-3746197feb9c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:28.269041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dea1e2a-5602-42ab-b59e-3746197feb9c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:28.270588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dea1e2a-5602-42ab-b59e-3746197feb9c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:28.271428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dea1e2a-5602-42ab-b59e-3746197feb9c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:28.274845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dea1e2a-5602-42ab-b59e-3746197feb9c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:28.462345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c4548c55-b008-420a-93de-2c8ab3eade22 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:28.480609 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c4548c55-b008-420a-93de-2c8ab3eade22 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1313 microversion: 2.1 time: 1.089546 Aug 27 05:08:28.482426 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1684/3308] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:27 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1313 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:28.487643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-83d2d883-43ab-4ac3-94cf-660bbd6dabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:28.492597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-83d2d883-43ab-4ac3-94cf-660bbd6dabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:28.504155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d2d883-43ab-4ac3-94cf-660bbd6dabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:28.504648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d2d883-43ab-4ac3-94cf-660bbd6dabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:28.505087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d2d883-43ab-4ac3-94cf-660bbd6dabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:28.505800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d2d883-43ab-4ac3-94cf-660bbd6dabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:28.506267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d2d883-43ab-4ac3-94cf-660bbd6dabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:28.506684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83d2d883-43ab-4ac3-94cf-660bbd6dabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:28.562509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=10 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:28.954495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5dea1e2a-5602-42ab-b59e-3746197feb9c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:28.968939 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5dea1e2a-5602-42ab-b59e-3746197feb9c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.719358 Aug 27 05:08:28.970901 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1625/3309] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:28 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:29.063688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-83d2d883-43ab-4ac3-94cf-660bbd6dabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:29.072548 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-83d2d883-43ab-4ac3-94cf-660bbd6dabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1315 microversion: 2.1 time: 0.588660 Aug 27 05:08:29.073399 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1685/3310] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:28 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:29.158007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:29.159687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:29.169737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:29.170892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:29.173735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:29.174384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:29.178990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:29.180376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:29.505212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e3ca6a0a-e26c-42c7-8efc-0618f8f7eada tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:29.506851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e3ca6a0a-e26c-42c7-8efc-0618f8f7eada tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:29.516458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3ca6a0a-e26c-42c7-8efc-0618f8f7eada tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:29.517621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3ca6a0a-e26c-42c7-8efc-0618f8f7eada tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:29.518193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3ca6a0a-e26c-42c7-8efc-0618f8f7eada tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:29.519137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3ca6a0a-e26c-42c7-8efc-0618f8f7eada tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:29.521382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3ca6a0a-e26c-42c7-8efc-0618f8f7eada tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:29.522252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3ca6a0a-e26c-42c7-8efc-0618f8f7eada tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:29.666981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:29.685566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:29.687493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:29.690572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b034230-2512-452a-bc43-bee0cab566b8 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2706 microversion: 2.32 time: 0.541463 Aug 27 05:08:29.711690 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1626/3311] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:29 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2706 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:29.994256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5644e985-c609-4f65-bc8a-bee4d226c8a4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:29.994892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5644e985-c609-4f65-bc8a-bee4d226c8a4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:30.005138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5644e985-c609-4f65-bc8a-bee4d226c8a4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:30.005489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5644e985-c609-4f65-bc8a-bee4d226c8a4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:30.007746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5644e985-c609-4f65-bc8a-bee4d226c8a4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:30.008774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5644e985-c609-4f65-bc8a-bee4d226c8a4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:30.009250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5644e985-c609-4f65-bc8a-bee4d226c8a4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:30.009692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5644e985-c609-4f65-bc8a-bee4d226c8a4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:30.548465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e3ca6a0a-e26c-42c7-8efc-0618f8f7eada tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:30.569376 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e3ca6a0a-e26c-42c7-8efc-0618f8f7eada tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1313 microversion: 2.1 time: 1.070432 Aug 27 05:08:30.572463 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1686/3312] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:29 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1313 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:30.583707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5644e985-c609-4f65-bc8a-bee4d226c8a4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:30.598612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a76559d5-14f2-4c13-bb97-380877b1fa7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:30.603452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a76559d5-14f2-4c13-bb97-380877b1fa7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:30.619839 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5644e985-c609-4f65-bc8a-bee4d226c8a4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.622331 Aug 27 05:08:30.620750 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1627/3313] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:29 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:30.638251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76559d5-14f2-4c13-bb97-380877b1fa7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:30.639362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76559d5-14f2-4c13-bb97-380877b1fa7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:30.640258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76559d5-14f2-4c13-bb97-380877b1fa7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:30.641162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76559d5-14f2-4c13-bb97-380877b1fa7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:30.642650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76559d5-14f2-4c13-bb97-380877b1fa7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:30.643302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76559d5-14f2-4c13-bb97-380877b1fa7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:30.647233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-240b21ca-4e89-424d-94b5-6d7485b40b41 req-6a1c141b-9b39-4bf8-91db-37f55e427fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-deleted", "tag": "bd1cea64-a33a-4b9a-85cb-bf98ccbc4a5f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:30.659036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-240b21ca-4e89-424d-94b5-6d7485b40b41 req-6a1c141b-9b39-4bf8-91db-37f55e427fd8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:30.659901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-240b21ca-4e89-424d-94b5-6d7485b40b41 req-6a1c141b-9b39-4bf8-91db-37f55e427fd8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:30.660495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-240b21ca-4e89-424d-94b5-6d7485b40b41 req-6a1c141b-9b39-4bf8-91db-37f55e427fd8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:30.690920 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-240b21ca-4e89-424d-94b5-6d7485b40b41 req-6a1c141b-9b39-4bf8-91db-37f55e427fd8 service nova] Creating event network-vif-deleted:bd1cea64-a33a-4b9a-85cb-bf98ccbc4a5f for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:08:30.701935 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-240b21ca-4e89-424d-94b5-6d7485b40b41 req-6a1c141b-9b39-4bf8-91db-37f55e427fd8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063886 Aug 27 05:08:30.703291 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1628/3314] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:30.741415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:30.744741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:30.755344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:30.756111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:30.756868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:30.775442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:30.776332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:30.777177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:31.131254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a76559d5-14f2-4c13-bb97-380877b1fa7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:31.144409 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a76559d5-14f2-4c13-bb97-380877b1fa7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1315 microversion: 2.1 time: 0.570521 Aug 27 05:08:31.159520 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1687/3315] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:30 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:31.309314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:31.319997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:31.321720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:31.323297 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-034c76f9-f7a4-423a-9764-3b5743f7c959 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2706 microversion: 2.32 time: 0.596463 Aug 27 05:08:31.324363 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1629/3316] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:30 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2706 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:31.596135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8275b9dd-f6b9-499f-9331-4e2efac9111a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:31.597433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8275b9dd-f6b9-499f-9331-4e2efac9111a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:31.611603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8275b9dd-f6b9-499f-9331-4e2efac9111a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:31.612462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8275b9dd-f6b9-499f-9331-4e2efac9111a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:31.613125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8275b9dd-f6b9-499f-9331-4e2efac9111a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:31.614603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8275b9dd-f6b9-499f-9331-4e2efac9111a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:31.617012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8275b9dd-f6b9-499f-9331-4e2efac9111a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:31.617688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8275b9dd-f6b9-499f-9331-4e2efac9111a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:31.645221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aabcdb7e-e28b-44c2-b09c-382fddae3617 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:31.649441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aabcdb7e-e28b-44c2-b09c-382fddae3617 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:31.697167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aabcdb7e-e28b-44c2-b09c-382fddae3617 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:31.699505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aabcdb7e-e28b-44c2-b09c-382fddae3617 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:31.700804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aabcdb7e-e28b-44c2-b09c-382fddae3617 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:31.702559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aabcdb7e-e28b-44c2-b09c-382fddae3617 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:31.704161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aabcdb7e-e28b-44c2-b09c-382fddae3617 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:31.708125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aabcdb7e-e28b-44c2-b09c-382fddae3617 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:32.339587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8275b9dd-f6b9-499f-9331-4e2efac9111a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:32.357833 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8275b9dd-f6b9-499f-9331-4e2efac9111a tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1313 microversion: 2.1 time: 0.766500 Aug 27 05:08:32.358434 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1688/3317] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:31 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1313 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:32.394075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aabcdb7e-e28b-44c2-b09c-382fddae3617 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:32.406839 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aabcdb7e-e28b-44c2-b09c-382fddae3617 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1475 microversion: 2.1 time: 0.765363 Aug 27 05:08:32.433517 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1630/3318] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:31 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1475 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:32.441595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1f0fa16b-e363-4c6d-8ff1-7c54abefa036 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:32.442649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1f0fa16b-e363-4c6d-8ff1-7c54abefa036 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:32.452595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f0fa16b-e363-4c6d-8ff1-7c54abefa036 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:32.453329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f0fa16b-e363-4c6d-8ff1-7c54abefa036 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:32.454739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f0fa16b-e363-4c6d-8ff1-7c54abefa036 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:32.456241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f0fa16b-e363-4c6d-8ff1-7c54abefa036 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:32.457179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f0fa16b-e363-4c6d-8ff1-7c54abefa036 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:32.457894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f0fa16b-e363-4c6d-8ff1-7c54abefa036 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:32.610641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-987963023", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "f0e542a5-5237-46b8-a26a-c2005caddb4f"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:32.682643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] validate_networks() for [('f0e542a5-5237-46b8-a26a-c2005caddb4f', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:08:32.862948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1f0fa16b-e363-4c6d-8ff1-7c54abefa036 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:32.877412 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1f0fa16b-e363-4c6d-8ff1-7c54abefa036 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1315 microversion: 2.1 time: 0.441858 Aug 27 05:08:32.887817 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1631/3319] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:32 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:32.895855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:32.896918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:32.904950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:32.905727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:32.906551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:32.909522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:32.910186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:32.910813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:33.323639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:33.330162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:33.335784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:33.338911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:33.352743 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4914662a-bd67-4750-87c3-9585ce8abb0e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2706 microversion: 2.32 time: 0.473151 Aug 27 05:08:33.353339 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1632/3320] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:32 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2706 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:33.379327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d8f8178f-efce-4b20-9a35-ef8b7cb62fed tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:33.379810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d8f8178f-efce-4b20-9a35-ef8b7cb62fed tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:33.390780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8f8178f-efce-4b20-9a35-ef8b7cb62fed tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.391319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8f8178f-efce-4b20-9a35-ef8b7cb62fed tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.391781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8f8178f-efce-4b20-9a35-ef8b7cb62fed tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:33.392496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8f8178f-efce-4b20-9a35-ef8b7cb62fed tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.392944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8f8178f-efce-4b20-9a35-ef8b7cb62fed tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.393366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8f8178f-efce-4b20-9a35-ef8b7cb62fed tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:33.914061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d8f8178f-efce-4b20-9a35-ef8b7cb62fed tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:33.924804 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d8f8178f-efce-4b20-9a35-ef8b7cb62fed tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1313 microversion: 2.1 time: 0.548972 Aug 27 05:08:33.927427 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1633/3321] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:33 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:33.934658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-33364458-7b20-4d5e-8f96-3d3e266bd986 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:33.937679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-33364458-7b20-4d5e-8f96-3d3e266bd986 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:33.952528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33364458-7b20-4d5e-8f96-3d3e266bd986 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.953026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33364458-7b20-4d5e-8f96-3d3e266bd986 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.953465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33364458-7b20-4d5e-8f96-3d3e266bd986 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:33.954843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33364458-7b20-4d5e-8f96-3d3e266bd986 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.955327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33364458-7b20-4d5e-8f96-3d3e266bd986 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.955750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33364458-7b20-4d5e-8f96-3d3e266bd986 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:34.072397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:08:34.073018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:08:34.073814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:08:34.074464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:08:34.075225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:08:34.098762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:34.099462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:34.100237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:34.101204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:34.101945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:34.102606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:34.122724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Getting quotas for project f601b382cfe849f4808002079a81cd5d. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:08:34.129302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Getting quotas for user 49a0d930551847a994b8f09600a59efd and project f601b382cfe849f4808002079a81cd5d. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:08:34.146762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:08:34.149887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:08:34.218624 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b3537345-b909-4975-8150-d383967eb6c8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.841343 Aug 27 05:08:34.220642 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1689/3322] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:08:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:08:34.226561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-e4e18bb9-33b8-4ad1-87cb-579e66c79cf5 req-4c480cdc-59bd-4244-ad57-8ff5b7414651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280517c9-191f-47fc-9fd3-4d54372bac54", "name": "network-vif-plugged", "status": "completed", "tag": "a07ccbfe-811c-44a6-a1f6-f6533c850ed8"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:34.238342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e4e18bb9-33b8-4ad1-87cb-579e66c79cf5 req-4c480cdc-59bd-4244-ad57-8ff5b7414651 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:34.239253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e4e18bb9-33b8-4ad1-87cb-579e66c79cf5 req-4c480cdc-59bd-4244-ad57-8ff5b7414651 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:34.239927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e4e18bb9-33b8-4ad1-87cb-579e66c79cf5 req-4c480cdc-59bd-4244-ad57-8ff5b7414651 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:34.253794 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-e4e18bb9-33b8-4ad1-87cb-579e66c79cf5 req-4c480cdc-59bd-4244-ad57-8ff5b7414651 service nova] Creating event network-vif-plugged:a07ccbfe-811c-44a6-a1f6-f6533c850ed8 for instance 280517c9-191f-47fc-9fd3-4d54372bac54 on n-h1-820368-35 Aug 27 05:08:34.260055 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-e4e18bb9-33b8-4ad1-87cb-579e66c79cf5 req-4c480cdc-59bd-4244-ad57-8ff5b7414651 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037767 Aug 27 05:08:34.261412 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1690/3323] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:34.283526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0fe4947-9781-49a2-8206-a856be1b6c1f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:34.285822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c0fe4947-9781-49a2-8206-a856be1b6c1f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:34.296899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe4947-9781-49a2-8206-a856be1b6c1f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:34.297728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe4947-9781-49a2-8206-a856be1b6c1f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:34.298510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe4947-9781-49a2-8206-a856be1b6c1f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:34.299599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe4947-9781-49a2-8206-a856be1b6c1f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:34.300287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe4947-9781-49a2-8206-a856be1b6c1f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:34.301084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe4947-9781-49a2-8206-a856be1b6c1f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:34.718066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-33364458-7b20-4d5e-8f96-3d3e266bd986 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:34.734442 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-33364458-7b20-4d5e-8f96-3d3e266bd986 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1474 microversion: 2.1 time: 0.805111 Aug 27 05:08:34.736857 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1634/3324] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:33 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1474 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:34.749807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a28a4312-714b-41e8-a6ca-48af4d31e09a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:34.766081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a28a4312-714b-41e8-a6ca-48af4d31e09a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:34.900858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c0fe4947-9781-49a2-8206-a856be1b6c1f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:34.914622 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c0fe4947-9781-49a2-8206-a856be1b6c1f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1315 microversion: 2.1 time: 0.650443 Aug 27 05:08:34.927482 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1691/3325] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:34 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:34.934817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:34.937497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:34.953707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:34.954738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:34.954879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:34.964711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:34.965227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:34.965682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:35.125670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a28a4312-714b-41e8-a6ca-48af4d31e09a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:35.134166 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a28a4312-714b-41e8-a6ca-48af4d31e09a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1216 microversion: 2.1 time: 0.394320 Aug 27 05:08:35.150376 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1635/3326] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:34 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1216 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:35.161832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c5e346e0-9ec7-4335-84e5-d6924f5ea327 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:35.162536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c5e346e0-9ec7-4335-84e5-d6924f5ea327 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:35.184296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e346e0-9ec7-4335-84e5-d6924f5ea327 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:35.184811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e346e0-9ec7-4335-84e5-d6924f5ea327 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:35.185252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e346e0-9ec7-4335-84e5-d6924f5ea327 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:35.185980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e346e0-9ec7-4335-84e5-d6924f5ea327 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:35.186431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e346e0-9ec7-4335-84e5-d6924f5ea327 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:35.186854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e346e0-9ec7-4335-84e5-d6924f5ea327 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:35.520491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:35.539425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:35.541578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:35.548777 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-66dddae6-634c-4da6-8967-688b6c745d52 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2372 microversion: 2.32 time: 0.614577 Aug 27 05:08:35.549417 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1692/3327] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:34 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2372 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:35.563613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c5e346e0-9ec7-4335-84e5-d6924f5ea327 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:35.575660 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c5e346e0-9ec7-4335-84e5-d6924f5ea327 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1313 microversion: 2.1 time: 0.424032 Aug 27 05:08:35.577551 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1636/3328] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:35 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:35.600991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ac3b1ab8-9cbd-4fc6-9ca1-9873c771a78c req-130aeb55-1576-4062-92a0-063bb7b28d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-deleted", "tag": "54fa96c5-5e23-4d52-a8f5-1c2c79f49849"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:35.612992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ac3b1ab8-9cbd-4fc6-9ca1-9873c771a78c req-130aeb55-1576-4062-92a0-063bb7b28d38 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:35.613856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ac3b1ab8-9cbd-4fc6-9ca1-9873c771a78c req-130aeb55-1576-4062-92a0-063bb7b28d38 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:35.614511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ac3b1ab8-9cbd-4fc6-9ca1-9873c771a78c req-130aeb55-1576-4062-92a0-063bb7b28d38 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:35.647335 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ac3b1ab8-9cbd-4fc6-9ca1-9873c771a78c req-130aeb55-1576-4062-92a0-063bb7b28d38 service nova] Creating event network-vif-deleted:54fa96c5-5e23-4d52-a8f5-1c2c79f49849 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:08:35.665948 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ac3b1ab8-9cbd-4fc6-9ca1-9873c771a78c req-130aeb55-1576-4062-92a0-063bb7b28d38 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086964 Aug 27 05:08:35.668574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-59c4109b-f5b0-484f-abd9-bbcbde548354 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Calling method '.version_select at 0x7fb569780280>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:35.669871 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1637/3329] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:35.723731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-59c4109b-f5b0-484f-abd9-bbcbde548354 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0daf49b6-0f90-4e6f-b52b-0063a6cf5922 does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:08:35.724347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-59c4109b-f5b0-484f-abd9-bbcbde548354 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Neutron security group 0daf49b6-0f90-4e6f-b52b-0063a6cf5922 not found {{(pid=128548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:08:35.724951 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-59c4109b-f5b0-484f-abd9-bbcbde548354 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] HTTP exception thrown: Security group 0daf49b6-0f90-4e6f-b52b-0063a6cf5922 does not exist Aug 27 05:08:35.724951 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-a755829a-2619-4b72-9183-e5c5022732dc'] Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-59c4109b-f5b0-484f-abd9-bbcbde548354 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Request method failure captured: Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-security-groups/0daf49b6-0f90-4e6f-b52b-0063a6cf5922 HTTP/1.1 Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCabS_I0g6B_3xB2kYWzRLhVguvuMlOCTH_tMzVhapsGVqe761VbvXEfr1dmv3tQDbqEneIEeidXFb7hWL3S2fVVH_EsXMuVywV8wQJmPtu4SB2tf6EXPqZXmAwl-W20Yc3DpQHsCIszl2getMjVTA8Yq30qIkVxKdoX5vnrBWpOISB0 Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 91040308ba644774b09e64c4da4fba33 Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_91040308ba644774b09e64c4da4fba33", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/91040308ba644774b09e64c4da4fba33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91040308ba644774b09e64c4da4fba33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91040308ba644774b09e64c4da4fba33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 91040308ba644774b09e64c4da4fba33 Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupsNegativeTestJSON-30954940-project Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: d3f1fe32f7d545ebb6489a5c4542aace Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-30954940-project Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group 0daf49b6-0f90-4e6f-b52b-0063a6cf5922 does not exist Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-a755829a-2619-4b72-9183-e5c5022732dc'] Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '0daf49b6-0f90-4e6f-b52b-0063a6cf5922'} Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:08:35.727525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0daf49b6-0f90-4e6f-b52b-0063a6cf5922 does not exist Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a755829a-2619-4b72-9183-e5c5022732dc'] Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0daf49b6-0f90-4e6f-b52b-0063a6cf5922 does not exist Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a755829a-2619-4b72-9183-e5c5022732dc'] Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0daf49b6-0f90-4e6f-b52b-0063a6cf5922 does not exist Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a755829a-2619-4b72-9183-e5c5022732dc'] Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0daf49b6-0f90-4e6f-b52b-0063a6cf5922 does not exist Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a755829a-2619-4b72-9183-e5c5022732dc'] Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-59c4109b-f5b0-484f-abd9-bbcbde548354 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Returning 404 to user: Security group 0daf49b6-0f90-4e6f-b52b-0063a6cf5922 does not exist Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-a755829a-2619-4b72-9183-e5c5022732dc'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-59c4109b-f5b0-484f-abd9-bbcbde548354 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/0daf49b6-0f90-4e6f-b52b-0063a6cf5922" status: 404 len: 194 microversion: 2.1 time: 0.178633 Aug 27 05:08:35.733251 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1693/3330] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:08:35 2022] DELETE /compute/v2.1/os-security-groups/0daf49b6-0f90-4e6f-b52b-0063a6cf5922 => generated 194 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:35.741554 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-32ecf705-0c6f-493c-95f4-fbaef15ccb2a tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004100 Aug 27 05:08:35.752895 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1638/3331] 10.222.0.58 () {58 vars in 1164 bytes} [Sat Aug 27 05:08:35 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 05:08:35.755061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-379c4199-9c3e-4c55-9ef7-9f7d6ade6cbf tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Calling method '.version_select at 0x7fb56524a5e0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:35.764666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bc017f49-0b91-4823-bb97-9fc54250cdc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:35.765380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bc017f49-0b91-4823-bb97-9fc54250cdc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:35.776775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc017f49-0b91-4823-bb97-9fc54250cdc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:35.778669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc017f49-0b91-4823-bb97-9fc54250cdc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:35.779368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc017f49-0b91-4823-bb97-9fc54250cdc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:35.780316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc017f49-0b91-4823-bb97-9fc54250cdc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:35.781005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc017f49-0b91-4823-bb97-9fc54250cdc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:35.781684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc017f49-0b91-4823-bb97-9fc54250cdc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.234556 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-379c4199-9c3e-4c55-9ef7-9f7d6ade6cbf tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.485350 Aug 27 05:08:36.235704 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1694/3332] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 05:08:35 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:36.240515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b00d4790-381b-4282-bc04-2f014803069f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:36.241340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b00d4790-381b-4282-bc04-2f014803069f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:36.262366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bc017f49-0b91-4823-bb97-9fc54250cdc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:36.266507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b00d4790-381b-4282-bc04-2f014803069f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.268509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b00d4790-381b-4282-bc04-2f014803069f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.269063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b00d4790-381b-4282-bc04-2f014803069f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.269938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b00d4790-381b-4282-bc04-2f014803069f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.270640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b00d4790-381b-4282-bc04-2f014803069f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.271310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b00d4790-381b-4282-bc04-2f014803069f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.274658 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bc017f49-0b91-4823-bb97-9fc54250cdc9 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1474 microversion: 2.1 time: 0.514148 Aug 27 05:08:36.276179 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1639/3333] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:35 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1474 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:36.288977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3be33117-2c01-417e-943e-100aa2cef4f2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:36.290256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3be33117-2c01-417e-943e-100aa2cef4f2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:36.299718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:36.311121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be33117-2c01-417e-943e-100aa2cef4f2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.312003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be33117-2c01-417e-943e-100aa2cef4f2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.313020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be33117-2c01-417e-943e-100aa2cef4f2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.314658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be33117-2c01-417e-943e-100aa2cef4f2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.315677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be33117-2c01-417e-943e-100aa2cef4f2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.316323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be33117-2c01-417e-943e-100aa2cef4f2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.424079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3be33117-2c01-417e-943e-100aa2cef4f2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:36.440659 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3be33117-2c01-417e-943e-100aa2cef4f2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1268 microversion: 2.1 time: 0.160434 Aug 27 05:08:36.443214 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1640/3334] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:36 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:36.455657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a9d2d8e-2eca-4c64-a2f0-81ab63c0a856 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Calling method '.version_select at 0x7fb5648a73a0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:36.671484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b00d4790-381b-4282-bc04-2f014803069f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:36.687082 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b00d4790-381b-4282-bc04-2f014803069f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1315 microversion: 2.1 time: 0.450116 Aug 27 05:08:36.689883 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1695/3335] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:36 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:36.719981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1c878749-ca1a-43b4-9b57-e3a23185d4e0 req-9825060c-ad5b-4c0c-ba8a-803a2131ef61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea", "name": "network-vif-unplugged", "status": "completed", "tag": "856e3225-e60e-4434-b63d-6d6e70bf7364"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:36.769166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1c878749-ca1a-43b4-9b57-e3a23185d4e0 req-9825060c-ad5b-4c0c-ba8a-803a2131ef61 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.771232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1c878749-ca1a-43b4-9b57-e3a23185d4e0 req-9825060c-ad5b-4c0c-ba8a-803a2131ef61 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.771878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1c878749-ca1a-43b4-9b57-e3a23185d4e0 req-9825060c-ad5b-4c0c-ba8a-803a2131ef61 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.822342 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1c878749-ca1a-43b4-9b57-e3a23185d4e0 req-9825060c-ad5b-4c0c-ba8a-803a2131ef61 service nova] Creating event network-vif-unplugged:856e3225-e60e-4434-b63d-6d6e70bf7364 for instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea on n-h1-820368-35 Aug 27 05:08:36.841000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-1c878749-ca1a-43b4-9b57-e3a23185d4e0 req-9825060c-ad5b-4c0c-ba8a-803a2131ef61 service nova] Instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:08:36.866565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1c878749-ca1a-43b4-9b57-e3a23185d4e0 req-9825060c-ad5b-4c0c-ba8a-803a2131ef61 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160901 Aug 27 05:08:36.872406 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1696/3336] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:36.881034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-9a9d2d8e-2eca-4c64-a2f0-81ab63c0a856 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:08:36.882110 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-9a9d2d8e-2eca-4c64-a2f0-81ab63c0a856 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 27 05:08:36.882110 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-d3d8719e-1376-47ba-8901-92e73cbb0270'] Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a9d2d8e-2eca-4c64-a2f0-81ab63c0a856 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Request method failure captured: Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/os-security-groups/b398a5d8-899c-46d4-ba77-77ed3b4c1ae5 HTTP/1.1 Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCabS_I0g6B_3xB2kYWzRLhVguvuMlOCTH_tMzVhapsGVqe761VbvXEfr1dmv3tQDbqEneIEeidXFb7hWL3S2fVVH_EsXMuVywV8wQJmPtu4SB2tf6EXPqZXmAwl-W20Yc3DpQHsCIszl2getMjVTA8Yq30qIkVxKdoX5vnrBWpOISB0 Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 91040308ba644774b09e64c4da4fba33 Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_91040308ba644774b09e64c4da4fba33", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/91040308ba644774b09e64c4da4fba33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91040308ba644774b09e64c4da4fba33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91040308ba644774b09e64c4da4fba33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 91040308ba644774b09e64c4da4fba33 Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupsNegativeTestJSON-30954940-project Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3f1fe32f7d545ebb6489a5c4542aace Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-30954940-project Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: exception: Insufficient rights for removing default security group. Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-d3d8719e-1376-47ba-8901-92e73cbb0270'] Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'b398a5d8-899c-46d4-ba77-77ed3b4c1ae5'} Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:08:36.884896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3d8719e-1376-47ba-8901-92e73cbb0270'] Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3d8719e-1376-47ba-8901-92e73cbb0270'] Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3d8719e-1376-47ba-8901-92e73cbb0270'] Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3d8719e-1376-47ba-8901-92e73cbb0270'] Aug 27 05:08:36.890000 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:36.895438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a9d2d8e-2eca-4c64-a2f0-81ab63c0a856 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 27 05:08:36.895438 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-d3d8719e-1376-47ba-8901-92e73cbb0270'] {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:36.897126 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a9d2d8e-2eca-4c64-a2f0-81ab63c0a856 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/b398a5d8-899c-46d4-ba77-77ed3b4c1ae5" status: 400 len: 182 microversion: 2.1 time: 0.449536 Aug 27 05:08:36.906577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:36.911176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:36.914888 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1641/3337] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:08:36 2022] DELETE /compute/v2.1/os-security-groups/b398a5d8-899c-46d4-ba77-77ed3b4c1ae5 => generated 182 bytes in 471 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:08:36.921112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ef92c966-ea3c-49fd-88a2-63ac592c0ed2 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:36.921749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ef92c966-ea3c-49fd-88a2-63ac592c0ed2 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:36.930942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef92c966-ea3c-49fd-88a2-63ac592c0ed2 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.931717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef92c966-ea3c-49fd-88a2-63ac592c0ed2 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.932479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef92c966-ea3c-49fd-88a2-63ac592c0ed2 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.933588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef92c966-ea3c-49fd-88a2-63ac592c0ed2 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.934363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef92c966-ea3c-49fd-88a2-63ac592c0ed2 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.934952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef92c966-ea3c-49fd-88a2-63ac592c0ed2 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.938861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.939520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.940122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.940880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.941343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.941773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:37.397973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ef92c966-ea3c-49fd-88a2-63ac592c0ed2 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:37.430253 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ef92c966-ea3c-49fd-88a2-63ac592c0ed2 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1313 microversion: 2.1 time: 0.503226 Aug 27 05:08:37.432890 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1642/3338] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:36 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:37.455541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65250c74-daeb-4b90-a684-f57db4e554f5 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Calling method '.version_select at 0x7fb564843160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:37.534518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-65250c74-daeb-4b90-a684-f57db4e554f5 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 56307d91-f21b-4b23-b9d2-6bcfacc11c46 does not exist", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:08:37.535415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.security_group_api [None req-65250c74-daeb-4b90-a684-f57db4e554f5 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Neutron security group 56307d91-f21b-4b23-b9d2-6bcfacc11c46 not found {{(pid=128547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:08:37.536136 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-65250c74-daeb-4b90-a684-f57db4e554f5 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] HTTP exception thrown: Security group 56307d91-f21b-4b23-b9d2-6bcfacc11c46 does not exist Aug 27 05:08:37.536136 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-0f586d25-384d-4a31-acce-f1e00f1e683d'] Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65250c74-daeb-4b90-a684-f57db4e554f5 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Request method failure captured: Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-security-groups/56307d91-f21b-4b23-b9d2-6bcfacc11c46 HTTP/1.1 Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCabS_I0g6B_3xB2kYWzRLhVguvuMlOCTH_tMzVhapsGVqe761VbvXEfr1dmv3tQDbqEneIEeidXFb7hWL3S2fVVH_EsXMuVywV8wQJmPtu4SB2tf6EXPqZXmAwl-W20Yc3DpQHsCIszl2getMjVTA8Yq30qIkVxKdoX5vnrBWpOISB0 Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 91040308ba644774b09e64c4da4fba33 Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_91040308ba644774b09e64c4da4fba33", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/91040308ba644774b09e64c4da4fba33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91040308ba644774b09e64c4da4fba33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91040308ba644774b09e64c4da4fba33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 91040308ba644774b09e64c4da4fba33 Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupsNegativeTestJSON-30954940-project Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3f1fe32f7d545ebb6489a5c4542aace Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-30954940-project Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: exception: Security group 56307d91-f21b-4b23-b9d2-6bcfacc11c46 does not exist Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-0f586d25-384d-4a31-acce-f1e00f1e683d'] Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '56307d91-f21b-4b23-b9d2-6bcfacc11c46'} Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:08:37.538807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 56307d91-f21b-4b23-b9d2-6bcfacc11c46 does not exist Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f586d25-384d-4a31-acce-f1e00f1e683d'] Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 56307d91-f21b-4b23-b9d2-6bcfacc11c46 does not exist Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f586d25-384d-4a31-acce-f1e00f1e683d'] Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 56307d91-f21b-4b23-b9d2-6bcfacc11c46 does not exist Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f586d25-384d-4a31-acce-f1e00f1e683d'] Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 56307d91-f21b-4b23-b9d2-6bcfacc11c46 does not exist Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f586d25-384d-4a31-acce-f1e00f1e683d'] Aug 27 05:08:37.544100 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.547274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:37.548480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65250c74-daeb-4b90-a684-f57db4e554f5 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Returning 404 to user: Security group 56307d91-f21b-4b23-b9d2-6bcfacc11c46 does not exist Aug 27 05:08:37.548480 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-0f586d25-384d-4a31-acce-f1e00f1e683d'] {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:37.549598 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-65250c74-daeb-4b90-a684-f57db4e554f5 tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/56307d91-f21b-4b23-b9d2-6bcfacc11c46" status: 404 len: 194 microversion: 2.1 time: 0.112459 Aug 27 05:08:37.554699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:37.556514 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1643/3339] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 05:08:37 2022] GET /compute/v2.1/os-security-groups/56307d91-f21b-4b23-b9d2-6bcfacc11c46 => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:37.561721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1b8a02c1-b85d-43fc-8266-005c66f2a5b2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:37.562333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1b8a02c1-b85d-43fc-8266-005c66f2a5b2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:37.565653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:37.566940 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ebea27ab-b6a3-43f3-9b86-a8a434bf63ef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 2213 microversion: 2.32 time: 0.692944 Aug 27 05:08:37.576273 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1697/3340] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:36 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 2213 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:37.582541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0c872919-d6ac-4110-9a1d-cb617aa6f441 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:37.588924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c872919-d6ac-4110-9a1d-cb617aa6f441 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:37.593326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b8a02c1-b85d-43fc-8266-005c66f2a5b2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:37.593828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b8a02c1-b85d-43fc-8266-005c66f2a5b2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:37.594265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b8a02c1-b85d-43fc-8266-005c66f2a5b2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:37.601867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c872919-d6ac-4110-9a1d-cb617aa6f441 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:37.602479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b8a02c1-b85d-43fc-8266-005c66f2a5b2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:37.602847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c872919-d6ac-4110-9a1d-cb617aa6f441 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:37.602984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b8a02c1-b85d-43fc-8266-005c66f2a5b2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:37.603447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b8a02c1-b85d-43fc-8266-005c66f2a5b2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:37.603778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c872919-d6ac-4110-9a1d-cb617aa6f441 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:37.604719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c872919-d6ac-4110-9a1d-cb617aa6f441 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:37.609008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c872919-d6ac-4110-9a1d-cb617aa6f441 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:37.609711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c872919-d6ac-4110-9a1d-cb617aa6f441 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:37.794137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0c872919-d6ac-4110-9a1d-cb617aa6f441 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:37.820571 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0c872919-d6ac-4110-9a1d-cb617aa6f441 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1268 microversion: 2.1 time: 0.242644 Aug 27 05:08:37.821555 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1698/3341] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:37 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1268 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:37.845706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a1dd99c-160f-49ea-a46e-bc9bd868cdfc tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Action: 'update', calling method: .version_select at 0x7fb5650d9280>, body: {"security_group": {"name": "tempest-sg-1895692351", "description": "tempest-description-160233539"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:37.934041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-7a1dd99c-160f-49ea-a46e-bc9bd868cdfc tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 772c8116-925c-4a00-84ae-e52f73399e6e does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:08:37.934650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-7a1dd99c-160f-49ea-a46e-bc9bd868cdfc tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Neutron security group 772c8116-925c-4a00-84ae-e52f73399e6e not found {{(pid=128548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:08:37.935217 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-7a1dd99c-160f-49ea-a46e-bc9bd868cdfc tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] HTTP exception thrown: Security group 772c8116-925c-4a00-84ae-e52f73399e6e does not exist Aug 27 05:08:37.935217 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-56deecd7-bd96-440b-a73d-28ddd11aae04'] Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a1dd99c-160f-49ea-a46e-bc9bd868cdfc tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Request method failure captured: Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: request: PUT /compute/v2.1/os-security-groups/772c8116-925c-4a00-84ae-e52f73399e6e HTTP/1.1 Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 101 Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCabS_I0g6B_3xB2kYWzRLhVguvuMlOCTH_tMzVhapsGVqe761VbvXEfr1dmv3tQDbqEneIEeidXFb7hWL3S2fVVH_EsXMuVywV8wQJmPtu4SB2tf6EXPqZXmAwl-W20Yc3DpQHsCIszl2getMjVTA8Yq30qIkVxKdoX5vnrBWpOISB0 Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 91040308ba644774b09e64c4da4fba33 Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_91040308ba644774b09e64c4da4fba33", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/91040308ba644774b09e64c4da4fba33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91040308ba644774b09e64c4da4fba33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91040308ba644774b09e64c4da4fba33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 91040308ba644774b09e64c4da4fba33 Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-30954940 Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupsNegativeTestJSON-30954940-project Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: d3f1fe32f7d545ebb6489a5c4542aace Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-30954940-project Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: {"security_group": {"name": "tempest-sg-1895692351", "description": "tempest-description-160233539"}} Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group 772c8116-925c-4a00-84ae-e52f73399e6e does not exist Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-56deecd7-bd96-440b-a73d-28ddd11aae04'] Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '772c8116-925c-4a00-84ae-e52f73399e6e', 'body': {'security_group': {'name': 'tempest-sg-1895692351', 'description': 'tempest-description-160233539'}}} Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:08:37.937737 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 772c8116-925c-4a00-84ae-e52f73399e6e does not exist Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56deecd7-bd96-440b-a73d-28ddd11aae04'] Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 772c8116-925c-4a00-84ae-e52f73399e6e does not exist Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56deecd7-bd96-440b-a73d-28ddd11aae04'] Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 772c8116-925c-4a00-84ae-e52f73399e6e does not exist Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56deecd7-bd96-440b-a73d-28ddd11aae04'] Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 772c8116-925c-4a00-84ae-e52f73399e6e does not exist Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56deecd7-bd96-440b-a73d-28ddd11aae04'] Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a1dd99c-160f-49ea-a46e-bc9bd868cdfc tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] Returning 404 to user: Security group 772c8116-925c-4a00-84ae-e52f73399e6e does not exist Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-56deecd7-bd96-440b-a73d-28ddd11aae04'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a1dd99c-160f-49ea-a46e-bc9bd868cdfc tempest-SecurityGroupsNegativeTestJSON-30954940 tempest-SecurityGroupsNegativeTestJSON-30954940-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/772c8116-925c-4a00-84ae-e52f73399e6e" status: 404 len: 194 microversion: 2.1 time: 0.114727 Aug 27 05:08:37.947757 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1699/3342] 10.222.0.58 () {60 vars in 1290 bytes} [Sat Aug 27 05:08:37 2022] PUT /compute/v2.1/os-security-groups/772c8116-925c-4a00-84ae-e52f73399e6e => generated 194 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:37.958405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-23616b93-121c-4af2-9d7e-cfe0a89f7413 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:37.959212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-23616b93-121c-4af2-9d7e-cfe0a89f7413 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:37.970224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23616b93-121c-4af2-9d7e-cfe0a89f7413 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:37.970742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23616b93-121c-4af2-9d7e-cfe0a89f7413 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:37.971227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23616b93-121c-4af2-9d7e-cfe0a89f7413 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:37.971962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23616b93-121c-4af2-9d7e-cfe0a89f7413 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:37.972430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23616b93-121c-4af2-9d7e-cfe0a89f7413 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:37.972867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23616b93-121c-4af2-9d7e-cfe0a89f7413 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:38.404697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1b8a02c1-b85d-43fc-8266-005c66f2a5b2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:38.413410 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1b8a02c1-b85d-43fc-8266-005c66f2a5b2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1474 microversion: 2.1 time: 0.855607 Aug 27 05:08:38.414194 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1644/3343] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:37 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1474 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:38.418917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-6feae03c-ee03-4033-935e-1a9bc9c5d2bb req-72275ad2-0468-4e12-af4e-3e226add933a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-deleted", "tag": "c9039cae-1e09-4044-a9e0-b73c85febfdd"}, {"name": "network-changed", "server_uuid": "6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea", "tag": "856e3225-e60e-4434-b63d-6d6e70bf7364"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:38.449195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6feae03c-ee03-4033-935e-1a9bc9c5d2bb req-72275ad2-0468-4e12-af4e-3e226add933a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:38.449659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6feae03c-ee03-4033-935e-1a9bc9c5d2bb req-72275ad2-0468-4e12-af4e-3e226add933a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:38.450073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6feae03c-ee03-4033-935e-1a9bc9c5d2bb req-72275ad2-0468-4e12-af4e-3e226add933a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:38.494944 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-6feae03c-ee03-4033-935e-1a9bc9c5d2bb req-72275ad2-0468-4e12-af4e-3e226add933a service nova] Creating event network-vif-deleted:c9039cae-1e09-4044-a9e0-b73c85febfdd for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:08:38.495560 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-6feae03c-ee03-4033-935e-1a9bc9c5d2bb req-72275ad2-0468-4e12-af4e-3e226add933a service nova] Creating event network-changed:856e3225-e60e-4434-b63d-6d6e70bf7364 for instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea on n-h1-820368-35 Aug 27 05:08:38.502267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-6feae03c-ee03-4033-935e-1a9bc9c5d2bb req-72275ad2-0468-4e12-af4e-3e226add933a service nova] Instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:08:38.522181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-23616b93-121c-4af2-9d7e-cfe0a89f7413 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:38.530614 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-6feae03c-ee03-4033-935e-1a9bc9c5d2bb req-72275ad2-0468-4e12-af4e-3e226add933a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.114993 Aug 27 05:08:38.534553 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1645/3344] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:38.541084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5787a217-ea11-4267-b160-fd79bc9dc041 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:38.541559 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-23616b93-121c-4af2-9d7e-cfe0a89f7413 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1315 microversion: 2.1 time: 0.599053 Aug 27 05:08:38.541803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5787a217-ea11-4267-b160-fd79bc9dc041 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:38.542526 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1700/3345] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:37 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:38.558293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5787a217-ea11-4267-b160-fd79bc9dc041 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:38.558801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5787a217-ea11-4267-b160-fd79bc9dc041 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:38.559291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5787a217-ea11-4267-b160-fd79bc9dc041 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:38.560898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5787a217-ea11-4267-b160-fd79bc9dc041 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:38.561547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5787a217-ea11-4267-b160-fd79bc9dc041 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:38.562141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5787a217-ea11-4267-b160-fd79bc9dc041 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:38.608052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:38.608761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:38.623803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:38.626994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:38.627654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:38.628470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:38.628945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:38.629381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:39.051841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:39.071938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:39.077547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:39.080631 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce028f70-40c3-4b5a-969b-188793ad30bf tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1988 microversion: 2.32 time: 0.480149 Aug 27 05:08:39.087415 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1701/3346] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:38 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1988 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:08:39.096222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-608c98ef-49ca-464c-80b7-b7fb4367aba1 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:39.108603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-608c98ef-49ca-464c-80b7-b7fb4367aba1 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:39.132491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-608c98ef-49ca-464c-80b7-b7fb4367aba1 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:39.132998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-608c98ef-49ca-464c-80b7-b7fb4367aba1 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:39.140082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-608c98ef-49ca-464c-80b7-b7fb4367aba1 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:39.141052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-608c98ef-49ca-464c-80b7-b7fb4367aba1 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:39.142091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-608c98ef-49ca-464c-80b7-b7fb4367aba1 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:39.142540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-608c98ef-49ca-464c-80b7-b7fb4367aba1 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:39.716457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5787a217-ea11-4267-b160-fd79bc9dc041 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:39.727045 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5787a217-ea11-4267-b160-fd79bc9dc041 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1497 microversion: 2.1 time: 1.191130 Aug 27 05:08:39.727998 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1646/3347] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:38 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1497 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:39.731620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-608c98ef-49ca-464c-80b7-b7fb4367aba1 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:39.734619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-214885e2-82ff-450b-84d9-152c7d2274bb req-8d93f1ca-0a7f-46f6-bc94-492036483938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a32c7b-9f76-488f-a8f4-06d89c55fe43", "name": "network-vif-plugged", "status": "completed", "tag": "92f60212-a478-43d9-9fbc-ff178cf2bc89"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:39.745857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-214885e2-82ff-450b-84d9-152c7d2274bb req-8d93f1ca-0a7f-46f6-bc94-492036483938 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:39.747345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-214885e2-82ff-450b-84d9-152c7d2274bb req-8d93f1ca-0a7f-46f6-bc94-492036483938 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:39.749287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-214885e2-82ff-450b-84d9-152c7d2274bb req-8d93f1ca-0a7f-46f6-bc94-492036483938 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:39.749427 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-608c98ef-49ca-464c-80b7-b7fb4367aba1 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1274 microversion: 2.1 time: 0.660604 Aug 27 05:08:39.751520 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1702/3348] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:39 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1274 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:39.757449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a6c21cfd-b857-42d0-98ca-f5fb94144f96 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:39.759993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a6c21cfd-b857-42d0-98ca-f5fb94144f96 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:39.788852 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-214885e2-82ff-450b-84d9-152c7d2274bb req-8d93f1ca-0a7f-46f6-bc94-492036483938 service nova] Creating event network-vif-plugged:92f60212-a478-43d9-9fbc-ff178cf2bc89 for instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 on n-h2-820368-35 Aug 27 05:08:39.791977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c21cfd-b857-42d0-98ca-f5fb94144f96 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:39.792489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c21cfd-b857-42d0-98ca-f5fb94144f96 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:39.792939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c21cfd-b857-42d0-98ca-f5fb94144f96 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:39.794844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c21cfd-b857-42d0-98ca-f5fb94144f96 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:39.795349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c21cfd-b857-42d0-98ca-f5fb94144f96 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:39.798801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c21cfd-b857-42d0-98ca-f5fb94144f96 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:39.813284 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-214885e2-82ff-450b-84d9-152c7d2274bb req-8d93f1ca-0a7f-46f6-bc94-492036483938 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083591 Aug 27 05:08:39.814547 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1647/3349] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:39.847228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5e52d95d-844a-4e39-b749-cb8dbb1979c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:39.851029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5e52d95d-844a-4e39-b749-cb8dbb1979c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:39.871061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e52d95d-844a-4e39-b749-cb8dbb1979c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:39.871541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e52d95d-844a-4e39-b749-cb8dbb1979c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:39.871990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e52d95d-844a-4e39-b749-cb8dbb1979c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:39.872726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e52d95d-844a-4e39-b749-cb8dbb1979c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:39.873189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e52d95d-844a-4e39-b749-cb8dbb1979c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:39.873625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e52d95d-844a-4e39-b749-cb8dbb1979c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:40.461293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a6c21cfd-b857-42d0-98ca-f5fb94144f96 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:40.474628 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a6c21cfd-b857-42d0-98ca-f5fb94144f96 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1474 microversion: 2.1 time: 0.719656 Aug 27 05:08:40.477562 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1703/3350] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:39 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1474 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:40.479992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5e52d95d-844a-4e39-b749-cb8dbb1979c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:40.492188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:40.493478 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5e52d95d-844a-4e39-b749-cb8dbb1979c4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1315 microversion: 2.1 time: 0.677644 Aug 27 05:08:40.495385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:40.496483 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1648/3351] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:39 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:40.528385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:40.529184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:40.529851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:40.534302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:40.535566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:40.536354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:40.762494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-35c16f95-29d0-4e04-b1a4-4271897c3aa7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:40.763635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-35c16f95-29d0-4e04-b1a4-4271897c3aa7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:40.775125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c16f95-29d0-4e04-b1a4-4271897c3aa7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:40.775904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c16f95-29d0-4e04-b1a4-4271897c3aa7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:40.779793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c16f95-29d0-4e04-b1a4-4271897c3aa7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:40.780847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c16f95-29d0-4e04-b1a4-4271897c3aa7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:40.781501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c16f95-29d0-4e04-b1a4-4271897c3aa7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:40.782449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c16f95-29d0-4e04-b1a4-4271897c3aa7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:40.848809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-35c16f95-29d0-4e04-b1a4-4271897c3aa7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:08:40.928391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:40.945385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:40.950833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:40.955681 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-43abae87-0206-42e9-a40b-152ecc467192 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.474738 Aug 27 05:08:40.956694 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1704/3352] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:40 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:40.964449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-465c265d-c8c0-49ff-bd83-fe8cb04df917 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:40.967544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-465c265d-c8c0-49ff-bd83-fe8cb04df917 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:40.981999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-465c265d-c8c0-49ff-bd83-fe8cb04df917 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:40.983275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-465c265d-c8c0-49ff-bd83-fe8cb04df917 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:40.985660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-465c265d-c8c0-49ff-bd83-fe8cb04df917 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:40.987902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-465c265d-c8c0-49ff-bd83-fe8cb04df917 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:40.988594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-465c265d-c8c0-49ff-bd83-fe8cb04df917 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:40.991443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-465c265d-c8c0-49ff-bd83-fe8cb04df917 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:41.081756 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-35c16f95-29d0-4e04-b1a4-4271897c3aa7 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 204 len: 0 microversion: 2.1 time: 0.323550 Aug 27 05:08:41.082707 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1649/3353] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:08:40 2022] DELETE /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:08:41.093033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68c08e07-f527-4325-beea-466c0d41aafb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:41.099489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68c08e07-f527-4325-beea-466c0d41aafb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:41.121219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c08e07-f527-4325-beea-466c0d41aafb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:41.121940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c08e07-f527-4325-beea-466c0d41aafb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:41.122591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c08e07-f527-4325-beea-466c0d41aafb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:41.124163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c08e07-f527-4325-beea-466c0d41aafb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:41.124869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c08e07-f527-4325-beea-466c0d41aafb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:41.125507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c08e07-f527-4325-beea-466c0d41aafb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:41.125900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-465c265d-c8c0-49ff-bd83-fe8cb04df917 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:41.138521 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-465c265d-c8c0-49ff-bd83-fe8cb04df917 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1274 microversion: 2.1 time: 0.180576 Aug 27 05:08:41.141269 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1705/3354] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:40 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:41.234356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-33c9dcf1-f1d0-4e39-ac77-966b89528c62 req-5ac041c8-c202-4dcf-bc25-609313611f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e17d99b-5a34-47d2-8845-751e9e3950c1", "name": "network-vif-deleted", "tag": "a40e1272-53cc-4930-bec4-a342676c13f1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:41.256457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-33c9dcf1-f1d0-4e39-ac77-966b89528c62 req-5ac041c8-c202-4dcf-bc25-609313611f6c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:41.257181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-33c9dcf1-f1d0-4e39-ac77-966b89528c62 req-5ac041c8-c202-4dcf-bc25-609313611f6c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:41.260144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-33c9dcf1-f1d0-4e39-ac77-966b89528c62 req-5ac041c8-c202-4dcf-bc25-609313611f6c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:41.292381 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-33c9dcf1-f1d0-4e39-ac77-966b89528c62 req-5ac041c8-c202-4dcf-bc25-609313611f6c service nova] Creating event network-vif-deleted:a40e1272-53cc-4930-bec4-a342676c13f1 for instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 on n-h2-820368-35 Aug 27 05:08:41.307739 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-33c9dcf1-f1d0-4e39-ac77-966b89528c62 req-5ac041c8-c202-4dcf-bc25-609313611f6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074366 Aug 27 05:08:41.311510 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1706/3355] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:41.504002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5581696f-b9e1-4978-8689-0e1a9a7b6d8f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:41.504747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5581696f-b9e1-4978-8689-0e1a9a7b6d8f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:41.540776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581696f-b9e1-4978-8689-0e1a9a7b6d8f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:41.541660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581696f-b9e1-4978-8689-0e1a9a7b6d8f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:41.542286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581696f-b9e1-4978-8689-0e1a9a7b6d8f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:41.543748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581696f-b9e1-4978-8689-0e1a9a7b6d8f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:41.544403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581696f-b9e1-4978-8689-0e1a9a7b6d8f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:41.545036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5581696f-b9e1-4978-8689-0e1a9a7b6d8f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:41.654532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68c08e07-f527-4325-beea-466c0d41aafb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:41.670490 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68c08e07-f527-4325-beea-466c0d41aafb tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1503 microversion: 2.1 time: 0.581796 Aug 27 05:08:41.673733 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1650/3356] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:41 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1503 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:41.688669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3007620b-ab08-426c-b063-770d398e09cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:41.691046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3007620b-ab08-426c-b063-770d398e09cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:41.712165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3007620b-ab08-426c-b063-770d398e09cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:41.712849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3007620b-ab08-426c-b063-770d398e09cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:41.713303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3007620b-ab08-426c-b063-770d398e09cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:41.714024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3007620b-ab08-426c-b063-770d398e09cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:41.714483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3007620b-ab08-426c-b063-770d398e09cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:41.714968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3007620b-ab08-426c-b063-770d398e09cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.156733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5581696f-b9e1-4978-8689-0e1a9a7b6d8f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:42.172059 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5581696f-b9e1-4978-8689-0e1a9a7b6d8f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1474 microversion: 2.1 time: 0.674569 Aug 27 05:08:42.172931 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1707/3357] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:41 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1474 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:42.185289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3007620b-ab08-426c-b063-770d398e09cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:42.209019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:42.209661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:42.225634 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3007620b-ab08-426c-b063-770d398e09cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1315 microversion: 2.1 time: 0.548341 Aug 27 05:08:42.271519 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1651/3358] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:41 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:42.293940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.294448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.294892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.295670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.296138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.297953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4eda8408-31ca-4e5a-a890-2e4f928631a6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:42.298599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4eda8408-31ca-4e5a-a890-2e4f928631a6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:42.301867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.325685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eda8408-31ca-4e5a-a890-2e4f928631a6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.326189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eda8408-31ca-4e5a-a890-2e4f928631a6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.326633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eda8408-31ca-4e5a-a890-2e4f928631a6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.336463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eda8408-31ca-4e5a-a890-2e4f928631a6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.339743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eda8408-31ca-4e5a-a890-2e4f928631a6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.358200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eda8408-31ca-4e5a-a890-2e4f928631a6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.565047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:42.579604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:42.581204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:42.582409 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10812fdb-79cc-4d22-b481-44e1b2ecb9fc tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.408530 Aug 27 05:08:42.582970 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1708/3359] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:42 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:42.698642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-46ed42c3-fdbf-491f-9391-ef32b8422172 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:42.701850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-46ed42c3-fdbf-491f-9391-ef32b8422172 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:42.720065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46ed42c3-fdbf-491f-9391-ef32b8422172 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.720827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46ed42c3-fdbf-491f-9391-ef32b8422172 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.721574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46ed42c3-fdbf-491f-9391-ef32b8422172 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.723328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46ed42c3-fdbf-491f-9391-ef32b8422172 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.724095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46ed42c3-fdbf-491f-9391-ef32b8422172 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.724713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46ed42c3-fdbf-491f-9391-ef32b8422172 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.781672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4eda8408-31ca-4e5a-a890-2e4f928631a6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:42.795047 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4eda8408-31ca-4e5a-a890-2e4f928631a6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 0.521837 Aug 27 05:08:42.805361 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1652/3360] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:42 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:43.123709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-46ed42c3-fdbf-491f-9391-ef32b8422172 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:43.139755 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-46ed42c3-fdbf-491f-9391-ef32b8422172 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1503 microversion: 2.1 time: 0.444377 Aug 27 05:08:43.152533 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1709/3361] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:42 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1503 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:43.198038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2c85db8c-a421-4d65-8b37-01f053fa8afa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:43.200081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2c85db8c-a421-4d65-8b37-01f053fa8afa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:43.209897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c85db8c-a421-4d65-8b37-01f053fa8afa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:43.210930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c85db8c-a421-4d65-8b37-01f053fa8afa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:43.211590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c85db8c-a421-4d65-8b37-01f053fa8afa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:43.212554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c85db8c-a421-4d65-8b37-01f053fa8afa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:43.213305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c85db8c-a421-4d65-8b37-01f053fa8afa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:43.213899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c85db8c-a421-4d65-8b37-01f053fa8afa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:43.259019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-415e86a3-6aa5-41ea-b266-c9cd7d5e1cbd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:43.259690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-415e86a3-6aa5-41ea-b266-c9cd7d5e1cbd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:43.290406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-415e86a3-6aa5-41ea-b266-c9cd7d5e1cbd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:43.296547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-415e86a3-6aa5-41ea-b266-c9cd7d5e1cbd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:43.297061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-415e86a3-6aa5-41ea-b266-c9cd7d5e1cbd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:43.306789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-415e86a3-6aa5-41ea-b266-c9cd7d5e1cbd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:43.308254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-415e86a3-6aa5-41ea-b266-c9cd7d5e1cbd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:43.309911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-415e86a3-6aa5-41ea-b266-c9cd7d5e1cbd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:43.331426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:44.057878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-415e86a3-6aa5-41ea-b266-c9cd7d5e1cbd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:44.074493 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-415e86a3-6aa5-41ea-b266-c9cd7d5e1cbd tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1315 microversion: 2.1 time: 0.820848 Aug 27 05:08:44.093856 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1710/3362] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:43 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1315 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:44.105461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:44.109426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:44.111858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2c85db8c-a421-4d65-8b37-01f053fa8afa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:44.113723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:44.128093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:44.128361 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2c85db8c-a421-4d65-8b37-01f053fa8afa tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1472 microversion: 2.1 time: 0.935995 Aug 27 05:08:44.128884 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1653/3363] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:43 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1472 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:44.132148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:44.135268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:44.136392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:44.142574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:44.143555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:44.144333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:44.160779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-889381b1-891e-46ce-80d3-1ca6ee108cff tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:44.161896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-889381b1-891e-46ce-80d3-1ca6ee108cff tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:44.179286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-889381b1-891e-46ce-80d3-1ca6ee108cff tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:44.179787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-889381b1-891e-46ce-80d3-1ca6ee108cff tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:44.180231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-889381b1-891e-46ce-80d3-1ca6ee108cff tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:44.180948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-889381b1-891e-46ce-80d3-1ca6ee108cff tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:44.181407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-889381b1-891e-46ce-80d3-1ca6ee108cff tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:44.181834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-889381b1-891e-46ce-80d3-1ca6ee108cff tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:44.339816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:44.371423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:44.375346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:44.379751 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-49e36e6a-36c6-4a44-92fa-1819be943a96 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.280609 Aug 27 05:08:44.382555 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1711/3364] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:44 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:44.399146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-282ac173-f457-4246-9ff3-1b91915fef40 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:44.399818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-282ac173-f457-4246-9ff3-1b91915fef40 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:44.409259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-282ac173-f457-4246-9ff3-1b91915fef40 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:44.410030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-282ac173-f457-4246-9ff3-1b91915fef40 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:44.410532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-282ac173-f457-4246-9ff3-1b91915fef40 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:44.413449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-282ac173-f457-4246-9ff3-1b91915fef40 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:44.414225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-282ac173-f457-4246-9ff3-1b91915fef40 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:44.414903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-282ac173-f457-4246-9ff3-1b91915fef40 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:44.718605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-889381b1-891e-46ce-80d3-1ca6ee108cff tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:44.751271 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-889381b1-891e-46ce-80d3-1ca6ee108cff tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 0.612406 Aug 27 05:08:44.752813 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1654/3365] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:44 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:44.931444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-282ac173-f457-4246-9ff3-1b91915fef40 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:44.942875 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-282ac173-f457-4246-9ff3-1b91915fef40 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1503 microversion: 2.1 time: 0.556910 Aug 27 05:08:44.943539 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1712/3366] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:44 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1503 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:45.098418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b9bbdd96-a15f-46f0-82af-f3ae27015840 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:45.099399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b9bbdd96-a15f-46f0-82af-f3ae27015840 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:45.109270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9bbdd96-a15f-46f0-82af-f3ae27015840 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.113419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9bbdd96-a15f-46f0-82af-f3ae27015840 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.116159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9bbdd96-a15f-46f0-82af-f3ae27015840 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.117014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9bbdd96-a15f-46f0-82af-f3ae27015840 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.117498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9bbdd96-a15f-46f0-82af-f3ae27015840 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.117937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9bbdd96-a15f-46f0-82af-f3ae27015840 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.130524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:45.155553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6b1e7338-25e9-401a-ad96-d73adf39d1c8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:45.156843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6b1e7338-25e9-401a-ad96-d73adf39d1c8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:45.165407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1e7338-25e9-401a-ad96-d73adf39d1c8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.169963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1e7338-25e9-401a-ad96-d73adf39d1c8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.177327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1e7338-25e9-401a-ad96-d73adf39d1c8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.178462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1e7338-25e9-401a-ad96-d73adf39d1c8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.179327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1e7338-25e9-401a-ad96-d73adf39d1c8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.180005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1e7338-25e9-401a-ad96-d73adf39d1c8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.756314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b9bbdd96-a15f-46f0-82af-f3ae27015840 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:45.767922 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b9bbdd96-a15f-46f0-82af-f3ae27015840 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1502 microversion: 2.1 time: 0.673685 Aug 27 05:08:45.772163 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1655/3367] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:45 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1502 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:45.778989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8955d88f-b11d-446b-8837-bae5afb92124 req-a32030cc-e976-445c-8427-34dac6f9c6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db19a38-d04d-405d-8ba3-3dbe475125d0", "tag": "c877212f-784b-451e-bc81-690eed2f366f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:45.840590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6b1e7338-25e9-401a-ad96-d73adf39d1c8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:45.850542 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6b1e7338-25e9-401a-ad96-d73adf39d1c8 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1472 microversion: 2.1 time: 0.699156 Aug 27 05:08:45.854980 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1713/3368] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:45 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1472 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:45.857011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8955d88f-b11d-446b-8837-bae5afb92124 req-a32030cc-e976-445c-8427-34dac6f9c6f7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.860901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8955d88f-b11d-446b-8837-bae5afb92124 req-a32030cc-e976-445c-8427-34dac6f9c6f7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.865038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:45.870090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8955d88f-b11d-446b-8837-bae5afb92124 req-a32030cc-e976-445c-8427-34dac6f9c6f7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.873392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:45.905824 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8955d88f-b11d-446b-8837-bae5afb92124 req-a32030cc-e976-445c-8427-34dac6f9c6f7 service nova] Creating event network-changed:c877212f-784b-451e-bc81-690eed2f366f for instance 6db19a38-d04d-405d-8ba3-3dbe475125d0 on n-h1-820368-35 Aug 27 05:08:45.922703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.923301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.923694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.924427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.929744 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8955d88f-b11d-446b-8837-bae5afb92124 req-a32030cc-e976-445c-8427-34dac6f9c6f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153822 Aug 27 05:08:45.931408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.931874 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1656/3369] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:45.935771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.945215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:45.965129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6e7b3bd1-4672-4718-a5c7-41791f9cc612 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:45.970631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6e7b3bd1-4672-4718-a5c7-41791f9cc612 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:45.988486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7b3bd1-4672-4718-a5c7-41791f9cc612 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.990082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7b3bd1-4672-4718-a5c7-41791f9cc612 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.990628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7b3bd1-4672-4718-a5c7-41791f9cc612 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.991634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7b3bd1-4672-4718-a5c7-41791f9cc612 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.992194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7b3bd1-4672-4718-a5c7-41791f9cc612 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.992918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e7b3bd1-4672-4718-a5c7-41791f9cc612 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:46.304595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:46.321990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:46.331532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:46.333583 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89e560ed-0c95-4b18-8906-99edc63ff7fd tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.475146 Aug 27 05:08:46.349674 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1714/3370] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:45 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:46.361955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4ec85549-2a08-402d-917e-8ea943a1fd6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:46.379980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ec85549-2a08-402d-917e-8ea943a1fd6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:46.380432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ec85549-2a08-402d-917e-8ea943a1fd6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:46.381391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ec85549-2a08-402d-917e-8ea943a1fd6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:46.443064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4ec85549-2a08-402d-917e-8ea943a1fd6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Going to try to stop instance {{(pid=128548) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:08:46.520027 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4ec85549-2a08-402d-917e-8ea943a1fd6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43/action" status: 202 len: 0 microversion: 2.1 time: 0.165857 Aug 27 05:08:46.525204 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1715/3371] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:08:46 2022] POST /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:08:46.533113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-118afa1f-1c18-4961-b1be-0e199120fd19 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:46.534049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-118afa1f-1c18-4961-b1be-0e199120fd19 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:46.543800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-118afa1f-1c18-4961-b1be-0e199120fd19 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:46.544504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-118afa1f-1c18-4961-b1be-0e199120fd19 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:46.545574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-118afa1f-1c18-4961-b1be-0e199120fd19 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:46.546458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-118afa1f-1c18-4961-b1be-0e199120fd19 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:46.548486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-118afa1f-1c18-4961-b1be-0e199120fd19 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:46.549096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-118afa1f-1c18-4961-b1be-0e199120fd19 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:46.866415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6e7b3bd1-4672-4718-a5c7-41791f9cc612 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:46.882187 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6e7b3bd1-4672-4718-a5c7-41791f9cc612 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 0.943755 Aug 27 05:08:46.882956 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1657/3372] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:45 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:46.900528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0d4c73b9-c471-45c7-b13f-9b3f86f94974 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:46.901231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0d4c73b9-c471-45c7-b13f-9b3f86f94974 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:46.911707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d4c73b9-c471-45c7-b13f-9b3f86f94974 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:46.912214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d4c73b9-c471-45c7-b13f-9b3f86f94974 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:46.912663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d4c73b9-c471-45c7-b13f-9b3f86f94974 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:46.913537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d4c73b9-c471-45c7-b13f-9b3f86f94974 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:46.918735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d4c73b9-c471-45c7-b13f-9b3f86f94974 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:46.919350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d4c73b9-c471-45c7-b13f-9b3f86f94974 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:47.253188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0d4c73b9-c471-45c7-b13f-9b3f86f94974 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:47.263125 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0d4c73b9-c471-45c7-b13f-9b3f86f94974 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.378413 Aug 27 05:08:47.276847 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1658/3373] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:46 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:47.276847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2bc3637f-99f6-473d-ac26-6a30ebb08ac7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:47.276847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2bc3637f-99f6-473d-ac26-6a30ebb08ac7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:47.292959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bc3637f-99f6-473d-ac26-6a30ebb08ac7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:47.293455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bc3637f-99f6-473d-ac26-6a30ebb08ac7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:47.293896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bc3637f-99f6-473d-ac26-6a30ebb08ac7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:47.294671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bc3637f-99f6-473d-ac26-6a30ebb08ac7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:47.295055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bc3637f-99f6-473d-ac26-6a30ebb08ac7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:47.295507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bc3637f-99f6-473d-ac26-6a30ebb08ac7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:48.262861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-118afa1f-1c18-4961-b1be-0e199120fd19 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:48.276472 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-118afa1f-1c18-4961-b1be-0e199120fd19 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1503 microversion: 2.1 time: 1.751500 Aug 27 05:08:48.291695 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1716/3374] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:46 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1503 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:48.299647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:48.300681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:48.308501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:48.309546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:48.310254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:48.311238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:48.311922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:48.312591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:48.354223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2bc3637f-99f6-473d-ac26-6a30ebb08ac7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:48.365049 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2bc3637f-99f6-473d-ac26-6a30ebb08ac7 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1469 microversion: 2.1 time: 1.096534 Aug 27 05:08:48.369978 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1659/3375] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:47 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1469 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:48.380773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6911aceb-f69e-41e6-b77d-85a039c57429 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:48.381841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6911aceb-f69e-41e6-b77d-85a039c57429 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:48.398289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6911aceb-f69e-41e6-b77d-85a039c57429 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:48.398895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6911aceb-f69e-41e6-b77d-85a039c57429 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:48.399471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6911aceb-f69e-41e6-b77d-85a039c57429 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:48.400289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6911aceb-f69e-41e6-b77d-85a039c57429 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:48.403627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6911aceb-f69e-41e6-b77d-85a039c57429 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:48.404230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6911aceb-f69e-41e6-b77d-85a039c57429 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:48.461368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:48.471787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:48.473539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:48.474952 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ae191ca-06b1-40cd-a93e-52e81c6476a4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.181132 Aug 27 05:08:48.476146 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1717/3376] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:48 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:48.480978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1a0853c5-0b2f-4ea7-bfd8-cc2042964884 req-aa72f48f-2fcd-4f30-9529-cf77e7e3a044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280517c9-191f-47fc-9fd3-4d54372bac54", "name": "network-vif-unplugged", "status": "completed", "tag": "a07ccbfe-811c-44a6-a1f6-f6533c850ed8"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:48.491747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:48.493867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1a0853c5-0b2f-4ea7-bfd8-cc2042964884 req-aa72f48f-2fcd-4f30-9529-cf77e7e3a044 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:48.494523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1a0853c5-0b2f-4ea7-bfd8-cc2042964884 req-aa72f48f-2fcd-4f30-9529-cf77e7e3a044 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:48.495162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1a0853c5-0b2f-4ea7-bfd8-cc2042964884 req-aa72f48f-2fcd-4f30-9529-cf77e7e3a044 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:48.510887 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1a0853c5-0b2f-4ea7-bfd8-cc2042964884 req-aa72f48f-2fcd-4f30-9529-cf77e7e3a044 service nova] Creating event network-vif-unplugged:a07ccbfe-811c-44a6-a1f6-f6533c850ed8 for instance 280517c9-191f-47fc-9fd3-4d54372bac54 on n-h1-820368-35 Aug 27 05:08:48.518476 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1a0853c5-0b2f-4ea7-bfd8-cc2042964884 req-aa72f48f-2fcd-4f30-9529-cf77e7e3a044 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040787 Aug 27 05:08:48.524996 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1718/3377] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:48.530574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bd51350f-7b28-467d-ad7d-d159d501832d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Action: 'create', calling method: .version_select at 0x7fb5652d6550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-480786393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHxk8mCjP4fYSH45rO/zoB9LxNnnkDET/AQTiOptpKH7jJEU0TuVsCMInbeZbEaBT1Ss7g9kpnbEs81nGpjuPCx7s3g8I31K2Xq4inibJyQAZQJuccY7pJhV4gzQOof1w=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:48.552777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bd51350f-7b28-467d-ad7d-d159d501832d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for project 8855a07236c54efa89fcec7f944afd94. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:08:48.558641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bd51350f-7b28-467d-ad7d-d159d501832d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for user bf8bd46b91cf4774af109507c7c4422a and project 8855a07236c54efa89fcec7f944afd94. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:08:48.592768 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bd51350f-7b28-467d-ad7d-d159d501832d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.066257 Aug 27 05:08:48.600200 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1719/3378] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:08:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:48.605846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bfdb9027-e257-4134-9864-4b59db38ba76 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:48.606809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bfdb9027-e257-4134-9864-4b59db38ba76 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:48.614663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfdb9027-e257-4134-9864-4b59db38ba76 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:48.615533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfdb9027-e257-4134-9864-4b59db38ba76 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:48.616311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfdb9027-e257-4134-9864-4b59db38ba76 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:48.617293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfdb9027-e257-4134-9864-4b59db38ba76 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:48.617989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfdb9027-e257-4134-9864-4b59db38ba76 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:48.618599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfdb9027-e257-4134-9864-4b59db38ba76 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:49.428255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bfdb9027-e257-4134-9864-4b59db38ba76 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:49.463879 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bfdb9027-e257-4134-9864-4b59db38ba76 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.861794 Aug 27 05:08:49.471322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6911aceb-f69e-41e6-b77d-85a039c57429 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:49.481007 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6911aceb-f69e-41e6-b77d-85a039c57429 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 1.109575 Aug 27 05:08:49.481944 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1720/3379] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:48 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:49.484083 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1660/3380] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:48 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:49.487962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ffdd499f-6c05-45a5-a383-62435ecdfa89 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:49.495575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ffdd499f-6c05-45a5-a383-62435ecdfa89 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:49.503368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-843c71ea-de0a-4deb-9937-59423427be2c tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:49.504223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-843c71ea-de0a-4deb-9937-59423427be2c tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:49.512260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffdd499f-6c05-45a5-a383-62435ecdfa89 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:49.517130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-843c71ea-de0a-4deb-9937-59423427be2c tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:49.518050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffdd499f-6c05-45a5-a383-62435ecdfa89 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:49.518677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffdd499f-6c05-45a5-a383-62435ecdfa89 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:49.520038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffdd499f-6c05-45a5-a383-62435ecdfa89 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:49.520468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-843c71ea-de0a-4deb-9937-59423427be2c tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:49.521092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-843c71ea-de0a-4deb-9937-59423427be2c tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:49.521727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffdd499f-6c05-45a5-a383-62435ecdfa89 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:49.522630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-843c71ea-de0a-4deb-9937-59423427be2c tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:49.523394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffdd499f-6c05-45a5-a383-62435ecdfa89 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:49.524045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-843c71ea-de0a-4deb-9937-59423427be2c tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:49.529904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-843c71ea-de0a-4deb-9937-59423427be2c tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:49.626523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-843c71ea-de0a-4deb-9937-59423427be2c tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:49.645346 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-843c71ea-de0a-4deb-9937-59423427be2c tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1461 microversion: 2.1 time: 0.156114 Aug 27 05:08:49.646440 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1661/3381] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:49 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1461 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:49.723958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:49.723958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:49.723958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:49.723958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:49.723958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:49.723958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:49.723958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:49.723958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:49.792660 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ffdd499f-6c05-45a5-a383-62435ecdfa89 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "POST /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea/action" status: 202 len: 0 microversion: 2.1 time: 0.309051 Aug 27 05:08:49.793279 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1721/3382] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:08:49 2022] POST /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:08:49.799053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-e48f49a4-51f8-4b28-b5c1-1cc32fdfc543 req-6dc25d7f-d27b-4155-9d80-32ce9d768782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280517c9-191f-47fc-9fd3-4d54372bac54", "name": "network-vif-deleted", "tag": "a07ccbfe-811c-44a6-a1f6-f6533c850ed8"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:49.814523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e48f49a4-51f8-4b28-b5c1-1cc32fdfc543 req-6dc25d7f-d27b-4155-9d80-32ce9d768782 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:49.815449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e48f49a4-51f8-4b28-b5c1-1cc32fdfc543 req-6dc25d7f-d27b-4155-9d80-32ce9d768782 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:49.816021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e48f49a4-51f8-4b28-b5c1-1cc32fdfc543 req-6dc25d7f-d27b-4155-9d80-32ce9d768782 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:49.847526 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-e48f49a4-51f8-4b28-b5c1-1cc32fdfc543 req-6dc25d7f-d27b-4155-9d80-32ce9d768782 service nova] Creating event network-vif-deleted:a07ccbfe-811c-44a6-a1f6-f6533c850ed8 for instance 280517c9-191f-47fc-9fd3-4d54372bac54 on n-h1-820368-35 Aug 27 05:08:49.864675 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-e48f49a4-51f8-4b28-b5c1-1cc32fdfc543 req-6dc25d7f-d27b-4155-9d80-32ce9d768782 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067918 Aug 27 05:08:49.866426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:49.867894 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1722/3383] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:49.881698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-900942f7-cfb9-49ee-a60c-08d67f5f0461 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:49.882555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-900942f7-cfb9-49ee-a60c-08d67f5f0461 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:49.884594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:49.886125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:49.887571 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b66c3563-aec6-4a69-9c1a-017c473e0cef tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.239524 Aug 27 05:08:49.889579 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1662/3384] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:49 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:49.890151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-900942f7-cfb9-49ee-a60c-08d67f5f0461 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:49.891548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-900942f7-cfb9-49ee-a60c-08d67f5f0461 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:49.892131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-900942f7-cfb9-49ee-a60c-08d67f5f0461 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:49.892964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-900942f7-cfb9-49ee-a60c-08d67f5f0461 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:49.893557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-900942f7-cfb9-49ee-a60c-08d67f5f0461 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:49.894100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-900942f7-cfb9-49ee-a60c-08d67f5f0461 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:50.091523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-900942f7-cfb9-49ee-a60c-08d67f5f0461 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:50.128431 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-900942f7-cfb9-49ee-a60c-08d67f5f0461 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.259085 Aug 27 05:08:50.129424 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1723/3385] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:49 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:50.507597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba957d95-2936-4010-becd-084e2c60257c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:50.508525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba957d95-2936-4010-becd-084e2c60257c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:50.510846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8e61fc8-0010-4f13-b941-cfef1d6a5859 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:50.511951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8e61fc8-0010-4f13-b941-cfef1d6a5859 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:50.521315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba957d95-2936-4010-becd-084e2c60257c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:50.532155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e61fc8-0010-4f13-b941-cfef1d6a5859 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:50.532794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e61fc8-0010-4f13-b941-cfef1d6a5859 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:50.533332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e61fc8-0010-4f13-b941-cfef1d6a5859 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:50.534150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e61fc8-0010-4f13-b941-cfef1d6a5859 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:50.535603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e61fc8-0010-4f13-b941-cfef1d6a5859 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:50.535947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba957d95-2936-4010-becd-084e2c60257c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:50.536549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba957d95-2936-4010-becd-084e2c60257c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:50.537225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e61fc8-0010-4f13-b941-cfef1d6a5859 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:50.539256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba957d95-2936-4010-becd-084e2c60257c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:50.542736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba957d95-2936-4010-becd-084e2c60257c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:50.543409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba957d95-2936-4010-becd-084e2c60257c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:50.943852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ba957d95-2936-4010-becd-084e2c60257c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:50.946477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8e61fc8-0010-4f13-b941-cfef1d6a5859 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:50.952876 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba957d95-2936-4010-becd-084e2c60257c tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.453675 Aug 27 05:08:50.954163 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1663/3386] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:50 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:50.960029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b9946e75-99d2-4545-b681-0e82ee308acb req-a96b5f4d-82ae-45e9-b93f-de682ca99af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea", "name": "network-vif-plugged", "status": "completed", "tag": "856e3225-e60e-4434-b63d-6d6e70bf7364"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:50.972505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b9946e75-99d2-4545-b681-0e82ee308acb req-a96b5f4d-82ae-45e9-b93f-de682ca99af1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:50.973189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b9946e75-99d2-4545-b681-0e82ee308acb req-a96b5f4d-82ae-45e9-b93f-de682ca99af1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:50.973781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b9946e75-99d2-4545-b681-0e82ee308acb req-a96b5f4d-82ae-45e9-b93f-de682ca99af1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:50.983387 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8e61fc8-0010-4f13-b941-cfef1d6a5859 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 0.471084 Aug 27 05:08:50.986772 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1724/3387] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:50 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:50.999424 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b9946e75-99d2-4545-b681-0e82ee308acb req-a96b5f4d-82ae-45e9-b93f-de682ca99af1 service nova] Creating event network-vif-plugged:856e3225-e60e-4434-b63d-6d6e70bf7364 for instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea on n-h1-820368-35 Aug 27 05:08:51.002230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-15414a40-115e-413c-bbf4-8475ff74ab26 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:51.003041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-15414a40-115e-413c-bbf4-8475ff74ab26 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:51.009677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-b9946e75-99d2-4545-b681-0e82ee308acb req-a96b5f4d-82ae-45e9-b93f-de682ca99af1 service nova] Instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:08:51.021212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15414a40-115e-413c-bbf4-8475ff74ab26 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:51.021867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15414a40-115e-413c-bbf4-8475ff74ab26 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:51.023021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15414a40-115e-413c-bbf4-8475ff74ab26 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:51.023973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15414a40-115e-413c-bbf4-8475ff74ab26 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:51.024574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15414a40-115e-413c-bbf4-8475ff74ab26 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:51.025146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15414a40-115e-413c-bbf4-8475ff74ab26 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:51.046632 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b9946e75-99d2-4545-b681-0e82ee308acb req-a96b5f4d-82ae-45e9-b93f-de682ca99af1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090351 Aug 27 05:08:51.049047 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1664/3388] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:51.059296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:51.060109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:51.081073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:51.081639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:51.082088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:51.082807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:51.083295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:51.083730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:51.169823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15414a40-115e-413c-bbf4-8475ff74ab26 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:51.181657 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-15414a40-115e-413c-bbf4-8475ff74ab26 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1461 microversion: 2.1 time: 0.193450 Aug 27 05:08:51.197210 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1725/3389] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:50 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1461 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:51.210517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6dbb29bb-3be0-4b8d-8d28-e92fd5611294 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:51.211397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6dbb29bb-3be0-4b8d-8d28-e92fd5611294 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:51.222832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dbb29bb-3be0-4b8d-8d28-e92fd5611294 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:51.223736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dbb29bb-3be0-4b8d-8d28-e92fd5611294 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:51.224458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dbb29bb-3be0-4b8d-8d28-e92fd5611294 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:51.225349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dbb29bb-3be0-4b8d-8d28-e92fd5611294 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:51.226021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dbb29bb-3be0-4b8d-8d28-e92fd5611294 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:51.226802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6dbb29bb-3be0-4b8d-8d28-e92fd5611294 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:51.238390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:51.258992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:51.262486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:51.264233 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d3fb6af2-e5c3-4fc8-ad04-c19c6945261e tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.214012 Aug 27 05:08:51.265316 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1665/3390] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:51 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:51.366369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1364563304", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "9b430b47-b891-43ab-946b-33e7e929371d"}], "key_name": "tempest-TestNetworkBasicOps-480786393", "security_groups": [{"name": "tempest-secgroup-smoke-651305741"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:51.443197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6dbb29bb-3be0-4b8d-8d28-e92fd5611294 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:51.453976 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6dbb29bb-3be0-4b8d-8d28-e92fd5611294 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.254493 Aug 27 05:08:51.455339 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1726/3391] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:51 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:51.501103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] validate_networks() for [('9b430b47-b891-43ab-946b-33e7e929371d', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:08:51.977207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:08:51.977774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:08:51.978109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:08:51.978525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:08:51.978945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:08:51.979625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bbba70e3-74ae-4d36-8a5e-914e40f1565b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:51.981169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bbba70e3-74ae-4d36-8a5e-914e40f1565b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:51.992108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bbba70e3-74ae-4d36-8a5e-914e40f1565b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:51.992962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bbba70e3-74ae-4d36-8a5e-914e40f1565b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:51.993641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bbba70e3-74ae-4d36-8a5e-914e40f1565b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:51.994621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bbba70e3-74ae-4d36-8a5e-914e40f1565b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:51.995361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bbba70e3-74ae-4d36-8a5e-914e40f1565b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:51.995534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:51.996071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bbba70e3-74ae-4d36-8a5e-914e40f1565b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:51.996182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:51.996627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:51.997453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:51.997833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:51.998267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:52.033312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for project 8855a07236c54efa89fcec7f944afd94. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:08:52.041836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Getting quotas for user bf8bd46b91cf4774af109507c7c4422a and project 8855a07236c54efa89fcec7f944afd94. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:08:52.057729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:08:52.060960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:08:52.095863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:52.131574 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-69fe37de-0bc0-4185-9710-4918ccaf2e5d tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.768926 Aug 27 05:08:52.132953 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1666/3392] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:08:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:08:52.143462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2e374b76-6808-46d2-af8b-25390e152ba2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:52.144419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2e374b76-6808-46d2-af8b-25390e152ba2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:52.157478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e374b76-6808-46d2-af8b-25390e152ba2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:52.157975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e374b76-6808-46d2-af8b-25390e152ba2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:52.158552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e374b76-6808-46d2-af8b-25390e152ba2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:52.160039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e374b76-6808-46d2-af8b-25390e152ba2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:52.160507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e374b76-6808-46d2-af8b-25390e152ba2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:52.160940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e374b76-6808-46d2-af8b-25390e152ba2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:52.492803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bbba70e3-74ae-4d36-8a5e-914e40f1565b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:52.504038 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bbba70e3-74ae-4d36-8a5e-914e40f1565b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.530321 Aug 27 05:08:52.504566 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1727/3393] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:51 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:52.524210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ee8bf064-a632-4298-a7a2-a97cd5840603 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:52.524997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ee8bf064-a632-4298-a7a2-a97cd5840603 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:52.649656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2e374b76-6808-46d2-af8b-25390e152ba2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:52.665033 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2e374b76-6808-46d2-af8b-25390e152ba2 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 0.526027 Aug 27 05:08:52.665816 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1667/3394] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:52 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:52.670703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:52.675993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:52.685379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:52.692469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:52.693061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:52.693920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:52.694488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:52.695025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:52.695384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ee8bf064-a632-4298-a7a2-a97cd5840603 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:52.704599 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ee8bf064-a632-4298-a7a2-a97cd5840603 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1248 microversion: 2.1 time: 0.194203 Aug 27 05:08:52.718216 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1728/3395] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:52 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1248 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:52.729390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:52.730076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:52.738230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:52.738939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:52.739634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:52.740617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:52.741376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:52.742160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:52.781242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:52.782535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:52.783046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:52.783578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lazy-loading 'fault' on Instance uuid 280517c9-191f-47fc-9fd3-4d54372bac54 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:08:52.872270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:52.890695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:52.893580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:52.895013 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6ffd8a25-7b76-4c44-a6bb-e2c97d2f41ea tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.175730 Aug 27 05:08:52.895954 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1729/3396] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:52 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:52.896272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0041a7908e8141c6be225f5e8769bfb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52a4949c7c74e60b345a30ffb6fd495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:52.912208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8ade64c0-32b4-4e7e-92f1-d81031482521 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:52.913317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8ade64c0-32b4-4e7e-92f1-d81031482521 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:52.917892 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5cd7fb9-9e33-4502-90e0-31dc668f0a97 tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 200 len: 1303 microversion: 2.1 time: 0.250287 Aug 27 05:08:52.918851 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1668/3397] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:52 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 1303 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:52.924405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ade64c0-32b4-4e7e-92f1-d81031482521 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:52.924903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ade64c0-32b4-4e7e-92f1-d81031482521 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:52.925341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ade64c0-32b4-4e7e-92f1-d81031482521 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:52.926050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ade64c0-32b4-4e7e-92f1-d81031482521 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:52.927592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ade64c0-32b4-4e7e-92f1-d81031482521 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:52.928055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ade64c0-32b4-4e7e-92f1-d81031482521 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:53.332281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8ade64c0-32b4-4e7e-92f1-d81031482521 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:53.345077 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8ade64c0-32b4-4e7e-92f1-d81031482521 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.447469 Aug 27 05:08:53.346351 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1730/3398] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:52 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:53.525866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d0435ccd-7049-4d29-be3c-25bd2e45053a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:53.527053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d0435ccd-7049-4d29-be3c-25bd2e45053a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:53.537582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0435ccd-7049-4d29-be3c-25bd2e45053a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:53.538708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0435ccd-7049-4d29-be3c-25bd2e45053a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:53.542715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0435ccd-7049-4d29-be3c-25bd2e45053a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:53.543677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0435ccd-7049-4d29-be3c-25bd2e45053a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:53.544295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0435ccd-7049-4d29-be3c-25bd2e45053a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:53.544893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0435ccd-7049-4d29-be3c-25bd2e45053a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:53.686109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7e1a96c3-8790-4291-ba17-3191c7307f65 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:53.686750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7e1a96c3-8790-4291-ba17-3191c7307f65 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:53.696882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e1a96c3-8790-4291-ba17-3191c7307f65 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:53.697630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e1a96c3-8790-4291-ba17-3191c7307f65 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:53.699785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e1a96c3-8790-4291-ba17-3191c7307f65 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:53.700701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e1a96c3-8790-4291-ba17-3191c7307f65 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:53.707820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e1a96c3-8790-4291-ba17-3191c7307f65 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:53.708509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e1a96c3-8790-4291-ba17-3191c7307f65 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:53.759564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:54.028702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d0435ccd-7049-4d29-be3c-25bd2e45053a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:54.042498 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d0435ccd-7049-4d29-be3c-25bd2e45053a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.520879 Aug 27 05:08:54.055136 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1669/3399] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:53 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:54.055136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-21381055-3d45-424f-a357-b315f7e1d2ec tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:54.055136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-21381055-3d45-424f-a357-b315f7e1d2ec tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:54.075749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21381055-3d45-424f-a357-b315f7e1d2ec tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:54.076252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21381055-3d45-424f-a357-b315f7e1d2ec tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:54.076723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21381055-3d45-424f-a357-b315f7e1d2ec tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:54.077609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21381055-3d45-424f-a357-b315f7e1d2ec tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:54.078073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21381055-3d45-424f-a357-b315f7e1d2ec tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:54.079061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21381055-3d45-424f-a357-b315f7e1d2ec tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:54.105167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7e1a96c3-8790-4291-ba17-3191c7307f65 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:54.114103 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7e1a96c3-8790-4291-ba17-3191c7307f65 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 0.432149 Aug 27 05:08:54.114711 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1731/3400] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:53 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:54.130547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:54.131871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:54.142338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:54.143231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:54.143918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:54.144885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:54.145590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:54.146213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:54.207012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-21381055-3d45-424f-a357-b315f7e1d2ec tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:54.220793 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-21381055-3d45-424f-a357-b315f7e1d2ec tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1300 microversion: 2.1 time: 0.176099 Aug 27 05:08:54.221571 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1670/3401] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:54 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1300 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:54.233615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:54.234471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] [instance: 280517c9-191f-47fc-9fd3-4d54372bac54] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:54.252625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:54.253403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:54.253990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:54.254877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:54.255510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:54.256080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:54.281238 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] HTTP exception thrown: Instance 280517c9-191f-47fc-9fd3-4d54372bac54 could not be found. Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Request method failure captured: Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 HTTP/1.1 Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaah1jF5G26RDObT9VCTmvazQ0ftcIufmOiOTQ2BKX0ZH7gBNRf0yo9DyA2N9-RRqMSDpnBdRsQf-YE3nCILz4NvTqzMfEzPpd9CHD1bjhPDXOjvtgKEZOoanzwzQVX3GZ6FH8w2Pbjg1k1GmvuhEH57SiexQqeLtUuQ3mvi0dbYOCM Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: a52a4949c7c74e60b345a30ffb6fd495 Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-VolumesActionsTest-1524314651 Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a52a4949c7c74e60b345a30ffb6fd495", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a52a4949c7c74e60b345a30ffb6fd495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a52a4949c7c74e60b345a30ffb6fd495"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a52a4949c7c74e60b345a30ffb6fd495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-VolumesActionsTest-1524314651 Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: a52a4949c7c74e60b345a30ffb6fd495 Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-VolumesActionsTest-1524314651 Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-VolumesActionsTest-1524314651-project Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 0041a7908e8141c6be225f5e8769bfb2 Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-VolumesActionsTest-1524314651-project Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 280517c9-191f-47fc-9fd3-4d54372bac54 could not be found. Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '280517c9-191f-47fc-9fd3-4d54372bac54'} Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280517c9-191f-47fc-9fd3-4d54372bac54 could not be found. Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280517c9-191f-47fc-9fd3-4d54372bac54 could not be found. Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:54.290743 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:54.293781 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:54.293781 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:54.293781 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:54.293781 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:54.293781 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:54.293781 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280517c9-191f-47fc-9fd3-4d54372bac54 could not be found. Aug 27 05:08:54.293781 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:08:54.295654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] Returning 404 to user: Instance 280517c9-191f-47fc-9fd3-4d54372bac54 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:54.297483 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed07f217-7a03-47e6-aeb8-55c261b7cd3d tempest-VolumesActionsTest-1524314651 tempest-VolumesActionsTest-1524314651-project] 10.222.0.58 "GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54" status: 404 len: 111 microversion: 2.1 time: 0.074110 Aug 27 05:08:54.300137 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1671/3402] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:54 2022] GET /compute/v2.1/servers/280517c9-191f-47fc-9fd3-4d54372bac54 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:54.316502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:54.342150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:54.360435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:54.367782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ccfbc448-6406-4500-90d5-6560cb02c03e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:54.368801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ccfbc448-6406-4500-90d5-6560cb02c03e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:54.380189 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-528235b6-3551-4a04-80eb-f2feba095d00 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.261989 Aug 27 05:08:54.381596 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1732/3403] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:54 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:54.381918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccfbc448-6406-4500-90d5-6560cb02c03e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:54.382912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccfbc448-6406-4500-90d5-6560cb02c03e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:54.384507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccfbc448-6406-4500-90d5-6560cb02c03e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:54.411349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccfbc448-6406-4500-90d5-6560cb02c03e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:54.411884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccfbc448-6406-4500-90d5-6560cb02c03e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:54.412479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccfbc448-6406-4500-90d5-6560cb02c03e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:54.426668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:54.969960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ccfbc448-6406-4500-90d5-6560cb02c03e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:54.983069 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ccfbc448-6406-4500-90d5-6560cb02c03e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.619073 Aug 27 05:08:54.983707 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1672/3404] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:54 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:55.075848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eabb4673-a0f8-4afe-bc22-edcebbdb08ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:55.076581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eabb4673-a0f8-4afe-bc22-edcebbdb08ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:55.086388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabb4673-a0f8-4afe-bc22-edcebbdb08ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.093136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabb4673-a0f8-4afe-bc22-edcebbdb08ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.093743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabb4673-a0f8-4afe-bc22-edcebbdb08ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.099449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabb4673-a0f8-4afe-bc22-edcebbdb08ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.100205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabb4673-a0f8-4afe-bc22-edcebbdb08ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.100792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabb4673-a0f8-4afe-bc22-edcebbdb08ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.138178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-986f7f7b-172b-4597-a1f2-272e23e28d09 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:55.138786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-986f7f7b-172b-4597-a1f2-272e23e28d09 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:55.161076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-986f7f7b-172b-4597-a1f2-272e23e28d09 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.161594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-986f7f7b-172b-4597-a1f2-272e23e28d09 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.162045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-986f7f7b-172b-4597-a1f2-272e23e28d09 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.162910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-986f7f7b-172b-4597-a1f2-272e23e28d09 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.163401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-986f7f7b-172b-4597-a1f2-272e23e28d09 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.163834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-986f7f7b-172b-4597-a1f2-272e23e28d09 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.476870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-986f7f7b-172b-4597-a1f2-272e23e28d09 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:55.490463 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-986f7f7b-172b-4597-a1f2-272e23e28d09 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 0.356623 Aug 27 05:08:55.493880 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1673/3405] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:55 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:55.501040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-437b3332-ec9b-464a-a65f-d86f9d269251 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:55.502065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-437b3332-ec9b-464a-a65f-d86f9d269251 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:55.517737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-437b3332-ec9b-464a-a65f-d86f9d269251 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.518104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eabb4673-a0f8-4afe-bc22-edcebbdb08ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:55.520107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-437b3332-ec9b-464a-a65f-d86f9d269251 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.529333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-437b3332-ec9b-464a-a65f-d86f9d269251 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.531018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-437b3332-ec9b-464a-a65f-d86f9d269251 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.532374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-437b3332-ec9b-464a-a65f-d86f9d269251 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.533212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-437b3332-ec9b-464a-a65f-d86f9d269251 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.541458 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eabb4673-a0f8-4afe-bc22-edcebbdb08ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.477874 Aug 27 05:08:55.542042 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1733/3406] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:55 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:55.561238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:55.562163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:55.569984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.570488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.570926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.572701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.573229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.573663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.665055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-437b3332-ec9b-464a-a65f-d86f9d269251 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:55.674607 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-437b3332-ec9b-464a-a65f-d86f9d269251 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1306 microversion: 2.1 time: 0.179155 Aug 27 05:08:55.675820 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1674/3407] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:55 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1306 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:55.774050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:55.795727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:55.798589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:55.800197 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a5ff5f8c-b7be-4b92-b556-cbc288b95964 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.257252 Aug 27 05:08:55.800891 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1734/3408] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:55 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:56.006373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d030830e-6ea3-457c-88f5-b088d9608765 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:56.006997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d030830e-6ea3-457c-88f5-b088d9608765 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:56.023055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d030830e-6ea3-457c-88f5-b088d9608765 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.023861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d030830e-6ea3-457c-88f5-b088d9608765 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.024455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d030830e-6ea3-457c-88f5-b088d9608765 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:56.025330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d030830e-6ea3-457c-88f5-b088d9608765 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.025939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d030830e-6ea3-457c-88f5-b088d9608765 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.033865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d030830e-6ea3-457c-88f5-b088d9608765 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:56.278414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d030830e-6ea3-457c-88f5-b088d9608765 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:56.302290 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d030830e-6ea3-457c-88f5-b088d9608765 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.300171 Aug 27 05:08:56.304189 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1675/3409] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:55 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:56.514450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b9adc994-31dc-45c1-8af6-aba6b7ce7ebc tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:56.515315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b9adc994-31dc-45c1-8af6-aba6b7ce7ebc tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:56.530184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9adc994-31dc-45c1-8af6-aba6b7ce7ebc tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.531423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9adc994-31dc-45c1-8af6-aba6b7ce7ebc tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.532123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9adc994-31dc-45c1-8af6-aba6b7ce7ebc tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:56.533093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9adc994-31dc-45c1-8af6-aba6b7ce7ebc tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.533759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9adc994-31dc-45c1-8af6-aba6b7ce7ebc tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.534568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9adc994-31dc-45c1-8af6-aba6b7ce7ebc tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:56.564794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5c976c8-614a-4cb1-a768-0d52e3174e31 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:56.565749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b5c976c8-614a-4cb1-a768-0d52e3174e31 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:56.574361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c976c8-614a-4cb1-a768-0d52e3174e31 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.580610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c976c8-614a-4cb1-a768-0d52e3174e31 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.585048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c976c8-614a-4cb1-a768-0d52e3174e31 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:56.586138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c976c8-614a-4cb1-a768-0d52e3174e31 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.586767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c976c8-614a-4cb1-a768-0d52e3174e31 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.587378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5c976c8-614a-4cb1-a768-0d52e3174e31 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:56.851385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b9adc994-31dc-45c1-8af6-aba6b7ce7ebc tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:56.862104 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b9adc994-31dc-45c1-8af6-aba6b7ce7ebc tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 0.351317 Aug 27 05:08:56.892024 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1735/3410] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:56 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:56.905859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d722e2f0-d0d9-4861-8bb8-d02fcc399e01 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:56.906927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d722e2f0-d0d9-4861-8bb8-d02fcc399e01 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:56.918246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d722e2f0-d0d9-4861-8bb8-d02fcc399e01 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.919305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d722e2f0-d0d9-4861-8bb8-d02fcc399e01 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.920008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d722e2f0-d0d9-4861-8bb8-d02fcc399e01 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:56.920961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d722e2f0-d0d9-4861-8bb8-d02fcc399e01 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.921666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d722e2f0-d0d9-4861-8bb8-d02fcc399e01 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.922537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d722e2f0-d0d9-4861-8bb8-d02fcc399e01 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:57.026705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5c976c8-614a-4cb1-a768-0d52e3174e31 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:57.040748 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5c976c8-614a-4cb1-a768-0d52e3174e31 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.480896 Aug 27 05:08:57.041384 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1676/3411] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:56 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:57.071767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:57.072906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:57.084959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:57.089223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:57.089873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:57.091421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:57.092038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:57.095358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:57.234833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:57.256373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:57.257842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:57.259409 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-46bd1a80-1d38-4fb9-a770-eaacb2f95c71 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.203285 Aug 27 05:08:57.284184 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1677/3412] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:57 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:57.307258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d722e2f0-d0d9-4861-8bb8-d02fcc399e01 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:57.318805 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d722e2f0-d0d9-4861-8bb8-d02fcc399e01 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.424759 Aug 27 05:08:57.323706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-48673464-92df-46e7-8ac1-5430e086495c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:57.324329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-48673464-92df-46e7-8ac1-5430e086495c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:57.347192 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1736/3413] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:56 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:57.350658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48673464-92df-46e7-8ac1-5430e086495c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:57.351379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48673464-92df-46e7-8ac1-5430e086495c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:57.351969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48673464-92df-46e7-8ac1-5430e086495c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:57.352837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48673464-92df-46e7-8ac1-5430e086495c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:57.353496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48673464-92df-46e7-8ac1-5430e086495c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:57.354114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48673464-92df-46e7-8ac1-5430e086495c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:57.626018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-48673464-92df-46e7-8ac1-5430e086495c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:57.635278 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-48673464-92df-46e7-8ac1-5430e086495c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.315215 Aug 27 05:08:57.648610 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1678/3414] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:57 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:57.910822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c2a7ae76-b646-4ebb-a7b7-2cd763a9b06a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:57.912125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c2a7ae76-b646-4ebb-a7b7-2cd763a9b06a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:57.926782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2a7ae76-b646-4ebb-a7b7-2cd763a9b06a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:57.927867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2a7ae76-b646-4ebb-a7b7-2cd763a9b06a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:57.928606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2a7ae76-b646-4ebb-a7b7-2cd763a9b06a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:57.931336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2a7ae76-b646-4ebb-a7b7-2cd763a9b06a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:57.935077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2a7ae76-b646-4ebb-a7b7-2cd763a9b06a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:57.935980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2a7ae76-b646-4ebb-a7b7-2cd763a9b06a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.063255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-77fab53c-f480-4e73-bf22-3b28efbfd70f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:58.064506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-77fab53c-f480-4e73-bf22-3b28efbfd70f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:58.076150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77fab53c-f480-4e73-bf22-3b28efbfd70f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.084660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77fab53c-f480-4e73-bf22-3b28efbfd70f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.087860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77fab53c-f480-4e73-bf22-3b28efbfd70f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.091422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77fab53c-f480-4e73-bf22-3b28efbfd70f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.097393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77fab53c-f480-4e73-bf22-3b28efbfd70f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.098974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77fab53c-f480-4e73-bf22-3b28efbfd70f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.397113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c2a7ae76-b646-4ebb-a7b7-2cd763a9b06a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:58.413418 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c2a7ae76-b646-4ebb-a7b7-2cd763a9b06a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 0.500991 Aug 27 05:08:58.416668 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1737/3415] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:57 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:58.434340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:58.437318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:58.462321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.466494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.467709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.468667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.479482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.480410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.506707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-77fab53c-f480-4e73-bf22-3b28efbfd70f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:58.518597 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-77fab53c-f480-4e73-bf22-3b28efbfd70f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.460470 Aug 27 05:08:58.519835 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1679/3416] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:58 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:58.529841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d4159d5a-2494-4a83-88ee-c8cb264a270f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:58.533809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d4159d5a-2494-4a83-88ee-c8cb264a270f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:58.553438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4159d5a-2494-4a83-88ee-c8cb264a270f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.554991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4159d5a-2494-4a83-88ee-c8cb264a270f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.556174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4159d5a-2494-4a83-88ee-c8cb264a270f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.559834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4159d5a-2494-4a83-88ee-c8cb264a270f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.562168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4159d5a-2494-4a83-88ee-c8cb264a270f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.563498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4159d5a-2494-4a83-88ee-c8cb264a270f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.655915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:58.684020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:58.688907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:58.699339 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7913a32c-6ce8-47cf-b622-1de5bc34ea64 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.278545 Aug 27 05:08:58.700800 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1738/3417] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:58 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:08:58.719383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3672f5ee-389b-42b3-837c-417f08c68fa4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:58.720383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3672f5ee-389b-42b3-837c-417f08c68fa4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:58.742779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3672f5ee-389b-42b3-837c-417f08c68fa4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.743499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3672f5ee-389b-42b3-837c-417f08c68fa4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.745091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3672f5ee-389b-42b3-837c-417f08c68fa4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.750787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3672f5ee-389b-42b3-837c-417f08c68fa4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.757750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3672f5ee-389b-42b3-837c-417f08c68fa4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.758929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3672f5ee-389b-42b3-837c-417f08c68fa4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.115310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d4159d5a-2494-4a83-88ee-c8cb264a270f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:59.126791 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d4159d5a-2494-4a83-88ee-c8cb264a270f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.601491 Aug 27 05:08:59.140517 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1680/3418] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:58 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:59.144818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7f0fbf54-6ccd-46ca-95e0-2f52b44fdda8 req-4555837e-3835-4779-8520-459171574e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db19a38-d04d-405d-8ba3-3dbe475125d0", "name": "network-vif-plugged", "status": "completed", "tag": "c877212f-784b-451e-bc81-690eed2f366f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:59.174169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7f0fbf54-6ccd-46ca-95e0-2f52b44fdda8 req-4555837e-3835-4779-8520-459171574e58 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.177281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7f0fbf54-6ccd-46ca-95e0-2f52b44fdda8 req-4555837e-3835-4779-8520-459171574e58 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.181323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7f0fbf54-6ccd-46ca-95e0-2f52b44fdda8 req-4555837e-3835-4779-8520-459171574e58 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.227438 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7f0fbf54-6ccd-46ca-95e0-2f52b44fdda8 req-4555837e-3835-4779-8520-459171574e58 service nova] Creating event network-vif-plugged:c877212f-784b-451e-bc81-690eed2f366f for instance 6db19a38-d04d-405d-8ba3-3dbe475125d0 on n-h1-820368-35 Aug 27 05:08:59.240549 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7f0fbf54-6ccd-46ca-95e0-2f52b44fdda8 req-4555837e-3835-4779-8520-459171574e58 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105641 Aug 27 05:08:59.242129 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1681/3419] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:59.285959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3672f5ee-389b-42b3-837c-417f08c68fa4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:59.300176 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3672f5ee-389b-42b3-837c-417f08c68fa4 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.595767 Aug 27 05:08:59.300789 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1739/3420] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:58 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:59.436655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed6a7381-2624-48bb-86db-b1d77116d52e tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:59.438112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed6a7381-2624-48bb-86db-b1d77116d52e tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:59.451755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed6a7381-2624-48bb-86db-b1d77116d52e tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.455377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed6a7381-2624-48bb-86db-b1d77116d52e tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.456115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed6a7381-2624-48bb-86db-b1d77116d52e tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.466895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed6a7381-2624-48bb-86db-b1d77116d52e tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.478009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1786ac71-f4a8-41d7-a1c8-43dfc8855d32 req-636faaf6-e649-4341-8953-d01deef9c029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea", "name": "network-vif-unplugged", "status": "completed", "tag": "856e3225-e60e-4434-b63d-6d6e70bf7364"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:59.486712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed6a7381-2624-48bb-86db-b1d77116d52e tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.492980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed6a7381-2624-48bb-86db-b1d77116d52e tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.521333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1786ac71-f4a8-41d7-a1c8-43dfc8855d32 req-636faaf6-e649-4341-8953-d01deef9c029 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.522085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1786ac71-f4a8-41d7-a1c8-43dfc8855d32 req-636faaf6-e649-4341-8953-d01deef9c029 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.523580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1786ac71-f4a8-41d7-a1c8-43dfc8855d32 req-636faaf6-e649-4341-8953-d01deef9c029 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.613960 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1786ac71-f4a8-41d7-a1c8-43dfc8855d32 req-636faaf6-e649-4341-8953-d01deef9c029 service nova] Creating event network-vif-unplugged:856e3225-e60e-4434-b63d-6d6e70bf7364 for instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea on n-h2-820368-35 Aug 27 05:08:59.638317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-1786ac71-f4a8-41d7-a1c8-43dfc8855d32 req-636faaf6-e649-4341-8953-d01deef9c029 service nova] Instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:08:59.685633 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1786ac71-f4a8-41d7-a1c8-43dfc8855d32 req-636faaf6-e649-4341-8953-d01deef9c029 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.212056 Aug 27 05:08:59.686812 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1740/3421] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:08:59.698288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-298f813c-e4d9-445b-87ac-2e6dde388584 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:59.699768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-298f813c-e4d9-445b-87ac-2e6dde388584 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:59.713483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-298f813c-e4d9-445b-87ac-2e6dde388584 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.718567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-298f813c-e4d9-445b-87ac-2e6dde388584 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.719799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-298f813c-e4d9-445b-87ac-2e6dde388584 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.720633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-298f813c-e4d9-445b-87ac-2e6dde388584 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.721172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-298f813c-e4d9-445b-87ac-2e6dde388584 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.723352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-298f813c-e4d9-445b-87ac-2e6dde388584 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.803521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ed6a7381-2624-48bb-86db-b1d77116d52e tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:59.812052 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed6a7381-2624-48bb-86db-b1d77116d52e tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 0.380889 Aug 27 05:08:59.825787 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1682/3422] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:59 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:59.825787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:59.832273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:59.848797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.849380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.857156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.857938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.858432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.858868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.033479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:00.045470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:00.047522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:00.048905 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d206db9-f880-4e67-a8e8-e923ac7d8a18 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1604 microversion: 2.32 time: 0.231791 Aug 27 05:09:00.063879 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1683/3423] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:08:59 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1604 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:09:00.083955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-298f813c-e4d9-445b-87ac-2e6dde388584 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:00.120590 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-298f813c-e4d9-445b-87ac-2e6dde388584 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.430596 Aug 27 05:09:00.123333 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1741/3424] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:59 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:00.148092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-38a55e3f-e425-4590-889c-faafbbd28e91 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:00.148719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-38a55e3f-e425-4590-889c-faafbbd28e91 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:00.165288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38a55e3f-e425-4590-889c-faafbbd28e91 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.165829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38a55e3f-e425-4590-889c-faafbbd28e91 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.166286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38a55e3f-e425-4590-889c-faafbbd28e91 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.167027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38a55e3f-e425-4590-889c-faafbbd28e91 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.167552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38a55e3f-e425-4590-889c-faafbbd28e91 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.167956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38a55e3f-e425-4590-889c-faafbbd28e91 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.326846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-21d3a498-8843-451e-9f32-9653b448e8e5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:00.328189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-21d3a498-8843-451e-9f32-9653b448e8e5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:00.335808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21d3a498-8843-451e-9f32-9653b448e8e5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.336622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21d3a498-8843-451e-9f32-9653b448e8e5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.337582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21d3a498-8843-451e-9f32-9653b448e8e5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.338943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21d3a498-8843-451e-9f32-9653b448e8e5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.339872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21d3a498-8843-451e-9f32-9653b448e8e5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.340506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21d3a498-8843-451e-9f32-9653b448e8e5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.459727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-38a55e3f-e425-4590-889c-faafbbd28e91 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:00.470995 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-38a55e3f-e425-4590-889c-faafbbd28e91 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.325723 Aug 27 05:09:00.474514 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1684/3425] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:00 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:00.598841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-21d3a498-8843-451e-9f32-9653b448e8e5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:00.615075 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-21d3a498-8843-451e-9f32-9653b448e8e5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.290502 Aug 27 05:09:00.625267 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1742/3426] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:00 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:00.837763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1f012e85-780d-4ab5-9869-fc811dd9f46a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:00.838646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1f012e85-780d-4ab5-9869-fc811dd9f46a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:00.847751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f012e85-780d-4ab5-9869-fc811dd9f46a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.848506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f012e85-780d-4ab5-9869-fc811dd9f46a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.849074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f012e85-780d-4ab5-9869-fc811dd9f46a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.850120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f012e85-780d-4ab5-9869-fc811dd9f46a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.850789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f012e85-780d-4ab5-9869-fc811dd9f46a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.851382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f012e85-780d-4ab5-9869-fc811dd9f46a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.073594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:01.075472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:01.089044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:01.093335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:01.095317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.096174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:01.097664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:01.099626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.172537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1f012e85-780d-4ab5-9869-fc811dd9f46a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:01.191350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:01.191995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:01.192537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.193265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lazy-loading 'fault' on Instance uuid 9e17d99b-5a34-47d2-8845-751e9e3950c1 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:09:01.193926 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1f012e85-780d-4ab5-9869-fc811dd9f46a tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1316 microversion: 2.1 time: 0.363412 Aug 27 05:09:01.211326 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1685/3427] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:00 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:01.225085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-80227962-2014-489d-97d0-8b729e7d2a40 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:01.229337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80227962-2014-489d-97d0-8b729e7d2a40 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:01.238844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80227962-2014-489d-97d0-8b729e7d2a40 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:01.243184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80227962-2014-489d-97d0-8b729e7d2a40 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:01.245079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80227962-2014-489d-97d0-8b729e7d2a40 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.246030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80227962-2014-489d-97d0-8b729e7d2a40 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:01.247703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80227962-2014-489d-97d0-8b729e7d2a40 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:01.252318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80227962-2014-489d-97d0-8b729e7d2a40 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.277897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:01.289941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:01.292951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1d8d4c4b9f4d678029a02bc805e194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc337cfec67e4408bb9f110021b3f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:01.298524 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fae65719-427a-48da-8171-ac7029555187 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 200 len: 1609 microversion: 2.32 time: 0.229208 Aug 27 05:09:01.300117 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1743/3428] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:01 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 1609 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:09:01.501531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c23a2ed3-c65c-40de-9c36-ad3273e2e87f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:01.502147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c23a2ed3-c65c-40de-9c36-ad3273e2e87f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:01.521451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c23a2ed3-c65c-40de-9c36-ad3273e2e87f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:01.527764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c23a2ed3-c65c-40de-9c36-ad3273e2e87f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:01.530395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c23a2ed3-c65c-40de-9c36-ad3273e2e87f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.532352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c23a2ed3-c65c-40de-9c36-ad3273e2e87f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:01.533514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c23a2ed3-c65c-40de-9c36-ad3273e2e87f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:01.534572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c23a2ed3-c65c-40de-9c36-ad3273e2e87f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.823521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-80227962-2014-489d-97d0-8b729e7d2a40 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:01.838010 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-80227962-2014-489d-97d0-8b729e7d2a40 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.625194 Aug 27 05:09:01.844149 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1686/3429] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:01 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:01.858845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d3d50d78-ad29-41e8-901f-faa277b5bfd3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:01.862815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d3d50d78-ad29-41e8-901f-faa277b5bfd3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:01.887376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d50d78-ad29-41e8-901f-faa277b5bfd3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:01.887866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d50d78-ad29-41e8-901f-faa277b5bfd3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:01.897167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d50d78-ad29-41e8-901f-faa277b5bfd3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.897371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d50d78-ad29-41e8-901f-faa277b5bfd3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:01.902668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d50d78-ad29-41e8-901f-faa277b5bfd3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:01.903161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d50d78-ad29-41e8-901f-faa277b5bfd3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.944508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c23a2ed3-c65c-40de-9c36-ad3273e2e87f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:01.957624 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c23a2ed3-c65c-40de-9c36-ad3273e2e87f tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.460497 Aug 27 05:09:01.958676 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1744/3430] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:01 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:02.016180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:02.052524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:02.219442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3c9dd65c-37cc-4bf2-9f40-cd94a49e5fc6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:02.220131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3c9dd65c-37cc-4bf2-9f40-cd94a49e5fc6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:02.228549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d3d50d78-ad29-41e8-901f-faa277b5bfd3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:02.251461 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d3d50d78-ad29-41e8-901f-faa277b5bfd3 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.404896 Aug 27 05:09:02.252704 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1687/3431] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:01 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:02.256840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c9dd65c-37cc-4bf2-9f40-cd94a49e5fc6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.257393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c9dd65c-37cc-4bf2-9f40-cd94a49e5fc6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.257896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c9dd65c-37cc-4bf2-9f40-cd94a49e5fc6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.259473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c9dd65c-37cc-4bf2-9f40-cd94a49e5fc6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.260251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c9dd65c-37cc-4bf2-9f40-cd94a49e5fc6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.260960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c9dd65c-37cc-4bf2-9f40-cd94a49e5fc6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.332857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:02.333530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:02.352759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.353265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.355040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.356039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.356680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.358344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.389354 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] HTTP exception thrown: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Request method failure captured: Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 HTTP/1.1 Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaVZNnGndE_qTw-ejEiFfOCsTmxJfPi69TDyiQfRKymrICw-rgKwhbum0R35_x8103zMGMbwxNB40hEmBPi0fY79RZNg5K3qS-I_m-HkoSW0ZVpZ1UPrHMe1JK3zs8vhrB1N4rj5Azh-8YXKUNIYMUcp-lZXgEPcievA7cL9F3tKnVA Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: dc337cfec67e4408bb9f110021b3f6b3 Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TaggedBootDevicesTest-1139340944 Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc337cfec67e4408bb9f110021b3f6b3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc337cfec67e4408bb9f110021b3f6b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc337cfec67e4408bb9f110021b3f6b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc337cfec67e4408bb9f110021b3f6b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TaggedBootDevicesTest-1139340944 Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: dc337cfec67e4408bb9f110021b3f6b3 Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1139340944 Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TaggedBootDevicesTest-1139340944-project Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 8e1d8d4c4b9f4d678029a02bc805e194 Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TaggedBootDevicesTest-1139340944-project Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '9e17d99b-5a34-47d2-8845-751e9e3950c1'} Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:02.391666 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:02.395397 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:02.395397 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:02.395397 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:02.395397 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:02.395397 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:09:02.395397 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:09:02.395397 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:02.395397 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:02.402526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Returning 404 to user: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:09:02.408766 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eddb929d-4d59-462c-86bb-3108baaf8778 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 404 len: 111 microversion: 2.32 time: 0.079741 Aug 27 05:09:02.409703 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1688/3432] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:02 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 05:09:02.424518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-01d9dce3-8e2a-4b68-a1cd-bed5d0611f32 req-d0e0f1fc-7b7d-4fbb-bdc9-be617b335b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea", "tag": "856e3225-e60e-4434-b63d-6d6e70bf7364"}, {"name": "network-changed", "server_uuid": "a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d", "tag": "9dd5172f-f947-4780-922c-290a788cf6ca"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:02.442280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-01d9dce3-8e2a-4b68-a1cd-bed5d0611f32 req-d0e0f1fc-7b7d-4fbb-bdc9-be617b335b3a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.443068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-01d9dce3-8e2a-4b68-a1cd-bed5d0611f32 req-d0e0f1fc-7b7d-4fbb-bdc9-be617b335b3a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.444136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-01d9dce3-8e2a-4b68-a1cd-bed5d0611f32 req-d0e0f1fc-7b7d-4fbb-bdc9-be617b335b3a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.465614 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-01d9dce3-8e2a-4b68-a1cd-bed5d0611f32 req-d0e0f1fc-7b7d-4fbb-bdc9-be617b335b3a service nova] Creating event network-changed:856e3225-e60e-4434-b63d-6d6e70bf7364 for instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea on n-h2-820368-35 Aug 27 05:09:02.466772 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-01d9dce3-8e2a-4b68-a1cd-bed5d0611f32 req-d0e0f1fc-7b7d-4fbb-bdc9-be617b335b3a service nova] Creating event network-changed:9dd5172f-f947-4780-922c-290a788cf6ca for instance a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d on n-h2-820368-35 Aug 27 05:09:02.474692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-01d9dce3-8e2a-4b68-a1cd-bed5d0611f32 req-d0e0f1fc-7b7d-4fbb-bdc9-be617b335b3a service nova] Instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:09:02.502365 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-01d9dce3-8e2a-4b68-a1cd-bed5d0611f32 req-d0e0f1fc-7b7d-4fbb-bdc9-be617b335b3a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.082762 Aug 27 05:09:02.509576 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1689/3433] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:02.515847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0747d5c1-7a9a-4613-824d-41f7fd53ca89 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '.version_select at 0x7fb564904670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:02.553854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3c9dd65c-37cc-4bf2-9f40-cd94a49e5fc6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:02.566266 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3c9dd65c-37cc-4bf2-9f40-cd94a49e5fc6 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1505 microversion: 2.1 time: 0.352077 Aug 27 05:09:02.567469 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1745/3434] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:02 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:02.587455 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0747d5c1-7a9a-4613-824d-41f7fd53ca89 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530238290" status: 204 len: 0 microversion: 2.32 time: 0.076332 Aug 27 05:09:02.589681 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1690/3435] 10.222.0.58 () {60 vars in 1259 bytes} [Sat Aug 27 05:09:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530238290 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:09:02.593845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5b1c73f-9e95-46c9-8dd2-9382ff917130 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:02.601163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c5b1c73f-9e95-46c9-8dd2-9382ff917130 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:02.627675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b1c73f-9e95-46c9-8dd2-9382ff917130 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.628425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b1c73f-9e95-46c9-8dd2-9382ff917130 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.629013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b1c73f-9e95-46c9-8dd2-9382ff917130 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.629926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b1c73f-9e95-46c9-8dd2-9382ff917130 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.630532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b1c73f-9e95-46c9-8dd2-9382ff917130 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.631317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5b1c73f-9e95-46c9-8dd2-9382ff917130 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.689827 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5b1c73f-9e95-46c9-8dd2-9382ff917130 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0/ips" status: 200 len: 109 microversion: 2.1 time: 0.100694 Aug 27 05:09:02.710673 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1746/3436] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:09:02 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0/ips => generated 109 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:02.713638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-80ab3ee5-233c-476d-9795-49ed8a7ff21d tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:02.714649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80ab3ee5-233c-476d-9795-49ed8a7ff21d tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:02.738671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80ab3ee5-233c-476d-9795-49ed8a7ff21d tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.739249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80ab3ee5-233c-476d-9795-49ed8a7ff21d tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.739712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80ab3ee5-233c-476d-9795-49ed8a7ff21d tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.746984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80ab3ee5-233c-476d-9795-49ed8a7ff21d tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.748482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80ab3ee5-233c-476d-9795-49ed8a7ff21d tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.748934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80ab3ee5-233c-476d-9795-49ed8a7ff21d tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.785611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:02.804381 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-80ab3ee5-233c-476d-9795-49ed8a7ff21d tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0/ips" status: 200 len: 109 microversion: 2.1 time: 0.099594 Aug 27 05:09:02.813756 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1691/3437] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:09:02 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0/ips => generated 109 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:09:02.819881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bee25af2-3f31-4a05-9569-adc56f8b73f8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:02.821237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bee25af2-3f31-4a05-9569-adc56f8b73f8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:02.832990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:02.837738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee25af2-3f31-4a05-9569-adc56f8b73f8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.844416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee25af2-3f31-4a05-9569-adc56f8b73f8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.845094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee25af2-3f31-4a05-9569-adc56f8b73f8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.848744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee25af2-3f31-4a05-9569-adc56f8b73f8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.851193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee25af2-3f31-4a05-9569-adc56f8b73f8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.853081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bee25af2-3f31-4a05-9569-adc56f8b73f8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.867136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-feb92d6f-ef9a-432b-8dad-bdff7cc2be7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:02.867775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-feb92d6f-ef9a-432b-8dad-bdff7cc2be7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:02.874370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feb92d6f-ef9a-432b-8dad-bdff7cc2be7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.874913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feb92d6f-ef9a-432b-8dad-bdff7cc2be7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.879923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feb92d6f-ef9a-432b-8dad-bdff7cc2be7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.880747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feb92d6f-ef9a-432b-8dad-bdff7cc2be7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.881274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feb92d6f-ef9a-432b-8dad-bdff7cc2be7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.881750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-feb92d6f-ef9a-432b-8dad-bdff7cc2be7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.923475 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bee25af2-3f31-4a05-9569-adc56f8b73f8 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0/ips/tempest-ServerAddressesTestJSON-468232733-network" status: 200 len: 94 microversion: 2.1 time: 0.107460 Aug 27 05:09:02.934849 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1747/3438] 10.222.0.58 () {58 vars in 1398 bytes} [Sat Aug 27 05:09:02 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0/ips/tempest-ServerAddressesTestJSON-468232733-network => generated 94 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:09:02.954582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cd9502a1-991b-4014-8b37-f956ba22db73 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:02.955380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cd9502a1-991b-4014-8b37-f956ba22db73 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:02.962953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd9502a1-991b-4014-8b37-f956ba22db73 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.963828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd9502a1-991b-4014-8b37-f956ba22db73 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.964613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd9502a1-991b-4014-8b37-f956ba22db73 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.965565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd9502a1-991b-4014-8b37-f956ba22db73 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.966305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd9502a1-991b-4014-8b37-f956ba22db73 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.967229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd9502a1-991b-4014-8b37-f956ba22db73 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:03.017293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cd9502a1-991b-4014-8b37-f956ba22db73 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:09:03.020386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:03.161743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-feb92d6f-ef9a-432b-8dad-bdff7cc2be7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:03.170607 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-feb92d6f-ef9a-432b-8dad-bdff7cc2be7f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.307712 Aug 27 05:09:03.188136 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1692/3439] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:02 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:03.201657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9436ee1b-0cf6-47d5-8b34-fba0e454eb42 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:03.202281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9436ee1b-0cf6-47d5-8b34-fba0e454eb42 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:03.203533 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cd9502a1-991b-4014-8b37-f956ba22db73 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 204 len: 0 microversion: 2.1 time: 0.264906 Aug 27 05:09:03.210083 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1748/3440] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:09:02 2022] DELETE /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:09:03.222763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9436ee1b-0cf6-47d5-8b34-fba0e454eb42 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:03.223362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9436ee1b-0cf6-47d5-8b34-fba0e454eb42 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:03.223821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9436ee1b-0cf6-47d5-8b34-fba0e454eb42 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:03.224597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9436ee1b-0cf6-47d5-8b34-fba0e454eb42 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:03.225030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9436ee1b-0cf6-47d5-8b34-fba0e454eb42 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:03.229012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9436ee1b-0cf6-47d5-8b34-fba0e454eb42 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:03.229637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8c95972b-c0cd-4742-93d8-af46c0aeba54 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:03.231407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8c95972b-c0cd-4742-93d8-af46c0aeba54 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:03.262229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c95972b-c0cd-4742-93d8-af46c0aeba54 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:03.262793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c95972b-c0cd-4742-93d8-af46c0aeba54 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:03.263266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c95972b-c0cd-4742-93d8-af46c0aeba54 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:03.264027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c95972b-c0cd-4742-93d8-af46c0aeba54 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:03.278725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c95972b-c0cd-4742-93d8-af46c0aeba54 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:03.280494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c95972b-c0cd-4742-93d8-af46c0aeba54 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:03.672639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9436ee1b-0cf6-47d5-8b34-fba0e454eb42 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:03.687955 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9436ee1b-0cf6-47d5-8b34-fba0e454eb42 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.497960 Aug 27 05:09:03.688764 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1693/3441] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:03 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:03.700119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c778229-2973-4bfc-a762-4028fd3eac63 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:03.700985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c778229-2973-4bfc-a762-4028fd3eac63 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:03.716908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c778229-2973-4bfc-a762-4028fd3eac63 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:03.720791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c778229-2973-4bfc-a762-4028fd3eac63 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:03.721436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c778229-2973-4bfc-a762-4028fd3eac63 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:03.722346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c778229-2973-4bfc-a762-4028fd3eac63 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:03.730589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c778229-2973-4bfc-a762-4028fd3eac63 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:03.731188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c778229-2973-4bfc-a762-4028fd3eac63 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:04.252352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8c95972b-c0cd-4742-93d8-af46c0aeba54 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:04.268941 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8c95972b-c0cd-4742-93d8-af46c0aeba54 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1511 microversion: 2.1 time: 1.055919 Aug 27 05:09:04.269837 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1749/3442] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:03 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1511 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:04.274908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f964706-fd04-4ff0-91af-4d7f53ed5afc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:04.279686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f964706-fd04-4ff0-91af-4d7f53ed5afc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:04.307663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f964706-fd04-4ff0-91af-4d7f53ed5afc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:04.308420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f964706-fd04-4ff0-91af-4d7f53ed5afc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:04.308999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f964706-fd04-4ff0-91af-4d7f53ed5afc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:04.309878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f964706-fd04-4ff0-91af-4d7f53ed5afc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:04.310479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f964706-fd04-4ff0-91af-4d7f53ed5afc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:04.311065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f964706-fd04-4ff0-91af-4d7f53ed5afc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:04.488097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c778229-2973-4bfc-a762-4028fd3eac63 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:04.497015 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c778229-2973-4bfc-a762-4028fd3eac63 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.806937 Aug 27 05:09:04.497801 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1694/3443] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:03 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:04.710629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-00190b19-5c9d-4299-a36d-5eeb849e2767 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:04.714877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-00190b19-5c9d-4299-a36d-5eeb849e2767 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:04.724271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f964706-fd04-4ff0-91af-4d7f53ed5afc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:04.735061 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f964706-fd04-4ff0-91af-4d7f53ed5afc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.463727 Aug 27 05:09:04.738913 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1750/3444] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:04 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:04.742622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00190b19-5c9d-4299-a36d-5eeb849e2767 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:04.744007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00190b19-5c9d-4299-a36d-5eeb849e2767 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:04.744734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00190b19-5c9d-4299-a36d-5eeb849e2767 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:04.745656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00190b19-5c9d-4299-a36d-5eeb849e2767 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:04.746710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00190b19-5c9d-4299-a36d-5eeb849e2767 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:04.747324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00190b19-5c9d-4299-a36d-5eeb849e2767 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:05.194704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-00190b19-5c9d-4299-a36d-5eeb849e2767 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:05.204803 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-00190b19-5c9d-4299-a36d-5eeb849e2767 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.498983 Aug 27 05:09:05.207399 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1695/3445] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:04 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:05.293685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-062b3ab8-d4b4-4b96-a398-5f7fe6d6cd52 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:05.295302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-062b3ab8-d4b4-4b96-a398-5f7fe6d6cd52 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:05.344060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062b3ab8-d4b4-4b96-a398-5f7fe6d6cd52 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:05.345403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062b3ab8-d4b4-4b96-a398-5f7fe6d6cd52 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:05.346398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062b3ab8-d4b4-4b96-a398-5f7fe6d6cd52 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:05.347739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062b3ab8-d4b4-4b96-a398-5f7fe6d6cd52 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:05.349139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062b3ab8-d4b4-4b96-a398-5f7fe6d6cd52 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:05.349814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062b3ab8-d4b4-4b96-a398-5f7fe6d6cd52 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:05.565481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-31d10b89-b34f-48f3-a670-1e2a84fc7d79 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Action: 'create', calling method: .version_select at 0x7fb56486a1f0>, body: {"keypair": {"name": "tempest-keypair-903576486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuDoXa4iG8/XEnH6djDvXHN1+i42sLLJhh1ss52BL7qmpS5KxtyqiOhDa+hL6ZMwXRvPRL9tdqwpLFPWSKXuHIYTHy/yq918ZdDUsrOU6Y+eObyqXnhNedLflIB8+cujA=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:05.598079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-31d10b89-b34f-48f3-a670-1e2a84fc7d79 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Getting quotas for project 5455e1b4fef14be99a76abf1e759219a. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:09:05.612544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-31d10b89-b34f-48f3-a670-1e2a84fc7d79 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Getting quotas for user 03ac7725d5424eddb2e1b79e2cac2fe4 and project 5455e1b4fef14be99a76abf1e759219a. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:09:05.660940 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-31d10b89-b34f-48f3-a670-1e2a84fc7d79 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.358005 Aug 27 05:09:05.667117 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1696/3446] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:09:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:05.672386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e08aa996-fbde-46d5-9417-799ec7ecf93e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:05.672386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e08aa996-fbde-46d5-9417-799ec7ecf93e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:05.684176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e08aa996-fbde-46d5-9417-799ec7ecf93e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:05.684676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e08aa996-fbde-46d5-9417-799ec7ecf93e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:05.685129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e08aa996-fbde-46d5-9417-799ec7ecf93e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:05.685835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e08aa996-fbde-46d5-9417-799ec7ecf93e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:05.686296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e08aa996-fbde-46d5-9417-799ec7ecf93e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:05.686727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e08aa996-fbde-46d5-9417-799ec7ecf93e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:05.981688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-062b3ab8-d4b4-4b96-a398-5f7fe6d6cd52 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:05.996121 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-062b3ab8-d4b4-4b96-a398-5f7fe6d6cd52 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1511 microversion: 2.1 time: 0.707755 Aug 27 05:09:06.005836 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1751/3447] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:05 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1511 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:06.036103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d532b72-8011-43a0-9aba-f586ccfe8a5e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:06.039358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d532b72-8011-43a0-9aba-f586ccfe8a5e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:06.064220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d532b72-8011-43a0-9aba-f586ccfe8a5e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:06.071938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d532b72-8011-43a0-9aba-f586ccfe8a5e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:06.077659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d532b72-8011-43a0-9aba-f586ccfe8a5e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:06.082240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d532b72-8011-43a0-9aba-f586ccfe8a5e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:06.084712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d532b72-8011-43a0-9aba-f586ccfe8a5e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:06.086347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d532b72-8011-43a0-9aba-f586ccfe8a5e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:06.175587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e08aa996-fbde-46d5-9417-799ec7ecf93e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:06.191655 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e08aa996-fbde-46d5-9417-799ec7ecf93e tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.527335 Aug 27 05:09:06.197831 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1697/3448] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:05 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:06.207043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-a6e85eb9-de9d-4090-8546-aea6424cb61b req-34045981-7cd6-40ec-b039-69bfe86054e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db19a38-d04d-405d-8ba3-3dbe475125d0", "name": "network-vif-deleted", "tag": "c877212f-784b-451e-bc81-690eed2f366f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:06.233066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a6e85eb9-de9d-4090-8546-aea6424cb61b req-34045981-7cd6-40ec-b039-69bfe86054e4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:06.233854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a6e85eb9-de9d-4090-8546-aea6424cb61b req-34045981-7cd6-40ec-b039-69bfe86054e4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:06.234540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a6e85eb9-de9d-4090-8546-aea6424cb61b req-34045981-7cd6-40ec-b039-69bfe86054e4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:06.270252 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-a6e85eb9-de9d-4090-8546-aea6424cb61b req-34045981-7cd6-40ec-b039-69bfe86054e4 service nova] Creating event network-vif-deleted:c877212f-784b-451e-bc81-690eed2f366f for instance 6db19a38-d04d-405d-8ba3-3dbe475125d0 on n-h1-820368-35 Aug 27 05:09:06.287238 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-a6e85eb9-de9d-4090-8546-aea6424cb61b req-34045981-7cd6-40ec-b039-69bfe86054e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083531 Aug 27 05:09:06.289280 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1698/3449] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:06.301248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2bf3e5b1-c2fd-4de8-809b-5e2f107735f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:06.307017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2bf3e5b1-c2fd-4de8-809b-5e2f107735f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:06.336323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bf3e5b1-c2fd-4de8-809b-5e2f107735f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:06.340146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bf3e5b1-c2fd-4de8-809b-5e2f107735f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:06.341064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bf3e5b1-c2fd-4de8-809b-5e2f107735f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:06.344646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bf3e5b1-c2fd-4de8-809b-5e2f107735f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:06.347231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bf3e5b1-c2fd-4de8-809b-5e2f107735f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:06.348346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2bf3e5b1-c2fd-4de8-809b-5e2f107735f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:06.620646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d532b72-8011-43a0-9aba-f586ccfe8a5e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:06.644216 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d532b72-8011-43a0-9aba-f586ccfe8a5e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.634963 Aug 27 05:09:06.659116 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1752/3450] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:06 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:06.835678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2bf3e5b1-c2fd-4de8-809b-5e2f107735f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:06.843745 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2bf3e5b1-c2fd-4de8-809b-5e2f107735f7 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.553002 Aug 27 05:09:06.844330 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1699/3451] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:06 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:07.025281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:07.025988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:07.037278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:07.039196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:07.039790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:07.054448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:07.057193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:07.058591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:07.153242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:07.155853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:07.156692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:07.157395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lazy-loading 'fault' on Instance uuid 6db19a38-d04d-405d-8ba3-3dbe475125d0 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:09:07.289118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a0d930551847a994b8f09600a59efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f601b382cfe849f4808002079a81cd5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:07.299725 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c42780bd-8313-4355-a22d-70e550d2d1a5 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 200 len: 1306 microversion: 2.1 time: 0.280252 Aug 27 05:09:07.300921 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1753/3452] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:07 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 1306 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:07.582360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d1c730c-628b-4e15-8f17-fe093ad01549 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:07.583254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7d1c730c-628b-4e15-8f17-fe093ad01549 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:07.600130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d1c730c-628b-4e15-8f17-fe093ad01549 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:07.602348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d1c730c-628b-4e15-8f17-fe093ad01549 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:07.603056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d1c730c-628b-4e15-8f17-fe093ad01549 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:07.606210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d1c730c-628b-4e15-8f17-fe093ad01549 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:07.606897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d1c730c-628b-4e15-8f17-fe093ad01549 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:07.609904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d1c730c-628b-4e15-8f17-fe093ad01549 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:07.673232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-abbcd7f8-0e24-4a73-b352-93e5e6c12677 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:07.673862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-abbcd7f8-0e24-4a73-b352-93e5e6c12677 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:07.701451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abbcd7f8-0e24-4a73-b352-93e5e6c12677 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:07.705249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abbcd7f8-0e24-4a73-b352-93e5e6c12677 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:07.708937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abbcd7f8-0e24-4a73-b352-93e5e6c12677 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:07.713100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abbcd7f8-0e24-4a73-b352-93e5e6c12677 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:07.716942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abbcd7f8-0e24-4a73-b352-93e5e6c12677 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:07.720518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-abbcd7f8-0e24-4a73-b352-93e5e6c12677 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:08.135228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7d1c730c-628b-4e15-8f17-fe093ad01549 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:08.156287 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7d1c730c-628b-4e15-8f17-fe093ad01549 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.933112 Aug 27 05:09:08.158455 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1700/3453] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:07 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:08.207315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-92d91676-6110-44f4-87a0-e64292e2b687 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:08.208480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-92d91676-6110-44f4-87a0-e64292e2b687 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:08.224275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92d91676-6110-44f4-87a0-e64292e2b687 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:08.225781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92d91676-6110-44f4-87a0-e64292e2b687 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:08.226477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92d91676-6110-44f4-87a0-e64292e2b687 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:08.239233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92d91676-6110-44f4-87a0-e64292e2b687 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:08.240038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92d91676-6110-44f4-87a0-e64292e2b687 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:08.240646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92d91676-6110-44f4-87a0-e64292e2b687 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:08.637942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-abbcd7f8-0e24-4a73-b352-93e5e6c12677 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:08.646888 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-abbcd7f8-0e24-4a73-b352-93e5e6c12677 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.978610 Aug 27 05:09:08.661629 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1754/3454] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:07 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:08.666801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:08.667779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] [instance: 6db19a38-d04d-405d-8ba3-3dbe475125d0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:08.674741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:08.681428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:08.682180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:08.682786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:08.683868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:08.684470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:08.685039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:08.709149 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] HTTP exception thrown: Instance 6db19a38-d04d-405d-8ba3-3dbe475125d0 could not be found. Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Request method failure captured: Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 HTTP/1.1 Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCabPlBQVNEEQjiEdiAMiiplM05DDNUTCMvjgZ978lfwaGJfjS6fR9Ymzz_C_M4fBklJY7T12pMvDLEY_rOsvpW-DHXv9g66oMeMQjBAwn59EIxYLDZ8hUq9rfzwxipPTykoP3Ds8cH0tly_E0D6SkGvCD9MiEyYVQQAXs4L9NcA2Qy4 Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: f601b382cfe849f4808002079a81cd5d Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerAddressesTestJSON-1284095793 Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f601b382cfe849f4808002079a81cd5d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f601b382cfe849f4808002079a81cd5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f601b382cfe849f4808002079a81cd5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f601b382cfe849f4808002079a81cd5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerAddressesTestJSON-1284095793 Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: f601b382cfe849f4808002079a81cd5d Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1284095793 Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerAddressesTestJSON-1284095793-project Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 49a0d930551847a994b8f09600a59efd Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerAddressesTestJSON-1284095793-project Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 6db19a38-d04d-405d-8ba3-3dbe475125d0 could not be found. Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '6db19a38-d04d-405d-8ba3-3dbe475125d0'} Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db19a38-d04d-405d-8ba3-3dbe475125d0 could not be found. Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db19a38-d04d-405d-8ba3-3dbe475125d0 could not be found. Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:08.711723 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:08.715330 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:08.715330 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:08.715330 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:08.715330 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:09:08.715330 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:09:08.715330 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db19a38-d04d-405d-8ba3-3dbe475125d0 could not be found. Aug 27 05:09:08.715330 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:08.716527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] Returning 404 to user: Instance 6db19a38-d04d-405d-8ba3-3dbe475125d0 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:09:08.717613 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8c22f9a-f4ca-4318-80a0-2ea6db77f2f3 tempest-ServerAddressesTestJSON-1284095793 tempest-ServerAddressesTestJSON-1284095793-project] 10.222.0.58 "GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0" status: 404 len: 111 microversion: 2.1 time: 0.054782 Aug 27 05:09:08.719323 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1755/3455] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:08 2022] GET /compute/v2.1/servers/6db19a38-d04d-405d-8ba3-3dbe475125d0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:09:08.918485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-92d91676-6110-44f4-87a0-e64292e2b687 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:08.928538 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-92d91676-6110-44f4-87a0-e64292e2b687 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.768593 Aug 27 05:09:08.949166 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1701/3456] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:08 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:09.189268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c7ab44b4-5123-45e8-b7f4-2f49a4f96f1f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:09.204487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c7ab44b4-5123-45e8-b7f4-2f49a4f96f1f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:09.245073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ab44b4-5123-45e8-b7f4-2f49a4f96f1f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:09.246144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ab44b4-5123-45e8-b7f4-2f49a4f96f1f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:09.246957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ab44b4-5123-45e8-b7f4-2f49a4f96f1f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:09.248324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ab44b4-5123-45e8-b7f4-2f49a4f96f1f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:09.249159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ab44b4-5123-45e8-b7f4-2f49a4f96f1f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:09.267680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ab44b4-5123-45e8-b7f4-2f49a4f96f1f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:09.669667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c4475848-d058-4b04-88e0-243c90ff328a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:09.670297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c4475848-d058-4b04-88e0-243c90ff328a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:09.687888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4475848-d058-4b04-88e0-243c90ff328a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:09.688392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4475848-d058-4b04-88e0-243c90ff328a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:09.688834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4475848-d058-4b04-88e0-243c90ff328a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:09.689560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4475848-d058-4b04-88e0-243c90ff328a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:09.690019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4475848-d058-4b04-88e0-243c90ff328a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:09.690450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4475848-d058-4b04-88e0-243c90ff328a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:09.893048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c7ab44b4-5123-45e8-b7f4-2f49a4f96f1f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:09.916776 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c7ab44b4-5123-45e8-b7f4-2f49a4f96f1f tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.736247 Aug 27 05:09:09.922281 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1756/3457] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:09 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:09.970072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b1164060-eb7d-4116-a8d9-36982340166b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:09.972206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b1164060-eb7d-4116-a8d9-36982340166b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:09.985209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1164060-eb7d-4116-a8d9-36982340166b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:09.994363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1164060-eb7d-4116-a8d9-36982340166b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:09.996680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1164060-eb7d-4116-a8d9-36982340166b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:09.998161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1164060-eb7d-4116-a8d9-36982340166b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:09.998800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1164060-eb7d-4116-a8d9-36982340166b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:09.999410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1164060-eb7d-4116-a8d9-36982340166b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:10.225873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4475848-d058-4b04-88e0-243c90ff328a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:10.247376 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c4475848-d058-4b04-88e0-243c90ff328a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.583343 Aug 27 05:09:10.259198 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1702/3458] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:09 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:10.460675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b1164060-eb7d-4116-a8d9-36982340166b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:10.485027 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b1164060-eb7d-4116-a8d9-36982340166b tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.527755 Aug 27 05:09:10.491102 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1757/3459] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:09 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:10.787733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b64cb7e3-0dea-4424-bfcb-725bd6bbb29a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:10.788940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b64cb7e3-0dea-4424-bfcb-725bd6bbb29a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:10.815347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b64cb7e3-0dea-4424-bfcb-725bd6bbb29a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:10.816234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b64cb7e3-0dea-4424-bfcb-725bd6bbb29a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:10.819477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b64cb7e3-0dea-4424-bfcb-725bd6bbb29a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:10.827968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b64cb7e3-0dea-4424-bfcb-725bd6bbb29a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:10.828477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b64cb7e3-0dea-4424-bfcb-725bd6bbb29a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:10.828929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b64cb7e3-0dea-4424-bfcb-725bd6bbb29a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:10.919227 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b64cb7e3-0dea-4424-bfcb-725bd6bbb29a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/ips" status: 200 len: 152 microversion: 2.20 time: 0.143800 Aug 27 05:09:10.944055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1e164564-b185-4e88-98a1-83145f80709b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:10.946293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1e164564-b185-4e88-98a1-83145f80709b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:10.959193 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1703/3460] 10.222.0.58 () {60 vars in 1289 bytes} [Sat Aug 27 05:09:10 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/ips => generated 152 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:09:10.967850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e164564-b185-4e88-98a1-83145f80709b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:10.969010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e164564-b185-4e88-98a1-83145f80709b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:10.974174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e164564-b185-4e88-98a1-83145f80709b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:10.979347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e164564-b185-4e88-98a1-83145f80709b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:10.980100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e164564-b185-4e88-98a1-83145f80709b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:10.985351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e164564-b185-4e88-98a1-83145f80709b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:11.271906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aa4b9211-c624-4b52-8b94-49460ab0f2d6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:11.274063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aa4b9211-c624-4b52-8b94-49460ab0f2d6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:11.296470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa4b9211-c624-4b52-8b94-49460ab0f2d6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:11.297944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa4b9211-c624-4b52-8b94-49460ab0f2d6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:11.302253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa4b9211-c624-4b52-8b94-49460ab0f2d6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:11.303469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa4b9211-c624-4b52-8b94-49460ab0f2d6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:11.307139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa4b9211-c624-4b52-8b94-49460ab0f2d6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:11.309320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa4b9211-c624-4b52-8b94-49460ab0f2d6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:11.627631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1e164564-b185-4e88-98a1-83145f80709b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:11.642717 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1e164564-b185-4e88-98a1-83145f80709b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1468 microversion: 2.1 time: 0.704093 Aug 27 05:09:11.646587 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1758/3461] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:10 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1468 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:11.666103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-87f2c4ae-785f-4b43-b0d7-594858aa3a23 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:11.668376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-87f2c4ae-785f-4b43-b0d7-594858aa3a23 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:11.714702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f2c4ae-785f-4b43-b0d7-594858aa3a23 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:11.717436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f2c4ae-785f-4b43-b0d7-594858aa3a23 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:11.724212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f2c4ae-785f-4b43-b0d7-594858aa3a23 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:11.725256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f2c4ae-785f-4b43-b0d7-594858aa3a23 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:11.730086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f2c4ae-785f-4b43-b0d7-594858aa3a23 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:11.732205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f2c4ae-785f-4b43-b0d7-594858aa3a23 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:11.925206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aa4b9211-c624-4b52-8b94-49460ab0f2d6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:11.940616 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aa4b9211-c624-4b52-8b94-49460ab0f2d6 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.672672 Aug 27 05:09:11.957167 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1704/3462] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:11 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:12.246377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-87f2c4ae-785f-4b43-b0d7-594858aa3a23 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:12.256608 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-87f2c4ae-785f-4b43-b0d7-594858aa3a23 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.603803 Aug 27 05:09:12.276570 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1759/3463] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:11 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:12.663377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0c1346fe-0429-4fb9-9b58-8feb3127af92 req-9e8c4a53-98db-4a8a-a84e-05795259ba04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d", "name": "network-vif-plugged", "status": "completed", "tag": "9dd5172f-f947-4780-922c-290a788cf6ca"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:12.675737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10c09dc9-ffee-4965-b63c-76edbb2211fe tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:12.676862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-10c09dc9-ffee-4965-b63c-76edbb2211fe tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:12.694669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c09dc9-ffee-4965-b63c-76edbb2211fe tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:12.697903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c09dc9-ffee-4965-b63c-76edbb2211fe tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:12.701643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c09dc9-ffee-4965-b63c-76edbb2211fe tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:12.705710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c09dc9-ffee-4965-b63c-76edbb2211fe tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:12.706657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c09dc9-ffee-4965-b63c-76edbb2211fe tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:12.708328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10c09dc9-ffee-4965-b63c-76edbb2211fe tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:12.709336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c1346fe-0429-4fb9-9b58-8feb3127af92 req-9e8c4a53-98db-4a8a-a84e-05795259ba04 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:12.716501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c1346fe-0429-4fb9-9b58-8feb3127af92 req-9e8c4a53-98db-4a8a-a84e-05795259ba04 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:12.717283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c1346fe-0429-4fb9-9b58-8feb3127af92 req-9e8c4a53-98db-4a8a-a84e-05795259ba04 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:12.777333 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0c1346fe-0429-4fb9-9b58-8feb3127af92 req-9e8c4a53-98db-4a8a-a84e-05795259ba04 service nova] Creating event network-vif-plugged:9dd5172f-f947-4780-922c-290a788cf6ca for instance a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d on n-h2-820368-35 Aug 27 05:09:12.807587 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0c1346fe-0429-4fb9-9b58-8feb3127af92 req-9e8c4a53-98db-4a8a-a84e-05795259ba04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140835 Aug 27 05:09:12.811544 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1705/3464] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:12.969419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db91582c-495c-4e55-9fac-939416f136f4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:12.971065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-db91582c-495c-4e55-9fac-939416f136f4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:12.988414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db91582c-495c-4e55-9fac-939416f136f4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:12.997535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db91582c-495c-4e55-9fac-939416f136f4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:12.998238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db91582c-495c-4e55-9fac-939416f136f4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:13.000445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db91582c-495c-4e55-9fac-939416f136f4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:13.004815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db91582c-495c-4e55-9fac-939416f136f4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:13.009602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db91582c-495c-4e55-9fac-939416f136f4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:13.380296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10c09dc9-ffee-4965-b63c-76edbb2211fe tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:13.396690 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10c09dc9-ffee-4965-b63c-76edbb2211fe tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1461 microversion: 2.1 time: 0.723777 Aug 27 05:09:13.399803 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1760/3465] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:12 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1461 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:13.413860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a4554e3-4c37-4883-b2ae-f37dc7254962 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:13.422013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7a4554e3-4c37-4883-b2ae-f37dc7254962 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:13.469657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4554e3-4c37-4883-b2ae-f37dc7254962 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:13.470236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4554e3-4c37-4883-b2ae-f37dc7254962 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:13.476927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4554e3-4c37-4883-b2ae-f37dc7254962 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:13.481385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4554e3-4c37-4883-b2ae-f37dc7254962 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:13.481992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4554e3-4c37-4883-b2ae-f37dc7254962 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:13.487063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4554e3-4c37-4883-b2ae-f37dc7254962 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:13.539481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-db91582c-495c-4e55-9fac-939416f136f4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:13.550288 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db91582c-495c-4e55-9fac-939416f136f4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.586448 Aug 27 05:09:13.554866 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1706/3466] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:12 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:13.562658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:13.564479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:13.600349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:13.600878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:13.601336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:13.602092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:13.602533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:13.604139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:13.647926 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] HTTP exception thrown: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Request method failure captured: Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 HTTP/1.1 Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaVZNnGndE_qTw-ejEiFfOCsTmxJfPi69TDyiQfRKymrICw-rgKwhbum0R35_x8103zMGMbwxNB40hEmBPi0fY79RZNg5K3qS-I_m-HkoSW0ZVpZ1UPrHMe1JK3zs8vhrB1N4rj5Azh-8YXKUNIYMUcp-lZXgEPcievA7cL9F3tKnVA Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: dc337cfec67e4408bb9f110021b3f6b3 Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TaggedBootDevicesTest-1139340944 Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc337cfec67e4408bb9f110021b3f6b3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc337cfec67e4408bb9f110021b3f6b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc337cfec67e4408bb9f110021b3f6b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc337cfec67e4408bb9f110021b3f6b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TaggedBootDevicesTest-1139340944 Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: dc337cfec67e4408bb9f110021b3f6b3 Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1139340944 Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TaggedBootDevicesTest-1139340944-project Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 8e1d8d4c4b9f4d678029a02bc805e194 Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TaggedBootDevicesTest-1139340944-project Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '9e17d99b-5a34-47d2-8845-751e9e3950c1'} Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:09:13.650136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Returning 404 to user: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:09:13.653235 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-be0ab1bd-4a81-4a4c-911b-4fb957c714d4 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 404 len: 111 microversion: 2.32 time: 0.095553 Aug 27 05:09:13.658368 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1707/3467] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:09:13 2022] DELETE /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:09:13.684653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b30bbc94-dc67-4728-a893-33f13db909c5 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:13.685300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b30bbc94-dc67-4728-a893-33f13db909c5 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:13.702899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b30bbc94-dc67-4728-a893-33f13db909c5 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:13.707703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b30bbc94-dc67-4728-a893-33f13db909c5 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:13.714531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b30bbc94-dc67-4728-a893-33f13db909c5 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:13.715620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b30bbc94-dc67-4728-a893-33f13db909c5 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:13.719859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b30bbc94-dc67-4728-a893-33f13db909c5 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:13.720610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b30bbc94-dc67-4728-a893-33f13db909c5 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:13.967033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7a4554e3-4c37-4883-b2ae-f37dc7254962 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:13.985031 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a4554e3-4c37-4883-b2ae-f37dc7254962 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.583249 Aug 27 05:09:13.999453 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1761/3468] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:13 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:13.999453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:13.999453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] [instance: 9e17d99b-5a34-47d2-8845-751e9e3950c1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:14.028207 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b30bbc94-dc67-4728-a893-33f13db909c5 tempest-MigrationsAdminTest-328741462 tempest-MigrationsAdminTest-328741462-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1614 microversion: 2.1 time: 0.367985 Aug 27 05:09:14.042250 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1708/3469] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:13 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1614 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:14.042438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:14.042438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:14.042438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:14.042438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:14.042438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:14.042438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:14.068036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fbc7c44f-33c4-4dbc-b781-9e94b378b818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:14.068842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fbc7c44f-33c4-4dbc-b781-9e94b378b818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:14.080965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:14.082284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbc7c44f-33c4-4dbc-b781-9e94b378b818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:14.085549 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] HTTP exception thrown: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:14.086899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbc7c44f-33c4-4dbc-b781-9e94b378b818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:14.087845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbc7c44f-33c4-4dbc-b781-9e94b378b818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:14.088645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbc7c44f-33c4-4dbc-b781-9e94b378b818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Request method failure captured: Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 HTTP/1.1 Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaVZNnGndE_qTw-ejEiFfOCsTmxJfPi69TDyiQfRKymrICw-rgKwhbum0R35_x8103zMGMbwxNB40hEmBPi0fY79RZNg5K3qS-I_m-HkoSW0ZVpZ1UPrHMe1JK3zs8vhrB1N4rj5Azh-8YXKUNIYMUcp-lZXgEPcievA7cL9F3tKnVA Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: dc337cfec67e4408bb9f110021b3f6b3 Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TaggedBootDevicesTest-1139340944 Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc337cfec67e4408bb9f110021b3f6b3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc337cfec67e4408bb9f110021b3f6b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc337cfec67e4408bb9f110021b3f6b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc337cfec67e4408bb9f110021b3f6b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TaggedBootDevicesTest-1139340944 Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: dc337cfec67e4408bb9f110021b3f6b3 Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1139340944 Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TaggedBootDevicesTest-1139340944-project Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 8e1d8d4c4b9f4d678029a02bc805e194 Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TaggedBootDevicesTest-1139340944-project Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '9e17d99b-5a34-47d2-8845-751e9e3950c1'} Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:14.089707 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:14.092788 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:14.092788 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:14.092788 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:14.092788 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:14.092788 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:09:14.092788 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:09:14.092788 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. Aug 27 05:09:14.092788 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:14.092788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] Returning 404 to user: Instance 9e17d99b-5a34-47d2-8845-751e9e3950c1 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:09:14.092788 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-35306786-618a-4eb3-afdc-6783ece603d9 tempest-TaggedBootDevicesTest-1139340944 tempest-TaggedBootDevicesTest-1139340944-project] 10.222.0.58 "GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1" status: 404 len: 111 microversion: 2.32 time: 0.102186 Aug 27 05:09:14.094905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbc7c44f-33c4-4dbc-b781-9e94b378b818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:14.094905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbc7c44f-33c4-4dbc-b781-9e94b378b818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:14.098916 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1762/3470] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:13 2022] GET /compute/v2.1/servers/9e17d99b-5a34-47d2-8845-751e9e3950c1 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:09:14.135961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fbc7c44f-33c4-4dbc-b781-9e94b378b818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:09:14.341948 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fbc7c44f-33c4-4dbc-b781-9e94b378b818 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 204 len: 0 microversion: 2.1 time: 0.282760 Aug 27 05:09:14.342457 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1709/3471] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:09:14 2022] DELETE /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:09:14.352340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-172b9931-ca87-45be-b831-e54cc94b0574 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:14.353502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-172b9931-ca87-45be-b831-e54cc94b0574 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:14.370361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172b9931-ca87-45be-b831-e54cc94b0574 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:14.372414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172b9931-ca87-45be-b831-e54cc94b0574 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:14.373782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172b9931-ca87-45be-b831-e54cc94b0574 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:14.376809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172b9931-ca87-45be-b831-e54cc94b0574 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:14.377650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172b9931-ca87-45be-b831-e54cc94b0574 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:14.378459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172b9931-ca87-45be-b831-e54cc94b0574 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:14.575900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c42f1d10-beb0-4e7d-86f5-2a4cfdd48497 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:14.576557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c42f1d10-beb0-4e7d-86f5-2a4cfdd48497 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:14.607307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c42f1d10-beb0-4e7d-86f5-2a4cfdd48497 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:14.607891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c42f1d10-beb0-4e7d-86f5-2a4cfdd48497 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:14.619042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c42f1d10-beb0-4e7d-86f5-2a4cfdd48497 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:14.620028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c42f1d10-beb0-4e7d-86f5-2a4cfdd48497 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:14.620532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c42f1d10-beb0-4e7d-86f5-2a4cfdd48497 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:14.621000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c42f1d10-beb0-4e7d-86f5-2a4cfdd48497 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:14.634393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:14.795114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-172b9931-ca87-45be-b831-e54cc94b0574 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:14.819950 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-172b9931-ca87-45be-b831-e54cc94b0574 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1467 microversion: 2.1 time: 0.472097 Aug 27 05:09:14.825585 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1763/3472] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:14 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1467 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:14.955904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-96463e0d-9bfa-44aa-8c27-b7fe528891cf req-a0c8bfde-1c5a-4eec-a056-e53f130748c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea", "name": "network-vif-plugged", "status": "completed", "tag": "856e3225-e60e-4434-b63d-6d6e70bf7364"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:14.978705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-96463e0d-9bfa-44aa-8c27-b7fe528891cf req-a0c8bfde-1c5a-4eec-a056-e53f130748c6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:14.979231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-96463e0d-9bfa-44aa-8c27-b7fe528891cf req-a0c8bfde-1c5a-4eec-a056-e53f130748c6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:14.979675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-96463e0d-9bfa-44aa-8c27-b7fe528891cf req-a0c8bfde-1c5a-4eec-a056-e53f130748c6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:15.031562 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-96463e0d-9bfa-44aa-8c27-b7fe528891cf req-a0c8bfde-1c5a-4eec-a056-e53f130748c6 service nova] Creating event network-vif-plugged:856e3225-e60e-4434-b63d-6d6e70bf7364 for instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea on n-h2-820368-35 Aug 27 05:09:15.049106 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-96463e0d-9bfa-44aa-8c27-b7fe528891cf req-a0c8bfde-1c5a-4eec-a056-e53f130748c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095228 Aug 27 05:09:15.050339 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1764/3473] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:15.069801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c42f1d10-beb0-4e7d-86f5-2a4cfdd48497 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:15.082242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad304612-3fac-44f0-881e-70f9e7e3ce81 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:15.092248 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c42f1d10-beb0-4e7d-86f5-2a4cfdd48497 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1512 microversion: 2.1 time: 0.519085 Aug 27 05:09:15.092919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad304612-3fac-44f0-881e-70f9e7e3ce81 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:15.094681 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1710/3474] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:14 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1512 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:15.109761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad304612-3fac-44f0-881e-70f9e7e3ce81 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:15.111156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad304612-3fac-44f0-881e-70f9e7e3ce81 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:15.111979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad304612-3fac-44f0-881e-70f9e7e3ce81 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:15.118510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad304612-3fac-44f0-881e-70f9e7e3ce81 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:15.119897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad304612-3fac-44f0-881e-70f9e7e3ce81 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:15.120533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad304612-3fac-44f0-881e-70f9e7e3ce81 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:15.173507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:15.518051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad304612-3fac-44f0-881e-70f9e7e3ce81 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:15.529283 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad304612-3fac-44f0-881e-70f9e7e3ce81 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1373 microversion: 2.1 time: 0.477459 Aug 27 05:09:15.529889 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1765/3475] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:15 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1373 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:15.846499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-abee81ad-7335-4c9c-bc23-3305f5878e93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:15.848327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-abee81ad-7335-4c9c-bc23-3305f5878e93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:15.850368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:15.882792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abee81ad-7335-4c9c-bc23-3305f5878e93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:15.888644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abee81ad-7335-4c9c-bc23-3305f5878e93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:15.892130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abee81ad-7335-4c9c-bc23-3305f5878e93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:15.895720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abee81ad-7335-4c9c-bc23-3305f5878e93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:15.902146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abee81ad-7335-4c9c-bc23-3305f5878e93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:15.914432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-abee81ad-7335-4c9c-bc23-3305f5878e93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:16.001606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-96bcb844-9549-4480-af2d-944e1d21ce32 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:16.002179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-96bcb844-9549-4480-af2d-944e1d21ce32 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:16.022045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96bcb844-9549-4480-af2d-944e1d21ce32 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:16.023304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96bcb844-9549-4480-af2d-944e1d21ce32 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:16.025063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96bcb844-9549-4480-af2d-944e1d21ce32 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:16.025839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96bcb844-9549-4480-af2d-944e1d21ce32 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:16.030153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96bcb844-9549-4480-af2d-944e1d21ce32 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:16.031612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96bcb844-9549-4480-af2d-944e1d21ce32 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:16.135989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-96bcb844-9549-4480-af2d-944e1d21ce32 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lazy-loading 'flavor' on Instance uuid 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:09:16.365963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-abee81ad-7335-4c9c-bc23-3305f5878e93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:16.387396 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-abee81ad-7335-4c9c-bc23-3305f5878e93 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1467 microversion: 2.1 time: 0.544155 Aug 27 05:09:16.391306 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1711/3476] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:15 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1467 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:16.407355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4671f6e5-85a9-444a-93e0-72fc4e72a3d3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:16.408517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4671f6e5-85a9-444a-93e0-72fc4e72a3d3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:16.428826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4671f6e5-85a9-444a-93e0-72fc4e72a3d3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:16.429724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4671f6e5-85a9-444a-93e0-72fc4e72a3d3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:16.430333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4671f6e5-85a9-444a-93e0-72fc4e72a3d3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:16.431321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4671f6e5-85a9-444a-93e0-72fc4e72a3d3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:16.432083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4671f6e5-85a9-444a-93e0-72fc4e72a3d3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:16.432886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4671f6e5-85a9-444a-93e0-72fc4e72a3d3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:16.789896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4671f6e5-85a9-444a-93e0-72fc4e72a3d3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:16.802142 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4671f6e5-85a9-444a-93e0-72fc4e72a3d3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1489 microversion: 2.1 time: 0.409468 Aug 27 05:09:16.803408 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1712/3477] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:16 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1489 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:16.819052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-977f4897-3fa7-4d7a-aa77-fee823bfe3db tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:16.821301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-977f4897-3fa7-4d7a-aa77-fee823bfe3db tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:16.846851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977f4897-3fa7-4d7a-aa77-fee823bfe3db tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:16.847383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977f4897-3fa7-4d7a-aa77-fee823bfe3db tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:16.847875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977f4897-3fa7-4d7a-aa77-fee823bfe3db tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:16.848610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977f4897-3fa7-4d7a-aa77-fee823bfe3db tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:16.849063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977f4897-3fa7-4d7a-aa77-fee823bfe3db tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:16.849701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977f4897-3fa7-4d7a-aa77-fee823bfe3db tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:17.173898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-977f4897-3fa7-4d7a-aa77-fee823bfe3db tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:17.193072 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-977f4897-3fa7-4d7a-aa77-fee823bfe3db tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1545 microversion: 2.1 time: 0.385927 Aug 27 05:09:17.211603 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1713/3478] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:16 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1545 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:17.217586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68272904-efd6-421d-88ae-d98311498dca tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:17.218095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68272904-efd6-421d-88ae-d98311498dca tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:17.237963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68272904-efd6-421d-88ae-d98311498dca tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:17.238475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68272904-efd6-421d-88ae-d98311498dca tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:17.238927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68272904-efd6-421d-88ae-d98311498dca tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:17.242842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68272904-efd6-421d-88ae-d98311498dca tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:17.243393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68272904-efd6-421d-88ae-d98311498dca tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:17.244973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68272904-efd6-421d-88ae-d98311498dca tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:17.307637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68272904-efd6-421d-88ae-d98311498dca tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:09:17.481373 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68272904-efd6-421d-88ae-d98311498dca tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 204 len: 0 microversion: 2.1 time: 0.268433 Aug 27 05:09:17.482025 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1714/3479] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:09:17 2022] DELETE /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:09:17.492251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b578a6cc-7074-494f-9b2f-d3a910dc3998 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:17.492963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b578a6cc-7074-494f-9b2f-d3a910dc3998 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:17.503687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b578a6cc-7074-494f-9b2f-d3a910dc3998 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:17.504192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b578a6cc-7074-494f-9b2f-d3a910dc3998 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:17.504627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b578a6cc-7074-494f-9b2f-d3a910dc3998 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:17.505339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b578a6cc-7074-494f-9b2f-d3a910dc3998 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:17.505809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b578a6cc-7074-494f-9b2f-d3a910dc3998 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:17.507370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b578a6cc-7074-494f-9b2f-d3a910dc3998 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:17.700090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b578a6cc-7074-494f-9b2f-d3a910dc3998 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:17.710508 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b578a6cc-7074-494f-9b2f-d3a910dc3998 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1545 microversion: 2.1 time: 0.226604 Aug 27 05:09:17.725268 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1715/3480] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:17 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1545 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:17.750209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8c090ef-2277-4864-9294-9e480f323c35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:17.750839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f8c090ef-2277-4864-9294-9e480f323c35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:17.767812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8c090ef-2277-4864-9294-9e480f323c35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:17.768294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8c090ef-2277-4864-9294-9e480f323c35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:17.768732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8c090ef-2277-4864-9294-9e480f323c35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:17.769447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8c090ef-2277-4864-9294-9e480f323c35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:17.769926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8c090ef-2277-4864-9294-9e480f323c35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:17.770375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8c090ef-2277-4864-9294-9e480f323c35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:18.308343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f8c090ef-2277-4864-9294-9e480f323c35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:18.336639 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8c090ef-2277-4864-9294-9e480f323c35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 200 len: 1467 microversion: 2.1 time: 0.609620 Aug 27 05:09:18.338766 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1716/3481] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:17 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 1467 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:18.350976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5cc91bd4-b190-4bc1-8f5e-c770ca46b792 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:18.361681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5cc91bd4-b190-4bc1-8f5e-c770ca46b792 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:18.386621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cc91bd4-b190-4bc1-8f5e-c770ca46b792 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:18.389076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cc91bd4-b190-4bc1-8f5e-c770ca46b792 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:18.392325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cc91bd4-b190-4bc1-8f5e-c770ca46b792 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:18.393819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cc91bd4-b190-4bc1-8f5e-c770ca46b792 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:18.397167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cc91bd4-b190-4bc1-8f5e-c770ca46b792 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:18.398470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cc91bd4-b190-4bc1-8f5e-c770ca46b792 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:19.325752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5cc91bd4-b190-4bc1-8f5e-c770ca46b792 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:19.348750 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5cc91bd4-b190-4bc1-8f5e-c770ca46b792 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1495 microversion: 2.1 time: 1.008390 Aug 27 05:09:19.369433 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1717/3482] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:18 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1495 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:19.376610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3a0f4ab5-b154-4159-a0ee-95c90ebe11ff req-73bb75dc-d8a7-4323-bcbc-28b2b191a031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea", "name": "network-vif-deleted", "tag": "856e3225-e60e-4434-b63d-6d6e70bf7364"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:19.390729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3a0f4ab5-b154-4159-a0ee-95c90ebe11ff req-73bb75dc-d8a7-4323-bcbc-28b2b191a031 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:19.393484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3a0f4ab5-b154-4159-a0ee-95c90ebe11ff req-73bb75dc-d8a7-4323-bcbc-28b2b191a031 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:19.394216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3a0f4ab5-b154-4159-a0ee-95c90ebe11ff req-73bb75dc-d8a7-4323-bcbc-28b2b191a031 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:19.409509 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3a0f4ab5-b154-4159-a0ee-95c90ebe11ff req-73bb75dc-d8a7-4323-bcbc-28b2b191a031 service nova] Creating event network-vif-deleted:856e3225-e60e-4434-b63d-6d6e70bf7364 for instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea on n-h2-820368-35 Aug 27 05:09:19.415905 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3a0f4ab5-b154-4159-a0ee-95c90ebe11ff req-73bb75dc-d8a7-4323-bcbc-28b2b191a031 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044844 Aug 27 05:09:19.418026 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1718/3483] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:19.424211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:19.425178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:19.431810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:19.432533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:19.433702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:19.434834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:19.435476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:19.436081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:19.459588 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] HTTP exception thrown: Instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea could not be found. Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Request method failure captured: Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea HTTP/1.1 Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaW5sJ5lUhO3GY4aV8NSn6w9zULB8nVWfk_cN_eqLTgTpwj9ObMGAJc_fT5ib3PGOxETiyVKGPAvIDYqgdzp4oUEchGV2-CtQMA6BU1L6AxZkqLVILVJ0vRGeuUoZpQHSY1qkXt6Ye0DDPH7ghT0TevcDxERs9jQXbG28D27z0Yf9mA Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: a39f432b94f846faafa73bf3c7db6f5f Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a39f432b94f846faafa73bf3c7db6f5f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: a39f432b94f846faafa73bf3c7db6f5f Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-MigrationsAdminTest-1141761303-project Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 58b3a6b755ba4d5f89899d3122ddc29d Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-MigrationsAdminTest-1141761303-project Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea could not be found. Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea'} Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea could not be found. Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea could not be found. Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:19.461914 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:19.465629 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:19.465629 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:19.465629 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:19.465629 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:09:19.465629 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:09:19.465629 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea could not be found. Aug 27 05:09:19.465629 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:19.469344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Returning 404 to user: Instance 6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:09:19.471058 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9fd645b5-65ed-4bdb-8463-8765ab373b57 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea" status: 404 len: 111 microversion: 2.1 time: 0.051133 Aug 27 05:09:19.472404 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1719/3484] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:19 2022] GET /compute/v2.1/servers/6b9d79e6-ce08-45b8-b1ee-9d65e62a9eea => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:09:19.488405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1d50a421-e4d8-4c47-9083-028c2e55a0d2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:19.489728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1d50a421-e4d8-4c47-9083-028c2e55a0d2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:19.506808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d50a421-e4d8-4c47-9083-028c2e55a0d2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:19.510649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d50a421-e4d8-4c47-9083-028c2e55a0d2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:19.511619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d50a421-e4d8-4c47-9083-028c2e55a0d2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:19.513564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d50a421-e4d8-4c47-9083-028c2e55a0d2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:19.514843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d50a421-e4d8-4c47-9083-028c2e55a0d2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:19.516211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d50a421-e4d8-4c47-9083-028c2e55a0d2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:19.597487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1d50a421-e4d8-4c47-9083-028c2e55a0d2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:09:19.770490 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1d50a421-e4d8-4c47-9083-028c2e55a0d2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "DELETE /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 204 len: 0 microversion: 2.1 time: 0.292543 Aug 27 05:09:19.771757 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1720/3485] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:09:19 2022] DELETE /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:09:19.788010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-26ad3dda-bb1f-4e18-8070-8753f8ddb747 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:19.788839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-26ad3dda-bb1f-4e18-8070-8753f8ddb747 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:19.823700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ad3dda-bb1f-4e18-8070-8753f8ddb747 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:19.824598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ad3dda-bb1f-4e18-8070-8753f8ddb747 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:19.825511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ad3dda-bb1f-4e18-8070-8753f8ddb747 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:19.826392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ad3dda-bb1f-4e18-8070-8753f8ddb747 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:19.826996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ad3dda-bb1f-4e18-8070-8753f8ddb747 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:19.828290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ad3dda-bb1f-4e18-8070-8753f8ddb747 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:20.906175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-26ad3dda-bb1f-4e18-8070-8753f8ddb747 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:20.931846 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-26ad3dda-bb1f-4e18-8070-8753f8ddb747 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1534 microversion: 2.1 time: 1.143743 Aug 27 05:09:20.936682 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1721/3486] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:19 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1534 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:20.951001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fba787dd-609f-42a9-9d7e-6669c5210b15 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:20.953918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fba787dd-609f-42a9-9d7e-6669c5210b15 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:20.990367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fba787dd-609f-42a9-9d7e-6669c5210b15 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:20.992670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fba787dd-609f-42a9-9d7e-6669c5210b15 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:20.994419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fba787dd-609f-42a9-9d7e-6669c5210b15 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:20.998375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fba787dd-609f-42a9-9d7e-6669c5210b15 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:21.000972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fba787dd-609f-42a9-9d7e-6669c5210b15 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:21.001658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fba787dd-609f-42a9-9d7e-6669c5210b15 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:21.179402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fba787dd-609f-42a9-9d7e-6669c5210b15 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:21.207497 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fba787dd-609f-42a9-9d7e-6669c5210b15 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 200 len: 1453 microversion: 2.1 time: 0.265468 Aug 27 05:09:21.208332 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1722/3487] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:20 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 1453 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:21.589298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-376d43d8-ee70-4324-b34f-2e1439345cc6 req-1dd10bef-ba16-448d-abc7-44b7b2425130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a32c7b-9f76-488f-a8f4-06d89c55fe43", "name": "network-vif-deleted", "tag": "92f60212-a478-43d9-9fbc-ff178cf2bc89"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:21.610292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-376d43d8-ee70-4324-b34f-2e1439345cc6 req-1dd10bef-ba16-448d-abc7-44b7b2425130 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:21.610292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-376d43d8-ee70-4324-b34f-2e1439345cc6 req-1dd10bef-ba16-448d-abc7-44b7b2425130 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:21.610292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-376d43d8-ee70-4324-b34f-2e1439345cc6 req-1dd10bef-ba16-448d-abc7-44b7b2425130 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:21.639557 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-376d43d8-ee70-4324-b34f-2e1439345cc6 req-1dd10bef-ba16-448d-abc7-44b7b2425130 service nova] Creating event network-vif-deleted:92f60212-a478-43d9-9fbc-ff178cf2bc89 for instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 on n-h2-820368-35 Aug 27 05:09:21.650620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-376d43d8-ee70-4324-b34f-2e1439345cc6 req-1dd10bef-ba16-448d-abc7-44b7b2425130 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066978 Aug 27 05:09:21.651806 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1723/3488] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:21.962290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-489519bb-78e9-43d0-a3ba-c53d7567ec5c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:21.963943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-489519bb-78e9-43d0-a3ba-c53d7567ec5c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:21.986499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489519bb-78e9-43d0-a3ba-c53d7567ec5c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:21.990504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489519bb-78e9-43d0-a3ba-c53d7567ec5c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:21.992154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489519bb-78e9-43d0-a3ba-c53d7567ec5c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:21.995126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489519bb-78e9-43d0-a3ba-c53d7567ec5c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:21.998826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489519bb-78e9-43d0-a3ba-c53d7567ec5c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:22.001516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489519bb-78e9-43d0-a3ba-c53d7567ec5c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:23.142654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-489519bb-78e9-43d0-a3ba-c53d7567ec5c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:23.161563 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-489519bb-78e9-43d0-a3ba-c53d7567ec5c tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 200 len: 1534 microversion: 2.1 time: 1.204444 Aug 27 05:09:23.164092 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1724/3489] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:21 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 1534 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:23.172927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:23.180350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:23.205154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:23.206490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:23.210914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:23.212158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:23.217001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:23.218217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:23.253825 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 HTTP/1.1 Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '47a32c7b-9f76-488f-a8f4-06d89c55fe43'} Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:23.257546 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:23.261186 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:23.261186 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:23.261186 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:23.261186 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:09:23.261186 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:09:23.261186 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:09:23.261186 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:23.263218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:09:23.264499 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a794fd00-97c1-4e34-b529-7d28254a960e tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 404 len: 111 microversion: 2.1 time: 0.099009 Aug 27 05:09:23.266132 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1725/3490] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:23 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:09:23.647204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2f9baff4-92e4-49c0-8853-b0c96ec4b859 req-735f3a40-5bc1-43a5-b072-03d629523a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26820abc-803a-4050-88be-17a76d7164ff", "name": "network-vif-deleted", "tag": "2990c3ed-258d-4779-8447-1c23744cef1b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:23.676882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2f9baff4-92e4-49c0-8853-b0c96ec4b859 req-735f3a40-5bc1-43a5-b072-03d629523a78 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:23.681078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2f9baff4-92e4-49c0-8853-b0c96ec4b859 req-735f3a40-5bc1-43a5-b072-03d629523a78 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:23.684851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2f9baff4-92e4-49c0-8853-b0c96ec4b859 req-735f3a40-5bc1-43a5-b072-03d629523a78 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:23.700014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:23.734526 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2f9baff4-92e4-49c0-8853-b0c96ec4b859 req-735f3a40-5bc1-43a5-b072-03d629523a78 service nova] Creating event network-vif-deleted:2990c3ed-258d-4779-8447-1c23744cef1b for instance 26820abc-803a-4050-88be-17a76d7164ff on n-h1-820368-35 Aug 27 05:09:23.751892 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2f9baff4-92e4-49c0-8853-b0c96ec4b859 req-735f3a40-5bc1-43a5-b072-03d629523a78 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108872 Aug 27 05:09:23.757013 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1726/3491] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:09:23.789225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-695583591", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "11b9ce7b-910c-4628-97fe-5e2c2147efa3"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:26.017745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=23 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:26.359563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:33.852889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:39.900100 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-96bcb844-9549-4480-af2d-944e1d21ce32 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "POST /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/action" status: 202 len: 0 microversion: 2.20 time: 23.905385 Aug 27 05:09:39.901762 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1766/3492] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 05:09:15 2022] POST /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/action => generated 0 bytes in 23908 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:09:39.906073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] validate_networks() for [('11b9ce7b-910c-4628-97fe-5e2c2147efa3', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:09:39.931687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:39.932580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 26820abc-803a-4050-88be-17a76d7164ff] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:39.952602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:39.953267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:39.953748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:39.956207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:39.956823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:39.958797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:40.003444 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] HTTP exception thrown: Instance 26820abc-803a-4050-88be-17a76d7164ff could not be found. Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Request method failure captured: Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff HTTP/1.1 Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaW5sJ5lUhO3GY4aV8NSn6w9zULB8nVWfk_cN_eqLTgTpwj9ObMGAJc_fT5ib3PGOxETiyVKGPAvIDYqgdzp4oUEchGV2-CtQMA6BU1L6AxZkqLVILVJ0vRGeuUoZpQHSY1qkXt6Ye0DDPH7ghT0TevcDxERs9jQXbG28D27z0Yf9mA Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: a39f432b94f846faafa73bf3c7db6f5f Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a39f432b94f846faafa73bf3c7db6f5f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: a39f432b94f846faafa73bf3c7db6f5f Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-MigrationsAdminTest-1141761303-project Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 58b3a6b755ba4d5f89899d3122ddc29d Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-MigrationsAdminTest-1141761303-project Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 26820abc-803a-4050-88be-17a76d7164ff could not be found. Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '26820abc-803a-4050-88be-17a76d7164ff'} Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26820abc-803a-4050-88be-17a76d7164ff could not be found. Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26820abc-803a-4050-88be-17a76d7164ff could not be found. Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:40.007130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:40.015905 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:40.015905 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:40.015905 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:40.015905 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:09:40.015905 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:09:40.015905 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26820abc-803a-4050-88be-17a76d7164ff could not be found. Aug 27 05:09:40.015905 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:40.018608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Returning 404 to user: Instance 26820abc-803a-4050-88be-17a76d7164ff could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:09:40.019015 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f2d814c9-12ee-46e1-bd0f-c7bc00bf455b tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff" status: 404 len: 111 microversion: 2.1 time: 0.115157 Aug 27 05:09:40.019942 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1767/3493] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:39 2022] GET /compute/v2.1/servers/26820abc-803a-4050-88be-17a76d7164ff => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:09:40.036501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-66b7dee1-02cf-41f8-8e34-7341cb90566a req-2a3dd9ca-fc3e-44c7-b428-bbe86c8e7bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d", "tag": "9dd5172f-f947-4780-922c-290a788cf6ca"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:40.074382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-66b7dee1-02cf-41f8-8e34-7341cb90566a req-2a3dd9ca-fc3e-44c7-b428-bbe86c8e7bf4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:40.074382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-66b7dee1-02cf-41f8-8e34-7341cb90566a req-2a3dd9ca-fc3e-44c7-b428-bbe86c8e7bf4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:40.074382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-66b7dee1-02cf-41f8-8e34-7341cb90566a req-2a3dd9ca-fc3e-44c7-b428-bbe86c8e7bf4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:40.120154 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-66b7dee1-02cf-41f8-8e34-7341cb90566a req-2a3dd9ca-fc3e-44c7-b428-bbe86c8e7bf4 service nova] Creating event network-changed:9dd5172f-f947-4780-922c-290a788cf6ca for instance a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d on n-h2-820368-35 Aug 27 05:09:40.128281 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-66b7dee1-02cf-41f8-8e34-7341cb90566a req-2a3dd9ca-fc3e-44c7-b428-bbe86c8e7bf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105108 Aug 27 05:09:40.129739 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1768/3494] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:40.380506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-686127194", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:40.562808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] validate_networks() for [('e2f40396-aecf-43c6-96a0-abd6bc947a07', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:09:40.826363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:09:40.827045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:09:40.827582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:09:40.827998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:09:40.833078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:09:40.849221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:40.852181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:40.852680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:40.853506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:40.853981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:40.854416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:40.909460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:09:40.916307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Getting quotas for user d3ae5460271c4f5291e6abb0e76cab17 and project 50a5e22135444607952f11ff576a5cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:09:40.945070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:09:40.951128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:09:41.073525 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e106f23-6146-47eb-b3fa-12573f0e1ed8 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 17.312183 Aug 27 05:09:41.074099 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1727/3495] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:09:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 17315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:09:41.099543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:41.100317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:41.129321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:41.130262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:41.130862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:41.131776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:41.133916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:41.134525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:41.490240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:41.502395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:41.504068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:41.505511 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df970675-c24e-4c42-bcdd-84d0e5eac7b3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1722 microversion: 2.20 time: 0.416250 Aug 27 05:09:41.532936 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1728/3496] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:41 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1722 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:09:41.538407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2891b460-b4f9-490b-9a26-bdde8418a235 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '.version_select at 0x7fb56953b310>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:41.583592 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2891b460-b4f9-490b-9a26-bdde8418a235 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955645992" status: 202 len: 0 microversion: 2.1 time: 0.049052 Aug 27 05:09:41.584489 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1729/3497] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 05:09:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955645992 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:09:41.589716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2ead6f73-fda2-4e29-9f71-7347d62fac32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:41.594249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2ead6f73-fda2-4e29-9f71-7347d62fac32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:41.685637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2ead6f73-fda2-4e29-9f71-7347d62fac32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:41.697526 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2ead6f73-fda2-4e29-9f71-7347d62fac32 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1214 microversion: 2.1 time: 0.111784 Aug 27 05:09:41.711948 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1730/3498] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:41 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:41.985655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:09:41.986094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:09:41.986589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:09:41.986983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:09:41.987554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:09:42.006925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:42.008336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:42.009260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:42.011449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:42.013249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:42.014303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:42.066486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Getting quotas for project b81288d9952a4ad08f073fd0b818f36a. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:09:42.073136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Getting quotas for user d258c8a1bb33492e99ef2df2b1686201 and project b81288d9952a4ad08f073fd0b818f36a. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:09:42.103460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:09:42.115154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:09:42.188160 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c1c87f6-9b43-4c32-9188-3d5532362e26 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.056405 Aug 27 05:09:42.189570 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1769/3499] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:09:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:09:42.200595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7ec5a669-b22f-4976-8b83-cc287675cb53 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:42.202894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7ec5a669-b22f-4976-8b83-cc287675cb53 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:42.473580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7ec5a669-b22f-4976-8b83-cc287675cb53 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:42.484263 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7ec5a669-b22f-4976-8b83-cc287675cb53 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1222 microversion: 2.1 time: 0.287510 Aug 27 05:09:42.490751 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1731/3500] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:42 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1222 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:42.531914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:42.532540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:42.547373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:42.549614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:42.551521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:42.552656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:42.553126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:42.553560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:42.721626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd41e6fb-a55a-49a8-8848-9a486c3ccba9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:42.722297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cd41e6fb-a55a-49a8-8848-9a486c3ccba9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:42.740601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd41e6fb-a55a-49a8-8848-9a486c3ccba9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:42.741181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd41e6fb-a55a-49a8-8848-9a486c3ccba9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:42.750016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd41e6fb-a55a-49a8-8848-9a486c3ccba9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:42.750841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd41e6fb-a55a-49a8-8848-9a486c3ccba9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:42.751899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd41e6fb-a55a-49a8-8848-9a486c3ccba9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:42.752498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd41e6fb-a55a-49a8-8848-9a486c3ccba9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:42.999839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cd41e6fb-a55a-49a8-8848-9a486c3ccba9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:43.015787 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cd41e6fb-a55a-49a8-8848-9a486c3ccba9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1266 microversion: 2.1 time: 0.299411 Aug 27 05:09:43.016784 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1732/3501] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:42 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:43.513047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-504b9d26-4863-4379-b391-66c3f8dd6f5f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:43.513689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-504b9d26-4863-4379-b391-66c3f8dd6f5f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:43.530402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-504b9d26-4863-4379-b391-66c3f8dd6f5f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:43.530915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-504b9d26-4863-4379-b391-66c3f8dd6f5f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:43.531384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-504b9d26-4863-4379-b391-66c3f8dd6f5f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:43.532099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-504b9d26-4863-4379-b391-66c3f8dd6f5f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:43.532553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-504b9d26-4863-4379-b391-66c3f8dd6f5f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:43.532978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-504b9d26-4863-4379-b391-66c3f8dd6f5f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:43.932523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-504b9d26-4863-4379-b391-66c3f8dd6f5f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:43.944249 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-504b9d26-4863-4379-b391-66c3f8dd6f5f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1218 microversion: 2.1 time: 0.435424 Aug 27 05:09:43.947160 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1733/3502] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:43 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1218 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:43.955938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:43.970509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:43.971989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:43.982337 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-27ffa1b1-7d0e-45be-a31e-ecd57d039035 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1722 microversion: 2.20 time: 1.447283 Aug 27 05:09:43.983962 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1770/3503] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:42 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1722 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:09:44.038509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5cbf50cc-f41a-404d-8054-f27e7ebd500b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:44.039467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5cbf50cc-f41a-404d-8054-f27e7ebd500b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:44.057616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cbf50cc-f41a-404d-8054-f27e7ebd500b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:44.058119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cbf50cc-f41a-404d-8054-f27e7ebd500b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:44.058595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cbf50cc-f41a-404d-8054-f27e7ebd500b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:44.059393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cbf50cc-f41a-404d-8054-f27e7ebd500b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:44.059864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cbf50cc-f41a-404d-8054-f27e7ebd500b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:44.060296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cbf50cc-f41a-404d-8054-f27e7ebd500b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:44.441427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5cbf50cc-f41a-404d-8054-f27e7ebd500b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:44.458552 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5cbf50cc-f41a-404d-8054-f27e7ebd500b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1272 microversion: 2.1 time: 0.417226 Aug 27 05:09:44.459540 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1734/3504] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:44 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1272 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:44.725058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c899ded-50b6-41ef-b0bc-9c83849ca964 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:44.725561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c899ded-50b6-41ef-b0bc-9c83849ca964 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:44.739584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c899ded-50b6-41ef-b0bc-9c83849ca964 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:44.740107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c899ded-50b6-41ef-b0bc-9c83849ca964 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:44.740551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c899ded-50b6-41ef-b0bc-9c83849ca964 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:44.746138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c899ded-50b6-41ef-b0bc-9c83849ca964 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:44.746625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c899ded-50b6-41ef-b0bc-9c83849ca964 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:44.747066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c899ded-50b6-41ef-b0bc-9c83849ca964 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:44.824293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c899ded-50b6-41ef-b0bc-9c83849ca964 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:09:44.968932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b1b2ac6-ed80-40f0-9d20-18519b08070b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:44.969659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3b1b2ac6-ed80-40f0-9d20-18519b08070b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:44.997795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b1b2ac6-ed80-40f0-9d20-18519b08070b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:44.998517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b1b2ac6-ed80-40f0-9d20-18519b08070b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:44.999027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b1b2ac6-ed80-40f0-9d20-18519b08070b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:44.999832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b1b2ac6-ed80-40f0-9d20-18519b08070b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.000299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b1b2ac6-ed80-40f0-9d20-18519b08070b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.000732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b1b2ac6-ed80-40f0-9d20-18519b08070b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:45.023905 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c899ded-50b6-41ef-b0bc-9c83849ca964 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 204 len: 0 microversion: 2.1 time: 0.304243 Aug 27 05:09:45.025386 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1771/3505] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:09:44 2022] DELETE /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:09:45.043226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:45.043954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:45.064520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.065253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.065986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:45.067450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.068919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.070035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:45.204825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3b1b2ac6-ed80-40f0-9d20-18519b08070b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:45.237573 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3b1b2ac6-ed80-40f0-9d20-18519b08070b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1280 microversion: 2.1 time: 0.272726 Aug 27 05:09:45.238930 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1735/3506] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:44 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:45.268764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-452d4e01-efcf-448b-ba4c-277ab4e0bfeb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:45.275741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-452d4e01-efcf-448b-ba4c-277ab4e0bfeb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:45.333264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-452d4e01-efcf-448b-ba4c-277ab4e0bfeb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.334625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-452d4e01-efcf-448b-ba4c-277ab4e0bfeb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.335898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-452d4e01-efcf-448b-ba4c-277ab4e0bfeb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:45.337414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-452d4e01-efcf-448b-ba4c-277ab4e0bfeb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.348325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-452d4e01-efcf-448b-ba4c-277ab4e0bfeb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.349398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-452d4e01-efcf-448b-ba4c-277ab4e0bfeb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:45.889104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:45.923005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:45.925921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:45.928253 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fdf43ad0-6266-4628-b777-dac9fc374f0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1722 microversion: 2.20 time: 0.899323 Aug 27 05:09:45.939626 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1772/3507] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:45 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1722 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:09:45.962060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2f7d0725-763c-4362-94ba-262a0ea15c0b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:45.963776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2f7d0725-763c-4362-94ba-262a0ea15c0b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:45.975488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f7d0725-763c-4362-94ba-262a0ea15c0b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.990903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f7d0725-763c-4362-94ba-262a0ea15c0b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.992192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f7d0725-763c-4362-94ba-262a0ea15c0b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:45.993711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f7d0725-763c-4362-94ba-262a0ea15c0b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.994897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f7d0725-763c-4362-94ba-262a0ea15c0b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.996080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f7d0725-763c-4362-94ba-262a0ea15c0b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:46.016596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-452d4e01-efcf-448b-ba4c-277ab4e0bfeb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:46.043884 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-452d4e01-efcf-448b-ba4c-277ab4e0bfeb tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1469 microversion: 2.1 time: 0.800156 Aug 27 05:09:46.057679 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1736/3508] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:45 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1469 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:46.271034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1456f65b-e0cb-42de-97e6-8045fa49bb5c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:46.279368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1456f65b-e0cb-42de-97e6-8045fa49bb5c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:46.298198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1456f65b-e0cb-42de-97e6-8045fa49bb5c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:46.298933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1456f65b-e0cb-42de-97e6-8045fa49bb5c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:46.299714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1456f65b-e0cb-42de-97e6-8045fa49bb5c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:46.300613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1456f65b-e0cb-42de-97e6-8045fa49bb5c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:46.316914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1456f65b-e0cb-42de-97e6-8045fa49bb5c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:46.317850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1456f65b-e0cb-42de-97e6-8045fa49bb5c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:47.314730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2f7d0725-763c-4362-94ba-262a0ea15c0b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:47.330138 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2f7d0725-763c-4362-94ba-262a0ea15c0b tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 1.388587 Aug 27 05:09:47.351216 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1773/3509] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:45 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:47.351216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:47.351216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:47.368213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:47.371586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:47.372638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:47.375480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:47.379053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:47.380130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:47.450052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1456f65b-e0cb-42de-97e6-8045fa49bb5c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:47.489923 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1456f65b-e0cb-42de-97e6-8045fa49bb5c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1322 microversion: 2.1 time: 1.232167 Aug 27 05:09:47.491053 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1737/3510] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:46 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1322 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:47.504133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de06cca0-2bb9-4b70-9e48-5a76f42cf6bf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:47.520050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de06cca0-2bb9-4b70-9e48-5a76f42cf6bf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:47.545543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de06cca0-2bb9-4b70-9e48-5a76f42cf6bf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:47.546833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de06cca0-2bb9-4b70-9e48-5a76f42cf6bf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:47.547476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de06cca0-2bb9-4b70-9e48-5a76f42cf6bf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:47.548368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de06cca0-2bb9-4b70-9e48-5a76f42cf6bf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:47.549100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de06cca0-2bb9-4b70-9e48-5a76f42cf6bf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:47.549671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de06cca0-2bb9-4b70-9e48-5a76f42cf6bf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:48.261597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:48.285567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:48.287311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:48.293266 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f197d3f-af68-4fdd-8482-ade1ef7bbff2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1722 microversion: 2.20 time: 0.958786 Aug 27 05:09:48.294328 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1774/3511] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:47 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1722 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:09:48.306523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b9bcb138-51a4-4503-b115-f006cb08cb64 req-4ce9067d-7d82-4dcc-bfd1-f366beece442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9", "tag": "57deadeb-fc01-4d2b-b151-830cad677ad7"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:48.334005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b9bcb138-51a4-4503-b115-f006cb08cb64 req-4ce9067d-7d82-4dcc-bfd1-f366beece442 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:48.334932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b9bcb138-51a4-4503-b115-f006cb08cb64 req-4ce9067d-7d82-4dcc-bfd1-f366beece442 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:48.339663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b9bcb138-51a4-4503-b115-f006cb08cb64 req-4ce9067d-7d82-4dcc-bfd1-f366beece442 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:48.367841 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b9bcb138-51a4-4503-b115-f006cb08cb64 req-4ce9067d-7d82-4dcc-bfd1-f366beece442 service nova] Creating event network-changed:57deadeb-fc01-4d2b-b151-830cad677ad7 for instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 on n-h1-820368-35 Aug 27 05:09:48.381649 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b9bcb138-51a4-4503-b115-f006cb08cb64 req-4ce9067d-7d82-4dcc-bfd1-f366beece442 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080009 Aug 27 05:09:48.389638 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1775/3512] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:48.395510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b73b7027-3fc9-487e-b5c4-5a768cbfab68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:48.403187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b73b7027-3fc9-487e-b5c4-5a768cbfab68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:48.411971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de06cca0-2bb9-4b70-9e48-5a76f42cf6bf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:48.429440 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de06cca0-2bb9-4b70-9e48-5a76f42cf6bf tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1469 microversion: 2.1 time: 0.933418 Aug 27 05:09:48.434517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73b7027-3fc9-487e-b5c4-5a768cbfab68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:48.434959 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1738/3513] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:47 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1469 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:48.437831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73b7027-3fc9-487e-b5c4-5a768cbfab68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:48.438468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73b7027-3fc9-487e-b5c4-5a768cbfab68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:48.441983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73b7027-3fc9-487e-b5c4-5a768cbfab68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:48.442635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73b7027-3fc9-487e-b5c4-5a768cbfab68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:48.443347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73b7027-3fc9-487e-b5c4-5a768cbfab68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:48.518171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-624bc18f-8112-4974-af8a-98d4ca9f16f1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:48.519015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-624bc18f-8112-4974-af8a-98d4ca9f16f1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:48.536699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-624bc18f-8112-4974-af8a-98d4ca9f16f1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:48.540291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-624bc18f-8112-4974-af8a-98d4ca9f16f1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:48.543706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-624bc18f-8112-4974-af8a-98d4ca9f16f1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:48.546024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-624bc18f-8112-4974-af8a-98d4ca9f16f1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:48.552900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-624bc18f-8112-4974-af8a-98d4ca9f16f1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:48.556675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-624bc18f-8112-4974-af8a-98d4ca9f16f1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:49.164991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b73b7027-3fc9-487e-b5c4-5a768cbfab68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:49.189423 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b73b7027-3fc9-487e-b5c4-5a768cbfab68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 0.796510 Aug 27 05:09:49.197904 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1776/3514] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:48 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:49.267447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-cfd4574a-6c94-4fd1-b64b-df3ac3657bd2 req-ad1ae542-a4e9-4d72-ad49-b63988e758bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d", "tag": "e65f23bf-b453-4531-8c18-55517ce62046"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:49.269886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-624bc18f-8112-4974-af8a-98d4ca9f16f1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:49.286631 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-624bc18f-8112-4974-af8a-98d4ca9f16f1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1322 microversion: 2.1 time: 0.773890 Aug 27 05:09:49.290589 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1739/3515] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:48 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1322 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:49.316448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cfd4574a-6c94-4fd1-b64b-df3ac3657bd2 req-ad1ae542-a4e9-4d72-ad49-b63988e758bc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:49.317022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cfd4574a-6c94-4fd1-b64b-df3ac3657bd2 req-ad1ae542-a4e9-4d72-ad49-b63988e758bc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:49.317491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cfd4574a-6c94-4fd1-b64b-df3ac3657bd2 req-ad1ae542-a4e9-4d72-ad49-b63988e758bc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:49.339900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:49.342666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:49.361785 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-cfd4574a-6c94-4fd1-b64b-df3ac3657bd2 req-ad1ae542-a4e9-4d72-ad49-b63988e758bc service nova] Creating event network-changed:e65f23bf-b453-4531-8c18-55517ce62046 for instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d on n-h1-820368-35 Aug 27 05:09:49.369949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:49.370909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:49.371679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:49.376062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:49.384520 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-cfd4574a-6c94-4fd1-b64b-df3ac3657bd2 req-ad1ae542-a4e9-4d72-ad49-b63988e758bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119722 Aug 27 05:09:49.386990 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1777/3516] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:49.393750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:49.394741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:49.473900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e179cd8d-0a93-46b3-b43d-97cfb81c09e2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:49.475301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e179cd8d-0a93-46b3-b43d-97cfb81c09e2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:49.499029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e179cd8d-0a93-46b3-b43d-97cfb81c09e2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:49.506496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e179cd8d-0a93-46b3-b43d-97cfb81c09e2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:49.507280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e179cd8d-0a93-46b3-b43d-97cfb81c09e2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:49.508205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e179cd8d-0a93-46b3-b43d-97cfb81c09e2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:49.509098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e179cd8d-0a93-46b3-b43d-97cfb81c09e2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:49.509698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e179cd8d-0a93-46b3-b43d-97cfb81c09e2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:49.745652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e179cd8d-0a93-46b3-b43d-97cfb81c09e2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:49.790814 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e179cd8d-0a93-46b3-b43d-97cfb81c09e2 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 200 len: 1427 microversion: 2.1 time: 0.322640 Aug 27 05:09:49.793282 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1778/3517] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:49 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 1427 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:50.138725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:50.173392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:50.175374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:50.182315 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-06113f22-8303-4869-ace2-b0cdb394d378 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1722 microversion: 2.20 time: 0.854474 Aug 27 05:09:50.186691 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1740/3518] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:49 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1722 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:09:50.226843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-358089b0-7b4e-4e53-82dc-ff3e7e0f3a6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:50.227762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-358089b0-7b4e-4e53-82dc-ff3e7e0f3a6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:50.238761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-358089b0-7b4e-4e53-82dc-ff3e7e0f3a6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.239465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-358089b0-7b4e-4e53-82dc-ff3e7e0f3a6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.240073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-358089b0-7b4e-4e53-82dc-ff3e7e0f3a6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.242751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-358089b0-7b4e-4e53-82dc-ff3e7e0f3a6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.243492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-358089b0-7b4e-4e53-82dc-ff3e7e0f3a6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.244148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-358089b0-7b4e-4e53-82dc-ff3e7e0f3a6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.319768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-585afaee-d014-4f43-a140-a1b25c5b0ed1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:50.320599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-585afaee-d014-4f43-a140-a1b25c5b0ed1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:50.333579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585afaee-d014-4f43-a140-a1b25c5b0ed1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.334339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585afaee-d014-4f43-a140-a1b25c5b0ed1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.334787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585afaee-d014-4f43-a140-a1b25c5b0ed1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.345531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585afaee-d014-4f43-a140-a1b25c5b0ed1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.346075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585afaee-d014-4f43-a140-a1b25c5b0ed1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.346515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585afaee-d014-4f43-a140-a1b25c5b0ed1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.702180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-358089b0-7b4e-4e53-82dc-ff3e7e0f3a6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:50.716014 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-358089b0-7b4e-4e53-82dc-ff3e7e0f3a6a tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 0.494372 Aug 27 05:09:50.716612 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1779/3519] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:50 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:50.735545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-dd057f2e-485a-424e-a6ac-d75e0e8f86a7 req-819de947-f1d5-4da1-be94-351e57ed6596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d651cd6-26b2-42d8-a902-a63b9e2031e0", "name": "network-vif-deleted", "tag": "4c90b0b6-88ed-4bcd-9abd-4403f18530ec"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:50.768887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dd057f2e-485a-424e-a6ac-d75e0e8f86a7 req-819de947-f1d5-4da1-be94-351e57ed6596 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.771586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dd057f2e-485a-424e-a6ac-d75e0e8f86a7 req-819de947-f1d5-4da1-be94-351e57ed6596 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.772278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dd057f2e-485a-424e-a6ac-d75e0e8f86a7 req-819de947-f1d5-4da1-be94-351e57ed6596 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.796043 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-dd057f2e-485a-424e-a6ac-d75e0e8f86a7 req-819de947-f1d5-4da1-be94-351e57ed6596 service nova] Creating event network-vif-deleted:4c90b0b6-88ed-4bcd-9abd-4403f18530ec for instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 on n-h2-820368-35 Aug 27 05:09:50.810872 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-dd057f2e-485a-424e-a6ac-d75e0e8f86a7 req-819de947-f1d5-4da1-be94-351e57ed6596 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088810 Aug 27 05:09:50.816387 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1780/3520] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:50.824745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-585afaee-d014-4f43-a140-a1b25c5b0ed1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:50.825014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:50.825853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: 5d651cd6-26b2-42d8-a902-a63b9e2031e0] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:50.833673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.834377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.835567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.836915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.837731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.838349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.850726 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-585afaee-d014-4f43-a140-a1b25c5b0ed1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1322 microversion: 2.1 time: 0.535779 Aug 27 05:09:50.851370 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1741/3521] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:50 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:50.857289 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] HTTP exception thrown: Instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 could not be found. Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Request method failure captured: Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 HTTP/1.1 Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaW5sJ5lUhO3GY4aV8NSn6w9zULB8nVWfk_cN_eqLTgTpwj9ObMGAJc_fT5ib3PGOxETiyVKGPAvIDYqgdzp4oUEchGV2-CtQMA6BU1L6AxZkqLVILVJ0vRGeuUoZpQHSY1qkXt6Ye0DDPH7ghT0TevcDxERs9jQXbG28D27z0Yf9mA Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: a39f432b94f846faafa73bf3c7db6f5f Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a39f432b94f846faafa73bf3c7db6f5f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: a39f432b94f846faafa73bf3c7db6f5f Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-MigrationsAdminTest-1141761303-project Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 58b3a6b755ba4d5f89899d3122ddc29d Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-MigrationsAdminTest-1141761303-project Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 could not be found. Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '5d651cd6-26b2-42d8-a902-a63b9e2031e0'} Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 could not be found. Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 could not be found. Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:50.859669 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:50.863120 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:50.863120 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:50.863120 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:50.863120 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:09:50.863120 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:09:50.863120 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 could not be found. Aug 27 05:09:50.863120 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:09:50.864622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Returning 404 to user: Instance 5d651cd6-26b2-42d8-a902-a63b9e2031e0 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:09:50.865739 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6ae1a032-7fd0-4e52-878a-24b06f3a6b35 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0" status: 404 len: 111 microversion: 2.1 time: 0.047601 Aug 27 05:09:50.866481 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1781/3522] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:50 2022] GET /compute/v2.1/servers/5d651cd6-26b2-42d8-a902-a63b9e2031e0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:09:50.878690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-79674a26-80c5-4e2e-8e0e-6bc64b6d40de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:50.882362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-79674a26-80c5-4e2e-8e0e-6bc64b6d40de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:50.895132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:50.897214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79674a26-80c5-4e2e-8e0e-6bc64b6d40de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.898032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79674a26-80c5-4e2e-8e0e-6bc64b6d40de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.898645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79674a26-80c5-4e2e-8e0e-6bc64b6d40de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.899596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79674a26-80c5-4e2e-8e0e-6bc64b6d40de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.900218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79674a26-80c5-4e2e-8e0e-6bc64b6d40de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.900804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79674a26-80c5-4e2e-8e0e-6bc64b6d40de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.932292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-79674a26-80c5-4e2e-8e0e-6bc64b6d40de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:09:51.064418 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-79674a26-80c5-4e2e-8e0e-6bc64b6d40de tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 204 len: 0 microversion: 2.1 time: 0.191839 Aug 27 05:09:51.066423 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1742/3523] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:09:50 2022] DELETE /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:09:51.075951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-513dcb22-d194-4d02-b4be-b718a70fe35d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:51.077773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-513dcb22-d194-4d02-b4be-b718a70fe35d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:51.086469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513dcb22-d194-4d02-b4be-b718a70fe35d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:51.087270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513dcb22-d194-4d02-b4be-b718a70fe35d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:51.088220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513dcb22-d194-4d02-b4be-b718a70fe35d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:51.090063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513dcb22-d194-4d02-b4be-b718a70fe35d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:51.090896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513dcb22-d194-4d02-b4be-b718a70fe35d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:51.091507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513dcb22-d194-4d02-b4be-b718a70fe35d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:51.212641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:51.213350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:51.226502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:51.227388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:51.227904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:51.228940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:51.229723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:51.230336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:51.371145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-513dcb22-d194-4d02-b4be-b718a70fe35d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:51.382543 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-513dcb22-d194-4d02-b4be-b718a70fe35d tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1468 microversion: 2.1 time: 0.311889 Aug 27 05:09:51.383561 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1782/3524] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:51 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1468 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:51.492428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:51.501624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:51.503397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:51.505011 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-534c4fb2-732a-44e6-b24a-d772d017b383 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1722 microversion: 2.20 time: 0.296841 Aug 27 05:09:51.506099 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1743/3525] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:51 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:09:51.611881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-788812745", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fd786863-e847-41d8-b280-d0a2831441fc"}], "security_groups": [{"name": "tempest-securitygroup--643660772"}], "key_name": "tempest-keypair-903576486", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "2b271b56-e85c-4b14-9d02-433fb00336f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:51.784558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] validate_networks() for [('fd786863-e847-41d8-b280-d0a2831441fc', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:09:52.031403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:52.096022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:52.164021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-af0588ee-c3fe-4b6d-b252-b73785e7d2ee tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:52.165081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-af0588ee-c3fe-4b6d-b252-b73785e7d2ee tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:52.184854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0588ee-c3fe-4b6d-b252-b73785e7d2ee tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.185797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0588ee-c3fe-4b6d-b252-b73785e7d2ee tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.186696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0588ee-c3fe-4b6d-b252-b73785e7d2ee tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.188150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0588ee-c3fe-4b6d-b252-b73785e7d2ee tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.188937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0588ee-c3fe-4b6d-b252-b73785e7d2ee tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.189635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0588ee-c3fe-4b6d-b252-b73785e7d2ee tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.471433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Getting quotas for project 5455e1b4fef14be99a76abf1e759219a. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:09:52.479180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Getting quotas for user 03ac7725d5424eddb2e1b79e2cac2fe4 and project 5455e1b4fef14be99a76abf1e759219a. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:09:52.484108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-af0588ee-c3fe-4b6d-b252-b73785e7d2ee tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:52.494600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:09:52.495325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:09:52.495981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:09:52.496961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:09:52.498259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:09:52.499552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=10 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:52.513171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.513713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.514733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.515581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.516052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.516793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.521982 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-af0588ee-c3fe-4b6d-b252-b73785e7d2ee tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 0.785412 Aug 27 05:09:52.522628 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1744/3526] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:51 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:52.540896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-605ce373-a308-4081-9bf8-e745574ad72a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:52.541095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Getting quotas for project 5455e1b4fef14be99a76abf1e759219a. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:09:52.541962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-605ce373-a308-4081-9bf8-e745574ad72a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:52.550044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Getting quotas for user 03ac7725d5424eddb2e1b79e2cac2fe4 and project 5455e1b4fef14be99a76abf1e759219a. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:09:52.550210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605ce373-a308-4081-9bf8-e745574ad72a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.550653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605ce373-a308-4081-9bf8-e745574ad72a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.551126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605ce373-a308-4081-9bf8-e745574ad72a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.551882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605ce373-a308-4081-9bf8-e745574ad72a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.552337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605ce373-a308-4081-9bf8-e745574ad72a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.552768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605ce373-a308-4081-9bf8-e745574ad72a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.573607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:52.652854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:09:52.655636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b271b56-e85c-4b14-9d02-433fb00336f7',volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:09:52.792885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-605ce373-a308-4081-9bf8-e745574ad72a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:52.809815 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-605ce373-a308-4081-9bf8-e745574ad72a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1322 microversion: 2.1 time: 0.274136 Aug 27 05:09:52.811800 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1745/3527] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:52 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:52.818273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8a1a1569-fba3-4b96-a35c-54abe0ff72d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:52.819253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8a1a1569-fba3-4b96-a35c-54abe0ff72d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:52.827233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a1a1569-fba3-4b96-a35c-54abe0ff72d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.828329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a1a1569-fba3-4b96-a35c-54abe0ff72d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.828917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a1a1569-fba3-4b96-a35c-54abe0ff72d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.830518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a1a1569-fba3-4b96-a35c-54abe0ff72d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.831386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a1a1569-fba3-4b96-a35c-54abe0ff72d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.831855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a1a1569-fba3-4b96-a35c-54abe0ff72d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.913140 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-964e8bbd-0c17-4096-80fb-e92f4f7926f1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.306263 Aug 27 05:09:52.915554 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1783/3528] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:09:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:09:52.922467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:52.923389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:52.931918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.933191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.933824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.934721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.935365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.936513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:53.588590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:53.616634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:53.619530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:53.621610 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd1612a3-d464-4214-9744-60f29c73b2dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1722 microversion: 2.20 time: 0.704615 Aug 27 05:09:53.635533 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1784/3529] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:52 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1722 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:09:53.635706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8a1a1569-fba3-4b96-a35c-54abe0ff72d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:53.644037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-47e48e62-4372-4c48-88f3-cb0b1f670f0e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:53.645324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-47e48e62-4372-4c48-88f3-cb0b1f670f0e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:53.649701 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8a1a1569-fba3-4b96-a35c-54abe0ff72d0 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1468 microversion: 2.1 time: 0.835722 Aug 27 05:09:53.673188 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1746/3530] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:52 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1468 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:53.690705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c2f493fa-f7d9-4e2e-840d-a9bf9901caa7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:53.692524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c2f493fa-f7d9-4e2e-840d-a9bf9901caa7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:53.705725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2f493fa-f7d9-4e2e-840d-a9bf9901caa7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:53.709122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2f493fa-f7d9-4e2e-840d-a9bf9901caa7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:53.709916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2f493fa-f7d9-4e2e-840d-a9bf9901caa7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:53.711253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2f493fa-f7d9-4e2e-840d-a9bf9901caa7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:53.712259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2f493fa-f7d9-4e2e-840d-a9bf9901caa7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:53.712965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2f493fa-f7d9-4e2e-840d-a9bf9901caa7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:53.845410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-47e48e62-4372-4c48-88f3-cb0b1f670f0e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:53.853925 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-47e48e62-4372-4c48-88f3-cb0b1f670f0e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1120 microversion: 2.1 time: 0.217118 Aug 27 05:09:53.860318 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1785/3531] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:53 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1120 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:53.865517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eb1b3938-eb8b-449e-ab83-7843bb08ef75 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:53.874538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eb1b3938-eb8b-449e-ab83-7843bb08ef75 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:53.891420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb1b3938-eb8b-449e-ab83-7843bb08ef75 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:53.892160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb1b3938-eb8b-449e-ab83-7843bb08ef75 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:53.892764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb1b3938-eb8b-449e-ab83-7843bb08ef75 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:53.893696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb1b3938-eb8b-449e-ab83-7843bb08ef75 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:53.898035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb1b3938-eb8b-449e-ab83-7843bb08ef75 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:53.899347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb1b3938-eb8b-449e-ab83-7843bb08ef75 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.139846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c2f493fa-f7d9-4e2e-840d-a9bf9901caa7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:54.154903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eb1b3938-eb8b-449e-ab83-7843bb08ef75 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:54.157207 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c2f493fa-f7d9-4e2e-840d-a9bf9901caa7 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 0.482698 Aug 27 05:09:54.161279 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1747/3532] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:53 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:54.197847 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eb1b3938-eb8b-449e-ab83-7843bb08ef75 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1322 microversion: 2.1 time: 0.317867 Aug 27 05:09:54.212246 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1786/3533] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:53 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:54.522879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b233ce8c-3b63-480c-9096-4e193570161a req-dd2ef5e6-7a4b-47c3-bd57-835ac8733b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f131d54a-c71c-4d45-84f2-28576acda582", "name": "network-vif-deleted", "tag": "c11fd666-9533-4ab6-8b6d-ca21e57491a1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:54.539033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b233ce8c-3b63-480c-9096-4e193570161a req-dd2ef5e6-7a4b-47c3-bd57-835ac8733b49 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.539883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b233ce8c-3b63-480c-9096-4e193570161a req-dd2ef5e6-7a4b-47c3-bd57-835ac8733b49 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.540622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b233ce8c-3b63-480c-9096-4e193570161a req-dd2ef5e6-7a4b-47c3-bd57-835ac8733b49 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.567354 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b233ce8c-3b63-480c-9096-4e193570161a req-dd2ef5e6-7a4b-47c3-bd57-835ac8733b49 service nova] Creating event network-vif-deleted:c11fd666-9533-4ab6-8b6d-ca21e57491a1 for instance f131d54a-c71c-4d45-84f2-28576acda582 on n-h2-820368-35 Aug 27 05:09:54.576750 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b233ce8c-3b63-480c-9096-4e193570161a req-dd2ef5e6-7a4b-47c3-bd57-835ac8733b49 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056716 Aug 27 05:09:54.577941 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1748/3534] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:09:54.652173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:54.652809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:54.662888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.665393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.665845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.666593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.667057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.667520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.688923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:54.690477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:54.705350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.708047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.709052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.710060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.711115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.713400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.789795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.790296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.794696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.796036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lazy-loading 'fault' on Instance uuid f131d54a-c71c-4d45-84f2-28576acda582 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:09:54.856295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:54.866236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:54.879690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:54.881144 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a231bf83-ba34-437b-9ba9-71ef991bc076 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1743 microversion: 2.20 time: 0.235491 Aug 27 05:09:54.881847 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1787/3535] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:54 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1743 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:09:54.886958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c6d4ea8-8821-4dd3-94f8-5a82d3a1dd5c tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:54.900067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c6d4ea8-8821-4dd3-94f8-5a82d3a1dd5c tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:54.907919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6d4ea8-8821-4dd3-94f8-5a82d3a1dd5c tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.908573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6d4ea8-8821-4dd3-94f8-5a82d3a1dd5c tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.909121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6d4ea8-8821-4dd3-94f8-5a82d3a1dd5c tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.909937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6d4ea8-8821-4dd3-94f8-5a82d3a1dd5c tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.910535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6d4ea8-8821-4dd3-94f8-5a82d3a1dd5c tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.911050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c6d4ea8-8821-4dd3-94f8-5a82d3a1dd5c tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.938414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3a6b755ba4d5f89899d3122ddc29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f432b94f846faafa73bf3c7db6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:54.952581 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8084cedf-0eee-4725-8e59-dfe4c846cca5 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 200 len: 1303 microversion: 2.1 time: 0.273030 Aug 27 05:09:54.954934 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1749/3536] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:54 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 1303 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:54.969211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:55.128443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9c6d4ea8-8821-4dd3-94f8-5a82d3a1dd5c tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:55.138875 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c6d4ea8-8821-4dd3-94f8-5a82d3a1dd5c tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1218 microversion: 2.1 time: 0.255795 Aug 27 05:09:55.158271 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1788/3537] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:54 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1218 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:55.188543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d5426743-6bf1-43b9-9cf4-21ce74f08749 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:55.189936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d5426743-6bf1-43b9-9cf4-21ce74f08749 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:55.216253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5426743-6bf1-43b9-9cf4-21ce74f08749 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.217830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5426743-6bf1-43b9-9cf4-21ce74f08749 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:55.219646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5426743-6bf1-43b9-9cf4-21ce74f08749 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:55.219760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-47af9f26-7345-4013-996c-e4afdbb7f6e4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:55.220341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-47af9f26-7345-4013-996c-e4afdbb7f6e4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:55.223603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5426743-6bf1-43b9-9cf4-21ce74f08749 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.224296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5426743-6bf1-43b9-9cf4-21ce74f08749 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:55.225704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5426743-6bf1-43b9-9cf4-21ce74f08749 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:55.235350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47af9f26-7345-4013-996c-e4afdbb7f6e4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.236888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47af9f26-7345-4013-996c-e4afdbb7f6e4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:55.238065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47af9f26-7345-4013-996c-e4afdbb7f6e4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:55.243953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47af9f26-7345-4013-996c-e4afdbb7f6e4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.248160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47af9f26-7345-4013-996c-e4afdbb7f6e4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:55.252729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47af9f26-7345-4013-996c-e4afdbb7f6e4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:55.684481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-47af9f26-7345-4013-996c-e4afdbb7f6e4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:55.697541 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-47af9f26-7345-4013-996c-e4afdbb7f6e4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1322 microversion: 2.1 time: 0.481664 Aug 27 05:09:55.698441 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1789/3538] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:55 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:55.698587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d5426743-6bf1-43b9-9cf4-21ce74f08749 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:55.709509 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d5426743-6bf1-43b9-9cf4-21ce74f08749 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 0.530214 Aug 27 05:09:55.712577 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1750/3539] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:55 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:55.909616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:55.910279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:55.918138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.918637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:55.919079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:55.920059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.921050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:55.921487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:55.976846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:55.977649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] [instance: f131d54a-c71c-4d45-84f2-28576acda582] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:55.987735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.994430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:55.995117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:55.996122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.996791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.002608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.026082 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] HTTP exception thrown: Instance f131d54a-c71c-4d45-84f2-28576acda582 could not be found. Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Request method failure captured: Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 HTTP/1.1 Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaW5sJ5lUhO3GY4aV8NSn6w9zULB8nVWfk_cN_eqLTgTpwj9ObMGAJc_fT5ib3PGOxETiyVKGPAvIDYqgdzp4oUEchGV2-CtQMA6BU1L6AxZkqLVILVJ0vRGeuUoZpQHSY1qkXt6Ye0DDPH7ghT0TevcDxERs9jQXbG28D27z0Yf9mA Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: a39f432b94f846faafa73bf3c7db6f5f Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a39f432b94f846faafa73bf3c7db6f5f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a39f432b94f846faafa73bf3c7db6f5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: a39f432b94f846faafa73bf3c7db6f5f Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-MigrationsAdminTest-1141761303 Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-MigrationsAdminTest-1141761303-project Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 58b3a6b755ba4d5f89899d3122ddc29d Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-MigrationsAdminTest-1141761303-project Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance f131d54a-c71c-4d45-84f2-28576acda582 could not be found. Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'f131d54a-c71c-4d45-84f2-28576acda582'} Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f131d54a-c71c-4d45-84f2-28576acda582 could not be found. Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f131d54a-c71c-4d45-84f2-28576acda582 could not be found. Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:09:56.034066 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:56.039238 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:09:56.039238 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:09:56.039238 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:09:56.039238 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:09:56.039238 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:09:56.039238 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f131d54a-c71c-4d45-84f2-28576acda582 could not be found. Aug 27 05:09:56.039238 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:09:56.041828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] Returning 404 to user: Instance f131d54a-c71c-4d45-84f2-28576acda582 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:09:56.043140 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-47a2a30d-22ec-4fbb-97b1-abf9e0c3b454 tempest-MigrationsAdminTest-1141761303 tempest-MigrationsAdminTest-1141761303-project] 10.222.0.58 "GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582" status: 404 len: 111 microversion: 2.1 time: 0.070532 Aug 27 05:09:56.044120 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1751/3540] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:55 2022] GET /compute/v2.1/servers/f131d54a-c71c-4d45-84f2-28576acda582 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:09:56.164750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:56.165458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a851bdf9-cdff-4b71-b379-cf3a276b5be4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:56.166247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a851bdf9-cdff-4b71-b379-cf3a276b5be4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:56.178616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a851bdf9-cdff-4b71-b379-cf3a276b5be4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.179336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a851bdf9-cdff-4b71-b379-cf3a276b5be4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.180778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:56.181348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a851bdf9-cdff-4b71-b379-cf3a276b5be4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.182184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a851bdf9-cdff-4b71-b379-cf3a276b5be4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.182329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:56.184287 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-513cba73-73d6-4be9-9553-328bdb8cd1f6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1743 microversion: 2.20 time: 0.278920 Aug 27 05:09:56.184981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a851bdf9-cdff-4b71-b379-cf3a276b5be4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.185623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a851bdf9-cdff-4b71-b379-cf3a276b5be4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.206077 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1790/3541] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:55 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1743 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:09:56.285628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a851bdf9-cdff-4b71-b379-cf3a276b5be4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:56.296558 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a851bdf9-cdff-4b71-b379-cf3a276b5be4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1236 microversion: 2.1 time: 0.137452 Aug 27 05:09:56.300282 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1752/3542] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:56 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1236 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:56.721895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ddcb18d4-50e2-4389-bfa0-02c62e14b4d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:56.722731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ddcb18d4-50e2-4389-bfa0-02c62e14b4d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:56.732912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddcb18d4-50e2-4389-bfa0-02c62e14b4d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.733823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddcb18d4-50e2-4389-bfa0-02c62e14b4d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.734599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddcb18d4-50e2-4389-bfa0-02c62e14b4d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.735673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddcb18d4-50e2-4389-bfa0-02c62e14b4d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.736352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddcb18d4-50e2-4389-bfa0-02c62e14b4d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.736463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a167965-f8ad-4099-8496-2628884fc99f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:56.737461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddcb18d4-50e2-4389-bfa0-02c62e14b4d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.737649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a167965-f8ad-4099-8496-2628884fc99f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:56.751529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a167965-f8ad-4099-8496-2628884fc99f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.754418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a167965-f8ad-4099-8496-2628884fc99f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.755036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a167965-f8ad-4099-8496-2628884fc99f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.757498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a167965-f8ad-4099-8496-2628884fc99f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.758182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a167965-f8ad-4099-8496-2628884fc99f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.759955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a167965-f8ad-4099-8496-2628884fc99f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.110774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ddcb18d4-50e2-4389-bfa0-02c62e14b4d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:57.128464 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ddcb18d4-50e2-4389-bfa0-02c62e14b4d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1322 microversion: 2.1 time: 0.413014 Aug 27 05:09:57.146031 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1791/3543] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:56 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:57.213650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:57.220367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:57.223951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a167965-f8ad-4099-8496-2628884fc99f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:57.233281 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a167965-f8ad-4099-8496-2628884fc99f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 0.503252 Aug 27 05:09:57.233587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.234260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.236614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.240417 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1753/3544] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:56 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:57.242869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.245931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.259017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.320990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f215060-96ed-422a-aa1b-7ec1eb1f5436 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:57.322633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f215060-96ed-422a-aa1b-7ec1eb1f5436 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:57.333076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f215060-96ed-422a-aa1b-7ec1eb1f5436 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.335753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f215060-96ed-422a-aa1b-7ec1eb1f5436 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.336769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f215060-96ed-422a-aa1b-7ec1eb1f5436 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.338488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f215060-96ed-422a-aa1b-7ec1eb1f5436 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.339513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f215060-96ed-422a-aa1b-7ec1eb1f5436 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.340333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f215060-96ed-422a-aa1b-7ec1eb1f5436 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.881423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:57.898702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:57.906465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:57.909636 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-baf49a8b-bbc4-4545-acb4-c44710055e20 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1743 microversion: 2.20 time: 0.704540 Aug 27 05:09:57.940704 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1792/3545] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:57 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1743 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:09:58.115347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5f215060-96ed-422a-aa1b-7ec1eb1f5436 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:58.129130 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f215060-96ed-422a-aa1b-7ec1eb1f5436 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1303 microversion: 2.1 time: 0.812239 Aug 27 05:09:58.132907 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1754/3546] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:57 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1303 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:58.159575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af9cb265-2250-4ca6-a6c5-72d52576872f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:58.163773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-af9cb265-2250-4ca6-a6c5-72d52576872f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:58.169706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:58.183162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9cb265-2250-4ca6-a6c5-72d52576872f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.185567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9cb265-2250-4ca6-a6c5-72d52576872f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.190982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9cb265-2250-4ca6-a6c5-72d52576872f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:58.191963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9cb265-2250-4ca6-a6c5-72d52576872f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.195385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9cb265-2250-4ca6-a6c5-72d52576872f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.196342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9cb265-2250-4ca6-a6c5-72d52576872f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:58.240793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-97f73e43-6a9e-43ea-8bdd-8851df65868b req-c7413db1-d0bf-447f-b84d-d16d16291d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcbd54c-7e88-44d7-ad7b-be669acb1c7c", "name": "network-vif-plugged", "status": "completed", "tag": "e1cc65c6-b976-41c9-a889-d9270df2c63d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:58.281443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-97f73e43-6a9e-43ea-8bdd-8851df65868b req-c7413db1-d0bf-447f-b84d-d16d16291d9f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.290650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-97f73e43-6a9e-43ea-8bdd-8851df65868b req-c7413db1-d0bf-447f-b84d-d16d16291d9f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.291742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-97f73e43-6a9e-43ea-8bdd-8851df65868b req-c7413db1-d0bf-447f-b84d-d16d16291d9f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:58.327403 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-97f73e43-6a9e-43ea-8bdd-8851df65868b req-c7413db1-d0bf-447f-b84d-d16d16291d9f service nova] Creating event network-vif-plugged:e1cc65c6-b976-41c9-a889-d9270df2c63d for instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c on n-h1-820368-35 Aug 27 05:09:58.350597 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-97f73e43-6a9e-43ea-8bdd-8851df65868b req-c7413db1-d0bf-447f-b84d-d16d16291d9f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113605 Aug 27 05:09:58.353120 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1755/3547] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:58.371796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e31ec987-ae82-4447-b558-04e798c070ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:58.372897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e31ec987-ae82-4447-b558-04e798c070ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:58.396694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e31ec987-ae82-4447-b558-04e798c070ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.400173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e31ec987-ae82-4447-b558-04e798c070ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.400645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e31ec987-ae82-4447-b558-04e798c070ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:58.409935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e31ec987-ae82-4447-b558-04e798c070ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.414644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e31ec987-ae82-4447-b558-04e798c070ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.415243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e31ec987-ae82-4447-b558-04e798c070ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:58.826799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af9cb265-2250-4ca6-a6c5-72d52576872f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:58.862228 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af9cb265-2250-4ca6-a6c5-72d52576872f tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1322 microversion: 2.1 time: 0.707091 Aug 27 05:09:58.865326 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1793/3548] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:58 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1322 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:58.939828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:58.940723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:58.950869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.953863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.956131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:58.959223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.959889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.960508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:59.628094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e31ec987-ae82-4447-b558-04e798c070ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:59.642784 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e31ec987-ae82-4447-b558-04e798c070ac tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 1.288165 Aug 27 05:09:59.643660 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1756/3549] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:58 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:59.657100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7a85526-7a4f-4d6f-af2e-1297bcd4eac7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:59.657976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7a85526-7a4f-4d6f-af2e-1297bcd4eac7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:59.671697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a85526-7a4f-4d6f-af2e-1297bcd4eac7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:59.673892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a85526-7a4f-4d6f-af2e-1297bcd4eac7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:59.674608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a85526-7a4f-4d6f-af2e-1297bcd4eac7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:59.675526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a85526-7a4f-4d6f-af2e-1297bcd4eac7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:59.682535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a85526-7a4f-4d6f-af2e-1297bcd4eac7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:59.683242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a85526-7a4f-4d6f-af2e-1297bcd4eac7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.074163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:00.119343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:00.121443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:00.127913 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b16ff442-0597-4d8f-b543-62dd7bf0cb40 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1743 microversion: 2.20 time: 1.193717 Aug 27 05:10:00.128848 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1794/3550] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:09:58 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1743 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:00.135001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-75f4ab6c-b815-4162-aadc-903431bdbd79 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:00.143544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-75f4ab6c-b815-4162-aadc-903431bdbd79 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:00.166206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f4ab6c-b815-4162-aadc-903431bdbd79 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.171641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f4ab6c-b815-4162-aadc-903431bdbd79 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.184800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f4ab6c-b815-4162-aadc-903431bdbd79 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.198615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f4ab6c-b815-4162-aadc-903431bdbd79 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.199670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f4ab6c-b815-4162-aadc-903431bdbd79 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.200346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75f4ab6c-b815-4162-aadc-903431bdbd79 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.301588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a7a85526-7a4f-4d6f-af2e-1297bcd4eac7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:00.322507 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7a85526-7a4f-4d6f-af2e-1297bcd4eac7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1303 microversion: 2.1 time: 0.677511 Aug 27 05:10:00.334690 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1757/3551] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:59 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1303 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:00.340202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68fd3e82-7164-470a-82d3-0116fb59102d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:00.353725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68fd3e82-7164-470a-82d3-0116fb59102d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:00.377546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fd3e82-7164-470a-82d3-0116fb59102d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.378322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fd3e82-7164-470a-82d3-0116fb59102d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.379044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fd3e82-7164-470a-82d3-0116fb59102d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.380549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fd3e82-7164-470a-82d3-0116fb59102d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.381251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fd3e82-7164-470a-82d3-0116fb59102d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.381916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68fd3e82-7164-470a-82d3-0116fb59102d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.388110 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-75f4ab6c-b815-4162-aadc-903431bdbd79 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "POST /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d/action" status: 200 len: 24573 microversion: 2.1 time: 0.257604 Aug 27 05:10:00.395631 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1795/3552] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:00 2022] POST /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d/action => generated 24573 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:10:00.481893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-aec205e9-c16d-495e-aa9a-70869c83a3a1 req-16b0bb46-b5c6-4a97-9c6b-b0f84ab15d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9", "name": "network-vif-plugged", "status": "completed", "tag": "57deadeb-fc01-4d2b-b151-830cad677ad7"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:00.523536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aec205e9-c16d-495e-aa9a-70869c83a3a1 req-16b0bb46-b5c6-4a97-9c6b-b0f84ab15d27 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.524455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aec205e9-c16d-495e-aa9a-70869c83a3a1 req-16b0bb46-b5c6-4a97-9c6b-b0f84ab15d27 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.525121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aec205e9-c16d-495e-aa9a-70869c83a3a1 req-16b0bb46-b5c6-4a97-9c6b-b0f84ab15d27 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.546872 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-aec205e9-c16d-495e-aa9a-70869c83a3a1 req-16b0bb46-b5c6-4a97-9c6b-b0f84ab15d27 service nova] Creating event network-vif-plugged:57deadeb-fc01-4d2b-b151-830cad677ad7 for instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 on n-h1-820368-35 Aug 27 05:10:00.558674 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-aec205e9-c16d-495e-aa9a-70869c83a3a1 req-16b0bb46-b5c6-4a97-9c6b-b0f84ab15d27 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080618 Aug 27 05:10:00.561007 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1796/3553] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:00.667515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f6a2ebf2-cd0d-49cc-b875-de95c9c843ba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:00.672137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68fd3e82-7164-470a-82d3-0116fb59102d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:00.681323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f6a2ebf2-cd0d-49cc-b875-de95c9c843ba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:00.689673 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68fd3e82-7164-470a-82d3-0116fb59102d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1322 microversion: 2.1 time: 0.353568 Aug 27 05:10:00.698918 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1758/3554] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:00 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:00.710440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6a2ebf2-cd0d-49cc-b875-de95c9c843ba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.711347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6a2ebf2-cd0d-49cc-b875-de95c9c843ba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.712050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6a2ebf2-cd0d-49cc-b875-de95c9c843ba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.713081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6a2ebf2-cd0d-49cc-b875-de95c9c843ba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.713787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6a2ebf2-cd0d-49cc-b875-de95c9c843ba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.714466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6a2ebf2-cd0d-49cc-b875-de95c9c843ba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.052398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f6a2ebf2-cd0d-49cc-b875-de95c9c843ba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:01.076172 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f6a2ebf2-cd0d-49cc-b875-de95c9c843ba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 0.412980 Aug 27 05:10:01.079192 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1797/3555] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:00 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:01.153261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:01.154127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:01.164833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.166014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.166703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.167932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.168631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.169314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.354922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9349423f-562a-44b2-a7ad-7c4dc969b295 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:01.355445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9349423f-562a-44b2-a7ad-7c4dc969b295 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:01.380938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9349423f-562a-44b2-a7ad-7c4dc969b295 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.381562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9349423f-562a-44b2-a7ad-7c4dc969b295 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.383557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9349423f-562a-44b2-a7ad-7c4dc969b295 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.384596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9349423f-562a-44b2-a7ad-7c4dc969b295 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.386685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9349423f-562a-44b2-a7ad-7c4dc969b295 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.389530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9349423f-562a-44b2-a7ad-7c4dc969b295 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.464233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:01.479875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:01.481924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:01.483648 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-507a10e2-a48a-4931-8492-fc1e326acdda tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1743 microversion: 2.20 time: 0.335656 Aug 27 05:10:01.500406 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1759/3556] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:01 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1743 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:01.698603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4914e3b7-f749-413d-ba2a-9136f705ea85 req-2cbc0d29-00c0-4fce-aee3-bcdf5ef03b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee435af-d600-47a1-ae47-316d49b71aed", "tag": "4bad91fd-25bd-4e3f-b774-ae5ff30f559d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:01.732097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4914e3b7-f749-413d-ba2a-9136f705ea85 req-2cbc0d29-00c0-4fce-aee3-bcdf5ef03b65 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.746465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4914e3b7-f749-413d-ba2a-9136f705ea85 req-2cbc0d29-00c0-4fce-aee3-bcdf5ef03b65 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.746925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4914e3b7-f749-413d-ba2a-9136f705ea85 req-2cbc0d29-00c0-4fce-aee3-bcdf5ef03b65 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.792002 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4914e3b7-f749-413d-ba2a-9136f705ea85 req-2cbc0d29-00c0-4fce-aee3-bcdf5ef03b65 service nova] Creating event network-changed:4bad91fd-25bd-4e3f-b774-ae5ff30f559d for instance 9ee435af-d600-47a1-ae47-316d49b71aed on n-h2-820368-35 Aug 27 05:10:01.817991 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4914e3b7-f749-413d-ba2a-9136f705ea85 req-2cbc0d29-00c0-4fce-aee3-bcdf5ef03b65 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124177 Aug 27 05:10:01.823040 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1760/3557] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:10:01.833307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-984a9f34-32bb-4d59-baf9-82878b4bf179 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:01.839695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-984a9f34-32bb-4d59-baf9-82878b4bf179 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:01.861778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-984a9f34-32bb-4d59-baf9-82878b4bf179 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.863772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-984a9f34-32bb-4d59-baf9-82878b4bf179 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.866366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-984a9f34-32bb-4d59-baf9-82878b4bf179 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.867354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-984a9f34-32bb-4d59-baf9-82878b4bf179 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.868766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-984a9f34-32bb-4d59-baf9-82878b4bf179 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.870586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-984a9f34-32bb-4d59-baf9-82878b4bf179 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.878060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9349423f-562a-44b2-a7ad-7c4dc969b295 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:01.915326 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9349423f-562a-44b2-a7ad-7c4dc969b295 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1303 microversion: 2.1 time: 0.564739 Aug 27 05:10:01.923758 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1798/3558] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:01 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1303 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:02.110214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-99e480cd-2917-4dfc-aa6a-deef81816521 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:02.112341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-99e480cd-2917-4dfc-aa6a-deef81816521 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:02.125603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99e480cd-2917-4dfc-aa6a-deef81816521 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.126502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99e480cd-2917-4dfc-aa6a-deef81816521 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.127535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99e480cd-2917-4dfc-aa6a-deef81816521 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.129753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99e480cd-2917-4dfc-aa6a-deef81816521 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.130710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99e480cd-2917-4dfc-aa6a-deef81816521 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.132814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99e480cd-2917-4dfc-aa6a-deef81816521 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.179267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-984a9f34-32bb-4d59-baf9-82878b4bf179 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:02.195221 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-984a9f34-32bb-4d59-baf9-82878b4bf179 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1322 microversion: 2.1 time: 0.370166 Aug 27 05:10:02.196402 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1761/3559] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:01 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:02.484229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-99e480cd-2917-4dfc-aa6a-deef81816521 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:02.502862 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-99e480cd-2917-4dfc-aa6a-deef81816521 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 0.401590 Aug 27 05:10:02.509464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:02.510417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:02.516157 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1799/3560] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:02 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:02.521856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.522735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.525848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.527066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.533301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.534210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.852215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:02.863646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:02.865846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:02.868195 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-83c102a3-6876-4896-b38b-94f379bb7bc6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.362766 Aug 27 05:10:02.869388 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1762/3561] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:02 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:10:02.948105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9b633a3-51c0-4f08-84e2-7793469e6a54 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:02.948994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9b633a3-51c0-4f08-84e2-7793469e6a54 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:02.952858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:02.976338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b633a3-51c0-4f08-84e2-7793469e6a54 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.977188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b633a3-51c0-4f08-84e2-7793469e6a54 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.977901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b633a3-51c0-4f08-84e2-7793469e6a54 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.978856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b633a3-51c0-4f08-84e2-7793469e6a54 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.979595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b633a3-51c0-4f08-84e2-7793469e6a54 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.980697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b633a3-51c0-4f08-84e2-7793469e6a54 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.228053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-347973a3-c145-4760-88a5-0b169ffaa32a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:03.230693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-347973a3-c145-4760-88a5-0b169ffaa32a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:03.245077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:03.257462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-347973a3-c145-4760-88a5-0b169ffaa32a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.259032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-347973a3-c145-4760-88a5-0b169ffaa32a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.261610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-347973a3-c145-4760-88a5-0b169ffaa32a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.264389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-347973a3-c145-4760-88a5-0b169ffaa32a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.265050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-347973a3-c145-4760-88a5-0b169ffaa32a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.268217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-347973a3-c145-4760-88a5-0b169ffaa32a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.286733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f9b633a3-51c0-4f08-84e2-7793469e6a54 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:03.303480 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9b633a3-51c0-4f08-84e2-7793469e6a54 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1303 microversion: 2.1 time: 0.361252 Aug 27 05:10:03.308838 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1800/3562] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:02 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1303 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:03.539258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7342217e-e0bb-43a4-8cbe-8740bb327682 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:03.540331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7342217e-e0bb-43a4-8cbe-8740bb327682 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:03.552560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7342217e-e0bb-43a4-8cbe-8740bb327682 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.555666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7342217e-e0bb-43a4-8cbe-8740bb327682 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.556493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7342217e-e0bb-43a4-8cbe-8740bb327682 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.561219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7342217e-e0bb-43a4-8cbe-8740bb327682 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.562562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7342217e-e0bb-43a4-8cbe-8740bb327682 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.566194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7342217e-e0bb-43a4-8cbe-8740bb327682 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.702086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-347973a3-c145-4760-88a5-0b169ffaa32a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:03.723369 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-347973a3-c145-4760-88a5-0b169ffaa32a tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1516 microversion: 2.1 time: 0.494588 Aug 27 05:10:03.724574 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1763/3563] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:03 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1516 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:03.853617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=12 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:03.927810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7342217e-e0bb-43a4-8cbe-8740bb327682 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:03.946202 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7342217e-e0bb-43a4-8cbe-8740bb327682 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 0.410687 Aug 27 05:10:03.948964 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1801/3564] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:03 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:03.960332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1feb5414-c654-49bb-aace-b70c8183a0c3 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:03.970764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1feb5414-c654-49bb-aace-b70c8183a0c3 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:03.994806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1feb5414-c654-49bb-aace-b70c8183a0c3 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.996015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1feb5414-c654-49bb-aace-b70c8183a0c3 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.996469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1feb5414-c654-49bb-aace-b70c8183a0c3 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.997438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1feb5414-c654-49bb-aace-b70c8183a0c3 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.997916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1feb5414-c654-49bb-aace-b70c8183a0c3 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.999469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1feb5414-c654-49bb-aace-b70c8183a0c3 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.021266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d6e47864-835f-439c-ac85-8e715b577ab4 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:04.030965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e47864-835f-439c-ac85-8e715b577ab4 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.032514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e47864-835f-439c-ac85-8e715b577ab4 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.035015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e47864-835f-439c-ac85-8e715b577ab4 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.038230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-1feb5414-c654-49bb-aace-b70c8183a0c3 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lazy-loading 'flavor' on Instance uuid 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:10:04.038695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e47864-835f-439c-ac85-8e715b577ab4 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.039562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e47864-835f-439c-ac85-8e715b577ab4 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.041651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e47864-835f-439c-ac85-8e715b577ab4 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.210063 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d6e47864-835f-439c-ac85-8e715b577ab4 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.484305 Aug 27 05:10:04.221948 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1764/3565] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:03 2022] GET /compute/v2.1/os-services => generated 949 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:04.269610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-54f74c37-98b1-4457-9595-e7a2f6a4aef0 req-6d3363d6-df3a-4caf-a698-6e0fd7632723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d", "name": "network-vif-plugged", "status": "completed", "tag": "e65f23bf-b453-4531-8c18-55517ce62046"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:04.319526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-54f74c37-98b1-4457-9595-e7a2f6a4aef0 req-6d3363d6-df3a-4caf-a698-6e0fd7632723 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.320809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-54f74c37-98b1-4457-9595-e7a2f6a4aef0 req-6d3363d6-df3a-4caf-a698-6e0fd7632723 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.321804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-54f74c37-98b1-4457-9595-e7a2f6a4aef0 req-6d3363d6-df3a-4caf-a698-6e0fd7632723 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.335537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:04.338284 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-54f74c37-98b1-4457-9595-e7a2f6a4aef0 req-6d3363d6-df3a-4caf-a698-6e0fd7632723 service nova] Creating event network-vif-plugged:e65f23bf-b453-4531-8c18-55517ce62046 for instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d on n-h1-820368-35 Aug 27 05:10:04.344853 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-54f74c37-98b1-4457-9595-e7a2f6a4aef0 req-6d3363d6-df3a-4caf-a698-6e0fd7632723 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102826 Aug 27 05:10:04.346205 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1765/3566] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:04.352753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:04.353953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:04.361911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.362886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.363653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.364671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.365348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.366107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.408975 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1feb5414-c654-49bb-aace-b70c8183a0c3 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "POST /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9/action" status: 200 len: 32 microversion: 2.1 time: 0.458659 Aug 27 05:10:04.409605 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1802/3567] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:03 2022] POST /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9/action => generated 32 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:10:04.433140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e48ef61f-1a9e-43a7-a9dc-f069a9dc6099 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:04.457468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e48ef61f-1a9e-43a7-a9dc-f069a9dc6099 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.457967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e48ef61f-1a9e-43a7-a9dc-f069a9dc6099 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.465914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e48ef61f-1a9e-43a7-a9dc-f069a9dc6099 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.468738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e48ef61f-1a9e-43a7-a9dc-f069a9dc6099 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.469247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e48ef61f-1a9e-43a7-a9dc-f069a9dc6099 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.469696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e48ef61f-1a9e-43a7-a9dc-f069a9dc6099 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.572089 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e48ef61f-1a9e-43a7-a9dc-f069a9dc6099 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.150448 Aug 27 05:10:04.586624 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1803/3568] 10.222.0.58 () {58 vars in 1170 bytes} [Sat Aug 27 05:10:04 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:04.601257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f1ef50b6-687f-4839-82df-c53eb8f6ba7f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:04.602260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f1ef50b6-687f-4839-82df-c53eb8f6ba7f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:04.620705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1ef50b6-687f-4839-82df-c53eb8f6ba7f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.621473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1ef50b6-687f-4839-82df-c53eb8f6ba7f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.622070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1ef50b6-687f-4839-82df-c53eb8f6ba7f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.622952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1ef50b6-687f-4839-82df-c53eb8f6ba7f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.623624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1ef50b6-687f-4839-82df-c53eb8f6ba7f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.624195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1ef50b6-687f-4839-82df-c53eb8f6ba7f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.671990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:05.421540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:05.434788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:05.443115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:05.447828 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e0628fba-fb1b-45ba-8f95-5eb4e16491e6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 1.098770 Aug 27 05:10:05.468531 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1766/3569] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:04 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:05.470266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f1ef50b6-687f-4839-82df-c53eb8f6ba7f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:05.493689 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f1ef50b6-687f-4839-82df-c53eb8f6ba7f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1303 microversion: 2.1 time: 0.902220 Aug 27 05:10:05.494300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-948d94f9-cdad-4996-bfb9-0101da757593 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:05.494947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-948d94f9-cdad-4996-bfb9-0101da757593 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:05.496419 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1804/3570] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:04 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1303 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:05.511946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb6f5545-829c-4919-861b-fa58d180042e tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:05.518953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-948d94f9-cdad-4996-bfb9-0101da757593 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:05.519754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-948d94f9-cdad-4996-bfb9-0101da757593 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:05.520982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-948d94f9-cdad-4996-bfb9-0101da757593 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:05.521875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-948d94f9-cdad-4996-bfb9-0101da757593 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:05.522988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-948d94f9-cdad-4996-bfb9-0101da757593 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:05.523593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-948d94f9-cdad-4996-bfb9-0101da757593 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:05.529125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb6f5545-829c-4919-861b-fa58d180042e tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:05.531077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb6f5545-829c-4919-861b-fa58d180042e tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:05.532226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb6f5545-829c-4919-861b-fa58d180042e tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:05.533323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb6f5545-829c-4919-861b-fa58d180042e tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:05.539462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb6f5545-829c-4919-861b-fa58d180042e tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:05.540150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb6f5545-829c-4919-861b-fa58d180042e tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:05.595795 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb6f5545-829c-4919-861b-fa58d180042e tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.097347 Aug 27 05:10:05.609004 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1805/3571] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:05 2022] GET /compute/v2.1/os-services => generated 949 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:05.614285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-146f59f6-236c-431d-920a-f5c72bdb9e93 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:05.615229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-146f59f6-236c-431d-920a-f5c72bdb9e93 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:05.621961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-146f59f6-236c-431d-920a-f5c72bdb9e93 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:05.622719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-146f59f6-236c-431d-920a-f5c72bdb9e93 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:05.623980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-146f59f6-236c-431d-920a-f5c72bdb9e93 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:05.624858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-146f59f6-236c-431d-920a-f5c72bdb9e93 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:05.625454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-146f59f6-236c-431d-920a-f5c72bdb9e93 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:05.626651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-146f59f6-236c-431d-920a-f5c72bdb9e93 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.125497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-948d94f9-cdad-4996-bfb9-0101da757593 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:06.144388 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-948d94f9-cdad-4996-bfb9-0101da757593 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.674546 Aug 27 05:10:06.145266 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1767/3572] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:05 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:06.150412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ed5373c-6083-4c8b-afd4-112edc0defa0 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:06.154885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ed5373c-6083-4c8b-afd4-112edc0defa0 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.155256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ed5373c-6083-4c8b-afd4-112edc0defa0 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.163970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ed5373c-6083-4c8b-afd4-112edc0defa0 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.166187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ed5373c-6083-4c8b-afd4-112edc0defa0 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.166827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ed5373c-6083-4c8b-afd4-112edc0defa0 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.167850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ed5373c-6083-4c8b-afd4-112edc0defa0 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.232903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-146f59f6-236c-431d-920a-f5c72bdb9e93 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:06.248416 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-146f59f6-236c-431d-920a-f5c72bdb9e93 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1314 microversion: 2.1 time: 0.637716 Aug 27 05:10:06.252733 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1806/3573] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:05 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:06.263290 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6ed5373c-6083-4c8b-afd4-112edc0defa0 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-820368-35&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.111493 Aug 27 05:10:06.277510 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1768/3574] 10.222.0.58 () {58 vars in 1196 bytes} [Sat Aug 27 05:10:06 2022] GET /compute/v2.1/os-services?host=n-d-820368-35&binary=xxx => generated 16 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:10:06.283515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-79d9a3f0-5c31-4af7-bc46-d7d3d72e117a tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:06.293730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d9a3f0-5c31-4af7-bc46-d7d3d72e117a tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.305021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d9a3f0-5c31-4af7-bc46-d7d3d72e117a tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.305723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d9a3f0-5c31-4af7-bc46-d7d3d72e117a tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.306791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d9a3f0-5c31-4af7-bc46-d7d3d72e117a tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.307511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d9a3f0-5c31-4af7-bc46-d7d3d72e117a tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.307949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79d9a3f0-5c31-4af7-bc46-d7d3d72e117a tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.383258 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-79d9a3f0-5c31-4af7-bc46-d7d3d72e117a tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.103832 Aug 27 05:10:06.384732 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1807/3575] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:06.396996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-48d930e0-df52-4a3b-955f-cbf80dd1ef54 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:06.415181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48d930e0-df52-4a3b-955f-cbf80dd1ef54 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.416029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48d930e0-df52-4a3b-955f-cbf80dd1ef54 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.416818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48d930e0-df52-4a3b-955f-cbf80dd1ef54 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.421548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48d930e0-df52-4a3b-955f-cbf80dd1ef54 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.422790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48d930e0-df52-4a3b-955f-cbf80dd1ef54 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.423480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48d930e0-df52-4a3b-955f-cbf80dd1ef54 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.473223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:06.474560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:06.484634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.487746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.488824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.493998 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-48d930e0-df52-4a3b-955f-cbf80dd1ef54 tempest-ServicesAdminNegativeTestJSON-2020121110 tempest-ServicesAdminNegativeTestJSON-2020121110-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.100629 Aug 27 05:10:06.497084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.497815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.499036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.518932 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1769/3576] 10.222.0.58 () {58 vars in 1198 bytes} [Sat Aug 27 05:10:06 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:10:06.526064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-32a262a6-5e81-4695-92c0-fc5a93e54d50 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:06.527124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-32a262a6-5e81-4695-92c0-fc5a93e54d50 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:06.538972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32a262a6-5e81-4695-92c0-fc5a93e54d50 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.539858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32a262a6-5e81-4695-92c0-fc5a93e54d50 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.540492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32a262a6-5e81-4695-92c0-fc5a93e54d50 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.541454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32a262a6-5e81-4695-92c0-fc5a93e54d50 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.542577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32a262a6-5e81-4695-92c0-fc5a93e54d50 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.543254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32a262a6-5e81-4695-92c0-fc5a93e54d50 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:07.148321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:07.165876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:07.167418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:07.168747 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-11c81e22-eba4-434b-8b55-990b5664bfa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.699455 Aug 27 05:10:07.177675 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1808/3577] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:06 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:07.535543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-32a262a6-5e81-4695-92c0-fc5a93e54d50 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:07.569692 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-32a262a6-5e81-4695-92c0-fc5a93e54d50 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1303 microversion: 2.1 time: 1.049166 Aug 27 05:10:07.570288 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1770/3578] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:06 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1303 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:07.579171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b48a2b8-24aa-43a9-be2b-1fab1da7a1cc tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:07.579422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3b48a2b8-24aa-43a9-be2b-1fab1da7a1cc tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:07.586129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b48a2b8-24aa-43a9-be2b-1fab1da7a1cc tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.587350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b48a2b8-24aa-43a9-be2b-1fab1da7a1cc tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.588000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b48a2b8-24aa-43a9-be2b-1fab1da7a1cc tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:07.588921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b48a2b8-24aa-43a9-be2b-1fab1da7a1cc tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.589674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b48a2b8-24aa-43a9-be2b-1fab1da7a1cc tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.590250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b48a2b8-24aa-43a9-be2b-1fab1da7a1cc tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:07.687385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24006618-d43a-49e3-b920-4c458eb449d3 tempest-ServicesAdminNegativeTestJSON-13286692 tempest-ServicesAdminNegativeTestJSON-13286692-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:07.694587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-24006618-d43a-49e3-b920-4c458eb449d3 tempest-ServicesAdminNegativeTestJSON-13286692 tempest-ServicesAdminNegativeTestJSON-13286692-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd50f2756645c49a6ad0ae59a09b1e06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501089ed81c4429f93e010f6a03e7650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24006618-d43a-49e3-b920-4c458eb449d3 tempest-ServicesAdminNegativeTestJSON-13286692 tempest-ServicesAdminNegativeTestJSON-13286692-project] Request method failure captured: Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCacqCP9KMpXU6tnawROj1dic3aVEQeymd25Gi7MoOYOJLLM8dGJU8QKA6pud_ZppwxF_oCx9VJRQEMuk8pw6PH2ysRs1EtWfcVDdh4a-lBW2Y7cNMwVCYKbeetQnrmn-MSF8whUi6agTaoJAaoE0m_gjR77eFiDr2Q0fIc71uKy_EM8 Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 501089ed81c4429f93e010f6a03e7650 Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-13286692 Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_501089ed81c4429f93e010f6a03e7650", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/501089ed81c4429f93e010f6a03e7650"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/501089ed81c4429f93e010f6a03e7650"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/501089ed81c4429f93e010f6a03e7650"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-13286692 Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 501089ed81c4429f93e010f6a03e7650 Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-13286692 Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServicesAdminNegativeTestJSON-13286692-project Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: d50f2756645c49a6ad0ae59a09b1e06d Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-13286692-project Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: action_args: {} Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 05:10:07.698271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24006618-d43a-49e3-b920-4c458eb449d3 tempest-ServicesAdminNegativeTestJSON-13286692 tempest-ServicesAdminNegativeTestJSON-13286692-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-24006618-d43a-49e3-b920-4c458eb449d3 tempest-ServicesAdminNegativeTestJSON-13286692 tempest-ServicesAdminNegativeTestJSON-13286692-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.514020 Aug 27 05:10:07.702331 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1809/3579] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:07 2022] GET /compute/v2.1/os-services => generated 112 bytes in 524 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:07.734212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0c85cd6d-d379-4005-9079-f352752aabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:07.737038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c85cd6d-d379-4005-9079-f352752aabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:07.766375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c85cd6d-d379-4005-9079-f352752aabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.769518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c85cd6d-d379-4005-9079-f352752aabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.771831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c85cd6d-d379-4005-9079-f352752aabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:07.774901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c85cd6d-d379-4005-9079-f352752aabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.780653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c85cd6d-d379-4005-9079-f352752aabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.783665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c85cd6d-d379-4005-9079-f352752aabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.298733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3b48a2b8-24aa-43a9-be2b-1fab1da7a1cc tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:08.316684 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3b48a2b8-24aa-43a9-be2b-1fab1da7a1cc tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.745314 Aug 27 05:10:08.317273 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1771/3580] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:07 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:08.321952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:08.322578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:08.334712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0c85cd6d-d379-4005-9079-f352752aabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:08.340944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.342269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.342879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.345503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.346275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.346901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.399474 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0c85cd6d-d379-4005-9079-f352752aabf2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1501 microversion: 2.1 time: 0.693918 Aug 27 05:10:08.400705 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1810/3581] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:07 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1501 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:08.422643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-385c5e52-cb42-4f23-bbb4-5efaa9d21d0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:08.424317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-385c5e52-cb42-4f23-bbb4-5efaa9d21d0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:08.442579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-385c5e52-cb42-4f23-bbb4-5efaa9d21d0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.449303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-385c5e52-cb42-4f23-bbb4-5efaa9d21d0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.450503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-385c5e52-cb42-4f23-bbb4-5efaa9d21d0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.454941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-385c5e52-cb42-4f23-bbb4-5efaa9d21d0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.456251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-385c5e52-cb42-4f23-bbb4-5efaa9d21d0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.459370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-385c5e52-cb42-4f23-bbb4-5efaa9d21d0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.514560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-385c5e52-cb42-4f23-bbb4-5efaa9d21d0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lazy-loading 'flavor' on Instance uuid e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:10:08.681738 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-385c5e52-cb42-4f23-bbb4-5efaa9d21d0d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "POST /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d/action" status: 202 len: 0 microversion: 2.1 time: 0.262806 Aug 27 05:10:08.685026 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1811/3582] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:08 2022] POST /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:10:08.706337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9bed131b-f6a1-458f-9884-9f6f377a8b66 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:08.710910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9bed131b-f6a1-458f-9884-9f6f377a8b66 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:08.731275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bed131b-f6a1-458f-9884-9f6f377a8b66 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.735025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bed131b-f6a1-458f-9884-9f6f377a8b66 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.736320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bed131b-f6a1-458f-9884-9f6f377a8b66 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.738482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bed131b-f6a1-458f-9884-9f6f377a8b66 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.740857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bed131b-f6a1-458f-9884-9f6f377a8b66 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.742266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bed131b-f6a1-458f-9884-9f6f377a8b66 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.850265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:08.880936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:08.894064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:08.895498 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c64e55d6-f33f-47f2-91ef-6fc7c12ca318 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.577134 Aug 27 05:10:08.905123 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1772/3583] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:08 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:08.942673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab2592d2-b841-4af1-9feb-41cd060a2bd3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:08.946221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ab2592d2-b841-4af1-9feb-41cd060a2bd3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:08.966271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2592d2-b841-4af1-9feb-41cd060a2bd3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.966864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2592d2-b841-4af1-9feb-41cd060a2bd3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.968258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2592d2-b841-4af1-9feb-41cd060a2bd3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.969009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2592d2-b841-4af1-9feb-41cd060a2bd3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.971558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2592d2-b841-4af1-9feb-41cd060a2bd3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.972035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab2592d2-b841-4af1-9feb-41cd060a2bd3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:09.456600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ab2592d2-b841-4af1-9feb-41cd060a2bd3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:09.465063 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ab2592d2-b841-4af1-9feb-41cd060a2bd3 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1509 microversion: 2.1 time: 0.540110 Aug 27 05:10:09.474584 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1773/3584] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:08 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:09.484070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a01d9673-1ee9-425c-a5e1-a11c114bf171 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:09.484702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a01d9673-1ee9-425c-a5e1-a11c114bf171 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:09.491947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9bed131b-f6a1-458f-9884-9f6f377a8b66 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:09.500442 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9bed131b-f6a1-458f-9884-9f6f377a8b66 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1291 microversion: 2.1 time: 0.813363 Aug 27 05:10:09.501032 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1812/3585] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:08 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1291 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:09.507410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a01d9673-1ee9-425c-a5e1-a11c114bf171 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:09.510213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a01d9673-1ee9-425c-a5e1-a11c114bf171 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:09.510838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a01d9673-1ee9-425c-a5e1-a11c114bf171 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:09.511785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a01d9673-1ee9-425c-a5e1-a11c114bf171 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:09.512399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a01d9673-1ee9-425c-a5e1-a11c114bf171 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:09.513006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a01d9673-1ee9-425c-a5e1-a11c114bf171 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:09.755277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a01d9673-1ee9-425c-a5e1-a11c114bf171 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:09.775907 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a01d9673-1ee9-425c-a5e1-a11c114bf171 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.307493 Aug 27 05:10:09.802110 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1774/3586] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:09 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:09.933750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:09.934648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:09.943907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:09.945667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:09.947724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:09.950083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:09.950651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:09.952314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:10.399859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:10.410305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:10.413438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:10.419315 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-45881da9-9a9f-4600-9f5d-161d036e2ab2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.489622 Aug 27 05:10:10.420165 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1813/3587] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:09 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:10.487802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b04909b7-1a23-4af8-93c8-a2617e15370d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:10.495421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b04909b7-1a23-4af8-93c8-a2617e15370d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:10.516950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b04909b7-1a23-4af8-93c8-a2617e15370d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:10.517477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b04909b7-1a23-4af8-93c8-a2617e15370d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:10.517934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b04909b7-1a23-4af8-93c8-a2617e15370d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:10.518694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b04909b7-1a23-4af8-93c8-a2617e15370d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:10.519210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b04909b7-1a23-4af8-93c8-a2617e15370d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:10.519708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b04909b7-1a23-4af8-93c8-a2617e15370d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:10.530602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-424d6516-28dd-459f-899a-3630db7399b5 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:10.531532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-424d6516-28dd-459f-899a-3630db7399b5 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:10.541475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-424d6516-28dd-459f-899a-3630db7399b5 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:10.544943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-424d6516-28dd-459f-899a-3630db7399b5 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:10.545669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-424d6516-28dd-459f-899a-3630db7399b5 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:10.553448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-424d6516-28dd-459f-899a-3630db7399b5 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:10.557574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-424d6516-28dd-459f-899a-3630db7399b5 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:10.561291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-424d6516-28dd-459f-899a-3630db7399b5 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.324995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b04909b7-1a23-4af8-93c8-a2617e15370d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:11.340261 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b04909b7-1a23-4af8-93c8-a2617e15370d tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1492 microversion: 2.1 time: 0.856789 Aug 27 05:10:11.342131 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1775/3588] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:10 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1492 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:11.353017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c9cd0a25-e470-42c9-8c9e-7f44840ae9d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:11.353978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c9cd0a25-e470-42c9-8c9e-7f44840ae9d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:11.380645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9cd0a25-e470-42c9-8c9e-7f44840ae9d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.381188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9cd0a25-e470-42c9-8c9e-7f44840ae9d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.381861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9cd0a25-e470-42c9-8c9e-7f44840ae9d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.382910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9cd0a25-e470-42c9-8c9e-7f44840ae9d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.383543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9cd0a25-e470-42c9-8c9e-7f44840ae9d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.384272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9cd0a25-e470-42c9-8c9e-7f44840ae9d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.465315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-424d6516-28dd-459f-899a-3630db7399b5 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:11.489569 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-424d6516-28dd-459f-899a-3630db7399b5 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1291 microversion: 2.1 time: 0.964646 Aug 27 05:10:11.499221 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1814/3589] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:10 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1291 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:11.523229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97e38eb8-5f7a-4a75-a454-c26bc9645df4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:11.523863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97e38eb8-5f7a-4a75-a454-c26bc9645df4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:11.544555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97e38eb8-5f7a-4a75-a454-c26bc9645df4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.550523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97e38eb8-5f7a-4a75-a454-c26bc9645df4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.553303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97e38eb8-5f7a-4a75-a454-c26bc9645df4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.556977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97e38eb8-5f7a-4a75-a454-c26bc9645df4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.558600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97e38eb8-5f7a-4a75-a454-c26bc9645df4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.560849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97e38eb8-5f7a-4a75-a454-c26bc9645df4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.647884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97e38eb8-5f7a-4a75-a454-c26bc9645df4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:10:11.810048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c9cd0a25-e470-42c9-8c9e-7f44840ae9d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:11.846822 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c9cd0a25-e470-42c9-8c9e-7f44840ae9d4 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.498711 Aug 27 05:10:11.848273 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1776/3590] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:11 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:11.860592 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-97e38eb8-5f7a-4a75-a454-c26bc9645df4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 204 len: 0 microversion: 2.1 time: 0.361436 Aug 27 05:10:11.865591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:11.868776 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1815/3591] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:11 2022] DELETE /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:10:11.869216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:11.875166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.875711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.876101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.878710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.879694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.880136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:12.130852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1511518262", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "736e8739-835a-43b2-8287-8468622c7c23"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:12.145251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:12.159930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:12.166283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:12.169958 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9c006562-1547-49ef-ab4e-9e5a0ffd7922 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.320242 Aug 27 05:10:12.174063 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1777/3592] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:11 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:12.208125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-09e2bf60-d7f3-4047-bb49-8b154476fa35 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:12.211934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-09e2bf60-d7f3-4047-bb49-8b154476fa35 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:12.230587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09e2bf60-d7f3-4047-bb49-8b154476fa35 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:12.231129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09e2bf60-d7f3-4047-bb49-8b154476fa35 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:12.231584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09e2bf60-d7f3-4047-bb49-8b154476fa35 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:12.232936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09e2bf60-d7f3-4047-bb49-8b154476fa35 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:12.233398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09e2bf60-d7f3-4047-bb49-8b154476fa35 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:12.233826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09e2bf60-d7f3-4047-bb49-8b154476fa35 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:12.267268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] validate_networks() for [('736e8739-835a-43b2-8287-8468622c7c23', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:10:12.601993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-09e2bf60-d7f3-4047-bb49-8b154476fa35 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:12.630541 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-09e2bf60-d7f3-4047-bb49-8b154476fa35 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1498 microversion: 2.1 time: 0.438162 Aug 27 05:10:12.646790 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1778/3593] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:12 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1498 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:12.898370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df96bcc0-f93f-48fc-8386-9b05fc455fed tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:12.925967 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df96bcc0-f93f-48fc-8386-9b05fc455fed tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.287251 Aug 27 05:10:12.926751 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1779/3594] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:12.931810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5be2baed-fa05-467d-898b-3019e1cbaafa tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:12.934018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5be2baed-fa05-467d-898b-3019e1cbaafa tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:12.942156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be2baed-fa05-467d-898b-3019e1cbaafa tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:12.942813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be2baed-fa05-467d-898b-3019e1cbaafa tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:12.943475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be2baed-fa05-467d-898b-3019e1cbaafa tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:12.948618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be2baed-fa05-467d-898b-3019e1cbaafa tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:12.949350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be2baed-fa05-467d-898b-3019e1cbaafa tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:12.950679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be2baed-fa05-467d-898b-3019e1cbaafa tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.111237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:10:13.112319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:10:13.112810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:10:13.113488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:10:13.114052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:10:13.141870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:13.142303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:13.142768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.143561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:13.144025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:13.144456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.163349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5be2baed-fa05-467d-898b-3019e1cbaafa tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:13.172888 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5be2baed-fa05-467d-898b-3019e1cbaafa tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1291 microversion: 2.1 time: 0.244900 Aug 27 05:10:13.176500 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1780/3595] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:12 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1291 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:13.188732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f6c32dd-aa33-462e-ac5b-9197c3d55ee1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:13.189708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0f6c32dd-aa33-462e-ac5b-9197c3d55ee1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:13.200617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Getting quotas for project d4dc3cb1dbf34bd1ad7f11a9e7e12f68. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:10:13.206469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f6c32dd-aa33-462e-ac5b-9197c3d55ee1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:13.207419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f6c32dd-aa33-462e-ac5b-9197c3d55ee1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:13.209627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f6c32dd-aa33-462e-ac5b-9197c3d55ee1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.211866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f6c32dd-aa33-462e-ac5b-9197c3d55ee1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:13.213685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f6c32dd-aa33-462e-ac5b-9197c3d55ee1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:13.214229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Getting quotas for user 8ac7db72de964accbb4f9a7084fb049f and project d4dc3cb1dbf34bd1ad7f11a9e7e12f68. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:10:13.215146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f6c32dd-aa33-462e-ac5b-9197c3d55ee1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.233790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:10:13.237554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:10:13.324868 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad983c6f-4df1-4b6f-a3b0-44ecf298a608 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457269 Aug 27 05:10:13.328791 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1816/3596] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:10:13.345126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4468f929-02dd-4002-9c19-f0cd7da5f733 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:13.423142 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4468f929-02dd-4002-9c19-f0cd7da5f733 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.090014 Aug 27 05:10:13.423960 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1817/3597] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 05:10:13 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:13.447385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:13.452208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:13.461948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:13.468505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:13.469336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.470270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:13.471634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:13.475529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.508400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0f6c32dd-aa33-462e-ac5b-9197c3d55ee1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:13.518839 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f6c32dd-aa33-462e-ac5b-9197c3d55ee1 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.340743 Aug 27 05:10:13.523781 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1781/3598] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:13 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:13.542100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-32fbd51a-01c3-4e5d-9c96-ceb5b48f68b2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:13.543455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-32fbd51a-01c3-4e5d-9c96-ceb5b48f68b2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:13.735977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:13.748924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-32fbd51a-01c3-4e5d-9c96-ceb5b48f68b2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:13.758608 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-32fbd51a-01c3-4e5d-9c96-ceb5b48f68b2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1225 microversion: 2.1 time: 0.229999 Aug 27 05:10:13.761969 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1782/3599] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:13 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1225 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:13.775627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:13.780935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-86722de8-243b-4f41-a205-e767aa388684 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:13.783423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:13.784910 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cf1a0f9f-e6cb-49e7-a457-64bdbaf9499f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.348756 Aug 27 05:10:13.799908 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1818/3600] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:13 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:13.816188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-48ca01bd-24c2-4672-8ae1-3138c836feba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:13.822166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-48ca01bd-24c2-4672-8ae1-3138c836feba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:13.826724 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-86722de8-243b-4f41-a205-e767aa388684 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.049575 Aug 27 05:10:13.844051 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1783/3601] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:13.851298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48ca01bd-24c2-4672-8ae1-3138c836feba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:13.853585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2351fdf0-6ad1-4522-911a-856f1326b0d8 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:13.854517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48ca01bd-24c2-4672-8ae1-3138c836feba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:13.855056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48ca01bd-24c2-4672-8ae1-3138c836feba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.855933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48ca01bd-24c2-4672-8ae1-3138c836feba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:13.856511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48ca01bd-24c2-4672-8ae1-3138c836feba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:13.859232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48ca01bd-24c2-4672-8ae1-3138c836feba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.888420 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2351fdf0-6ad1-4522-911a-856f1326b0d8 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042792 Aug 27 05:10:13.895513 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1784/3602] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:13.905278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2dfc767-18fa-4ae2-9bdf-d03230ab894f tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.007248 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2dfc767-18fa-4ae2-9bdf-d03230ab894f tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.106863 Aug 27 05:10:14.025026 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1785/3603] 10.222.0.58 () {58 vars in 1165 bytes} [Sat Aug 27 05:10:13 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:14.040114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-89403b95-e8db-45bf-bf04-0e988a0cc493 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.054388 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-89403b95-e8db-45bf-bf04-0e988a0cc493 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019000 Aug 27 05:10:14.054989 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1786/3604] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:10:14.067137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ca7b3fb-b11a-4e72-9939-65e0f4775573 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.145344 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6ca7b3fb-b11a-4e72-9939-65e0f4775573 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.082056 Aug 27 05:10:14.146004 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1787/3605] 10.222.0.58 () {58 vars in 1169 bytes} [Sat Aug 27 05:10:14 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:14.162962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7edc1a54-d121-4628-a783-8d4b707c7817 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.184877 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7edc1a54-d121-4628-a783-8d4b707c7817 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.025856 Aug 27 05:10:14.193688 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1788/3606] 10.222.0.58 () {58 vars in 1161 bytes} [Sat Aug 27 05:10:14 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:10:14.201880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9727895e-0830-4b22-a708-4c794cf52ad4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.202853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9727895e-0830-4b22-a708-4c794cf52ad4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:14.222226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9727895e-0830-4b22-a708-4c794cf52ad4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:14.224662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-48ca01bd-24c2-4672-8ae1-3138c836feba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:14.225212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9727895e-0830-4b22-a708-4c794cf52ad4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:14.229067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9727895e-0830-4b22-a708-4c794cf52ad4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:14.229898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9727895e-0830-4b22-a708-4c794cf52ad4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:14.234915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9727895e-0830-4b22-a708-4c794cf52ad4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:14.236699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9727895e-0830-4b22-a708-4c794cf52ad4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:14.253947 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-48ca01bd-24c2-4672-8ae1-3138c836feba tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1498 microversion: 2.1 time: 0.452485 Aug 27 05:10:14.254538 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1819/3607] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:13 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1498 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:14.260570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-05c9d2c3-d19e-4190-9250-bfd28081a2e8 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.353065 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-05c9d2c3-d19e-4190-9250-bfd28081a2e8 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.068885 Aug 27 05:10:14.356857 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1820/3608] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:14.365848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f85b530-a60f-4244-a1ea-bd685b203970 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.649330 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f85b530-a60f-4244-a1ea-bd685b203970 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.284247 Aug 27 05:10:14.654032 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1821/3609] 10.222.0.58 () {58 vars in 1167 bytes} [Sat Aug 27 05:10:14 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:14.655443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9727895e-0830-4b22-a708-4c794cf52ad4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:14.668695 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9727895e-0830-4b22-a708-4c794cf52ad4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1291 microversion: 2.1 time: 0.470540 Aug 27 05:10:14.672398 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1789/3610] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:14 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1291 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:14.684054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ee67947-c20b-4da4-a453-62703a312d8f tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.685589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae7e9d5f-73a0-43a7-8336-3c67ae5afd3b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.687262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae7e9d5f-73a0-43a7-8336-3c67ae5afd3b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:14.695321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d5f-73a0-43a7-8336-3c67ae5afd3b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:14.696545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d5f-73a0-43a7-8336-3c67ae5afd3b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:14.697545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d5f-73a0-43a7-8336-3c67ae5afd3b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:14.698932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d5f-73a0-43a7-8336-3c67ae5afd3b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:14.699962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d5f-73a0-43a7-8336-3c67ae5afd3b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:14.701345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d5f-73a0-43a7-8336-3c67ae5afd3b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:14.703145 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3ee67947-c20b-4da4-a453-62703a312d8f tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029265 Aug 27 05:10:14.707480 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1790/3611] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:14.728981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a83c56ac-0749-42b2-9615-611bca895f47 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.804953 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a83c56ac-0749-42b2-9615-611bca895f47 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.091309 Aug 27 05:10:14.806756 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1791/3612] 10.222.0.58 () {58 vars in 1144 bytes} [Sat Aug 27 05:10:14 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:14.813916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2ec5cd8d-33e9-4a4a-808a-090653a7f13e tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.817268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2ec5cd8d-33e9-4a4a-808a-090653a7f13e tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:14.825257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ec5cd8d-33e9-4a4a-808a-090653a7f13e tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:14.829974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ec5cd8d-33e9-4a4a-808a-090653a7f13e tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:14.830980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ec5cd8d-33e9-4a4a-808a-090653a7f13e tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:14.831952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ec5cd8d-33e9-4a4a-808a-090653a7f13e tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:14.833234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ec5cd8d-33e9-4a4a-808a-090653a7f13e tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:14.835584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ec5cd8d-33e9-4a4a-808a-090653a7f13e tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:15.125531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2ec5cd8d-33e9-4a4a-808a-090653a7f13e tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:15.138013 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2ec5cd8d-33e9-4a4a-808a-090653a7f13e tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1229 microversion: 2.1 time: 0.327400 Aug 27 05:10:15.139939 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1792/3613] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:14 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1229 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:15.161416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:15.162420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:15.171748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:15.172500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:15.173127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:15.174853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:15.175521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:15.176643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:15.214180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae7e9d5f-73a0-43a7-8336-3c67ae5afd3b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:15.237332 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae7e9d5f-73a0-43a7-8336-3c67ae5afd3b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.580649 Aug 27 05:10:15.243348 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1822/3614] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:14 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:15.259338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-186f5a63-9a00-44cf-9d74-6ff7b007a14f tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:15.296543 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-186f5a63-9a00-44cf-9d74-6ff7b007a14f tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051780 Aug 27 05:10:15.296963 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1823/3615] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:15.328122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-fa14bb88-61e4-4e4b-8650-9857a0c39d07 req-30a129b7-27d2-4d4d-ad51-ee26365b6c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d", "name": "network-vif-deleted", "tag": "e65f23bf-b453-4531-8c18-55517ce62046"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:15.362787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fa14bb88-61e4-4e4b-8650-9857a0c39d07 req-30a129b7-27d2-4d4d-ad51-ee26365b6c75 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:15.365665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fa14bb88-61e4-4e4b-8650-9857a0c39d07 req-30a129b7-27d2-4d4d-ad51-ee26365b6c75 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:15.366991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fa14bb88-61e4-4e4b-8650-9857a0c39d07 req-30a129b7-27d2-4d4d-ad51-ee26365b6c75 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:15.429532 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-fa14bb88-61e4-4e4b-8650-9857a0c39d07 req-30a129b7-27d2-4d4d-ad51-ee26365b6c75 service nova] Creating event network-vif-deleted:e65f23bf-b453-4531-8c18-55517ce62046 for instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d on n-h1-820368-35 Aug 27 05:10:15.446273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:15.450652 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-fa14bb88-61e4-4e4b-8650-9857a0c39d07 req-30a129b7-27d2-4d4d-ad51-ee26365b6c75 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133982 Aug 27 05:10:15.462230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:15.473272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:15.475029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:15.476461 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2f9df89f-9a1c-439e-a223-83f08a4abc12 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.333323 Aug 27 05:10:15.478679 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1793/3616] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:15 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:15.479213 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1824/3617] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:15.494568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:15.495584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:15.497100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e70ea2b-88e2-4d56-81d4-e61683b67afe tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:15.504650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:15.506503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:15.512095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:15.513161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:15.513878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:15.514528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:15.565958 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e70ea2b-88e2-4d56-81d4-e61683b67afe tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.085237 Aug 27 05:10:15.587014 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1825/3618] 10.222.0.58 () {58 vars in 1148 bytes} [Sat Aug 27 05:10:15 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:15.587720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:15.587720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:15.587720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:15.587720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lazy-loading 'fault' on Instance uuid e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:10:15.594977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-efabdf11-86ad-452f-a637-8c49d3ab8f37 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:15.621199 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-efabdf11-86ad-452f-a637-8c49d3ab8f37 tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.031664 Aug 27 05:10:15.622502 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1826/3619] 10.222.0.58 () {58 vars in 1140 bytes} [Sat Aug 27 05:10:15 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:10:15.641598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d80c5c45-dd11-4be2-b6e2-879ad568201e tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:15.660402 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d80c5c45-dd11-4be2-b6e2-879ad568201e tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029824 Aug 27 05:10:15.667051 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1827/3620] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:15.692756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6bc3d6bc-dad9-4aa1-9164-5dc97cbab3de tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:15.692959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ae5460271c4f5291e6abb0e76cab17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a5e22135444607952f11ff576a5cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:15.711059 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed32e500-71bc-404b-bff3-e73824e98813 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 200 len: 1304 microversion: 2.1 time: 0.220614 Aug 27 05:10:15.711952 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1794/3621] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:15 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 1304 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:15.719026 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6bc3d6bc-dad9-4aa1-9164-5dc97cbab3de tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.045223 Aug 27 05:10:15.720293 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1828/3622] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 05:10:15 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:15.732913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ce41a30c-cbc3-4460-8b4c-5449cc9892a2 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:15.733544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ce41a30c-cbc3-4460-8b4c-5449cc9892a2 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:15.736561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b9822fbd-5d64-4108-81c8-d5621a6cf07d tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:15.740251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce41a30c-cbc3-4460-8b4c-5449cc9892a2 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:15.741174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce41a30c-cbc3-4460-8b4c-5449cc9892a2 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:15.741739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce41a30c-cbc3-4460-8b4c-5449cc9892a2 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:15.742616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce41a30c-cbc3-4460-8b4c-5449cc9892a2 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:15.743422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce41a30c-cbc3-4460-8b4c-5449cc9892a2 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:15.745401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce41a30c-cbc3-4460-8b4c-5449cc9892a2 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:15.775533 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b9822fbd-5d64-4108-81c8-d5621a6cf07d tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045638 Aug 27 05:10:15.778488 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1829/3623] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 05:10:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:15.794390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ac58202-c5d3-4a0c-938c-ef19c2cbecef tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:15.806357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:15.811358 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5ac58202-c5d3-4a0c-938c-ef19c2cbecef tempest-FlavorsV2TestJSON-1120191023 tempest-FlavorsV2TestJSON-1120191023-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021395 Aug 27 05:10:15.814915 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1830/3624] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:10:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:16.019201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ce41a30c-cbc3-4460-8b4c-5449cc9892a2 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:16.035717 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ce41a30c-cbc3-4460-8b4c-5449cc9892a2 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1291 microversion: 2.1 time: 0.322453 Aug 27 05:10:16.050163 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1795/3625] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:15 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1291 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:16.173532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2af9f7f9-207b-4b57-b38e-8875b602307d tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:16.179107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2af9f7f9-207b-4b57-b38e-8875b602307d tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:16.196745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af9f7f9-207b-4b57-b38e-8875b602307d tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.196745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af9f7f9-207b-4b57-b38e-8875b602307d tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.197382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af9f7f9-207b-4b57-b38e-8875b602307d tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.198350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af9f7f9-207b-4b57-b38e-8875b602307d tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.199264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af9f7f9-207b-4b57-b38e-8875b602307d tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.200628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af9f7f9-207b-4b57-b38e-8875b602307d tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.257201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:16.271558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-127ac512-e192-401c-82bf-9d51d91864ee tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:16.273156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-127ac512-e192-401c-82bf-9d51d91864ee tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:16.288942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-127ac512-e192-401c-82bf-9d51d91864ee tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.289683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-127ac512-e192-401c-82bf-9d51d91864ee tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.290307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-127ac512-e192-401c-82bf-9d51d91864ee tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.292066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-127ac512-e192-401c-82bf-9d51d91864ee tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.296115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-127ac512-e192-401c-82bf-9d51d91864ee tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.297271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-127ac512-e192-401c-82bf-9d51d91864ee tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.452128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:16.484080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2af9f7f9-207b-4b57-b38e-8875b602307d tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:16.501249 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2af9f7f9-207b-4b57-b38e-8875b602307d tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1277 microversion: 2.1 time: 0.344110 Aug 27 05:10:16.538918 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1831/3626] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:16 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1277 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:16.578181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:16.580345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:16.602264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.604113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.604577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.617963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.618616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.621861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.706793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-127ac512-e192-401c-82bf-9d51d91864ee tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:16.718007 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-127ac512-e192-401c-82bf-9d51d91864ee tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.451765 Aug 27 05:10:16.719743 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1796/3627] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:16 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:16.743603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:16.744425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:16.764590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.771760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.773252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.774179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.781545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.782138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.843602 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d HTTP/1.1 Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d'} Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:16.848249 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.851879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:16.851879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:16.851879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:16.851879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:16.851879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:16.851879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.851879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.863614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:16.869030 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d3c91b4d-24fd-4602-8313-250108e0cabe tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 404 len: 111 microversion: 2.1 time: 0.127490 Aug 27 05:10:16.870154 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1797/3628] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:16 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:16.888719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:16.892186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:16.902451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.903357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.904180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.914660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.917260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.919127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.936384 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d HTTP/1.1 Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d'} Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:16.938526 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:16.943050 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.943050 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.943050 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:16.943050 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.943050 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:16.943050 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:16.943050 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:16.943050 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:16.943050 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:16.943050 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.943050 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.943890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:16.945049 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c9e6707b-ff44-4d17-a9b5-70aa0dd31f68 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 404 len: 111 microversion: 2.1 time: 0.062894 Aug 27 05:10:16.948843 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1798/3629] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:16 2022] DELETE /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:16.954694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:16.955497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:16.965525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.966091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.967716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.968557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.969131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.969689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.988907 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d HTTP/1.1 Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d'} Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:16.990654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.994861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:16.994861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:16.994861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:16.994861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:16.994861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:16.994861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. Aug 27 05:10:16.994861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:16.995664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:16.996646 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-64ea2be7-f50d-4141-be01-e51d1b0979ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d" status: 404 len: 111 microversion: 2.1 time: 0.046572 Aug 27 05:10:17.001040 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1799/3630] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:16 2022] GET /compute/v2.1/servers/e3b5511c-e6ce-4756-a4c8-e8f7f1ccc14d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:17.005970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.006606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.016294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.018056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.018056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.018804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.019585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.020132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.037085 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 HTTP/1.1 Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '47a32c7b-9f76-488f-a8f4-06d89c55fe43'} Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:17.039191 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:17.043325 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:10:17.043325 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.043325 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.043325 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.043325 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.043325 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.043325 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.043325 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:17.043325 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:17.043325 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:10:17.043325 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.045205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:17.046365 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4321a86-f27d-4132-8446-054f8eab5ea9 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 404 len: 111 microversion: 2.1 time: 0.044080 Aug 27 05:10:17.049867 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1800/3631] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:17 2022] DELETE /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:17.051767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:17.060492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:17.062645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.062788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:17.062891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 47a32c7b-9f76-488f-a8f4-06d89c55fe43] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.063146 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d21fbc3d-97c7-4922-a646-b4e0d1bd2d53 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.506469 Aug 27 05:10:17.073171 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1832/3632] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:16 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:17.075246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.078581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.079198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.082622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.082776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-df9a99a2-65d2-42b8-8772-90fc0b8370e4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.083344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.083458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-df9a99a2-65d2-42b8-8772-90fc0b8370e4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.084077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.097888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df9a99a2-65d2-42b8-8772-90fc0b8370e4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.098390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df9a99a2-65d2-42b8-8772-90fc0b8370e4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.099322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df9a99a2-65d2-42b8-8772-90fc0b8370e4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.103375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df9a99a2-65d2-42b8-8772-90fc0b8370e4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.104120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df9a99a2-65d2-42b8-8772-90fc0b8370e4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.104755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df9a99a2-65d2-42b8-8772-90fc0b8370e4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.119689 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 HTTP/1.1 Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '47a32c7b-9f76-488f-a8f4-06d89c55fe43'} Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.122110 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.126169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.126169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.126169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.126169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:17.126169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:17.126169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. Aug 27 05:10:17.126169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.127141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance 47a32c7b-9f76-488f-a8f4-06d89c55fe43 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:17.128260 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e0281fd4-1fc0-424d-9c5b-de472f2a42d4 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43" status: 404 len: 111 microversion: 2.1 time: 0.077261 Aug 27 05:10:17.129368 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1801/3633] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:17 2022] GET /compute/v2.1/servers/47a32c7b-9f76-488f-a8f4-06d89c55fe43 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:17.139426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.142266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.158389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.161454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.161454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.165166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.165675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.166114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.204449 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 HTTP/1.1 Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '780d1d8c-aaf6-4d22-b37a-b48a881f9d77'} Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:17.206330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:17.210350 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:10:17.210350 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.210350 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.210350 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.210350 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.210350 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.210350 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.210350 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:17.210350 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:17.210350 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:10:17.210350 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.212408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:17.214139 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2988649b-cde9-4d56-a5eb-a7210fb3c5cc tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 404 len: 111 microversion: 2.1 time: 0.080504 Aug 27 05:10:17.214974 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1802/3634] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:17 2022] DELETE /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:17.226757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.229597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: 780d1d8c-aaf6-4d22-b37a-b48a881f9d77] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.246795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.247505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.247974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.248724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.249168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.249598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.272950 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 HTTP/1.1 Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '780d1d8c-aaf6-4d22-b37a-b48a881f9d77'} Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.276126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.280574 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.280574 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.280574 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.280574 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:17.280574 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:17.280574 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. Aug 27 05:10:17.280574 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.282528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance 780d1d8c-aaf6-4d22-b37a-b48a881f9d77 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:17.283612 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-123d07d6-324d-4d3e-ad7f-e9d6337e13a1 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77" status: 404 len: 111 microversion: 2.1 time: 0.063255 Aug 27 05:10:17.287936 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1803/3635] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:17 2022] GET /compute/v2.1/servers/780d1d8c-aaf6-4d22-b37a-b48a881f9d77 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:17.295503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.296228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.308372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.309139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.309738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.311641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.312403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.312989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.345166 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 HTTP/1.1 Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'b5444757-a4f6-468b-b13c-09adffde5530'} Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:17.352287 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:17.356608 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:10:17.356608 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.356608 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.356608 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.356608 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.356608 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.356608 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.356608 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:17.356608 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:17.356608 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:10:17.356608 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.359717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:17.360857 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-84c8edc7-797e-490d-8132-cfd618e1f189 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 404 len: 111 microversion: 2.1 time: 0.071647 Aug 27 05:10:17.365273 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1804/3636] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:17 2022] DELETE /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:17.378207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.379238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: b5444757-a4f6-468b-b13c-09adffde5530] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.390124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.392293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.393442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.394548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.395257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.395867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.426510 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 HTTP/1.1 Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'b5444757-a4f6-468b-b13c-09adffde5530'} Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.442377 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.448477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.448477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.448477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.448477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:17.448477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:17.448477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. Aug 27 05:10:17.448477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.452310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance b5444757-a4f6-468b-b13c-09adffde5530 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:17.453386 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-27d889a6-2490-4a24-861e-5472e9a80807 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530" status: 404 len: 111 microversion: 2.1 time: 0.087083 Aug 27 05:10:17.463438 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1805/3637] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:17 2022] GET /compute/v2.1/servers/b5444757-a4f6-468b-b13c-09adffde5530 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:17.474082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a4dccd37-2dc7-43b6-b12c-8f7024777da5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.475010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a4dccd37-2dc7-43b6-b12c-8f7024777da5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e88738cd-c485-44af-aeb4-57eb2d09b00a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.478986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-df9a99a2-65d2-42b8-8772-90fc0b8370e4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:17.485940 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a4dccd37-2dc7-43b6-b12c-8f7024777da5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a4dccd37-2dc7-43b6-b12c-8f7024777da5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a HTTP/1.1 Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e88738cd-c485-44af-aeb4-57eb2d09b00a'} Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.487879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.492263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.492263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.492263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.492263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:17.492263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:17.492263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:10:17.492263 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.495350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a4dccd37-2dc7-43b6-b12c-8f7024777da5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:17.496456 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a4dccd37-2dc7-43b6-b12c-8f7024777da5 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a" status: 404 len: 111 microversion: 2.1 time: 0.029928 Aug 27 05:10:17.498224 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-df9a99a2-65d2-42b8-8772-90fc0b8370e4 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1291 microversion: 2.1 time: 0.423873 Aug 27 05:10:17.501460 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1806/3638] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:17 2022] DELETE /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:17.502262 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1833/3639] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:17 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1291 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:17.509164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-38e42ac7-5299-49ba-988a-d69c0e44c17f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.509783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-38e42ac7-5299-49ba-988a-d69c0e44c17f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: e88738cd-c485-44af-aeb4-57eb2d09b00a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.517943 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-38e42ac7-5299-49ba-988a-d69c0e44c17f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-38e42ac7-5299-49ba-988a-d69c0e44c17f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a HTTP/1.1 Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e88738cd-c485-44af-aeb4-57eb2d09b00a'} Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:17.526142 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:17.530136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:17.530136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:17.530136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:17.530136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. Aug 27 05:10:17.530136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:17.530136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-38e42ac7-5299-49ba-988a-d69c0e44c17f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance e88738cd-c485-44af-aeb4-57eb2d09b00a could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:17.530468 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-38e42ac7-5299-49ba-988a-d69c0e44c17f tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a" status: 404 len: 111 microversion: 2.1 time: 0.025166 Aug 27 05:10:17.531618 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1807/3640] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:17 2022] GET /compute/v2.1/servers/e88738cd-c485-44af-aeb4-57eb2d09b00a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:17.542328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dfafc60b-5a17-4625-827f-be31f1fab972 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.543169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dfafc60b-5a17-4625-827f-be31f1fab972 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.551978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfafc60b-5a17-4625-827f-be31f1fab972 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.552473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfafc60b-5a17-4625-827f-be31f1fab972 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.552907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfafc60b-5a17-4625-827f-be31f1fab972 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.553612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfafc60b-5a17-4625-827f-be31f1fab972 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.558569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfafc60b-5a17-4625-827f-be31f1fab972 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.559282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfafc60b-5a17-4625-827f-be31f1fab972 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.657230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dfafc60b-5a17-4625-827f-be31f1fab972 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:17.677889 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dfafc60b-5a17-4625-827f-be31f1fab972 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1283 microversion: 2.1 time: 0.137913 Aug 27 05:10:17.698077 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1834/3641] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:17 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1283 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:17.745565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22d336a4-b702-4626-93e8-665cda59d3c5 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.746113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22d336a4-b702-4626-93e8-665cda59d3c5 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.750310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:17.769288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d336a4-b702-4626-93e8-665cda59d3c5 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.769959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d336a4-b702-4626-93e8-665cda59d3c5 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.770515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d336a4-b702-4626-93e8-665cda59d3c5 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.771407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d336a4-b702-4626-93e8-665cda59d3c5 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.771984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d336a4-b702-4626-93e8-665cda59d3c5 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.772613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d336a4-b702-4626-93e8-665cda59d3c5 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.094936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:18.095574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:18.115212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.118606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.120959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.121742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.126543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.127300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.197334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-22d336a4-b702-4626-93e8-665cda59d3c5 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:18.206945 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22d336a4-b702-4626-93e8-665cda59d3c5 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.465559 Aug 27 05:10:18.209163 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1808/3642] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:17 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:18.531206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-25b164c8-6abb-4321-bc79-4f45670550f3 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:18.533136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25b164c8-6abb-4321-bc79-4f45670550f3 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:18.556764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25b164c8-6abb-4321-bc79-4f45670550f3 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.563327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25b164c8-6abb-4321-bc79-4f45670550f3 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.567371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25b164c8-6abb-4321-bc79-4f45670550f3 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.568558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25b164c8-6abb-4321-bc79-4f45670550f3 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.570705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25b164c8-6abb-4321-bc79-4f45670550f3 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.577284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25b164c8-6abb-4321-bc79-4f45670550f3 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.647377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:18.661314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:18.669053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:18.670881 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-81b09d7a-b775-46ec-87b5-6d0f79b15779 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.585479 Aug 27 05:10:18.675458 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1835/3643] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:18 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:18.703909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-56a0d58a-a2df-4bd4-ac7e-673154b23b6b tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:18.704390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-56a0d58a-a2df-4bd4-ac7e-673154b23b6b tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:18.724870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56a0d58a-a2df-4bd4-ac7e-673154b23b6b tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.725370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56a0d58a-a2df-4bd4-ac7e-673154b23b6b tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.725810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56a0d58a-a2df-4bd4-ac7e-673154b23b6b tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.726523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56a0d58a-a2df-4bd4-ac7e-673154b23b6b tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.726973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56a0d58a-a2df-4bd4-ac7e-673154b23b6b tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.727426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56a0d58a-a2df-4bd4-ac7e-673154b23b6b tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.976810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-25b164c8-6abb-4321-bc79-4f45670550f3 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:18.995725 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-25b164c8-6abb-4321-bc79-4f45670550f3 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1291 microversion: 2.1 time: 0.471896 Aug 27 05:10:19.009299 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1809/3644] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:18 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1291 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:19.152446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-56a0d58a-a2df-4bd4-ac7e-673154b23b6b tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:19.165040 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-56a0d58a-a2df-4bd4-ac7e-673154b23b6b tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1325 microversion: 2.1 time: 0.465268 Aug 27 05:10:19.169835 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1836/3645] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:18 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1325 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:19.233998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fd51ab0f-349a-4d92-b656-396067bbc69c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:19.234983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fd51ab0f-349a-4d92-b656-396067bbc69c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:19.246381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd51ab0f-349a-4d92-b656-396067bbc69c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:19.248711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd51ab0f-349a-4d92-b656-396067bbc69c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:19.250465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd51ab0f-349a-4d92-b656-396067bbc69c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:19.252534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd51ab0f-349a-4d92-b656-396067bbc69c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:19.253070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd51ab0f-349a-4d92-b656-396067bbc69c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:19.254753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd51ab0f-349a-4d92-b656-396067bbc69c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:19.499624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6a7d5d0d-4df2-438d-9208-75b2e2bcaf09 req-06df62db-a7a8-4e1f-9443-f284a8e5b8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee435af-d600-47a1-ae47-316d49b71aed", "name": "network-vif-plugged", "status": "completed", "tag": "4bad91fd-25bd-4e3f-b774-ae5ff30f559d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:19.531341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6a7d5d0d-4df2-438d-9208-75b2e2bcaf09 req-06df62db-a7a8-4e1f-9443-f284a8e5b8a1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:19.533646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6a7d5d0d-4df2-438d-9208-75b2e2bcaf09 req-06df62db-a7a8-4e1f-9443-f284a8e5b8a1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:19.534743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6a7d5d0d-4df2-438d-9208-75b2e2bcaf09 req-06df62db-a7a8-4e1f-9443-f284a8e5b8a1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:19.569566 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6a7d5d0d-4df2-438d-9208-75b2e2bcaf09 req-06df62db-a7a8-4e1f-9443-f284a8e5b8a1 service nova] Creating event network-vif-plugged:4bad91fd-25bd-4e3f-b774-ae5ff30f559d for instance 9ee435af-d600-47a1-ae47-316d49b71aed on n-h2-820368-35 Aug 27 05:10:19.604542 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6a7d5d0d-4df2-438d-9208-75b2e2bcaf09 req-06df62db-a7a8-4e1f-9443-f284a8e5b8a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109473 Aug 27 05:10:19.609936 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1837/3646] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:19.689924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fd51ab0f-349a-4d92-b656-396067bbc69c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:19.697718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:19.698448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:19.702107 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fd51ab0f-349a-4d92-b656-396067bbc69c tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.472453 Aug 27 05:10:19.718875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:19.719404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:19.719847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:19.720571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:19.721025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:19.721150 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1810/3647] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:19 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:19.721490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.023425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-50fc0b3d-a8a6-4f7c-a124-13021513f968 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:20.024275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-50fc0b3d-a8a6-4f7c-a124-13021513f968 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:20.032495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50fc0b3d-a8a6-4f7c-a124-13021513f968 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.033247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50fc0b3d-a8a6-4f7c-a124-13021513f968 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.033838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50fc0b3d-a8a6-4f7c-a124-13021513f968 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.034790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50fc0b3d-a8a6-4f7c-a124-13021513f968 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.035469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50fc0b3d-a8a6-4f7c-a124-13021513f968 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.036204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50fc0b3d-a8a6-4f7c-a124-13021513f968 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.342503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:20.354471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:20.356128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:20.357245 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1ea4cab1-1eda-438f-b12a-e00c282d83c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.666018 Aug 27 05:10:20.360696 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1838/3648] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:19 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:10:20.372400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2cbb0190-8809-4602-9c6e-54184a659ff8 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:20.373421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2cbb0190-8809-4602-9c6e-54184a659ff8 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:20.386472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cbb0190-8809-4602-9c6e-54184a659ff8 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.393779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cbb0190-8809-4602-9c6e-54184a659ff8 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.394533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cbb0190-8809-4602-9c6e-54184a659ff8 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.395518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cbb0190-8809-4602-9c6e-54184a659ff8 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.396136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cbb0190-8809-4602-9c6e-54184a659ff8 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.396754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cbb0190-8809-4602-9c6e-54184a659ff8 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.474051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-50fc0b3d-a8a6-4f7c-a124-13021513f968 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:20.483506 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-50fc0b3d-a8a6-4f7c-a124-13021513f968 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1291 microversion: 2.1 time: 0.465309 Aug 27 05:10:20.488067 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1811/3649] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:20 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1291 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:20.512046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8af4eeb6-a0d6-4e7b-b876-92f94dc884b0 req-e1f1f4cb-35e8-4729-8236-835e1d9c4f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f7d946f-3ba2-48f9-899f-0d5ab050b72a", "tag": "e64db20b-f5e9-46c9-a96c-bf3c98452484"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:20.541477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8af4eeb6-a0d6-4e7b-b876-92f94dc884b0 req-e1f1f4cb-35e8-4729-8236-835e1d9c4f54 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.542020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8af4eeb6-a0d6-4e7b-b876-92f94dc884b0 req-e1f1f4cb-35e8-4729-8236-835e1d9c4f54 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.542665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8af4eeb6-a0d6-4e7b-b876-92f94dc884b0 req-e1f1f4cb-35e8-4729-8236-835e1d9c4f54 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.574234 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8af4eeb6-a0d6-4e7b-b876-92f94dc884b0 req-e1f1f4cb-35e8-4729-8236-835e1d9c4f54 service nova] Creating event network-changed:e64db20b-f5e9-46c9-a96c-bf3c98452484 for instance 4f7d946f-3ba2-48f9-899f-0d5ab050b72a on n-h2-820368-35 Aug 27 05:10:20.583081 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8af4eeb6-a0d6-4e7b-b876-92f94dc884b0 req-e1f1f4cb-35e8-4729-8236-835e1d9c4f54 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079152 Aug 27 05:10:20.584276 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1812/3650] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:20.693705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2cbb0190-8809-4602-9c6e-54184a659ff8 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:20.716161 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2cbb0190-8809-4602-9c6e-54184a659ff8 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1325 microversion: 2.1 time: 0.347196 Aug 27 05:10:20.719998 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1839/3651] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:20 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:20.736043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e4c669b3-6307-4e02-8b69-ede76a20837e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:20.736758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e4c669b3-6307-4e02-8b69-ede76a20837e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:20.754081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4c669b3-6307-4e02-8b69-ede76a20837e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.754605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4c669b3-6307-4e02-8b69-ede76a20837e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.755053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4c669b3-6307-4e02-8b69-ede76a20837e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.755979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4c669b3-6307-4e02-8b69-ede76a20837e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.757501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4c669b3-6307-4e02-8b69-ede76a20837e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.759821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4c669b3-6307-4e02-8b69-ede76a20837e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:21.181193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e4c669b3-6307-4e02-8b69-ede76a20837e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:21.197592 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e4c669b3-6307-4e02-8b69-ede76a20837e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.471204 Aug 27 05:10:21.200603 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1813/3652] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:20 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:21.382817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:21.384133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:21.396796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:21.400807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:21.401723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:21.404458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:21.406403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:21.407124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:21.509765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6af9bb4b-a92e-43cc-9b8d-72094ac127c1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:21.510733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6af9bb4b-a92e-43cc-9b8d-72094ac127c1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:21.520184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6af9bb4b-a92e-43cc-9b8d-72094ac127c1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:21.522614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6af9bb4b-a92e-43cc-9b8d-72094ac127c1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:21.525369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6af9bb4b-a92e-43cc-9b8d-72094ac127c1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:21.529461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6af9bb4b-a92e-43cc-9b8d-72094ac127c1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:21.535828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6af9bb4b-a92e-43cc-9b8d-72094ac127c1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:21.536598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6af9bb4b-a92e-43cc-9b8d-72094ac127c1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:21.758127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:21.767542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:21.772781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:21.776087 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0d345ded-0376-4703-8a8b-c9bbfa31b460 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.398390 Aug 27 05:10:21.790357 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1840/3653] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:21 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:21.796182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ecebceb-1f80-4148-ad13-54f241b743c1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:21.796973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ecebceb-1f80-4148-ad13-54f241b743c1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:21.804975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ecebceb-1f80-4148-ad13-54f241b743c1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:21.805824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ecebceb-1f80-4148-ad13-54f241b743c1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:21.806453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ecebceb-1f80-4148-ad13-54f241b743c1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:21.807383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ecebceb-1f80-4148-ad13-54f241b743c1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:21.807999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ecebceb-1f80-4148-ad13-54f241b743c1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:21.808612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ecebceb-1f80-4148-ad13-54f241b743c1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:21.852676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6af9bb4b-a92e-43cc-9b8d-72094ac127c1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:21.863672 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6af9bb4b-a92e-43cc-9b8d-72094ac127c1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1291 microversion: 2.1 time: 0.359101 Aug 27 05:10:21.882115 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1814/3654] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:21 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1291 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:22.074672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7ecebceb-1f80-4148-ad13-54f241b743c1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:22.083536 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ecebceb-1f80-4148-ad13-54f241b743c1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1325 microversion: 2.1 time: 0.291646 Aug 27 05:10:22.084134 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1841/3655] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:21 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1325 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:22.223552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-be0b926b-0e54-4230-8111-bbf6347c0a00 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:22.224895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-be0b926b-0e54-4230-8111-bbf6347c0a00 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:22.240580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0b926b-0e54-4230-8111-bbf6347c0a00 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:22.241089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0b926b-0e54-4230-8111-bbf6347c0a00 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:22.241536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0b926b-0e54-4230-8111-bbf6347c0a00 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:22.242272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0b926b-0e54-4230-8111-bbf6347c0a00 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:22.242906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0b926b-0e54-4230-8111-bbf6347c0a00 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:22.243556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be0b926b-0e54-4230-8111-bbf6347c0a00 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:22.799537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-be0b926b-0e54-4230-8111-bbf6347c0a00 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:22.809331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:22.810005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:22.818192 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-be0b926b-0e54-4230-8111-bbf6347c0a00 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.599022 Aug 27 05:10:22.839266 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1815/3656] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:22 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:22.840486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:22.841204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:22.842333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:22.843265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:22.843879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:22.844457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:22.890558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-16280a04-16ab-4978-a795-eb02255d1f18 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:22.891804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-16280a04-16ab-4978-a795-eb02255d1f18 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:22.898754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16280a04-16ab-4978-a795-eb02255d1f18 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:22.899531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16280a04-16ab-4978-a795-eb02255d1f18 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:22.900761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16280a04-16ab-4978-a795-eb02255d1f18 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:22.901680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16280a04-16ab-4978-a795-eb02255d1f18 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:22.902302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16280a04-16ab-4978-a795-eb02255d1f18 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:22.902892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16280a04-16ab-4978-a795-eb02255d1f18 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:23.173077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:23.225082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:23.602358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:23.612692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:23.617145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:23.619713 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-09e821bd-58eb-447b-811b-74e7d1724594 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.814282 Aug 27 05:10:23.621443 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1842/3657] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:22 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:23.639492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b6475afe-b932-4608-9a03-56f4038851e0 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:23.640438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b6475afe-b932-4608-9a03-56f4038851e0 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:23.657055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6475afe-b932-4608-9a03-56f4038851e0 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:23.657807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6475afe-b932-4608-9a03-56f4038851e0 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:23.658405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6475afe-b932-4608-9a03-56f4038851e0 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:23.659555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6475afe-b932-4608-9a03-56f4038851e0 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:23.660356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6475afe-b932-4608-9a03-56f4038851e0 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:23.660942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6475afe-b932-4608-9a03-56f4038851e0 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:23.681684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-16280a04-16ab-4978-a795-eb02255d1f18 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:23.690974 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-16280a04-16ab-4978-a795-eb02255d1f18 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1482 microversion: 2.1 time: 0.804863 Aug 27 05:10:23.711535 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1816/3658] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:22 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1482 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:23.725918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:23.726431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:23.750306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:23.756752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:23.765070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:23.767906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:23.771792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:23.773623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:23.796815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:23.846774 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d HTTP/1.1 Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'ea714cda-ef28-4c42-9836-7dd70dcc4f4d'} Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:23.859067 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:23.863404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:23.864879 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-308b32a7-7190-49f4-8c4c-1f514cfb15ea tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 404 len: 111 microversion: 2.1 time: 0.151157 Aug 27 05:10:23.870030 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1817/3659] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:23 2022] DELETE /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:23.880711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-66c175be-f9cb-40a2-ad04-0908f6420610 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:23.881330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-66c175be-f9cb-40a2-ad04-0908f6420610 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:23.898035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66c175be-f9cb-40a2-ad04-0908f6420610 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:23.898638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66c175be-f9cb-40a2-ad04-0908f6420610 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:23.900620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66c175be-f9cb-40a2-ad04-0908f6420610 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:23.901474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66c175be-f9cb-40a2-ad04-0908f6420610 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:23.906546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66c175be-f9cb-40a2-ad04-0908f6420610 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:23.907644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66c175be-f9cb-40a2-ad04-0908f6420610 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:24.110796 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-66c175be-f9cb-40a2-ad04-0908f6420610 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.239443 Aug 27 05:10:24.119738 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1818/3660] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:10:23 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed/os-interface => generated 284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:24.125428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3db95453-5759-4a8d-b82b-be60f476b319 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:24.126264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3db95453-5759-4a8d-b82b-be60f476b319 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:24.133502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db95453-5759-4a8d-b82b-be60f476b319 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:24.134564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db95453-5759-4a8d-b82b-be60f476b319 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:24.135294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db95453-5759-4a8d-b82b-be60f476b319 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:24.136232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db95453-5759-4a8d-b82b-be60f476b319 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:24.136930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db95453-5759-4a8d-b82b-be60f476b319 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:24.137593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db95453-5759-4a8d-b82b-be60f476b319 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:24.221970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b6475afe-b932-4608-9a03-56f4038851e0 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:24.237289 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b6475afe-b932-4608-9a03-56f4038851e0 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1325 microversion: 2.1 time: 0.614347 Aug 27 05:10:24.240672 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1843/3661] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:23 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1325 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:24.262857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:24.266050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: ea714cda-ef28-4c42-9836-7dd70dcc4f4d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:24.291799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:24.292727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:24.294734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:24.296703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:24.298910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:24.299971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:24.335653 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d HTTP/1.1 Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'ea714cda-ef28-4c42-9836-7dd70dcc4f4d'} Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:24.337830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.342706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:24.342706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:24.342706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:24.342706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:24.342706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:24.342706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. Aug 27 05:10:24.342706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.344475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance ea714cda-ef28-4c42-9836-7dd70dcc4f4d could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:24.345785 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d25a3352-a82c-43df-be9d-27a2ec2a1b49 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d" status: 404 len: 111 microversion: 2.1 time: 0.100355 Aug 27 05:10:24.346663 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1844/3662] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:24 2022] GET /compute/v2.1/servers/ea714cda-ef28-4c42-9836-7dd70dcc4f4d => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:24.360000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:24.368786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:24.390784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:24.391366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:24.391819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:24.392559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:24.393018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:24.393456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:24.428116 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d HTTP/1.1 Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'afb77376-d3d6-410b-b281-9d39ea7ccd3d'} Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:24.429706 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.433833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:24.435428 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c84ab34-c02a-4e69-9c7f-57ff24405634 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "DELETE /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 404 len: 111 microversion: 2.1 time: 0.076395 Aug 27 05:10:24.440127 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1845/3663] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:24 2022] DELETE /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:24.449514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:24.457766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] [instance: afb77376-d3d6-410b-b281-9d39ea7ccd3d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:24.474036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:24.478381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:24.479027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:24.479939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:24.480576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:24.481150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:24.533347 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] HTTP exception thrown: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Request method failure captured: Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d HTTP/1.1 Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaXzlAMgk44cPbT0t4csJKnR48QPNEKe_ndp3HNJkWHljnOlzoxA6xI7Ywp4L99fiCYJTcUTFa0-5tyDEzoj-jrQCZRjpMm36owaudvZWnK_UdGO7i_FMNd_3g7ejU1DO-MAAHmZbl6lrObNt_zlzknyrWTHfRRYprOArUYO98a7JSI Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50a5e22135444607952f11ff576a5cbc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50a5e22135444607952f11ff576a5cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 50a5e22135444607952f11ff576a5cbc Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-DeleteServersTestJSON-106764487 Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: d3ae5460271c4f5291e6abb0e76cab17 Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-DeleteServersTestJSON-106764487-project Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'afb77376-d3d6-410b-b281-9d39ea7ccd3d'} Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:24.536396 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.542174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:24.542174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:24.542174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:24.542174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:24.542174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:24.542174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. Aug 27 05:10:24.542174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:10:24.549194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] Returning 404 to user: Instance afb77376-d3d6-410b-b281-9d39ea7ccd3d could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:24.550299 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3b56e9c5-1d30-494d-8314-3ddb568e1db2 tempest-DeleteServersTestJSON-106764487 tempest-DeleteServersTestJSON-106764487-project] 10.222.0.58 "GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d" status: 404 len: 111 microversion: 2.1 time: 0.107457 Aug 27 05:10:24.554845 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1846/3664] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:24 2022] GET /compute/v2.1/servers/afb77376-d3d6-410b-b281-9d39ea7ccd3d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:24.646840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:24.647801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:24.653996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:24.654496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:24.654922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:24.662615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:24.667426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:24.668199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:24.993587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3db95453-5759-4a8d-b82b-be60f476b319 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:24.999868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:25.010562 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3db95453-5759-4a8d-b82b-be60f476b319 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.889291 Aug 27 05:10:25.011209 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1819/3665] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:24 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:25.259716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:25.266627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9e16d6a3-214c-450a-8a39-633b6241a53c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:25.269273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9e16d6a3-214c-450a-8a39-633b6241a53c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:25.278255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:25.280282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:25.281466 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1943de02-9e5e-4878-9d46-d3aa4a3c5e3a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.639487 Aug 27 05:10:25.296632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e16d6a3-214c-450a-8a39-633b6241a53c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:25.296632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e16d6a3-214c-450a-8a39-633b6241a53c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:25.296632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e16d6a3-214c-450a-8a39-633b6241a53c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:25.296632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e16d6a3-214c-450a-8a39-633b6241a53c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:25.296632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e16d6a3-214c-450a-8a39-633b6241a53c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:25.296632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9e16d6a3-214c-450a-8a39-633b6241a53c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:25.299479 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1847/3666] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:24 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:25.818334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9e16d6a3-214c-450a-8a39-633b6241a53c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:25.828251 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9e16d6a3-214c-450a-8a39-633b6241a53c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1325 microversion: 2.1 time: 0.565425 Aug 27 05:10:25.834239 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1820/3667] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:25 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1325 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:26.035948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-18ae5414-04c1-47fd-b367-c62ee842273d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:26.036474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-18ae5414-04c1-47fd-b367-c62ee842273d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:26.062439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ae5414-04c1-47fd-b367-c62ee842273d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:26.079350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ae5414-04c1-47fd-b367-c62ee842273d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:26.079814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ae5414-04c1-47fd-b367-c62ee842273d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:26.081734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ae5414-04c1-47fd-b367-c62ee842273d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:26.082223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ae5414-04c1-47fd-b367-c62ee842273d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:26.082663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ae5414-04c1-47fd-b367-c62ee842273d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:26.323998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:26.325224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:26.341128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:26.341977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:26.342574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:26.343756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:26.344433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:26.345076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:26.949709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18ae5414-04c1-47fd-b367-c62ee842273d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:26.960574 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-18ae5414-04c1-47fd-b367-c62ee842273d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.930474 Aug 27 05:10:26.963732 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1848/3668] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:26 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:26.973553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-80d8c432-6f5e-412a-9480-8eec875825b9 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:26.976450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-80d8c432-6f5e-412a-9480-8eec875825b9 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:26.988817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80d8c432-6f5e-412a-9480-8eec875825b9 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:26.994020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80d8c432-6f5e-412a-9480-8eec875825b9 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:26.998887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80d8c432-6f5e-412a-9480-8eec875825b9 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:26.999934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80d8c432-6f5e-412a-9480-8eec875825b9 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:27.005212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80d8c432-6f5e-412a-9480-8eec875825b9 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:27.005835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80d8c432-6f5e-412a-9480-8eec875825b9 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:27.260591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:27.279498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:27.281511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:27.284012 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cdf201a5-d966-46c3-a0a2-4d22104e557f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.965629 Aug 27 05:10:27.287428 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1821/3669] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:26 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:27.627030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-80d8c432-6f5e-412a-9480-8eec875825b9 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:27.635702 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-80d8c432-6f5e-412a-9480-8eec875825b9 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1325 microversion: 2.1 time: 0.670706 Aug 27 05:10:27.643388 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1849/3670] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:26 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1325 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:27.923989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-587e1aad-51f8-4bef-9f00-62fad3b8ea94 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:27.924765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-587e1aad-51f8-4bef-9f00-62fad3b8ea94 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:27.940181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-587e1aad-51f8-4bef-9f00-62fad3b8ea94 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:27.941104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-587e1aad-51f8-4bef-9f00-62fad3b8ea94 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:27.941756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-587e1aad-51f8-4bef-9f00-62fad3b8ea94 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:27.944676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-587e1aad-51f8-4bef-9f00-62fad3b8ea94 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:27.945384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-587e1aad-51f8-4bef-9f00-62fad3b8ea94 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:27.946030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-587e1aad-51f8-4bef-9f00-62fad3b8ea94 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:27.955045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-54ca1ae8-f235-4fdc-ab20-c3655862be6d req-75453153-30e1-437a-ab56-ba41e54e3a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee435af-d600-47a1-ae47-316d49b71aed", "tag": "4bad91fd-25bd-4e3f-b774-ae5ff30f559d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:27.992446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-54ca1ae8-f235-4fdc-ab20-c3655862be6d req-75453153-30e1-437a-ab56-ba41e54e3a3c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:27.992947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-54ca1ae8-f235-4fdc-ab20-c3655862be6d req-75453153-30e1-437a-ab56-ba41e54e3a3c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:27.993393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-54ca1ae8-f235-4fdc-ab20-c3655862be6d req-75453153-30e1-437a-ab56-ba41e54e3a3c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:28.045813 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-54ca1ae8-f235-4fdc-ab20-c3655862be6d req-75453153-30e1-437a-ab56-ba41e54e3a3c service nova] Creating event network-changed:4bad91fd-25bd-4e3f-b774-ae5ff30f559d for instance 9ee435af-d600-47a1-ae47-316d49b71aed on n-h2-820368-35 Aug 27 05:10:28.051493 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-54ca1ae8-f235-4fdc-ab20-c3655862be6d req-75453153-30e1-437a-ab56-ba41e54e3a3c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101031 Aug 27 05:10:28.076256 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1850/3671] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:10:28.085623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b3fd3c76-eff7-4321-8abe-c2c55ed71218 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:28.102073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b3fd3c76-eff7-4321-8abe-c2c55ed71218 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:28.121477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3fd3c76-eff7-4321-8abe-c2c55ed71218 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:28.126303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3fd3c76-eff7-4321-8abe-c2c55ed71218 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:28.129440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3fd3c76-eff7-4321-8abe-c2c55ed71218 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:28.132881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3fd3c76-eff7-4321-8abe-c2c55ed71218 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:28.136107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3fd3c76-eff7-4321-8abe-c2c55ed71218 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:28.139016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3fd3c76-eff7-4321-8abe-c2c55ed71218 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:28.244785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:28.681157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-587e1aad-51f8-4bef-9f00-62fad3b8ea94 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:28.705251 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-587e1aad-51f8-4bef-9f00-62fad3b8ea94 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1482 microversion: 2.1 time: 0.781233 Aug 27 05:10:28.711313 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1822/3672] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:27 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1482 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:28.723334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:28.729440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:28.743660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:28.745927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:28.746505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:28.747948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:28.748674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:28.749383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:28.921689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b3fd3c76-eff7-4321-8abe-c2c55ed71218 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:28.932873 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b3fd3c76-eff7-4321-8abe-c2c55ed71218 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.851645 Aug 27 05:10:28.937471 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1851/3673] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:28 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:28.948511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-feae4730-5e9c-4e05-b4c3-432cdab955b4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:28.949321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-feae4730-5e9c-4e05-b4c3-432cdab955b4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:28.969095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feae4730-5e9c-4e05-b4c3-432cdab955b4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:28.972552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feae4730-5e9c-4e05-b4c3-432cdab955b4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:28.978171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feae4730-5e9c-4e05-b4c3-432cdab955b4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:28.979306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feae4730-5e9c-4e05-b4c3-432cdab955b4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:28.979957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feae4730-5e9c-4e05-b4c3-432cdab955b4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:28.980837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feae4730-5e9c-4e05-b4c3-432cdab955b4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:29.182876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:29.198326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:29.208112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:29.211504 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-645074be-08ba-4864-b8c5-3227a96b2059 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.498953 Aug 27 05:10:29.213971 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1823/3674] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:28 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:29.430752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-feae4730-5e9c-4e05-b4c3-432cdab955b4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:29.445915 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-feae4730-5e9c-4e05-b4c3-432cdab955b4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1325 microversion: 2.1 time: 0.504999 Aug 27 05:10:29.449361 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1852/3675] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:28 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1325 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:29.964998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eae4b958-8cfe-44c6-9608-ba9a961b6949 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:29.967058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eae4b958-8cfe-44c6-9608-ba9a961b6949 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:29.978005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eae4b958-8cfe-44c6-9608-ba9a961b6949 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:29.978834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eae4b958-8cfe-44c6-9608-ba9a961b6949 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:29.979760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eae4b958-8cfe-44c6-9608-ba9a961b6949 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:29.980720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eae4b958-8cfe-44c6-9608-ba9a961b6949 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:29.981423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eae4b958-8cfe-44c6-9608-ba9a961b6949 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:29.984841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eae4b958-8cfe-44c6-9608-ba9a961b6949 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:30.245561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:30.248384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:30.270012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:30.282542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:30.283392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:30.284324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:30.285047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:30.285630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:30.526631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eae4b958-8cfe-44c6-9608-ba9a961b6949 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:30.542703 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eae4b958-8cfe-44c6-9608-ba9a961b6949 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.587161 Aug 27 05:10:30.578284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:30.578698 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1824/3676] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:29 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:30.597936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:30.602196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-691eac00-f185-4030-8eeb-934c58663ebf tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:30.610040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:30.612313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-691eac00-f185-4030-8eeb-934c58663ebf tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:30.615952 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-54e670af-44ec-49c6-91cb-8ec278db328f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1738 microversion: 2.20 time: 0.379371 Aug 27 05:10:30.616763 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1853/3677] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:30 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1738 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:30.626943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691eac00-f185-4030-8eeb-934c58663ebf tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:30.633524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691eac00-f185-4030-8eeb-934c58663ebf tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:30.634272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691eac00-f185-4030-8eeb-934c58663ebf tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:30.635496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691eac00-f185-4030-8eeb-934c58663ebf tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:30.636167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691eac00-f185-4030-8eeb-934c58663ebf tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:30.636790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691eac00-f185-4030-8eeb-934c58663ebf tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:30.882668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-691eac00-f185-4030-8eeb-934c58663ebf tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:30.894420 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-691eac00-f185-4030-8eeb-934c58663ebf tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1325 microversion: 2.1 time: 0.314148 Aug 27 05:10:30.908513 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1825/3678] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:30 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1325 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:31.311002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-579c9b10-8752-4ca1-8d22-c784c1dbbf82 req-4947cd82-4104-45e6-a973-03d3ebfbb470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7d946f-3ba2-48f9-899f-0d5ab050b72a", "name": "network-vif-plugged", "status": "completed", "tag": "e64db20b-f5e9-46c9-a96c-bf3c98452484"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:31.326773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-579c9b10-8752-4ca1-8d22-c784c1dbbf82 req-4947cd82-4104-45e6-a973-03d3ebfbb470 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:31.327310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-579c9b10-8752-4ca1-8d22-c784c1dbbf82 req-4947cd82-4104-45e6-a973-03d3ebfbb470 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:31.334129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-579c9b10-8752-4ca1-8d22-c784c1dbbf82 req-4947cd82-4104-45e6-a973-03d3ebfbb470 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:31.380159 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-579c9b10-8752-4ca1-8d22-c784c1dbbf82 req-4947cd82-4104-45e6-a973-03d3ebfbb470 service nova] Creating event network-vif-plugged:e64db20b-f5e9-46c9-a96c-bf3c98452484 for instance 4f7d946f-3ba2-48f9-899f-0d5ab050b72a on n-h2-820368-35 Aug 27 05:10:31.390325 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-579c9b10-8752-4ca1-8d22-c784c1dbbf82 req-4947cd82-4104-45e6-a973-03d3ebfbb470 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083735 Aug 27 05:10:31.393382 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1854/3679] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:10:31.603791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40d87650-92a8-4f7e-a61e-a309429596eb tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:31.604496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-40d87650-92a8-4f7e-a61e-a309429596eb tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:31.624938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40d87650-92a8-4f7e-a61e-a309429596eb tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:31.626963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40d87650-92a8-4f7e-a61e-a309429596eb tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:31.627667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40d87650-92a8-4f7e-a61e-a309429596eb tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:31.630433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40d87650-92a8-4f7e-a61e-a309429596eb tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:31.632671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40d87650-92a8-4f7e-a61e-a309429596eb tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:31.633335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40d87650-92a8-4f7e-a61e-a309429596eb tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:31.641901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:31.643227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:31.665172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:31.670938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:31.673705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:31.674685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:31.678680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:31.679450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:32.212074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:32.226496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:32.234093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:32.237100 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3fa8b883-3b16-4e7c-bd60-2aa9feffb8a2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1720 microversion: 2.20 time: 0.600001 Aug 27 05:10:32.238821 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1855/3680] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:31 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1720 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:32.246002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-40d87650-92a8-4f7e-a61e-a309429596eb tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:32.250839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b822a7bb-386e-4512-886f-88583d077bf1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:32.251792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b822a7bb-386e-4512-886f-88583d077bf1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:32.256187 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40d87650-92a8-4f7e-a61e-a309429596eb tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.659439 Aug 27 05:10:32.271714 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1826/3681] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:31 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:32.273297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b822a7bb-386e-4512-886f-88583d077bf1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:32.275678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b822a7bb-386e-4512-886f-88583d077bf1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:32.281521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b822a7bb-386e-4512-886f-88583d077bf1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:32.282435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b822a7bb-386e-4512-886f-88583d077bf1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:32.283127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b822a7bb-386e-4512-886f-88583d077bf1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:32.284879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b822a7bb-386e-4512-886f-88583d077bf1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:32.746699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b822a7bb-386e-4512-886f-88583d077bf1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:32.764635 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b822a7bb-386e-4512-886f-88583d077bf1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1325 microversion: 2.1 time: 0.520267 Aug 27 05:10:32.767452 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1856/3682] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:32 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1325 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:33.272207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:33.273400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:33.293113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a9e0a30-7db2-4424-8815-34dc8f4f9a1d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:33.296098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7a9e0a30-7db2-4424-8815-34dc8f4f9a1d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:33.309513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:33.310256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:33.311702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:33.313580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:33.316238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:33.317692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:33.317923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a9e0a30-7db2-4424-8815-34dc8f4f9a1d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:33.318741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a9e0a30-7db2-4424-8815-34dc8f4f9a1d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:33.321028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a9e0a30-7db2-4424-8815-34dc8f4f9a1d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:33.321961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a9e0a30-7db2-4424-8815-34dc8f4f9a1d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:33.330741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a9e0a30-7db2-4424-8815-34dc8f4f9a1d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:33.331785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a9e0a30-7db2-4424-8815-34dc8f4f9a1d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:33.772337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:33.780625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7a9e0a30-7db2-4424-8815-34dc8f4f9a1d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:33.799487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:33.802357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:33.807333 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-263d35a2-1261-4cfe-80cc-689cd2694a79 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1720 microversion: 2.20 time: 0.542792 Aug 27 05:10:33.810786 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1827/3683] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:33 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1720 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:33.813757 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a9e0a30-7db2-4424-8815-34dc8f4f9a1d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.529114 Aug 27 05:10:33.816997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1984408-a519-4b86-9f75-404e80fe2de5 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:33.818032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1984408-a519-4b86-9f75-404e80fe2de5 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:33.828655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1984408-a519-4b86-9f75-404e80fe2de5 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:33.829892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1984408-a519-4b86-9f75-404e80fe2de5 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:33.830522 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1857/3684] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:33 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:33.830896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1984408-a519-4b86-9f75-404e80fe2de5 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:33.831847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1984408-a519-4b86-9f75-404e80fe2de5 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:33.832536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1984408-a519-4b86-9f75-404e80fe2de5 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:33.833092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1984408-a519-4b86-9f75-404e80fe2de5 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:34.045476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1718112964", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "1aa18e23-bd5d-4795-b707-5a6105a5c877"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:34.119644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] validate_networks() for [('1aa18e23-bd5d-4795-b707-5a6105a5c877', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:10:34.328840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1984408-a519-4b86-9f75-404e80fe2de5 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:34.342354 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1984408-a519-4b86-9f75-404e80fe2de5 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1523 microversion: 2.1 time: 0.528007 Aug 27 05:10:34.353479 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1828/3685] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:33 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1523 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:34.370516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:34.371273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:34.388396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:34.389900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:34.397156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:34.399520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:34.400927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:34.401977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:34.479981 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] HTTP exception thrown: Action 999 not found Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Request method failure captured: Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a/os-instance-actions/999 HTTP/1.1 Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCacz22t74ANKZO6i3rRDHEZYYa8pVX0CivNJZJPLDMjYtTrulbnuZmQovgs8zXx_I2rWT-IMu_-TgeesT6UHEhXRg9t0XG-m15zqWgH4vwC4nnL9xWe7TqhhHQzKgyejdGb0eknh30hqA7I-T66rcEszSM1EwIphjzF6fiQo6eQF7Kc Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d4dc3cb1dbf34bd1ad7f11a9e7e12f68 Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-650290850 Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d4dc3cb1dbf34bd1ad7f11a9e7e12f68", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d4dc3cb1dbf34bd1ad7f11a9e7e12f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4dc3cb1dbf34bd1ad7f11a9e7e12f68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4dc3cb1dbf34bd1ad7f11a9e7e12f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-650290850 Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d4dc3cb1dbf34bd1ad7f11a9e7e12f68 Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-650290850 Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-InstanceActionsNegativeTestJSON-650290850-project Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 8ac7db72de964accbb4f9a7084fb049f Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-650290850-project Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: exception: Action 999 not found Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'server_id': '4f7d946f-3ba2-48f9-899f-0d5ab050b72a', 'id': '999'} Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 27 05:10:34.496867 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:34.516227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Returning 404 to user: Action 999 not found {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:34.518480 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f760883e-2449-4701-b0be-d038dd49aaab tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.153893 Aug 27 05:10:34.525004 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1829/3686] 10.222.0.58 () {58 vars in 1308 bytes} [Sat Aug 27 05:10:34 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a/os-instance-actions/999 => generated 66 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:10:34.533535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d631023-af56-48c7-bc2c-837e18fee70c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '.version_select at 0x7fb56517ff70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:34.541376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d631023-af56-48c7-bc2c-837e18fee70c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: b730bb31-0114-48d3-81dc-6b3d1c3b8220] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:34.548643 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-8d631023-af56-48c7-bc2c-837e18fee70c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] HTTP exception thrown: Instance b730bb31-0114-48d3-81dc-6b3d1c3b8220 could not be found. Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d631023-af56-48c7-bc2c-837e18fee70c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Request method failure captured: Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/b730bb31-0114-48d3-81dc-6b3d1c3b8220/os-instance-actions HTTP/1.1 Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCacz22t74ANKZO6i3rRDHEZYYa8pVX0CivNJZJPLDMjYtTrulbnuZmQovgs8zXx_I2rWT-IMu_-TgeesT6UHEhXRg9t0XG-m15zqWgH4vwC4nnL9xWe7TqhhHQzKgyejdGb0eknh30hqA7I-T66rcEszSM1EwIphjzF6fiQo6eQF7Kc Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d4dc3cb1dbf34bd1ad7f11a9e7e12f68 Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-650290850 Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d4dc3cb1dbf34bd1ad7f11a9e7e12f68", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d4dc3cb1dbf34bd1ad7f11a9e7e12f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4dc3cb1dbf34bd1ad7f11a9e7e12f68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4dc3cb1dbf34bd1ad7f11a9e7e12f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-650290850 Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d4dc3cb1dbf34bd1ad7f11a9e7e12f68 Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-650290850 Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-InstanceActionsNegativeTestJSON-650290850-project Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 8ac7db72de964accbb4f9a7084fb049f Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-650290850-project Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance b730bb31-0114-48d3-81dc-6b3d1c3b8220 could not be found. Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'server_id': 'b730bb31-0114-48d3-81dc-6b3d1c3b8220'} Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b730bb31-0114-48d3-81dc-6b3d1c3b8220 could not be found. Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:34.550861 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:34.555032 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b730bb31-0114-48d3-81dc-6b3d1c3b8220 could not be found. Aug 27 05:10:34.555032 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:34.555032 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:34.555032 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:34.555032 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:34.555032 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:34.555032 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:34.555032 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:34.555032 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:34.555032 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b730bb31-0114-48d3-81dc-6b3d1c3b8220 could not be found. Aug 27 05:10:34.555032 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:34.557154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d631023-af56-48c7-bc2c-837e18fee70c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Returning 404 to user: Instance b730bb31-0114-48d3-81dc-6b3d1c3b8220 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:34.568597 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d631023-af56-48c7-bc2c-837e18fee70c tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/b730bb31-0114-48d3-81dc-6b3d1c3b8220/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.029662 Aug 27 05:10:34.570804 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1830/3687] 10.222.0.58 () {58 vars in 1296 bytes} [Sat Aug 27 05:10:34 2022] GET /compute/v2.1/servers/b730bb31-0114-48d3-81dc-6b3d1c3b8220/os-instance-actions => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:34.600767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a1939709-6e45-46b7-85c9-622d12745c50 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:34.601237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a1939709-6e45-46b7-85c9-622d12745c50 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:34.610803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1939709-6e45-46b7-85c9-622d12745c50 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:34.611682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1939709-6e45-46b7-85c9-622d12745c50 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:34.613094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1939709-6e45-46b7-85c9-622d12745c50 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:34.617882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1939709-6e45-46b7-85c9-622d12745c50 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:34.618610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1939709-6e45-46b7-85c9-622d12745c50 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:34.619258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1939709-6e45-46b7-85c9-622d12745c50 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:34.650749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a1939709-6e45-46b7-85c9-622d12745c50 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:10:34.784276 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a1939709-6e45-46b7-85c9-622d12745c50 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 204 len: 0 microversion: 2.1 time: 0.205569 Aug 27 05:10:34.786425 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1831/3688] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:34 2022] DELETE /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:10:34.796453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f38f4c0f-23c0-4a46-ae7d-11449f3b5142 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:34.798084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f38f4c0f-23c0-4a46-ae7d-11449f3b5142 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:34.808989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38f4c0f-23c0-4a46-ae7d-11449f3b5142 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:34.809937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38f4c0f-23c0-4a46-ae7d-11449f3b5142 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:34.810711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38f4c0f-23c0-4a46-ae7d-11449f3b5142 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:34.811890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38f4c0f-23c0-4a46-ae7d-11449f3b5142 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:34.812518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38f4c0f-23c0-4a46-ae7d-11449f3b5142 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:34.813167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38f4c0f-23c0-4a46-ae7d-11449f3b5142 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:35.101050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:10:35.101971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:10:35.102950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:10:35.104196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:10:35.104969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:10:35.128542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:35.130466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:35.131610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:35.133022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:35.133824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:35.135298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:35.135499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f38f4c0f-23c0-4a46-ae7d-11449f3b5142 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:35.148185 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f38f4c0f-23c0-4a46-ae7d-11449f3b5142 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1529 microversion: 2.1 time: 0.356548 Aug 27 05:10:35.152989 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1832/3689] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:34 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1529 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:35.159200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ecda5820-7b93-4521-97a9-b7d6ed34cf82 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:35.160078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ecda5820-7b93-4521-97a9-b7d6ed34cf82 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:35.167115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecda5820-7b93-4521-97a9-b7d6ed34cf82 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:35.167773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecda5820-7b93-4521-97a9-b7d6ed34cf82 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:35.168591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecda5820-7b93-4521-97a9-b7d6ed34cf82 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:35.169543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecda5820-7b93-4521-97a9-b7d6ed34cf82 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:35.170320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecda5820-7b93-4521-97a9-b7d6ed34cf82 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:35.170942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ecda5820-7b93-4521-97a9-b7d6ed34cf82 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:35.195879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Getting quotas for project a209e7e52dcd4983a112f751fdb1da05. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:10:35.209755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Getting quotas for user 2108e75d88ec40cba3c70ab2e954e11a and project a209e7e52dcd4983a112f751fdb1da05. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:10:35.229294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:10:35.231686 n-d-820368-35 devstack@n-api.service[128548]: WARNING nova.utils [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1718112964 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-171811296 Aug 27 05:10:35.232793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:10:35.321464 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0454724a-bef3-4123-b465-77e8cc396396 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454040 Aug 27 05:10:35.341664 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1858/3690] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:10:35.353523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:35.354918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:35.390918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:35.391465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:35.396204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:35.397117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:35.400615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:35.401340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:36.016957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ecda5820-7b93-4521-97a9-b7d6ed34cf82 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:36.031961 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ecda5820-7b93-4521-97a9-b7d6ed34cf82 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.881581 Aug 27 05:10:36.048054 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1833/3691] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:35 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:36.055578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8463acb1-036f-4f41-bb1f-27a926a4ea6c req-6afd8012-b270-4be6-a4c7-edae5fb61114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcbd54c-7e88-44d7-ad7b-be669acb1c7c", "name": "network-vif-unplugged", "status": "completed", "tag": "e1cc65c6-b976-41c9-a889-d9270df2c63d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:36.068293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8463acb1-036f-4f41-bb1f-27a926a4ea6c req-6afd8012-b270-4be6-a4c7-edae5fb61114 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:36.069080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8463acb1-036f-4f41-bb1f-27a926a4ea6c req-6afd8012-b270-4be6-a4c7-edae5fb61114 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:36.069695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:36.069855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8463acb1-036f-4f41-bb1f-27a926a4ea6c req-6afd8012-b270-4be6-a4c7-edae5fb61114 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:36.085371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:36.087529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:36.093430 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8463acb1-036f-4f41-bb1f-27a926a4ea6c req-6afd8012-b270-4be6-a4c7-edae5fb61114 service nova] Creating event network-vif-unplugged:e1cc65c6-b976-41c9-a889-d9270df2c63d for instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c on n-h1-820368-35 Aug 27 05:10:36.095582 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ea5cf39-a89c-4dc3-b890-8dd197d81704 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1723 microversion: 2.20 time: 0.754618 Aug 27 05:10:36.100636 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1859/3692] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:35 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1723 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:36.101262 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8463acb1-036f-4f41-bb1f-27a926a4ea6c req-6afd8012-b270-4be6-a4c7-edae5fb61114 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050001 Aug 27 05:10:36.102034 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1834/3693] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:36.110976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10061a2a-f1b8-46ed-aaa0-b0851710406f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:36.111638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-10061a2a-f1b8-46ed-aaa0-b0851710406f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:36.125711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b12af1e6-d62a-4370-930f-781d61fafffb tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a70e3da-5f8a-4469-a189-68117472ff0c"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:36.128383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10061a2a-f1b8-46ed-aaa0-b0851710406f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:36.128894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10061a2a-f1b8-46ed-aaa0-b0851710406f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:36.129330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b12af1e6-d62a-4370-930f-781d61fafffb tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:36.129455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10061a2a-f1b8-46ed-aaa0-b0851710406f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:36.130141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10061a2a-f1b8-46ed-aaa0-b0851710406f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:36.130664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10061a2a-f1b8-46ed-aaa0-b0851710406f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:36.131032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10061a2a-f1b8-46ed-aaa0-b0851710406f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:36.137574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b12af1e6-d62a-4370-930f-781d61fafffb tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:36.138313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b12af1e6-d62a-4370-930f-781d61fafffb tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:36.139502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b12af1e6-d62a-4370-930f-781d61fafffb tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:36.140399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b12af1e6-d62a-4370-930f-781d61fafffb tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:36.141028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b12af1e6-d62a-4370-930f-781d61fafffb tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:36.141610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b12af1e6-d62a-4370-930f-781d61fafffb tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:36.294797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10061a2a-f1b8-46ed-aaa0-b0851710406f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:36.309568 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10061a2a-f1b8-46ed-aaa0-b0851710406f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1236 microversion: 2.1 time: 0.206654 Aug 27 05:10:36.315321 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1860/3694] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:36 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1236 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:36.331591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8b5274c8-accc-4bb5-85ad-b41a631a8ee4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:36.334630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8b5274c8-accc-4bb5-85ad-b41a631a8ee4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:36.355595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b5274c8-accc-4bb5-85ad-b41a631a8ee4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:36.357786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b5274c8-accc-4bb5-85ad-b41a631a8ee4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:36.358405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b5274c8-accc-4bb5-85ad-b41a631a8ee4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:36.359949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b5274c8-accc-4bb5-85ad-b41a631a8ee4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:36.362319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b5274c8-accc-4bb5-85ad-b41a631a8ee4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:36.364624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b5274c8-accc-4bb5-85ad-b41a631a8ee4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:36.569706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:36.656483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8b5274c8-accc-4bb5-85ad-b41a631a8ee4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:36.664950 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8b5274c8-accc-4bb5-85ad-b41a631a8ee4 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1529 microversion: 2.1 time: 0.347920 Aug 27 05:10:36.668627 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1861/3695] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:36 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1529 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:36.751781 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b12af1e6-d62a-4370-930f-781d61fafffb tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "POST /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.630938 Aug 27 05:10:36.755500 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1835/3696] 10.222.0.58 () {62 vars in 1364 bytes} [Sat Aug 27 05:10:36 2022] POST /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments => generated 188 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 05:10:37.030032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9925aad0-38c1-45fd-afa2-8462f1fa5de7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:37.033187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9925aad0-38c1-45fd-afa2-8462f1fa5de7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:37.047456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9925aad0-38c1-45fd-afa2-8462f1fa5de7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:37.048211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9925aad0-38c1-45fd-afa2-8462f1fa5de7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:37.050209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9925aad0-38c1-45fd-afa2-8462f1fa5de7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:37.051170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9925aad0-38c1-45fd-afa2-8462f1fa5de7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:37.052513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9925aad0-38c1-45fd-afa2-8462f1fa5de7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:37.053105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9925aad0-38c1-45fd-afa2-8462f1fa5de7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:37.070479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-170a484c-df63-4de3-89a8-95b78a22a572 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:37.071445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-170a484c-df63-4de3-89a8-95b78a22a572 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:37.087619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-170a484c-df63-4de3-89a8-95b78a22a572 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:37.089064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-170a484c-df63-4de3-89a8-95b78a22a572 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:37.089526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-170a484c-df63-4de3-89a8-95b78a22a572 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:37.097544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-170a484c-df63-4de3-89a8-95b78a22a572 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:37.100712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-170a484c-df63-4de3-89a8-95b78a22a572 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:37.101322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-170a484c-df63-4de3-89a8-95b78a22a572 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:37.240251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9925aad0-38c1-45fd-afa2-8462f1fa5de7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128548) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 05:10:37.447523 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9925aad0-38c1-45fd-afa2-8462f1fa5de7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "POST /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/action" status: 202 len: 0 microversion: 2.20 time: 0.435008 Aug 27 05:10:37.451358 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1862/3697] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 05:10:37 2022] POST /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:10:37.473129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5b09b2e-913f-499f-88ee-363d709e337b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:37.480006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f5b09b2e-913f-499f-88ee-363d709e337b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:37.500242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b09b2e-913f-499f-88ee-363d709e337b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:37.502747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b09b2e-913f-499f-88ee-363d709e337b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:37.510861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b09b2e-913f-499f-88ee-363d709e337b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:37.524496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b09b2e-913f-499f-88ee-363d709e337b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:37.525933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b09b2e-913f-499f-88ee-363d709e337b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:37.527581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5b09b2e-913f-499f-88ee-363d709e337b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:37.753992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f5b09b2e-913f-499f-88ee-363d709e337b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:37.766620 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5b09b2e-913f-499f-88ee-363d709e337b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1284 microversion: 2.1 time: 0.309289 Aug 27 05:10:37.785928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-170a484c-df63-4de3-89a8-95b78a22a572 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:37.787873 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1863/3698] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:37 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:37.801271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:37.804798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:37.807123 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-170a484c-df63-4de3-89a8-95b78a22a572 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1522 microversion: 2.1 time: 0.741371 Aug 27 05:10:37.808439 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1836/3699] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:37 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1522 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:37.822241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:37.823503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:37.826331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:37.827391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:37.827864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:37.829076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:37.840503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c33052c3-1161-422f-bc88-171f0d7e6cc1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:37.841651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c33052c3-1161-422f-bc88-171f0d7e6cc1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:37.863276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c33052c3-1161-422f-bc88-171f0d7e6cc1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:37.864362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c33052c3-1161-422f-bc88-171f0d7e6cc1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:37.865255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c33052c3-1161-422f-bc88-171f0d7e6cc1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:37.866262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c33052c3-1161-422f-bc88-171f0d7e6cc1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:37.873080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c33052c3-1161-422f-bc88-171f0d7e6cc1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:37.873585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c33052c3-1161-422f-bc88-171f0d7e6cc1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:38.051801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c33052c3-1161-422f-bc88-171f0d7e6cc1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac7db72de964accbb4f9a7084fb049f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc3cb1dbf34bd1ad7f11a9e7e12f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:38.060789 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c33052c3-1161-422f-bc88-171f0d7e6cc1 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 200 len: 1310 microversion: 2.1 time: 0.251252 Aug 27 05:10:38.071998 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1837/3700] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:37 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 1310 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:38.096017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-bb7c2218-1d99-494b-ad41-18e386c33bdf req-7a95c8de-99c9-4f19-8fc9-a121b5d247b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7d946f-3ba2-48f9-899f-0d5ab050b72a", "name": "network-vif-deleted", "tag": "e64db20b-f5e9-46c9-a96c-bf3c98452484"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:38.127838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bb7c2218-1d99-494b-ad41-18e386c33bdf req-7a95c8de-99c9-4f19-8fc9-a121b5d247b4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:38.128700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bb7c2218-1d99-494b-ad41-18e386c33bdf req-7a95c8de-99c9-4f19-8fc9-a121b5d247b4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:38.129301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bb7c2218-1d99-494b-ad41-18e386c33bdf req-7a95c8de-99c9-4f19-8fc9-a121b5d247b4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:38.146378 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-bb7c2218-1d99-494b-ad41-18e386c33bdf req-7a95c8de-99c9-4f19-8fc9-a121b5d247b4 service nova] Creating event network-vif-deleted:e64db20b-f5e9-46c9-a96c-bf3c98452484 for instance 4f7d946f-3ba2-48f9-899f-0d5ab050b72a on n-h2-820368-35 Aug 27 05:10:38.158006 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-bb7c2218-1d99-494b-ad41-18e386c33bdf req-7a95c8de-99c9-4f19-8fc9-a121b5d247b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084528 Aug 27 05:10:38.158724 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1838/3701] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:38.639598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:38.660507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:38.663479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:38.673853 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3e1387a4-6430-4782-b885-93395b223cf9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1749 microversion: 2.20 time: 0.884253 Aug 27 05:10:38.704543 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1864/3702] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:37 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1749 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:38.810122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0bc07089-53ed-47fc-857d-461e3c1484e5 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:38.811616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0bc07089-53ed-47fc-857d-461e3c1484e5 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:38.840391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bce63e3d-d73e-40dd-aed9-fa589e9bbe5e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:38.842423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bce63e3d-d73e-40dd-aed9-fa589e9bbe5e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:38.885497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc07089-53ed-47fc-857d-461e3c1484e5 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:38.886010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc07089-53ed-47fc-857d-461e3c1484e5 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:38.890292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc07089-53ed-47fc-857d-461e3c1484e5 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:38.890890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bce63e3d-d73e-40dd-aed9-fa589e9bbe5e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:38.892443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc07089-53ed-47fc-857d-461e3c1484e5 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:38.892716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc07089-53ed-47fc-857d-461e3c1484e5 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:38.893160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc07089-53ed-47fc-857d-461e3c1484e5 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:38.895423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bce63e3d-d73e-40dd-aed9-fa589e9bbe5e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:38.896092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bce63e3d-d73e-40dd-aed9-fa589e9bbe5e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:38.896861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bce63e3d-d73e-40dd-aed9-fa589e9bbe5e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:38.903316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bce63e3d-d73e-40dd-aed9-fa589e9bbe5e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:38.903797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bce63e3d-d73e-40dd-aed9-fa589e9bbe5e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:39.436123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0bc07089-53ed-47fc-857d-461e3c1484e5 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:39.445517 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0bc07089-53ed-47fc-857d-461e3c1484e5 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1290 microversion: 2.1 time: 0.656453 Aug 27 05:10:39.446376 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1839/3703] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:38 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1290 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:39.463218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:39.463855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] [instance: 4f7d946f-3ba2-48f9-899f-0d5ab050b72a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:39.497959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:39.498824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:39.499497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:39.500232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:39.500702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:39.501142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:39.524863 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] HTTP exception thrown: Instance 4f7d946f-3ba2-48f9-899f-0d5ab050b72a could not be found. Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Request method failure captured: Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a HTTP/1.1 Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCacz22t74ANKZO6i3rRDHEZYYa8pVX0CivNJZJPLDMjYtTrulbnuZmQovgs8zXx_I2rWT-IMu_-TgeesT6UHEhXRg9t0XG-m15zqWgH4vwC4nnL9xWe7TqhhHQzKgyejdGb0eknh30hqA7I-T66rcEszSM1EwIphjzF6fiQo6eQF7Kc Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d4dc3cb1dbf34bd1ad7f11a9e7e12f68 Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-650290850 Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d4dc3cb1dbf34bd1ad7f11a9e7e12f68", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d4dc3cb1dbf34bd1ad7f11a9e7e12f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4dc3cb1dbf34bd1ad7f11a9e7e12f68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4dc3cb1dbf34bd1ad7f11a9e7e12f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-650290850 Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d4dc3cb1dbf34bd1ad7f11a9e7e12f68 Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-650290850 Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-InstanceActionsNegativeTestJSON-650290850-project Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 8ac7db72de964accbb4f9a7084fb049f Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-650290850-project Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 4f7d946f-3ba2-48f9-899f-0d5ab050b72a could not be found. Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '4f7d946f-3ba2-48f9-899f-0d5ab050b72a'} Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f7d946f-3ba2-48f9-899f-0d5ab050b72a could not be found. Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f7d946f-3ba2-48f9-899f-0d5ab050b72a could not be found. Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:39.540183 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:39.544556 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:39.544556 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:39.544556 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:39.544556 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:39.544556 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:39.544556 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:39.544556 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f7d946f-3ba2-48f9-899f-0d5ab050b72a could not be found. Aug 27 05:10:39.544556 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:39.547876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] Returning 404 to user: Instance 4f7d946f-3ba2-48f9-899f-0d5ab050b72a could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:39.552884 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-064ad00f-99c4-4dbe-b13f-10e74303d0f2 tempest-InstanceActionsNegativeTestJSON-650290850 tempest-InstanceActionsNegativeTestJSON-650290850-project] 10.222.0.58 "GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a" status: 404 len: 111 microversion: 2.1 time: 0.093591 Aug 27 05:10:39.565261 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1840/3704] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:39 2022] GET /compute/v2.1/servers/4f7d946f-3ba2-48f9-899f-0d5ab050b72a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:39.575848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e39159c9-d7b0-4429-aa81-e5cd01f8ffbd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:39.581459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e39159c9-d7b0-4429-aa81-e5cd01f8ffbd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:39.593470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39159c9-d7b0-4429-aa81-e5cd01f8ffbd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:39.598871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39159c9-d7b0-4429-aa81-e5cd01f8ffbd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:39.599648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39159c9-d7b0-4429-aa81-e5cd01f8ffbd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:39.600517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39159c9-d7b0-4429-aa81-e5cd01f8ffbd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:39.601120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39159c9-d7b0-4429-aa81-e5cd01f8ffbd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:39.603698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39159c9-d7b0-4429-aa81-e5cd01f8ffbd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:39.693529 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e39159c9-d7b0-4429-aa81-e5cd01f8ffbd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "POST /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d/action" status: 200 len: 32638 microversion: 2.1 time: 0.126867 Aug 27 05:10:39.694337 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1841/3705] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:39 2022] POST /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d/action => generated 32638 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:10:39.734324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:39.735180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:39.746230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:39.747191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:39.748531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:39.749987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:39.750859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:39.751545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:40.498159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bce63e3d-d73e-40dd-aed9-fa589e9bbe5e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:40.501622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:40.511595 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bce63e3d-d73e-40dd-aed9-fa589e9bbe5e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1502 microversion: 2.1 time: 1.684885 Aug 27 05:10:40.514820 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1865/3706] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:38 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1502 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:40.517167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:40.518803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:40.522278 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4fd2083e-73ab-43f3-bd46-2fb411be634e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1749 microversion: 2.20 time: 0.793512 Aug 27 05:10:40.524034 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1842/3707] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:39 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1749 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:10:40.530521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-361f8e88-d4f3-48aa-8124-8d2a9322a966 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:40.535316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-361f8e88-d4f3-48aa-8124-8d2a9322a966 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:40.539607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c072f685-8bac-4a5d-8112-a04667b1854e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Action: 'create', calling method: .version_select at 0x7fb565172790>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-287707085", "description": "tempest-description-203967321"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:40.563271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-361f8e88-d4f3-48aa-8124-8d2a9322a966 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:40.563770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-361f8e88-d4f3-48aa-8124-8d2a9322a966 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:40.565013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-361f8e88-d4f3-48aa-8124-8d2a9322a966 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:40.572685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-361f8e88-d4f3-48aa-8124-8d2a9322a966 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:40.573029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-361f8e88-d4f3-48aa-8124-8d2a9322a966 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:40.573483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-361f8e88-d4f3-48aa-8124-8d2a9322a966 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:41.806113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-361f8e88-d4f3-48aa-8124-8d2a9322a966 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:41.818250 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-361f8e88-d4f3-48aa-8124-8d2a9322a966 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1332 microversion: 2.1 time: 1.300405 Aug 27 05:10:41.819576 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1866/3708] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:40 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1332 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:41.855349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:41.856000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:41.910485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:41.912132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:41.912602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:41.913369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:41.913839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:41.914274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:41.958916 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c072f685-8bac-4a5d-8112-a04667b1854e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.424162 Aug 27 05:10:41.968891 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1843/3709] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:10:40 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:41.974367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-beaeb4db-ae74-4d18-9f12-f20dc6a2992d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-287707085"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:41.978707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-beaeb4db-ae74-4d18-9f12-f20dc6a2992d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:41.991310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beaeb4db-ae74-4d18-9f12-f20dc6a2992d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:41.991785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beaeb4db-ae74-4d18-9f12-f20dc6a2992d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:41.992378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beaeb4db-ae74-4d18-9f12-f20dc6a2992d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:41.993123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beaeb4db-ae74-4d18-9f12-f20dc6a2992d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:41.993593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beaeb4db-ae74-4d18-9f12-f20dc6a2992d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:41.994034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-beaeb4db-ae74-4d18-9f12-f20dc6a2992d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:42.531864 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.network.security_group_api [None req-beaeb4db-ae74-4d18-9f12-f20dc6a2992d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Adding security group 10df6a22-d20c-402e-8530-c20fa8f7e02e to port 57deadeb-fc01-4d2b-b151-830cad677ad7 Aug 27 05:10:42.575982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:42.591845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:42.602441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:42.609264 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-81df2b07-2e7c-41e8-a87b-33ed583e4350 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1751 microversion: 2.20 time: 0.788254 Aug 27 05:10:42.611286 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1867/3710] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:41 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1751 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:42.846277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78c8c094-5566-41ab-b13d-8e4379d278f9 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:42.848067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-78c8c094-5566-41ab-b13d-8e4379d278f9 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:42.863786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78c8c094-5566-41ab-b13d-8e4379d278f9 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:42.864469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78c8c094-5566-41ab-b13d-8e4379d278f9 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:42.864928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78c8c094-5566-41ab-b13d-8e4379d278f9 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:42.865664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78c8c094-5566-41ab-b13d-8e4379d278f9 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:42.866129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78c8c094-5566-41ab-b13d-8e4379d278f9 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:42.866566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78c8c094-5566-41ab-b13d-8e4379d278f9 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:42.892026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:43.606767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-78c8c094-5566-41ab-b13d-8e4379d278f9 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:43.615237 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-78c8c094-5566-41ab-b13d-8e4379d278f9 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1332 microversion: 2.1 time: 0.776619 Aug 27 05:10:43.617318 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1868/3711] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:42 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1332 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:43.634221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d386e433-555e-49fb-96c3-b810516ca7c3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:43.635265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d386e433-555e-49fb-96c3-b810516ca7c3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:43.642468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d386e433-555e-49fb-96c3-b810516ca7c3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:43.645125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d386e433-555e-49fb-96c3-b810516ca7c3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:43.645801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d386e433-555e-49fb-96c3-b810516ca7c3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:43.650911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d386e433-555e-49fb-96c3-b810516ca7c3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:43.651802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d386e433-555e-49fb-96c3-b810516ca7c3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:43.652486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d386e433-555e-49fb-96c3-b810516ca7c3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:43.708385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d386e433-555e-49fb-96c3-b810516ca7c3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:10:43.876469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:43.885288 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-beaeb4db-ae74-4d18-9f12-f20dc6a2992d tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "POST /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9/action" status: 202 len: 0 microversion: 2.1 time: 1.915144 Aug 27 05:10:43.890010 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1844/3712] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:41 2022] POST /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9/action => generated 0 bytes in 1917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:10:43.895936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-547adef6-f6e7-41b0-a052-15723d37a22f req-dfee3e4e-045a-4961-a7d5-b7c8f8da301c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d", "tag": "9dd5172f-f947-4780-922c-290a788cf6ca"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:43.928111 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d386e433-555e-49fb-96c3-b810516ca7c3 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 204 len: 0 microversion: 2.1 time: 0.297417 Aug 27 05:10:43.930575 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1869/3713] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:43 2022] DELETE /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:10:43.939353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-547adef6-f6e7-41b0-a052-15723d37a22f req-dfee3e4e-045a-4961-a7d5-b7c8f8da301c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:43.942049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-547adef6-f6e7-41b0-a052-15723d37a22f req-dfee3e4e-045a-4961-a7d5-b7c8f8da301c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:43.944444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-547adef6-f6e7-41b0-a052-15723d37a22f req-dfee3e4e-045a-4961-a7d5-b7c8f8da301c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:43.954413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:43.955579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:43.973967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:43.974751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:43.975688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:43.978173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:43.980080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:43.981055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:43.986164 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-547adef6-f6e7-41b0-a052-15723d37a22f req-dfee3e4e-045a-4961-a7d5-b7c8f8da301c service nova] Creating event network-changed:9dd5172f-f947-4780-922c-290a788cf6ca for instance a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d on n-h2-820368-35 Aug 27 05:10:44.001036 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-547adef6-f6e7-41b0-a052-15723d37a22f req-dfee3e4e-045a-4961-a7d5-b7c8f8da301c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107651 Aug 27 05:10:44.001712 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1845/3714] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:44.021676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-90291bbe-e5eb-4338-a45a-48fb7ca57a07 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-287707085"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:44.024853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-90291bbe-e5eb-4338-a45a-48fb7ca57a07 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:44.046504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90291bbe-e5eb-4338-a45a-48fb7ca57a07 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:44.047326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90291bbe-e5eb-4338-a45a-48fb7ca57a07 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:44.049937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90291bbe-e5eb-4338-a45a-48fb7ca57a07 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:44.052184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90291bbe-e5eb-4338-a45a-48fb7ca57a07 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:44.054115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90291bbe-e5eb-4338-a45a-48fb7ca57a07 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:44.055043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90291bbe-e5eb-4338-a45a-48fb7ca57a07 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:44.497340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:44.511224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:44.517012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:44.518365 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f56f4410-df94-46e9-9893-926ca837ef6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1751 microversion: 2.20 time: 0.580080 Aug 27 05:10:44.519438 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1870/3715] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:43 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1751 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:44.531716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa5c6748-75bb-45ad-a5d2-2c1d69ff96c1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:44.539980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aa5c6748-75bb-45ad-a5d2-2c1d69ff96c1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:44.546824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa5c6748-75bb-45ad-a5d2-2c1d69ff96c1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:44.554563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa5c6748-75bb-45ad-a5d2-2c1d69ff96c1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:44.555328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa5c6748-75bb-45ad-a5d2-2c1d69ff96c1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:44.559234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa5c6748-75bb-45ad-a5d2-2c1d69ff96c1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:44.560058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa5c6748-75bb-45ad-a5d2-2c1d69ff96c1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:44.560761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa5c6748-75bb-45ad-a5d2-2c1d69ff96c1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:45.165479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:45.169606 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.network.security_group_api [None req-90291bbe-e5eb-4338-a45a-48fb7ca57a07 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Removing security group 10df6a22-d20c-402e-8530-c20fa8f7e02e from port 57deadeb-fc01-4d2b-b151-830cad677ad7 Aug 27 05:10:45.221133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:46.266571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aa5c6748-75bb-45ad-a5d2-2c1d69ff96c1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:46.291338 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aa5c6748-75bb-45ad-a5d2-2c1d69ff96c1 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1669 microversion: 2.1 time: 1.752889 Aug 27 05:10:46.308609 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1871/3716] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:44 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1669 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:46.318347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-186bd8de-02e6-486f-b483-0f34712ad051 req-dcb56a47-600b-4ec5-9548-cea1f3daa4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9", "tag": "57deadeb-fc01-4d2b-b151-830cad677ad7"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:46.357458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-186bd8de-02e6-486f-b483-0f34712ad051 req-dcb56a47-600b-4ec5-9548-cea1f3daa4e8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:46.362487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-186bd8de-02e6-486f-b483-0f34712ad051 req-dcb56a47-600b-4ec5-9548-cea1f3daa4e8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:46.363242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-186bd8de-02e6-486f-b483-0f34712ad051 req-dcb56a47-600b-4ec5-9548-cea1f3daa4e8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:46.392241 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-186bd8de-02e6-486f-b483-0f34712ad051 req-dcb56a47-600b-4ec5-9548-cea1f3daa4e8 service nova] Creating event network-changed:57deadeb-fc01-4d2b-b151-830cad677ad7 for instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 on n-h1-820368-35 Aug 27 05:10:46.402132 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-186bd8de-02e6-486f-b483-0f34712ad051 req-dcb56a47-600b-4ec5-9548-cea1f3daa4e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091251 Aug 27 05:10:46.406154 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1872/3717] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:46.415419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e36be922-9300-427e-b94e-c2d130e87831 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:46.418172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e36be922-9300-427e-b94e-c2d130e87831 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:46.436177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e36be922-9300-427e-b94e-c2d130e87831 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:46.436961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e36be922-9300-427e-b94e-c2d130e87831 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:46.439497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e36be922-9300-427e-b94e-c2d130e87831 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:46.446725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e36be922-9300-427e-b94e-c2d130e87831 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:46.447623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e36be922-9300-427e-b94e-c2d130e87831 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:46.451326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e36be922-9300-427e-b94e-c2d130e87831 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:47.144676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e36be922-9300-427e-b94e-c2d130e87831 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:47.156282 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e36be922-9300-427e-b94e-c2d130e87831 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1332 microversion: 2.1 time: 0.748811 Aug 27 05:10:47.159939 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1873/3718] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:46 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1332 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:47.173464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:47.174451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:47.190005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:47.191549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:47.198061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:47.204773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:47.205433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:47.208017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:47.823370 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-90291bbe-e5eb-4338-a45a-48fb7ca57a07 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "POST /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9/action" status: 202 len: 0 microversion: 2.1 time: 3.817763 Aug 27 05:10:47.824148 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1846/3719] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:44 2022] POST /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9/action => generated 0 bytes in 3821 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:10:47.833928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4bbae2d8-f7fa-4d37-84dd-9629aa85ce8b req-8726d8b9-6de0-4d8c-ab10-a84a0ed508ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410af4b7-cf62-42fe-a9c1-64c5b9d20f92", "tag": "a54a98e7-93a1-4190-a824-b3544f7a2005"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:47.857925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:47.860304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4bbae2d8-f7fa-4d37-84dd-9629aa85ce8b req-8726d8b9-6de0-4d8c-ab10-a84a0ed508ad service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:47.868139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4bbae2d8-f7fa-4d37-84dd-9629aa85ce8b req-8726d8b9-6de0-4d8c-ab10-a84a0ed508ad service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:47.868923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4bbae2d8-f7fa-4d37-84dd-9629aa85ce8b req-8726d8b9-6de0-4d8c-ab10-a84a0ed508ad service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:47.900293 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4bbae2d8-f7fa-4d37-84dd-9629aa85ce8b req-8726d8b9-6de0-4d8c-ab10-a84a0ed508ad service nova] Creating event network-changed:a54a98e7-93a1-4190-a824-b3544f7a2005 for instance 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 on n-h1-820368-35 Aug 27 05:10:47.910653 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4bbae2d8-f7fa-4d37-84dd-9629aa85ce8b req-8726d8b9-6de0-4d8c-ab10-a84a0ed508ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084080 Aug 27 05:10:47.915933 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1847/3720] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:47.932313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:47.941009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:47.968013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:47.968585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:47.968994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:47.975803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:47.977304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:47.977936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:48.082348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:48.083071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:48.083912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:48.084376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lazy-loading 'fault' on Instance uuid a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:10:48.107683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:48.125985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:48.130425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:48.133166 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f627333b-591d-4aa2-be20-9e0dae334d93 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1751 microversion: 2.20 time: 0.965072 Aug 27 05:10:48.145846 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1874/3721] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:47 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1751 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:48.151558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-476f6453-ac71-4166-bd98-f1451b47e6c8 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Action: 'create', calling method: .version_select at 0x7fb56954de50>, body: {"pool": null} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:48.332558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8bd46b91cf4774af109507c7c4422a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8855a07236c54efa89fcec7f944afd94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:48.359748 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e865cb74-1ecf-4170-b10e-7a3636b22ffd tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 200 len: 1338 microversion: 2.1 time: 0.436571 Aug 27 05:10:48.365266 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1848/3722] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:47 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 1338 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:48.385548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b6f5e28b-a70d-4f67-a88f-027cfbec8d2a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:48.391296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b6f5e28b-a70d-4f67-a88f-027cfbec8d2a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:48.413921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6f5e28b-a70d-4f67-a88f-027cfbec8d2a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:48.415338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6f5e28b-a70d-4f67-a88f-027cfbec8d2a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:48.420916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6f5e28b-a70d-4f67-a88f-027cfbec8d2a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:48.421976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6f5e28b-a70d-4f67-a88f-027cfbec8d2a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:48.424258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6f5e28b-a70d-4f67-a88f-027cfbec8d2a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:48.425153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6f5e28b-a70d-4f67-a88f-027cfbec8d2a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:49.415997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6f5e28b-a70d-4f67-a88f-027cfbec8d2a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:49.432019 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b6f5e28b-a70d-4f67-a88f-027cfbec8d2a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1332 microversion: 2.1 time: 1.062304 Aug 27 05:10:49.434703 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1849/3723] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:48 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1332 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:49.458229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-43635573-1966-4ab3-9cc0-0eef1291a34a req-ed89ee23-4111-4b6a-9d1f-143f26eb97a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9", "tag": "57deadeb-fc01-4d2b-b151-830cad677ad7"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:49.481637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-43635573-1966-4ab3-9cc0-0eef1291a34a req-ed89ee23-4111-4b6a-9d1f-143f26eb97a7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:49.482636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-43635573-1966-4ab3-9cc0-0eef1291a34a req-ed89ee23-4111-4b6a-9d1f-143f26eb97a7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:49.486303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-43635573-1966-4ab3-9cc0-0eef1291a34a req-ed89ee23-4111-4b6a-9d1f-143f26eb97a7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:49.506896 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-43635573-1966-4ab3-9cc0-0eef1291a34a req-ed89ee23-4111-4b6a-9d1f-143f26eb97a7 service nova] Creating event network-changed:57deadeb-fc01-4d2b-b151-830cad677ad7 for instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 on n-h1-820368-35 Aug 27 05:10:49.516955 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-43635573-1966-4ab3-9cc0-0eef1291a34a req-ed89ee23-4111-4b6a-9d1f-143f26eb97a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079072 Aug 27 05:10:49.519894 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1850/3724] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:49.532813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:49.536449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:49.548884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:49.549872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:49.550546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:49.551759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:49.552513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:49.553125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:50.001046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:50.023987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:50.026576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:50.028128 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-557c9112-449a-403a-91c0-17fbfa7f8673 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1751 microversion: 2.20 time: 0.506509 Aug 27 05:10:50.028859 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1851/3725] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:49 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1751 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:50.040576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:50.041491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] [instance: a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:50.056321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:50.061039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:50.062823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:50.063842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:50.065694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:50.065968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:50.103905 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] HTTP exception thrown: Instance a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d could not be found. Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Request method failure captured: Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d HTTP/1.1 Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaXQAsB2XQRlEqN77yMjRdnxICdaUvx6aP-hcZhMjA1lQrSkOUf-2PDotZlnHuVaSViuVVQmGWkusSlpeFvcQztnOYnTvckKqFy1eNapeLUENE8eCZ_V2GMGXqynlCiHGRNLoU4zJ2OE1t9a_J-SZPHQ25ZNK3M6X1I9WG2wrZWVomI Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 8855a07236c54efa89fcec7f944afd94 Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestNetworkBasicOps-2034116476 Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8855a07236c54efa89fcec7f944afd94", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8855a07236c54efa89fcec7f944afd94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8855a07236c54efa89fcec7f944afd94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8855a07236c54efa89fcec7f944afd94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestNetworkBasicOps-2034116476 Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 8855a07236c54efa89fcec7f944afd94 Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestNetworkBasicOps-2034116476 Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestNetworkBasicOps-2034116476-project Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: bf8bd46b91cf4774af109507c7c4422a Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestNetworkBasicOps-2034116476-project Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d could not be found. Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d'} Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d could not be found. Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d could not be found. Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:50.109001 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:50.113412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:50.113412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:50.113412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:50.113412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:50.113412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:50.113412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d could not be found. Aug 27 05:10:50.113412 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:10:50.117078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Returning 404 to user: Instance a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:50.118215 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-32fc2326-3190-4d78-a734-cb6307a36e20 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d" status: 404 len: 111 microversion: 2.1 time: 0.088063 Aug 27 05:10:50.118819 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1852/3726] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:50 2022] GET /compute/v2.1/servers/a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:50.129544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-62cee5c7-7bbe-4894-aef2-f22640900e8b req-243dd4c7-9ccd-4eea-911c-ab98651ce8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d", "name": "network-vif-deleted", "tag": "9dd5172f-f947-4780-922c-290a788cf6ca"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:50.142497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-62cee5c7-7bbe-4894-aef2-f22640900e8b req-243dd4c7-9ccd-4eea-911c-ab98651ce8d2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:50.143337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-62cee5c7-7bbe-4894-aef2-f22640900e8b req-243dd4c7-9ccd-4eea-911c-ab98651ce8d2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:50.144048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-62cee5c7-7bbe-4894-aef2-f22640900e8b req-243dd4c7-9ccd-4eea-911c-ab98651ce8d2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:50.159130 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-62cee5c7-7bbe-4894-aef2-f22640900e8b req-243dd4c7-9ccd-4eea-911c-ab98651ce8d2 service nova] Creating event network-vif-deleted:9dd5172f-f947-4780-922c-290a788cf6ca for instance a27e34ff-eb5c-4dca-8f4b-f1138ade7b6d on n-h2-820368-35 Aug 27 05:10:50.166681 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-62cee5c7-7bbe-4894-aef2-f22640900e8b req-243dd4c7-9ccd-4eea-911c-ab98651ce8d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041802 Aug 27 05:10:50.167926 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1853/3727] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:50.464950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b14bd4e7-b48a-4608-b469-5ce884609e0d tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:50.470597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b14bd4e7-b48a-4608-b469-5ce884609e0d tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:50.495497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b14bd4e7-b48a-4608-b469-5ce884609e0d tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:50.497423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b14bd4e7-b48a-4608-b469-5ce884609e0d tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:50.500807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b14bd4e7-b48a-4608-b469-5ce884609e0d tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:50.502287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b14bd4e7-b48a-4608-b469-5ce884609e0d tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:50.504133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b14bd4e7-b48a-4608-b469-5ce884609e0d tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:50.504779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b14bd4e7-b48a-4608-b469-5ce884609e0d tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:51.038898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b14bd4e7-b48a-4608-b469-5ce884609e0d tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:51.056591 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b14bd4e7-b48a-4608-b469-5ce884609e0d tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1332 microversion: 2.1 time: 0.599704 Aug 27 05:10:51.067338 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1854/3728] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:50 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1332 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:51.093525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b5b0597-7ab5-4804-9b9c-af359ee20c07 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] Calling method '.version_select at 0x7fb565797310>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:51.131364 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b5b0597-7ab5-4804-9b9c-af359ee20c07 tempest-TestNetworkBasicOps-2034116476 tempest-TestNetworkBasicOps-2034116476-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-480786393" status: 202 len: 0 microversion: 2.1 time: 0.051234 Aug 27 05:10:51.132356 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1855/3729] 10.222.0.58 () {58 vars in 1254 bytes} [Sat Aug 27 05:10:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-480786393 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:10:51.148803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:51.160434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:51.173521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:51.180394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:51.181451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:51.183108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:51.186914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:51.188006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:52.407249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:52.444266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:52.455187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:52.458294 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-02b349cd-d48d-4c09-838c-a6e97a7bb24b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 1.323933 Aug 27 05:10:52.480839 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1856/3730] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:51 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:52.502998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fd61747a-c413-4e7b-9531-e5f50831363a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:52.503904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fd61747a-c413-4e7b-9531-e5f50831363a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:52.511411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd61747a-c413-4e7b-9531-e5f50831363a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:52.512221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd61747a-c413-4e7b-9531-e5f50831363a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:52.512919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd61747a-c413-4e7b-9531-e5f50831363a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:52.513868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd61747a-c413-4e7b-9531-e5f50831363a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:52.514505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd61747a-c413-4e7b-9531-e5f50831363a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:52.515115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd61747a-c413-4e7b-9531-e5f50831363a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:53.523860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fd61747a-c413-4e7b-9531-e5f50831363a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:53.535469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:53.559540 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fd61747a-c413-4e7b-9531-e5f50831363a tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1332 microversion: 2.1 time: 1.075986 Aug 27 05:10:53.573965 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1857/3731] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:52 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1332 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:53.591934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8aec36da-f651-4f16-879a-cc789e3029c0 req-b41c01a1-d484-49d0-94ec-981c2c17bf7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcbd54c-7e88-44d7-ad7b-be669acb1c7c", "tag": "e1cc65c6-b976-41c9-a889-d9270df2c63d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:53.611828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8aec36da-f651-4f16-879a-cc789e3029c0 req-b41c01a1-d484-49d0-94ec-981c2c17bf7a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:53.612644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8aec36da-f651-4f16-879a-cc789e3029c0 req-b41c01a1-d484-49d0-94ec-981c2c17bf7a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:53.613911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8aec36da-f651-4f16-879a-cc789e3029c0 req-b41c01a1-d484-49d0-94ec-981c2c17bf7a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:53.642305 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8aec36da-f651-4f16-879a-cc789e3029c0 req-b41c01a1-d484-49d0-94ec-981c2c17bf7a service nova] Creating event network-changed:e1cc65c6-b976-41c9-a889-d9270df2c63d for instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c on n-h2-820368-35 Aug 27 05:10:53.651189 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8aec36da-f651-4f16-879a-cc789e3029c0 req-b41c01a1-d484-49d0-94ec-981c2c17bf7a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074939 Aug 27 05:10:53.665757 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1858/3732] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:53.678052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:53.678692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:53.692449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:53.692963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:53.693413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:53.694145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:53.694608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:53.695038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:54.720909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:54.743283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:54.745155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:54.747267 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-80933347-72e7-46af-a144-05487383a6e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 1.079333 Aug 27 05:10:54.748714 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1859/3733] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:53 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:10:54.754774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a3374f9-7f8b-488c-82f3-3aa600d80700 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:54.757383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a3374f9-7f8b-488c-82f3-3aa600d80700 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:54.766238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3374f9-7f8b-488c-82f3-3aa600d80700 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:54.767065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3374f9-7f8b-488c-82f3-3aa600d80700 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:54.767722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3374f9-7f8b-488c-82f3-3aa600d80700 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:54.769599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3374f9-7f8b-488c-82f3-3aa600d80700 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:54.770367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3374f9-7f8b-488c-82f3-3aa600d80700 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:54.770951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a3374f9-7f8b-488c-82f3-3aa600d80700 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:55.522132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a3374f9-7f8b-488c-82f3-3aa600d80700 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:55.533145 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a3374f9-7f8b-488c-82f3-3aa600d80700 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1332 microversion: 2.1 time: 0.782538 Aug 27 05:10:55.542574 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1860/3734] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:54 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1332 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:55.669278 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-476f6453-ac71-4166-bd98-f1451b47e6c8 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.521454 Aug 27 05:10:55.670971 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1875/3735] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 05:10:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:55.695270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.41"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:55.708264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:55.730574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:55.737673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:55.739163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:55.741363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:55.743315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:55.743942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:55.775444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:55.776110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:55.797629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "refresh_cache-10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 05:10:55.798245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquired lock "refresh_cache-10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 05:10:55.805671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:55.806178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:55.806622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:55.807374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:55.808522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:55.808522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:56.708370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:56.718465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:56.720208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:56.736868 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f64c8b9-f780-43c1-9db8-06bf468a6c3f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 0.965588 Aug 27 05:10:56.737540 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1876/3736] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:55 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:10:56.760455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-87c442f5-53ba-48bc-b6b2-b6a0c7a334f3 req-349f729b-975e-4446-8acb-856581a25b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410af4b7-cf62-42fe-a9c1-64c5b9d20f92", "name": "network-vif-plugged", "status": "completed", "tag": "a54a98e7-93a1-4190-a824-b3544f7a2005"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:56.797698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-87c442f5-53ba-48bc-b6b2-b6a0c7a334f3 req-349f729b-975e-4446-8acb-856581a25b2e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:56.798085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-87c442f5-53ba-48bc-b6b2-b6a0c7a334f3 req-349f729b-975e-4446-8acb-856581a25b2e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:56.799154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-87c442f5-53ba-48bc-b6b2-b6a0c7a334f3 req-349f729b-975e-4446-8acb-856581a25b2e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:56.843388 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-87c442f5-53ba-48bc-b6b2-b6a0c7a334f3 req-349f729b-975e-4446-8acb-856581a25b2e service nova] Creating event network-vif-plugged:a54a98e7-93a1-4190-a824-b3544f7a2005 for instance 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 on n-h1-820368-35 Aug 27 05:10:56.862985 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-87c442f5-53ba-48bc-b6b2-b6a0c7a334f3 req-349f729b-975e-4446-8acb-856581a25b2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124116 Aug 27 05:10:56.866066 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1877/3737] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:56.875013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f206f800-3d9b-4cc9-9b41-11174708cbb6 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:56.876385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f206f800-3d9b-4cc9-9b41-11174708cbb6 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:56.915070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f206f800-3d9b-4cc9-9b41-11174708cbb6 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:56.916688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f206f800-3d9b-4cc9-9b41-11174708cbb6 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:56.917267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f206f800-3d9b-4cc9-9b41-11174708cbb6 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:56.918202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f206f800-3d9b-4cc9-9b41-11174708cbb6 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:56.919469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f206f800-3d9b-4cc9-9b41-11174708cbb6 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:56.920228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f206f800-3d9b-4cc9-9b41-11174708cbb6 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:59.206054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f206f800-3d9b-4cc9-9b41-11174708cbb6 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:59.241148 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f206f800-3d9b-4cc9-9b41-11174708cbb6 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1332 microversion: 2.1 time: 2.370567 Aug 27 05:10:59.243265 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1878/3738] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:56 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1332 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:59.251141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:59.258348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:59.301980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:59.303804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:59.307331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:59.308285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:59.311702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:59.312851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:00.339426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:00.383427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:00.394990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:00.401639 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c96cfb7c-343c-47c5-a8b0-8e6203bb36db tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 1.155324 Aug 27 05:11:00.409160 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1879/3739] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:10:59 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:00.428540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5189e5ee-5726-49f3-845e-5405b9547355 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:00.434432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5189e5ee-5726-49f3-845e-5405b9547355 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:00.450996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5189e5ee-5726-49f3-845e-5405b9547355 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:00.454334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5189e5ee-5726-49f3-845e-5405b9547355 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:00.455182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5189e5ee-5726-49f3-845e-5405b9547355 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:00.456258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5189e5ee-5726-49f3-845e-5405b9547355 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:00.458385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5189e5ee-5726-49f3-845e-5405b9547355 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:00.463538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5189e5ee-5726-49f3-845e-5405b9547355 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:01.155152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5189e5ee-5726-49f3-845e-5405b9547355 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:01.170568 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5189e5ee-5726-49f3-845e-5405b9547355 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1537 microversion: 2.1 time: 0.759341 Aug 27 05:11:01.174722 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1880/3740] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:00 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1537 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:01.206016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90ea6a36-9e4f-45c6-b558-3a1bbf4b3741 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Action: 'create', calling method: .version_select at 0x7fb5645a5670>, body: {"pool": "7357b3fa-8561-40d7-8704-75e0551009fe"} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:03.012921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Building network info cache for instance {{(pid=128547) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 05:11:05.730964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:06.136356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Updating instance_info_cache with network_info: [{"id": "57deadeb-fc01-4d2b-b151-830cad677ad7", "address": "fa:16:3e:4d:21:3d", "network": {"id": "e2f40396-aecf-43c6-96a0-abd6bc947a07", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-420069598-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b81288d9952a4ad08f073fd0b818f36a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap57deadeb-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 05:11:06.161210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Releasing lock "refresh_cache-10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 05:11:06.162533 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8cd332bf-ae84-4cd1-b890-442ef6919335 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "POST /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9/action" status: 202 len: 0 microversion: 2.1 time: 10.477079 Aug 27 05:11:06.167427 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1861/3741] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:55 2022] POST /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9/action => generated 0 bytes in 10483 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 05:11:06.173933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:06.179918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:06.200031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:06.200893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:06.203750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:06.205021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:06.205752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:06.206462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:06.727074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:06.747323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:06.751249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:06.754718 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-be8a08de-7c0a-449d-837a-f8a5482280ac tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 0.585177 Aug 27 05:11:06.758673 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1862/3742] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:06 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:06.782579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c1017bd6-3172-4465-af44-95972513004c req-6e69fdff-3feb-4f27-9d91-be8a94b8a047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9", "tag": "57deadeb-fc01-4d2b-b151-830cad677ad7"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:06.838590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c1017bd6-3172-4465-af44-95972513004c req-6e69fdff-3feb-4f27-9d91-be8a94b8a047 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:06.850612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c1017bd6-3172-4465-af44-95972513004c req-6e69fdff-3feb-4f27-9d91-be8a94b8a047 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:06.853333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c1017bd6-3172-4465-af44-95972513004c req-6e69fdff-3feb-4f27-9d91-be8a94b8a047 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:06.895919 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c1017bd6-3172-4465-af44-95972513004c req-6e69fdff-3feb-4f27-9d91-be8a94b8a047 service nova] Creating event network-changed:57deadeb-fc01-4d2b-b151-830cad677ad7 for instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 on n-h1-820368-35 Aug 27 05:11:06.909606 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c1017bd6-3172-4465-af44-95972513004c req-6e69fdff-3feb-4f27-9d91-be8a94b8a047 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147846 Aug 27 05:11:06.916092 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1863/3743] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:07.299411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1890113741", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "90fd8a0a-ef10-4e08-b2d9-58279f4cb7d3"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:07.441903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] validate_networks() for [('90fd8a0a-ef10-4e08-b2d9-58279f4cb7d3', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:11:09.276228 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90ea6a36-9e4f-45c6-b558-3a1bbf4b3741 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.080495 Aug 27 05:11:09.289559 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1881/3744] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 05:11:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:09.297549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.41"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:09.836832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:09.844209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:09.845127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:09.845252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:09.845931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:09.846625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:09.847198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:10.581186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:11:10.581792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:11:10.582113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:11:10.582588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:11:10.583826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:11:10.623503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:10.623761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:10.631975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:10.633195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:10.636092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:10.637324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:10.752061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Getting quotas for project 508e4e58e793462aa81e0fc257aeb429. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:11:10.803581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Getting quotas for user ebd52fd44c03441b9bc9974be3b5f2bc and project 508e4e58e793462aa81e0fc257aeb429. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:11:10.864190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:11:10.866815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:11:11.053635 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ef925709-4f0f-4412-9dc5-bd7fbf0e1893 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.133461 Aug 27 05:11:11.055231 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1864/3745] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 05:11:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4138 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 05:11:11.067402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ccdd15d-69dc-4812-9ae1-3d36716b718e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:11.067780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "refresh_cache-10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 05:11:11.069732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquired lock "refresh_cache-10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 05:11:11.080613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3ccdd15d-69dc-4812-9ae1-3d36716b718e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:11.082364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3ccdd15d-69dc-4812-9ae1-3d36716b718e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Searching by: {'deleted': False, 'project_id': '5455e1b4fef14be99a76abf1e759219a'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:11:11.103383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ccdd15d-69dc-4812-9ae1-3d36716b718e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:11.108198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ccdd15d-69dc-4812-9ae1-3d36716b718e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:11.111563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ccdd15d-69dc-4812-9ae1-3d36716b718e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:11.112845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ccdd15d-69dc-4812-9ae1-3d36716b718e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:11.113596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ccdd15d-69dc-4812-9ae1-3d36716b718e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:11.114774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ccdd15d-69dc-4812-9ae1-3d36716b718e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:11.198977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-3ccdd15d-69dc-4812-9ae1-3d36716b718e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:11:11.324946 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3ccdd15d-69dc-4812-9ae1-3d36716b718e tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.267317 Aug 27 05:11:11.326062 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1865/3746] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 05:11:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:11.337618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:11.339291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:11.360521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:11.361655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:11.362308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:11.364702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:11.365418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:11.366024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:12.118515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:12.172620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:12.178427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:12.188123 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-47c742a1-ee9c-46fa-b8c3-8a4c7c63feb0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 0.857875 Aug 27 05:11:12.192865 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1866/3747] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:11 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:12.218827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.143"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:12.233564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:12.247687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:12.249047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:12.250247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:12.252182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:12.253405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:12.254531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:12.350431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 05:11:12.350744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquired lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 05:11:12.758203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Building network info cache for instance {{(pid=128548) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 05:11:14.135690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Updating instance_info_cache with network_info: [{"id": "57deadeb-fc01-4d2b-b151-830cad677ad7", "address": "fa:16:3e:4d:21:3d", "network": {"id": "e2f40396-aecf-43c6-96a0-abd6bc947a07", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-420069598-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b81288d9952a4ad08f073fd0b818f36a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap57deadeb-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128548) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 05:11:14.150276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:14.159980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Releasing lock "refresh_cache-10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 05:11:14.163494 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7dc7a2cb-d4dd-4b96-9909-f7d0f710dba2 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "POST /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9/action" status: 202 len: 0 microversion: 2.1 time: 4.874091 Aug 27 05:11:14.166388 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1882/3748] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:09 2022] POST /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9/action => generated 0 bytes in 4878 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 05:11:14.184715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:14.185797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:14.232471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:14.234098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:14.234616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:14.235062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:14.235835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:14.236300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:14.236820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:14.374486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:14.397934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:14.400013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:14.402222 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fee1385d-d20b-41c4-acb4-511ae9930bf8 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1263 microversion: 2.21 time: 0.231202 Aug 27 05:11:14.411621 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1883/3749] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:14 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1263 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:14.423405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:14.431136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:14.432223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Searching by: {'deleted': False, 'project_id': '5455e1b4fef14be99a76abf1e759219a'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:11:14.451667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:14.455754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:14.456573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:14.457938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:14.459910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:14.461863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:14.522692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:11:14.618016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:14.626780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:14.627492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:14.628107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:14.885511 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cbeea528-2488-42dd-b46e-a77b1f30c543 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.474384 Aug 27 05:11:14.886890 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1884/3750] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 05:11:14 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:14.892276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-15c426fd-d575-439d-8919-0fd5f8206fc4 req-a7ee3b2a-71a6-4c67-88f4-b3696f0b1369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9", "tag": "57deadeb-fc01-4d2b-b151-830cad677ad7"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:14.930533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-15c426fd-d575-439d-8919-0fd5f8206fc4 req-a7ee3b2a-71a6-4c67-88f4-b3696f0b1369 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:14.931334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-15c426fd-d575-439d-8919-0fd5f8206fc4 req-a7ee3b2a-71a6-4c67-88f4-b3696f0b1369 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:14.932019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-15c426fd-d575-439d-8919-0fd5f8206fc4 req-a7ee3b2a-71a6-4c67-88f4-b3696f0b1369 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:14.983509 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-15c426fd-d575-439d-8919-0fd5f8206fc4 req-a7ee3b2a-71a6-4c67-88f4-b3696f0b1369 service nova] Creating event network-changed:57deadeb-fc01-4d2b-b151-830cad677ad7 for instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 on n-h1-820368-35 Aug 27 05:11:14.995170 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-15c426fd-d575-439d-8919-0fd5f8206fc4 req-a7ee3b2a-71a6-4c67-88f4-b3696f0b1369 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106533 Aug 27 05:11:14.996126 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1885/3751] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:15.006922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:15.008455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:15.018427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:15.019416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:15.020233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:15.021249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:15.021741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:15.022431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:15.400158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Building network info cache for instance {{(pid=128547) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 05:11:15.549540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:15.572978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:15.575908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:15.578003 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-812810b9-09cf-4166-8ba7-c2705e45cf10 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 0.580507 Aug 27 05:11:15.593023 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1886/3752] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:14 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:15.601658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2effd9b4-db79-4630-ad56-2f67dd0f251b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '.version_select at 0x7fb56964cb80>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:17.753513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Updating instance_info_cache with network_info: [{"id": "a54a98e7-93a1-4190-a824-b3544f7a2005", "address": "fa:16:3e:a1:ee:60", "network": {"id": "1aa18e23-bd5d-4795-b707-5a6105a5c877", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1733634762-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a209e7e52dcd4983a112f751fdb1da05", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa54a98e7-93", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 05:11:17.785726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Releasing lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 05:11:17.787012 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6a5a574c-7416-4f25-9b7c-d95288fbc45b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action" status: 202 len: 0 microversion: 2.1 time: 5.592394 Aug 27 05:11:17.788390 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1867/3753] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:12 2022] POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action => generated 0 bytes in 5595 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 05:11:17.809226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f55dd9af-d7df-4157-b6a5-d922e6a780ee tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:17.819720 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f55dd9af-d7df-4157-b6a5-d922e6a780ee tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028638 Aug 27 05:11:17.821778 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1868/3754] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:11:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:17.842133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:17.847363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:17.869036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:17.870052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:17.871435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:17.872347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:17.874246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:17.877968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:18.039385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:18.058830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:18.060333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:18.061498 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-86946435-c4f4-454b-9ed7-0df4698229b1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1317 microversion: 2.21 time: 0.238545 Aug 27 05:11:18.062068 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1869/3755] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:17 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:18.481392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40c31829-2989-4e52-8f11-e336b67cbd61 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Action: 'create', calling method: .version_select at 0x7fb5658210d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1849100245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhx/dgjvu1wdKg8Yb9ltdULnDygcG1EWiyQ2QemZhKy5/7OG+gLdWi54zqZatY/5ya6HdZSWfKN2K+TzXfQKrrDFH9s3PmzhfbqXAWc/FJthYwVy20ye0OHosZS7dVjxg=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:18.544190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-40c31829-2989-4e52-8f11-e336b67cbd61 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Getting quotas for project 59d7d58fbe4248afb4d5d0a40dc11ee5. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:11:18.555948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-40c31829-2989-4e52-8f11-e336b67cbd61 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Getting quotas for user db172a8f7d4c4a17bd34911f31229502 and project 59d7d58fbe4248afb4d5d0a40dc11ee5. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:11:18.625447 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40c31829-2989-4e52-8f11-e336b67cbd61 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.554603 Aug 27 05:11:18.626346 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1870/3756] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:11:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:18.632149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:18.633136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:18.641155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:18.641902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:18.643164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:18.644087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:18.645182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:18.645812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:19.454650 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2effd9b4-db79-4630-ad56-2f67dd0f251b tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/e040be28-791c-407d-98e6-f1b0109409a7" status: 202 len: 0 microversion: 2.1 time: 3.860028 Aug 27 05:11:19.457488 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1887/3757] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:11:15 2022] DELETE /compute/v2.1/os-floating-ips/e040be28-791c-407d-98e6-f1b0109409a7 => generated 0 bytes in 3863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:19.493750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-26d6da92-4aa7-4f86-8a81-d129447e0633 req-7e921290-b154-4be9-baa1-9a37b920a9ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410af4b7-cf62-42fe-a9c1-64c5b9d20f92", "tag": "a54a98e7-93a1-4190-a824-b3544f7a2005"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:19.555320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26d6da92-4aa7-4f86-8a81-d129447e0633 req-7e921290-b154-4be9-baa1-9a37b920a9ff service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:19.556151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26d6da92-4aa7-4f86-8a81-d129447e0633 req-7e921290-b154-4be9-baa1-9a37b920a9ff service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:19.556736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26d6da92-4aa7-4f86-8a81-d129447e0633 req-7e921290-b154-4be9-baa1-9a37b920a9ff service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:19.570062 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-26d6da92-4aa7-4f86-8a81-d129447e0633 req-7e921290-b154-4be9-baa1-9a37b920a9ff service nova] Creating event network-changed:a54a98e7-93a1-4190-a824-b3544f7a2005 for instance 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 on n-h1-820368-35 Aug 27 05:11:19.584069 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-26d6da92-4aa7-4f86-8a81-d129447e0633 req-7e921290-b154-4be9-baa1-9a37b920a9ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111391 Aug 27 05:11:19.585378 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1888/3758] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:19.595360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-87283003-905f-46b7-bf76-5ec13caac774 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Action: 'create', calling method: .version_select at 0x7fb564b65550>, body: {"pool": "7357b3fa-8561-40d7-8704-75e0551009fe"} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:19.603522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:19.624826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:19.628545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:19.630550 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1832d468-c797-4cd1-bec4-f6dd75182556 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 1.002807 Aug 27 05:11:19.637022 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1871/3759] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:18 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:19.656603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5cdef040-88d9-4eb9-a4ee-94d2066d8c30 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:19.657548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5cdef040-88d9-4eb9-a4ee-94d2066d8c30 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:19.675195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cdef040-88d9-4eb9-a4ee-94d2066d8c30 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:19.675768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cdef040-88d9-4eb9-a4ee-94d2066d8c30 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:19.676375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cdef040-88d9-4eb9-a4ee-94d2066d8c30 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:19.681454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cdef040-88d9-4eb9-a4ee-94d2066d8c30 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:19.682021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cdef040-88d9-4eb9-a4ee-94d2066d8c30 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:19.685504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cdef040-88d9-4eb9-a4ee-94d2066d8c30 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:19.762092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5cdef040-88d9-4eb9-a4ee-94d2066d8c30 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:11:19.960566 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5cdef040-88d9-4eb9-a4ee-94d2066d8c30 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 204 len: 0 microversion: 2.1 time: 0.321811 Aug 27 05:11:19.965080 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1872/3760] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:11:19 2022] DELETE /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:11:19.972165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:19.975485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:20.017305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:20.019497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:20.020148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:20.025025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:20.025729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:20.027348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:20.506339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:20.521554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:20.523397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:20.530852 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f233ac47-345e-41a3-9aed-5fb311efda40 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1359 microversion: 2.21 time: 0.562875 Aug 27 05:11:20.531768 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1873/3761] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:19 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1359 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:20.544201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7c646d83-9545-46c5-b97d-c67717ecd178 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '.version_select at 0x7fb5655db040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:21.143264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:21.526587 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7c646d83-9545-46c5-b97d-c67717ecd178 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/10df6a22-d20c-402e-8530-c20fa8f7e02e" status: 202 len: 0 microversion: 2.1 time: 0.993573 Aug 27 05:11:21.527944 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1874/3762] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:11:20 2022] DELETE /compute/v2.1/os-security-groups/10df6a22-d20c-402e-8530-c20fa8f7e02e => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:21.536175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad666972-74cf-4db4-82a3-b9408e3e6bf1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:21.538464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ad666972-74cf-4db4-82a3-b9408e3e6bf1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:21.551215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad666972-74cf-4db4-82a3-b9408e3e6bf1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:21.556902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad666972-74cf-4db4-82a3-b9408e3e6bf1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:21.558844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad666972-74cf-4db4-82a3-b9408e3e6bf1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:21.560868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad666972-74cf-4db4-82a3-b9408e3e6bf1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:21.561649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad666972-74cf-4db4-82a3-b9408e3e6bf1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:21.564321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad666972-74cf-4db4-82a3-b9408e3e6bf1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:21.942820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ad666972-74cf-4db4-82a3-b9408e3e6bf1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:21.948190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:21.962971 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ad666972-74cf-4db4-82a3-b9408e3e6bf1 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1607 microversion: 2.1 time: 0.432311 Aug 27 05:11:21.967523 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1875/3763] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:21 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1607 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:21.990432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:21.994415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:22.013041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.019670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.021832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.023210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.025436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.027029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.405551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:22.415171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:22.417006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:22.418857 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-33cd4b13-29fd-48b5-8527-20d6631b5e2a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 0.449290 Aug 27 05:11:22.424585 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1876/3764] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:21 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:22.424585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9a67dc8c-65f8-4306-b545-00f42d1aa9fc req-4421be39-973c-476f-a6f2-f5ec194c2b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b1540b0-d10c-4e44-8ddc-7917d7468eea", "tag": "1907916f-ff99-4bd3-b5e4-bfe1556c0ef1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:22.440505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9a67dc8c-65f8-4306-b545-00f42d1aa9fc req-4421be39-973c-476f-a6f2-f5ec194c2b9c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.441035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9a67dc8c-65f8-4306-b545-00f42d1aa9fc req-4421be39-973c-476f-a6f2-f5ec194c2b9c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.441841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9a67dc8c-65f8-4306-b545-00f42d1aa9fc req-4421be39-973c-476f-a6f2-f5ec194c2b9c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.459536 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9a67dc8c-65f8-4306-b545-00f42d1aa9fc req-4421be39-973c-476f-a6f2-f5ec194c2b9c service nova] Creating event network-changed:1907916f-ff99-4bd3-b5e4-bfe1556c0ef1 for instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea on n-h2-820368-35 Aug 27 05:11:22.465396 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9a67dc8c-65f8-4306-b545-00f42d1aa9fc req-4421be39-973c-476f-a6f2-f5ec194c2b9c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044559 Aug 27 05:11:22.466004 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1877/3765] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:22.473001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-41ac3b5c-dec9-42f8-b2bd-3a44e3ef9e43 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:22.473935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-41ac3b5c-dec9-42f8-b2bd-3a44e3ef9e43 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:22.483180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41ac3b5c-dec9-42f8-b2bd-3a44e3ef9e43 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.484643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41ac3b5c-dec9-42f8-b2bd-3a44e3ef9e43 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.485561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41ac3b5c-dec9-42f8-b2bd-3a44e3ef9e43 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.486452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41ac3b5c-dec9-42f8-b2bd-3a44e3ef9e43 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.488669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41ac3b5c-dec9-42f8-b2bd-3a44e3ef9e43 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.491362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41ac3b5c-dec9-42f8-b2bd-3a44e3ef9e43 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.529291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-41ac3b5c-dec9-42f8-b2bd-3a44e3ef9e43 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:11:22.631682 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-41ac3b5c-dec9-42f8-b2bd-3a44e3ef9e43 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 204 len: 0 microversion: 2.1 time: 0.164031 Aug 27 05:11:22.632655 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1878/3766] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:11:22 2022] DELETE /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:11:22.639834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:22.640710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:22.647244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.647897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.648376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.649243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.649771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.650267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.931193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:22.946034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:22.947686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:22.949792 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c790ac40-1362-4715-aca6-e2a434e37026 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1359 microversion: 2.21 time: 0.315782 Aug 27 05:11:22.950500 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1879/3767] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:22 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1359 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:22.975758 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-87283003-905f-46b7-bf76-5ec13caac774 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.386231 Aug 27 05:11:22.976465 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1889/3768] 10.222.0.58 () {60 vars in 1170 bytes} [Sat Aug 27 05:11:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:22.981382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-686330303", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1849100245", "security_groups": [{"name": "tempest-secgroup-smoke-1709726315"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "f705f6f6-139c-42d2-9d2c-f2528f5606cd"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:23.125751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] validate_networks() for [('f705f6f6-139c-42d2-9d2c-f2528f5606cd', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:11:23.273391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1679025933", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "888f8806-59be-4858-89cf-85a078fd49ed"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:23.383534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] validate_networks() for [('888f8806-59be-4858-89cf-85a078fd49ed', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:11:23.896040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Getting quotas for project 59d7d58fbe4248afb4d5d0a40dc11ee5. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:11:23.905643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Getting quotas for user db172a8f7d4c4a17bd34911f31229502 and project 59d7d58fbe4248afb4d5d0a40dc11ee5. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:11:23.922534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:11:23.922958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:11:23.923929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:11:23.924166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:11:23.924587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:11:23.933750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:23.934239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:23.934673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:23.935430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:23.935881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:23.936307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:23.955898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Getting quotas for project 59d7d58fbe4248afb4d5d0a40dc11ee5. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:11:23.962019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Getting quotas for user db172a8f7d4c4a17bd34911f31229502 and project 59d7d58fbe4248afb4d5d0a40dc11ee5. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:11:23.981474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:11:23.984886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:11:24.045576 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-152bce64-bfab-45b5-abf2-8f23f6a390bb tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.067338 Aug 27 05:11:24.047430 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1890/3769] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:11:24.058108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-248880c3-d442-4adc-a33f-2367800fd97e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:24.059043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-248880c3-d442-4adc-a33f-2367800fd97e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:24.070596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-248880c3-d442-4adc-a33f-2367800fd97e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.071401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-248880c3-d442-4adc-a33f-2367800fd97e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.072726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-248880c3-d442-4adc-a33f-2367800fd97e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.074371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-248880c3-d442-4adc-a33f-2367800fd97e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.075563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-248880c3-d442-4adc-a33f-2367800fd97e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.075899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-248880c3-d442-4adc-a33f-2367800fd97e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.417623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:11:24.418207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:11:24.418527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:11:24.418938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:11:24.419540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:11:24.430618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-248880c3-d442-4adc-a33f-2367800fd97e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:24.444617 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-248880c3-d442-4adc-a33f-2367800fd97e tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1508 microversion: 2.1 time: 0.395679 Aug 27 05:11:24.445212 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1891/3770] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:24 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:24.450579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.451857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.452496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.453412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.454023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.454724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.462676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.122"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:24.466364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:24.477752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.478267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.478695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.481888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.482370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.482820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.507169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Getting quotas for project 98b1b469396c435d8ee08ee24b3e5791. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:11:24.518241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Getting quotas for user da9b26e9246d42f998f31e0643b26573 and project 98b1b469396c435d8ee08ee24b3e5791. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:11:24.529506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 05:11:24.530162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquired lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 05:11:24.559980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:11:24.563489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:11:24.648064 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1888a559-4f0a-436a-9c82-cc393826669f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.695420 Aug 27 05:11:24.649297 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1880/3771] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:11:24.664175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-82839e8b-8b2c-4d99-ad3b-1de8fb670006 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:24.669724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-82839e8b-8b2c-4d99-ad3b-1de8fb670006 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:24.686290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82839e8b-8b2c-4d99-ad3b-1de8fb670006 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.687081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82839e8b-8b2c-4d99-ad3b-1de8fb670006 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.687425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82839e8b-8b2c-4d99-ad3b-1de8fb670006 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.688739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82839e8b-8b2c-4d99-ad3b-1de8fb670006 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.689206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82839e8b-8b2c-4d99-ad3b-1de8fb670006 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.689638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-82839e8b-8b2c-4d99-ad3b-1de8fb670006 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.899822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-82839e8b-8b2c-4d99-ad3b-1de8fb670006 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:24.909750 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-82839e8b-8b2c-4d99-ad3b-1de8fb670006 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1540 microversion: 2.1 time: 0.259153 Aug 27 05:11:24.910337 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1881/3772] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:24 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1540 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:24.920874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:24.925860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:24.944270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.945635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.946773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.949577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.951571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.952217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:25.318807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:25.332245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:25.339010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:25.344113 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb873b85-6a01-4307-81fc-cff3d3ac0ddc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 0.425799 Aug 27 05:11:25.346493 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1882/3773] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:24 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:25.366901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:25.371867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:25.394628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:25.395189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:25.395300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.122 (e684ce33-d618-4eb6-8efa-6714ef4fe5d5) with port a54a98e7-93a1-4190-a824-b3544f7a2005 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7357b3fa-8561-40d7-8704-75e0551009fe.", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:11:25.395669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:25.395821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Releasing lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 05:11:25.396355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:25.396791 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.122 (e684ce33-d618-4eb6-8efa-6714ef4fe5d5) with port a54a98e7-93a1-4190-a824-b3544f7a2005 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7357b3fa-8561-40d7-8704-75e0551009fe. Aug 27 05:11:25.396791 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-1db15472-f345-4da5-a130-6e5097ef7ead'] Aug 27 05:11:25.396965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:25.397215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Request method failure captured: Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action HTTP/1.1 Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 46 Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCadJCXOdChSpllxNErbPU0dSFn7c3jvObDALavDFnFMKMi2rVyqLgcfTbIWCPO1LyEZdletQPOVhW6OHZSOyaSfzgfOytrEqWPhRUO8iTz8SVyUNDmuNOQRbPIMH3ehDu1mUi05sRKgrhpxGRMyV4vIGRgSZ-v67VL-wehzeDjiQ2FU Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: a209e7e52dcd4983a112f751fdb1da05 Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a209e7e52dcd4983a112f751fdb1da05", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: a209e7e52dcd4983a112f751fdb1da05 Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 2108e75d88ec40cba3c70ab2e954e11a Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: {"addFloatingIp": {"address": "172.25.9.122"}} Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot associate floating IP 172.25.9.122 (e684ce33-d618-4eb6-8efa-6714ef4fe5d5) with port a54a98e7-93a1-4190-a824-b3544f7a2005 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7357b3fa-8561-40d7-8704-75e0551009fe. Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-1db15472-f345-4da5-a130-6e5097ef7ead'] Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '410af4b7-cf62-42fe-a9c1-64c5b9d20f92', 'body': {'addFloatingIp': {'address': '172.25.9.122'}}} Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:11:25.399705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.122 (e684ce33-d618-4eb6-8efa-6714ef4fe5d5) with port a54a98e7-93a1-4190-a824-b3544f7a2005 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7357b3fa-8561-40d7-8704-75e0551009fe. Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1db15472-f345-4da5-a130-6e5097ef7ead'] Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.122 (e684ce33-d618-4eb6-8efa-6714ef4fe5d5) with port a54a98e7-93a1-4190-a824-b3544f7a2005 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7357b3fa-8561-40d7-8704-75e0551009fe. Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1db15472-f345-4da5-a130-6e5097ef7ead'] Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.122 (e684ce33-d618-4eb6-8efa-6714ef4fe5d5) with port a54a98e7-93a1-4190-a824-b3544f7a2005 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7357b3fa-8561-40d7-8704-75e0551009fe. Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1db15472-f345-4da5-a130-6e5097ef7ead'] Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.122 (e684ce33-d618-4eb6-8efa-6714ef4fe5d5) with port a54a98e7-93a1-4190-a824-b3544f7a2005 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7357b3fa-8561-40d7-8704-75e0551009fe. Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1db15472-f345-4da5-a130-6e5097ef7ead'] Aug 27 05:11:25.404966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:25.411348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Returning 400 to user: Cannot associate floating IP 172.25.9.122 (e684ce33-d618-4eb6-8efa-6714ef4fe5d5) with port a54a98e7-93a1-4190-a824-b3544f7a2005 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7357b3fa-8561-40d7-8704-75e0551009fe. Aug 27 05:11:25.411348 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-1db15472-f345-4da5-a130-6e5097ef7ead'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:25.412545 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f88d7936-b321-4d8c-bf64-a7312506d769 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action" status: 400 len: 382 microversion: 2.1 time: 0.965968 Aug 27 05:11:25.413483 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1892/3774] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:24 2022] POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action => generated 382 bytes in 968 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:11:25.424577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab9da1ae-8669-430f-a9e0-f1805897e2b8 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:25.425613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ab9da1ae-8669-430f-a9e0-f1805897e2b8 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:25.443898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9da1ae-8669-430f-a9e0-f1805897e2b8 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:25.444747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9da1ae-8669-430f-a9e0-f1805897e2b8 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:25.445497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9da1ae-8669-430f-a9e0-f1805897e2b8 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:25.448037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9da1ae-8669-430f-a9e0-f1805897e2b8 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:25.448838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9da1ae-8669-430f-a9e0-f1805897e2b8 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:25.450272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9da1ae-8669-430f-a9e0-f1805897e2b8 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:25.721995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ab9da1ae-8669-430f-a9e0-f1805897e2b8 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:25.738611 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ab9da1ae-8669-430f-a9e0-f1805897e2b8 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1354 microversion: 2.1 time: 0.323807 Aug 27 05:11:25.741006 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1893/3775] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:25 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1354 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:25.753948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7e9e61ad-7500-4314-a6da-de1bca45a3f1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:25.755877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7e9e61ad-7500-4314-a6da-de1bca45a3f1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:25.770601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:25.772890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e9e61ad-7500-4314-a6da-de1bca45a3f1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:25.773397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e9e61ad-7500-4314-a6da-de1bca45a3f1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:25.773868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e9e61ad-7500-4314-a6da-de1bca45a3f1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:25.780350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:25.781168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e9e61ad-7500-4314-a6da-de1bca45a3f1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:25.781852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e9e61ad-7500-4314-a6da-de1bca45a3f1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:25.782844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e9e61ad-7500-4314-a6da-de1bca45a3f1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:25.791759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:25.793727 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c436c122-228d-4a6e-bc29-3895f1aba9e1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1359 microversion: 2.21 time: 0.444170 Aug 27 05:11:25.794741 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1883/3776] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:25 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1359 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:25.804178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0a8ef710-0dbb-4a89-ad8e-d0a3a445bee6 req-678df1ab-e51d-4233-b62c-b127d0404794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee435af-d600-47a1-ae47-316d49b71aed", "name": "network-vif-deleted", "tag": "4bad91fd-25bd-4e3f-b774-ae5ff30f559d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:25.838271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0a8ef710-0dbb-4a89-ad8e-d0a3a445bee6 req-678df1ab-e51d-4233-b62c-b127d0404794 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:25.838857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0a8ef710-0dbb-4a89-ad8e-d0a3a445bee6 req-678df1ab-e51d-4233-b62c-b127d0404794 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:25.840280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0a8ef710-0dbb-4a89-ad8e-d0a3a445bee6 req-678df1ab-e51d-4233-b62c-b127d0404794 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:25.893651 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0a8ef710-0dbb-4a89-ad8e-d0a3a445bee6 req-678df1ab-e51d-4233-b62c-b127d0404794 service nova] Creating event network-vif-deleted:4bad91fd-25bd-4e3f-b774-ae5ff30f559d for instance 9ee435af-d600-47a1-ae47-316d49b71aed on n-h2-820368-35 Aug 27 05:11:25.905025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7e9e61ad-7500-4314-a6da-de1bca45a3f1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:25.906230 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0a8ef710-0dbb-4a89-ad8e-d0a3a445bee6 req-678df1ab-e51d-4233-b62c-b127d0404794 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109837 Aug 27 05:11:25.908504 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1884/3777] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:25.917447 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7e9e61ad-7500-4314-a6da-de1bca45a3f1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1220 microversion: 2.1 time: 0.174510 Aug 27 05:11:25.922588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c062f560-8e54-4f97-9fce-874623ab6c07 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '.version_select at 0x7fb56517fca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:25.933611 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1894/3778] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:25 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1220 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:25.948333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4e3ddbe6-6eb0-4d95-8082-d76491e24ab6 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:25.951587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4e3ddbe6-6eb0-4d95-8082-d76491e24ab6 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:25.960560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e3ddbe6-6eb0-4d95-8082-d76491e24ab6 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:25.961289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e3ddbe6-6eb0-4d95-8082-d76491e24ab6 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:25.961920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e3ddbe6-6eb0-4d95-8082-d76491e24ab6 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:25.963605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e3ddbe6-6eb0-4d95-8082-d76491e24ab6 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:25.965452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e3ddbe6-6eb0-4d95-8082-d76491e24ab6 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:25.967259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e3ddbe6-6eb0-4d95-8082-d76491e24ab6 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:26.473071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4e3ddbe6-6eb0-4d95-8082-d76491e24ab6 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:26.484364 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4e3ddbe6-6eb0-4d95-8082-d76491e24ab6 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1508 microversion: 2.1 time: 0.548738 Aug 27 05:11:26.499454 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1895/3779] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:25 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1508 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:26.504856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5186b6f8-1b73-4cdb-9236-c3f388689f4f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:26.505674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5186b6f8-1b73-4cdb-9236-c3f388689f4f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:26.519936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5186b6f8-1b73-4cdb-9236-c3f388689f4f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:26.520441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5186b6f8-1b73-4cdb-9236-c3f388689f4f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:26.520884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5186b6f8-1b73-4cdb-9236-c3f388689f4f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:26.521596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5186b6f8-1b73-4cdb-9236-c3f388689f4f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:26.522117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5186b6f8-1b73-4cdb-9236-c3f388689f4f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:26.522545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5186b6f8-1b73-4cdb-9236-c3f388689f4f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:26.727519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5186b6f8-1b73-4cdb-9236-c3f388689f4f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:26.746819 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5186b6f8-1b73-4cdb-9236-c3f388689f4f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1251 microversion: 2.1 time: 0.245924 Aug 27 05:11:26.747467 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1896/3780] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:26 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1251 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:26.767266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:26.773328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:26.787844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:26.788597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:26.789283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:26.792075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:26.793015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:26.793602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:27.276427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:27.287443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:27.295522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:27.297629 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e0fc33d1-eb17-47de-a32d-8209d06c42d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 0.536667 Aug 27 05:11:27.320385 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1897/3781] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:26 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:27.333343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-39685070-0c03-496c-a78b-1dec79d40565 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:27.334130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-39685070-0c03-496c-a78b-1dec79d40565 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:27.342871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39685070-0c03-496c-a78b-1dec79d40565 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:27.348142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39685070-0c03-496c-a78b-1dec79d40565 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:27.349076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39685070-0c03-496c-a78b-1dec79d40565 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:27.350085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39685070-0c03-496c-a78b-1dec79d40565 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:27.352623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39685070-0c03-496c-a78b-1dec79d40565 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:27.353262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39685070-0c03-496c-a78b-1dec79d40565 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:27.487565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-39685070-0c03-496c-a78b-1dec79d40565 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:27.498054 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-39685070-0c03-496c-a78b-1dec79d40565 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1360 microversion: 2.1 time: 0.175407 Aug 27 05:11:27.501372 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1898/3782] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:27 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1360 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:27.506523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:27.509755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:27.525683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:27.531290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:27.532579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:27.533911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:27.534803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:27.535418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:27.818612 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c062f560-8e54-4f97-9fce-874623ab6c07 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/e684ce33-d618-4eb6-8efa-6714ef4fe5d5" status: 202 len: 0 microversion: 2.1 time: 1.907020 Aug 27 05:11:27.820085 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1885/3783] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:11:25 2022] DELETE /compute/v2.1/os-floating-ips/e684ce33-d618-4eb6-8efa-6714ef4fe5d5 => generated 0 bytes in 1911 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:27.843290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0545824c-7b66-440b-b7ab-cea0f7310252 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:27.844553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0545824c-7b66-440b-b7ab-cea0f7310252 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:27.861229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:27.877796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:27.878830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0545824c-7b66-440b-b7ab-cea0f7310252 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:27.879402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0545824c-7b66-440b-b7ab-cea0f7310252 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:27.880811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0545824c-7b66-440b-b7ab-cea0f7310252 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:27.881664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:27.882742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0545824c-7b66-440b-b7ab-cea0f7310252 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:27.883276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0545824c-7b66-440b-b7ab-cea0f7310252 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:27.885594 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a7e9507e-fcb5-4241-b067-9e0dda46d25b tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1359 microversion: 2.21 time: 0.381356 Aug 27 05:11:27.886970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0545824c-7b66-440b-b7ab-cea0f7310252 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:27.888596 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1899/3784] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:27 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1359 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:27.908539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:27.909261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:27.921619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:27.922135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:27.922583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:27.923341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:27.924820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:27.925509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.079405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.079928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.081562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.083762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lazy-loading 'fault' on Instance uuid 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:11:28.091982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0545824c-7b66-440b-b7ab-cea0f7310252 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:28.101923 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0545824c-7b66-440b-b7ab-cea0f7310252 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1282 microversion: 2.1 time: 0.276604 Aug 27 05:11:28.102508 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1886/3785] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:27 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1282 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:28.113436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-617750b4-5752-40ab-9ee2-ce42e2989340 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:28.128132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-617750b4-5752-40ab-9ee2-ce42e2989340 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:28.145789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-617750b4-5752-40ab-9ee2-ce42e2989340 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.146293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-617750b4-5752-40ab-9ee2-ce42e2989340 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.146735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd258c8a1bb33492e99ef2df2b1686201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81288d9952a4ad08f073fd0b818f36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:28.146864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-617750b4-5752-40ab-9ee2-ce42e2989340 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.147669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-617750b4-5752-40ab-9ee2-ce42e2989340 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.147915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-617750b4-5752-40ab-9ee2-ce42e2989340 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.153336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-617750b4-5752-40ab-9ee2-ce42e2989340 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.156742 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d18f93f-7909-4afb-9622-14b0f0bbb396 tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 200 len: 1312 microversion: 2.1 time: 0.266725 Aug 27 05:11:28.157683 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1900/3786] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:27 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:28.172032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.143"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:28.329530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-617750b4-5752-40ab-9ee2-ce42e2989340 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:28.339791 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-617750b4-5752-40ab-9ee2-ce42e2989340 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1251 microversion: 2.1 time: 0.233053 Aug 27 05:11:28.355972 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1887/3787] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:28 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1251 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:28.361730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:28.362660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:28.370783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:28.374458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.376876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.377707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.380283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.382394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.385049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.553753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:28.562477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.564020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.565834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.571328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.572024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.579982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.788293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:28.809555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:28.811040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:28.812400 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-55105f5c-ed16-47f8-affd-813d2ce595dd tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 0.455067 Aug 27 05:11:28.815513 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1888/3788] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:28 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:28.820327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-527a8deb-cb3b-40a5-a732-3fa2e06a0386 req-c09f6e47-238e-40d4-b892-4f752e4b83fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9", "name": "network-vif-deleted", "tag": "57deadeb-fc01-4d2b-b151-830cad677ad7"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:28.844348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-527a8deb-cb3b-40a5-a732-3fa2e06a0386 req-c09f6e47-238e-40d4-b892-4f752e4b83fe service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.854403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-527a8deb-cb3b-40a5-a732-3fa2e06a0386 req-c09f6e47-238e-40d4-b892-4f752e4b83fe service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.855615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-527a8deb-cb3b-40a5-a732-3fa2e06a0386 req-c09f6e47-238e-40d4-b892-4f752e4b83fe service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.883489 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-527a8deb-cb3b-40a5-a732-3fa2e06a0386 req-c09f6e47-238e-40d4-b892-4f752e4b83fe service nova] Creating event network-vif-deleted:57deadeb-fc01-4d2b-b151-830cad677ad7 for instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 on n-h1-820368-35 Aug 27 05:11:28.894301 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-527a8deb-cb3b-40a5-a732-3fa2e06a0386 req-c09f6e47-238e-40d4-b892-4f752e4b83fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077439 Aug 27 05:11:28.897018 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1889/3789] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:28.912437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cb633e3d-547e-449d-a169-d79e9368ad05 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:28.913209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cb633e3d-547e-449d-a169-d79e9368ad05 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:28.935691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb633e3d-547e-449d-a169-d79e9368ad05 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.936198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb633e3d-547e-449d-a169-d79e9368ad05 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.936640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb633e3d-547e-449d-a169-d79e9368ad05 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.938019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb633e3d-547e-449d-a169-d79e9368ad05 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.938490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb633e3d-547e-449d-a169-d79e9368ad05 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.938919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb633e3d-547e-449d-a169-d79e9368ad05 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:29.088863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 05:11:29.090854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquired lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 05:11:29.211176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cb633e3d-547e-449d-a169-d79e9368ad05 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:29.221882 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cb633e3d-547e-449d-a169-d79e9368ad05 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1428 microversion: 2.1 time: 0.323566 Aug 27 05:11:29.236009 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1890/3790] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:28 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1428 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:29.243739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:29.244694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:29.252975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:29.253479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:29.253951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:29.254671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:29.255167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:29.255600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:29.754646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:29.779793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:29.789389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:29.794470 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-611f2dc4-12ce-474e-9493-45bb83ed84a6 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1359 microversion: 2.21 time: 0.559361 Aug 27 05:11:29.797258 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1891/3791] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:29 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1359 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:29.809427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-94c6eb49-ec03-4680-b055-21f540e81bfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:29.810174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-94c6eb49-ec03-4680-b055-21f540e81bfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:29.829808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94c6eb49-ec03-4680-b055-21f540e81bfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:29.830473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94c6eb49-ec03-4680-b055-21f540e81bfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:29.830676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94c6eb49-ec03-4680-b055-21f540e81bfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:29.836498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94c6eb49-ec03-4680-b055-21f540e81bfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:29.838040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94c6eb49-ec03-4680-b055-21f540e81bfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:29.838641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94c6eb49-ec03-4680-b055-21f540e81bfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:30.228808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-94c6eb49-ec03-4680-b055-21f540e81bfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:30.241948 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-94c6eb49-ec03-4680-b055-21f540e81bfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1324 microversion: 2.1 time: 0.441998 Aug 27 05:11:30.243979 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1892/3792] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:29 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1324 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:30.251539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:30.252474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] [instance: 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:30.269481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:30.279876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:30.280831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:30.281717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:30.282448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:30.283164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:30.308552 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] HTTP exception thrown: Instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 could not be found. Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Request method failure captured: Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 HTTP/1.1 Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCacOtRmpuJE9QcF3NkGCVcWXNOr1ckrh7q-vNxyv3WzyljaqTgSJ2CrUiVsglqdeugB8NSs_wjufcqeHI3FuuAbf1k5intw4U5U9jxSFxS6Ka0BUZB5bl0lPjT7Xv2ar2QaFuAUEL7Q7jDz_HWCjzAf3xJ7TQ67ElCS29MnnYFMnPb8 Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: b81288d9952a4ad08f073fd0b818f36a Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1759977370 Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b81288d9952a4ad08f073fd0b818f36a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b81288d9952a4ad08f073fd0b818f36a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b81288d9952a4ad08f073fd0b818f36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b81288d9952a4ad08f073fd0b818f36a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1759977370 Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: b81288d9952a4ad08f073fd0b818f36a Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1759977370 Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerRescueTestJSONUnderV235-1759977370-project Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: d258c8a1bb33492e99ef2df2b1686201 Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1759977370-project Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 could not be found. Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9'} Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 could not be found. Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 could not be found. Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:30.310661 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:30.314253 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:30.314253 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:30.314253 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:30.314253 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:30.314253 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:30.314253 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:30.314253 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 could not be found. Aug 27 05:11:30.314253 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:30.316353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] Returning 404 to user: Instance 10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:30.317480 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e209e287-39ca-4355-8494-c4125214aaff tempest-ServerRescueTestJSONUnderV235-1759977370 tempest-ServerRescueTestJSONUnderV235-1759977370-project] 10.222.0.58 "GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9" status: 404 len: 111 microversion: 2.1 time: 0.071167 Aug 27 05:11:30.318583 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1893/3793] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:30 2022] GET /compute/v2.1/servers/10f6e4b9-1be4-4cdd-98b5-bc41877ae9b9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:11:30.323722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc101533-3cec-4054-beeb-2a00d36408f7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:30.324679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dc101533-3cec-4054-beeb-2a00d36408f7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:30.331622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc101533-3cec-4054-beeb-2a00d36408f7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:30.332527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc101533-3cec-4054-beeb-2a00d36408f7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:30.333193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc101533-3cec-4054-beeb-2a00d36408f7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:30.334342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc101533-3cec-4054-beeb-2a00d36408f7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:30.335034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc101533-3cec-4054-beeb-2a00d36408f7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:30.335972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc101533-3cec-4054-beeb-2a00d36408f7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:30.437559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dc101533-3cec-4054-beeb-2a00d36408f7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:30.447983 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dc101533-3cec-4054-beeb-2a00d36408f7 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1251 microversion: 2.1 time: 0.128071 Aug 27 05:11:30.464983 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1894/3794] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:30 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1251 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:30.470922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:30.471812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:30.484984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:30.485719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:30.486506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:30.489335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:30.489963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:30.490563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:30.496497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:31.087584 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:11:31.089587 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 05:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action (ip 10.222.0.58) !!! Aug 27 05:11:31.217334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:31.223463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Building network info cache for instance {{(pid=128548) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 05:11:31.228897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:31.234554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:31.236118 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-09d6b554-1cfb-4919-bebe-283af6d5b0c8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 0.769785 Aug 27 05:11:31.259897 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1895/3795] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:30 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:31.268589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f8b8b332-05d5-4e93-83c9-15a52556ad80 req-7b855ac5-2cc9-462c-ae92-7f98dfae463c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcbd54c-7e88-44d7-ad7b-be669acb1c7c", "name": "network-vif-plugged", "status": "completed", "tag": "e1cc65c6-b976-41c9-a889-d9270df2c63d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:31.299367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f8b8b332-05d5-4e93-83c9-15a52556ad80 req-7b855ac5-2cc9-462c-ae92-7f98dfae463c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:31.313053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f8b8b332-05d5-4e93-83c9-15a52556ad80 req-7b855ac5-2cc9-462c-ae92-7f98dfae463c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:31.313983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f8b8b332-05d5-4e93-83c9-15a52556ad80 req-7b855ac5-2cc9-462c-ae92-7f98dfae463c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:31.335847 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f8b8b332-05d5-4e93-83c9-15a52556ad80 req-7b855ac5-2cc9-462c-ae92-7f98dfae463c service nova] Creating event network-vif-plugged:e1cc65c6-b976-41c9-a889-d9270df2c63d for instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c on n-h2-820368-35 Aug 27 05:11:31.341971 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f8b8b332-05d5-4e93-83c9-15a52556ad80 req-7b855ac5-2cc9-462c-ae92-7f98dfae463c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080288 Aug 27 05:11:31.343186 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1896/3796] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:31.349804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-50e1d96f-fc9f-4a21-b606-7995a145c240 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:31.350712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-50e1d96f-fc9f-4a21-b606-7995a145c240 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:31.358677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e1d96f-fc9f-4a21-b606-7995a145c240 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:31.359580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e1d96f-fc9f-4a21-b606-7995a145c240 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:31.360200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e1d96f-fc9f-4a21-b606-7995a145c240 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:31.361232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e1d96f-fc9f-4a21-b606-7995a145c240 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:31.361890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e1d96f-fc9f-4a21-b606-7995a145c240 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:31.362483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e1d96f-fc9f-4a21-b606-7995a145c240 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:31.991672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-50e1d96f-fc9f-4a21-b606-7995a145c240 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:32.001042 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-50e1d96f-fc9f-4a21-b606-7995a145c240 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1428 microversion: 2.1 time: 0.656471 Aug 27 05:11:32.003372 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1897/3797] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:31 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1428 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:32.008581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:32.009614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:32.017796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:32.018548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:32.019172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:32.020128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:32.020735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:32.021309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:32.401505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:32.421988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:32.424781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:32.426154 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68b38be7-4771-4351-8613-6183d6d74476 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1359 microversion: 2.21 time: 0.421587 Aug 27 05:11:32.426883 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1898/3798] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:32 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1359 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:32.431985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-efc45ec6-5025-4525-a6e0-991cf899b2ec req-40920e02-2ff8-4837-b8b2-b93bb1f285a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f179b67-f086-4d14-9088-e2fdf6f0c17d", "tag": "f52edb24-891f-48e2-a92d-bc4fb7d64dc6"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:32.442922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-efc45ec6-5025-4525-a6e0-991cf899b2ec req-40920e02-2ff8-4837-b8b2-b93bb1f285a6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:32.443668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-efc45ec6-5025-4525-a6e0-991cf899b2ec req-40920e02-2ff8-4837-b8b2-b93bb1f285a6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:32.444254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-efc45ec6-5025-4525-a6e0-991cf899b2ec req-40920e02-2ff8-4837-b8b2-b93bb1f285a6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:32.457735 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-efc45ec6-5025-4525-a6e0-991cf899b2ec req-40920e02-2ff8-4837-b8b2-b93bb1f285a6 service nova] Creating event network-changed:f52edb24-891f-48e2-a92d-bc4fb7d64dc6 for instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d on n-h1-820368-35 Aug 27 05:11:32.468842 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-efc45ec6-5025-4525-a6e0-991cf899b2ec req-40920e02-2ff8-4837-b8b2-b93bb1f285a6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040531 Aug 27 05:11:32.469770 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1899/3799] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:32.479100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4403abb6-3838-4efb-958a-46182a1daea9 req-a638cf88-0965-430c-a468-f55faee41e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410af4b7-cf62-42fe-a9c1-64c5b9d20f92", "tag": "a54a98e7-93a1-4190-a824-b3544f7a2005"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:32.491384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4403abb6-3838-4efb-958a-46182a1daea9 req-a638cf88-0965-430c-a468-f55faee41e2e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:32.491867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4403abb6-3838-4efb-958a-46182a1daea9 req-a638cf88-0965-430c-a468-f55faee41e2e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:32.492468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4403abb6-3838-4efb-958a-46182a1daea9 req-a638cf88-0965-430c-a468-f55faee41e2e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:32.505561 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4403abb6-3838-4efb-958a-46182a1daea9 req-a638cf88-0965-430c-a468-f55faee41e2e service nova] Creating event network-changed:a54a98e7-93a1-4190-a824-b3544f7a2005 for instance 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 on n-h1-820368-35 Aug 27 05:11:32.511399 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4403abb6-3838-4efb-958a-46182a1daea9 req-a638cf88-0965-430c-a468-f55faee41e2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039464 Aug 27 05:11:32.512181 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1900/3800] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:32.517357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ebd64019-7f94-4716-aa7b-6a2f95b32b3a tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:32.518071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ebd64019-7f94-4716-aa7b-6a2f95b32b3a tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:32.524275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebd64019-7f94-4716-aa7b-6a2f95b32b3a tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:32.524763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebd64019-7f94-4716-aa7b-6a2f95b32b3a tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:32.525199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebd64019-7f94-4716-aa7b-6a2f95b32b3a tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:32.525896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebd64019-7f94-4716-aa7b-6a2f95b32b3a tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:32.526421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebd64019-7f94-4716-aa7b-6a2f95b32b3a tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:32.527377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebd64019-7f94-4716-aa7b-6a2f95b32b3a tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:32.734943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Updating instance_info_cache with network_info: [{"id": "a54a98e7-93a1-4190-a824-b3544f7a2005", "address": "fa:16:3e:a1:ee:60", "network": {"id": "1aa18e23-bd5d-4795-b707-5a6105a5c877", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1733634762-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a209e7e52dcd4983a112f751fdb1da05", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa54a98e7-93", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128548) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 05:11:32.738421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:32.753449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Releasing lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 05:11:32.754463 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d7795f96-9993-47e2-bfbd-406da3f61b1b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action" status: 202 len: 0 microversion: 2.1 time: 4.595482 Aug 27 05:11:32.758054 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1901/3801] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:28 2022] POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action => generated 0 bytes in 4597 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 05:11:32.761789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f81f463b-f523-4fa3-a5ce-a5265d10e321 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:32.762414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f81f463b-f523-4fa3-a5ce-a5265d10e321 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:32.770529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f81f463b-f523-4fa3-a5ce-a5265d10e321 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:32.771031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f81f463b-f523-4fa3-a5ce-a5265d10e321 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:32.771744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f81f463b-f523-4fa3-a5ce-a5265d10e321 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:32.772196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f81f463b-f523-4fa3-a5ce-a5265d10e321 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:32.775994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ebd64019-7f94-4716-aa7b-6a2f95b32b3a tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:32.780563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f81f463b-f523-4fa3-a5ce-a5265d10e321 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:32.781259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f81f463b-f523-4fa3-a5ce-a5265d10e321 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:32.789802 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ebd64019-7f94-4716-aa7b-6a2f95b32b3a tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1324 microversion: 2.1 time: 0.276322 Aug 27 05:11:32.791209 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1901/3802] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:32 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:32.798305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:32.799139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:32.814262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:32.814929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:32.815533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:32.817006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:32.817736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:32.818089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:32.911310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f81f463b-f523-4fa3-a5ce-a5265d10e321 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ac7725d5424eddb2e1b79e2cac2fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5455e1b4fef14be99a76abf1e759219a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:32.923470 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f81f463b-f523-4fa3-a5ce-a5265d10e321 tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 200 len: 1251 microversion: 2.1 time: 0.167016 Aug 27 05:11:32.924754 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1902/3803] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:32 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 1251 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:32.930252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-38001ffe-cf75-418c-984b-3d0e5f83d33f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '.version_select at 0x7fb56501ae50>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:33.182232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:33.191375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:33.193134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:33.194420 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0fa98036-4394-4943-9aed-608b801caa0c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1807 microversion: 2.20 time: 0.401273 Aug 27 05:11:33.194990 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1902/3804] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:32 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1807 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:33.200445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d61d6382-5819-4eee-b7bd-aa8dcafd5cd0 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:33.201244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d61d6382-5819-4eee-b7bd-aa8dcafd5cd0 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:33.207709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d61d6382-5819-4eee-b7bd-aa8dcafd5cd0 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:33.208401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d61d6382-5819-4eee-b7bd-aa8dcafd5cd0 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:33.209030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d61d6382-5819-4eee-b7bd-aa8dcafd5cd0 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:33.209899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d61d6382-5819-4eee-b7bd-aa8dcafd5cd0 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:33.210517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d61d6382-5819-4eee-b7bd-aa8dcafd5cd0 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:33.211106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d61d6382-5819-4eee-b7bd-aa8dcafd5cd0 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:33.628657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d61d6382-5819-4eee-b7bd-aa8dcafd5cd0 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:33.646611 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d61d6382-5819-4eee-b7bd-aa8dcafd5cd0 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1428 microversion: 2.1 time: 0.450038 Aug 27 05:11:33.663184 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1903/3805] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:33 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1428 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:33.670794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1aa5481c-ea3a-4587-80b6-6910965267fe req-4e7e7d46-3e74-455f-845b-7aa6179f5b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1540b0-d10c-4e44-8ddc-7917d7468eea", "name": "network-vif-plugged", "status": "completed", "tag": "1907916f-ff99-4bd3-b5e4-bfe1556c0ef1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:33.700683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1aa5481c-ea3a-4587-80b6-6910965267fe req-4e7e7d46-3e74-455f-845b-7aa6179f5b9e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:33.701538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1aa5481c-ea3a-4587-80b6-6910965267fe req-4e7e7d46-3e74-455f-845b-7aa6179f5b9e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:33.702609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1aa5481c-ea3a-4587-80b6-6910965267fe req-4e7e7d46-3e74-455f-845b-7aa6179f5b9e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:33.725529 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1aa5481c-ea3a-4587-80b6-6910965267fe req-4e7e7d46-3e74-455f-845b-7aa6179f5b9e service nova] Creating event network-vif-plugged:1907916f-ff99-4bd3-b5e4-bfe1556c0ef1 for instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea on n-h2-820368-35 Aug 27 05:11:33.733783 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1aa5481c-ea3a-4587-80b6-6910965267fe req-4e7e7d46-3e74-455f-845b-7aa6179f5b9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068872 Aug 27 05:11:33.739282 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1904/3806] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:33.764523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:33.765529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:33.773412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:33.774109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:33.774648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:33.775500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:33.775953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:33.776442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:33.945256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:33.973141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=12 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:34.145568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:34.156754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:34.159343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:34.160926 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b6aabf7e-4b8b-4855-9547-712e972ffcba tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1359 microversion: 2.21 time: 0.419338 Aug 27 05:11:34.175251 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1905/3807] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:33 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1359 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:34.184561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68d4aba0-38e8-4944-b154-f63cadf967b1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:34.185257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68d4aba0-38e8-4944-b154-f63cadf967b1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:34.192213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d4aba0-38e8-4944-b154-f63cadf967b1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:34.192711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d4aba0-38e8-4944-b154-f63cadf967b1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:34.193148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d4aba0-38e8-4944-b154-f63cadf967b1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:34.194031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d4aba0-38e8-4944-b154-f63cadf967b1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:34.194646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d4aba0-38e8-4944-b154-f63cadf967b1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:34.195258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68d4aba0-38e8-4944-b154-f63cadf967b1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:34.484517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:34.545072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=16 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:34.867010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68d4aba0-38e8-4944-b154-f63cadf967b1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:34.881091 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68d4aba0-38e8-4944-b154-f63cadf967b1 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1324 microversion: 2.1 time: 0.709232 Aug 27 05:11:34.882232 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1906/3808] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:34 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1324 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:34.889772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:34.891117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] [instance: 9ee435af-d600-47a1-ae47-316d49b71aed] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:34.899897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:34.902824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:34.903444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:34.904311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:34.905023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:34.905601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:34.928964 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] HTTP exception thrown: Instance 9ee435af-d600-47a1-ae47-316d49b71aed could not be found. Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Request method failure captured: Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed HTTP/1.1 Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCabxbhJXGnY9b6dbGi3USANdnSnWPODidVffEwMedP29_QL-DjFjZbY6FDhXtY4gjMPnbiAcM2YtyOG8r2T_trYIvSQfwAnCJ17snZVZyx_Qz1MJdpHsgvMKK9FDLLzFeQNzyVym6RtrZh2oc4NUjyAMXWB9nNRzzVqrkV1uf18UXvM Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 5455e1b4fef14be99a76abf1e759219a Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestBootFromVolume-2142515073 Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5455e1b4fef14be99a76abf1e759219a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5455e1b4fef14be99a76abf1e759219a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5455e1b4fef14be99a76abf1e759219a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5455e1b4fef14be99a76abf1e759219a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestBootFromVolume-2142515073 Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 5455e1b4fef14be99a76abf1e759219a Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestBootFromVolume-2142515073 Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestBootFromVolume-2142515073-project Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 03ac7725d5424eddb2e1b79e2cac2fe4 Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestBootFromVolume-2142515073-project Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 9ee435af-d600-47a1-ae47-316d49b71aed could not be found. Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '9ee435af-d600-47a1-ae47-316d49b71aed'} Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee435af-d600-47a1-ae47-316d49b71aed could not be found. Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee435af-d600-47a1-ae47-316d49b71aed could not be found. Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:34.945674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:34.950844 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:34.950844 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:34.950844 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:34.950844 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:34.950844 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:34.950844 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee435af-d600-47a1-ae47-316d49b71aed could not be found. Aug 27 05:11:34.950844 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:34.952878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Returning 404 to user: Instance 9ee435af-d600-47a1-ae47-316d49b71aed could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:34.954189 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a0646768-ee30-4777-bc26-e73b92b7d78f tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed" status: 404 len: 111 microversion: 2.1 time: 0.070635 Aug 27 05:11:34.956407 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1907/3809] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:34 2022] GET /compute/v2.1/servers/9ee435af-d600-47a1-ae47-316d49b71aed => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:11:34.971703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:34.973236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:34.980404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:34.980911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:34.981336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:34.982907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:34.983701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:34.984270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:35.100481 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-38001ffe-cf75-418c-984b-3d0e5f83d33f tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/b1e0614d-c619-4cbe-be33-43f39f228e29" status: 202 len: 0 microversion: 2.1 time: 2.174368 Aug 27 05:11:35.102797 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1903/3810] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:11:32 2022] DELETE /compute/v2.1/os-floating-ips/b1e0614d-c619-4cbe-be33-43f39f228e29 => generated 0 bytes in 2177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:35.112489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b6762301-e011-403a-8e0e-07cd04f2ff87 req-efebb1de-59f5-4591-8709-cd8f39541dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19ad795-2b69-464a-b2ad-797883329153", "tag": "7b8d43dd-ac77-454c-86de-5d2d2b3d6c4b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:35.134872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b6762301-e011-403a-8e0e-07cd04f2ff87 req-efebb1de-59f5-4591-8709-cd8f39541dc1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:35.136378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b6762301-e011-403a-8e0e-07cd04f2ff87 req-efebb1de-59f5-4591-8709-cd8f39541dc1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:35.136989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b6762301-e011-403a-8e0e-07cd04f2ff87 req-efebb1de-59f5-4591-8709-cd8f39541dc1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:35.153593 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b6762301-e011-403a-8e0e-07cd04f2ff87 req-efebb1de-59f5-4591-8709-cd8f39541dc1 service nova] Creating event network-changed:7b8d43dd-ac77-454c-86de-5d2d2b3d6c4b for instance a19ad795-2b69-464a-b2ad-797883329153 on n-h1-820368-35 Aug 27 05:11:35.164033 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b6762301-e011-403a-8e0e-07cd04f2ff87 req-efebb1de-59f5-4591-8709-cd8f39541dc1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059362 Aug 27 05:11:35.168016 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1904/3811] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:35.178720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-848925cf-1536-42bd-a3da-6ea27584851b tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:35.184668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-848925cf-1536-42bd-a3da-6ea27584851b tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:35.194957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-848925cf-1536-42bd-a3da-6ea27584851b tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:35.195535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-848925cf-1536-42bd-a3da-6ea27584851b tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:35.195977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-848925cf-1536-42bd-a3da-6ea27584851b tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:35.196808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-848925cf-1536-42bd-a3da-6ea27584851b tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:35.197986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-848925cf-1536-42bd-a3da-6ea27584851b tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:35.198988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-848925cf-1536-42bd-a3da-6ea27584851b tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:35.272232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:35.293203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:35.296553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:35.297959 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c4dc0798-2688-4dcf-87fd-c6f415982012 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1794 microversion: 2.20 time: 0.339305 Aug 27 05:11:35.319744 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1908/3812] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:34 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1794 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:35.335946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2194069-09c2-4f02-ac2a-5309ceb4366b tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] Calling method '.version_select at 0x7fb5655da4c0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:35.428280 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b2194069-09c2-4f02-ac2a-5309ceb4366b tempest-ServersTestBootFromVolume-2142515073 tempest-ServersTestBootFromVolume-2142515073-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-903576486" status: 202 len: 0 microversion: 2.1 time: 0.101341 Aug 27 05:11:35.432271 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1909/3813] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 05:11:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-903576486 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:35.440694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-982a376c-92c0-4e06-88e4-094f84edaf44 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-982a376c-92c0-4e06-88e4-094f84edaf44 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Request method failure captured: Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action HTTP/1.1 Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 34 Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCadJCXOdChSpllxNErbPU0dSFn7c3jvObDALavDFnFMKMi2rVyqLgcfTbIWCPO1LyEZdletQPOVhW6OHZSOyaSfzgfOytrEqWPhRUO8iTz8SVyUNDmuNOQRbPIMH3ehDu1mUi05sRKgrhpxGRMyV4vIGRgSZ-v67VL-wehzeDjiQ2FU Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: a209e7e52dcd4983a112f751fdb1da05 Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a209e7e52dcd4983a112f751fdb1da05", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: a209e7e52dcd4983a112f751fdb1da05 Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 2108e75d88ec40cba3c70ab2e954e11a Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: {"addFloatingIp": {"address": ""}} Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '410af4b7-cf62-42fe-a9c1-64c5b9d20f92', 'body': {'addFloatingIp': {'address': ''}}} Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi '' Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:11:35.448704 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 05:11:35.453765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:35.455666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-982a376c-92c0-4e06-88e4-094f84edaf44 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:35.457918 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-982a376c-92c0-4e06-88e4-094f84edaf44 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action" status: 400 len: 142 microversion: 2.1 time: 0.023790 Aug 27 05:11:35.461651 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1910/3814] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:35 2022] POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action => generated 142 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:11:35.473412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:35.474438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:35.492824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:35.494371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:35.496266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:35.497178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:35.499104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:35.500900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:35.873916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:35.886451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:35.888524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:35.890234 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3f87a540-9672-48c2-80a2-2cadceba2060 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1551 microversion: 2.21 time: 0.427423 Aug 27 05:11:35.891161 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1911/3815] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:35 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1551 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:35.917955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:35.925996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:35.936257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:35.936766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:35.939633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:35.943741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:35.946988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:35.946988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:35.979457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-848925cf-1536-42bd-a3da-6ea27584851b tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:36.003260 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-848925cf-1536-42bd-a3da-6ea27584851b tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1428 microversion: 2.1 time: 0.830679 Aug 27 05:11:36.010741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 05:11:36.011870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquired lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 05:11:36.017201 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1905/3816] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:35 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1428 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:36.027528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3786fee7-e550-415f-ab8c-ef41bfa4efa6 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:36.030579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3786fee7-e550-415f-ab8c-ef41bfa4efa6 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:36.037297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3786fee7-e550-415f-ab8c-ef41bfa4efa6 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:36.038053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3786fee7-e550-415f-ab8c-ef41bfa4efa6 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:36.038690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3786fee7-e550-415f-ab8c-ef41bfa4efa6 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:36.039702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3786fee7-e550-415f-ab8c-ef41bfa4efa6 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:36.040325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3786fee7-e550-415f-ab8c-ef41bfa4efa6 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:36.040922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3786fee7-e550-415f-ab8c-ef41bfa4efa6 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:36.381842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Releasing lock "refresh_cache-410af4b7-cf62-42fe-a9c1-64c5b9d20f92" {{(pid=128547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 05:11:36.382859 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] HTTP exception thrown: floating IP not found Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Request method failure captured: Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action HTTP/1.1 Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 41 Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCadJCXOdChSpllxNErbPU0dSFn7c3jvObDALavDFnFMKMi2rVyqLgcfTbIWCPO1LyEZdletQPOVhW6OHZSOyaSfzgfOytrEqWPhRUO8iTz8SVyUNDmuNOQRbPIMH3ehDu1mUi05sRKgrhpxGRMyV4vIGRgSZ-v67VL-wehzeDjiQ2FU Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: a209e7e52dcd4983a112f751fdb1da05 Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a209e7e52dcd4983a112f751fdb1da05", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: a209e7e52dcd4983a112f751fdb1da05 Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 2108e75d88ec40cba3c70ab2e954e11a Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: exception: floating IP not found Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '410af4b7-cf62-42fe-a9c1-64c5b9d20f92', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 27 05:11:36.385527 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:36.390236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:36.390236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:36.390236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:36.390236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:36.390236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:36.390236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:36.390236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:36.390236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 27 05:11:36.390236 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:36.397819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Returning 404 to user: floating IP not found {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:36.399020 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-50e46857-8976-4a43-b437-2ca3ccbfa667 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action" status: 404 len: 67 microversion: 2.1 time: 0.506553 Aug 27 05:11:36.400231 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1912/3817] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:35 2022] POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action => generated 67 bytes in 508 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:11:36.408195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d7c94d5-686a-42fc-acaa-9919c6f29a16 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:36.408979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d7c94d5-686a-42fc-acaa-9919c6f29a16 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:36.418176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7c94d5-686a-42fc-acaa-9919c6f29a16 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:36.418900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7c94d5-686a-42fc-acaa-9919c6f29a16 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:36.419528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7c94d5-686a-42fc-acaa-9919c6f29a16 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:36.420774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7c94d5-686a-42fc-acaa-9919c6f29a16 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:36.421208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7c94d5-686a-42fc-acaa-9919c6f29a16 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:36.421835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d7c94d5-686a-42fc-acaa-9919c6f29a16 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:36.463010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d7c94d5-686a-42fc-acaa-9919c6f29a16 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:11:36.575929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3786fee7-e550-415f-ab8c-ef41bfa4efa6 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:36.586342 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3786fee7-e550-415f-ab8c-ef41bfa4efa6 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1324 microversion: 2.1 time: 0.567699 Aug 27 05:11:36.587636 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1906/3818] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:36 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1324 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:36.591123 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d7c94d5-686a-42fc-acaa-9919c6f29a16 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 204 len: 0 microversion: 2.21 time: 0.188923 Aug 27 05:11:36.592169 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1913/3819] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:11:36 2022] DELETE /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:11:36.593803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-46723259-02a9-44b3-8ea1-2465b4ed5ddb tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:36.603038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:36.606470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:36.617741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:36.618501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:36.619128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:36.620082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:36.620685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:36.621264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:36.673692 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-46723259-02a9-44b3-8ea1-2465b4ed5ddb tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-46723259-02a9-44b3-8ea1-2465b4ed5ddb tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Request method failure captured: Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action HTTP/1.1 Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 44 Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCadJCXOdChSpllxNErbPU0dSFn7c3jvObDALavDFnFMKMi2rVyqLgcfTbIWCPO1LyEZdletQPOVhW6OHZSOyaSfzgfOytrEqWPhRUO8iTz8SVyUNDmuNOQRbPIMH3ehDu1mUi05sRKgrhpxGRMyV4vIGRgSZ-v67VL-wehzeDjiQ2FU Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: a209e7e52dcd4983a112f751fdb1da05 Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a209e7e52dcd4983a112f751fdb1da05", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: a209e7e52dcd4983a112f751fdb1da05 Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 2108e75d88ec40cba3c70ab2e954e11a Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: exception: Floating IP not found for address 0.0.0.0. Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '410af4b7-cf62-42fe-a9c1-64c5b9d20f92', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 27 05:11:36.680409 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-46723259-02a9-44b3-8ea1-2465b4ed5ddb tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:36.684820 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-46723259-02a9-44b3-8ea1-2465b4ed5ddb tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action" status: 404 len: 88 microversion: 2.1 time: 0.093640 Aug 27 05:11:36.688527 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1907/3820] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:36 2022] POST /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92/action => generated 88 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:11:36.694911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2a0f2009-083c-413f-b29c-6d5d0d0c3698 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:36.695531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2a0f2009-083c-413f-b29c-6d5d0d0c3698 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:36.720399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a0f2009-083c-413f-b29c-6d5d0d0c3698 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:36.720833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a0f2009-083c-413f-b29c-6d5d0d0c3698 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:36.721286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a0f2009-083c-413f-b29c-6d5d0d0c3698 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:36.722024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a0f2009-083c-413f-b29c-6d5d0d0c3698 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:36.723328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a0f2009-083c-413f-b29c-6d5d0d0c3698 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:36.724616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a0f2009-083c-413f-b29c-6d5d0d0c3698 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:36.796689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2a0f2009-083c-413f-b29c-6d5d0d0c3698 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:11:36.862165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:36.874876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:36.876507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:36.877924 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3f87801d-bace-4b4a-a76c-c68f85cd12d1 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1557 microversion: 2.21 time: 0.281474 Aug 27 05:11:36.878652 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1914/3821] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:36 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1557 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:36.992914 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2a0f2009-083c-413f-b29c-6d5d0d0c3698 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "DELETE /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 204 len: 0 microversion: 2.1 time: 0.302939 Aug 27 05:11:36.994868 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1908/3822] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:11:36 2022] DELETE /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:11:37.003915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6c40691f-c383-41f8-b881-9c679d0ec3d8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:37.004671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6c40691f-c383-41f8-b881-9c679d0ec3d8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:37.029173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c40691f-c383-41f8-b881-9c679d0ec3d8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:37.030551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c40691f-c383-41f8-b881-9c679d0ec3d8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:37.031042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c40691f-c383-41f8-b881-9c679d0ec3d8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:37.032519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e2143060-e6b5-4711-8b82-4da0a2088467 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:37.033247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e2143060-e6b5-4711-8b82-4da0a2088467 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:37.035953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c40691f-c383-41f8-b881-9c679d0ec3d8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:37.036613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c40691f-c383-41f8-b881-9c679d0ec3d8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:37.037362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c40691f-c383-41f8-b881-9c679d0ec3d8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:37.071016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2143060-e6b5-4711-8b82-4da0a2088467 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:37.073817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2143060-e6b5-4711-8b82-4da0a2088467 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:37.078112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2143060-e6b5-4711-8b82-4da0a2088467 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:37.080567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2143060-e6b5-4711-8b82-4da0a2088467 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:37.081259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2143060-e6b5-4711-8b82-4da0a2088467 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:37.083066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2143060-e6b5-4711-8b82-4da0a2088467 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:37.514260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6c40691f-c383-41f8-b881-9c679d0ec3d8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:37.520659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:37.528504 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6c40691f-c383-41f8-b881-9c679d0ec3d8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1543 microversion: 2.1 time: 0.529009 Aug 27 05:11:37.536920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e2143060-e6b5-4711-8b82-4da0a2088467 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:37.543222 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1915/3823] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:36 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1543 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:37.546059 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e2143060-e6b5-4711-8b82-4da0a2088467 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1428 microversion: 2.1 time: 0.524149 Aug 27 05:11:37.546782 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1909/3824] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:37 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1428 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:37.609284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2ac4fa8-6e5a-4839-a930-54ce61228e07 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:37.609912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b2ac4fa8-6e5a-4839-a930-54ce61228e07 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:37.637476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2ac4fa8-6e5a-4839-a930-54ce61228e07 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:37.638090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2ac4fa8-6e5a-4839-a930-54ce61228e07 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:37.638548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2ac4fa8-6e5a-4839-a930-54ce61228e07 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:37.639342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2ac4fa8-6e5a-4839-a930-54ce61228e07 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:37.639815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2ac4fa8-6e5a-4839-a930-54ce61228e07 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:37.640244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2ac4fa8-6e5a-4839-a930-54ce61228e07 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:37.912453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:37.912938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:37.929910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:37.932338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:37.933405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b2ac4fa8-6e5a-4839-a930-54ce61228e07 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:37.933992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:37.936558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:37.937062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:37.937507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:37.947614 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b2ac4fa8-6e5a-4839-a930-54ce61228e07 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1324 microversion: 2.1 time: 0.341071 Aug 27 05:11:37.964948 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1916/3825] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:37 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1324 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:38.313569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:38.325581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:38.326959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:38.344375 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-15fb3611-73ec-4877-b7e9-727b8a033b3c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1557 microversion: 2.21 time: 0.441565 Aug 27 05:11:38.345426 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1910/3826] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:37 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1557 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:11:38.555449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a6c891d-9db0-4208-9ee4-23a02b53ed2b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:38.556910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a6c891d-9db0-4208-9ee4-23a02b53ed2b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:38.572546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7420ef53-f764-49e9-9bd3-27a9b7f2972d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:38.575870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7420ef53-f764-49e9-9bd3-27a9b7f2972d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:38.594153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a6c891d-9db0-4208-9ee4-23a02b53ed2b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:38.596228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a6c891d-9db0-4208-9ee4-23a02b53ed2b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:38.597906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a6c891d-9db0-4208-9ee4-23a02b53ed2b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:38.603278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a6c891d-9db0-4208-9ee4-23a02b53ed2b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:38.604451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a6c891d-9db0-4208-9ee4-23a02b53ed2b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:38.606103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7420ef53-f764-49e9-9bd3-27a9b7f2972d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:38.607285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a6c891d-9db0-4208-9ee4-23a02b53ed2b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:38.608842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7420ef53-f764-49e9-9bd3-27a9b7f2972d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:38.609891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7420ef53-f764-49e9-9bd3-27a9b7f2972d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:38.621507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7420ef53-f764-49e9-9bd3-27a9b7f2972d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:38.625267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7420ef53-f764-49e9-9bd3-27a9b7f2972d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:38.626574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7420ef53-f764-49e9-9bd3-27a9b7f2972d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:39.124728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7420ef53-f764-49e9-9bd3-27a9b7f2972d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:39.137826 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7420ef53-f764-49e9-9bd3-27a9b7f2972d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1428 microversion: 2.1 time: 0.574011 Aug 27 05:11:39.139899 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1911/3827] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:38 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1428 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:39.148574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-ce876ca9-9d23-4bbd-9452-d0f57b9af684 req-1205f4c6-caa9-429d-be75-91c55e3032b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f179b67-f086-4d14-9088-e2fdf6f0c17d", "name": "network-vif-plugged", "status": "completed", "tag": "f52edb24-891f-48e2-a92d-bc4fb7d64dc6"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:39.173881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ce876ca9-9d23-4bbd-9452-d0f57b9af684 req-1205f4c6-caa9-429d-be75-91c55e3032b2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:39.174792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ce876ca9-9d23-4bbd-9452-d0f57b9af684 req-1205f4c6-caa9-429d-be75-91c55e3032b2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:39.175561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ce876ca9-9d23-4bbd-9452-d0f57b9af684 req-1205f4c6-caa9-429d-be75-91c55e3032b2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:39.175672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2a6c891d-9db0-4208-9ee4-23a02b53ed2b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:39.187441 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a6c891d-9db0-4208-9ee4-23a02b53ed2b tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1543 microversion: 2.1 time: 0.638300 Aug 27 05:11:39.191012 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1917/3828] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:38 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1543 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:39.194194 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-ce876ca9-9d23-4bbd-9452-d0f57b9af684 req-1205f4c6-caa9-429d-be75-91c55e3032b2 service nova] Creating event network-vif-plugged:f52edb24-891f-48e2-a92d-bc4fb7d64dc6 for instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d on n-h1-820368-35 Aug 27 05:11:39.195893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-08611ec3-4904-42e6-86b1-831f829ab00f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:39.196521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-08611ec3-4904-42e6-86b1-831f829ab00f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:39.206298 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-ce876ca9-9d23-4bbd-9452-d0f57b9af684 req-1205f4c6-caa9-429d-be75-91c55e3032b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064828 Aug 27 05:11:39.207451 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1912/3829] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:39.213486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08611ec3-4904-42e6-86b1-831f829ab00f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:39.214035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08611ec3-4904-42e6-86b1-831f829ab00f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:39.214481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08611ec3-4904-42e6-86b1-831f829ab00f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:39.215227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08611ec3-4904-42e6-86b1-831f829ab00f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:39.215523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-95546070-554b-4744-87b8-197ffe6dae69 req-d16dce77-645b-44d0-9bb4-e1dfe08e3696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1540b0-d10c-4e44-8ddc-7917d7468eea", "name": "network-vif-deleted", "tag": "1907916f-ff99-4bd3-b5e4-bfe1556c0ef1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:39.215682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08611ec3-4904-42e6-86b1-831f829ab00f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:39.218867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08611ec3-4904-42e6-86b1-831f829ab00f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:39.233752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-95546070-554b-4744-87b8-197ffe6dae69 req-d16dce77-645b-44d0-9bb4-e1dfe08e3696 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:39.234507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-95546070-554b-4744-87b8-197ffe6dae69 req-d16dce77-645b-44d0-9bb4-e1dfe08e3696 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:39.235049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-95546070-554b-4744-87b8-197ffe6dae69 req-d16dce77-645b-44d0-9bb4-e1dfe08e3696 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:39.252478 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-95546070-554b-4744-87b8-197ffe6dae69 req-d16dce77-645b-44d0-9bb4-e1dfe08e3696 service nova] Creating event network-vif-deleted:1907916f-ff99-4bd3-b5e4-bfe1556c0ef1 for instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea on n-h2-820368-35 Aug 27 05:11:39.259371 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-95546070-554b-4744-87b8-197ffe6dae69 req-d16dce77-645b-44d0-9bb4-e1dfe08e3696 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050120 Aug 27 05:11:39.267237 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1913/3830] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:39.390104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:39.390821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:39.405790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:39.406346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:39.406826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:39.407890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:39.408360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:39.408795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:39.444920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:39.445412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:39.445870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:39.446308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lazy-loading 'fault' on Instance uuid 4b1540b0-d10c-4e44-8ddc-7917d7468eea {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:11:39.498328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-08611ec3-4904-42e6-86b1-831f829ab00f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:39.501624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:39.522557 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-08611ec3-4904-42e6-86b1-831f829ab00f tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1324 microversion: 2.1 time: 0.330039 Aug 27 05:11:39.525673 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1918/3831] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:39 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:39.533748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:39.535516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd52fd44c03441b9bc9974be3b5f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508e4e58e793462aa81e0fc257aeb429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:39.536958 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dc7c7db2-2bc7-404b-b6ac-5c1149d921d3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 200 len: 1349 microversion: 2.21 time: 0.157635 Aug 27 05:11:39.537711 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1914/3832] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:39 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 1349 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:11:40.159970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b6430a4-a1ae-461a-9c0e-73ef49d0a452 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:40.161018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6b6430a4-a1ae-461a-9c0e-73ef49d0a452 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:40.168558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b6430a4-a1ae-461a-9c0e-73ef49d0a452 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.169135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b6430a4-a1ae-461a-9c0e-73ef49d0a452 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.169992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b6430a4-a1ae-461a-9c0e-73ef49d0a452 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.171046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b6430a4-a1ae-461a-9c0e-73ef49d0a452 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.171718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b6430a4-a1ae-461a-9c0e-73ef49d0a452 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.172344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b6430a4-a1ae-461a-9c0e-73ef49d0a452 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.209686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0080c48e-aa8d-4bba-a12c-021088bf1fb8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:40.210315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0080c48e-aa8d-4bba-a12c-021088bf1fb8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:40.218734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0080c48e-aa8d-4bba-a12c-021088bf1fb8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.219542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0080c48e-aa8d-4bba-a12c-021088bf1fb8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.219983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0080c48e-aa8d-4bba-a12c-021088bf1fb8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.220726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0080c48e-aa8d-4bba-a12c-021088bf1fb8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.221187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0080c48e-aa8d-4bba-a12c-021088bf1fb8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.221618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0080c48e-aa8d-4bba-a12c-021088bf1fb8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.943515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0080c48e-aa8d-4bba-a12c-021088bf1fb8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:40.957355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6b6430a4-a1ae-461a-9c0e-73ef49d0a452 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:40.958663 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0080c48e-aa8d-4bba-a12c-021088bf1fb8 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1543 microversion: 2.1 time: 0.752932 Aug 27 05:11:40.962198 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1915/3833] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:40 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1543 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:40.968095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4d0bcdde-4b49-4e0e-9897-a86667cff5da tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:40.968995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4d0bcdde-4b49-4e0e-9897-a86667cff5da tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:40.969189 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b6430a4-a1ae-461a-9c0e-73ef49d0a452 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1428 microversion: 2.1 time: 0.813046 Aug 27 05:11:40.973228 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1919/3834] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:40 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1428 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:40.980555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d0bcdde-4b49-4e0e-9897-a86667cff5da tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.981294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d0bcdde-4b49-4e0e-9897-a86667cff5da tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.981903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d0bcdde-4b49-4e0e-9897-a86667cff5da tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.982778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d0bcdde-4b49-4e0e-9897-a86667cff5da tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.983068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:40.983584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d0bcdde-4b49-4e0e-9897-a86667cff5da tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.984172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d0bcdde-4b49-4e0e-9897-a86667cff5da tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.985289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:41.000783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:41.001393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:41.002153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.002890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:41.003409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:41.003847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.032035 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] HTTP exception thrown: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Request method failure captured: Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea HTTP/1.1 Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCadoA3jubH8ZTdze_ftEeY-wiC5nCtpKvAz-JnOl5E0PjdSEVVal7mntO6lGftIxF0NfQHscOlwrO3d62KyWlbGFGgVnZsHu-OauBTo-dTMK5r3f4wrhB9iWZxwvdmWywpgiGCCf0Kasho3V7wGTk9c-BTD8Y3rWNrRm0NxGVzWsF2Q Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 508e4e58e793462aa81e0fc257aeb429 Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-InstanceActionsV221TestJSON-845124642 Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_508e4e58e793462aa81e0fc257aeb429", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/508e4e58e793462aa81e0fc257aeb429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/508e4e58e793462aa81e0fc257aeb429"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/508e4e58e793462aa81e0fc257aeb429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-InstanceActionsV221TestJSON-845124642 Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 508e4e58e793462aa81e0fc257aeb429 Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-845124642 Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-InstanceActionsV221TestJSON-845124642-project Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ebd52fd44c03441b9bc9974be3b5f2bc Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-InstanceActionsV221TestJSON-845124642-project Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '4b1540b0-d10c-4e44-8ddc-7917d7468eea'} Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.036094 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:41.040890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.040890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:41.040890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:41.040890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:41.040890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:41.040890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:41.040890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.040890 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.042879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Returning 404 to user: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:41.044262 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3962eebd-d49b-40ca-9f7d-0e81a91c80de tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 404 len: 111 microversion: 2.21 time: 0.069826 Aug 27 05:11:41.045805 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1920/3835] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:40 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:11:41.053825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8323be0a-f827-4560-a86d-f6779a2da144 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '.version_select at 0x7fb5650228b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:41.054419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8323be0a-f827-4560-a86d-f6779a2da144 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:41.060794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8323be0a-f827-4560-a86d-f6779a2da144 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:41.061293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8323be0a-f827-4560-a86d-f6779a2da144 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:41.061729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8323be0a-f827-4560-a86d-f6779a2da144 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.062639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8323be0a-f827-4560-a86d-f6779a2da144 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:41.063277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8323be0a-f827-4560-a86d-f6779a2da144 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:41.063943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8323be0a-f827-4560-a86d-f6779a2da144 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.139847 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8323be0a-f827-4560-a86d-f6779a2da144 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.090007 Aug 27 05:11:41.149206 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1921/3836] 10.222.0.58 () {60 vars in 1337 bytes} [Sat Aug 27 05:11:41 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea/os-instance-actions => generated 611 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 05:11:41.156088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:41.156829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:41.163545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:41.164263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:41.164872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.167472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:41.168134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:41.168715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.186053 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] HTTP exception thrown: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.187954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4d0bcdde-4b49-4e0e-9897-a86667cff5da tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Request method failure captured: Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea HTTP/1.1 Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCadoA3jubH8ZTdze_ftEeY-wiC5nCtpKvAz-JnOl5E0PjdSEVVal7mntO6lGftIxF0NfQHscOlwrO3d62KyWlbGFGgVnZsHu-OauBTo-dTMK5r3f4wrhB9iWZxwvdmWywpgiGCCf0Kasho3V7wGTk9c-BTD8Y3rWNrRm0NxGVzWsF2Q Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 508e4e58e793462aa81e0fc257aeb429 Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-InstanceActionsV221TestJSON-845124642 Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_508e4e58e793462aa81e0fc257aeb429", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/508e4e58e793462aa81e0fc257aeb429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/508e4e58e793462aa81e0fc257aeb429"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/508e4e58e793462aa81e0fc257aeb429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-InstanceActionsV221TestJSON-845124642 Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 508e4e58e793462aa81e0fc257aeb429 Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-845124642 Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-InstanceActionsV221TestJSON-845124642-project Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ebd52fd44c03441b9bc9974be3b5f2bc Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-InstanceActionsV221TestJSON-845124642-project Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '4b1540b0-d10c-4e44-8ddc-7917d7468eea'} Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:11:41.188209 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:11:41.192530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.192530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.192530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:41.192530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.192530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:41.192530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:41.192530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:41.192530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:41.192530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:41.192530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.192530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.194480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Returning 404 to user: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:41.195448 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b33f55a-a922-44c7-be92-cc115e25edc3 tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 404 len: 111 microversion: 2.21 time: 0.044961 Aug 27 05:11:41.198854 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4d0bcdde-4b49-4e0e-9897-a86667cff5da tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1324 microversion: 2.1 time: 0.235234 Aug 27 05:11:41.202794 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1922/3837] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:11:41 2022] DELETE /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:11:41.202999 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1916/3838] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:40 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:41.211506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:41.212153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] [instance: 4b1540b0-d10c-4e44-8ddc-7917d7468eea] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:41.225828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:41.226346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:41.226798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.227883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:41.228352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:41.229004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.248328 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] HTTP exception thrown: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Request method failure captured: Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea HTTP/1.1 Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCadoA3jubH8ZTdze_ftEeY-wiC5nCtpKvAz-JnOl5E0PjdSEVVal7mntO6lGftIxF0NfQHscOlwrO3d62KyWlbGFGgVnZsHu-OauBTo-dTMK5r3f4wrhB9iWZxwvdmWywpgiGCCf0Kasho3V7wGTk9c-BTD8Y3rWNrRm0NxGVzWsF2Q Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 508e4e58e793462aa81e0fc257aeb429 Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-InstanceActionsV221TestJSON-845124642 Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_508e4e58e793462aa81e0fc257aeb429", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/508e4e58e793462aa81e0fc257aeb429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/508e4e58e793462aa81e0fc257aeb429"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/508e4e58e793462aa81e0fc257aeb429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-InstanceActionsV221TestJSON-845124642 Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 508e4e58e793462aa81e0fc257aeb429 Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-845124642 Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-InstanceActionsV221TestJSON-845124642-project Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ebd52fd44c03441b9bc9974be3b5f2bc Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-InstanceActionsV221TestJSON-845124642-project Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '4b1540b0-d10c-4e44-8ddc-7917d7468eea'} Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.249898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:41.254124 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.254124 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:41.254124 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:41.254124 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:41.254124 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:41.254124 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:41.254124 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. Aug 27 05:11:41.254124 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:41.254124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] Returning 404 to user: Instance 4b1540b0-d10c-4e44-8ddc-7917d7468eea could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:41.254124 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14076fed-56b3-4e70-bde7-c2d592f9324c tempest-InstanceActionsV221TestJSON-845124642 tempest-InstanceActionsV221TestJSON-845124642-project] 10.222.0.58 "GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea" status: 404 len: 111 microversion: 2.21 time: 0.047539 Aug 27 05:11:41.256199 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1923/3839] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:11:41 2022] GET /compute/v2.1/servers/4b1540b0-d10c-4e44-8ddc-7917d7468eea => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:11:41.636499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-a158e263-d076-41b8-ab7e-37931a6b571a req-4f1a215f-7330-4059-91dc-25ddfbaf9702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410af4b7-cf62-42fe-a9c1-64c5b9d20f92", "name": "network-vif-deleted", "tag": "a54a98e7-93a1-4190-a824-b3544f7a2005"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:41.655542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a158e263-d076-41b8-ab7e-37931a6b571a req-4f1a215f-7330-4059-91dc-25ddfbaf9702 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:41.656323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a158e263-d076-41b8-ab7e-37931a6b571a req-4f1a215f-7330-4059-91dc-25ddfbaf9702 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:41.657013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a158e263-d076-41b8-ab7e-37931a6b571a req-4f1a215f-7330-4059-91dc-25ddfbaf9702 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.673812 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-a158e263-d076-41b8-ab7e-37931a6b571a req-4f1a215f-7330-4059-91dc-25ddfbaf9702 service nova] Creating event network-vif-deleted:a54a98e7-93a1-4190-a824-b3544f7a2005 for instance 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 on n-h1-820368-35 Aug 27 05:11:41.680541 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-a158e263-d076-41b8-ab7e-37931a6b571a req-4f1a215f-7330-4059-91dc-25ddfbaf9702 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051824 Aug 27 05:11:41.681819 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1917/3840] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:41.984306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:41.984953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:41.995057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70f656b0-b43c-4012-bce8-500055cbba97 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:41.995807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-70f656b0-b43c-4012-bce8-500055cbba97 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:42.003951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:42.006177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f656b0-b43c-4012-bce8-500055cbba97 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:42.006842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f656b0-b43c-4012-bce8-500055cbba97 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:42.007974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:42.008614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f656b0-b43c-4012-bce8-500055cbba97 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:42.009486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:42.010414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f656b0-b43c-4012-bce8-500055cbba97 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:42.011704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f656b0-b43c-4012-bce8-500055cbba97 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:42.012367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:42.012970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f656b0-b43c-4012-bce8-500055cbba97 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:42.013586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:42.015761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:42.110645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:42.111421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:42.112004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:42.112646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lazy-loading 'fault' on Instance uuid 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:11:42.215331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2108e75d88ec40cba3c70ab2e954e11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a209e7e52dcd4983a112f751fdb1da05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:42.245027 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14a94a94-017b-47ea-ab33-7825773631da tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 200 len: 1322 microversion: 2.1 time: 0.266522 Aug 27 05:11:42.245624 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1924/3841] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:41 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:42.275428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b6b3b0da-b05c-456f-952a-87e906004cfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:42.277204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b6b3b0da-b05c-456f-952a-87e906004cfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:42.290081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b3b0da-b05c-456f-952a-87e906004cfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:42.294110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b3b0da-b05c-456f-952a-87e906004cfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:42.295139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b3b0da-b05c-456f-952a-87e906004cfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:42.298000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b3b0da-b05c-456f-952a-87e906004cfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:42.299703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b3b0da-b05c-456f-952a-87e906004cfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:42.301218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6b3b0da-b05c-456f-952a-87e906004cfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:42.525359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-70f656b0-b43c-4012-bce8-500055cbba97 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:42.533149 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70f656b0-b43c-4012-bce8-500055cbba97 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1428 microversion: 2.1 time: 0.542746 Aug 27 05:11:42.534262 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1918/3842] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:41 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1428 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:42.766583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6b3b0da-b05c-456f-952a-87e906004cfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:42.781013 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b6b3b0da-b05c-456f-952a-87e906004cfc tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1324 microversion: 2.1 time: 0.521734 Aug 27 05:11:42.788898 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1925/3843] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:42 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1324 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:43.222033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-35c39cd9-2520-4c0f-a976-6865a7f434fd req-a27f5509-4956-4bbd-aa4f-cd61db6692c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19ad795-2b69-464a-b2ad-797883329153", "name": "network-vif-plugged", "status": "completed", "tag": "7b8d43dd-ac77-454c-86de-5d2d2b3d6c4b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:43.229729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:43.236046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-35c39cd9-2520-4c0f-a976-6865a7f434fd req-a27f5509-4956-4bbd-aa4f-cd61db6692c5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:43.236921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-35c39cd9-2520-4c0f-a976-6865a7f434fd req-a27f5509-4956-4bbd-aa4f-cd61db6692c5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:43.237568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-35c39cd9-2520-4c0f-a976-6865a7f434fd req-a27f5509-4956-4bbd-aa4f-cd61db6692c5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:43.261478 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-35c39cd9-2520-4c0f-a976-6865a7f434fd req-a27f5509-4956-4bbd-aa4f-cd61db6692c5 service nova] Creating event network-vif-plugged:7b8d43dd-ac77-454c-86de-5d2d2b3d6c4b for instance a19ad795-2b69-464a-b2ad-797883329153 on n-h1-820368-35 Aug 27 05:11:43.267279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:43.268488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] [instance: 410af4b7-cf62-42fe-a9c1-64c5b9d20f92] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:43.270301 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-35c39cd9-2520-4c0f-a976-6865a7f434fd req-a27f5509-4956-4bbd-aa4f-cd61db6692c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050988 Aug 27 05:11:43.274758 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1919/3844] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:11:43.280495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:43.281045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:43.281508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:43.282243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:43.282784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:43.290276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:43.350551 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] HTTP exception thrown: Instance 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 could not be found. Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Request method failure captured: Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 HTTP/1.1 Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCadJCXOdChSpllxNErbPU0dSFn7c3jvObDALavDFnFMKMi2rVyqLgcfTbIWCPO1LyEZdletQPOVhW6OHZSOyaSfzgfOytrEqWPhRUO8iTz8SVyUNDmuNOQRbPIMH3ehDu1mUi05sRKgrhpxGRMyV4vIGRgSZ-v67VL-wehzeDjiQ2FU Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: a209e7e52dcd4983a112f751fdb1da05 Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a209e7e52dcd4983a112f751fdb1da05", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a209e7e52dcd4983a112f751fdb1da05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: a209e7e52dcd4983a112f751fdb1da05 Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251 Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 2108e75d88ec40cba3c70ab2e954e11a Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 could not be found. Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '410af4b7-cf62-42fe-a9c1-64c5b9d20f92'} Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 could not be found. Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 could not be found. Aug 27 05:11:43.351992 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:43.356167 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:43.356167 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:43.356167 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:43.356167 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:43.356167 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:43.356167 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:43.356167 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:43.356167 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 could not be found. Aug 27 05:11:43.356167 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:43.356167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] Returning 404 to user: Instance 410af4b7-cf62-42fe-a9c1-64c5b9d20f92 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:43.356167 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f827f53-48c1-423b-885e-cd61e6b3f115 tempest-FloatingIPsAssociationNegativeTestJSON-688308251 tempest-FloatingIPsAssociationNegativeTestJSON-688308251-project] 10.222.0.58 "GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92" status: 404 len: 111 microversion: 2.1 time: 0.090253 Aug 27 05:11:43.365865 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1926/3845] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:43 2022] GET /compute/v2.1/servers/410af4b7-cf62-42fe-a9c1-64c5b9d20f92 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:11:43.555866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8006e552-5e1d-4dd6-8c0f-7b32d94c1bad tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:43.561386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8006e552-5e1d-4dd6-8c0f-7b32d94c1bad tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:43.574946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8006e552-5e1d-4dd6-8c0f-7b32d94c1bad tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:43.575963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8006e552-5e1d-4dd6-8c0f-7b32d94c1bad tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:43.576413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8006e552-5e1d-4dd6-8c0f-7b32d94c1bad tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:43.577662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8006e552-5e1d-4dd6-8c0f-7b32d94c1bad tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:43.578284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8006e552-5e1d-4dd6-8c0f-7b32d94c1bad tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:43.578939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8006e552-5e1d-4dd6-8c0f-7b32d94c1bad tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:43.814615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-156ce2f3-cd7a-42f4-ab0a-fb115dfe6675 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:43.815278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-156ce2f3-cd7a-42f4-ab0a-fb115dfe6675 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:43.822784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-156ce2f3-cd7a-42f4-ab0a-fb115dfe6675 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:43.823337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-156ce2f3-cd7a-42f4-ab0a-fb115dfe6675 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:43.824094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-156ce2f3-cd7a-42f4-ab0a-fb115dfe6675 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:43.824877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-156ce2f3-cd7a-42f4-ab0a-fb115dfe6675 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:43.825610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-156ce2f3-cd7a-42f4-ab0a-fb115dfe6675 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:43.826058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-156ce2f3-cd7a-42f4-ab0a-fb115dfe6675 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:44.488781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8006e552-5e1d-4dd6-8c0f-7b32d94c1bad tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:44.496917 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8006e552-5e1d-4dd6-8c0f-7b32d94c1bad tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1608 microversion: 2.1 time: 0.946402 Aug 27 05:11:44.501785 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1920/3846] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:43 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1608 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:44.527151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5fdcf6d6-6c81-48bc-aacb-2a06fa4f41ee tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:44.528296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5fdcf6d6-6c81-48bc-aacb-2a06fa4f41ee tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:44.540866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcf6d6-6c81-48bc-aacb-2a06fa4f41ee tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:44.541648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcf6d6-6c81-48bc-aacb-2a06fa4f41ee tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:44.542253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcf6d6-6c81-48bc-aacb-2a06fa4f41ee tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:44.543426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcf6d6-6c81-48bc-aacb-2a06fa4f41ee tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:44.544061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcf6d6-6c81-48bc-aacb-2a06fa4f41ee tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:44.544671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fdcf6d6-6c81-48bc-aacb-2a06fa4f41ee tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:44.573985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:45.017766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-156ce2f3-cd7a-42f4-ab0a-fb115dfe6675 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:45.030288 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-156ce2f3-cd7a-42f4-ab0a-fb115dfe6675 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1324 microversion: 2.1 time: 1.218899 Aug 27 05:11:45.032900 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1927/3847] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:43 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1324 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:45.197981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5fdcf6d6-6c81-48bc-aacb-2a06fa4f41ee tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:45.211038 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5fdcf6d6-6c81-48bc-aacb-2a06fa4f41ee tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1608 microversion: 2.1 time: 0.694942 Aug 27 05:11:45.212831 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1921/3848] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:44 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1608 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:45.236598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7085878c-df3d-4feb-bf6f-de3cef68c91d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:45.237555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7085878c-df3d-4feb-bf6f-de3cef68c91d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:45.249117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7085878c-df3d-4feb-bf6f-de3cef68c91d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:45.249873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7085878c-df3d-4feb-bf6f-de3cef68c91d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:45.250746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7085878c-df3d-4feb-bf6f-de3cef68c91d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:45.251552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7085878c-df3d-4feb-bf6f-de3cef68c91d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:45.252681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7085878c-df3d-4feb-bf6f-de3cef68c91d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:45.253102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7085878c-df3d-4feb-bf6f-de3cef68c91d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:45.628076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7085878c-df3d-4feb-bf6f-de3cef68c91d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:45.637855 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7085878c-df3d-4feb-bf6f-de3cef68c91d tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1608 microversion: 2.1 time: 0.409419 Aug 27 05:11:45.638839 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1928/3849] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:45 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1608 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:46.063542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2a270959-54f5-488b-acbe-f1c0a0da0eb4 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:46.065210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2a270959-54f5-488b-acbe-f1c0a0da0eb4 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:46.074858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a270959-54f5-488b-acbe-f1c0a0da0eb4 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:46.076408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a270959-54f5-488b-acbe-f1c0a0da0eb4 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:46.077189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a270959-54f5-488b-acbe-f1c0a0da0eb4 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:46.078685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a270959-54f5-488b-acbe-f1c0a0da0eb4 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:46.079674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a270959-54f5-488b-acbe-f1c0a0da0eb4 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:46.080356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a270959-54f5-488b-acbe-f1c0a0da0eb4 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:46.911971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2a270959-54f5-488b-acbe-f1c0a0da0eb4 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:46.933620 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2a270959-54f5-488b-acbe-f1c0a0da0eb4 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1520 microversion: 2.1 time: 0.880315 Aug 27 05:11:46.934241 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1922/3850] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:46 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1520 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:47.096802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5e1182a-fca6-40a9-b0b4-12edd7381217 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-942655160", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "888f8806-59be-4858-89cf-85a078fd49ed"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5e1182a-fca6-40a9-b0b4-12edd7381217 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Request method failure captured: Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 242 Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCad5QEwiyFIytB6h9D83TNG8YY1iPBDwrje840Y_2RO-TYxhVibkumic9GMFB3t2wPIJleLQDyPvISvMeu89v0sprQDI6QsxHwEPU3h9p0UtlNWDQK1Bbc8haO66bSQWNMJ0k19Kqc6KQpi_a5wajSdpty-xbocAv1NvwfNWomeT1W8 Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98b1b469396c435d8ee08ee24b3e5791", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: da9b26e9246d42f998f31e0643b26573 Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-942655160", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "888f8806-59be-4858-89cf-85a078fd49ed"}]}} Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-942655160', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '888f8806-59be-4858-89cf-85a078fd49ed'}]}}} Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:11:47.104938 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.110285 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.116023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5e1182a-fca6-40a9-b0b4-12edd7381217 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:47.117124 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5e1182a-fca6-40a9-b0b4-12edd7381217 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.025307 Aug 27 05:11:47.134030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6d064e02-707e-43b6-8049-4cf2c5b014bd tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:47.135564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6d064e02-707e-43b6-8049-4cf2c5b014bd tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: dc309a2b-852a-4dd2-97a1-45dad29be6c5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:47.140390 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1929/3851] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:47 2022] POST /compute/v2.1/servers => generated 175 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:11:47.144367 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-6d064e02-707e-43b6-8049-4cf2c5b014bd tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] HTTP exception thrown: Instance dc309a2b-852a-4dd2-97a1-45dad29be6c5 could not be found. Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6d064e02-707e-43b6-8049-4cf2c5b014bd tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Request method failure captured: Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/dc309a2b-852a-4dd2-97a1-45dad29be6c5/metadata HTTP/1.1 Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCad5QEwiyFIytB6h9D83TNG8YY1iPBDwrje840Y_2RO-TYxhVibkumic9GMFB3t2wPIJleLQDyPvISvMeu89v0sprQDI6QsxHwEPU3h9p0UtlNWDQK1Bbc8haO66bSQWNMJ0k19Kqc6KQpi_a5wajSdpty-xbocAv1NvwfNWomeT1W8 Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98b1b469396c435d8ee08ee24b3e5791", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: da9b26e9246d42f998f31e0643b26573 Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance dc309a2b-852a-4dd2-97a1-45dad29be6c5 could not be found. Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'server_id': 'dc309a2b-852a-4dd2-97a1-45dad29be6c5'} Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc309a2b-852a-4dd2-97a1-45dad29be6c5 could not be found. Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc309a2b-852a-4dd2-97a1-45dad29be6c5 could not be found. Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.154411 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.160871 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:47.160871 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:47.160871 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc309a2b-852a-4dd2-97a1-45dad29be6c5 could not be found. Aug 27 05:11:47.160871 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.162793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6d064e02-707e-43b6-8049-4cf2c5b014bd tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Returning 404 to user: Instance dc309a2b-852a-4dd2-97a1-45dad29be6c5 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:47.163990 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6d064e02-707e-43b6-8049-4cf2c5b014bd tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/dc309a2b-852a-4dd2-97a1-45dad29be6c5/metadata" status: 404 len: 111 microversion: 2.1 time: 0.036193 Aug 27 05:11:47.175865 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1923/3852] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:11:47 2022] GET /compute/v2.1/servers/dc309a2b-852a-4dd2-97a1-45dad29be6c5/metadata => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:11:47.252374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-73e4be80-5691-4195-a051-6b794dde8401 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1167445840", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "888f8806-59be-4858-89cf-85a078fd49ed"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-73e4be80-5691-4195-a051-6b794dde8401 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Request method failure captured: Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 499 Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCad5QEwiyFIytB6h9D83TNG8YY1iPBDwrje840Y_2RO-TYxhVibkumic9GMFB3t2wPIJleLQDyPvISvMeu89v0sprQDI6QsxHwEPU3h9p0UtlNWDQK1Bbc8haO66bSQWNMJ0k19Kqc6KQpi_a5wajSdpty-xbocAv1NvwfNWomeT1W8 Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98b1b469396c435d8ee08ee24b3e5791", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: da9b26e9246d42f998f31e0643b26573 Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1167445840", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "888f8806-59be-4858-89cf-85a078fd49ed"}]}} Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1167445840', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '888f8806-59be-4858-89cf-85a078fd49ed'}]}}} Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 05:11:47.261264 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.264267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.272291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-73e4be80-5691-4195-a051-6b794dde8401 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:47.274500 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-73e4be80-5691-4195-a051-6b794dde8401 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.027138 Aug 27 05:11:47.305613 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1930/3853] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:47 2022] POST /compute/v2.1/servers => generated 687 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:11:47.455074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f62a5ab6-d753-498d-8207-b4da681b2341 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1510478241", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "888f8806-59be-4858-89cf-85a078fd49ed"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f62a5ab6-d753-498d-8207-b4da681b2341 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Request method failure captured: Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 500 Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCad5QEwiyFIytB6h9D83TNG8YY1iPBDwrje840Y_2RO-TYxhVibkumic9GMFB3t2wPIJleLQDyPvISvMeu89v0sprQDI6QsxHwEPU3h9p0UtlNWDQK1Bbc8haO66bSQWNMJ0k19Kqc6KQpi_a5wajSdpty-xbocAv1NvwfNWomeT1W8 Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98b1b469396c435d8ee08ee24b3e5791", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: da9b26e9246d42f998f31e0643b26573 Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1510478241", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "888f8806-59be-4858-89cf-85a078fd49ed"}]}} Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1510478241', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '888f8806-59be-4858-89cf-85a078fd49ed'}]}}} Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 05:11:47.465557 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.468485 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.475203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f62a5ab6-d753-498d-8207-b4da681b2341 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:47.476529 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f62a5ab6-d753-498d-8207-b4da681b2341 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.027394 Aug 27 05:11:47.487637 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1924/3854] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:47 2022] POST /compute/v2.1/servers => generated 689 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:11:47.559912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdd00f61-a690-4bd2-bec1-72761f56db30 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-115129789", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "888f8806-59be-4858-89cf-85a078fd49ed"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdd00f61-a690-4bd2-bec1-72761f56db30 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Request method failure captured: Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 753 Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCad5QEwiyFIytB6h9D83TNG8YY1iPBDwrje840Y_2RO-TYxhVibkumic9GMFB3t2wPIJleLQDyPvISvMeu89v0sprQDI6QsxHwEPU3h9p0UtlNWDQK1Bbc8haO66bSQWNMJ0k19Kqc6KQpi_a5wajSdpty-xbocAv1NvwfNWomeT1W8 Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98b1b469396c435d8ee08ee24b3e5791", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: da9b26e9246d42f998f31e0643b26573 Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-115129789", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "888f8806-59be-4858-89cf-85a078fd49ed"}]}} Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-115129789', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '888f8806-59be-4858-89cf-85a078fd49ed'}]}}} Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:11:47.564655 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:11:47.567369 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:11:47.569857 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.569857 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.575804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdd00f61-a690-4bd2-bec1-72761f56db30 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:47.577441 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cdd00f61-a690-4bd2-bec1-72761f56db30 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.021107 Aug 27 05:11:47.578533 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1931/3855] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:47 2022] POST /compute/v2.1/servers => generated 1197 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 27 05:11:47.686724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88247e64-bd99-41da-83a6-66512d208a19 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2124433643", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "888f8806-59be-4858-89cf-85a078fd49ed"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88247e64-bd99-41da-83a6-66512d208a19 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Request method failure captured: Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 1266 Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCad5QEwiyFIytB6h9D83TNG8YY1iPBDwrje840Y_2RO-TYxhVibkumic9GMFB3t2wPIJleLQDyPvISvMeu89v0sprQDI6QsxHwEPU3h9p0UtlNWDQK1Bbc8haO66bSQWNMJ0k19Kqc6KQpi_a5wajSdpty-xbocAv1NvwfNWomeT1W8 Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98b1b469396c435d8ee08ee24b3e5791", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: da9b26e9246d42f998f31e0643b26573 Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2124433643", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "888f8806-59be-4858-89cf-85a078fd49ed"}]}} Aug 27 05:11:47.692665 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2124433643', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '888f8806-59be-4858-89cf-85a078fd49ed'}]}}} Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.695437 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:11:47.696629 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:11:47.699106 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:11:47.699106 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.699106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88247e64-bd99-41da-83a6-66512d208a19 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:47.699106 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88247e64-bd99-41da-83a6-66512d208a19 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.011881 Aug 27 05:11:47.699106 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1925/3856] 10.222.0.58 () {60 vars in 1148 bytes} [Sat Aug 27 05:11:47 2022] POST /compute/v2.1/servers => generated 2221 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 27 05:11:47.707528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-079019db-65a6-41c6-a194-270458214324 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:47.708477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-079019db-65a6-41c6-a194-270458214324 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: f718290e-dca7-40f4-8948-0b8ecf9c33dc] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:47.721625 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-079019db-65a6-41c6-a194-270458214324 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] HTTP exception thrown: Instance f718290e-dca7-40f4-8948-0b8ecf9c33dc could not be found. Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-079019db-65a6-41c6-a194-270458214324 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Request method failure captured: Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/f718290e-dca7-40f4-8948-0b8ecf9c33dc/metadata/test2 HTTP/1.1 Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCad5QEwiyFIytB6h9D83TNG8YY1iPBDwrje840Y_2RO-TYxhVibkumic9GMFB3t2wPIJleLQDyPvISvMeu89v0sprQDI6QsxHwEPU3h9p0UtlNWDQK1Bbc8haO66bSQWNMJ0k19Kqc6KQpi_a5wajSdpty-xbocAv1NvwfNWomeT1W8 Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98b1b469396c435d8ee08ee24b3e5791", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: da9b26e9246d42f998f31e0643b26573 Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance f718290e-dca7-40f4-8948-0b8ecf9c33dc could not be found. Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'server_id': 'f718290e-dca7-40f4-8948-0b8ecf9c33dc', 'id': 'test2'} Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f718290e-dca7-40f4-8948-0b8ecf9c33dc could not be found. Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f718290e-dca7-40f4-8948-0b8ecf9c33dc could not be found. Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:47.736536 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:47.740951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:47.740951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:47.740951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f718290e-dca7-40f4-8948-0b8ecf9c33dc could not be found. Aug 27 05:11:47.740951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:11:47.742587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-079019db-65a6-41c6-a194-270458214324 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Returning 404 to user: Instance f718290e-dca7-40f4-8948-0b8ecf9c33dc could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:47.743715 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-079019db-65a6-41c6-a194-270458214324 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/f718290e-dca7-40f4-8948-0b8ecf9c33dc/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.042219 Aug 27 05:11:47.745340 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1932/3857] 10.222.0.58 () {58 vars in 1281 bytes} [Sat Aug 27 05:11:47 2022] GET /compute/v2.1/servers/f718290e-dca7-40f4-8948-0b8ecf9c33dc/metadata/test2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:11:47.761211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8911e04-d3d0-4e13-aeab-f230733408c5 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:47.761709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8911e04-d3d0-4e13-aeab-f230733408c5 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:47.783567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8911e04-d3d0-4e13-aeab-f230733408c5 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:47.784956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8911e04-d3d0-4e13-aeab-f230733408c5 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:47.788129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8911e04-d3d0-4e13-aeab-f230733408c5 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:47.789247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8911e04-d3d0-4e13-aeab-f230733408c5 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:47.790168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8911e04-d3d0-4e13-aeab-f230733408c5 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:47.791324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8911e04-d3d0-4e13-aeab-f230733408c5 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:47.839915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8911e04-d3d0-4e13-aeab-f230733408c5 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:11:48.007902 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8911e04-d3d0-4e13-aeab-f230733408c5 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 204 len: 0 microversion: 2.1 time: 0.252600 Aug 27 05:11:48.009087 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1926/3858] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:11:47 2022] DELETE /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:11:48.021467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c6c1f35b-d449-4613-a84b-c051d85a6a2b tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:48.022119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c6c1f35b-d449-4613-a84b-c051d85a6a2b tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:48.030321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6c1f35b-d449-4613-a84b-c051d85a6a2b tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:48.031082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6c1f35b-d449-4613-a84b-c051d85a6a2b tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:48.031741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6c1f35b-d449-4613-a84b-c051d85a6a2b tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:48.032721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6c1f35b-d449-4613-a84b-c051d85a6a2b tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:48.033382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6c1f35b-d449-4613-a84b-c051d85a6a2b tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:48.034013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6c1f35b-d449-4613-a84b-c051d85a6a2b tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:48.702083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c6c1f35b-d449-4613-a84b-c051d85a6a2b tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:48.713073 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c6c1f35b-d449-4613-a84b-c051d85a6a2b tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1526 microversion: 2.1 time: 0.698937 Aug 27 05:11:48.714496 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1933/3859] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:48 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1526 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:49.753797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7cbed62a-dbf7-42ab-a408-64a681704d52 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:49.756033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7cbed62a-dbf7-42ab-a408-64a681704d52 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:49.766866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbed62a-dbf7-42ab-a408-64a681704d52 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:49.767693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbed62a-dbf7-42ab-a408-64a681704d52 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:49.768305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbed62a-dbf7-42ab-a408-64a681704d52 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:49.769552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbed62a-dbf7-42ab-a408-64a681704d52 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:49.770175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbed62a-dbf7-42ab-a408-64a681704d52 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:49.770771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbed62a-dbf7-42ab-a408-64a681704d52 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:50.564502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7cbed62a-dbf7-42ab-a408-64a681704d52 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:50.574445 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7cbed62a-dbf7-42ab-a408-64a681704d52 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1526 microversion: 2.1 time: 0.840528 Aug 27 05:11:50.578030 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1927/3860] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:49 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1526 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:51.378903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0fd0571b-a9a6-4733-91cb-505d8d9c293c req-11378301-e31f-41bc-bafe-7eedd98a6667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19ad795-2b69-464a-b2ad-797883329153", "name": "network-vif-deleted", "tag": "7b8d43dd-ac77-454c-86de-5d2d2b3d6c4b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:51.410038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0fd0571b-a9a6-4733-91cb-505d8d9c293c req-11378301-e31f-41bc-bafe-7eedd98a6667 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:51.410588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0fd0571b-a9a6-4733-91cb-505d8d9c293c req-11378301-e31f-41bc-bafe-7eedd98a6667 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:51.413528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0fd0571b-a9a6-4733-91cb-505d8d9c293c req-11378301-e31f-41bc-bafe-7eedd98a6667 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:51.456845 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0fd0571b-a9a6-4733-91cb-505d8d9c293c req-11378301-e31f-41bc-bafe-7eedd98a6667 service nova] Creating event network-vif-deleted:7b8d43dd-ac77-454c-86de-5d2d2b3d6c4b for instance a19ad795-2b69-464a-b2ad-797883329153 on n-h1-820368-35 Aug 27 05:11:51.473178 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0fd0571b-a9a6-4733-91cb-505d8d9c293c req-11378301-e31f-41bc-bafe-7eedd98a6667 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103520 Aug 27 05:11:51.477637 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1934/3861] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:11:51.603059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:51.604831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:51.628532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:51.629373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:51.630314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:51.630717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:51.631219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:51.631650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:51.704498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:51.705265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:51.705872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:51.706494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lazy-loading 'fault' on Instance uuid a19ad795-2b69-464a-b2ad-797883329153 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:11:52.020803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9b26e9246d42f998f31e0643b26573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b1b469396c435d8ee08ee24b3e5791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:52.065045 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-629c5bba-0782-4c87-9710-ad0cf31d2c27 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 200 len: 1314 microversion: 2.1 time: 0.463664 Aug 27 05:11:52.066062 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1928/3862] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:51 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:53.086577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:53.087979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] [instance: a19ad795-2b69-464a-b2ad-797883329153] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:53.105747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:53.106573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:53.107260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:53.108205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:53.117575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:53.118255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:53.145865 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] HTTP exception thrown: Instance a19ad795-2b69-464a-b2ad-797883329153 could not be found. Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Request method failure captured: Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 HTTP/1.1 Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCad5QEwiyFIytB6h9D83TNG8YY1iPBDwrje840Y_2RO-TYxhVibkumic9GMFB3t2wPIJleLQDyPvISvMeu89v0sprQDI6QsxHwEPU3h9p0UtlNWDQK1Bbc8haO66bSQWNMJ0k19Kqc6KQpi_a5wajSdpty-xbocAv1NvwfNWomeT1W8 Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98b1b469396c435d8ee08ee24b3e5791", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98b1b469396c435d8ee08ee24b3e5791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 98b1b469396c435d8ee08ee24b3e5791 Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-631296419 Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: da9b26e9246d42f998f31e0643b26573 Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-631296419-project Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance a19ad795-2b69-464a-b2ad-797883329153 could not be found. Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'a19ad795-2b69-464a-b2ad-797883329153'} Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a19ad795-2b69-464a-b2ad-797883329153 could not be found. Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19ad795-2b69-464a-b2ad-797883329153 could not be found. Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:53.147792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:53.152856 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:53.152856 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:53.152856 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:53.152856 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:53.152856 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:53.152856 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:53.152856 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19ad795-2b69-464a-b2ad-797883329153 could not be found. Aug 27 05:11:53.152856 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:11:53.156337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] Returning 404 to user: Instance a19ad795-2b69-464a-b2ad-797883329153 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:53.157530 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e3a7b07a-9b58-467e-ab9f-9bbeed38aff8 tempest-ServerMetadataNegativeTestJSON-631296419 tempest-ServerMetadataNegativeTestJSON-631296419-project] 10.222.0.58 "GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153" status: 404 len: 111 microversion: 2.1 time: 0.074858 Aug 27 05:11:53.160626 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1929/3863] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:53 2022] GET /compute/v2.1/servers/a19ad795-2b69-464a-b2ad-797883329153 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:11:53.341469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a321c077-40f4-44d3-ab69-dc9cbf753680 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Action: 'create', calling method: .version_select at 0x7fb56968c790>, body: {"keypair": {"name": "tempest-keypair-515078189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxdnEedvNn04Mdh2mAlMM2azalcSkh/jS9hIHHimzoiJw+BCrONXprFCGVTGqxApqIxfsLdrjdtrVuVDGxYIKGv6XWwUg5TbLrti1oav2BPRfoEB/tB/sOJzx1LN2rI3A=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:53.377913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a321c077-40f4-44d3-ab69-dc9cbf753680 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Getting quotas for project 53d3ce49750c408f92141d38db831c55. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:11:53.383780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:53.386127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a321c077-40f4-44d3-ab69-dc9cbf753680 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Getting quotas for user e392f02f2c7145a5864f33ac08994c87 and project 53d3ce49750c408f92141d38db831c55. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:11:53.449707 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a321c077-40f4-44d3-ab69-dc9cbf753680 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.433144 Aug 27 05:11:53.450875 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1935/3864] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:11:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:54.787667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5e1cf7f3-13dd-4a4b-8529-a8e78154a82a req-2a09d008-59c7-4a68-881f-410fcbae500e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f179b67-f086-4d14-9088-e2fdf6f0c17d", "tag": "f52edb24-891f-48e2-a92d-bc4fb7d64dc6"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:54.809097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5e1cf7f3-13dd-4a4b-8529-a8e78154a82a req-2a09d008-59c7-4a68-881f-410fcbae500e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:54.809765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5e1cf7f3-13dd-4a4b-8529-a8e78154a82a req-2a09d008-59c7-4a68-881f-410fcbae500e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:54.811453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5e1cf7f3-13dd-4a4b-8529-a8e78154a82a req-2a09d008-59c7-4a68-881f-410fcbae500e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:54.842005 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-5e1cf7f3-13dd-4a4b-8529-a8e78154a82a req-2a09d008-59c7-4a68-881f-410fcbae500e service nova] Creating event network-changed:f52edb24-891f-48e2-a92d-bc4fb7d64dc6 for instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d on n-h1-820368-35 Aug 27 05:11:54.853075 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5e1cf7f3-13dd-4a4b-8529-a8e78154a82a req-2a09d008-59c7-4a68-881f-410fcbae500e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074131 Aug 27 05:11:54.854887 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1930/3865] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:11:57.683854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1358650126", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "43620fdb-3b93-439f-955c-01e22d65d95a"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:57.778795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] validate_networks() for [('43620fdb-3b93-439f-955c-01e22d65d95a', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:11:59.934455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1289138721", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2cf173e0-b495-4024-a387-a83bd555e23b"}], "security_groups": [{"name": "tempest-securitygroup--935338799"}], "key_name": "tempest-keypair-515078189", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:59.988835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:11:59.989350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:11:59.989742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:11:59.990214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:11:59.990639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:00.048620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:00.050140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:00.051458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:00.053226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:00.053913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:00.055591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:00.086628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:00.101933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for user c75dd4d6f001450bb9279d592e9783bd and project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:00.147027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:00.149968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:00.273088 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-481cfb60-416e-4387-9743-f204dc37ead0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.848593 Aug 27 05:12:00.280325 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1936/3866] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:12:00.290531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bfc04795-d4a4-437a-b83e-2f3ece8b42a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:00.293810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bfc04795-d4a4-437a-b83e-2f3ece8b42a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:00.326507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] validate_networks() for [('2cf173e0-b495-4024-a387-a83bd555e23b', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:00.539872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bfc04795-d4a4-437a-b83e-2f3ece8b42a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:00.555123 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bfc04795-d4a4-437a-b83e-2f3ece8b42a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1193 microversion: 2.1 time: 0.273525 Aug 27 05:12:00.557575 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1937/3867] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:00 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1193 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:01.057686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1542946860", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "700e9dd3-277c-4000-a19c-e41adb6c5854"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:01.142808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] validate_networks() for [('700e9dd3-277c-4000-a19c-e41adb6c5854', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:01.766775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Getting quotas for project 53d3ce49750c408f92141d38db831c55. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:01.780137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Getting quotas for user e392f02f2c7145a5864f33ac08994c87 and project 53d3ce49750c408f92141d38db831c55. Resources: dict_keys(['metadata_items']) {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:01.828061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:01.828506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:01.829224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:01.829622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:01.840346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:01.876517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:01.877457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:01.878942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:01.881874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:01.886428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:01.888796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:01.947930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Getting quotas for project 53d3ce49750c408f92141d38db831c55. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:01.956687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Getting quotas for user e392f02f2c7145a5864f33ac08994c87 and project 53d3ce49750c408f92141d38db831c55. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:01.979555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:01.987147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:01.989470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:01.990236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:01.990871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:01.991461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:01.992051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:02.018808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.019658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.020407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.021365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.023551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.024209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.100913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Getting quotas for project fb1a58fcad164480a373ed1c2ad516a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:02.107725 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4827754d-f141-4242-a02e-33092a32e47d tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.179604 Aug 27 05:12:02.108825 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1931/3868] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:12:02.115544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Getting quotas for user 5924d371bcec4bae863b774bbb084e52 and project fb1a58fcad164480a373ed1c2ad516a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:02.122779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-665fdf1a-c471-4bab-af10-87328c04053a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:02.124850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-665fdf1a-c471-4bab-af10-87328c04053a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:02.163857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:02.169116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-665fdf1a-c471-4bab-af10-87328c04053a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.169766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:02.170974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-665fdf1a-c471-4bab-af10-87328c04053a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.171959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-665fdf1a-c471-4bab-af10-87328c04053a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.173190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-665fdf1a-c471-4bab-af10-87328c04053a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.173964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-665fdf1a-c471-4bab-af10-87328c04053a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.180869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-665fdf1a-c471-4bab-af10-87328c04053a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.309250 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cdbb67c0-c511-4b97-b34b-dcbef5309dc6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509481 Aug 27 05:12:02.319947 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1938/3869] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:12:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:12:02.337186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-665fdf1a-c471-4bab-af10-87328c04053a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:02.350850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b3427681-2674-4642-a341-cdafc16ba855 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:02.351980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b3427681-2674-4642-a341-cdafc16ba855 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:02.372498 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-665fdf1a-c471-4bab-af10-87328c04053a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1245 microversion: 2.1 time: 0.259014 Aug 27 05:12:02.373726 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1932/3870] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:02 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1245 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:02.517630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b3427681-2674-4642-a341-cdafc16ba855 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:02.527473 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b3427681-2674-4642-a341-cdafc16ba855 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1269 microversion: 2.1 time: 0.202874 Aug 27 05:12:02.530142 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1939/3871] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:02 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1269 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:02.622891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-788159247", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "700e9dd3-277c-4000-a19c-e41adb6c5854"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:02.810228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] validate_networks() for [('700e9dd3-277c-4000-a19c-e41adb6c5854', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:03.396980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e39ce65d-eaad-49f6-80ae-745c9fc00e00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:03.397777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e39ce65d-eaad-49f6-80ae-745c9fc00e00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:03.413266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39ce65d-eaad-49f6-80ae-745c9fc00e00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.413774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39ce65d-eaad-49f6-80ae-745c9fc00e00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.414776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39ce65d-eaad-49f6-80ae-745c9fc00e00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.415556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39ce65d-eaad-49f6-80ae-745c9fc00e00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.417190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39ce65d-eaad-49f6-80ae-745c9fc00e00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.417635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39ce65d-eaad-49f6-80ae-745c9fc00e00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.658328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e39ce65d-eaad-49f6-80ae-745c9fc00e00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:03.680557 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e39ce65d-eaad-49f6-80ae-745c9fc00e00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1251 microversion: 2.1 time: 0.287739 Aug 27 05:12:03.683813 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1940/3872] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:03 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1251 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:03.691806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-62b62e19-5c9a-4ddf-bbd2-0c9e6fc4c81e tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:03.696006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-62b62e19-5c9a-4ddf-bbd2-0c9e6fc4c81e tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:03.706615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62b62e19-5c9a-4ddf-bbd2-0c9e6fc4c81e tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.707148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62b62e19-5c9a-4ddf-bbd2-0c9e6fc4c81e tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.707601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62b62e19-5c9a-4ddf-bbd2-0c9e6fc4c81e tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.708322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62b62e19-5c9a-4ddf-bbd2-0c9e6fc4c81e tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.708787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62b62e19-5c9a-4ddf-bbd2-0c9e6fc4c81e tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.709222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62b62e19-5c9a-4ddf-bbd2-0c9e6fc4c81e tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.925254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:03.926319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:03.926951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:03.927564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:03.928175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:03.944697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-62b62e19-5c9a-4ddf-bbd2-0c9e6fc4c81e tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:03.946742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.948187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.949447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.951051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.952960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.953625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.956584 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-62b62e19-5c9a-4ddf-bbd2-0c9e6fc4c81e tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1265 microversion: 2.1 time: 0.271224 Aug 27 05:12:03.977979 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1941/3873] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:03 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:03.996996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Getting quotas for project fb1a58fcad164480a373ed1c2ad516a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:04.011388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Getting quotas for user 5924d371bcec4bae863b774bbb084e52 and project fb1a58fcad164480a373ed1c2ad516a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:04.024676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:04.027697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 5bb0289f-a421-4664-bdd2-1133b9e99e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:04.084126 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-36f281f4-5874-4618-912f-da46af7c1a4f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464783 Aug 27 05:12:04.085264 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1933/3874] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:12:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:12:04.448103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1543587796", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "451", "networks": [{"uuid": "700e9dd3-277c-4000-a19c-e41adb6c5854"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:04.558395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] validate_networks() for [('700e9dd3-277c-4000-a19c-e41adb6c5854', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:04.703378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-06952c24-5bf0-4139-ba22-6f2ccea9e7e8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:04.704246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-06952c24-5bf0-4139-ba22-6f2ccea9e7e8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:04.713947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06952c24-5bf0-4139-ba22-6f2ccea9e7e8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:04.714444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06952c24-5bf0-4139-ba22-6f2ccea9e7e8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:04.714884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06952c24-5bf0-4139-ba22-6f2ccea9e7e8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:04.719041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06952c24-5bf0-4139-ba22-6f2ccea9e7e8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:04.720706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06952c24-5bf0-4139-ba22-6f2ccea9e7e8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:04.721234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06952c24-5bf0-4139-ba22-6f2ccea9e7e8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:05.856962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-06952c24-5bf0-4139-ba22-6f2ccea9e7e8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:05.870113 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-06952c24-5bf0-4139-ba22-6f2ccea9e7e8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 1.170511 Aug 27 05:12:05.870878 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1934/3875] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:04 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:05.880978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c566e040-63f1-48f2-8e2a-73660c41112f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:05.881962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c566e040-63f1-48f2-8e2a-73660c41112f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:05.892207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c566e040-63f1-48f2-8e2a-73660c41112f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:05.892526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c566e040-63f1-48f2-8e2a-73660c41112f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:05.892970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c566e040-63f1-48f2-8e2a-73660c41112f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:05.894982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c566e040-63f1-48f2-8e2a-73660c41112f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:05.895499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c566e040-63f1-48f2-8e2a-73660c41112f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:05.895928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c566e040-63f1-48f2-8e2a-73660c41112f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:05.989306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c566e040-63f1-48f2-8e2a-73660c41112f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:06.000202 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c566e040-63f1-48f2-8e2a-73660c41112f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1327 microversion: 2.1 time: 0.127835 Aug 27 05:12:06.001006 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1935/3876] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:05 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1327 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:06.429031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:06.430079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:06.430919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:06.431378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:06.434276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:06.453468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:06.454257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:06.456293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:06.457496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:06.458133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:06.462406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:06.496605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Getting quotas for project fb1a58fcad164480a373ed1c2ad516a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:06.505534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Getting quotas for user 5924d371bcec4bae863b774bbb084e52 and project fb1a58fcad164480a373ed1c2ad516a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:06.524945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:06.532862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:06.610316 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a0236656-bb21-4968-a576-e65541c16425 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.166688 Aug 27 05:12:06.611538 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1942/3877] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:12:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:12:06.628942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-98746914-98ff-4bcb-8e1d-f40812fc991d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:06.629912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-98746914-98ff-4bcb-8e1d-f40812fc991d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:06.734469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-98746914-98ff-4bcb-8e1d-f40812fc991d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:06.747232 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-98746914-98ff-4bcb-8e1d-f40812fc991d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1221 microversion: 2.1 time: 0.129268 Aug 27 05:12:06.748150 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1936/3878] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:06 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1221 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:06.893041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7a8461b0-441a-4a52-9561-1142138c9041 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:06.895470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7a8461b0-441a-4a52-9561-1142138c9041 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:06.905764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a8461b0-441a-4a52-9561-1142138c9041 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:06.906928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a8461b0-441a-4a52-9561-1142138c9041 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:06.907520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a8461b0-441a-4a52-9561-1142138c9041 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:06.908334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a8461b0-441a-4a52-9561-1142138c9041 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:06.908891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a8461b0-441a-4a52-9561-1142138c9041 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:06.909414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a8461b0-441a-4a52-9561-1142138c9041 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:07.028733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-db4e6ef2-e1fc-46c6-aeb3-5b8977914094 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:07.030991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-db4e6ef2-e1fc-46c6-aeb3-5b8977914094 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:07.043573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4e6ef2-e1fc-46c6-aeb3-5b8977914094 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:07.044968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4e6ef2-e1fc-46c6-aeb3-5b8977914094 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:07.045577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4e6ef2-e1fc-46c6-aeb3-5b8977914094 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:07.046573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4e6ef2-e1fc-46c6-aeb3-5b8977914094 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:07.047239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4e6ef2-e1fc-46c6-aeb3-5b8977914094 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:07.047861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4e6ef2-e1fc-46c6-aeb3-5b8977914094 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:07.171667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-db4e6ef2-e1fc-46c6-aeb3-5b8977914094 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:07.181347 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-db4e6ef2-e1fc-46c6-aeb3-5b8977914094 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1327 microversion: 2.1 time: 0.161046 Aug 27 05:12:07.183627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7a8461b0-441a-4a52-9561-1142138c9041 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:07.184005 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1937/3879] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:07 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1327 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:07.196628 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7a8461b0-441a-4a52-9561-1142138c9041 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.308785 Aug 27 05:12:07.197824 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1943/3880] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:06 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:07.221532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-402f7fea-0d27-470d-8615-bdf2da9c0523 req-c41818a8-8ea7-40eb-8eb8-f827f5177fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c08f9da-2f0f-445e-b1a9-2bbae7adc63c", "tag": "f07984a1-c0c7-4c67-acb9-8a9dcf3f4cc0"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:07.235811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-402f7fea-0d27-470d-8615-bdf2da9c0523 req-c41818a8-8ea7-40eb-8eb8-f827f5177fe3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:07.236549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-402f7fea-0d27-470d-8615-bdf2da9c0523 req-c41818a8-8ea7-40eb-8eb8-f827f5177fe3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:07.237202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-402f7fea-0d27-470d-8615-bdf2da9c0523 req-c41818a8-8ea7-40eb-8eb8-f827f5177fe3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:07.258366 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-402f7fea-0d27-470d-8615-bdf2da9c0523 req-c41818a8-8ea7-40eb-8eb8-f827f5177fe3 service nova] Creating event network-changed:f07984a1-c0c7-4c67-acb9-8a9dcf3f4cc0 for instance 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c on n-h1-820368-35 Aug 27 05:12:07.265596 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-402f7fea-0d27-470d-8615-bdf2da9c0523 req-c41818a8-8ea7-40eb-8eb8-f827f5177fe3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047701 Aug 27 05:12:07.266617 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1938/3881] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:07.783281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5ac33e7-586d-4fd1-89f2-17b1c2f2eab5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:07.784286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b5ac33e7-586d-4fd1-89f2-17b1c2f2eab5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:07.794460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ac33e7-586d-4fd1-89f2-17b1c2f2eab5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:07.795597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ac33e7-586d-4fd1-89f2-17b1c2f2eab5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:07.796280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ac33e7-586d-4fd1-89f2-17b1c2f2eab5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:07.797346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ac33e7-586d-4fd1-89f2-17b1c2f2eab5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:07.798153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ac33e7-586d-4fd1-89f2-17b1c2f2eab5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:07.798806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ac33e7-586d-4fd1-89f2-17b1c2f2eab5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:07.802460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:07.904960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5ac33e7-586d-4fd1-89f2-17b1c2f2eab5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:07.919054 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5ac33e7-586d-4fd1-89f2-17b1c2f2eab5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1273 microversion: 2.1 time: 0.150622 Aug 27 05:12:07.921400 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1944/3882] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:07 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:08.211396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f5e681d-f8ea-4127-9b60-840f5626bdc0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:08.213354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f5e681d-f8ea-4127-9b60-840f5626bdc0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:08.220529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b3f110a-680e-4612-888c-55392001ae4c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:08.221148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b3f110a-680e-4612-888c-55392001ae4c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:08.234975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b3f110a-680e-4612-888c-55392001ae4c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.235512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b3f110a-680e-4612-888c-55392001ae4c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.241008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b3f110a-680e-4612-888c-55392001ae4c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.245632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f5e681d-f8ea-4127-9b60-840f5626bdc0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.246141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b3f110a-680e-4612-888c-55392001ae4c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.247940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b3f110a-680e-4612-888c-55392001ae4c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.249047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b3f110a-680e-4612-888c-55392001ae4c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.251846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f5e681d-f8ea-4127-9b60-840f5626bdc0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.257033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f5e681d-f8ea-4127-9b60-840f5626bdc0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.259595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f5e681d-f8ea-4127-9b60-840f5626bdc0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.261483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f5e681d-f8ea-4127-9b60-840f5626bdc0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.262975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f5e681d-f8ea-4127-9b60-840f5626bdc0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.568265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b3f110a-680e-4612-888c-55392001ae4c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:08.590138 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b3f110a-680e-4612-888c-55392001ae4c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.371542 Aug 27 05:12:08.625688 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1945/3883] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:08 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:08.640156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7d7f6052-0429-4a2a-9617-ecef9ad9739e req-22bf0d4b-b69a-46c6-9fef-063d1b7b6a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb0289f-a421-4664-bdd2-1133b9e99e56", "tag": "e245a126-f6fc-4e9e-b345-3109a61d051d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:08.673556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7d7f6052-0429-4a2a-9617-ecef9ad9739e req-22bf0d4b-b69a-46c6-9fef-063d1b7b6a41 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.674485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7d7f6052-0429-4a2a-9617-ecef9ad9739e req-22bf0d4b-b69a-46c6-9fef-063d1b7b6a41 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.684871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7d7f6052-0429-4a2a-9617-ecef9ad9739e req-22bf0d4b-b69a-46c6-9fef-063d1b7b6a41 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.703168 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7d7f6052-0429-4a2a-9617-ecef9ad9739e req-22bf0d4b-b69a-46c6-9fef-063d1b7b6a41 service nova] Creating event network-changed:e245a126-f6fc-4e9e-b345-3109a61d051d for instance 5bb0289f-a421-4664-bdd2-1133b9e99e56 on n-h1-820368-35 Aug 27 05:12:08.716070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f5e681d-f8ea-4127-9b60-840f5626bdc0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:08.720177 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7d7f6052-0429-4a2a-9617-ecef9ad9739e req-22bf0d4b-b69a-46c6-9fef-063d1b7b6a41 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090426 Aug 27 05:12:08.721448 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1946/3884] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:08.728471 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f5e681d-f8ea-4127-9b60-840f5626bdc0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.524986 Aug 27 05:12:08.730086 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1939/3885] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:08 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:08.945295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9112a013-c080-4293-8837-f4e8a2ef1283 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:08.946692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9112a013-c080-4293-8837-f4e8a2ef1283 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:08.958218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9112a013-c080-4293-8837-f4e8a2ef1283 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.959234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9112a013-c080-4293-8837-f4e8a2ef1283 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.959690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9112a013-c080-4293-8837-f4e8a2ef1283 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.960465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9112a013-c080-4293-8837-f4e8a2ef1283 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.960935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9112a013-c080-4293-8837-f4e8a2ef1283 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.961654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9112a013-c080-4293-8837-f4e8a2ef1283 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.095372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9112a013-c080-4293-8837-f4e8a2ef1283 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:09.131406 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9112a013-c080-4293-8837-f4e8a2ef1283 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1279 microversion: 2.1 time: 0.190389 Aug 27 05:12:09.134637 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1947/3886] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:08 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1279 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:09.614574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bdc5bb9d-45c8-42c3-b140-19f7dfffbc2c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:09.615361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bdc5bb9d-45c8-42c3-b140-19f7dfffbc2c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:09.630673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdc5bb9d-45c8-42c3-b140-19f7dfffbc2c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.633512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdc5bb9d-45c8-42c3-b140-19f7dfffbc2c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.639194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdc5bb9d-45c8-42c3-b140-19f7dfffbc2c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.640259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdc5bb9d-45c8-42c3-b140-19f7dfffbc2c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.640931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdc5bb9d-45c8-42c3-b140-19f7dfffbc2c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.641561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdc5bb9d-45c8-42c3-b140-19f7dfffbc2c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.756185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8f9c4ec-09e6-43d1-8a6a-6898252c3fce tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:09.757108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f8f9c4ec-09e6-43d1-8a6a-6898252c3fce tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:09.770292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8f9c4ec-09e6-43d1-8a6a-6898252c3fce tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.772214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8f9c4ec-09e6-43d1-8a6a-6898252c3fce tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.773043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8f9c4ec-09e6-43d1-8a6a-6898252c3fce tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.774313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8f9c4ec-09e6-43d1-8a6a-6898252c3fce tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.776015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8f9c4ec-09e6-43d1-8a6a-6898252c3fce tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.776745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8f9c4ec-09e6-43d1-8a6a-6898252c3fce tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:10.081131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bdc5bb9d-45c8-42c3-b140-19f7dfffbc2c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:10.089808 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bdc5bb9d-45c8-42c3-b140-19f7dfffbc2c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.479727 Aug 27 05:12:10.099184 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1940/3887] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:09 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:10.124169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f8f9c4ec-09e6-43d1-8a6a-6898252c3fce tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:10.140002 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8f9c4ec-09e6-43d1-8a6a-6898252c3fce tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.393026 Aug 27 05:12:10.149848 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1948/3888] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:09 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:10.176942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-71ecc805-59e3-41e0-8569-1a742f32340f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:10.177949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-71ecc805-59e3-41e0-8569-1a742f32340f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:10.185429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71ecc805-59e3-41e0-8569-1a742f32340f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:10.186314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71ecc805-59e3-41e0-8569-1a742f32340f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:10.190291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71ecc805-59e3-41e0-8569-1a742f32340f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:10.191423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71ecc805-59e3-41e0-8569-1a742f32340f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:10.192252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71ecc805-59e3-41e0-8569-1a742f32340f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:10.192938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71ecc805-59e3-41e0-8569-1a742f32340f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:10.396902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-71ecc805-59e3-41e0-8569-1a742f32340f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:10.410319 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-71ecc805-59e3-41e0-8569-1a742f32340f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1279 microversion: 2.1 time: 0.252684 Aug 27 05:12:10.411614 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1941/3889] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:10 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1279 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:11.101263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9639a2b1-33af-40a9-8350-f3b207db3393 req-f410cbc2-a7bb-4f49-bddf-418036f1aa2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871c1afd-5f3a-4cf5-93c2-01c274d2a4bb", "tag": "a39f49ec-9e04-46ba-b543-f745bd65b603"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:11.114704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8259c657-036c-4f1e-805a-7e277afe2a3a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:11.115474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8259c657-036c-4f1e-805a-7e277afe2a3a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:11.137556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8259c657-036c-4f1e-805a-7e277afe2a3a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.138057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8259c657-036c-4f1e-805a-7e277afe2a3a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.138501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8259c657-036c-4f1e-805a-7e277afe2a3a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.143540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9639a2b1-33af-40a9-8350-f3b207db3393 req-f410cbc2-a7bb-4f49-bddf-418036f1aa2a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.144102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9639a2b1-33af-40a9-8350-f3b207db3393 req-f410cbc2-a7bb-4f49-bddf-418036f1aa2a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.145062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8259c657-036c-4f1e-805a-7e277afe2a3a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.145711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8259c657-036c-4f1e-805a-7e277afe2a3a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.146321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8259c657-036c-4f1e-805a-7e277afe2a3a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.152528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9639a2b1-33af-40a9-8350-f3b207db3393 req-f410cbc2-a7bb-4f49-bddf-418036f1aa2a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.205958 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9639a2b1-33af-40a9-8350-f3b207db3393 req-f410cbc2-a7bb-4f49-bddf-418036f1aa2a service nova] Creating event network-changed:a39f49ec-9e04-46ba-b543-f745bd65b603 for instance 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb on n-h2-820368-35 Aug 27 05:12:11.220263 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9639a2b1-33af-40a9-8350-f3b207db3393 req-f410cbc2-a7bb-4f49-bddf-418036f1aa2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127480 Aug 27 05:12:11.224996 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1949/3890] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:11.240310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b7e5272-43b6-4f68-a0b2-c74dc81119a5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:11.243017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8b7e5272-43b6-4f68-a0b2-c74dc81119a5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:11.255392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7e5272-43b6-4f68-a0b2-c74dc81119a5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.256561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7e5272-43b6-4f68-a0b2-c74dc81119a5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.257309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7e5272-43b6-4f68-a0b2-c74dc81119a5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.258899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7e5272-43b6-4f68-a0b2-c74dc81119a5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.260740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7e5272-43b6-4f68-a0b2-c74dc81119a5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.261764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7e5272-43b6-4f68-a0b2-c74dc81119a5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:12.036860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8259c657-036c-4f1e-805a-7e277afe2a3a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:12.073077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b7e5272-43b6-4f68-a0b2-c74dc81119a5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:12.080356 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8259c657-036c-4f1e-805a-7e277afe2a3a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.971922 Aug 27 05:12:12.091110 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1942/3891] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:11 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:12.091110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-22e7683f-9ae1-4a74-8881-6552e4ded98d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:12.091110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-22e7683f-9ae1-4a74-8881-6552e4ded98d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:12.094596 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b7e5272-43b6-4f68-a0b2-c74dc81119a5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.867897 Aug 27 05:12:12.107486 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1950/3892] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:11 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:12.108697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22e7683f-9ae1-4a74-8881-6552e4ded98d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:12.109421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22e7683f-9ae1-4a74-8881-6552e4ded98d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:12.116734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22e7683f-9ae1-4a74-8881-6552e4ded98d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:12.118121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22e7683f-9ae1-4a74-8881-6552e4ded98d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:12.120565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22e7683f-9ae1-4a74-8881-6552e4ded98d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:12.121216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22e7683f-9ae1-4a74-8881-6552e4ded98d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:12.162513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:12.418708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-22e7683f-9ae1-4a74-8881-6552e4ded98d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:12.433383 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-22e7683f-9ae1-4a74-8881-6552e4ded98d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1321 microversion: 2.1 time: 0.349313 Aug 27 05:12:12.434827 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1943/3893] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:12 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:13.127309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc5da84b-3570-472a-867f-b97b3627133c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:13.127920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dc5da84b-3570-472a-867f-b97b3627133c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:13.131144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8adc8826-8fe7-4e5a-9305-8082c3a9e473 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:13.132190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8adc8826-8fe7-4e5a-9305-8082c3a9e473 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:13.153448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adc8826-8fe7-4e5a-9305-8082c3a9e473 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.154051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc5da84b-3570-472a-867f-b97b3627133c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.154612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc5da84b-3570-472a-867f-b97b3627133c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.155212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adc8826-8fe7-4e5a-9305-8082c3a9e473 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.157201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc5da84b-3570-472a-867f-b97b3627133c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.157831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adc8826-8fe7-4e5a-9305-8082c3a9e473 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.159645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc5da84b-3570-472a-867f-b97b3627133c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.160302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adc8826-8fe7-4e5a-9305-8082c3a9e473 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.161627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adc8826-8fe7-4e5a-9305-8082c3a9e473 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.161820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc5da84b-3570-472a-867f-b97b3627133c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.162532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc5da84b-3570-472a-867f-b97b3627133c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.163040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8adc8826-8fe7-4e5a-9305-8082c3a9e473 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.527745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dc5da84b-3570-472a-867f-b97b3627133c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:13.533353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8adc8826-8fe7-4e5a-9305-8082c3a9e473 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:13.550562 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dc5da84b-3570-472a-867f-b97b3627133c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.446058 Aug 27 05:12:13.551365 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8adc8826-8fe7-4e5a-9305-8082c3a9e473 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.432265 Aug 27 05:12:13.552681 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1944/3894] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:13 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:13.555366 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1951/3895] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:13 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:13.562241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-e6b2af1e-c3e4-4b18-84e5-185b9c55bcbd req-175c89ba-efcc-4727-b196-b0a3f25afd0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47d1403-a080-46a6-afcb-fb0aaf21616a", "tag": "5e7060fe-bfe9-42bd-b0d4-3a21859a112b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:13.564786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4a487e62-ef8a-493b-a6aa-b1a3d02efeae tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:13.565411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4a487e62-ef8a-493b-a6aa-b1a3d02efeae tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:13.582032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e6b2af1e-c3e4-4b18-84e5-185b9c55bcbd req-175c89ba-efcc-4727-b196-b0a3f25afd0d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.584645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a487e62-ef8a-493b-a6aa-b1a3d02efeae tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.585299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a487e62-ef8a-493b-a6aa-b1a3d02efeae tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.585959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a487e62-ef8a-493b-a6aa-b1a3d02efeae tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.586897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a487e62-ef8a-493b-a6aa-b1a3d02efeae tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.588353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e6b2af1e-c3e4-4b18-84e5-185b9c55bcbd req-175c89ba-efcc-4727-b196-b0a3f25afd0d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.588792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e6b2af1e-c3e4-4b18-84e5-185b9c55bcbd req-175c89ba-efcc-4727-b196-b0a3f25afd0d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.593698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a487e62-ef8a-493b-a6aa-b1a3d02efeae tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.594310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a487e62-ef8a-493b-a6aa-b1a3d02efeae tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.615292 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-e6b2af1e-c3e4-4b18-84e5-185b9c55bcbd req-175c89ba-efcc-4727-b196-b0a3f25afd0d service nova] Creating event network-changed:5e7060fe-bfe9-42bd-b0d4-3a21859a112b for instance d47d1403-a080-46a6-afcb-fb0aaf21616a on n-h2-820368-35 Aug 27 05:12:13.625399 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-e6b2af1e-c3e4-4b18-84e5-185b9c55bcbd req-175c89ba-efcc-4727-b196-b0a3f25afd0d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071168 Aug 27 05:12:13.628594 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1945/3896] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:13.939540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4a487e62-ef8a-493b-a6aa-b1a3d02efeae tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:13.950585 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4a487e62-ef8a-493b-a6aa-b1a3d02efeae tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1321 microversion: 2.1 time: 0.394134 Aug 27 05:12:13.953501 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1952/3897] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:13 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:14.589804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-98fb76df-fa10-4622-8bcf-f31b2153ee14 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:14.591129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-98fb76df-fa10-4622-8bcf-f31b2153ee14 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:14.591814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-470a9874-3784-4da5-ab08-5ed05442d753 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:14.592435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-470a9874-3784-4da5-ab08-5ed05442d753 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:14.594262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:14.598153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:14.607652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-470a9874-3784-4da5-ab08-5ed05442d753 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:14.609253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-470a9874-3784-4da5-ab08-5ed05442d753 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:14.609861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-470a9874-3784-4da5-ab08-5ed05442d753 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:14.611177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-470a9874-3784-4da5-ab08-5ed05442d753 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:14.612245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-470a9874-3784-4da5-ab08-5ed05442d753 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:14.612786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98fb76df-fa10-4622-8bcf-f31b2153ee14 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:14.612993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-470a9874-3784-4da5-ab08-5ed05442d753 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:14.613323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98fb76df-fa10-4622-8bcf-f31b2153ee14 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:14.613779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98fb76df-fa10-4622-8bcf-f31b2153ee14 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:14.614572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98fb76df-fa10-4622-8bcf-f31b2153ee14 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:14.615030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98fb76df-fa10-4622-8bcf-f31b2153ee14 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:14.615486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-98fb76df-fa10-4622-8bcf-f31b2153ee14 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:15.389026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-98fb76df-fa10-4622-8bcf-f31b2153ee14 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:15.391339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-470a9874-3784-4da5-ab08-5ed05442d753 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:15.401395 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-470a9874-3784-4da5-ab08-5ed05442d753 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.812889 Aug 27 05:12:15.401989 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-98fb76df-fa10-4622-8bcf-f31b2153ee14 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.818076 Aug 27 05:12:15.402616 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1946/3898] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:14 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:15.415079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a2e15000-9ea9-4479-bce0-2025e0fba936 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:15.415079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a2e15000-9ea9-4479-bce0-2025e0fba936 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:15.417279 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1953/3899] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:14 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:15.430550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2e15000-9ea9-4479-bce0-2025e0fba936 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:15.431108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2e15000-9ea9-4479-bce0-2025e0fba936 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:15.432310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2e15000-9ea9-4479-bce0-2025e0fba936 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:15.433524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2e15000-9ea9-4479-bce0-2025e0fba936 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:15.434010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2e15000-9ea9-4479-bce0-2025e0fba936 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:15.434448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2e15000-9ea9-4479-bce0-2025e0fba936 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:16.272463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a2e15000-9ea9-4479-bce0-2025e0fba936 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:16.288425 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a2e15000-9ea9-4479-bce0-2025e0fba936 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1321 microversion: 2.1 time: 0.881568 Aug 27 05:12:16.288657 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1947/3900] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:15 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1321 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:16.426404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29cccbe2-3fe7-4b4a-b608-e95a99adc95c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:16.428758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-29cccbe2-3fe7-4b4a-b608-e95a99adc95c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:16.438337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d687633e-7e95-46a3-b396-cc72461b29b7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:16.439249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d687633e-7e95-46a3-b396-cc72461b29b7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:16.448770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d687633e-7e95-46a3-b396-cc72461b29b7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:16.451726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d687633e-7e95-46a3-b396-cc72461b29b7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:16.451902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29cccbe2-3fe7-4b4a-b608-e95a99adc95c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:16.452548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d687633e-7e95-46a3-b396-cc72461b29b7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:16.452670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29cccbe2-3fe7-4b4a-b608-e95a99adc95c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:16.453915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d687633e-7e95-46a3-b396-cc72461b29b7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:16.454109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29cccbe2-3fe7-4b4a-b608-e95a99adc95c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:16.454723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d687633e-7e95-46a3-b396-cc72461b29b7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:16.456054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29cccbe2-3fe7-4b4a-b608-e95a99adc95c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:16.456629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d687633e-7e95-46a3-b396-cc72461b29b7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:16.456882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29cccbe2-3fe7-4b4a-b608-e95a99adc95c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:16.457519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29cccbe2-3fe7-4b4a-b608-e95a99adc95c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:16.494901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:16.521924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=26 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:16.747795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=18 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:17.017139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d687633e-7e95-46a3-b396-cc72461b29b7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:17.038647 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d687633e-7e95-46a3-b396-cc72461b29b7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.604206 Aug 27 05:12:17.043483 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1948/3901] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:16 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:17.113765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-29cccbe2-3fe7-4b4a-b608-e95a99adc95c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:17.126359 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-29cccbe2-3fe7-4b4a-b608-e95a99adc95c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.707019 Aug 27 05:12:17.138361 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1954/3902] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:16 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:17.312873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5dfe8f10-02ce-4f10-a4c4-436f2b899c52 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:17.314753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5dfe8f10-02ce-4f10-a4c4-436f2b899c52 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:17.326741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfe8f10-02ce-4f10-a4c4-436f2b899c52 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:17.327585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfe8f10-02ce-4f10-a4c4-436f2b899c52 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:17.329747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfe8f10-02ce-4f10-a4c4-436f2b899c52 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:17.332048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfe8f10-02ce-4f10-a4c4-436f2b899c52 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:17.332807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfe8f10-02ce-4f10-a4c4-436f2b899c52 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:17.333413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfe8f10-02ce-4f10-a4c4-436f2b899c52 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:17.590598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5dfe8f10-02ce-4f10-a4c4-436f2b899c52 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:17.600863 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5dfe8f10-02ce-4f10-a4c4-436f2b899c52 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1321 microversion: 2.1 time: 0.292248 Aug 27 05:12:17.601698 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1949/3903] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:17 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:18.014754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-689628937", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "06d72324-f9f1-4084-9dda-bc54bcca1f35"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:18.067676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1b823654-b378-48a2-a14a-85bd5ce1e54b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:18.068651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1b823654-b378-48a2-a14a-85bd5ce1e54b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:18.078851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b823654-b378-48a2-a14a-85bd5ce1e54b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.079956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b823654-b378-48a2-a14a-85bd5ce1e54b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.082724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b823654-b378-48a2-a14a-85bd5ce1e54b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.083698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b823654-b378-48a2-a14a-85bd5ce1e54b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.084261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b823654-b378-48a2-a14a-85bd5ce1e54b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.084768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b823654-b378-48a2-a14a-85bd5ce1e54b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.098307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] validate_networks() for [('06d72324-f9f1-4084-9dda-bc54bcca1f35', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:18.487926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1b823654-b378-48a2-a14a-85bd5ce1e54b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:18.502391 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1b823654-b378-48a2-a14a-85bd5ce1e54b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.439154 Aug 27 05:12:18.503005 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1950/3904] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:18 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:18.516217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aed47a33-4b19-484c-ac78-4e02adf7a6a6 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:18.516878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aed47a33-4b19-484c-ac78-4e02adf7a6a6 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:18.527700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed47a33-4b19-484c-ac78-4e02adf7a6a6 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.528202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed47a33-4b19-484c-ac78-4e02adf7a6a6 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.528646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed47a33-4b19-484c-ac78-4e02adf7a6a6 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.530315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed47a33-4b19-484c-ac78-4e02adf7a6a6 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.530943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed47a33-4b19-484c-ac78-4e02adf7a6a6 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.531567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aed47a33-4b19-484c-ac78-4e02adf7a6a6 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.809910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aed47a33-4b19-484c-ac78-4e02adf7a6a6 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:18.818310 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aed47a33-4b19-484c-ac78-4e02adf7a6a6 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.314211 Aug 27 05:12:18.824699 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1951/3905] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:18 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:18.853400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-905ea24a-1f96-4209-8927-6e9054c65068 req-2335cf01-d88f-4446-9623-43e9379ecb60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c08f9da-2f0f-445e-b1a9-2bbae7adc63c", "name": "network-vif-plugged", "status": "completed", "tag": "f07984a1-c0c7-4c67-acb9-8a9dcf3f4cc0"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:18.905775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-905ea24a-1f96-4209-8927-6e9054c65068 req-2335cf01-d88f-4446-9623-43e9379ecb60 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.906161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-905ea24a-1f96-4209-8927-6e9054c65068 req-2335cf01-d88f-4446-9623-43e9379ecb60 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.906608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-905ea24a-1f96-4209-8927-6e9054c65068 req-2335cf01-d88f-4446-9623-43e9379ecb60 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.927634 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-905ea24a-1f96-4209-8927-6e9054c65068 req-2335cf01-d88f-4446-9623-43e9379ecb60 service nova] Creating event network-vif-plugged:f07984a1-c0c7-4c67-acb9-8a9dcf3f4cc0 for instance 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c on n-h1-820368-35 Aug 27 05:12:18.933248 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-905ea24a-1f96-4209-8927-6e9054c65068 req-2335cf01-d88f-4446-9623-43e9379ecb60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107169 Aug 27 05:12:18.934239 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1952/3906] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:18.943128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c7577c7f-86e7-4ae7-9ea9-a2b996562442 req-bdbb34e5-768c-4cfa-8d51-e57a898a6717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "414cf2c1-b160-43bf-9a21-3185fa2fd06b", "tag": "dc2c77da-3bf2-4cc3-a09c-5796e57080fe"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:18.950949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:18.951788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:18.952049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:18.952463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:18.952885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:18.964717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c7577c7f-86e7-4ae7-9ea9-a2b996562442 req-bdbb34e5-768c-4cfa-8d51-e57a898a6717 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.972897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.975257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.975965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.977013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.979692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.981382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c7577c7f-86e7-4ae7-9ea9-a2b996562442 req-bdbb34e5-768c-4cfa-8d51-e57a898a6717 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.981716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.982011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c7577c7f-86e7-4ae7-9ea9-a2b996562442 req-bdbb34e5-768c-4cfa-8d51-e57a898a6717 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.014276 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c7577c7f-86e7-4ae7-9ea9-a2b996562442 req-bdbb34e5-768c-4cfa-8d51-e57a898a6717 service nova] Creating event network-changed:dc2c77da-3bf2-4cc3-a09c-5796e57080fe for instance 414cf2c1-b160-43bf-9a21-3185fa2fd06b on n-h1-820368-35 Aug 27 05:12:19.035640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Getting quotas for project 7a00617ff4994b899d6eae47d2eeae00. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:19.036153 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c7577c7f-86e7-4ae7-9ea9-a2b996562442 req-bdbb34e5-768c-4cfa-8d51-e57a898a6717 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098597 Aug 27 05:12:19.036867 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1953/3907] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:19.042728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fef9134c-e2e8-40e9-8cdd-ecf14f287427 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:19.043880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fef9134c-e2e8-40e9-8cdd-ecf14f287427 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:19.049751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Getting quotas for user 0e0b9a8c46c142debdf7cf8398399742 and project 7a00617ff4994b899d6eae47d2eeae00. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:19.055932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9134c-e2e8-40e9-8cdd-ecf14f287427 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.056268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:19.056470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9134c-e2e8-40e9-8cdd-ecf14f287427 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.056921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9134c-e2e8-40e9-8cdd-ecf14f287427 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.057645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9134c-e2e8-40e9-8cdd-ecf14f287427 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.063046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9134c-e2e8-40e9-8cdd-ecf14f287427 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.063755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9134c-e2e8-40e9-8cdd-ecf14f287427 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.088556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:19.096995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:19.203954 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c7ea570c-acd8-4d11-b9d6-f0ebd8a2c097 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.442078 Aug 27 05:12:19.212053 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1955/3908] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 05:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 05:12:19.289803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fef9134c-e2e8-40e9-8cdd-ecf14f287427 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:19.299255 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fef9134c-e2e8-40e9-8cdd-ecf14f287427 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1321 microversion: 2.1 time: 0.260858 Aug 27 05:12:19.301259 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1954/3909] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:19 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:19.306717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1da5c3f6-8ebd-4865-bdd3-f34e10d26031 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:19.307373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1da5c3f6-8ebd-4865-bdd3-f34e10d26031 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:19.334751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-913016715", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "76473937-2038-466b-84c2-4acb1818557e"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:19.404033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1da5c3f6-8ebd-4865-bdd3-f34e10d26031 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:19.412919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1da5c3f6-8ebd-4865-bdd3-f34e10d26031 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:19.415762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1da5c3f6-8ebd-4865-bdd3-f34e10d26031 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:19.417592 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1da5c3f6-8ebd-4865-bdd3-f34e10d26031 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1261 microversion: 2.26 time: 0.115352 Aug 27 05:12:19.419141 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1955/3910] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:19 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1261 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:19.456868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] validate_networks() for [('76473937-2038-466b-84c2-4acb1818557e', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:19.527522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f623df08-519c-4808-b83c-0138e591463b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:19.528145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f623df08-519c-4808-b83c-0138e591463b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:19.547300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f623df08-519c-4808-b83c-0138e591463b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.547888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f623df08-519c-4808-b83c-0138e591463b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.548347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f623df08-519c-4808-b83c-0138e591463b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.549751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f623df08-519c-4808-b83c-0138e591463b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.550218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f623df08-519c-4808-b83c-0138e591463b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.550650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f623df08-519c-4808-b83c-0138e591463b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.971286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f623df08-519c-4808-b83c-0138e591463b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:19.992376 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f623df08-519c-4808-b83c-0138e591463b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.468716 Aug 27 05:12:19.993130 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1956/3911] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:19 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:20.000482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24106856-72f5-41cf-b608-dcf965eafeb3 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:20.006048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-24106856-72f5-41cf-b608-dcf965eafeb3 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:20.031417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24106856-72f5-41cf-b608-dcf965eafeb3 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:20.031921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24106856-72f5-41cf-b608-dcf965eafeb3 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:20.032522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24106856-72f5-41cf-b608-dcf965eafeb3 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.033377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24106856-72f5-41cf-b608-dcf965eafeb3 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:20.033874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24106856-72f5-41cf-b608-dcf965eafeb3 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:20.034318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24106856-72f5-41cf-b608-dcf965eafeb3 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.439192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:20.439681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:20.440090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:20.440506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:20.440925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:20.459758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:20.460254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:20.460701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.461445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:20.461907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:20.462921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.488754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-24106856-72f5-41cf-b608-dcf965eafeb3 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:20.496753 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-24106856-72f5-41cf-b608-dcf965eafeb3 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.502356 Aug 27 05:12:20.497346 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1957/3912] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:19 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:20.511151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f37a2e40-bead-4193-b20e-fe9df6f61c7c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:20.513880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Getting quotas for project 05bb331ed3d141f9950c5fbe121f3e7f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:20.517084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f37a2e40-bead-4193-b20e-fe9df6f61c7c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:20.525818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Getting quotas for user 6438306d009f43f6a1aac4dc35b07ecf and project 05bb331ed3d141f9950c5fbe121f3e7f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:20.529213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f37a2e40-bead-4193-b20e-fe9df6f61c7c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:20.529833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f37a2e40-bead-4193-b20e-fe9df6f61c7c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:20.530143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f37a2e40-bead-4193-b20e-fe9df6f61c7c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.530864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f37a2e40-bead-4193-b20e-fe9df6f61c7c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:20.531353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f37a2e40-bead-4193-b20e-fe9df6f61c7c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:20.531786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f37a2e40-bead-4193-b20e-fe9df6f61c7c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.549065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:20.552109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:20.608502 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7ef5b789-0f73-4e80-8cf4-391d54adb936 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402557 Aug 27 05:12:20.609680 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1956/3913] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:12:20.649147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:20.650374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:20.692292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:20.700553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:20.700553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.700553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:20.700553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:20.700986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.869237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:20.893623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:20.896777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:20.899279 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-183afa1c-e404-469f-8731-0f8bbd06c564 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1313 microversion: 2.26 time: 0.288091 Aug 27 05:12:20.905179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f37a2e40-bead-4193-b20e-fe9df6f61c7c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:20.913972 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1957/3914] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:20 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:20.921071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68652038-f89e-4d2c-a36b-b147d923280b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:20.921914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68652038-f89e-4d2c-a36b-b147d923280b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:20.929724 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f37a2e40-bead-4193-b20e-fe9df6f61c7c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1321 microversion: 2.1 time: 0.428809 Aug 27 05:12:20.931422 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1958/3915] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:20 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:21.015277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68652038-f89e-4d2c-a36b-b147d923280b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:21.020890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e2f94fc-8bda-4ce0-b4b4-4fd9220da2d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:21.021450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e2f94fc-8bda-4ce0-b4b4-4fd9220da2d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:21.031164 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68652038-f89e-4d2c-a36b-b147d923280b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1224 microversion: 2.1 time: 0.114477 Aug 27 05:12:21.035017 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1958/3916] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:20 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1224 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:21.037347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f94fc-8bda-4ce0-b4b4-4fd9220da2d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.037850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f94fc-8bda-4ce0-b4b4-4fd9220da2d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.038296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f94fc-8bda-4ce0-b4b4-4fd9220da2d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.039015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f94fc-8bda-4ce0-b4b4-4fd9220da2d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.043868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f94fc-8bda-4ce0-b4b4-4fd9220da2d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.044311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f94fc-8bda-4ce0-b4b4-4fd9220da2d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.047259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3dccd441-f051-4f2f-892d-f433debe5311 req-969c7fa0-6220-457a-8203-148c714d4774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb0289f-a421-4664-bdd2-1133b9e99e56", "name": "network-vif-plugged", "status": "completed", "tag": "e245a126-f6fc-4e9e-b345-3109a61d051d"}, {"server_uuid": "871c1afd-5f3a-4cf5-93c2-01c274d2a4bb", "name": "network-vif-plugged", "status": "completed", "tag": "a39f49ec-9e04-46ba-b543-f745bd65b603"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:21.078378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3dccd441-f051-4f2f-892d-f433debe5311 req-969c7fa0-6220-457a-8203-148c714d4774 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.079553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3dccd441-f051-4f2f-892d-f433debe5311 req-969c7fa0-6220-457a-8203-148c714d4774 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.080135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3dccd441-f051-4f2f-892d-f433debe5311 req-969c7fa0-6220-457a-8203-148c714d4774 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.099455 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3dccd441-f051-4f2f-892d-f433debe5311 req-969c7fa0-6220-457a-8203-148c714d4774 service nova] Creating event network-vif-plugged:e245a126-f6fc-4e9e-b345-3109a61d051d for instance 5bb0289f-a421-4664-bdd2-1133b9e99e56 on n-h1-820368-35 Aug 27 05:12:21.099975 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3dccd441-f051-4f2f-892d-f433debe5311 req-969c7fa0-6220-457a-8203-148c714d4774 service nova] Creating event network-vif-plugged:a39f49ec-9e04-46ba-b543-f745bd65b603 for instance 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb on n-h2-820368-35 Aug 27 05:12:21.113668 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3dccd441-f051-4f2f-892d-f433debe5311 req-969c7fa0-6220-457a-8203-148c714d4774 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073522 Aug 27 05:12:21.115859 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1959/3917] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:21.253157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e2f94fc-8bda-4ce0-b4b4-4fd9220da2d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:21.261957 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e2f94fc-8bda-4ce0-b4b4-4fd9220da2d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.251275 Aug 27 05:12:21.274308 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1959/3918] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:21 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:21.526061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-475d8fd4-ade3-4a8c-bce1-45df1fbae0d2 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:21.526930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-475d8fd4-ade3-4a8c-bce1-45df1fbae0d2 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:21.550763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475d8fd4-ade3-4a8c-bce1-45df1fbae0d2 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.551896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475d8fd4-ade3-4a8c-bce1-45df1fbae0d2 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.552351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475d8fd4-ade3-4a8c-bce1-45df1fbae0d2 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.563744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475d8fd4-ade3-4a8c-bce1-45df1fbae0d2 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.564275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475d8fd4-ade3-4a8c-bce1-45df1fbae0d2 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.564724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-475d8fd4-ade3-4a8c-bce1-45df1fbae0d2 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.813209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-475d8fd4-ade3-4a8c-bce1-45df1fbae0d2 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:21.823943 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-475d8fd4-ade3-4a8c-bce1-45df1fbae0d2 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.307171 Aug 27 05:12:21.825664 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1960/3919] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:21 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:21.956605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-95517615-dfa4-4831-b772-12e08c5c2926 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:21.957880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-95517615-dfa4-4831-b772-12e08c5c2926 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:21.958192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:21.959175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:21.966481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.967341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.968371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.969632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.970443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.971296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.973144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95517615-dfa4-4831-b772-12e08c5c2926 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.973643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95517615-dfa4-4831-b772-12e08c5c2926 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.974081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95517615-dfa4-4831-b772-12e08c5c2926 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.974803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95517615-dfa4-4831-b772-12e08c5c2926 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.975288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95517615-dfa4-4831-b772-12e08c5c2926 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.975716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95517615-dfa4-4831-b772-12e08c5c2926 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.049463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:22.080171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:22.084315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:22.088649 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-42f81626-4b92-4e6b-8ea7-01af8fb1c5b5 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1319 microversion: 2.26 time: 0.134547 Aug 27 05:12:22.104610 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1961/3920] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:21 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:22.117864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6f3d6c9d-5746-4382-9ae1-e47988e28510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:22.121863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6f3d6c9d-5746-4382-9ae1-e47988e28510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:22.140797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3d6c9d-5746-4382-9ae1-e47988e28510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.147680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3d6c9d-5746-4382-9ae1-e47988e28510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.148285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3d6c9d-5746-4382-9ae1-e47988e28510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.149251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3d6c9d-5746-4382-9ae1-e47988e28510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.150418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3d6c9d-5746-4382-9ae1-e47988e28510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.151224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3d6c9d-5746-4382-9ae1-e47988e28510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.287844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6f3d6c9d-5746-4382-9ae1-e47988e28510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:22.298448 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6f3d6c9d-5746-4382-9ae1-e47988e28510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1228 microversion: 2.1 time: 0.192360 Aug 27 05:12:22.301614 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1962/3921] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:22 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1228 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:22.313302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-95517615-dfa4-4831-b772-12e08c5c2926 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:22.319733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f48e906a-9cfc-427a-aacf-392d38cef61d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:22.320518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f48e906a-9cfc-427a-aacf-392d38cef61d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:22.328323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f48e906a-9cfc-427a-aacf-392d38cef61d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.329234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f48e906a-9cfc-427a-aacf-392d38cef61d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.329906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f48e906a-9cfc-427a-aacf-392d38cef61d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.330417 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-95517615-dfa4-4831-b772-12e08c5c2926 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1321 microversion: 2.1 time: 0.374317 Aug 27 05:12:22.331394 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1960/3922] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:21 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:22.331675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f48e906a-9cfc-427a-aacf-392d38cef61d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.332340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f48e906a-9cfc-427a-aacf-392d38cef61d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.333038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f48e906a-9cfc-427a-aacf-392d38cef61d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.508010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f48e906a-9cfc-427a-aacf-392d38cef61d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:22.517852 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f48e906a-9cfc-427a-aacf-392d38cef61d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.213615 Aug 27 05:12:22.519171 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1963/3923] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:22 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:22.847917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7b5324aa-0eb9-4fa1-aa7a-8ec793498bfa tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:22.848991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7b5324aa-0eb9-4fa1-aa7a-8ec793498bfa tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:22.858804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b5324aa-0eb9-4fa1-aa7a-8ec793498bfa tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.860650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b5324aa-0eb9-4fa1-aa7a-8ec793498bfa tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.861574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b5324aa-0eb9-4fa1-aa7a-8ec793498bfa tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.863368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b5324aa-0eb9-4fa1-aa7a-8ec793498bfa tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.863701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b5324aa-0eb9-4fa1-aa7a-8ec793498bfa tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.864857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b5324aa-0eb9-4fa1-aa7a-8ec793498bfa tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.042406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7b5324aa-0eb9-4fa1-aa7a-8ec793498bfa tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:23.060318 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7b5324aa-0eb9-4fa1-aa7a-8ec793498bfa tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.217783 Aug 27 05:12:23.062003 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1961/3924] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:22 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:23.126582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:23.127787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:23.136152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.136651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.137107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.137828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.138289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.138720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.323577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0b46131-7900-4e78-9808-f62ea114de39 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:23.324735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c0b46131-7900-4e78-9808-f62ea114de39 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:23.342393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0b46131-7900-4e78-9808-f62ea114de39 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.345958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0b46131-7900-4e78-9808-f62ea114de39 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.346756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0b46131-7900-4e78-9808-f62ea114de39 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.348554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0b46131-7900-4e78-9808-f62ea114de39 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.351777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0b46131-7900-4e78-9808-f62ea114de39 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.352567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0b46131-7900-4e78-9808-f62ea114de39 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.380830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:23.392730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:23.394395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:23.397044 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2da984b3-f6c2-4fb6-aaae-967c2c636262 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.276902 Aug 27 05:12:23.397868 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1964/3925] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:23 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:23.420301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-37de67ce-f191-4630-b691-082f1fd3be23 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:23.422911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-37de67ce-f191-4630-b691-082f1fd3be23 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:23.432017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37de67ce-f191-4630-b691-082f1fd3be23 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.436563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37de67ce-f191-4630-b691-082f1fd3be23 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.437392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37de67ce-f191-4630-b691-082f1fd3be23 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.438741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37de67ce-f191-4630-b691-082f1fd3be23 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.439577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37de67ce-f191-4630-b691-082f1fd3be23 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.440372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37de67ce-f191-4630-b691-082f1fd3be23 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.446361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:23.492421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c0b46131-7900-4e78-9808-f62ea114de39 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:23.504158 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c0b46131-7900-4e78-9808-f62ea114de39 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1228 microversion: 2.1 time: 0.186084 Aug 27 05:12:23.510012 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1962/3926] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:23 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1228 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:23.541765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0860eb8a-4a53-40e2-ae6f-0122c3137e66 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:23.542681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0860eb8a-4a53-40e2-ae6f-0122c3137e66 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:23.556260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0860eb8a-4a53-40e2-ae6f-0122c3137e66 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.560310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0860eb8a-4a53-40e2-ae6f-0122c3137e66 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.560974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0860eb8a-4a53-40e2-ae6f-0122c3137e66 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.562075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0860eb8a-4a53-40e2-ae6f-0122c3137e66 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.562727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0860eb8a-4a53-40e2-ae6f-0122c3137e66 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.567113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0860eb8a-4a53-40e2-ae6f-0122c3137e66 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.571360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:23.663753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-37de67ce-f191-4630-b691-082f1fd3be23 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:23.681063 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-37de67ce-f191-4630-b691-082f1fd3be23 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1321 microversion: 2.1 time: 0.281867 Aug 27 05:12:23.681775 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1965/3927] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:23 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:23.951507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0860eb8a-4a53-40e2-ae6f-0122c3137e66 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:23.971779 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0860eb8a-4a53-40e2-ae6f-0122c3137e66 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1293 microversion: 2.1 time: 0.434063 Aug 27 05:12:23.972925 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1963/3928] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:23 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1293 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:24.083834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d2ee1a26-e711-44c6-bc1d-cd2a7134651a tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:24.084631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d2ee1a26-e711-44c6-bc1d-cd2a7134651a tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:24.092384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2ee1a26-e711-44c6-bc1d-cd2a7134651a tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.092759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2ee1a26-e711-44c6-bc1d-cd2a7134651a tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.100585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2ee1a26-e711-44c6-bc1d-cd2a7134651a tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.102208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2ee1a26-e711-44c6-bc1d-cd2a7134651a tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.103520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2ee1a26-e711-44c6-bc1d-cd2a7134651a tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.105864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2ee1a26-e711-44c6-bc1d-cd2a7134651a tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.336400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-4d1c55b0-ff25-4e5f-b0fb-ac9876e21851 req-ea75cfda-9fa7-4c83-bc3d-12a1127ad9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47d1403-a080-46a6-afcb-fb0aaf21616a", "name": "network-vif-plugged", "status": "completed", "tag": "5e7060fe-bfe9-42bd-b0d4-3a21859a112b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:24.356928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4d1c55b0-ff25-4e5f-b0fb-ac9876e21851 req-ea75cfda-9fa7-4c83-bc3d-12a1127ad9a8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.357931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4d1c55b0-ff25-4e5f-b0fb-ac9876e21851 req-ea75cfda-9fa7-4c83-bc3d-12a1127ad9a8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.358571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4d1c55b0-ff25-4e5f-b0fb-ac9876e21851 req-ea75cfda-9fa7-4c83-bc3d-12a1127ad9a8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.374857 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-4d1c55b0-ff25-4e5f-b0fb-ac9876e21851 req-ea75cfda-9fa7-4c83-bc3d-12a1127ad9a8 service nova] Creating event network-vif-plugged:5e7060fe-bfe9-42bd-b0d4-3a21859a112b for instance d47d1403-a080-46a6-afcb-fb0aaf21616a on n-h2-820368-35 Aug 27 05:12:24.381745 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-4d1c55b0-ff25-4e5f-b0fb-ac9876e21851 req-ea75cfda-9fa7-4c83-bc3d-12a1127ad9a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052264 Aug 27 05:12:24.382642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d2ee1a26-e711-44c6-bc1d-cd2a7134651a tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:24.383166 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1964/3929] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:24.398324 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d2ee1a26-e711-44c6-bc1d-cd2a7134651a tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.320123 Aug 27 05:12:24.401353 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1966/3930] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:24 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:24.425323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:24.427861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:24.447066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.447670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.449166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.452220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.452894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.453461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.530985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-28b22769-aff4-4e82-a049-727060fd55d7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:24.532931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-28b22769-aff4-4e82-a049-727060fd55d7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:24.542229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28b22769-aff4-4e82-a049-727060fd55d7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.543515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28b22769-aff4-4e82-a049-727060fd55d7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.544277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28b22769-aff4-4e82-a049-727060fd55d7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.545255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28b22769-aff4-4e82-a049-727060fd55d7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.545965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28b22769-aff4-4e82-a049-727060fd55d7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.546505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28b22769-aff4-4e82-a049-727060fd55d7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.650171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-28b22769-aff4-4e82-a049-727060fd55d7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:24.664471 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-28b22769-aff4-4e82-a049-727060fd55d7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1276 microversion: 2.1 time: 0.135723 Aug 27 05:12:24.666493 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1967/3931] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:24 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:24.705571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b1a459b-3536-4fa3-af50-ebafa055a137 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:24.706202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9b1a459b-3536-4fa3-af50-ebafa055a137 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:24.717778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a459b-3536-4fa3-af50-ebafa055a137 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.719408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a459b-3536-4fa3-af50-ebafa055a137 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.720285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a459b-3536-4fa3-af50-ebafa055a137 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.723277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a459b-3536-4fa3-af50-ebafa055a137 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.724143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a459b-3536-4fa3-af50-ebafa055a137 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.726154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1a459b-3536-4fa3-af50-ebafa055a137 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.738881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:24.753435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:24.756073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:24.758431 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5978c90a-4287-4976-9818-ddd707522e4a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.339520 Aug 27 05:12:24.776186 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1965/3932] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:24 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:24.837866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c92db7ed-0b78-4f95-b3e5-4f15aaf97b19 req-0e01f8b0-8035-4c5a-8e7a-0be34a267f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "263a0733-49e6-42cf-ad6c-23d43ae09b0b", "tag": "2416198c-9325-4324-8e19-dea4c0714282"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:24.849350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c92db7ed-0b78-4f95-b3e5-4f15aaf97b19 req-0e01f8b0-8035-4c5a-8e7a-0be34a267f6f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.849918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c92db7ed-0b78-4f95-b3e5-4f15aaf97b19 req-0e01f8b0-8035-4c5a-8e7a-0be34a267f6f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.850362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c92db7ed-0b78-4f95-b3e5-4f15aaf97b19 req-0e01f8b0-8035-4c5a-8e7a-0be34a267f6f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.873053 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c92db7ed-0b78-4f95-b3e5-4f15aaf97b19 req-0e01f8b0-8035-4c5a-8e7a-0be34a267f6f service nova] Creating event network-changed:2416198c-9325-4324-8e19-dea4c0714282 for instance 263a0733-49e6-42cf-ad6c-23d43ae09b0b on n-h2-820368-35 Aug 27 05:12:24.881537 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c92db7ed-0b78-4f95-b3e5-4f15aaf97b19 req-0e01f8b0-8035-4c5a-8e7a-0be34a267f6f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049243 Aug 27 05:12:24.885372 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1966/3933] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:24.904256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9b1a459b-3536-4fa3-af50-ebafa055a137 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:24.912570 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9b1a459b-3536-4fa3-af50-ebafa055a137 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1321 microversion: 2.1 time: 0.210899 Aug 27 05:12:24.913189 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1968/3934] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:24 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:24.992937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-38ddf6d1-4e1c-4794-9761-546ed42a1917 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:24.994032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-38ddf6d1-4e1c-4794-9761-546ed42a1917 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:25.001341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38ddf6d1-4e1c-4794-9761-546ed42a1917 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.001715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38ddf6d1-4e1c-4794-9761-546ed42a1917 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.002450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38ddf6d1-4e1c-4794-9761-546ed42a1917 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.003441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38ddf6d1-4e1c-4794-9761-546ed42a1917 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.004356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38ddf6d1-4e1c-4794-9761-546ed42a1917 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.004978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38ddf6d1-4e1c-4794-9761-546ed42a1917 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.182667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-38ddf6d1-4e1c-4794-9761-546ed42a1917 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:25.199743 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-38ddf6d1-4e1c-4794-9761-546ed42a1917 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1475 microversion: 2.1 time: 0.210927 Aug 27 05:12:25.200374 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1967/3935] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:24 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1475 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:25.318533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-721956337", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:25.375308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] validate_networks() for [('43620fdb-3b93-439f-955c-01e22d65d95a', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:25.422108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89edf498-ad9f-4524-9548-0bb510fd8fc1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:25.422780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89edf498-ad9f-4524-9548-0bb510fd8fc1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:25.434683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89edf498-ad9f-4524-9548-0bb510fd8fc1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.435482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89edf498-ad9f-4524-9548-0bb510fd8fc1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.435938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89edf498-ad9f-4524-9548-0bb510fd8fc1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.436833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89edf498-ad9f-4524-9548-0bb510fd8fc1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.437298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89edf498-ad9f-4524-9548-0bb510fd8fc1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.438148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89edf498-ad9f-4524-9548-0bb510fd8fc1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.657041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89edf498-ad9f-4524-9548-0bb510fd8fc1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:25.666362 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89edf498-ad9f-4524-9548-0bb510fd8fc1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1394 microversion: 2.1 time: 0.248268 Aug 27 05:12:25.667200 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1968/3936] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:25 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1394 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:25.688323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e4acfc8c-64ca-41bb-949c-c533b09839ac tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:25.689119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e4acfc8c-64ca-41bb-949c-c533b09839ac tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:25.696049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4acfc8c-64ca-41bb-949c-c533b09839ac tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.697562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4acfc8c-64ca-41bb-949c-c533b09839ac tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.698696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4acfc8c-64ca-41bb-949c-c533b09839ac tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.700430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4acfc8c-64ca-41bb-949c-c533b09839ac tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.701092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4acfc8c-64ca-41bb-949c-c533b09839ac tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.701682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4acfc8c-64ca-41bb-949c-c533b09839ac tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.777874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e4acfc8c-64ca-41bb-949c-c533b09839ac tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:25.787565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e4acfc8c-64ca-41bb-949c-c533b09839ac tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1276 microversion: 2.1 time: 0.103656 Aug 27 05:12:25.788454 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1969/3937] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:25 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:25.794256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:25.795306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:25.802879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.803882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.804186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.805274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.806372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.806881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.959398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:25.959950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:25.960306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:25.960723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:25.961323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:25.979117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.979615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.984433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.985339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.986088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.986593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.996682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:26.011230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:26.012977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:26.014954 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-afbc9375-8313-443b-8b74-ffbd013540b1 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.224602 Aug 27 05:12:26.016188 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1970/3938] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:25 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:26.021082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f077c8b-8f86-4247-905c-764b96a9bca2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:26.021309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:26.021995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f077c8b-8f86-4247-905c-764b96a9bca2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:26.027256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for user c75dd4d6f001450bb9279d592e9783bd and project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:26.028932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f077c8b-8f86-4247-905c-764b96a9bca2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:26.029488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f077c8b-8f86-4247-905c-764b96a9bca2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:26.030821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f077c8b-8f86-4247-905c-764b96a9bca2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:26.030821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f077c8b-8f86-4247-905c-764b96a9bca2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:26.031418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f077c8b-8f86-4247-905c-764b96a9bca2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:26.032110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f077c8b-8f86-4247-905c-764b96a9bca2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:26.046042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:26.053822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 764f0c62-714d-48a3-a991-66abbebdfeb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:26.118509 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-174ba102-26d7-48e6-aa73-527a0b754094 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804110 Aug 27 05:12:26.123242 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1969/3939] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:12:26.132491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-477dfad6-033d-4fbc-b599-992a591c399c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:26.133049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-477dfad6-033d-4fbc-b599-992a591c399c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 764f0c62-714d-48a3-a991-66abbebdfeb6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:26.158399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-477dfad6-033d-4fbc-b599-992a591c399c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 764f0c62-714d-48a3-a991-66abbebdfeb6] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:12:26.219614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f077c8b-8f86-4247-905c-764b96a9bca2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:26.230685 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f077c8b-8f86-4247-905c-764b96a9bca2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1321 microversion: 2.1 time: 0.213303 Aug 27 05:12:26.231943 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1971/3940] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:26 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:26.409839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-942985c7-8ef2-4d4c-88d5-bfd97a331247 req-85a687d0-048c-4a87-8617-97ae3a116f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414cf2c1-b160-43bf-9a21-3185fa2fd06b", "name": "network-vif-plugged", "status": "completed", "tag": "dc2c77da-3bf2-4cc3-a09c-5796e57080fe"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:26.433057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-942985c7-8ef2-4d4c-88d5-bfd97a331247 req-85a687d0-048c-4a87-8617-97ae3a116f78 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:26.433624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-942985c7-8ef2-4d4c-88d5-bfd97a331247 req-85a687d0-048c-4a87-8617-97ae3a116f78 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:26.434171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-942985c7-8ef2-4d4c-88d5-bfd97a331247 req-85a687d0-048c-4a87-8617-97ae3a116f78 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:26.461066 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-942985c7-8ef2-4d4c-88d5-bfd97a331247 req-85a687d0-048c-4a87-8617-97ae3a116f78 service nova] Creating event network-vif-plugged:dc2c77da-3bf2-4cc3-a09c-5796e57080fe for instance 414cf2c1-b160-43bf-9a21-3185fa2fd06b on n-h1-820368-35 Aug 27 05:12:26.490044 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-942985c7-8ef2-4d4c-88d5-bfd97a331247 req-85a687d0-048c-4a87-8617-97ae3a116f78 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075223 Aug 27 05:12:26.492101 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1972/3941] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:26.593597 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-477dfad6-033d-4fbc-b599-992a591c399c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/764f0c62-714d-48a3-a991-66abbebdfeb6" status: 204 len: 0 microversion: 2.1 time: 0.465033 Aug 27 05:12:26.596110 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1970/3942] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:12:26 2022] DELETE /compute/v2.1/servers/764f0c62-714d-48a3-a991-66abbebdfeb6 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:12:26.607908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f2f1c36-6a6b-484f-8972-6ba97d5479dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:26.608744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3f2f1c36-6a6b-484f-8972-6ba97d5479dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 764f0c62-714d-48a3-a991-66abbebdfeb6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:26.654438 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3f2f1c36-6a6b-484f-8972-6ba97d5479dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f2f1c36-6a6b-484f-8972-6ba97d5479dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/764f0c62-714d-48a3-a991-66abbebdfeb6 HTTP/1.1 Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '764f0c62-714d-48a3-a991-66abbebdfeb6'} Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 764f0c62-714d-48a3-a991-66abbebdfeb6 Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:26.664712 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f2f1c36-6a6b-484f-8972-6ba97d5479dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3f2f1c36-6a6b-484f-8972-6ba97d5479dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/764f0c62-714d-48a3-a991-66abbebdfeb6" status: 404 len: 111 microversion: 2.1 time: 0.065480 Aug 27 05:12:26.681574 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1973/3943] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:26 2022] GET /compute/v2.1/servers/764f0c62-714d-48a3-a991-66abbebdfeb6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:12:26.690398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e7a9c284-ade4-4cff-be93-1e5bb1bfb195 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:26.691185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e7a9c284-ade4-4cff-be93-1e5bb1bfb195 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:26.717769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7a9c284-ade4-4cff-be93-1e5bb1bfb195 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:26.719415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7a9c284-ade4-4cff-be93-1e5bb1bfb195 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:26.721862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7a9c284-ade4-4cff-be93-1e5bb1bfb195 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:26.722880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7a9c284-ade4-4cff-be93-1e5bb1bfb195 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:26.723589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7a9c284-ade4-4cff-be93-1e5bb1bfb195 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:26.725062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7a9c284-ade4-4cff-be93-1e5bb1bfb195 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:26.770322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1784555209", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "43620fdb-3b93-439f-955c-01e22d65d95a"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:26.862463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] validate_networks() for [('43620fdb-3b93-439f-955c-01e22d65d95a', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:27.011774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e7a9c284-ade4-4cff-be93-1e5bb1bfb195 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:27.022561 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e7a9c284-ade4-4cff-be93-1e5bb1bfb195 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1574 microversion: 2.1 time: 0.337773 Aug 27 05:12:27.023417 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1971/3944] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:26 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1574 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:27.044528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-60b3a387-e948-4f33-8852-7cb09a51ffaa tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:27.045368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-60b3a387-e948-4f33-8852-7cb09a51ffaa tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:27.051575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3a387-e948-4f33-8852-7cb09a51ffaa tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.052314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3a387-e948-4f33-8852-7cb09a51ffaa tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.053746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3a387-e948-4f33-8852-7cb09a51ffaa tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.054479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3a387-e948-4f33-8852-7cb09a51ffaa tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.054935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3a387-e948-4f33-8852-7cb09a51ffaa tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.055391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60b3a387-e948-4f33-8852-7cb09a51ffaa tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.147919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-60b3a387-e948-4f33-8852-7cb09a51ffaa tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:27.157242 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-60b3a387-e948-4f33-8852-7cb09a51ffaa tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1282 microversion: 2.1 time: 0.116878 Aug 27 05:12:27.158085 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1972/3945] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:27 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:27.163498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:27.164410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:27.171911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.172863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.173458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.174170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.174623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.175047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.399587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:27.412104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:27.414244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:27.416812 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8a2f94f0-047b-4e6c-9573-fcc3f8700bd3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.257569 Aug 27 05:12:27.423904 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1973/3946] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:27 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:27.430379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-086a9caf-6c1a-40f3-b1ec-e9b09481cba0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:27.432146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-086a9caf-6c1a-40f3-b1ec-e9b09481cba0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:27.440240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-086a9caf-6c1a-40f3-b1ec-e9b09481cba0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.440950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-086a9caf-6c1a-40f3-b1ec-e9b09481cba0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.441495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-086a9caf-6c1a-40f3-b1ec-e9b09481cba0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.442808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-086a9caf-6c1a-40f3-b1ec-e9b09481cba0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.443403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-086a9caf-6c1a-40f3-b1ec-e9b09481cba0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.443932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-086a9caf-6c1a-40f3-b1ec-e9b09481cba0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.457564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:27.458549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:27.459223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:27.459641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:27.460246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:27.472932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.473522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.474101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.474952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.475406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.476130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.497780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:27.503928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for user c75dd4d6f001450bb9279d592e9783bd and project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:27.518775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:27.521582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:27.544773 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-086a9caf-6c1a-40f3-b1ec-e9b09481cba0 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118400 Aug 27 05:12:27.545754 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1974/3947] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:12:27 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:27.550612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a9d853d6-ab3b-4f2f-b8b5-c54063b22ffd tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:27.551463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a9d853d6-ab3b-4f2f-b8b5-c54063b22ffd tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:27.558870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9d853d6-ab3b-4f2f-b8b5-c54063b22ffd tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.559540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9d853d6-ab3b-4f2f-b8b5-c54063b22ffd tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.560117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9d853d6-ab3b-4f2f-b8b5-c54063b22ffd tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.560762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9d853d6-ab3b-4f2f-b8b5-c54063b22ffd tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.561229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9d853d6-ab3b-4f2f-b8b5-c54063b22ffd tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.561680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9d853d6-ab3b-4f2f-b8b5-c54063b22ffd tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.591771 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f158263a-6b67-47fd-a30b-a07d15076051 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821038 Aug 27 05:12:27.594676 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1974/3948] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:12:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:12:27.606379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1caf3048-db03-43f2-a9f6-6533d82ca476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:27.607131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1caf3048-db03-43f2-a9f6-6533d82ca476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:28.079691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1caf3048-db03-43f2-a9f6-6533d82ca476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:28.109858 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1caf3048-db03-43f2-a9f6-6533d82ca476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1221 microversion: 2.1 time: 0.508063 Aug 27 05:12:28.112371 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1975/3949] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:27 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1221 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:28.182338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dde7c534-6d20-45bc-be9c-20893a545ee8 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:28.182978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dde7c534-6d20-45bc-be9c-20893a545ee8 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:28.189881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a9d853d6-ab3b-4f2f-b8b5-c54063b22ffd tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:28.192754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dde7c534-6d20-45bc-be9c-20893a545ee8 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:28.194334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dde7c534-6d20-45bc-be9c-20893a545ee8 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:28.195881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dde7c534-6d20-45bc-be9c-20893a545ee8 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:28.198355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dde7c534-6d20-45bc-be9c-20893a545ee8 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:28.198913 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a9d853d6-ab3b-4f2f-b8b5-c54063b22ffd tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1321 microversion: 2.1 time: 0.652001 Aug 27 05:12:28.199376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dde7c534-6d20-45bc-be9c-20893a545ee8 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:28.200038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dde7c534-6d20-45bc-be9c-20893a545ee8 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:28.211760 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1975/3950] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:27 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1321 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:28.441063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:28.443167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:28.452129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:28.453167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:28.453804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:28.455426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:28.456107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:28.456735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:28.505441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dde7c534-6d20-45bc-be9c-20893a545ee8 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:28.514511 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dde7c534-6d20-45bc-be9c-20893a545ee8 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1324 microversion: 2.1 time: 0.336565 Aug 27 05:12:28.515207 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1976/3951] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:28 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1324 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:28.732642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:28.741934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:28.744071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:28.745523 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8ecfb0b-9241-470d-a137-19a7867cf437 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.310162 Aug 27 05:12:28.746262 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1976/3952] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:28 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:12:29.139164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-295d6705-c696-4cf6-90ad-405207c46a69 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:29.140028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-295d6705-c696-4cf6-90ad-405207c46a69 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:29.149122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-295d6705-c696-4cf6-90ad-405207c46a69 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.150140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-295d6705-c696-4cf6-90ad-405207c46a69 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.150612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-295d6705-c696-4cf6-90ad-405207c46a69 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.151394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-295d6705-c696-4cf6-90ad-405207c46a69 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.151854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-295d6705-c696-4cf6-90ad-405207c46a69 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.152281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-295d6705-c696-4cf6-90ad-405207c46a69 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.219963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0cad2773-3673-4259-aeeb-44988beccf85 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:29.220957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0cad2773-3673-4259-aeeb-44988beccf85 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:29.228622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cad2773-3673-4259-aeeb-44988beccf85 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.229213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cad2773-3673-4259-aeeb-44988beccf85 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.229781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cad2773-3673-4259-aeeb-44988beccf85 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.230730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cad2773-3673-4259-aeeb-44988beccf85 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.231428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cad2773-3673-4259-aeeb-44988beccf85 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.231957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cad2773-3673-4259-aeeb-44988beccf85 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.243329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-295d6705-c696-4cf6-90ad-405207c46a69 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:29.284562 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-295d6705-c696-4cf6-90ad-405207c46a69 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1225 microversion: 2.1 time: 0.154681 Aug 27 05:12:29.288002 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1977/3953] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:29 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1225 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:29.317106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-06171e84-41cd-471a-8224-fd8267174621 req-f36d522a-b0a4-418a-855f-3f47930a37b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c39d751-b91a-4901-b8fe-f0d280024110", "tag": "2be9f11f-25a4-4df1-a652-708e2819755c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:29.328495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-06171e84-41cd-471a-8224-fd8267174621 req-f36d522a-b0a4-418a-855f-3f47930a37b2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.329158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-06171e84-41cd-471a-8224-fd8267174621 req-f36d522a-b0a4-418a-855f-3f47930a37b2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.329707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-06171e84-41cd-471a-8224-fd8267174621 req-f36d522a-b0a4-418a-855f-3f47930a37b2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.346471 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-06171e84-41cd-471a-8224-fd8267174621 req-f36d522a-b0a4-418a-855f-3f47930a37b2 service nova] Creating event network-changed:2be9f11f-25a4-4df1-a652-708e2819755c for instance 6c39d751-b91a-4901-b8fe-f0d280024110 on n-h1-820368-35 Aug 27 05:12:29.355764 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-06171e84-41cd-471a-8224-fd8267174621 req-f36d522a-b0a4-418a-855f-3f47930a37b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042342 Aug 27 05:12:29.357299 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1978/3954] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:29.381784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e19a6a9e-9e48-477e-9744-6f84487e5a41 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:29.382512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e19a6a9e-9e48-477e-9744-6f84487e5a41 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:29.389979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e19a6a9e-9e48-477e-9744-6f84487e5a41 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.390719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e19a6a9e-9e48-477e-9744-6f84487e5a41 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.391414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e19a6a9e-9e48-477e-9744-6f84487e5a41 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.392157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e19a6a9e-9e48-477e-9744-6f84487e5a41 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.392628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e19a6a9e-9e48-477e-9744-6f84487e5a41 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.393067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e19a6a9e-9e48-477e-9744-6f84487e5a41 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.519890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0cad2773-3673-4259-aeeb-44988beccf85 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:29.529047 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0cad2773-3673-4259-aeeb-44988beccf85 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1512 microversion: 2.1 time: 0.313221 Aug 27 05:12:29.540406 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1977/3955] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:29 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:29.551640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4e45f740-daf9-49d8-8948-8d5e2876cb7e req-625ae5f0-9f1e-4e5b-9497-ed52a2a01b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47d1403-a080-46a6-afcb-fb0aaf21616a", "tag": "5e7060fe-bfe9-42bd-b0d4-3a21859a112b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:29.563467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4e45f740-daf9-49d8-8948-8d5e2876cb7e req-625ae5f0-9f1e-4e5b-9497-ed52a2a01b30 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.564017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4e45f740-daf9-49d8-8948-8d5e2876cb7e req-625ae5f0-9f1e-4e5b-9497-ed52a2a01b30 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.564372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4e45f740-daf9-49d8-8948-8d5e2876cb7e req-625ae5f0-9f1e-4e5b-9497-ed52a2a01b30 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.583813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e19a6a9e-9e48-477e-9744-6f84487e5a41 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:29.584313 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4e45f740-daf9-49d8-8948-8d5e2876cb7e req-625ae5f0-9f1e-4e5b-9497-ed52a2a01b30 service nova] Creating event network-changed:5e7060fe-bfe9-42bd-b0d4-3a21859a112b for instance d47d1403-a080-46a6-afcb-fb0aaf21616a on n-h2-820368-35 Aug 27 05:12:29.590320 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4e45f740-daf9-49d8-8948-8d5e2876cb7e req-625ae5f0-9f1e-4e5b-9497-ed52a2a01b30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048294 Aug 27 05:12:29.590948 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1978/3956] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:29.594960 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e19a6a9e-9e48-477e-9744-6f84487e5a41 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1574 microversion: 2.1 time: 0.218517 Aug 27 05:12:29.607127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d50fcf4-d650-4836-9fcd-4c5da99fe20d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:29.607127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7d50fcf4-d650-4836-9fcd-4c5da99fe20d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:29.608581 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1979/3957] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:29 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1574 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:29.611979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d50fcf4-d650-4836-9fcd-4c5da99fe20d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.613061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d50fcf4-d650-4836-9fcd-4c5da99fe20d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.613748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d50fcf4-d650-4836-9fcd-4c5da99fe20d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.614653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d50fcf4-d650-4836-9fcd-4c5da99fe20d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.615303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d50fcf4-d650-4836-9fcd-4c5da99fe20d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.615894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d50fcf4-d650-4836-9fcd-4c5da99fe20d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.628309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-397a6a34-3c8d-401e-97f6-3d7d78c710f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:29.631658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-397a6a34-3c8d-401e-97f6-3d7d78c710f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:29.643038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-397a6a34-3c8d-401e-97f6-3d7d78c710f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.643979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-397a6a34-3c8d-401e-97f6-3d7d78c710f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.644589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-397a6a34-3c8d-401e-97f6-3d7d78c710f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.645507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-397a6a34-3c8d-401e-97f6-3d7d78c710f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.645974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-397a6a34-3c8d-401e-97f6-3d7d78c710f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.646413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-397a6a34-3c8d-401e-97f6-3d7d78c710f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.853093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7d50fcf4-d650-4836-9fcd-4c5da99fe20d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:29.856078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-397a6a34-3c8d-401e-97f6-3d7d78c710f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:29.861265 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7d50fcf4-d650-4836-9fcd-4c5da99fe20d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1324 microversion: 2.1 time: 0.269050 Aug 27 05:12:29.862123 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1979/3958] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:29 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1324 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:29.869433 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-397a6a34-3c8d-401e-97f6-3d7d78c710f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1512 microversion: 2.1 time: 0.259484 Aug 27 05:12:29.870245 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1980/3959] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:29 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:29.885471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:29.885471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:29.885471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.885471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.886122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.886581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.887284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.888372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.893991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-12b45285-4148-4f91-b627-e44f08886a69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:29.894925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-12b45285-4148-4f91-b627-e44f08886a69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 5bb0289f-a421-4664-bdd2-1133b9e99e56] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:29.902767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b45285-4148-4f91-b627-e44f08886a69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.903541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b45285-4148-4f91-b627-e44f08886a69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.904105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b45285-4148-4f91-b627-e44f08886a69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.904828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b45285-4148-4f91-b627-e44f08886a69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.905292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b45285-4148-4f91-b627-e44f08886a69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.905789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b45285-4148-4f91-b627-e44f08886a69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.126767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:30.137245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:30.139380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:30.141545 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c4fb9e03-41f8-4f2a-931c-b3c8ca032a52 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.278279 Aug 27 05:12:30.143804 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1980/3960] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:29 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:30.188143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-12b45285-4148-4f91-b627-e44f08886a69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:30.201242 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-12b45285-4148-4f91-b627-e44f08886a69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56" status: 200 len: 1511 microversion: 2.1 time: 0.311117 Aug 27 05:12:30.213370 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1981/3961] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:29 2022] GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56 => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:30.240913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:30.247411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:30.248690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:12:30.256775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:30.265606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.266242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.266791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.267718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.268288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.268825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.310335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-58aabca1-a3c8-4759-9642-4598accdc91a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:30.311591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-58aabca1-a3c8-4759-9642-4598accdc91a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:30.320791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58aabca1-a3c8-4759-9642-4598accdc91a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.321793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58aabca1-a3c8-4759-9642-4598accdc91a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.322612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58aabca1-a3c8-4759-9642-4598accdc91a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.323643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58aabca1-a3c8-4759-9642-4598accdc91a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.324268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58aabca1-a3c8-4759-9642-4598accdc91a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.324927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58aabca1-a3c8-4759-9642-4598accdc91a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.408179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:12:30.430033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-58aabca1-a3c8-4759-9642-4598accdc91a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:30.440377 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-58aabca1-a3c8-4759-9642-4598accdc91a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1273 microversion: 2.1 time: 0.135443 Aug 27 05:12:30.443335 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1982/3962] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:30 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:30.497388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:30.503864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.504529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.505028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.626051 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2e261e0-62b1-4d60-882d-6640934620d0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.389814 Aug 27 05:12:30.626639 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1981/3963] 10.222.0.58 () {58 vars in 1167 bytes} [Sat Aug 27 05:12:30 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:30.649191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:30.655494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:30.656458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1542946860', 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:12:30.662895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.663415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.663856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.664587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.665659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.666092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.765399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:12:30.860637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:30.874466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.875510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.876354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.883530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2138755b-587d-43cf-86d9-b50e06184a44 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:30.885402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2138755b-587d-43cf-86d9-b50e06184a44 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:30.899399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2138755b-587d-43cf-86d9-b50e06184a44 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.901142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2138755b-587d-43cf-86d9-b50e06184a44 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.902101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2138755b-587d-43cf-86d9-b50e06184a44 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.903032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2138755b-587d-43cf-86d9-b50e06184a44 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.905172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2138755b-587d-43cf-86d9-b50e06184a44 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.906046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2138755b-587d-43cf-86d9-b50e06184a44 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.121366 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10e06ec3-302c-46ef-8ef2-9af6a7c7bfdb tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1542946860" status: 200 len: 1515 microversion: 2.1 time: 0.476161 Aug 27 05:12:31.124741 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1983/3964] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:12:30 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1542946860 => generated 1515 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:31.144707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2138755b-587d-43cf-86d9-b50e06184a44 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:31.148223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:31.153066 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2138755b-587d-43cf-86d9-b50e06184a44 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1324 microversion: 2.1 time: 0.274309 Aug 27 05:12:31.153666 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1982/3965] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:30 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:31.153939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:31.154770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:12:31.156960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:31.162024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.162506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.162941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.163700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.164153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.164587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.179680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:31.180456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:31.187508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.188472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.188734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.189585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.190168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.190694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.264472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:31.272505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:12:31.351932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:31.353761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:31.362655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:31.365275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:31.366861 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b080d95-9c99-4296-b15b-dcc8522b1f8c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.192232 Aug 27 05:12:31.367717 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1983/3966] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:31 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:12:31.468888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f2967160-38df-401e-9d4a-c8ebc91dd193 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:31.470443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f2967160-38df-401e-9d4a-c8ebc91dd193 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:31.483808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2967160-38df-401e-9d4a-c8ebc91dd193 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.484961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2967160-38df-401e-9d4a-c8ebc91dd193 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.485917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2967160-38df-401e-9d4a-c8ebc91dd193 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.487434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2967160-38df-401e-9d4a-c8ebc91dd193 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.488443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2967160-38df-401e-9d4a-c8ebc91dd193 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.489434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2967160-38df-401e-9d4a-c8ebc91dd193 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.575001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f2967160-38df-401e-9d4a-c8ebc91dd193 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:31.587122 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f2967160-38df-401e-9d4a-c8ebc91dd193 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1279 microversion: 2.1 time: 0.125033 Aug 27 05:12:31.588151 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1984/3967] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:31 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1279 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:31.599261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:31.607018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.607535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.607969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.772319 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-39201c42-ab3d-4af2-8415-63da2532c5c5 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.629005 Aug 27 05:12:31.772966 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1984/3968] 10.222.0.58 () {58 vars in 1173 bytes} [Sat Aug 27 05:12:31 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:31.807756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:31.813669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:31.814525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.compute.servers [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Removing options 'limit' from query {{(pid=128547) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1510}} Aug 27 05:12:31.815638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:12:31.828009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.830510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.830912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.831825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.832524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.833026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.878829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:31.886695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.887589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.888191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.018452 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ef53a632-f282-4555-905d-1a4bb7ba5e8d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.219558 Aug 27 05:12:32.019514 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1985/3969] 10.222.0.58 () {58 vars in 1161 bytes} [Sat Aug 27 05:12:31 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:32.042006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-47d8a389-7782-49f8-aad8-03be8c365a5c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.047331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-47d8a389-7782-49f8-aad8-03be8c365a5c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.048062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-47d8a389-7782-49f8-aad8-03be8c365a5c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:12:32.053482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47d8a389-7782-49f8-aad8-03be8c365a5c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.053979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47d8a389-7782-49f8-aad8-03be8c365a5c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.054413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47d8a389-7782-49f8-aad8-03be8c365a5c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.055165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47d8a389-7782-49f8-aad8-03be8c365a5c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.056162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47d8a389-7782-49f8-aad8-03be8c365a5c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.056592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47d8a389-7782-49f8-aad8-03be8c365a5c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.087322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-47d8a389-7782-49f8-aad8-03be8c365a5c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:12:32.116532 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-47d8a389-7782-49f8-aad8-03be8c365a5c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.078595 Aug 27 05:12:32.117452 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1985/3970] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:32.131368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.136997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.137757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.compute.servers [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Removing options 'limit' from query {{(pid=128547) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1510}} Aug 27 05:12:32.138420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:12:32.143888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.144695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.145159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.145852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.146466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.147066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.174446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ee632c7e-e2e8-466b-868e-0affdf79d2f3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.175283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ee632c7e-e2e8-466b-868e-0affdf79d2f3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:32.181810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:12:32.183045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee632c7e-e2e8-466b-868e-0affdf79d2f3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.183651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee632c7e-e2e8-466b-868e-0affdf79d2f3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.184735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee632c7e-e2e8-466b-868e-0affdf79d2f3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.185562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee632c7e-e2e8-466b-868e-0affdf79d2f3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.186337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee632c7e-e2e8-466b-868e-0affdf79d2f3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.186936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee632c7e-e2e8-466b-868e-0affdf79d2f3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.211268 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-959d095b-0d5b-4287-bf98-41c9c90ba4b8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.083906 Aug 27 05:12:32.212089 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1986/3971] 10.222.0.58 () {58 vars in 1150 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:32.224111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0852ab87-0656-4635-9c2f-393e105d40c9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.230131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0852ab87-0656-4635-9c2f-393e105d40c9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.231179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0852ab87-0656-4635-9c2f-393e105d40c9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:12:32.236924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0852ab87-0656-4635-9c2f-393e105d40c9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.237927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0852ab87-0656-4635-9c2f-393e105d40c9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.238546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0852ab87-0656-4635-9c2f-393e105d40c9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.239471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0852ab87-0656-4635-9c2f-393e105d40c9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.240069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0852ab87-0656-4635-9c2f-393e105d40c9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.240640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0852ab87-0656-4635-9c2f-393e105d40c9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.272331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-0852ab87-0656-4635-9c2f-393e105d40c9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:12:32.303180 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0852ab87-0656-4635-9c2f-393e105d40c9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.082814 Aug 27 05:12:32.303771 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1987/3972] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:32.316619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-88412790-cf49-46eb-8bc9-9dfaf6491909 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.322060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-88412790-cf49-46eb-8bc9-9dfaf6491909 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.322733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-88412790-cf49-46eb-8bc9-9dfaf6491909 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:12:32.328926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ee632c7e-e2e8-466b-868e-0affdf79d2f3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.335381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88412790-cf49-46eb-8bc9-9dfaf6491909 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.335868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88412790-cf49-46eb-8bc9-9dfaf6491909 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.336309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88412790-cf49-46eb-8bc9-9dfaf6491909 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.337076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88412790-cf49-46eb-8bc9-9dfaf6491909 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.337257 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ee632c7e-e2e8-466b-868e-0affdf79d2f3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1324 microversion: 2.1 time: 0.166694 Aug 27 05:12:32.337687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88412790-cf49-46eb-8bc9-9dfaf6491909 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.338117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88412790-cf49-46eb-8bc9-9dfaf6491909 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.353989 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1986/3973] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:32.392506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.393736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:32.401107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.401867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.402579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.403821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.404652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.405541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.426639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-88412790-cf49-46eb-8bc9-9dfaf6491909 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:12:32.491056 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-88412790-cf49-46eb-8bc9-9dfaf6491909 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.178100 Aug 27 05:12:32.500205 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1988/3974] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:32.506837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bade8da8-b73d-4397-a630-7f17245abfa6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.513260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bade8da8-b73d-4397-a630-7f17245abfa6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.513828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.compute.servers [None req-bade8da8-b73d-4397-a630-7f17245abfa6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Removing options 'limit' from query {{(pid=128547) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1510}} Aug 27 05:12:32.514490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bade8da8-b73d-4397-a630-7f17245abfa6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:12:32.521218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bade8da8-b73d-4397-a630-7f17245abfa6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.521796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bade8da8-b73d-4397-a630-7f17245abfa6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.522557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bade8da8-b73d-4397-a630-7f17245abfa6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.523586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bade8da8-b73d-4397-a630-7f17245abfa6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.524583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bade8da8-b73d-4397-a630-7f17245abfa6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.525181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bade8da8-b73d-4397-a630-7f17245abfa6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.553545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.564578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.566258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.567851 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-04c97dc1-0ada-4ac3-862c-66716c3e785c tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.180366 Aug 27 05:12:32.568010 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bade8da8-b73d-4397-a630-7f17245abfa6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.066393 Aug 27 05:12:32.569026 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1987/3975] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:32.569266 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1989/3976] 10.222.0.58 () {58 vars in 1140 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:32.582157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-feece693-3320-4748-b110-9462d6e36d58 req-4cc768e1-5152-4e42-bf63-e723e55ddd2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e48b153-aae9-4313-8baf-057bfa027e6a", "tag": "a54be20d-2eca-4a0a-8f76-c26ad3eda581"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:32.584947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-77d2b3b9-1609-4c40-81c7-cfbba5eaedad tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.591176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-77d2b3b9-1609-4c40-81c7-cfbba5eaedad tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.592103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-77d2b3b9-1609-4c40-81c7-cfbba5eaedad tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1542946860', 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:12:32.597220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d2b3b9-1609-4c40-81c7-cfbba5eaedad tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.597705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d2b3b9-1609-4c40-81c7-cfbba5eaedad tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.598144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d2b3b9-1609-4c40-81c7-cfbba5eaedad tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.599049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-feece693-3320-4748-b110-9462d6e36d58 req-4cc768e1-5152-4e42-bf63-e723e55ddd2f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.599208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d2b3b9-1609-4c40-81c7-cfbba5eaedad tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.600091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d2b3b9-1609-4c40-81c7-cfbba5eaedad tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.600684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-77d2b3b9-1609-4c40-81c7-cfbba5eaedad tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.602144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-feece693-3320-4748-b110-9462d6e36d58 req-4cc768e1-5152-4e42-bf63-e723e55ddd2f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.603436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-feece693-3320-4748-b110-9462d6e36d58 req-4cc768e1-5152-4e42-bf63-e723e55ddd2f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.631403 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-feece693-3320-4748-b110-9462d6e36d58 req-4cc768e1-5152-4e42-bf63-e723e55ddd2f service nova] Creating event network-changed:a54be20d-2eca-4a0a-8f76-c26ad3eda581 for instance 8e48b153-aae9-4313-8baf-057bfa027e6a on n-h2-820368-35 Aug 27 05:12:32.637563 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-feece693-3320-4748-b110-9462d6e36d58 req-4cc768e1-5152-4e42-bf63-e723e55ddd2f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066744 Aug 27 05:12:32.639306 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1988/3977] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:32.652035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-08a77aba-7119-4799-9aea-abedfdee2173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.652857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-08a77aba-7119-4799-9aea-abedfdee2173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:32.662603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a77aba-7119-4799-9aea-abedfdee2173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.663459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a77aba-7119-4799-9aea-abedfdee2173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.664209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a77aba-7119-4799-9aea-abedfdee2173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.665799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a77aba-7119-4799-9aea-abedfdee2173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.666531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a77aba-7119-4799-9aea-abedfdee2173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.667443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08a77aba-7119-4799-9aea-abedfdee2173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.717396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-77d2b3b9-1609-4c40-81c7-cfbba5eaedad tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:12:32.814164 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-77d2b3b9-1609-4c40-81c7-cfbba5eaedad tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1542946860" status: 200 len: 346 microversion: 2.1 time: 0.233102 Aug 27 05:12:32.826961 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1990/3978] 10.222.0.58 () {58 vars in 1242 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1542946860 => generated 346 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:32.834403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-37c4e1bf-a037-4443-baea-7ecc98b96728 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:32.841225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37c4e1bf-a037-4443-baea-7ecc98b96728 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.841722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37c4e1bf-a037-4443-baea-7ecc98b96728 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.842216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37c4e1bf-a037-4443-baea-7ecc98b96728 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.849296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-08a77aba-7119-4799-9aea-abedfdee2173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.869604 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-08a77aba-7119-4799-9aea-abedfdee2173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1321 microversion: 2.1 time: 0.227671 Aug 27 05:12:32.870589 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1989/3979] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:32.908212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-37c4e1bf-a037-4443-baea-7ecc98b96728 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Going to try to stop instance {{(pid=128547) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:12:32.960216 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-37c4e1bf-a037-4443-baea-7ecc98b96728 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "POST /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb/action" status: 202 len: 0 microversion: 2.1 time: 0.130417 Aug 27 05:12:32.961644 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1991/3980] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:12:32 2022] POST /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:12:32.971771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fba98c3a-fe57-446f-b0ea-45000e1b4963 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.972814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fba98c3a-fe57-446f-b0ea-45000e1b4963 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:32.980316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fba98c3a-fe57-446f-b0ea-45000e1b4963 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.981006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fba98c3a-fe57-446f-b0ea-45000e1b4963 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.981708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fba98c3a-fe57-446f-b0ea-45000e1b4963 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.982678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fba98c3a-fe57-446f-b0ea-45000e1b4963 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.983169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fba98c3a-fe57-446f-b0ea-45000e1b4963 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.983609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fba98c3a-fe57-446f-b0ea-45000e1b4963 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.130037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fba98c3a-fe57-446f-b0ea-45000e1b4963 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:33.139129 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fba98c3a-fe57-446f-b0ea-45000e1b4963 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.172550 Aug 27 05:12:33.139731 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1990/3981] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:33.362018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aeceb3f4-c3c9-40e8-b70b-fc57dcaf1d37 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:33.362736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aeceb3f4-c3c9-40e8-b70b-fc57dcaf1d37 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:33.369164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeceb3f4-c3c9-40e8-b70b-fc57dcaf1d37 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.369777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeceb3f4-c3c9-40e8-b70b-fc57dcaf1d37 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.370227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeceb3f4-c3c9-40e8-b70b-fc57dcaf1d37 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.370941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeceb3f4-c3c9-40e8-b70b-fc57dcaf1d37 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.371430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeceb3f4-c3c9-40e8-b70b-fc57dcaf1d37 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.371863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeceb3f4-c3c9-40e8-b70b-fc57dcaf1d37 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.519597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aeceb3f4-c3c9-40e8-b70b-fc57dcaf1d37 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:33.527793 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aeceb3f4-c3c9-40e8-b70b-fc57dcaf1d37 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1324 microversion: 2.1 time: 0.170249 Aug 27 05:12:33.528378 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1992/3982] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:33 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:33.591917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:33.592535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:33.599107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.599604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.600041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.600739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.601189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.601613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.741585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:33.751151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:33.752592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:33.753759 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-538f6348-3a61-46d6-9bcf-9a14606a8039 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.165950 Aug 27 05:12:33.754311 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1991/3983] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:33 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:33.892369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-523995c1-478d-45a5-9d8b-7dac2f0e401f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:33.892979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-523995c1-478d-45a5-9d8b-7dac2f0e401f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:33.898904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-523995c1-478d-45a5-9d8b-7dac2f0e401f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.899657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-523995c1-478d-45a5-9d8b-7dac2f0e401f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.900099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-523995c1-478d-45a5-9d8b-7dac2f0e401f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.900794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-523995c1-478d-45a5-9d8b-7dac2f0e401f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.901306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-523995c1-478d-45a5-9d8b-7dac2f0e401f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.901735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-523995c1-478d-45a5-9d8b-7dac2f0e401f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.953495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-11e03fff-166f-4793-ae27-83cd45d5d568 req-bae3202f-b98e-4cfb-8520-0aa1377abcbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "263a0733-49e6-42cf-ad6c-23d43ae09b0b", "name": "network-vif-plugged", "status": "completed", "tag": "2416198c-9325-4324-8e19-dea4c0714282"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:33.963373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-11e03fff-166f-4793-ae27-83cd45d5d568 req-bae3202f-b98e-4cfb-8520-0aa1377abcbc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.963883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-11e03fff-166f-4793-ae27-83cd45d5d568 req-bae3202f-b98e-4cfb-8520-0aa1377abcbc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.964311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-11e03fff-166f-4793-ae27-83cd45d5d568 req-bae3202f-b98e-4cfb-8520-0aa1377abcbc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.978680 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-11e03fff-166f-4793-ae27-83cd45d5d568 req-bae3202f-b98e-4cfb-8520-0aa1377abcbc service nova] Creating event network-vif-plugged:2416198c-9325-4324-8e19-dea4c0714282 for instance 263a0733-49e6-42cf-ad6c-23d43ae09b0b on n-h2-820368-35 Aug 27 05:12:33.984069 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-11e03fff-166f-4793-ae27-83cd45d5d568 req-bae3202f-b98e-4cfb-8520-0aa1377abcbc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034878 Aug 27 05:12:33.984751 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1992/3984] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:34.046728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-523995c1-478d-45a5-9d8b-7dac2f0e401f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:34.054987 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-523995c1-478d-45a5-9d8b-7dac2f0e401f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1321 microversion: 2.1 time: 0.166444 Aug 27 05:12:34.056300 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1993/3985] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:33 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:34.161821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13b944fa-67cf-451e-ac28-cd874146fe31 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:34.162527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-13b944fa-67cf-451e-ac28-cd874146fe31 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:34.169525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13b944fa-67cf-451e-ac28-cd874146fe31 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:34.170015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13b944fa-67cf-451e-ac28-cd874146fe31 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:34.170455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13b944fa-67cf-451e-ac28-cd874146fe31 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:34.171231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13b944fa-67cf-451e-ac28-cd874146fe31 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:34.172016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13b944fa-67cf-451e-ac28-cd874146fe31 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:34.172505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13b944fa-67cf-451e-ac28-cd874146fe31 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:34.312136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13b944fa-67cf-451e-ac28-cd874146fe31 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:34.319824 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-13b944fa-67cf-451e-ac28-cd874146fe31 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.162381 Aug 27 05:12:34.320398 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1993/3986] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:34 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:34.548761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-deb0acf4-3f6c-4864-98fb-4aa6fbaeb397 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:34.549380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-deb0acf4-3f6c-4864-98fb-4aa6fbaeb397 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:34.556356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-deb0acf4-3f6c-4864-98fb-4aa6fbaeb397 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:34.556784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-deb0acf4-3f6c-4864-98fb-4aa6fbaeb397 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:34.557224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-deb0acf4-3f6c-4864-98fb-4aa6fbaeb397 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:34.557957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-deb0acf4-3f6c-4864-98fb-4aa6fbaeb397 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:34.558401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-deb0acf4-3f6c-4864-98fb-4aa6fbaeb397 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:34.558828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-deb0acf4-3f6c-4864-98fb-4aa6fbaeb397 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:34.694119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-deb0acf4-3f6c-4864-98fb-4aa6fbaeb397 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:34.702439 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-deb0acf4-3f6c-4864-98fb-4aa6fbaeb397 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1324 microversion: 2.1 time: 0.157455 Aug 27 05:12:34.703024 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1994/3987] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:34 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1324 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:34.778125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:34.778774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:34.785675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:34.786159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:34.786601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:34.787328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:34.787788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:34.788215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:34.917083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:34.925157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:34.926676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:34.927848 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-67179011-657d-4906-bd70-567a4b69c6e2 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.154359 Aug 27 05:12:34.928406 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1994/3988] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:34 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:35.076567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2074db1a-5888-46b8-b260-e53bd8663ca6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:35.077183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2074db1a-5888-46b8-b260-e53bd8663ca6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:35.083181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2074db1a-5888-46b8-b260-e53bd8663ca6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:35.083669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2074db1a-5888-46b8-b260-e53bd8663ca6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:35.084108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2074db1a-5888-46b8-b260-e53bd8663ca6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:35.084813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2074db1a-5888-46b8-b260-e53bd8663ca6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:35.085268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2074db1a-5888-46b8-b260-e53bd8663ca6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:35.085698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2074db1a-5888-46b8-b260-e53bd8663ca6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:35.218948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2074db1a-5888-46b8-b260-e53bd8663ca6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:35.226606 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2074db1a-5888-46b8-b260-e53bd8663ca6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1321 microversion: 2.1 time: 0.154019 Aug 27 05:12:35.227201 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1995/3989] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:35 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:35.341539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7df5495e-f98e-455e-9e95-3f07834686cc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:35.342158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7df5495e-f98e-455e-9e95-3f07834686cc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:35.348245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7df5495e-f98e-455e-9e95-3f07834686cc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:35.348733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7df5495e-f98e-455e-9e95-3f07834686cc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:35.349171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7df5495e-f98e-455e-9e95-3f07834686cc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:35.349867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7df5495e-f98e-455e-9e95-3f07834686cc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:35.350322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7df5495e-f98e-455e-9e95-3f07834686cc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:35.350750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7df5495e-f98e-455e-9e95-3f07834686cc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:35.481531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7df5495e-f98e-455e-9e95-3f07834686cc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:35.489375 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7df5495e-f98e-455e-9e95-3f07834686cc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.151740 Aug 27 05:12:35.489944 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1995/3990] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:35 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:35.723854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dcf9930c-6e0d-4d5e-b429-dba740408653 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:35.724492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dcf9930c-6e0d-4d5e-b429-dba740408653 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:35.731442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf9930c-6e0d-4d5e-b429-dba740408653 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:35.731934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf9930c-6e0d-4d5e-b429-dba740408653 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:35.732376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf9930c-6e0d-4d5e-b429-dba740408653 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:35.733090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf9930c-6e0d-4d5e-b429-dba740408653 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:35.733549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf9930c-6e0d-4d5e-b429-dba740408653 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:35.733981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dcf9930c-6e0d-4d5e-b429-dba740408653 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:35.881873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dcf9930c-6e0d-4d5e-b429-dba740408653 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:35.890791 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dcf9930c-6e0d-4d5e-b429-dba740408653 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1324 microversion: 2.1 time: 0.171062 Aug 27 05:12:35.891394 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1996/3991] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:35 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:35.950855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:35.951710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:35.958775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:35.959296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:35.959737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:35.960439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:35.960893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:35.961319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:36.104636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-37474557-f809-4bb8-a9b9-e18b4fd9d39a req-e5cbcb39-49dd-453b-b1dd-8c6a273f9a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c39d751-b91a-4901-b8fe-f0d280024110", "name": "network-vif-plugged", "status": "completed", "tag": "2be9f11f-25a4-4df1-a652-708e2819755c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:36.122685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-37474557-f809-4bb8-a9b9-e18b4fd9d39a req-e5cbcb39-49dd-453b-b1dd-8c6a273f9a72 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:36.123227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-37474557-f809-4bb8-a9b9-e18b4fd9d39a req-e5cbcb39-49dd-453b-b1dd-8c6a273f9a72 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:36.123671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-37474557-f809-4bb8-a9b9-e18b4fd9d39a req-e5cbcb39-49dd-453b-b1dd-8c6a273f9a72 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:36.145307 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-37474557-f809-4bb8-a9b9-e18b4fd9d39a req-e5cbcb39-49dd-453b-b1dd-8c6a273f9a72 service nova] Creating event network-vif-plugged:2be9f11f-25a4-4df1-a652-708e2819755c for instance 6c39d751-b91a-4901-b8fe-f0d280024110 on n-h1-820368-35 Aug 27 05:12:36.157495 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-37474557-f809-4bb8-a9b9-e18b4fd9d39a req-e5cbcb39-49dd-453b-b1dd-8c6a273f9a72 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057619 Aug 27 05:12:36.157813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:36.158446 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1997/3992] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:36.168005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:36.169639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:36.170817 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c72f2ce1-baf5-4abb-ac7d-94934fbb0668 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.224629 Aug 27 05:12:36.175203 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1996/3993] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:35 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:36.250980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c7408b9a-bc94-4c71-963e-695aa8ff58b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:36.252100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c7408b9a-bc94-4c71-963e-695aa8ff58b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:36.260297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7408b9a-bc94-4c71-963e-695aa8ff58b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:36.261118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7408b9a-bc94-4c71-963e-695aa8ff58b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:36.261810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7408b9a-bc94-4c71-963e-695aa8ff58b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:36.262818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7408b9a-bc94-4c71-963e-695aa8ff58b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:36.264137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7408b9a-bc94-4c71-963e-695aa8ff58b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:36.265015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7408b9a-bc94-4c71-963e-695aa8ff58b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:36.402685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c7408b9a-bc94-4c71-963e-695aa8ff58b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:36.411790 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c7408b9a-bc94-4c71-963e-695aa8ff58b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1321 microversion: 2.1 time: 0.167031 Aug 27 05:12:36.412386 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1998/3994] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:36 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:36.511574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1ee58443-1082-427f-821e-ba88a812cf60 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:36.512103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1ee58443-1082-427f-821e-ba88a812cf60 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:36.518626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ee58443-1082-427f-821e-ba88a812cf60 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:36.519137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ee58443-1082-427f-821e-ba88a812cf60 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:36.519579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ee58443-1082-427f-821e-ba88a812cf60 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:36.520289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ee58443-1082-427f-821e-ba88a812cf60 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:36.520741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ee58443-1082-427f-821e-ba88a812cf60 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:36.521168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ee58443-1082-427f-821e-ba88a812cf60 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:36.654888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1ee58443-1082-427f-821e-ba88a812cf60 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:36.662875 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1ee58443-1082-427f-821e-ba88a812cf60 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.155842 Aug 27 05:12:36.663491 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1997/3995] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:36 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:36.911034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a1bdefcc-ed6d-4346-ac0d-8ffc3ce978cb tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:36.911700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a1bdefcc-ed6d-4346-ac0d-8ffc3ce978cb tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:36.918906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1bdefcc-ed6d-4346-ac0d-8ffc3ce978cb tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:36.919407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1bdefcc-ed6d-4346-ac0d-8ffc3ce978cb tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:36.919844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1bdefcc-ed6d-4346-ac0d-8ffc3ce978cb tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:36.920548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1bdefcc-ed6d-4346-ac0d-8ffc3ce978cb tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:36.921188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1bdefcc-ed6d-4346-ac0d-8ffc3ce978cb tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:36.921709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1bdefcc-ed6d-4346-ac0d-8ffc3ce978cb tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:36.938339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:37.066216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a1bdefcc-ed6d-4346-ac0d-8ffc3ce978cb tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:37.076560 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a1bdefcc-ed6d-4346-ac0d-8ffc3ce978cb tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1324 microversion: 2.1 time: 0.169326 Aug 27 05:12:37.077281 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 1999/3996] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:36 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1324 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:37.194929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:37.195688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:37.203649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:37.204149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:37.204589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:37.205299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:37.205751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:37.206178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:37.350990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:37.359575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:37.361054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:37.362211 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-52f3f395-4dd0-4a3f-8239-81974fbc46d3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1361 microversion: 2.26 time: 0.171237 Aug 27 05:12:37.362768 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1998/3997] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:37 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:37.433641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3c216089-abf8-4451-b31d-7a3a4e5d3604 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:37.434459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3c216089-abf8-4451-b31d-7a3a4e5d3604 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:37.441935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c216089-abf8-4451-b31d-7a3a4e5d3604 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:37.442875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c216089-abf8-4451-b31d-7a3a4e5d3604 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:37.443353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c216089-abf8-4451-b31d-7a3a4e5d3604 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:37.444697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c216089-abf8-4451-b31d-7a3a4e5d3604 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:37.445158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c216089-abf8-4451-b31d-7a3a4e5d3604 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:37.445586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c216089-abf8-4451-b31d-7a3a4e5d3604 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:37.588284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3c216089-abf8-4451-b31d-7a3a4e5d3604 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:37.598231 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3c216089-abf8-4451-b31d-7a3a4e5d3604 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1321 microversion: 2.1 time: 0.168997 Aug 27 05:12:37.599832 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2000/3998] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:37 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:37.685145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0157347f-8548-47ae-9e84-3fee9618e805 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:37.685942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0157347f-8548-47ae-9e84-3fee9618e805 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:37.692150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0157347f-8548-47ae-9e84-3fee9618e805 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:37.692702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0157347f-8548-47ae-9e84-3fee9618e805 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:37.693140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0157347f-8548-47ae-9e84-3fee9618e805 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:37.693832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0157347f-8548-47ae-9e84-3fee9618e805 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:37.694285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0157347f-8548-47ae-9e84-3fee9618e805 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:37.694707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0157347f-8548-47ae-9e84-3fee9618e805 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:37.837505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0157347f-8548-47ae-9e84-3fee9618e805 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:37.845779 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0157347f-8548-47ae-9e84-3fee9618e805 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.165231 Aug 27 05:12:37.846431 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 1999/3999] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:37 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:38.098268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d3b84e76-4b7f-46dc-97f2-93bf6489918e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.098886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d3b84e76-4b7f-46dc-97f2-93bf6489918e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:38.106349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b84e76-4b7f-46dc-97f2-93bf6489918e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.106815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b84e76-4b7f-46dc-97f2-93bf6489918e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.107291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b84e76-4b7f-46dc-97f2-93bf6489918e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.107988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b84e76-4b7f-46dc-97f2-93bf6489918e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.108500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b84e76-4b7f-46dc-97f2-93bf6489918e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.108872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3b84e76-4b7f-46dc-97f2-93bf6489918e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.238658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d3b84e76-4b7f-46dc-97f2-93bf6489918e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:38.247223 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d3b84e76-4b7f-46dc-97f2-93bf6489918e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1522 microversion: 2.1 time: 0.152838 Aug 27 05:12:38.247802 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2001/4000] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:38 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:38.267792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-301c2c85-3f5d-4bf5-b09b-c26d35eadbe1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.268413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-301c2c85-3f5d-4bf5-b09b-c26d35eadbe1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:38.275821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-301c2c85-3f5d-4bf5-b09b-c26d35eadbe1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.276307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-301c2c85-3f5d-4bf5-b09b-c26d35eadbe1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.276746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-301c2c85-3f5d-4bf5-b09b-c26d35eadbe1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.277483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-301c2c85-3f5d-4bf5-b09b-c26d35eadbe1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.277938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-301c2c85-3f5d-4bf5-b09b-c26d35eadbe1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.278367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-301c2c85-3f5d-4bf5-b09b-c26d35eadbe1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.386792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.387570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:38.393807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.394295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.394731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.395462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.395921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.396351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.409132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-301c2c85-3f5d-4bf5-b09b-c26d35eadbe1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:38.417339 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-301c2c85-3f5d-4bf5-b09b-c26d35eadbe1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1522 microversion: 2.1 time: 0.153446 Aug 27 05:12:38.417914 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2000/4001] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:38 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:38.437325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-801a667d-ff92-4e27-9397-894fa3c812a1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-702755513", "metadata": {"": ""}}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-801a667d-ff92-4e27-9397-894fa3c812a1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action HTTP/1.1 Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 106 Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-702755513", "metadata": {"": ""}}} Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '6c39d751-b91a-4901-b8fe-f0d280024110', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-702755513', 'metadata': {'': ''}}}} Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'': ''} Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:12:38.441529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-801a667d-ff92-4e27-9397-894fa3c812a1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-801a667d-ff92-4e27-9397-894fa3c812a1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action" status: 400 len: 170 microversion: 2.1 time: 0.009608 Aug 27 05:12:38.446402 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2001/4002] 10.222.0.58 () {60 vars in 1279 bytes} [Sat Aug 27 05:12:38 2022] POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action => generated 170 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 05:12:38.451822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-00ea9e9b-148a-44e5-9303-ad294508d19c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.452443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-00ea9e9b-148a-44e5-9303-ad294508d19c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:38.460602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00ea9e9b-148a-44e5-9303-ad294508d19c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.461098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00ea9e9b-148a-44e5-9303-ad294508d19c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.461599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00ea9e9b-148a-44e5-9303-ad294508d19c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.462833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00ea9e9b-148a-44e5-9303-ad294508d19c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.463317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00ea9e9b-148a-44e5-9303-ad294508d19c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.463751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00ea9e9b-148a-44e5-9303-ad294508d19c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.494783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:38.576102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:38.584570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:38.586220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:38.588748 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5cd6ca10-b337-43a7-b96d-3faba9aa7d2d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1545 microversion: 2.26 time: 0.206742 Aug 27 05:12:38.589402 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2002/4003] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:38 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1545 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:12:38.612911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb5644bedc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.622316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.622800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.623280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.623757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:38.629050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.629528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.629969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.630653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.631414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.631846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.637035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-00ea9e9b-148a-44e5-9303-ad294508d19c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:38.644944 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-00ea9e9b-148a-44e5-9303-ad294508d19c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1522 microversion: 2.1 time: 0.196807 Aug 27 05:12:38.645511 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2002/4004] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:38 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:38.650502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f2fbbadc-8d49-4722-bf67-8708a49a3c30 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.651124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f2fbbadc-8d49-4722-bf67-8708a49a3c30 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:38.656932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2fbbadc-8d49-4722-bf67-8708a49a3c30 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.657417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2fbbadc-8d49-4722-bf67-8708a49a3c30 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.657848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2fbbadc-8d49-4722-bf67-8708a49a3c30 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.658739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2fbbadc-8d49-4722-bf67-8708a49a3c30 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.659227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2fbbadc-8d49-4722-bf67-8708a49a3c30 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.659896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2fbbadc-8d49-4722-bf67-8708a49a3c30 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.664663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.665232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.665672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.679116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.679594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.680033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.705436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:38.755444 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-568ffc78-b5c9-4055-887a-cd29ff6e1b02 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-1530237055" status: 201 len: 0 microversion: 2.26 time: 0.146921 Aug 27 05:12:38.756210 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2003/4005] 10.222.0.58 () {62 vars in 1380 bytes} [Sat Aug 27 05:12:38 2022] PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-1530237055 => generated 0 bytes in 149 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 27 05:12:38.761990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb462482-1232-4e5c-b6e4-851cbb02f674 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.762610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb462482-1232-4e5c-b6e4-851cbb02f674 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:38.768632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb462482-1232-4e5c-b6e4-851cbb02f674 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.769136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb462482-1232-4e5c-b6e4-851cbb02f674 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.769643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb462482-1232-4e5c-b6e4-851cbb02f674 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.770346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb462482-1232-4e5c-b6e4-851cbb02f674 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.770801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb462482-1232-4e5c-b6e4-851cbb02f674 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.771275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb462482-1232-4e5c-b6e4-851cbb02f674 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.802869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f2fbbadc-8d49-4722-bf67-8708a49a3c30 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:38.809693 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f2fbbadc-8d49-4722-bf67-8708a49a3c30 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1321 microversion: 2.1 time: 0.163112 Aug 27 05:12:38.810360 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2003/4006] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:38 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:38.815648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-41b4c045-0aa6-4bb8-b2fe-e7a8300b710d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb564b65550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.823841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41b4c045-0aa6-4bb8-b2fe-e7a8300b710d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.824326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41b4c045-0aa6-4bb8-b2fe-e7a8300b710d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.824766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41b4c045-0aa6-4bb8-b2fe-e7a8300b710d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.840038 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-41b4c045-0aa6-4bb8-b2fe-e7a8300b710d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-1530237055" status: 204 len: 0 microversion: 2.26 time: 0.028245 Aug 27 05:12:38.840639 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2004/4007] 10.222.0.58 () {60 vars in 1361 bytes} [Sat Aug 27 05:12:38 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-1530237055 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:12:38.849196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb569686dc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.856717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.857196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.857628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.858098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:38.863942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.864501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.864944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.865633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.866083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.866508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.892683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.893200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.893636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.906763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb462482-1232-4e5c-b6e4-851cbb02f674 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:38.910796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:38.914740 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb462482-1232-4e5c-b6e4-851cbb02f674 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1522 microversion: 2.1 time: 0.157434 Aug 27 05:12:38.915418 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2004/4008] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:38 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:38.921040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b504f037-6767-4d90-ac4f-89f0a54ebff2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.921654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b504f037-6767-4d90-ac4f-89f0a54ebff2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:38.927661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b504f037-6767-4d90-ac4f-89f0a54ebff2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.928158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b504f037-6767-4d90-ac4f-89f0a54ebff2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.928600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b504f037-6767-4d90-ac4f-89f0a54ebff2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.929300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b504f037-6767-4d90-ac4f-89f0a54ebff2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.929758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b504f037-6767-4d90-ac4f-89f0a54ebff2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.930277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b504f037-6767-4d90-ac4f-89f0a54ebff2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.935380 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bfd647b7-860f-4556-8be0-712a830f9338 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags" status: 204 len: 0 microversion: 2.26 time: 0.090163 Aug 27 05:12:38.936168 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2005/4009] 10.222.0.58 () {60 vars in 1295 bytes} [Sat Aug 27 05:12:38 2022] DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:12:38.944305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10ecfedd-b657-4ac0-98bd-9f1f464e7df5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1161707081", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10ecfedd-b657-4ac0-98bd-9f1f464e7df5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action HTTP/1.1 Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 619 Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1161707081", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '6c39d751-b91a-4901-b8fe-f0d280024110', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1161707081', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:12:38.948750 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 05:12:38.951667 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:38.954294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10ecfedd-b657-4ac0-98bd-9f1f464e7df5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:38.954294 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10ecfedd-b657-4ac0-98bd-9f1f464e7df5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action" status: 400 len: 938 microversion: 2.1 time: 0.009883 Aug 27 05:12:38.954294 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2006/4010] 10.222.0.58 () {60 vars in 1279 bytes} [Sat Aug 27 05:12:38 2022] POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action => generated 938 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:12:38.957620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b3fb9e7f-9ad8-4783-bd35-f2a447100bae tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb564513310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.967374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3fb9e7f-9ad8-4783-bd35-f2a447100bae tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.967885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3fb9e7f-9ad8-4783-bd35-f2a447100bae tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.968319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3fb9e7f-9ad8-4783-bd35-f2a447100bae tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.983877 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b3fb9e7f-9ad8-4783-bd35-f2a447100bae tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags" status: 200 len: 12 microversion: 2.26 time: 0.031973 Aug 27 05:12:38.984492 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2007/4011] 10.222.0.58 () {60 vars in 1292 bytes} [Sat Aug 27 05:12:38 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags => generated 12 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:38.989089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-14d7e88c-cc44-4acb-a78d-b647b790e199 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.990011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-14d7e88c-cc44-4acb-a78d-b647b790e199 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:38.995922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d7e88c-cc44-4acb-a78d-b647b790e199 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.996410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d7e88c-cc44-4acb-a78d-b647b790e199 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.996852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d7e88c-cc44-4acb-a78d-b647b790e199 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:38.997547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d7e88c-cc44-4acb-a78d-b647b790e199 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:38.998000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d7e88c-cc44-4acb-a78d-b647b790e199 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:38.998431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d7e88c-cc44-4acb-a78d-b647b790e199 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.096439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b504f037-6767-4d90-ac4f-89f0a54ebff2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:39.105058 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b504f037-6767-4d90-ac4f-89f0a54ebff2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.187834 Aug 27 05:12:39.105982 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2005/4012] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:38 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:39.110535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb5646808b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.119664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.120070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.120501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.120971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.126290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.126764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.127219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.127897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.128345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.128765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.156144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.156736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.157181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.159235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-14d7e88c-cc44-4acb-a78d-b647b790e199 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:39.165636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.166109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.166540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.167309 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-14d7e88c-cc44-4acb-a78d-b647b790e199 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1522 microversion: 2.1 time: 0.181831 Aug 27 05:12:39.168028 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2008/4013] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:38 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:39.189505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:39.189714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5331c731-5669-45bc-959c-4d517a961fe5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.190253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5331c731-5669-45bc-959c-4d517a961fe5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.197251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5331c731-5669-45bc-959c-4d517a961fe5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.197736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5331c731-5669-45bc-959c-4d517a961fe5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.198169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5331c731-5669-45bc-959c-4d517a961fe5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.198866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5331c731-5669-45bc-959c-4d517a961fe5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.199355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5331c731-5669-45bc-959c-4d517a961fe5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.199778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5331c731-5669-45bc-959c-4d517a961fe5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.204978 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40a4502f-5f7a-43c0-9644-6dd66cc0d26b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-883561329" status: 201 len: 0 microversion: 2.26 time: 0.097979 Aug 27 05:12:39.205626 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2006/4014] 10.222.0.58 () {62 vars in 1377 bytes} [Sat Aug 27 05:12:39 2022] PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-883561329 => generated 0 bytes in 99 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 05:12:39.215706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-97247233-8bb1-44d3-a549-c1aa4505eaaa tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb5644be5e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.223885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97247233-8bb1-44d3-a549-c1aa4505eaaa tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.224363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97247233-8bb1-44d3-a549-c1aa4505eaaa tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.224795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97247233-8bb1-44d3-a549-c1aa4505eaaa tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.233375 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-97247233-8bb1-44d3-a549-c1aa4505eaaa tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags" status: 200 len: 35 microversion: 2.26 time: 0.022145 Aug 27 05:12:39.234066 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2007/4015] 10.222.0.58 () {60 vars in 1292 bytes} [Sat Aug 27 05:12:39 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags => generated 35 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:39.244421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb5644e8310>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.251687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.252163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.252593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.253060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.258187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.259477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.259913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.260582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.261027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.261441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.283494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.283975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.284401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.308565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:39.323228 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e6f2be9-6bbc-49c9-976a-adfd3070ad0b tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-883561329" status: 204 len: 0 microversion: 2.26 time: 0.082545 Aug 27 05:12:39.323836 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2008/4016] 10.222.0.58 () {60 vars in 1361 bytes} [Sat Aug 27 05:12:39 2022] DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-883561329 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:12:39.332028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-acbcf6e3-a510-490c-821a-9599cefddb94 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb564680a60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.332836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5331c731-5669-45bc-959c-4d517a961fe5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:39.340054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-acbcf6e3-a510-490c-821a-9599cefddb94 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.340535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-acbcf6e3-a510-490c-821a-9599cefddb94 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.340969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-acbcf6e3-a510-490c-821a-9599cefddb94 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.341479 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5331c731-5669-45bc-959c-4d517a961fe5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1522 microversion: 2.1 time: 0.156124 Aug 27 05:12:39.342119 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2009/4017] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:39 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:39.349994 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-acbcf6e3-a510-490c-821a-9599cefddb94 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags" status: 200 len: 12 microversion: 2.26 time: 0.021867 Aug 27 05:12:39.350572 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2009/4018] 10.222.0.58 () {60 vars in 1292 bytes} [Sat Aug 27 05:12:39 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags => generated 12 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:39.360523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb569576ee0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.363727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f67af2fa-90cf-40f3-ad21-961d590db569 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f67af2fa-90cf-40f3-ad21-961d590db569 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action HTTP/1.1 Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 285 Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '6c39d751-b91a-4901-b8fe-f0d280024110', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:39.367517 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:12:39.371625 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:39.374821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.374984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f67af2fa-90cf-40f3-ad21-961d590db569 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:39.375172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.375318 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f67af2fa-90cf-40f3-ad21-961d590db569 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action" status: 400 len: 619 microversion: 2.1 time: 0.008934 Aug 27 05:12:39.375478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.375478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.375752 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2010/4019] 10.222.0.58 () {60 vars in 1279 bytes} [Sat Aug 27 05:12:39 2022] POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:12:39.376793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8395a37-1a46-4d9b-b5f2-c76a839c51ba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.377398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f8395a37-1a46-4d9b-b5f2-c76a839c51ba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.377847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.378334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.378776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.379852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.380020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.380369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.384987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8395a37-1a46-4d9b-b5f2-c76a839c51ba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.385474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8395a37-1a46-4d9b-b5f2-c76a839c51ba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.385917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8395a37-1a46-4d9b-b5f2-c76a839c51ba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.386617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8395a37-1a46-4d9b-b5f2-c76a839c51ba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.387072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8395a37-1a46-4d9b-b5f2-c76a839c51ba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.387520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8395a37-1a46-4d9b-b5f2-c76a839c51ba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.405306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.406125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.406271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.417167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:39.431810 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-08af913a-648b-4510-8325-561cada25125 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags" status: 204 len: 0 microversion: 2.26 time: 0.075210 Aug 27 05:12:39.432426 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2010/4020] 10.222.0.58 () {60 vars in 1295 bytes} [Sat Aug 27 05:12:39 2022] DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:12:39.442319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb569537550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.451978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.452499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.452940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.453614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.459100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.459592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.460026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.460708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.461158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.462145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.489067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.489556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.490004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.499684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.500169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.500607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.525086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:39.533459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f8395a37-1a46-4d9b-b5f2-c76a839c51ba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:39.540356 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7e8bbc6a-2939-4b72-8ed8-54fb750b8df3 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-1594056601" status: 201 len: 0 microversion: 2.26 time: 0.102227 Aug 27 05:12:39.541016 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2011/4021] 10.222.0.58 () {62 vars in 1380 bytes} [Sat Aug 27 05:12:39 2022] PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-1594056601 => generated 0 bytes in 104 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 27 05:12:39.543169 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8395a37-1a46-4d9b-b5f2-c76a839c51ba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1522 microversion: 2.1 time: 0.169634 Aug 27 05:12:39.543779 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2011/4022] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:39 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:39.550761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb569576940>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.560872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.561354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.561790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.562273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.564120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e4a2a2b-ce08-4c84-9b43-a5c239b5cac2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.564781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e4a2a2b-ce08-4c84-9b43-a5c239b5cac2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.569506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.569997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.570504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.571778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.572266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.572401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e4a2a2b-ce08-4c84-9b43-a5c239b5cac2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.572689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.572837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e4a2a2b-ce08-4c84-9b43-a5c239b5cac2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.573256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e4a2a2b-ce08-4c84-9b43-a5c239b5cac2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.573947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e4a2a2b-ce08-4c84-9b43-a5c239b5cac2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.574394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e4a2a2b-ce08-4c84-9b43-a5c239b5cac2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.574812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e4a2a2b-ce08-4c84-9b43-a5c239b5cac2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.599490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.599981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.600421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.609248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.609723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.610160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.633458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:39.649268 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4ab580d8-72e2-4d9c-a170-3643ede28728 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-336257787" status: 201 len: 0 microversion: 2.26 time: 0.102516 Aug 27 05:12:39.654095 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2012/4023] 10.222.0.58 () {62 vars in 1377 bytes} [Sat Aug 27 05:12:39 2022] PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-336257787 => generated 0 bytes in 104 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 27 05:12:39.659277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb56954de50>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.667062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.667580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.668016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.668499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.674267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.674747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.675208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.675899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.676353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.676791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.699251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.699624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.700240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.710740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e4a2a2b-ce08-4c84-9b43-a5c239b5cac2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:39.713880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:39.718905 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e4a2a2b-ce08-4c84-9b43-a5c239b5cac2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1522 microversion: 2.1 time: 0.158359 Aug 27 05:12:39.719810 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2012/4024] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:39 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:39.730055 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-713f1029-f483-456e-b5f8-1536417c507e tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags" status: 204 len: 0 microversion: 2.26 time: 0.074772 Aug 27 05:12:39.730663 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2013/4025] 10.222.0.58 () {60 vars in 1295 bytes} [Sat Aug 27 05:12:39 2022] DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:12:39.738658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-adfd5ac5-1262-4f91-953f-c7699abab851 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb56954d700>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.739062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-929dbfc9-91a9-4e8d-b9af-c9657ac35037 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1632560431"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:39.741730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-929dbfc9-91a9-4e8d-b9af-c9657ac35037 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.746909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-adfd5ac5-1262-4f91-953f-c7699abab851 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.747470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-adfd5ac5-1262-4f91-953f-c7699abab851 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.747969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-adfd5ac5-1262-4f91-953f-c7699abab851 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.748096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-929dbfc9-91a9-4e8d-b9af-c9657ac35037 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.748589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-929dbfc9-91a9-4e8d-b9af-c9657ac35037 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.749045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-929dbfc9-91a9-4e8d-b9af-c9657ac35037 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.749733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-929dbfc9-91a9-4e8d-b9af-c9657ac35037 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.750185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-929dbfc9-91a9-4e8d-b9af-c9657ac35037 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.751000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-929dbfc9-91a9-4e8d-b9af-c9657ac35037 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.756831 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-adfd5ac5-1262-4f91-953f-c7699abab851 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags" status: 200 len: 12 microversion: 2.26 time: 0.021946 Aug 27 05:12:39.763177 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2014/4026] 10.222.0.58 () {60 vars in 1292 bytes} [Sat Aug 27 05:12:39 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags => generated 12 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:39.766423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:39.768385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb56954d160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.776120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.776603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.777044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.777548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.783336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.784222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.784431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.785691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.786374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.786526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.822901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.823516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.824064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.835969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:39.841617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:39.854401 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cc69c875-dca4-454c-849d-e22eb730b88d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags" status: 204 len: 0 microversion: 2.26 time: 0.089903 Aug 27 05:12:39.855039 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2015/4027] 10.222.0.58 () {60 vars in 1295 bytes} [Sat Aug 27 05:12:39 2022] DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:12:39.859899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6cc3b95f-ba0e-454d-80df-f99660a179b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.860517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6cc3b95f-ba0e-454d-80df-f99660a179b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.867803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cc3b95f-ba0e-454d-80df-f99660a179b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.868801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cc3b95f-ba0e-454d-80df-f99660a179b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.869250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cc3b95f-ba0e-454d-80df-f99660a179b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.869993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cc3b95f-ba0e-454d-80df-f99660a179b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.870454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cc3b95f-ba0e-454d-80df-f99660a179b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.870883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cc3b95f-ba0e-454d-80df-f99660a179b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.960602 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-929dbfc9-91a9-4e8d-b9af-c9657ac35037 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action" status: 202 len: 0 microversion: 2.1 time: 0.225257 Aug 27 05:12:39.961398 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2013/4028] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:12:39 2022] POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 05:12:39.976453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb564511430>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:39.992616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.993689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.994842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.994842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:40.017005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.017607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.018222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.019007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.019586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.020183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.052415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.053644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.054213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.059809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6cc3b95f-ba0e-454d-80df-f99660a179b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:40.068258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.069091 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6cc3b95f-ba0e-454d-80df-f99660a179b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1321 microversion: 2.1 time: 0.212977 Aug 27 05:12:40.069451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.069908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.070037 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2016/4029] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:39 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:40.075069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-576996301"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:40.077492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:40.084082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.084577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.085015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.085723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.086177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.086637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.095011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:40.111802 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6ae26a2d-6657-4572-af02-669853c5e581 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-1686291298" status: 201 len: 0 microversion: 2.26 time: 0.148934 Aug 27 05:12:40.112482 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2014/4030] 10.222.0.58 () {62 vars in 1380 bytes} [Sat Aug 27 05:12:39 2022] PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-1686291298 => generated 0 bytes in 150 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 05:12:40.122270 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] HTTP exception thrown: Cannot 'createImage' instance 6c39d751-b91a-4901-b8fe-f0d280024110 while it is in task_state image_snapshot Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action HTTP/1.1 Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 84 Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-576996301"}} Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot 'createImage' instance 6c39d751-b91a-4901-b8fe-f0d280024110 while it is in task_state image_snapshot Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '6c39d751-b91a-4901-b8fe-f0d280024110', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-576996301'}}} Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1369, in _action_create_image Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1374, in _action_create_image Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:12:40.123938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 6c39d751-b91a-4901-b8fe-f0d280024110 while it is in task_state image_snapshot Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 6c39d751-b91a-4901-b8fe-f0d280024110 while it is in task_state image_snapshot Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 409 to user: Cannot 'createImage' instance 6c39d751-b91a-4901-b8fe-f0d280024110 while it is in task_state image_snapshot {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0e8a5bb8-b69d-4eec-ba29-30f5bac71fe0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action" status: 409 len: 159 microversion: 2.1 time: 0.054784 Aug 27 05:12:40.128295 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2017/4031] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:12:40 2022] POST /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110/action => generated 159 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:12:40.134580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb5695769d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:40.144593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.145329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.145657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.146139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:40.151671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.152601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.152601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.153200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.153956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.154525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.185826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e36161e9-a1f7-4e1b-8b97-69fd0d1fa8e7 req-682f712c-db08-465a-8352-55a11cefaa75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e48b153-aae9-4313-8baf-057bfa027e6a", "name": "network-vif-plugged", "status": "completed", "tag": "a54be20d-2eca-4a0a-8f76-c26ad3eda581"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:40.195199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.196139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.196919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e36161e9-a1f7-4e1b-8b97-69fd0d1fa8e7 req-682f712c-db08-465a-8352-55a11cefaa75 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.197036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.197395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e36161e9-a1f7-4e1b-8b97-69fd0d1fa8e7 req-682f712c-db08-465a-8352-55a11cefaa75 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.197826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e36161e9-a1f7-4e1b-8b97-69fd0d1fa8e7 req-682f712c-db08-465a-8352-55a11cefaa75 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.210007 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e36161e9-a1f7-4e1b-8b97-69fd0d1fa8e7 req-682f712c-db08-465a-8352-55a11cefaa75 service nova] Creating event network-vif-plugged:a54be20d-2eca-4a0a-8f76-c26ad3eda581 for instance 8e48b153-aae9-4313-8baf-057bfa027e6a on n-h2-820368-35 Aug 27 05:12:40.212499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.212991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.213446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.215423 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e36161e9-a1f7-4e1b-8b97-69fd0d1fa8e7 req-682f712c-db08-465a-8352-55a11cefaa75 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101849 Aug 27 05:12:40.216331 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2015/4032] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:40.221269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9897da69-a218-4a7a-a3f6-247a68bf41ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:40.221965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9897da69-a218-4a7a-a3f6-247a68bf41ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:40.228804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9897da69-a218-4a7a-a3f6-247a68bf41ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.229286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9897da69-a218-4a7a-a3f6-247a68bf41ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.229721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9897da69-a218-4a7a-a3f6-247a68bf41ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.230418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9897da69-a218-4a7a-a3f6-247a68bf41ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.231000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9897da69-a218-4a7a-a3f6-247a68bf41ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.231454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9897da69-a218-4a7a-a3f6-247a68bf41ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.239189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:40.255664 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-003b33a1-9381-4974-99bf-f18b14783b1a tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-1224860783" status: 201 len: 0 microversion: 2.26 time: 0.125021 Aug 27 05:12:40.257019 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2018/4033] 10.222.0.58 () {62 vars in 1380 bytes} [Sat Aug 27 05:12:40 2022] PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags/tempest-tag-1224860783 => generated 0 bytes in 130 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 05:12:40.262115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-18eca4c1-2b75-4449-bdce-8bde3003493c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '.version_select at 0x7fb5656959d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:40.385541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9897da69-a218-4a7a-a3f6-247a68bf41ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:40.391618 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-18eca4c1-2b75-4449-bdce-8bde3003493c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "DELETE /compute/v2.1/images/997ad68f-23e6-4628-822d-8e8684286dc8" status: 204 len: 0 microversion: 2.1 time: 0.131130 Aug 27 05:12:40.395544 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2019/4034] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:40 2022] DELETE /compute/v2.1/images/997ad68f-23e6-4628-822d-8e8684286dc8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:12:40.406833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Action: 'update_all', calling method: .version_select at 0x7fb56964c820>, body: {"tags": ["tempest-tag-2033491337", "tempest-tag-947117049"]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:40.407155 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9897da69-a218-4a7a-a3f6-247a68bf41ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.185675 Aug 27 05:12:40.411665 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2016/4035] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:40 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:40.412915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a962a4d-bd5b-416a-8c98-0bdb03655f36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:40.413654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a962a4d-bd5b-416a-8c98-0bdb03655f36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:40.418812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.419360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.419811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.420425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:40.421684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a962a4d-bd5b-416a-8c98-0bdb03655f36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.422272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a962a4d-bd5b-416a-8c98-0bdb03655f36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.422818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a962a4d-bd5b-416a-8c98-0bdb03655f36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.423626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a962a4d-bd5b-416a-8c98-0bdb03655f36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.424155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a962a4d-bd5b-416a-8c98-0bdb03655f36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.424649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a962a4d-bd5b-416a-8c98-0bdb03655f36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.426690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.427218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.427662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.428347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.428807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.429243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.450594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.451076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.451534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.472540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:40.490088 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-31de220f-a08f-48cc-9f68-3bc9e505a799 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags" status: 200 len: 61 microversion: 2.26 time: 0.089873 Aug 27 05:12:40.495855 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2020/4036] 10.222.0.58 () {62 vars in 1312 bytes} [Sat Aug 27 05:12:40 2022] PUT /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags => generated 61 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:40.501511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8764a34-e5d8-4ec4-bc33-f91b36c80313 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb569686550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:40.510048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8764a34-e5d8-4ec4-bc33-f91b36c80313 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.510537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8764a34-e5d8-4ec4-bc33-f91b36c80313 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.511324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8764a34-e5d8-4ec4-bc33-f91b36c80313 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.521362 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8764a34-e5d8-4ec4-bc33-f91b36c80313 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags" status: 200 len: 61 microversion: 2.26 time: 0.023852 Aug 27 05:12:40.522192 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2021/4037] 10.222.0.58 () {60 vars in 1292 bytes} [Sat Aug 27 05:12:40 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags => generated 61 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:40.533654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '.version_select at 0x7fb564f4d160>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:40.541867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.542369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.542806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.543309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:40.548618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.549091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.549521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.550194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.550643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.551066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.557784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a962a4d-bd5b-416a-8c98-0bdb03655f36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:40.565931 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a962a4d-bd5b-416a-8c98-0bdb03655f36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1534 microversion: 2.1 time: 0.156784 Aug 27 05:12:40.566521 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2017/4038] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:40 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1534 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:40.574637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.575155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.575592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.589367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'flavor' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:40.604546 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-411c56cc-0477-41ee-bd08-380d1dd91009 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags" status: 204 len: 0 microversion: 2.26 time: 0.075183 Aug 27 05:12:40.605164 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2022/4039] 10.222.0.58 () {60 vars in 1295 bytes} [Sat Aug 27 05:12:40 2022] DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b/tags => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:12:40.615026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cb93c4e4-37ea-4c4a-8e5e-47fe88013cda tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:40.615571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cb93c4e4-37ea-4c4a-8e5e-47fe88013cda tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:40.621914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb93c4e4-37ea-4c4a-8e5e-47fe88013cda tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.622397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb93c4e4-37ea-4c4a-8e5e-47fe88013cda tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.622832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb93c4e4-37ea-4c4a-8e5e-47fe88013cda tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.623558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb93c4e4-37ea-4c4a-8e5e-47fe88013cda tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.624018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb93c4e4-37ea-4c4a-8e5e-47fe88013cda tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.624438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb93c4e4-37ea-4c4a-8e5e-47fe88013cda tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.652105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cb93c4e4-37ea-4c4a-8e5e-47fe88013cda tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:12:40.725875 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cb93c4e4-37ea-4c4a-8e5e-47fe88013cda tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 204 len: 0 microversion: 2.26 time: 0.114879 Aug 27 05:12:40.726443 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2018/4040] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:12:40 2022] DELETE /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:12:40.734585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:40.735279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:40.741620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.742115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.742588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.743323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.743785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.744216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.879924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:40.888942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:40.890707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:40.892263 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f34fd5cf-1c66-4e9d-b377-658adcc4899f tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1551 microversion: 2.26 time: 0.161677 Aug 27 05:12:40.892821 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2023/4041] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:40 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1551 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:12:41.090283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-da0972a0-b464-4339-939a-90f2290bb45a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:41.090980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-da0972a0-b464-4339-939a-90f2290bb45a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:41.096973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da0972a0-b464-4339-939a-90f2290bb45a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:41.097455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da0972a0-b464-4339-939a-90f2290bb45a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:41.097889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da0972a0-b464-4339-939a-90f2290bb45a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:41.098579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da0972a0-b464-4339-939a-90f2290bb45a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:41.099032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da0972a0-b464-4339-939a-90f2290bb45a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:41.099483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da0972a0-b464-4339-939a-90f2290bb45a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:41.226951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-da0972a0-b464-4339-939a-90f2290bb45a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:41.234571 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-da0972a0-b464-4339-939a-90f2290bb45a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1321 microversion: 2.1 time: 0.148474 Aug 27 05:12:41.235151 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2019/4042] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:41 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:41.428228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd95b398-e26b-47f0-b82a-a12bc738fadc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:41.428851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dd95b398-e26b-47f0-b82a-a12bc738fadc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:41.435716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd95b398-e26b-47f0-b82a-a12bc738fadc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:41.436201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd95b398-e26b-47f0-b82a-a12bc738fadc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:41.436646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd95b398-e26b-47f0-b82a-a12bc738fadc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:41.437350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd95b398-e26b-47f0-b82a-a12bc738fadc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:41.437807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd95b398-e26b-47f0-b82a-a12bc738fadc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:41.438237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd95b398-e26b-47f0-b82a-a12bc738fadc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:41.572648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dd95b398-e26b-47f0-b82a-a12bc738fadc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:41.580670 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd95b398-e26b-47f0-b82a-a12bc738fadc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.156308 Aug 27 05:12:41.581283 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2024/4043] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:41 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:41.589398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f1581c7a-eeb6-4934-b2d7-8c8819f4eadd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:41.590011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f1581c7a-eeb6-4934-b2d7-8c8819f4eadd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:41.597049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1581c7a-eeb6-4934-b2d7-8c8819f4eadd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:41.597545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1581c7a-eeb6-4934-b2d7-8c8819f4eadd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:41.597986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1581c7a-eeb6-4934-b2d7-8c8819f4eadd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:41.598718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1581c7a-eeb6-4934-b2d7-8c8819f4eadd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:41.599202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1581c7a-eeb6-4934-b2d7-8c8819f4eadd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:41.599631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1581c7a-eeb6-4934-b2d7-8c8819f4eadd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:41.729992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f1581c7a-eeb6-4934-b2d7-8c8819f4eadd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:41.738431 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f1581c7a-eeb6-4934-b2d7-8c8819f4eadd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1534 microversion: 2.1 time: 0.153520 Aug 27 05:12:41.738999 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2020/4044] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:41 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1534 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:41.916552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:41.917169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:41.918989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=14 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:41.924680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:41.925167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:41.925608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:41.926302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:41.926884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:41.927365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:42.056255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:42.062421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:42.065697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:42.067159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:42.068336 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a4339b04-be74-4a0e-b5db-6f4160049ca8 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1551 microversion: 2.26 time: 0.156375 Aug 27 05:12:42.068905 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2025/4045] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:41 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:42.256154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2d7f9b1d-a738-41b1-a105-88f5de5e5b91 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:42.256768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2d7f9b1d-a738-41b1-a105-88f5de5e5b91 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:42.258616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=26 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:42.260128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:42.266015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d7f9b1d-a738-41b1-a105-88f5de5e5b91 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:42.266495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d7f9b1d-a738-41b1-a105-88f5de5e5b91 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:42.266927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d7f9b1d-a738-41b1-a105-88f5de5e5b91 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:42.267654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d7f9b1d-a738-41b1-a105-88f5de5e5b91 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:42.268105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d7f9b1d-a738-41b1-a105-88f5de5e5b91 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:42.268525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d7f9b1d-a738-41b1-a105-88f5de5e5b91 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:42.398853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2d7f9b1d-a738-41b1-a105-88f5de5e5b91 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:42.406337 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2d7f9b1d-a738-41b1-a105-88f5de5e5b91 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1321 microversion: 2.1 time: 0.154308 Aug 27 05:12:42.406907 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2021/4046] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:42 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:42.603164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ce8060d-71eb-4410-b503-55d5876f1f88 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:42.603801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ce8060d-71eb-4410-b503-55d5876f1f88 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:42.611335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ce8060d-71eb-4410-b503-55d5876f1f88 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:42.611828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ce8060d-71eb-4410-b503-55d5876f1f88 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:42.612273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ce8060d-71eb-4410-b503-55d5876f1f88 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:42.612999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ce8060d-71eb-4410-b503-55d5876f1f88 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:42.613459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ce8060d-71eb-4410-b503-55d5876f1f88 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:42.613888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ce8060d-71eb-4410-b503-55d5876f1f88 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:42.742568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ce8060d-71eb-4410-b503-55d5876f1f88 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:42.750733 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ce8060d-71eb-4410-b503-55d5876f1f88 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.152854 Aug 27 05:12:42.751330 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2026/4047] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:42 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:42.759705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b15d7ff8-bf62-4cbb-9c4e-24d730db6f62 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:42.760443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b15d7ff8-bf62-4cbb-9c4e-24d730db6f62 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:42.762984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=20 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:42.768274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15d7ff8-bf62-4cbb-9c4e-24d730db6f62 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:42.768759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15d7ff8-bf62-4cbb-9c4e-24d730db6f62 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:42.769228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15d7ff8-bf62-4cbb-9c4e-24d730db6f62 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:42.770121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15d7ff8-bf62-4cbb-9c4e-24d730db6f62 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:42.770581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15d7ff8-bf62-4cbb-9c4e-24d730db6f62 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:42.771014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15d7ff8-bf62-4cbb-9c4e-24d730db6f62 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:42.901512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b15d7ff8-bf62-4cbb-9c4e-24d730db6f62 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:42.909160 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b15d7ff8-bf62-4cbb-9c4e-24d730db6f62 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1540 microversion: 2.1 time: 0.154206 Aug 27 05:12:42.909734 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2022/4048] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:42 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1540 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:43.091505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:43.092103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:43.094315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:43.100213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:43.100694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:43.101128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:43.101817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:43.103137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:43.103570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:43.237826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:43.246006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:43.247507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:43.248699 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fb15762a-68f0-4e0c-abbb-18cd1774d3af tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1551 microversion: 2.26 time: 0.161585 Aug 27 05:12:43.249441 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2027/4049] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:43 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1551 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:43.428097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d9751079-a8f6-4b6d-b4b8-0d434a21cc20 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:43.428734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d9751079-a8f6-4b6d-b4b8-0d434a21cc20 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:43.435115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9751079-a8f6-4b6d-b4b8-0d434a21cc20 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:43.435722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9751079-a8f6-4b6d-b4b8-0d434a21cc20 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:43.436161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9751079-a8f6-4b6d-b4b8-0d434a21cc20 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:43.437228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9751079-a8f6-4b6d-b4b8-0d434a21cc20 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:43.437693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9751079-a8f6-4b6d-b4b8-0d434a21cc20 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:43.438474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9751079-a8f6-4b6d-b4b8-0d434a21cc20 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:43.593258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d9751079-a8f6-4b6d-b4b8-0d434a21cc20 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:43.604131 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d9751079-a8f6-4b6d-b4b8-0d434a21cc20 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1321 microversion: 2.1 time: 0.179813 Aug 27 05:12:43.604758 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2023/4050] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:43 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:43.773199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-821e9933-64c5-4cda-b2b6-7188d2b75201 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:43.773823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-821e9933-64c5-4cda-b2b6-7188d2b75201 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:43.799061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-821e9933-64c5-4cda-b2b6-7188d2b75201 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:43.799845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-821e9933-64c5-4cda-b2b6-7188d2b75201 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:43.800604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-821e9933-64c5-4cda-b2b6-7188d2b75201 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:43.802167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-821e9933-64c5-4cda-b2b6-7188d2b75201 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:43.802788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-821e9933-64c5-4cda-b2b6-7188d2b75201 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:43.803853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-821e9933-64c5-4cda-b2b6-7188d2b75201 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:43.870863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7e39d378-97f3-4bdd-a368-5a44011022df req-7f74599d-28b3-49ef-96f9-1aef2c8fb363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "263a0733-49e6-42cf-ad6c-23d43ae09b0b", "name": "network-vif-deleted", "tag": "2416198c-9325-4324-8e19-dea4c0714282"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:43.880894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7e39d378-97f3-4bdd-a368-5a44011022df req-7f74599d-28b3-49ef-96f9-1aef2c8fb363 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:43.881655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7e39d378-97f3-4bdd-a368-5a44011022df req-7f74599d-28b3-49ef-96f9-1aef2c8fb363 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:43.882266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7e39d378-97f3-4bdd-a368-5a44011022df req-7f74599d-28b3-49ef-96f9-1aef2c8fb363 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:43.895807 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7e39d378-97f3-4bdd-a368-5a44011022df req-7f74599d-28b3-49ef-96f9-1aef2c8fb363 service nova] Creating event network-vif-deleted:2416198c-9325-4324-8e19-dea4c0714282 for instance 263a0733-49e6-42cf-ad6c-23d43ae09b0b on n-h2-820368-35 Aug 27 05:12:43.901649 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7e39d378-97f3-4bdd-a368-5a44011022df req-7f74599d-28b3-49ef-96f9-1aef2c8fb363 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117754 Aug 27 05:12:43.902589 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2024/4051] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:43.932872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6903850d-04c3-4837-8a11-d1df43d39e0f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:43.933861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6903850d-04c3-4837-8a11-d1df43d39e0f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:43.940556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6903850d-04c3-4837-8a11-d1df43d39e0f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:43.941276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6903850d-04c3-4837-8a11-d1df43d39e0f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:43.941887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6903850d-04c3-4837-8a11-d1df43d39e0f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:43.942827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6903850d-04c3-4837-8a11-d1df43d39e0f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:43.943510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6903850d-04c3-4837-8a11-d1df43d39e0f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:43.944127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6903850d-04c3-4837-8a11-d1df43d39e0f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:43.955690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-821e9933-64c5-4cda-b2b6-7188d2b75201 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:43.964460 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-821e9933-64c5-4cda-b2b6-7188d2b75201 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.195266 Aug 27 05:12:43.965817 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2028/4052] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:43 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:44.088692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6903850d-04c3-4837-8a11-d1df43d39e0f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:44.097818 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6903850d-04c3-4837-8a11-d1df43d39e0f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1540 microversion: 2.1 time: 0.169646 Aug 27 05:12:44.098715 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2025/4053] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:43 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1540 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:44.271824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:44.272439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:44.278345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:44.278822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:44.279306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:44.279994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:44.280446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:44.280869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:44.312675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:44.313150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:44.313586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:44.314028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lazy-loading 'fault' on Instance uuid 263a0733-49e6-42cf-ad6c-23d43ae09b0b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:44.357928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:44.366241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:44.367725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e0b9a8c46c142debdf7cf8398399742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a00617ff4994b899d6eae47d2eeae00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:44.369505 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-44af5802-5491-4f1e-b318-eaa09bcb301d tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 200 len: 1351 microversion: 2.26 time: 0.101588 Aug 27 05:12:44.370069 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2029/4054] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:44 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:12:44.624777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa721d13-cd83-4f12-aed1-c5d3872a65a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:44.625428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fa721d13-cd83-4f12-aed1-c5d3872a65a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:44.632044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa721d13-cd83-4f12-aed1-c5d3872a65a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:44.632526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa721d13-cd83-4f12-aed1-c5d3872a65a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:44.632956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa721d13-cd83-4f12-aed1-c5d3872a65a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:44.634163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa721d13-cd83-4f12-aed1-c5d3872a65a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:44.634887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa721d13-cd83-4f12-aed1-c5d3872a65a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:44.635335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa721d13-cd83-4f12-aed1-c5d3872a65a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:44.653839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:44.766670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fa721d13-cd83-4f12-aed1-c5d3872a65a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:44.774373 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa721d13-cd83-4f12-aed1-c5d3872a65a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1503 microversion: 2.1 time: 0.153538 Aug 27 05:12:44.774954 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2026/4055] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:44 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:44.794769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0835882b-8ca2-4322-8b81-3e1a6d202ad1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:44.795424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0835882b-8ca2-4322-8b81-3e1a6d202ad1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:44.802472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835882b-8ca2-4322-8b81-3e1a6d202ad1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:44.802968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835882b-8ca2-4322-8b81-3e1a6d202ad1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:44.803450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835882b-8ca2-4322-8b81-3e1a6d202ad1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:44.804159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835882b-8ca2-4322-8b81-3e1a6d202ad1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:44.804624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835882b-8ca2-4322-8b81-3e1a6d202ad1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:44.805057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835882b-8ca2-4322-8b81-3e1a6d202ad1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:44.823445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:44.939998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0835882b-8ca2-4322-8b81-3e1a6d202ad1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:44.948367 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0835882b-8ca2-4322-8b81-3e1a6d202ad1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1503 microversion: 2.1 time: 0.157499 Aug 27 05:12:44.948963 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2030/4056] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:44 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:44.967901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e0cbe2a-0706-4504-ba05-a2927ec4889e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:44.968397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3e0cbe2a-0706-4504-ba05-a2927ec4889e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:44.974718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e0cbe2a-0706-4504-ba05-a2927ec4889e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:44.975239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e0cbe2a-0706-4504-ba05-a2927ec4889e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:44.975680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e0cbe2a-0706-4504-ba05-a2927ec4889e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:44.976373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e0cbe2a-0706-4504-ba05-a2927ec4889e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:44.976826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e0cbe2a-0706-4504-ba05-a2927ec4889e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:44.977252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e0cbe2a-0706-4504-ba05-a2927ec4889e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:44.985803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-492d2ec6-158c-443e-bd8e-8f761a54fbca tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:44.986417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-492d2ec6-158c-443e-bd8e-8f761a54fbca tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:44.992465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-492d2ec6-158c-443e-bd8e-8f761a54fbca tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:44.993499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-492d2ec6-158c-443e-bd8e-8f761a54fbca tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:44.993930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-492d2ec6-158c-443e-bd8e-8f761a54fbca tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:44.994632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-492d2ec6-158c-443e-bd8e-8f761a54fbca tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:44.995101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-492d2ec6-158c-443e-bd8e-8f761a54fbca tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:44.995535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-492d2ec6-158c-443e-bd8e-8f761a54fbca tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:45.007363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3e0cbe2a-0706-4504-ba05-a2927ec4889e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:12:45.088884 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e0cbe2a-0706-4504-ba05-a2927ec4889e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 204 len: 0 microversion: 2.1 time: 0.124309 Aug 27 05:12:45.089789 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2027/4057] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:12:44 2022] DELETE /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:12:45.099133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7626c35c-dc75-4c85-8fff-4feb59c5f720 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:45.100027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7626c35c-dc75-4c85-8fff-4feb59c5f720 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:45.107287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7626c35c-dc75-4c85-8fff-4feb59c5f720 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:45.107784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7626c35c-dc75-4c85-8fff-4feb59c5f720 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:45.108271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7626c35c-dc75-4c85-8fff-4feb59c5f720 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:45.109134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7626c35c-dc75-4c85-8fff-4feb59c5f720 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:45.109488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7626c35c-dc75-4c85-8fff-4feb59c5f720 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:45.109915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7626c35c-dc75-4c85-8fff-4feb59c5f720 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:45.486791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-492d2ec6-158c-443e-bd8e-8f761a54fbca tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:45.494190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7626c35c-dc75-4c85-8fff-4feb59c5f720 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:45.495113 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-492d2ec6-158c-443e-bd8e-8f761a54fbca tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.513422 Aug 27 05:12:45.495765 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2031/4058] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:44 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:45.500365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5e96c34e-0b82-467d-8580-d528fd2a8e2e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:45.500971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5e96c34e-0b82-467d-8580-d528fd2a8e2e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:45.501962 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7626c35c-dc75-4c85-8fff-4feb59c5f720 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1509 microversion: 2.1 time: 0.407161 Aug 27 05:12:45.502718 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2028/4059] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:45 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1509 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:45.506905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:45.507550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] [instance: 263a0733-49e6-42cf-ad6c-23d43ae09b0b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:45.514435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:45.514928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:45.515418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:45.516118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:45.516580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:45.516730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e96c34e-0b82-467d-8580-d528fd2a8e2e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:45.517009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:45.517262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e96c34e-0b82-467d-8580-d528fd2a8e2e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:45.517774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e96c34e-0b82-467d-8580-d528fd2a8e2e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:45.518591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e96c34e-0b82-467d-8580-d528fd2a8e2e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:45.519152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e96c34e-0b82-467d-8580-d528fd2a8e2e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:45.519678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e96c34e-0b82-467d-8580-d528fd2a8e2e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:45.530652 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] HTTP exception thrown: Instance 263a0733-49e6-42cf-ad6c-23d43ae09b0b could not be found. Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Request method failure captured: Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b HTTP/1.1 Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaexndd8Z-rmGSYM8dYqSm0pcct0Q0PxpjGvI6sajpbf7UNbOSkqefBByTfTwfj2Zy6dqDEe11PrWrdUu5g5rdRnoacEUtlSR8D3V3SNjYp8o_qZZWOX_2yMFMZP4RsDYc4ehcMnaYeKv7SCh-Cu7-1ZB8kk2RoqVhi_2BoDmLt2R2g Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.26 Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7a00617ff4994b899d6eae47d2eeae00 Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerTagsTestJSON-2043971325 Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7a00617ff4994b899d6eae47d2eeae00", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7a00617ff4994b899d6eae47d2eeae00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a00617ff4994b899d6eae47d2eeae00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a00617ff4994b899d6eae47d2eeae00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerTagsTestJSON-2043971325 Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7a00617ff4994b899d6eae47d2eeae00 Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerTagsTestJSON-2043971325 Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerTagsTestJSON-2043971325-project Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 0e0b9a8c46c142debdf7cf8398399742 Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerTagsTestJSON-2043971325-project Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 263a0733-49e6-42cf-ad6c-23d43ae09b0b could not be found. Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '263a0733-49e6-42cf-ad6c-23d43ae09b0b'} Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 263a0733-49e6-42cf-ad6c-23d43ae09b0b could not be found. Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 263a0733-49e6-42cf-ad6c-23d43ae09b0b could not be found. Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:45.532332 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:45.540132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:45.540132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:45.540132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:45.540132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:45.540132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:45.540132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 263a0733-49e6-42cf-ad6c-23d43ae09b0b could not be found. Aug 27 05:12:45.540132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:45.540132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] Returning 404 to user: Instance 263a0733-49e6-42cf-ad6c-23d43ae09b0b could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:45.540132 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb974a72-632b-4fc9-8a5f-155e9cd6f633 tempest-ServerTagsTestJSON-2043971325 tempest-ServerTagsTestJSON-2043971325-project] 10.222.0.58 "GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b" status: 404 len: 111 microversion: 2.26 time: 0.030281 Aug 27 05:12:45.540132 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2029/4060] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:45 2022] GET /compute/v2.1/servers/263a0733-49e6-42cf-ad6c-23d43ae09b0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:12:45.762648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5e96c34e-0b82-467d-8580-d528fd2a8e2e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:45.770587 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5e96c34e-0b82-467d-8580-d528fd2a8e2e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1540 microversion: 2.1 time: 0.273814 Aug 27 05:12:45.771195 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2032/4061] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:45 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1540 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:46.114547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0d7700e8-a892-47ea-ba68-370ea834a12c req-3ee3d663-b57b-4f20-8d85-a1492b7b8208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c39d751-b91a-4901-b8fe-f0d280024110", "name": "network-vif-plugged", "status": "completed", "tag": "2be9f11f-25a4-4df1-a652-708e2819755c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:46.128404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0d7700e8-a892-47ea-ba68-370ea834a12c req-3ee3d663-b57b-4f20-8d85-a1492b7b8208 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:46.129029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0d7700e8-a892-47ea-ba68-370ea834a12c req-3ee3d663-b57b-4f20-8d85-a1492b7b8208 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:46.129645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0d7700e8-a892-47ea-ba68-370ea834a12c req-3ee3d663-b57b-4f20-8d85-a1492b7b8208 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:46.142694 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0d7700e8-a892-47ea-ba68-370ea834a12c req-3ee3d663-b57b-4f20-8d85-a1492b7b8208 service nova] Creating event network-vif-plugged:2be9f11f-25a4-4df1-a652-708e2819755c for instance 6c39d751-b91a-4901-b8fe-f0d280024110 on n-h1-820368-35 Aug 27 05:12:46.148056 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0d7700e8-a892-47ea-ba68-370ea834a12c req-3ee3d663-b57b-4f20-8d85-a1492b7b8208 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037527 Aug 27 05:12:46.148847 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2030/4062] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:46.518630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f277a004-b52c-43eb-b1d7-64c99c9432b0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:46.518630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f277a004-b52c-43eb-b1d7-64c99c9432b0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:46.524858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1f9ae08b-8760-4206-bc64-aa1225e23b77 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:46.525561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1f9ae08b-8760-4206-bc64-aa1225e23b77 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:46.535285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f9ae08b-8760-4206-bc64-aa1225e23b77 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:46.535777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f9ae08b-8760-4206-bc64-aa1225e23b77 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:46.536213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f9ae08b-8760-4206-bc64-aa1225e23b77 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:46.536935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f9ae08b-8760-4206-bc64-aa1225e23b77 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:46.537387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f9ae08b-8760-4206-bc64-aa1225e23b77 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:46.537817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f9ae08b-8760-4206-bc64-aa1225e23b77 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:46.544891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f277a004-b52c-43eb-b1d7-64c99c9432b0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:46.545389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f277a004-b52c-43eb-b1d7-64c99c9432b0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:46.545831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f277a004-b52c-43eb-b1d7-64c99c9432b0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:46.546551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f277a004-b52c-43eb-b1d7-64c99c9432b0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:46.547005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f277a004-b52c-43eb-b1d7-64c99c9432b0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:46.547462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f277a004-b52c-43eb-b1d7-64c99c9432b0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:46.855887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f277a004-b52c-43eb-b1d7-64c99c9432b0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:46.865065 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f277a004-b52c-43eb-b1d7-64c99c9432b0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.352202 Aug 27 05:12:46.865727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1f9ae08b-8760-4206-bc64-aa1225e23b77 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:46.875741 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2033/4063] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:46 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:46.886410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-884eb878-7e72-4fbe-bf6d-6eed0abe2b1d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:46.887032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-884eb878-7e72-4fbe-bf6d-6eed0abe2b1d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:46.887769 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1f9ae08b-8760-4206-bc64-aa1225e23b77 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1509 microversion: 2.1 time: 0.367554 Aug 27 05:12:46.898373 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2031/4064] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:46 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:46.898588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-884eb878-7e72-4fbe-bf6d-6eed0abe2b1d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:46.898588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-884eb878-7e72-4fbe-bf6d-6eed0abe2b1d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:46.898588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-884eb878-7e72-4fbe-bf6d-6eed0abe2b1d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:46.898588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-884eb878-7e72-4fbe-bf6d-6eed0abe2b1d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:46.898588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-884eb878-7e72-4fbe-bf6d-6eed0abe2b1d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:46.898588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-884eb878-7e72-4fbe-bf6d-6eed0abe2b1d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:47.121204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-884eb878-7e72-4fbe-bf6d-6eed0abe2b1d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:47.129342 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-884eb878-7e72-4fbe-bf6d-6eed0abe2b1d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1540 microversion: 2.1 time: 0.252425 Aug 27 05:12:47.135139 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2034/4065] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:46 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1540 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:47.461338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-291b297e-a0d4-469b-87be-f83c3501d3db req-b6828012-b15b-4178-8edb-ffbd96f7dfef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e48b153-aae9-4313-8baf-057bfa027e6a", "name": "network-vif-deleted", "tag": "a54be20d-2eca-4a0a-8f76-c26ad3eda581"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:47.473680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-291b297e-a0d4-469b-87be-f83c3501d3db req-b6828012-b15b-4178-8edb-ffbd96f7dfef service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:47.474449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-291b297e-a0d4-469b-87be-f83c3501d3db req-b6828012-b15b-4178-8edb-ffbd96f7dfef service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:47.475144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-291b297e-a0d4-469b-87be-f83c3501d3db req-b6828012-b15b-4178-8edb-ffbd96f7dfef service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:47.493694 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-291b297e-a0d4-469b-87be-f83c3501d3db req-b6828012-b15b-4178-8edb-ffbd96f7dfef service nova] Creating event network-vif-deleted:a54be20d-2eca-4a0a-8f76-c26ad3eda581 for instance 8e48b153-aae9-4313-8baf-057bfa027e6a on n-h2-820368-35 Aug 27 05:12:47.504293 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-291b297e-a0d4-469b-87be-f83c3501d3db req-b6828012-b15b-4178-8edb-ffbd96f7dfef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046946 Aug 27 05:12:47.511026 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2032/4066] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:47.890137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-db4ecfe6-ab93-473a-8019-9a97475b1685 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:47.891946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-db4ecfe6-ab93-473a-8019-9a97475b1685 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:47.898661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4ecfe6-ab93-473a-8019-9a97475b1685 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:47.899695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4ecfe6-ab93-473a-8019-9a97475b1685 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:47.900333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4ecfe6-ab93-473a-8019-9a97475b1685 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:47.901074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4ecfe6-ab93-473a-8019-9a97475b1685 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:47.901847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4ecfe6-ab93-473a-8019-9a97475b1685 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:47.902440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4ecfe6-ab93-473a-8019-9a97475b1685 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:47.911268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:47.912203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:47.926349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:47.926870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:47.927362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:47.929528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:47.930937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:47.931557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:47.968583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:47.969163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:47.969680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:47.970238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lazy-loading 'fault' on Instance uuid 8e48b153-aae9-4313-8baf-057bfa027e6a {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:48.063177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:48.074666 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f3fabf1c-c545-4887-a679-e95ca74ba3da tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 200 len: 1311 microversion: 2.1 time: 0.168684 Aug 27 05:12:48.087155 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2033/4067] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:47 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:48.150764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2cb5adfc-0c6e-4ed3-80e9-f9faf97908b1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:48.151437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2cb5adfc-0c6e-4ed3-80e9-f9faf97908b1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:48.157648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cb5adfc-0c6e-4ed3-80e9-f9faf97908b1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:48.158143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cb5adfc-0c6e-4ed3-80e9-f9faf97908b1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:48.158588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cb5adfc-0c6e-4ed3-80e9-f9faf97908b1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:48.159323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cb5adfc-0c6e-4ed3-80e9-f9faf97908b1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:48.159784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cb5adfc-0c6e-4ed3-80e9-f9faf97908b1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:48.160217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cb5adfc-0c6e-4ed3-80e9-f9faf97908b1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:48.290458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-db4ecfe6-ab93-473a-8019-9a97475b1685 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:48.299244 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-db4ecfe6-ab93-473a-8019-9a97475b1685 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.413002 Aug 27 05:12:48.299858 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2035/4068] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:47 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:48.396253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2cb5adfc-0c6e-4ed3-80e9-f9faf97908b1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:48.405572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2cb5adfc-0c6e-4ed3-80e9-f9faf97908b1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1540 microversion: 2.1 time: 0.259307 Aug 27 05:12:48.406165 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2034/4069] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:48 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1540 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:49.110907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:49.112307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:49.137700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:49.137898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:49.138276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:49.138999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:49.139494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:49.139934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:49.160219 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a HTTP/1.1 Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '8e48b153-aae9-4313-8baf-057bfa027e6a'} Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:49.161745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:49.167830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:49.167830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:49.167830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:49.167830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:49.167830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:49.167830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:12:49.167830 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:49.167830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:49.167830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f091f25c-e209-40f1-9d8d-158b83de8476 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 404 len: 111 microversion: 2.1 time: 0.068826 Aug 27 05:12:49.183686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa074843-9860-45c0-94d3-ed60acc73ff8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'create', calling method: .version_select at 0x7fb5644725e0>, body: {"keypair": {"name": "tempest-key-433385823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8NMkYGCaqIdyzc98tFDX46rTnv1ntj+pjddIW+CpXir/4SdYOB+j1lA2xpQ7FatbtHC7Yy+6gsSf2HBQM02bWPhAyQMN0wAWY4q3Q1/2cikrnh0boUZDOze3fhswR5JA=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:49.188499 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2036/4070] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:49 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:12:49.206870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-fa074843-9860-45c0-94d3-ed60acc73ff8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:49.213026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-fa074843-9860-45c0-94d3-ed60acc73ff8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for user c75dd4d6f001450bb9279d592e9783bd and project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:49.241291 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa074843-9860-45c0-94d3-ed60acc73ff8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.061953 Aug 27 05:12:49.247697 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2035/4071] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:12:49 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:49.254542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6fbe17ef-b7d8-4067-bb48-ff94d7a2f9d4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '.version_select at 0x7fb564c414c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:49.260483 n-d-820368-35 devstack@n-api.service[128548]: WARNING oslo_db.sqlalchemy.utils [None req-6fbe17ef-b7d8-4067-bb48-ff94d7a2f9d4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 05:12:49.266635 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6fbe17ef-b7d8-4067-bb48-ff94d7a2f9d4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.017316 Aug 27 05:12:49.267370 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2037/4072] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:12:49 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:49.320499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6052ba8f-c036-437d-bf1d-778e34e34d2c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:49.321213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6052ba8f-c036-437d-bf1d-778e34e34d2c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:49.332436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2130144408", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "key_name": "tempest-key-433385823", "networks": [{"uuid": "43620fdb-3b93-439f-955c-01e22d65d95a"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:49.333422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6052ba8f-c036-437d-bf1d-778e34e34d2c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:49.333986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6052ba8f-c036-437d-bf1d-778e34e34d2c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:49.337420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6052ba8f-c036-437d-bf1d-778e34e34d2c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:49.338434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6052ba8f-c036-437d-bf1d-778e34e34d2c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:49.341885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6052ba8f-c036-437d-bf1d-778e34e34d2c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:49.342546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6052ba8f-c036-437d-bf1d-778e34e34d2c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:49.429853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] validate_networks() for [('43620fdb-3b93-439f-955c-01e22d65d95a', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:50.033812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6052ba8f-c036-437d-bf1d-778e34e34d2c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:50.042575 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6052ba8f-c036-437d-bf1d-778e34e34d2c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.726223 Aug 27 05:12:50.055884 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2036/4073] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:49 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:50.060928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0416fa37-49ea-4227-a09e-96b0b380160b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:50.061548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0416fa37-49ea-4227-a09e-96b0b380160b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:50.068311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0416fa37-49ea-4227-a09e-96b0b380160b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:50.068799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0416fa37-49ea-4227-a09e-96b0b380160b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:50.069243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0416fa37-49ea-4227-a09e-96b0b380160b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:50.069938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0416fa37-49ea-4227-a09e-96b0b380160b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:50.070390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0416fa37-49ea-4227-a09e-96b0b380160b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:50.071832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0416fa37-49ea-4227-a09e-96b0b380160b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:50.345162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0416fa37-49ea-4227-a09e-96b0b380160b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:50.353498 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0416fa37-49ea-4227-a09e-96b0b380160b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1522 microversion: 2.1 time: 0.296406 Aug 27 05:12:50.354294 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2037/4074] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:50 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:50.374465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f15cb0b-357f-478b-bc4a-ee600c1c350e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:50.374899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f15cb0b-357f-478b-bc4a-ee600c1c350e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:50.384083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f15cb0b-357f-478b-bc4a-ee600c1c350e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:50.384859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f15cb0b-357f-478b-bc4a-ee600c1c350e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:50.385307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f15cb0b-357f-478b-bc4a-ee600c1c350e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:50.386030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f15cb0b-357f-478b-bc4a-ee600c1c350e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:50.386666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f15cb0b-357f-478b-bc4a-ee600c1c350e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:50.387124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f15cb0b-357f-478b-bc4a-ee600c1c350e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:50.415004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f15cb0b-357f-478b-bc4a-ee600c1c350e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:12:50.479784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:50.480800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:50.481292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:50.481876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:50.482478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:50.492352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:50.493671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:50.494305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:50.496057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:50.496417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:50.496809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:50.506733 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f15cb0b-357f-478b-bc4a-ee600c1c350e tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 204 len: 0 microversion: 2.1 time: 0.135933 Aug 27 05:12:50.507384 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2038/4075] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:12:50 2022] DELETE /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:12:50.517257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c9bd907-62a1-4bee-9c65-688c45d2c356 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:50.518214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c9bd907-62a1-4bee-9c65-688c45d2c356 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:50.525200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c9bd907-62a1-4bee-9c65-688c45d2c356 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:50.525376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c9bd907-62a1-4bee-9c65-688c45d2c356 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:50.525641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:50.525767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c9bd907-62a1-4bee-9c65-688c45d2c356 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:50.526385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c9bd907-62a1-4bee-9c65-688c45d2c356 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:50.526844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c9bd907-62a1-4bee-9c65-688c45d2c356 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:50.527303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c9bd907-62a1-4bee-9c65-688c45d2c356 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:50.531274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for user c75dd4d6f001450bb9279d592e9783bd and project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:50.550888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:50.554645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:50.612654 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c599bec5-e45d-4b66-9881-aea924e82c23 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.284476 Aug 27 05:12:50.613304 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2038/4076] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:12:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:12:50.623923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d1883a6-36f8-40fa-8593-81869f701c04 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:50.624618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7d1883a6-36f8-40fa-8593-81869f701c04 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:50.702698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7d1883a6-36f8-40fa-8593-81869f701c04 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:50.714107 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d1883a6-36f8-40fa-8593-81869f701c04 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1228 microversion: 2.1 time: 0.093537 Aug 27 05:12:50.716695 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2039/4077] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:50 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1228 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:50.718865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c9bd907-62a1-4bee-9c65-688c45d2c356 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:50.727372 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c9bd907-62a1-4bee-9c65-688c45d2c356 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1528 microversion: 2.1 time: 0.214729 Aug 27 05:12:50.741820 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2039/4078] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:50 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1528 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:51.066262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33140cbf-7fdd-4535-8500-851df612d06c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:51.066974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-33140cbf-7fdd-4535-8500-851df612d06c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:51.073853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33140cbf-7fdd-4535-8500-851df612d06c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:51.074159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33140cbf-7fdd-4535-8500-851df612d06c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.074598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33140cbf-7fdd-4535-8500-851df612d06c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.075500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33140cbf-7fdd-4535-8500-851df612d06c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:51.075963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33140cbf-7fdd-4535-8500-851df612d06c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.076395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33140cbf-7fdd-4535-8500-851df612d06c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.225436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-33140cbf-7fdd-4535-8500-851df612d06c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:51.234158 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-33140cbf-7fdd-4535-8500-851df612d06c tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.172327 Aug 27 05:12:51.235019 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2040/4079] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:51 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:51.484577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db32f272-7b92-42b6-9977-b1229e7c7b7e tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Action: 'create', calling method: .version_select at 0x7fb564453af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-825361496", "metadata": {"Type": "work"}}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db32f272-7b92-42b6-9977-b1229e7c7b7e tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Request method failure captured: Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 121 Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCafTaf70lZPpdeRXEZDsw5v2a0KK_XE6ImhibOFZNtopTsUSxdYZiBTxY_0aESMBTeuMhUSa6LTTRpMT3BwgBQkQZAyH2wnRUxEAiYHMp8xp4d6v4oP_a7BHhqFggDnYfokIre2p9FUdl9BbAe2_KwWegTTSIZsw_s9lXnzP_eiNPUY Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2742bd012ab24b529248e2592ed1a21f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6d118d8e100a46c293e3f74a5f590a1b Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-825361496", "metadata": {"Type": "work"}}} Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-825361496', 'metadata': {'Type': 'work'}}}} Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi '#$%' Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:12:51.488716 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db32f272-7b92-42b6-9977-b1229e7c7b7e tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db32f272-7b92-42b6-9977-b1229e7c7b7e tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133368 Aug 27 05:12:51.493950 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2040/4080] 10.222.0.58 () {60 vars in 1156 bytes} [Sat Aug 27 05:12:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:12:51.500332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ae903ec-afba-48b2-a4a4-7ecf93d92e3a tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Action: 'create', calling method: .version_select at 0x7fb569537430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-327613032", "metadata": {"Type": "work"}}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ae903ec-afba-48b2-a4a4-7ecf93d92e3a tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Request method failure captured: Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 119 Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCafTaf70lZPpdeRXEZDsw5v2a0KK_XE6ImhibOFZNtopTsUSxdYZiBTxY_0aESMBTeuMhUSa6LTTRpMT3BwgBQkQZAyH2wnRUxEAiYHMp8xp4d6v4oP_a7BHhqFggDnYfokIre2p9FUdl9BbAe2_KwWegTTSIZsw_s9lXnzP_eiNPUY Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2742bd012ab24b529248e2592ed1a21f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6d118d8e100a46c293e3f74a5f590a1b Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-327613032", "metadata": {"Type": "work"}}} Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-327613032', 'metadata': {'Type': 'work'}}}} Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi '0' Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:12:51.504174 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ae903ec-afba-48b2-a4a4-7ecf93d92e3a tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ae903ec-afba-48b2-a4a4-7ecf93d92e3a tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009234 Aug 27 05:12:51.510536 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2041/4081] 10.222.0.58 () {60 vars in 1156 bytes} [Sat Aug 27 05:12:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:12:51.515444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-35864dc1-d4c6-4f06-a3f7-4f77526b7551 tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Action: 'create', calling method: .version_select at 0x7fb56444b280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-981883257", "metadata": {"Type": "work"}}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-35864dc1-d4c6-4f06-a3f7-4f77526b7551 tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Request method failure captured: Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 118 Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCafTaf70lZPpdeRXEZDsw5v2a0KK_XE6ImhibOFZNtopTsUSxdYZiBTxY_0aESMBTeuMhUSa6LTTRpMT3BwgBQkQZAyH2wnRUxEAiYHMp8xp4d6v4oP_a7BHhqFggDnYfokIre2p9FUdl9BbAe2_KwWegTTSIZsw_s9lXnzP_eiNPUY Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2742bd012ab24b529248e2592ed1a21f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6d118d8e100a46c293e3f74a5f590a1b Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-981883257", "metadata": {"Type": "work"}}} Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-981883257', 'metadata': {'Type': 'work'}}}} Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi '' Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:12:51.522198 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-35864dc1-d4c6-4f06-a3f7-4f77526b7551 tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-35864dc1-d4c6-4f06-a3f7-4f77526b7551 tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011943 Aug 27 05:12:51.526968 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2041/4082] 10.222.0.58 () {60 vars in 1156 bytes} [Sat Aug 27 05:12:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:12:51.533384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a290d95a-c05d-481b-a621-b042d6d6338f tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Calling method '.version_select at 0x7fb564ae8040>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:51.563896 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-a290d95a-c05d-481b-a621-b042d6d6338f tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] HTTP exception thrown: Volume tempest-invalid-532388888 could not be found. Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a290d95a-c05d-481b-a621-b042d6d6338f tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Request method failure captured: Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-532388888 HTTP/1.1 Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCafTaf70lZPpdeRXEZDsw5v2a0KK_XE6ImhibOFZNtopTsUSxdYZiBTxY_0aESMBTeuMhUSa6LTTRpMT3BwgBQkQZAyH2wnRUxEAiYHMp8xp4d6v4oP_a7BHhqFggDnYfokIre2p9FUdl9BbAe2_KwWegTTSIZsw_s9lXnzP_eiNPUY Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2742bd012ab24b529248e2592ed1a21f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6d118d8e100a46c293e3f74a5f590a1b Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: exception: Volume tempest-invalid-532388888 could not be found. Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'tempest-invalid-532388888'} Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-532388888 could not be found. (HTTP 404) (Request-ID: req-8b247f60-ad46-4785-838b-00ccd79e06cd) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 05:12:51.565921 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-532388888 could not be found. Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-532388888 could not be found. Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-532388888 could not be found. Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a290d95a-c05d-481b-a621-b042d6d6338f tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Returning 404 to user: Volume tempest-invalid-532388888 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a290d95a-c05d-481b-a621-b042d6d6338f tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-532388888" status: 404 len: 98 microversion: 2.1 time: 0.037948 Aug 27 05:12:51.570603 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2042/4083] 10.222.0.58 () {58 vars in 1215 bytes} [Sat Aug 27 05:12:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-532388888 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:12:51.577573 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de14d252-241f-4bfb-8e78-74636da5e3f5 tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003772 Aug 27 05:12:51.578073 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2042/4084] 10.222.0.58 () {58 vars in 1140 bytes} [Sat Aug 27 05:12:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 05:12:51.586964 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3513ac61-10b7-4194-a077-cec1ca16442c tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004010 Aug 27 05:12:51.587507 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2043/4085] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:12:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 05:12:51.595812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0778fc7e-ebca-4ed0-91ee-9bf36f225e6f tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Calling method '.version_select at 0x7fb56440c8b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:51.624602 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-0778fc7e-ebca-4ed0-91ee-9bf36f225e6f tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] HTTP exception thrown: Volume 4326e8f2-a8ca-4595-854d-da27d1769419 could not be found. Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0778fc7e-ebca-4ed0-91ee-9bf36f225e6f tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Request method failure captured: Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/os-volumes/4326e8f2-a8ca-4595-854d-da27d1769419 HTTP/1.1 Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCafTaf70lZPpdeRXEZDsw5v2a0KK_XE6ImhibOFZNtopTsUSxdYZiBTxY_0aESMBTeuMhUSa6LTTRpMT3BwgBQkQZAyH2wnRUxEAiYHMp8xp4d6v4oP_a7BHhqFggDnYfokIre2p9FUdl9BbAe2_KwWegTTSIZsw_s9lXnzP_eiNPUY Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2742bd012ab24b529248e2592ed1a21f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6d118d8e100a46c293e3f74a5f590a1b Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: exception: Volume 4326e8f2-a8ca-4595-854d-da27d1769419 could not be found. Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '4326e8f2-a8ca-4595-854d-da27d1769419'} Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4326e8f2-a8ca-4595-854d-da27d1769419 could not be found. (HTTP 404) (Request-ID: req-dfe99a64-beb7-4ad4-b3aa-de5f8dc5dfe3) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 05:12:51.626807 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4326e8f2-a8ca-4595-854d-da27d1769419 could not be found. Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4326e8f2-a8ca-4595-854d-da27d1769419 could not be found. Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4326e8f2-a8ca-4595-854d-da27d1769419 could not be found. Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0778fc7e-ebca-4ed0-91ee-9bf36f225e6f tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Returning 404 to user: Volume 4326e8f2-a8ca-4595-854d-da27d1769419 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0778fc7e-ebca-4ed0-91ee-9bf36f225e6f tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/4326e8f2-a8ca-4595-854d-da27d1769419" status: 404 len: 109 microversion: 2.1 time: 0.036172 Aug 27 05:12:51.631476 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2043/4086] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:12:51 2022] DELETE /compute/v2.1/os-volumes/4326e8f2-a8ca-4595-854d-da27d1769419 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:12:51.638512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4c37c28b-477b-4040-987f-6e69e285ca61 tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Calling method '.version_select at 0x7fb569686550>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:51.665442 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-4c37c28b-477b-4040-987f-6e69e285ca61 tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] HTTP exception thrown: Volume e4efb4bf-08b1-4b6e-ba7e-49b0bc2bda33 could not be found. Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4c37c28b-477b-4040-987f-6e69e285ca61 tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Request method failure captured: Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-volumes/e4efb4bf-08b1-4b6e-ba7e-49b0bc2bda33 HTTP/1.1 Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCafTaf70lZPpdeRXEZDsw5v2a0KK_XE6ImhibOFZNtopTsUSxdYZiBTxY_0aESMBTeuMhUSa6LTTRpMT3BwgBQkQZAyH2wnRUxEAiYHMp8xp4d6v4oP_a7BHhqFggDnYfokIre2p9FUdl9BbAe2_KwWegTTSIZsw_s9lXnzP_eiNPUY Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2742bd012ab24b529248e2592ed1a21f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2742bd012ab24b529248e2592ed1a21f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 2742bd012ab24b529248e2592ed1a21f Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesNegativeTest-1998200528 Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6d118d8e100a46c293e3f74a5f590a1b Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesNegativeTest-1998200528-project Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: exception: Volume e4efb4bf-08b1-4b6e-ba7e-49b0bc2bda33 could not be found. Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e4efb4bf-08b1-4b6e-ba7e-49b0bc2bda33'} Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4efb4bf-08b1-4b6e-ba7e-49b0bc2bda33 could not be found. (HTTP 404) (Request-ID: req-1bbc3aa7-ac23-4aa4-a797-c8b7c0b9a3f2) Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 05:12:51.667461 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4efb4bf-08b1-4b6e-ba7e-49b0bc2bda33 could not be found. Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4efb4bf-08b1-4b6e-ba7e-49b0bc2bda33 could not be found. Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4efb4bf-08b1-4b6e-ba7e-49b0bc2bda33 could not be found. Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4c37c28b-477b-4040-987f-6e69e285ca61 tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] Returning 404 to user: Volume e4efb4bf-08b1-4b6e-ba7e-49b0bc2bda33 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4c37c28b-477b-4040-987f-6e69e285ca61 tempest-VolumesNegativeTest-1998200528 tempest-VolumesNegativeTest-1998200528-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e4efb4bf-08b1-4b6e-ba7e-49b0bc2bda33" status: 404 len: 109 microversion: 2.1 time: 0.034449 Aug 27 05:12:51.672046 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2044/4087] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:12:51 2022] GET /compute/v2.1/os-volumes/e4efb4bf-08b1-4b6e-ba7e-49b0bc2bda33 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:12:51.737109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d9afec6-21e4-4c23-908f-6631e5fa8a9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:51.737729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7d9afec6-21e4-4c23-908f-6631e5fa8a9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:51.750795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2a69ea37-4446-4115-bc92-7af763b31238 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:51.755964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2a69ea37-4446-4115-bc92-7af763b31238 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:51.771447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a69ea37-4446-4115-bc92-7af763b31238 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:51.771997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a69ea37-4446-4115-bc92-7af763b31238 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.772443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a69ea37-4446-4115-bc92-7af763b31238 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.773227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a69ea37-4446-4115-bc92-7af763b31238 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:51.773690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a69ea37-4446-4115-bc92-7af763b31238 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.774159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a69ea37-4446-4115-bc92-7af763b31238 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.931902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2a69ea37-4446-4115-bc92-7af763b31238 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:51.941406 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2a69ea37-4446-4115-bc92-7af763b31238 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1528 microversion: 2.1 time: 0.194749 Aug 27 05:12:51.942029 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2045/4088] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:51 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1528 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:52.065443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d9afec6-21e4-4c23-908f-6631e5fa8a9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.065943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d9afec6-21e4-4c23-908f-6631e5fa8a9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.066407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d9afec6-21e4-4c23-908f-6631e5fa8a9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.067272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d9afec6-21e4-4c23-908f-6631e5fa8a9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.067674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d9afec6-21e4-4c23-908f-6631e5fa8a9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.068289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d9afec6-21e4-4c23-908f-6631e5fa8a9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.141787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7d9afec6-21e4-4c23-908f-6631e5fa8a9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:52.149907 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7d9afec6-21e4-4c23-908f-6631e5fa8a9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1286 microversion: 2.1 time: 0.416671 Aug 27 05:12:52.150469 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2044/4089] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:51 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1286 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:52.255833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-58320793-2561-421c-be30-742eddc82e96 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:52.256482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-58320793-2561-421c-be30-742eddc82e96 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:52.263556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58320793-2561-421c-be30-742eddc82e96 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.264224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58320793-2561-421c-be30-742eddc82e96 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.264865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58320793-2561-421c-be30-742eddc82e96 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.265534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58320793-2561-421c-be30-742eddc82e96 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.265987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58320793-2561-421c-be30-742eddc82e96 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.266417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58320793-2561-421c-be30-742eddc82e96 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.434723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-58320793-2561-421c-be30-742eddc82e96 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:52.447255 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-58320793-2561-421c-be30-742eddc82e96 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.195232 Aug 27 05:12:52.447845 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2046/4090] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:52 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:52.526362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b7824b74-a674-4cf1-902e-dd588a0840c5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:52.526876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b7824b74-a674-4cf1-902e-dd588a0840c5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:52.539202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7824b74-a674-4cf1-902e-dd588a0840c5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.540562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7824b74-a674-4cf1-902e-dd588a0840c5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.541875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7824b74-a674-4cf1-902e-dd588a0840c5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.542980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7824b74-a674-4cf1-902e-dd588a0840c5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.544116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7824b74-a674-4cf1-902e-dd588a0840c5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.545084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7824b74-a674-4cf1-902e-dd588a0840c5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.580427 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b7824b74-a674-4cf1-902e-dd588a0840c5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments/3a70e3da-5f8a-4469-a189-68117472ff0c" status: 200 len: 194 microversion: 2.20 time: 0.301766 Aug 27 05:12:52.581354 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2045/4091] 10.222.0.58 () {60 vars in 1454 bytes} [Sat Aug 27 05:12:52 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments/3a70e3da-5f8a-4469-a189-68117472ff0c => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:12:52.665868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b93b8a46-401f-45bb-b927-f8d7526631d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:52.666444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b93b8a46-401f-45bb-b927-f8d7526631d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:52.672812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b93b8a46-401f-45bb-b927-f8d7526631d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.673467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b93b8a46-401f-45bb-b927-f8d7526631d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.674573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b93b8a46-401f-45bb-b927-f8d7526631d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.676361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b93b8a46-401f-45bb-b927-f8d7526631d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.676866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b93b8a46-401f-45bb-b927-f8d7526631d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.677252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b93b8a46-401f-45bb-b927-f8d7526631d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.792168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-b93b8a46-401f-45bb-b927-f8d7526631d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lazy-loading 'services' on Instance uuid 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:52.929229 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b93b8a46-401f-45bb-b927-f8d7526631d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments/3a70e3da-5f8a-4469-a189-68117472ff0c" status: 202 len: 0 microversion: 2.20 time: 0.268341 Aug 27 05:12:52.929757 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2047/4092] 10.222.0.58 () {60 vars in 1457 bytes} [Sat Aug 27 05:12:52 2022] DELETE /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments/3a70e3da-5f8a-4469-a189-68117472ff0c => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:12:52.945054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65d8d17d-be82-44e7-97a5-3c6575bd5b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:52.953083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-65d8d17d-be82-44e7-97a5-3c6575bd5b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:52.967138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f2546184-71c9-40c3-92ae-1e3e0db3e255 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:52.970044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f2546184-71c9-40c3-92ae-1e3e0db3e255 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:52.978367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d8d17d-be82-44e7-97a5-3c6575bd5b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.978875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d8d17d-be82-44e7-97a5-3c6575bd5b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.979358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d8d17d-be82-44e7-97a5-3c6575bd5b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.980088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d8d17d-be82-44e7-97a5-3c6575bd5b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.980552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d8d17d-be82-44e7-97a5-3c6575bd5b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.980801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2546184-71c9-40c3-92ae-1e3e0db3e255 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.980987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d8d17d-be82-44e7-97a5-3c6575bd5b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.981648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2546184-71c9-40c3-92ae-1e3e0db3e255 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.982268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2546184-71c9-40c3-92ae-1e3e0db3e255 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.983487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2546184-71c9-40c3-92ae-1e3e0db3e255 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.997773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2546184-71c9-40c3-92ae-1e3e0db3e255 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.999080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2546184-71c9-40c3-92ae-1e3e0db3e255 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:53.030567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:53.049314 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-65d8d17d-be82-44e7-97a5-3c6575bd5b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114267 Aug 27 05:12:53.050053 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2046/4093] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 05:12:52 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:12:53.172247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4e865d9-fa3a-4938-8e1b-2f7b98134549 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:53.172964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4e865d9-fa3a-4938-8e1b-2f7b98134549 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:53.179724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4e865d9-fa3a-4938-8e1b-2f7b98134549 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:53.181571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4e865d9-fa3a-4938-8e1b-2f7b98134549 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:53.182293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4e865d9-fa3a-4938-8e1b-2f7b98134549 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:53.183269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4e865d9-fa3a-4938-8e1b-2f7b98134549 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:53.183930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4e865d9-fa3a-4938-8e1b-2f7b98134549 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:53.184568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4e865d9-fa3a-4938-8e1b-2f7b98134549 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:53.217479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f2546184-71c9-40c3-92ae-1e3e0db3e255 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:53.227701 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f2546184-71c9-40c3-92ae-1e3e0db3e255 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1528 microversion: 2.1 time: 0.266586 Aug 27 05:12:53.230062 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2048/4094] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:52 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1528 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:53.351204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b4e865d9-fa3a-4938-8e1b-2f7b98134549 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:53.363112 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4e865d9-fa3a-4938-8e1b-2f7b98134549 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1328 microversion: 2.1 time: 0.195275 Aug 27 05:12:53.367612 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2047/4095] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:53 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1328 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:53.474548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5c7c1ca-b83e-4834-afe9-b89e633c9141 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:53.475831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f5c7c1ca-b83e-4834-afe9-b89e633c9141 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:53.484055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5c7c1ca-b83e-4834-afe9-b89e633c9141 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:53.484821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5c7c1ca-b83e-4834-afe9-b89e633c9141 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:53.485622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5c7c1ca-b83e-4834-afe9-b89e633c9141 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:53.486528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5c7c1ca-b83e-4834-afe9-b89e633c9141 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:53.497367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5c7c1ca-b83e-4834-afe9-b89e633c9141 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:53.498647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5c7c1ca-b83e-4834-afe9-b89e633c9141 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:53.685804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f5c7c1ca-b83e-4834-afe9-b89e633c9141 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:53.701589 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5c7c1ca-b83e-4834-afe9-b89e633c9141 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.235081 Aug 27 05:12:53.702930 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2049/4096] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:53 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:53.856002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9377f70e-c070-436a-a48e-daa71c878d26 req-36c8526e-0237-4809-a690-4de09a1d3a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2179539-1d65-4da2-9ffa-cc66ee2000a1", "tag": "783824ae-3016-4f15-a3ae-18ec46c14ed2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:53.871888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9377f70e-c070-436a-a48e-daa71c878d26 req-36c8526e-0237-4809-a690-4de09a1d3a2e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:53.873091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9377f70e-c070-436a-a48e-daa71c878d26 req-36c8526e-0237-4809-a690-4de09a1d3a2e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:53.873975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9377f70e-c070-436a-a48e-daa71c878d26 req-36c8526e-0237-4809-a690-4de09a1d3a2e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:53.893640 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9377f70e-c070-436a-a48e-daa71c878d26 req-36c8526e-0237-4809-a690-4de09a1d3a2e service nova] Creating event network-changed:783824ae-3016-4f15-a3ae-18ec46c14ed2 for instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 on n-h2-820368-35 Aug 27 05:12:53.902416 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9377f70e-c070-436a-a48e-daa71c878d26 req-36c8526e-0237-4809-a690-4de09a1d3a2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052083 Aug 27 05:12:53.904748 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2048/4097] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:54.064891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fda302b7-3c67-46e1-8970-7a14ae8baa34 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:54.068819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fda302b7-3c67-46e1-8970-7a14ae8baa34 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:54.094935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fda302b7-3c67-46e1-8970-7a14ae8baa34 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:54.096455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fda302b7-3c67-46e1-8970-7a14ae8baa34 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:54.097744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fda302b7-3c67-46e1-8970-7a14ae8baa34 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:54.098610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fda302b7-3c67-46e1-8970-7a14ae8baa34 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:54.101494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fda302b7-3c67-46e1-8970-7a14ae8baa34 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:54.104140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fda302b7-3c67-46e1-8970-7a14ae8baa34 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:54.189086 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fda302b7-3c67-46e1-8970-7a14ae8baa34 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.130409 Aug 27 05:12:54.190847 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2050/4098] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 05:12:54 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:12:54.251075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fbd8694c-c493-43fb-abe5-88e8473a62e4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:54.251983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fbd8694c-c493-43fb-abe5-88e8473a62e4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:54.262978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbd8694c-c493-43fb-abe5-88e8473a62e4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:54.263553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbd8694c-c493-43fb-abe5-88e8473a62e4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:54.263947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbd8694c-c493-43fb-abe5-88e8473a62e4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:54.265118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbd8694c-c493-43fb-abe5-88e8473a62e4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:54.266192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbd8694c-c493-43fb-abe5-88e8473a62e4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:54.267666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbd8694c-c493-43fb-abe5-88e8473a62e4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:54.375726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fbd8694c-c493-43fb-abe5-88e8473a62e4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:54.385495 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fbd8694c-c493-43fb-abe5-88e8473a62e4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1486 microversion: 2.1 time: 0.139364 Aug 27 05:12:54.387019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-782a1a29-b2f3-40e1-bbb2-831b5384bf09 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:54.387600 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2049/4099] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:54 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1486 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:54.387999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-782a1a29-b2f3-40e1-bbb2-831b5384bf09 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:54.440796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-782a1a29-b2f3-40e1-bbb2-831b5384bf09 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:54.459518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-782a1a29-b2f3-40e1-bbb2-831b5384bf09 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:54.460452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-782a1a29-b2f3-40e1-bbb2-831b5384bf09 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:54.462079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-782a1a29-b2f3-40e1-bbb2-831b5384bf09 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:54.463786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-782a1a29-b2f3-40e1-bbb2-831b5384bf09 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:54.464496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-782a1a29-b2f3-40e1-bbb2-831b5384bf09 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:54.725288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b799f0a-8ab5-4248-8d67-4c2c996a5133 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:54.730073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6b799f0a-8ab5-4248-8d67-4c2c996a5133 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:54.733275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-782a1a29-b2f3-40e1-bbb2-831b5384bf09 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:54.742366 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-782a1a29-b2f3-40e1-bbb2-831b5384bf09 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1328 microversion: 2.1 time: 0.361248 Aug 27 05:12:54.743235 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2051/4100] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:54 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1328 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:54.743445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b799f0a-8ab5-4248-8d67-4c2c996a5133 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:54.743938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b799f0a-8ab5-4248-8d67-4c2c996a5133 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:54.744384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b799f0a-8ab5-4248-8d67-4c2c996a5133 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:54.745096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b799f0a-8ab5-4248-8d67-4c2c996a5133 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:54.745701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b799f0a-8ab5-4248-8d67-4c2c996a5133 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:54.746132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b799f0a-8ab5-4248-8d67-4c2c996a5133 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:54.911266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6b799f0a-8ab5-4248-8d67-4c2c996a5133 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:54.924142 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b799f0a-8ab5-4248-8d67-4c2c996a5133 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.202543 Aug 27 05:12:54.925357 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2050/4101] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:54 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:55.204800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-31399aea-99fb-423d-a09a-3d44cfbf347b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:55.208909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-31399aea-99fb-423d-a09a-3d44cfbf347b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:55.217734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31399aea-99fb-423d-a09a-3d44cfbf347b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:55.218413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31399aea-99fb-423d-a09a-3d44cfbf347b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:55.218852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31399aea-99fb-423d-a09a-3d44cfbf347b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:55.219584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31399aea-99fb-423d-a09a-3d44cfbf347b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:55.220042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31399aea-99fb-423d-a09a-3d44cfbf347b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:55.220468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31399aea-99fb-423d-a09a-3d44cfbf347b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:55.271314 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-31399aea-99fb-423d-a09a-3d44cfbf347b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072911 Aug 27 05:12:55.272154 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2052/4102] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 05:12:55 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 05:12:55.411842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:55.412647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:55.420524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:55.421021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:55.421523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:55.422240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:55.422748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:55.423206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:55.458269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:55.459022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:55.459426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:55.460254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lazy-loading 'fault' on Instance uuid 6c39d751-b91a-4901-b8fe-f0d280024110 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:55.508584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:55.517789 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0e481a17-af85-4152-8c7f-4d52489f5c93 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 200 len: 1314 microversion: 2.1 time: 0.110802 Aug 27 05:12:55.518438 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2051/4103] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:55 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 1314 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:55.764187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d9fb8fcd-e9ee-4e9c-a911-103c727ffa11 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:55.765464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d9fb8fcd-e9ee-4e9c-a911-103c727ffa11 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:55.771961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9fb8fcd-e9ee-4e9c-a911-103c727ffa11 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:55.772670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9fb8fcd-e9ee-4e9c-a911-103c727ffa11 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:55.773277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9fb8fcd-e9ee-4e9c-a911-103c727ffa11 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:55.774566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9fb8fcd-e9ee-4e9c-a911-103c727ffa11 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:55.775022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9fb8fcd-e9ee-4e9c-a911-103c727ffa11 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:55.775482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9fb8fcd-e9ee-4e9c-a911-103c727ffa11 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:55.941468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-77678dff-28a2-437e-acbd-0ae0b4cd3bb7 req-ed282df5-0ed1-436a-929b-8224fed35d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c39d751-b91a-4901-b8fe-f0d280024110", "name": "network-vif-deleted", "tag": "2be9f11f-25a4-4df1-a652-708e2819755c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:55.944473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d9fb8fcd-e9ee-4e9c-a911-103c727ffa11 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:55.956949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-77678dff-28a2-437e-acbd-0ae0b4cd3bb7 req-ed282df5-0ed1-436a-929b-8224fed35d68 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:55.957711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-77678dff-28a2-437e-acbd-0ae0b4cd3bb7 req-ed282df5-0ed1-436a-929b-8224fed35d68 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:55.958391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-77678dff-28a2-437e-acbd-0ae0b4cd3bb7 req-ed282df5-0ed1-436a-929b-8224fed35d68 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:55.958629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:55.970151 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d9fb8fcd-e9ee-4e9c-a911-103c727ffa11 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1328 microversion: 2.1 time: 0.210354 Aug 27 05:12:55.970672 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2053/4104] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:55 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1328 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:55.972708 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-77678dff-28a2-437e-acbd-0ae0b4cd3bb7 req-ed282df5-0ed1-436a-929b-8224fed35d68 service nova] Creating event network-vif-deleted:2be9f11f-25a4-4df1-a652-708e2819755c for instance 6c39d751-b91a-4901-b8fe-f0d280024110 on n-h1-820368-35 Aug 27 05:12:55.985929 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-77678dff-28a2-437e-acbd-0ae0b4cd3bb7 req-ed282df5-0ed1-436a-929b-8224fed35d68 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048407 Aug 27 05:12:55.987302 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2052/4105] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:55.989688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e11cfa7-a4d0-4fa7-8091-da6b47118b9d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:55.990306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e11cfa7-a4d0-4fa7-8091-da6b47118b9d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:55.998173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e11cfa7-a4d0-4fa7-8091-da6b47118b9d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:55.998887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e11cfa7-a4d0-4fa7-8091-da6b47118b9d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:55.999489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e11cfa7-a4d0-4fa7-8091-da6b47118b9d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:56.000239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e11cfa7-a4d0-4fa7-8091-da6b47118b9d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:56.000701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e11cfa7-a4d0-4fa7-8091-da6b47118b9d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:56.001185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e11cfa7-a4d0-4fa7-8091-da6b47118b9d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:56.161013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e11cfa7-a4d0-4fa7-8091-da6b47118b9d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:56.168940 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e11cfa7-a4d0-4fa7-8091-da6b47118b9d tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.183804 Aug 27 05:12:56.169529 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2054/4106] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:55 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:56.284807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23735fa9-137f-40d0-9271-7b31c4026fcf tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:56.287054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-23735fa9-137f-40d0-9271-7b31c4026fcf tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:56.293234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23735fa9-137f-40d0-9271-7b31c4026fcf tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:56.293719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23735fa9-137f-40d0-9271-7b31c4026fcf tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:56.294152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23735fa9-137f-40d0-9271-7b31c4026fcf tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:56.294860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23735fa9-137f-40d0-9271-7b31c4026fcf tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:56.295352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23735fa9-137f-40d0-9271-7b31c4026fcf tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:56.295766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23735fa9-137f-40d0-9271-7b31c4026fcf tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:56.328574 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-23735fa9-137f-40d0-9271-7b31c4026fcf tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047986 Aug 27 05:12:56.329414 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2053/4107] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 05:12:56 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:12:56.538321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:56.538944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:56.544970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:56.545643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:56.546107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:56.546822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:56.547326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:56.547757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:56.561713 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] HTTP exception thrown: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 HTTP/1.1 Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '6c39d751-b91a-4901-b8fe-f0d280024110'} Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:56.563476 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:56.569969 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:56.569969 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:56.569969 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:56.569969 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:56.569969 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:56.569969 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:56.569969 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:12:56.569969 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:12:56.569969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 404 to user: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:56.569969 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a09098a-0b46-4215-948b-762aec6a2fba tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 404 len: 111 microversion: 2.1 time: 0.030490 Aug 27 05:12:56.569969 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2055/4108] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:56 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:12:56.579908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0c28d2d5-2b6a-4adf-94a9-85388c57e182 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Action: 'create', calling method: .version_select at 0x7fb5648cc430>, body: {"keypair": {"name": "tempest-keypair-1187774505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInFt5jXjAJmzV6o58Xr245puoeJKCc7xfuR2lt+W/TepW4CNk1F3qq4xhF35icx6jSTwc/vbgB4a4ihUhOr98N3+1FPUSqrRTWi/Z0J8v6bYBDzjXwKz1qesdRVlFEHIg=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:56.597904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0c28d2d5-2b6a-4adf-94a9-85388c57e182 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Getting quotas for project 05bb331ed3d141f9950c5fbe121f3e7f. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:56.603361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0c28d2d5-2b6a-4adf-94a9-85388c57e182 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Getting quotas for user 6438306d009f43f6a1aac4dc35b07ecf and project 05bb331ed3d141f9950c5fbe121f3e7f. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:56.630565 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0c28d2d5-2b6a-4adf-94a9-85388c57e182 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054711 Aug 27 05:12:56.631457 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2054/4109] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:12:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:56.991676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ca1aa939-f275-4127-9a5d-7022cc9bf100 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:56.992824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ca1aa939-f275-4127-9a5d-7022cc9bf100 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:57.001498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca1aa939-f275-4127-9a5d-7022cc9bf100 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:57.001938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca1aa939-f275-4127-9a5d-7022cc9bf100 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:57.002554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca1aa939-f275-4127-9a5d-7022cc9bf100 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:57.003456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca1aa939-f275-4127-9a5d-7022cc9bf100 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:57.004138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca1aa939-f275-4127-9a5d-7022cc9bf100 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:57.004575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca1aa939-f275-4127-9a5d-7022cc9bf100 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:57.157222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ca1aa939-f275-4127-9a5d-7022cc9bf100 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:57.168181 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ca1aa939-f275-4127-9a5d-7022cc9bf100 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1328 microversion: 2.1 time: 0.181697 Aug 27 05:12:57.169227 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2056/4110] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:56 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1328 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:57.190950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fd6c0cea-9f57-4311-8ce5-3b28ecbbbd64 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:57.191593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fd6c0cea-9f57-4311-8ce5-3b28ecbbbd64 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:57.198817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd6c0cea-9f57-4311-8ce5-3b28ecbbbd64 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:57.199350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd6c0cea-9f57-4311-8ce5-3b28ecbbbd64 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:57.199784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd6c0cea-9f57-4311-8ce5-3b28ecbbbd64 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:57.200649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd6c0cea-9f57-4311-8ce5-3b28ecbbbd64 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:57.201252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd6c0cea-9f57-4311-8ce5-3b28ecbbbd64 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:57.201944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd6c0cea-9f57-4311-8ce5-3b28ecbbbd64 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:57.341147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-34e060c2-06ee-4d56-8b8d-2b88d160c9c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:57.343799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-34e060c2-06ee-4d56-8b8d-2b88d160c9c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:57.350963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e060c2-06ee-4d56-8b8d-2b88d160c9c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:57.352303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e060c2-06ee-4d56-8b8d-2b88d160c9c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:57.352902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e060c2-06ee-4d56-8b8d-2b88d160c9c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:57.353905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e060c2-06ee-4d56-8b8d-2b88d160c9c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:57.354700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e060c2-06ee-4d56-8b8d-2b88d160c9c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:57.355623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34e060c2-06ee-4d56-8b8d-2b88d160c9c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:57.361054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fd6c0cea-9f57-4311-8ce5-3b28ecbbbd64 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:57.371438 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fd6c0cea-9f57-4311-8ce5-3b28ecbbbd64 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.185247 Aug 27 05:12:57.372969 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2055/4111] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:57 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:57.429767 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-34e060c2-06ee-4d56-8b8d-2b88d160c9c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092850 Aug 27 05:12:57.431524 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2057/4112] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 05:12:57 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:12:58.194686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9cf8bf8-151d-42a8-93c6-9b210c7f0c42 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:58.195985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9cf8bf8-151d-42a8-93c6-9b210c7f0c42 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:58.212564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9cf8bf8-151d-42a8-93c6-9b210c7f0c42 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:58.215315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9cf8bf8-151d-42a8-93c6-9b210c7f0c42 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:58.216055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9cf8bf8-151d-42a8-93c6-9b210c7f0c42 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:58.217863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9cf8bf8-151d-42a8-93c6-9b210c7f0c42 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:58.219260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9cf8bf8-151d-42a8-93c6-9b210c7f0c42 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:58.221385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9cf8bf8-151d-42a8-93c6-9b210c7f0c42 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:58.394701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a3d009f-cff8-4cb8-8dcd-7900b3675680 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:58.395370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7a3d009f-cff8-4cb8-8dcd-7900b3675680 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:58.407875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a3d009f-cff8-4cb8-8dcd-7900b3675680 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:58.415551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a3d009f-cff8-4cb8-8dcd-7900b3675680 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:58.416080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a3d009f-cff8-4cb8-8dcd-7900b3675680 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:58.416858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a3d009f-cff8-4cb8-8dcd-7900b3675680 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:58.417347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a3d009f-cff8-4cb8-8dcd-7900b3675680 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:58.417787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a3d009f-cff8-4cb8-8dcd-7900b3675680 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:58.442782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f9cf8bf8-151d-42a8-93c6-9b210c7f0c42 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:58.454113 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9cf8bf8-151d-42a8-93c6-9b210c7f0c42 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1328 microversion: 2.1 time: 0.267462 Aug 27 05:12:58.455963 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2056/4113] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:58 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1328 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:58.463879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b00f741a-77bc-4298-9d3f-dcd458a5a755 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:58.467142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b00f741a-77bc-4298-9d3f-dcd458a5a755 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:58.470743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:58.476123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00f741a-77bc-4298-9d3f-dcd458a5a755 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:58.476600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00f741a-77bc-4298-9d3f-dcd458a5a755 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:58.478211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00f741a-77bc-4298-9d3f-dcd458a5a755 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:58.479281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00f741a-77bc-4298-9d3f-dcd458a5a755 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:58.479797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00f741a-77bc-4298-9d3f-dcd458a5a755 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:58.480263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00f741a-77bc-4298-9d3f-dcd458a5a755 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:58.553870 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b00f741a-77bc-4298-9d3f-dcd458a5a755 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095767 Aug 27 05:12:58.555291 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2057/4114] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 05:12:58 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:12:58.684121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7a3d009f-cff8-4cb8-8dcd-7900b3675680 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:58.697285 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a3d009f-cff8-4cb8-8dcd-7900b3675680 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1522 microversion: 2.1 time: 0.307012 Aug 27 05:12:58.707478 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2058/4115] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:58 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:58.819362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2045628202", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:58.903797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] validate_networks() for [('76473937-2038-466b-84c2-4acb1818557e', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:59.317606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:59.318207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:59.318505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:59.318944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:59.319369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:59.329855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.330349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.330798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.331646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.332219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.332723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.350146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Getting quotas for project 05bb331ed3d141f9950c5fbe121f3e7f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:59.355942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Getting quotas for user 6438306d009f43f6a1aac4dc35b07ecf and project 05bb331ed3d141f9950c5fbe121f3e7f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:59.369024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:59.371256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:59.425008 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3cad9416-580e-4078-b7cd-741847e32bab tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.610607 Aug 27 05:12:59.432066 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2058/4116] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:12:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:12:59.437266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6cf86bf4-d971-47e4-9e4b-03cdcc8b0be1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:59.437882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6cf86bf4-d971-47e4-9e4b-03cdcc8b0be1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:59.481131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed84402a-ace5-4808-b6dd-79e3b061dda6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:59.481768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed84402a-ace5-4808-b6dd-79e3b061dda6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:59.491402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed84402a-ace5-4808-b6dd-79e3b061dda6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.491903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed84402a-ace5-4808-b6dd-79e3b061dda6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.492904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed84402a-ace5-4808-b6dd-79e3b061dda6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.493898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed84402a-ace5-4808-b6dd-79e3b061dda6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.494543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed84402a-ace5-4808-b6dd-79e3b061dda6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.494979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed84402a-ace5-4808-b6dd-79e3b061dda6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.506351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6cf86bf4-d971-47e4-9e4b-03cdcc8b0be1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:59.516639 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6cf86bf4-d971-47e4-9e4b-03cdcc8b0be1 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1225 microversion: 2.1 time: 0.083137 Aug 27 05:12:59.517607 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2059/4117] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:59 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:59.567464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-48eefebb-003c-48a4-bb70-9b314b202b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:59.570911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-48eefebb-003c-48a4-bb70-9b314b202b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:59.584791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48eefebb-003c-48a4-bb70-9b314b202b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.585576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48eefebb-003c-48a4-bb70-9b314b202b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.586128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48eefebb-003c-48a4-bb70-9b314b202b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.586912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48eefebb-003c-48a4-bb70-9b314b202b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.587464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48eefebb-003c-48a4-bb70-9b314b202b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.588223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48eefebb-003c-48a4-bb70-9b314b202b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.627105 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-48eefebb-003c-48a4-bb70-9b314b202b2d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063898 Aug 27 05:12:59.634201 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2060/4118] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 05:12:59 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:59.675525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ed84402a-ace5-4808-b6dd-79e3b061dda6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:59.688806 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed84402a-ace5-4808-b6dd-79e3b061dda6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1328 microversion: 2.1 time: 0.214125 Aug 27 05:12:59.689436 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2059/4119] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:59 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1328 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:59.721211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a0c57c74-8ca7-4dc1-9e1a-5d3cda1ee3af tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:59.721985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a0c57c74-8ca7-4dc1-9e1a-5d3cda1ee3af tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:59.729240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0c57c74-8ca7-4dc1-9e1a-5d3cda1ee3af tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.729824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0c57c74-8ca7-4dc1-9e1a-5d3cda1ee3af tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.730341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0c57c74-8ca7-4dc1-9e1a-5d3cda1ee3af tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.731156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0c57c74-8ca7-4dc1-9e1a-5d3cda1ee3af tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.731959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0c57c74-8ca7-4dc1-9e1a-5d3cda1ee3af tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.732586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0c57c74-8ca7-4dc1-9e1a-5d3cda1ee3af tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.737568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a7a1c01-1806-4e5e-9d4e-e4386d778c2e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:59.738312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a7a1c01-1806-4e5e-9d4e-e4386d778c2e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:59.747256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c01-1806-4e5e-9d4e-e4386d778c2e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.750353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c01-1806-4e5e-9d4e-e4386d778c2e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.750973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c01-1806-4e5e-9d4e-e4386d778c2e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.751891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c01-1806-4e5e-9d4e-e4386d778c2e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.752361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c01-1806-4e5e-9d4e-e4386d778c2e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.752792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c01-1806-4e5e-9d4e-e4386d778c2e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.788972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a7a1c01-1806-4e5e-9d4e-e4386d778c2e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:12:59.917476 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a7a1c01-1806-4e5e-9d4e-e4386d778c2e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 204 len: 0 microversion: 2.20 time: 0.185992 Aug 27 05:12:59.918028 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2060/4120] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:12:59 2022] DELETE /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:12:59.927682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:59.928417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:59.949679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.950253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.950700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.952261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.952733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.953293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.953615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a0c57c74-8ca7-4dc1-9e1a-5d3cda1ee3af tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:59.966478 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a0c57c74-8ca7-4dc1-9e1a-5d3cda1ee3af tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1499 microversion: 2.1 time: 0.248569 Aug 27 05:12:59.970291 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2061/4121] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:59 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1499 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:59.991925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b778d4c1-eb84-4db3-a887-19ad062996d9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:59.997727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b778d4c1-eb84-4db3-a887-19ad062996d9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:59.999469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b778d4c1-eb84-4db3-a887-19ad062996d9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:00.020652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b778d4c1-eb84-4db3-a887-19ad062996d9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.021150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b778d4c1-eb84-4db3-a887-19ad062996d9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.021595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b778d4c1-eb84-4db3-a887-19ad062996d9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.027520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b778d4c1-eb84-4db3-a887-19ad062996d9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.029370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b778d4c1-eb84-4db3-a887-19ad062996d9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.032042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b778d4c1-eb84-4db3-a887-19ad062996d9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.090278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-b778d4c1-eb84-4db3-a887-19ad062996d9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:13:00.144318 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b778d4c1-eb84-4db3-a887-19ad062996d9 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.156028 Aug 27 05:13:00.152001 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2062/4122] 10.222.0.58 () {58 vars in 1154 bytes} [Sat Aug 27 05:12:59 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:00.162617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dfd6e46b-7622-4a03-9fa3-a2213112c08a tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:00.177832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfd6e46b-7622-4a03-9fa3-a2213112c08a tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.178505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfd6e46b-7622-4a03-9fa3-a2213112c08a tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.181548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfd6e46b-7622-4a03-9fa3-a2213112c08a tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.230293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dfd6e46b-7622-4a03-9fa3-a2213112c08a tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Going to try to start instance {{(pid=128548) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 05:13:00.230584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:00.239576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:00.241595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:00.243647 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-150f2f81-54ac-4bd7-b2df-70ea76835e58 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1722 microversion: 2.20 time: 0.320834 Aug 27 05:13:00.258983 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2061/4123] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:12:59 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:00.269217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f29fca32-0f6b-4a2c-b863-27b968528864 req-7419f0c6-251d-4bc9-8628-e89a1a99c5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2179539-1d65-4da2-9ffa-cc66ee2000a1", "name": "network-vif-plugged", "status": "completed", "tag": "783824ae-3016-4f15-a3ae-18ec46c14ed2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:00.294935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f29fca32-0f6b-4a2c-b863-27b968528864 req-7419f0c6-251d-4bc9-8628-e89a1a99c5d9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.298564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f29fca32-0f6b-4a2c-b863-27b968528864 req-7419f0c6-251d-4bc9-8628-e89a1a99c5d9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.299719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f29fca32-0f6b-4a2c-b863-27b968528864 req-7419f0c6-251d-4bc9-8628-e89a1a99c5d9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.315474 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f29fca32-0f6b-4a2c-b863-27b968528864 req-7419f0c6-251d-4bc9-8628-e89a1a99c5d9 service nova] Creating event network-vif-plugged:783824ae-3016-4f15-a3ae-18ec46c14ed2 for instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 on n-h2-820368-35 Aug 27 05:13:00.321388 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f29fca32-0f6b-4a2c-b863-27b968528864 req-7419f0c6-251d-4bc9-8628-e89a1a99c5d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061596 Aug 27 05:13:00.322892 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2062/4124] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:00.333770 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dfd6e46b-7622-4a03-9fa3-a2213112c08a tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "POST /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb/action" status: 202 len: 0 microversion: 2.1 time: 0.180034 Aug 27 05:13:00.335224 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2063/4125] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:13:00 2022] POST /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:13:00.344050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0c051302-b39c-430e-a7be-d1e4b153bc41 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:00.344767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0c051302-b39c-430e-a7be-d1e4b153bc41 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:00.351423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c051302-b39c-430e-a7be-d1e4b153bc41 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.352626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c051302-b39c-430e-a7be-d1e4b153bc41 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.353069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c051302-b39c-430e-a7be-d1e4b153bc41 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.353782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c051302-b39c-430e-a7be-d1e4b153bc41 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.354242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c051302-b39c-430e-a7be-d1e4b153bc41 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.354784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c051302-b39c-430e-a7be-d1e4b153bc41 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.526458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0c051302-b39c-430e-a7be-d1e4b153bc41 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:00.535887 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0c051302-b39c-430e-a7be-d1e4b153bc41 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1508 microversion: 2.1 time: 0.196057 Aug 27 05:13:00.536946 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2063/4126] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:00 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:00.540767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8360cf73-a395-4fdd-a9ca-081a73f47831 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:00.541485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8360cf73-a395-4fdd-a9ca-081a73f47831 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:00.550196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8360cf73-a395-4fdd-a9ca-081a73f47831 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.551395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8360cf73-a395-4fdd-a9ca-081a73f47831 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.551948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8360cf73-a395-4fdd-a9ca-081a73f47831 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.552725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8360cf73-a395-4fdd-a9ca-081a73f47831 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.553238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8360cf73-a395-4fdd-a9ca-081a73f47831 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.553715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8360cf73-a395-4fdd-a9ca-081a73f47831 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.628657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8360cf73-a395-4fdd-a9ca-081a73f47831 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:00.637370 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8360cf73-a395-4fdd-a9ca-081a73f47831 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1277 microversion: 2.1 time: 0.103112 Aug 27 05:13:00.637954 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2064/4127] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:00 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:00.710454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5dff3d3e-97a5-4d2d-98fa-6aab67848890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:00.710758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5dff3d3e-97a5-4d2d-98fa-6aab67848890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:00.718063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dff3d3e-97a5-4d2d-98fa-6aab67848890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.718781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dff3d3e-97a5-4d2d-98fa-6aab67848890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.719216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dff3d3e-97a5-4d2d-98fa-6aab67848890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.720116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dff3d3e-97a5-4d2d-98fa-6aab67848890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.720603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dff3d3e-97a5-4d2d-98fa-6aab67848890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.721228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dff3d3e-97a5-4d2d-98fa-6aab67848890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.859129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5dff3d3e-97a5-4d2d-98fa-6aab67848890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:00.862771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:00.875590 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5dff3d3e-97a5-4d2d-98fa-6aab67848890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1328 microversion: 2.1 time: 0.169307 Aug 27 05:13:00.876426 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2064/4128] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:00 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1328 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:01.268971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:01.270165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:01.280112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.281037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.281858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:01.282735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.283382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.284158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:01.478521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:01.499012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:01.501150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:01.503123 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8695b40b-7706-4cd1-a8ff-7d40041dde22 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1722 microversion: 2.20 time: 0.240900 Aug 27 05:13:01.504261 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2065/4129] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:01 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:13:01.558661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-78a7a993-a7c6-492b-98ee-a095e717f7dc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:01.560075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-78a7a993-a7c6-492b-98ee-a095e717f7dc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:01.575143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78a7a993-a7c6-492b-98ee-a095e717f7dc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.579050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78a7a993-a7c6-492b-98ee-a095e717f7dc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.582571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78a7a993-a7c6-492b-98ee-a095e717f7dc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:01.584724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78a7a993-a7c6-492b-98ee-a095e717f7dc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.585289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78a7a993-a7c6-492b-98ee-a095e717f7dc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.585646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78a7a993-a7c6-492b-98ee-a095e717f7dc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:01.662419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1df51f8d-211f-4e57-9f30-f0dd4ad1b4b4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:01.663652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1df51f8d-211f-4e57-9f30-f0dd4ad1b4b4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:01.673322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1df51f8d-211f-4e57-9f30-f0dd4ad1b4b4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.673820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1df51f8d-211f-4e57-9f30-f0dd4ad1b4b4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.674276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1df51f8d-211f-4e57-9f30-f0dd4ad1b4b4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:01.675782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1df51f8d-211f-4e57-9f30-f0dd4ad1b4b4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.676255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1df51f8d-211f-4e57-9f30-f0dd4ad1b4b4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.676826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1df51f8d-211f-4e57-9f30-f0dd4ad1b4b4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:01.770071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1df51f8d-211f-4e57-9f30-f0dd4ad1b4b4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:01.772094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-78a7a993-a7c6-492b-98ee-a095e717f7dc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:01.780420 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-78a7a993-a7c6-492b-98ee-a095e717f7dc tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1508 microversion: 2.1 time: 0.226295 Aug 27 05:13:01.791293 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1df51f8d-211f-4e57-9f30-f0dd4ad1b4b4 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1283 microversion: 2.1 time: 0.134390 Aug 27 05:13:01.795437 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2065/4130] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:01 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:01.795846 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2066/4131] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:01 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1283 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:01.897861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5aa83424-e4aa-4108-9bb0-0084063cdcba tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:01.898696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5aa83424-e4aa-4108-9bb0-0084063cdcba tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:01.905216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa83424-e4aa-4108-9bb0-0084063cdcba tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.906037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa83424-e4aa-4108-9bb0-0084063cdcba tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.907119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa83424-e4aa-4108-9bb0-0084063cdcba tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:01.908335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa83424-e4aa-4108-9bb0-0084063cdcba tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.909629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa83424-e4aa-4108-9bb0-0084063cdcba tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.910244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa83424-e4aa-4108-9bb0-0084063cdcba tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:02.067428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5aa83424-e4aa-4108-9bb0-0084063cdcba tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:02.075967 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5aa83424-e4aa-4108-9bb0-0084063cdcba tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1328 microversion: 2.1 time: 0.182109 Aug 27 05:13:02.077005 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2066/4132] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:01 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1328 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:02.528960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:02.529572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:02.536264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:02.536873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:02.537176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:02.538248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:02.538699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:02.539710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:02.681092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:02.691523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:02.693039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:02.694710 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-18ef830b-7ff6-4ec7-8c30-967aabbc13c9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1722 microversion: 2.20 time: 0.169447 Aug 27 05:13:02.707716 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2067/4133] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:02 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:02.801300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-719f2ae2-882b-431c-bcda-2d9fa9803479 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:02.801901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-719f2ae2-882b-431c-bcda-2d9fa9803479 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:02.814976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b861ab8-e605-48c7-95eb-cc0da9769b3d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:02.816258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b861ab8-e605-48c7-95eb-cc0da9769b3d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:02.828605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-719f2ae2-882b-431c-bcda-2d9fa9803479 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:02.830213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b861ab8-e605-48c7-95eb-cc0da9769b3d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:02.830721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b861ab8-e605-48c7-95eb-cc0da9769b3d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:02.831599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-719f2ae2-882b-431c-bcda-2d9fa9803479 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:02.832056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-719f2ae2-882b-431c-bcda-2d9fa9803479 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:02.833327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b861ab8-e605-48c7-95eb-cc0da9769b3d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:02.834070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b861ab8-e605-48c7-95eb-cc0da9769b3d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:02.834524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-719f2ae2-882b-431c-bcda-2d9fa9803479 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:02.835242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-719f2ae2-882b-431c-bcda-2d9fa9803479 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:02.835970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b861ab8-e605-48c7-95eb-cc0da9769b3d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:02.836633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-719f2ae2-882b-431c-bcda-2d9fa9803479 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:02.837925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b861ab8-e605-48c7-95eb-cc0da9769b3d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.137061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4b861ab8-e605-48c7-95eb-cc0da9769b3d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:03.145715 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b861ab8-e605-48c7-95eb-cc0da9769b3d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1325 microversion: 2.1 time: 0.336595 Aug 27 05:13:03.146614 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2068/4134] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:02 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1325 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:03.153686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a869a877-93b8-464d-9378-84007c2a91df tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:03.155015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a869a877-93b8-464d-9378-84007c2a91df tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:03.167222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a869a877-93b8-464d-9378-84007c2a91df tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:03.168472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a869a877-93b8-464d-9378-84007c2a91df tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:03.168985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a869a877-93b8-464d-9378-84007c2a91df tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.169994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a869a877-93b8-464d-9378-84007c2a91df tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:03.170651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a869a877-93b8-464d-9378-84007c2a91df tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:03.172076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a869a877-93b8-464d-9378-84007c2a91df tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.186513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-719f2ae2-882b-431c-bcda-2d9fa9803479 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:03.212639 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-719f2ae2-882b-431c-bcda-2d9fa9803479 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1508 microversion: 2.1 time: 0.415482 Aug 27 05:13:03.216419 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2067/4135] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:02 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:03.429679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a869a877-93b8-464d-9378-84007c2a91df tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:03.440025 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a869a877-93b8-464d-9378-84007c2a91df tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1328 microversion: 2.1 time: 0.291401 Aug 27 05:13:03.441242 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2069/4136] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:03 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1328 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:03.729196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:03.733769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:03.751286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:03.754272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:03.754805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.755604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:03.756078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:03.758298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.808515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-3f2d6093-e547-4fb1-a6a2-dfc5ff2e58c3 req-b0d2fada-e0d3-4e27-8cb1-1ad3d288b8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcbd54c-7e88-44d7-ad7b-be669acb1c7c", "name": "network-vif-deleted", "tag": "e1cc65c6-b976-41c9-a889-d9270df2c63d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:03.818835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:03.822263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3f2d6093-e547-4fb1-a6a2-dfc5ff2e58c3 req-b0d2fada-e0d3-4e27-8cb1-1ad3d288b8cd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:03.823757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3f2d6093-e547-4fb1-a6a2-dfc5ff2e58c3 req-b0d2fada-e0d3-4e27-8cb1-1ad3d288b8cd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:03.824685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3f2d6093-e547-4fb1-a6a2-dfc5ff2e58c3 req-b0d2fada-e0d3-4e27-8cb1-1ad3d288b8cd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.841845 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-3f2d6093-e547-4fb1-a6a2-dfc5ff2e58c3 req-b0d2fada-e0d3-4e27-8cb1-1ad3d288b8cd service nova] Creating event network-vif-deleted:e1cc65c6-b976-41c9-a889-d9270df2c63d for instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c on n-h2-820368-35 Aug 27 05:13:03.849565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-3f2d6093-e547-4fb1-a6a2-dfc5ff2e58c3 req-b0d2fada-e0d3-4e27-8cb1-1ad3d288b8cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045310 Aug 27 05:13:03.850433 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2070/4137] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:03.925573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:03.934780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:03.939851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:03.943731 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1fbff2f-6f14-4d69-9e2d-da8ae2adfb5b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 200 len: 1654 microversion: 2.20 time: 0.228094 Aug 27 05:13:03.955910 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2068/4138] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:03 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 1654 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:04.169216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c6ee7903-9989-47f9-94db-fbecac2a8918 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:04.169216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c6ee7903-9989-47f9-94db-fbecac2a8918 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:04.174308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6ee7903-9989-47f9-94db-fbecac2a8918 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.174811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6ee7903-9989-47f9-94db-fbecac2a8918 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.175316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6ee7903-9989-47f9-94db-fbecac2a8918 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.176025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6ee7903-9989-47f9-94db-fbecac2a8918 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.176483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6ee7903-9989-47f9-94db-fbecac2a8918 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.176914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6ee7903-9989-47f9-94db-fbecac2a8918 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.201501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:04.237726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-87779e0b-fe25-4f5a-8858-7a0c9a947c97 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:04.238356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-87779e0b-fe25-4f5a-8858-7a0c9a947c97 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:04.247061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87779e0b-fe25-4f5a-8858-7a0c9a947c97 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.247586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87779e0b-fe25-4f5a-8858-7a0c9a947c97 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.248023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87779e0b-fe25-4f5a-8858-7a0c9a947c97 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.248735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87779e0b-fe25-4f5a-8858-7a0c9a947c97 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.249211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87779e0b-fe25-4f5a-8858-7a0c9a947c97 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.249633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87779e0b-fe25-4f5a-8858-7a0c9a947c97 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.487696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c6ee7903-9989-47f9-94db-fbecac2a8918 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:04.498288 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c6ee7903-9989-47f9-94db-fbecac2a8918 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1325 microversion: 2.1 time: 0.335457 Aug 27 05:13:04.498898 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2071/4139] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:04 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:04.508410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-72f9ac26-49ff-450b-8ddd-f6fcfb1db8c5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:04.511032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-87779e0b-fe25-4f5a-8858-7a0c9a947c97 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:04.512012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-72f9ac26-49ff-450b-8ddd-f6fcfb1db8c5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:04.526019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72f9ac26-49ff-450b-8ddd-f6fcfb1db8c5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.526694 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-87779e0b-fe25-4f5a-8858-7a0c9a947c97 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1508 microversion: 2.1 time: 0.292258 Aug 27 05:13:04.528430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72f9ac26-49ff-450b-8ddd-f6fcfb1db8c5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.528896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72f9ac26-49ff-450b-8ddd-f6fcfb1db8c5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.529229 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2069/4140] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:04 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:04.529677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72f9ac26-49ff-450b-8ddd-f6fcfb1db8c5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.537057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72f9ac26-49ff-450b-8ddd-f6fcfb1db8c5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.537758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72f9ac26-49ff-450b-8ddd-f6fcfb1db8c5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.738946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-72f9ac26-49ff-450b-8ddd-f6fcfb1db8c5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:04.749634 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-72f9ac26-49ff-450b-8ddd-f6fcfb1db8c5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1509 microversion: 2.1 time: 0.249503 Aug 27 05:13:04.750598 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2072/4141] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:04 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:04.772772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa0c99a5-1b70-425f-a2e8-890202bc49ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:04.773978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fa0c99a5-1b70-425f-a2e8-890202bc49ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:04.786231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa0c99a5-1b70-425f-a2e8-890202bc49ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.787861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa0c99a5-1b70-425f-a2e8-890202bc49ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.790131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa0c99a5-1b70-425f-a2e8-890202bc49ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.796518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa0c99a5-1b70-425f-a2e8-890202bc49ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.797415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa0c99a5-1b70-425f-a2e8-890202bc49ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.798102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa0c99a5-1b70-425f-a2e8-890202bc49ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.969655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:04.970319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:04.973196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fa0c99a5-1b70-425f-a2e8-890202bc49ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:04.979512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.980106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.980560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.981291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.981768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.982193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.984100 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa0c99a5-1b70-425f-a2e8-890202bc49ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1509 microversion: 2.1 time: 0.215387 Aug 27 05:13:04.985411 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2070/4142] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:04 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:04.997938 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] HTTP exception thrown: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Request method failure captured: Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c HTTP/1.1 Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaZ9-FtmAk7CY1rYRFdtfey_9ZqVkOQebMp2rvOdv_ug4cOHxXVsFqO3XFHj76pE0qg7oAMNwotycwqxl3QYVs4AwIkneMP6l2SLwu3tidnzbgHgLI2JZIZnQbM876-3oWEfBRtKgfW3DxWssvfiH40pMATCqubkwx75lT72sP5NDt4 Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cba630546e34472498c6e180a3ec2849", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cba630546e34472498c6e180a3ec2849"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 14ad24b744324d3e856a64b4c4979e8a Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '0dcbd54c-7e88-44d7-ad7b-be669acb1c7c'} Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:05.004533 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:05.008740 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:05.008740 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:05.008740 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:05.008740 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:05.008740 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:05.008740 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:05.008740 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:13:05.008740 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:05.008740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Returning 404 to user: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:05.008740 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88473f6b-ff1a-4122-9e3d-45f114365458 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 404 len: 111 microversion: 2.20 time: 0.041595 Aug 27 05:13:05.008740 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2073/4143] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:04 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 05:13:05.016516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e4e70553-425f-49a2-a1fe-846c2812e8d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '.version_select at 0x7fb5645464c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:05.018348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-568e633e-5e7c-4815-9171-8859fbbcf8c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:05.019022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-568e633e-5e7c-4815-9171-8859fbbcf8c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:05.028849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568e633e-5e7c-4815-9171-8859fbbcf8c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.030255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568e633e-5e7c-4815-9171-8859fbbcf8c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.031911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568e633e-5e7c-4815-9171-8859fbbcf8c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.033574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568e633e-5e7c-4815-9171-8859fbbcf8c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.034360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568e633e-5e7c-4815-9171-8859fbbcf8c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.034930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568e633e-5e7c-4815-9171-8859fbbcf8c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.049686 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e4e70553-425f-49a2-a1fe-846c2812e8d3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-97754129" status: 204 len: 0 microversion: 2.20 time: 0.037723 Aug 27 05:13:05.050292 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2074/4144] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:13:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-97754129 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:13:05.073512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-568e633e-5e7c-4815-9171-8859fbbcf8c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:05.165180 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-568e633e-5e7c-4815-9171-8859fbbcf8c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 204 len: 0 microversion: 2.1 time: 0.163039 Aug 27 05:13:05.165849 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2071/4145] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:04 2022] DELETE /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:13:05.175934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-803897c9-04de-42f7-97e3-ae71b787d8a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:05.177039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-803897c9-04de-42f7-97e3-ae71b787d8a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:05.185531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803897c9-04de-42f7-97e3-ae71b787d8a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.186031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803897c9-04de-42f7-97e3-ae71b787d8a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.186798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803897c9-04de-42f7-97e3-ae71b787d8a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.188200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803897c9-04de-42f7-97e3-ae71b787d8a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.188682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803897c9-04de-42f7-97e3-ae71b787d8a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.189125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803897c9-04de-42f7-97e3-ae71b787d8a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.448626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-803897c9-04de-42f7-97e3-ae71b787d8a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:05.457433 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-803897c9-04de-42f7-97e3-ae71b787d8a1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1515 microversion: 2.1 time: 0.287164 Aug 27 05:13:05.458025 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2075/4146] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:05 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1515 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:05.526299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-95df7883-de06-44c3-b6db-246667a98f35 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:05.527862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-95df7883-de06-44c3-b6db-246667a98f35 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:05.535238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95df7883-de06-44c3-b6db-246667a98f35 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.536728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95df7883-de06-44c3-b6db-246667a98f35 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.537784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95df7883-de06-44c3-b6db-246667a98f35 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.538692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95df7883-de06-44c3-b6db-246667a98f35 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.539819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95df7883-de06-44c3-b6db-246667a98f35 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.540560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95df7883-de06-44c3-b6db-246667a98f35 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.552685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97eca9a3-0888-40b3-abd2-3578ad035b69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:05.553560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97eca9a3-0888-40b3-abd2-3578ad035b69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:05.561445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97eca9a3-0888-40b3-abd2-3578ad035b69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.562888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97eca9a3-0888-40b3-abd2-3578ad035b69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.563590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97eca9a3-0888-40b3-abd2-3578ad035b69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.564528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97eca9a3-0888-40b3-abd2-3578ad035b69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.565291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97eca9a3-0888-40b3-abd2-3578ad035b69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.565944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97eca9a3-0888-40b3-abd2-3578ad035b69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.834216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-95df7883-de06-44c3-b6db-246667a98f35 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:05.843551 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-95df7883-de06-44c3-b6db-246667a98f35 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1325 microversion: 2.1 time: 0.325222 Aug 27 05:13:05.844215 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2072/4147] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:05 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1325 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:05.855431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-97eca9a3-0888-40b3-abd2-3578ad035b69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:05.863034 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-97eca9a3-0888-40b3-abd2-3578ad035b69 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1512 microversion: 2.1 time: 0.316843 Aug 27 05:13:05.863691 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2076/4148] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:05 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1512 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:05.871795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d32d3d50-e3db-4a54-b81a-9e520200bdf7 req-a6b9c62c-4064-47b1-ad15-625c1a5709f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290c9cc0-3ff4-45e6-8e5c-b885a54cc30a", "tag": "106f2f3f-c34b-4f95-9a32-5acf05d7e9ad"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:05.892742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8a8ab43-2b4a-49c2-aa0d-87f5ad60e661 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:05.896585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d32d3d50-e3db-4a54-b81a-9e520200bdf7 req-a6b9c62c-4064-47b1-ad15-625c1a5709f3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.897076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d32d3d50-e3db-4a54-b81a-9e520200bdf7 req-a6b9c62c-4064-47b1-ad15-625c1a5709f3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.897509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d32d3d50-e3db-4a54-b81a-9e520200bdf7 req-a6b9c62c-4064-47b1-ad15-625c1a5709f3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.898908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f8a8ab43-2b4a-49c2-aa0d-87f5ad60e661 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:05.899579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.compute.servers [None req-f8a8ab43-2b4a-49c2-aa0d-87f5ad60e661 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Removing options 'limit' from query {{(pid=128547) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1510}} Aug 27 05:13:05.900698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f8a8ab43-2b4a-49c2-aa0d-87f5ad60e661 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:05.902144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8a8ab43-2b4a-49c2-aa0d-87f5ad60e661 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.902672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8a8ab43-2b4a-49c2-aa0d-87f5ad60e661 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.903389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8a8ab43-2b4a-49c2-aa0d-87f5ad60e661 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.904566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8a8ab43-2b4a-49c2-aa0d-87f5ad60e661 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.905255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8a8ab43-2b4a-49c2-aa0d-87f5ad60e661 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.905928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8a8ab43-2b4a-49c2-aa0d-87f5ad60e661 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.907844 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8a8ab43-2b4a-49c2-aa0d-87f5ad60e661 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.019054 Aug 27 05:13:05.908368 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2073/4149] 10.222.0.58 () {58 vars in 1140 bytes} [Sat Aug 27 05:13:05 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:13:05.926102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b9684c4b-0c1c-4310-9b01-45deec3afd62 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:05.926730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b9684c4b-0c1c-4310-9b01-45deec3afd62 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:05.930646 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d32d3d50-e3db-4a54-b81a-9e520200bdf7 req-a6b9c62c-4064-47b1-ad15-625c1a5709f3 service nova] Creating event network-changed:106f2f3f-c34b-4f95-9a32-5acf05d7e9ad for instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a on n-h1-820368-35 Aug 27 05:13:05.940788 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d32d3d50-e3db-4a54-b81a-9e520200bdf7 req-a6b9c62c-4064-47b1-ad15-625c1a5709f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073217 Aug 27 05:13:05.941805 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2077/4150] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:05.944764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9684c4b-0c1c-4310-9b01-45deec3afd62 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.945539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9684c4b-0c1c-4310-9b01-45deec3afd62 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.946451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9684c4b-0c1c-4310-9b01-45deec3afd62 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.947437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9684c4b-0c1c-4310-9b01-45deec3afd62 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.948060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9684c4b-0c1c-4310-9b01-45deec3afd62 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.948829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9684c4b-0c1c-4310-9b01-45deec3afd62 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.019397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7eb2bf45-85c6-4c90-83ce-2093f6aa3aed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Action: 'create', calling method: .version_select at 0x7fb564add1f0>, body: {"keypair": {"name": "tempest-keypair-409568921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEimKv+ViSKGzWdlsMXocjr4BcoP7NtQ5TT4H8T0K2WfWUEYkl/orYQV97FxvMqsx/pQFBeXlPRBWvQuqvWo9b2qV6KgZXvYew6UwBIf/c0EtGnnQkQ2vfTW4LcUI1i4ew=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:06.035476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-7eb2bf45-85c6-4c90-83ce-2093f6aa3aed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Getting quotas for project cba630546e34472498c6e180a3ec2849. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:06.043172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-7eb2bf45-85c6-4c90-83ce-2093f6aa3aed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Getting quotas for user 14ad24b744324d3e856a64b4c4979e8a and project cba630546e34472498c6e180a3ec2849. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:06.071262 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7eb2bf45-85c6-4c90-83ce-2093f6aa3aed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.056568 Aug 27 05:13:06.072641 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2078/4151] 10.222.0.58 () {62 vars in 1200 bytes} [Sat Aug 27 05:13:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 05:13:06.121466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b9684c4b-0c1c-4310-9b01-45deec3afd62 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:06.130650 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b9684c4b-0c1c-4310-9b01-45deec3afd62 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1512 microversion: 2.1 time: 0.212572 Aug 27 05:13:06.131384 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2074/4152] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:05 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:06.154776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-658a9c21-f482-47f2-9233-4ccb303b310e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:06.155595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-658a9c21-f482-47f2-9233-4ccb303b310e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 5bb0289f-a421-4664-bdd2-1133b9e99e56] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:06.162680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-658a9c21-f482-47f2-9233-4ccb303b310e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.163417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-658a9c21-f482-47f2-9233-4ccb303b310e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.163937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-658a9c21-f482-47f2-9233-4ccb303b310e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.165126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-658a9c21-f482-47f2-9233-4ccb303b310e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.165590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-658a9c21-f482-47f2-9233-4ccb303b310e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.166081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-658a9c21-f482-47f2-9233-4ccb303b310e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.375916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-658a9c21-f482-47f2-9233-4ccb303b310e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:06.385942 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-658a9c21-f482-47f2-9233-4ccb303b310e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56" status: 200 len: 1511 microversion: 2.1 time: 0.237246 Aug 27 05:13:06.386777 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2079/4153] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:06 2022] GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56 => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:06.407923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0c6aeb7e-402c-4b33-8ce0-9d2691777968 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:06.408834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0c6aeb7e-402c-4b33-8ce0-9d2691777968 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:06.415620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c6aeb7e-402c-4b33-8ce0-9d2691777968 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.416114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c6aeb7e-402c-4b33-8ce0-9d2691777968 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.416771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c6aeb7e-402c-4b33-8ce0-9d2691777968 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.417482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c6aeb7e-402c-4b33-8ce0-9d2691777968 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.418102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c6aeb7e-402c-4b33-8ce0-9d2691777968 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.418544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c6aeb7e-402c-4b33-8ce0-9d2691777968 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.481880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2f76465a-912c-482f-95d8-c973538d6483 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:06.482745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2f76465a-912c-482f-95d8-c973538d6483 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:06.490758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f76465a-912c-482f-95d8-c973538d6483 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.492254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f76465a-912c-482f-95d8-c973538d6483 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.493145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f76465a-912c-482f-95d8-c973538d6483 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.493871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f76465a-912c-482f-95d8-c973538d6483 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.495444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f76465a-912c-482f-95d8-c973538d6483 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.496245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f76465a-912c-482f-95d8-c973538d6483 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.667216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0c6aeb7e-402c-4b33-8ce0-9d2691777968 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:06.677840 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0c6aeb7e-402c-4b33-8ce0-9d2691777968 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1512 microversion: 2.1 time: 0.274062 Aug 27 05:13:06.679126 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2075/4154] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:06 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:06.699987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e362803-1e29-4ece-8b8d-a777325b7f3f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:06.705627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1e362803-1e29-4ece-8b8d-a777325b7f3f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:06.706303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1e362803-1e29-4ece-8b8d-a777325b7f3f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:06.709969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2f76465a-912c-482f-95d8-c973538d6483 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:06.722012 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2f76465a-912c-482f-95d8-c973538d6483 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1515 microversion: 2.1 time: 0.244640 Aug 27 05:13:06.724315 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2080/4155] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:06 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1515 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:06.826567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e362803-1e29-4ece-8b8d-a777325b7f3f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.827077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e362803-1e29-4ece-8b8d-a777325b7f3f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.828063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e362803-1e29-4ece-8b8d-a777325b7f3f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.828980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e362803-1e29-4ece-8b8d-a777325b7f3f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.829561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e362803-1e29-4ece-8b8d-a777325b7f3f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.830161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e362803-1e29-4ece-8b8d-a777325b7f3f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.868448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f6f3ce1-a037-4d9d-b2f9-7f3b1430dad3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:06.869509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1f6f3ce1-a037-4d9d-b2f9-7f3b1430dad3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:06.877557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f6f3ce1-a037-4d9d-b2f9-7f3b1430dad3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.878301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f6f3ce1-a037-4d9d-b2f9-7f3b1430dad3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.878952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f6f3ce1-a037-4d9d-b2f9-7f3b1430dad3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.880096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f6f3ce1-a037-4d9d-b2f9-7f3b1430dad3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.880758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f6f3ce1-a037-4d9d-b2f9-7f3b1430dad3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.881577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f6f3ce1-a037-4d9d-b2f9-7f3b1430dad3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.923800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-1e362803-1e29-4ece-8b8d-a777325b7f3f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:13:06.989801 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e362803-1e29-4ece-8b8d-a777325b7f3f tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 346 microversion: 2.1 time: 0.293678 Aug 27 05:13:06.991011 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2076/4156] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 05:13:06 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 346 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:07.004042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1b7de300-13e5-48f4-809a-32ad8fc5b4f2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:07.004609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1b7de300-13e5-48f4-809a-32ad8fc5b4f2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:07.014177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b7de300-13e5-48f4-809a-32ad8fc5b4f2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.014845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b7de300-13e5-48f4-809a-32ad8fc5b4f2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.015334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b7de300-13e5-48f4-809a-32ad8fc5b4f2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.016063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b7de300-13e5-48f4-809a-32ad8fc5b4f2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.016550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b7de300-13e5-48f4-809a-32ad8fc5b4f2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.016988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b7de300-13e5-48f4-809a-32ad8fc5b4f2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.059818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1f6f3ce1-a037-4d9d-b2f9-7f3b1430dad3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:07.070951 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1f6f3ce1-a037-4d9d-b2f9-7f3b1430dad3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1325 microversion: 2.1 time: 0.205984 Aug 27 05:13:07.087460 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2081/4157] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:06 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:07.195170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1b7de300-13e5-48f4-809a-32ad8fc5b4f2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:07.204849 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1b7de300-13e5-48f4-809a-32ad8fc5b4f2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1512 microversion: 2.1 time: 0.204997 Aug 27 05:13:07.205785 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2077/4158] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:06 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:07.224585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e1cc37fe-684d-41df-a1ac-b02170ff7f49 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:07.225485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e1cc37fe-684d-41df-a1ac-b02170ff7f49 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 5bb0289f-a421-4664-bdd2-1133b9e99e56] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:07.231418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1cc37fe-684d-41df-a1ac-b02170ff7f49 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.232121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1cc37fe-684d-41df-a1ac-b02170ff7f49 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.232561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1cc37fe-684d-41df-a1ac-b02170ff7f49 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.233256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1cc37fe-684d-41df-a1ac-b02170ff7f49 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.233898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1cc37fe-684d-41df-a1ac-b02170ff7f49 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.234544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1cc37fe-684d-41df-a1ac-b02170ff7f49 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.394902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e1cc37fe-684d-41df-a1ac-b02170ff7f49 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:07.409960 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e1cc37fe-684d-41df-a1ac-b02170ff7f49 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56" status: 200 len: 1511 microversion: 2.1 time: 0.188882 Aug 27 05:13:07.410798 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2082/4159] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:07 2022] GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:07.433806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0dcd49fd-46e1-46cb-a965-3fbcb8274471 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:07.435156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0dcd49fd-46e1-46cb-a965-3fbcb8274471 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:07.445863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcd49fd-46e1-46cb-a965-3fbcb8274471 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.447006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcd49fd-46e1-46cb-a965-3fbcb8274471 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.471686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcd49fd-46e1-46cb-a965-3fbcb8274471 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.474196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcd49fd-46e1-46cb-a965-3fbcb8274471 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.476024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcd49fd-46e1-46cb-a965-3fbcb8274471 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.479346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcd49fd-46e1-46cb-a965-3fbcb8274471 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.745446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:07.746300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:07.762534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.763340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.764110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.765054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.765870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.766467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.813466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0dcd49fd-46e1-46cb-a965-3fbcb8274471 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:07.826465 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0dcd49fd-46e1-46cb-a965-3fbcb8274471 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1512 microversion: 2.1 time: 0.398041 Aug 27 05:13:07.831211 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2078/4160] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:07 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1512 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:07.843182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.844147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.844601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.845162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lazy-loading 'fault' on Instance uuid d2179539-1d65-4da2-9ffa-cc66ee2000a1 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:07.850690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:07.861348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:07.862135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:07.871466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.872034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.885229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.887575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.889275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.890736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.895733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:07.907846 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bd8d9362-5767-490f-b2c2-84a8444b7762 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 200 len: 1318 microversion: 2.1 time: 0.167504 Aug 27 05:13:07.908680 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2083/4161] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:07 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:07.954888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-cc4aa0cd-1fb4-41bd-98d3-1d02e73cc24d req-a21a2e9b-7965-40c1-b0f3-f1088a18cf2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2179539-1d65-4da2-9ffa-cc66ee2000a1", "name": "network-vif-deleted", "tag": "783824ae-3016-4f15-a3ae-18ec46c14ed2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:07.958837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:13:07.974685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cc4aa0cd-1fb4-41bd-98d3-1d02e73cc24d req-a21a2e9b-7965-40c1-b0f3-f1088a18cf2a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.975453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cc4aa0cd-1fb4-41bd-98d3-1d02e73cc24d req-a21a2e9b-7965-40c1-b0f3-f1088a18cf2a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.977206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cc4aa0cd-1fb4-41bd-98d3-1d02e73cc24d req-a21a2e9b-7965-40c1-b0f3-f1088a18cf2a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.989633 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-cc4aa0cd-1fb4-41bd-98d3-1d02e73cc24d req-a21a2e9b-7965-40c1-b0f3-f1088a18cf2a service nova] Creating event network-vif-deleted:783824ae-3016-4f15-a3ae-18ec46c14ed2 for instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 on n-h2-820368-35 Aug 27 05:13:07.996252 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-cc4aa0cd-1fb4-41bd-98d3-1d02e73cc24d req-a21a2e9b-7965-40c1-b0f3-f1088a18cf2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045197 Aug 27 05:13:07.997378 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2084/4162] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:08.004700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:08.012644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.013133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.013579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.017219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:08.095527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e14b195e-8c1f-4f06-a64b-0fc37b6beb36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:08.096309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e14b195e-8c1f-4f06-a64b-0fc37b6beb36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:08.106263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e14b195e-8c1f-4f06-a64b-0fc37b6beb36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.106766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e14b195e-8c1f-4f06-a64b-0fc37b6beb36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.107246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e14b195e-8c1f-4f06-a64b-0fc37b6beb36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.108045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e14b195e-8c1f-4f06-a64b-0fc37b6beb36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.116278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e14b195e-8c1f-4f06-a64b-0fc37b6beb36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.117318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e14b195e-8c1f-4f06-a64b-0fc37b6beb36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.165090 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db4cff55-6c39-492f-9f23-63a8b55f5281 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.320128 Aug 27 05:13:08.165750 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2079/4163] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 05:13:07 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:08.190474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2f2f9d97-2265-4a39-96d5-72404db7aac6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:08.195817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2f2f9d97-2265-4a39-96d5-72404db7aac6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:08.196493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2f2f9d97-2265-4a39-96d5-72404db7aac6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:08.321332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f2f9d97-2265-4a39-96d5-72404db7aac6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.322295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f2f9d97-2265-4a39-96d5-72404db7aac6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.322896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f2f9d97-2265-4a39-96d5-72404db7aac6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.324428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f2f9d97-2265-4a39-96d5-72404db7aac6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.325121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f2f9d97-2265-4a39-96d5-72404db7aac6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.325714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f2f9d97-2265-4a39-96d5-72404db7aac6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.382450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-2f2f9d97-2265-4a39-96d5-72404db7aac6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:13:08.435391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e14b195e-8c1f-4f06-a64b-0fc37b6beb36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:08.446472 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e14b195e-8c1f-4f06-a64b-0fc37b6beb36 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1325 microversion: 2.1 time: 0.355037 Aug 27 05:13:08.459143 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2085/4164] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:08 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1325 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:08.459510 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2f2f9d97-2265-4a39-96d5-72404db7aac6 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.266207 Aug 27 05:13:08.459510 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2080/4165] 10.222.0.58 () {58 vars in 1150 bytes} [Sat Aug 27 05:13:08 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:08.475938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3802d5c9-15b7-4c3d-a456-a1f09d0602a1 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:08.481664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3802d5c9-15b7-4c3d-a456-a1f09d0602a1 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:08.482527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3802d5c9-15b7-4c3d-a456-a1f09d0602a1 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:08.488031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3802d5c9-15b7-4c3d-a456-a1f09d0602a1 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.488518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3802d5c9-15b7-4c3d-a456-a1f09d0602a1 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.488953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3802d5c9-15b7-4c3d-a456-a1f09d0602a1 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.490043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3802d5c9-15b7-4c3d-a456-a1f09d0602a1 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.490159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3802d5c9-15b7-4c3d-a456-a1f09d0602a1 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.490504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3802d5c9-15b7-4c3d-a456-a1f09d0602a1 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.601344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-3802d5c9-15b7-4c3d-a456-a1f09d0602a1 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:13:08.670473 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3802d5c9-15b7-4c3d-a456-a1f09d0602a1 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.198856 Aug 27 05:13:08.677896 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2086/4166] 10.222.0.58 () {58 vars in 1212 bytes} [Sat Aug 27 05:13:08 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:08.687255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bfc13a78-054c-4681-b31d-72b7236a6820 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:08.696878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bfc13a78-054c-4681-b31d-72b7236a6820 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:08.697665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bfc13a78-054c-4681-b31d-72b7236a6820 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:08.706173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc13a78-054c-4681-b31d-72b7236a6820 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.706903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc13a78-054c-4681-b31d-72b7236a6820 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.707379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc13a78-054c-4681-b31d-72b7236a6820 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.708736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc13a78-054c-4681-b31d-72b7236a6820 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.709229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc13a78-054c-4681-b31d-72b7236a6820 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.709666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc13a78-054c-4681-b31d-72b7236a6820 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.768627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-464081444", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26693bae-61f8-4132-bd2b-dd87b033168d"}], "security_groups": [{"name": "tempest-securitygroup--1361189208"}], "key_name": "tempest-keypair-409568921", "user_data": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:08.814987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-bfc13a78-054c-4681-b31d-72b7236a6820 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:13:08.893146 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bfc13a78-054c-4681-b31d-72b7236a6820 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.213654 Aug 27 05:13:08.894805 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2081/4167] 10.222.0.58 () {58 vars in 1196 bytes} [Sat Aug 27 05:13:08 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:08.907448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d8f7bf9-2da1-4ebb-86b6-1d3ebc634e79 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:08.911734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] validate_networks() for [('26693bae-61f8-4132-bd2b-dd87b033168d', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:13:08.913562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d8f7bf9-2da1-4ebb-86b6-1d3ebc634e79 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:08.914510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d8f7bf9-2da1-4ebb-86b6-1d3ebc634e79 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'name': '1542946860', 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:08.920754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d8f7bf9-2da1-4ebb-86b6-1d3ebc634e79 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.921484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d8f7bf9-2da1-4ebb-86b6-1d3ebc634e79 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.922086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d8f7bf9-2da1-4ebb-86b6-1d3ebc634e79 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.923065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d8f7bf9-2da1-4ebb-86b6-1d3ebc634e79 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.925399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d8f7bf9-2da1-4ebb-86b6-1d3ebc634e79 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.926002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d8f7bf9-2da1-4ebb-86b6-1d3ebc634e79 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.033439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-8d8f7bf9-2da1-4ebb-86b6-1d3ebc634e79 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:13:09.102111 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d8f7bf9-2da1-4ebb-86b6-1d3ebc634e79 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?name=1542946860" status: 200 len: 346 microversion: 2.1 time: 0.199387 Aug 27 05:13:09.103570 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2082/4168] 10.222.0.58 () {58 vars in 1156 bytes} [Sat Aug 27 05:13:08 2022] GET /compute/v2.1/servers?name=1542946860 => generated 346 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:09.110116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:09.111402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:09.118437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.119120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.119650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.120479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.121367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.121489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.136067 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 HTTP/1.1 Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'd2179539-1d65-4da2-9ffa-cc66ee2000a1'} Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:09.137822 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:09.141896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:09.141896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:09.141896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:09.141896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:09.141896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:09.141896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:13:09.141896 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:09.141896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:09.141896 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dc7c12fd-e2fd-41ee-8d91-33870c4d7f55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 404 len: 111 microversion: 2.1 time: 0.034459 Aug 27 05:13:09.141896 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2083/4169] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:09 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:09.145622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-98fe5e49-7d25-4730-a743-7e4651423eee tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:09.150710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-98fe5e49-7d25-4730-a743-7e4651423eee tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:09.151714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-98fe5e49-7d25-4730-a743-7e4651423eee tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:09.157066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe5e49-7d25-4730-a743-7e4651423eee tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.157695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe5e49-7d25-4730-a743-7e4651423eee tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.158302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe5e49-7d25-4730-a743-7e4651423eee tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.159165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe5e49-7d25-4730-a743-7e4651423eee tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.159642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe5e49-7d25-4730-a743-7e4651423eee tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.160136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe5e49-7d25-4730-a743-7e4651423eee tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.279495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-98fe5e49-7d25-4730-a743-7e4651423eee tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:13:09.349843 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-98fe5e49-7d25-4730-a743-7e4651423eee tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.208829 Aug 27 05:13:09.357495 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2084/4170] 10.222.0.58 () {58 vars in 1154 bytes} [Sat Aug 27 05:13:09 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:09.357495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bd523f47-0f61-4dfd-8ff6-79674447dc6e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '.version_select at 0x7fb56490d040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:09.377350 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bd523f47-0f61-4dfd-8ff6-79674447dc6e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-key-433385823" status: 202 len: 0 microversion: 2.1 time: 0.024997 Aug 27 05:13:09.387741 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2085/4171] 10.222.0.58 () {58 vars in 1206 bytes} [Sat Aug 27 05:13:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-433385823 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:13:09.387741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7cd1f063-2907-4e0f-987c-523f4f8aa327 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:09.391873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:13:09.392318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:13:09.392827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:13:09.393477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:13:09.393915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:13:09.406406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7cd1f063-2907-4e0f-987c-523f4f8aa327 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:09.406679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7cd1f063-2907-4e0f-987c-523f4f8aa327 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-154294686', 'deleted': False, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:09.406823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.408283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.408913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.410104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.410825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.411449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.416958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cd1f063-2907-4e0f-987c-523f4f8aa327 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.417247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cd1f063-2907-4e0f-987c-523f4f8aa327 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.417696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cd1f063-2907-4e0f-987c-523f4f8aa327 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.418436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cd1f063-2907-4e0f-987c-523f4f8aa327 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.418897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cd1f063-2907-4e0f-987c-523f4f8aa327 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.419359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cd1f063-2907-4e0f-987c-523f4f8aa327 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.438320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Getting quotas for project cba630546e34472498c6e180a3ec2849. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:09.444836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Getting quotas for user 14ad24b744324d3e856a64b4c4979e8a and project cba630546e34472498c6e180a3ec2849. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:09.463900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:13:09.469281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:13:09.514032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-7cd1f063-2907-4e0f-987c-523f4f8aa327 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:13:09.530541 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a3383aa3-fec8-4fb7-93c2-f4c75b035e7c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.766857 Aug 27 05:13:09.537747 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2087/4172] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 05:13:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 05:13:09.547126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2cc3f57f-7aa1-451d-ac5d-48296c0aa942 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:09.547750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2cc3f57f-7aa1-451d-ac5d-48296c0aa942 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:09.555521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cc3f57f-7aa1-451d-ac5d-48296c0aa942 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.555977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cc3f57f-7aa1-451d-ac5d-48296c0aa942 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.556425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cc3f57f-7aa1-451d-ac5d-48296c0aa942 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.557156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cc3f57f-7aa1-451d-ac5d-48296c0aa942 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.557703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cc3f57f-7aa1-451d-ac5d-48296c0aa942 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.558083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cc3f57f-7aa1-451d-ac5d-48296c0aa942 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.591024 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7cd1f063-2907-4e0f-987c-523f4f8aa327 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-154294686" status: 200 len: 346 microversion: 2.1 time: 0.211966 Aug 27 05:13:09.592464 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2086/4173] 10.222.0.58 () {58 vars in 1228 bytes} [Sat Aug 27 05:13:09 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-154294686 => generated 346 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:09.604832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1440546185", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "43620fdb-3b93-439f-955c-01e22d65d95a"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:09.668771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] validate_networks() for [('43620fdb-3b93-439f-955c-01e22d65d95a', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:13:09.784669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2cc3f57f-7aa1-451d-ac5d-48296c0aa942 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:09.798016 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2cc3f57f-7aa1-451d-ac5d-48296c0aa942 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1325 microversion: 2.1 time: 0.258420 Aug 27 05:13:09.800205 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2088/4174] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:09 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1325 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:09.806462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c70fb97e-60fa-41d8-a378-d48da8b5ad8a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:09.807012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c70fb97e-60fa-41d8-a378-d48da8b5ad8a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:09.891247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c70fb97e-60fa-41d8-a378-d48da8b5ad8a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:09.908169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c70fb97e-60fa-41d8-a378-d48da8b5ad8a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:09.909936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c70fb97e-60fa-41d8-a378-d48da8b5ad8a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:09.911701 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c70fb97e-60fa-41d8-a378-d48da8b5ad8a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1280 microversion: 2.20 time: 0.109951 Aug 27 05:13:09.913100 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2089/4175] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:09 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1280 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:09.928455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b3d6d29b-8dff-44d3-ac53-dc0d63e1850b tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:09.929163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b3d6d29b-8dff-44d3-ac53-dc0d63e1850b tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:09.937914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3d6d29b-8dff-44d3-ac53-dc0d63e1850b tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.938788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3d6d29b-8dff-44d3-ac53-dc0d63e1850b tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.939491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3d6d29b-8dff-44d3-ac53-dc0d63e1850b tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.940412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3d6d29b-8dff-44d3-ac53-dc0d63e1850b tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.941036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3d6d29b-8dff-44d3-ac53-dc0d63e1850b tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.941627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3d6d29b-8dff-44d3-ac53-dc0d63e1850b tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.980523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b3d6d29b-8dff-44d3-ac53-dc0d63e1850b tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:10.090411 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b3d6d29b-8dff-44d3-ac53-dc0d63e1850b tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "DELETE /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 204 len: 0 microversion: 2.1 time: 0.175699 Aug 27 05:13:10.091950 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2090/4176] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:09 2022] DELETE /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:10.110211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7addd9b6-db15-4ef4-8281-b25bd7df8cba tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:10.110878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7addd9b6-db15-4ef4-8281-b25bd7df8cba tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:10.118478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7addd9b6-db15-4ef4-8281-b25bd7df8cba tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:10.119664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7addd9b6-db15-4ef4-8281-b25bd7df8cba tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:10.120282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7addd9b6-db15-4ef4-8281-b25bd7df8cba tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:10.121155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7addd9b6-db15-4ef4-8281-b25bd7df8cba tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:10.121773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7addd9b6-db15-4ef4-8281-b25bd7df8cba tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:10.122513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7addd9b6-db15-4ef4-8281-b25bd7df8cba tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:10.141819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:10.239421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:13:10.240451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:13:10.241143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:13:10.241636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:13:10.242664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:13:10.253350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:10.254074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:10.255608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:10.256633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:10.257236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:10.258369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:10.277671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:10.283610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for user c75dd4d6f001450bb9279d592e9783bd and project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:10.297966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:13:10.300198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:13:10.315682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7addd9b6-db15-4ef4-8281-b25bd7df8cba tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:10.324768 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7addd9b6-db15-4ef4-8281-b25bd7df8cba tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1518 microversion: 2.1 time: 0.226794 Aug 27 05:13:10.326061 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2091/4177] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:10 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1518 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:10.355943 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c7d948b9-49ed-4bd8-adfe-21eb0cb41413 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755324 Aug 27 05:13:10.357173 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2087/4178] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:13:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:13:10.368740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4fabc061-1a27-4573-9e51-0399e58a29f1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:10.369697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4fabc061-1a27-4573-9e51-0399e58a29f1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:10.450544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4fabc061-1a27-4573-9e51-0399e58a29f1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:10.459925 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4fabc061-1a27-4573-9e51-0399e58a29f1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1209 microversion: 2.1 time: 0.095472 Aug 27 05:13:10.461512 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2092/4179] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:10 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:10.565798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-62686100-dcea-464f-afe2-a2084364279b req-3ac02b43-1e30-4a14-9794-20c18454ea39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290c9cc0-3ff4-45e6-8e5c-b885a54cc30a", "name": "network-vif-plugged", "status": "completed", "tag": "106f2f3f-c34b-4f95-9a32-5acf05d7e9ad"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:10.575654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:10.583195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-62686100-dcea-464f-afe2-a2084364279b req-3ac02b43-1e30-4a14-9794-20c18454ea39 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:10.584041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-62686100-dcea-464f-afe2-a2084364279b req-3ac02b43-1e30-4a14-9794-20c18454ea39 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:10.584807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-62686100-dcea-464f-afe2-a2084364279b req-3ac02b43-1e30-4a14-9794-20c18454ea39 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:10.599722 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-62686100-dcea-464f-afe2-a2084364279b req-3ac02b43-1e30-4a14-9794-20c18454ea39 service nova] Creating event network-vif-plugged:106f2f3f-c34b-4f95-9a32-5acf05d7e9ad for instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a on n-h1-820368-35 Aug 27 05:13:10.609298 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-62686100-dcea-464f-afe2-a2084364279b req-3ac02b43-1e30-4a14-9794-20c18454ea39 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048114 Aug 27 05:13:10.610424 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2088/4180] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:10.821357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60d30db7-f54f-4637-9ebe-90a5a85858f5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:10.822196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60d30db7-f54f-4637-9ebe-90a5a85858f5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:10.829111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d30db7-f54f-4637-9ebe-90a5a85858f5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:10.830070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d30db7-f54f-4637-9ebe-90a5a85858f5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:10.830606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d30db7-f54f-4637-9ebe-90a5a85858f5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:10.831930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d30db7-f54f-4637-9ebe-90a5a85858f5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:10.832389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d30db7-f54f-4637-9ebe-90a5a85858f5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:10.833033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d30db7-f54f-4637-9ebe-90a5a85858f5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:10.939614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:10.940365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:10.954624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:10.955262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:10.956031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:10.956835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:10.957603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:10.958958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:10.980608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-60d30db7-f54f-4637-9ebe-90a5a85858f5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:10.996879 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-60d30db7-f54f-4637-9ebe-90a5a85858f5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1325 microversion: 2.1 time: 0.178918 Aug 27 05:13:10.998541 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2093/4181] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:10 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1325 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:11.045472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:11.053722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:11.055745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:11.056864 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-663ba0bd-577d-4829-8ace-11943e5dfd6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1332 microversion: 2.20 time: 0.122087 Aug 27 05:13:11.057426 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2089/4182] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:10 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:11.349765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d74615db-da85-4e57-93bb-cf30f4beaf9e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:11.352094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d74615db-da85-4e57-93bb-cf30f4beaf9e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:11.359808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d74615db-da85-4e57-93bb-cf30f4beaf9e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:11.360199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d74615db-da85-4e57-93bb-cf30f4beaf9e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:11.361027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d74615db-da85-4e57-93bb-cf30f4beaf9e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:11.361832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d74615db-da85-4e57-93bb-cf30f4beaf9e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:11.362350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d74615db-da85-4e57-93bb-cf30f4beaf9e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:11.362852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d74615db-da85-4e57-93bb-cf30f4beaf9e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:11.482515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7dbe419-29df-401f-8623-318177f7e016 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:11.483405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7dbe419-29df-401f-8623-318177f7e016 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:11.492941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7dbe419-29df-401f-8623-318177f7e016 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:11.493276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7dbe419-29df-401f-8623-318177f7e016 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:11.493705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7dbe419-29df-401f-8623-318177f7e016 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:11.494413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7dbe419-29df-401f-8623-318177f7e016 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:11.494860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7dbe419-29df-401f-8623-318177f7e016 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:11.503512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7dbe419-29df-401f-8623-318177f7e016 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:11.537772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d74615db-da85-4e57-93bb-cf30f4beaf9e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:11.547815 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d74615db-da85-4e57-93bb-cf30f4beaf9e tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1518 microversion: 2.1 time: 0.201866 Aug 27 05:13:11.556193 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2094/4183] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:11 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1518 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:11.582281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a7dbe419-29df-401f-8623-318177f7e016 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:11.592299 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7dbe419-29df-401f-8623-318177f7e016 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1261 microversion: 2.1 time: 0.113985 Aug 27 05:13:11.593083 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2090/4184] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:11 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:12.020818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d856cc88-5838-442e-91d8-9a84bea0303c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:12.021445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d856cc88-5838-442e-91d8-9a84bea0303c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:12.034063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d856cc88-5838-442e-91d8-9a84bea0303c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.034825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d856cc88-5838-442e-91d8-9a84bea0303c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.035927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d856cc88-5838-442e-91d8-9a84bea0303c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.037175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d856cc88-5838-442e-91d8-9a84bea0303c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.039457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d856cc88-5838-442e-91d8-9a84bea0303c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.040324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d856cc88-5838-442e-91d8-9a84bea0303c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.081282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:12.082141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:12.090212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.090758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.091379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.092312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.092849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.093673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.261226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d856cc88-5838-442e-91d8-9a84bea0303c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:12.271644 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d856cc88-5838-442e-91d8-9a84bea0303c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1325 microversion: 2.1 time: 0.254550 Aug 27 05:13:12.279456 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2095/4185] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:12 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:12.362424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:12.372575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:12.375981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:12.377486 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cce8bb1c-b8ec-414a-9977-0b93c816c499 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1406 microversion: 2.20 time: 0.300682 Aug 27 05:13:12.382970 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2091/4186] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:12 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:12.583586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8282c4b6-2165-497b-b733-48ff9d481890 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:12.584351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8282c4b6-2165-497b-b733-48ff9d481890 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:12.597013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8282c4b6-2165-497b-b733-48ff9d481890 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.597579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8282c4b6-2165-497b-b733-48ff9d481890 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.598391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8282c4b6-2165-497b-b733-48ff9d481890 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.599208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8282c4b6-2165-497b-b733-48ff9d481890 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.599727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8282c4b6-2165-497b-b733-48ff9d481890 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.600174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8282c4b6-2165-497b-b733-48ff9d481890 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.615350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d198df8-e8c5-4869-b2fa-c255c1325cd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:12.617368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7d198df8-e8c5-4869-b2fa-c255c1325cd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:12.630296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d198df8-e8c5-4869-b2fa-c255c1325cd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.631113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d198df8-e8c5-4869-b2fa-c255c1325cd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.631760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d198df8-e8c5-4869-b2fa-c255c1325cd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.632715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d198df8-e8c5-4869-b2fa-c255c1325cd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.633325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d198df8-e8c5-4869-b2fa-c255c1325cd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.634041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d198df8-e8c5-4869-b2fa-c255c1325cd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.722105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7d198df8-e8c5-4869-b2fa-c255c1325cd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:12.745274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7d198df8-e8c5-4869-b2fa-c255c1325cd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1267 microversion: 2.1 time: 0.135748 Aug 27 05:13:12.761401 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2092/4187] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:12 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:12.792180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8282c4b6-2165-497b-b733-48ff9d481890 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:12.800962 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8282c4b6-2165-497b-b733-48ff9d481890 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1518 microversion: 2.1 time: 0.227238 Aug 27 05:13:12.815914 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2096/4188] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:12 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1518 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:13.293371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e2bf18ae-b7fb-454c-ab72-ed66e7bd18e9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:13.294089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e2bf18ae-b7fb-454c-ab72-ed66e7bd18e9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:13.300827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2bf18ae-b7fb-454c-ab72-ed66e7bd18e9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.301397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2bf18ae-b7fb-454c-ab72-ed66e7bd18e9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.302028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2bf18ae-b7fb-454c-ab72-ed66e7bd18e9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:13.303904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2bf18ae-b7fb-454c-ab72-ed66e7bd18e9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.304409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2bf18ae-b7fb-454c-ab72-ed66e7bd18e9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.304834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2bf18ae-b7fb-454c-ab72-ed66e7bd18e9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:13.405988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:13.406868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:13.415793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.423954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.424428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:13.425194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.425658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.426270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:13.507964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e2bf18ae-b7fb-454c-ab72-ed66e7bd18e9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:13.528442 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e2bf18ae-b7fb-454c-ab72-ed66e7bd18e9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1325 microversion: 2.1 time: 0.238471 Aug 27 05:13:13.531207 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2093/4189] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:13 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:13.682097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:13.692515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:13.694312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:13.696195 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-847d98ba-e6eb-4e31-8c95-bc1885a46f71 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1406 microversion: 2.20 time: 0.294928 Aug 27 05:13:13.704564 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2097/4190] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:13 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:13:13.767253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-91633a96-9c4a-40b6-a141-0e6c08c804e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:13.767890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-91633a96-9c4a-40b6-a141-0e6c08c804e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:13.777096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91633a96-9c4a-40b6-a141-0e6c08c804e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.777605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91633a96-9c4a-40b6-a141-0e6c08c804e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.778047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91633a96-9c4a-40b6-a141-0e6c08c804e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:13.778972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91633a96-9c4a-40b6-a141-0e6c08c804e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.779667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91633a96-9c4a-40b6-a141-0e6c08c804e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.780118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91633a96-9c4a-40b6-a141-0e6c08c804e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:13.824697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b2eac34-37c6-4d93-90ba-1535b11520c2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:13.826914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2b2eac34-37c6-4d93-90ba-1535b11520c2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:13.834703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b2eac34-37c6-4d93-90ba-1535b11520c2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.835465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b2eac34-37c6-4d93-90ba-1535b11520c2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.837425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b2eac34-37c6-4d93-90ba-1535b11520c2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:13.838886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b2eac34-37c6-4d93-90ba-1535b11520c2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.840383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b2eac34-37c6-4d93-90ba-1535b11520c2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.841333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b2eac34-37c6-4d93-90ba-1535b11520c2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:14.004327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-91633a96-9c4a-40b6-a141-0e6c08c804e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:14.020472 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-91633a96-9c4a-40b6-a141-0e6c08c804e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1309 microversion: 2.1 time: 0.257302 Aug 27 05:13:14.021739 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2094/4191] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:13 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:14.034818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2b2eac34-37c6-4d93-90ba-1535b11520c2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:14.040763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c7dae158-e8e0-4f76-a5a6-a1b7b9da4e51 req-e11f6777-d043-4ad0-b211-daa20864dc62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08a333d-504a-41ad-a796-2069aecd4bd9", "tag": "6e183864-02b7-4485-8c8f-1050892f3cb4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:14.044166 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2b2eac34-37c6-4d93-90ba-1535b11520c2 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1518 microversion: 2.1 time: 0.225335 Aug 27 05:13:14.046138 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2098/4192] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:13 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1518 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:14.064291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c7dae158-e8e0-4f76-a5a6-a1b7b9da4e51 req-e11f6777-d043-4ad0-b211-daa20864dc62 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:14.064639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c7dae158-e8e0-4f76-a5a6-a1b7b9da4e51 req-e11f6777-d043-4ad0-b211-daa20864dc62 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:14.065078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c7dae158-e8e0-4f76-a5a6-a1b7b9da4e51 req-e11f6777-d043-4ad0-b211-daa20864dc62 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:14.076948 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c7dae158-e8e0-4f76-a5a6-a1b7b9da4e51 req-e11f6777-d043-4ad0-b211-daa20864dc62 service nova] Creating event network-changed:6e183864-02b7-4485-8c8f-1050892f3cb4 for instance e08a333d-504a-41ad-a796-2069aecd4bd9 on n-h2-820368-35 Aug 27 05:13:14.081992 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c7dae158-e8e0-4f76-a5a6-a1b7b9da4e51 req-e11f6777-d043-4ad0-b211-daa20864dc62 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058627 Aug 27 05:13:14.082596 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2095/4193] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:14.553219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5bf62f96-0b80-4354-aa24-a259e1e83d83 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:14.554403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5bf62f96-0b80-4354-aa24-a259e1e83d83 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:14.563979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf62f96-0b80-4354-aa24-a259e1e83d83 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:14.564905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf62f96-0b80-4354-aa24-a259e1e83d83 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:14.565738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf62f96-0b80-4354-aa24-a259e1e83d83 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:14.566750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf62f96-0b80-4354-aa24-a259e1e83d83 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:14.567684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf62f96-0b80-4354-aa24-a259e1e83d83 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:14.568352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bf62f96-0b80-4354-aa24-a259e1e83d83 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:14.720421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:14.721347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:14.733261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:14.735493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:14.739732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:14.750534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:14.752456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:14.754806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:14.860392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5bf62f96-0b80-4354-aa24-a259e1e83d83 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:14.887752 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5bf62f96-0b80-4354-aa24-a259e1e83d83 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1522 microversion: 2.1 time: 0.328000 Aug 27 05:13:14.888737 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2099/4194] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:14 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:14.915420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d801a7ca-9c08-4c6c-adb0-0782d5c596c7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:14.918118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d801a7ca-9c08-4c6c-adb0-0782d5c596c7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:14.927475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:14.937298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d801a7ca-9c08-4c6c-adb0-0782d5c596c7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:14.941798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d801a7ca-9c08-4c6c-adb0-0782d5c596c7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:14.943408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d801a7ca-9c08-4c6c-adb0-0782d5c596c7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:14.945685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d801a7ca-9c08-4c6c-adb0-0782d5c596c7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:14.947941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d801a7ca-9c08-4c6c-adb0-0782d5c596c7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:14.951001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d801a7ca-9c08-4c6c-adb0-0782d5c596c7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.097648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:15.114812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:15.116670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:15.118547 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a9581901-d071-4542-a75f-82907bf6d277 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1406 microversion: 2.20 time: 0.402909 Aug 27 05:13:15.119760 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2096/4195] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:14 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:13:15.124595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d196c68-4288-4640-abdc-c8db028167e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:15.125539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d196c68-4288-4640-abdc-c8db028167e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:15.135129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d196c68-4288-4640-abdc-c8db028167e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.136372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d196c68-4288-4640-abdc-c8db028167e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.137649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d196c68-4288-4640-abdc-c8db028167e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.140938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d196c68-4288-4640-abdc-c8db028167e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.141937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d196c68-4288-4640-abdc-c8db028167e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.143055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d196c68-4288-4640-abdc-c8db028167e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.191290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d801a7ca-9c08-4c6c-adb0-0782d5c596c7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:15.203689 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d801a7ca-9c08-4c6c-adb0-0782d5c596c7 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1522 microversion: 2.1 time: 0.295039 Aug 27 05:13:15.204716 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2100/4196] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:14 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:15.214143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:15.214888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:15.227042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.227920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.228763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.229647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.230385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.230926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.275253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.275959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.276596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.277246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lazy-loading 'fault' on Instance uuid 414cf2c1-b160-43bf-9a21-3185fa2fd06b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:15.334824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:15.345284 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b45f28ec-3c6e-4a53-b1a8-34308b0293a4 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 200 len: 1311 microversion: 2.1 time: 0.139215 Aug 27 05:13:15.359117 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2101/4197] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:15 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 1311 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:15.368136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0b4f31a5-8680-493b-b374-4c1095e584c0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1990571567"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:15.371733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0b4f31a5-8680-493b-b374-4c1095e584c0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:15.381618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b4f31a5-8680-493b-b374-4c1095e584c0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.382125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b4f31a5-8680-493b-b374-4c1095e584c0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.382647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b4f31a5-8680-493b-b374-4c1095e584c0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.383642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b4f31a5-8680-493b-b374-4c1095e584c0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.385597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b4f31a5-8680-493b-b374-4c1095e584c0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.386248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b4f31a5-8680-493b-b374-4c1095e584c0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.386764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d196c68-4288-4640-abdc-c8db028167e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:15.396039 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d196c68-4288-4640-abdc-c8db028167e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1309 microversion: 2.1 time: 0.274856 Aug 27 05:13:15.408778 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2097/4198] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:15 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1309 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:15.613256 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0b4f31a5-8680-493b-b374-4c1095e584c0 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "POST /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a/action" status: 202 len: 0 microversion: 2.1 time: 0.265627 Aug 27 05:13:15.613906 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2102/4199] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:13:15 2022] POST /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 05:13:15.627399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-00a0fb3e-b2f2-460b-843a-befc64b9031f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '.version_select at 0x7fb5644be1f0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:15.758581 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-00a0fb3e-b2f2-460b-843a-befc64b9031f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "DELETE /compute/v2.1/images/a68d1852-8dcd-4dd0-91d5-de35bcebca38" status: 204 len: 0 microversion: 2.1 time: 0.135052 Aug 27 05:13:15.759811 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2098/4200] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:15 2022] DELETE /compute/v2.1/images/a68d1852-8dcd-4dd0-91d5-de35bcebca38 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:15.768424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b7037d0e-f4ed-4285-b5fd-a218b6847622 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '.version_select at 0x7fb565436c10>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:15.792821 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-b7037d0e-f4ed-4285-b5fd-a218b6847622 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] HTTP exception thrown: Image not found. Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b7037d0e-f4ed-4285-b5fd-a218b6847622 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/images/a68d1852-8dcd-4dd0-91d5-de35bcebca38 HTTP/1.1 Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: exception: Image not found. Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'a68d1852-8dcd-4dd0-91d5-de35bcebca38'} Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a68d1852-8dcd-4dd0-91d5-de35bcebca38 Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 05:13:15.795167 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a68d1852-8dcd-4dd0-91d5-de35bcebca38 could not be found. Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b7037d0e-f4ed-4285-b5fd-a218b6847622 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 404 to user: Image not found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b7037d0e-f4ed-4285-b5fd-a218b6847622 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/images/a68d1852-8dcd-4dd0-91d5-de35bcebca38" status: 404 len: 62 microversion: 2.1 time: 0.033260 Aug 27 05:13:15.803837 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2103/4201] 10.222.0.58 () {58 vars in 1233 bytes} [Sat Aug 27 05:13:15 2022] GET /compute/v2.1/images/a68d1852-8dcd-4dd0-91d5-de35bcebca38 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 05:13:15.809133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-027a81d9-d31c-451b-8834-b284da8a815a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:15.809829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-027a81d9-d31c-451b-8834-b284da8a815a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:15.816683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027a81d9-d31c-451b-8834-b284da8a815a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.817351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027a81d9-d31c-451b-8834-b284da8a815a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.817929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027a81d9-d31c-451b-8834-b284da8a815a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.818636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027a81d9-d31c-451b-8834-b284da8a815a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.821100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027a81d9-d31c-451b-8834-b284da8a815a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.821100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027a81d9-d31c-451b-8834-b284da8a815a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.845065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:15.972755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-027a81d9-d31c-451b-8834-b284da8a815a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:15.981011 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-027a81d9-d31c-451b-8834-b284da8a815a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1534 microversion: 2.1 time: 0.178440 Aug 27 05:13:15.982141 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2099/4202] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:15 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1534 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:16.100575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-e1acad91-fa8e-4f6d-829c-fdc6a440253e req-78ab25e1-3120-4717-851b-aeac0e07e582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414cf2c1-b160-43bf-9a21-3185fa2fd06b", "name": "network-vif-deleted", "tag": "dc2c77da-3bf2-4cc3-a09c-5796e57080fe"}, {"name": "network-changed", "server_uuid": "990fabb7-dca0-43bb-92c4-93645540f6ac", "tag": "447bc2e8-b81d-4a37-adb4-15242002eb71"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:16.111754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e1acad91-fa8e-4f6d-829c-fdc6a440253e req-78ab25e1-3120-4717-851b-aeac0e07e582 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.112312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e1acad91-fa8e-4f6d-829c-fdc6a440253e req-78ab25e1-3120-4717-851b-aeac0e07e582 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.112821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e1acad91-fa8e-4f6d-829c-fdc6a440253e req-78ab25e1-3120-4717-851b-aeac0e07e582 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.124363 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-e1acad91-fa8e-4f6d-829c-fdc6a440253e req-78ab25e1-3120-4717-851b-aeac0e07e582 service nova] Creating event network-vif-deleted:dc2c77da-3bf2-4cc3-a09c-5796e57080fe for instance 414cf2c1-b160-43bf-9a21-3185fa2fd06b on n-h1-820368-35 Aug 27 05:13:16.124870 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-e1acad91-fa8e-4f6d-829c-fdc6a440253e req-78ab25e1-3120-4717-851b-aeac0e07e582 service nova] Creating event network-changed:447bc2e8-b81d-4a37-adb4-15242002eb71 for instance 990fabb7-dca0-43bb-92c4-93645540f6ac on n-h2-820368-35 Aug 27 05:13:16.134505 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-e1acad91-fa8e-4f6d-829c-fdc6a440253e req-78ab25e1-3120-4717-851b-aeac0e07e582 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038557 Aug 27 05:13:16.136197 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2104/4203] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:16.142304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:16.142963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:16.149646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.150141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.150582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.151316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.151775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.152206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.286004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:16.294987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:16.296580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:16.297703 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2765fb5b-817b-408f-844d-a9dcbafd450b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1406 microversion: 2.20 time: 0.159904 Aug 27 05:13:16.298256 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2100/4204] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:16 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:16.370374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:16.371122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 414cf2c1-b160-43bf-9a21-3185fa2fd06b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:16.378667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.379213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.379647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.380352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.380807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.381233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.395284 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] HTTP exception thrown: Instance 414cf2c1-b160-43bf-9a21-3185fa2fd06b could not be found. Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Request method failure captured: Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b HTTP/1.1 Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaegn6vDe2dDXrIyu2UVMtEnw39fTQwaeDh8KpoCgpSMMXYNFTrAuYRrvkqm-eTVg0wOPzC4sB3M3z2VDdmcRg46lIVsj_pUNrgkgIbjlQYYT5T8c9gg6cOfF10IeO3Sc-6AjKgZvr3tS1hZGhqyPZ1OgNFYpIps_RZoPW6vdamRsO4 Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: fb1a58fcad164480a373ed1c2ad516a9 Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ListServerFiltersTestJSON-1141666309 Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb1a58fcad164480a373ed1c2ad516a9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb1a58fcad164480a373ed1c2ad516a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb1a58fcad164480a373ed1c2ad516a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb1a58fcad164480a373ed1c2ad516a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ListServerFiltersTestJSON-1141666309 Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: fb1a58fcad164480a373ed1c2ad516a9 Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1141666309 Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ListServerFiltersTestJSON-1141666309-project Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5924d371bcec4bae863b774bbb084e52 Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ListServerFiltersTestJSON-1141666309-project Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 414cf2c1-b160-43bf-9a21-3185fa2fd06b could not be found. Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '414cf2c1-b160-43bf-9a21-3185fa2fd06b'} Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 414cf2c1-b160-43bf-9a21-3185fa2fd06b could not be found. Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 414cf2c1-b160-43bf-9a21-3185fa2fd06b could not be found. Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:16.396915 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.402630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:16.402630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:16.402630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:16.402630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:16.402630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:16.402630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 414cf2c1-b160-43bf-9a21-3185fa2fd06b could not be found. Aug 27 05:13:16.402630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.402630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Returning 404 to user: Instance 414cf2c1-b160-43bf-9a21-3185fa2fd06b could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:16.402630 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9a5ed97e-2c27-471b-96d9-3079b6c53024 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b" status: 404 len: 111 microversion: 2.1 time: 0.033475 Aug 27 05:13:16.402630 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2105/4205] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:16 2022] GET /compute/v2.1/servers/414cf2c1-b160-43bf-9a21-3185fa2fd06b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:16.408460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ada6fb8f-afc6-4422-ae16-e5750f1a82ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:16.409088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ada6fb8f-afc6-4422-ae16-e5750f1a82ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 5bb0289f-a421-4664-bdd2-1133b9e99e56] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:16.416388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ada6fb8f-afc6-4422-ae16-e5750f1a82ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.416715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ada6fb8f-afc6-4422-ae16-e5750f1a82ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.417045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ada6fb8f-afc6-4422-ae16-e5750f1a82ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.417994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ada6fb8f-afc6-4422-ae16-e5750f1a82ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.418490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ebf7af6b-cbe7-47f0-868a-55d1ad99f30e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:16.418661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ada6fb8f-afc6-4422-ae16-e5750f1a82ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.419119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ebf7af6b-cbe7-47f0-868a-55d1ad99f30e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:16.419851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ada6fb8f-afc6-4422-ae16-e5750f1a82ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.425643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebf7af6b-cbe7-47f0-868a-55d1ad99f30e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.426133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebf7af6b-cbe7-47f0-868a-55d1ad99f30e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.426566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebf7af6b-cbe7-47f0-868a-55d1ad99f30e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.427303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebf7af6b-cbe7-47f0-868a-55d1ad99f30e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.427755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebf7af6b-cbe7-47f0-868a-55d1ad99f30e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.428181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebf7af6b-cbe7-47f0-868a-55d1ad99f30e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.448520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ada6fb8f-afc6-4422-ae16-e5750f1a82ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 5bb0289f-a421-4664-bdd2-1133b9e99e56] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:16.544738 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ada6fb8f-afc6-4422-ae16-e5750f1a82ac tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56" status: 204 len: 0 microversion: 2.1 time: 0.140485 Aug 27 05:13:16.545588 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2101/4206] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:16 2022] DELETE /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:16.555531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3fbd596c-8659-4312-ba89-9282b2ae1586 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:16.556415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3fbd596c-8659-4312-ba89-9282b2ae1586 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 5bb0289f-a421-4664-bdd2-1133b9e99e56] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:16.562437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fbd596c-8659-4312-ba89-9282b2ae1586 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.563201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fbd596c-8659-4312-ba89-9282b2ae1586 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.563806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fbd596c-8659-4312-ba89-9282b2ae1586 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.564515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fbd596c-8659-4312-ba89-9282b2ae1586 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.564972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fbd596c-8659-4312-ba89-9282b2ae1586 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.565405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fbd596c-8659-4312-ba89-9282b2ae1586 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.583652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ebf7af6b-cbe7-47f0-868a-55d1ad99f30e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:16.592993 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ebf7af6b-cbe7-47f0-868a-55d1ad99f30e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1309 microversion: 2.1 time: 0.178919 Aug 27 05:13:16.593574 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2106/4207] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:16 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1309 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:17.002059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a57d6ea7-ea9b-44a4-b267-59ddee159b56 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:17.003071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a57d6ea7-ea9b-44a4-b267-59ddee159b56 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:17.010742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a57d6ea7-ea9b-44a4-b267-59ddee159b56 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:17.011276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a57d6ea7-ea9b-44a4-b267-59ddee159b56 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:17.011770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a57d6ea7-ea9b-44a4-b267-59ddee159b56 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:17.012432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a57d6ea7-ea9b-44a4-b267-59ddee159b56 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:17.013097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a57d6ea7-ea9b-44a4-b267-59ddee159b56 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:17.013779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a57d6ea7-ea9b-44a4-b267-59ddee159b56 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:17.023563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3fbd596c-8659-4312-ba89-9282b2ae1586 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:17.032660 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3fbd596c-8659-4312-ba89-9282b2ae1586 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56" status: 200 len: 1517 microversion: 2.1 time: 0.482062 Aug 27 05:13:17.039692 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2102/4208] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:16 2022] GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56 => generated 1517 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:17.149380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a57d6ea7-ea9b-44a4-b267-59ddee159b56 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:17.156950 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a57d6ea7-ea9b-44a4-b267-59ddee159b56 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1534 microversion: 2.1 time: 0.159122 Aug 27 05:13:17.157521 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2107/4209] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:16 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1534 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:17.320790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:17.321518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:17.327656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:17.328335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:17.328777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:17.329649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:17.330102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:17.330528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:17.470149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:17.479752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:17.481308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:17.482506 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-50023a76-6d63-43fc-b97a-33a9107150d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1406 microversion: 2.20 time: 0.166215 Aug 27 05:13:17.483271 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2103/4210] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:17 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:17.615687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9d60785c-2283-48ea-8cc6-3ac54915bd16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:17.616319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9d60785c-2283-48ea-8cc6-3ac54915bd16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:17.623138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d60785c-2283-48ea-8cc6-3ac54915bd16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:17.623546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d60785c-2283-48ea-8cc6-3ac54915bd16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:17.623993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d60785c-2283-48ea-8cc6-3ac54915bd16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:17.624878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d60785c-2283-48ea-8cc6-3ac54915bd16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:17.625413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d60785c-2283-48ea-8cc6-3ac54915bd16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:17.625904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d60785c-2283-48ea-8cc6-3ac54915bd16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:17.806792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9d60785c-2283-48ea-8cc6-3ac54915bd16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:17.814886 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9d60785c-2283-48ea-8cc6-3ac54915bd16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1309 microversion: 2.1 time: 0.203520 Aug 27 05:13:17.815506 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2108/4211] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:17 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1309 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:18.058289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cbfe670f-e88d-4a74-8746-28e292e17f93 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:18.059401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cbfe670f-e88d-4a74-8746-28e292e17f93 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 5bb0289f-a421-4664-bdd2-1133b9e99e56] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:18.067842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbfe670f-e88d-4a74-8746-28e292e17f93 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.068573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbfe670f-e88d-4a74-8746-28e292e17f93 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.069401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbfe670f-e88d-4a74-8746-28e292e17f93 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:18.070964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbfe670f-e88d-4a74-8746-28e292e17f93 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.071618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbfe670f-e88d-4a74-8746-28e292e17f93 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.072249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbfe670f-e88d-4a74-8746-28e292e17f93 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:18.177831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b5ff16b1-e134-4913-8b9e-32ff06c5c343 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:18.178577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b5ff16b1-e134-4913-8b9e-32ff06c5c343 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:18.202023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5ff16b1-e134-4913-8b9e-32ff06c5c343 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.202816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5ff16b1-e134-4913-8b9e-32ff06c5c343 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.203474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5ff16b1-e134-4913-8b9e-32ff06c5c343 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:18.204392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5ff16b1-e134-4913-8b9e-32ff06c5c343 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.205018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5ff16b1-e134-4913-8b9e-32ff06c5c343 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.205661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5ff16b1-e134-4913-8b9e-32ff06c5c343 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:18.333870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cbfe670f-e88d-4a74-8746-28e292e17f93 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:18.345147 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cbfe670f-e88d-4a74-8746-28e292e17f93 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56" status: 200 len: 1517 microversion: 2.1 time: 0.293611 Aug 27 05:13:18.346840 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2104/4212] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:18 2022] GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56 => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:18.432910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b5ff16b1-e134-4913-8b9e-32ff06c5c343 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:18.435187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:18.443617 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b5ff16b1-e134-4913-8b9e-32ff06c5c343 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1534 microversion: 2.1 time: 0.269627 Aug 27 05:13:18.444584 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2109/4213] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:18 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1534 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:18.506859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:18.515320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:18.531433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.531965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.532407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:18.533765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.534268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.534925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:18.686373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:18.703763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:18.705506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:18.706908 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-42b79d20-da76-4fd7-9856-3a6476e545c7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1406 microversion: 2.20 time: 0.204855 Aug 27 05:13:18.719993 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2105/4214] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:18 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:18.839581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b3ed1c23-f5a4-4f47-8e32-151d27ed76ed tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:18.840774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b3ed1c23-f5a4-4f47-8e32-151d27ed76ed tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:18.851660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3ed1c23-f5a4-4f47-8e32-151d27ed76ed tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.852508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3ed1c23-f5a4-4f47-8e32-151d27ed76ed tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.852955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3ed1c23-f5a4-4f47-8e32-151d27ed76ed tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:18.854254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3ed1c23-f5a4-4f47-8e32-151d27ed76ed tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.854986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3ed1c23-f5a4-4f47-8e32-151d27ed76ed tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.855446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3ed1c23-f5a4-4f47-8e32-151d27ed76ed tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.018867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b3ed1c23-f5a4-4f47-8e32-151d27ed76ed tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:19.029108 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b3ed1c23-f5a4-4f47-8e32-151d27ed76ed tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1309 microversion: 2.1 time: 0.196096 Aug 27 05:13:19.029695 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2110/4215] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:18 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:19.366988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-93277299-5a3e-4ab0-b417-5518a4662764 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:19.368177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-93277299-5a3e-4ab0-b417-5518a4662764 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 5bb0289f-a421-4664-bdd2-1133b9e99e56] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:19.376372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277299-5a3e-4ab0-b417-5518a4662764 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.376877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277299-5a3e-4ab0-b417-5518a4662764 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.377821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277299-5a3e-4ab0-b417-5518a4662764 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.378020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277299-5a3e-4ab0-b417-5518a4662764 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.378480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277299-5a3e-4ab0-b417-5518a4662764 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.378911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277299-5a3e-4ab0-b417-5518a4662764 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.452550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-93277299-5a3e-4ab0-b417-5518a4662764 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:19.463289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b292ab45-8dba-41bd-906b-9abfd09a03f1 req-e0f2db12-964c-46c7-8115-26776da52b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb0289f-a421-4664-bdd2-1133b9e99e56", "name": "network-vif-deleted", "tag": "e245a126-f6fc-4e9e-b345-3109a61d051d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:19.464143 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-93277299-5a3e-4ab0-b417-5518a4662764 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56" status: 200 len: 1475 microversion: 2.1 time: 0.101363 Aug 27 05:13:19.464726 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2106/4216] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:19 2022] GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56 => generated 1475 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:19.471228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69874f29-68fe-4709-b246-d1606081356d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:19.472155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-69874f29-68fe-4709-b246-d1606081356d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:19.475623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:19.479575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b292ab45-8dba-41bd-906b-9abfd09a03f1 req-e0f2db12-964c-46c7-8115-26776da52b51 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.480266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b292ab45-8dba-41bd-906b-9abfd09a03f1 req-e0f2db12-964c-46c7-8115-26776da52b51 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.481016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69874f29-68fe-4709-b246-d1606081356d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.481187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b292ab45-8dba-41bd-906b-9abfd09a03f1 req-e0f2db12-964c-46c7-8115-26776da52b51 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.481840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69874f29-68fe-4709-b246-d1606081356d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.482502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69874f29-68fe-4709-b246-d1606081356d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.483618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69874f29-68fe-4709-b246-d1606081356d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.484308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69874f29-68fe-4709-b246-d1606081356d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.484890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69874f29-68fe-4709-b246-d1606081356d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.497408 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b292ab45-8dba-41bd-906b-9abfd09a03f1 req-e0f2db12-964c-46c7-8115-26776da52b51 service nova] Creating event network-vif-deleted:e245a126-f6fc-4e9e-b345-3109a61d051d for instance 5bb0289f-a421-4664-bdd2-1133b9e99e56 on n-h1-820368-35 Aug 27 05:13:19.502749 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b292ab45-8dba-41bd-906b-9abfd09a03f1 req-e0f2db12-964c-46c7-8115-26776da52b51 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046115 Aug 27 05:13:19.504303 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2111/4217] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:19.635117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-69874f29-68fe-4709-b246-d1606081356d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:19.644014 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-69874f29-68fe-4709-b246-d1606081356d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1540 microversion: 2.1 time: 0.177728 Aug 27 05:13:19.644663 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2107/4218] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:19 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1540 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:19.731907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:19.732631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:19.739967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.740468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.740910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.741876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.742339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.742803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.914544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:19.923856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:19.925339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:19.926843 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ba8d79e5-7e2d-49c5-9af6-532caa64ced6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1406 microversion: 2.20 time: 0.199560 Aug 27 05:13:19.927697 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2112/4219] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:19 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:20.050801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b57ed7f0-a993-4bfd-940d-febf54743aee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:20.052416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b57ed7f0-a993-4bfd-940d-febf54743aee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:20.059579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b57ed7f0-a993-4bfd-940d-febf54743aee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.060287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b57ed7f0-a993-4bfd-940d-febf54743aee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.060898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b57ed7f0-a993-4bfd-940d-febf54743aee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.062074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b57ed7f0-a993-4bfd-940d-febf54743aee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.062683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b57ed7f0-a993-4bfd-940d-febf54743aee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.063504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b57ed7f0-a993-4bfd-940d-febf54743aee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.229689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b57ed7f0-a993-4bfd-940d-febf54743aee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:20.239945 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b57ed7f0-a993-4bfd-940d-febf54743aee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1309 microversion: 2.1 time: 0.193528 Aug 27 05:13:20.240766 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2108/4220] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:20 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:20.256312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-ac042491-a00b-427a-bf8d-c5cd1231123d req-2146448f-76bd-4010-8ea1-d45464040415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08a333d-504a-41ad-a796-2069aecd4bd9", "name": "network-vif-plugged", "status": "completed", "tag": "6e183864-02b7-4485-8c8f-1050892f3cb4"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:20.271197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ac042491-a00b-427a-bf8d-c5cd1231123d req-2146448f-76bd-4010-8ea1-d45464040415 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.271618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ac042491-a00b-427a-bf8d-c5cd1231123d req-2146448f-76bd-4010-8ea1-d45464040415 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.272055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ac042491-a00b-427a-bf8d-c5cd1231123d req-2146448f-76bd-4010-8ea1-d45464040415 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.285099 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-ac042491-a00b-427a-bf8d-c5cd1231123d req-2146448f-76bd-4010-8ea1-d45464040415 service nova] Creating event network-vif-plugged:6e183864-02b7-4485-8c8f-1050892f3cb4 for instance e08a333d-504a-41ad-a796-2069aecd4bd9 on n-h2-820368-35 Aug 27 05:13:20.290417 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-ac042491-a00b-427a-bf8d-c5cd1231123d req-2146448f-76bd-4010-8ea1-d45464040415 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040671 Aug 27 05:13:20.291215 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2113/4221] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:20.490445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:20.491010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 5bb0289f-a421-4664-bdd2-1133b9e99e56] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:20.493560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=18 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:20.494407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=22 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:20.501436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.502164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.503065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.503939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.504542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.505132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.521273 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] HTTP exception thrown: Instance 5bb0289f-a421-4664-bdd2-1133b9e99e56 could not be found. Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Request method failure captured: Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56 HTTP/1.1 Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaegn6vDe2dDXrIyu2UVMtEnw39fTQwaeDh8KpoCgpSMMXYNFTrAuYRrvkqm-eTVg0wOPzC4sB3M3z2VDdmcRg46lIVsj_pUNrgkgIbjlQYYT5T8c9gg6cOfF10IeO3Sc-6AjKgZvr3tS1hZGhqyPZ1OgNFYpIps_RZoPW6vdamRsO4 Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: fb1a58fcad164480a373ed1c2ad516a9 Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ListServerFiltersTestJSON-1141666309 Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb1a58fcad164480a373ed1c2ad516a9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb1a58fcad164480a373ed1c2ad516a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb1a58fcad164480a373ed1c2ad516a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb1a58fcad164480a373ed1c2ad516a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ListServerFiltersTestJSON-1141666309 Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: fb1a58fcad164480a373ed1c2ad516a9 Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1141666309 Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ListServerFiltersTestJSON-1141666309-project Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5924d371bcec4bae863b774bbb084e52 Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ListServerFiltersTestJSON-1141666309-project Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 5bb0289f-a421-4664-bdd2-1133b9e99e56 could not be found. Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '5bb0289f-a421-4664-bdd2-1133b9e99e56'} Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb0289f-a421-4664-bdd2-1133b9e99e56 could not be found. Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb0289f-a421-4664-bdd2-1133b9e99e56 could not be found. Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:20.523901 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:20.529360 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:20.529360 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:20.529360 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:20.529360 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:20.529360 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:20.529360 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb0289f-a421-4664-bdd2-1133b9e99e56 could not be found. Aug 27 05:13:20.529360 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:20.529360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Returning 404 to user: Instance 5bb0289f-a421-4664-bdd2-1133b9e99e56 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:20.529360 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ff4ce58-204d-49d4-8e05-17b13d78ebef tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56" status: 404 len: 111 microversion: 2.1 time: 0.038779 Aug 27 05:13:20.529360 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2109/4222] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:20 2022] GET /compute/v2.1/servers/5bb0289f-a421-4664-bdd2-1133b9e99e56 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:20.532349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=24 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:20.538152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a33f7e0-4a7b-4bed-80e7-68dc0df3e3f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:20.539726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a33f7e0-4a7b-4bed-80e7-68dc0df3e3f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:20.547229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a33f7e0-4a7b-4bed-80e7-68dc0df3e3f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.547798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a33f7e0-4a7b-4bed-80e7-68dc0df3e3f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.548589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a33f7e0-4a7b-4bed-80e7-68dc0df3e3f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.549370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a33f7e0-4a7b-4bed-80e7-68dc0df3e3f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.549906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a33f7e0-4a7b-4bed-80e7-68dc0df3e3f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.550330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a33f7e0-4a7b-4bed-80e7-68dc0df3e3f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.579880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a33f7e0-4a7b-4bed-80e7-68dc0df3e3f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:20.667424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-44342fc4-b196-462f-a33d-570a3ace245b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:20.668489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-44342fc4-b196-462f-a33d-570a3ace245b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:20.668924 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a33f7e0-4a7b-4bed-80e7-68dc0df3e3f0 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "DELETE /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 204 len: 0 microversion: 2.1 time: 0.137029 Aug 27 05:13:20.671182 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2114/4223] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:20 2022] DELETE /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:20.680237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33c1132f-3cfb-412f-b29b-19779a4f1960 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:20.680376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44342fc4-b196-462f-a33d-570a3ace245b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.681098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-33c1132f-3cfb-412f-b29b-19779a4f1960 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:20.681267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44342fc4-b196-462f-a33d-570a3ace245b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.682363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44342fc4-b196-462f-a33d-570a3ace245b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.683692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44342fc4-b196-462f-a33d-570a3ace245b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.684549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44342fc4-b196-462f-a33d-570a3ace245b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.685355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-44342fc4-b196-462f-a33d-570a3ace245b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.687736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33c1132f-3cfb-412f-b29b-19779a4f1960 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.688316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33c1132f-3cfb-412f-b29b-19779a4f1960 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.688819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33c1132f-3cfb-412f-b29b-19779a4f1960 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.689861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33c1132f-3cfb-412f-b29b-19779a4f1960 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.690478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33c1132f-3cfb-412f-b29b-19779a4f1960 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.691067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33c1132f-3cfb-412f-b29b-19779a4f1960 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.904860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-44342fc4-b196-462f-a33d-570a3ace245b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:20.907384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-33c1132f-3cfb-412f-b29b-19779a4f1960 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:20.914983 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-44342fc4-b196-462f-a33d-570a3ace245b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1540 microversion: 2.1 time: 0.252221 Aug 27 05:13:20.916099 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2110/4224] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:20 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1540 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:20.916426 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-33c1132f-3cfb-412f-b29b-19779a4f1960 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1518 microversion: 2.1 time: 0.240929 Aug 27 05:13:20.916995 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2115/4225] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:20 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1518 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:20.957971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:20.958590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:20.965309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.965809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.966416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.967402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.968488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.968925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.116323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:21.125063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:21.126642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:21.127900 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-86dd10a1-e887-4774-89d6-2a1c61873250 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1406 microversion: 2.20 time: 0.181762 Aug 27 05:13:21.128554 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2111/4226] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:20 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:21.262793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c076c6f-da91-4268-81b5-fa1bb649eac7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:21.263603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c076c6f-da91-4268-81b5-fa1bb649eac7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:21.270017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c076c6f-da91-4268-81b5-fa1bb649eac7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.270557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c076c6f-da91-4268-81b5-fa1bb649eac7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.270990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c076c6f-da91-4268-81b5-fa1bb649eac7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.271704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c076c6f-da91-4268-81b5-fa1bb649eac7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.272162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c076c6f-da91-4268-81b5-fa1bb649eac7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.272590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c076c6f-da91-4268-81b5-fa1bb649eac7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.403575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9c076c6f-da91-4268-81b5-fa1bb649eac7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:21.414440 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c076c6f-da91-4268-81b5-fa1bb649eac7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1309 microversion: 2.1 time: 0.155673 Aug 27 05:13:21.415405 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2116/4227] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:21 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1309 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:21.937535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1b10a34d-abee-4622-9d02-09785d4ac20f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:21.938143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1b10a34d-abee-4622-9d02-09785d4ac20f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:21.947644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b10a34d-abee-4622-9d02-09785d4ac20f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.948187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b10a34d-abee-4622-9d02-09785d4ac20f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.948770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b10a34d-abee-4622-9d02-09785d4ac20f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.949514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b10a34d-abee-4622-9d02-09785d4ac20f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.949631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a96ac1b2-2478-4169-a1f0-da29b967a619 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:21.950289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a96ac1b2-2478-4169-a1f0-da29b967a619 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:21.950736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b10a34d-abee-4622-9d02-09785d4ac20f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.951383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b10a34d-abee-4622-9d02-09785d4ac20f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.957360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a96ac1b2-2478-4169-a1f0-da29b967a619 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.957930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a96ac1b2-2478-4169-a1f0-da29b967a619 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.958434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a96ac1b2-2478-4169-a1f0-da29b967a619 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.959290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a96ac1b2-2478-4169-a1f0-da29b967a619 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.959824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a96ac1b2-2478-4169-a1f0-da29b967a619 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.960913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a96ac1b2-2478-4169-a1f0-da29b967a619 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:22.172441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a96ac1b2-2478-4169-a1f0-da29b967a619 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:22.181000 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a96ac1b2-2478-4169-a1f0-da29b967a619 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1518 microversion: 2.1 time: 0.237217 Aug 27 05:13:22.182138 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2117/4228] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:21 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:22.187156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:22.187990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:22.203657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1b10a34d-abee-4622-9d02-09785d4ac20f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:22.214998 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1b10a34d-abee-4622-9d02-09785d4ac20f tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1540 microversion: 2.1 time: 0.281340 Aug 27 05:13:22.215229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:22.215827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:22.216420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:22.217353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:22.217871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:22.218689 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2112/4229] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:21 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1540 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:22.221184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:22.392560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:22.401548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:22.402999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:22.407769 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-45f4a9c6-593a-4c29-930e-aab912607f84 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1406 microversion: 2.20 time: 0.224446 Aug 27 05:13:22.408359 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2118/4230] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:22 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:22.436929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b23540c0-7044-4a95-ad5c-b30bf219548f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:22.439035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b23540c0-7044-4a95-ad5c-b30bf219548f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:22.446595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23540c0-7044-4a95-ad5c-b30bf219548f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:22.447082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23540c0-7044-4a95-ad5c-b30bf219548f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:22.447550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23540c0-7044-4a95-ad5c-b30bf219548f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:22.448254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23540c0-7044-4a95-ad5c-b30bf219548f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:22.448705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23540c0-7044-4a95-ad5c-b30bf219548f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:22.449128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b23540c0-7044-4a95-ad5c-b30bf219548f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:22.563484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c4c5fcf2-2712-4e30-a5a0-54800aa69212 req-45238547-78d0-47ce-8593-c5165f8c07ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290c9cc0-3ff4-45e6-8e5c-b885a54cc30a", "name": "network-vif-plugged", "status": "completed", "tag": "106f2f3f-c34b-4f95-9a32-5acf05d7e9ad"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:22.581443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c4c5fcf2-2712-4e30-a5a0-54800aa69212 req-45238547-78d0-47ce-8593-c5165f8c07ac service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:22.583442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c4c5fcf2-2712-4e30-a5a0-54800aa69212 req-45238547-78d0-47ce-8593-c5165f8c07ac service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:22.584166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c4c5fcf2-2712-4e30-a5a0-54800aa69212 req-45238547-78d0-47ce-8593-c5165f8c07ac service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:22.594350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b23540c0-7044-4a95-ad5c-b30bf219548f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:22.603778 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b23540c0-7044-4a95-ad5c-b30bf219548f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1309 microversion: 2.1 time: 0.171497 Aug 27 05:13:22.604367 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2113/4231] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:22 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:22.610449 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c4c5fcf2-2712-4e30-a5a0-54800aa69212 req-45238547-78d0-47ce-8593-c5165f8c07ac service nova] Creating event network-vif-plugged:106f2f3f-c34b-4f95-9a32-5acf05d7e9ad for instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a on n-h1-820368-35 Aug 27 05:13:22.621605 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c4c5fcf2-2712-4e30-a5a0-54800aa69212 req-45238547-78d0-47ce-8593-c5165f8c07ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062683 Aug 27 05:13:22.622553 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2119/4232] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:23.205917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-48238652-2122-4cce-85cc-fcb767c96498 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:23.206529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-48238652-2122-4cce-85cc-fcb767c96498 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:23.214140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48238652-2122-4cce-85cc-fcb767c96498 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.214626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48238652-2122-4cce-85cc-fcb767c96498 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.215058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48238652-2122-4cce-85cc-fcb767c96498 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.215769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48238652-2122-4cce-85cc-fcb767c96498 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.216471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48238652-2122-4cce-85cc-fcb767c96498 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.216898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48238652-2122-4cce-85cc-fcb767c96498 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.242169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4689c053-457b-4d42-9dd6-1b5c32c70774 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:23.242876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4689c053-457b-4d42-9dd6-1b5c32c70774 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:23.249244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4689c053-457b-4d42-9dd6-1b5c32c70774 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.249728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4689c053-457b-4d42-9dd6-1b5c32c70774 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.250167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4689c053-457b-4d42-9dd6-1b5c32c70774 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.250862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4689c053-457b-4d42-9dd6-1b5c32c70774 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.251348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4689c053-457b-4d42-9dd6-1b5c32c70774 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.251919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4689c053-457b-4d42-9dd6-1b5c32c70774 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.424240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-48238652-2122-4cce-85cc-fcb767c96498 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:23.432576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4689c053-457b-4d42-9dd6-1b5c32c70774 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:23.439685 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-48238652-2122-4cce-85cc-fcb767c96498 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1518 microversion: 2.1 time: 0.237505 Aug 27 05:13:23.440524 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2114/4233] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:23 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:23.441523 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4689c053-457b-4d42-9dd6-1b5c32c70774 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1540 microversion: 2.1 time: 0.204302 Aug 27 05:13:23.442643 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2120/4234] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:23 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1540 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:23.446442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:23.447285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:23.453800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.454505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.455163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.456012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.456420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.457022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.475661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:23.596621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:23.605687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:23.607173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:23.608308 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b25a145-4af0-4d64-8151-1aebb0045ee0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1406 microversion: 2.20 time: 0.166648 Aug 27 05:13:23.608883 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2115/4235] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:23 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:23.621844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f41d21ba-d406-4bc9-89aa-2cd1830d9f2a tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:23.622344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f41d21ba-d406-4bc9-89aa-2cd1830d9f2a tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:23.628184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-31a16eca-a370-4bd0-a8bd-b5522a6c9685 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:23.628454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41d21ba-d406-4bc9-89aa-2cd1830d9f2a tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.628774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-31a16eca-a370-4bd0-a8bd-b5522a6c9685 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:23.628946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41d21ba-d406-4bc9-89aa-2cd1830d9f2a tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.629386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41d21ba-d406-4bc9-89aa-2cd1830d9f2a tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.630084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41d21ba-d406-4bc9-89aa-2cd1830d9f2a tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.630573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41d21ba-d406-4bc9-89aa-2cd1830d9f2a tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.631003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f41d21ba-d406-4bc9-89aa-2cd1830d9f2a tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.635771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a16eca-a370-4bd0-a8bd-b5522a6c9685 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.636262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a16eca-a370-4bd0-a8bd-b5522a6c9685 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.636692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a16eca-a370-4bd0-a8bd-b5522a6c9685 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.637394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a16eca-a370-4bd0-a8bd-b5522a6c9685 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.637890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a16eca-a370-4bd0-a8bd-b5522a6c9685 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.638297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31a16eca-a370-4bd0-a8bd-b5522a6c9685 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.659987 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f41d21ba-d406-4bc9-89aa-2cd1830d9f2a tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042367 Aug 27 05:13:23.660575 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2121/4236] 10.222.0.58 () {58 vars in 1293 bytes} [Sat Aug 27 05:13:23 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d/os-server-password => generated 116 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:23.771896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-31a16eca-a370-4bd0-a8bd-b5522a6c9685 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:23.780943 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-31a16eca-a370-4bd0-a8bd-b5522a6c9685 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1309 microversion: 2.1 time: 0.155518 Aug 27 05:13:23.780943 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2116/4237] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:23 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1309 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:24.463955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5d208618-3728-4e5b-8e93-d1b07a28ff81 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:24.464576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5d208618-3728-4e5b-8e93-d1b07a28ff81 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:24.465050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-41c61769-c4c6-4b00-8111-304801b95ba2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:24.465665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-41c61769-c4c6-4b00-8111-304801b95ba2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:24.471577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d208618-3728-4e5b-8e93-d1b07a28ff81 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.472021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d208618-3728-4e5b-8e93-d1b07a28ff81 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.472465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d208618-3728-4e5b-8e93-d1b07a28ff81 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.473225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d208618-3728-4e5b-8e93-d1b07a28ff81 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.473350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41c61769-c4c6-4b00-8111-304801b95ba2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.474054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d208618-3728-4e5b-8e93-d1b07a28ff81 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.474179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41c61769-c4c6-4b00-8111-304801b95ba2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.474631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d208618-3728-4e5b-8e93-d1b07a28ff81 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.474868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41c61769-c4c6-4b00-8111-304801b95ba2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.475816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41c61769-c4c6-4b00-8111-304801b95ba2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.476851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41c61769-c4c6-4b00-8111-304801b95ba2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.477262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41c61769-c4c6-4b00-8111-304801b95ba2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.669312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d208618-3728-4e5b-8e93-d1b07a28ff81 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:24.673003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-41c61769-c4c6-4b00-8111-304801b95ba2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:24.678040 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5d208618-3728-4e5b-8e93-d1b07a28ff81 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1518 microversion: 2.1 time: 0.220118 Aug 27 05:13:24.678621 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2122/4238] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:24 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1518 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:24.683379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:24.683993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:24.690509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.691007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.691582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.692464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.692928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.693362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.694523 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-41c61769-c4c6-4b00-8111-304801b95ba2 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1540 microversion: 2.1 time: 0.234210 Aug 27 05:13:24.695621 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2117/4239] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:24 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1540 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:24.700020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4f5fbc7d-1a49-4b31-a656-a5ab6ed25346 req-2726d059-6bbd-48ed-81b0-b3dedefbe7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990fabb7-dca0-43bb-92c4-93645540f6ac", "name": "network-vif-plugged", "status": "completed", "tag": "447bc2e8-b81d-4a37-adb4-15242002eb71"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:24.713774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4f5fbc7d-1a49-4b31-a656-a5ab6ed25346 req-2726d059-6bbd-48ed-81b0-b3dedefbe7bf service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.714258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4f5fbc7d-1a49-4b31-a656-a5ab6ed25346 req-2726d059-6bbd-48ed-81b0-b3dedefbe7bf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.714684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4f5fbc7d-1a49-4b31-a656-a5ab6ed25346 req-2726d059-6bbd-48ed-81b0-b3dedefbe7bf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.726491 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4f5fbc7d-1a49-4b31-a656-a5ab6ed25346 req-2726d059-6bbd-48ed-81b0-b3dedefbe7bf service nova] Creating event network-vif-plugged:447bc2e8-b81d-4a37-adb4-15242002eb71 for instance 990fabb7-dca0-43bb-92c4-93645540f6ac on n-h2-820368-35 Aug 27 05:13:24.731870 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4f5fbc7d-1a49-4b31-a656-a5ab6ed25346 req-2726d059-6bbd-48ed-81b0-b3dedefbe7bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035383 Aug 27 05:13:24.732490 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2118/4240] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:24.801760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-585cd965-e771-4b57-8de5-20a91407a2f8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:24.802640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-585cd965-e771-4b57-8de5-20a91407a2f8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:24.809852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585cd965-e771-4b57-8de5-20a91407a2f8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.810862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585cd965-e771-4b57-8de5-20a91407a2f8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.810862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585cd965-e771-4b57-8de5-20a91407a2f8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.812918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585cd965-e771-4b57-8de5-20a91407a2f8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.813498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585cd965-e771-4b57-8de5-20a91407a2f8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.814090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-585cd965-e771-4b57-8de5-20a91407a2f8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.841594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:24.850437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:24.852008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:24.853151 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1c851551-64ef-403d-9c37-1bca8a012114 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1406 microversion: 2.20 time: 0.173401 Aug 27 05:13:24.853911 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2123/4241] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:24 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:24.959022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-585cd965-e771-4b57-8de5-20a91407a2f8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:24.976269 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-585cd965-e771-4b57-8de5-20a91407a2f8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1309 microversion: 2.1 time: 0.178561 Aug 27 05:13:24.979368 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2119/4242] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:24 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1309 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:25.140156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-3db21e67-66cb-404c-9857-a91247f2fd6c req-ba878939-b92d-4588-b994-ab44960a9daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871c1afd-5f3a-4cf5-93c2-01c274d2a4bb", "name": "network-vif-deleted", "tag": "a39f49ec-9e04-46ba-b543-f745bd65b603"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:25.155689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3db21e67-66cb-404c-9857-a91247f2fd6c req-ba878939-b92d-4588-b994-ab44960a9daf service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.156685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3db21e67-66cb-404c-9857-a91247f2fd6c req-ba878939-b92d-4588-b994-ab44960a9daf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.157381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3db21e67-66cb-404c-9857-a91247f2fd6c req-ba878939-b92d-4588-b994-ab44960a9daf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.174149 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-3db21e67-66cb-404c-9857-a91247f2fd6c req-ba878939-b92d-4588-b994-ab44960a9daf service nova] Creating event network-vif-deleted:a39f49ec-9e04-46ba-b543-f745bd65b603 for instance 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb on n-h2-820368-35 Aug 27 05:13:25.183881 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-3db21e67-66cb-404c-9857-a91247f2fd6c req-ba878939-b92d-4588-b994-ab44960a9daf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047475 Aug 27 05:13:25.185213 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2124/4243] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:25.700225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:25.700835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:25.707640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.708121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.708579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.709269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.709719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.710707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.718275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ac4a9d8b-3f17-4a22-9c4a-1c949a8303a3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:25.719018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ac4a9d8b-3f17-4a22-9c4a-1c949a8303a3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:25.725480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac4a9d8b-3f17-4a22-9c4a-1c949a8303a3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.725972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac4a9d8b-3f17-4a22-9c4a-1c949a8303a3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.726414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac4a9d8b-3f17-4a22-9c4a-1c949a8303a3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.727153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac4a9d8b-3f17-4a22-9c4a-1c949a8303a3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.727616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac4a9d8b-3f17-4a22-9c4a-1c949a8303a3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.728046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac4a9d8b-3f17-4a22-9c4a-1c949a8303a3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.744002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.744002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.744450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.745043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lazy-loading 'fault' on Instance uuid 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:25.817900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5924d371bcec4bae863b774bbb084e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a58fcad164480a373ed1c2ad516a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:25.826689 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-89a145c4-1df3-4f39-8b8d-ea36ea88ff03 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 200 len: 1311 microversion: 2.1 time: 0.130332 Aug 27 05:13:25.827301 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2120/4244] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:25 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:25.875535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:25.876148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:25.882528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.883006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.883503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.884144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ac4a9d8b-3f17-4a22-9c4a-1c949a8303a3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:25.884537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.884983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.885414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.892807 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ac4a9d8b-3f17-4a22-9c4a-1c949a8303a3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1535 microversion: 2.1 time: 0.179702 Aug 27 05:13:25.893401 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2125/4245] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:25 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1535 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:26.001800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d95a1361-d949-4e98-8ce7-63e115557021 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:26.002424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d95a1361-d949-4e98-8ce7-63e115557021 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:26.009002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d95a1361-d949-4e98-8ce7-63e115557021 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:26.009779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d95a1361-d949-4e98-8ce7-63e115557021 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:26.010220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d95a1361-d949-4e98-8ce7-63e115557021 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:26.010936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d95a1361-d949-4e98-8ce7-63e115557021 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:26.011438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d95a1361-d949-4e98-8ce7-63e115557021 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:26.011875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d95a1361-d949-4e98-8ce7-63e115557021 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:26.017661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:26.025675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:26.027165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:26.028332 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b12ae50-8175-4a53-962e-1d64fb023a64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1598 microversion: 2.20 time: 0.156907 Aug 27 05:13:26.028969 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2121/4246] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:25 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:13:26.050198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-78c227ee-35bc-4c5b-80e6-f63e3f896ba8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:26.050696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-78c227ee-35bc-4c5b-80e6-f63e3f896ba8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:26.057317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78c227ee-35bc-4c5b-80e6-f63e3f896ba8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:26.057804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78c227ee-35bc-4c5b-80e6-f63e3f896ba8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:26.058239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78c227ee-35bc-4c5b-80e6-f63e3f896ba8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:26.058938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78c227ee-35bc-4c5b-80e6-f63e3f896ba8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:26.059418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78c227ee-35bc-4c5b-80e6-f63e3f896ba8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:26.060017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78c227ee-35bc-4c5b-80e6-f63e3f896ba8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:26.159775 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-78c227ee-35bc-4c5b-80e6-f63e3f896ba8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.113335 Aug 27 05:13:26.160560 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2122/4247] 10.222.0.58 () {60 vars in 1316 bytes} [Sat Aug 27 05:13:26 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 05:13:26.183998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d95a1361-d949-4e98-8ce7-63e115557021 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:26.192120 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d95a1361-d949-4e98-8ce7-63e115557021 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1309 microversion: 2.1 time: 0.194174 Aug 27 05:13:26.193019 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2126/4248] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:25 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1309 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:26.848119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:26.848768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] [instance: 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:26.856045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:26.856529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:26.857165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:26.858914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:26.859356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:26.859784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:26.877392 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] HTTP exception thrown: Instance 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb could not be found. Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Request method failure captured: Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb HTTP/1.1 Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaegn6vDe2dDXrIyu2UVMtEnw39fTQwaeDh8KpoCgpSMMXYNFTrAuYRrvkqm-eTVg0wOPzC4sB3M3z2VDdmcRg46lIVsj_pUNrgkgIbjlQYYT5T8c9gg6cOfF10IeO3Sc-6AjKgZvr3tS1hZGhqyPZ1OgNFYpIps_RZoPW6vdamRsO4 Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: fb1a58fcad164480a373ed1c2ad516a9 Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ListServerFiltersTestJSON-1141666309 Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb1a58fcad164480a373ed1c2ad516a9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb1a58fcad164480a373ed1c2ad516a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb1a58fcad164480a373ed1c2ad516a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb1a58fcad164480a373ed1c2ad516a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ListServerFiltersTestJSON-1141666309 Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: fb1a58fcad164480a373ed1c2ad516a9 Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1141666309 Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ListServerFiltersTestJSON-1141666309-project Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5924d371bcec4bae863b774bbb084e52 Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ListServerFiltersTestJSON-1141666309-project Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb could not be found. Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '871c1afd-5f3a-4cf5-93c2-01c274d2a4bb'} Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb could not be found. Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb could not be found. Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:26.885593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:26.890374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:26.890374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:26.890374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:26.890374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:26.890374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:26.890374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb could not be found. Aug 27 05:13:26.890374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:26.890374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] Returning 404 to user: Instance 871c1afd-5f3a-4cf5-93c2-01c274d2a4bb could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:26.890374 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3742ed16-41ad-4fc9-8d42-e33c5522e3a8 tempest-ListServerFiltersTestJSON-1141666309 tempest-ListServerFiltersTestJSON-1141666309-project] 10.222.0.58 "GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb" status: 404 len: 111 microversion: 2.1 time: 0.043296 Aug 27 05:13:26.891222 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2123/4249] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:26 2022] GET /compute/v2.1/servers/871c1afd-5f3a-4cf5-93c2-01c274d2a4bb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:26.914223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90361d7c-6419-4f4c-af33-944d028a962c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:26.915747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-90361d7c-6419-4f4c-af33-944d028a962c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:26.923237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90361d7c-6419-4f4c-af33-944d028a962c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:26.923730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90361d7c-6419-4f4c-af33-944d028a962c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:26.924165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90361d7c-6419-4f4c-af33-944d028a962c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:26.925095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90361d7c-6419-4f4c-af33-944d028a962c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:26.925619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90361d7c-6419-4f4c-af33-944d028a962c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:26.926217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90361d7c-6419-4f4c-af33-944d028a962c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.158429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-90361d7c-6419-4f4c-af33-944d028a962c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:27.161176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:27.170565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90361d7c-6419-4f4c-af33-944d028a962c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1522 microversion: 2.1 time: 0.260204 Aug 27 05:13:27.171376 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2127/4250] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:26 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:27.195135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4bb3ceaf-1ca1-497e-b478-b1859bdab246 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:27.195858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4bb3ceaf-1ca1-497e-b478-b1859bdab246 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:27.204123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4bb3ceaf-1ca1-497e-b478-b1859bdab246 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.204467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-72448c7f-bcad-4022-a758-c2635f0ca2b0 req-5340fe56-fd71-4c69-9a45-c4b3b53273c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08a333d-504a-41ad-a796-2069aecd4bd9", "tag": "6e183864-02b7-4485-8c8f-1050892f3cb4"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:27.205422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4bb3ceaf-1ca1-497e-b478-b1859bdab246 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.206036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4bb3ceaf-1ca1-497e-b478-b1859bdab246 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.207107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4bb3ceaf-1ca1-497e-b478-b1859bdab246 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.207779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4bb3ceaf-1ca1-497e-b478-b1859bdab246 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.208200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4bb3ceaf-1ca1-497e-b478-b1859bdab246 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.222899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-72448c7f-bcad-4022-a758-c2635f0ca2b0 req-5340fe56-fd71-4c69-9a45-c4b3b53273c1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.223428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-72448c7f-bcad-4022-a758-c2635f0ca2b0 req-5340fe56-fd71-4c69-9a45-c4b3b53273c1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.223881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-72448c7f-bcad-4022-a758-c2635f0ca2b0 req-5340fe56-fd71-4c69-9a45-c4b3b53273c1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.240263 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-72448c7f-bcad-4022-a758-c2635f0ca2b0 req-5340fe56-fd71-4c69-9a45-c4b3b53273c1 service nova] Creating event network-changed:6e183864-02b7-4485-8c8f-1050892f3cb4 for instance e08a333d-504a-41ad-a796-2069aecd4bd9 on n-h2-820368-35 Aug 27 05:13:27.245388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4bb3ceaf-1ca1-497e-b478-b1859bdab246 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:27.247336 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-72448c7f-bcad-4022-a758-c2635f0ca2b0 req-5340fe56-fd71-4c69-9a45-c4b3b53273c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048150 Aug 27 05:13:27.248071 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2128/4251] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:27.257394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c4ffbbe5-b743-4c75-9b17-3aafa7f329ad tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:27.258358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c4ffbbe5-b743-4c75-9b17-3aafa7f329ad tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:27.265757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4ffbbe5-b743-4c75-9b17-3aafa7f329ad tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.266560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4ffbbe5-b743-4c75-9b17-3aafa7f329ad tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.267185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4ffbbe5-b743-4c75-9b17-3aafa7f329ad tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.268086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4ffbbe5-b743-4c75-9b17-3aafa7f329ad tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.268703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4ffbbe5-b743-4c75-9b17-3aafa7f329ad tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.269408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4ffbbe5-b743-4c75-9b17-3aafa7f329ad tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.381176 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4bb3ceaf-1ca1-497e-b478-b1859bdab246 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "DELETE /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 204 len: 0 microversion: 2.1 time: 0.191470 Aug 27 05:13:27.385358 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2124/4252] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:27 2022] DELETE /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:27.400978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-922a9550-e0fb-48e5-978f-f76f3ac62678 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:27.401892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-922a9550-e0fb-48e5-978f-f76f3ac62678 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:27.411942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922a9550-e0fb-48e5-978f-f76f3ac62678 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.412693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922a9550-e0fb-48e5-978f-f76f3ac62678 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.413894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922a9550-e0fb-48e5-978f-f76f3ac62678 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.414663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922a9550-e0fb-48e5-978f-f76f3ac62678 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.415141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922a9550-e0fb-48e5-978f-f76f3ac62678 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.415617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922a9550-e0fb-48e5-978f-f76f3ac62678 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.571883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c4ffbbe5-b743-4c75-9b17-3aafa7f329ad tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:27.582323 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c4ffbbe5-b743-4c75-9b17-3aafa7f329ad tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1491 microversion: 2.1 time: 0.328285 Aug 27 05:13:27.583680 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2129/4253] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:27 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1491 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:27.652711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-922a9550-e0fb-48e5-978f-f76f3ac62678 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:27.662390 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-922a9550-e0fb-48e5-978f-f76f3ac62678 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1528 microversion: 2.1 time: 0.274428 Aug 27 05:13:27.665200 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2125/4254] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:27 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1528 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:27.775641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1440546185", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "43620fdb-3b93-439f-955c-01e22d65d95a"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:27.860710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] validate_networks() for [('43620fdb-3b93-439f-955c-01e22d65d95a', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:13:28.300162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:13:28.300721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:13:28.301046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:13:28.301453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:13:28.301862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:13:28.313658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:28.314235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:28.314920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:28.315982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:28.316524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:28.318066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:28.339792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:28.345657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for user c75dd4d6f001450bb9279d592e9783bd and project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:28.359305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:13:28.361696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:13:28.424975 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-95f3d5dc-e2db-4ee5-8f59-c56976e19546 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654315 Aug 27 05:13:28.434494 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2130/4255] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:13:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:13:28.437701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2cec8a5-54d0-49cf-a00f-439714f6eb5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:28.438386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b2cec8a5-54d0-49cf-a00f-439714f6eb5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:28.529563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5c84ed71-5308-4069-81b6-800a89cfb229 req-674bb91c-a2f5-4bb2-b863-d7be19665e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290c9cc0-3ff4-45e6-8e5c-b885a54cc30a", "name": "network-vif-unplugged", "status": "completed", "tag": "106f2f3f-c34b-4f95-9a32-5acf05d7e9ad"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:28.548478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b2cec8a5-54d0-49cf-a00f-439714f6eb5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:28.555586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5c84ed71-5308-4069-81b6-800a89cfb229 req-674bb91c-a2f5-4bb2-b863-d7be19665e24 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:28.559899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5c84ed71-5308-4069-81b6-800a89cfb229 req-674bb91c-a2f5-4bb2-b863-d7be19665e24 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:28.560838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5c84ed71-5308-4069-81b6-800a89cfb229 req-674bb91c-a2f5-4bb2-b863-d7be19665e24 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:28.562398 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b2cec8a5-54d0-49cf-a00f-439714f6eb5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1209 microversion: 2.1 time: 0.128662 Aug 27 05:13:28.564620 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2126/4256] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:28 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1209 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:28.591705 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-5c84ed71-5308-4069-81b6-800a89cfb229 req-674bb91c-a2f5-4bb2-b863-d7be19665e24 service nova] Creating event network-vif-unplugged:106f2f3f-c34b-4f95-9a32-5acf05d7e9ad for instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a on n-h1-820368-35 Aug 27 05:13:28.598725 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5c84ed71-5308-4069-81b6-800a89cfb229 req-674bb91c-a2f5-4bb2-b863-d7be19665e24 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072994 Aug 27 05:13:28.601683 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2131/4257] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:28.687935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0bf2c1d8-2995-40f8-9c5d-dc178632f260 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:28.688746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0bf2c1d8-2995-40f8-9c5d-dc178632f260 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:28.699940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bf2c1d8-2995-40f8-9c5d-dc178632f260 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:28.707637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bf2c1d8-2995-40f8-9c5d-dc178632f260 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:28.708425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bf2c1d8-2995-40f8-9c5d-dc178632f260 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:28.710124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bf2c1d8-2995-40f8-9c5d-dc178632f260 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:28.710740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bf2c1d8-2995-40f8-9c5d-dc178632f260 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:28.711983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bf2c1d8-2995-40f8-9c5d-dc178632f260 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:28.944748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0bf2c1d8-2995-40f8-9c5d-dc178632f260 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:28.954259 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0bf2c1d8-2995-40f8-9c5d-dc178632f260 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1528 microversion: 2.1 time: 0.271098 Aug 27 05:13:28.967147 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2127/4258] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:28 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1528 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:29.591413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0274477-33af-4013-89a7-d5af2f0312cb tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:29.593411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c0274477-33af-4013-89a7-d5af2f0312cb tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:29.611333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0274477-33af-4013-89a7-d5af2f0312cb tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:29.616703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0274477-33af-4013-89a7-d5af2f0312cb tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:29.617377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0274477-33af-4013-89a7-d5af2f0312cb tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:29.618335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0274477-33af-4013-89a7-d5af2f0312cb tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:29.618808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0274477-33af-4013-89a7-d5af2f0312cb tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:29.619594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0274477-33af-4013-89a7-d5af2f0312cb tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:29.695211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c0274477-33af-4013-89a7-d5af2f0312cb tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:29.706843 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c0274477-33af-4013-89a7-d5af2f0312cb tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1261 microversion: 2.1 time: 0.121351 Aug 27 05:13:29.707800 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2132/4259] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:29 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1261 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:29.977443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7186c209-5f03-40db-b533-593223e620c3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:29.978312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7186c209-5f03-40db-b533-593223e620c3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:29.986935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7186c209-5f03-40db-b533-593223e620c3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:29.988038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7186c209-5f03-40db-b533-593223e620c3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:29.988615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7186c209-5f03-40db-b533-593223e620c3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:29.989572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7186c209-5f03-40db-b533-593223e620c3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:29.990087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7186c209-5f03-40db-b533-593223e620c3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:29.991892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7186c209-5f03-40db-b533-593223e620c3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:30.083417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7186c209-5f03-40db-b533-593223e620c3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:30.096670 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7186c209-5f03-40db-b533-593223e620c3 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 200 len: 1486 microversion: 2.1 time: 0.123137 Aug 27 05:13:30.097237 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2128/4260] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:29 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 1486 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:30.108787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-01e0cb29-1fd0-43ba-a8b0-093cda0ced61 req-6d89eb8c-2df5-4d5b-92a2-bdd559247a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290c9cc0-3ff4-45e6-8e5c-b885a54cc30a", "name": "network-vif-deleted", "tag": "106f2f3f-c34b-4f95-9a32-5acf05d7e9ad"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:30.130086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-01e0cb29-1fd0-43ba-a8b0-093cda0ced61 req-6d89eb8c-2df5-4d5b-92a2-bdd559247a12 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:30.130828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-01e0cb29-1fd0-43ba-a8b0-093cda0ced61 req-6d89eb8c-2df5-4d5b-92a2-bdd559247a12 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:30.132237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-01e0cb29-1fd0-43ba-a8b0-093cda0ced61 req-6d89eb8c-2df5-4d5b-92a2-bdd559247a12 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:30.152277 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-01e0cb29-1fd0-43ba-a8b0-093cda0ced61 req-6d89eb8c-2df5-4d5b-92a2-bdd559247a12 service nova] Creating event network-vif-deleted:106f2f3f-c34b-4f95-9a32-5acf05d7e9ad for instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a on n-h1-820368-35 Aug 27 05:13:30.160211 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-01e0cb29-1fd0-43ba-a8b0-093cda0ced61 req-6d89eb8c-2df5-4d5b-92a2-bdd559247a12 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055493 Aug 27 05:13:30.160821 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2133/4261] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:30.729012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-546bcf05-7122-487d-9279-69f76992a46a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:30.729727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-546bcf05-7122-487d-9279-69f76992a46a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:30.736260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-546bcf05-7122-487d-9279-69f76992a46a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:30.736889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-546bcf05-7122-487d-9279-69f76992a46a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:30.737389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-546bcf05-7122-487d-9279-69f76992a46a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:30.738480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-546bcf05-7122-487d-9279-69f76992a46a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:30.739016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-546bcf05-7122-487d-9279-69f76992a46a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:30.739481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-546bcf05-7122-487d-9279-69f76992a46a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:30.835982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-546bcf05-7122-487d-9279-69f76992a46a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:30.847300 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-546bcf05-7122-487d-9279-69f76992a46a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1267 microversion: 2.1 time: 0.122283 Aug 27 05:13:30.859135 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2129/4262] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:30 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1267 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:31.121442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:31.122774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:31.130576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:31.131364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:31.132500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:31.133441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:31.134049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:31.134879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:31.156871 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] HTTP exception thrown: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a HTTP/1.1 Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '290c9cc0-3ff4-45e6-8e5c-b885a54cc30a'} Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:31.159051 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:31.163746 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:31.163746 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:31.163746 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:31.163746 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:31.163746 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:31.163746 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:31.163746 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:31.163746 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:31.165513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 404 to user: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:31.166629 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-748c1e87-68b9-42bf-8ea7-c1dcfae672e5 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 404 len: 111 microversion: 2.1 time: 0.050006 Aug 27 05:13:31.176823 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2134/4263] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:31 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:31.373945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1306912632", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:31.454802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] validate_networks() for [('76473937-2038-466b-84c2-4acb1818557e', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:13:31.882087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b82edb86-7db7-4175-8403-3e498efe3120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:31.885150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b82edb86-7db7-4175-8403-3e498efe3120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:31.896626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82edb86-7db7-4175-8403-3e498efe3120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:31.897992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82edb86-7db7-4175-8403-3e498efe3120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:31.898623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82edb86-7db7-4175-8403-3e498efe3120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:31.899606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82edb86-7db7-4175-8403-3e498efe3120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:31.900443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82edb86-7db7-4175-8403-3e498efe3120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:31.901356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82edb86-7db7-4175-8403-3e498efe3120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:32.266283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b82edb86-7db7-4175-8403-3e498efe3120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:32.279457 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b82edb86-7db7-4175-8403-3e498efe3120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1309 microversion: 2.1 time: 0.413005 Aug 27 05:13:32.280890 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2135/4264] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:31 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1309 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:32.298021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f2381ac6-a4de-49fe-90b0-234948cb3744 req-3333b9ec-29b4-49cc-b3c4-e4fb5cef9bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad4ba155-37ea-46b7-b986-d8e0756edec9", "tag": "9794153f-a2d2-4cc8-b24a-fda0050577c0"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:32.308655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f2381ac6-a4de-49fe-90b0-234948cb3744 req-3333b9ec-29b4-49cc-b3c4-e4fb5cef9bee service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:32.309211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f2381ac6-a4de-49fe-90b0-234948cb3744 req-3333b9ec-29b4-49cc-b3c4-e4fb5cef9bee service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:32.309857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f2381ac6-a4de-49fe-90b0-234948cb3744 req-3333b9ec-29b4-49cc-b3c4-e4fb5cef9bee service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:32.333188 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f2381ac6-a4de-49fe-90b0-234948cb3744 req-3333b9ec-29b4-49cc-b3c4-e4fb5cef9bee service nova] Creating event network-changed:9794153f-a2d2-4cc8-b24a-fda0050577c0 for instance ad4ba155-37ea-46b7-b986-d8e0756edec9 on n-h1-820368-35 Aug 27 05:13:32.339336 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f2381ac6-a4de-49fe-90b0-234948cb3744 req-3333b9ec-29b4-49cc-b3c4-e4fb5cef9bee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056860 Aug 27 05:13:32.340551 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2136/4265] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:32.352313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:13:32.352746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:13:32.353401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:13:32.353825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:13:32.354246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:13:32.359023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:32.377176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:32.377872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:32.378244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:32.378989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:32.379487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:32.388929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:32.450200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Getting quotas for project 05bb331ed3d141f9950c5fbe121f3e7f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:32.459224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Getting quotas for user 6438306d009f43f6a1aac4dc35b07ecf and project 05bb331ed3d141f9950c5fbe121f3e7f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:32.481955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:13:32.484846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:13:32.539952 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1235eba2-0cd0-4a0d-b187-076aa2c2ccdf tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.175051 Aug 27 05:13:32.541235 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2130/4266] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:13:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:13:32.553916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5a6a082f-6405-4907-8ef9-fc2a66f8e992 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:32.554717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5a6a082f-6405-4907-8ef9-fc2a66f8e992 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:32.644324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5a6a082f-6405-4907-8ef9-fc2a66f8e992 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:32.652167 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5a6a082f-6405-4907-8ef9-fc2a66f8e992 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1225 microversion: 2.1 time: 0.103065 Aug 27 05:13:32.652743 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2137/4267] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:32 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:33.302258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-436f3756-801d-47e4-8bd4-f5de5726ed95 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:33.303272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-436f3756-801d-47e4-8bd4-f5de5726ed95 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:33.310241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-436f3756-801d-47e4-8bd4-f5de5726ed95 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:33.310866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-436f3756-801d-47e4-8bd4-f5de5726ed95 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:33.311443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-436f3756-801d-47e4-8bd4-f5de5726ed95 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:33.312295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-436f3756-801d-47e4-8bd4-f5de5726ed95 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:33.313029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-436f3756-801d-47e4-8bd4-f5de5726ed95 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:33.313589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-436f3756-801d-47e4-8bd4-f5de5726ed95 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:33.543356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-436f3756-801d-47e4-8bd4-f5de5726ed95 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:33.553217 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-436f3756-801d-47e4-8bd4-f5de5726ed95 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1309 microversion: 2.1 time: 0.254199 Aug 27 05:13:33.554344 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2131/4268] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:33 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1309 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:33.673059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6641cccc-3f32-4203-b62e-85038b94f923 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:33.673694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6641cccc-3f32-4203-b62e-85038b94f923 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:33.682110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6641cccc-3f32-4203-b62e-85038b94f923 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:33.683010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6641cccc-3f32-4203-b62e-85038b94f923 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:33.683564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6641cccc-3f32-4203-b62e-85038b94f923 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:33.684728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6641cccc-3f32-4203-b62e-85038b94f923 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:33.685221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6641cccc-3f32-4203-b62e-85038b94f923 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:33.685825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6641cccc-3f32-4203-b62e-85038b94f923 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:33.774766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6641cccc-3f32-4203-b62e-85038b94f923 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:33.785084 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6641cccc-3f32-4203-b62e-85038b94f923 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1229 microversion: 2.1 time: 0.116041 Aug 27 05:13:33.786024 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2138/4269] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:33 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1229 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:34.577115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8229f28-f79b-4427-b5cb-b2333d124820 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:34.577733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8229f28-f79b-4427-b5cb-b2333d124820 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:34.585861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8229f28-f79b-4427-b5cb-b2333d124820 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:34.586760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8229f28-f79b-4427-b5cb-b2333d124820 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:34.587448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8229f28-f79b-4427-b5cb-b2333d124820 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:34.588447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8229f28-f79b-4427-b5cb-b2333d124820 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:34.589014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8229f28-f79b-4427-b5cb-b2333d124820 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:34.589666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8229f28-f79b-4427-b5cb-b2333d124820 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:34.737267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8229f28-f79b-4427-b5cb-b2333d124820 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:34.748182 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8229f28-f79b-4427-b5cb-b2333d124820 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1309 microversion: 2.1 time: 0.176313 Aug 27 05:13:34.748872 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2132/4270] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:34 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1309 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:34.810999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8313877f-3c52-4372-bf08-a7360c82175b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:34.811743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8313877f-3c52-4372-bf08-a7360c82175b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:34.819835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:34.822044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8313877f-3c52-4372-bf08-a7360c82175b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:34.822529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8313877f-3c52-4372-bf08-a7360c82175b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:34.824000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8313877f-3c52-4372-bf08-a7360c82175b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:34.825051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8313877f-3c52-4372-bf08-a7360c82175b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:34.825893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8313877f-3c52-4372-bf08-a7360c82175b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:34.826332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8313877f-3c52-4372-bf08-a7360c82175b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:34.905903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8313877f-3c52-4372-bf08-a7360c82175b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:34.916702 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8313877f-3c52-4372-bf08-a7360c82175b tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1229 microversion: 2.1 time: 0.113912 Aug 27 05:13:34.917304 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2139/4271] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:34 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:35.586206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5558420e-82b7-4054-aa5a-5f52cfef0fbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'create', calling method: .version_select at 0x7fb56528c310>, body: {"keypair": {"name": "tempest-keypair-107615364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiZ4HYwOr2YHrfYRJS7oROg/+/TqNrsD8FIVq7uWKMiFzsAYxIO7hFRVtAJJ6pLq60Qi++p1Y9g4SZU4qHCxPqmy8bhEOMMXyjineatVYLcXxVx9KO4zpQldB4q0uEEUg=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:35.604574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5558420e-82b7-4054-aa5a-5f52cfef0fbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:35.635869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-5558420e-82b7-4054-aa5a-5f52cfef0fbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for user dffafef392eb4e1fba13953f47b2d105 and project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:35.697774 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5558420e-82b7-4054-aa5a-5f52cfef0fbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.279653 Aug 27 05:13:35.698921 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2133/4272] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:13:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:35.769797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7f7dc0fa-a25d-4175-ad61-f487ba748570 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:35.770497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7f7dc0fa-a25d-4175-ad61-f487ba748570 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:35.777400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7dc0fa-a25d-4175-ad61-f487ba748570 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:35.778160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7dc0fa-a25d-4175-ad61-f487ba748570 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:35.793295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7dc0fa-a25d-4175-ad61-f487ba748570 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:35.794790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7dc0fa-a25d-4175-ad61-f487ba748570 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:35.795508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7dc0fa-a25d-4175-ad61-f487ba748570 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:35.796151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f7dc0fa-a25d-4175-ad61-f487ba748570 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:35.938528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a7c1dba-e7a7-4cc9-8121-c3795c1a0f1c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:35.939504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a7c1dba-e7a7-4cc9-8121-c3795c1a0f1c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:35.946060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7c1dba-e7a7-4cc9-8121-c3795c1a0f1c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:35.947431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7c1dba-e7a7-4cc9-8121-c3795c1a0f1c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:35.948151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7c1dba-e7a7-4cc9-8121-c3795c1a0f1c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:35.949642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7c1dba-e7a7-4cc9-8121-c3795c1a0f1c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:35.950460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7c1dba-e7a7-4cc9-8121-c3795c1a0f1c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:35.951120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a7c1dba-e7a7-4cc9-8121-c3795c1a0f1c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:35.957248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:36.047163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a7c1dba-e7a7-4cc9-8121-c3795c1a0f1c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:36.048277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7f7dc0fa-a25d-4175-ad61-f487ba748570 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:36.057406 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7f7dc0fa-a25d-4175-ad61-f487ba748570 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1309 microversion: 2.1 time: 0.291822 Aug 27 05:13:36.058380 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a7c1dba-e7a7-4cc9-8121-c3795c1a0f1c tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1277 microversion: 2.1 time: 0.123606 Aug 27 05:13:36.058694 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2140/4273] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:35 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1309 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:36.059618 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2134/4274] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:35 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:37.081132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ef9f4608-eacc-4cf0-a25f-ba080e9940a6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:37.082040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-05b26d9a-6925-4116-9685-5b228460d525 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:37.082792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ef9f4608-eacc-4cf0-a25f-ba080e9940a6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:37.083372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-05b26d9a-6925-4116-9685-5b228460d525 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:37.096826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05b26d9a-6925-4116-9685-5b228460d525 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:37.098759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05b26d9a-6925-4116-9685-5b228460d525 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:37.099043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef9f4608-eacc-4cf0-a25f-ba080e9940a6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:37.099665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef9f4608-eacc-4cf0-a25f-ba080e9940a6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:37.100469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05b26d9a-6925-4116-9685-5b228460d525 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:37.101943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05b26d9a-6925-4116-9685-5b228460d525 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:37.102241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef9f4608-eacc-4cf0-a25f-ba080e9940a6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:37.103081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef9f4608-eacc-4cf0-a25f-ba080e9940a6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:37.104004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05b26d9a-6925-4116-9685-5b228460d525 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:37.104496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef9f4608-eacc-4cf0-a25f-ba080e9940a6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:37.105245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05b26d9a-6925-4116-9685-5b228460d525 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:37.106119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef9f4608-eacc-4cf0-a25f-ba080e9940a6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:37.285771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ef9f4608-eacc-4cf0-a25f-ba080e9940a6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:37.294497 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ef9f4608-eacc-4cf0-a25f-ba080e9940a6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1283 microversion: 2.1 time: 0.217216 Aug 27 05:13:37.297962 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2135/4275] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:37 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1283 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:37.353206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-05b26d9a-6925-4116-9685-5b228460d525 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:37.362546 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-05b26d9a-6925-4116-9685-5b228460d525 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1309 microversion: 2.1 time: 0.286512 Aug 27 05:13:37.363164 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2141/4276] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:37 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1309 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:37.823002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-751923479", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc52ef93-257f-431d-a3c4-4629a0c53bfc"}], "security_groups": [{"name": "tempest-securitygroup--1745082804"}], "key_name": "tempest-keypair-107615364", "user_data": "}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:37.954587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] validate_networks() for [('dc52ef93-257f-431d-a3c4-4629a0c53bfc', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:13:38.327877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-378b1482-a612-4642-aeee-5db017a55e74 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:38.329297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-378b1482-a612-4642-aeee-5db017a55e74 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:38.340748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:38.344102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-378b1482-a612-4642-aeee-5db017a55e74 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:38.345254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-378b1482-a612-4642-aeee-5db017a55e74 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:38.346860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-378b1482-a612-4642-aeee-5db017a55e74 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:38.349203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-378b1482-a612-4642-aeee-5db017a55e74 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:38.350098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-378b1482-a612-4642-aeee-5db017a55e74 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:38.350881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-378b1482-a612-4642-aeee-5db017a55e74 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:38.488643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:13:38.491694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:13:38.492252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:13:38.492668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:13:38.493263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:13:38.509841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:38.510347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:38.510953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:38.512967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:38.516010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:38.516470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:38.538612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:38.545724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for user dffafef392eb4e1fba13953f47b2d105 and project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:38.559489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:13:38.561967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:13:38.563490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-378b1482-a612-4642-aeee-5db017a55e74 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:38.572554 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-378b1482-a612-4642-aeee-5db017a55e74 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1325 microversion: 2.1 time: 0.255675 Aug 27 05:13:38.586685 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2142/4277] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:38 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1325 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:38.586685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6d5bac7c-1e89-4d8a-abc5-0f1a10de058e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:38.586685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6d5bac7c-1e89-4d8a-abc5-0f1a10de058e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:38.588248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5bac7c-1e89-4d8a-abc5-0f1a10de058e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:38.588741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5bac7c-1e89-4d8a-abc5-0f1a10de058e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:38.589179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5bac7c-1e89-4d8a-abc5-0f1a10de058e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:38.589883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5bac7c-1e89-4d8a-abc5-0f1a10de058e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:38.590337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5bac7c-1e89-4d8a-abc5-0f1a10de058e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:38.590760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d5bac7c-1e89-4d8a-abc5-0f1a10de058e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:38.629986 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf0e75a9-22d5-4c0a-8f21-bb14c127ccb4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.811196 Aug 27 05:13:38.631024 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2136/4278] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:13:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:13:38.636378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4bcf55ad-2ed6-4993-87a9-fd41d868350f req-7743cce9-53ad-4f45-a3d3-9f87aed28db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af99fc0-c020-438e-8387-9702ccb5cff9", "tag": "2d762bc6-b199-4250-aa1b-0d1ea440806e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:38.649141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4bcf55ad-2ed6-4993-87a9-fd41d868350f req-7743cce9-53ad-4f45-a3d3-9f87aed28db0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:38.649626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4bcf55ad-2ed6-4993-87a9-fd41d868350f req-7743cce9-53ad-4f45-a3d3-9f87aed28db0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:38.650076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4bcf55ad-2ed6-4993-87a9-fd41d868350f req-7743cce9-53ad-4f45-a3d3-9f87aed28db0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:38.681028 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4bcf55ad-2ed6-4993-87a9-fd41d868350f req-7743cce9-53ad-4f45-a3d3-9f87aed28db0 service nova] Creating event network-changed:2d762bc6-b199-4250-aa1b-0d1ea440806e for instance 1af99fc0-c020-438e-8387-9702ccb5cff9 on n-h1-820368-35 Aug 27 05:13:38.687502 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4bcf55ad-2ed6-4993-87a9-fd41d868350f req-7743cce9-53ad-4f45-a3d3-9f87aed28db0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054624 Aug 27 05:13:38.688669 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2137/4279] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:38.696180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7cf55d89-86ed-42bf-8397-361d72a33c87 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:38.696913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7cf55d89-86ed-42bf-8397-361d72a33c87 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:38.804008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7cf55d89-86ed-42bf-8397-361d72a33c87 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:38.812739 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7cf55d89-86ed-42bf-8397-361d72a33c87 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1237 microversion: 2.1 time: 0.121405 Aug 27 05:13:38.814012 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2138/4280] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:38 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1237 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:38.884174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6d5bac7c-1e89-4d8a-abc5-0f1a10de058e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:38.893143 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6d5bac7c-1e89-4d8a-abc5-0f1a10de058e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1309 microversion: 2.1 time: 0.316580 Aug 27 05:13:38.894040 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2143/4281] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:38 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1309 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:38.972525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e69c83e7-18a3-43b5-87e7-f6d263316779 req-c6410ddd-0ce5-48f0-9f01-dfefbfac3a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4ba155-37ea-46b7-b986-d8e0756edec9", "name": "network-vif-plugged", "status": "completed", "tag": "9794153f-a2d2-4cc8-b24a-fda0050577c0"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:38.985695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e69c83e7-18a3-43b5-87e7-f6d263316779 req-c6410ddd-0ce5-48f0-9f01-dfefbfac3a81 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:38.986900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e69c83e7-18a3-43b5-87e7-f6d263316779 req-c6410ddd-0ce5-48f0-9f01-dfefbfac3a81 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:38.987704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e69c83e7-18a3-43b5-87e7-f6d263316779 req-c6410ddd-0ce5-48f0-9f01-dfefbfac3a81 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:39.007267 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e69c83e7-18a3-43b5-87e7-f6d263316779 req-c6410ddd-0ce5-48f0-9f01-dfefbfac3a81 service nova] Creating event network-vif-plugged:9794153f-a2d2-4cc8-b24a-fda0050577c0 for instance ad4ba155-37ea-46b7-b986-d8e0756edec9 on n-h1-820368-35 Aug 27 05:13:39.014728 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e69c83e7-18a3-43b5-87e7-f6d263316779 req-c6410ddd-0ce5-48f0-9f01-dfefbfac3a81 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046742 Aug 27 05:13:39.015724 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2139/4282] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:39.597464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-efd26eea-005e-4a5b-8a87-f1eb5ed8cdb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:39.598099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-efd26eea-005e-4a5b-8a87-f1eb5ed8cdb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:39.606600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efd26eea-005e-4a5b-8a87-f1eb5ed8cdb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:39.607122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efd26eea-005e-4a5b-8a87-f1eb5ed8cdb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:39.607556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efd26eea-005e-4a5b-8a87-f1eb5ed8cdb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:39.608261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efd26eea-005e-4a5b-8a87-f1eb5ed8cdb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:39.608715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efd26eea-005e-4a5b-8a87-f1eb5ed8cdb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:39.609138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efd26eea-005e-4a5b-8a87-f1eb5ed8cdb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:39.770434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-efd26eea-005e-4a5b-8a87-f1eb5ed8cdb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:39.779907 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-efd26eea-005e-4a5b-8a87-f1eb5ed8cdb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1325 microversion: 2.1 time: 0.187135 Aug 27 05:13:39.781027 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2144/4283] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:39 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:39.840430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-32f1e1ac-90d1-4e6c-a21f-14fec35ebef0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:39.841875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-32f1e1ac-90d1-4e6c-a21f-14fec35ebef0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:39.849776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32f1e1ac-90d1-4e6c-a21f-14fec35ebef0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:39.851143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32f1e1ac-90d1-4e6c-a21f-14fec35ebef0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:39.851851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32f1e1ac-90d1-4e6c-a21f-14fec35ebef0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:39.852753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32f1e1ac-90d1-4e6c-a21f-14fec35ebef0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:39.853219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32f1e1ac-90d1-4e6c-a21f-14fec35ebef0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:39.853649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32f1e1ac-90d1-4e6c-a21f-14fec35ebef0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:39.917166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cfa13596-d547-43f1-bd48-1519035f73a7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:39.917707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cfa13596-d547-43f1-bd48-1519035f73a7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:39.924725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfa13596-d547-43f1-bd48-1519035f73a7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:39.925231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfa13596-d547-43f1-bd48-1519035f73a7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:39.925680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfa13596-d547-43f1-bd48-1519035f73a7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:39.926721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfa13596-d547-43f1-bd48-1519035f73a7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:39.927289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfa13596-d547-43f1-bd48-1519035f73a7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:39.927731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfa13596-d547-43f1-bd48-1519035f73a7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:39.931347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-32f1e1ac-90d1-4e6c-a21f-14fec35ebef0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:39.939609 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-32f1e1ac-90d1-4e6c-a21f-14fec35ebef0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1289 microversion: 2.1 time: 0.103472 Aug 27 05:13:39.944654 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2140/4284] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:39 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:40.094628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cfa13596-d547-43f1-bd48-1519035f73a7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:40.102890 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cfa13596-d547-43f1-bd48-1519035f73a7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1309 microversion: 2.1 time: 0.190017 Aug 27 05:13:40.103595 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2145/4285] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:39 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:40.801805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5dd52916-02b6-4818-9641-57c8a290c13a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:40.802417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5dd52916-02b6-4818-9641-57c8a290c13a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:40.808630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dd52916-02b6-4818-9641-57c8a290c13a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:40.809136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dd52916-02b6-4818-9641-57c8a290c13a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:40.809778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dd52916-02b6-4818-9641-57c8a290c13a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:40.810593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dd52916-02b6-4818-9641-57c8a290c13a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:40.810944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dd52916-02b6-4818-9641-57c8a290c13a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:40.811395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5dd52916-02b6-4818-9641-57c8a290c13a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:40.965616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-634ce2be-40ee-422c-b645-1139b2603f5c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:40.966897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-634ce2be-40ee-422c-b645-1139b2603f5c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:40.967204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5dd52916-02b6-4818-9641-57c8a290c13a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:40.975945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634ce2be-40ee-422c-b645-1139b2603f5c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:40.976687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634ce2be-40ee-422c-b645-1139b2603f5c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:40.976805 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5dd52916-02b6-4818-9641-57c8a290c13a tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1325 microversion: 2.1 time: 0.178771 Aug 27 05:13:40.977410 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2141/4286] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:40 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1325 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:40.986719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634ce2be-40ee-422c-b645-1139b2603f5c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:40.988254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634ce2be-40ee-422c-b645-1139b2603f5c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:40.988901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634ce2be-40ee-422c-b645-1139b2603f5c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:40.989500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634ce2be-40ee-422c-b645-1139b2603f5c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:41.126073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eda991c1-e15c-46fb-a425-6dbdeab5e7a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:41.126590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eda991c1-e15c-46fb-a425-6dbdeab5e7a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:41.135741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda991c1-e15c-46fb-a425-6dbdeab5e7a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:41.136842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda991c1-e15c-46fb-a425-6dbdeab5e7a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:41.137466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda991c1-e15c-46fb-a425-6dbdeab5e7a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:41.138338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda991c1-e15c-46fb-a425-6dbdeab5e7a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:41.138946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda991c1-e15c-46fb-a425-6dbdeab5e7a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:41.140114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda991c1-e15c-46fb-a425-6dbdeab5e7a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:41.140760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-634ce2be-40ee-422c-b645-1139b2603f5c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:41.148744 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-634ce2be-40ee-422c-b645-1139b2603f5c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1363 microversion: 2.1 time: 0.187160 Aug 27 05:13:41.162518 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2146/4287] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:40 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:41.302511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eda991c1-e15c-46fb-a425-6dbdeab5e7a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:41.311448 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eda991c1-e15c-46fb-a425-6dbdeab5e7a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1309 microversion: 2.1 time: 0.189550 Aug 27 05:13:41.312118 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2142/4288] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:41 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:41.575885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-27c9998f-e266-4a7e-9a2b-55c4051bd431 req-7d885166-9921-4419-a303-4e695db0d704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f4c359-6f7e-4009-a365-7b070eec11a9", "tag": "2a4e09b9-01c8-433a-8d9e-e93f9888b163"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:41.586396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-27c9998f-e266-4a7e-9a2b-55c4051bd431 req-7d885166-9921-4419-a303-4e695db0d704 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:41.586881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-27c9998f-e266-4a7e-9a2b-55c4051bd431 req-7d885166-9921-4419-a303-4e695db0d704 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:41.587345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-27c9998f-e266-4a7e-9a2b-55c4051bd431 req-7d885166-9921-4419-a303-4e695db0d704 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:41.599944 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-27c9998f-e266-4a7e-9a2b-55c4051bd431 req-7d885166-9921-4419-a303-4e695db0d704 service nova] Creating event network-changed:2a4e09b9-01c8-433a-8d9e-e93f9888b163 for instance e5f4c359-6f7e-4009-a365-7b070eec11a9 on n-h2-820368-35 Aug 27 05:13:41.611551 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-27c9998f-e266-4a7e-9a2b-55c4051bd431 req-7d885166-9921-4419-a303-4e695db0d704 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039111 Aug 27 05:13:41.612589 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2147/4289] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:41.998017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a05320a9-4925-442a-9326-fc48073e5949 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:41.998763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a05320a9-4925-442a-9326-fc48073e5949 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:42.005521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a05320a9-4925-442a-9326-fc48073e5949 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.006018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a05320a9-4925-442a-9326-fc48073e5949 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.007054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a05320a9-4925-442a-9326-fc48073e5949 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.007785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a05320a9-4925-442a-9326-fc48073e5949 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.008252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a05320a9-4925-442a-9326-fc48073e5949 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.008688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a05320a9-4925-442a-9326-fc48073e5949 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.142319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a05320a9-4925-442a-9326-fc48073e5949 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:42.150234 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a05320a9-4925-442a-9326-fc48073e5949 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1325 microversion: 2.1 time: 0.156121 Aug 27 05:13:42.150905 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2143/4290] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:41 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1325 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:42.171221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af9f5fa0-3bc4-4e6f-863f-66f8d6416bae tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:42.171934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-af9f5fa0-3bc4-4e6f-863f-66f8d6416bae tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:42.179709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9f5fa0-3bc4-4e6f-863f-66f8d6416bae tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.180205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9f5fa0-3bc4-4e6f-863f-66f8d6416bae tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.180648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9f5fa0-3bc4-4e6f-863f-66f8d6416bae tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.181352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9f5fa0-3bc4-4e6f-863f-66f8d6416bae tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.181811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9f5fa0-3bc4-4e6f-863f-66f8d6416bae tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.182240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af9f5fa0-3bc4-4e6f-863f-66f8d6416bae tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.312907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af9f5fa0-3bc4-4e6f-863f-66f8d6416bae tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:42.320899 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af9f5fa0-3bc4-4e6f-863f-66f8d6416bae tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1363 microversion: 2.1 time: 0.154281 Aug 27 05:13:42.321490 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2148/4291] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:42 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:42.333564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fc42de67-5010-4643-b54d-6f880bd4e3a4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:42.334094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fc42de67-5010-4643-b54d-6f880bd4e3a4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:42.340319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc42de67-5010-4643-b54d-6f880bd4e3a4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.340822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc42de67-5010-4643-b54d-6f880bd4e3a4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.341317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc42de67-5010-4643-b54d-6f880bd4e3a4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.341958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc42de67-5010-4643-b54d-6f880bd4e3a4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.342413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc42de67-5010-4643-b54d-6f880bd4e3a4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.342841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc42de67-5010-4643-b54d-6f880bd4e3a4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.486454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fc42de67-5010-4643-b54d-6f880bd4e3a4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:42.495387 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fc42de67-5010-4643-b54d-6f880bd4e3a4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1309 microversion: 2.1 time: 0.165801 Aug 27 05:13:42.495965 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2144/4292] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:42 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:43.171884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ec331846-769f-4dfe-9626-ab04b477adbc tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:43.172507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ec331846-769f-4dfe-9626-ab04b477adbc tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:43.174458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:43.181478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec331846-769f-4dfe-9626-ab04b477adbc tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.182097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec331846-769f-4dfe-9626-ab04b477adbc tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.182537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec331846-769f-4dfe-9626-ab04b477adbc tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.183299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec331846-769f-4dfe-9626-ab04b477adbc tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.183752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec331846-769f-4dfe-9626-ab04b477adbc tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.184177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec331846-769f-4dfe-9626-ab04b477adbc tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.326514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ec331846-769f-4dfe-9626-ab04b477adbc tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:43.334871 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ec331846-769f-4dfe-9626-ab04b477adbc tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1325 microversion: 2.1 time: 0.166398 Aug 27 05:13:43.335728 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2149/4293] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:43 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1325 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:43.342587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bab570b3-39cf-484c-b3f8-81201dcaafec tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:43.343348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bab570b3-39cf-484c-b3f8-81201dcaafec tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:43.351354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab570b3-39cf-484c-b3f8-81201dcaafec tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.351938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab570b3-39cf-484c-b3f8-81201dcaafec tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.352550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab570b3-39cf-484c-b3f8-81201dcaafec tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.353342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab570b3-39cf-484c-b3f8-81201dcaafec tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.353871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab570b3-39cf-484c-b3f8-81201dcaafec tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.354317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab570b3-39cf-484c-b3f8-81201dcaafec tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.488600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bab570b3-39cf-484c-b3f8-81201dcaafec tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:43.496306 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bab570b3-39cf-484c-b3f8-81201dcaafec tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1363 microversion: 2.1 time: 0.158139 Aug 27 05:13:43.496887 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2145/4294] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:43 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:43.516450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9680dd06-dccc-44d3-8c21-ed1a2c71fc16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:43.517047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9680dd06-dccc-44d3-8c21-ed1a2c71fc16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:43.523763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9680dd06-dccc-44d3-8c21-ed1a2c71fc16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.524318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9680dd06-dccc-44d3-8c21-ed1a2c71fc16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.524756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9680dd06-dccc-44d3-8c21-ed1a2c71fc16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.525445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9680dd06-dccc-44d3-8c21-ed1a2c71fc16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.525895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9680dd06-dccc-44d3-8c21-ed1a2c71fc16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.526319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9680dd06-dccc-44d3-8c21-ed1a2c71fc16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.530524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:43.670435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9680dd06-dccc-44d3-8c21-ed1a2c71fc16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:43.678249 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9680dd06-dccc-44d3-8c21-ed1a2c71fc16 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1490 microversion: 2.1 time: 0.165866 Aug 27 05:13:43.679176 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2150/4295] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:43 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1490 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:43.699121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bfc851ab-217e-4af2-a359-83f6e6b55dd7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:43.699590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bfc851ab-217e-4af2-a359-83f6e6b55dd7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:43.705879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc851ab-217e-4af2-a359-83f6e6b55dd7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.706580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc851ab-217e-4af2-a359-83f6e6b55dd7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.707028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc851ab-217e-4af2-a359-83f6e6b55dd7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.707763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc851ab-217e-4af2-a359-83f6e6b55dd7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.708223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc851ab-217e-4af2-a359-83f6e6b55dd7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.708657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfc851ab-217e-4af2-a359-83f6e6b55dd7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.844528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bfc851ab-217e-4af2-a359-83f6e6b55dd7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:43.852345 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bfc851ab-217e-4af2-a359-83f6e6b55dd7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1491 microversion: 2.1 time: 0.157457 Aug 27 05:13:43.852914 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2146/4296] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:43 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1491 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:43.871801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1ec4dd59-db4c-4421-84d3-77e008084f76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:43.872506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1ec4dd59-db4c-4421-84d3-77e008084f76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:43.878469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec4dd59-db4c-4421-84d3-77e008084f76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.878946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec4dd59-db4c-4421-84d3-77e008084f76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.879423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec4dd59-db4c-4421-84d3-77e008084f76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.880109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec4dd59-db4c-4421-84d3-77e008084f76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.880559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec4dd59-db4c-4421-84d3-77e008084f76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.880979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec4dd59-db4c-4421-84d3-77e008084f76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.008721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1ec4dd59-db4c-4421-84d3-77e008084f76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:44.016809 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1ec4dd59-db4c-4421-84d3-77e008084f76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1490 microversion: 2.1 time: 0.148794 Aug 27 05:13:44.017392 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2151/4297] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:43 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1490 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:44.036367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f058de93-88b7-40bd-8f44-bdf767affbce tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:44.036870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f058de93-88b7-40bd-8f44-bdf767affbce tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:44.042753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f058de93-88b7-40bd-8f44-bdf767affbce tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.043282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f058de93-88b7-40bd-8f44-bdf767affbce tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.043726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f058de93-88b7-40bd-8f44-bdf767affbce tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.044422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f058de93-88b7-40bd-8f44-bdf767affbce tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.044907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f058de93-88b7-40bd-8f44-bdf767affbce tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.045336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f058de93-88b7-40bd-8f44-bdf767affbce tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.073072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f058de93-88b7-40bd-8f44-bdf767affbce tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:44.149526 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f058de93-88b7-40bd-8f44-bdf767affbce tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 204 len: 0 microversion: 2.1 time: 0.116405 Aug 27 05:13:44.150317 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2147/4298] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:44 2022] DELETE /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:44.158678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e3c3cea8-ed1f-48a5-a081-757b4a732312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:44.159330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e3c3cea8-ed1f-48a5-a081-757b4a732312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:44.165348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c3cea8-ed1f-48a5-a081-757b4a732312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.165838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c3cea8-ed1f-48a5-a081-757b4a732312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.166280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c3cea8-ed1f-48a5-a081-757b4a732312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.166977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c3cea8-ed1f-48a5-a081-757b4a732312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.167469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c3cea8-ed1f-48a5-a081-757b4a732312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.167899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c3cea8-ed1f-48a5-a081-757b4a732312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.304454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e3c3cea8-ed1f-48a5-a081-757b4a732312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:44.312728 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e3c3cea8-ed1f-48a5-a081-757b4a732312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1496 microversion: 2.1 time: 0.157881 Aug 27 05:13:44.313306 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2152/4299] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:44 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:44.356928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69c4253b-5d16-4caf-a4e3-d8a3028d01df tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:44.357922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-69c4253b-5d16-4caf-a4e3-d8a3028d01df tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:44.364994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69c4253b-5d16-4caf-a4e3-d8a3028d01df tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.365503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69c4253b-5d16-4caf-a4e3-d8a3028d01df tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.366575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69c4253b-5d16-4caf-a4e3-d8a3028d01df tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.367313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69c4253b-5d16-4caf-a4e3-d8a3028d01df tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.367767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69c4253b-5d16-4caf-a4e3-d8a3028d01df tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.368193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69c4253b-5d16-4caf-a4e3-d8a3028d01df tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.500827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-69c4253b-5d16-4caf-a4e3-d8a3028d01df tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:44.509703 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-69c4253b-5d16-4caf-a4e3-d8a3028d01df tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1325 microversion: 2.1 time: 0.156586 Aug 27 05:13:44.510223 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2148/4300] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:44 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1325 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:44.517767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e342dceb-a51e-47b0-8a9f-55a942b34e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:44.518389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e342dceb-a51e-47b0-8a9f-55a942b34e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:44.525795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e342dceb-a51e-47b0-8a9f-55a942b34e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.526291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e342dceb-a51e-47b0-8a9f-55a942b34e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.526888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e342dceb-a51e-47b0-8a9f-55a942b34e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.527694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e342dceb-a51e-47b0-8a9f-55a942b34e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.528153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e342dceb-a51e-47b0-8a9f-55a942b34e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.528587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e342dceb-a51e-47b0-8a9f-55a942b34e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.654081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-d8a9e411-0a76-4bb3-9793-45c548a6047e req-1218234f-1a45-4578-aa6e-309b5bb2023c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af99fc0-c020-438e-8387-9702ccb5cff9", "name": "network-vif-plugged", "status": "completed", "tag": "2d762bc6-b199-4250-aa1b-0d1ea440806e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:44.666329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e342dceb-a51e-47b0-8a9f-55a942b34e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:44.672739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d8a9e411-0a76-4bb3-9793-45c548a6047e req-1218234f-1a45-4578-aa6e-309b5bb2023c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.673228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d8a9e411-0a76-4bb3-9793-45c548a6047e req-1218234f-1a45-4578-aa6e-309b5bb2023c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.673665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d8a9e411-0a76-4bb3-9793-45c548a6047e req-1218234f-1a45-4578-aa6e-309b5bb2023c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.675340 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e342dceb-a51e-47b0-8a9f-55a942b34e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1363 microversion: 2.1 time: 0.161296 Aug 27 05:13:44.684528 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2153/4301] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:44 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:44.685292 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-d8a9e411-0a76-4bb3-9793-45c548a6047e req-1218234f-1a45-4578-aa6e-309b5bb2023c service nova] Creating event network-vif-plugged:2d762bc6-b199-4250-aa1b-0d1ea440806e for instance 1af99fc0-c020-438e-8387-9702ccb5cff9 on n-h1-820368-35 Aug 27 05:13:44.691195 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-d8a9e411-0a76-4bb3-9793-45c548a6047e req-1218234f-1a45-4578-aa6e-309b5bb2023c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041788 Aug 27 05:13:44.691937 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2149/4302] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:45.333964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f4dcfa9b-c2cd-4092-9902-ad95e9cf0069 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:45.334509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f4dcfa9b-c2cd-4092-9902-ad95e9cf0069 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:45.341814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4dcfa9b-c2cd-4092-9902-ad95e9cf0069 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:45.342298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4dcfa9b-c2cd-4092-9902-ad95e9cf0069 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:45.342745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4dcfa9b-c2cd-4092-9902-ad95e9cf0069 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:45.343488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4dcfa9b-c2cd-4092-9902-ad95e9cf0069 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:45.343940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4dcfa9b-c2cd-4092-9902-ad95e9cf0069 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:45.344370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4dcfa9b-c2cd-4092-9902-ad95e9cf0069 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:45.478911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f4dcfa9b-c2cd-4092-9902-ad95e9cf0069 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:45.486874 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f4dcfa9b-c2cd-4092-9902-ad95e9cf0069 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1496 microversion: 2.1 time: 0.157005 Aug 27 05:13:45.487495 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2154/4303] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:45 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:45.532874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7e267fb4-3269-442a-bc55-ddf3df46bb82 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:45.533616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7e267fb4-3269-442a-bc55-ddf3df46bb82 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:45.540564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e267fb4-3269-442a-bc55-ddf3df46bb82 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:45.541055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e267fb4-3269-442a-bc55-ddf3df46bb82 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:45.541500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e267fb4-3269-442a-bc55-ddf3df46bb82 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:45.542200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e267fb4-3269-442a-bc55-ddf3df46bb82 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:45.542661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e267fb4-3269-442a-bc55-ddf3df46bb82 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:45.543117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e267fb4-3269-442a-bc55-ddf3df46bb82 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:45.676004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7e267fb4-3269-442a-bc55-ddf3df46bb82 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:45.683722 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7e267fb4-3269-442a-bc55-ddf3df46bb82 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1325 microversion: 2.1 time: 0.156042 Aug 27 05:13:45.684298 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2150/4304] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:45 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1325 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:45.696739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-22bdb4f6-df5b-4840-b5f0-9d03b4ff5d9a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:45.697356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-22bdb4f6-df5b-4840-b5f0-9d03b4ff5d9a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:45.703439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22bdb4f6-df5b-4840-b5f0-9d03b4ff5d9a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:45.703922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22bdb4f6-df5b-4840-b5f0-9d03b4ff5d9a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:45.704356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22bdb4f6-df5b-4840-b5f0-9d03b4ff5d9a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:45.705049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22bdb4f6-df5b-4840-b5f0-9d03b4ff5d9a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:45.705503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22bdb4f6-df5b-4840-b5f0-9d03b4ff5d9a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:45.705929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22bdb4f6-df5b-4840-b5f0-9d03b4ff5d9a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:45.840394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-22bdb4f6-df5b-4840-b5f0-9d03b4ff5d9a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:45.848383 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-22bdb4f6-df5b-4840-b5f0-9d03b4ff5d9a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1363 microversion: 2.1 time: 0.155501 Aug 27 05:13:45.848973 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2155/4305] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:45 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:46.508045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4def4c59-b6a3-4ff5-8d7f-a1eaa3ccd8e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:46.508664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4def4c59-b6a3-4ff5-8d7f-a1eaa3ccd8e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:46.514983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4def4c59-b6a3-4ff5-8d7f-a1eaa3ccd8e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:46.515505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4def4c59-b6a3-4ff5-8d7f-a1eaa3ccd8e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:46.515950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4def4c59-b6a3-4ff5-8d7f-a1eaa3ccd8e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:46.516654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4def4c59-b6a3-4ff5-8d7f-a1eaa3ccd8e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:46.517113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4def4c59-b6a3-4ff5-8d7f-a1eaa3ccd8e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:46.517544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4def4c59-b6a3-4ff5-8d7f-a1eaa3ccd8e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:46.645992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4def4c59-b6a3-4ff5-8d7f-a1eaa3ccd8e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:46.653835 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4def4c59-b6a3-4ff5-8d7f-a1eaa3ccd8e1 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1496 microversion: 2.1 time: 0.150300 Aug 27 05:13:46.654422 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2151/4306] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:46 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1496 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:46.704772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a94f5f9b-916e-49c5-804d-dc98fdf45510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:46.705498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a94f5f9b-916e-49c5-804d-dc98fdf45510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:46.712602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a94f5f9b-916e-49c5-804d-dc98fdf45510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:46.713097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a94f5f9b-916e-49c5-804d-dc98fdf45510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:46.713574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a94f5f9b-916e-49c5-804d-dc98fdf45510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:46.714288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a94f5f9b-916e-49c5-804d-dc98fdf45510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:46.714749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a94f5f9b-916e-49c5-804d-dc98fdf45510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:46.715431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a94f5f9b-916e-49c5-804d-dc98fdf45510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:46.855506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a94f5f9b-916e-49c5-804d-dc98fdf45510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:46.863632 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a94f5f9b-916e-49c5-804d-dc98fdf45510 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1325 microversion: 2.1 time: 0.162898 Aug 27 05:13:46.864353 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2156/4307] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:46 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:46.871499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba2bbadf-cb87-45c9-bec7-cb18dfab6a06 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:46.872351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba2bbadf-cb87-45c9-bec7-cb18dfab6a06 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:46.878613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2bbadf-cb87-45c9-bec7-cb18dfab6a06 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:46.879356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2bbadf-cb87-45c9-bec7-cb18dfab6a06 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:46.879791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2bbadf-cb87-45c9-bec7-cb18dfab6a06 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:46.880670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2bbadf-cb87-45c9-bec7-cb18dfab6a06 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:46.881163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2bbadf-cb87-45c9-bec7-cb18dfab6a06 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:46.881553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba2bbadf-cb87-45c9-bec7-cb18dfab6a06 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:47.054155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ba2bbadf-cb87-45c9-bec7-cb18dfab6a06 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:47.066495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:47.082603 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba2bbadf-cb87-45c9-bec7-cb18dfab6a06 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1363 microversion: 2.1 time: 0.217607 Aug 27 05:13:47.090666 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2152/4308] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:46 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:47.147917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5b97bde6-9482-4563-9300-1c9ea19d0bae req-32bc7847-ab65-4276-a8b0-1810144e47b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4ba155-37ea-46b7-b986-d8e0756edec9", "name": "network-vif-deleted", "tag": "9794153f-a2d2-4cc8-b24a-fda0050577c0"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:47.186065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5b97bde6-9482-4563-9300-1c9ea19d0bae req-32bc7847-ab65-4276-a8b0-1810144e47b5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:47.186563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5b97bde6-9482-4563-9300-1c9ea19d0bae req-32bc7847-ab65-4276-a8b0-1810144e47b5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:47.187011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5b97bde6-9482-4563-9300-1c9ea19d0bae req-32bc7847-ab65-4276-a8b0-1810144e47b5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:47.208906 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-5b97bde6-9482-4563-9300-1c9ea19d0bae req-32bc7847-ab65-4276-a8b0-1810144e47b5 service nova] Creating event network-vif-deleted:9794153f-a2d2-4cc8-b24a-fda0050577c0 for instance ad4ba155-37ea-46b7-b986-d8e0756edec9 on n-h1-820368-35 Aug 27 05:13:47.216583 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5b97bde6-9482-4563-9300-1c9ea19d0bae req-32bc7847-ab65-4276-a8b0-1810144e47b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072541 Aug 27 05:13:47.218287 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2157/4309] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:47.675405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:47.676725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:47.686901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:47.687583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:47.688095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:47.688890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:47.689418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:47.689921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:47.723153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:47.723651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:47.724096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:47.724579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lazy-loading 'fault' on Instance uuid ad4ba155-37ea-46b7-b986-d8e0756edec9 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:47.768969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:47.777511 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-49b94eb4-6fe7-4e15-8f81-ef7fda78a2bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 200 len: 1299 microversion: 2.1 time: 0.105988 Aug 27 05:13:47.778439 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2153/4310] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:47 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:47.890013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-47967f8e-123e-41b8-8643-9e4859f08810 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:47.891004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-47967f8e-123e-41b8-8643-9e4859f08810 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:47.899679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47967f8e-123e-41b8-8643-9e4859f08810 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:47.900239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47967f8e-123e-41b8-8643-9e4859f08810 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:47.901003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47967f8e-123e-41b8-8643-9e4859f08810 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:47.902115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47967f8e-123e-41b8-8643-9e4859f08810 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:47.902743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47967f8e-123e-41b8-8643-9e4859f08810 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:47.903409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47967f8e-123e-41b8-8643-9e4859f08810 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.073299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-47967f8e-123e-41b8-8643-9e4859f08810 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:48.081869 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-47967f8e-123e-41b8-8643-9e4859f08810 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1522 microversion: 2.1 time: 0.198108 Aug 27 05:13:48.082761 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2158/4311] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:47 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:48.106134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ef28e639-1c8a-414a-ade3-ebdbd132c641 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:48.107029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ef28e639-1c8a-414a-ade3-ebdbd132c641 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:48.111684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-544b69d1-32f1-448a-a4e5-2f042638dfb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:48.111684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-544b69d1-32f1-448a-a4e5-2f042638dfb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:48.118985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-544b69d1-32f1-448a-a4e5-2f042638dfb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.119672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef28e639-1c8a-414a-ade3-ebdbd132c641 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.120371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef28e639-1c8a-414a-ade3-ebdbd132c641 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.120496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-544b69d1-32f1-448a-a4e5-2f042638dfb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.121086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef28e639-1c8a-414a-ade3-ebdbd132c641 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.121226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-544b69d1-32f1-448a-a4e5-2f042638dfb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.122219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef28e639-1c8a-414a-ade3-ebdbd132c641 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.122365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-544b69d1-32f1-448a-a4e5-2f042638dfb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.122807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-544b69d1-32f1-448a-a4e5-2f042638dfb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.122974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef28e639-1c8a-414a-ade3-ebdbd132c641 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.123303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef28e639-1c8a-414a-ade3-ebdbd132c641 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.124295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-544b69d1-32f1-448a-a4e5-2f042638dfb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.159237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-544b69d1-32f1-448a-a4e5-2f042638dfb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:48.281392 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-544b69d1-32f1-448a-a4e5-2f042638dfb9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 204 len: 0 microversion: 2.1 time: 0.172256 Aug 27 05:13:48.283560 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2159/4312] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:48 2022] DELETE /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:48.296986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3a5b8968-334a-4924-8436-263dd6613071 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:48.297790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3a5b8968-334a-4924-8436-263dd6613071 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:48.304600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ef28e639-1c8a-414a-ade3-ebdbd132c641 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:48.306561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5b8968-334a-4924-8436-263dd6613071 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.307171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5b8968-334a-4924-8436-263dd6613071 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.307686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5b8968-334a-4924-8436-263dd6613071 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.308990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5b8968-334a-4924-8436-263dd6613071 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.311317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5b8968-334a-4924-8436-263dd6613071 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.312265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a5b8968-334a-4924-8436-263dd6613071 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.316594 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ef28e639-1c8a-414a-ade3-ebdbd132c641 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1363 microversion: 2.1 time: 0.214502 Aug 27 05:13:48.319861 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2154/4313] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:48 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:48.364652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ce2d7e8a-30f1-4123-a7bd-1576193985d3 req-ea0143d9-30da-428a-8fcc-25429dfce574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f4c359-6f7e-4009-a365-7b070eec11a9", "name": "network-vif-plugged", "status": "completed", "tag": "2a4e09b9-01c8-433a-8d9e-e93f9888b163"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:48.376801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ce2d7e8a-30f1-4123-a7bd-1576193985d3 req-ea0143d9-30da-428a-8fcc-25429dfce574 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.377510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ce2d7e8a-30f1-4123-a7bd-1576193985d3 req-ea0143d9-30da-428a-8fcc-25429dfce574 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.378148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ce2d7e8a-30f1-4123-a7bd-1576193985d3 req-ea0143d9-30da-428a-8fcc-25429dfce574 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.396652 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ce2d7e8a-30f1-4123-a7bd-1576193985d3 req-ea0143d9-30da-428a-8fcc-25429dfce574 service nova] Creating event network-vif-plugged:2a4e09b9-01c8-433a-8d9e-e93f9888b163 for instance e5f4c359-6f7e-4009-a365-7b070eec11a9 on n-h2-820368-35 Aug 27 05:13:48.402428 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ce2d7e8a-30f1-4123-a7bd-1576193985d3 req-ea0143d9-30da-428a-8fcc-25429dfce574 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042456 Aug 27 05:13:48.403957 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2155/4314] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:48.499637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3a5b8968-334a-4924-8436-263dd6613071 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:48.509145 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3a5b8968-334a-4924-8436-263dd6613071 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1528 microversion: 2.1 time: 0.220498 Aug 27 05:13:48.510377 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2160/4315] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:48 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1528 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:48.797307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:48.802488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:48.803741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:48.805617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:48.810882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=20 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:48.813060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.813530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.813997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.814711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.815372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.815809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.831368 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 HTTP/1.1 Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'ad4ba155-37ea-46b7-b986-d8e0756edec9'} Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:48.832952 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:48.837908 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:48.837908 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:48.837908 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:48.837908 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:48.837908 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:48.837908 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:13:48.837908 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:48.837908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:48.837908 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-770470f1-ab6e-4d04-9f59-529ed081a9c4 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 404 len: 111 microversion: 2.1 time: 0.037995 Aug 27 05:13:48.838796 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2156/4316] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:48 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:48.843482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-331fea5d-ec74-4847-b7a3-45c8b67cba39 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:48.843988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-331fea5d-ec74-4847-b7a3-45c8b67cba39 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:48.850732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-331fea5d-ec74-4847-b7a3-45c8b67cba39 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.851250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-331fea5d-ec74-4847-b7a3-45c8b67cba39 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.851705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-331fea5d-ec74-4847-b7a3-45c8b67cba39 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.852401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-331fea5d-ec74-4847-b7a3-45c8b67cba39 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.852863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-331fea5d-ec74-4847-b7a3-45c8b67cba39 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.853295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-331fea5d-ec74-4847-b7a3-45c8b67cba39 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.880352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-331fea5d-ec74-4847-b7a3-45c8b67cba39 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:48.960070 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-331fea5d-ec74-4847-b7a3-45c8b67cba39 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 204 len: 0 microversion: 2.1 time: 0.120283 Aug 27 05:13:48.960762 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2161/4317] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:48 2022] DELETE /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:13:48.969134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3bf8962c-77a5-42cb-b908-b686faf63f70 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:48.970732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3bf8962c-77a5-42cb-b908-b686faf63f70 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:48.978755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bf8962c-77a5-42cb-b908-b686faf63f70 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.978755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bf8962c-77a5-42cb-b908-b686faf63f70 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.978755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bf8962c-77a5-42cb-b908-b686faf63f70 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:48.981591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bf8962c-77a5-42cb-b908-b686faf63f70 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:48.981872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bf8962c-77a5-42cb-b908-b686faf63f70 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:48.982619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bf8962c-77a5-42cb-b908-b686faf63f70 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:49.135365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3bf8962c-77a5-42cb-b908-b686faf63f70 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:49.143470 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3bf8962c-77a5-42cb-b908-b686faf63f70 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1497 microversion: 2.1 time: 0.178040 Aug 27 05:13:49.144054 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2157/4318] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:48 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:49.341932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-246f9aa5-fa89-4ab4-ad91-87e112d2e8df tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:49.342790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-246f9aa5-fa89-4ab4-ad91-87e112d2e8df tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:49.350803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-246f9aa5-fa89-4ab4-ad91-87e112d2e8df tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:49.351324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-246f9aa5-fa89-4ab4-ad91-87e112d2e8df tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:49.351765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-246f9aa5-fa89-4ab4-ad91-87e112d2e8df tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:49.352539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-246f9aa5-fa89-4ab4-ad91-87e112d2e8df tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:49.353055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-246f9aa5-fa89-4ab4-ad91-87e112d2e8df tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:49.353798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-246f9aa5-fa89-4ab4-ad91-87e112d2e8df tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:49.512105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-246f9aa5-fa89-4ab4-ad91-87e112d2e8df tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:49.523108 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-246f9aa5-fa89-4ab4-ad91-87e112d2e8df tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1363 microversion: 2.1 time: 0.184272 Aug 27 05:13:49.526742 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2162/4319] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:49 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:49.532207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c03aaac8-bbf7-4688-9bb7-3e065bbcefde tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:49.533138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c03aaac8-bbf7-4688-9bb7-3e065bbcefde tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:49.540719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03aaac8-bbf7-4688-9bb7-3e065bbcefde tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:49.541361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03aaac8-bbf7-4688-9bb7-3e065bbcefde tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:49.541919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03aaac8-bbf7-4688-9bb7-3e065bbcefde tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:49.542777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03aaac8-bbf7-4688-9bb7-3e065bbcefde tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:49.543378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03aaac8-bbf7-4688-9bb7-3e065bbcefde tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:49.543913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03aaac8-bbf7-4688-9bb7-3e065bbcefde tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:49.682017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c03aaac8-bbf7-4688-9bb7-3e065bbcefde tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:49.690880 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c03aaac8-bbf7-4688-9bb7-3e065bbcefde tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1528 microversion: 2.1 time: 0.162813 Aug 27 05:13:49.691493 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2158/4320] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:49 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1528 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:50.166314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-66e0bc9d-989f-46c6-ae40-f90fffdd4e4d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:50.167203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-66e0bc9d-989f-46c6-ae40-f90fffdd4e4d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:50.175008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66e0bc9d-989f-46c6-ae40-f90fffdd4e4d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:50.175543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66e0bc9d-989f-46c6-ae40-f90fffdd4e4d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:50.176016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66e0bc9d-989f-46c6-ae40-f90fffdd4e4d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:50.176735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66e0bc9d-989f-46c6-ae40-f90fffdd4e4d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:50.180508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66e0bc9d-989f-46c6-ae40-f90fffdd4e4d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:50.180508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66e0bc9d-989f-46c6-ae40-f90fffdd4e4d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:50.314707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-605cd387-ee59-41ea-a31f-e154ec5575b3 req-07a52e2d-9106-44dc-b1d7-068147e93493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af99fc0-c020-438e-8387-9702ccb5cff9", "name": "network-vif-deleted", "tag": "2d762bc6-b199-4250-aa1b-0d1ea440806e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:50.333859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-605cd387-ee59-41ea-a31f-e154ec5575b3 req-07a52e2d-9106-44dc-b1d7-068147e93493 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:50.335384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-605cd387-ee59-41ea-a31f-e154ec5575b3 req-07a52e2d-9106-44dc-b1d7-068147e93493 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:50.337089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-605cd387-ee59-41ea-a31f-e154ec5575b3 req-07a52e2d-9106-44dc-b1d7-068147e93493 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:50.351500 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-605cd387-ee59-41ea-a31f-e154ec5575b3 req-07a52e2d-9106-44dc-b1d7-068147e93493 service nova] Creating event network-vif-deleted:2d762bc6-b199-4250-aa1b-0d1ea440806e for instance 1af99fc0-c020-438e-8387-9702ccb5cff9 on n-h1-820368-35 Aug 27 05:13:50.358165 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-605cd387-ee59-41ea-a31f-e154ec5575b3 req-07a52e2d-9106-44dc-b1d7-068147e93493 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047185 Aug 27 05:13:50.363959 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2159/4321] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:50.397866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66e0bc9d-989f-46c6-ae40-f90fffdd4e4d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:50.409540 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-66e0bc9d-989f-46c6-ae40-f90fffdd4e4d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1497 microversion: 2.1 time: 0.247957 Aug 27 05:13:50.411825 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2163/4322] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:50 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1497 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:50.553611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b15b6450-62f3-432a-93df-a5351ac70d23 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:50.554355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b15b6450-62f3-432a-93df-a5351ac70d23 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:50.561293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15b6450-62f3-432a-93df-a5351ac70d23 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:50.561788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15b6450-62f3-432a-93df-a5351ac70d23 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:50.562472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15b6450-62f3-432a-93df-a5351ac70d23 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:50.562926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15b6450-62f3-432a-93df-a5351ac70d23 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:50.563404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15b6450-62f3-432a-93df-a5351ac70d23 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:50.563828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b15b6450-62f3-432a-93df-a5351ac70d23 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:50.702481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b15b6450-62f3-432a-93df-a5351ac70d23 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:50.710773 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b15b6450-62f3-432a-93df-a5351ac70d23 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1363 microversion: 2.1 time: 0.161395 Aug 27 05:13:50.722660 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2160/4323] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:50 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:50.723022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:50.723022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:50.723022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:50.723022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:50.723022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:50.723022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:50.723022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:50.723022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:50.727679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:50.760337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:50.760816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:50.761252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:50.761701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lazy-loading 'fault' on Instance uuid 1af99fc0-c020-438e-8387-9702ccb5cff9 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:50.803761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6438306d009f43f6a1aac4dc35b07ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb331ed3d141f9950c5fbe121f3e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:50.812970 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ded725b-ba7a-41cf-aac3-39388bf34b0d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 200 len: 1315 microversion: 2.1 time: 0.104068 Aug 27 05:13:50.813542 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2164/4324] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:50 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 1315 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:51.151453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9172f033-a798-40af-8313-80ffcec81506 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:51.156626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9172f033-a798-40af-8313-80ffcec81506 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:51.157024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9172f033-a798-40af-8313-80ffcec81506 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Searching by: {'deleted': False, 'project_id': '53d3ce49750c408f92141d38db831c55'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:51.163262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9172f033-a798-40af-8313-80ffcec81506 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.163757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9172f033-a798-40af-8313-80ffcec81506 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.164205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9172f033-a798-40af-8313-80ffcec81506 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.164937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9172f033-a798-40af-8313-80ffcec81506 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.165392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9172f033-a798-40af-8313-80ffcec81506 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.165822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9172f033-a798-40af-8313-80ffcec81506 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.191388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-9172f033-a798-40af-8313-80ffcec81506 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:13:51.219879 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9172f033-a798-40af-8313-80ffcec81506 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.072186 Aug 27 05:13:51.228475 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2161/4325] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 05:13:51 2022] GET /compute/v2.1/servers => generated 334 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:51.233658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:51.239355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:51.240315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Searching by: {'deleted': False, 'project_id': '53d3ce49750c408f92141d38db831c55'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:13:51.247722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.248235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.248810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.249401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.249843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.250377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.278714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:13:51.328877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:51.334726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.335676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.335676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.433409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5bf0a137-d2f9-4880-8cc5-734a422b4fee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:51.434740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5bf0a137-d2f9-4880-8cc5-734a422b4fee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:51.444656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bf0a137-d2f9-4880-8cc5-734a422b4fee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.445248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bf0a137-d2f9-4880-8cc5-734a422b4fee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.445687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bf0a137-d2f9-4880-8cc5-734a422b4fee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.446386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bf0a137-d2f9-4880-8cc5-734a422b4fee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.446991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bf0a137-d2f9-4880-8cc5-734a422b4fee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.447607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bf0a137-d2f9-4880-8cc5-734a422b4fee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.574212 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a77bfb6-dcd6-44ac-be8e-6287d2e3715c tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.344527 Aug 27 05:13:51.575145 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2165/4326] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 05:13:51 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:51.599212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-79490032-8ea8-4675-b8fe-c2cf70542860 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:51.608295 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-79490032-8ea8-4675-b8fe-c2cf70542860 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012878 Aug 27 05:13:51.608872 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2166/4327] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:13:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:51.661331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5bf0a137-d2f9-4880-8cc5-734a422b4fee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:51.670230 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5bf0a137-d2f9-4880-8cc5-734a422b4fee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1497 microversion: 2.1 time: 0.240743 Aug 27 05:13:51.670812 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2162/4328] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:51 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1497 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:51.732858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3fb504ca-8eb0-414b-b83e-ab92832ff8f4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:51.733685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3fb504ca-8eb0-414b-b83e-ab92832ff8f4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:51.747030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fb504ca-8eb0-414b-b83e-ab92832ff8f4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.748891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fb504ca-8eb0-414b-b83e-ab92832ff8f4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.750036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fb504ca-8eb0-414b-b83e-ab92832ff8f4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.750277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fb504ca-8eb0-414b-b83e-ab92832ff8f4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.750774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fb504ca-8eb0-414b-b83e-ab92832ff8f4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.751550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fb504ca-8eb0-414b-b83e-ab92832ff8f4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.833965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:51.835193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 1af99fc0-c020-438e-8387-9702ccb5cff9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:51.841399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.842110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.842861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.843819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.845631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.846846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.863667 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] HTTP exception thrown: Instance 1af99fc0-c020-438e-8387-9702ccb5cff9 could not be found. Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 HTTP/1.1 Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 1af99fc0-c020-438e-8387-9702ccb5cff9 could not be found. Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '1af99fc0-c020-438e-8387-9702ccb5cff9'} Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af99fc0-c020-438e-8387-9702ccb5cff9 could not be found. Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af99fc0-c020-438e-8387-9702ccb5cff9 could not be found. Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.865755 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:51.870414 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.870414 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:51.870414 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:51.870414 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:51.870414 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:51.870414 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:51.870414 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af99fc0-c020-438e-8387-9702ccb5cff9 could not be found. Aug 27 05:13:51.870414 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.870996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 404 to user: Instance 1af99fc0-c020-438e-8387-9702ccb5cff9 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:51.875043 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3dcd1c17-f806-458a-a27b-c2cc7182ffe9 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9" status: 404 len: 111 microversion: 2.1 time: 0.044554 Aug 27 05:13:51.877092 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2163/4329] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:51 2022] GET /compute/v2.1/servers/1af99fc0-c020-438e-8387-9702ccb5cff9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:51.889122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8bfe63d-7428-4933-aeb9-c3777a5ffca6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '.version_select at 0x7fb565962160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:51.921079 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e8bfe63d-7428-4933-aeb9-c3777a5ffca6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] HTTP exception thrown: Image not found. Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8bfe63d-7428-4933-aeb9-c3777a5ffca6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/images/a68d1852-8dcd-4dd0-91d5-de35bcebca38 HTTP/1.1 Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: exception: Image not found. Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'a68d1852-8dcd-4dd0-91d5-de35bcebca38'} Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a68d1852-8dcd-4dd0-91d5-de35bcebca38 to delete Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a68d1852-8dcd-4dd0-91d5-de35bcebca38 could not be found. Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:51.923848 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 05:13:51.928640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.931924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8bfe63d-7428-4933-aeb9-c3777a5ffca6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 404 to user: Image not found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:51.933182 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e8bfe63d-7428-4933-aeb9-c3777a5ffca6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "DELETE /compute/v2.1/images/a68d1852-8dcd-4dd0-91d5-de35bcebca38" status: 404 len: 62 microversion: 2.1 time: 0.050809 Aug 27 05:13:51.937148 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2164/4330] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:51 2022] DELETE /compute/v2.1/images/a68d1852-8dcd-4dd0-91d5-de35bcebca38 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:13:51.945544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3fb504ca-8eb0-414b-b83e-ab92832ff8f4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:51.949357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:51.951023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:51.956411 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3fb504ca-8eb0-414b-b83e-ab92832ff8f4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1549 microversion: 2.1 time: 0.227826 Aug 27 05:13:51.957154 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2167/4331] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:51 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1549 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:51.964149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.965163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.966022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.967997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.968674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.969662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.979551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ff5048c-51f8-445b-97b0-f43f29fb8d3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:51.980149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ff5048c-51f8-445b-97b0-f43f29fb8d3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:51.988606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff5048c-51f8-445b-97b0-f43f29fb8d3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.989254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff5048c-51f8-445b-97b0-f43f29fb8d3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.989680 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] HTTP exception thrown: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:51.989870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff5048c-51f8-445b-97b0-f43f29fb8d3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.991892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff5048c-51f8-445b-97b0-f43f29fb8d3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a HTTP/1.1 Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '290c9cc0-3ff4-45e6-8e5c-b885a54cc30a'} Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:51.992048 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:51.996584 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:51.996584 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.996584 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:51.996584 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.996584 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:51.996584 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:51.996584 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:51.996584 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:51.996584 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:51.996584 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:51.996584 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:51.997395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff5048c-51f8-445b-97b0-f43f29fb8d3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:51.997395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ff5048c-51f8-445b-97b0-f43f29fb8d3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:51.998751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 404 to user: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:52.000076 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6a01206e-573c-45dd-9892-4d753e15ec8d tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "DELETE /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 404 len: 111 microversion: 2.1 time: 0.061222 Aug 27 05:13:52.005160 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2165/4332] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:51 2022] DELETE /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:52.012877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:52.013841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:52.022614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:52.023406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:52.024167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:52.025778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:52.026434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:52.028068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:52.045337 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] HTTP exception thrown: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a HTTP/1.1 Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '290c9cc0-3ff4-45e6-8e5c-b885a54cc30a'} Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:52.047415 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:52.051925 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:52.051925 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:52.051925 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:52.051925 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:52.051925 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:52.051925 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:52.051925 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. Aug 27 05:13:52.051925 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:52.054674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 404 to user: Instance 290c9cc0-3ff4-45e6-8e5c-b885a54cc30a could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:52.055818 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8f56bd24-b923-4acd-9741-4591f7c76cee tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a" status: 404 len: 111 microversion: 2.1 time: 0.048018 Aug 27 05:13:52.059991 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2166/4333] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:52 2022] GET /compute/v2.1/servers/290c9cc0-3ff4-45e6-8e5c-b885a54cc30a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:52.065741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-75b549b9-d816-4001-b961-7e027d9384f6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '.version_select at 0x7fb565585af0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:52.093725 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-75b549b9-d816-4001-b961-7e027d9384f6 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187774505" status: 202 len: 0 microversion: 2.1 time: 0.032243 Aug 27 05:13:52.100215 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2167/4334] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 05:13:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187774505 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:13:52.132387 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ff5048c-51f8-445b-97b0-f43f29fb8d3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156787 Aug 27 05:13:52.143404 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2168/4335] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:13:51 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:52.382369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9064b790-5cd7-48b4-8b5f-f66beff95dbf tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:52.382872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9064b790-5cd7-48b4-8b5f-f66beff95dbf tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:52.389789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9064b790-5cd7-48b4-8b5f-f66beff95dbf tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:52.390474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9064b790-5cd7-48b4-8b5f-f66beff95dbf tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:52.391175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9064b790-5cd7-48b4-8b5f-f66beff95dbf tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:52.392063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9064b790-5cd7-48b4-8b5f-f66beff95dbf tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:52.392690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9064b790-5cd7-48b4-8b5f-f66beff95dbf tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:52.393268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9064b790-5cd7-48b4-8b5f-f66beff95dbf tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:52.423187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9064b790-5cd7-48b4-8b5f-f66beff95dbf tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:52.553483 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9064b790-5cd7-48b4-8b5f-f66beff95dbf tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 204 len: 0 microversion: 2.1 time: 0.174700 Aug 27 05:13:52.554600 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2168/4336] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:52 2022] DELETE /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:52.564402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e2b7260f-a858-420d-95bc-23b4e0e96367 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:52.565694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e2b7260f-a858-420d-95bc-23b4e0e96367 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:52.575598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2b7260f-a858-420d-95bc-23b4e0e96367 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:52.576670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2b7260f-a858-420d-95bc-23b4e0e96367 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:52.577265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2b7260f-a858-420d-95bc-23b4e0e96367 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:52.578125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2b7260f-a858-420d-95bc-23b4e0e96367 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:52.578737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2b7260f-a858-420d-95bc-23b4e0e96367 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:52.579509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2b7260f-a858-420d-95bc-23b4e0e96367 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:52.691915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9d62a933-5265-4bdb-ba37-277dcb034bd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:52.693036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9d62a933-5265-4bdb-ba37-277dcb034bd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:52.699981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d62a933-5265-4bdb-ba37-277dcb034bd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:52.700924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d62a933-5265-4bdb-ba37-277dcb034bd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:52.701527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d62a933-5265-4bdb-ba37-277dcb034bd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:52.702443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d62a933-5265-4bdb-ba37-277dcb034bd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:52.703135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d62a933-5265-4bdb-ba37-277dcb034bd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:52.703727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d62a933-5265-4bdb-ba37-277dcb034bd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:52.837480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9d62a933-5265-4bdb-ba37-277dcb034bd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:52.849474 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9d62a933-5265-4bdb-ba37-277dcb034bd8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1455 microversion: 2.1 time: 0.161879 Aug 27 05:13:52.851721 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2169/4337] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:52 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:52.874844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-a12fc184-4623-4640-86fc-7cfdaa6a5060 req-9234a8c9-b6a8-4dc6-a610-5001c0c03c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990fabb7-dca0-43bb-92c4-93645540f6ac", "name": "network-vif-deleted", "tag": "447bc2e8-b81d-4a37-adb4-15242002eb71"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:52.894601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a12fc184-4623-4640-86fc-7cfdaa6a5060 req-9234a8c9-b6a8-4dc6-a610-5001c0c03c91 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:52.897934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a12fc184-4623-4640-86fc-7cfdaa6a5060 req-9234a8c9-b6a8-4dc6-a610-5001c0c03c91 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:52.898548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a12fc184-4623-4640-86fc-7cfdaa6a5060 req-9234a8c9-b6a8-4dc6-a610-5001c0c03c91 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:52.923501 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-a12fc184-4623-4640-86fc-7cfdaa6a5060 req-9234a8c9-b6a8-4dc6-a610-5001c0c03c91 service nova] Creating event network-vif-deleted:447bc2e8-b81d-4a37-adb4-15242002eb71 for instance 990fabb7-dca0-43bb-92c4-93645540f6ac on n-h2-820368-35 Aug 27 05:13:52.930943 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-a12fc184-4623-4640-86fc-7cfdaa6a5060 req-9234a8c9-b6a8-4dc6-a610-5001c0c03c91 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060375 Aug 27 05:13:52.932390 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2170/4338] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:52.968858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e2b7260f-a858-420d-95bc-23b4e0e96367 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:52.988454 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e2b7260f-a858-420d-95bc-23b4e0e96367 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1698 microversion: 2.1 time: 0.424330 Aug 27 05:13:53.007426 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2169/4339] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:52 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1698 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:53.498854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3a30ab3f-4586-4ba1-ab98-41a9f96dd862 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '.version_select at 0x7fb565908b80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:53.528475 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-3a30ab3f-4586-4ba1-ab98-41a9f96dd862 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] HTTP exception thrown: Image not found. Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3a30ab3f-4586-4ba1-ab98-41a9f96dd862 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/images/997ad68f-23e6-4628-822d-8e8684286dc8 HTTP/1.1 Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: exception: Image not found. Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '997ad68f-23e6-4628-822d-8e8684286dc8'} Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 997ad68f-23e6-4628-822d-8e8684286dc8 to delete Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 997ad68f-23e6-4628-822d-8e8684286dc8 could not be found. Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:53.530659 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 05:13:53.535505 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.539235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3a30ab3f-4586-4ba1-ab98-41a9f96dd862 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 404 to user: Image not found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:53.539235 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3a30ab3f-4586-4ba1-ab98-41a9f96dd862 tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "DELETE /compute/v2.1/images/997ad68f-23e6-4628-822d-8e8684286dc8" status: 404 len: 62 microversion: 2.1 time: 0.045770 Aug 27 05:13:53.543160 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2171/4340] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:53 2022] DELETE /compute/v2.1/images/997ad68f-23e6-4628-822d-8e8684286dc8 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:13:53.550565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:53.551114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:53.558627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:53.559176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:53.559630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:53.560837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:53.561307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:53.561745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:53.578587 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] HTTP exception thrown: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 HTTP/1.1 Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '6c39d751-b91a-4901-b8fe-f0d280024110'} Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:53.580499 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 404 to user: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:53.585346 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a9d37fca-1989-4817-9568-86456548faca tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 404 len: 111 microversion: 2.1 time: 0.035963 Aug 27 05:13:53.587043 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2170/4341] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:53 2022] DELETE /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:53.592630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:53.594741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] [instance: 6c39d751-b91a-4901-b8fe-f0d280024110] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:53.601593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:53.602093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:53.602537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:53.603290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:53.603744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:53.604169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:53.621953 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] HTTP exception thrown: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Request method failure captured: Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 HTTP/1.1 Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaeyh4uMDGlY96CmPS2tpf6VXECG513dR4HnOvqzaILuEZpkW0FdzE1qNWHdIp17BfpMZTzLiDlaXr8nxYwPP-2uX8ihTUhllPWi6OSaMp4OX8FfIkA0PvF0nM9z1jvnLM30mrwx67BFlY9aXupmzZZS8fQAKvXQHrD_Dexkirpe3gU Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05bb331ed3d141f9950c5fbe121f3e7f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05bb331ed3d141f9950c5fbe121f3e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 05bb331ed3d141f9950c5fbe121f3e7f Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-752069280 Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6438306d009f43f6a1aac4dc35b07ecf Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-752069280-project Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '6c39d751-b91a-4901-b8fe-f0d280024110'} Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.623645 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:53.628231 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.628231 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:53.628231 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:53.628231 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:53.628231 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:53.628231 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:53.628231 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. Aug 27 05:13:53.628231 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:53.628231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] Returning 404 to user: Instance 6c39d751-b91a-4901-b8fe-f0d280024110 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:53.628231 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f0e5f2fc-54d7-4a33-8ad3-a454e7bea9dd tempest-ImagesOneServerNegativeTestJSON-752069280 tempest-ImagesOneServerNegativeTestJSON-752069280-project] 10.222.0.58 "GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110" status: 404 len: 111 microversion: 2.1 time: 0.036695 Aug 27 05:13:53.628231 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2172/4342] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:53 2022] GET /compute/v2.1/servers/6c39d751-b91a-4901-b8fe-f0d280024110 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:53.876336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:53.877443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:53.887272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:53.888084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:53.888705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:53.889803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:53.890525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:53.891503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:53.929731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:53.930228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:53.930671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:53.931149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lazy-loading 'fault' on Instance uuid 990fabb7-dca0-43bb-92c4-93645540f6ac {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:54.008978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:54.010948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f65f347-f328-42e8-a932-f1bc423d0a26 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:54.011834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0f65f347-f328-42e8-a932-f1bc423d0a26 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:54.018783 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-48732fb0-1b10-44da-9e19-15b253bd16b5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 200 len: 1299 microversion: 2.1 time: 0.150021 Aug 27 05:13:54.019465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f65f347-f328-42e8-a932-f1bc423d0a26 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:54.020051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f65f347-f328-42e8-a932-f1bc423d0a26 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:54.020691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f65f347-f328-42e8-a932-f1bc423d0a26 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:54.021464 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2171/4343] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:53 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:54.022436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f65f347-f328-42e8-a932-f1bc423d0a26 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:54.023190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f65f347-f328-42e8-a932-f1bc423d0a26 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:54.024252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f65f347-f328-42e8-a932-f1bc423d0a26 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:54.259037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0f65f347-f328-42e8-a932-f1bc423d0a26 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:54.271398 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f65f347-f328-42e8-a932-f1bc423d0a26 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1698 microversion: 2.1 time: 0.264652 Aug 27 05:13:54.272406 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2173/4344] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:54 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1698 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:54.415579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-3060474b-0632-4248-a68c-c0a737c6e8ad req-11716ca4-3ec0-4372-ba93-aa5c4a5b95dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f4c359-6f7e-4009-a365-7b070eec11a9", "tag": "2a4e09b9-01c8-433a-8d9e-e93f9888b163"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:54.432521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3060474b-0632-4248-a68c-c0a737c6e8ad req-11716ca4-3ec0-4372-ba93-aa5c4a5b95dc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:54.433430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3060474b-0632-4248-a68c-c0a737c6e8ad req-11716ca4-3ec0-4372-ba93-aa5c4a5b95dc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:54.433953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3060474b-0632-4248-a68c-c0a737c6e8ad req-11716ca4-3ec0-4372-ba93-aa5c4a5b95dc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:54.450057 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-3060474b-0632-4248-a68c-c0a737c6e8ad req-11716ca4-3ec0-4372-ba93-aa5c4a5b95dc service nova] Creating event network-changed:2a4e09b9-01c8-433a-8d9e-e93f9888b163 for instance e5f4c359-6f7e-4009-a365-7b070eec11a9 on n-h2-820368-35 Aug 27 05:13:54.456332 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-3060474b-0632-4248-a68c-c0a737c6e8ad req-11716ca4-3ec0-4372-ba93-aa5c4a5b95dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.318610 Aug 27 05:13:54.457190 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2172/4345] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:55.042673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:55.047415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:55.061586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:55.062466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:55.063269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:55.064319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:55.064933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:55.065518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:55.097455 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac HTTP/1.1 Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '990fabb7-dca0-43bb-92c4-93645540f6ac'} Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:55.099509 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:55.103394 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:55.103394 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:55.103394 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:55.103394 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:55.103394 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:55.103394 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:13:55.103394 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:13:55.108535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:55.110478 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-edbb685d-5237-46a8-b185-6e798601edae tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 404 len: 111 microversion: 2.1 time: 0.071237 Aug 27 05:13:55.111570 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2174/4346] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:55 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:55.254164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-31932613", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "43620fdb-3b93-439f-955c-01e22d65d95a"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:55.295519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9da3d4dd-5bc2-46d9-90ff-197ab3654ee5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:55.296432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9da3d4dd-5bc2-46d9-90ff-197ab3654ee5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:55.310800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9da3d4dd-5bc2-46d9-90ff-197ab3654ee5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:55.311403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9da3d4dd-5bc2-46d9-90ff-197ab3654ee5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:55.311825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9da3d4dd-5bc2-46d9-90ff-197ab3654ee5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:55.312900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9da3d4dd-5bc2-46d9-90ff-197ab3654ee5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:55.313540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9da3d4dd-5bc2-46d9-90ff-197ab3654ee5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:55.314078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9da3d4dd-5bc2-46d9-90ff-197ab3654ee5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:55.325760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] validate_networks() for [('43620fdb-3b93-439f-955c-01e22d65d95a', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:13:55.739427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9da3d4dd-5bc2-46d9-90ff-197ab3654ee5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:55.749809 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9da3d4dd-5bc2-46d9-90ff-197ab3654ee5 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1698 microversion: 2.1 time: 0.460564 Aug 27 05:13:55.755650 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2175/4347] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:55 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1698 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:56.108210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:13:56.108733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:13:56.109314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:13:56.109849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:13:56.110336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:13:56.120687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:56.121316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:56.121780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:56.122663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:56.123220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:56.123929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:56.163826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:56.175131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for user c75dd4d6f001450bb9279d592e9783bd and project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:56.191930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:13:56.194722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:13:56.220109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:56.253737 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-80deccf1-21b0-4aa8-a054-4f25b8994a58 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006195 Aug 27 05:13:56.254845 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2173/4348] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:13:56.273172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-255289a9-b7c4-47b2-a800-f86ee5d37e55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:56.274998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-255289a9-b7c4-47b2-a800-f86ee5d37e55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:56.341651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-255289a9-b7c4-47b2-a800-f86ee5d37e55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:56.351945 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-255289a9-b7c4-47b2-a800-f86ee5d37e55 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1207 microversion: 2.1 time: 0.089692 Aug 27 05:13:56.354434 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2176/4349] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:56 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1207 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:56.782115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-57006f13-1313-48a7-8c3e-d9bc746a5259 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:56.783517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-57006f13-1313-48a7-8c3e-d9bc746a5259 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:56.795740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57006f13-1313-48a7-8c3e-d9bc746a5259 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:56.796952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57006f13-1313-48a7-8c3e-d9bc746a5259 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:56.797959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57006f13-1313-48a7-8c3e-d9bc746a5259 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:56.799838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57006f13-1313-48a7-8c3e-d9bc746a5259 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:56.800911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57006f13-1313-48a7-8c3e-d9bc746a5259 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:56.801676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57006f13-1313-48a7-8c3e-d9bc746a5259 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:56.922298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-57006f13-1313-48a7-8c3e-d9bc746a5259 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:56.931765 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-57006f13-1313-48a7-8c3e-d9bc746a5259 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1631 microversion: 2.1 time: 0.157032 Aug 27 05:13:56.946159 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2174/4350] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:56 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1631 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:57.380665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c3b22db-4f2b-42f9-afc3-8b369046d4ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:57.381853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c3b22db-4f2b-42f9-afc3-8b369046d4ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:57.411184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3b22db-4f2b-42f9-afc3-8b369046d4ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:57.411576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-99a2f698-525b-463d-bc96-637637deb8ff req-1f672a8e-9d51-4fca-8095-0d32b819995a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47d1403-a080-46a6-afcb-fb0aaf21616a", "name": "network-vif-deleted", "tag": "5e7060fe-bfe9-42bd-b0d4-3a21859a112b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:57.415254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3b22db-4f2b-42f9-afc3-8b369046d4ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:57.415951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3b22db-4f2b-42f9-afc3-8b369046d4ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:57.416934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3b22db-4f2b-42f9-afc3-8b369046d4ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:57.417574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3b22db-4f2b-42f9-afc3-8b369046d4ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:57.418155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3b22db-4f2b-42f9-afc3-8b369046d4ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:57.425129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-99a2f698-525b-463d-bc96-637637deb8ff req-1f672a8e-9d51-4fca-8095-0d32b819995a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:57.426040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-99a2f698-525b-463d-bc96-637637deb8ff req-1f672a8e-9d51-4fca-8095-0d32b819995a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:57.426687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-99a2f698-525b-463d-bc96-637637deb8ff req-1f672a8e-9d51-4fca-8095-0d32b819995a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:57.435196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:57.448282 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-99a2f698-525b-463d-bc96-637637deb8ff req-1f672a8e-9d51-4fca-8095-0d32b819995a service nova] Creating event network-vif-deleted:5e7060fe-bfe9-42bd-b0d4-3a21859a112b for instance d47d1403-a080-46a6-afcb-fb0aaf21616a on n-h2-820368-35 Aug 27 05:13:57.474260 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-99a2f698-525b-463d-bc96-637637deb8ff req-1f672a8e-9d51-4fca-8095-0d32b819995a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067099 Aug 27 05:13:57.477589 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2175/4351] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:57.591618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c3b22db-4f2b-42f9-afc3-8b369046d4ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:57.604518 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c3b22db-4f2b-42f9-afc3-8b369046d4ec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1259 microversion: 2.1 time: 0.230624 Aug 27 05:13:57.607568 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2177/4352] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:57 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1259 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:57.953941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:57.954663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:57.967199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:57.967719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:57.968169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:57.968903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:57.971436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:57.971924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:58.067282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:58.068030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:58.069250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:58.071491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lazy-loading 'fault' on Instance uuid d47d1403-a080-46a6-afcb-fb0aaf21616a {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:58.136300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e392f02f2c7145a5864f33ac08994c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d3ce49750c408f92141d38db831c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:58.150854 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e090c201-2390-4ec7-9145-96701587b1a1 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 200 len: 1359 microversion: 2.1 time: 0.201162 Aug 27 05:13:58.152271 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2176/4353] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:57 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:58.628934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-10fd6a57-90f3-44a0-be1e-e7302e8364bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:58.629570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-10fd6a57-90f3-44a0-be1e-e7302e8364bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:58.640825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10fd6a57-90f3-44a0-be1e-e7302e8364bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:58.641548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10fd6a57-90f3-44a0-be1e-e7302e8364bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:58.646764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10fd6a57-90f3-44a0-be1e-e7302e8364bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:58.647953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10fd6a57-90f3-44a0-be1e-e7302e8364bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:58.654952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10fd6a57-90f3-44a0-be1e-e7302e8364bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:58.656286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10fd6a57-90f3-44a0-be1e-e7302e8364bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:58.753170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-10fd6a57-90f3-44a0-be1e-e7302e8364bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:58.762322 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-10fd6a57-90f3-44a0-be1e-e7302e8364bd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1265 microversion: 2.1 time: 0.137889 Aug 27 05:13:58.763265 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2178/4354] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:58 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:59.175456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:59.176856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] [instance: d47d1403-a080-46a6-afcb-fb0aaf21616a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:59.185449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:59.186362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:59.187016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:59.188706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:59.189491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:59.194476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:59.223200 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] HTTP exception thrown: Instance d47d1403-a080-46a6-afcb-fb0aaf21616a could not be found. Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Request method failure captured: Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a HTTP/1.1 Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaeYQi6O2pE5yCfXLf4OGm3QcovkG09Y2kxX_i8gfdlrO16pdq_t0h40CLGiBE0ztWQrnynhOOKd8Ak2zF0a6FotBc6e48hViZXOho2j5Ah5EAt6MdPlXfbBKk9kYqdi2mNMWGhasH3bLo4DZnIC47jLXCZOeYBV8HaZbzcSdM0xGQY Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 53d3ce49750c408f92141d38db831c55 Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1018779372 Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_53d3ce49750c408f92141d38db831c55", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/53d3ce49750c408f92141d38db831c55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/53d3ce49750c408f92141d38db831c55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/53d3ce49750c408f92141d38db831c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1018779372 Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 53d3ce49750c408f92141d38db831c55 Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1018779372 Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1018779372-project Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: e392f02f2c7145a5864f33ac08994c87 Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1018779372-project Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance d47d1403-a080-46a6-afcb-fb0aaf21616a could not be found. Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd47d1403-a080-46a6-afcb-fb0aaf21616a'} Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47d1403-a080-46a6-afcb-fb0aaf21616a could not be found. Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47d1403-a080-46a6-afcb-fb0aaf21616a could not be found. Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:59.225200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:59.233989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:59.233989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:59.233989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:59.233989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:59.233989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:59.233989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47d1403-a080-46a6-afcb-fb0aaf21616a could not be found. Aug 27 05:13:59.233989 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:13:59.233989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Returning 404 to user: Instance d47d1403-a080-46a6-afcb-fb0aaf21616a could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:59.233989 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2c06f54c-1fc9-42db-9d94-ede43e8fee74 tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a" status: 404 len: 111 microversion: 2.1 time: 0.055611 Aug 27 05:13:59.233989 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2177/4355] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:59 2022] GET /compute/v2.1/servers/d47d1403-a080-46a6-afcb-fb0aaf21616a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:59.237118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-732e4996-93ea-425d-a75c-c5b738d0503f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] Calling method '.version_select at 0x7fb5657834c0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:59.280917 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-732e4996-93ea-425d-a75c-c5b738d0503f tempest-ServersTestJSON-1018779372 tempest-ServersTestJSON-1018779372-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-515078189" status: 202 len: 0 microversion: 2.1 time: 0.047963 Aug 27 05:13:59.282359 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2179/4356] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 05:13:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-515078189 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:13:59.797890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-37288633-16a5-4dfc-b5fc-fae9271c18bf tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:59.798825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-37288633-16a5-4dfc-b5fc-fae9271c18bf tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:59.814434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37288633-16a5-4dfc-b5fc-fae9271c18bf tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:59.815167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37288633-16a5-4dfc-b5fc-fae9271c18bf tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:59.815731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37288633-16a5-4dfc-b5fc-fae9271c18bf tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:59.818449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37288633-16a5-4dfc-b5fc-fae9271c18bf tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:59.820615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37288633-16a5-4dfc-b5fc-fae9271c18bf tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:59.823188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37288633-16a5-4dfc-b5fc-fae9271c18bf tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:00.276885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37288633-16a5-4dfc-b5fc-fae9271c18bf tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:00.286460 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-37288633-16a5-4dfc-b5fc-fae9271c18bf tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1307 microversion: 2.1 time: 0.495572 Aug 27 05:14:00.287619 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2178/4357] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:59 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1307 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:01.307462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:01.321531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bd2158ff-952d-4ebb-b55c-82f862d23ff6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:01.324055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bd2158ff-952d-4ebb-b55c-82f862d23ff6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:01.333714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd2158ff-952d-4ebb-b55c-82f862d23ff6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:01.335692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd2158ff-952d-4ebb-b55c-82f862d23ff6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:01.336358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd2158ff-952d-4ebb-b55c-82f862d23ff6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:01.337841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd2158ff-952d-4ebb-b55c-82f862d23ff6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:01.338784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd2158ff-952d-4ebb-b55c-82f862d23ff6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:01.339830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd2158ff-952d-4ebb-b55c-82f862d23ff6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:01.683684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bd2158ff-952d-4ebb-b55c-82f862d23ff6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:01.696162 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bd2158ff-952d-4ebb-b55c-82f862d23ff6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1307 microversion: 2.1 time: 0.390985 Aug 27 05:14:01.712548 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2180/4358] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:01 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1307 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:02.388829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-534e660d-304d-4858-aff2-5ba19ac3b1c7 req-0a02526f-1682-45fb-bd39-23f42142130c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaa690f1-d939-4d44-8cd5-187c582696c7", "tag": "aa088f88-25f0-41b9-92e2-e7ef1039f2e9"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:02.413937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-534e660d-304d-4858-aff2-5ba19ac3b1c7 req-0a02526f-1682-45fb-bd39-23f42142130c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:02.414467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-534e660d-304d-4858-aff2-5ba19ac3b1c7 req-0a02526f-1682-45fb-bd39-23f42142130c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:02.414909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-534e660d-304d-4858-aff2-5ba19ac3b1c7 req-0a02526f-1682-45fb-bd39-23f42142130c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:02.428175 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-534e660d-304d-4858-aff2-5ba19ac3b1c7 req-0a02526f-1682-45fb-bd39-23f42142130c service nova] Creating event network-changed:aa088f88-25f0-41b9-92e2-e7ef1039f2e9 for instance eaa690f1-d939-4d44-8cd5-187c582696c7 on n-h1-820368-35 Aug 27 05:14:02.434298 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-534e660d-304d-4858-aff2-5ba19ac3b1c7 req-0a02526f-1682-45fb-bd39-23f42142130c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049483 Aug 27 05:14:02.435538 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2179/4359] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:02.720244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ea9d2c48-f3f4-47be-b842-cc0212719522 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:02.721225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ea9d2c48-f3f4-47be-b842-cc0212719522 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:02.744920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea9d2c48-f3f4-47be-b842-cc0212719522 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:02.746252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea9d2c48-f3f4-47be-b842-cc0212719522 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:02.747128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea9d2c48-f3f4-47be-b842-cc0212719522 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:02.748727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea9d2c48-f3f4-47be-b842-cc0212719522 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:02.749452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea9d2c48-f3f4-47be-b842-cc0212719522 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:02.750118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea9d2c48-f3f4-47be-b842-cc0212719522 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:03.018942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ea9d2c48-f3f4-47be-b842-cc0212719522 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:03.032407 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ea9d2c48-f3f4-47be-b842-cc0212719522 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1307 microversion: 2.1 time: 0.317472 Aug 27 05:14:03.035692 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2181/4360] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:02 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1307 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:04.065093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad34cbc8-5eb6-48af-9a17-ebecec517df2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:04.066609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad34cbc8-5eb6-48af-9a17-ebecec517df2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:04.080869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad34cbc8-5eb6-48af-9a17-ebecec517df2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:04.082848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad34cbc8-5eb6-48af-9a17-ebecec517df2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:04.086257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad34cbc8-5eb6-48af-9a17-ebecec517df2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:04.089175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad34cbc8-5eb6-48af-9a17-ebecec517df2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:04.089825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad34cbc8-5eb6-48af-9a17-ebecec517df2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:04.091179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad34cbc8-5eb6-48af-9a17-ebecec517df2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:04.292317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad34cbc8-5eb6-48af-9a17-ebecec517df2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:04.303207 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad34cbc8-5eb6-48af-9a17-ebecec517df2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1307 microversion: 2.1 time: 0.244598 Aug 27 05:14:04.304980 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2180/4361] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:04 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1307 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:05.329213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba09e26a-7258-4314-8ff3-daaccf9c680b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:05.329998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba09e26a-7258-4314-8ff3-daaccf9c680b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:05.342232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba09e26a-7258-4314-8ff3-daaccf9c680b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:05.345618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba09e26a-7258-4314-8ff3-daaccf9c680b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:05.346122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba09e26a-7258-4314-8ff3-daaccf9c680b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:05.346864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba09e26a-7258-4314-8ff3-daaccf9c680b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:05.347363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba09e26a-7258-4314-8ff3-daaccf9c680b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:05.347790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba09e26a-7258-4314-8ff3-daaccf9c680b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:06.017825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ba09e26a-7258-4314-8ff3-daaccf9c680b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:06.030393 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba09e26a-7258-4314-8ff3-daaccf9c680b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1307 microversion: 2.1 time: 0.707437 Aug 27 05:14:06.032227 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2182/4362] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:05 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1307 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:07.052553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6fe469da-2f2c-49b2-87cf-832a5b5ddede tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:07.053169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6fe469da-2f2c-49b2-87cf-832a5b5ddede tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:07.070588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:07.072337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:07.080150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fe469da-2f2c-49b2-87cf-832a5b5ddede tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:07.080975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fe469da-2f2c-49b2-87cf-832a5b5ddede tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:07.081571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fe469da-2f2c-49b2-87cf-832a5b5ddede tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:07.082542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fe469da-2f2c-49b2-87cf-832a5b5ddede tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:07.083257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fe469da-2f2c-49b2-87cf-832a5b5ddede tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:07.084486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fe469da-2f2c-49b2-87cf-832a5b5ddede tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:07.423655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6fe469da-2f2c-49b2-87cf-832a5b5ddede tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:07.434669 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6fe469da-2f2c-49b2-87cf-832a5b5ddede tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1307 microversion: 2.1 time: 0.385402 Aug 27 05:14:07.435619 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2181/4363] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:07 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1307 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:08.456133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e789ecb4-c5bb-4a46-a7db-c36fc12d07dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:08.456765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e789ecb4-c5bb-4a46-a7db-c36fc12d07dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:08.464931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:08.476153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e789ecb4-c5bb-4a46-a7db-c36fc12d07dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:08.476968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e789ecb4-c5bb-4a46-a7db-c36fc12d07dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:08.478062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e789ecb4-c5bb-4a46-a7db-c36fc12d07dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:08.478685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e789ecb4-c5bb-4a46-a7db-c36fc12d07dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:08.478685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e789ecb4-c5bb-4a46-a7db-c36fc12d07dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:08.479781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e789ecb4-c5bb-4a46-a7db-c36fc12d07dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:08.999823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e789ecb4-c5bb-4a46-a7db-c36fc12d07dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:09.014005 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e789ecb4-c5bb-4a46-a7db-c36fc12d07dd tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1307 microversion: 2.1 time: 0.559243 Aug 27 05:14:09.031031 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2183/4364] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:08 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1307 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:09.730402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-52ae7bb7-3c57-4909-8005-d57510145d37 req-adf941a9-6ba2-4e63-8f42-fe3b4fe5e9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa690f1-d939-4d44-8cd5-187c582696c7", "name": "network-vif-plugged", "status": "completed", "tag": "aa088f88-25f0-41b9-92e2-e7ef1039f2e9"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:09.760415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52ae7bb7-3c57-4909-8005-d57510145d37 req-adf941a9-6ba2-4e63-8f42-fe3b4fe5e9c0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:09.764206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52ae7bb7-3c57-4909-8005-d57510145d37 req-adf941a9-6ba2-4e63-8f42-fe3b4fe5e9c0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:09.764967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52ae7bb7-3c57-4909-8005-d57510145d37 req-adf941a9-6ba2-4e63-8f42-fe3b4fe5e9c0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:09.805479 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-52ae7bb7-3c57-4909-8005-d57510145d37 req-adf941a9-6ba2-4e63-8f42-fe3b4fe5e9c0 service nova] Creating event network-vif-plugged:aa088f88-25f0-41b9-92e2-e7ef1039f2e9 for instance eaa690f1-d939-4d44-8cd5-187c582696c7 on n-h1-820368-35 Aug 27 05:14:09.813797 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-52ae7bb7-3c57-4909-8005-d57510145d37 req-adf941a9-6ba2-4e63-8f42-fe3b4fe5e9c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088217 Aug 27 05:14:09.815467 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2182/4365] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:10.039970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f095c0d6-3c47-4535-b790-62d4969f311e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:10.040753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f095c0d6-3c47-4535-b790-62d4969f311e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:10.056944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f095c0d6-3c47-4535-b790-62d4969f311e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:10.057462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f095c0d6-3c47-4535-b790-62d4969f311e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:10.058591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f095c0d6-3c47-4535-b790-62d4969f311e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:10.060888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f095c0d6-3c47-4535-b790-62d4969f311e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:10.061808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f095c0d6-3c47-4535-b790-62d4969f311e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:10.062267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f095c0d6-3c47-4535-b790-62d4969f311e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:10.618761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f095c0d6-3c47-4535-b790-62d4969f311e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:10.636992 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f095c0d6-3c47-4535-b790-62d4969f311e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1307 microversion: 2.1 time: 0.602450 Aug 27 05:14:10.638069 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2184/4366] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:10 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1307 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:11.664155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fbb419bc-643b-4b48-95a4-3b4532c49431 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:11.664996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fbb419bc-643b-4b48-95a4-3b4532c49431 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:11.686815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb419bc-643b-4b48-95a4-3b4532c49431 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:11.687709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb419bc-643b-4b48-95a4-3b4532c49431 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:11.688398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb419bc-643b-4b48-95a4-3b4532c49431 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:11.689509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb419bc-643b-4b48-95a4-3b4532c49431 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:11.690261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb419bc-643b-4b48-95a4-3b4532c49431 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:11.691325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbb419bc-643b-4b48-95a4-3b4532c49431 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:12.295661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fbb419bc-643b-4b48-95a4-3b4532c49431 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:12.324460 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fbb419bc-643b-4b48-95a4-3b4532c49431 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1307 microversion: 2.1 time: 0.665251 Aug 27 05:14:12.334868 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2183/4367] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:11 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1307 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:13.213110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-58263d0b-ccdc-4886-9bad-ddc51f0fea3f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb565185ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-595418494", "description": "tempest-description-815876797"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:13.357582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-84ed1a3f-aec1-4f3b-89c4-754278ea6cf8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:13.358945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-84ed1a3f-aec1-4f3b-89c4-754278ea6cf8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:13.378253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ed1a3f-aec1-4f3b-89c4-754278ea6cf8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:13.378756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ed1a3f-aec1-4f3b-89c4-754278ea6cf8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:13.379235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ed1a3f-aec1-4f3b-89c4-754278ea6cf8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:13.379979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ed1a3f-aec1-4f3b-89c4-754278ea6cf8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:13.381050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ed1a3f-aec1-4f3b-89c4-754278ea6cf8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:13.388483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ed1a3f-aec1-4f3b-89c4-754278ea6cf8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:13.664342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-84ed1a3f-aec1-4f3b-89c4-754278ea6cf8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:13.690462 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-84ed1a3f-aec1-4f3b-89c4-754278ea6cf8 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1489 microversion: 2.1 time: 0.338433 Aug 27 05:14:13.692165 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2184/4368] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:13 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1489 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:13.702410 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-58263d0b-ccdc-4886-9bad-ddc51f0fea3f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.655769 Aug 27 05:14:13.703016 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2185/4369] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:14:13 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:13.736126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cbc2c751-06ad-45dd-8a40-520dc26ec670 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb5650dc8b0>, body: {"security_group_rule": {"parent_group_id": "73100c96-66c2-4d34-81d8-71728ba0060d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:13.736430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d418ced-f18c-4825-8033-0dbf7ee23fd5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:13.751720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d418ced-f18c-4825-8033-0dbf7ee23fd5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:13.789149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d418ced-f18c-4825-8033-0dbf7ee23fd5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:13.794672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d418ced-f18c-4825-8033-0dbf7ee23fd5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:13.795481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d418ced-f18c-4825-8033-0dbf7ee23fd5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:13.796839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d418ced-f18c-4825-8033-0dbf7ee23fd5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:13.797572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d418ced-f18c-4825-8033-0dbf7ee23fd5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:13.798242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d418ced-f18c-4825-8033-0dbf7ee23fd5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:14.059555 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d418ced-f18c-4825-8033-0dbf7ee23fd5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "PUT /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1084 microversion: 2.1 time: 0.335515 Aug 27 05:14:14.084429 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2186/4370] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:14:13 2022] PUT /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1084 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:14.095662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9ed9dfd-5905-4c34-90a1-f194cd58fc9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:14.097177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9ed9dfd-5905-4c34-90a1-f194cd58fc9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:14.110567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9ed9dfd-5905-4c34-90a1-f194cd58fc9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:14.112383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9ed9dfd-5905-4c34-90a1-f194cd58fc9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:14.113723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9ed9dfd-5905-4c34-90a1-f194cd58fc9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:14.115895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9ed9dfd-5905-4c34-90a1-f194cd58fc9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:14.117186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9ed9dfd-5905-4c34-90a1-f194cd58fc9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:14.118458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9ed9dfd-5905-4c34-90a1-f194cd58fc9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:14.528689 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cbc2c751-06ad-45dd-8a40-520dc26ec670 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.805799 Aug 27 05:14:14.529943 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2185/4371] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:14:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:14.549548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-64a07a8e-2a3b-4eae-857e-b241651ab996 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb56500b5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-280211231", "description": "tempest-description-898104302"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:14.694687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f9ed9dfd-5905-4c34-90a1-f194cd58fc9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:14.719828 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9ed9dfd-5905-4c34-90a1-f194cd58fc9f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1510 microversion: 2.1 time: 0.630737 Aug 27 05:14:14.720421 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2187/4372] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:14 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1510 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:14.763233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-17f9823e-bf7c-444e-b92f-1509b8792949 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:14.763934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-17f9823e-bf7c-444e-b92f-1509b8792949 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:14.777864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f9823e-bf7c-444e-b92f-1509b8792949 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:14.779394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f9823e-bf7c-444e-b92f-1509b8792949 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:14.782234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f9823e-bf7c-444e-b92f-1509b8792949 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:14.784037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f9823e-bf7c-444e-b92f-1509b8792949 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:14.787229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f9823e-bf7c-444e-b92f-1509b8792949 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:14.787838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f9823e-bf7c-444e-b92f-1509b8792949 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:15.025684 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-64a07a8e-2a3b-4eae-857e-b241651ab996 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.481188 Aug 27 05:14:15.027627 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2186/4373] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:14:14 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:14:15.044910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-710157c4-24e7-43f4-a1ba-294d5dc0139f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb565426d30>, body: {"security_group_rule": {"parent_group_id": "ef4535a3-26f4-4bde-9d56-cfb22bc0c13e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:15.737003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-17f9823e-bf7c-444e-b92f-1509b8792949 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:15.747516 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-17f9823e-bf7c-444e-b92f-1509b8792949 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1510 microversion: 2.1 time: 0.989421 Aug 27 05:14:15.748960 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2188/4374] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:14 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1510 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:15.778666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1dc68c69-c28a-42c7-b619-6aab684e5042 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:15.779521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1dc68c69-c28a-42c7-b619-6aab684e5042 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:15.791497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68c69-c28a-42c7-b619-6aab684e5042 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:15.791989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68c69-c28a-42c7-b619-6aab684e5042 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:15.792422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68c69-c28a-42c7-b619-6aab684e5042 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:15.798081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68c69-c28a-42c7-b619-6aab684e5042 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:15.798725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68c69-c28a-42c7-b619-6aab684e5042 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:15.799986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68c69-c28a-42c7-b619-6aab684e5042 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:15.873811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1dc68c69-c28a-42c7-b619-6aab684e5042 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:14:16.013972 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1dc68c69-c28a-42c7-b619-6aab684e5042 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 204 len: 0 microversion: 2.1 time: 0.242756 Aug 27 05:14:16.014987 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2189/4375] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:14:15 2022] DELETE /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:14:16.029368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eab4ddbb-6566-4a86-b65c-d03a6e110f5c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:16.030135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eab4ddbb-6566-4a86-b65c-d03a6e110f5c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:16.039064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eab4ddbb-6566-4a86-b65c-d03a6e110f5c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:16.039586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eab4ddbb-6566-4a86-b65c-d03a6e110f5c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:16.040038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eab4ddbb-6566-4a86-b65c-d03a6e110f5c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:16.040776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eab4ddbb-6566-4a86-b65c-d03a6e110f5c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:16.041290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eab4ddbb-6566-4a86-b65c-d03a6e110f5c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:16.041662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eab4ddbb-6566-4a86-b65c-d03a6e110f5c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:16.108706 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-710157c4-24e7-43f4-a1ba-294d5dc0139f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.069307 Aug 27 05:14:16.108706 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2187/4376] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:14:15 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:14:16.123042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f32d64f8-689d-4e9d-ac08-1ef42c6d99b4 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb565426430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-849461729", "description": "tempest-description-1290800333"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:16.443236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eab4ddbb-6566-4a86-b65c-d03a6e110f5c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:16.460446 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eab4ddbb-6566-4a86-b65c-d03a6e110f5c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1516 microversion: 2.1 time: 0.441082 Aug 27 05:14:16.461045 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2190/4377] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:16 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1516 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:16.584904 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f32d64f8-689d-4e9d-ac08-1ef42c6d99b4 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.465430 Aug 27 05:14:16.589067 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2188/4378] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:14:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:16.608590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-beb52ec5-8021-4815-aff4-b17fd6451ffa tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb565585af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-691038069", "description": "tempest-description-837844407"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:17.166519 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-beb52ec5-8021-4815-aff4-b17fd6451ffa tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.569089 Aug 27 05:14:17.169565 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2191/4379] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:14:16 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:17.181282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6df2a9d-ff1d-48c9-b27c-6f6267ff12e5 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb564f73c10>, body: {"security_group_rule": {"parent_group_id": "f6532d8d-f963-4848-b2fd-3fa6d38fd7e3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e6603660-f747-40f7-8b89-55a229e818af"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:17.496322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a328734-05b7-4138-b23c-a118623dcefa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:17.500711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a328734-05b7-4138-b23c-a118623dcefa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:17.518226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a328734-05b7-4138-b23c-a118623dcefa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:17.519892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a328734-05b7-4138-b23c-a118623dcefa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:17.520336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a328734-05b7-4138-b23c-a118623dcefa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:17.521670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a328734-05b7-4138-b23c-a118623dcefa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:17.522131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a328734-05b7-4138-b23c-a118623dcefa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:17.527908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a328734-05b7-4138-b23c-a118623dcefa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:17.750890 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6df2a9d-ff1d-48c9-b27c-6f6267ff12e5 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.575045 Aug 27 05:14:17.760776 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2189/4380] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:14:17 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:17.766707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c616da8-7960-4dff-86ea-8db8577dc77d tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb5652d09d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-591045290", "description": "tempest-description-2061614554"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:17.849301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a328734-05b7-4138-b23c-a118623dcefa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:17.858388 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a328734-05b7-4138-b23c-a118623dcefa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1516 microversion: 2.1 time: 0.374353 Aug 27 05:14:17.865162 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2192/4381] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:17 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1516 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:18.000678 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c616da8-7960-4dff-86ea-8db8577dc77d tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.237482 Aug 27 05:14:18.001857 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2190/4382] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:14:17 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:18.014576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-211bab2f-e8ae-4a1e-b6ee-820b2877c84f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb56490d0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-162804721", "description": "tempest-description-1104763836"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:18.205814 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-211bab2f-e8ae-4a1e-b6ee-820b2877c84f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.195306 Aug 27 05:14:18.207109 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2193/4383] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:14:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:18.227371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ba817da-38e7-4a1e-8a37-bded00db0fab tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb5652d0af0>, body: {"security_group_rule": {"parent_group_id": "30fa85c1-1abf-47e9-b01f-b355f37b0f6f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d7112f7e-cf0d-4e70-ade2-d7a223871369"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:18.517774 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ba817da-38e7-4a1e-8a37-bded00db0fab tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.300134 Aug 27 05:14:18.518459 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2191/4384] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:14:18 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:18.531678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fb55d736-8a9d-4b32-9a5c-77a825a2371c tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Calling method '.version_select at 0x7fb565962670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:18.886370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa1e39df-875e-4a3b-8908-91fc703b232c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:18.889643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aa1e39df-875e-4a3b-8908-91fc703b232c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:18.894193 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fb55d736-8a9d-4b32-9a5c-77a825a2371c tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/d7112f7e-cf0d-4e70-ade2-d7a223871369" status: 202 len: 0 microversion: 2.1 time: 0.367218 Aug 27 05:14:18.895381 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2194/4385] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:14:18 2022] DELETE /compute/v2.1/os-security-groups/d7112f7e-cf0d-4e70-ade2-d7a223871369 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:14:18.900209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1e39df-875e-4a3b-8908-91fc703b232c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:18.900776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1e39df-875e-4a3b-8908-91fc703b232c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:18.901278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1e39df-875e-4a3b-8908-91fc703b232c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:18.901992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1e39df-875e-4a3b-8908-91fc703b232c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:18.902469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1e39df-875e-4a3b-8908-91fc703b232c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:18.902886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa1e39df-875e-4a3b-8908-91fc703b232c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:18.906407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-93704fc1-3ee0-4016-9604-50459f9b2ffd tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Calling method '.version_select at 0x7fb5650a4280>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:18.908147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:19.066679 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-93704fc1-3ee0-4016-9604-50459f9b2ffd tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/30fa85c1-1abf-47e9-b01f-b355f37b0f6f" status: 200 len: 247 microversion: 2.1 time: 0.166420 Aug 27 05:14:19.067743 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2195/4386] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 05:14:18 2022] GET /compute/v2.1/os-security-groups/30fa85c1-1abf-47e9-b01f-b355f37b0f6f => generated 247 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:19.087785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-585a4965-a275-4fb4-838c-af07f6ce1166 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb565004550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1378838717", "description": "tempest-description-1220697772"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:19.229138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aa1e39df-875e-4a3b-8908-91fc703b232c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:19.239734 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aa1e39df-875e-4a3b-8908-91fc703b232c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 200 len: 1516 microversion: 2.1 time: 0.357943 Aug 27 05:14:19.246942 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2192/4387] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:18 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 1516 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:19.347691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-ffb5ce59-d5a3-4c85-b7c3-cfe7eea46298 req-32fc6633-2b0c-4d18-8688-a4ad49fda292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa690f1-d939-4d44-8cd5-187c582696c7", "name": "network-vif-deleted", "tag": "aa088f88-25f0-41b9-92e2-e7ef1039f2e9"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:19.376816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ffb5ce59-d5a3-4c85-b7c3-cfe7eea46298 req-32fc6633-2b0c-4d18-8688-a4ad49fda292 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:19.377306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ffb5ce59-d5a3-4c85-b7c3-cfe7eea46298 req-32fc6633-2b0c-4d18-8688-a4ad49fda292 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:19.377750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ffb5ce59-d5a3-4c85-b7c3-cfe7eea46298 req-32fc6633-2b0c-4d18-8688-a4ad49fda292 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:19.436542 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-ffb5ce59-d5a3-4c85-b7c3-cfe7eea46298 req-32fc6633-2b0c-4d18-8688-a4ad49fda292 service nova] Creating event network-vif-deleted:aa088f88-25f0-41b9-92e2-e7ef1039f2e9 for instance eaa690f1-d939-4d44-8cd5-187c582696c7 on n-h1-820368-35 Aug 27 05:14:19.467020 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-ffb5ce59-d5a3-4c85-b7c3-cfe7eea46298 req-32fc6633-2b0c-4d18-8688-a4ad49fda292 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123458 Aug 27 05:14:19.469389 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2193/4388] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:14:19.486102 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-585a4965-a275-4fb4-838c-af07f6ce1166 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.408447 Aug 27 05:14:19.488275 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2196/4389] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:14:19 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:14:19.505026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e0a59a1b-6d8e-452b-a7ce-395156bb23f1 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb5652ef9d0>, body: {"security_group_rule": {"parent_group_id": "26fd5bb7-8026-42ca-ab30-e787c1825cd4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:19.819204 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e0a59a1b-6d8e-452b-a7ce-395156bb23f1 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.321824 Aug 27 05:14:19.819814 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2194/4390] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:14:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:19.840600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-19239254-b9c6-4ebc-ba31-5300e79e2241 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Action: 'create', calling method: .version_select at 0x7fb565585b80>, body: {"security_group_rule": {"parent_group_id": "26fd5bb7-8026-42ca-ab30-e787c1825cd4", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:20.268422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:20.269444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:20.280653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:20.281158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:20.281606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:20.290252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:20.290910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:20.291392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:20.321870 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 HTTP/1.1 Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'eaa690f1-d939-4d44-8cd5-187c582696c7'} Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:20.328354 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:20.334200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:20.334200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:20.334200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:20.334200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:14:20.334200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:14:20.334200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:14:20.334200 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:20.337197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:14:20.338931 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c34b11f7-abd0-40fe-bba1-720a4d96481d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 404 len: 111 microversion: 2.1 time: 0.075000 Aug 27 05:14:20.343040 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2195/4391] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:20 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:14:20.460845 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-19239254-b9c6-4ebc-ba31-5300e79e2241 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.633335 Aug 27 05:14:20.462161 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2197/4392] 10.222.0.58 () {60 vars in 1195 bytes} [Sat Aug 27 05:14:19 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:20.473193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9228ae0c-b2ff-41df-83f9-00db0dff6b58 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Calling method '.version_select at 0x7fb5652d0280>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:20.506655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-309178573", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "43620fdb-3b93-439f-955c-01e22d65d95a"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:20.522727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:20.590388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] validate_networks() for [('43620fdb-3b93-439f-955c-01e22d65d95a', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:14:20.713165 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9228ae0c-b2ff-41df-83f9-00db0dff6b58 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/26fd5bb7-8026-42ca-ab30-e787c1825cd4" status: 200 len: 665 microversion: 2.1 time: 0.242939 Aug 27 05:14:20.714320 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2196/4393] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 05:14:20 2022] GET /compute/v2.1/os-security-groups/26fd5bb7-8026-42ca-ab30-e787c1825cd4 => generated 665 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:20.729158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1810487966", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "4e6a0038-b0f6-4c23-bf96-76b079c7bcc0"}, {"uuid": "5b9e2ade-e93c-45ce-bf92-238f8eb2d929"}, {"uuid": "4e6a0038-b0f6-4c23-bf96-76b079c7bcc0"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:20.832047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] validate_networks() for [('4e6a0038-b0f6-4c23-bf96-76b079c7bcc0', None, None, None, None, None), ('5b9e2ade-e93c-45ce-bf92-238f8eb2d929', None, None, None, None, None), ('4e6a0038-b0f6-4c23-bf96-76b079c7bcc0', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:14:21.309988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:14:21.310746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:14:21.311452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:14:21.311874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:14:21.312287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:14:21.326296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:21.326788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:21.327451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:21.328528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:21.329166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:21.329754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:21.354687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:14:21.362894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Getting quotas for user c75dd4d6f001450bb9279d592e9783bd and project 61d7174d18c840b4b1d3e4d0c20b7887. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:14:21.383665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:14:21.386474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:14:21.475953 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ee2ac3bb-3a74-484d-9474-8d890af4ea06 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971454 Aug 27 05:14:21.477873 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2198/4394] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:14:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:14:21.488377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-376bf002-73a9-4597-86b0-520e751ccfe6 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Calling method '.version_select at 0x7fb56953b0d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:22.483007 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-376bf002-73a9-4597-86b0-520e751ccfe6 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/e02b83a4-49c2-4e12-846c-c4bf0e3d6985" status: 202 len: 0 microversion: 2.1 time: 1.003469 Aug 27 05:14:22.483968 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2199/4395] 10.222.0.58 () {58 vars in 1287 bytes} [Sat Aug 27 05:14:21 2022] DELETE /compute/v2.1/os-security-group-rules/e02b83a4-49c2-4e12-846c-c4bf0e3d6985 => generated 0 bytes in 1005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:14:22.493905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e2dc23ea-3149-4083-853e-caca0821b173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:22.494532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e2dc23ea-3149-4083-853e-caca0821b173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:22.510896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2dc23ea-3149-4083-853e-caca0821b173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:22.523469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2dc23ea-3149-4083-853e-caca0821b173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:22.524102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2dc23ea-3149-4083-853e-caca0821b173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:22.524922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2dc23ea-3149-4083-853e-caca0821b173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:22.525378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2dc23ea-3149-4083-853e-caca0821b173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:22.525815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2dc23ea-3149-4083-853e-caca0821b173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:22.670606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e2dc23ea-3149-4083-853e-caca0821b173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:22.701622 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e2dc23ea-3149-4083-853e-caca0821b173 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1212 microversion: 2.1 time: 0.216533 Aug 27 05:14:22.707232 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2200/4396] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:22 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1212 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:22.720137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ba54247-85f3-4180-a2df-627196dfefb4 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Calling method '.version_select at 0x7fb5650374c0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:22.907307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:14:22.908344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:14:22.910840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:14:22.912039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:14:22.912638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:14:22.943488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:22.944092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:22.944557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:22.948780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:22.949281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:22.949728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:22.995333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Getting quotas for project e2fce25efce44ca2af48550a5e49d3c4. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:14:23.007513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Getting quotas for user a4f64cdce2564b2aaeefe6ff048ce65f and project e2fce25efce44ca2af48550a5e49d3c4. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:14:23.037962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:14:23.041776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:14:23.143920 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-15ea8f2f-85f9-4041-a579-528028ac5758 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.426825 Aug 27 05:14:23.144965 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2197/4397] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:14:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:14:23.157329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6b2cf51a-d5b7-4c7d-9b33-ab0d17872172 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:23.158145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6b2cf51a-d5b7-4c7d-9b33-ab0d17872172 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:23.278205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6b2cf51a-d5b7-4c7d-9b33-ab0d17872172 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:23.327942 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6b2cf51a-d5b7-4c7d-9b33-ab0d17872172 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1213 microversion: 2.1 time: 0.173582 Aug 27 05:14:23.346604 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2198/4398] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:23 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1213 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:23.352019 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ba54247-85f3-4180-a2df-627196dfefb4 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/26fd5bb7-8026-42ca-ab30-e787c1825cd4" status: 202 len: 0 microversion: 2.1 time: 0.639913 Aug 27 05:14:23.352880 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2201/4399] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:14:22 2022] DELETE /compute/v2.1/os-security-groups/26fd5bb7-8026-42ca-ab30-e787c1825cd4 => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:14:23.362936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-53905a57-36f7-4b27-8057-39e911a1f50f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Calling method '.version_select at 0x7fb564ed5430>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:23.483633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-53905a57-36f7-4b27-8057-39e911a1f50f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d7112f7e-cf0d-4e70-ade2-d7a223871369 does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:14:23.484316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-53905a57-36f7-4b27-8057-39e911a1f50f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Neutron security group d7112f7e-cf0d-4e70-ade2-d7a223871369 not found {{(pid=128548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:14:23.484867 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-53905a57-36f7-4b27-8057-39e911a1f50f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] HTTP exception thrown: Security group d7112f7e-cf0d-4e70-ade2-d7a223871369 does not exist Aug 27 05:14:23.484867 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-fde58a56-6fd6-401c-94b7-7971d0e772a8'] Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-53905a57-36f7-4b27-8057-39e911a1f50f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Request method failure captured: Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-security-groups/d7112f7e-cf0d-4e70-ade2-d7a223871369 HTTP/1.1 Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCagkntpYHNl9ZRk8ZkuiH-L3pP4bxeTFTODXVQxn6ZVkoEeH1NW3fbpN-HciExYMHjTJURQ5RnGzR9Wccw83df4SSB928R4ZfYDo5maWXe5zPZDhEdpXRwd1RNt8AfZ_YIpUz9PL3daVJUYgdOhzEtfBmvXqfuhhGDh2x_HWznXKocU Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 3a01d4489eda4bc78f705797bdc253c6 Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-121299440 Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3a01d4489eda4bc78f705797bdc253c6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3a01d4489eda4bc78f705797bdc253c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3a01d4489eda4bc78f705797bdc253c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3a01d4489eda4bc78f705797bdc253c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupRulesTestJSON-121299440 Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 3a01d4489eda4bc78f705797bdc253c6 Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-121299440 Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupRulesTestJSON-121299440-project Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 97dc1e45a8ca4187919a6bab0cb3d883 Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupRulesTestJSON-121299440-project Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group d7112f7e-cf0d-4e70-ade2-d7a223871369 does not exist Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-fde58a56-6fd6-401c-94b7-7971d0e772a8'] Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd7112f7e-cf0d-4e70-ade2-d7a223871369'} Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:14:23.493470 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d7112f7e-cf0d-4e70-ade2-d7a223871369 does not exist Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fde58a56-6fd6-401c-94b7-7971d0e772a8'] Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d7112f7e-cf0d-4e70-ade2-d7a223871369 does not exist Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fde58a56-6fd6-401c-94b7-7971d0e772a8'] Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d7112f7e-cf0d-4e70-ade2-d7a223871369 does not exist Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fde58a56-6fd6-401c-94b7-7971d0e772a8'] Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d7112f7e-cf0d-4e70-ade2-d7a223871369 does not exist Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fde58a56-6fd6-401c-94b7-7971d0e772a8'] Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-53905a57-36f7-4b27-8057-39e911a1f50f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Returning 404 to user: Security group d7112f7e-cf0d-4e70-ade2-d7a223871369 does not exist Aug 27 05:14:23.498698 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-fde58a56-6fd6-401c-94b7-7971d0e772a8'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:14:23.507262 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-53905a57-36f7-4b27-8057-39e911a1f50f tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/d7112f7e-cf0d-4e70-ade2-d7a223871369" status: 404 len: 194 microversion: 2.1 time: 0.143215 Aug 27 05:14:23.507262 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2199/4400] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:14:23 2022] DELETE /compute/v2.1/os-security-groups/d7112f7e-cf0d-4e70-ade2-d7a223871369 => generated 194 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:14:23.514501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c30d6793-bcca-44d6-8894-eb48b2e20b99 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Calling method '.version_select at 0x7fb5650378b0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:23.724917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-74c988ee-e357-42f3-808e-89a8c3f3f099 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:23.725882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-74c988ee-e357-42f3-808e-89a8c3f3f099 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:23.747471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74c988ee-e357-42f3-808e-89a8c3f3f099 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:23.749129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74c988ee-e357-42f3-808e-89a8c3f3f099 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:23.755382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74c988ee-e357-42f3-808e-89a8c3f3f099 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:23.759617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74c988ee-e357-42f3-808e-89a8c3f3f099 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:23.763437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74c988ee-e357-42f3-808e-89a8c3f3f099 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:23.767881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74c988ee-e357-42f3-808e-89a8c3f3f099 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:24.080105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-74c988ee-e357-42f3-808e-89a8c3f3f099 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:24.093667 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-74c988ee-e357-42f3-808e-89a8c3f3f099 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1268 microversion: 2.1 time: 0.375561 Aug 27 05:14:24.096627 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2200/4401] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:23 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1268 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:24.281929 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c30d6793-bcca-44d6-8894-eb48b2e20b99 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/30fa85c1-1abf-47e9-b01f-b355f37b0f6f" status: 202 len: 0 microversion: 2.1 time: 0.774935 Aug 27 05:14:24.282676 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2202/4402] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:14:23 2022] DELETE /compute/v2.1/os-security-groups/30fa85c1-1abf-47e9-b01f-b355f37b0f6f => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:14:24.292297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c4d71acb-7952-44c4-9331-1d0f0408741b tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Calling method '.version_select at 0x7fb5696d8430>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:24.354315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dfd9e5ca-000f-48d0-8f01-3431312a9661 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:24.355021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dfd9e5ca-000f-48d0-8f01-3431312a9661 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:24.578404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dfd9e5ca-000f-48d0-8f01-3431312a9661 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:24.585533 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dfd9e5ca-000f-48d0-8f01-3431312a9661 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1213 microversion: 2.1 time: 0.235041 Aug 27 05:14:24.594872 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2203/4403] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:24 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1213 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:25.125278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-caa26682-5950-4a83-b051-64af2d85a4a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:25.126130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-caa26682-5950-4a83-b051-64af2d85a4a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:25.145592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa26682-5950-4a83-b051-64af2d85a4a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:25.151388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa26682-5950-4a83-b051-64af2d85a4a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:25.151999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa26682-5950-4a83-b051-64af2d85a4a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:25.152902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa26682-5950-4a83-b051-64af2d85a4a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:25.153654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa26682-5950-4a83-b051-64af2d85a4a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:25.154162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-caa26682-5950-4a83-b051-64af2d85a4a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:25.160789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:25.448342 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c4d71acb-7952-44c4-9331-1d0f0408741b tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/e6603660-f747-40f7-8b89-55a229e818af" status: 202 len: 0 microversion: 2.1 time: 1.160593 Aug 27 05:14:25.449466 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2201/4404] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:14:24 2022] DELETE /compute/v2.1/os-security-groups/e6603660-f747-40f7-8b89-55a229e818af => generated 0 bytes in 1163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:14:25.457637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6da8f259-d538-4a44-b5e9-79a408a160cb tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Calling method '.version_select at 0x7fb5652d04c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:25.832316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-caa26682-5950-4a83-b051-64af2d85a4a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:25.840949 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-caa26682-5950-4a83-b051-64af2d85a4a2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1308 microversion: 2.1 time: 0.721403 Aug 27 05:14:25.843565 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2204/4405] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:25 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1308 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:25.870959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8351e5d9-8e5e-4c02-b3d3-188c95cfff93 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:25.887271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8351e5d9-8e5e-4c02-b3d3-188c95cfff93 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:25.894061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8351e5d9-8e5e-4c02-b3d3-188c95cfff93 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:25.894766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8351e5d9-8e5e-4c02-b3d3-188c95cfff93 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:25.895508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8351e5d9-8e5e-4c02-b3d3-188c95cfff93 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:25.896454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8351e5d9-8e5e-4c02-b3d3-188c95cfff93 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:25.897262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8351e5d9-8e5e-4c02-b3d3-188c95cfff93 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:25.897847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8351e5d9-8e5e-4c02-b3d3-188c95cfff93 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:26.039512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8351e5d9-8e5e-4c02-b3d3-188c95cfff93 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:26.055978 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8351e5d9-8e5e-4c02-b3d3-188c95cfff93 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1271 microversion: 2.1 time: 0.198131 Aug 27 05:14:26.056588 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2205/4406] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:25 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:26.158290 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6da8f259-d538-4a44-b5e9-79a408a160cb tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/f6532d8d-f963-4848-b2fd-3fa6d38fd7e3" status: 202 len: 0 microversion: 2.1 time: 0.704904 Aug 27 05:14:26.159297 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2202/4407] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:14:25 2022] DELETE /compute/v2.1/os-security-groups/f6532d8d-f963-4848-b2fd-3fa6d38fd7e3 => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:14:26.168325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6acdb606-156c-4f2a-a15c-ed6bbbb03f89 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Calling method '.version_select at 0x7fb565962f70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:26.436963 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6acdb606-156c-4f2a-a15c-ed6bbbb03f89 tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ef4535a3-26f4-4bde-9d56-cfb22bc0c13e" status: 202 len: 0 microversion: 2.1 time: 0.272844 Aug 27 05:14:26.437948 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2206/4408] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:14:26 2022] DELETE /compute/v2.1/os-security-groups/ef4535a3-26f4-4bde-9d56-cfb22bc0c13e => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:14:26.448380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c58709de-5799-4f84-9a85-ff151909299a tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] Calling method '.version_select at 0x7fb564be9af0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:26.718296 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c58709de-5799-4f84-9a85-ff151909299a tempest-SecurityGroupRulesTestJSON-121299440 tempest-SecurityGroupRulesTestJSON-121299440-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/73100c96-66c2-4d34-81d8-71728ba0060d" status: 202 len: 0 microversion: 2.1 time: 0.275558 Aug 27 05:14:26.718887 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2203/4409] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:14:26 2022] DELETE /compute/v2.1/os-security-groups/73100c96-66c2-4d34-81d8-71728ba0060d => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:14:26.869565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-efb40fea-85d8-4130-9fc7-6593da4c0bcc tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:26.870178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-efb40fea-85d8-4130-9fc7-6593da4c0bcc tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:26.876618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb40fea-85d8-4130-9fc7-6593da4c0bcc tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:26.877500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb40fea-85d8-4130-9fc7-6593da4c0bcc tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:26.878316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb40fea-85d8-4130-9fc7-6593da4c0bcc tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:26.879319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb40fea-85d8-4130-9fc7-6593da4c0bcc tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:26.880602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb40fea-85d8-4130-9fc7-6593da4c0bcc tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:26.881631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb40fea-85d8-4130-9fc7-6593da4c0bcc tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:27.081254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d5c4b58a-4c44-49c8-a706-6e43f26e3217 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:27.086120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d5c4b58a-4c44-49c8-a706-6e43f26e3217 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:27.094928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=50 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:27.097087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5c4b58a-4c44-49c8-a706-6e43f26e3217 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:27.098072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5c4b58a-4c44-49c8-a706-6e43f26e3217 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:27.098901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5c4b58a-4c44-49c8-a706-6e43f26e3217 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:27.100760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5c4b58a-4c44-49c8-a706-6e43f26e3217 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:27.101790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5c4b58a-4c44-49c8-a706-6e43f26e3217 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:27.102631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5c4b58a-4c44-49c8-a706-6e43f26e3217 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:27.109912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-efb40fea-85d8-4130-9fc7-6593da4c0bcc tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:27.138617 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-efb40fea-85d8-4130-9fc7-6593da4c0bcc tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1308 microversion: 2.1 time: 0.269250 Aug 27 05:14:27.155489 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2207/4410] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:26 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:27.211067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5c4b58a-4c44-49c8-a706-6e43f26e3217 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:27.221573 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d5c4b58a-4c44-49c8-a706-6e43f26e3217 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1271 microversion: 2.1 time: 0.145438 Aug 27 05:14:27.222736 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2204/4411] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:27 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:27.729135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7c768a5f-cc4e-4851-88da-9b0771992b85 req-455093a8-0d12-4de9-9e84-44b63d6079ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83048b85-98f0-4a17-903d-89196b965312", "tag": "353c0667-5778-4fab-afbd-69a24561dae3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:27.761531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7c768a5f-cc4e-4851-88da-9b0771992b85 req-455093a8-0d12-4de9-9e84-44b63d6079ab service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:27.766268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7c768a5f-cc4e-4851-88da-9b0771992b85 req-455093a8-0d12-4de9-9e84-44b63d6079ab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:27.766953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7c768a5f-cc4e-4851-88da-9b0771992b85 req-455093a8-0d12-4de9-9e84-44b63d6079ab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:27.798225 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7c768a5f-cc4e-4851-88da-9b0771992b85 req-455093a8-0d12-4de9-9e84-44b63d6079ab service nova] Creating event network-changed:353c0667-5778-4fab-afbd-69a24561dae3 for instance 83048b85-98f0-4a17-903d-89196b965312 on n-h1-820368-35 Aug 27 05:14:27.812905 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7c768a5f-cc4e-4851-88da-9b0771992b85 req-455093a8-0d12-4de9-9e84-44b63d6079ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089736 Aug 27 05:14:27.815941 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2208/4412] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:28.163807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-068665e9-f5e3-4a2d-a3c7-49151addf3d0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:28.165601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-068665e9-f5e3-4a2d-a3c7-49151addf3d0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:28.173359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068665e9-f5e3-4a2d-a3c7-49151addf3d0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:28.174056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068665e9-f5e3-4a2d-a3c7-49151addf3d0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:28.174281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068665e9-f5e3-4a2d-a3c7-49151addf3d0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:28.176022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068665e9-f5e3-4a2d-a3c7-49151addf3d0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:28.176022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068665e9-f5e3-4a2d-a3c7-49151addf3d0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:28.176219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-068665e9-f5e3-4a2d-a3c7-49151addf3d0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:28.247541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-50dd5a35-913d-41e7-b99c-bc4b4278ef69 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:28.248267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-50dd5a35-913d-41e7-b99c-bc4b4278ef69 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:28.258034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dd5a35-913d-41e7-b99c-bc4b4278ef69 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:28.260226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dd5a35-913d-41e7-b99c-bc4b4278ef69 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:28.260987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dd5a35-913d-41e7-b99c-bc4b4278ef69 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:28.262720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dd5a35-913d-41e7-b99c-bc4b4278ef69 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:28.263519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dd5a35-913d-41e7-b99c-bc4b4278ef69 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:28.264339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50dd5a35-913d-41e7-b99c-bc4b4278ef69 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:28.545287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-068665e9-f5e3-4a2d-a3c7-49151addf3d0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:28.555799 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-068665e9-f5e3-4a2d-a3c7-49151addf3d0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1308 microversion: 2.1 time: 0.396369 Aug 27 05:14:28.556504 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2205/4413] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:28 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:28.642533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-50dd5a35-913d-41e7-b99c-bc4b4278ef69 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:28.663920 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-50dd5a35-913d-41e7-b99c-bc4b4278ef69 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1313 microversion: 2.1 time: 0.420200 Aug 27 05:14:28.672581 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2209/4414] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:28 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:29.579920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a6af929-3452-47d7-830c-ffec8dae3f36 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:29.580751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0a6af929-3452-47d7-830c-ffec8dae3f36 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:29.600489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6af929-3452-47d7-830c-ffec8dae3f36 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:29.603326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6af929-3452-47d7-830c-ffec8dae3f36 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:29.604453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6af929-3452-47d7-830c-ffec8dae3f36 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:29.610541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6af929-3452-47d7-830c-ffec8dae3f36 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:29.611817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6af929-3452-47d7-830c-ffec8dae3f36 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:29.615194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a6af929-3452-47d7-830c-ffec8dae3f36 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:29.689225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9035d98-ae35-4c34-ac64-5aa1a38c873f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:29.691105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9035d98-ae35-4c34-ac64-5aa1a38c873f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:29.707072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9035d98-ae35-4c34-ac64-5aa1a38c873f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:29.708077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9035d98-ae35-4c34-ac64-5aa1a38c873f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:29.709044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9035d98-ae35-4c34-ac64-5aa1a38c873f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:29.712234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9035d98-ae35-4c34-ac64-5aa1a38c873f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:29.713406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9035d98-ae35-4c34-ac64-5aa1a38c873f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:29.714182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9035d98-ae35-4c34-ac64-5aa1a38c873f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:30.335154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0a6af929-3452-47d7-830c-ffec8dae3f36 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:30.346210 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a6af929-3452-47d7-830c-ffec8dae3f36 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1308 microversion: 2.1 time: 0.770408 Aug 27 05:14:30.349388 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2206/4415] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:29 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1308 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:30.465453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f9035d98-ae35-4c34-ac64-5aa1a38c873f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:30.478226 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9035d98-ae35-4c34-ac64-5aa1a38c873f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.795213 Aug 27 05:14:30.500026 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2210/4416] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:29 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:30.517158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b09d2fcb-988e-42f3-80b3-b009598d1251 req-0f821767-9a1c-4ceb-8757-1725dc58d2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03424c7-42f3-4ae4-9175-cc7e56cbeeec", "tag": "03e994c5-1805-40cd-83a2-3622264ef2eb"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:30.539846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b09d2fcb-988e-42f3-80b3-b009598d1251 req-0f821767-9a1c-4ceb-8757-1725dc58d2bc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:30.541149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b09d2fcb-988e-42f3-80b3-b009598d1251 req-0f821767-9a1c-4ceb-8757-1725dc58d2bc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:30.555191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b09d2fcb-988e-42f3-80b3-b009598d1251 req-0f821767-9a1c-4ceb-8757-1725dc58d2bc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:30.580758 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b09d2fcb-988e-42f3-80b3-b009598d1251 req-0f821767-9a1c-4ceb-8757-1725dc58d2bc service nova] Creating event network-changed:03e994c5-1805-40cd-83a2-3622264ef2eb for instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec on n-h2-820368-35 Aug 27 05:14:30.588915 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b09d2fcb-988e-42f3-80b3-b009598d1251 req-0f821767-9a1c-4ceb-8757-1725dc58d2bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082141 Aug 27 05:14:30.590751 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2207/4417] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:31.373046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3be8d831-eeef-49bd-8d0c-2132eee43544 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:31.374290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3be8d831-eeef-49bd-8d0c-2132eee43544 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:31.380899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:31.395960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be8d831-eeef-49bd-8d0c-2132eee43544 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:31.396605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be8d831-eeef-49bd-8d0c-2132eee43544 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:31.397167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be8d831-eeef-49bd-8d0c-2132eee43544 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:31.400708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be8d831-eeef-49bd-8d0c-2132eee43544 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:31.402766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be8d831-eeef-49bd-8d0c-2132eee43544 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:31.403779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3be8d831-eeef-49bd-8d0c-2132eee43544 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:31.510155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f2dd0668-cbb6-40ae-946c-8b71c169e536 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:31.510882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f2dd0668-cbb6-40ae-946c-8b71c169e536 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:31.524312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2dd0668-cbb6-40ae-946c-8b71c169e536 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:31.524835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2dd0668-cbb6-40ae-946c-8b71c169e536 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:31.525291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2dd0668-cbb6-40ae-946c-8b71c169e536 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:31.526053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2dd0668-cbb6-40ae-946c-8b71c169e536 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:31.526610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2dd0668-cbb6-40ae-946c-8b71c169e536 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:31.527051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2dd0668-cbb6-40ae-946c-8b71c169e536 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:31.662863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3be8d831-eeef-49bd-8d0c-2132eee43544 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:31.677940 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3be8d831-eeef-49bd-8d0c-2132eee43544 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1308 microversion: 2.1 time: 0.312218 Aug 27 05:14:31.678894 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2211/4418] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:31 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:31.869567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f2dd0668-cbb6-40ae-946c-8b71c169e536 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:31.880691 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f2dd0668-cbb6-40ae-946c-8b71c169e536 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.375565 Aug 27 05:14:31.882163 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2208/4419] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:31 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:32.703384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb2fcbbc-d3e8-4c1a-9294-fe5536de5b76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:32.704707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bb2fcbbc-d3e8-4c1a-9294-fe5536de5b76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:32.714334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb2fcbbc-d3e8-4c1a-9294-fe5536de5b76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:32.714537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb2fcbbc-d3e8-4c1a-9294-fe5536de5b76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:32.714854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb2fcbbc-d3e8-4c1a-9294-fe5536de5b76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:32.716653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb2fcbbc-d3e8-4c1a-9294-fe5536de5b76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:32.717310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb2fcbbc-d3e8-4c1a-9294-fe5536de5b76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:32.717931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb2fcbbc-d3e8-4c1a-9294-fe5536de5b76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:32.792361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-db6ca869-6906-4039-856b-bbaca7d6d63f req-8c94016f-1b28-4ba0-8e5f-2f58f53d8326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03424c7-42f3-4ae4-9175-cc7e56cbeeec", "tag": "b2a2758d-2695-4b32-a58c-dbf50660807f"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:32.825907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-db6ca869-6906-4039-856b-bbaca7d6d63f req-8c94016f-1b28-4ba0-8e5f-2f58f53d8326 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:32.826844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-db6ca869-6906-4039-856b-bbaca7d6d63f req-8c94016f-1b28-4ba0-8e5f-2f58f53d8326 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:32.827212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-db6ca869-6906-4039-856b-bbaca7d6d63f req-8c94016f-1b28-4ba0-8e5f-2f58f53d8326 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:32.853308 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-db6ca869-6906-4039-856b-bbaca7d6d63f req-8c94016f-1b28-4ba0-8e5f-2f58f53d8326 service nova] Creating event network-changed:b2a2758d-2695-4b32-a58c-dbf50660807f for instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec on n-h2-820368-35 Aug 27 05:14:32.867041 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-db6ca869-6906-4039-856b-bbaca7d6d63f req-8c94016f-1b28-4ba0-8e5f-2f58f53d8326 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079038 Aug 27 05:14:32.867964 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2209/4420] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:32.904020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-007ba8ed-5f73-4231-b76b-758f13192471 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:32.905368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-007ba8ed-5f73-4231-b76b-758f13192471 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:32.914973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-007ba8ed-5f73-4231-b76b-758f13192471 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:32.917358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-007ba8ed-5f73-4231-b76b-758f13192471 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:32.921513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-007ba8ed-5f73-4231-b76b-758f13192471 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:32.922455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-007ba8ed-5f73-4231-b76b-758f13192471 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:32.924005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-007ba8ed-5f73-4231-b76b-758f13192471 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:32.924608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-007ba8ed-5f73-4231-b76b-758f13192471 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:32.972824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:33.089813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb2fcbbc-d3e8-4c1a-9294-fe5536de5b76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:33.098233 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb2fcbbc-d3e8-4c1a-9294-fe5536de5b76 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1308 microversion: 2.1 time: 0.400478 Aug 27 05:14:33.112306 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2212/4421] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:32 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1308 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:33.255299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ed12a790-590a-4ecc-a1da-3609f09e4585 req-4cc95711-31ea-4753-9983-a2af25d98e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83048b85-98f0-4a17-903d-89196b965312", "name": "network-vif-plugged", "status": "completed", "tag": "353c0667-5778-4fab-afbd-69a24561dae3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:33.297040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ed12a790-590a-4ecc-a1da-3609f09e4585 req-4cc95711-31ea-4753-9983-a2af25d98e01 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:33.297549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ed12a790-590a-4ecc-a1da-3609f09e4585 req-4cc95711-31ea-4753-9983-a2af25d98e01 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:33.297979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ed12a790-590a-4ecc-a1da-3609f09e4585 req-4cc95711-31ea-4753-9983-a2af25d98e01 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:33.299629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-007ba8ed-5f73-4231-b76b-758f13192471 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:33.314846 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-007ba8ed-5f73-4231-b76b-758f13192471 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.415557 Aug 27 05:14:33.315798 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2210/4422] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:32 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:33.317796 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ed12a790-590a-4ecc-a1da-3609f09e4585 req-4cc95711-31ea-4753-9983-a2af25d98e01 service nova] Creating event network-vif-plugged:353c0667-5778-4fab-afbd-69a24561dae3 for instance 83048b85-98f0-4a17-903d-89196b965312 on n-h1-820368-35 Aug 27 05:14:33.338255 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ed12a790-590a-4ecc-a1da-3609f09e4585 req-4cc95711-31ea-4753-9983-a2af25d98e01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088583 Aug 27 05:14:33.345055 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2213/4423] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:14:34.120593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10388d5e-a161-4aa2-a75b-e483c9419c82 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:34.122016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-10388d5e-a161-4aa2-a75b-e483c9419c82 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:34.128361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:34.131405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10388d5e-a161-4aa2-a75b-e483c9419c82 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:34.132272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10388d5e-a161-4aa2-a75b-e483c9419c82 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:34.132923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10388d5e-a161-4aa2-a75b-e483c9419c82 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:34.133838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10388d5e-a161-4aa2-a75b-e483c9419c82 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:34.134768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10388d5e-a161-4aa2-a75b-e483c9419c82 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:34.135658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10388d5e-a161-4aa2-a75b-e483c9419c82 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:34.338996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2742b687-28e0-4348-a09a-73586998696b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:34.340393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2742b687-28e0-4348-a09a-73586998696b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:34.347211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2742b687-28e0-4348-a09a-73586998696b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:34.347710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2742b687-28e0-4348-a09a-73586998696b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:34.348210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2742b687-28e0-4348-a09a-73586998696b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:34.349439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2742b687-28e0-4348-a09a-73586998696b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:34.349900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2742b687-28e0-4348-a09a-73586998696b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:34.350332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2742b687-28e0-4348-a09a-73586998696b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:34.423374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10388d5e-a161-4aa2-a75b-e483c9419c82 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:34.434606 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10388d5e-a161-4aa2-a75b-e483c9419c82 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1308 microversion: 2.1 time: 0.317950 Aug 27 05:14:34.435598 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2211/4424] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:34 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:34.586110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:34.671333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2742b687-28e0-4348-a09a-73586998696b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:34.685403 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2742b687-28e0-4348-a09a-73586998696b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.351639 Aug 27 05:14:34.687452 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2214/4425] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:34 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:34.897577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-cf8cb4cc-c337-42ee-8ff8-22907792c13c req-7d5b21a8-ec61-4d08-8347-86ec4a63b90e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03424c7-42f3-4ae4-9175-cc7e56cbeeec", "tag": "b37f5080-12c5-4ffb-af46-8d330263c243"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:34.909774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cf8cb4cc-c337-42ee-8ff8-22907792c13c req-7d5b21a8-ec61-4d08-8347-86ec4a63b90e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:34.910505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cf8cb4cc-c337-42ee-8ff8-22907792c13c req-7d5b21a8-ec61-4d08-8347-86ec4a63b90e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:34.911900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cf8cb4cc-c337-42ee-8ff8-22907792c13c req-7d5b21a8-ec61-4d08-8347-86ec4a63b90e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:34.925025 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-cf8cb4cc-c337-42ee-8ff8-22907792c13c req-7d5b21a8-ec61-4d08-8347-86ec4a63b90e service nova] Creating event network-changed:b37f5080-12c5-4ffb-af46-8d330263c243 for instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec on n-h2-820368-35 Aug 27 05:14:34.931255 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-cf8cb4cc-c337-42ee-8ff8-22907792c13c req-7d5b21a8-ec61-4d08-8347-86ec4a63b90e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040438 Aug 27 05:14:34.932305 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2212/4426] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:14:35.457584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-555740f1-d72b-4a01-b766-8db1ec4f15d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:35.459511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-555740f1-d72b-4a01-b766-8db1ec4f15d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:35.470715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555740f1-d72b-4a01-b766-8db1ec4f15d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:35.471381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555740f1-d72b-4a01-b766-8db1ec4f15d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:35.471981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555740f1-d72b-4a01-b766-8db1ec4f15d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:35.487449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555740f1-d72b-4a01-b766-8db1ec4f15d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:35.490734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555740f1-d72b-4a01-b766-8db1ec4f15d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:35.491237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555740f1-d72b-4a01-b766-8db1ec4f15d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:35.692695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-555740f1-d72b-4a01-b766-8db1ec4f15d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:35.701258 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-555740f1-d72b-4a01-b766-8db1ec4f15d3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1489 microversion: 2.1 time: 0.248206 Aug 27 05:14:35.701982 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2215/4427] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:35 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1489 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:35.716495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d73f13df-43b4-4bc9-908c-e1a1e6ddbfe3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:35.718846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d73f13df-43b4-4bc9-908c-e1a1e6ddbfe3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:35.726179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a60c7eaf-fe4a-4790-b9cf-e71298cdd655 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-831934991"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:35.729164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a60c7eaf-fe4a-4790-b9cf-e71298cdd655 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:35.736148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d73f13df-43b4-4bc9-908c-e1a1e6ddbfe3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:35.736584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a60c7eaf-fe4a-4790-b9cf-e71298cdd655 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:35.736811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d73f13df-43b4-4bc9-908c-e1a1e6ddbfe3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:35.737253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a60c7eaf-fe4a-4790-b9cf-e71298cdd655 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:35.737598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d73f13df-43b4-4bc9-908c-e1a1e6ddbfe3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:35.737718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a60c7eaf-fe4a-4790-b9cf-e71298cdd655 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:35.738393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a60c7eaf-fe4a-4790-b9cf-e71298cdd655 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:35.739411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a60c7eaf-fe4a-4790-b9cf-e71298cdd655 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:35.739834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d73f13df-43b4-4bc9-908c-e1a1e6ddbfe3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:35.740390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d73f13df-43b4-4bc9-908c-e1a1e6ddbfe3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:35.741315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d73f13df-43b4-4bc9-908c-e1a1e6ddbfe3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:35.746279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a60c7eaf-fe4a-4790-b9cf-e71298cdd655 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:35.841072 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a60c7eaf-fe4a-4790-b9cf-e71298cdd655 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "PUT /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1074 microversion: 2.1 time: 0.119166 Aug 27 05:14:35.841832 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2216/4428] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:14:35 2022] PUT /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1074 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:35.858528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-745d10b5-7b59-438f-90cd-96e4b8a62120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:35.859248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-745d10b5-7b59-438f-90cd-96e4b8a62120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:35.865776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-745d10b5-7b59-438f-90cd-96e4b8a62120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:35.866269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-745d10b5-7b59-438f-90cd-96e4b8a62120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:35.866708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-745d10b5-7b59-438f-90cd-96e4b8a62120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:35.867459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-745d10b5-7b59-438f-90cd-96e4b8a62120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:35.867920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-745d10b5-7b59-438f-90cd-96e4b8a62120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:35.868358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-745d10b5-7b59-438f-90cd-96e4b8a62120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:36.155762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d73f13df-43b4-4bc9-908c-e1a1e6ddbfe3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:36.172662 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d73f13df-43b4-4bc9-908c-e1a1e6ddbfe3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.463316 Aug 27 05:14:36.174180 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2213/4429] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:35 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:36.182078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-745d10b5-7b59-438f-90cd-96e4b8a62120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:36.195642 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-745d10b5-7b59-438f-90cd-96e4b8a62120 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1500 microversion: 2.1 time: 0.340682 Aug 27 05:14:36.196357 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2217/4430] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:35 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1500 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:36.215377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-561d3107-a05a-4b67-852b-53bf4eefdaea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:36.216273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-561d3107-a05a-4b67-852b-53bf4eefdaea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:36.222442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561d3107-a05a-4b67-852b-53bf4eefdaea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:36.223654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561d3107-a05a-4b67-852b-53bf4eefdaea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:36.224257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561d3107-a05a-4b67-852b-53bf4eefdaea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:36.225173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561d3107-a05a-4b67-852b-53bf4eefdaea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:36.225818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561d3107-a05a-4b67-852b-53bf4eefdaea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:36.226244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-561d3107-a05a-4b67-852b-53bf4eefdaea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:36.448292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-561d3107-a05a-4b67-852b-53bf4eefdaea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:36.463011 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-561d3107-a05a-4b67-852b-53bf4eefdaea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1500 microversion: 2.1 time: 0.251487 Aug 27 05:14:36.464937 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2214/4431] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:36 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1500 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:36.487069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6e126198-529d-414f-94f4-feded8215430 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:36.494702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e126198-529d-414f-94f4-feded8215430 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:36.495687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e126198-529d-414f-94f4-feded8215430 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:36.496331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e126198-529d-414f-94f4-feded8215430 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:36.525288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6e126198-529d-414f-94f4-feded8215430 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Going to try to stop instance {{(pid=128547) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:14:36.592857 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6e126198-529d-414f-94f4-feded8215430 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "POST /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312/action" status: 202 len: 0 microversion: 2.1 time: 0.108718 Aug 27 05:14:36.595734 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2218/4432] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:14:36 2022] POST /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:14:36.610131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01e94529-e63b-4ba2-8094-bf1dc2fa2f9c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:36.611106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-01e94529-e63b-4ba2-8094-bf1dc2fa2f9c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:36.622767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01e94529-e63b-4ba2-8094-bf1dc2fa2f9c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:36.623645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01e94529-e63b-4ba2-8094-bf1dc2fa2f9c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:36.625437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01e94529-e63b-4ba2-8094-bf1dc2fa2f9c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:36.626760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01e94529-e63b-4ba2-8094-bf1dc2fa2f9c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:36.628132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01e94529-e63b-4ba2-8094-bf1dc2fa2f9c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:36.628886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01e94529-e63b-4ba2-8094-bf1dc2fa2f9c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:37.066952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-01e94529-e63b-4ba2-8094-bf1dc2fa2f9c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:37.078420 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01e94529-e63b-4ba2-8094-bf1dc2fa2f9c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.477968 Aug 27 05:14:37.081247 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2215/4433] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:36 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:37.197139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-780d970e-97b9-435f-af42-a11f5aa614d1 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:37.198028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-780d970e-97b9-435f-af42-a11f5aa614d1 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:37.210549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-780d970e-97b9-435f-af42-a11f5aa614d1 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:37.211056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-780d970e-97b9-435f-af42-a11f5aa614d1 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:37.211529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-780d970e-97b9-435f-af42-a11f5aa614d1 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:37.212262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-780d970e-97b9-435f-af42-a11f5aa614d1 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:37.212719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-780d970e-97b9-435f-af42-a11f5aa614d1 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:37.213153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-780d970e-97b9-435f-af42-a11f5aa614d1 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:37.994536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-780d970e-97b9-435f-af42-a11f5aa614d1 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:38.010246 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-780d970e-97b9-435f-af42-a11f5aa614d1 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.817035 Aug 27 05:14:38.012784 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2219/4434] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:37 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:38.102516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e0c49946-8833-4c1e-a7c8-6c31a84aff5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:38.104063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e0c49946-8833-4c1e-a7c8-6c31a84aff5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:38.111472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0c49946-8833-4c1e-a7c8-6c31a84aff5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:38.112201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0c49946-8833-4c1e-a7c8-6c31a84aff5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:38.112917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0c49946-8833-4c1e-a7c8-6c31a84aff5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:38.113993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0c49946-8833-4c1e-a7c8-6c31a84aff5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:38.114685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0c49946-8833-4c1e-a7c8-6c31a84aff5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:38.115295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0c49946-8833-4c1e-a7c8-6c31a84aff5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:38.372078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e0c49946-8833-4c1e-a7c8-6c31a84aff5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:38.385356 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e0c49946-8833-4c1e-a7c8-6c31a84aff5e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.287340 Aug 27 05:14:38.386542 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2216/4435] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:38 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:39.033754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9be94b64-6edb-4d9b-a36a-7435387ee052 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:39.034381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9be94b64-6edb-4d9b-a36a-7435387ee052 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:39.043345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9be94b64-6edb-4d9b-a36a-7435387ee052 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:39.044158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9be94b64-6edb-4d9b-a36a-7435387ee052 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:39.044770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9be94b64-6edb-4d9b-a36a-7435387ee052 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:39.045703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9be94b64-6edb-4d9b-a36a-7435387ee052 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:39.046169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9be94b64-6edb-4d9b-a36a-7435387ee052 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:39.046605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9be94b64-6edb-4d9b-a36a-7435387ee052 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:39.408553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9be94b64-6edb-4d9b-a36a-7435387ee052 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:39.409405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-47e6e6bf-eab5-45b1-8b47-13c78218acc5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:39.410259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-47e6e6bf-eab5-45b1-8b47-13c78218acc5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:39.436372 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9be94b64-6edb-4d9b-a36a-7435387ee052 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.406337 Aug 27 05:14:39.439970 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2220/4436] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:39 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:39.444270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e6e6bf-eab5-45b1-8b47-13c78218acc5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:39.445025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e6e6bf-eab5-45b1-8b47-13c78218acc5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:39.445547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e6e6bf-eab5-45b1-8b47-13c78218acc5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:39.446475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e6e6bf-eab5-45b1-8b47-13c78218acc5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:39.449188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e6e6bf-eab5-45b1-8b47-13c78218acc5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:39.452194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-47e6e6bf-eab5-45b1-8b47-13c78218acc5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:40.022586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-47e6e6bf-eab5-45b1-8b47-13c78218acc5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:40.037383 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-47e6e6bf-eab5-45b1-8b47-13c78218acc5 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.633665 Aug 27 05:14:40.038311 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2217/4437] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:39 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:40.460242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a035b1e7-3e7d-4cf7-932e-a4baff7d6fb4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:40.460987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a035b1e7-3e7d-4cf7-932e-a4baff7d6fb4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:40.474814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a035b1e7-3e7d-4cf7-932e-a4baff7d6fb4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:40.475406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a035b1e7-3e7d-4cf7-932e-a4baff7d6fb4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:40.475868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a035b1e7-3e7d-4cf7-932e-a4baff7d6fb4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:40.476616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a035b1e7-3e7d-4cf7-932e-a4baff7d6fb4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:40.477085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a035b1e7-3e7d-4cf7-932e-a4baff7d6fb4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:40.477523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a035b1e7-3e7d-4cf7-932e-a4baff7d6fb4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:40.515583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:40.857979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a035b1e7-3e7d-4cf7-932e-a4baff7d6fb4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:40.871318 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a035b1e7-3e7d-4cf7-932e-a4baff7d6fb4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.413659 Aug 27 05:14:40.875889 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2221/4438] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:40 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:41.061457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8447e0b-a424-4eed-b14a-7d6621d0311f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:41.062199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e8447e0b-a424-4eed-b14a-7d6621d0311f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:41.078142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8447e0b-a424-4eed-b14a-7d6621d0311f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:41.080147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8447e0b-a424-4eed-b14a-7d6621d0311f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:41.080723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8447e0b-a424-4eed-b14a-7d6621d0311f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:41.081561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8447e0b-a424-4eed-b14a-7d6621d0311f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:41.083588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8447e0b-a424-4eed-b14a-7d6621d0311f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:41.084132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8447e0b-a424-4eed-b14a-7d6621d0311f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:41.393682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e8447e0b-a424-4eed-b14a-7d6621d0311f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:41.406189 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e8447e0b-a424-4eed-b14a-7d6621d0311f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.352108 Aug 27 05:14:41.408551 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2218/4439] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:41 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:41.896025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fe5122ab-1a30-4964-a773-429e97b8369b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:41.897191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fe5122ab-1a30-4964-a773-429e97b8369b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:41.906173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5122ab-1a30-4964-a773-429e97b8369b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:41.907546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5122ab-1a30-4964-a773-429e97b8369b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:41.908326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5122ab-1a30-4964-a773-429e97b8369b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:41.909732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5122ab-1a30-4964-a773-429e97b8369b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:41.910436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5122ab-1a30-4964-a773-429e97b8369b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:41.912086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5122ab-1a30-4964-a773-429e97b8369b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:42.226711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fe5122ab-1a30-4964-a773-429e97b8369b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:42.237884 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fe5122ab-1a30-4964-a773-429e97b8369b tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.347865 Aug 27 05:14:42.239705 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2222/4440] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:41 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:42.429178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-334dbdd4-d79d-42cf-aafa-5ecfb6f5d44e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:42.429798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-334dbdd4-d79d-42cf-aafa-5ecfb6f5d44e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:42.437075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334dbdd4-d79d-42cf-aafa-5ecfb6f5d44e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:42.437948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334dbdd4-d79d-42cf-aafa-5ecfb6f5d44e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:42.438577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334dbdd4-d79d-42cf-aafa-5ecfb6f5d44e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:42.439466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334dbdd4-d79d-42cf-aafa-5ecfb6f5d44e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:42.440073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334dbdd4-d79d-42cf-aafa-5ecfb6f5d44e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:42.440650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334dbdd4-d79d-42cf-aafa-5ecfb6f5d44e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:42.610710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-334dbdd4-d79d-42cf-aafa-5ecfb6f5d44e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:42.618096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:42.621417 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-334dbdd4-d79d-42cf-aafa-5ecfb6f5d44e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.197182 Aug 27 05:14:42.622556 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2219/4441] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:42 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:42.701031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f01ed0f-115d-41ae-9e84-6662c53fa60a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'create', calling method: .version_select at 0x7fb56953ba60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1295593844", "description": "tempest-description-1011945772"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:42.877798 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f01ed0f-115d-41ae-9e84-6662c53fa60a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.355521 Aug 27 05:14:42.878530 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2223/4442] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:14:42 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:42.893243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c35ee808-5222-46c2-a20e-a77cb7a7c866 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'create', calling method: .version_select at 0x7fb564f739d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2107620759", "description": "tempest-description-2013903264"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:43.050386 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c35ee808-5222-46c2-a20e-a77cb7a7c866 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.162556 Aug 27 05:14:43.052424 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2220/4443] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:14:42 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:43.105011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-899259044", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "951782e2-b687-44c2-a8d0-a05e5ba80574"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:43.176750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] validate_networks() for [('951782e2-b687-44c2-a8d0-a05e5ba80574', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:14:43.265743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5f987393-d1ac-4465-bcc3-74042d2b310e tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:43.266804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5f987393-d1ac-4465-bcc3-74042d2b310e tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:43.278807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f987393-d1ac-4465-bcc3-74042d2b310e tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:43.280260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f987393-d1ac-4465-bcc3-74042d2b310e tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:43.281026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f987393-d1ac-4465-bcc3-74042d2b310e tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:43.282124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f987393-d1ac-4465-bcc3-74042d2b310e tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:43.282749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f987393-d1ac-4465-bcc3-74042d2b310e tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:43.284168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f987393-d1ac-4465-bcc3-74042d2b310e tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:43.645776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5f987393-d1ac-4465-bcc3-74042d2b310e tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:43.655558 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5f987393-d1ac-4465-bcc3-74042d2b310e tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.396195 Aug 27 05:14:43.657780 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2221/4444] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:43 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:43.664796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-268271aa-fc05-41d9-81a5-e71f98e93735 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:43.665553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-268271aa-fc05-41d9-81a5-e71f98e93735 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:43.674689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-268271aa-fc05-41d9-81a5-e71f98e93735 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:43.676026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-268271aa-fc05-41d9-81a5-e71f98e93735 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:43.677434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-268271aa-fc05-41d9-81a5-e71f98e93735 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:43.678761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-268271aa-fc05-41d9-81a5-e71f98e93735 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:43.679719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-268271aa-fc05-41d9-81a5-e71f98e93735 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:43.680994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-268271aa-fc05-41d9-81a5-e71f98e93735 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:43.977219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-268271aa-fc05-41d9-81a5-e71f98e93735 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:43.991155 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-268271aa-fc05-41d9-81a5-e71f98e93735 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.330937 Aug 27 05:14:43.992096 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2222/4445] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:43 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:44.064636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:14:44.065138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:14:44.065713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:14:44.066376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:14:44.066908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:14:44.076683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:44.077291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:44.077946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:44.078673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:44.079318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:44.079744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:44.098563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Getting quotas for project d9240388d4fa4d02adec50746d5a95d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:14:44.105781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Getting quotas for user ee93433499ee4ccd9644173eb2e1a4ea and project d9240388d4fa4d02adec50746d5a95d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:14:44.124678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:14:44.128459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:14:44.185960 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22519ea8-dd70-43c7-b9c6-4175d0bbbcec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085837 Aug 27 05:14:44.192523 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2224/4446] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:14:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:14:44.199879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9ad157e1-c130-4588-8b36-fe0f4772e40c tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:44.201709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9ad157e1-c130-4588-8b36-fe0f4772e40c tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:44.292721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ad157e1-c130-4588-8b36-fe0f4772e40c tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:44.301648 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9ad157e1-c130-4588-8b36-fe0f4772e40c tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1215 microversion: 2.1 time: 0.107748 Aug 27 05:14:44.303010 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2223/4447] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:44 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:44.678485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f494389-90dd-4c5e-b280-a6a8a708f905 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:44.679197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f494389-90dd-4c5e-b280-a6a8a708f905 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:44.697321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f494389-90dd-4c5e-b280-a6a8a708f905 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:44.698449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f494389-90dd-4c5e-b280-a6a8a708f905 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:44.699297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f494389-90dd-4c5e-b280-a6a8a708f905 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:44.701356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f494389-90dd-4c5e-b280-a6a8a708f905 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:44.702007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f494389-90dd-4c5e-b280-a6a8a708f905 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:44.702625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f494389-90dd-4c5e-b280-a6a8a708f905 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:44.930735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5f494389-90dd-4c5e-b280-a6a8a708f905 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:44.940889 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f494389-90dd-4c5e-b280-a6a8a708f905 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.266798 Aug 27 05:14:44.943684 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2225/4448] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:44 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:45.014326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7b4ae910-f1c7-4eed-8ade-ff60b7d9f91c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:45.015783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7b4ae910-f1c7-4eed-8ade-ff60b7d9f91c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:45.025143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b4ae910-f1c7-4eed-8ade-ff60b7d9f91c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:45.026392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b4ae910-f1c7-4eed-8ade-ff60b7d9f91c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:45.027214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b4ae910-f1c7-4eed-8ade-ff60b7d9f91c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:45.033909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b4ae910-f1c7-4eed-8ade-ff60b7d9f91c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:45.034675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b4ae910-f1c7-4eed-8ade-ff60b7d9f91c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:45.035940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b4ae910-f1c7-4eed-8ade-ff60b7d9f91c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:45.237568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7b4ae910-f1c7-4eed-8ade-ff60b7d9f91c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:45.249940 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7b4ae910-f1c7-4eed-8ade-ff60b7d9f91c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.241213 Aug 27 05:14:45.260364 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2224/4449] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:45 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:45.305206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-eec9daf0-b4a4-4758-b6d5-024dbf73a6a2 req-13658aab-0ad1-4587-a3d7-24cdfb93b7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03424c7-42f3-4ae4-9175-cc7e56cbeeec", "name": "network-vif-plugged", "status": "completed", "tag": "03e994c5-1805-40cd-83a2-3622264ef2eb"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:45.326886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-269c9e1d-cfd0-4014-b83a-40ad05e6641a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:45.327629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-269c9e1d-cfd0-4014-b83a-40ad05e6641a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:45.331483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-eec9daf0-b4a4-4758-b6d5-024dbf73a6a2 req-13658aab-0ad1-4587-a3d7-24cdfb93b7c1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:45.332845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-eec9daf0-b4a4-4758-b6d5-024dbf73a6a2 req-13658aab-0ad1-4587-a3d7-24cdfb93b7c1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:45.334966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-eec9daf0-b4a4-4758-b6d5-024dbf73a6a2 req-13658aab-0ad1-4587-a3d7-24cdfb93b7c1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:45.343613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-269c9e1d-cfd0-4014-b83a-40ad05e6641a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:45.344276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-269c9e1d-cfd0-4014-b83a-40ad05e6641a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:45.351452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-269c9e1d-cfd0-4014-b83a-40ad05e6641a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:45.353027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-269c9e1d-cfd0-4014-b83a-40ad05e6641a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:45.354896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-269c9e1d-cfd0-4014-b83a-40ad05e6641a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:45.355835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-269c9e1d-cfd0-4014-b83a-40ad05e6641a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:45.358762 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-eec9daf0-b4a4-4758-b6d5-024dbf73a6a2 req-13658aab-0ad1-4587-a3d7-24cdfb93b7c1 service nova] Creating event network-vif-plugged:03e994c5-1805-40cd-83a2-3622264ef2eb for instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec on n-h2-820368-35 Aug 27 05:14:45.381665 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-eec9daf0-b4a4-4758-b6d5-024dbf73a6a2 req-13658aab-0ad1-4587-a3d7-24cdfb93b7c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078278 Aug 27 05:14:45.384585 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2226/4450] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:45.472463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-269c9e1d-cfd0-4014-b83a-40ad05e6641a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:45.482728 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-269c9e1d-cfd0-4014-b83a-40ad05e6641a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1267 microversion: 2.1 time: 0.163834 Aug 27 05:14:45.497441 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2225/4451] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:45 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:45.966918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-270d7f3d-c41e-456e-ba75-61e19de65740 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:45.967615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-270d7f3d-c41e-456e-ba75-61e19de65740 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:45.976877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-270d7f3d-c41e-456e-ba75-61e19de65740 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:45.977730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-270d7f3d-c41e-456e-ba75-61e19de65740 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:45.978347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-270d7f3d-c41e-456e-ba75-61e19de65740 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:45.979508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-270d7f3d-c41e-456e-ba75-61e19de65740 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:45.980195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-270d7f3d-c41e-456e-ba75-61e19de65740 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:45.980928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-270d7f3d-c41e-456e-ba75-61e19de65740 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:46.153386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-270d7f3d-c41e-456e-ba75-61e19de65740 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:46.162484 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-270d7f3d-c41e-456e-ba75-61e19de65740 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.201072 Aug 27 05:14:46.176873 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2227/4452] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:45 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:46.276701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-68df06a6-5167-4643-ba0e-e037a0270714 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:46.278357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68df06a6-5167-4643-ba0e-e037a0270714 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:46.295865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68df06a6-5167-4643-ba0e-e037a0270714 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:46.296364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68df06a6-5167-4643-ba0e-e037a0270714 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:46.296800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68df06a6-5167-4643-ba0e-e037a0270714 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:46.297565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68df06a6-5167-4643-ba0e-e037a0270714 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:46.300935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68df06a6-5167-4643-ba0e-e037a0270714 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:46.301502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68df06a6-5167-4643-ba0e-e037a0270714 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:46.508080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-763b7110-70c6-44f8-92df-aa387040f92d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:46.510112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-763b7110-70c6-44f8-92df-aa387040f92d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:46.518608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-763b7110-70c6-44f8-92df-aa387040f92d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:46.519557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-763b7110-70c6-44f8-92df-aa387040f92d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:46.520670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-763b7110-70c6-44f8-92df-aa387040f92d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:46.521760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-763b7110-70c6-44f8-92df-aa387040f92d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:46.522559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-763b7110-70c6-44f8-92df-aa387040f92d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:46.523259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-763b7110-70c6-44f8-92df-aa387040f92d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:46.903633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-763b7110-70c6-44f8-92df-aa387040f92d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:46.922123 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-763b7110-70c6-44f8-92df-aa387040f92d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1273 microversion: 2.1 time: 0.420485 Aug 27 05:14:46.938020 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2228/4453] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:46 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1273 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:46.965280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-68df06a6-5167-4643-ba0e-e037a0270714 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:46.974764 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-68df06a6-5167-4643-ba0e-e037a0270714 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.705827 Aug 27 05:14:46.975414 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2226/4454] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:46 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:47.188143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f3fbeda9-ed0a-4425-8f5e-0ff036d22682 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:47.188772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f3fbeda9-ed0a-4425-8f5e-0ff036d22682 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:47.196689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fbeda9-ed0a-4425-8f5e-0ff036d22682 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:47.198102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fbeda9-ed0a-4425-8f5e-0ff036d22682 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:47.198871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fbeda9-ed0a-4425-8f5e-0ff036d22682 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:47.199869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fbeda9-ed0a-4425-8f5e-0ff036d22682 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:47.200573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fbeda9-ed0a-4425-8f5e-0ff036d22682 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:47.201102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3fbeda9-ed0a-4425-8f5e-0ff036d22682 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:47.408333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f3fbeda9-ed0a-4425-8f5e-0ff036d22682 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:47.417561 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f3fbeda9-ed0a-4425-8f5e-0ff036d22682 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.235468 Aug 27 05:14:47.418156 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2229/4455] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:47 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:47.439675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-afd6496c-7878-4bdc-8bb5-d8dc046a1836 req-986533b5-de5f-474a-8d54-ee5f2e35d259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03424c7-42f3-4ae4-9175-cc7e56cbeeec", "name": "network-vif-plugged", "status": "completed", "tag": "b2a2758d-2695-4b32-a58c-dbf50660807f"}, {"server_uuid": "f03424c7-42f3-4ae4-9175-cc7e56cbeeec", "name": "network-vif-plugged", "status": "completed", "tag": "b37f5080-12c5-4ffb-af46-8d330263c243"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:47.454027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-afd6496c-7878-4bdc-8bb5-d8dc046a1836 req-986533b5-de5f-474a-8d54-ee5f2e35d259 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:47.454926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-afd6496c-7878-4bdc-8bb5-d8dc046a1836 req-986533b5-de5f-474a-8d54-ee5f2e35d259 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:47.455551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-afd6496c-7878-4bdc-8bb5-d8dc046a1836 req-986533b5-de5f-474a-8d54-ee5f2e35d259 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:47.470431 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-afd6496c-7878-4bdc-8bb5-d8dc046a1836 req-986533b5-de5f-474a-8d54-ee5f2e35d259 service nova] Creating event network-vif-plugged:b2a2758d-2695-4b32-a58c-dbf50660807f for instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec on n-h2-820368-35 Aug 27 05:14:47.471210 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-afd6496c-7878-4bdc-8bb5-d8dc046a1836 req-986533b5-de5f-474a-8d54-ee5f2e35d259 service nova] Creating event network-vif-plugged:b37f5080-12c5-4ffb-af46-8d330263c243 for instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec on n-h2-820368-35 Aug 27 05:14:47.477597 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-afd6496c-7878-4bdc-8bb5-d8dc046a1836 req-986533b5-de5f-474a-8d54-ee5f2e35d259 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041902 Aug 27 05:14:47.478818 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2227/4456] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:47.948248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a948dc36-49bc-437b-9e06-898975da88d1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:47.949033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a948dc36-49bc-437b-9e06-898975da88d1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:47.956577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a948dc36-49bc-437b-9e06-898975da88d1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:47.957892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a948dc36-49bc-437b-9e06-898975da88d1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:47.958416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a948dc36-49bc-437b-9e06-898975da88d1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:47.959240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a948dc36-49bc-437b-9e06-898975da88d1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:47.959768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a948dc36-49bc-437b-9e06-898975da88d1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:47.960378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a948dc36-49bc-437b-9e06-898975da88d1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:47.999627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eafb9d08-c4f6-4778-92b7-079e5f685bf7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:48.000345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eafb9d08-c4f6-4778-92b7-079e5f685bf7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:48.007915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eafb9d08-c4f6-4778-92b7-079e5f685bf7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:48.009201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eafb9d08-c4f6-4778-92b7-079e5f685bf7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:48.010270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eafb9d08-c4f6-4778-92b7-079e5f685bf7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:48.010643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eafb9d08-c4f6-4778-92b7-079e5f685bf7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:48.011126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eafb9d08-c4f6-4778-92b7-079e5f685bf7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:48.012022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eafb9d08-c4f6-4778-92b7-079e5f685bf7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:48.201922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a948dc36-49bc-437b-9e06-898975da88d1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:48.219168 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a948dc36-49bc-437b-9e06-898975da88d1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1315 microversion: 2.1 time: 0.274989 Aug 27 05:14:48.220960 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2230/4457] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:47 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:48.241072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eafb9d08-c4f6-4778-92b7-079e5f685bf7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:48.250197 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eafb9d08-c4f6-4778-92b7-079e5f685bf7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.254761 Aug 27 05:14:48.250788 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2228/4458] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:47 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:48.444292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-52f20121-cb6d-4d56-88db-a06a79ff2323 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:48.444941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-52f20121-cb6d-4d56-88db-a06a79ff2323 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:48.451251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52f20121-cb6d-4d56-88db-a06a79ff2323 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:48.451957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52f20121-cb6d-4d56-88db-a06a79ff2323 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:48.452396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52f20121-cb6d-4d56-88db-a06a79ff2323 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:48.453286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52f20121-cb6d-4d56-88db-a06a79ff2323 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:48.454654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52f20121-cb6d-4d56-88db-a06a79ff2323 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:48.454654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52f20121-cb6d-4d56-88db-a06a79ff2323 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:48.621714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-52f20121-cb6d-4d56-88db-a06a79ff2323 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:48.632500 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-52f20121-cb6d-4d56-88db-a06a79ff2323 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.192839 Aug 27 05:14:48.633277 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2231/4459] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:48 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:48.963481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-dbf37908-845e-477d-915f-a91b66e4de3d req-af3c1a65-4f8d-4085-97ca-710a7417268d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12268895-61a7-4826-895a-6e8ead0a1635", "tag": "bafcaedc-bcc2-439a-b01c-9b80d27c8f47"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:48.975446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dbf37908-845e-477d-915f-a91b66e4de3d req-af3c1a65-4f8d-4085-97ca-710a7417268d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:48.976207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dbf37908-845e-477d-915f-a91b66e4de3d req-af3c1a65-4f8d-4085-97ca-710a7417268d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:48.976807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dbf37908-845e-477d-915f-a91b66e4de3d req-af3c1a65-4f8d-4085-97ca-710a7417268d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:48.991351 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-dbf37908-845e-477d-915f-a91b66e4de3d req-af3c1a65-4f8d-4085-97ca-710a7417268d service nova] Creating event network-changed:bafcaedc-bcc2-439a-b01c-9b80d27c8f47 for instance 12268895-61a7-4826-895a-6e8ead0a1635 on n-h1-820368-35 Aug 27 05:14:48.997692 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-dbf37908-845e-477d-915f-a91b66e4de3d req-af3c1a65-4f8d-4085-97ca-710a7417268d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037758 Aug 27 05:14:48.998876 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2229/4460] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:49.245192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7482d73a-daa3-4903-8070-ee2b02ffc9ca tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:49.246699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7482d73a-daa3-4903-8070-ee2b02ffc9ca tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:49.256347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7482d73a-daa3-4903-8070-ee2b02ffc9ca tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:49.257140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7482d73a-daa3-4903-8070-ee2b02ffc9ca tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:49.257836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7482d73a-daa3-4903-8070-ee2b02ffc9ca tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:49.258777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7482d73a-daa3-4903-8070-ee2b02ffc9ca tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:49.259749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7482d73a-daa3-4903-8070-ee2b02ffc9ca tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:49.260516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7482d73a-daa3-4903-8070-ee2b02ffc9ca tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:49.273903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8743091b-e63f-4a12-a248-5f4bc52251a6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:49.275023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8743091b-e63f-4a12-a248-5f4bc52251a6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:49.282386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8743091b-e63f-4a12-a248-5f4bc52251a6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:49.283478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8743091b-e63f-4a12-a248-5f4bc52251a6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:49.284155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8743091b-e63f-4a12-a248-5f4bc52251a6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:49.285994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8743091b-e63f-4a12-a248-5f4bc52251a6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:49.286693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8743091b-e63f-4a12-a248-5f4bc52251a6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:49.287624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8743091b-e63f-4a12-a248-5f4bc52251a6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:49.668252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8743091b-e63f-4a12-a248-5f4bc52251a6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:49.677003 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8743091b-e63f-4a12-a248-5f4bc52251a6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.408306 Aug 27 05:14:49.680793 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2230/4461] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:49 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:49.692577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c7e5c048-9e3d-4729-93be-d4cc2ce3b402 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:49.693597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c7e5c048-9e3d-4729-93be-d4cc2ce3b402 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:49.706733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7e5c048-9e3d-4729-93be-d4cc2ce3b402 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:49.707816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7e5c048-9e3d-4729-93be-d4cc2ce3b402 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:49.708263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7e5c048-9e3d-4729-93be-d4cc2ce3b402 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:49.708979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7e5c048-9e3d-4729-93be-d4cc2ce3b402 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:49.709433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7e5c048-9e3d-4729-93be-d4cc2ce3b402 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:49.709860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7e5c048-9e3d-4729-93be-d4cc2ce3b402 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:49.723420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7482d73a-daa3-4903-8070-ee2b02ffc9ca tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:49.743261 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7482d73a-daa3-4903-8070-ee2b02ffc9ca tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1315 microversion: 2.1 time: 0.505414 Aug 27 05:14:49.743865 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2232/4462] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:49 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:49.994812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c7e5c048-9e3d-4729-93be-d4cc2ce3b402 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:50.007021 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c7e5c048-9e3d-4729-93be-d4cc2ce3b402 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1355 microversion: 2.1 time: 0.324810 Aug 27 05:14:50.009497 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2231/4463] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:49 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1355 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:50.701893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d0c1f0ef-6d3a-4f11-b159-69313609a312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:50.702509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d0c1f0ef-6d3a-4f11-b159-69313609a312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:50.705423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:50.711234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0c1f0ef-6d3a-4f11-b159-69313609a312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:50.711807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0c1f0ef-6d3a-4f11-b159-69313609a312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:50.712320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0c1f0ef-6d3a-4f11-b159-69313609a312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:50.713102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0c1f0ef-6d3a-4f11-b159-69313609a312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:50.713569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0c1f0ef-6d3a-4f11-b159-69313609a312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:50.714112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0c1f0ef-6d3a-4f11-b159-69313609a312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:50.766168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-feb79b4e-8375-4c18-ab16-5f23f2b744b4 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:50.766862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-feb79b4e-8375-4c18-ab16-5f23f2b744b4 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:50.773245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feb79b4e-8375-4c18-ab16-5f23f2b744b4 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:50.773736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feb79b4e-8375-4c18-ab16-5f23f2b744b4 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:50.774182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feb79b4e-8375-4c18-ab16-5f23f2b744b4 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:50.774883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feb79b4e-8375-4c18-ab16-5f23f2b744b4 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:50.775630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feb79b4e-8375-4c18-ab16-5f23f2b744b4 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:50.776223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-feb79b4e-8375-4c18-ab16-5f23f2b744b4 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:50.913204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d0c1f0ef-6d3a-4f11-b159-69313609a312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:50.922935 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d0c1f0ef-6d3a-4f11-b159-69313609a312 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.224970 Aug 27 05:14:50.923568 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2233/4464] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:50 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:50.970002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-feb79b4e-8375-4c18-ab16-5f23f2b744b4 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:50.985387 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-feb79b4e-8375-4c18-ab16-5f23f2b744b4 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1315 microversion: 2.1 time: 0.222960 Aug 27 05:14:50.999457 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2232/4465] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:50 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:51.030042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-90ae18a9-ad16-42c3-9fb9-cac252d382dc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:51.030663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-90ae18a9-ad16-42c3-9fb9-cac252d382dc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:51.036723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90ae18a9-ad16-42c3-9fb9-cac252d382dc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.037215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90ae18a9-ad16-42c3-9fb9-cac252d382dc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.037658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90ae18a9-ad16-42c3-9fb9-cac252d382dc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:51.038353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90ae18a9-ad16-42c3-9fb9-cac252d382dc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.038810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90ae18a9-ad16-42c3-9fb9-cac252d382dc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.039278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90ae18a9-ad16-42c3-9fb9-cac252d382dc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:51.192205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-90ae18a9-ad16-42c3-9fb9-cac252d382dc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:51.202334 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-90ae18a9-ad16-42c3-9fb9-cac252d382dc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1805 microversion: 2.1 time: 0.175943 Aug 27 05:14:51.218840 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2234/4466] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:51 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:51.225548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1546b62-acfd-4278-a573-5df68e1e2d9d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:51.226151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a1546b62-acfd-4278-a573-5df68e1e2d9d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:51.233550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1546b62-acfd-4278-a573-5df68e1e2d9d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.236595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1546b62-acfd-4278-a573-5df68e1e2d9d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.237090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1546b62-acfd-4278-a573-5df68e1e2d9d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:51.238081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1546b62-acfd-4278-a573-5df68e1e2d9d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.239277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1546b62-acfd-4278-a573-5df68e1e2d9d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.239733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1546b62-acfd-4278-a573-5df68e1e2d9d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:51.269152 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a1546b62-acfd-4278-a573-5df68e1e2d9d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec/ips" status: 200 len: 218 microversion: 2.1 time: 0.048009 Aug 27 05:14:51.269876 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2233/4467] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:14:51 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec/ips => generated 218 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:51.285457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2db4b0b8-53cc-4df4-96eb-33c0ea2d272a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:51.285990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2db4b0b8-53cc-4df4-96eb-33c0ea2d272a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:51.294189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db4b0b8-53cc-4df4-96eb-33c0ea2d272a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.294724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db4b0b8-53cc-4df4-96eb-33c0ea2d272a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.295557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db4b0b8-53cc-4df4-96eb-33c0ea2d272a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:51.296617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db4b0b8-53cc-4df4-96eb-33c0ea2d272a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.297348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db4b0b8-53cc-4df4-96eb-33c0ea2d272a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.298292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db4b0b8-53cc-4df4-96eb-33c0ea2d272a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:51.334895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2db4b0b8-53cc-4df4-96eb-33c0ea2d272a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:14:51.472195 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2db4b0b8-53cc-4df4-96eb-33c0ea2d272a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 204 len: 0 microversion: 2.1 time: 0.193270 Aug 27 05:14:51.473764 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2235/4468] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:14:51 2022] DELETE /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:14:51.485390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4eee1d1c-86fe-42eb-8b7e-4f2dcc97644a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:51.486029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4eee1d1c-86fe-42eb-8b7e-4f2dcc97644a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:51.494694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4eee1d1c-86fe-42eb-8b7e-4f2dcc97644a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.495506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4eee1d1c-86fe-42eb-8b7e-4f2dcc97644a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.496261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4eee1d1c-86fe-42eb-8b7e-4f2dcc97644a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:51.497163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4eee1d1c-86fe-42eb-8b7e-4f2dcc97644a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.497926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4eee1d1c-86fe-42eb-8b7e-4f2dcc97644a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.498783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4eee1d1c-86fe-42eb-8b7e-4f2dcc97644a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:51.762688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4eee1d1c-86fe-42eb-8b7e-4f2dcc97644a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:51.770874 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4eee1d1c-86fe-42eb-8b7e-4f2dcc97644a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1811 microversion: 2.1 time: 0.291682 Aug 27 05:14:51.771693 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2234/4469] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:51 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1811 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:51.945732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-747c5acc-e839-44c8-b9c4-9f9d96ae4748 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:51.946453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-747c5acc-e839-44c8-b9c4-9f9d96ae4748 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:51.954667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-747c5acc-e839-44c8-b9c4-9f9d96ae4748 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.955261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-747c5acc-e839-44c8-b9c4-9f9d96ae4748 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.955703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-747c5acc-e839-44c8-b9c4-9f9d96ae4748 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:51.956417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-747c5acc-e839-44c8-b9c4-9f9d96ae4748 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.956902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-747c5acc-e839-44c8-b9c4-9f9d96ae4748 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.957340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-747c5acc-e839-44c8-b9c4-9f9d96ae4748 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:52.010136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-04bd0df7-00c3-4ef8-98d3-fa7928403f37 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:52.011405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-04bd0df7-00c3-4ef8-98d3-fa7928403f37 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:52.018777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04bd0df7-00c3-4ef8-98d3-fa7928403f37 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:52.019304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04bd0df7-00c3-4ef8-98d3-fa7928403f37 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:52.019794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04bd0df7-00c3-4ef8-98d3-fa7928403f37 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:52.020694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04bd0df7-00c3-4ef8-98d3-fa7928403f37 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:52.021159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04bd0df7-00c3-4ef8-98d3-fa7928403f37 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:52.021589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04bd0df7-00c3-4ef8-98d3-fa7928403f37 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:52.202992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-747c5acc-e839-44c8-b9c4-9f9d96ae4748 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:52.211447 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-747c5acc-e839-44c8-b9c4-9f9d96ae4748 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.269988 Aug 27 05:14:52.212025 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2236/4470] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:51 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:52.284722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04bd0df7-00c3-4ef8-98d3-fa7928403f37 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:52.294514 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-04bd0df7-00c3-4ef8-98d3-fa7928403f37 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1315 microversion: 2.1 time: 0.288477 Aug 27 05:14:52.295414 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2235/4471] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:52 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:52.794626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-670bf22d-7029-40f5-b6c3-62e2777559c3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:52.795425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-670bf22d-7029-40f5-b6c3-62e2777559c3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:52.808384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-670bf22d-7029-40f5-b6c3-62e2777559c3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:52.808883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-670bf22d-7029-40f5-b6c3-62e2777559c3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:52.809322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-670bf22d-7029-40f5-b6c3-62e2777559c3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:52.810062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-670bf22d-7029-40f5-b6c3-62e2777559c3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:52.810519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-670bf22d-7029-40f5-b6c3-62e2777559c3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:52.810947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-670bf22d-7029-40f5-b6c3-62e2777559c3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:53.018628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-670bf22d-7029-40f5-b6c3-62e2777559c3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:53.028083 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-670bf22d-7029-40f5-b6c3-62e2777559c3 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1811 microversion: 2.1 time: 0.237356 Aug 27 05:14:53.028748 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2237/4472] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:52 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1811 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:53.233561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c95f4623-ced9-4974-87bd-2375ea488a4b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:53.234217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c95f4623-ced9-4974-87bd-2375ea488a4b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:53.241622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c95f4623-ced9-4974-87bd-2375ea488a4b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:53.242115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c95f4623-ced9-4974-87bd-2375ea488a4b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:53.242553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c95f4623-ced9-4974-87bd-2375ea488a4b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:53.243325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c95f4623-ced9-4974-87bd-2375ea488a4b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:53.243965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c95f4623-ced9-4974-87bd-2375ea488a4b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:53.244393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c95f4623-ced9-4974-87bd-2375ea488a4b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:53.317296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb1da276-a929-45db-b961-7dd93fffac51 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:53.317794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bb1da276-a929-45db-b961-7dd93fffac51 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:53.325135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1da276-a929-45db-b961-7dd93fffac51 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:53.325638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1da276-a929-45db-b961-7dd93fffac51 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:53.326084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1da276-a929-45db-b961-7dd93fffac51 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:53.326815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1da276-a929-45db-b961-7dd93fffac51 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:53.327311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1da276-a929-45db-b961-7dd93fffac51 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:53.327922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb1da276-a929-45db-b961-7dd93fffac51 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:53.704886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c95f4623-ced9-4974-87bd-2375ea488a4b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:53.713212 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c95f4623-ced9-4974-87bd-2375ea488a4b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.483640 Aug 27 05:14:53.714118 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2236/4473] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:53 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:53.723054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb1da276-a929-45db-b961-7dd93fffac51 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:53.726782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:53.732874 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb1da276-a929-45db-b961-7dd93fffac51 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1315 microversion: 2.1 time: 0.420255 Aug 27 05:14:53.733579 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2238/4474] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:53 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:53.915697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-a364a3b0-9f74-49f7-bb87-9edc2fa8a264 req-605f7f2b-b6e8-476f-ba10-cb893374b34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03424c7-42f3-4ae4-9175-cc7e56cbeeec", "name": "network-vif-deleted", "tag": "03e994c5-1805-40cd-83a2-3622264ef2eb"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:53.935571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a364a3b0-9f74-49f7-bb87-9edc2fa8a264 req-605f7f2b-b6e8-476f-ba10-cb893374b34b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:53.944721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a364a3b0-9f74-49f7-bb87-9edc2fa8a264 req-605f7f2b-b6e8-476f-ba10-cb893374b34b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:53.945219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a364a3b0-9f74-49f7-bb87-9edc2fa8a264 req-605f7f2b-b6e8-476f-ba10-cb893374b34b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:53.967423 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-a364a3b0-9f74-49f7-bb87-9edc2fa8a264 req-605f7f2b-b6e8-476f-ba10-cb893374b34b service nova] Creating event network-vif-deleted:03e994c5-1805-40cd-83a2-3622264ef2eb for instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec on n-h2-820368-35 Aug 27 05:14:53.992267 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-a364a3b0-9f74-49f7-bb87-9edc2fa8a264 req-605f7f2b-b6e8-476f-ba10-cb893374b34b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080171 Aug 27 05:14:53.993144 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2237/4475] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:54.050499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3dd89a80-7998-4ead-ae5b-a5d029beadbd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:54.051850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3dd89a80-7998-4ead-ae5b-a5d029beadbd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:54.071485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd89a80-7998-4ead-ae5b-a5d029beadbd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:54.072137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd89a80-7998-4ead-ae5b-a5d029beadbd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:54.072587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd89a80-7998-4ead-ae5b-a5d029beadbd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:54.073316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd89a80-7998-4ead-ae5b-a5d029beadbd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:54.073774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd89a80-7998-4ead-ae5b-a5d029beadbd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:54.074204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd89a80-7998-4ead-ae5b-a5d029beadbd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:54.125142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:54.125908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:54.386888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3dd89a80-7998-4ead-ae5b-a5d029beadbd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:54.399214 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3dd89a80-7998-4ead-ae5b-a5d029beadbd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1675 microversion: 2.1 time: 0.352715 Aug 27 05:14:54.399646 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2239/4476] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:54 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1675 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:54.736549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8fe39a10-5c1d-4878-a901-6acec32bb078 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:54.738082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8fe39a10-5c1d-4878-a901-6acec32bb078 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:54.742079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:54.747426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fe39a10-5c1d-4878-a901-6acec32bb078 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:54.747926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fe39a10-5c1d-4878-a901-6acec32bb078 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:54.748525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fe39a10-5c1d-4878-a901-6acec32bb078 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:54.749697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fe39a10-5c1d-4878-a901-6acec32bb078 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:54.750626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fe39a10-5c1d-4878-a901-6acec32bb078 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:54.751246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fe39a10-5c1d-4878-a901-6acec32bb078 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:54.755728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b48635a1-ee5a-4c0e-a52c-a79419001775 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:54.756610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b48635a1-ee5a-4c0e-a52c-a79419001775 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:54.767687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b48635a1-ee5a-4c0e-a52c-a79419001775 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:54.768440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b48635a1-ee5a-4c0e-a52c-a79419001775 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:54.769032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b48635a1-ee5a-4c0e-a52c-a79419001775 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:54.770735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b48635a1-ee5a-4c0e-a52c-a79419001775 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:54.771552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b48635a1-ee5a-4c0e-a52c-a79419001775 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:54.772063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b48635a1-ee5a-4c0e-a52c-a79419001775 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.091778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8fe39a10-5c1d-4878-a901-6acec32bb078 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:55.107177 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8fe39a10-5c1d-4878-a901-6acec32bb078 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.375497 Aug 27 05:14:55.122665 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2238/4477] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:54 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:55.145005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b48635a1-ee5a-4c0e-a52c-a79419001775 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:55.155878 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b48635a1-ee5a-4c0e-a52c-a79419001775 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1315 microversion: 2.1 time: 0.404699 Aug 27 05:14:55.156839 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2240/4478] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:54 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:55.420720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:55.422085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:55.429224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:55.429849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:55.430297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.431007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:55.431493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:55.432130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.464532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:55.465023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:55.465469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.465933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lazy-loading 'fault' on Instance uuid f03424c7-42f3-4ae4-9175-cc7e56cbeeec {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:14:55.532873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:55.541362 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9ccad34f-4da9-47ef-9e76-94a00f4e823d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 200 len: 1303 microversion: 2.1 time: 0.124652 Aug 27 05:14:55.542129 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2239/4479] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:55 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:55.559395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f723877e-3d7d-4c55-9d79-46667651afe3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:55.560005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f723877e-3d7d-4c55-9d79-46667651afe3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:55.566721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f723877e-3d7d-4c55-9d79-46667651afe3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:55.567325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f723877e-3d7d-4c55-9d79-46667651afe3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:55.567832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f723877e-3d7d-4c55-9d79-46667651afe3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.568598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f723877e-3d7d-4c55-9d79-46667651afe3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:55.569121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f723877e-3d7d-4c55-9d79-46667651afe3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:55.569663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f723877e-3d7d-4c55-9d79-46667651afe3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.596451 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f723877e-3d7d-4c55-9d79-46667651afe3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/ips" status: 200 len: 151 microversion: 2.20 time: 0.041383 Aug 27 05:14:55.599290 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2241/4480] 10.222.0.58 () {60 vars in 1289 bytes} [Sat Aug 27 05:14:55 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:14:56.044628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c1557268-f625-480d-b97e-0a36fbcfc5b1 req-89e1f55e-bd2f-4e57-8654-104cf8b055ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03424c7-42f3-4ae4-9175-cc7e56cbeeec", "name": "network-vif-deleted", "tag": "b2a2758d-2695-4b32-a58c-dbf50660807f"}, {"server_uuid": "f03424c7-42f3-4ae4-9175-cc7e56cbeeec", "name": "network-vif-deleted", "tag": "b37f5080-12c5-4ffb-af46-8d330263c243"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:56.056751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c1557268-f625-480d-b97e-0a36fbcfc5b1 req-89e1f55e-bd2f-4e57-8654-104cf8b055ab service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:56.057246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c1557268-f625-480d-b97e-0a36fbcfc5b1 req-89e1f55e-bd2f-4e57-8654-104cf8b055ab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:56.057714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c1557268-f625-480d-b97e-0a36fbcfc5b1 req-89e1f55e-bd2f-4e57-8654-104cf8b055ab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:56.070325 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c1557268-f625-480d-b97e-0a36fbcfc5b1 req-89e1f55e-bd2f-4e57-8654-104cf8b055ab service nova] Creating event network-vif-deleted:b2a2758d-2695-4b32-a58c-dbf50660807f for instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec on n-h2-820368-35 Aug 27 05:14:56.070840 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c1557268-f625-480d-b97e-0a36fbcfc5b1 req-89e1f55e-bd2f-4e57-8654-104cf8b055ab service nova] Creating event network-vif-deleted:b37f5080-12c5-4ffb-af46-8d330263c243 for instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec on n-h2-820368-35 Aug 27 05:14:56.076028 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c1557268-f625-480d-b97e-0a36fbcfc5b1 req-89e1f55e-bd2f-4e57-8654-104cf8b055ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035020 Aug 27 05:14:56.076640 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2240/4481] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:14:56.129898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f2b9cd6a-ee7c-440f-9dee-cd24fb24db8c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:56.130594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f2b9cd6a-ee7c-440f-9dee-cd24fb24db8c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:56.137691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b9cd6a-ee7c-440f-9dee-cd24fb24db8c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:56.138252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b9cd6a-ee7c-440f-9dee-cd24fb24db8c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:56.138919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b9cd6a-ee7c-440f-9dee-cd24fb24db8c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:56.139728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b9cd6a-ee7c-440f-9dee-cd24fb24db8c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:56.140397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b9cd6a-ee7c-440f-9dee-cd24fb24db8c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:56.140839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b9cd6a-ee7c-440f-9dee-cd24fb24db8c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:56.178247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70f51422-847f-491f-a230-9c5053bd1c66 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:56.179390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-70f51422-847f-491f-a230-9c5053bd1c66 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:56.186104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f51422-847f-491f-a230-9c5053bd1c66 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:56.186802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f51422-847f-491f-a230-9c5053bd1c66 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:56.187397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f51422-847f-491f-a230-9c5053bd1c66 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:56.188117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f51422-847f-491f-a230-9c5053bd1c66 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:56.188607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f51422-847f-491f-a230-9c5053bd1c66 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:56.189062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70f51422-847f-491f-a230-9c5053bd1c66 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:56.194359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:56.440386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f2b9cd6a-ee7c-440f-9dee-cd24fb24db8c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:56.453136 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f2b9cd6a-ee7c-440f-9dee-cd24fb24db8c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.327195 Aug 27 05:14:56.454619 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2242/4482] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:56 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:56.551643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-70f51422-847f-491f-a230-9c5053bd1c66 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:56.565511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:56.566872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:56.576322 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70f51422-847f-491f-a230-9c5053bd1c66 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1315 microversion: 2.1 time: 0.400347 Aug 27 05:14:56.578021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:56.578667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2241/4483] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:56 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:56.578917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:56.579916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:56.580789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:56.581573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:56.583612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:56.602256 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] HTTP exception thrown: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Request method failure captured: Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec HTTP/1.1 Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCagoSOpwQi58WywYii5oPLrCN_Ys5nWq9vCaDcXMwhtminn4JSgjdMui0jQrXjzOAP19XX1ZiK9WPv2FzfSklqswQsyZfxSvVT4KRLi88Umlwx_-aOOdxyHsvh3fwHwnRmxE8NI7-nNcIJv3mMBBU-I_DXMVLPizvCrDF_AG7lyFwpg Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2fce25efce44ca2af48550a5e49d3c4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestMultiNic-1492440714 Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: a4f64cdce2564b2aaeefe6ff048ce65f Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'f03424c7-42f3-4ae4-9175-cc7e56cbeeec'} Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:56.604493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:14:56.608673 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:56.608673 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:56.608673 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:56.608673 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:14:56.608673 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:14:56.608673 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:14:56.608673 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:14:56.611201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Returning 404 to user: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:14:56.613941 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5021e412-019a-4bfe-82d0-e61a439ef585 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 404 len: 111 microversion: 2.1 time: 0.053004 Aug 27 05:14:56.614906 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2243/4484] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:56 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:14:57.209681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-24012aef-d59d-483e-889d-88c517021e42 req-ab91d880-31b3-46e6-8389-6b8f34a7e596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12268895-61a7-4826-895a-6e8ead0a1635", "name": "network-vif-plugged", "status": "completed", "tag": "bafcaedc-bcc2-439a-b01c-9b80d27c8f47"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:57.230387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=78 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:57.237436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-24012aef-d59d-483e-889d-88c517021e42 req-ab91d880-31b3-46e6-8389-6b8f34a7e596 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.238868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-24012aef-d59d-483e-889d-88c517021e42 req-ab91d880-31b3-46e6-8389-6b8f34a7e596 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.239496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-24012aef-d59d-483e-889d-88c517021e42 req-ab91d880-31b3-46e6-8389-6b8f34a7e596 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.253550 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-24012aef-d59d-483e-889d-88c517021e42 req-ab91d880-31b3-46e6-8389-6b8f34a7e596 service nova] Creating event network-vif-plugged:bafcaedc-bcc2-439a-b01c-9b80d27c8f47 for instance 12268895-61a7-4826-895a-6e8ead0a1635 on n-h1-820368-35 Aug 27 05:14:57.260531 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-24012aef-d59d-483e-889d-88c517021e42 req-ab91d880-31b3-46e6-8389-6b8f34a7e596 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055308 Aug 27 05:14:57.263792 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2242/4485] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:57.478119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-239e6aee-3bbf-43d9-acf1-3930a91f0892 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:57.479567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-239e6aee-3bbf-43d9-acf1-3930a91f0892 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:57.502124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e6aee-3bbf-43d9-acf1-3930a91f0892 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.502785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e6aee-3bbf-43d9-acf1-3930a91f0892 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.503343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e6aee-3bbf-43d9-acf1-3930a91f0892 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.504185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e6aee-3bbf-43d9-acf1-3930a91f0892 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.504841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e6aee-3bbf-43d9-acf1-3930a91f0892 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.505270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e6aee-3bbf-43d9-acf1-3930a91f0892 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.544168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-244f28d2-f8ce-49bf-9f1e-6edd5846998c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:57.545107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-244f28d2-f8ce-49bf-9f1e-6edd5846998c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:57.559150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244f28d2-f8ce-49bf-9f1e-6edd5846998c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.560052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244f28d2-f8ce-49bf-9f1e-6edd5846998c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.561403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244f28d2-f8ce-49bf-9f1e-6edd5846998c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.562668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244f28d2-f8ce-49bf-9f1e-6edd5846998c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.568982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244f28d2-f8ce-49bf-9f1e-6edd5846998c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.569857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-244f28d2-f8ce-49bf-9f1e-6edd5846998c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.626508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-244f28d2-f8ce-49bf-9f1e-6edd5846998c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lazy-loading 'flavor' on Instance uuid e08a333d-504a-41ad-a796-2069aecd4bd9 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:14:57.747077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-239e6aee-3bbf-43d9-acf1-3930a91f0892 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:57.762519 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-239e6aee-3bbf-43d9-acf1-3930a91f0892 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.290857 Aug 27 05:14:57.770441 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2244/4486] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:57 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:57.790447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f310103-e12a-482f-92e7-a822a3c5acbc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:57.791290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8f310103-e12a-482f-92e7-a822a3c5acbc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:57.799555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f310103-e12a-482f-92e7-a822a3c5acbc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.800564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f310103-e12a-482f-92e7-a822a3c5acbc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.801636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f310103-e12a-482f-92e7-a822a3c5acbc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.802871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f310103-e12a-482f-92e7-a822a3c5acbc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.803649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f310103-e12a-482f-92e7-a822a3c5acbc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.804382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f310103-e12a-482f-92e7-a822a3c5acbc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.940774 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-244f28d2-f8ce-49bf-9f1e-6edd5846998c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "POST /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/action" status: 202 len: 0 microversion: 2.20 time: 0.407019 Aug 27 05:14:57.942399 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2243/4487] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 05:14:57 2022] POST /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:14:57.955618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:57.956011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:57.966807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.968446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.969259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.970146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.971158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.972761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:58.574509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8f310103-e12a-482f-92e7-a822a3c5acbc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:58.602313 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8f310103-e12a-482f-92e7-a822a3c5acbc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1315 microversion: 2.1 time: 0.815117 Aug 27 05:14:58.603711 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2245/4488] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:57 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:58.607963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:58.622241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:58.632221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:58.634809 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-10ff5782-b9a0-4e55-a436-bbd41cf24056 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1722 microversion: 2.20 time: 0.687675 Aug 27 05:14:58.636951 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2244/4489] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:14:57 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1722 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:14:58.792551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7d40185-5c30-4a8d-b278-0fcf2dfdca19 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:58.793306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7d40185-5c30-4a8d-b278-0fcf2dfdca19 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:58.803329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7d40185-5c30-4a8d-b278-0fcf2dfdca19 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:58.803827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7d40185-5c30-4a8d-b278-0fcf2dfdca19 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:58.806282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7d40185-5c30-4a8d-b278-0fcf2dfdca19 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:58.811954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7d40185-5c30-4a8d-b278-0fcf2dfdca19 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:58.812439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7d40185-5c30-4a8d-b278-0fcf2dfdca19 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:58.815274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7d40185-5c30-4a8d-b278-0fcf2dfdca19 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:59.104548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a7d40185-5c30-4a8d-b278-0fcf2dfdca19 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:59.117408 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7d40185-5c30-4a8d-b278-0fcf2dfdca19 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.329192 Aug 27 05:14:59.133452 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2246/4490] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:58 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:59.629703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e66144a5-c54a-4d29-9ec4-a5ce42aacf0f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:59.630252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e66144a5-c54a-4d29-9ec4-a5ce42aacf0f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:59.638384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66144a5-c54a-4d29-9ec4-a5ce42aacf0f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:59.638901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66144a5-c54a-4d29-9ec4-a5ce42aacf0f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:59.639507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66144a5-c54a-4d29-9ec4-a5ce42aacf0f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:59.640246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66144a5-c54a-4d29-9ec4-a5ce42aacf0f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:59.640709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66144a5-c54a-4d29-9ec4-a5ce42aacf0f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:59.641270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66144a5-c54a-4d29-9ec4-a5ce42aacf0f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:59.662857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:59.664186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:59.673927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:59.674917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:59.676300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:59.678374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:59.679061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:59.679753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:59.947734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e66144a5-c54a-4d29-9ec4-a5ce42aacf0f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:59.956298 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e66144a5-c54a-4d29-9ec4-a5ce42aacf0f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1502 microversion: 2.1 time: 0.331633 Aug 27 05:14:59.957421 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2245/4491] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:59 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1502 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:59.978686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0b908234-8430-4ab3-8ed8-424f3472dda7 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1295593844"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:59.979889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0b908234-8430-4ab3-8ed8-424f3472dda7 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:59.986133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:59.995909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:00.000906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:00.001489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b908234-8430-4ab3-8ed8-424f3472dda7 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:00.002235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b908234-8430-4ab3-8ed8-424f3472dda7 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:00.004357 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-94546262-9649-4430-beb7-efa9b08c3ca6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1722 microversion: 2.20 time: 0.345570 Aug 27 05:15:00.005603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b908234-8430-4ab3-8ed8-424f3472dda7 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:00.006579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b908234-8430-4ab3-8ed8-424f3472dda7 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:00.007220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b908234-8430-4ab3-8ed8-424f3472dda7 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:00.007810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b908234-8430-4ab3-8ed8-424f3472dda7 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:00.010067 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2247/4492] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:14:59 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1722 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:00.140411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cc1e53ec-9e0d-46ce-8bc4-19dcab0c5cfa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:00.141316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cc1e53ec-9e0d-46ce-8bc4-19dcab0c5cfa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:00.148735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc1e53ec-9e0d-46ce-8bc4-19dcab0c5cfa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:00.149324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc1e53ec-9e0d-46ce-8bc4-19dcab0c5cfa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:00.149843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc1e53ec-9e0d-46ce-8bc4-19dcab0c5cfa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:00.150649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc1e53ec-9e0d-46ce-8bc4-19dcab0c5cfa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:00.151345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc1e53ec-9e0d-46ce-8bc4-19dcab0c5cfa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:00.151961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc1e53ec-9e0d-46ce-8bc4-19dcab0c5cfa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:00.294734 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.network.security_group_api [None req-0b908234-8430-4ab3-8ed8-424f3472dda7 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Adding security group bb3802fe-d7e0-4d25-b889-a04f1a93083c to port bafcaedc-bcc2-439a-b01c-9b80d27c8f47 Aug 27 05:15:00.475798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cc1e53ec-9e0d-46ce-8bc4-19dcab0c5cfa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:00.496531 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cc1e53ec-9e0d-46ce-8bc4-19dcab0c5cfa tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.359042 Aug 27 05:15:00.514020 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2248/4493] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:00 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:00.770129 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0b908234-8430-4ab3-8ed8-424f3472dda7 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635/action" status: 202 len: 0 microversion: 2.1 time: 0.795458 Aug 27 05:15:00.774166 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2246/4494] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:14:59 2022] POST /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635/action => generated 0 bytes in 798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:15:00.779913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-89b4b711-65c6-4c78-849c-8f7b15cdd3b8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2107620759"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:00.781946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-89b4b711-65c6-4c78-849c-8f7b15cdd3b8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:00.793568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b4b711-65c6-4c78-849c-8f7b15cdd3b8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:00.801692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b4b711-65c6-4c78-849c-8f7b15cdd3b8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:00.801692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b4b711-65c6-4c78-849c-8f7b15cdd3b8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:00.801951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-3b523d95-264f-40eb-9987-cfdfdd6bebad req-cda577c0-0b77-4d57-87f4-12a9fbdaaaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12268895-61a7-4826-895a-6e8ead0a1635", "tag": "bafcaedc-bcc2-439a-b01c-9b80d27c8f47"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:00.804057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b4b711-65c6-4c78-849c-8f7b15cdd3b8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:00.804839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b4b711-65c6-4c78-849c-8f7b15cdd3b8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:00.807337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89b4b711-65c6-4c78-849c-8f7b15cdd3b8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:00.861944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3b523d95-264f-40eb-9987-cfdfdd6bebad req-cda577c0-0b77-4d57-87f4-12a9fbdaaaf2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:00.862434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3b523d95-264f-40eb-9987-cfdfdd6bebad req-cda577c0-0b77-4d57-87f4-12a9fbdaaaf2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:00.872148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3b523d95-264f-40eb-9987-cfdfdd6bebad req-cda577c0-0b77-4d57-87f4-12a9fbdaaaf2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:00.923487 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-3b523d95-264f-40eb-9987-cfdfdd6bebad req-cda577c0-0b77-4d57-87f4-12a9fbdaaaf2 service nova] Creating event network-changed:bafcaedc-bcc2-439a-b01c-9b80d27c8f47 for instance 12268895-61a7-4826-895a-6e8ead0a1635 on n-h1-820368-35 Aug 27 05:15:00.940858 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-3b523d95-264f-40eb-9987-cfdfdd6bebad req-cda577c0-0b77-4d57-87f4-12a9fbdaaaf2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140145 Aug 27 05:15:00.941534 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2247/4495] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:01.031247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:01.032150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:01.048240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:01.048747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:01.049196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:01.049924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:01.051055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:01.051524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:01.298209 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.network.security_group_api [None req-89b4b711-65c6-4c78-849c-8f7b15cdd3b8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Adding security group efa3c73f-70ac-4222-bc28-9e9306f70d18 to port bafcaedc-bcc2-439a-b01c-9b80d27c8f47 Aug 27 05:15:01.577209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:01.587525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:01.591103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:01.592630 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9bfecd19-3c79-49ab-bf53-d26be09f5311 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1722 microversion: 2.20 time: 0.566442 Aug 27 05:15:01.593725 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2248/4496] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:01 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1722 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:01.602256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ccb63fc1-e073-4277-8600-23205f0383e9 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:01.604547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ccb63fc1-e073-4277-8600-23205f0383e9 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:01.612471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ccb63fc1-e073-4277-8600-23205f0383e9 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:01.613751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ccb63fc1-e073-4277-8600-23205f0383e9 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:01.614876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ccb63fc1-e073-4277-8600-23205f0383e9 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:01.616654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ccb63fc1-e073-4277-8600-23205f0383e9 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:01.617787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ccb63fc1-e073-4277-8600-23205f0383e9 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:01.618380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ccb63fc1-e073-4277-8600-23205f0383e9 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:02.060610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ccb63fc1-e073-4277-8600-23205f0383e9 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:02.073093 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ccb63fc1-e073-4277-8600-23205f0383e9 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.477594 Aug 27 05:15:02.073961 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2249/4497] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:01 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:02.138876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-930974294", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "c0b9321a-d1ec-458f-9044-4c3b2b1d687a"}, {"uuid": "6532c020-0dfd-4e5a-8217-60f8713b55cb"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:02.221633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] validate_networks() for [('c0b9321a-d1ec-458f-9044-4c3b2b1d687a', None, None, None, None, None), ('6532c020-0dfd-4e5a-8217-60f8713b55cb', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:15:02.361856 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-89b4b711-65c6-4c78-849c-8f7b15cdd3b8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635/action" status: 202 len: 0 microversion: 2.1 time: 1.585329 Aug 27 05:15:02.363427 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2249/4498] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:15:00 2022] POST /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635/action => generated 0 bytes in 1588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:02.373309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7b44fcea-08fc-430e-8a67-9101e617ecff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:02.374279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7b44fcea-08fc-430e-8a67-9101e617ecff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:02.382347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b44fcea-08fc-430e-8a67-9101e617ecff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:02.382858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b44fcea-08fc-430e-8a67-9101e617ecff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:02.383357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b44fcea-08fc-430e-8a67-9101e617ecff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:02.384587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b44fcea-08fc-430e-8a67-9101e617ecff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:02.385094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b44fcea-08fc-430e-8a67-9101e617ecff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:02.385675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b44fcea-08fc-430e-8a67-9101e617ecff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:02.766596 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7b44fcea-08fc-430e-8a67-9101e617ecff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.397660 Aug 27 05:15:02.780927 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2250/4499] 10.222.0.58 () {58 vars in 1293 bytes} [Sat Aug 27 05:15:02 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635/os-security-groups => generated 1159 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:02.798083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:02.801145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:02.810785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:02.812289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:02.813510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:02.814582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:02.821793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:02.822640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:03.644855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:03.673470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:03.681415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:03.682784 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e857aab1-4a00-46ab-ab6e-91f6dfbd9cdc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1722 microversion: 2.20 time: 0.900637 Aug 27 05:15:03.695973 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2251/4500] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:02 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1722 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:03.711451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0b9b2feb-398a-4e05-9935-69132204211a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'create', calling method: .version_select at 0x7fb5650d30d0>, body: {"security_group": {"name": " tempest-securitygroup -1715845399 ", "description": "tempest-description-1902627474"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:04.267731 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0b9b2feb-398a-4e05-9935-69132204211a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.570174 Aug 27 05:15:04.276613 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2252/4501] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:15:03 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:04.281987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-58babc62-ab5c-4d07-9a04-9a5a0df143bd req-eef7b021-0dae-4c87-91f7-5497c6ee24d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12268895-61a7-4826-895a-6e8ead0a1635", "tag": "bafcaedc-bcc2-439a-b01c-9b80d27c8f47"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:04.295395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-58babc62-ab5c-4d07-9a04-9a5a0df143bd req-eef7b021-0dae-4c87-91f7-5497c6ee24d3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:04.295985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-58babc62-ab5c-4d07-9a04-9a5a0df143bd req-eef7b021-0dae-4c87-91f7-5497c6ee24d3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:04.296639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-58babc62-ab5c-4d07-9a04-9a5a0df143bd req-eef7b021-0dae-4c87-91f7-5497c6ee24d3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:04.308568 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-58babc62-ab5c-4d07-9a04-9a5a0df143bd req-eef7b021-0dae-4c87-91f7-5497c6ee24d3 service nova] Creating event network-changed:bafcaedc-bcc2-439a-b01c-9b80d27c8f47 for instance 12268895-61a7-4826-895a-6e8ead0a1635 on n-h1-820368-35 Aug 27 05:15:04.314444 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-58babc62-ab5c-4d07-9a04-9a5a0df143bd req-eef7b021-0dae-4c87-91f7-5497c6ee24d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036221 Aug 27 05:15:04.315142 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2253/4502] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:04.320447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0b455ce6-f9c9-4845-a0cb-dcf761e24635 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:04.321163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0b455ce6-f9c9-4845-a0cb-dcf761e24635 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:04.327616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b455ce6-f9c9-4845-a0cb-dcf761e24635 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:04.328113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b455ce6-f9c9-4845-a0cb-dcf761e24635 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:04.329193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b455ce6-f9c9-4845-a0cb-dcf761e24635 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:04.329920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b455ce6-f9c9-4845-a0cb-dcf761e24635 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:04.330385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b455ce6-f9c9-4845-a0cb-dcf761e24635 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:04.330818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b455ce6-f9c9-4845-a0cb-dcf761e24635 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:04.397725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:15:04.398931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:15:04.399877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:15:04.400579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:15:04.401230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:15:04.411956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:04.412786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:04.413715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:04.415610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:04.416411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:04.417156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:04.440215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Getting quotas for project e2fce25efce44ca2af48550a5e49d3c4. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:15:04.446676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Getting quotas for user a4f64cdce2564b2aaeefe6ff048ce65f and project e2fce25efce44ca2af48550a5e49d3c4. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:15:04.461617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:15:04.464307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:15:04.522336 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4ce5d914-4889-49b7-b89d-058167190ef9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.388898 Aug 27 05:15:04.523666 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2250/4503] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:15:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:15:04.528806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-726816f9-daad-4086-9c63-87f2dd58b7a2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb564f519d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:04.615630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0b455ce6-f9c9-4845-a0cb-dcf761e24635 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:04.626703 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0b455ce6-f9c9-4845-a0cb-dcf761e24635 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.309479 Aug 27 05:15:04.630364 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2254/4504] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:04 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:04.638581 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-726816f9-daad-4086-9c63-87f2dd58b7a2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/90f75973-36c6-4321-8259-6eae7605c79d" status: 200 len: 224 microversion: 2.1 time: 0.113668 Aug 27 05:15:04.639318 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2251/4505] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 05:15:04 2022] GET /compute/v2.1/os-security-groups/90f75973-36c6-4321-8259-6eae7605c79d => generated 224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:04.645123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7a243ab2-650b-4cb8-82ad-6faf7877185f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:04.647004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7a243ab2-650b-4cb8-82ad-6faf7877185f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:04.653094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c79d2ee3-2614-4b2a-9d57-9a349e380252 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb56974d820>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:04.779432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7a243ab2-650b-4cb8-82ad-6faf7877185f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:04.788226 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7a243ab2-650b-4cb8-82ad-6faf7877185f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1212 microversion: 2.1 time: 0.156387 Aug 27 05:15:04.791739 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2255/4506] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:04 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1212 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:04.808104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:04.808837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:04.821563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:04.824987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:04.827112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:04.827972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:04.831681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:04.832242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:05.225309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:05.239956 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c79d2ee3-2614-4b2a-9d57-9a349e380252 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/90f75973-36c6-4321-8259-6eae7605c79d" status: 202 len: 0 microversion: 2.1 time: 0.591596 Aug 27 05:15:05.240864 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2252/4507] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:04 2022] DELETE /compute/v2.1/os-security-groups/90f75973-36c6-4321-8259-6eae7605c79d => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:05.249056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9108c62-f83f-4487-be89-7e232ff6960d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb56974d670>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:05.250043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:05.251717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:05.253217 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d7a852c-98ab-4150-8ea9-65db6b2297a7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1722 microversion: 2.20 time: 0.459558 Aug 27 05:15:05.253923 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2256/4508] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:04 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1722 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:05.293112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-c9108c62-f83f-4487-be89-7e232ff6960d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:05.294371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-c9108c62-f83f-4487-be89-7e232ff6960d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Neutron security group 90f75973-36c6-4321-8259-6eae7605c79d not found {{(pid=128548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:15:05.295029 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c9108c62-f83f-4487-be89-7e232ff6960d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:05.295029 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-adf19448-cc87-4384-88ad-a41e88b9e059'] Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9108c62-f83f-4487-be89-7e232ff6960d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-security-groups/90f75973-36c6-4321-8259-6eae7605c79d HTTP/1.1 Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-adf19448-cc87-4384-88ad-a41e88b9e059'] Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '90f75973-36c6-4321-8259-6eae7605c79d'} Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:05.299607 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adf19448-cc87-4384-88ad-a41e88b9e059'] Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adf19448-cc87-4384-88ad-a41e88b9e059'] Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adf19448-cc87-4384-88ad-a41e88b9e059'] Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adf19448-cc87-4384-88ad-a41e88b9e059'] Aug 27 05:15:05.303517 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:05.308523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9108c62-f83f-4487-be89-7e232ff6960d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:05.308523 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-adf19448-cc87-4384-88ad-a41e88b9e059'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:05.309976 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c9108c62-f83f-4487-be89-7e232ff6960d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/90f75973-36c6-4321-8259-6eae7605c79d" status: 404 len: 194 microversion: 2.1 time: 0.065006 Aug 27 05:15:05.311145 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2253/4509] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 05:15:05 2022] GET /compute/v2.1/os-security-groups/90f75973-36c6-4321-8259-6eae7605c79d => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:15:05.322677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-95b3eef8-1343-439b-a1d0-bb9b8317dadd tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'create', calling method: .version_select at 0x7fb5650d3310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-79119829", "description": "tempest-description-1345120047"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:05.518488 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-95b3eef8-1343-439b-a1d0-bb9b8317dadd tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.199624 Aug 27 05:15:05.519576 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2257/4510] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:15:05 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:15:05.533441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eac2dfe3-c822-4863-9c68-60927b3ff94b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'create', calling method: .version_select at 0x7fb564be9940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1455932696", "description": "tempest-description-951544281"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:05.651688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e39daaeb-7e62-47bd-b348-d03598b30441 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:05.653117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e39daaeb-7e62-47bd-b348-d03598b30441 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:05.662388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39daaeb-7e62-47bd-b348-d03598b30441 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:05.663541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39daaeb-7e62-47bd-b348-d03598b30441 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:05.665542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39daaeb-7e62-47bd-b348-d03598b30441 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:05.666315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39daaeb-7e62-47bd-b348-d03598b30441 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:05.666850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39daaeb-7e62-47bd-b348-d03598b30441 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:05.667261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e39daaeb-7e62-47bd-b348-d03598b30441 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:06.011722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e39daaeb-7e62-47bd-b348-d03598b30441 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:06.017748 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eac2dfe3-c822-4863-9c68-60927b3ff94b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.489488 Aug 27 05:15:06.019413 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2254/4511] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:15:05 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:06.025465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78b8a241-8513-4b77-baff-760e101291fe tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:06.026552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-78b8a241-8513-4b77-baff-760e101291fe tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:06.034011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78b8a241-8513-4b77-baff-760e101291fe tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:06.034262 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e39daaeb-7e62-47bd-b348-d03598b30441 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.387099 Aug 27 05:15:06.035432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78b8a241-8513-4b77-baff-760e101291fe tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:06.036099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78b8a241-8513-4b77-baff-760e101291fe tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:06.036969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78b8a241-8513-4b77-baff-760e101291fe tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:06.037599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78b8a241-8513-4b77-baff-760e101291fe tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:06.038253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78b8a241-8513-4b77-baff-760e101291fe tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:06.038917 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2258/4512] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:05 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:06.046618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-79c9a1fb-bcf7-4043-af80-4e6ba95f950b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'create', calling method: .version_select at 0x7fb56587c670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-10543516", "description": "tempest-description-1697136701"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:06.171383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-78b8a241-8513-4b77-baff-760e101291fe tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:06.183404 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-78b8a241-8513-4b77-baff-760e101291fe tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1264 microversion: 2.1 time: 0.162417 Aug 27 05:15:06.184352 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2255/4513] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:06 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:06.282465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:06.283170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:06.297037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:06.297037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:06.298604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:06.300386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:06.302403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:06.303045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:06.427159 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-79c9a1fb-bcf7-4043-af80-4e6ba95f950b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.386794 Aug 27 05:15:06.427750 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2259/4514] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:15:06 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:06.440668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-36c01793-6c50-4b3b-a23b-26b03a40c684 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb564904ca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:06.618635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:06.630052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:06.631695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:06.632994 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9bab3bf5-8609-4e78-ad07-ff3ffcf6150a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1722 microversion: 2.20 time: 0.357842 Aug 27 05:15:06.635131 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2256/4515] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:06 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1722 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:06.973633 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-36c01793-6c50-4b3b-a23b-26b03a40c684 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.536715 Aug 27 05:15:06.974442 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2260/4516] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 05:15:06 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:06.995344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a29a221-d89c-413e-87bf-df9ab9d6ace1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb5696a4af0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:07.058371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4aa0042e-9dd9-45d2-a89e-9050f503f4b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:07.059021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4aa0042e-9dd9-45d2-a89e-9050f503f4b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:07.066185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa0042e-9dd9-45d2-a89e-9050f503f4b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:07.067148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa0042e-9dd9-45d2-a89e-9050f503f4b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:07.068362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa0042e-9dd9-45d2-a89e-9050f503f4b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:07.070993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa0042e-9dd9-45d2-a89e-9050f503f4b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:07.071693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa0042e-9dd9-45d2-a89e-9050f503f4b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:07.072392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa0042e-9dd9-45d2-a89e-9050f503f4b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:07.273802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4aa0042e-9dd9-45d2-a89e-9050f503f4b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:07.276924 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a29a221-d89c-413e-87bf-df9ab9d6ace1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/e16372a9-c87b-47cc-9731-939b62c6ee86" status: 202 len: 0 microversion: 2.1 time: 0.291482 Aug 27 05:15:07.277554 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2257/4517] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:06 2022] DELETE /compute/v2.1/os-security-groups/e16372a9-c87b-47cc-9731-939b62c6ee86 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:07.292621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-389ec6cf-147d-4449-bf05-0e2ad4a0ba1f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:07.293465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-389ec6cf-147d-4449-bf05-0e2ad4a0ba1f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:07.298703 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4aa0042e-9dd9-45d2-a89e-9050f503f4b0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1510 microversion: 2.1 time: 0.245578 Aug 27 05:15:07.304758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389ec6cf-147d-4449-bf05-0e2ad4a0ba1f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:07.305258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389ec6cf-147d-4449-bf05-0e2ad4a0ba1f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:07.305704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389ec6cf-147d-4449-bf05-0e2ad4a0ba1f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:07.307874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389ec6cf-147d-4449-bf05-0e2ad4a0ba1f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:07.307874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389ec6cf-147d-4449-bf05-0e2ad4a0ba1f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:07.307874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389ec6cf-147d-4449-bf05-0e2ad4a0ba1f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:07.312557 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2261/4518] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:07 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:07.317714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-540007e9-271b-4cc3-a371-a0d22607ed12 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb564904700>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:07.351587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-540007e9-271b-4cc3-a371-a0d22607ed12 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:07.352245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.security_group_api [None req-540007e9-271b-4cc3-a371-a0d22607ed12 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Neutron security group e16372a9-c87b-47cc-9731-939b62c6ee86 not found {{(pid=128547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:15:07.352870 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-540007e9-271b-4cc3-a371-a0d22607ed12 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:07.352870 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-5a3b12be-db24-42a3-8410-a57fe849fef7'] Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-540007e9-271b-4cc3-a371-a0d22607ed12 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-security-groups/e16372a9-c87b-47cc-9731-939b62c6ee86 HTTP/1.1 Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: exception: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-5a3b12be-db24-42a3-8410-a57fe849fef7'] Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e16372a9-c87b-47cc-9731-939b62c6ee86'} Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:07.355431 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a3b12be-db24-42a3-8410-a57fe849fef7'] Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a3b12be-db24-42a3-8410-a57fe849fef7'] Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a3b12be-db24-42a3-8410-a57fe849fef7'] Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a3b12be-db24-42a3-8410-a57fe849fef7'] Aug 27 05:15:07.359324 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:07.363207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-540007e9-271b-4cc3-a371-a0d22607ed12 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:07.363207 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-5a3b12be-db24-42a3-8410-a57fe849fef7'] {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:07.364405 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-540007e9-271b-4cc3-a371-a0d22607ed12 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/e16372a9-c87b-47cc-9731-939b62c6ee86" status: 404 len: 194 microversion: 2.1 time: 0.050632 Aug 27 05:15:07.365157 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2262/4519] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 05:15:07 2022] GET /compute/v2.1/os-security-groups/e16372a9-c87b-47cc-9731-939b62c6ee86 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:07.374603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b1a4238d-8931-4c71-a114-6cfba2ae118a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb5648004c0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:07.524216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-389ec6cf-147d-4449-bf05-0e2ad4a0ba1f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:07.539546 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-389ec6cf-147d-4449-bf05-0e2ad4a0ba1f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1312 microversion: 2.1 time: 0.255304 Aug 27 05:15:07.553201 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2258/4520] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:07 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:07.661414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:07.662920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:07.670698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:07.671874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:07.672530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:07.673477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:07.674381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:07.675134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:08.015824 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b1a4238d-8931-4c71-a114-6cfba2ae118a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/75615337-77cd-44e8-9b18-e4557fbfdc22" status: 202 len: 0 microversion: 2.1 time: 0.644861 Aug 27 05:15:08.017348 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2263/4521] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:07 2022] DELETE /compute/v2.1/os-security-groups/75615337-77cd-44e8-9b18-e4557fbfdc22 => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:15:08.027347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d9b4739a-fb8f-4b01-a7ac-b409f76620e9 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb5649041f0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:08.065585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-d9b4739a-fb8f-4b01-a7ac-b409f76620e9 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:08.066391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.security_group_api [None req-d9b4739a-fb8f-4b01-a7ac-b409f76620e9 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Neutron security group 75615337-77cd-44e8-9b18-e4557fbfdc22 not found {{(pid=128547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:15:08.067199 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-d9b4739a-fb8f-4b01-a7ac-b409f76620e9 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:08.067199 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-69121c1e-4db1-4844-9ca2-c42a7c012351'] Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d9b4739a-fb8f-4b01-a7ac-b409f76620e9 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-security-groups/75615337-77cd-44e8-9b18-e4557fbfdc22 HTTP/1.1 Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: exception: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-69121c1e-4db1-4844-9ca2-c42a7c012351'] Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '75615337-77cd-44e8-9b18-e4557fbfdc22'} Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:08.069040 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69121c1e-4db1-4844-9ca2-c42a7c012351'] Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69121c1e-4db1-4844-9ca2-c42a7c012351'] Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69121c1e-4db1-4844-9ca2-c42a7c012351'] Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69121c1e-4db1-4844-9ca2-c42a7c012351'] Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d9b4739a-fb8f-4b01-a7ac-b409f76620e9 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:08.072951 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-69121c1e-4db1-4844-9ca2-c42a7c012351'] {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:08.075447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:08.075546 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d9b4739a-fb8f-4b01-a7ac-b409f76620e9 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/75615337-77cd-44e8-9b18-e4557fbfdc22" status: 404 len: 194 microversion: 2.1 time: 0.048946 Aug 27 05:15:08.075546 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2264/4522] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 05:15:08 2022] GET /compute/v2.1/os-security-groups/75615337-77cd-44e8-9b18-e4557fbfdc22 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:08.083603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec841e79-0e4b-4d19-8d6e-a292074feaf0 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb56587c670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:08.084656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:08.086186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:08.088051 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fb776fd0-50b7-4c86-a9a9-ae71dab48686 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1722 microversion: 2.20 time: 0.432533 Aug 27 05:15:08.088871 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2259/4523] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:07 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1722 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:08.292378 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec841e79-0e4b-4d19-8d6e-a292074feaf0 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/d0a03b68-1abd-4566-be1c-f4383db8d02c" status: 202 len: 0 microversion: 2.1 time: 0.216314 Aug 27 05:15:08.293011 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2265/4524] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:08 2022] DELETE /compute/v2.1/os-security-groups/d0a03b68-1abd-4566-be1c-f4383db8d02c => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:08.301040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4dd107a4-1c1f-48a9-9706-3a4d370dd0a0 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb569698b80>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:08.330055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-4dd107a4-1c1f-48a9-9706-3a4d370dd0a0 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:08.333077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-4dd107a4-1c1f-48a9-9706-3a4d370dd0a0 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Neutron security group d0a03b68-1abd-4566-be1c-f4383db8d02c not found {{(pid=128548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:15:08.333868 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-4dd107a4-1c1f-48a9-9706-3a4d370dd0a0 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:08.333868 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-18c731a6-87fb-4d47-8118-4b822a95eae8'] Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4dd107a4-1c1f-48a9-9706-3a4d370dd0a0 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/os-security-groups/d0a03b68-1abd-4566-be1c-f4383db8d02c HTTP/1.1 Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-18c731a6-87fb-4d47-8118-4b822a95eae8'] Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd0a03b68-1abd-4566-be1c-f4383db8d02c'} Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:08.336131 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18c731a6-87fb-4d47-8118-4b822a95eae8'] Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18c731a6-87fb-4d47-8118-4b822a95eae8'] Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18c731a6-87fb-4d47-8118-4b822a95eae8'] Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18c731a6-87fb-4d47-8118-4b822a95eae8'] Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4dd107a4-1c1f-48a9-9706-3a4d370dd0a0 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:08.341076 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-18c731a6-87fb-4d47-8118-4b822a95eae8'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:08.344560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a0d86e6c-bcbb-4b4f-be59-311d6c88513e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:08.344672 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4dd107a4-1c1f-48a9-9706-3a4d370dd0a0 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/d0a03b68-1abd-4566-be1c-f4383db8d02c" status: 404 len: 194 microversion: 2.1 time: 0.041008 Aug 27 05:15:08.344672 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2260/4525] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 05:15:08 2022] GET /compute/v2.1/os-security-groups/d0a03b68-1abd-4566-be1c-f4383db8d02c => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:08.344851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a0d86e6c-bcbb-4b4f-be59-311d6c88513e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:08.354806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3de184da-ee45-4f6a-bd58-ae5d5b961398 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb564b9bdc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:08.356144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0d86e6c-bcbb-4b4f-be59-311d6c88513e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:08.356823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0d86e6c-bcbb-4b4f-be59-311d6c88513e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:08.357517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0d86e6c-bcbb-4b4f-be59-311d6c88513e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:08.358572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0d86e6c-bcbb-4b4f-be59-311d6c88513e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:08.359326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0d86e6c-bcbb-4b4f-be59-311d6c88513e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:08.359957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0d86e6c-bcbb-4b4f-be59-311d6c88513e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:08.588438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a0d86e6c-bcbb-4b4f-be59-311d6c88513e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:08.593265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:08.601584 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a0d86e6c-bcbb-4b4f-be59-311d6c88513e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1487 microversion: 2.1 time: 0.278322 Aug 27 05:15:08.602357 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2266/4526] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:08 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1487 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:08.608660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-186f83cf-6231-4fdd-a8e5-c179403a4d0c tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:08.609557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-186f83cf-6231-4fdd-a8e5-c179403a4d0c tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:08.636730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-186f83cf-6231-4fdd-a8e5-c179403a4d0c tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:08.637372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-186f83cf-6231-4fdd-a8e5-c179403a4d0c tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:08.640098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-186f83cf-6231-4fdd-a8e5-c179403a4d0c tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:08.640804 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3de184da-ee45-4f6a-bd58-ae5d5b961398 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.292217 Aug 27 05:15:08.641065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-186f83cf-6231-4fdd-a8e5-c179403a4d0c tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:08.641539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-186f83cf-6231-4fdd-a8e5-c179403a4d0c tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:08.642067 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2261/4527] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 05:15:08 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:08.642239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-186f83cf-6231-4fdd-a8e5-c179403a4d0c tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:08.649539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-49fc3c0c-4124-4659-b636-831033c3ce32 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1815834825"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:08.652408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-49fc3c0c-4124-4659-b636-831033c3ce32 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:08.668853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49fc3c0c-4124-4659-b636-831033c3ce32 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:08.669541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49fc3c0c-4124-4659-b636-831033c3ce32 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:08.669956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49fc3c0c-4124-4659-b636-831033c3ce32 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:08.671119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49fc3c0c-4124-4659-b636-831033c3ce32 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:08.671665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49fc3c0c-4124-4659-b636-831033c3ce32 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:08.672165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49fc3c0c-4124-4659-b636-831033c3ce32 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:08.747806 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-49fc3c0c-4124-4659-b636-831033c3ce32 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "PUT /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1061 microversion: 2.1 time: 0.104272 Aug 27 05:15:08.751296 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2262/4528] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:15:08 2022] PUT /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1061 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:08.757435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b39737de-230c-47c2-8f3e-a8c09b4b8131 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'create', calling method: .version_select at 0x7fb564be9ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1663153428", "description": "tempest-description-700776512"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:08.852528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-186f83cf-6231-4fdd-a8e5-c179403a4d0c tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:08.866005 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-186f83cf-6231-4fdd-a8e5-c179403a4d0c tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1333 microversion: 2.1 time: 0.262328 Aug 27 05:15:08.867430 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2267/4529] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:08 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1333 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:08.873099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd823969-b14a-4acd-9db3-e738def6e5c0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:08.873993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd823969-b14a-4acd-9db3-e738def6e5c0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:08.884816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd823969-b14a-4acd-9db3-e738def6e5c0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:08.885957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd823969-b14a-4acd-9db3-e738def6e5c0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:08.886766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd823969-b14a-4acd-9db3-e738def6e5c0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:08.889066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd823969-b14a-4acd-9db3-e738def6e5c0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:08.890246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd823969-b14a-4acd-9db3-e738def6e5c0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:08.891078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd823969-b14a-4acd-9db3-e738def6e5c0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:09.074798 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b39737de-230c-47c2-8f3e-a8c09b4b8131 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.321718 Aug 27 05:15:09.076087 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2263/4530] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:15:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:09.091127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4fd8e452-faf6-48b7-b3ee-0134364d9e81 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'create', calling method: .version_select at 0x7fb56969ce50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1164177383", "description": "tempest-description-1915318883"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:09.156974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dd823969-b14a-4acd-9db3-e738def6e5c0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:09.165833 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd823969-b14a-4acd-9db3-e738def6e5c0 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1488 microversion: 2.1 time: 0.297143 Aug 27 05:15:09.166748 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2268/4531] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:08 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1488 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:09.172197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:09.173057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:09.179468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:09.180303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:09.180954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:09.182033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:09.182913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:09.183631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:09.391426 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4fd8e452-faf6-48b7-b3ee-0134364d9e81 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.305422 Aug 27 05:15:09.404646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:09.416839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:09.418307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:09.420001 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e5862196-58d7-409e-997b-202a6aa51d37 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1722 microversion: 2.20 time: 0.251436 Aug 27 05:15:09.420001 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2269/4532] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:09 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:09.432169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4b1cdbc4-cf9d-4f8e-9ccc-e44e8cca73c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:09.433050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4b1cdbc4-cf9d-4f8e-9ccc-e44e8cca73c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:09.434328 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2264/4533] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:15:09 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:09.442731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b1cdbc4-cf9d-4f8e-9ccc-e44e8cca73c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:09.443524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b1cdbc4-cf9d-4f8e-9ccc-e44e8cca73c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:09.444137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b1cdbc4-cf9d-4f8e-9ccc-e44e8cca73c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:09.445034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b1cdbc4-cf9d-4f8e-9ccc-e44e8cca73c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:09.445644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b1cdbc4-cf9d-4f8e-9ccc-e44e8cca73c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:09.446776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b1cdbc4-cf9d-4f8e-9ccc-e44e8cca73c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:09.483183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1387101644", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "951782e2-b687-44c2-a8d0-a05e5ba80574"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:09.542181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] validate_networks() for [('951782e2-b687-44c2-a8d0-a05e5ba80574', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:15:09.679119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4b1cdbc4-cf9d-4f8e-9ccc-e44e8cca73c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:09.689268 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4b1cdbc4-cf9d-4f8e-9ccc-e44e8cca73c7 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1488 microversion: 2.1 time: 0.267438 Aug 27 05:15:09.690928 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2270/4534] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:09 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1488 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:09.714997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0bc2310b-90a2-4068-a29e-e8fb90556890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:09.715658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0bc2310b-90a2-4068-a29e-e8fb90556890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:09.724363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc2310b-90a2-4068-a29e-e8fb90556890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:09.725031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc2310b-90a2-4068-a29e-e8fb90556890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:09.725571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc2310b-90a2-4068-a29e-e8fb90556890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:09.726914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc2310b-90a2-4068-a29e-e8fb90556890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:09.728042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc2310b-90a2-4068-a29e-e8fb90556890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:09.728721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bc2310b-90a2-4068-a29e-e8fb90556890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:09.761359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0bc2310b-90a2-4068-a29e-e8fb90556890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:15:09.888312 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0bc2310b-90a2-4068-a29e-e8fb90556890 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 204 len: 0 microversion: 2.1 time: 0.177608 Aug 27 05:15:09.891555 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2271/4535] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:09 2022] DELETE /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:15:09.899661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2318cb02-861e-4bf7-8bef-979dc8f4d69d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:09.899873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2318cb02-861e-4bf7-8bef-979dc8f4d69d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:09.911784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2318cb02-861e-4bf7-8bef-979dc8f4d69d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:09.912288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2318cb02-861e-4bf7-8bef-979dc8f4d69d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:09.912737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2318cb02-861e-4bf7-8bef-979dc8f4d69d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:09.913450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2318cb02-861e-4bf7-8bef-979dc8f4d69d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:09.913904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2318cb02-861e-4bf7-8bef-979dc8f4d69d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:09.914324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2318cb02-861e-4bf7-8bef-979dc8f4d69d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.136985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:15:10.137580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:15:10.138492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:15:10.138969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:15:10.139731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:15:10.150991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:10.151519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:10.152151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.152892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:10.153344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:10.153802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.174313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2318cb02-861e-4bf7-8bef-979dc8f4d69d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:10.178874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Getting quotas for project d9240388d4fa4d02adec50746d5a95d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:15:10.188177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Getting quotas for user ee93433499ee4ccd9644173eb2e1a4ea and project d9240388d4fa4d02adec50746d5a95d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:15:10.189145 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2318cb02-861e-4bf7-8bef-979dc8f4d69d tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1333 microversion: 2.1 time: 0.294490 Aug 27 05:15:10.189892 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2272/4536] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:09 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1333 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:10.203516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:15:10.205991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:15:10.210779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23334821-5210-42fe-804a-51dfee166c00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:10.211810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-23334821-5210-42fe-804a-51dfee166c00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:10.218697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23334821-5210-42fe-804a-51dfee166c00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:10.219437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23334821-5210-42fe-804a-51dfee166c00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:10.220035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23334821-5210-42fe-804a-51dfee166c00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.220948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23334821-5210-42fe-804a-51dfee166c00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:10.221491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23334821-5210-42fe-804a-51dfee166c00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:10.222624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23334821-5210-42fe-804a-51dfee166c00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.258398 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-279d9e6d-e448-4edb-bbf4-353ffb1bc9c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779528 Aug 27 05:15:10.265392 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2265/4537] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:15:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:15:10.272148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d87887a-31f4-4615-a631-696cc92f1fec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:10.273732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7d87887a-31f4-4615-a631-696cc92f1fec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:10.399227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7d87887a-31f4-4615-a631-696cc92f1fec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:10.415491 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d87887a-31f4-4615-a631-696cc92f1fec tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1216 microversion: 2.1 time: 0.148635 Aug 27 05:15:10.417243 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2266/4538] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:10 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:10.434820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23334821-5210-42fe-804a-51dfee166c00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:10.443532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:10.444181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:10.448798 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-23334821-5210-42fe-804a-51dfee166c00 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1494 microversion: 2.1 time: 0.244275 Aug 27 05:15:10.449839 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2273/4539] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:10 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1494 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:10.453689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:10.454408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:10.455016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.457360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:10.458317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:10.458937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.580116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f62d012e-063e-4e20-9713-1731058ce309 req-561decaf-8c0a-49f6-ac4b-5e8caf2ef73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4498264f-9b1d-45e7-ac47-fa063bbce8ab", "tag": "b7410f35-32ab-4ed2-9666-cd5a034fc9b0"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:10.595443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f62d012e-063e-4e20-9713-1731058ce309 req-561decaf-8c0a-49f6-ac4b-5e8caf2ef73c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:10.595943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f62d012e-063e-4e20-9713-1731058ce309 req-561decaf-8c0a-49f6-ac4b-5e8caf2ef73c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:10.596421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f62d012e-063e-4e20-9713-1731058ce309 req-561decaf-8c0a-49f6-ac4b-5e8caf2ef73c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.611365 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f62d012e-063e-4e20-9713-1731058ce309 req-561decaf-8c0a-49f6-ac4b-5e8caf2ef73c service nova] Creating event network-changed:b7410f35-32ab-4ed2-9666-cd5a034fc9b0 for instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab on n-h2-820368-35 Aug 27 05:15:10.619707 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f62d012e-063e-4e20-9713-1731058ce309 req-561decaf-8c0a-49f6-ac4b-5e8caf2ef73c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041632 Aug 27 05:15:10.621550 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2274/4540] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:10.655214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:10.663960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:10.666154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:10.668463 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-befece90-3c94-417a-9e0c-ad21994a4bf1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1743 microversion: 2.20 time: 0.228837 Aug 27 05:15:10.669193 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2267/4541] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:10 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1743 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:11.217245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9022efcc-7388-4e0b-9f49-376edfde19cd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:11.218560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9022efcc-7388-4e0b-9f49-376edfde19cd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:11.233745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9022efcc-7388-4e0b-9f49-376edfde19cd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:11.234239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9022efcc-7388-4e0b-9f49-376edfde19cd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:11.234860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9022efcc-7388-4e0b-9f49-376edfde19cd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:11.236445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9022efcc-7388-4e0b-9f49-376edfde19cd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:11.237079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9022efcc-7388-4e0b-9f49-376edfde19cd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:11.237759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9022efcc-7388-4e0b-9f49-376edfde19cd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:11.440598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d0850f5e-d2e9-45ca-b383-dba3fd6b598b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:11.441313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d0850f5e-d2e9-45ca-b383-dba3fd6b598b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:11.448594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0850f5e-d2e9-45ca-b383-dba3fd6b598b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:11.449249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0850f5e-d2e9-45ca-b383-dba3fd6b598b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:11.449697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0850f5e-d2e9-45ca-b383-dba3fd6b598b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:11.450424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0850f5e-d2e9-45ca-b383-dba3fd6b598b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:11.450889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0850f5e-d2e9-45ca-b383-dba3fd6b598b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:11.451405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d0850f5e-d2e9-45ca-b383-dba3fd6b598b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:11.456023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:11.567488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9022efcc-7388-4e0b-9f49-376edfde19cd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:11.572481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d0850f5e-d2e9-45ca-b383-dba3fd6b598b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:11.584693 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9022efcc-7388-4e0b-9f49-376edfde19cd tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1333 microversion: 2.1 time: 0.369942 Aug 27 05:15:11.585599 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2275/4542] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:11 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1333 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:11.589603 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d0850f5e-d2e9-45ca-b383-dba3fd6b598b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1268 microversion: 2.1 time: 0.151136 Aug 27 05:15:11.590985 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2268/4543] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:11 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:11.598447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9bb4fa09-f2fa-40f4-830d-65c65ae781f6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:11.599062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9bb4fa09-f2fa-40f4-830d-65c65ae781f6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:11.611008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bb4fa09-f2fa-40f4-830d-65c65ae781f6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:11.611819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bb4fa09-f2fa-40f4-830d-65c65ae781f6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:11.612968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bb4fa09-f2fa-40f4-830d-65c65ae781f6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:11.613841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bb4fa09-f2fa-40f4-830d-65c65ae781f6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:11.614450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bb4fa09-f2fa-40f4-830d-65c65ae781f6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:11.615026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9bb4fa09-f2fa-40f4-830d-65c65ae781f6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:11.694907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:11.695611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:11.706608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:11.721867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:11.723012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:11.724339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:11.724970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:11.725558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:11.841403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9bb4fa09-f2fa-40f4-830d-65c65ae781f6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:11.870673 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9bb4fa09-f2fa-40f4-830d-65c65ae781f6 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1494 microversion: 2.1 time: 0.282377 Aug 27 05:15:11.871781 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2276/4544] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:11 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1494 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:12.067720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:12.076896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:12.078355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:12.080225 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bddeabbd-6cfd-4794-8693-871fad318fb2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1743 microversion: 2.20 time: 0.391438 Aug 27 05:15:12.081845 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2269/4545] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:11 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1743 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:12.606783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-60ec9d0b-1ca1-43d8-8594-f0fee47a2959 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:12.608246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-60ec9d0b-1ca1-43d8-8594-f0fee47a2959 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:12.616128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5ccf255-4055-4f4e-829c-7e24f6398ffe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:12.617586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c5ccf255-4055-4f4e-829c-7e24f6398ffe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:12.632697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ec9d0b-1ca1-43d8-8594-f0fee47a2959 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.633652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5ccf255-4055-4f4e-829c-7e24f6398ffe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.635263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ec9d0b-1ca1-43d8-8594-f0fee47a2959 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.635510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5ccf255-4055-4f4e-829c-7e24f6398ffe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.636170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5ccf255-4055-4f4e-829c-7e24f6398ffe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.636782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ec9d0b-1ca1-43d8-8594-f0fee47a2959 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.637684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5ccf255-4055-4f4e-829c-7e24f6398ffe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.638852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ec9d0b-1ca1-43d8-8594-f0fee47a2959 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.639515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5ccf255-4055-4f4e-829c-7e24f6398ffe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.640147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ec9d0b-1ca1-43d8-8594-f0fee47a2959 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.640773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5ccf255-4055-4f4e-829c-7e24f6398ffe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.641398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60ec9d0b-1ca1-43d8-8594-f0fee47a2959 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.790334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c5ccf255-4055-4f4e-829c-7e24f6398ffe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:12.814243 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5ccf255-4055-4f4e-829c-7e24f6398ffe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1274 microversion: 2.1 time: 0.201960 Aug 27 05:15:12.817176 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2270/4546] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:12 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1274 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:12.826762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-bb8f06b4-a804-4992-9b6a-1957ac3b4e3b req-9380606f-52ef-470f-98f9-4d003071b062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4498264f-9b1d-45e7-ac47-fa063bbce8ab", "tag": "409e3819-0d57-441c-98c8-1adac98de63d"}, {"server_uuid": "83048b85-98f0-4a17-903d-89196b965312", "name": "network-vif-deleted", "tag": "353c0667-5778-4fab-afbd-69a24561dae3"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:12.838191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bb8f06b4-a804-4992-9b6a-1957ac3b4e3b req-9380606f-52ef-470f-98f9-4d003071b062 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.838863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bb8f06b4-a804-4992-9b6a-1957ac3b4e3b req-9380606f-52ef-470f-98f9-4d003071b062 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.839383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bb8f06b4-a804-4992-9b6a-1957ac3b4e3b req-9380606f-52ef-470f-98f9-4d003071b062 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.857039 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-bb8f06b4-a804-4992-9b6a-1957ac3b4e3b req-9380606f-52ef-470f-98f9-4d003071b062 service nova] Creating event network-changed:409e3819-0d57-441c-98c8-1adac98de63d for instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab on n-h2-820368-35 Aug 27 05:15:12.857391 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-bb8f06b4-a804-4992-9b6a-1957ac3b4e3b req-9380606f-52ef-470f-98f9-4d003071b062 service nova] Creating event network-vif-deleted:353c0667-5778-4fab-afbd-69a24561dae3 for instance 83048b85-98f0-4a17-903d-89196b965312 on n-h1-820368-35 Aug 27 05:15:12.870451 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-bb8f06b4-a804-4992-9b6a-1957ac3b4e3b req-9380606f-52ef-470f-98f9-4d003071b062 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050657 Aug 27 05:15:12.872376 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2271/4547] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:12.893213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:12.894500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:12.902258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.903239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.903877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.904594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.905054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.905475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.945212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.945712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.946154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.946656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lazy-loading 'fault' on Instance uuid 83048b85-98f0-4a17-903d-89196b965312 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:15:13.037519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:13.039334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-60ec9d0b-1ca1-43d8-8594-f0fee47a2959 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:13.047929 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-60ec9d0b-1ca1-43d8-8594-f0fee47a2959 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1333 microversion: 2.1 time: 0.445328 Aug 27 05:15:13.051204 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2277/4548] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:12 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1333 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:13.063644 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-817c9f5b-30fc-47cb-ac8f-cef33307ca0c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 200 len: 1310 microversion: 2.1 time: 0.164436 Aug 27 05:15:13.063644 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2272/4549] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:12 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 1310 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:13.126945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:13.128337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:13.148214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:13.148720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:13.149163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:13.149882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:13.150332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:13.151742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:13.316704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-21ad7f73-cc90-4ca3-a682-e6f7243074c7 req-46b25583-0bc6-41f2-a195-05e0f2e265c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08a333d-504a-41ad-a796-2069aecd4bd9", "name": "network-vif-plugged", "status": "completed", "tag": "6e183864-02b7-4485-8c8f-1050892f3cb4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:13.328468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-21ad7f73-cc90-4ca3-a682-e6f7243074c7 req-46b25583-0bc6-41f2-a195-05e0f2e265c9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:13.329352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-21ad7f73-cc90-4ca3-a682-e6f7243074c7 req-46b25583-0bc6-41f2-a195-05e0f2e265c9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:13.330015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-21ad7f73-cc90-4ca3-a682-e6f7243074c7 req-46b25583-0bc6-41f2-a195-05e0f2e265c9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:13.345909 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-21ad7f73-cc90-4ca3-a682-e6f7243074c7 req-46b25583-0bc6-41f2-a195-05e0f2e265c9 service nova] Creating event network-vif-plugged:6e183864-02b7-4485-8c8f-1050892f3cb4 for instance e08a333d-504a-41ad-a796-2069aecd4bd9 on n-h2-820368-35 Aug 27 05:15:13.354757 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-21ad7f73-cc90-4ca3-a682-e6f7243074c7 req-46b25583-0bc6-41f2-a195-05e0f2e265c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041650 Aug 27 05:15:13.355991 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2278/4550] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:13.493897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:13.517189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:13.519201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:13.520447 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb1c68b2-2b20-42ef-916b-c6d2665d7ff0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1743 microversion: 2.20 time: 0.417655 Aug 27 05:15:13.521275 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2273/4551] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:13 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1743 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:13.844129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-60e71196-b1cd-407d-b007-d6c52d709dd1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:13.845919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-60e71196-b1cd-407d-b007-d6c52d709dd1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:13.855780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60e71196-b1cd-407d-b007-d6c52d709dd1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:13.857041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60e71196-b1cd-407d-b007-d6c52d709dd1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:13.857825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60e71196-b1cd-407d-b007-d6c52d709dd1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:13.858752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60e71196-b1cd-407d-b007-d6c52d709dd1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:13.859849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60e71196-b1cd-407d-b007-d6c52d709dd1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:13.860440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-60e71196-b1cd-407d-b007-d6c52d709dd1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.072137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a104722-3706-4938-9aca-14eb50be2a47 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.073480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7a104722-3706-4938-9aca-14eb50be2a47 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.081488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a104722-3706-4938-9aca-14eb50be2a47 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.081960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a104722-3706-4938-9aca-14eb50be2a47 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.082400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a104722-3706-4938-9aca-14eb50be2a47 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.084116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a104722-3706-4938-9aca-14eb50be2a47 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.084116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a104722-3706-4938-9aca-14eb50be2a47 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.084116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a104722-3706-4938-9aca-14eb50be2a47 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.479480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-60e71196-b1cd-407d-b007-d6c52d709dd1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:14.488407 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-60e71196-b1cd-407d-b007-d6c52d709dd1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1316 microversion: 2.1 time: 0.651800 Aug 27 05:15:14.489468 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2279/4552] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:13 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1316 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:14.494712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.495541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.501930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.502903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.503531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.504405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.505665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.506543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.532603 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 HTTP/1.1 Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '83048b85-98f0-4a17-903d-89196b965312'} Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.534808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.547007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.547007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.547007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.547007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:14.547007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:14.547007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.547007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.547007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:14.547007 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6169c4c5-ec57-45fe-a22b-bf2147ab8e28 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 404 len: 111 microversion: 2.1 time: 0.045900 Aug 27 05:15:14.547007 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2280/4553] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:14 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:14.557223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.557839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.563725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.564209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.564656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.565384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.566394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.566816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.601942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7a104722-3706-4938-9aca-14eb50be2a47 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:14.610116 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a104722-3706-4938-9aca-14eb50be2a47 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1333 microversion: 2.1 time: 0.543089 Aug 27 05:15:14.610698 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2274/4554] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:14 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1333 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:14.616400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.617130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.623685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.624183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.624624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.625338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.625804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.626234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.640536 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 HTTP/1.1 Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '83048b85-98f0-4a17-903d-89196b965312'} Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:14.642433 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-78f75601-dbd3-4101-a667-91589901a01a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 404 len: 111 microversion: 2.1 time: 0.032043 Aug 27 05:15:14.648192 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2275/4555] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:14 2022] DELETE /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:14.653610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.654227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 83048b85-98f0-4a17-903d-89196b965312] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.660261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.660754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.661203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.661905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.662365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.662800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.677167 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 HTTP/1.1 Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '83048b85-98f0-4a17-903d-89196b965312'} Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.679223 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.683572 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.683572 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.683572 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.683572 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:14.683572 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:14.683572 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. Aug 27 05:15:14.683572 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.683572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 83048b85-98f0-4a17-903d-89196b965312 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:14.683572 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d7c56d1a-1a13-4d48-b94c-9f9751991e3b tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312" status: 404 len: 111 microversion: 2.1 time: 0.030281 Aug 27 05:15:14.683572 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2276/4556] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:14 2022] GET /compute/v2.1/servers/83048b85-98f0-4a17-903d-89196b965312 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:15:14.688659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.689168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.695889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.696391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.696841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.697559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.698017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.698634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.714747 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 HTTP/1.1 Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'eaa690f1-d939-4d44-8cd5-187c582696c7'} Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:14.716450 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f65dfab-fd04-41c9-8f7a-295ffebd4f9a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 404 len: 111 microversion: 2.1 time: 0.033088 Aug 27 05:15:14.720452 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2277/4557] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:14 2022] DELETE /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:15:14.726270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.726884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: eaa690f1-d939-4d44-8cd5-187c582696c7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.732932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.733415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.733857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.734560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.735019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.735475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.750194 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 HTTP/1.1 Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'eaa690f1-d939-4d44-8cd5-187c582696c7'} Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.751798 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.758526 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.758526 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.758526 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.758526 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:14.758526 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:14.758526 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. Aug 27 05:15:14.758526 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.758526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance eaa690f1-d939-4d44-8cd5-187c582696c7 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:14.758526 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-25afe9ee-fbee-4ccd-95f0-2a4b3f082fea tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7" status: 404 len: 111 microversion: 2.1 time: 0.030522 Aug 27 05:15:14.758526 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2278/4558] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:14 2022] GET /compute/v2.1/servers/eaa690f1-d939-4d44-8cd5-187c582696c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:15:14.763164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.763672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.769947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.770442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.770886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.771633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.772101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.772535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.786916 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:15:14.787727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 HTTP/1.1 Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'ad4ba155-37ea-46b7-b986-d8e0756edec9'} Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:14.788733 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-478ad992-95f7-4a7a-8340-ec09f8cd357c tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 404 len: 111 microversion: 2.1 time: 0.032619 Aug 27 05:15:14.793890 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2279/4559] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:14 2022] DELETE /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:15:14.801410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.802041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: ad4ba155-37ea-46b7-b986-d8e0756edec9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.807163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:14.812220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.812719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.813339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.814068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.814520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.815138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.824513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:14.826487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:14.828002 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d9b4a13-db2f-4d4d-a7a5-07ee54c03f46 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1743 microversion: 2.20 time: 0.274680 Aug 27 05:15:14.828949 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2281/4560] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:14 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1743 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:14.843071 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 HTTP/1.1 Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'ad4ba155-37ea-46b7-b986-d8e0756edec9'} Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.844970 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.849260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.849260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.849260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.849260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:14.849260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:14.849260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. Aug 27 05:15:14.849260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.849260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance ad4ba155-37ea-46b7-b986-d8e0756edec9 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:14.849260 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8a214e40-4616-435a-9575-9f702620655a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9" status: 404 len: 111 microversion: 2.1 time: 0.050474 Aug 27 05:15:14.849260 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2280/4561] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:14 2022] GET /compute/v2.1/servers/ad4ba155-37ea-46b7-b986-d8e0756edec9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:14.856325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.857105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.865042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.865535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.865973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.866703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.867413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.868344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.884474 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac HTTP/1.1 Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '990fabb7-dca0-43bb-92c4-93645540f6ac'} Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:14.886064 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9f4e3f72-0fa1-4882-8181-54fc284def2e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 404 len: 111 microversion: 2.1 time: 0.035543 Aug 27 05:15:14.892023 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2282/4562] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:14 2022] DELETE /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:15:14.894522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-394ed29e-9b30-4aa5-b784-3e10b0e2cc4d req-d84d664c-f29b-422b-945f-2d292a4509ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28389f5a-754e-4bb2-95fc-909ef29e9bc8", "tag": "534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:14.902752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.903971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-394ed29e-9b30-4aa5-b784-3e10b0e2cc4d req-d84d664c-f29b-422b-945f-2d292a4509ec service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.904542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-394ed29e-9b30-4aa5-b784-3e10b0e2cc4d req-d84d664c-f29b-422b-945f-2d292a4509ec service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.904988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-394ed29e-9b30-4aa5-b784-3e10b0e2cc4d req-d84d664c-f29b-422b-945f-2d292a4509ec service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.906351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 990fabb7-dca0-43bb-92c4-93645540f6ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.917839 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-394ed29e-9b30-4aa5-b784-3e10b0e2cc4d req-d84d664c-f29b-422b-945f-2d292a4509ec service nova] Creating event network-changed:534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67 for instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 on n-h2-820368-35 Aug 27 05:15:14.918037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.918763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.919313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.920210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.920739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.921236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.922843 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-394ed29e-9b30-4aa5-b784-3e10b0e2cc4d req-d84d664c-f29b-422b-945f-2d292a4509ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038503 Aug 27 05:15:14.923499 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2281/4563] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:14.939320 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac HTTP/1.1 Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '990fabb7-dca0-43bb-92c4-93645540f6ac'} Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.941497 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.945575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.945575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.945575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.945575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:14.945575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:14.945575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. Aug 27 05:15:14.945575 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.945575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 990fabb7-dca0-43bb-92c4-93645540f6ac could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:14.945575 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7dc2ada9-8ea7-47c3-ae17-a9c2845bbcec tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac" status: 404 len: 111 microversion: 2.1 time: 0.046678 Aug 27 05:15:14.945575 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2283/4564] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:14 2022] GET /compute/v2.1/servers/990fabb7-dca0-43bb-92c4-93645540f6ac => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:14.952950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.953547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.959944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.960668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.961304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.962274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.962734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.963189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.977643 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 HTTP/1.1 Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd2179539-1d65-4da2-9ffa-cc66ee2000a1'} Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:14.979372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3b620fa6-8476-44b7-a701-a898fc20dd68 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 404 len: 111 microversion: 2.1 time: 0.032449 Aug 27 05:15:14.984102 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2282/4565] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:14 2022] DELETE /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:14.990823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.991509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: d2179539-1d65-4da2-9ffa-cc66ee2000a1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.993766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:14.999408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.999901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.000405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.001055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.001513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.002005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.017188 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 HTTP/1.1 Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'd2179539-1d65-4da2-9ffa-cc66ee2000a1'} Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:15.018764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.023902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.023902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:15.023902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:15.023902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:15.023902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:15.023902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. Aug 27 05:15:15.023902 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.023902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance d2179539-1d65-4da2-9ffa-cc66ee2000a1 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:15.023902 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-74aa544b-4bc1-42db-8f63-648052c67076 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1" status: 404 len: 111 microversion: 2.1 time: 0.033844 Aug 27 05:15:15.023902 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2284/4566] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:14 2022] GET /compute/v2.1/servers/d2179539-1d65-4da2-9ffa-cc66ee2000a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:15.029777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:15.030291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:15.036589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.037541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.038174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.042659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.046167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.046839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.062801 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a HTTP/1.1 Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '8e48b153-aae9-4313-8baf-057bfa027e6a'} Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:15.064467 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a032dfdd-d1bd-4447-8552-3328e1e4e63a tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 404 len: 111 microversion: 2.1 time: 0.041043 Aug 27 05:15:15.070490 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2283/4567] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:15 2022] DELETE /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:15.075342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:15.075962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 8e48b153-aae9-4313-8baf-057bfa027e6a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:15.081865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.082367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.082790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.083522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.083975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.084405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.101033 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a HTTP/1.1 Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '8e48b153-aae9-4313-8baf-057bfa027e6a'} Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:15.102751 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.107784 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.107784 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:15.107784 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:15.107784 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:15.107784 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:15.107784 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. Aug 27 05:15:15.107784 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.107784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 8e48b153-aae9-4313-8baf-057bfa027e6a could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:15.107784 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-846458ec-8a02-4737-9d51-26bc9b6e75e2 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a" status: 404 len: 111 microversion: 2.1 time: 0.032691 Aug 27 05:15:15.107784 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2285/4568] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:15 2022] GET /compute/v2.1/servers/8e48b153-aae9-4313-8baf-057bfa027e6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:15.115797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78831c5e-c8c7-4c4c-aa82-2c83fa29b33e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:15.116402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-78831c5e-c8c7-4c4c-aa82-2c83fa29b33e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 764f0c62-714d-48a3-a991-66abbebdfeb6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:15.123487 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-78831c5e-c8c7-4c4c-aa82-2c83fa29b33e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78831c5e-c8c7-4c4c-aa82-2c83fa29b33e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/764f0c62-714d-48a3-a991-66abbebdfeb6 HTTP/1.1 Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '764f0c62-714d-48a3-a991-66abbebdfeb6'} Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:15.125114 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.129670 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.129670 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:15.129670 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:15.129670 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:15.129670 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:15.129670 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:15:15.129670 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.129670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78831c5e-c8c7-4c4c-aa82-2c83fa29b33e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:15.129670 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-78831c5e-c8c7-4c4c-aa82-2c83fa29b33e tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/764f0c62-714d-48a3-a991-66abbebdfeb6" status: 404 len: 111 microversion: 2.1 time: 0.015692 Aug 27 05:15:15.129670 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2284/4569] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:15 2022] DELETE /compute/v2.1/servers/764f0c62-714d-48a3-a991-66abbebdfeb6 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:15.136469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dfb7730b-b562-46b5-a2ca-3d05e07501a3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:15.137160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dfb7730b-b562-46b5-a2ca-3d05e07501a3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 764f0c62-714d-48a3-a991-66abbebdfeb6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:15.142762 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-dfb7730b-b562-46b5-a2ca-3d05e07501a3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dfb7730b-b562-46b5-a2ca-3d05e07501a3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/764f0c62-714d-48a3-a991-66abbebdfeb6 HTTP/1.1 Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '764f0c62-714d-48a3-a991-66abbebdfeb6'} Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:15.144520 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:15.148593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:15.148593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:15.148593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:15.148593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. Aug 27 05:15:15.148593 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:15.148593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dfb7730b-b562-46b5-a2ca-3d05e07501a3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 764f0c62-714d-48a3-a991-66abbebdfeb6 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:15.148593 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dfb7730b-b562-46b5-a2ca-3d05e07501a3 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/764f0c62-714d-48a3-a991-66abbebdfeb6" status: 404 len: 111 microversion: 2.1 time: 0.013691 Aug 27 05:15:15.148593 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2286/4570] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:15 2022] GET /compute/v2.1/servers/764f0c62-714d-48a3-a991-66abbebdfeb6 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:15.157225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0c42130d-4588-4ffc-b5de-fe7ec4f8909d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:15.158039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c42130d-4588-4ffc-b5de-fe7ec4f8909d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:15.162769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:15.167016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c42130d-4588-4ffc-b5de-fe7ec4f8909d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.167593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c42130d-4588-4ffc-b5de-fe7ec4f8909d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.168032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c42130d-4588-4ffc-b5de-fe7ec4f8909d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.168745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c42130d-4588-4ffc-b5de-fe7ec4f8909d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.169322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c42130d-4588-4ffc-b5de-fe7ec4f8909d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.169752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c42130d-4588-4ffc-b5de-fe7ec4f8909d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.200287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c42130d-4588-4ffc-b5de-fe7ec4f8909d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:15:15.287665 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0c42130d-4588-4ffc-b5de-fe7ec4f8909d tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 204 len: 0 microversion: 2.1 time: 0.135862 Aug 27 05:15:15.288178 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2285/4571] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:15 2022] DELETE /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:15:15.297325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-959c4c83-43d8-401b-ae81-b6d1b16bbf17 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:15.298036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-959c4c83-43d8-401b-ae81-b6d1b16bbf17 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:15.305498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959c4c83-43d8-401b-ae81-b6d1b16bbf17 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.306272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959c4c83-43d8-401b-ae81-b6d1b16bbf17 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.306838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959c4c83-43d8-401b-ae81-b6d1b16bbf17 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.307912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959c4c83-43d8-401b-ae81-b6d1b16bbf17 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.308494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959c4c83-43d8-401b-ae81-b6d1b16bbf17 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.308927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-959c4c83-43d8-401b-ae81-b6d1b16bbf17 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.327826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:15.512671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b4a98a3f-3dd5-45c7-88ff-39914617ed7b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:15.513384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b4a98a3f-3dd5-45c7-88ff-39914617ed7b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:15.519962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4a98a3f-3dd5-45c7-88ff-39914617ed7b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.520454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4a98a3f-3dd5-45c7-88ff-39914617ed7b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.520910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4a98a3f-3dd5-45c7-88ff-39914617ed7b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.521606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4a98a3f-3dd5-45c7-88ff-39914617ed7b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.522068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4a98a3f-3dd5-45c7-88ff-39914617ed7b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.522498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4a98a3f-3dd5-45c7-88ff-39914617ed7b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.539773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-959c4c83-43d8-401b-ae81-b6d1b16bbf17 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:15.548350 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-959c4c83-43d8-401b-ae81-b6d1b16bbf17 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1481 microversion: 2.1 time: 0.255194 Aug 27 05:15:15.550272 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2287/4572] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:15 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1481 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:15.631345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e87fe88-cbcc-49c5-ab7f-2a9c3163d9bc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:15.631964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e87fe88-cbcc-49c5-ab7f-2a9c3163d9bc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:15.638960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e87fe88-cbcc-49c5-ab7f-2a9c3163d9bc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.639688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e87fe88-cbcc-49c5-ab7f-2a9c3163d9bc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.640173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e87fe88-cbcc-49c5-ab7f-2a9c3163d9bc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.640873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e87fe88-cbcc-49c5-ab7f-2a9c3163d9bc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.641681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e87fe88-cbcc-49c5-ab7f-2a9c3163d9bc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.641947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e87fe88-cbcc-49c5-ab7f-2a9c3163d9bc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.813390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b4a98a3f-3dd5-45c7-88ff-39914617ed7b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:15.827416 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b4a98a3f-3dd5-45c7-88ff-39914617ed7b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1316 microversion: 2.1 time: 0.319541 Aug 27 05:15:15.828007 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2286/4573] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:15 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:15.851877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:15.852498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:15.858470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.858960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.859436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.860140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.860628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.861057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.975098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e87fe88-cbcc-49c5-ab7f-2a9c3163d9bc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:15.982762 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e87fe88-cbcc-49c5-ab7f-2a9c3163d9bc tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1333 microversion: 2.1 time: 0.355922 Aug 27 05:15:15.983455 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2288/4574] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:15 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1333 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:16.153435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:16.162056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:16.163529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:16.164699 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-06760c30-3994-4403-a290-7d9bd331be48 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1743 microversion: 2.20 time: 0.316962 Aug 27 05:15:16.165270 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2287/4575] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:15 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1743 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:16.572043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b66c04bf-527a-4d9c-b550-12b94a78902f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:16.572432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b66c04bf-527a-4d9c-b550-12b94a78902f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:16.578773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c04bf-527a-4d9c-b550-12b94a78902f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:16.579300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c04bf-527a-4d9c-b550-12b94a78902f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:16.579736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c04bf-527a-4d9c-b550-12b94a78902f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:16.580449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c04bf-527a-4d9c-b550-12b94a78902f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:16.580900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c04bf-527a-4d9c-b550-12b94a78902f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:16.581323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b66c04bf-527a-4d9c-b550-12b94a78902f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:16.716970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b66c04bf-527a-4d9c-b550-12b94a78902f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:16.725670 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b66c04bf-527a-4d9c-b550-12b94a78902f tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1481 microversion: 2.1 time: 0.157695 Aug 27 05:15:16.726253 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2289/4576] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:16 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1481 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:16.849819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-197d69fd-14c2-4b84-9c51-8929741eeb16 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:16.850604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-197d69fd-14c2-4b84-9c51-8929741eeb16 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:16.856822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-197d69fd-14c2-4b84-9c51-8929741eeb16 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:16.857963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-197d69fd-14c2-4b84-9c51-8929741eeb16 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:16.858453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-197d69fd-14c2-4b84-9c51-8929741eeb16 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:16.859266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-197d69fd-14c2-4b84-9c51-8929741eeb16 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:16.859741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-197d69fd-14c2-4b84-9c51-8929741eeb16 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:16.860188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-197d69fd-14c2-4b84-9c51-8929741eeb16 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:16.995924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-197d69fd-14c2-4b84-9c51-8929741eeb16 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:17.004070 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-197d69fd-14c2-4b84-9c51-8929741eeb16 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1316 microversion: 2.1 time: 0.158664 Aug 27 05:15:17.004652 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2288/4577] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:16 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:17.006227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d9795cf1-2f88-4625-8d3c-323a25508fbf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:17.006961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d9795cf1-2f88-4625-8d3c-323a25508fbf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:17.014316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9795cf1-2f88-4625-8d3c-323a25508fbf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:17.014991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9795cf1-2f88-4625-8d3c-323a25508fbf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:17.015720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9795cf1-2f88-4625-8d3c-323a25508fbf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:17.016671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9795cf1-2f88-4625-8d3c-323a25508fbf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:17.017354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9795cf1-2f88-4625-8d3c-323a25508fbf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:17.018029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9795cf1-2f88-4625-8d3c-323a25508fbf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:17.188840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:17.189458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:17.196774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:17.197535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:17.198210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:17.199118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:17.199739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:17.200315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:17.218609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d9795cf1-2f88-4625-8d3c-323a25508fbf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:17.228563 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d9795cf1-2f88-4625-8d3c-323a25508fbf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1333 microversion: 2.1 time: 0.226604 Aug 27 05:15:17.235118 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2290/4578] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:17 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1333 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:17.397691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:17.414074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:17.416833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:17.420162 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9e696794-4c50-4ce1-9874-b647387a4cbc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1743 microversion: 2.20 time: 0.235613 Aug 27 05:15:17.421884 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2289/4579] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:17 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1743 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:17.754249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1f5ca3c4-ad7c-4ff2-b97d-6cdffd71a6ee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:17.755422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1f5ca3c4-ad7c-4ff2-b97d-6cdffd71a6ee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:17.766936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f5ca3c4-ad7c-4ff2-b97d-6cdffd71a6ee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:17.768369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f5ca3c4-ad7c-4ff2-b97d-6cdffd71a6ee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:17.769483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f5ca3c4-ad7c-4ff2-b97d-6cdffd71a6ee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:17.770595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f5ca3c4-ad7c-4ff2-b97d-6cdffd71a6ee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:17.771697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f5ca3c4-ad7c-4ff2-b97d-6cdffd71a6ee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:17.771952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f5ca3c4-ad7c-4ff2-b97d-6cdffd71a6ee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:18.026233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f11cdf9-03c2-4fb6-af5e-358c36b0bbef tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:18.027172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f11cdf9-03c2-4fb6-af5e-358c36b0bbef tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:18.029430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1f5ca3c4-ad7c-4ff2-b97d-6cdffd71a6ee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75dd4d6f001450bb9279d592e9783bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d7174d18c840b4b1d3e4d0c20b7887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:18.036841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f11cdf9-03c2-4fb6-af5e-358c36b0bbef tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:18.038149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f11cdf9-03c2-4fb6-af5e-358c36b0bbef tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:18.038777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f11cdf9-03c2-4fb6-af5e-358c36b0bbef tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:18.039685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f11cdf9-03c2-4fb6-af5e-358c36b0bbef tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:18.039810 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1f5ca3c4-ad7c-4ff2-b97d-6cdffd71a6ee tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 200 len: 1481 microversion: 2.1 time: 0.295056 Aug 27 05:15:18.040424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f11cdf9-03c2-4fb6-af5e-358c36b0bbef tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:18.054551 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2291/4580] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:17 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 1481 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:18.055789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f11cdf9-03c2-4fb6-af5e-358c36b0bbef tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:18.078025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:18.103646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5e56b1ae-9d57-4835-bbd0-13d3c14c037b req-04b3d580-e282-430b-b6f3-fc18fe6d2da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c08f9da-2f0f-445e-b1a9-2bbae7adc63c", "name": "network-vif-deleted", "tag": "f07984a1-c0c7-4c67-acb9-8a9dcf3f4cc0"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:18.119075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5e56b1ae-9d57-4835-bbd0-13d3c14c037b req-04b3d580-e282-430b-b6f3-fc18fe6d2da3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:18.119602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5e56b1ae-9d57-4835-bbd0-13d3c14c037b req-04b3d580-e282-430b-b6f3-fc18fe6d2da3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:18.120245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5e56b1ae-9d57-4835-bbd0-13d3c14c037b req-04b3d580-e282-430b-b6f3-fc18fe6d2da3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:18.134794 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5e56b1ae-9d57-4835-bbd0-13d3c14c037b req-04b3d580-e282-430b-b6f3-fc18fe6d2da3 service nova] Creating event network-vif-deleted:f07984a1-c0c7-4c67-acb9-8a9dcf3f4cc0 for instance 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c on n-h1-820368-35 Aug 27 05:15:18.144506 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5e56b1ae-9d57-4835-bbd0-13d3c14c037b req-04b3d580-e282-430b-b6f3-fc18fe6d2da3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046538 Aug 27 05:15:18.146456 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2292/4581] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:18.252756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-568ff4d7-5bfc-46ae-9ab5-ee3b98dc5166 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:18.253869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-568ff4d7-5bfc-46ae-9ab5-ee3b98dc5166 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:18.263310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ff4d7-5bfc-46ae-9ab5-ee3b98dc5166 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:18.263817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ff4d7-5bfc-46ae-9ab5-ee3b98dc5166 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:18.264280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ff4d7-5bfc-46ae-9ab5-ee3b98dc5166 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:18.265008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ff4d7-5bfc-46ae-9ab5-ee3b98dc5166 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:18.265477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ff4d7-5bfc-46ae-9ab5-ee3b98dc5166 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:18.265913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-568ff4d7-5bfc-46ae-9ab5-ee3b98dc5166 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:18.401865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9f11cdf9-03c2-4fb6-af5e-358c36b0bbef tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:18.418386 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f11cdf9-03c2-4fb6-af5e-358c36b0bbef tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1316 microversion: 2.1 time: 0.392693 Aug 27 05:15:18.420192 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2290/4582] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:18 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:18.448112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:18.456816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:18.467549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:18.468053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:18.468499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:18.474330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:18.475643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:18.476745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:18.647256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-568ff4d7-5bfc-46ae-9ab5-ee3b98dc5166 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:18.680514 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-568ff4d7-5bfc-46ae-9ab5-ee3b98dc5166 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1333 microversion: 2.1 time: 0.431988 Aug 27 05:15:18.682890 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2293/4583] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:18 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1333 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:18.795550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:18.809880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:18.814005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:18.816428 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9089e76e-afd7-4589-8295-e50c8c3e18ba tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1743 microversion: 2.20 time: 0.372569 Aug 27 05:15:18.823940 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2291/4584] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:18 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1743 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:19.062916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:19.063867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] [instance: 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:19.076986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:19.077491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:19.077939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:19.078650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:19.084123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:19.084631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:19.103572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] HTTP exception thrown: Instance 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c could not be found. Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Request method failure captured: Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c HTTP/1.1 Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaedjOqpQ_oXXRoRhZ7Hifomr2lI5r0rIxEBIKukgLyaeqw01EDk2V6rnE6dBGLC2Kjm3fT4-MCqvEBV-ZXaMH5pMcNZ8yRZZTq01IBBBYOeag-F2n4KsdHOJbmoz0NH6wniDt2UmAgEuuJ8aU-_uceZ2nepffXUeh0hYfHQl8YFodQ Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61d7174d18c840b4b1d3e4d0c20b7887", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61d7174d18c840b4b1d3e4d0c20b7887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestJSON-1940702634 Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61d7174d18c840b4b1d3e4d0c20b7887 Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestJSON-1940702634 Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: c75dd4d6f001450bb9279d592e9783bd Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestJSON-1940702634-project Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c could not be found. Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '3c08f9da-2f0f-445e-b1a9-2bbae7adc63c'} Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c could not be found. Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c could not be found. Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:19.106118 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:19.111451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:19.111451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:19.111451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:19.111451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:19.111451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:19.111451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c could not be found. Aug 27 05:15:19.111451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:19.111451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] Returning 404 to user: Instance 3c08f9da-2f0f-445e-b1a9-2bbae7adc63c could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:19.111451 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-835a67a1-09d2-436e-9f34-d8b3b2d49650 tempest-ServersTestJSON-1940702634 tempest-ServersTestJSON-1940702634-project] 10.222.0.58 "GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c" status: 404 len: 111 microversion: 2.1 time: 0.049014 Aug 27 05:15:19.111451 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2294/4585] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:19 2022] GET /compute/v2.1/servers/3c08f9da-2f0f-445e-b1a9-2bbae7adc63c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:19.444739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90bb1451-58ae-4027-a199-a2deae02ed14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:19.445509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-90bb1451-58ae-4027-a199-a2deae02ed14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:19.460408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90bb1451-58ae-4027-a199-a2deae02ed14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:19.460989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90bb1451-58ae-4027-a199-a2deae02ed14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:19.461336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90bb1451-58ae-4027-a199-a2deae02ed14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:19.462067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90bb1451-58ae-4027-a199-a2deae02ed14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:19.462512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90bb1451-58ae-4027-a199-a2deae02ed14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:19.467705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90bb1451-58ae-4027-a199-a2deae02ed14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:19.604648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-09a20d2b-9dcc-4e40-9b73-8a9779158a60 req-7b14cd1a-ac72-4728-b92b-16624a370601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4498264f-9b1d-45e7-ac47-fa063bbce8ab", "name": "network-vif-plugged", "status": "completed", "tag": "b7410f35-32ab-4ed2-9666-cd5a034fc9b0"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:19.628836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-09a20d2b-9dcc-4e40-9b73-8a9779158a60 req-7b14cd1a-ac72-4728-b92b-16624a370601 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:19.629324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-09a20d2b-9dcc-4e40-9b73-8a9779158a60 req-7b14cd1a-ac72-4728-b92b-16624a370601 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:19.629762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-09a20d2b-9dcc-4e40-9b73-8a9779158a60 req-7b14cd1a-ac72-4728-b92b-16624a370601 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:19.692620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-09a20d2b-9dcc-4e40-9b73-8a9779158a60 req-7b14cd1a-ac72-4728-b92b-16624a370601 service nova] Creating event network-vif-plugged:b7410f35-32ab-4ed2-9666-cd5a034fc9b0 for instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab on n-h2-820368-35 Aug 27 05:15:19.697215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-90bb1451-58ae-4027-a199-a2deae02ed14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:19.715152 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-09a20d2b-9dcc-4e40-9b73-8a9779158a60 req-7b14cd1a-ac72-4728-b92b-16624a370601 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115096 Aug 27 05:15:19.715966 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90bb1451-58ae-4027-a199-a2deae02ed14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1316 microversion: 2.1 time: 0.275560 Aug 27 05:15:19.716966 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2292/4586] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:19 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:19.717878 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2295/4587] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:15:19.728788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-afa1059d-d5fa-4ba8-a07d-2f0701b959af tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:19.732888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-afa1059d-d5fa-4ba8-a07d-2f0701b959af tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:19.755567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afa1059d-d5fa-4ba8-a07d-2f0701b959af tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:19.758495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afa1059d-d5fa-4ba8-a07d-2f0701b959af tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:19.762234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afa1059d-d5fa-4ba8-a07d-2f0701b959af tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:19.767736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afa1059d-d5fa-4ba8-a07d-2f0701b959af tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:19.768837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afa1059d-d5fa-4ba8-a07d-2f0701b959af tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:19.769587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afa1059d-d5fa-4ba8-a07d-2f0701b959af tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:19.844274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:19.845405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:19.880188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:19.887438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:19.890170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:19.891489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:19.894081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:19.898652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:20.163273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:20.178235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-afa1059d-d5fa-4ba8-a07d-2f0701b959af tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:20.199363 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-afa1059d-d5fa-4ba8-a07d-2f0701b959af tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1333 microversion: 2.1 time: 0.478880 Aug 27 05:15:20.204923 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2293/4588] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:19 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1333 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:20.293397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:20.321484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:20.323057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:20.331817 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dab75af4-0d37-4ae1-ac88-1b9dbe48bcca tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.493102 Aug 27 05:15:20.352228 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2296/4589] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:19 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:20.740596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3789b26a-ffb3-4737-a88e-48c8680017fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:20.741592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3789b26a-ffb3-4737-a88e-48c8680017fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:20.743439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=14 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:20.757334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3789b26a-ffb3-4737-a88e-48c8680017fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:20.759635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3789b26a-ffb3-4737-a88e-48c8680017fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:20.761017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3789b26a-ffb3-4737-a88e-48c8680017fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:20.763220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3789b26a-ffb3-4737-a88e-48c8680017fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:20.764151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3789b26a-ffb3-4737-a88e-48c8680017fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:20.765496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3789b26a-ffb3-4737-a88e-48c8680017fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:21.226226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40220c0c-9199-431a-8120-9136b2491833 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:21.226588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3789b26a-ffb3-4737-a88e-48c8680017fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:21.226855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-40220c0c-9199-431a-8120-9136b2491833 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:21.241523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40220c0c-9199-431a-8120-9136b2491833 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:21.242437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40220c0c-9199-431a-8120-9136b2491833 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:21.246005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40220c0c-9199-431a-8120-9136b2491833 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:21.250199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40220c0c-9199-431a-8120-9136b2491833 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:21.257026 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3789b26a-ffb3-4737-a88e-48c8680017fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1316 microversion: 2.1 time: 0.521038 Aug 27 05:15:21.262007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40220c0c-9199-431a-8120-9136b2491833 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:21.264595 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2294/4590] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:20 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:21.265707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40220c0c-9199-431a-8120-9136b2491833 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:21.277218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-96df4491-ac71-42b4-b368-4bb31dfc92c8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:21.277850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-96df4491-ac71-42b4-b368-4bb31dfc92c8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:21.302766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96df4491-ac71-42b4-b368-4bb31dfc92c8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:21.303375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96df4491-ac71-42b4-b368-4bb31dfc92c8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:21.303842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96df4491-ac71-42b4-b368-4bb31dfc92c8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:21.305560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96df4491-ac71-42b4-b368-4bb31dfc92c8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:21.306232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96df4491-ac71-42b4-b368-4bb31dfc92c8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:21.307671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96df4491-ac71-42b4-b368-4bb31dfc92c8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:22.028692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-40220c0c-9199-431a-8120-9136b2491833 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:22.040342 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40220c0c-9199-431a-8120-9136b2491833 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1333 microversion: 2.1 time: 0.818078 Aug 27 05:15:22.040939 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2297/4591] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:21 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1333 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:22.045863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:22.047928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:22.059837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:22.064184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:22.066800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:22.067830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:22.068449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:22.069750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:22.138724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-96df4491-ac71-42b4-b368-4bb31dfc92c8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:22.150831 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-96df4491-ac71-42b4-b368-4bb31dfc92c8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.884803 Aug 27 05:15:22.153002 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2295/4592] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:21 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:22.171132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-14385e90-aa1b-4edd-90ad-dfb5ebea9209 req-34ea9551-5bdc-4a53-9e94-732f8090600a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4498264f-9b1d-45e7-ac47-fa063bbce8ab", "name": "network-vif-plugged", "status": "completed", "tag": "409e3819-0d57-441c-98c8-1adac98de63d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:22.200321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-14385e90-aa1b-4edd-90ad-dfb5ebea9209 req-34ea9551-5bdc-4a53-9e94-732f8090600a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:22.201084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-14385e90-aa1b-4edd-90ad-dfb5ebea9209 req-34ea9551-5bdc-4a53-9e94-732f8090600a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:22.203722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-14385e90-aa1b-4edd-90ad-dfb5ebea9209 req-34ea9551-5bdc-4a53-9e94-732f8090600a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:22.228710 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-14385e90-aa1b-4edd-90ad-dfb5ebea9209 req-34ea9551-5bdc-4a53-9e94-732f8090600a service nova] Creating event network-vif-plugged:409e3819-0d57-441c-98c8-1adac98de63d for instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab on n-h2-820368-35 Aug 27 05:15:22.236649 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-14385e90-aa1b-4edd-90ad-dfb5ebea9209 req-34ea9551-5bdc-4a53-9e94-732f8090600a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079055 Aug 27 05:15:22.238679 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2296/4593] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:22.246521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b66cedac-926a-426a-af9b-fe6cc4517886 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:22.247551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b66cedac-926a-426a-af9b-fe6cc4517886 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:22.255747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b66cedac-926a-426a-af9b-fe6cc4517886 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:22.256554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b66cedac-926a-426a-af9b-fe6cc4517886 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:22.257182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b66cedac-926a-426a-af9b-fe6cc4517886 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:22.258217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b66cedac-926a-426a-af9b-fe6cc4517886 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:22.258929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b66cedac-926a-426a-af9b-fe6cc4517886 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:22.260144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b66cedac-926a-426a-af9b-fe6cc4517886 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:22.624495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:22.629864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b66cedac-926a-426a-af9b-fe6cc4517886 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:22.640106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:22.642846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:22.644244 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b66cedac-926a-426a-af9b-fe6cc4517886 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.403562 Aug 27 05:15:22.651478 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2297/4594] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:22 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:22.651638 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c340dee0-2f06-4156-93dc-633091f34dfc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.603083 Aug 27 05:15:22.657507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc055cb4-f231-4ea5-825d-5f00d2faf259 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:22.659545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cc055cb4-f231-4ea5-825d-5f00d2faf259 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:22.660101 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2298/4595] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:22 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:22.667259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ca03202b-d0ac-4de6-b21c-ddc5b955bcc3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:22.667901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ca03202b-d0ac-4de6-b21c-ddc5b955bcc3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:22.674710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc055cb4-f231-4ea5-825d-5f00d2faf259 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:22.674967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca03202b-d0ac-4de6-b21c-ddc5b955bcc3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:22.675325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca03202b-d0ac-4de6-b21c-ddc5b955bcc3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:22.675591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc055cb4-f231-4ea5-825d-5f00d2faf259 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:22.675819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca03202b-d0ac-4de6-b21c-ddc5b955bcc3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:22.676243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc055cb4-f231-4ea5-825d-5f00d2faf259 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:22.676567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca03202b-d0ac-4de6-b21c-ddc5b955bcc3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:22.677073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca03202b-d0ac-4de6-b21c-ddc5b955bcc3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:22.677260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc055cb4-f231-4ea5-825d-5f00d2faf259 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:22.677528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca03202b-d0ac-4de6-b21c-ddc5b955bcc3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:22.677902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc055cb4-f231-4ea5-825d-5f00d2faf259 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:22.678445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc055cb4-f231-4ea5-825d-5f00d2faf259 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:23.039869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cc055cb4-f231-4ea5-825d-5f00d2faf259 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:23.054048 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cc055cb4-f231-4ea5-825d-5f00d2faf259 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1316 microversion: 2.1 time: 0.407762 Aug 27 05:15:23.071895 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2298/4596] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:22 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:23.105492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2c63eb80-8977-4d80-b744-1f8998634fc9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:23.108438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2c63eb80-8977-4d80-b744-1f8998634fc9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:23.126011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c63eb80-8977-4d80-b744-1f8998634fc9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:23.128822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c63eb80-8977-4d80-b744-1f8998634fc9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:23.129796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c63eb80-8977-4d80-b744-1f8998634fc9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:23.134928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c63eb80-8977-4d80-b744-1f8998634fc9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:23.135703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c63eb80-8977-4d80-b744-1f8998634fc9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:23.136164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c63eb80-8977-4d80-b744-1f8998634fc9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:23.179140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ca03202b-d0ac-4de6-b21c-ddc5b955bcc3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:23.190355 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ca03202b-d0ac-4de6-b21c-ddc5b955bcc3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.528949 Aug 27 05:15:23.211810 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2299/4597] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:22 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:23.226958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f5c90ae7-5773-4198-859f-a0679c5316db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1851753143"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:23.233514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f5c90ae7-5773-4198-859f-a0679c5316db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:23.265219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c90ae7-5773-4198-859f-a0679c5316db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:23.268378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c90ae7-5773-4198-859f-a0679c5316db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:23.268853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c90ae7-5773-4198-859f-a0679c5316db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:23.269625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c90ae7-5773-4198-859f-a0679c5316db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:23.272162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c90ae7-5773-4198-859f-a0679c5316db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:23.272627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c90ae7-5773-4198-859f-a0679c5316db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:23.614262 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f5c90ae7-5773-4198-859f-a0679c5316db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.400066 Aug 27 05:15:23.619161 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2300/4598] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:15:23 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 05:15:23.682388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:23.687025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:23.693626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2c63eb80-8977-4d80-b744-1f8998634fc9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:23.704232 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2c63eb80-8977-4d80-b744-1f8998634fc9 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1333 microversion: 2.1 time: 0.628638 Aug 27 05:15:23.704654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:23.705960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:23.706140 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2299/4599] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:23 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1333 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:23.708405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:23.709691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:23.710459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:23.711252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:24.042201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:24.052483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:24.054246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:24.055829 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9057929b-e0fb-4fa5-acf4-08e324b2ad64 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.385978 Aug 27 05:15:24.074383 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2301/4600] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:23 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:24.078449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-380accb1-1c1d-4314-9e6e-0b5bdd84418d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:24.086824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-380accb1-1c1d-4314-9e6e-0b5bdd84418d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:24.107800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380accb1-1c1d-4314-9e6e-0b5bdd84418d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:24.109977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380accb1-1c1d-4314-9e6e-0b5bdd84418d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:24.113011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380accb1-1c1d-4314-9e6e-0b5bdd84418d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:24.113905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380accb1-1c1d-4314-9e6e-0b5bdd84418d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:24.115476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380accb1-1c1d-4314-9e6e-0b5bdd84418d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:24.116745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380accb1-1c1d-4314-9e6e-0b5bdd84418d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:24.409793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-380accb1-1c1d-4314-9e6e-0b5bdd84418d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:24.425644 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-380accb1-1c1d-4314-9e6e-0b5bdd84418d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1316 microversion: 2.1 time: 0.350452 Aug 27 05:15:24.429706 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2300/4601] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:24 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:24.732150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-42d77ebf-b8de-47ee-8548-f68adb12c828 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:24.733355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-42d77ebf-b8de-47ee-8548-f68adb12c828 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:24.744970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d77ebf-b8de-47ee-8548-f68adb12c828 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:24.753396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d77ebf-b8de-47ee-8548-f68adb12c828 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:24.754147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d77ebf-b8de-47ee-8548-f68adb12c828 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:24.755144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d77ebf-b8de-47ee-8548-f68adb12c828 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:24.755820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d77ebf-b8de-47ee-8548-f68adb12c828 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:24.756443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d77ebf-b8de-47ee-8548-f68adb12c828 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:25.087168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:25.087786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:25.111368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:25.112428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:25.112878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:25.113604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:25.123000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:25.123815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:25.281648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-42d77ebf-b8de-47ee-8548-f68adb12c828 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:25.290548 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-42d77ebf-b8de-47ee-8548-f68adb12c828 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1668 microversion: 2.1 time: 0.562311 Aug 27 05:15:25.298565 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2302/4602] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:24 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1668 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:25.312854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-06736ae8-b455-4e61-96c4-8536ac5e8d5f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:25.315967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-06736ae8-b455-4e61-96c4-8536ac5e8d5f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:25.328442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06736ae8-b455-4e61-96c4-8536ac5e8d5f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:25.329133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06736ae8-b455-4e61-96c4-8536ac5e8d5f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:25.329917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06736ae8-b455-4e61-96c4-8536ac5e8d5f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:25.331526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06736ae8-b455-4e61-96c4-8536ac5e8d5f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:25.331833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06736ae8-b455-4e61-96c4-8536ac5e8d5f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:25.332271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06736ae8-b455-4e61-96c4-8536ac5e8d5f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:25.416444 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-06736ae8-b455-4e61-96c4-8536ac5e8d5f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab/ips" status: 200 len: 179 microversion: 2.1 time: 0.107356 Aug 27 05:15:25.420481 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2303/4603] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:15:25 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab/ips => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:15:25.446596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f00316c7-bf78-4c22-b9fc-49668fda6ac7 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:25.451108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f00316c7-bf78-4c22-b9fc-49668fda6ac7 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:25.477480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f00316c7-bf78-4c22-b9fc-49668fda6ac7 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:25.478015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f00316c7-bf78-4c22-b9fc-49668fda6ac7 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:25.479470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f00316c7-bf78-4c22-b9fc-49668fda6ac7 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:25.492813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f00316c7-bf78-4c22-b9fc-49668fda6ac7 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:25.493361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f00316c7-bf78-4c22-b9fc-49668fda6ac7 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:25.494595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f00316c7-bf78-4c22-b9fc-49668fda6ac7 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:25.575051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f00316c7-bf78-4c22-b9fc-49668fda6ac7 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:15:25.637962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:25.740555 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f00316c7-bf78-4c22-b9fc-49668fda6ac7 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 204 len: 0 microversion: 2.1 time: 0.307915 Aug 27 05:15:25.746507 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2304/4604] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:25 2022] DELETE /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:15:25.756387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d9b66d24-c1bd-4ab0-9923-d77983735bf6 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:25.757417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d9b66d24-c1bd-4ab0-9923-d77983735bf6 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:25.766074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b66d24-c1bd-4ab0-9923-d77983735bf6 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:25.766989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b66d24-c1bd-4ab0-9923-d77983735bf6 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:25.767740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b66d24-c1bd-4ab0-9923-d77983735bf6 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:25.769400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b66d24-c1bd-4ab0-9923-d77983735bf6 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:25.771216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b66d24-c1bd-4ab0-9923-d77983735bf6 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:25.771879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9b66d24-c1bd-4ab0-9923-d77983735bf6 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:26.042047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:26.051280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:26.058317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:26.065176 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-67ab6d71-c637-4497-b109-c5f5ee7b1037 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.981820 Aug 27 05:15:26.065986 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2301/4605] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:25 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:26.070915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9961fab4-7f42-40dd-8bdb-4bc9752a5e88 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:26.077614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9961fab4-7f42-40dd-8bdb-4bc9752a5e88 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:26.090036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9961fab4-7f42-40dd-8bdb-4bc9752a5e88 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:26.092679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9961fab4-7f42-40dd-8bdb-4bc9752a5e88 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:26.093314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9961fab4-7f42-40dd-8bdb-4bc9752a5e88 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:26.101430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9961fab4-7f42-40dd-8bdb-4bc9752a5e88 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:26.105602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9961fab4-7f42-40dd-8bdb-4bc9752a5e88 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:26.106264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9961fab4-7f42-40dd-8bdb-4bc9752a5e88 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:26.365360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d9b66d24-c1bd-4ab0-9923-d77983735bf6 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:26.383890 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d9b66d24-c1bd-4ab0-9923-d77983735bf6 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1316 microversion: 2.1 time: 0.634742 Aug 27 05:15:26.385489 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2305/4606] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:25 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:26.494384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9961fab4-7f42-40dd-8bdb-4bc9752a5e88 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:26.518859 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9961fab4-7f42-40dd-8bdb-4bc9752a5e88 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1674 microversion: 2.1 time: 0.446484 Aug 27 05:15:26.520786 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2302/4607] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:26 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1674 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:26.999076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b6a5ae52-8c7c-4f7e-9459-ac198288bcee req-006a809d-fe47-4ba6-a98e-791e1ad5aadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28389f5a-754e-4bb2-95fc-909ef29e9bc8", "name": "network-vif-plugged", "status": "completed", "tag": "534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:27.025482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b6a5ae52-8c7c-4f7e-9459-ac198288bcee req-006a809d-fe47-4ba6-a98e-791e1ad5aadf service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.025992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b6a5ae52-8c7c-4f7e-9459-ac198288bcee req-006a809d-fe47-4ba6-a98e-791e1ad5aadf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.026440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b6a5ae52-8c7c-4f7e-9459-ac198288bcee req-006a809d-fe47-4ba6-a98e-791e1ad5aadf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.045762 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b6a5ae52-8c7c-4f7e-9459-ac198288bcee req-006a809d-fe47-4ba6-a98e-791e1ad5aadf service nova] Creating event network-vif-plugged:534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67 for instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 on n-h2-820368-35 Aug 27 05:15:27.065833 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b6a5ae52-8c7c-4f7e-9459-ac198288bcee req-006a809d-fe47-4ba6-a98e-791e1ad5aadf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069836 Aug 27 05:15:27.066447 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2306/4608] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:15:27.095405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:27.096029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:27.106927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.107460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.107904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.108631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.109107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.109523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.412211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-75cc629e-483d-455b-9d04-ce15ee52e905 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:27.413104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-75cc629e-483d-455b-9d04-ce15ee52e905 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:27.425065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75cc629e-483d-455b-9d04-ce15ee52e905 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.425562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75cc629e-483d-455b-9d04-ce15ee52e905 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.428350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75cc629e-483d-455b-9d04-ce15ee52e905 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.429118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75cc629e-483d-455b-9d04-ce15ee52e905 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.432169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75cc629e-483d-455b-9d04-ce15ee52e905 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.432884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-75cc629e-483d-455b-9d04-ce15ee52e905 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.476777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:27.528736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:27.538259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:27.540008 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-453c9e6e-cf9b-4df3-b720-ff8161a57be6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.449795 Aug 27 05:15:27.545417 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2303/4609] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:27 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:27.554571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-16a58ace-cfd5-4cab-93e3-2c2589160cdb tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:27.555636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-16a58ace-cfd5-4cab-93e3-2c2589160cdb tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:27.580295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a58ace-cfd5-4cab-93e3-2c2589160cdb tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.581203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a58ace-cfd5-4cab-93e3-2c2589160cdb tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.582159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a58ace-cfd5-4cab-93e3-2c2589160cdb tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.583467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a58ace-cfd5-4cab-93e3-2c2589160cdb tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.584215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a58ace-cfd5-4cab-93e3-2c2589160cdb tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.584949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a58ace-cfd5-4cab-93e3-2c2589160cdb tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.999557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-75cc629e-483d-455b-9d04-ce15ee52e905 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:28.000472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-16a58ace-cfd5-4cab-93e3-2c2589160cdb tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:28.015902 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-16a58ace-cfd5-4cab-93e3-2c2589160cdb tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1674 microversion: 2.1 time: 0.468295 Aug 27 05:15:28.017795 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-75cc629e-483d-455b-9d04-ce15ee52e905 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1316 microversion: 2.1 time: 0.608537 Aug 27 05:15:28.018573 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2304/4610] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:27 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1674 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:28.020486 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2307/4611] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:27 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:28.573915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:28.575147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:28.597886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:28.598385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:28.601421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:28.605215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:28.608339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:28.610130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:28.943838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:28.959561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:28.961322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:28.964509 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e0dbe759-5e0b-4316-b8e9-d4fab7aae2c1 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.397365 Aug 27 05:15:28.965532 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2305/4612] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:28 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:29.052532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf54595c-71e8-4f3a-a33c-d25ebe93e9ff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:29.054534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf54595c-71e8-4f3a-a33c-d25ebe93e9ff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:29.059472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-82a0684c-45b9-44fb-b61d-aebf6b2956bf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:29.060108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-82a0684c-45b9-44fb-b61d-aebf6b2956bf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:29.068942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82a0684c-45b9-44fb-b61d-aebf6b2956bf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:29.069484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82a0684c-45b9-44fb-b61d-aebf6b2956bf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:29.069873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82a0684c-45b9-44fb-b61d-aebf6b2956bf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:29.070600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82a0684c-45b9-44fb-b61d-aebf6b2956bf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:29.071059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82a0684c-45b9-44fb-b61d-aebf6b2956bf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:29.071523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-82a0684c-45b9-44fb-b61d-aebf6b2956bf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:29.084877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf54595c-71e8-4f3a-a33c-d25ebe93e9ff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:29.085396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf54595c-71e8-4f3a-a33c-d25ebe93e9ff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:29.085837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf54595c-71e8-4f3a-a33c-d25ebe93e9ff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:29.086564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf54595c-71e8-4f3a-a33c-d25ebe93e9ff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:29.087028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf54595c-71e8-4f3a-a33c-d25ebe93e9ff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:29.087504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf54595c-71e8-4f3a-a33c-d25ebe93e9ff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:29.497691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-82a0684c-45b9-44fb-b61d-aebf6b2956bf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:29.507135 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-82a0684c-45b9-44fb-b61d-aebf6b2956bf tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1674 microversion: 2.1 time: 0.451236 Aug 27 05:15:29.510233 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2306/4613] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:29 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1674 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:29.517488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cf54595c-71e8-4f3a-a33c-d25ebe93e9ff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:29.539477 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf54595c-71e8-4f3a-a33c-d25ebe93e9ff tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1316 microversion: 2.1 time: 0.490732 Aug 27 05:15:29.540824 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2308/4614] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:29 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:29.756298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-831c3ecd-6642-4fc2-9b73-dfebea660caa req-121b39d7-8949-4598-bdfe-2f0ceacb7bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4498264f-9b1d-45e7-ac47-fa063bbce8ab", "name": "network-vif-deleted", "tag": "b7410f35-32ab-4ed2-9666-cd5a034fc9b0"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:29.807506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-831c3ecd-6642-4fc2-9b73-dfebea660caa req-121b39d7-8949-4598-bdfe-2f0ceacb7bc7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:29.809832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-831c3ecd-6642-4fc2-9b73-dfebea660caa req-121b39d7-8949-4598-bdfe-2f0ceacb7bc7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:29.810773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-831c3ecd-6642-4fc2-9b73-dfebea660caa req-121b39d7-8949-4598-bdfe-2f0ceacb7bc7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:29.874796 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-831c3ecd-6642-4fc2-9b73-dfebea660caa req-121b39d7-8949-4598-bdfe-2f0ceacb7bc7 service nova] Creating event network-vif-deleted:b7410f35-32ab-4ed2-9666-cd5a034fc9b0 for instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab on n-h2-820368-35 Aug 27 05:15:29.889486 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-831c3ecd-6642-4fc2-9b73-dfebea660caa req-121b39d7-8949-4598-bdfe-2f0ceacb7bc7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143983 Aug 27 05:15:29.891244 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2309/4615] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:29.991778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-267365952", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": "none"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:29.995199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:29.995978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:30.027707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.030788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.031478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.035261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.035992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.036613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.108429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:15:30.109002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:15:30.109804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:15:30.110374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:15:30.110966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:15:30.126577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.140510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.141227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.142201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.142883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.143518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.199220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Getting quotas for project c854f94d0d7c400181d00b87ca011ee4. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:15:30.225077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Getting quotas for user 1ee1d9324a6e42f5b405441aa2a6e1e4 and project c854f94d0d7c400181d00b87ca011ee4. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:15:30.255830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:15:30.262549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:15:30.365000 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ebb2eca7-98a6-4b73-a9cd-8cd5cbbdec47 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.853463 Aug 27 05:15:30.365797 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2307/4616] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 05:15:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 05:15:30.378619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8246a8c-a7f0-4a36-b380-242d82f5bd7e tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:30.385388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:30.386652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8246a8c-a7f0-4a36-b380-242d82f5bd7e tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:30.401028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:30.402988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:30.404653 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-da41f59d-9cbc-4bb6-a54e-ddc981bc1d9c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.415273 Aug 27 05:15:30.406131 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2310/4617] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:29 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:30.539064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-32d4004e-b0d0-488f-9d97-b0979ff43a86 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:30.539064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-32d4004e-b0d0-488f-9d97-b0979ff43a86 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:30.546584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32d4004e-b0d0-488f-9d97-b0979ff43a86 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.547518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32d4004e-b0d0-488f-9d97-b0979ff43a86 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.548510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32d4004e-b0d0-488f-9d97-b0979ff43a86 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.550691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32d4004e-b0d0-488f-9d97-b0979ff43a86 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.551691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32d4004e-b0d0-488f-9d97-b0979ff43a86 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.552288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32d4004e-b0d0-488f-9d97-b0979ff43a86 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.556333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d8246a8c-a7f0-4a36-b380-242d82f5bd7e tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:30.570991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d8246a8c-a7f0-4a36-b380-242d82f5bd7e tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:30.573317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d8246a8c-a7f0-4a36-b380-242d82f5bd7e tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:30.574698 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8246a8c-a7f0-4a36-b380-242d82f5bd7e tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1277 microversion: 2.54 time: 0.201410 Aug 27 05:15:30.578407 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2308/4618] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:30 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:30.610913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-92205e3e-08a0-4128-bf90-d59e928f1c86 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:30.613537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-92205e3e-08a0-4128-bf90-d59e928f1c86 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:30.628182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92205e3e-08a0-4128-bf90-d59e928f1c86 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.630509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92205e3e-08a0-4128-bf90-d59e928f1c86 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.630878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92205e3e-08a0-4128-bf90-d59e928f1c86 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.633928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92205e3e-08a0-4128-bf90-d59e928f1c86 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.634830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92205e3e-08a0-4128-bf90-d59e928f1c86 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.637874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92205e3e-08a0-4128-bf90-d59e928f1c86 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.676490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:30.947258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-32d4004e-b0d0-488f-9d97-b0979ff43a86 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:30.965077 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-32d4004e-b0d0-488f-9d97-b0979ff43a86 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1496 microversion: 2.1 time: 0.431713 Aug 27 05:15:30.970614 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2311/4619] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:30 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1496 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:31.125962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-92205e3e-08a0-4128-bf90-d59e928f1c86 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:31.142617 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-92205e3e-08a0-4128-bf90-d59e928f1c86 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1504 microversion: 2.1 time: 0.562171 Aug 27 05:15:31.144234 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2309/4620] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:30 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1504 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:31.173794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-07e2b87c-477c-42f6-ba47-efec24f8ba56 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1663153428"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:31.175037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-07e2b87c-477c-42f6-ba47-efec24f8ba56 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:31.185580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07e2b87c-477c-42f6-ba47-efec24f8ba56 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:31.186334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07e2b87c-477c-42f6-ba47-efec24f8ba56 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:31.186961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07e2b87c-477c-42f6-ba47-efec24f8ba56 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:31.187881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07e2b87c-477c-42f6-ba47-efec24f8ba56 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:31.188502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07e2b87c-477c-42f6-ba47-efec24f8ba56 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:31.189091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07e2b87c-477c-42f6-ba47-efec24f8ba56 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:31.441903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:31.442533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:31.465653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:31.468466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:31.470772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:31.475639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:31.499069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:31.504060 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.network.security_group_api [None req-07e2b87c-477c-42f6-ba47-efec24f8ba56 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Adding security group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 to port 534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67 Aug 27 05:15:31.508017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:32.354595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:32.365655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:32.367758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:32.369918 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9a748d45-8989-4ac0-bd33-672378a362b6 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.937246 Aug 27 05:15:32.371244 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2310/4621] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:31 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:32.409809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:32.428900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:32.457550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:32.462103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:32.462797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:32.463766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:32.466266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:32.470004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:32.698889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:32.715929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:32.717539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:32.722168 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-95997510-0cec-44f4-9f3d-116071a13b1d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1329 microversion: 2.54 time: 0.317054 Aug 27 05:15:32.723588 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2311/4622] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:32 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1329 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:32.740792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-bf919e2e-5963-42d1-81c4-e7f46f6a20fe req-b46d5a75-1e8c-45be-aece-d85c897be0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4498264f-9b1d-45e7-ac47-fa063bbce8ab", "name": "network-vif-deleted", "tag": "409e3819-0d57-441c-98c8-1adac98de63d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:32.768767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bf919e2e-5963-42d1-81c4-e7f46f6a20fe req-b46d5a75-1e8c-45be-aece-d85c897be0c2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:32.772113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bf919e2e-5963-42d1-81c4-e7f46f6a20fe req-b46d5a75-1e8c-45be-aece-d85c897be0c2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:32.772802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bf919e2e-5963-42d1-81c4-e7f46f6a20fe req-b46d5a75-1e8c-45be-aece-d85c897be0c2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:32.802789 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-bf919e2e-5963-42d1-81c4-e7f46f6a20fe req-b46d5a75-1e8c-45be-aece-d85c897be0c2 service nova] Creating event network-vif-deleted:409e3819-0d57-441c-98c8-1adac98de63d for instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab on n-h2-820368-35 Aug 27 05:15:32.827581 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-bf919e2e-5963-42d1-81c4-e7f46f6a20fe req-b46d5a75-1e8c-45be-aece-d85c897be0c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096771 Aug 27 05:15:32.830794 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2312/4623] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:32.851898 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-07e2b87c-477c-42f6-ba47-efec24f8ba56 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8/action" status: 202 len: 0 microversion: 2.1 time: 1.686753 Aug 27 05:15:32.858247 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2312/4624] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:15:31 2022] POST /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8/action => generated 0 bytes in 1694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:32.873765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8a8c279-38c3-419f-9a1c-47d0185e2f30 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb564843430>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:32.875977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:32.876865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:32.922348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:32.928545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:32.933533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:32.937172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:32.939948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:32.940495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.039693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.043568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.044473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.046889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lazy-loading 'fault' on Instance uuid 4498264f-9b1d-45e7-ac47-fa063bbce8ab {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:15:33.331657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-f8a8c279-38c3-419f-9a1c-47d0185e2f30 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 in use.", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:33.332797 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f8a8c279-38c3-419f-9a1c-47d0185e2f30 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security Group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 in use. Aug 27 05:15:33.332797 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-05a2c2b9-8cc2-444e-b8dc-30f5f157013f'] Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8a8c279-38c3-419f-9a1c-47d0185e2f30 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/os-security-groups/7bf6812b-667f-4645-a6b4-72b5c21f8b76 HTTP/1.1 Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: exception: Security Group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 in use. Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-05a2c2b9-8cc2-444e-b8dc-30f5f157013f'] Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '7bf6812b-667f-4645-a6b4-72b5c21f8b76'} Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:33.334711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 in use. Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05a2c2b9-8cc2-444e-b8dc-30f5f157013f'] Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 in use. Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05a2c2b9-8cc2-444e-b8dc-30f5f157013f'] Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 in use. Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05a2c2b9-8cc2-444e-b8dc-30f5f157013f'] Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 in use. Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05a2c2b9-8cc2-444e-b8dc-30f5f157013f'] Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8a8c279-38c3-419f-9a1c-47d0185e2f30 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 400 to user: Security Group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 in use. Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-05a2c2b9-8cc2-444e-b8dc-30f5f157013f'] {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:33.339376 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8a8c279-38c3-419f-9a1c-47d0185e2f30 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/7bf6812b-667f-4645-a6b4-72b5c21f8b76" status: 400 len: 185 microversion: 2.1 time: 0.476492 Aug 27 05:15:33.342604 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2313/4625] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:32 2022] DELETE /compute/v2.1/os-security-groups/7bf6812b-667f-4645-a6b4-72b5c21f8b76 => generated 185 bytes in 482 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:15:33.344905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f64cdce2564b2aaeefe6ff048ce65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fce25efce44ca2af48550a5e49d3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:33.354803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-279e9c5f-6086-47ef-b073-01941fdcb7cd req-b22fdf21-1985-4373-ad82-e798d80e3384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28389f5a-754e-4bb2-95fc-909ef29e9bc8", "tag": "534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:33.357746 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c94eaa6-5123-4f0e-aa0a-63ccceb49632 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 200 len: 1302 microversion: 2.1 time: 0.523231 Aug 27 05:15:33.375459 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2313/4626] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:32 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 1302 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:33.397530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1e952c1b-cf52-44f6-85e8-6977dcbf8454 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:33.407147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1e952c1b-cf52-44f6-85e8-6977dcbf8454 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:33.430603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-279e9c5f-6086-47ef-b073-01941fdcb7cd req-b22fdf21-1985-4373-ad82-e798d80e3384 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.431119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-279e9c5f-6086-47ef-b073-01941fdcb7cd req-b22fdf21-1985-4373-ad82-e798d80e3384 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.431967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e952c1b-cf52-44f6-85e8-6977dcbf8454 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.432537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e952c1b-cf52-44f6-85e8-6977dcbf8454 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.433222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e952c1b-cf52-44f6-85e8-6977dcbf8454 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.434185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e952c1b-cf52-44f6-85e8-6977dcbf8454 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.438062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e952c1b-cf52-44f6-85e8-6977dcbf8454 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.438867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e952c1b-cf52-44f6-85e8-6977dcbf8454 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.440182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-279e9c5f-6086-47ef-b073-01941fdcb7cd req-b22fdf21-1985-4373-ad82-e798d80e3384 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.492786 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-279e9c5f-6086-47ef-b073-01941fdcb7cd req-b22fdf21-1985-4373-ad82-e798d80e3384 service nova] Creating event network-changed:534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67 for instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 on n-h2-820368-35 Aug 27 05:15:33.525739 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-279e9c5f-6086-47ef-b073-01941fdcb7cd req-b22fdf21-1985-4373-ad82-e798d80e3384 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175243 Aug 27 05:15:33.537694 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2314/4627] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:33.550651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:33.553887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:33.582110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.585270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.591322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.593085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.598941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.600361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.743644 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1e952c1b-cf52-44f6-85e8-6977dcbf8454 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8/action" status: 202 len: 0 microversion: 2.1 time: 0.363747 Aug 27 05:15:33.745852 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2314/4628] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:15:33 2022] POST /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:33.757677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:33.759606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:33.772755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.774090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.775199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.777156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.778213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.778864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.983175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:34.018827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:34.021236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:34.022701 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-375ada0c-39f8-464c-a1ba-5a1c618198ee tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1335 microversion: 2.54 time: 0.274714 Aug 27 05:15:34.036027 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2315/4629] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:33 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1335 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:34.047238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-52c47fd4-f298-4607-8e0b-2cd1ba8b420f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:34.048226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-52c47fd4-f298-4607-8e0b-2cd1ba8b420f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:34.055485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52c47fd4-f298-4607-8e0b-2cd1ba8b420f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:34.056689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52c47fd4-f298-4607-8e0b-2cd1ba8b420f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:34.057797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52c47fd4-f298-4607-8e0b-2cd1ba8b420f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:34.058743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52c47fd4-f298-4607-8e0b-2cd1ba8b420f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:34.059411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52c47fd4-f298-4607-8e0b-2cd1ba8b420f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:34.060080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52c47fd4-f298-4607-8e0b-2cd1ba8b420f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:34.069355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:34.087656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:34.092750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:34.098809 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-263e195e-020f-49a9-a685-2bb9b41d3e04 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.557932 Aug 27 05:15:34.106362 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2315/4630] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:33 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:34.383933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:34.385023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:34.414789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:34.417888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:34.418812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:34.423755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:34.427442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:34.429997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:34.478139 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] HTTP exception thrown: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Request method failure captured: Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab HTTP/1.1 Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCagoSOpwQi58WywYii5oPLrCN_Ys5nWq9vCaDcXMwhtminn4JSgjdMui0jQrXjzOAP19XX1ZiK9WPv2FzfSklqswQsyZfxSvVT4KRLi88Umlwx_-aOOdxyHsvh3fwHwnRmxE8NI7-nNcIJv3mMBBU-I_DXMVLPizvCrDF_AG7lyFwpg Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2fce25efce44ca2af48550a5e49d3c4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: a4f64cdce2564b2aaeefe6ff048ce65f Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '4498264f-9b1d-45e7-ac47-fa063bbce8ab'} Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:34.480081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:34.484179 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:34.484179 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:34.484179 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:34.484179 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:34.484179 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:34.484179 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:34.484179 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:34.484179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Returning 404 to user: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:34.484179 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c41bb339-5fbc-4fc5-a6af-829c025ab436 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 404 len: 111 microversion: 2.1 time: 0.103045 Aug 27 05:15:34.491579 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2316/4631] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:34 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:34.585483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-52c47fd4-f298-4607-8e0b-2cd1ba8b420f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:34.597652 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-52c47fd4-f298-4607-8e0b-2cd1ba8b420f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1575 microversion: 2.1 time: 0.560138 Aug 27 05:15:34.618481 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2316/4632] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:34 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1575 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:34.705393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f853a47a-1bb0-497c-baac-389769eed70d req-d04e5078-5feb-4a05-a924-08586bdd78f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f4c359-6f7e-4009-a365-7b070eec11a9", "name": "network-vif-plugged", "status": "completed", "tag": "2a4e09b9-01c8-433a-8d9e-e93f9888b163"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:34.721816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f853a47a-1bb0-497c-baac-389769eed70d req-d04e5078-5feb-4a05-a924-08586bdd78f4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:34.722596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f853a47a-1bb0-497c-baac-389769eed70d req-d04e5078-5feb-4a05-a924-08586bdd78f4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:34.723260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f853a47a-1bb0-497c-baac-389769eed70d req-d04e5078-5feb-4a05-a924-08586bdd78f4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:34.738173 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f853a47a-1bb0-497c-baac-389769eed70d req-d04e5078-5feb-4a05-a924-08586bdd78f4 service nova] Creating event network-vif-plugged:2a4e09b9-01c8-433a-8d9e-e93f9888b163 for instance e5f4c359-6f7e-4009-a365-7b070eec11a9 on n-h2-820368-35 Aug 27 05:15:34.746205 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f853a47a-1bb0-497c-baac-389769eed70d req-d04e5078-5feb-4a05-a924-08586bdd78f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043103 Aug 27 05:15:34.747602 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2317/4633] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:35.063723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:35.067397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:35.089740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:35.090996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:35.092057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:35.093866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:35.094985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:35.096857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:35.135363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:35.137791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:35.162645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:35.177984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:35.181299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:35.191154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:35.192017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:35.193728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:35.374900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:35.425893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:35.437243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:35.445882 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-18522bde-42e8-42b1-a27a-330ef765e3a0 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1335 microversion: 2.54 time: 0.395628 Aug 27 05:15:35.448635 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2317/4634] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:35 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1335 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:35.626502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5d8fd0d4-8c6d-4811-90ce-35a595f5b978 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:35.628684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5d8fd0d4-8c6d-4811-90ce-35a595f5b978 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:35.647639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d8fd0d4-8c6d-4811-90ce-35a595f5b978 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:35.648511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d8fd0d4-8c6d-4811-90ce-35a595f5b978 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:35.649176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d8fd0d4-8c6d-4811-90ce-35a595f5b978 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:35.650231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d8fd0d4-8c6d-4811-90ce-35a595f5b978 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:35.650868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d8fd0d4-8c6d-4811-90ce-35a595f5b978 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:35.651498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d8fd0d4-8c6d-4811-90ce-35a595f5b978 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:36.194540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:36.226341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:36.239078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:36.239078 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6988ea80-77b4-4a41-a230-854f29fe052d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 1.113057 Aug 27 05:15:36.243273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d8fd0d4-8c6d-4811-90ce-35a595f5b978 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:36.252150 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2318/4635] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:35 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:36.263472 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5d8fd0d4-8c6d-4811-90ce-35a595f5b978 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1575 microversion: 2.1 time: 0.641744 Aug 27 05:15:36.277814 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2318/4636] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:35 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1575 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:36.477411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:36.478087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:36.495219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:36.497845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:36.498634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:36.499920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:36.500489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:36.500917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:36.623351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:36.648127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:36.651479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:36.653624 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a0cf69e-83ef-4d98-b60d-41da1bdff894 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1335 microversion: 2.54 time: 0.180996 Aug 27 05:15:36.654856 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2319/4637] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:36 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:37.269353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:37.270971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:37.291683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9fcb1dae-ff4a-4c7c-b629-d8da31dd0868 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:37.293742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9fcb1dae-ff4a-4c7c-b629-d8da31dd0868 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:37.310160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fcb1dae-ff4a-4c7c-b629-d8da31dd0868 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:37.319820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:37.321082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fcb1dae-ff4a-4c7c-b629-d8da31dd0868 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:37.327149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:37.328061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fcb1dae-ff4a-4c7c-b629-d8da31dd0868 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:37.329675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fcb1dae-ff4a-4c7c-b629-d8da31dd0868 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:37.330893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:37.334963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:37.336776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fcb1dae-ff4a-4c7c-b629-d8da31dd0868 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:37.337910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fcb1dae-ff4a-4c7c-b629-d8da31dd0868 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:37.338943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:37.347430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:38.061098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:38.082863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:38.085965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:38.093407 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b0a16c52-78ac-4195-a922-77c4dcf788f7 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.826735 Aug 27 05:15:38.102199 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2319/4638] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:37 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:38.124634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:38.130037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:38.147129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:38.150469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:38.151505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:38.154569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:38.155689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:38.160611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:38.193425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9fcb1dae-ff4a-4c7c-b629-d8da31dd0868 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:38.202036 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9fcb1dae-ff4a-4c7c-b629-d8da31dd0868 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1575 microversion: 2.1 time: 0.914682 Aug 27 05:15:38.207949 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2320/4639] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:37 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1575 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:38.369492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:38.439901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:38.453019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:38.455404 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-66773d05-e08d-41c5-b1bf-59639d0671da tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1335 microversion: 2.54 time: 0.347892 Aug 27 05:15:38.468399 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2320/4640] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:38 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1335 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:39.144929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:39.146219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:39.161232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:39.164998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:39.165944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:39.169047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:39.170517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:39.172738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:39.240846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-50bd7526-368a-4f58-bc6c-c33b059e88c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:39.241979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-50bd7526-368a-4f58-bc6c-c33b059e88c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:39.265677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50bd7526-368a-4f58-bc6c-c33b059e88c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:39.270931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50bd7526-368a-4f58-bc6c-c33b059e88c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:39.271758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50bd7526-368a-4f58-bc6c-c33b059e88c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:39.275460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50bd7526-368a-4f58-bc6c-c33b059e88c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:39.276364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50bd7526-368a-4f58-bc6c-c33b059e88c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:39.280003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50bd7526-368a-4f58-bc6c-c33b059e88c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.168243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:40.216612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:40.242253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:40.244160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:40.245403 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b64dc33-2dd6-4cb4-9a23-a927fbcc9857 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 1.106751 Aug 27 05:15:40.260875 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2321/4641] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:39 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:40.276863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:40.279820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:40.307335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.308416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.312915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.316106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.317029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.317662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.365768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-50bd7526-368a-4f58-bc6c-c33b059e88c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:40.401274 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-50bd7526-368a-4f58-bc6c-c33b059e88c2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1575 microversion: 2.1 time: 1.165424 Aug 27 05:15:40.403561 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2321/4642] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:39 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1575 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:40.642394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:40.660653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:40.670757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:40.676913 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-15655f7a-e939-4041-9b0f-7cbcc6bb7173 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1356 microversion: 2.54 time: 0.414391 Aug 27 05:15:40.677995 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2322/4643] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:40 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1356 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:40.710765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-55bc523b-f632-44c3-991e-40572ae14358 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Action: 'create', calling method: .version_select at 0x7fb56962e940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1558762357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2A8OTVf1UeOB+MCQL0ZqAwHrtrl30cqJecGbPY0cC1hZHctIJpBo+I3G07CR3Irk6gqmGjOdPiaQQc3i12ZvgBX66sDKKOUi1beXt815hq5G61PvwO/v3J2+o/00gYWg=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:40.732900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:40.749878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:40.765507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-55bc523b-f632-44c3-991e-40572ae14358 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Getting quotas for project c854f94d0d7c400181d00b87ca011ee4. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:15:40.789844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-55bc523b-f632-44c3-991e-40572ae14358 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Getting quotas for user 1ee1d9324a6e42f5b405441aa2a6e1e4 and project c854f94d0d7c400181d00b87ca011ee4. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:15:40.851208 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-55bc523b-f632-44c3-991e-40572ae14358 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.147727 Aug 27 05:15:40.858905 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2322/4644] 10.222.0.58 () {62 vars in 1200 bytes} [Sat Aug 27 05:15:40 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 157 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 05:15:40.864039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1558762357", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:40.867121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:40.897682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.898187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.898644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.902461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.913990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.914775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:41.296452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:41.298788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:41.323032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:41.323896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:41.324546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:41.327390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:41.331360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:41.332255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:41.860231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:41.886857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:41.898349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:41.900492 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-838d3f88-29ad-4ddd-b329-f0395146dd3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.608171 Aug 27 05:15:41.919203 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2323/4645] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:41 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:41.925603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b6337315-db40-4113-b1b0-f1e5a8f20608 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:41.936083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b6337315-db40-4113-b1b0-f1e5a8f20608 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:41.968862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6337315-db40-4113-b1b0-f1e5a8f20608 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:41.969674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6337315-db40-4113-b1b0-f1e5a8f20608 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:41.970279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6337315-db40-4113-b1b0-f1e5a8f20608 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:41.971872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6337315-db40-4113-b1b0-f1e5a8f20608 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:41.972514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6337315-db40-4113-b1b0-f1e5a8f20608 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:41.973112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6337315-db40-4113-b1b0-f1e5a8f20608 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:42.435132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b6337315-db40-4113-b1b0-f1e5a8f20608 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:42.453530 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b6337315-db40-4113-b1b0-f1e5a8f20608 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1573 microversion: 2.1 time: 0.532487 Aug 27 05:15:42.469917 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2324/4646] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:41 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1573 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:42.475423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-919ad1d1-c7f0-4087-9c5d-2558eb536bf2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1164177383"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:42.476256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-919ad1d1-c7f0-4087-9c5d-2558eb536bf2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:42.484393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-919ad1d1-c7f0-4087-9c5d-2558eb536bf2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:42.485130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-919ad1d1-c7f0-4087-9c5d-2558eb536bf2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:42.485769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-919ad1d1-c7f0-4087-9c5d-2558eb536bf2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:42.487220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-919ad1d1-c7f0-4087-9c5d-2558eb536bf2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:42.487840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-919ad1d1-c7f0-4087-9c5d-2558eb536bf2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:42.488428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-919ad1d1-c7f0-4087-9c5d-2558eb536bf2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:42.791362 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.network.security_group_api [None req-919ad1d1-c7f0-4087-9c5d-2558eb536bf2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Adding security group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 to port 534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67 Aug 27 05:15:43.401271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:15:43.401772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:15:43.402183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:15:43.402600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:15:43.403009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:15:43.496160 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-919ad1d1-c7f0-4087-9c5d-2558eb536bf2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8/action" status: 202 len: 0 microversion: 2.1 time: 1.024690 Aug 27 05:15:43.500597 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2325/4647] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:15:42 2022] POST /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8/action => generated 0 bytes in 1030 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:43.506116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:43.506630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:43.524512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:43.524933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:43.529599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:43.530628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:43.531072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:43.531607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:43.532209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:43.578978 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] HTTP exception thrown: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Request method failure captured: Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab HTTP/1.1 Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCagoSOpwQi58WywYii5oPLrCN_Ys5nWq9vCaDcXMwhtminn4JSgjdMui0jQrXjzOAP19XX1ZiK9WPv2FzfSklqswQsyZfxSvVT4KRLi88Umlwx_-aOOdxyHsvh3fwHwnRmxE8NI7-nNcIJv3mMBBU-I_DXMVLPizvCrDF_AG7lyFwpg Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2fce25efce44ca2af48550a5e49d3c4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: a4f64cdce2564b2aaeefe6ff048ce65f Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '4498264f-9b1d-45e7-ac47-fa063bbce8ab'} Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:43.581056 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:43.585786 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:43.585786 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:43.585786 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:43.585786 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:43.585786 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:43.585786 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:43.585786 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:43.585786 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:43.585786 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:43.585786 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:43.585786 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:43.591580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Returning 404 to user: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:43.593201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:43.595257 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aeeb7b6c-a6e1-4605-a13e-46cd49bbc47f tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 404 len: 111 microversion: 2.1 time: 0.093195 Aug 27 05:15:43.601290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:43.604312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:43.605100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:43.607203 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2326/4648] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:43 2022] DELETE /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:43.608296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:43.610107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:43.610748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:43.631991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:43.633293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:43.653449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:43.654279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:43.659865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:43.660924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:43.664270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:43.665189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:43.705380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:43.716522 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0d585a72-778e-4d95-9a49-033b282f051f tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "POST /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d/action" status: 202 len: 1139 microversion: 2.54 time: 2.854685 Aug 27 05:15:43.717795 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2323/4649] 10.222.0.58 () {62 vars in 1320 bytes} [Sat Aug 27 05:15:40 2022] POST /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d/action => generated 1139 bytes in 2859 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 27 05:15:43.728077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8cfea60d-89a1-4886-8e27-ce583b5052a1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb56412d280>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:44.191732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-8cfea60d-89a1-4886-8e27-ce583b5052a1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 in use.", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:44.192750 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-8cfea60d-89a1-4886-8e27-ce583b5052a1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security Group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 in use. Aug 27 05:15:44.192750 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-add3678c-bd3c-4814-8108-0d90cb1aaefa'] Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8cfea60d-89a1-4886-8e27-ce583b5052a1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/os-security-groups/95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 HTTP/1.1 Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: exception: Security Group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 in use. Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-add3678c-bd3c-4814-8108-0d90cb1aaefa'] Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4'} Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:44.195205 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 in use. Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add3678c-bd3c-4814-8108-0d90cb1aaefa'] Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 in use. Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add3678c-bd3c-4814-8108-0d90cb1aaefa'] Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 in use. Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add3678c-bd3c-4814-8108-0d90cb1aaefa'] Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 in use. Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add3678c-bd3c-4814-8108-0d90cb1aaefa'] Aug 27 05:15:44.199646 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.207921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8cfea60d-89a1-4886-8e27-ce583b5052a1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 400 to user: Security Group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 in use. Aug 27 05:15:44.207921 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-add3678c-bd3c-4814-8108-0d90cb1aaefa'] {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:44.209155 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8cfea60d-89a1-4886-8e27-ce583b5052a1 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4" status: 400 len: 185 microversion: 2.1 time: 0.489994 Aug 27 05:15:44.209853 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2324/4650] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:43 2022] DELETE /compute/v2.1/os-security-groups/95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 => generated 185 bytes in 491 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:15:44.219565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:44.221230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: 4498264f-9b1d-45e7-ac47-fa063bbce8ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:44.225512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:44.235362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.240547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.244878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.245854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.246470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.247996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.248352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:44.250963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:44.252285 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cc22a6bd-65fc-4a8c-8357-5a92373bc16b tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1738 microversion: 2.20 time: 0.643690 Aug 27 05:15:44.267136 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2327/4651] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:43 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1738 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:44.267136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-737e50cc-5ddf-4a39-aa90-c26145c2dbe5 req-993721bd-2358-42a8-b20e-a77f063df8ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28389f5a-754e-4bb2-95fc-909ef29e9bc8", "tag": "534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:44.287024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-737e50cc-5ddf-4a39-aa90-c26145c2dbe5 req-993721bd-2358-42a8-b20e-a77f063df8ca service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.287683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-737e50cc-5ddf-4a39-aa90-c26145c2dbe5 req-993721bd-2358-42a8-b20e-a77f063df8ca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.295039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-737e50cc-5ddf-4a39-aa90-c26145c2dbe5 req-993721bd-2358-42a8-b20e-a77f063df8ca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.296956 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] HTTP exception thrown: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Request method failure captured: Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab HTTP/1.1 Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCagoSOpwQi58WywYii5oPLrCN_Ys5nWq9vCaDcXMwhtminn4JSgjdMui0jQrXjzOAP19XX1ZiK9WPv2FzfSklqswQsyZfxSvVT4KRLi88Umlwx_-aOOdxyHsvh3fwHwnRmxE8NI7-nNcIJv3mMBBU-I_DXMVLPizvCrDF_AG7lyFwpg Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2fce25efce44ca2af48550a5e49d3c4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: a4f64cdce2564b2aaeefe6ff048ce65f Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '4498264f-9b1d-45e7-ac47-fa063bbce8ab'} Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:44.307709 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.312834 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.312834 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:44.312834 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:44.312834 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:44.312834 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:44.312834 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. Aug 27 05:15:44.312834 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.312834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Returning 404 to user: Instance 4498264f-9b1d-45e7-ac47-fa063bbce8ab could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:44.313756 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa48f7d9-f0ed-4f69-b4e0-59593848b820 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab" status: 404 len: 111 microversion: 2.1 time: 0.102143 Aug 27 05:15:44.315902 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2325/4652] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:44 2022] GET /compute/v2.1/servers/4498264f-9b1d-45e7-ac47-fa063bbce8ab => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:44.326661 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-737e50cc-5ddf-4a39-aa90-c26145c2dbe5 req-993721bd-2358-42a8-b20e-a77f063df8ca service nova] Creating event network-changed:534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67 for instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 on n-h2-820368-35 Aug 27 05:15:44.331503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:44.336559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:44.337632 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-737e50cc-5ddf-4a39-aa90-c26145c2dbe5 req-993721bd-2358-42a8-b20e-a77f063df8ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082291 Aug 27 05:15:44.339464 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2328/4653] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:44.347018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-20dbcbe9-7e91-440f-b8c1-4d48064ce78f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:44.348343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-20dbcbe9-7e91-440f-b8c1-4d48064ce78f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:44.355298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20dbcbe9-7e91-440f-b8c1-4d48064ce78f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.356604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20dbcbe9-7e91-440f-b8c1-4d48064ce78f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.357063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20dbcbe9-7e91-440f-b8c1-4d48064ce78f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.357803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20dbcbe9-7e91-440f-b8c1-4d48064ce78f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.358272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20dbcbe9-7e91-440f-b8c1-4d48064ce78f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.358713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20dbcbe9-7e91-440f-b8c1-4d48064ce78f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.368592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.374381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.377772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.385792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.386598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.387284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.423287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-20dbcbe9-7e91-440f-b8c1-4d48064ce78f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:15:44.556521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:44.618901 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-20dbcbe9-7e91-440f-b8c1-4d48064ce78f tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 204 len: 0 microversion: 2.1 time: 0.277376 Aug 27 05:15:44.620294 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2329/4654] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:44 2022] DELETE /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:15:44.621016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:44.624611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:44.626281 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e56319a4-2307-4906-b85c-66115cc9431c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.307629 Aug 27 05:15:44.632063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:44.639163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:44.643041 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2326/4655] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:44 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:44.654311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.655203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.657924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.659230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.660989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.663068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.664292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14feea1c-2ea7-41c8-be16-3d723bc670ac tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:44.665187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14feea1c-2ea7-41c8-be16-3d723bc670ac tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:44.675518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14feea1c-2ea7-41c8-be16-3d723bc670ac tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.677739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14feea1c-2ea7-41c8-be16-3d723bc670ac tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.678397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14feea1c-2ea7-41c8-be16-3d723bc670ac tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.680006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14feea1c-2ea7-41c8-be16-3d723bc670ac tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.680721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14feea1c-2ea7-41c8-be16-3d723bc670ac tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.681305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14feea1c-2ea7-41c8-be16-3d723bc670ac tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.702709 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] HTTP exception thrown: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Request method failure captured: Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec HTTP/1.1 Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCagoSOpwQi58WywYii5oPLrCN_Ys5nWq9vCaDcXMwhtminn4JSgjdMui0jQrXjzOAP19XX1ZiK9WPv2FzfSklqswQsyZfxSvVT4KRLi88Umlwx_-aOOdxyHsvh3fwHwnRmxE8NI7-nNcIJv3mMBBU-I_DXMVLPizvCrDF_AG7lyFwpg Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2fce25efce44ca2af48550a5e49d3c4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: a4f64cdce2564b2aaeefe6ff048ce65f Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'f03424c7-42f3-4ae4-9175-cc7e56cbeeec'} Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:44.706477 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:44.713541 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:15:44.713541 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.713541 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:44.713541 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.713541 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.713541 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:44.713541 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:44.713541 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:44.713541 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:44.713541 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:15:44.713541 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.716280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Returning 404 to user: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:44.717809 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-45ab6d1b-7f8b-463c-9513-3319528ac81a tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 404 len: 111 microversion: 2.1 time: 0.096146 Aug 27 05:15:44.723184 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2330/4656] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:44 2022] DELETE /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:44.729084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:44.730124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] [instance: f03424c7-42f3-4ae4-9175-cc7e56cbeeec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:44.737679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.738478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.739118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.740041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.740672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.741288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.762047 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] HTTP exception thrown: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Request method failure captured: Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec HTTP/1.1 Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCagoSOpwQi58WywYii5oPLrCN_Ys5nWq9vCaDcXMwhtminn4JSgjdMui0jQrXjzOAP19XX1ZiK9WPv2FzfSklqswQsyZfxSvVT4KRLi88Umlwx_-aOOdxyHsvh3fwHwnRmxE8NI7-nNcIJv3mMBBU-I_DXMVLPizvCrDF_AG7lyFwpg Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2fce25efce44ca2af48550a5e49d3c4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2fce25efce44ca2af48550a5e49d3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e2fce25efce44ca2af48550a5e49d3c4 Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersTestMultiNic-1492440714 Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: a4f64cdce2564b2aaeefe6ff048ce65f Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersTestMultiNic-1492440714-project Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'f03424c7-42f3-4ae4-9175-cc7e56cbeeec'} Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:44.764569 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.769150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.769150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:44.769150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:44.769150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:44.769150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:44.769150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. Aug 27 05:15:44.769150 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.770968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] Returning 404 to user: Instance f03424c7-42f3-4ae4-9175-cc7e56cbeeec could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:44.772346 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-038a0ce3-ec1e-4e8f-9543-acb012cae9d4 tempest-ServersTestMultiNic-1492440714 tempest-ServersTestMultiNic-1492440714-project] 10.222.0.58 "GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec" status: 404 len: 111 microversion: 2.1 time: 0.047451 Aug 27 05:15:44.773653 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2331/4657] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:44 2022] GET /compute/v2.1/servers/f03424c7-42f3-4ae4-9175-cc7e56cbeeec => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:45.156836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14feea1c-2ea7-41c8-be16-3d723bc670ac tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:45.168472 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14feea1c-2ea7-41c8-be16-3d723bc670ac tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1648 microversion: 2.1 time: 0.523948 Aug 27 05:15:45.183705 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2327/4658] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:44 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1648 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:45.282060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:45.283410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:45.293426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.303291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.309055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.311866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.320640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.324258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.662119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:45.662743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:45.666678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:45.686843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.687694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.688300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.689757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.690385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.690976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.825397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:45.845104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:45.847804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:45.850660 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7c4c98dc-c832-4ebc-b952-ed317aee6daf tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.192426 Aug 27 05:15:45.851317 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2328/4659] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:45 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:45.897702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:45.918516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:45.922216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:45.927488 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-24eb4b68-8744-497e-8be5-f518da19a145 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1720 microversion: 2.20 time: 0.650373 Aug 27 05:15:45.937330 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2332/4660] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:45 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1720 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:46.190632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb0fc0c1-143d-40dc-9167-9bafc738d69b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:46.191432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bb0fc0c1-143d-40dc-9167-9bafc738d69b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:46.205134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0c1-143d-40dc-9167-9bafc738d69b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:46.205635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0c1-143d-40dc-9167-9bafc738d69b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:46.206283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0c1-143d-40dc-9167-9bafc738d69b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:46.207202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0c1-143d-40dc-9167-9bafc738d69b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:46.207819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0c1-143d-40dc-9167-9bafc738d69b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:46.208652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0c1-143d-40dc-9167-9bafc738d69b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:46.623306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb0fc0c1-143d-40dc-9167-9bafc738d69b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:46.638705 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb0fc0c1-143d-40dc-9167-9bafc738d69b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1648 microversion: 2.1 time: 0.452584 Aug 27 05:15:46.641269 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2329/4661] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:46 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1648 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:46.882035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:46.884625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:46.907501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:46.911233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:46.912142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:46.913243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:46.913900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:46.914537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:46.957367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:46.958687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:46.975308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:46.975793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:46.976239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:46.976970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:46.977423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:46.982129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:47.233123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:47.266733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:47.272534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:47.276353 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-45f0ce23-3f9d-4c2d-833a-6ab7457566c3 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.399319 Aug 27 05:15:47.289654 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2333/4662] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:46 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:47.610279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:47.620209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:47.625809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:47.629563 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5aa4f85d-afc0-41c0-a1b1-4b39edc0af72 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1720 microversion: 2.20 time: 0.679510 Aug 27 05:15:47.633357 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2330/4663] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:46 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1720 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:47.669746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fbab0f3b-97e3-4dc1-8122-d85ba577b9bb tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:47.670818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fbab0f3b-97e3-4dc1-8122-d85ba577b9bb tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:47.697885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbab0f3b-97e3-4dc1-8122-d85ba577b9bb tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:47.699600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbab0f3b-97e3-4dc1-8122-d85ba577b9bb tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:47.700717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbab0f3b-97e3-4dc1-8122-d85ba577b9bb tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:47.702390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbab0f3b-97e3-4dc1-8122-d85ba577b9bb tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:47.703555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbab0f3b-97e3-4dc1-8122-d85ba577b9bb tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:47.705226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fbab0f3b-97e3-4dc1-8122-d85ba577b9bb tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:48.267424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fbab0f3b-97e3-4dc1-8122-d85ba577b9bb tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:48.281807 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fbab0f3b-97e3-4dc1-8122-d85ba577b9bb tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1648 microversion: 2.1 time: 0.616323 Aug 27 05:15:48.283426 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2334/4664] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:47 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1648 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:48.303144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:48.303998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:48.318141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:48.318794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:48.323299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:48.324209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:48.324833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:48.325333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:48.495666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:48.508633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:48.511701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:48.513965 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c1ac2a69-189f-4fe8-8625-697ccb88626d tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.215521 Aug 27 05:15:48.516172 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2331/4665] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:48 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:48.658892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:48.660119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:48.675311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:48.679174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:48.689317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:48.692947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:48.693887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:48.694987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:49.032939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:49.047140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:49.049166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:49.050883 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f79dc07d-7279-4165-a806-6d9581095aa4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1720 microversion: 2.20 time: 0.397491 Aug 27 05:15:49.055057 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2335/4666] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:48 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1720 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:49.122298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f0584846-0d8b-42e4-9535-ab892c3f4a4d req-d2a8bd88-b72e-4e9c-a51b-aad25e80951f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08a333d-504a-41ad-a796-2069aecd4bd9", "name": "network-vif-unplugged", "status": "completed", "tag": "6e183864-02b7-4485-8c8f-1050892f3cb4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:49.161145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f0584846-0d8b-42e4-9535-ab892c3f4a4d req-d2a8bd88-b72e-4e9c-a51b-aad25e80951f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:49.162419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f0584846-0d8b-42e4-9535-ab892c3f4a4d req-d2a8bd88-b72e-4e9c-a51b-aad25e80951f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:49.165375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f0584846-0d8b-42e4-9535-ab892c3f4a4d req-d2a8bd88-b72e-4e9c-a51b-aad25e80951f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:49.193562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-8c0ef9c2-a849-4055-a791-98ec9c342215 req-6078047e-a79c-494a-8ee1-0e31e566157d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28389f5a-754e-4bb2-95fc-909ef29e9bc8", "name": "network-vif-deleted", "tag": "534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:49.233580 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f0584846-0d8b-42e4-9535-ab892c3f4a4d req-d2a8bd88-b72e-4e9c-a51b-aad25e80951f service nova] Creating event network-vif-unplugged:6e183864-02b7-4485-8c8f-1050892f3cb4 for instance e08a333d-504a-41ad-a796-2069aecd4bd9 on n-h2-820368-35 Aug 27 05:15:49.238548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8c0ef9c2-a849-4055-a791-98ec9c342215 req-6078047e-a79c-494a-8ee1-0e31e566157d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:49.240127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8c0ef9c2-a849-4055-a791-98ec9c342215 req-6078047e-a79c-494a-8ee1-0e31e566157d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:49.240801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8c0ef9c2-a849-4055-a791-98ec9c342215 req-6078047e-a79c-494a-8ee1-0e31e566157d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:49.254217 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f0584846-0d8b-42e4-9535-ab892c3f4a4d req-d2a8bd88-b72e-4e9c-a51b-aad25e80951f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136271 Aug 27 05:15:49.256282 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2332/4667] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:49.289440 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-8c0ef9c2-a849-4055-a791-98ec9c342215 req-6078047e-a79c-494a-8ee1-0e31e566157d service nova] Creating event network-vif-deleted:534ce3a2-ba4e-43b6-bfa4-2f5c5dee1a67 for instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 on n-h2-820368-35 Aug 27 05:15:49.300278 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-8c0ef9c2-a849-4055-a791-98ec9c342215 req-6078047e-a79c-494a-8ee1-0e31e566157d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111890 Aug 27 05:15:49.302180 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2336/4668] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:15:49.309068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb771f03-74fc-4a3d-a880-e340d4e72a89 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:49.309809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb771f03-74fc-4a3d-a880-e340d4e72a89 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:49.331437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb771f03-74fc-4a3d-a880-e340d4e72a89 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:49.332050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb771f03-74fc-4a3d-a880-e340d4e72a89 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:49.332518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb771f03-74fc-4a3d-a880-e340d4e72a89 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:49.333295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb771f03-74fc-4a3d-a880-e340d4e72a89 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:49.333773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb771f03-74fc-4a3d-a880-e340d4e72a89 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:49.343769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb771f03-74fc-4a3d-a880-e340d4e72a89 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:49.485724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb771f03-74fc-4a3d-a880-e340d4e72a89 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:49.514850 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb771f03-74fc-4a3d-a880-e340d4e72a89 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1468 microversion: 2.1 time: 0.211316 Aug 27 05:15:49.533507 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2333/4669] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:49 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1468 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:49.546920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:49.547680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:49.566437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:49.570090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:49.570830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:49.572495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:49.575957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:49.576664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:49.842034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:49.869080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:49.871476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:49.880539 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a06cd5c-5b9d-4f38-85a3-1d7253b10460 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.337545 Aug 27 05:15:49.881892 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2337/4670] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:49 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:50.082130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:50.084453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:50.103185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:50.104246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:50.105049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:50.106366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:50.107301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:50.111128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:50.547409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:50.548574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:50.584914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:50.595356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:50.597316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:50.601875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:50.609846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:50.621027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:50.626268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:50.627818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:50.654950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:50.670690 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6c4abc0e-ffe2-4026-89a9-e7ed32c1ae9d tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1720 microversion: 2.20 time: 0.596108 Aug 27 05:15:50.672685 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2334/4671] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:50 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1720 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:50.752886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:50.754971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:50.757989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:50.760619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lazy-loading 'fault' on Instance uuid 28389f5a-754e-4bb2-95fc-909ef29e9bc8 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:15:50.812012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:50.844803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:50.883180 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-68bfcf57-5a0d-42b1-97db-bfb3339ce8c8 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 200 len: 1306 microversion: 2.1 time: 0.345632 Aug 27 05:15:50.899132 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2338/4672] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:50 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 1306 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:50.938836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:50.940444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:50.953620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:50.954145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:50.955155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:50.960217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:50.960719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:50.961177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:51.099771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:51.123895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:51.125954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:51.128037 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aa54356a-54fb-4a03-9195-714af794a638 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.193818 Aug 27 05:15:51.129156 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2335/4673] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:50 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:51.700156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:51.700806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:51.711742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:51.712245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:51.712698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:51.713439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:51.713877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:51.714312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:51.915435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:51.916085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:51.929442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:51.936297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:51.940338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:51.941503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:51.944810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:51.948097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:52.005277 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 HTTP/1.1 Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '28389f5a-754e-4bb2-95fc-909ef29e9bc8'} Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:52.013642 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:52.019241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:52.019241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:52.019241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:52.019241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:52.019241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:52.019241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:52.019241 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:52.023482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:52.025020 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-639ee385-6fa2-4e71-9e36-d074a62df648 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 404 len: 111 microversion: 2.1 time: 0.113563 Aug 27 05:15:52.026322 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2336/4674] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:51 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:52.038390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9620bee-ebe8-4d22-82fa-28c92ec9d28a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb5696141f0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:52.953815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:52.976735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:52.979214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:52.982048 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b53c736a-0600-4b34-bd70-8e8957a448d9 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1723 microversion: 2.20 time: 1.286640 Aug 27 05:15:52.985991 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2339/4675] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:51 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1723 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:52.997162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:52.998058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:53.001148 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9620bee-ebe8-4d22-82fa-28c92ec9d28a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/7bf6812b-667f-4645-a6b4-72b5c21f8b76" status: 202 len: 0 microversion: 2.1 time: 0.967012 Aug 27 05:15:53.008888 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2337/4676] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:52 2022] DELETE /compute/v2.1/os-security-groups/7bf6812b-667f-4645-a6b4-72b5c21f8b76 => generated 0 bytes in 975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:53.012003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:53.012605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:53.013073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:53.013802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:53.014288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:53.014737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:53.016046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-52d0c1c9-7326-4f46-9989-115f34ea67ed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c745f90-80c4-4c50-b867-8d5b6077318d"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:53.019365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-52d0c1c9-7326-4f46-9989-115f34ea67ed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:53.042120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52d0c1c9-7326-4f46-9989-115f34ea67ed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:53.042953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52d0c1c9-7326-4f46-9989-115f34ea67ed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:53.043650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52d0c1c9-7326-4f46-9989-115f34ea67ed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:53.044613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52d0c1c9-7326-4f46-9989-115f34ea67ed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:53.045284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52d0c1c9-7326-4f46-9989-115f34ea67ed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:53.056697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52d0c1c9-7326-4f46-9989-115f34ea67ed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:53.633466 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-52d0c1c9-7326-4f46-9989-115f34ea67ed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "POST /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.622547 Aug 27 05:15:53.634689 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2338/4677] 10.222.0.58 () {62 vars in 1364 bytes} [Sat Aug 27 05:15:53 2022] POST /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/os-volume_attachments => generated 188 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:15:53.639812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d784832e-241b-421d-ab15-0075eae50e50 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb56486a9d0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:53.910332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:53.929316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:53.930773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:53.932008 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-210453e5-c5e9-426d-a6c3-bb97777b4a2b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.944667 Aug 27 05:15:53.933166 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2340/4678] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:52 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:53.941675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7be1b6bb-bc0d-4061-839b-7950e04e9455 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:53.942534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7be1b6bb-bc0d-4061-839b-7950e04e9455 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:53.964287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b6bb-bc0d-4061-839b-7950e04e9455 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:53.966373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b6bb-bc0d-4061-839b-7950e04e9455 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:53.967029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b6bb-bc0d-4061-839b-7950e04e9455 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:53.967972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b6bb-bc0d-4061-839b-7950e04e9455 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:53.973561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b6bb-bc0d-4061-839b-7950e04e9455 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:53.974269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b6bb-bc0d-4061-839b-7950e04e9455 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:54.512895 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7be1b6bb-bc0d-4061-839b-7950e04e9455 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/os-volume_attachments/3c745f90-80c4-4c50-b867-8d5b6077318d" status: 202 len: 0 microversion: 2.20 time: 0.574429 Aug 27 05:15:54.514702 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2341/4679] 10.222.0.58 () {60 vars in 1457 bytes} [Sat Aug 27 05:15:53 2022] DELETE /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/os-volume_attachments/3c745f90-80c4-4c50-b867-8d5b6077318d => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:15:54.650632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97cabcc5-1c6e-456a-9c5b-6bbf3f72de00 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:54.651507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97cabcc5-1c6e-456a-9c5b-6bbf3f72de00 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:54.679403 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d784832e-241b-421d-ab15-0075eae50e50 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4" status: 202 len: 0 microversion: 2.1 time: 1.042602 Aug 27 05:15:54.680743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97cabcc5-1c6e-456a-9c5b-6bbf3f72de00 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:54.681260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97cabcc5-1c6e-456a-9c5b-6bbf3f72de00 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:54.681778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97cabcc5-1c6e-456a-9c5b-6bbf3f72de00 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:54.682051 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2339/4680] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:53 2022] DELETE /compute/v2.1/os-security-groups/95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:54.682535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97cabcc5-1c6e-456a-9c5b-6bbf3f72de00 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:54.682958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97cabcc5-1c6e-456a-9c5b-6bbf3f72de00 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:54.687278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97cabcc5-1c6e-456a-9c5b-6bbf3f72de00 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:54.699749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:54.737986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5e2bbec8-45dd-4a91-a0e2-a6971d3c2407 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'create', calling method: .version_select at 0x7fb564133310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1398684076", "description": "tempest-description-1651861763"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:54.812780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97cabcc5-1c6e-456a-9c5b-6bbf3f72de00 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128548) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 05:15:55.101055 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-97cabcc5-1c6e-456a-9c5b-6bbf3f72de00 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "POST /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/action" status: 202 len: 0 microversion: 2.20 time: 0.457623 Aug 27 05:15:55.101822 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2342/4681] 10.222.0.58 () {62 vars in 1319 bytes} [Sat Aug 27 05:15:54 2022] POST /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:15:55.124442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:55.125109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:55.148412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.149213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.149854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:55.150757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.151426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.152051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:55.365822 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5e2bbec8-45dd-4a91-a0e2-a6971d3c2407 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.656828 Aug 27 05:15:55.367773 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2340/4682] 10.222.0.58 () {60 vars in 1180 bytes} [Sat Aug 27 05:15:54 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:55.377443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:55.386309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:55.389183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:55.401893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:55.404756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:55.411743 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-19087723-297a-4f89-80c8-adc872cad310 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.308068 Aug 27 05:15:55.414756 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2343/4683] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:55 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:55.420946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e3b870dd-9911-4db9-9787-db4af7e6e689 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Action: 'update', calling method: .version_select at 0x7fb5644bc820>, body: {"security_group": {"name": "tempest-sg-hth-739162992", "description": "tempest-description-hth-676294952"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:55.433745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.449425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.453328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:55.454416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.454951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.455462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:56.024213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:56.046688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:56.050343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:56.057441 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-787b44d0-a2fa-47a8-bfb3-781e973b3e0a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1671 microversion: 2.20 time: 0.685777 Aug 27 05:15:56.094490 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2341/4684] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:55 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1671 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:56.198728 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e3b870dd-9911-4db9-9787-db4af7e6e689 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/958665fa-13b5-4b63-8fb8-84bc4196d487" status: 200 len: 216 microversion: 2.1 time: 0.782637 Aug 27 05:15:56.215506 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2344/4685] 10.222.0.58 () {60 vars in 1290 bytes} [Sat Aug 27 05:15:55 2022] PUT /compute/v2.1/os-security-groups/958665fa-13b5-4b63-8fb8-84bc4196d487 => generated 216 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:56.217135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-396d947a-fe62-439f-8986-aba2da2fb8ce tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb5640cd430>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:56.447065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:56.450631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:56.480297 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-396d947a-fe62-439f-8986-aba2da2fb8ce tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/958665fa-13b5-4b63-8fb8-84bc4196d487" status: 200 len: 216 microversion: 2.1 time: 0.267881 Aug 27 05:15:56.494161 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2342/4686] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 05:15:56 2022] GET /compute/v2.1/os-security-groups/958665fa-13b5-4b63-8fb8-84bc4196d487 => generated 216 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:56.505116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aaeaddad-fd99-489f-8508-492f95289db2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb5640cdc10>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:56.532105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:56.533154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:56.533597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:56.534314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:56.549912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:56.550393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:56.985021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:56.995680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:57.002576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:57.005669 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aaeaddad-fd99-489f-8508-492f95289db2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/958665fa-13b5-4b63-8fb8-84bc4196d487" status: 202 len: 0 microversion: 2.1 time: 0.510389 Aug 27 05:15:57.006503 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2343/4687] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:56 2022] DELETE /compute/v2.1/os-security-groups/958665fa-13b5-4b63-8fb8-84bc4196d487 => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:57.008540 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-11c9158a-0bba-48ab-a5d6-239c7a4edd3c tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.567779 Aug 27 05:15:57.015132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.015766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:57.024278 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2345/4688] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:56 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:57.028655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:57.034693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:57.035666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:57.036644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:57.037331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:57.038001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:57.057844 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 HTTP/1.1 Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '28389f5a-754e-4bb2-95fc-909ef29e9bc8'} Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:57.059854 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1910e155-82d5-4f24-abf1-613f420556fe tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 404 len: 111 microversion: 2.1 time: 0.050226 Aug 27 05:15:57.065541 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2344/4689] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:57 2022] DELETE /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:15:57.071718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.072503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 28389f5a-754e-4bb2-95fc-909ef29e9bc8] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:57.080293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:57.081230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:57.081911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:57.082987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:57.083616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:57.084137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:57.090778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.092810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:57.104226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:57.105431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:57.106235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:57.107344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:57.107977 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:57.108113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:57.108710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 HTTP/1.1 Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '28389f5a-754e-4bb2-95fc-909ef29e9bc8'} Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.110694 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.130687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.130687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.130687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.130687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:57.130687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:57.130687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. Aug 27 05:15:57.130687 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.130687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Instance 28389f5a-754e-4bb2-95fc-909ef29e9bc8 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:57.130687 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c364bee7-bf4f-4235-9130-afc8eab3e62d tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8" status: 404 len: 111 microversion: 2.1 time: 0.047050 Aug 27 05:15:57.130687 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2346/4690] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:57 2022] GET /compute/v2.1/servers/28389f5a-754e-4bb2-95fc-909ef29e9bc8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:57.130687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-679737bd-930d-4054-b827-0016b73cacdd tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb56456d280>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.135966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=91,nova_cell1:INSERT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:57.219157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-679737bd-930d-4054-b827-0016b73cacdd tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:57.220622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-679737bd-930d-4054-b827-0016b73cacdd tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Neutron security group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 not found {{(pid=128548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:15:57.221707 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-679737bd-930d-4054-b827-0016b73cacdd tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 does not exist Aug 27 05:15:57.221707 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-7cf35fd2-cd58-48e4-9b24-8e8897cc04ef'] Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-679737bd-930d-4054-b827-0016b73cacdd tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-security-groups/95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 HTTP/1.1 Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 does not exist Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-7cf35fd2-cd58-48e4-9b24-8e8897cc04ef'] Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4'} Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:57.224019 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 does not exist Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cf35fd2-cd58-48e4-9b24-8e8897cc04ef'] Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 does not exist Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cf35fd2-cd58-48e4-9b24-8e8897cc04ef'] Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 does not exist Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cf35fd2-cd58-48e4-9b24-8e8897cc04ef'] Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 does not exist Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cf35fd2-cd58-48e4-9b24-8e8897cc04ef'] Aug 27 05:15:57.228519 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.238481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-679737bd-930d-4054-b827-0016b73cacdd tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Security group 95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 does not exist Aug 27 05:15:57.238481 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-7cf35fd2-cd58-48e4-9b24-8e8897cc04ef'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:57.238481 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-679737bd-930d-4054-b827-0016b73cacdd tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4" status: 404 len: 194 microversion: 2.1 time: 0.110694 Aug 27 05:15:57.238481 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2347/4691] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:57 2022] DELETE /compute/v2.1/os-security-groups/95d4b648-2fef-4fd6-a0cd-1386c0bd1ad4 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:57.247807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c6214279-2622-4ae8-805f-e879b4004698 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb5644fa4c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.430489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-c6214279-2622-4ae8-805f-e879b4004698 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:57.432252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-c6214279-2622-4ae8-805f-e879b4004698 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Neutron security group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 not found {{(pid=128548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:15:57.434526 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c6214279-2622-4ae8-805f-e879b4004698 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 does not exist Aug 27 05:15:57.434526 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-3e5ad400-bb77-499d-907d-27db1b3debad'] Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c6214279-2622-4ae8-805f-e879b4004698 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-security-groups/7bf6812b-667f-4645-a6b4-72b5c21f8b76 HTTP/1.1 Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 does not exist Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-3e5ad400-bb77-499d-907d-27db1b3debad'] Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '7bf6812b-667f-4645-a6b4-72b5c21f8b76'} Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:57.437926 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 does not exist Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e5ad400-bb77-499d-907d-27db1b3debad'] Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 does not exist Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e5ad400-bb77-499d-907d-27db1b3debad'] Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 does not exist Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e5ad400-bb77-499d-907d-27db1b3debad'] Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 does not exist Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e5ad400-bb77-499d-907d-27db1b3debad'] Aug 27 05:15:57.444177 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.450095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c6214279-2622-4ae8-805f-e879b4004698 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Security group 7bf6812b-667f-4645-a6b4-72b5c21f8b76 does not exist Aug 27 05:15:57.450095 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-3e5ad400-bb77-499d-907d-27db1b3debad'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:57.451453 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c6214279-2622-4ae8-805f-e879b4004698 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/7bf6812b-667f-4645-a6b4-72b5c21f8b76" status: 404 len: 194 microversion: 2.1 time: 0.211616 Aug 27 05:15:57.452574 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2348/4692] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:57 2022] DELETE /compute/v2.1/os-security-groups/7bf6812b-667f-4645-a6b4-72b5c21f8b76 => generated 194 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:15:57.467419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f292741-a3be-46f9-a1e2-cdcaf90297fc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb56456dca0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.540383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-8f292741-a3be-46f9-a1e2-cdcaf90297fc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:57.542388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-8f292741-a3be-46f9-a1e2-cdcaf90297fc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Neutron security group d0a03b68-1abd-4566-be1c-f4383db8d02c not found {{(pid=128548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:15:57.551988 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-8f292741-a3be-46f9-a1e2-cdcaf90297fc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:57.551988 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-2f8eb740-3faf-4283-9aa9-1c91919c918e'] Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f292741-a3be-46f9-a1e2-cdcaf90297fc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-security-groups/d0a03b68-1abd-4566-be1c-f4383db8d02c HTTP/1.1 Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-2f8eb740-3faf-4283-9aa9-1c91919c918e'] Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd0a03b68-1abd-4566-be1c-f4383db8d02c'} Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:57.555619 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f8eb740-3faf-4283-9aa9-1c91919c918e'] Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f8eb740-3faf-4283-9aa9-1c91919c918e'] Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f8eb740-3faf-4283-9aa9-1c91919c918e'] Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f8eb740-3faf-4283-9aa9-1c91919c918e'] Aug 27 05:15:57.559792 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.567468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f292741-a3be-46f9-a1e2-cdcaf90297fc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Security group d0a03b68-1abd-4566-be1c-f4383db8d02c does not exist Aug 27 05:15:57.567468 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-2f8eb740-3faf-4283-9aa9-1c91919c918e'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:57.571700 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f292741-a3be-46f9-a1e2-cdcaf90297fc tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/d0a03b68-1abd-4566-be1c-f4383db8d02c" status: 404 len: 194 microversion: 2.1 time: 0.110539 Aug 27 05:15:57.572654 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2349/4693] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:57 2022] DELETE /compute/v2.1/os-security-groups/d0a03b68-1abd-4566-be1c-f4383db8d02c => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:57.586988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-625d501a-c54e-4bfe-b757-3263370d1e41 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb5644bce50>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.639747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:57.649967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:57.651805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-625d501a-c54e-4bfe-b757-3263370d1e41 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:57.652528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-625d501a-c54e-4bfe-b757-3263370d1e41 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Neutron security group 75615337-77cd-44e8-9b18-e4557fbfdc22 not found {{(pid=128548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:15:57.653398 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-625d501a-c54e-4bfe-b757-3263370d1e41 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:57.653398 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-2eeea082-13bb-4ff1-b2c5-641e55a1f25b'] Aug 27 05:15:57.655467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-625d501a-c54e-4bfe-b757-3263370d1e41 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-security-groups/75615337-77cd-44e8-9b18-e4557fbfdc22 HTTP/1.1 Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-2eeea082-13bb-4ff1-b2c5-641e55a1f25b'] Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '75615337-77cd-44e8-9b18-e4557fbfdc22'} Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:57.656794 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2eeea082-13bb-4ff1-b2c5-641e55a1f25b'] Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2eeea082-13bb-4ff1-b2c5-641e55a1f25b'] Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2eeea082-13bb-4ff1-b2c5-641e55a1f25b'] Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2eeea082-13bb-4ff1-b2c5-641e55a1f25b'] Aug 27 05:15:57.662088 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.665126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-625d501a-c54e-4bfe-b757-3263370d1e41 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Security group 75615337-77cd-44e8-9b18-e4557fbfdc22 does not exist Aug 27 05:15:57.665126 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-2eeea082-13bb-4ff1-b2c5-641e55a1f25b'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:57.666152 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-625d501a-c54e-4bfe-b757-3263370d1e41 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/75615337-77cd-44e8-9b18-e4557fbfdc22" status: 404 len: 194 microversion: 2.1 time: 0.088611 Aug 27 05:15:57.667534 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2350/4694] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:57 2022] DELETE /compute/v2.1/os-security-groups/75615337-77cd-44e8-9b18-e4557fbfdc22 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:57.669760 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-96234b14-bf97-4475-a49c-e857057fe6d4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1671 microversion: 2.20 time: 0.584309 Aug 27 05:15:57.670819 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2345/4695] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:57 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1671 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:57.700374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-26f172a4-63c4-47cb-8013-fa536f76fe14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb5644fa310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.740653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG neutronclient.v2_0.client [None req-26f172a4-63c4-47cb-8013-fa536f76fe14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist", "detail": ""}} {{(pid=128548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:57.742302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-26f172a4-63c4-47cb-8013-fa536f76fe14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Neutron security group e16372a9-c87b-47cc-9731-939b62c6ee86 not found {{(pid=128548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:15:57.745478 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-26f172a4-63c4-47cb-8013-fa536f76fe14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:57.745478 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-b7642943-5dea-4a1d-9efa-aa2424075043'] Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-26f172a4-63c4-47cb-8013-fa536f76fe14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-security-groups/e16372a9-c87b-47cc-9731-939b62c6ee86 HTTP/1.1 Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: method: Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: exception: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-b7642943-5dea-4a1d-9efa-aa2424075043'] Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e16372a9-c87b-47cc-9731-939b62c6ee86'} Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:57.750420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7642943-5dea-4a1d-9efa-aa2424075043'] Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7642943-5dea-4a1d-9efa-aa2424075043'] Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7642943-5dea-4a1d-9efa-aa2424075043'] Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7642943-5dea-4a1d-9efa-aa2424075043'] Aug 27 05:15:57.754994 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.761450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-26f172a4-63c4-47cb-8013-fa536f76fe14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Security group e16372a9-c87b-47cc-9731-939b62c6ee86 does not exist Aug 27 05:15:57.761450 n-d-820368-35 devstack@n-api.service[128548]: Neutron server returns request_ids: ['req-b7642943-5dea-4a1d-9efa-aa2424075043'] {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:57.763428 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-26f172a4-63c4-47cb-8013-fa536f76fe14 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/e16372a9-c87b-47cc-9731-939b62c6ee86" status: 404 len: 194 microversion: 2.1 time: 0.079522 Aug 27 05:15:57.764712 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2351/4696] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:57 2022] DELETE /compute/v2.1/os-security-groups/e16372a9-c87b-47cc-9731-939b62c6ee86 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:57.773730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f294580a-5210-44cc-88b5-7101fe4a2c49 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb564135dc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.812748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG neutronclient.v2_0.client [None req-f294580a-5210-44cc-88b5-7101fe4a2c49 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist", "detail": ""}} {{(pid=128547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 05:15:57.813358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.security_group_api [None req-f294580a-5210-44cc-88b5-7101fe4a2c49 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Neutron security group 90f75973-36c6-4321-8259-6eae7605c79d not found {{(pid=128547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 05:15:57.814435 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f294580a-5210-44cc-88b5-7101fe4a2c49 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:57.814435 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-56fe1395-e5e6-4b84-8ca4-41a6d19233e8'] Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f294580a-5210-44cc-88b5-7101fe4a2c49 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/os-security-groups/90f75973-36c6-4321-8259-6eae7605c79d HTTP/1.1 Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: exception: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-56fe1395-e5e6-4b84-8ca4-41a6d19233e8'] Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '90f75973-36c6-4321-8259-6eae7605c79d'} Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 05:15:57.816289 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56fe1395-e5e6-4b84-8ca4-41a6d19233e8'] Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56fe1395-e5e6-4b84-8ca4-41a6d19233e8'] Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56fe1395-e5e6-4b84-8ca4-41a6d19233e8'] Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56fe1395-e5e6-4b84-8ca4-41a6d19233e8'] Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f294580a-5210-44cc-88b5-7101fe4a2c49 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Security group 90f75973-36c6-4321-8259-6eae7605c79d does not exist Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: Neutron server returns request_ids: ['req-56fe1395-e5e6-4b84-8ca4-41a6d19233e8'] {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f294580a-5210-44cc-88b5-7101fe4a2c49 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/90f75973-36c6-4321-8259-6eae7605c79d" status: 404 len: 194 microversion: 2.1 time: 0.047923 Aug 27 05:15:57.821314 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2346/4697] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:15:57 2022] DELETE /compute/v2.1/os-security-groups/90f75973-36c6-4321-8259-6eae7605c79d => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:57.907567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-42d4c8cf-3968-4548-aadd-531e089684ab tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.908706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-42d4c8cf-3968-4548-aadd-531e089684ab tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:57.929626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42d4c8cf-3968-4548-aadd-531e089684ab tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:57.933052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42d4c8cf-3968-4548-aadd-531e089684ab tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:57.933514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42d4c8cf-3968-4548-aadd-531e089684ab tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:57.934286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42d4c8cf-3968-4548-aadd-531e089684ab tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:57.936158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42d4c8cf-3968-4548-aadd-531e089684ab tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:57.936925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42d4c8cf-3968-4548-aadd-531e089684ab tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:58.005647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-42d4c8cf-3968-4548-aadd-531e089684ab tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:15:58.050254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:58.053736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:58.081948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:58.095567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:58.096636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:58.098065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:58.099200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:58.100183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:58.277784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:58.295992 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-42d4c8cf-3968-4548-aadd-531e089684ab tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 204 len: 0 microversion: 2.1 time: 0.468717 Aug 27 05:15:58.298744 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2352/4698] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:57 2022] DELETE /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:15:58.320469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:58.325672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ff4f6271-c2f2-46e4-bfa4-c937c849890b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:58.327000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ff4f6271-c2f2-46e4-bfa4-c937c849890b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:58.327903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:58.333388 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7c134f64-869e-435a-9568-f9e42d48d03a tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.288987 Aug 27 05:15:58.341483 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2347/4699] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:58 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:15:58.352103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4f6271-c2f2-46e4-bfa4-c937c849890b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:58.352784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4f6271-c2f2-46e4-bfa4-c937c849890b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:58.363823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4f6271-c2f2-46e4-bfa4-c937c849890b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:58.368478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4f6271-c2f2-46e4-bfa4-c937c849890b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:58.369494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4f6271-c2f2-46e4-bfa4-c937c849890b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:58.370268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4f6271-c2f2-46e4-bfa4-c937c849890b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:58.698401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:58.703263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:58.739156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ff4f6271-c2f2-46e4-bfa4-c937c849890b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:58.742201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:58.743040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:58.753488 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ff4f6271-c2f2-46e4-bfa4-c937c849890b tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1646 microversion: 2.1 time: 0.447310 Aug 27 05:15:58.753718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:58.754920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:58.755953 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2353/4700] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:58 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1646 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:58.771558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:58.772548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:59.121458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:59.132556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:59.134465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:59.136086 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6143b2c5-54fd-4cb0-b33a-826861d57016 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.445164 Aug 27 05:15:59.147128 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2348/4701] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:58 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:59.382426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:59.383289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:59.395446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:59.404255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:59.404862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:59.414017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:59.414771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:59.415312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:59.533286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:59.556096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:59.559811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:59.562488 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-383c1a55-5026-4d00-93e4-e463a4936b83 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.184496 Aug 27 05:15:59.565284 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2354/4702] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:15:59 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:15:59.795510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a32dd0b8-aa2f-4141-9389-7dc19a2905b2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:59.796658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a32dd0b8-aa2f-4141-9389-7dc19a2905b2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:59.803726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a32dd0b8-aa2f-4141-9389-7dc19a2905b2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:59.804842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a32dd0b8-aa2f-4141-9389-7dc19a2905b2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:59.805554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a32dd0b8-aa2f-4141-9389-7dc19a2905b2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:59.806497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a32dd0b8-aa2f-4141-9389-7dc19a2905b2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:59.807197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a32dd0b8-aa2f-4141-9389-7dc19a2905b2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:59.808066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a32dd0b8-aa2f-4141-9389-7dc19a2905b2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:00.078153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a9ce64c0-cc58-43bd-800b-63d52346119b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:00.079044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a9ce64c0-cc58-43bd-800b-63d52346119b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:00.086187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ce64c0-cc58-43bd-800b-63d52346119b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:00.086860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ce64c0-cc58-43bd-800b-63d52346119b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:00.087496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ce64c0-cc58-43bd-800b-63d52346119b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:00.088392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ce64c0-cc58-43bd-800b-63d52346119b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:00.089026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ce64c0-cc58-43bd-800b-63d52346119b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:00.089714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ce64c0-cc58-43bd-800b-63d52346119b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:00.395904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a32dd0b8-aa2f-4141-9389-7dc19a2905b2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:00.422631 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a32dd0b8-aa2f-4141-9389-7dc19a2905b2 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1646 microversion: 2.1 time: 0.631104 Aug 27 05:16:00.425445 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2349/4703] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:59 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1646 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:00.441754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:00.445451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:00.462451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:00.471978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:00.473677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:00.474657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:00.476893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:00.479176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:00.566906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a9ce64c0-cc58-43bd-800b-63d52346119b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:00.588704 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a9ce64c0-cc58-43bd-800b-63d52346119b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 0.514554 Aug 27 05:16:00.592980 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2355/4704] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:00 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:00.602161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:00.603244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:00.638814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:00.640885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:00.645793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:00.646927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:00.647677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:00.648376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:00.894335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:00.912921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:00.914724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:00.919618 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-500622d9-302d-4585-bea1-3d90b33c1175 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.492654 Aug 27 05:16:00.923974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:00.935315 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2350/4705] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:00 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:00.954918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:00.966211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:00.971565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-992107e7-6feb-45ea-9416-5c0f9d018433 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.374262 Aug 27 05:16:00.978356 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2356/4706] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:00 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:01.464938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f51fd022-9e06-4411-9228-f3cf795a1fb5 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:01.478987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f51fd022-9e06-4411-9228-f3cf795a1fb5 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:01.525062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51fd022-9e06-4411-9228-f3cf795a1fb5 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:01.533159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51fd022-9e06-4411-9228-f3cf795a1fb5 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:01.548821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51fd022-9e06-4411-9228-f3cf795a1fb5 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:01.550214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51fd022-9e06-4411-9228-f3cf795a1fb5 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:01.552746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51fd022-9e06-4411-9228-f3cf795a1fb5 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:01.553941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51fd022-9e06-4411-9228-f3cf795a1fb5 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:01.612947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b695529-8c57-482b-9f4a-345047415b65 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:01.613581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3b695529-8c57-482b-9f4a-345047415b65 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:01.644042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b695529-8c57-482b-9f4a-345047415b65 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:01.644576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b695529-8c57-482b-9f4a-345047415b65 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:01.654268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b695529-8c57-482b-9f4a-345047415b65 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:01.663627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b695529-8c57-482b-9f4a-345047415b65 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:01.664034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b695529-8c57-482b-9f4a-345047415b65 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:01.664491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b695529-8c57-482b-9f4a-345047415b65 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:02.514072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3b695529-8c57-482b-9f4a-345047415b65 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:02.553179 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3b695529-8c57-482b-9f4a-345047415b65 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.943692 Aug 27 05:16:02.560032 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2357/4707] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:01 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:02.571704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:02.576734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:02.592877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:02.597074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:02.597610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:02.605636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:02.606159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:02.606620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:02.811392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f51fd022-9e06-4411-9228-f3cf795a1fb5 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:02.864986 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f51fd022-9e06-4411-9228-f3cf795a1fb5 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1646 microversion: 2.1 time: 1.412229 Aug 27 05:16:02.867641 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2351/4708] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:01 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1646 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:02.880595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:02.881954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:02.893819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:02.894825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:02.895473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:02.897397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:02.898196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:02.898914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:03.155261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:03.178130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:03.185599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:03.190061 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-08271b2b-3bb5-446d-aec6-2584fde36981 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.317208 Aug 27 05:16:03.191210 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2352/4709] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:02 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:03.202126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed59bc63-e184-4813-94ea-b92b671bf4f7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-410542875"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:03.210346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed59bc63-e184-4813-94ea-b92b671bf4f7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:03.226606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed59bc63-e184-4813-94ea-b92b671bf4f7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:03.227560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed59bc63-e184-4813-94ea-b92b671bf4f7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:03.228299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed59bc63-e184-4813-94ea-b92b671bf4f7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:03.232191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed59bc63-e184-4813-94ea-b92b671bf4f7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:03.232950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed59bc63-e184-4813-94ea-b92b671bf4f7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:03.234290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed59bc63-e184-4813-94ea-b92b671bf4f7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:03.241231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:03.271194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:03.280053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:03.288802 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce001dd1-38a1-4c9a-a872-283809fe0a27 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.721005 Aug 27 05:16:03.303128 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2358/4710] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:02 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:03.551711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-821d3ba5-dd8a-46e9-bcf7-d50c4e74c953 req-12c45992-cdc2-4455-8613-ee668c698b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12268895-61a7-4826-895a-6e8ead0a1635", "name": "network-vif-deleted", "tag": "bafcaedc-bcc2-439a-b01c-9b80d27c8f47"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:03.591017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-821d3ba5-dd8a-46e9-bcf7-d50c4e74c953 req-12c45992-cdc2-4455-8613-ee668c698b8c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:03.603725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-821d3ba5-dd8a-46e9-bcf7-d50c4e74c953 req-12c45992-cdc2-4455-8613-ee668c698b8c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:03.605033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-821d3ba5-dd8a-46e9-bcf7-d50c4e74c953 req-12c45992-cdc2-4455-8613-ee668c698b8c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:03.669411 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-821d3ba5-dd8a-46e9-bcf7-d50c4e74c953 req-12c45992-cdc2-4455-8613-ee668c698b8c service nova] Creating event network-vif-deleted:bafcaedc-bcc2-439a-b01c-9b80d27c8f47 for instance 12268895-61a7-4826-895a-6e8ead0a1635 on n-h1-820368-35 Aug 27 05:16:03.708283 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-821d3ba5-dd8a-46e9-bcf7-d50c4e74c953 req-12c45992-cdc2-4455-8613-ee668c698b8c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159981 Aug 27 05:16:03.712218 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2359/4711] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:16:03.916870 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed59bc63-e184-4813-94ea-b92b671bf4f7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.720222 Aug 27 05:16:03.917633 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2353/4712] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:16:03 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 05:16:03.929566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:03.964560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:04.033925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:04.043340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:04.046022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:04.050520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:04.056319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:04.061915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:04.176533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:04.177298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:04.177950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:04.178572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lazy-loading 'fault' on Instance uuid 12268895-61a7-4826-895a-6e8ead0a1635 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:16:04.228775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:04.230779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:04.250283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:04.252868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:04.254318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:04.255904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:04.257119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:04.258374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:04.477398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee93433499ee4ccd9644173eb2e1a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9240388d4fa4d02adec50746d5a95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:04.497379 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6df18c35-8747-416e-9325-ee3058489e71 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 200 len: 1305 microversion: 2.1 time: 0.602607 Aug 27 05:16:04.498213 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2360/4713] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:03 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 1305 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:04.505866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:04.510485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:04.535804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:04.557594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:04.558250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:04.559253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:04.559726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:04.560169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:04.716193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:04.726457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:04.728079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:04.736509 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2557a206-9185-492b-809f-133d10c745a6 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.516078 Aug 27 05:16:04.742727 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2354/4714] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:04 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:16:05.533638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:05.534681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] [instance: 12268895-61a7-4826-895a-6e8ead0a1635] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:05.556609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:05.559515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:05.564379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:05.568634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:05.569475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:05.569946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:05.612370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:05.633274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] HTTP exception thrown: Instance 12268895-61a7-4826-895a-6e8ead0a1635 could not be found. Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Request method failure captured: Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 HTTP/1.1 Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCahCFEHVCMh-q9YfDInSG7aONg8uKAx_v0VFtt8GV2Han340IiD06Q6xYfxd8XJIouuPxcR7P8WM-C1bNdHsIx4umu8HiIfKQ_m7M3ml-An0mfuK9K1GREZlQ3TVLvjmu_U8rK-6tLDyIp9zbr0CUySnIUKV7F51lpL6mZKxulIB880 Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9240388d4fa4d02adec50746d5a95d7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9240388d4fa4d02adec50746d5a95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d9240388d4fa4d02adec50746d5a95d7 Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-455181067 Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ee93433499ee4ccd9644173eb2e1a4ea Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-SecurityGroupsTestJSON-455181067-project Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 12268895-61a7-4826-895a-6e8ead0a1635 could not be found. Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '12268895-61a7-4826-895a-6e8ead0a1635'} Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12268895-61a7-4826-895a-6e8ead0a1635 could not be found. Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12268895-61a7-4826-895a-6e8ead0a1635 could not be found. Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:05.635393 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:05.642846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:05.642846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:05.642846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:05.642846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:05.642846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:05.642846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12268895-61a7-4826-895a-6e8ead0a1635 could not be found. Aug 27 05:16:05.642846 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:05.643805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:05.643805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:05.643805 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-badfb7b6-1133-4b5d-94f5-6921d12cd933 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 1.142485 Aug 27 05:16:05.643805 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2361/4715] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:04 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:05.646344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Returning 404 to user: Instance 12268895-61a7-4826-895a-6e8ead0a1635 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:05.647470 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ac935b84-2bd4-4ebf-8b21-7784954f3a64 tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635" status: 404 len: 111 microversion: 2.1 time: 0.119126 Aug 27 05:16:05.649304 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2355/4716] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:05 2022] GET /compute/v2.1/servers/12268895-61a7-4826-895a-6e8ead0a1635 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:16:05.665740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2210fe6f-dadf-4ca9-a56c-572f7d12a62a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb5643730d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:05.730097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-77b036d2-6332-468a-91c7-1c0706466e60 req-9dea12a1-b3b0-4cdc-abed-ce37d5c6fea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f4c359-6f7e-4009-a365-7b070eec11a9", "name": "network-vif-unplugged", "status": "completed", "tag": "2a4e09b9-01c8-433a-8d9e-e93f9888b163"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:05.796264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-77b036d2-6332-468a-91c7-1c0706466e60 req-9dea12a1-b3b0-4cdc-abed-ce37d5c6fea0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:05.805710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-77b036d2-6332-468a-91c7-1c0706466e60 req-9dea12a1-b3b0-4cdc-abed-ce37d5c6fea0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:05.806521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-77b036d2-6332-468a-91c7-1c0706466e60 req-9dea12a1-b3b0-4cdc-abed-ce37d5c6fea0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:05.842265 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-77b036d2-6332-468a-91c7-1c0706466e60 req-9dea12a1-b3b0-4cdc-abed-ce37d5c6fea0 service nova] Creating event network-vif-unplugged:2a4e09b9-01c8-433a-8d9e-e93f9888b163 for instance e5f4c359-6f7e-4009-a365-7b070eec11a9 on n-h2-820368-35 Aug 27 05:16:05.858332 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-77b036d2-6332-468a-91c7-1c0706466e60 req-9dea12a1-b3b0-4cdc-abed-ce37d5c6fea0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133363 Aug 27 05:16:05.859754 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2356/4717] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:16:05.865419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:05.873659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:05.893997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:05.894883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:05.897487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:05.898581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:05.903981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:05.904800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:06.265314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:06.320025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:06.327684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:06.336422 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-19affd95-beb8-4c25-bc6f-74c97014d7a7 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.470372 Aug 27 05:16:06.337226 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2357/4718] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:05 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:06.682035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:06.683667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:06.695289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:06.697123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:06.698647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:06.702147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:06.703214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:06.704041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:06.726761 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2210fe6f-dadf-4ca9-a56c-572f7d12a62a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/efa3c73f-70ac-4222-bc28-9e9306f70d18" status: 202 len: 0 microversion: 2.1 time: 1.072871 Aug 27 05:16:06.728112 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2362/4719] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:16:05 2022] DELETE /compute/v2.1/os-security-groups/efa3c73f-70ac-4222-bc28-9e9306f70d18 => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:16:06.740265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-80bf2106-4d16-4956-8415-68f04170590a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] Calling method '.version_select at 0x7fb564373670>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:07.135022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:07.150843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:07.154713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:07.155667 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6e262d71-020a-4730-962d-51b9c1b91c80 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.483637 Aug 27 05:16:07.167011 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2358/4720] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:06 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:07.374285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:07.375468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:07.382367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:07.387968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:07.389498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:07.392669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:07.393429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:07.394789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:07.436630 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-80bf2106-4d16-4956-8415-68f04170590a tempest-SecurityGroupsTestJSON-455181067 tempest-SecurityGroupsTestJSON-455181067-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/bb3802fe-d7e0-4d25-b889-a04f1a93083c" status: 202 len: 0 microversion: 2.1 time: 0.702818 Aug 27 05:16:07.441374 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2363/4721] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:16:06 2022] DELETE /compute/v2.1/os-security-groups/bb3802fe-d7e0-4d25-b889-a04f1a93083c => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:16:07.560680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:07.576356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:07.577874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:07.579676 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cdd58695-e7ad-4831-b3a8-95787b3adf19 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.210831 Aug 27 05:16:07.580252 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2359/4722] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:07 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:16:08.186249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:08.186990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:08.202248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:08.205630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:08.206433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:08.209672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:08.210515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:08.213003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:08.609656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:08.610438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:08.645858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:08.646722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:08.648912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:08.656691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:08.657526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:08.658988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:09.035848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:09.064049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:09.070910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:09.072445 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4eb6ad51-b84f-4a27-833a-2749cb549764 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.466903 Aug 27 05:16:09.074285 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2360/4723] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:08 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:09.293921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:09.313469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:09.314923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:09.316213 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e7e66620-fc25-451e-bba4-a73733644696 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 1.135246 Aug 27 05:16:09.326226 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2364/4724] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:08 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:10.130299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:10.133675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:10.156138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:10.160950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:10.162617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:10.164259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:10.165393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:10.166393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:10.376901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:10.378324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:10.395817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:10.417971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:10.419006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:10.421529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:10.441421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:10.457164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:10.466559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:10.473037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:10.512153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:10.517899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:10.523792 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-24e8a011-d044-4613-abff-c3713fd3f3d1 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1408 microversion: 2.54 time: 0.419945 Aug 27 05:16:10.540999 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2361/4725] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:10 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1408 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:10.627680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:11.122535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:11.137910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:11.142594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:11.155362 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-60d32535-cb35-431f-8886-863354ec6a23 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.789644 Aug 27 05:16:11.160354 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2365/4726] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:10 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:11.563043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:11.566519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:11.610921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:11.618562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:11.619820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:11.624834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:11.635335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:11.637619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:11.819497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:11.833045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:11.865173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:11.869008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:11.872567 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b15cadf-9b4b-49b0-9e8b-3bf7c0095c55 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1414 microversion: 2.54 time: 0.319785 Aug 27 05:16:11.892709 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2362/4727] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:11 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1414 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:12.212111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:12.212963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:12.223358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:12.224243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:12.224243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:12.236928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:12.237561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:12.238810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:12.908333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:12.909208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:12.928157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:12.928950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:12.929569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:12.931164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:12.931807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:12.932501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:13.112785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:13.129395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:13.131871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:13.134472 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb1685f3-c9a3-47dc-b5d9-cd83da4bfdf2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1414 microversion: 2.54 time: 0.230354 Aug 27 05:16:13.141856 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2363/4728] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:12 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1414 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:13.604083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:13.629358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:13.633454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:13.638856 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8a0ca660-79fc-4733-9e7f-157aa82b459e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 1.430930 Aug 27 05:16:13.642093 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2366/4729] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:12 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:16:14.175571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:14.176462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:14.197499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:14.198000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:14.198498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:14.199328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:14.199787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:14.200260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:14.404925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:14.442687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:14.450889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:14.459477 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-040c8f59-aabb-4f8b-80dd-56f315ba5d75 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1414 microversion: 2.54 time: 0.288411 Aug 27 05:16:14.469840 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2364/4730] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:14 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1414 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:16:14.672858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:14.673639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:14.687365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:14.687860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:14.688920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:14.689646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:14.703871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:14.704408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:15.168472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:15.214990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:15.228062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:15.235898 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-345618f3-8dfb-4d38-9a52-828b19309ed8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.562985 Aug 27 05:16:15.263548 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2367/4731] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:14 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:16:15.503336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:15.507506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:15.522801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:15.523561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:15.524732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:15.526240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:15.527168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:15.528072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:15.858177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:15.883275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:15.891304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:15.899709 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e1ac2de-49ea-47a1-a2ed-80ff9baf64e4 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1414 microversion: 2.54 time: 0.410971 Aug 27 05:16:15.910889 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2365/4732] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:15 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1414 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:16.275921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:16.276942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:16.322864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:16.324138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:16.334202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:16.339072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:16.342033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:16.347415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:16.480531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c839e962-8a75-4916-b40b-0438d01af62f req-f2d59bca-c4ac-40d4-8445-3732898dbedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f4c359-6f7e-4009-a365-7b070eec11a9", "name": "network-vif-plugged", "status": "completed", "tag": "2a4e09b9-01c8-433a-8d9e-e93f9888b163"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:16.539992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=64 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:16.558933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c839e962-8a75-4916-b40b-0438d01af62f req-f2d59bca-c4ac-40d4-8445-3732898dbedb service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:16.566772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c839e962-8a75-4916-b40b-0438d01af62f req-f2d59bca-c4ac-40d4-8445-3732898dbedb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:16.567763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c839e962-8a75-4916-b40b-0438d01af62f req-f2d59bca-c4ac-40d4-8445-3732898dbedb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:16.634678 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c839e962-8a75-4916-b40b-0438d01af62f req-f2d59bca-c4ac-40d4-8445-3732898dbedb service nova] Creating event network-vif-plugged:2a4e09b9-01c8-433a-8d9e-e93f9888b163 for instance e5f4c359-6f7e-4009-a365-7b070eec11a9 on n-h2-820368-35 Aug 27 05:16:16.646013 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c839e962-8a75-4916-b40b-0438d01af62f req-f2d59bca-c4ac-40d4-8445-3732898dbedb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168752 Aug 27 05:16:16.647806 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2366/4733] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:16:16.947440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:16.948759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:16.973055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:16.973806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:16.977518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:16.978491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:16.986928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:16.990775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:17.058091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:17.077100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:17.081404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:17.087997 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dc18daf8-75aa-46dd-a171-b7fb9a4e9651 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.821168 Aug 27 05:16:17.089234 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2368/4734] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:16 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:17.137916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:17.153132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:17.158920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:17.160796 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-af0ada44-138a-4ce9-a70f-bae975e2c883 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1399 microversion: 2.54 time: 0.218173 Aug 27 05:16:17.162827 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2367/4735] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:16 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1399 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:17.198404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2f37578c-cd54-4a27-a9e7-1af0960e3254 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '.version_select at 0x7fb5640973a0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:17.280526 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2f37578c-cd54-4a27-a9e7-1af0960e3254 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1558762357" status: 204 len: 0 microversion: 2.54 time: 0.090817 Aug 27 05:16:17.282597 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2368/4736] 10.222.0.58 () {60 vars in 1319 bytes} [Sat Aug 27 05:16:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1558762357 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:16:17.301698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e6bf5f3f-d264-45df-a4a1-4318ed314113 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:17.302213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e6bf5f3f-d264-45df-a4a1-4318ed314113 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:17.343877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6bf5f3f-d264-45df-a4a1-4318ed314113 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:17.346068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6bf5f3f-d264-45df-a4a1-4318ed314113 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:17.349443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6bf5f3f-d264-45df-a4a1-4318ed314113 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:17.352429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6bf5f3f-d264-45df-a4a1-4318ed314113 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:17.355621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6bf5f3f-d264-45df-a4a1-4318ed314113 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:17.356380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6bf5f3f-d264-45df-a4a1-4318ed314113 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:17.476151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e6bf5f3f-d264-45df-a4a1-4318ed314113 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:16:17.671550 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e6bf5f3f-d264-45df-a4a1-4318ed314113 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 204 len: 0 microversion: 2.54 time: 0.375045 Aug 27 05:16:17.676605 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2369/4737] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:16:17 2022] DELETE /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:16:17.684696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:17.685415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:17.694723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d95afca-58eb-4aa1-bfff-79ca1154824d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Action: 'create', calling method: .version_select at 0x7fb564f6c5e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-807416745", "policies": ["affinity"]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:17.723386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:17.731572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:17.732047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:17.733071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:17.733964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:17.734576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:17.792508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-7d95afca-58eb-4aa1-bfff-79ca1154824d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:17.809206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-7d95afca-58eb-4aa1-bfff-79ca1154824d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:17.915462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:17.962863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:17.970729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:17.978669 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2168f4d6-b734-48a6-9af0-437839293b07 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1405 microversion: 2.54 time: 0.300381 Aug 27 05:16:17.988119 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2370/4738] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:17 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:18.068139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-7d95afca-58eb-4aa1-bfff-79ca1154824d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:18.092828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-7d95afca-58eb-4aa1-bfff-79ca1154824d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:18.120598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:18.128577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:18.152377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:18.154599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:18.160027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:18.160935 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d95afca-58eb-4aa1-bfff-79ca1154824d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 1.068593 Aug 27 05:16:18.165007 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2369/4739] 10.222.0.58 () {60 vars in 1174 bytes} [Sat Aug 27 05:16:17 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:18.165341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:18.168026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:18.169611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:18.187535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bdf1e65e-85d9-4b74-b822-dae66a05d208 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Action: 'create', calling method: .version_select at 0x7fb569607b80>, body: {"server_group": {"name": "tempest-server-group-1735436375", "policies": ["affinity"]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:18.258324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bdf1e65e-85d9-4b74-b822-dae66a05d208 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:18.286360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bdf1e65e-85d9-4b74-b822-dae66a05d208 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:18.411031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bdf1e65e-85d9-4b74-b822-dae66a05d208 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:18.426447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bdf1e65e-85d9-4b74-b822-dae66a05d208 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:18.468650 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bdf1e65e-85d9-4b74-b822-dae66a05d208 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.292744 Aug 27 05:16:18.471371 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2370/4740] 10.222.0.58 () {60 vars in 1173 bytes} [Sat Aug 27 05:16:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:16:18.494708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-acc69817-e203-4d37-a8fb-05d5fba7eae5 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Action: 'create', calling method: .version_select at 0x7fb564510160>, body: {"server_group": {"name": "tempest-server-group-1735436375", "policies": ["affinity"]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:18.528080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-acc69817-e203-4d37-a8fb-05d5fba7eae5 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:18.535652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-acc69817-e203-4d37-a8fb-05d5fba7eae5 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:18.644348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-acc69817-e203-4d37-a8fb-05d5fba7eae5 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:18.652559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-acc69817-e203-4d37-a8fb-05d5fba7eae5 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:18.670536 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-acc69817-e203-4d37-a8fb-05d5fba7eae5 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.188221 Aug 27 05:16:18.671797 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2371/4741] 10.222.0.58 () {60 vars in 1173 bytes} [Sat Aug 27 05:16:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:18.687005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b8aa92c-3355-4d62-a4c7-c46cb7ba5f79 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:18.752565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9b8aa92c-3355-4d62-a4c7-c46cb7ba5f79 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/d36da7c9-e94a-4576-aec1-6bb2fcc74642" status: 204 len: 0 microversion: 2.1 time: 0.071922 Aug 27 05:16:18.753546 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2372/4742] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 05:16:18 2022] DELETE /compute/v2.1/os-server-groups/d36da7c9-e94a-4576-aec1-6bb2fcc74642 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:16:18.761271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-30153988-6e4e-479d-95f0-2218704eb455 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:18.834528 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-30153988-6e4e-479d-95f0-2218704eb455 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.072331 Aug 27 05:16:18.849099 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2373/4743] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 05:16:18 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:16:18.867587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d611d4bb-e6fc-4b3e-99ec-a38cd207c2c6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:18.890596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:18.909649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:18.911819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:18.915237 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c98dc8ee-bb12-417a-bd78-71cee58be3e5 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.800670 Aug 27 05:16:18.935614 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2371/4744] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:18 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:18.938107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:18.967260 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d611d4bb-e6fc-4b3e-99ec-a38cd207c2c6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/5b50693d-5d6e-43a7-affa-e6204756fba3" status: 204 len: 0 microversion: 2.1 time: 0.109058 Aug 27 05:16:18.970419 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2374/4745] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 05:16:18 2022] DELETE /compute/v2.1/os-server-groups/5b50693d-5d6e-43a7-affa-e6204756fba3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:16:18.984245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-47df4387-4934-46fc-9f62-964411ba1c5d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:19.003910 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-47df4387-4934-46fc-9f62-964411ba1c5d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029029 Aug 27 05:16:19.006379 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2372/4746] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 05:16:18 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:19.020289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c76ed676-0e34-489e-8061-29e82a120a48 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Action: 'create', calling method: .version_select at 0x7fb569666c10>, body: {"server_group": {"name": "tempest-server-group-1237527232", "policies": ["affinity"]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:19.048278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:19.055668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:19.092212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:19.093586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:19.095319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:19.096410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:19.097090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:19.097907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:19.104297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c76ed676-0e34-489e-8061-29e82a120a48 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:19.121224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c76ed676-0e34-489e-8061-29e82a120a48 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:19.212254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c76ed676-0e34-489e-8061-29e82a120a48 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:19.224787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c76ed676-0e34-489e-8061-29e82a120a48 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:19.257322 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c76ed676-0e34-489e-8061-29e82a120a48 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.239662 Aug 27 05:16:19.260822 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2375/4747] 10.222.0.58 () {60 vars in 1173 bytes} [Sat Aug 27 05:16:19 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:19.284905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-caf704b0-d82f-4b1b-a80d-b811e1e60700 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:19.319458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:19.339493 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-caf704b0-d82f-4b1b-a80d-b811e1e60700 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/51162d05-2c9f-4391-9ee9-2c69aae95f87" status: 204 len: 0 microversion: 2.1 time: 0.069000 Aug 27 05:16:19.340655 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2376/4748] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 05:16:19 2022] DELETE /compute/v2.1/os-server-groups/51162d05-2c9f-4391-9ee9-2c69aae95f87 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:16:19.355792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-076664d6-559f-4338-846f-0f052f3aa05d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:19.363889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:19.370473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:19.373474 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-076664d6-559f-4338-846f-0f052f3aa05d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.026178 Aug 27 05:16:19.374601 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2377/4749] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 05:16:19 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:16:19.380966 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fb2ce782-0970-4e91-b40f-2f34c5bc99c2 tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1405 microversion: 2.54 time: 0.351111 Aug 27 05:16:19.395595 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2373/4750] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:19 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1405 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:19.439997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2f3c123d-3c5d-4fd7-91c2-a45b52375fe3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Action: 'create', calling method: .version_select at 0x7fb56962e3a0>, body: {"server_group": {"name": "tempest-server-group-663874690", "policies": ["anti-affinity"]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:19.519604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-2f3c123d-3c5d-4fd7-91c2-a45b52375fe3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:19.546221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-2f3c123d-3c5d-4fd7-91c2-a45b52375fe3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:19.669570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-2f3c123d-3c5d-4fd7-91c2-a45b52375fe3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:19.690912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-2f3c123d-3c5d-4fd7-91c2-a45b52375fe3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_groups'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:19.745690 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2f3c123d-3c5d-4fd7-91c2-a45b52375fe3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.357142 Aug 27 05:16:19.747368 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2378/4751] 10.222.0.58 () {60 vars in 1173 bytes} [Sat Aug 27 05:16:19 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:19.760238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c0359e12-000d-49c0-91cf-aaad77996355 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:19.836995 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c0359e12-000d-49c0-91cf-aaad77996355 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/694282f1-3129-4803-8036-530cfa8616a3" status: 204 len: 0 microversion: 2.1 time: 0.081279 Aug 27 05:16:19.837958 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2374/4752] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 05:16:19 2022] DELETE /compute/v2.1/os-server-groups/694282f1-3129-4803-8036-530cfa8616a3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:16:19.852429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e270bd16-bde2-4d2b-b8fb-81eb44fa0ae7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:19.903408 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e270bd16-bde2-4d2b-b8fb-81eb44fa0ae7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.059972 Aug 27 05:16:19.913375 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2379/4753] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 05:16:19 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:19.955797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:19.956604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:19.968109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:19.968597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:19.969595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:19.970362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:19.970800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:19.971268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:20.399944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1856858563", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "cb75859b-ccda-4fad-b70a-0f4751c20f0b"}]}, "os:scheduler_hints": {"group": "fc45549b-9606-41b8-846e-8f5a16e2bc08"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:20.472979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:20.485940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:20.487630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:20.489005 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ca51012-7ae7-4b5a-8293-f8a85a99a4e3 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.537870 Aug 27 05:16:20.489575 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2375/4754] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:19 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:20.507263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:20.507896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:20.534737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] validate_networks() for [('cb75859b-ccda-4fad-b70a-0f4751c20f0b', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:16:20.562155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:20.568640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:20.571445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:20.572430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:20.577157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:20.579337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:20.769629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:20.778352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:20.779673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:20.780790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lazy-loading 'fault' on Instance uuid 6aadece8-ec1b-4797-ab22-af2d7569b05d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:16:20.973077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:21.004952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:21.014077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ee1d9324a6e42f5b405441aa2a6e1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f94d0d7c400181d00b87ca011ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:21.019080 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ca0b23e5-9f75-4113-8cdd-b17eb8c04cdb tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 200 len: 1410 microversion: 2.54 time: 0.526426 Aug 27 05:16:21.022270 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2376/4755] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:20 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 1410 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:21.514378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:21.515123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:21.537492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:21.538010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:21.546340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:21.556065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:21.556434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:21.557260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:21.848770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:16:21.850269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:16:21.851162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:16:21.852774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:16:21.853653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:16:21.941725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:21.942589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:21.961254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:21.971792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:21.985253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:21.986454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:22.061170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:22.083451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:22.144476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:16:22.157796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:16:22.271572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128548) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 27 05:16:22.284317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:22.294155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:22.295598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:22.309751 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f18977d9-509c-42f5-a25e-f7b64e5356b8 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.799251 Aug 27 05:16:22.311907 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2377/4756] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:21 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:22.327249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:22.329128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] [instance: 6aadece8-ec1b-4797-ab22-af2d7569b05d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:22.340473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_group_members'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:22.350403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_group_members'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:22.352373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:22.352895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:22.356228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=7 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:22.361510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:22.362294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:22.362792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:22.363251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:22.394731 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] HTTP exception thrown: Instance 6aadece8-ec1b-4797-ab22-af2d7569b05d could not be found. Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Request method failure captured: Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d HTTP/1.1 Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCahxoywEx5cp402HxGlza6lZPJpNcP7eOb-YXBcbOZ_35X4b6BUn7Ui6d5LT9odjnOxO2ueyFhpDImH8ci2zWI-ouXcce2zwKG0wrUSWN5VbW11oPl9KuYJSihMbKK8NkMhss62Zs-xWBDKoY1dKg4-2T-9gamhfeMT7vhxsPDiFtFI Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.54 Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: c854f94d0d7c400181d00b87ca011ee4 Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerShowV254Test-1928506198 Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c854f94d0d7c400181d00b87ca011ee4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c854f94d0d7c400181d00b87ca011ee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c854f94d0d7c400181d00b87ca011ee4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c854f94d0d7c400181d00b87ca011ee4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerShowV254Test-1928506198 Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: c854f94d0d7c400181d00b87ca011ee4 Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerShowV254Test-1928506198 Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerShowV254Test-1928506198-project Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 1ee1d9324a6e42f5b405441aa2a6e1e4 Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerShowV254Test-1928506198-project Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 6aadece8-ec1b-4797-ab22-af2d7569b05d could not be found. Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '6aadece8-ec1b-4797-ab22-af2d7569b05d'} Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aadece8-ec1b-4797-ab22-af2d7569b05d could not be found. Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aadece8-ec1b-4797-ab22-af2d7569b05d could not be found. Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:22.398737 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:22.406739 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:22.406739 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:22.406739 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:22.406739 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:22.406739 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:22.406739 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aadece8-ec1b-4797-ab22-af2d7569b05d could not be found. Aug 27 05:16:22.406739 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:22.411443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] Returning 404 to user: Instance 6aadece8-ec1b-4797-ab22-af2d7569b05d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:22.413286 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e8bacaf-725a-44e3-ad9b-c2b52c2e386b tempest-ServerShowV254Test-1928506198 tempest-ServerShowV254Test-1928506198-project] 10.222.0.58 "GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d" status: 404 len: 111 microversion: 2.54 time: 0.095685 Aug 27 05:16:22.414475 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2378/4757] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:22 2022] GET /compute/v2.1/servers/6aadece8-ec1b-4797-ab22-af2d7569b05d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:16:22.429895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_group_members'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:22.436845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Getting quotas for user 934e7d34149642d191521d4844c86da9 and project 69d255ad319749c1963c099d9f7e177d. Resources: {'server_group_members'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:22.484201 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4223ddb8-60ce-4a4a-9899-c33ff343230d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.087250 Aug 27 05:16:22.492278 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2380/4758] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:16:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:16:22.506253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70be3409-04b5-474c-9933-db498046e4d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:22.521934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-70be3409-04b5-474c-9933-db498046e4d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:22.737945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-70be3409-04b5-474c-9933-db498046e4d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:22.751786 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70be3409-04b5-474c-9933-db498046e4d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1213 microversion: 2.1 time: 0.256594 Aug 27 05:16:22.760179 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2381/4759] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:22 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1213 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:22.889927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-38b94812-e389-4f82-bd2c-c6e13fdc3e12 tempest-AZV2TestJSON-1335226095 tempest-AZV2TestJSON-1335226095-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:22.895338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38b94812-e389-4f82-bd2c-c6e13fdc3e12 tempest-AZV2TestJSON-1335226095 tempest-AZV2TestJSON-1335226095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:22.895837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38b94812-e389-4f82-bd2c-c6e13fdc3e12 tempest-AZV2TestJSON-1335226095 tempest-AZV2TestJSON-1335226095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:22.896289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38b94812-e389-4f82-bd2c-c6e13fdc3e12 tempest-AZV2TestJSON-1335226095 tempest-AZV2TestJSON-1335226095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:22.911226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38b94812-e389-4f82-bd2c-c6e13fdc3e12 tempest-AZV2TestJSON-1335226095 tempest-AZV2TestJSON-1335226095-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:22.915613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38b94812-e389-4f82-bd2c-c6e13fdc3e12 tempest-AZV2TestJSON-1335226095 tempest-AZV2TestJSON-1335226095-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:22.917256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38b94812-e389-4f82-bd2c-c6e13fdc3e12 tempest-AZV2TestJSON-1335226095 tempest-AZV2TestJSON-1335226095-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:23.027827 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-38b94812-e389-4f82-bd2c-c6e13fdc3e12 tempest-AZV2TestJSON-1335226095 tempest-AZV2TestJSON-1335226095-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.611833 Aug 27 05:16:23.030503 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2379/4760] 10.222.0.58 () {58 vars in 1164 bytes} [Sat Aug 27 05:16:22 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:16:23.341068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:23.342918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:23.365816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:23.368259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:23.370941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:23.375948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:23.382308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:23.383124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:23.754001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:23.766249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:23.769156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:23.771652 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-27ce9ad5-d7c6-45f7-9952-eefb48c370b4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.435514 Aug 27 05:16:23.788128 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2382/4761] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:23 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:23.794480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-96b1ea2b-4118-4ded-9564-fbc60bdf24bf tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:23.796322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-96b1ea2b-4118-4ded-9564-fbc60bdf24bf tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:24.074331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-96b1ea2b-4118-4ded-9564-fbc60bdf24bf tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:24.085476 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-96b1ea2b-4118-4ded-9564-fbc60bdf24bf tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1213 microversion: 2.1 time: 0.296141 Aug 27 05:16:24.103237 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2380/4762] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:23 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1213 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:24.809432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:24.810052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:24.825695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:24.832073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:24.832862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:24.834179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:24.834737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:24.840441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:25.125085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7cfbd16d-c40d-489b-8bb2-7fc6f08d5010 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:25.133980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7cfbd16d-c40d-489b-8bb2-7fc6f08d5010 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:25.192104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:25.222984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cfbd16d-c40d-489b-8bb2-7fc6f08d5010 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:25.224115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cfbd16d-c40d-489b-8bb2-7fc6f08d5010 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:25.226608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:25.228602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cfbd16d-c40d-489b-8bb2-7fc6f08d5010 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:25.230043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:25.232862 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-13497032-22cd-4687-9554-a58b11e868c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.427351 Aug 27 05:16:25.249286 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2383/4763] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:24 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:25.256831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cfbd16d-c40d-489b-8bb2-7fc6f08d5010 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:25.264604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cfbd16d-c40d-489b-8bb2-7fc6f08d5010 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:25.274562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cfbd16d-c40d-489b-8bb2-7fc6f08d5010 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:25.564276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7cfbd16d-c40d-489b-8bb2-7fc6f08d5010 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:25.601495 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7cfbd16d-c40d-489b-8bb2-7fc6f08d5010 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1273 microversion: 2.1 time: 0.478598 Aug 27 05:16:25.608952 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2381/4764] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:25 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1273 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:26.271725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:26.288781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:26.328002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:26.328991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:26.334334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:26.335709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:26.336601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:26.338246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:26.644158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9609409-261c-4cae-9093-5f7846395978 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:26.646900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9609409-261c-4cae-9093-5f7846395978 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:26.681802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9609409-261c-4cae-9093-5f7846395978 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:26.683073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9609409-261c-4cae-9093-5f7846395978 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:26.684176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9609409-261c-4cae-9093-5f7846395978 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:26.686006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9609409-261c-4cae-9093-5f7846395978 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:26.687177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9609409-261c-4cae-9093-5f7846395978 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:26.688749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9609409-261c-4cae-9093-5f7846395978 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:26.951200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f9609409-261c-4cae-9093-5f7846395978 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:26.961010 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9609409-261c-4cae-9093-5f7846395978 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1271 microversion: 2.1 time: 0.328598 Aug 27 05:16:26.973638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:27.000488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:27.001126 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2382/4765] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:26 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1271 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:27.019443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:27.021622 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-41daab72-9793-4537-9fb6-d3a99abf9184 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.759055 Aug 27 05:16:27.022580 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2384/4766] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:26 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:28.014260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dffce7fe-f3d0-43dc-ae79-8c93c5533ff6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:28.015373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dffce7fe-f3d0-43dc-ae79-8c93c5533ff6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:28.057663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dffce7fe-f3d0-43dc-ae79-8c93c5533ff6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:28.058492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dffce7fe-f3d0-43dc-ae79-8c93c5533ff6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:28.059375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dffce7fe-f3d0-43dc-ae79-8c93c5533ff6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:28.081163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:28.082246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dffce7fe-f3d0-43dc-ae79-8c93c5533ff6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:28.084070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:28.090024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dffce7fe-f3d0-43dc-ae79-8c93c5533ff6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:28.092243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dffce7fe-f3d0-43dc-ae79-8c93c5533ff6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:28.134849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:28.135741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:28.148043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:28.152455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:28.153331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:28.160293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:28.177978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:28.414422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dffce7fe-f3d0-43dc-ae79-8c93c5533ff6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:28.424166 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dffce7fe-f3d0-43dc-ae79-8c93c5533ff6 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1271 microversion: 2.1 time: 0.420365 Aug 27 05:16:28.432014 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2383/4767] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:28 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1271 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:28.596267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:28.616035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:28.618186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:28.624882 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c08ca641-0c39-4247-906e-55b300d01936 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.551082 Aug 27 05:16:28.626668 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2385/4768] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:28 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:29.291240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-389f9e39-e6d5-40b0-bad1-15d70f7ad479 req-8ac9883c-7b75-46f3-a444-f8ca7bfe514c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08a333d-504a-41ad-a796-2069aecd4bd9", "name": "network-vif-plugged", "status": "completed", "tag": "6e183864-02b7-4485-8c8f-1050892f3cb4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:29.314654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-389f9e39-e6d5-40b0-bad1-15d70f7ad479 req-8ac9883c-7b75-46f3-a444-f8ca7bfe514c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:29.318654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-389f9e39-e6d5-40b0-bad1-15d70f7ad479 req-8ac9883c-7b75-46f3-a444-f8ca7bfe514c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:29.319546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-389f9e39-e6d5-40b0-bad1-15d70f7ad479 req-8ac9883c-7b75-46f3-a444-f8ca7bfe514c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:29.360308 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-389f9e39-e6d5-40b0-bad1-15d70f7ad479 req-8ac9883c-7b75-46f3-a444-f8ca7bfe514c service nova] Creating event network-vif-plugged:6e183864-02b7-4485-8c8f-1050892f3cb4 for instance e08a333d-504a-41ad-a796-2069aecd4bd9 on n-h2-820368-35 Aug 27 05:16:29.374540 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-389f9e39-e6d5-40b0-bad1-15d70f7ad479 req-8ac9883c-7b75-46f3-a444-f8ca7bfe514c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088356 Aug 27 05:16:29.378478 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2384/4769] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:16:29.449199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3974aac7-9569-438d-be25-31fd5c949441 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:29.451368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3974aac7-9569-438d-be25-31fd5c949441 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:29.462960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3974aac7-9569-438d-be25-31fd5c949441 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:29.466406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3974aac7-9569-438d-be25-31fd5c949441 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:29.470071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3974aac7-9569-438d-be25-31fd5c949441 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:29.471802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3974aac7-9569-438d-be25-31fd5c949441 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:29.485224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3974aac7-9569-438d-be25-31fd5c949441 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:29.489975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3974aac7-9569-438d-be25-31fd5c949441 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:29.682674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:29.683694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:29.702552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:29.703989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:29.704743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:29.706443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:29.707356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:29.708112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:30.404282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3974aac7-9569-438d-be25-31fd5c949441 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:30.417870 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3974aac7-9569-438d-be25-31fd5c949441 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 0.972617 Aug 27 05:16:30.419245 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2386/4770] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:29 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:30.556699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:30.571721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:30.573707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:30.583572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c1e96dc6-503b-43f6-93a3-b09c69a5ef08 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 0.902589 Aug 27 05:16:30.584905 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2385/4771] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:29 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:31.443702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65fb69ae-8591-48b5-874f-47fdff677958 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.444538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-65fb69ae-8591-48b5-874f-47fdff677958 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.472989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fb69ae-8591-48b5-874f-47fdff677958 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.480410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fb69ae-8591-48b5-874f-47fdff677958 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.483945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fb69ae-8591-48b5-874f-47fdff677958 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.494949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fb69ae-8591-48b5-874f-47fdff677958 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.497818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fb69ae-8591-48b5-874f-47fdff677958 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.498781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65fb69ae-8591-48b5-874f-47fdff677958 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.620511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.621726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.647670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.651041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.655345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.657567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.663266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.664713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:32.030841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:32.312853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-65fb69ae-8591-48b5-874f-47fdff677958 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:32.338157 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-65fb69ae-8591-48b5-874f-47fdff677958 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 0.901403 Aug 27 05:16:32.346389 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2387/4772] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:31 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:32.352139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-42dc1c6b-291d-488a-bc11-a17871b78b9c req-e5af7a08-f36a-4607-99a7-baeacf6672fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1", "tag": "8c21ce07-ce02-4263-9c4d-4c084f9e94c1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:32.400358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-42dc1c6b-291d-488a-bc11-a17871b78b9c req-e5af7a08-f36a-4607-99a7-baeacf6672fa service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:32.403737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-42dc1c6b-291d-488a-bc11-a17871b78b9c req-e5af7a08-f36a-4607-99a7-baeacf6672fa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:32.405641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-42dc1c6b-291d-488a-bc11-a17871b78b9c req-e5af7a08-f36a-4607-99a7-baeacf6672fa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:32.455055 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-42dc1c6b-291d-488a-bc11-a17871b78b9c req-e5af7a08-f36a-4607-99a7-baeacf6672fa service nova] Creating event network-changed:8c21ce07-ce02-4263-9c4d-4c084f9e94c1 for instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 on n-h1-820368-35 Aug 27 05:16:32.481068 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-42dc1c6b-291d-488a-bc11-a17871b78b9c req-e5af7a08-f36a-4607-99a7-baeacf6672fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132317 Aug 27 05:16:32.482045 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2388/4773] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:32.599528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:32.619346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:32.621504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:32.627329 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0eaa4a47-2ad2-450e-a43b-2347afd157dc tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 1.011078 Aug 27 05:16:32.633029 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2386/4774] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:31 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:33.365398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=56 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:33.370318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f99bf6dd-e938-4851-8d53-1eee0b859e13 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:33.371953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f99bf6dd-e938-4851-8d53-1eee0b859e13 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:33.400742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99bf6dd-e938-4851-8d53-1eee0b859e13 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:33.401244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99bf6dd-e938-4851-8d53-1eee0b859e13 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:33.401683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99bf6dd-e938-4851-8d53-1eee0b859e13 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:33.402400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99bf6dd-e938-4851-8d53-1eee0b859e13 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:33.402855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99bf6dd-e938-4851-8d53-1eee0b859e13 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:33.403368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99bf6dd-e938-4851-8d53-1eee0b859e13 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:33.662603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:33.663545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:33.666481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:33.698565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:33.699197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:33.699657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:33.700582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:33.701117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:33.701622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:34.079066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:34.238566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f99bf6dd-e938-4851-8d53-1eee0b859e13 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:34.246998 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f99bf6dd-e938-4851-8d53-1eee0b859e13 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 0.882602 Aug 27 05:16:34.262412 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2389/4775] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:33 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:34.937028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:34.961837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:34.965896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:34.969756 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-095f37c5-e0fc-47ab-aff3-62e14a4037fa tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1729 microversion: 2.20 time: 1.311822 Aug 27 05:16:34.972593 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2387/4776] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:33 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1729 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:35.284188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f8e48e68-5e43-4ca8-b6ed-6dc3119be408 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:35.284901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f8e48e68-5e43-4ca8-b6ed-6dc3119be408 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:35.311115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8e48e68-5e43-4ca8-b6ed-6dc3119be408 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:35.313729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8e48e68-5e43-4ca8-b6ed-6dc3119be408 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:35.320365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8e48e68-5e43-4ca8-b6ed-6dc3119be408 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:35.329729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8e48e68-5e43-4ca8-b6ed-6dc3119be408 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:35.330838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8e48e68-5e43-4ca8-b6ed-6dc3119be408 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:35.355138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8e48e68-5e43-4ca8-b6ed-6dc3119be408 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:36.088857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:36.089777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:36.142766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:36.143652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:36.154030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:36.154837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:36.155343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:36.156253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:36.793331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f8e48e68-5e43-4ca8-b6ed-6dc3119be408 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:36.815460 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f8e48e68-5e43-4ca8-b6ed-6dc3119be408 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 1.536128 Aug 27 05:16:36.816058 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2390/4777] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:35 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:36.929706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:36.939589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:36.946796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:36.948327 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-85596b1e-9e31-47ae-a20a-a6fb0bbd0ce0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1716 microversion: 2.20 time: 0.875170 Aug 27 05:16:36.951507 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2388/4778] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:36 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1716 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:37.842909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ba53a73d-6c28-4b9a-ae9b-7af15ca54903 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:37.844841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ba53a73d-6c28-4b9a-ae9b-7af15ca54903 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:37.860971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba53a73d-6c28-4b9a-ae9b-7af15ca54903 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:37.866516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba53a73d-6c28-4b9a-ae9b-7af15ca54903 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:37.867334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba53a73d-6c28-4b9a-ae9b-7af15ca54903 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:37.868265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba53a73d-6c28-4b9a-ae9b-7af15ca54903 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:37.868891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba53a73d-6c28-4b9a-ae9b-7af15ca54903 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:37.870208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba53a73d-6c28-4b9a-ae9b-7af15ca54903 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:39.192011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ba53a73d-6c28-4b9a-ae9b-7af15ca54903 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:39.209023 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ba53a73d-6c28-4b9a-ae9b-7af15ca54903 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 1.370488 Aug 27 05:16:39.216306 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2391/4779] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:37 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:16:40.239684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa72bf15-1861-48d4-ab94-a2583276311c tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:40.240534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fa72bf15-1861-48d4-ab94-a2583276311c tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:40.248864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa72bf15-1861-48d4-ab94-a2583276311c tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:40.250612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa72bf15-1861-48d4-ab94-a2583276311c tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:40.251311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa72bf15-1861-48d4-ab94-a2583276311c tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:40.256425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa72bf15-1861-48d4-ab94-a2583276311c tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:40.258131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa72bf15-1861-48d4-ab94-a2583276311c tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:40.258804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa72bf15-1861-48d4-ab94-a2583276311c tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:40.706088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fa72bf15-1861-48d4-ab94-a2583276311c tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:40.721476 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa72bf15-1861-48d4-ab94-a2583276311c tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 0.483247 Aug 27 05:16:40.742971 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2389/4780] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:40 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:41.743676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:41.745153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:41.759706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:41.760318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:41.761514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:41.764363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:41.769502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:41.770391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:41.843169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=81 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:42.306707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:42.327166 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 0.585226 Aug 27 05:16:42.330302 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2392/4781] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:41 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:43.386689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5ddcdbaa-22f2-4a0c-9d3f-a4286059ed14 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:43.402150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5ddcdbaa-22f2-4a0c-9d3f-a4286059ed14 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:43.470692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ddcdbaa-22f2-4a0c-9d3f-a4286059ed14 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:43.478073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ddcdbaa-22f2-4a0c-9d3f-a4286059ed14 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:43.488401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ddcdbaa-22f2-4a0c-9d3f-a4286059ed14 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:43.490394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ddcdbaa-22f2-4a0c-9d3f-a4286059ed14 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:43.500588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ddcdbaa-22f2-4a0c-9d3f-a4286059ed14 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:43.507001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ddcdbaa-22f2-4a0c-9d3f-a4286059ed14 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:43.663721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:43.664826 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1ec202b3-0ac4-4a46-8ebc-45197eb5199d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005262 Aug 27 05:16:43.665542 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2393/4782] 10.222.0.58 () {56 vars in 886 bytes} [Sat Aug 27 05:16:43 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 05:16:43.858282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5ddcdbaa-22f2-4a0c-9d3f-a4286059ed14 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:43.872556 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5ddcdbaa-22f2-4a0c-9d3f-a4286059ed14 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 0.522118 Aug 27 05:16:43.873793 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2390/4783] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:43 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:44.898686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e637f5e1-604e-400b-bc3e-22d20c2edcc2 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:44.899536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e637f5e1-604e-400b-bc3e-22d20c2edcc2 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:44.923419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e637f5e1-604e-400b-bc3e-22d20c2edcc2 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:44.924459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e637f5e1-604e-400b-bc3e-22d20c2edcc2 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:44.924989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e637f5e1-604e-400b-bc3e-22d20c2edcc2 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:44.927791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e637f5e1-604e-400b-bc3e-22d20c2edcc2 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:44.928863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e637f5e1-604e-400b-bc3e-22d20c2edcc2 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:44.929362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e637f5e1-604e-400b-bc3e-22d20c2edcc2 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:45.374667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e637f5e1-604e-400b-bc3e-22d20c2edcc2 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:45.387313 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e637f5e1-604e-400b-bc3e-22d20c2edcc2 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 0.492966 Aug 27 05:16:45.389987 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2394/4784] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:44 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:46.409031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8893018-cc2c-4456-b781-8ed177b756ce tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:46.410058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e8893018-cc2c-4456-b781-8ed177b756ce tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:46.423340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8893018-cc2c-4456-b781-8ed177b756ce tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:46.423875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8893018-cc2c-4456-b781-8ed177b756ce tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:46.424326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8893018-cc2c-4456-b781-8ed177b756ce tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:46.425060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8893018-cc2c-4456-b781-8ed177b756ce tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:46.425530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8893018-cc2c-4456-b781-8ed177b756ce tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:46.425968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8893018-cc2c-4456-b781-8ed177b756ce tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:46.778085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1740725363", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "2aeab05f-61ed-48ec-a332-5b3d621869b3"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:46.936308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] validate_networks() for [('2aeab05f-61ed-48ec-a332-5b3d621869b3', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:16:47.589804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e8893018-cc2c-4456-b781-8ed177b756ce tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:47.617177 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e8893018-cc2c-4456-b781-8ed177b756ce tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 1.212523 Aug 27 05:16:47.619014 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2391/4785] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:46 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:47.625175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-265a1ae1-d44f-4cd6-8bc4-8c91ec3e0bd0 req-58a74913-eabc-484a-a329-9411416f8f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1", "name": "network-vif-plugged", "status": "completed", "tag": "8c21ce07-ce02-4263-9c4d-4c084f9e94c1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:47.636283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:47.640996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-265a1ae1-d44f-4cd6-8bc4-8c91ec3e0bd0 req-58a74913-eabc-484a-a329-9411416f8f7c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:47.641892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-265a1ae1-d44f-4cd6-8bc4-8c91ec3e0bd0 req-58a74913-eabc-484a-a329-9411416f8f7c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:47.642588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-265a1ae1-d44f-4cd6-8bc4-8c91ec3e0bd0 req-58a74913-eabc-484a-a329-9411416f8f7c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:47.656758 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-265a1ae1-d44f-4cd6-8bc4-8c91ec3e0bd0 req-58a74913-eabc-484a-a329-9411416f8f7c service nova] Creating event network-vif-plugged:8c21ce07-ce02-4263-9c4d-4c084f9e94c1 for instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 on n-h1-820368-35 Aug 27 05:16:47.667520 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-265a1ae1-d44f-4cd6-8bc4-8c91ec3e0bd0 req-58a74913-eabc-484a-a329-9411416f8f7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044508 Aug 27 05:16:47.669971 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2392/4786] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:47.690715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-48dcdf0b-28ac-47e4-a43a-9a792df093b3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:47.696308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-48dcdf0b-28ac-47e4-a43a-9a792df093b3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:47.729286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48dcdf0b-28ac-47e4-a43a-9a792df093b3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:47.730246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48dcdf0b-28ac-47e4-a43a-9a792df093b3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:47.730934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48dcdf0b-28ac-47e4-a43a-9a792df093b3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:47.732264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48dcdf0b-28ac-47e4-a43a-9a792df093b3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:47.733392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48dcdf0b-28ac-47e4-a43a-9a792df093b3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:47.734932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48dcdf0b-28ac-47e4-a43a-9a792df093b3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:48.138182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-48dcdf0b-28ac-47e4-a43a-9a792df093b3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:48.152350 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-48dcdf0b-28ac-47e4-a43a-9a792df093b3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 0.480841 Aug 27 05:16:48.159971 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2393/4787] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:47 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:48.204581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:16:48.205149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:16:48.205863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:16:48.206492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:16:48.207157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:16:48.224156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:48.224642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:48.225315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:48.226234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:48.226936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:48.227444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:48.264503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Getting quotas for project 39c2ef4112e84253b7924d7759080b9f. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:48.282514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Getting quotas for user a5ad6957c00747888364ff932074db8b and project 39c2ef4112e84253b7924d7759080b9f. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:48.324844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:16:48.328295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:16:48.481698 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-db5aef3e-bff7-4d02-b72a-fe9cb21bed51 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.902663 Aug 27 05:16:48.487051 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2395/4788] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:16:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:16:48.500571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4855943c-c52b-456b-ac0b-6e7ed806d390 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:48.501871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4855943c-c52b-456b-ac0b-6e7ed806d390 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:48.623980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4855943c-c52b-456b-ac0b-6e7ed806d390 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:48.661693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-87551964-9728-4511-b72f-956b7740bb7f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:48.663148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-87551964-9728-4511-b72f-956b7740bb7f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:48.675924 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4855943c-c52b-456b-ac0b-6e7ed806d390 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1218 microversion: 2.1 time: 0.181232 Aug 27 05:16:48.683626 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2394/4789] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:48 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1218 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:48.690293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87551964-9728-4511-b72f-956b7740bb7f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:48.691176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87551964-9728-4511-b72f-956b7740bb7f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:48.691832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87551964-9728-4511-b72f-956b7740bb7f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:48.692868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87551964-9728-4511-b72f-956b7740bb7f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:48.693995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87551964-9728-4511-b72f-956b7740bb7f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:48.695029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87551964-9728-4511-b72f-956b7740bb7f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:48.954761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-87551964-9728-4511-b72f-956b7740bb7f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:48.965169 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-87551964-9728-4511-b72f-956b7740bb7f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 0.313635 Aug 27 05:16:48.966118 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2396/4790] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:48 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:49.183331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-faff9c95-3a05-458e-9ace-f1a599118449 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:49.184036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-faff9c95-3a05-458e-9ace-f1a599118449 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:49.205221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-faff9c95-3a05-458e-9ace-f1a599118449 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:49.207730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-faff9c95-3a05-458e-9ace-f1a599118449 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:49.208543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-faff9c95-3a05-458e-9ace-f1a599118449 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:49.212190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-faff9c95-3a05-458e-9ace-f1a599118449 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:49.213214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-faff9c95-3a05-458e-9ace-f1a599118449 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:49.214023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-faff9c95-3a05-458e-9ace-f1a599118449 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:49.457268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-faff9c95-3a05-458e-9ace-f1a599118449 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:49.469343 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-faff9c95-3a05-458e-9ace-f1a599118449 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.292377 Aug 27 05:16:49.471171 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2395/4791] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:49 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:49.521311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ed76f5d-99a3-4156-9c5d-2cc44c58aa54 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-996281072"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:49.539158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ed76f5d-99a3-4156-9c5d-2cc44c58aa54 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:49.567071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ed76f5d-99a3-4156-9c5d-2cc44c58aa54 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:49.567881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ed76f5d-99a3-4156-9c5d-2cc44c58aa54 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:49.568504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ed76f5d-99a3-4156-9c5d-2cc44c58aa54 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:49.569409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ed76f5d-99a3-4156-9c5d-2cc44c58aa54 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:49.569885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ed76f5d-99a3-4156-9c5d-2cc44c58aa54 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:49.570327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ed76f5d-99a3-4156-9c5d-2cc44c58aa54 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:49.720141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f5e4ac8b-fcb8-4136-b233-815e3e292749 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:49.721261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f5e4ac8b-fcb8-4136-b233-815e3e292749 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:49.742988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e4ac8b-fcb8-4136-b233-815e3e292749 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:49.743889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e4ac8b-fcb8-4136-b233-815e3e292749 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:49.744663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e4ac8b-fcb8-4136-b233-815e3e292749 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:49.745938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e4ac8b-fcb8-4136-b233-815e3e292749 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:49.746651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e4ac8b-fcb8-4136-b233-815e3e292749 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:49.756296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5e4ac8b-fcb8-4136-b233-815e3e292749 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:49.946394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f5e4ac8b-fcb8-4136-b233-815e3e292749 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:49.956373 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f5e4ac8b-fcb8-4136-b233-815e3e292749 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1214 microversion: 2.1 time: 0.243704 Aug 27 05:16:49.971917 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2396/4792] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:49 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1214 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:49.990394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f63ecb24-2de0-413c-a777-fad576a1c290 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:49.993584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f63ecb24-2de0-413c-a777-fad576a1c290 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:50.013847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f63ecb24-2de0-413c-a777-fad576a1c290 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:50.014449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f63ecb24-2de0-413c-a777-fad576a1c290 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:50.018063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f63ecb24-2de0-413c-a777-fad576a1c290 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:50.019026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f63ecb24-2de0-413c-a777-fad576a1c290 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:50.025215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f63ecb24-2de0-413c-a777-fad576a1c290 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:50.026434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f63ecb24-2de0-413c-a777-fad576a1c290 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:50.052545 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ed76f5d-99a3-4156-9c5d-2cc44c58aa54 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.560494 Aug 27 05:16:50.054983 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2397/4793] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:16:49 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 05:16:50.092271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1caa2692-8f3d-4718-a4a4-9f9681bb067d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:50.093700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1caa2692-8f3d-4718-a4a4-9f9681bb067d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:50.101989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1caa2692-8f3d-4718-a4a4-9f9681bb067d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:50.102571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1caa2692-8f3d-4718-a4a4-9f9681bb067d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:50.103030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1caa2692-8f3d-4718-a4a4-9f9681bb067d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:50.103806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1caa2692-8f3d-4718-a4a4-9f9681bb067d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:50.104481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1caa2692-8f3d-4718-a4a4-9f9681bb067d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:50.105206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1caa2692-8f3d-4718-a4a4-9f9681bb067d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:50.461086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f63ecb24-2de0-413c-a777-fad576a1c290 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:50.474482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1caa2692-8f3d-4718-a4a4-9f9681bb067d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:50.484993 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1caa2692-8f3d-4718-a4a4-9f9681bb067d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.414313 Aug 27 05:16:50.487935 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2398/4794] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:50 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:50.495327 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f63ecb24-2de0-413c-a777-fad576a1c290 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1313 microversion: 2.1 time: 0.510409 Aug 27 05:16:50.497918 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2397/4795] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:49 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:51.002063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b89bb0f7-30ee-4b73-9dcb-535eb5d2c6ad tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:51.010999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b89bb0f7-30ee-4b73-9dcb-535eb5d2c6ad tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:51.039999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b89bb0f7-30ee-4b73-9dcb-535eb5d2c6ad tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:51.040915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b89bb0f7-30ee-4b73-9dcb-535eb5d2c6ad tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:51.041881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b89bb0f7-30ee-4b73-9dcb-535eb5d2c6ad tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:51.042886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b89bb0f7-30ee-4b73-9dcb-535eb5d2c6ad tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:51.043889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b89bb0f7-30ee-4b73-9dcb-535eb5d2c6ad tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:51.045153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b89bb0f7-30ee-4b73-9dcb-535eb5d2c6ad tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:51.193885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b89bb0f7-30ee-4b73-9dcb-535eb5d2c6ad tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:51.208276 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b89bb0f7-30ee-4b73-9dcb-535eb5d2c6ad tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1276 microversion: 2.1 time: 0.224360 Aug 27 05:16:51.209575 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2399/4796] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:50 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:51.512985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-da1cd2e8-48f9-49b6-aae9-1a7708766f68 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:51.514119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-da1cd2e8-48f9-49b6-aae9-1a7708766f68 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:51.536983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-389a73c3-fcf9-4c50-8030-5369877898d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:51.538159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-389a73c3-fcf9-4c50-8030-5369877898d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:51.553958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da1cd2e8-48f9-49b6-aae9-1a7708766f68 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:51.554522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da1cd2e8-48f9-49b6-aae9-1a7708766f68 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:51.555062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da1cd2e8-48f9-49b6-aae9-1a7708766f68 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:51.555831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da1cd2e8-48f9-49b6-aae9-1a7708766f68 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:51.556306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da1cd2e8-48f9-49b6-aae9-1a7708766f68 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:51.556739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da1cd2e8-48f9-49b6-aae9-1a7708766f68 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:51.563634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389a73c3-fcf9-4c50-8030-5369877898d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:51.572081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389a73c3-fcf9-4c50-8030-5369877898d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:51.573003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389a73c3-fcf9-4c50-8030-5369877898d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:51.574302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389a73c3-fcf9-4c50-8030-5369877898d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:51.575171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389a73c3-fcf9-4c50-8030-5369877898d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:51.575943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-389a73c3-fcf9-4c50-8030-5369877898d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:52.308148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-da1cd2e8-48f9-49b6-aae9-1a7708766f68 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:52.320083 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-da1cd2e8-48f9-49b6-aae9-1a7708766f68 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.815630 Aug 27 05:16:52.335752 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2398/4797] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:51 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:52.344854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-a1bd2c6c-5d8b-4a8d-88ed-29717cd2839b req-d14a5731-4536-43e6-991a-e108c671820e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f4c359-6f7e-4009-a365-7b070eec11a9", "name": "network-vif-unplugged", "status": "completed", "tag": "2a4e09b9-01c8-433a-8d9e-e93f9888b163"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:52.361211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a1bd2c6c-5d8b-4a8d-88ed-29717cd2839b req-d14a5731-4536-43e6-991a-e108c671820e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:52.362052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a1bd2c6c-5d8b-4a8d-88ed-29717cd2839b req-d14a5731-4536-43e6-991a-e108c671820e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:52.362690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a1bd2c6c-5d8b-4a8d-88ed-29717cd2839b req-d14a5731-4536-43e6-991a-e108c671820e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:52.377506 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-a1bd2c6c-5d8b-4a8d-88ed-29717cd2839b req-d14a5731-4536-43e6-991a-e108c671820e service nova] Creating event network-vif-unplugged:2a4e09b9-01c8-433a-8d9e-e93f9888b163 for instance e5f4c359-6f7e-4009-a365-7b070eec11a9 on n-h2-820368-35 Aug 27 05:16:52.384382 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-a1bd2c6c-5d8b-4a8d-88ed-29717cd2839b req-d14a5731-4536-43e6-991a-e108c671820e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046583 Aug 27 05:16:52.385866 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2399/4798] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:52.393362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-17ab96bf-00e1-4f7c-a5c1-fbfb3e308e20 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:52.394460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-17ab96bf-00e1-4f7c-a5c1-fbfb3e308e20 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:52.414330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17ab96bf-00e1-4f7c-a5c1-fbfb3e308e20 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:52.415347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17ab96bf-00e1-4f7c-a5c1-fbfb3e308e20 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:52.416005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17ab96bf-00e1-4f7c-a5c1-fbfb3e308e20 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:52.416964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17ab96bf-00e1-4f7c-a5c1-fbfb3e308e20 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:52.417612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17ab96bf-00e1-4f7c-a5c1-fbfb3e308e20 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:52.418236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17ab96bf-00e1-4f7c-a5c1-fbfb3e308e20 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:52.565525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-389a73c3-fcf9-4c50-8030-5369877898d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:52.579866 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-389a73c3-fcf9-4c50-8030-5369877898d9 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1498 microversion: 2.1 time: 1.050504 Aug 27 05:16:52.580479 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2400/4799] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:51 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1498 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:52.589961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-17ab96bf-00e1-4f7c-a5c1-fbfb3e308e20 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:52.623112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f3cd8094-d5d5-417f-8beb-ac55ebb52141 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:52.624561 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-17ab96bf-00e1-4f7c-a5c1-fbfb3e308e20 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1276 microversion: 2.1 time: 0.234079 Aug 27 05:16:52.625618 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2400/4800] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:52 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1276 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:52.631867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:52.697695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.compute.server_groups [None req-f3cd8094-d5d5-417f-8beb-ac55ebb52141 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Querying cell ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) for 1 instances {{(pid=128548) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 05:16:52.702187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3cd8094-d5d5-417f-8beb-ac55ebb52141 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:52.711434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3cd8094-d5d5-417f-8beb-ac55ebb52141 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:52.712456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3cd8094-d5d5-417f-8beb-ac55ebb52141 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:52.788181 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f3cd8094-d5d5-417f-8beb-ac55ebb52141 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/fc45549b-9606-41b8-846e-8f5a16e2bc08" status: 200 len: 221 microversion: 2.1 time: 0.189118 Aug 27 05:16:52.808483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d171247d-ace0-4784-b6f7-05eab0259ee7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:52.810850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d171247d-ace0-4784-b6f7-05eab0259ee7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:52.812457 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2401/4801] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:16:52 2022] GET /compute/v2.1/os-server-groups/fc45549b-9606-41b8-846e-8f5a16e2bc08 => generated 221 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:52.839477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d171247d-ace0-4784-b6f7-05eab0259ee7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:52.842728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d171247d-ace0-4784-b6f7-05eab0259ee7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:52.843663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d171247d-ace0-4784-b6f7-05eab0259ee7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:52.845869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d171247d-ace0-4784-b6f7-05eab0259ee7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:52.846889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d171247d-ace0-4784-b6f7-05eab0259ee7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:52.847794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d171247d-ace0-4784-b6f7-05eab0259ee7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:52.897552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d171247d-ace0-4784-b6f7-05eab0259ee7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:16:52.991031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:53.094880 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d171247d-ace0-4784-b6f7-05eab0259ee7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 204 len: 0 microversion: 2.1 time: 0.285284 Aug 27 05:16:53.104570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b76cbcc-5dea-4fa6-9841-7eab96536c9f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:53.105505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3b76cbcc-5dea-4fa6-9841-7eab96536c9f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:53.109921 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2401/4802] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:16:52 2022] DELETE /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:16:53.123552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b76cbcc-5dea-4fa6-9841-7eab96536c9f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:53.124925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b76cbcc-5dea-4fa6-9841-7eab96536c9f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:53.125583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b76cbcc-5dea-4fa6-9841-7eab96536c9f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:53.126535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b76cbcc-5dea-4fa6-9841-7eab96536c9f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:53.127885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b76cbcc-5dea-4fa6-9841-7eab96536c9f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:53.128537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b76cbcc-5dea-4fa6-9841-7eab96536c9f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:53.351779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23327c44-cb8d-4571-bf62-55ec51f4c914 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:53.353133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-23327c44-cb8d-4571-bf62-55ec51f4c914 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:53.389341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23327c44-cb8d-4571-bf62-55ec51f4c914 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:53.390669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23327c44-cb8d-4571-bf62-55ec51f4c914 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:53.391325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23327c44-cb8d-4571-bf62-55ec51f4c914 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:53.392846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23327c44-cb8d-4571-bf62-55ec51f4c914 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:53.393515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23327c44-cb8d-4571-bf62-55ec51f4c914 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:53.394192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23327c44-cb8d-4571-bf62-55ec51f4c914 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:54.398252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23327c44-cb8d-4571-bf62-55ec51f4c914 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:54.410209 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-23327c44-cb8d-4571-bf62-55ec51f4c914 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 1.063738 Aug 27 05:16:54.414904 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2402/4803] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:53 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:54.444860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e486d2fe-4e72-47be-ad8d-9702010c0e1a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:54.447690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e486d2fe-4e72-47be-ad8d-9702010c0e1a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:54.469362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e486d2fe-4e72-47be-ad8d-9702010c0e1a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:54.470120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e486d2fe-4e72-47be-ad8d-9702010c0e1a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:54.474057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e486d2fe-4e72-47be-ad8d-9702010c0e1a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:54.475020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e486d2fe-4e72-47be-ad8d-9702010c0e1a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:54.478606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e486d2fe-4e72-47be-ad8d-9702010c0e1a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:54.479206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e486d2fe-4e72-47be-ad8d-9702010c0e1a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:54.609945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3b76cbcc-5dea-4fa6-9841-7eab96536c9f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:54.623775 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3b76cbcc-5dea-4fa6-9841-7eab96536c9f tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1504 microversion: 2.1 time: 1.522991 Aug 27 05:16:54.624822 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2402/4804] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:53 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1504 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:54.874209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e486d2fe-4e72-47be-ad8d-9702010c0e1a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:54.896294 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e486d2fe-4e72-47be-ad8d-9702010c0e1a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1318 microversion: 2.1 time: 0.478851 Aug 27 05:16:54.897027 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2403/4805] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:54 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:55.454288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0beb75df-9bb4-4a92-87cc-0caf7602cf21 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:55.465951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0beb75df-9bb4-4a92-87cc-0caf7602cf21 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:55.486218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0beb75df-9bb4-4a92-87cc-0caf7602cf21 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:55.504429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0beb75df-9bb4-4a92-87cc-0caf7602cf21 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:55.505694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0beb75df-9bb4-4a92-87cc-0caf7602cf21 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:55.507448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0beb75df-9bb4-4a92-87cc-0caf7602cf21 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:55.508580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0beb75df-9bb4-4a92-87cc-0caf7602cf21 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:55.512215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0beb75df-9bb4-4a92-87cc-0caf7602cf21 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:55.652227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e875cef-87b7-47b1-9996-d4f2cc2bbc99 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:55.653020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3e875cef-87b7-47b1-9996-d4f2cc2bbc99 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:55.670083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e875cef-87b7-47b1-9996-d4f2cc2bbc99 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:55.687544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e875cef-87b7-47b1-9996-d4f2cc2bbc99 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:55.690475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e875cef-87b7-47b1-9996-d4f2cc2bbc99 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:55.694918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e875cef-87b7-47b1-9996-d4f2cc2bbc99 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:55.695690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e875cef-87b7-47b1-9996-d4f2cc2bbc99 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:55.703212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e875cef-87b7-47b1-9996-d4f2cc2bbc99 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:56.153625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0beb75df-9bb4-4a92-87cc-0caf7602cf21 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:56.166929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3e875cef-87b7-47b1-9996-d4f2cc2bbc99 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:56.175796 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e875cef-87b7-47b1-9996-d4f2cc2bbc99 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1504 microversion: 2.1 time: 0.528468 Aug 27 05:16:56.176445 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2404/4806] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:55 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1504 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:56.188684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0401f93-8f03-40c0-9963-5ad96f34fc45 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:56.190488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e0401f93-8f03-40c0-9963-5ad96f34fc45 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:56.208418 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0beb75df-9bb4-4a92-87cc-0caf7602cf21 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1686 microversion: 2.1 time: 0.760899 Aug 27 05:16:56.212222 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2403/4807] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:55 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1686 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:56.221882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0401f93-8f03-40c0-9963-5ad96f34fc45 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:56.222787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0401f93-8f03-40c0-9963-5ad96f34fc45 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:56.223456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0401f93-8f03-40c0-9963-5ad96f34fc45 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:56.224553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0401f93-8f03-40c0-9963-5ad96f34fc45 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:56.225195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0401f93-8f03-40c0-9963-5ad96f34fc45 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:56.225817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0401f93-8f03-40c0-9963-5ad96f34fc45 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:56.529240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-45963422-b392-4729-a9f1-54cefcccbbb4 req-e39bea8a-d485-4cf3-a28b-fd8b36ebfc13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1", "name": "network-vif-deleted", "tag": "8c21ce07-ce02-4263-9c4d-4c084f9e94c1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:56.581125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-45963422-b392-4729-a9f1-54cefcccbbb4 req-e39bea8a-d485-4cf3-a28b-fd8b36ebfc13 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:56.581880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-45963422-b392-4729-a9f1-54cefcccbbb4 req-e39bea8a-d485-4cf3-a28b-fd8b36ebfc13 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:56.582464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-45963422-b392-4729-a9f1-54cefcccbbb4 req-e39bea8a-d485-4cf3-a28b-fd8b36ebfc13 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:56.607419 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-45963422-b392-4729-a9f1-54cefcccbbb4 req-e39bea8a-d485-4cf3-a28b-fd8b36ebfc13 service nova] Creating event network-vif-deleted:8c21ce07-ce02-4263-9c4d-4c084f9e94c1 for instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 on n-h1-820368-35 Aug 27 05:16:56.626059 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-45963422-b392-4729-a9f1-54cefcccbbb4 req-e39bea8a-d485-4cf3-a28b-fd8b36ebfc13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103163 Aug 27 05:16:56.627538 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2404/4808] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:16:56.747763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e0401f93-8f03-40c0-9963-5ad96f34fc45 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:56.765519 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e0401f93-8f03-40c0-9963-5ad96f34fc45 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1318 microversion: 2.1 time: 0.581665 Aug 27 05:16:56.767632 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2405/4809] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:56 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:57.218485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:57.218921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:57.233913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:57.234927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:57.238519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e39bfb6-bcbb-41d3-896d-61062f24c8ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:57.239268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e39bfb6-bcbb-41d3-896d-61062f24c8ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:57.239492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:57.240305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:57.240810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:57.241437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:57.251162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e39bfb6-bcbb-41d3-896d-61062f24c8ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:57.251648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e39bfb6-bcbb-41d3-896d-61062f24c8ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:57.252085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e39bfb6-bcbb-41d3-896d-61062f24c8ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:57.252800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e39bfb6-bcbb-41d3-896d-61062f24c8ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:57.253259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e39bfb6-bcbb-41d3-896d-61062f24c8ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:57.253705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e39bfb6-bcbb-41d3-896d-61062f24c8ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:57.315482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:57.316333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:57.316949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:57.317691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lazy-loading 'fault' on Instance uuid e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:16:57.433147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934e7d34149642d191521d4844c86da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d255ad319749c1963c099d9f7e177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:57.447448 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-838b6a00-4e70-408a-b535-34ce7ba0c9be tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 200 len: 1303 microversion: 2.1 time: 0.238300 Aug 27 05:16:57.448448 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2405/4810] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:57 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 1303 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:57.620362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e39bfb6-bcbb-41d3-896d-61062f24c8ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:57.632097 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e39bfb6-bcbb-41d3-896d-61062f24c8ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1686 microversion: 2.1 time: 0.397193 Aug 27 05:16:57.633293 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2406/4811] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:57 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1686 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:16:57.797790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f386fe70-0f07-487b-8029-5a62c7bcdca7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:57.798410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f386fe70-0f07-487b-8029-5a62c7bcdca7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:57.805917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f386fe70-0f07-487b-8029-5a62c7bcdca7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:57.807451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f386fe70-0f07-487b-8029-5a62c7bcdca7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:57.807908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f386fe70-0f07-487b-8029-5a62c7bcdca7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:57.808634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f386fe70-0f07-487b-8029-5a62c7bcdca7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:57.809095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f386fe70-0f07-487b-8029-5a62c7bcdca7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:57.809524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f386fe70-0f07-487b-8029-5a62c7bcdca7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.055362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f386fe70-0f07-487b-8029-5a62c7bcdca7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:58.073045 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f386fe70-0f07-487b-8029-5a62c7bcdca7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1318 microversion: 2.1 time: 0.279225 Aug 27 05:16:58.074030 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2406/4812] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:57 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:58.471070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:58.473013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:58.482582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.483943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.484776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.485822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.486482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.487197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.504743 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] HTTP exception thrown: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Request method failure captured: Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 HTTP/1.1 Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaigGVmeSvCf5rqjbvud-1QeDFfGRLRuYmyYELIV1_tRFGpNpPbEiY6SmVssnpeHrb8fToVaj8CIl2WSk95eBMZQcN5U70YlPcVOukQvAIbfnKzIkKyyHAZutnp7MoRr5A5-xwc2jcJAvFZcWwn_7cIEsPKO0GSItpqWIo5kip54qYg Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69d255ad319749c1963c099d9f7e177d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 934e7d34149642d191521d4844c86da9 Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1'} Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.507621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.513690 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.513690 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.513690 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.513690 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:58.513690 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:58.513690 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.513690 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.522678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Returning 404 to user: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:58.523858 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-35186406-0f6f-4153-87c3-fcf9f0275ff0 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 404 len: 111 microversion: 2.1 time: 0.058184 Aug 27 05:16:58.529972 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2407/4813] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:58 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:58.535628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f62b9d0b-267a-478f-9ff7-92cec4e96b6d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:58.548475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:58.549182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:58.578437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.compute.server_groups [None req-f62b9d0b-267a-478f-9ff7-92cec4e96b6d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Querying cell ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) for 1 instances {{(pid=128548) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 05:16:58.579347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f62b9d0b-267a-478f-9ff7-92cec4e96b6d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.579976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f62b9d0b-267a-478f-9ff7-92cec4e96b6d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.581024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f62b9d0b-267a-478f-9ff7-92cec4e96b6d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.600792 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f62b9d0b-267a-478f-9ff7-92cec4e96b6d tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.069312 Aug 27 05:16:58.601567 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2407/4814] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 05:16:58 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:58.618813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b742169e-dbcc-458b-839b-fff03498f584 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:58.639150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.compute.server_groups [None req-b742169e-dbcc-458b-839b-fff03498f584 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Querying cell ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) for 1 instances {{(pid=128547) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 05:16:58.641614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b742169e-dbcc-458b-839b-fff03498f584 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.642409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b742169e-dbcc-458b-839b-fff03498f584 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.653112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-46c6f32a-6b36-452d-9aa7-1c8e5e22aa9d req-9cf27179-75fd-45ef-9ffc-b6daa3a615aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9219a13-89e0-41e4-ad6c-3f3b17da15b9", "tag": "293ddc90-e975-483a-bf8c-cdab8f0c658a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:58.655030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b742169e-dbcc-458b-839b-fff03498f584 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.667787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:58.709549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-46c6f32a-6b36-452d-9aa7-1c8e5e22aa9d req-9cf27179-75fd-45ef-9ffc-b6daa3a615aa service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.710098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-46c6f32a-6b36-452d-9aa7-1c8e5e22aa9d req-9cf27179-75fd-45ef-9ffc-b6daa3a615aa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.710550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-46c6f32a-6b36-452d-9aa7-1c8e5e22aa9d req-9cf27179-75fd-45ef-9ffc-b6daa3a615aa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.718250 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b742169e-dbcc-458b-839b-fff03498f584 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/fc45549b-9606-41b8-846e-8f5a16e2bc08" status: 200 len: 183 microversion: 2.1 time: 0.106611 Aug 27 05:16:58.720975 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2408/4815] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:16:58 2022] GET /compute/v2.1/os-server-groups/fc45549b-9606-41b8-846e-8f5a16e2bc08 => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:58.727967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-239e1516-2210-4d00-9a9d-83c3cf9d31a2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:58.734192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-239e1516-2210-4d00-9a9d-83c3cf9d31a2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:58.742576 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-46c6f32a-6b36-452d-9aa7-1c8e5e22aa9d req-9cf27179-75fd-45ef-9ffc-b6daa3a615aa service nova] Creating event network-changed:293ddc90-e975-483a-bf8c-cdab8f0c658a for instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 on n-h2-820368-35 Aug 27 05:16:58.749884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e1516-2210-4d00-9a9d-83c3cf9d31a2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.750658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e1516-2210-4d00-9a9d-83c3cf9d31a2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.751396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e1516-2210-4d00-9a9d-83c3cf9d31a2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.753358 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-46c6f32a-6b36-452d-9aa7-1c8e5e22aa9d req-9cf27179-75fd-45ef-9ffc-b6daa3a615aa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108728 Aug 27 05:16:58.755008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e1516-2210-4d00-9a9d-83c3cf9d31a2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.755713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e1516-2210-4d00-9a9d-83c3cf9d31a2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.756162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-239e1516-2210-4d00-9a9d-83c3cf9d31a2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.760415 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2408/4816] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:16:58.781569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:58.782189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:58.809907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.810404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.811396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.811629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.812092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.812527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.832432 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] HTTP exception thrown: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Request method failure captured: Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 HTTP/1.1 Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaigGVmeSvCf5rqjbvud-1QeDFfGRLRuYmyYELIV1_tRFGpNpPbEiY6SmVssnpeHrb8fToVaj8CIl2WSk95eBMZQcN5U70YlPcVOukQvAIbfnKzIkKyyHAZutnp7MoRr5A5-xwc2jcJAvFZcWwn_7cIEsPKO0GSItpqWIo5kip54qYg Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69d255ad319749c1963c099d9f7e177d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 934e7d34149642d191521d4844c86da9 Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1'} Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:58.834637 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:58.839753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.839753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.839753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.839753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.839753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.839753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.839753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.839753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:58.839753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:58.839753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.839753 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.841878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Returning 404 to user: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:58.844039 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a40a002d-7d2c-42a8-b5be-e4027650f5ff tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 404 len: 111 microversion: 2.1 time: 0.082018 Aug 27 05:16:58.844790 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2409/4817] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:16:58 2022] DELETE /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:58.852791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:58.853573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] [instance: e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:58.861769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.862272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.862714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.863518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.864426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.865055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.890004 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] HTTP exception thrown: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Request method failure captured: Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 HTTP/1.1 Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaigGVmeSvCf5rqjbvud-1QeDFfGRLRuYmyYELIV1_tRFGpNpPbEiY6SmVssnpeHrb8fToVaj8CIl2WSk95eBMZQcN5U70YlPcVOukQvAIbfnKzIkKyyHAZutnp7MoRr5A5-xwc2jcJAvFZcWwn_7cIEsPKO0GSItpqWIo5kip54qYg Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69d255ad319749c1963c099d9f7e177d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 934e7d34149642d191521d4844c86da9 Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1'} Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.891998 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.897623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.897623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.897623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.897623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:58.897623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:58.897623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. Aug 27 05:16:58.897623 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.897623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Returning 404 to user: Instance e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:58.898811 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f48488c-6ccf-4914-abfc-d9dd45c1bce3 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1" status: 404 len: 111 microversion: 2.1 time: 0.047803 Aug 27 05:16:58.903554 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2410/4818] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:58 2022] GET /compute/v2.1/servers/e6fa69e3-b6db-42a6-999e-f3b5f1ef05d1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:58.914084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-119fd72c-3652-455a-bd8d-e4b3fec1766e tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:58.922561 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-119fd72c-3652-455a-bd8d-e4b3fec1766e tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] HTTP exception thrown: Instance group 694282f1-3129-4803-8036-530cfa8616a3 could not be found. Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-119fd72c-3652-455a-bd8d-e4b3fec1766e tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Request method failure captured: Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-server-groups/694282f1-3129-4803-8036-530cfa8616a3 HTTP/1.1 Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaigGVmeSvCf5rqjbvud-1QeDFfGRLRuYmyYELIV1_tRFGpNpPbEiY6SmVssnpeHrb8fToVaj8CIl2WSk95eBMZQcN5U70YlPcVOukQvAIbfnKzIkKyyHAZutnp7MoRr5A5-xwc2jcJAvFZcWwn_7cIEsPKO0GSItpqWIo5kip54qYg Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69d255ad319749c1963c099d9f7e177d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 934e7d34149642d191521d4844c86da9 Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance group 694282f1-3129-4803-8036-530cfa8616a3 could not be found. Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '694282f1-3129-4803-8036-530cfa8616a3'} Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 694282f1-3129-4803-8036-530cfa8616a3 could not be found. Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 694282f1-3129-4803-8036-530cfa8616a3 could not be found. Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.925284 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.930887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.930887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.930887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:58.930887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:58.930887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 694282f1-3129-4803-8036-530cfa8616a3 could not be found. Aug 27 05:16:58.930887 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.930887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-119fd72c-3652-455a-bd8d-e4b3fec1766e tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Returning 404 to user: Instance group 694282f1-3129-4803-8036-530cfa8616a3 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:58.930887 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-119fd72c-3652-455a-bd8d-e4b3fec1766e tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/694282f1-3129-4803-8036-530cfa8616a3" status: 404 len: 117 microversion: 2.1 time: 0.024455 Aug 27 05:16:58.935548 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2411/4819] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 05:16:58 2022] DELETE /compute/v2.1/os-server-groups/694282f1-3129-4803-8036-530cfa8616a3 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:58.942045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-20b59682-da84-47ae-acf4-a6792f9103a1 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:58.952526 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-20b59682-da84-47ae-acf4-a6792f9103a1 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] HTTP exception thrown: Instance group 51162d05-2c9f-4391-9ee9-2c69aae95f87 could not be found. Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-20b59682-da84-47ae-acf4-a6792f9103a1 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Request method failure captured: Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-server-groups/51162d05-2c9f-4391-9ee9-2c69aae95f87 HTTP/1.1 Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaigGVmeSvCf5rqjbvud-1QeDFfGRLRuYmyYELIV1_tRFGpNpPbEiY6SmVssnpeHrb8fToVaj8CIl2WSk95eBMZQcN5U70YlPcVOukQvAIbfnKzIkKyyHAZutnp7MoRr5A5-xwc2jcJAvFZcWwn_7cIEsPKO0GSItpqWIo5kip54qYg Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69d255ad319749c1963c099d9f7e177d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 934e7d34149642d191521d4844c86da9 Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance group 51162d05-2c9f-4391-9ee9-2c69aae95f87 could not be found. Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '51162d05-2c9f-4391-9ee9-2c69aae95f87'} Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 51162d05-2c9f-4391-9ee9-2c69aae95f87 could not be found. Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 51162d05-2c9f-4391-9ee9-2c69aae95f87 could not be found. Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.955598 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.962233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.962233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.962233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:58.962233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:58.962233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 51162d05-2c9f-4391-9ee9-2c69aae95f87 could not be found. Aug 27 05:16:58.962233 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.962233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-20b59682-da84-47ae-acf4-a6792f9103a1 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Returning 404 to user: Instance group 51162d05-2c9f-4391-9ee9-2c69aae95f87 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:58.962233 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-20b59682-da84-47ae-acf4-a6792f9103a1 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/51162d05-2c9f-4391-9ee9-2c69aae95f87" status: 404 len: 117 microversion: 2.1 time: 0.023615 Aug 27 05:16:58.963709 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2412/4820] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 05:16:58 2022] DELETE /compute/v2.1/os-server-groups/51162d05-2c9f-4391-9ee9-2c69aae95f87 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:58.978328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13b04fb0-d1bd-44dd-8a76-0ac7d34755de tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:58.990243 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-13b04fb0-d1bd-44dd-8a76-0ac7d34755de tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] HTTP exception thrown: Instance group 5b50693d-5d6e-43a7-affa-e6204756fba3 could not be found. Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13b04fb0-d1bd-44dd-8a76-0ac7d34755de tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Request method failure captured: Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-server-groups/5b50693d-5d6e-43a7-affa-e6204756fba3 HTTP/1.1 Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaigGVmeSvCf5rqjbvud-1QeDFfGRLRuYmyYELIV1_tRFGpNpPbEiY6SmVssnpeHrb8fToVaj8CIl2WSk95eBMZQcN5U70YlPcVOukQvAIbfnKzIkKyyHAZutnp7MoRr5A5-xwc2jcJAvFZcWwn_7cIEsPKO0GSItpqWIo5kip54qYg Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69d255ad319749c1963c099d9f7e177d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 934e7d34149642d191521d4844c86da9 Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance group 5b50693d-5d6e-43a7-affa-e6204756fba3 could not be found. Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '5b50693d-5d6e-43a7-affa-e6204756fba3'} Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5b50693d-5d6e-43a7-affa-e6204756fba3 could not be found. Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5b50693d-5d6e-43a7-affa-e6204756fba3 could not be found. Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.993890 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:58.998993 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:58.998993 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:58.998993 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:58.998993 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:58.998993 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5b50693d-5d6e-43a7-affa-e6204756fba3 could not be found. Aug 27 05:16:58.998993 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:58.998993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13b04fb0-d1bd-44dd-8a76-0ac7d34755de tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Returning 404 to user: Instance group 5b50693d-5d6e-43a7-affa-e6204756fba3 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:58.998993 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-13b04fb0-d1bd-44dd-8a76-0ac7d34755de tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/5b50693d-5d6e-43a7-affa-e6204756fba3" status: 404 len: 117 microversion: 2.1 time: 0.027028 Aug 27 05:16:58.998993 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2413/4821] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 05:16:58 2022] DELETE /compute/v2.1/os-server-groups/5b50693d-5d6e-43a7-affa-e6204756fba3 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:16:59.021112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f0a52a6-07ed-409e-aecb-75ec3b1c12e7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:59.037391 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-1f0a52a6-07ed-409e-aecb-75ec3b1c12e7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] HTTP exception thrown: Instance group d36da7c9-e94a-4576-aec1-6bb2fcc74642 could not be found. Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f0a52a6-07ed-409e-aecb-75ec3b1c12e7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Request method failure captured: Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/os-server-groups/d36da7c9-e94a-4576-aec1-6bb2fcc74642 HTTP/1.1 Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaigGVmeSvCf5rqjbvud-1QeDFfGRLRuYmyYELIV1_tRFGpNpPbEiY6SmVssnpeHrb8fToVaj8CIl2WSk95eBMZQcN5U70YlPcVOukQvAIbfnKzIkKyyHAZutnp7MoRr5A5-xwc2jcJAvFZcWwn_7cIEsPKO0GSItpqWIo5kip54qYg Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69d255ad319749c1963c099d9f7e177d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69d255ad319749c1963c099d9f7e177d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 69d255ad319749c1963c099d9f7e177d Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerGroupTestJSON-419097725 Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 934e7d34149642d191521d4844c86da9 Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerGroupTestJSON-419097725-project Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance group d36da7c9-e94a-4576-aec1-6bb2fcc74642 could not be found. Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd36da7c9-e94a-4576-aec1-6bb2fcc74642'} Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d36da7c9-e94a-4576-aec1-6bb2fcc74642 could not be found. Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d36da7c9-e94a-4576-aec1-6bb2fcc74642 could not be found. Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:59.039318 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:59.044117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:59.044117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:59.044117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:59.044117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:59.044117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d36da7c9-e94a-4576-aec1-6bb2fcc74642 could not be found. Aug 27 05:16:59.044117 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:16:59.046394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f0a52a6-07ed-409e-aecb-75ec3b1c12e7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Returning 404 to user: Instance group d36da7c9-e94a-4576-aec1-6bb2fcc74642 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:59.048047 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1f0a52a6-07ed-409e-aecb-75ec3b1c12e7 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/d36da7c9-e94a-4576-aec1-6bb2fcc74642" status: 404 len: 117 microversion: 2.1 time: 0.040913 Aug 27 05:16:59.049152 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2414/4822] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 05:16:59 2022] DELETE /compute/v2.1/os-server-groups/d36da7c9-e94a-4576-aec1-6bb2fcc74642 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:59.063167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2ea34f65-6cee-4290-a59e-7d6f53b8ff48 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:59.107659 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2ea34f65-6cee-4290-a59e-7d6f53b8ff48 tempest-ServerGroupTestJSON-419097725 tempest-ServerGroupTestJSON-419097725-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/fc45549b-9606-41b8-846e-8f5a16e2bc08" status: 204 len: 0 microversion: 2.1 time: 0.051433 Aug 27 05:16:59.108685 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2415/4823] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 05:16:59 2022] DELETE /compute/v2.1/os-server-groups/fc45549b-9606-41b8-846e-8f5a16e2bc08 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:16:59.120461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f8db8c52-68d4-4b16-834b-1ed97cecd033 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:59.121332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f8db8c52-68d4-4b16-834b-1ed97cecd033 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:59.136001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8db8c52-68d4-4b16-834b-1ed97cecd033 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:59.137063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8db8c52-68d4-4b16-834b-1ed97cecd033 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:59.137977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8db8c52-68d4-4b16-834b-1ed97cecd033 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:59.139073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8db8c52-68d4-4b16-834b-1ed97cecd033 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:59.140451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8db8c52-68d4-4b16-834b-1ed97cecd033 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:59.141365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8db8c52-68d4-4b16-834b-1ed97cecd033 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:59.153516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-239e1516-2210-4d00-9a9d-83c3cf9d31a2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:59.182433 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-239e1516-2210-4d00-9a9d-83c3cf9d31a2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1686 microversion: 2.1 time: 0.460125 Aug 27 05:16:59.184003 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2409/4824] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:58 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1686 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:59.595282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f8db8c52-68d4-4b16-834b-1ed97cecd033 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:59.628629 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f8db8c52-68d4-4b16-834b-1ed97cecd033 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1318 microversion: 2.1 time: 0.512492 Aug 27 05:16:59.631042 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2416/4825] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:59 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:59.780038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5810b5ed-c23b-4525-98c6-3bbfe6051bef req-a4220833-0bac-4652-ae41-9f051dc2ec3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f4c359-6f7e-4009-a365-7b070eec11a9", "name": "network-vif-plugged", "status": "completed", "tag": "2a4e09b9-01c8-433a-8d9e-e93f9888b163"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:59.798924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5810b5ed-c23b-4525-98c6-3bbfe6051bef req-a4220833-0bac-4652-ae41-9f051dc2ec3e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:59.799451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5810b5ed-c23b-4525-98c6-3bbfe6051bef req-a4220833-0bac-4652-ae41-9f051dc2ec3e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:59.799883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5810b5ed-c23b-4525-98c6-3bbfe6051bef req-a4220833-0bac-4652-ae41-9f051dc2ec3e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:59.839888 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5810b5ed-c23b-4525-98c6-3bbfe6051bef req-a4220833-0bac-4652-ae41-9f051dc2ec3e service nova] Creating event network-vif-plugged:2a4e09b9-01c8-433a-8d9e-e93f9888b163 for instance e5f4c359-6f7e-4009-a365-7b070eec11a9 on n-h2-820368-35 Aug 27 05:16:59.882126 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5810b5ed-c23b-4525-98c6-3bbfe6051bef req-a4220833-0bac-4652-ae41-9f051dc2ec3e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109439 Aug 27 05:16:59.883131 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2410/4826] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:00.212690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dbad79bc-c37a-4a75-9d39-dbb66858042f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:00.213315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dbad79bc-c37a-4a75-9d39-dbb66858042f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:00.231147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbad79bc-c37a-4a75-9d39-dbb66858042f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:00.231631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbad79bc-c37a-4a75-9d39-dbb66858042f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:00.234895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbad79bc-c37a-4a75-9d39-dbb66858042f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:00.235933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbad79bc-c37a-4a75-9d39-dbb66858042f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:00.236694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbad79bc-c37a-4a75-9d39-dbb66858042f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:00.237240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dbad79bc-c37a-4a75-9d39-dbb66858042f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:00.285782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:00.581737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dbad79bc-c37a-4a75-9d39-dbb66858042f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:00.597597 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dbad79bc-c37a-4a75-9d39-dbb66858042f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1686 microversion: 2.1 time: 0.390121 Aug 27 05:17:00.599431 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2417/4827] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:00 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1686 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:00.656528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-38d0e051-f4bd-4289-b79a-705863963e6a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:00.658013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-38d0e051-f4bd-4289-b79a-705863963e6a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:00.672885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d0e051-f4bd-4289-b79a-705863963e6a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:00.673639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d0e051-f4bd-4289-b79a-705863963e6a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:00.674145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d0e051-f4bd-4289-b79a-705863963e6a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:00.675411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d0e051-f4bd-4289-b79a-705863963e6a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:00.675934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d0e051-f4bd-4289-b79a-705863963e6a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:00.676496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38d0e051-f4bd-4289-b79a-705863963e6a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:01.141505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-38d0e051-f4bd-4289-b79a-705863963e6a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:01.154982 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-38d0e051-f4bd-4289-b79a-705863963e6a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1318 microversion: 2.1 time: 0.506077 Aug 27 05:17:01.167571 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2411/4828] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:00 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:01.637998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-79e98760-bc49-4a79-a1a2-881fc9ea3d96 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:01.637998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-79e98760-bc49-4a79-a1a2-881fc9ea3d96 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:01.651232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79e98760-bc49-4a79-a1a2-881fc9ea3d96 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:01.651232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79e98760-bc49-4a79-a1a2-881fc9ea3d96 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:01.663844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79e98760-bc49-4a79-a1a2-881fc9ea3d96 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:01.665387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79e98760-bc49-4a79-a1a2-881fc9ea3d96 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:01.666295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79e98760-bc49-4a79-a1a2-881fc9ea3d96 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:01.667192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79e98760-bc49-4a79-a1a2-881fc9ea3d96 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:02.192378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-359d0c3c-dab4-4a29-a88f-ba42785b7823 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:02.194674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-359d0c3c-dab4-4a29-a88f-ba42785b7823 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:02.218226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-359d0c3c-dab4-4a29-a88f-ba42785b7823 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:02.219587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-359d0c3c-dab4-4a29-a88f-ba42785b7823 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:02.220152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-359d0c3c-dab4-4a29-a88f-ba42785b7823 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:02.223244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-359d0c3c-dab4-4a29-a88f-ba42785b7823 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:02.224077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-359d0c3c-dab4-4a29-a88f-ba42785b7823 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:02.224810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-359d0c3c-dab4-4a29-a88f-ba42785b7823 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:02.353348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-79e98760-bc49-4a79-a1a2-881fc9ea3d96 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:02.388496 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-79e98760-bc49-4a79-a1a2-881fc9ea3d96 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1686 microversion: 2.1 time: 0.762385 Aug 27 05:17:02.390875 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2418/4829] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:01 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1686 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:02.642621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-359d0c3c-dab4-4a29-a88f-ba42785b7823 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:02.651310 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-359d0c3c-dab4-4a29-a88f-ba42785b7823 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1318 microversion: 2.1 time: 0.463851 Aug 27 05:17:02.652678 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2412/4830] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:02 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:03.417755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f47c8413-51b9-4e49-99f0-b93c1b24b924 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:03.418394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f47c8413-51b9-4e49-99f0-b93c1b24b924 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:03.428525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47c8413-51b9-4e49-99f0-b93c1b24b924 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:03.429235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47c8413-51b9-4e49-99f0-b93c1b24b924 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:03.429851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47c8413-51b9-4e49-99f0-b93c1b24b924 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:03.430758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47c8413-51b9-4e49-99f0-b93c1b24b924 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:03.431416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47c8413-51b9-4e49-99f0-b93c1b24b924 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:03.432025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f47c8413-51b9-4e49-99f0-b93c1b24b924 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:03.682000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8367aea4-f409-4549-89d7-c9cc226dc798 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:03.690971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8367aea4-f409-4549-89d7-c9cc226dc798 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:03.715200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8367aea4-f409-4549-89d7-c9cc226dc798 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:03.716002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8367aea4-f409-4549-89d7-c9cc226dc798 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:03.716683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8367aea4-f409-4549-89d7-c9cc226dc798 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:03.726895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8367aea4-f409-4549-89d7-c9cc226dc798 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:03.728006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8367aea4-f409-4549-89d7-c9cc226dc798 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:03.728992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8367aea4-f409-4549-89d7-c9cc226dc798 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:03.946106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f47c8413-51b9-4e49-99f0-b93c1b24b924 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:03.959159 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f47c8413-51b9-4e49-99f0-b93c1b24b924 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 0.546156 Aug 27 05:17:03.963899 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2419/4831] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:03 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:04.336582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8367aea4-f409-4549-89d7-c9cc226dc798 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:04.350027 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8367aea4-f409-4549-89d7-c9cc226dc798 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1318 microversion: 2.1 time: 0.679925 Aug 27 05:17:04.359516 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2413/4832] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:03 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1318 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:04.989873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd0510c7-3c1a-4210-8a0d-7cd9c4a3df16 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:04.990776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd0510c7-3c1a-4210-8a0d-7cd9c4a3df16 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:05.008704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd0510c7-3c1a-4210-8a0d-7cd9c4a3df16 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:05.012158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd0510c7-3c1a-4210-8a0d-7cd9c4a3df16 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:05.012979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd0510c7-3c1a-4210-8a0d-7cd9c4a3df16 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:05.013423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd0510c7-3c1a-4210-8a0d-7cd9c4a3df16 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:05.018462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd0510c7-3c1a-4210-8a0d-7cd9c4a3df16 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:05.019276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd0510c7-3c1a-4210-8a0d-7cd9c4a3df16 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:05.388141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e6256569-10d0-47ee-9688-38436fdac2a2 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:05.391778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e6256569-10d0-47ee-9688-38436fdac2a2 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:05.409861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6256569-10d0-47ee-9688-38436fdac2a2 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:05.411461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6256569-10d0-47ee-9688-38436fdac2a2 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:05.412592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6256569-10d0-47ee-9688-38436fdac2a2 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:05.415571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6256569-10d0-47ee-9688-38436fdac2a2 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:05.417588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6256569-10d0-47ee-9688-38436fdac2a2 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:05.419076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6256569-10d0-47ee-9688-38436fdac2a2 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:05.821091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e6256569-10d0-47ee-9688-38436fdac2a2 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:05.833540 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e6256569-10d0-47ee-9688-38436fdac2a2 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1318 microversion: 2.1 time: 0.452452 Aug 27 05:17:05.834653 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2414/4833] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:05 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:06.182047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd0510c7-3c1a-4210-8a0d-7cd9c4a3df16 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:06.212597 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd0510c7-3c1a-4210-8a0d-7cd9c4a3df16 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 1.230044 Aug 27 05:17:06.215986 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2420/4834] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:04 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:06.319570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9f255c01-b597-451e-a077-6aeddf5b4b47 req-6ddad1d1-1032-4841-add8-8ee78c60e532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9219a13-89e0-41e4-ad6c-3f3b17da15b9", "name": "network-vif-plugged", "status": "completed", "tag": "293ddc90-e975-483a-bf8c-cdab8f0c658a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:06.344731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9f255c01-b597-451e-a077-6aeddf5b4b47 req-6ddad1d1-1032-4841-add8-8ee78c60e532 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:06.351863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9f255c01-b597-451e-a077-6aeddf5b4b47 req-6ddad1d1-1032-4841-add8-8ee78c60e532 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:06.357756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9f255c01-b597-451e-a077-6aeddf5b4b47 req-6ddad1d1-1032-4841-add8-8ee78c60e532 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:06.405385 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9f255c01-b597-451e-a077-6aeddf5b4b47 req-6ddad1d1-1032-4841-add8-8ee78c60e532 service nova] Creating event network-vif-plugged:293ddc90-e975-483a-bf8c-cdab8f0c658a for instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 on n-h2-820368-35 Aug 27 05:17:06.422762 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9f255c01-b597-451e-a077-6aeddf5b4b47 req-6ddad1d1-1032-4841-add8-8ee78c60e532 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109986 Aug 27 05:17:06.428949 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2415/4835] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:06.864915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0fb8feba-4599-49c1-87f3-eab69bae1787 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:06.875419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0fb8feba-4599-49c1-87f3-eab69bae1787 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:06.889582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb8feba-4599-49c1-87f3-eab69bae1787 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:06.890463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb8feba-4599-49c1-87f3-eab69bae1787 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:06.893375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb8feba-4599-49c1-87f3-eab69bae1787 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:06.894652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb8feba-4599-49c1-87f3-eab69bae1787 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:06.896076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb8feba-4599-49c1-87f3-eab69bae1787 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:06.897794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fb8feba-4599-49c1-87f3-eab69bae1787 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:07.244502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-975cfed0-b543-4dd7-8872-d0ff3b9ac6d4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:07.245394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-975cfed0-b543-4dd7-8872-d0ff3b9ac6d4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:07.278437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-975cfed0-b543-4dd7-8872-d0ff3b9ac6d4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:07.287877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-975cfed0-b543-4dd7-8872-d0ff3b9ac6d4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:07.289085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-975cfed0-b543-4dd7-8872-d0ff3b9ac6d4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:07.293379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-975cfed0-b543-4dd7-8872-d0ff3b9ac6d4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:07.297812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-975cfed0-b543-4dd7-8872-d0ff3b9ac6d4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:07.302288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-975cfed0-b543-4dd7-8872-d0ff3b9ac6d4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:07.376547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0fb8feba-4599-49c1-87f3-eab69bae1787 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:07.412195 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0fb8feba-4599-49c1-87f3-eab69bae1787 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1318 microversion: 2.1 time: 0.553023 Aug 27 05:17:07.421115 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2421/4836] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:06 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:07.722351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-975cfed0-b543-4dd7-8872-d0ff3b9ac6d4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:07.738517 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-975cfed0-b543-4dd7-8872-d0ff3b9ac6d4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 0.499917 Aug 27 05:17:07.755791 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2416/4837] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:07 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:08.441010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1d7f7122-92e1-4ea8-8eee-0ea25ddc2240 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:08.442231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1d7f7122-92e1-4ea8-8eee-0ea25ddc2240 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:08.469778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7f7122-92e1-4ea8-8eee-0ea25ddc2240 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:08.470944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7f7122-92e1-4ea8-8eee-0ea25ddc2240 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:08.472058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7f7122-92e1-4ea8-8eee-0ea25ddc2240 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:08.473199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7f7122-92e1-4ea8-8eee-0ea25ddc2240 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:08.476593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7f7122-92e1-4ea8-8eee-0ea25ddc2240 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:08.477427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7f7122-92e1-4ea8-8eee-0ea25ddc2240 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:08.764055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2085fccf-85fc-4a35-8bc8-bd2ace9c2880 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:08.767664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2085fccf-85fc-4a35-8bc8-bd2ace9c2880 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:08.817542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2085fccf-85fc-4a35-8bc8-bd2ace9c2880 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:08.818681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2085fccf-85fc-4a35-8bc8-bd2ace9c2880 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:08.823036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2085fccf-85fc-4a35-8bc8-bd2ace9c2880 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:08.824100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2085fccf-85fc-4a35-8bc8-bd2ace9c2880 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:08.825093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2085fccf-85fc-4a35-8bc8-bd2ace9c2880 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:08.826018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2085fccf-85fc-4a35-8bc8-bd2ace9c2880 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:10.268161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1d7f7122-92e1-4ea8-8eee-0ea25ddc2240 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:10.293178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1d7f7122-92e1-4ea8-8eee-0ea25ddc2240 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1318 microversion: 2.1 time: 1.853549 Aug 27 05:17:10.298495 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2422/4838] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:08 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1318 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:10.373172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2085fccf-85fc-4a35-8bc8-bd2ace9c2880 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:10.391380 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2085fccf-85fc-4a35-8bc8-bd2ace9c2880 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 1.626731 Aug 27 05:17:10.393967 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2417/4839] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:08 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:11.318710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90dc16a6-d5c9-49a9-ae1e-6a15e7339333 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:11.319560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-90dc16a6-d5c9-49a9-ae1e-6a15e7339333 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:11.338006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90dc16a6-d5c9-49a9-ae1e-6a15e7339333 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:11.340735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90dc16a6-d5c9-49a9-ae1e-6a15e7339333 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:11.341220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90dc16a6-d5c9-49a9-ae1e-6a15e7339333 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:11.342921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90dc16a6-d5c9-49a9-ae1e-6a15e7339333 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:11.343042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90dc16a6-d5c9-49a9-ae1e-6a15e7339333 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:11.343627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90dc16a6-d5c9-49a9-ae1e-6a15e7339333 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:11.419584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f5bd0335-d98e-4485-bfb5-7726c9b834fe tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:11.420801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f5bd0335-d98e-4485-bfb5-7726c9b834fe tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:11.430237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5bd0335-d98e-4485-bfb5-7726c9b834fe tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:11.430833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5bd0335-d98e-4485-bfb5-7726c9b834fe tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:11.431378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5bd0335-d98e-4485-bfb5-7726c9b834fe tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:11.432180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5bd0335-d98e-4485-bfb5-7726c9b834fe tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:11.432717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5bd0335-d98e-4485-bfb5-7726c9b834fe tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:11.447423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5bd0335-d98e-4485-bfb5-7726c9b834fe tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:11.798799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-90dc16a6-d5c9-49a9-ae1e-6a15e7339333 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:11.844819 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90dc16a6-d5c9-49a9-ae1e-6a15e7339333 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1508 microversion: 2.1 time: 0.529546 Aug 27 05:17:11.852812 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2423/4840] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:11 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1508 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:11.899823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7703a11b-dabf-4bbf-9e3e-b35df8669895 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:11.905579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7703a11b-dabf-4bbf-9e3e-b35df8669895 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:11.957611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7703a11b-dabf-4bbf-9e3e-b35df8669895 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:11.960484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7703a11b-dabf-4bbf-9e3e-b35df8669895 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:11.962684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7703a11b-dabf-4bbf-9e3e-b35df8669895 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:11.969258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7703a11b-dabf-4bbf-9e3e-b35df8669895 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:11.974858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7703a11b-dabf-4bbf-9e3e-b35df8669895 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:11.977164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7703a11b-dabf-4bbf-9e3e-b35df8669895 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:12.006184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f5bd0335-d98e-4485-bfb5-7726c9b834fe tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:12.031692 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f5bd0335-d98e-4485-bfb5-7726c9b834fe tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 0.615862 Aug 27 05:17:12.040163 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2418/4841] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:11 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:12.348536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7703a11b-dabf-4bbf-9e3e-b35df8669895 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:12.385406 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7703a11b-dabf-4bbf-9e3e-b35df8669895 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1508 microversion: 2.1 time: 0.507384 Aug 27 05:17:12.411954 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2424/4842] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:11 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1508 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:12.414385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:12.417182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:12.438469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:12.439212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:12.439947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:12.442191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:12.443457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:12.444333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:12.599420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:17:12.599852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:17:12.608938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:17:12.609896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:17:12.610886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:17:12.690553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:12.759549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:12.773793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:12.775459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:12.776886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:12.778318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:12.781802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:12.783830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:12.921988 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8b81597-cb65-48e1-a0b0-4d7f68641bbe tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "POST /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9/action" status: 202 len: 1110 microversion: 2.1 time: 0.511485 Aug 27 05:17:12.938463 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2419/4843] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:17:12 2022] POST /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9/action => generated 1110 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 05:17:12.966326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-906279a1-7c3f-4317-9d9a-edc3d0df1498 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:12.969620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-906279a1-7c3f-4317-9d9a-edc3d0df1498 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:12.981810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906279a1-7c3f-4317-9d9a-edc3d0df1498 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:12.982360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906279a1-7c3f-4317-9d9a-edc3d0df1498 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:12.983401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906279a1-7c3f-4317-9d9a-edc3d0df1498 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:12.985544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906279a1-7c3f-4317-9d9a-edc3d0df1498 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:12.986462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906279a1-7c3f-4317-9d9a-edc3d0df1498 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:12.987266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906279a1-7c3f-4317-9d9a-edc3d0df1498 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:13.075728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dfd315ee-ddb8-40ef-b086-df5c2c350440 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:13.076502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dfd315ee-ddb8-40ef-b086-df5c2c350440 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:13.117662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfd315ee-ddb8-40ef-b086-df5c2c350440 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:13.119197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfd315ee-ddb8-40ef-b086-df5c2c350440 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:13.122758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfd315ee-ddb8-40ef-b086-df5c2c350440 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:13.129282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfd315ee-ddb8-40ef-b086-df5c2c350440 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:13.132354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfd315ee-ddb8-40ef-b086-df5c2c350440 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:13.145920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dfd315ee-ddb8-40ef-b086-df5c2c350440 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:13.697900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-906279a1-7c3f-4317-9d9a-edc3d0df1498 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:13.734990 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-906279a1-7c3f-4317-9d9a-edc3d0df1498 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 0.790651 Aug 27 05:17:13.752254 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2425/4844] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:12 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:13.765709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dfd315ee-ddb8-40ef-b086-df5c2c350440 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:13.778658 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dfd315ee-ddb8-40ef-b086-df5c2c350440 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 0.722417 Aug 27 05:17:13.794424 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2420/4845] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:13 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:14.759644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-40c3d131-de47-43a2-a5f2-8b37d06fce8d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:14.762058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-40c3d131-de47-43a2-a5f2-8b37d06fce8d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:14.775413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c3d131-de47-43a2-a5f2-8b37d06fce8d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:14.777514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c3d131-de47-43a2-a5f2-8b37d06fce8d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:14.780155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c3d131-de47-43a2-a5f2-8b37d06fce8d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:14.789660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c3d131-de47-43a2-a5f2-8b37d06fce8d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:14.793704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c3d131-de47-43a2-a5f2-8b37d06fce8d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:14.794453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40c3d131-de47-43a2-a5f2-8b37d06fce8d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:14.809652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-993d2801-3d12-436a-ad69-86bd4b941ad9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:14.813152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-993d2801-3d12-436a-ad69-86bd4b941ad9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:14.856017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-993d2801-3d12-436a-ad69-86bd4b941ad9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:14.859180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-993d2801-3d12-436a-ad69-86bd4b941ad9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:14.863917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-993d2801-3d12-436a-ad69-86bd4b941ad9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:14.879824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-993d2801-3d12-436a-ad69-86bd4b941ad9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:14.882759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-993d2801-3d12-436a-ad69-86bd4b941ad9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:14.884318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-993d2801-3d12-436a-ad69-86bd4b941ad9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:15.382030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-40c3d131-de47-43a2-a5f2-8b37d06fce8d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:15.405964 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-40c3d131-de47-43a2-a5f2-8b37d06fce8d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 0.647927 Aug 27 05:17:15.407712 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2426/4846] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:14 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:15.463766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-993d2801-3d12-436a-ad69-86bd4b941ad9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:15.484528 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-993d2801-3d12-436a-ad69-86bd4b941ad9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 0.683157 Aug 27 05:17:15.485982 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2421/4847] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:14 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:16.438443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-85660d1f-a8f1-4578-8300-310467e6f64a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:16.439289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-85660d1f-a8f1-4578-8300-310467e6f64a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:16.454971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85660d1f-a8f1-4578-8300-310467e6f64a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:16.455863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85660d1f-a8f1-4578-8300-310467e6f64a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:16.459385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85660d1f-a8f1-4578-8300-310467e6f64a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:16.462719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85660d1f-a8f1-4578-8300-310467e6f64a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:16.464438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85660d1f-a8f1-4578-8300-310467e6f64a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:16.469770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85660d1f-a8f1-4578-8300-310467e6f64a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:16.514715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7224f5e-2aed-4b0e-991b-a054b1134bbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:16.516312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7224f5e-2aed-4b0e-991b-a054b1134bbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:16.525651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7224f5e-2aed-4b0e-991b-a054b1134bbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:16.526520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7224f5e-2aed-4b0e-991b-a054b1134bbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:16.527228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7224f5e-2aed-4b0e-991b-a054b1134bbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:16.528216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7224f5e-2aed-4b0e-991b-a054b1134bbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:16.531693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7224f5e-2aed-4b0e-991b-a054b1134bbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:16.532447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7224f5e-2aed-4b0e-991b-a054b1134bbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:17.110607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-85660d1f-a8f1-4578-8300-310467e6f64a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:17.117076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a7224f5e-2aed-4b0e-991b-a054b1134bbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:17.129380 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7224f5e-2aed-4b0e-991b-a054b1134bbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 0.619883 Aug 27 05:17:17.132028 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2422/4848] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:16 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:17.140649 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-85660d1f-a8f1-4578-8300-310467e6f64a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 0.703235 Aug 27 05:17:17.159187 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2427/4849] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:16 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:18.165203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa31eba4-600a-42c8-b1d6-ae17b97e516f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:18.165943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fa31eba4-600a-42c8-b1d6-ae17b97e516f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:18.173252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-31db66e3-f673-4663-a604-c153df0f3c29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:18.174624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-31db66e3-f673-4663-a604-c153df0f3c29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:18.179199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:18.188802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31db66e3-f673-4663-a604-c153df0f3c29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:18.189739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31db66e3-f673-4663-a604-c153df0f3c29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:18.190365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31db66e3-f673-4663-a604-c153df0f3c29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:18.190603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa31eba4-600a-42c8-b1d6-ae17b97e516f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:18.191120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa31eba4-600a-42c8-b1d6-ae17b97e516f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:18.191607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa31eba4-600a-42c8-b1d6-ae17b97e516f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:18.191929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31db66e3-f673-4663-a604-c153df0f3c29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:18.192334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa31eba4-600a-42c8-b1d6-ae17b97e516f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:18.192793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa31eba4-600a-42c8-b1d6-ae17b97e516f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:18.193020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31db66e3-f673-4663-a604-c153df0f3c29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:18.193219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa31eba4-600a-42c8-b1d6-ae17b97e516f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:18.194026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31db66e3-f673-4663-a604-c153df0f3c29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:18.610580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-31db66e3-f673-4663-a604-c153df0f3c29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:18.625238 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-31db66e3-f673-4663-a604-c153df0f3c29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 0.455818 Aug 27 05:17:18.636182 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2428/4850] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:18 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:18.641028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fa31eba4-600a-42c8-b1d6-ae17b97e516f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:18.653174 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa31eba4-600a-42c8-b1d6-ae17b97e516f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 0.497971 Aug 27 05:17:18.655488 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2423/4851] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:18 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:19.650686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-45b00e67-1d31-4aa9-83b4-e07c3678ec46 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:19.652954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-45b00e67-1d31-4aa9-83b4-e07c3678ec46 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:19.670968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b00e67-1d31-4aa9-83b4-e07c3678ec46 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:19.675807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b00e67-1d31-4aa9-83b4-e07c3678ec46 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:19.676769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b00e67-1d31-4aa9-83b4-e07c3678ec46 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:19.677977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b00e67-1d31-4aa9-83b4-e07c3678ec46 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:19.684355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b00e67-1d31-4aa9-83b4-e07c3678ec46 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:19.685258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b00e67-1d31-4aa9-83b4-e07c3678ec46 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:19.719922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c1e74d0f-2b01-4278-8567-4719a4a805bb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:19.722331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c1e74d0f-2b01-4278-8567-4719a4a805bb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:19.746670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e74d0f-2b01-4278-8567-4719a4a805bb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:19.748448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e74d0f-2b01-4278-8567-4719a4a805bb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:19.752667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e74d0f-2b01-4278-8567-4719a4a805bb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:19.760317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e74d0f-2b01-4278-8567-4719a4a805bb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:19.761196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e74d0f-2b01-4278-8567-4719a4a805bb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:19.765251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1e74d0f-2b01-4278-8567-4719a4a805bb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:20.815804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1e74d0f-2b01-4278-8567-4719a4a805bb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:20.834137 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c1e74d0f-2b01-4278-8567-4719a4a805bb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 1.143750 Aug 27 05:17:20.841513 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2424/4852] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:19 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:20.887527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45b00e67-1d31-4aa9-83b4-e07c3678ec46 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:20.916277 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-45b00e67-1d31-4aa9-83b4-e07c3678ec46 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 1.271089 Aug 27 05:17:20.917098 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2429/4853] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:19 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:21.880208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-90eca4de-0c7c-4715-b65e-68a9b7b8088e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:21.881596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-90eca4de-0c7c-4715-b65e-68a9b7b8088e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:21.892595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90eca4de-0c7c-4715-b65e-68a9b7b8088e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:21.893381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90eca4de-0c7c-4715-b65e-68a9b7b8088e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:21.894065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90eca4de-0c7c-4715-b65e-68a9b7b8088e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:21.894976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90eca4de-0c7c-4715-b65e-68a9b7b8088e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:21.895633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90eca4de-0c7c-4715-b65e-68a9b7b8088e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:21.896236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90eca4de-0c7c-4715-b65e-68a9b7b8088e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:21.939624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a141dc20-d9d1-4312-b633-a717b0394b91 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:21.941156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a141dc20-d9d1-4312-b633-a717b0394b91 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:21.972893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141dc20-d9d1-4312-b633-a717b0394b91 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:21.974112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141dc20-d9d1-4312-b633-a717b0394b91 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:21.974759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141dc20-d9d1-4312-b633-a717b0394b91 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:21.976075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141dc20-d9d1-4312-b633-a717b0394b91 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:21.976730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141dc20-d9d1-4312-b633-a717b0394b91 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:21.977338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141dc20-d9d1-4312-b633-a717b0394b91 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:23.025527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-90eca4de-0c7c-4715-b65e-68a9b7b8088e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:23.037091 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-90eca4de-0c7c-4715-b65e-68a9b7b8088e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 1.162899 Aug 27 05:17:23.045176 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2425/4854] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:21 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:23.068681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a141dc20-d9d1-4312-b633-a717b0394b91 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:23.088430 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a141dc20-d9d1-4312-b633-a717b0394b91 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 1.153472 Aug 27 05:17:23.090696 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2430/4855] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:21 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:24.072765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dff259e8-ae9d-4e1a-a7d7-d661bfe2494a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:24.074403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dff259e8-ae9d-4e1a-a7d7-d661bfe2494a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:24.094850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dff259e8-ae9d-4e1a-a7d7-d661bfe2494a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:24.098272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dff259e8-ae9d-4e1a-a7d7-d661bfe2494a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:24.100914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dff259e8-ae9d-4e1a-a7d7-d661bfe2494a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:24.107435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dff259e8-ae9d-4e1a-a7d7-d661bfe2494a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:24.110294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dff259e8-ae9d-4e1a-a7d7-d661bfe2494a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:24.111810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dff259e8-ae9d-4e1a-a7d7-d661bfe2494a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:24.124133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3532b390-134b-47e3-b7fa-c0aa0868f116 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:24.128640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3532b390-134b-47e3-b7fa-c0aa0868f116 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:24.164868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:24.176832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3532b390-134b-47e3-b7fa-c0aa0868f116 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:24.177675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3532b390-134b-47e3-b7fa-c0aa0868f116 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:24.187656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3532b390-134b-47e3-b7fa-c0aa0868f116 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:24.197029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3532b390-134b-47e3-b7fa-c0aa0868f116 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:24.198196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3532b390-134b-47e3-b7fa-c0aa0868f116 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:24.198644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3532b390-134b-47e3-b7fa-c0aa0868f116 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:24.915791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3532b390-134b-47e3-b7fa-c0aa0868f116 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:24.946436 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3532b390-134b-47e3-b7fa-c0aa0868f116 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 0.829214 Aug 27 05:17:24.960815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dff259e8-ae9d-4e1a-a7d7-d661bfe2494a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:24.968823 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2431/4856] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:24 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:24.980415 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dff259e8-ae9d-4e1a-a7d7-d661bfe2494a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 0.915774 Aug 27 05:17:24.995782 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2426/4857] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:24 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:26.002540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1b56db46-0f86-48d7-9cd7-3d3b05604993 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:26.003302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1b56db46-0f86-48d7-9cd7-3d3b05604993 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:26.020658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3674fb78-3433-4294-95a4-f330c089d200 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:26.022321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3674fb78-3433-4294-95a4-f330c089d200 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:26.042674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3674fb78-3433-4294-95a4-f330c089d200 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:26.043171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b56db46-0f86-48d7-9cd7-3d3b05604993 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:26.043920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b56db46-0f86-48d7-9cd7-3d3b05604993 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:26.044720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3674fb78-3433-4294-95a4-f330c089d200 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:26.045357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b56db46-0f86-48d7-9cd7-3d3b05604993 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:26.046434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b56db46-0f86-48d7-9cd7-3d3b05604993 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:26.047209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3674fb78-3433-4294-95a4-f330c089d200 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:26.051638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3674fb78-3433-4294-95a4-f330c089d200 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:26.052009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b56db46-0f86-48d7-9cd7-3d3b05604993 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:26.052669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b56db46-0f86-48d7-9cd7-3d3b05604993 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:26.053526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3674fb78-3433-4294-95a4-f330c089d200 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:26.055771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3674fb78-3433-4294-95a4-f330c089d200 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:27.472272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3674fb78-3433-4294-95a4-f330c089d200 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:27.486849 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3674fb78-3433-4294-95a4-f330c089d200 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 1.473018 Aug 27 05:17:27.487571 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2427/4858] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:26 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:27.598127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1b56db46-0f86-48d7-9cd7-3d3b05604993 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:27.607835 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1b56db46-0f86-48d7-9cd7-3d3b05604993 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 1.609203 Aug 27 05:17:27.625768 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2432/4859] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:25 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:27.927820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-800698370", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "5a983fb0-b409-4105-abbe-97ae7340146f"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:28.181625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] validate_networks() for [('5a983fb0-b409-4105-abbe-97ae7340146f', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:17:28.405249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6cf7d3d1-5fa9-4fe2-abb3-26d8569f5d73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:28.405916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6cf7d3d1-5fa9-4fe2-abb3-26d8569f5d73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:28.415395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cf7d3d1-5fa9-4fe2-abb3-26d8569f5d73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:28.416140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cf7d3d1-5fa9-4fe2-abb3-26d8569f5d73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:28.417592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cf7d3d1-5fa9-4fe2-abb3-26d8569f5d73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:28.418767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cf7d3d1-5fa9-4fe2-abb3-26d8569f5d73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:28.421182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cf7d3d1-5fa9-4fe2-abb3-26d8569f5d73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:28.421878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cf7d3d1-5fa9-4fe2-abb3-26d8569f5d73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:28.458888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6cf7d3d1-5fa9-4fe2-abb3-26d8569f5d73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:17:28.527493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:28.684774 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6cf7d3d1-5fa9-4fe2-abb3-26d8569f5d73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 204 len: 0 microversion: 2.1 time: 1.049790 Aug 27 05:17:28.691015 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2433/4860] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:17:27 2022] DELETE /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 0 bytes in 1063 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:17:28.706275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b702c52-1182-491c-9b3a-28374de7c407 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:28.707599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2b702c52-1182-491c-9b3a-28374de7c407 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:28.729476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b702c52-1182-491c-9b3a-28374de7c407 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:28.731021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b702c52-1182-491c-9b3a-28374de7c407 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:28.732713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b702c52-1182-491c-9b3a-28374de7c407 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:28.735600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b702c52-1182-491c-9b3a-28374de7c407 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:28.736504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b702c52-1182-491c-9b3a-28374de7c407 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:28.739611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b702c52-1182-491c-9b3a-28374de7c407 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:29.783935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2b702c52-1182-491c-9b3a-28374de7c407 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:29.815603 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2b702c52-1182-491c-9b3a-28374de7c407 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 1.122801 Aug 27 05:17:29.821559 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2434/4861] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:28 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:29.844185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aab0532a-1faa-46e3-b99c-443bc60e369b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:29.844855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aab0532a-1faa-46e3-b99c-443bc60e369b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:29.869498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0532a-1faa-46e3-b99c-443bc60e369b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:29.870952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0532a-1faa-46e3-b99c-443bc60e369b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:29.883282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0532a-1faa-46e3-b99c-443bc60e369b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:29.885187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0532a-1faa-46e3-b99c-443bc60e369b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:29.886519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0532a-1faa-46e3-b99c-443bc60e369b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:29.887639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0532a-1faa-46e3-b99c-443bc60e369b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:30.416890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:17:30.419492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:17:30.421240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:17:30.422305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:17:30.424399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:17:30.443479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:30.447218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:30.448178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:30.449365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:30.452140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:30.453097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:30.477066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Getting quotas for project 0dd1d46e7abc4cad9a21b47f1197f09b. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:17:30.484067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Getting quotas for user c5dda26fd9ae485094e76750883d9758 and project 0dd1d46e7abc4cad9a21b47f1197f09b. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:17:30.502047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:17:30.506048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:17:30.551053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aab0532a-1faa-46e3-b99c-443bc60e369b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:30.590262 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aab0532a-1faa-46e3-b99c-443bc60e369b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 0.752852 Aug 27 05:17:30.602206 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-39dedc43-a656-4a3a-ad75-a144f0b9bdce tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.112608 Aug 27 05:17:30.610686 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2435/4862] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:29 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:30.612883 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2428/4863] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:17:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:17:30.625018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-305ab572-7c96-4d86-acd7-f6560144b248 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:30.626698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-305ab572-7c96-4d86-acd7-f6560144b248 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:30.628398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-654b0292-89b9-4080-b1dc-bfbaa8f99c79 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:30.629042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-654b0292-89b9-4080-b1dc-bfbaa8f99c79 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:30.644177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-654b0292-89b9-4080-b1dc-bfbaa8f99c79 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:30.644681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-654b0292-89b9-4080-b1dc-bfbaa8f99c79 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:30.645126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-654b0292-89b9-4080-b1dc-bfbaa8f99c79 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:30.646921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-654b0292-89b9-4080-b1dc-bfbaa8f99c79 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:30.646921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-654b0292-89b9-4080-b1dc-bfbaa8f99c79 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:30.646921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-654b0292-89b9-4080-b1dc-bfbaa8f99c79 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:31.174619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-305ab572-7c96-4d86-acd7-f6560144b248 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:31.191536 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-305ab572-7c96-4d86-acd7-f6560144b248 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1215 microversion: 2.1 time: 0.572702 Aug 27 05:17:31.192143 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2429/4864] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:30 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1215 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:31.216339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-74d31880-638f-4515-b3c6-b1d5ebbd87aa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:31.217439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-74d31880-638f-4515-b3c6-b1d5ebbd87aa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:31.227619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74d31880-638f-4515-b3c6-b1d5ebbd87aa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:31.259406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74d31880-638f-4515-b3c6-b1d5ebbd87aa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:31.260371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74d31880-638f-4515-b3c6-b1d5ebbd87aa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:31.262079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74d31880-638f-4515-b3c6-b1d5ebbd87aa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:31.264512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74d31880-638f-4515-b3c6-b1d5ebbd87aa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:31.265171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74d31880-638f-4515-b3c6-b1d5ebbd87aa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:32.318277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-654b0292-89b9-4080-b1dc-bfbaa8f99c79 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:32.337941 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-654b0292-89b9-4080-b1dc-bfbaa8f99c79 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1732 microversion: 2.1 time: 1.722114 Aug 27 05:17:32.355398 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2436/4865] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:30 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1732 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:32.383490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-895a0eec-77be-44f6-9830-d4627336954c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:32.384581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-895a0eec-77be-44f6-9830-d4627336954c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:32.395057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-895a0eec-77be-44f6-9830-d4627336954c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:32.397235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-895a0eec-77be-44f6-9830-d4627336954c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:32.403241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-895a0eec-77be-44f6-9830-d4627336954c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:32.405843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-895a0eec-77be-44f6-9830-d4627336954c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:32.406429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-895a0eec-77be-44f6-9830-d4627336954c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:32.406767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-895a0eec-77be-44f6-9830-d4627336954c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:32.565963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-74d31880-638f-4515-b3c6-b1d5ebbd87aa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:32.586221 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-74d31880-638f-4515-b3c6-b1d5ebbd87aa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1681 microversion: 2.1 time: 1.374595 Aug 27 05:17:32.591160 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2430/4866] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:31 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1681 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:32.600448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-806c9ee1-6aba-48b1-a5d4-fb320b092ce6 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:32.603494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-806c9ee1-6aba-48b1-a5d4-fb320b092ce6 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:32.851675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-806c9ee1-6aba-48b1-a5d4-fb320b092ce6 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:32.861352 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-806c9ee1-6aba-48b1-a5d4-fb320b092ce6 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1215 microversion: 2.1 time: 0.268903 Aug 27 05:17:32.868890 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2431/4867] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:32 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1215 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:32.995945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-72013142-9679-4646-9020-89deaaeba451 req-1f10a104-37bc-4979-a821-5b29980337a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f179b67-f086-4d14-9088-e2fdf6f0c17d", "name": "network-vif-deleted", "tag": "f52edb24-891f-48e2-a92d-bc4fb7d64dc6"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:33.028377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-72013142-9679-4646-9020-89deaaeba451 req-1f10a104-37bc-4979-a821-5b29980337a5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:33.030197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-72013142-9679-4646-9020-89deaaeba451 req-1f10a104-37bc-4979-a821-5b29980337a5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:33.032199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-72013142-9679-4646-9020-89deaaeba451 req-1f10a104-37bc-4979-a821-5b29980337a5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:33.059701 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-72013142-9679-4646-9020-89deaaeba451 req-1f10a104-37bc-4979-a821-5b29980337a5 service nova] Creating event network-vif-deleted:f52edb24-891f-48e2-a92d-bc4fb7d64dc6 for instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d on n-h1-820368-35 Aug 27 05:17:33.073164 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-72013142-9679-4646-9020-89deaaeba451 req-1f10a104-37bc-4979-a821-5b29980337a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087584 Aug 27 05:17:33.087813 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2432/4868] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:17:33.287547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-895a0eec-77be-44f6-9830-d4627336954c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:33.326649 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-895a0eec-77be-44f6-9830-d4627336954c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 0.965020 Aug 27 05:17:33.331526 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2437/4869] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:32 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:33.381456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:33.388750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:33.414603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:33.421713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:33.422885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:33.427570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:33.429628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:33.433445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:33.600707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:33.603057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:33.604228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:33.607135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lazy-loading 'fault' on Instance uuid 6f179b67-f086-4d14-9088-e2fdf6f0c17d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:17:33.632837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13efcffe-4ce8-4887-9c27-7845e976c7a1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:33.640058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-13efcffe-4ce8-4887-9c27-7845e976c7a1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:33.662676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13efcffe-4ce8-4887-9c27-7845e976c7a1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:33.663819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13efcffe-4ce8-4887-9c27-7845e976c7a1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:33.664809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13efcffe-4ce8-4887-9c27-7845e976c7a1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:33.665897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13efcffe-4ce8-4887-9c27-7845e976c7a1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:33.666874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13efcffe-4ce8-4887-9c27-7845e976c7a1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:33.667783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13efcffe-4ce8-4887-9c27-7845e976c7a1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:33.739774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db172a8f7d4c4a17bd34911f31229502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d7d58fbe4248afb4d5d0a40dc11ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:33.754468 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-65f4a7aa-2c94-46d2-bc99-91ca13765ddd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 200 len: 1388 microversion: 2.1 time: 0.378749 Aug 27 05:17:33.757004 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2433/4870] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:33 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 1388 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:33.895310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5897c207-662a-41f3-8a17-4837c70fc2f5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:33.897999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5897c207-662a-41f3-8a17-4837c70fc2f5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:33.929314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5897c207-662a-41f3-8a17-4837c70fc2f5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:33.934903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5897c207-662a-41f3-8a17-4837c70fc2f5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:33.956640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5897c207-662a-41f3-8a17-4837c70fc2f5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:33.960550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5897c207-662a-41f3-8a17-4837c70fc2f5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:33.964404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5897c207-662a-41f3-8a17-4837c70fc2f5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:33.969681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5897c207-662a-41f3-8a17-4837c70fc2f5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:34.118462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13efcffe-4ce8-4887-9c27-7845e976c7a1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:34.145140 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-13efcffe-4ce8-4887-9c27-7845e976c7a1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.514534 Aug 27 05:17:34.149981 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2438/4871] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:33 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:34.251474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5897c207-662a-41f3-8a17-4837c70fc2f5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:34.262408 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5897c207-662a-41f3-8a17-4837c70fc2f5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1211 microversion: 2.1 time: 0.379971 Aug 27 05:17:34.282559 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2434/4872] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:33 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1211 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:34.378868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8869898-0644-466e-8155-ac7151a3cc3a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:34.380299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e8869898-0644-466e-8155-ac7151a3cc3a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:34.421946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8869898-0644-466e-8155-ac7151a3cc3a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:34.428999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8869898-0644-466e-8155-ac7151a3cc3a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:34.434559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8869898-0644-466e-8155-ac7151a3cc3a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:34.435861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8869898-0644-466e-8155-ac7151a3cc3a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:34.436942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8869898-0644-466e-8155-ac7151a3cc3a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:34.439768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8869898-0644-466e-8155-ac7151a3cc3a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:34.784083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:34.789095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:34.816218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:34.819030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:34.819736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:34.820676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:34.821338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:34.821947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:34.846451 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] HTTP exception thrown: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Request method failure captured: Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d HTTP/1.1 Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCada8JoY-54x2ksiBU7K3EJDeHC_3cFlssCWUk19qhwj7AW_ZbPX57CRLjunUV3YC_WxdXQ80Bngq04D9dJzKaXj082y1YaM44qs0gHk_4LoPiDa6e3_i7Bl6nUk146tNFM2V2hWHODBMqUD1JKZr7LBwNqnO46xVHW8FDjPGh9FwEQ Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 59d7d58fbe4248afb4d5d0a40dc11ee5 Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestServerBasicOps-1988204493 Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59d7d58fbe4248afb4d5d0a40dc11ee5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59d7d58fbe4248afb4d5d0a40dc11ee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59d7d58fbe4248afb4d5d0a40dc11ee5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59d7d58fbe4248afb4d5d0a40dc11ee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestServerBasicOps-1988204493 Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 59d7d58fbe4248afb4d5d0a40dc11ee5 Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestServerBasicOps-1988204493 Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestServerBasicOps-1988204493-project Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: db172a8f7d4c4a17bd34911f31229502 Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestServerBasicOps-1988204493-project Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '6f179b67-f086-4d14-9088-e2fdf6f0c17d'} Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:17:34.848453 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:34.854175 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:34.854175 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:17:34.854175 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:17:34.854175 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:17:34.854175 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:17:34.854175 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:34.854175 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:34.859573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Returning 404 to user: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:17:34.860827 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5ba44624-5a6f-4303-add9-a06fe0fa8f2c tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 404 len: 111 microversion: 2.1 time: 0.085233 Aug 27 05:17:34.861887 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2435/4873] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:34 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:17:34.949875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e8869898-0644-466e-8155-ac7151a3cc3a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:34.995598 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e8869898-0644-466e-8155-ac7151a3cc3a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 0.629142 Aug 27 05:17:34.996577 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2439/4874] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:34 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:35.295216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2ab28931-1532-46a2-bb93-198ea16177d0 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:35.298427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2ab28931-1532-46a2-bb93-198ea16177d0 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:35.347261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ab28931-1532-46a2-bb93-198ea16177d0 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:35.372901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ab28931-1532-46a2-bb93-198ea16177d0 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:35.374076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ab28931-1532-46a2-bb93-198ea16177d0 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:35.375981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ab28931-1532-46a2-bb93-198ea16177d0 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:35.384509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ab28931-1532-46a2-bb93-198ea16177d0 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:35.398133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ab28931-1532-46a2-bb93-198ea16177d0 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:35.706530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2ab28931-1532-46a2-bb93-198ea16177d0 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:35.723532 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2ab28931-1532-46a2-bb93-198ea16177d0 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1285 microversion: 2.1 time: 0.435801 Aug 27 05:17:35.724657 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2436/4875] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:35 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1285 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:36.045795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ff65d563-ae64-4f8a-9816-ae83a2b3e0f4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:36.046498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ff65d563-ae64-4f8a-9816-ae83a2b3e0f4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:36.079285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff65d563-ae64-4f8a-9816-ae83a2b3e0f4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:36.085073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff65d563-ae64-4f8a-9816-ae83a2b3e0f4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:36.087655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff65d563-ae64-4f8a-9816-ae83a2b3e0f4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:36.092645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff65d563-ae64-4f8a-9816-ae83a2b3e0f4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:36.094901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff65d563-ae64-4f8a-9816-ae83a2b3e0f4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:36.098306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff65d563-ae64-4f8a-9816-ae83a2b3e0f4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:36.484980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d9db778-88f0-4513-9099-78bef1afc84a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:36.488841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d9db778-88f0-4513-9099-78bef1afc84a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:36.538738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9db778-88f0-4513-9099-78bef1afc84a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:36.546927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9db778-88f0-4513-9099-78bef1afc84a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:36.547817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9db778-88f0-4513-9099-78bef1afc84a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:36.552065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9db778-88f0-4513-9099-78bef1afc84a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:36.553304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9db778-88f0-4513-9099-78bef1afc84a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:36.554324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d9db778-88f0-4513-9099-78bef1afc84a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:37.438891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ff65d563-ae64-4f8a-9816-ae83a2b3e0f4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:37.457707 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ff65d563-ae64-4f8a-9816-ae83a2b3e0f4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 1.409355 Aug 27 05:17:37.462411 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2440/4876] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:36 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:37.488485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-44daed81-0623-4f7f-a449-66ab03209336 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:37.489648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-44daed81-0623-4f7f-a449-66ab03209336 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:37.504157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44daed81-0623-4f7f-a449-66ab03209336 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:37.511177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44daed81-0623-4f7f-a449-66ab03209336 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:37.511974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44daed81-0623-4f7f-a449-66ab03209336 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:37.513964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44daed81-0623-4f7f-a449-66ab03209336 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:37.514871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44daed81-0623-4f7f-a449-66ab03209336 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:37.515569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44daed81-0623-4f7f-a449-66ab03209336 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:37.775561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d9db778-88f0-4513-9099-78bef1afc84a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:37.816015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-44daed81-0623-4f7f-a449-66ab03209336 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:37.818576 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d9db778-88f0-4513-9099-78bef1afc84a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 1.339694 Aug 27 05:17:37.824581 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2437/4877] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:36 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:37.839545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:37.840664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:37.854561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:37.855312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:37.857464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:37.860352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:37.870135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:37.871299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:37.887583 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-44daed81-0623-4f7f-a449-66ab03209336 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1273 microversion: 2.1 time: 0.417311 Aug 27 05:17:37.888399 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2441/4878] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:37 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1273 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:37.898228 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] HTTP exception thrown: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Request method failure captured: Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d HTTP/1.1 Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCada8JoY-54x2ksiBU7K3EJDeHC_3cFlssCWUk19qhwj7AW_ZbPX57CRLjunUV3YC_WxdXQ80Bngq04D9dJzKaXj082y1YaM44qs0gHk_4LoPiDa6e3_i7Bl6nUk146tNFM2V2hWHODBMqUD1JKZr7LBwNqnO46xVHW8FDjPGh9FwEQ Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 59d7d58fbe4248afb4d5d0a40dc11ee5 Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestServerBasicOps-1988204493 Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59d7d58fbe4248afb4d5d0a40dc11ee5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59d7d58fbe4248afb4d5d0a40dc11ee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59d7d58fbe4248afb4d5d0a40dc11ee5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59d7d58fbe4248afb4d5d0a40dc11ee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestServerBasicOps-1988204493 Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 59d7d58fbe4248afb4d5d0a40dc11ee5 Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestServerBasicOps-1988204493 Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestServerBasicOps-1988204493-project Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: db172a8f7d4c4a17bd34911f31229502 Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestServerBasicOps-1988204493-project Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '6f179b67-f086-4d14-9088-e2fdf6f0c17d'} Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:17:37.900214 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:17:37.905089 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:37.905089 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:37.905089 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:17:37.905089 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:37.905089 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:37.905089 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:17:37.905089 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:17:37.905089 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:17:37.905089 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:17:37.905089 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:37.905089 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:37.907363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Returning 404 to user: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:17:37.908488 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-57f605a2-a9a8-4401-8856-c39438b917bd tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 404 len: 111 microversion: 2.1 time: 0.082877 Aug 27 05:17:37.909587 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2438/4879] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:17:37 2022] DELETE /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:17:37.918442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:37.920037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] [instance: 6f179b67-f086-4d14-9088-e2fdf6f0c17d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:37.929713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:37.930454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:37.931556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:37.932589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:37.933599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:37.934644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:37.980373 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] HTTP exception thrown: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Request method failure captured: Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d HTTP/1.1 Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCada8JoY-54x2ksiBU7K3EJDeHC_3cFlssCWUk19qhwj7AW_ZbPX57CRLjunUV3YC_WxdXQ80Bngq04D9dJzKaXj082y1YaM44qs0gHk_4LoPiDa6e3_i7Bl6nUk146tNFM2V2hWHODBMqUD1JKZr7LBwNqnO46xVHW8FDjPGh9FwEQ Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 59d7d58fbe4248afb4d5d0a40dc11ee5 Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestServerBasicOps-1988204493 Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59d7d58fbe4248afb4d5d0a40dc11ee5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59d7d58fbe4248afb4d5d0a40dc11ee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59d7d58fbe4248afb4d5d0a40dc11ee5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59d7d58fbe4248afb4d5d0a40dc11ee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestServerBasicOps-1988204493 Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 59d7d58fbe4248afb4d5d0a40dc11ee5 Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestServerBasicOps-1988204493 Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestServerBasicOps-1988204493-project Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: db172a8f7d4c4a17bd34911f31229502 Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestServerBasicOps-1988204493-project Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '6f179b67-f086-4d14-9088-e2fdf6f0c17d'} Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:17:37.984948 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:17:37.991469 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:37.991469 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:17:37.991469 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:17:37.991469 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:17:37.991469 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:17:37.991469 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. Aug 27 05:17:37.991469 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:17:37.995275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Returning 404 to user: Instance 6f179b67-f086-4d14-9088-e2fdf6f0c17d could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:17:37.996619 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3d76b628-c05d-4ca0-82c0-cc2274dad9a9 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d" status: 404 len: 111 microversion: 2.1 time: 0.082816 Aug 27 05:17:38.001617 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2442/4880] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:37 2022] GET /compute/v2.1/servers/6f179b67-f086-4d14-9088-e2fdf6f0c17d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:17:38.218275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1684a2cf-e375-459f-b71c-efaf132032b5 req-a7faa828-ec0a-4338-8311-3520f77f5732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f4c359-6f7e-4009-a365-7b070eec11a9", "name": "network-vif-unplugged", "status": "completed", "tag": "2a4e09b9-01c8-433a-8d9e-e93f9888b163"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:38.237382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1684a2cf-e375-459f-b71c-efaf132032b5 req-a7faa828-ec0a-4338-8311-3520f77f5732 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:38.238420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1684a2cf-e375-459f-b71c-efaf132032b5 req-a7faa828-ec0a-4338-8311-3520f77f5732 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:38.239244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1684a2cf-e375-459f-b71c-efaf132032b5 req-a7faa828-ec0a-4338-8311-3520f77f5732 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:38.493868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-620e9cbe-8dca-4446-9650-45385caa6174 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:38.494897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-620e9cbe-8dca-4446-9650-45385caa6174 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:38.537773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-620e9cbe-8dca-4446-9650-45385caa6174 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:38.538474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-620e9cbe-8dca-4446-9650-45385caa6174 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:38.539292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-620e9cbe-8dca-4446-9650-45385caa6174 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:38.546098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-620e9cbe-8dca-4446-9650-45385caa6174 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:38.549381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-620e9cbe-8dca-4446-9650-45385caa6174 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:38.552510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-620e9cbe-8dca-4446-9650-45385caa6174 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:39.172993 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1684a2cf-e375-459f-b71c-efaf132032b5 req-a7faa828-ec0a-4338-8311-3520f77f5732 service nova] Creating event network-vif-unplugged:2a4e09b9-01c8-433a-8d9e-e93f9888b163 for instance e5f4c359-6f7e-4009-a365-7b070eec11a9 on n-h2-820368-35 Aug 27 05:17:39.198229 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1684a2cf-e375-459f-b71c-efaf132032b5 req-a7faa828-ec0a-4338-8311-3520f77f5732 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.983728 Aug 27 05:17:39.201716 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2439/4881] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:39.212090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c7a12f45-186c-4654-97ca-f7a1c8b19c73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] Calling method '.version_select at 0x7fb56405aca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:39.255885 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c7a12f45-186c-4654-97ca-f7a1c8b19c73 tempest-TestServerBasicOps-1988204493 tempest-TestServerBasicOps-1988204493-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1849100245" status: 202 len: 0 microversion: 2.1 time: 0.051635 Aug 27 05:17:39.256905 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2440/4882] 10.222.0.58 () {58 vars in 1254 bytes} [Sat Aug 27 05:17:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1849100245 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:17:39.276589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7853bd2-08c0-49a0-b0b0-4e8fbc5d0493 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:39.299451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7853bd2-08c0-49a0-b0b0-4e8fbc5d0493 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:39.322533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7853bd2-08c0-49a0-b0b0-4e8fbc5d0493 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:39.329779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7853bd2-08c0-49a0-b0b0-4e8fbc5d0493 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:39.333247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7853bd2-08c0-49a0-b0b0-4e8fbc5d0493 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:39.336798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7853bd2-08c0-49a0-b0b0-4e8fbc5d0493 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:39.348563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7853bd2-08c0-49a0-b0b0-4e8fbc5d0493 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:39.359306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7853bd2-08c0-49a0-b0b0-4e8fbc5d0493 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:39.449387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:39.643621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-620e9cbe-8dca-4446-9650-45385caa6174 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:39.671193 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-620e9cbe-8dca-4446-9650-45385caa6174 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1515 microversion: 2.1 time: 1.187629 Aug 27 05:17:39.697578 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2443/4883] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:38 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1515 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:39.834797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a7853bd2-08c0-49a0-b0b0-4e8fbc5d0493 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:39.846884 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7853bd2-08c0-49a0-b0b0-4e8fbc5d0493 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1315 microversion: 2.1 time: 0.587844 Aug 27 05:17:39.848304 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2441/4884] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:39 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:40.726322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-58ceebad-5edd-4b37-bd89-8de7b9bf1669 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:40.728011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-58ceebad-5edd-4b37-bd89-8de7b9bf1669 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:40.736834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58ceebad-5edd-4b37-bd89-8de7b9bf1669 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:40.738161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58ceebad-5edd-4b37-bd89-8de7b9bf1669 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:40.738827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58ceebad-5edd-4b37-bd89-8de7b9bf1669 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:40.740100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58ceebad-5edd-4b37-bd89-8de7b9bf1669 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:40.740784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58ceebad-5edd-4b37-bd89-8de7b9bf1669 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:40.742829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58ceebad-5edd-4b37-bd89-8de7b9bf1669 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:40.872215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e644659-911c-4580-b7db-903cdd8f1375 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:40.872996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1e644659-911c-4580-b7db-903cdd8f1375 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:40.878197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:40.885339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e644659-911c-4580-b7db-903cdd8f1375 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:40.890519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e644659-911c-4580-b7db-903cdd8f1375 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:40.891869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e644659-911c-4580-b7db-903cdd8f1375 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:40.894754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e644659-911c-4580-b7db-903cdd8f1375 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:40.895654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e644659-911c-4580-b7db-903cdd8f1375 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:40.897087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e644659-911c-4580-b7db-903cdd8f1375 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:41.594077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-58ceebad-5edd-4b37-bd89-8de7b9bf1669 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:41.612933 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-58ceebad-5edd-4b37-bd89-8de7b9bf1669 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1521 microversion: 2.1 time: 0.902915 Aug 27 05:17:41.629626 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2444/4885] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:40 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1521 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:41.654741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c11f0858-c62e-45a8-9309-72b6ce6fbf93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:41.656604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c11f0858-c62e-45a8-9309-72b6ce6fbf93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:41.666698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1e644659-911c-4580-b7db-903cdd8f1375 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:41.676843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c11f0858-c62e-45a8-9309-72b6ce6fbf93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:41.677418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c11f0858-c62e-45a8-9309-72b6ce6fbf93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:41.677864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c11f0858-c62e-45a8-9309-72b6ce6fbf93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:41.678587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c11f0858-c62e-45a8-9309-72b6ce6fbf93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:41.679045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c11f0858-c62e-45a8-9309-72b6ce6fbf93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:41.679503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c11f0858-c62e-45a8-9309-72b6ce6fbf93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:41.682698 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e644659-911c-4580-b7db-903cdd8f1375 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1315 microversion: 2.1 time: 0.817057 Aug 27 05:17:41.700405 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2442/4886] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:40 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1315 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:41.921363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-bfa2ab5a-1f31-4232-beed-46c05a42317f req-7e96cf9e-c5e4-46f9-ad51-712b3bc1762b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4b7d845-61be-4eb2-8b0e-4dbd22280a9e", "tag": "223dc391-3c56-4447-bc18-64b08a368db2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:41.936623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bfa2ab5a-1f31-4232-beed-46c05a42317f req-7e96cf9e-c5e4-46f9-ad51-712b3bc1762b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:41.937305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bfa2ab5a-1f31-4232-beed-46c05a42317f req-7e96cf9e-c5e4-46f9-ad51-712b3bc1762b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:41.937826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bfa2ab5a-1f31-4232-beed-46c05a42317f req-7e96cf9e-c5e4-46f9-ad51-712b3bc1762b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:41.967726 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-bfa2ab5a-1f31-4232-beed-46c05a42317f req-7e96cf9e-c5e4-46f9-ad51-712b3bc1762b service nova] Creating event network-changed:223dc391-3c56-4447-bc18-64b08a368db2 for instance e4b7d845-61be-4eb2-8b0e-4dbd22280a9e on n-h1-820368-35 Aug 27 05:17:41.977742 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-bfa2ab5a-1f31-4232-beed-46c05a42317f req-7e96cf9e-c5e4-46f9-ad51-712b3bc1762b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070052 Aug 27 05:17:41.979034 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2443/4887] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:42.064740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c11f0858-c62e-45a8-9309-72b6ce6fbf93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:42.075734 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c11f0858-c62e-45a8-9309-72b6ce6fbf93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.443950 Aug 27 05:17:42.077381 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2445/4888] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:41 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:42.099634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-70207811-9c79-410c-b8c3-0115a1b073cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:42.100758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-70207811-9c79-410c-b8c3-0115a1b073cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:42.111541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70207811-9c79-410c-b8c3-0115a1b073cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:42.112130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70207811-9c79-410c-b8c3-0115a1b073cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:42.113201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70207811-9c79-410c-b8c3-0115a1b073cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:42.114897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70207811-9c79-410c-b8c3-0115a1b073cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:42.115893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70207811-9c79-410c-b8c3-0115a1b073cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:42.116579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70207811-9c79-410c-b8c3-0115a1b073cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:42.481088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-70207811-9c79-410c-b8c3-0115a1b073cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:42.493689 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-70207811-9c79-410c-b8c3-0115a1b073cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.398688 Aug 27 05:17:42.494543 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2444/4889] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:42 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:42.519415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5161f3e7-372c-47b6-9538-8c115acd26ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:42.520876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5161f3e7-372c-47b6-9538-8c115acd26ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:42.531732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5161f3e7-372c-47b6-9538-8c115acd26ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:42.532473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5161f3e7-372c-47b6-9538-8c115acd26ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:42.533080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5161f3e7-372c-47b6-9538-8c115acd26ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:42.534206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5161f3e7-372c-47b6-9538-8c115acd26ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:42.535363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5161f3e7-372c-47b6-9538-8c115acd26ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:42.535982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5161f3e7-372c-47b6-9538-8c115acd26ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:42.660672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-350e4acc-b8b4-46ac-80fb-11f4cdf83a5d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:42.662047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-350e4acc-b8b4-46ac-80fb-11f4cdf83a5d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:42.682714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-350e4acc-b8b4-46ac-80fb-11f4cdf83a5d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:42.686307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-350e4acc-b8b4-46ac-80fb-11f4cdf83a5d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:42.687853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-350e4acc-b8b4-46ac-80fb-11f4cdf83a5d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:42.688844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-350e4acc-b8b4-46ac-80fb-11f4cdf83a5d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:42.691658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-350e4acc-b8b4-46ac-80fb-11f4cdf83a5d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:42.692213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-350e4acc-b8b4-46ac-80fb-11f4cdf83a5d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:42.858151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=10 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:42.895986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5161f3e7-372c-47b6-9538-8c115acd26ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:42.909432 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5161f3e7-372c-47b6-9538-8c115acd26ca tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.396763 Aug 27 05:17:42.910605 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2446/4890] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:42 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:42.936543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5033cab9-9818-4193-abcd-c5c3a6ced79e tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:42.937386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5033cab9-9818-4193-abcd-c5c3a6ced79e tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:42.953226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5033cab9-9818-4193-abcd-c5c3a6ced79e tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:42.954154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5033cab9-9818-4193-abcd-c5c3a6ced79e tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:42.955112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5033cab9-9818-4193-abcd-c5c3a6ced79e tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:42.956321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5033cab9-9818-4193-abcd-c5c3a6ced79e tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:42.957044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5033cab9-9818-4193-abcd-c5c3a6ced79e tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:42.957686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5033cab9-9818-4193-abcd-c5c3a6ced79e tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:43.116629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-350e4acc-b8b4-46ac-80fb-11f4cdf83a5d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:43.184689 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-350e4acc-b8b4-46ac-80fb-11f4cdf83a5d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1521 microversion: 2.1 time: 0.531075 Aug 27 05:17:43.186134 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2445/4891] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:42 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1521 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:43.204789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d2b55a80-6341-4ef2-9515-0338fbb6550e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:43.210569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d2b55a80-6341-4ef2-9515-0338fbb6550e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:43.222654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2b55a80-6341-4ef2-9515-0338fbb6550e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:43.223849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2b55a80-6341-4ef2-9515-0338fbb6550e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:43.224918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2b55a80-6341-4ef2-9515-0338fbb6550e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:43.227169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2b55a80-6341-4ef2-9515-0338fbb6550e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:43.228259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2b55a80-6341-4ef2-9515-0338fbb6550e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:43.229485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2b55a80-6341-4ef2-9515-0338fbb6550e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:43.290582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5033cab9-9818-4193-abcd-c5c3a6ced79e tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:43.312035 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5033cab9-9818-4193-abcd-c5c3a6ced79e tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1315 microversion: 2.1 time: 0.393880 Aug 27 05:17:43.316784 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2447/4892] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:42 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:43.364073 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d2b55a80-6341-4ef2-9515-0338fbb6550e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.167684 Aug 27 05:17:43.364691 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2446/4893] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:17:43 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:17:43.373650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9726f003-e314-433f-bc2d-b8dec03d21cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:43.374793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9726f003-e314-433f-bc2d-b8dec03d21cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:43.388387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9726f003-e314-433f-bc2d-b8dec03d21cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:43.393776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9726f003-e314-433f-bc2d-b8dec03d21cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:43.394865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9726f003-e314-433f-bc2d-b8dec03d21cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:43.396107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9726f003-e314-433f-bc2d-b8dec03d21cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:43.396852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9726f003-e314-433f-bc2d-b8dec03d21cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:43.397535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9726f003-e314-433f-bc2d-b8dec03d21cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:43.633053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9726f003-e314-433f-bc2d-b8dec03d21cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:43.653526 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9726f003-e314-433f-bc2d-b8dec03d21cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1670 microversion: 2.1 time: 0.284111 Aug 27 05:17:43.656760 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2448/4894] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:43 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1670 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:44.119163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7e2bbee2-bb7e-488c-b932-6f0a6d22fb6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:44.127492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7e2bbee2-bb7e-488c-b932-6f0a6d22fb6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:44.145028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e2bbee2-bb7e-488c-b932-6f0a6d22fb6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:44.146088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e2bbee2-bb7e-488c-b932-6f0a6d22fb6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:44.147013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e2bbee2-bb7e-488c-b932-6f0a6d22fb6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:44.148477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e2bbee2-bb7e-488c-b932-6f0a6d22fb6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:44.149491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e2bbee2-bb7e-488c-b932-6f0a6d22fb6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:44.150459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e2bbee2-bb7e-488c-b932-6f0a6d22fb6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:44.225183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-22b1b1d9-1919-4d10-918b-9d62240aa6ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:44.226675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-22b1b1d9-1919-4d10-918b-9d62240aa6ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:44.234564 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7e2bbee2-bb7e-488c-b932-6f0a6d22fb6e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.123006 Aug 27 05:17:44.235497 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2447/4895] 10.222.0.58 () {60 vars in 1343 bytes} [Sat Aug 27 05:17:44 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:44.297234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22b1b1d9-1919-4d10-918b-9d62240aa6ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:44.297985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22b1b1d9-1919-4d10-918b-9d62240aa6ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:44.300475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22b1b1d9-1919-4d10-918b-9d62240aa6ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:44.302324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22b1b1d9-1919-4d10-918b-9d62240aa6ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:44.303054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22b1b1d9-1919-4d10-918b-9d62240aa6ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:44.303758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22b1b1d9-1919-4d10-918b-9d62240aa6ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:44.340336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-194bdf3b-636a-4a0d-aa7f-e2f99a6f5ca8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:44.342788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-194bdf3b-636a-4a0d-aa7f-e2f99a6f5ca8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:44.369169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-194bdf3b-636a-4a0d-aa7f-e2f99a6f5ca8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:44.370025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-194bdf3b-636a-4a0d-aa7f-e2f99a6f5ca8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:44.370730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-194bdf3b-636a-4a0d-aa7f-e2f99a6f5ca8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:44.376703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-194bdf3b-636a-4a0d-aa7f-e2f99a6f5ca8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:44.378786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-194bdf3b-636a-4a0d-aa7f-e2f99a6f5ca8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:44.379795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-194bdf3b-636a-4a0d-aa7f-e2f99a6f5ca8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:44.804113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-22b1b1d9-1919-4d10-918b-9d62240aa6ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:44.806470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:44.821160 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-22b1b1d9-1919-4d10-918b-9d62240aa6ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1521 microversion: 2.1 time: 0.605031 Aug 27 05:17:44.823203 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2449/4896] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:44 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:44.842851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-194bdf3b-636a-4a0d-aa7f-e2f99a6f5ca8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:44.849804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6c32323-0c8a-458a-9134-32bafbbcb4c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:44.853246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6c32323-0c8a-458a-9134-32bafbbcb4c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:44.865029 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-194bdf3b-636a-4a0d-aa7f-e2f99a6f5ca8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1315 microversion: 2.1 time: 0.530211 Aug 27 05:17:44.867583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6c32323-0c8a-458a-9134-32bafbbcb4c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:44.869178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6c32323-0c8a-458a-9134-32bafbbcb4c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:44.869685 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2448/4897] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:44 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:44.873192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6c32323-0c8a-458a-9134-32bafbbcb4c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:44.874294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6c32323-0c8a-458a-9134-32bafbbcb4c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:44.875511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6c32323-0c8a-458a-9134-32bafbbcb4c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:44.877053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6c32323-0c8a-458a-9134-32bafbbcb4c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:44.880876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-89f187cc-3bb6-4354-bb5d-24428becfabd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:44.885918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-89f187cc-3bb6-4354-bb5d-24428becfabd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:44.904835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89f187cc-3bb6-4354-bb5d-24428becfabd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:44.906132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89f187cc-3bb6-4354-bb5d-24428becfabd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:44.907034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89f187cc-3bb6-4354-bb5d-24428becfabd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:44.908200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89f187cc-3bb6-4354-bb5d-24428becfabd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:44.908904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89f187cc-3bb6-4354-bb5d-24428becfabd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:44.909685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89f187cc-3bb6-4354-bb5d-24428becfabd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:44.942438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6c32323-0c8a-458a-9134-32bafbbcb4c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:17:45.082125 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6c32323-0c8a-458a-9134-32bafbbcb4c2 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 204 len: 0 microversion: 2.20 time: 0.256298 Aug 27 05:17:45.086628 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2450/4898] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:17:44 2022] DELETE /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:17:45.095643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:45.109217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:45.119756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:45.121012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:45.122439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:45.124886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:45.125901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:45.126906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:45.233665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-89f187cc-3bb6-4354-bb5d-24428becfabd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:45.245612 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-89f187cc-3bb6-4354-bb5d-24428becfabd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1670 microversion: 2.1 time: 0.372353 Aug 27 05:17:45.246915 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2449/4899] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:44 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1670 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:45.548293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:45.571058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:45.600425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:45.602208 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c2018805-b5a0-4e29-8ede-cb4394429e5f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1722 microversion: 2.20 time: 0.513246 Aug 27 05:17:45.605252 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2451/4900] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:45 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1722 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:45.852077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-30d7193d-e522-4451-9a5f-52ade26e9736 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:45.852715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-30d7193d-e522-4451-9a5f-52ade26e9736 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:45.860877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30d7193d-e522-4451-9a5f-52ade26e9736 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:45.861375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30d7193d-e522-4451-9a5f-52ade26e9736 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:45.861929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30d7193d-e522-4451-9a5f-52ade26e9736 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:45.863855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30d7193d-e522-4451-9a5f-52ade26e9736 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:45.864346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30d7193d-e522-4451-9a5f-52ade26e9736 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:45.867293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30d7193d-e522-4451-9a5f-52ade26e9736 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:45.902102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0b9693b1-e662-42d8-a1cf-1fcef13e5503 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:45.904422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0b9693b1-e662-42d8-a1cf-1fcef13e5503 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:45.926370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b9693b1-e662-42d8-a1cf-1fcef13e5503 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:45.928744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b9693b1-e662-42d8-a1cf-1fcef13e5503 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:45.930539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b9693b1-e662-42d8-a1cf-1fcef13e5503 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:45.933107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b9693b1-e662-42d8-a1cf-1fcef13e5503 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:45.936252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b9693b1-e662-42d8-a1cf-1fcef13e5503 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:45.939414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b9693b1-e662-42d8-a1cf-1fcef13e5503 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:46.424173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-30d7193d-e522-4451-9a5f-52ade26e9736 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:46.437943 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-30d7193d-e522-4451-9a5f-52ade26e9736 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1521 microversion: 2.1 time: 0.593835 Aug 27 05:17:46.438543 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2450/4901] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:45 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:46.692827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0b9693b1-e662-42d8-a1cf-1fcef13e5503 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:46.704720 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0b9693b1-e662-42d8-a1cf-1fcef13e5503 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1315 microversion: 2.1 time: 0.808765 Aug 27 05:17:46.705887 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2452/4902] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:45 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:46.712070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-99bd30a2-7a65-4411-8b08-5aa442bb2c4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:46.721365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-99bd30a2-7a65-4411-8b08-5aa442bb2c4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:46.758169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99bd30a2-7a65-4411-8b08-5aa442bb2c4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:46.761972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99bd30a2-7a65-4411-8b08-5aa442bb2c4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:46.764064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99bd30a2-7a65-4411-8b08-5aa442bb2c4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:46.765986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99bd30a2-7a65-4411-8b08-5aa442bb2c4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:46.766972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99bd30a2-7a65-4411-8b08-5aa442bb2c4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:46.769417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99bd30a2-7a65-4411-8b08-5aa442bb2c4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:46.863072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-64dfd764-96dd-42a2-99b8-e457c3be092a req-22246768-2078-4465-85ac-3ce73b8a1e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9219a13-89e0-41e4-ad6c-3f3b17da15b9", "name": "network-vif-unplugged", "status": "completed", "tag": "293ddc90-e975-483a-bf8c-cdab8f0c658a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:46.897359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-64dfd764-96dd-42a2-99b8-e457c3be092a req-22246768-2078-4465-85ac-3ce73b8a1e87 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:46.898135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-64dfd764-96dd-42a2-99b8-e457c3be092a req-22246768-2078-4465-85ac-3ce73b8a1e87 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:46.900849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-64dfd764-96dd-42a2-99b8-e457c3be092a req-22246768-2078-4465-85ac-3ce73b8a1e87 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:46.944488 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-64dfd764-96dd-42a2-99b8-e457c3be092a req-22246768-2078-4465-85ac-3ce73b8a1e87 service nova] Creating event network-vif-unplugged:293ddc90-e975-483a-bf8c-cdab8f0c658a for instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 on n-h2-820368-35 Aug 27 05:17:46.954873 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-64dfd764-96dd-42a2-99b8-e457c3be092a req-22246768-2078-4465-85ac-3ce73b8a1e87 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.511202 Aug 27 05:17:46.956098 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2451/4903] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:46.963034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:46.964211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:46.975897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:46.976832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:46.978212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:46.987762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:47.008177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:47.010566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:47.365933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:47.369915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-99bd30a2-7a65-4411-8b08-5aa442bb2c4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:47.384159 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-99bd30a2-7a65-4411-8b08-5aa442bb2c4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1675 microversion: 2.1 time: 0.671283 Aug 27 05:17:47.385402 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2453/4904] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:46 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1675 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:47.393293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:47.395711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:47.403780 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a399501e-46dd-4928-a007-f0437eae3c1f tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1722 microversion: 2.20 time: 0.445109 Aug 27 05:17:47.411539 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2452/4905] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:46 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:47.465278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a0b80182-ef0e-496d-9e83-c8aad679a9fb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:47.466784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a0b80182-ef0e-496d-9e83-c8aad679a9fb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:47.481871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b80182-ef0e-496d-9e83-c8aad679a9fb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:47.483541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b80182-ef0e-496d-9e83-c8aad679a9fb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:47.484009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b80182-ef0e-496d-9e83-c8aad679a9fb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:47.484839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b80182-ef0e-496d-9e83-c8aad679a9fb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:47.485192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b80182-ef0e-496d-9e83-c8aad679a9fb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:47.485616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0b80182-ef0e-496d-9e83-c8aad679a9fb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:47.692976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a0b80182-ef0e-496d-9e83-c8aad679a9fb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:47.706093 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a0b80182-ef0e-496d-9e83-c8aad679a9fb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1521 microversion: 2.1 time: 0.245115 Aug 27 05:17:47.707599 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2454/4906] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:47 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:47.734771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a79addcf-62df-4e88-afbe-7d3cb5809049 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:47.736292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a79addcf-62df-4e88-afbe-7d3cb5809049 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:47.745275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a79addcf-62df-4e88-afbe-7d3cb5809049 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:47.746345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a79addcf-62df-4e88-afbe-7d3cb5809049 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:47.747134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a79addcf-62df-4e88-afbe-7d3cb5809049 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:47.748177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a79addcf-62df-4e88-afbe-7d3cb5809049 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:47.748863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a79addcf-62df-4e88-afbe-7d3cb5809049 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:47.749550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a79addcf-62df-4e88-afbe-7d3cb5809049 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:47.954965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a79addcf-62df-4e88-afbe-7d3cb5809049 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:47.969724 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a79addcf-62df-4e88-afbe-7d3cb5809049 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1315 microversion: 2.1 time: 0.238799 Aug 27 05:17:47.971222 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2453/4907] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:47 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:48.410596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0877b6d4-f6b1-4204-a3e1-3ba7866aa510 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:48.411488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0877b6d4-f6b1-4204-a3e1-3ba7866aa510 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:48.423657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0877b6d4-f6b1-4204-a3e1-3ba7866aa510 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:48.424481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0877b6d4-f6b1-4204-a3e1-3ba7866aa510 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:48.424935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0877b6d4-f6b1-4204-a3e1-3ba7866aa510 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:48.425848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0877b6d4-f6b1-4204-a3e1-3ba7866aa510 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:48.426236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0877b6d4-f6b1-4204-a3e1-3ba7866aa510 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:48.426863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0877b6d4-f6b1-4204-a3e1-3ba7866aa510 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:48.435316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:48.436304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:48.439243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:48.461372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:48.461875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:48.462387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:48.463024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:48.463507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:48.464087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:49.128708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:49.129639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0877b6d4-f6b1-4204-a3e1-3ba7866aa510 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:49.140401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:49.141861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:49.143449 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-895dfd85-9176-4601-a7a4-ff41b6b5c23a tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1722 microversion: 2.20 time: 0.712302 Aug 27 05:17:49.144210 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2454/4908] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:48 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1722 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:49.149158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-574023fc-118d-49b6-8394-aa830fa1a305 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:49.150197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-574023fc-118d-49b6-8394-aa830fa1a305 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:49.154204 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0877b6d4-f6b1-4204-a3e1-3ba7866aa510 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.746590 Aug 27 05:17:49.156484 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2455/4909] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:48 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:49.157857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574023fc-118d-49b6-8394-aa830fa1a305 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:49.158519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574023fc-118d-49b6-8394-aa830fa1a305 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:49.159201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574023fc-118d-49b6-8394-aa830fa1a305 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:49.160079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574023fc-118d-49b6-8394-aa830fa1a305 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:49.160869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574023fc-118d-49b6-8394-aa830fa1a305 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:49.161620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574023fc-118d-49b6-8394-aa830fa1a305 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:49.211040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3bc171c8-741d-4103-a932-ab9de42d8c3f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:49.219643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3bc171c8-741d-4103-a932-ab9de42d8c3f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:49.240272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc171c8-741d-4103-a932-ab9de42d8c3f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:49.241489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc171c8-741d-4103-a932-ab9de42d8c3f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:49.244599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc171c8-741d-4103-a932-ab9de42d8c3f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:49.249886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc171c8-741d-4103-a932-ab9de42d8c3f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:49.250302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc171c8-741d-4103-a932-ab9de42d8c3f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:49.254943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc171c8-741d-4103-a932-ab9de42d8c3f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:49.394536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-574023fc-118d-49b6-8394-aa830fa1a305 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:49.417336 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-574023fc-118d-49b6-8394-aa830fa1a305 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1521 microversion: 2.1 time: 0.270395 Aug 27 05:17:49.419557 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2455/4910] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:49 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:49.445900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1dc68139-454f-4a51-8427-df5349489a2c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:49.465032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1dc68139-454f-4a51-8427-df5349489a2c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:49.474515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68139-454f-4a51-8427-df5349489a2c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:49.475360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68139-454f-4a51-8427-df5349489a2c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:49.476918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68139-454f-4a51-8427-df5349489a2c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:49.480385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68139-454f-4a51-8427-df5349489a2c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:49.481646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68139-454f-4a51-8427-df5349489a2c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:49.489289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1dc68139-454f-4a51-8427-df5349489a2c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:49.565344 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1dc68139-454f-4a51-8427-df5349489a2c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 200 len: 323 microversion: 2.1 time: 0.139884 Aug 27 05:17:49.572321 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2456/4911] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:17:49 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 323 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:49.580956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e676f15b-cbbb-4979-893b-84d6efd4b9ba tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:49.581988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e676f15b-cbbb-4979-893b-84d6efd4b9ba tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:49.600725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e676f15b-cbbb-4979-893b-84d6efd4b9ba tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:49.601586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e676f15b-cbbb-4979-893b-84d6efd4b9ba tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:49.602157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e676f15b-cbbb-4979-893b-84d6efd4b9ba tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:49.602895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e676f15b-cbbb-4979-893b-84d6efd4b9ba tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:49.608561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e676f15b-cbbb-4979-893b-84d6efd4b9ba tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:49.609429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e676f15b-cbbb-4979-893b-84d6efd4b9ba tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:49.711026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3bc171c8-741d-4103-a932-ab9de42d8c3f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:49.740173 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3bc171c8-741d-4103-a932-ab9de42d8c3f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1315 microversion: 2.1 time: 0.581705 Aug 27 05:17:49.742630 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2456/4912] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:49 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:49.936665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e676f15b-cbbb-4979-893b-84d6efd4b9ba tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:49.948389 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e676f15b-cbbb-4979-893b-84d6efd4b9ba tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.371868 Aug 27 05:17:49.949271 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2457/4913] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:49 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:49.982384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-68008d6a-5cee-40ba-a96e-cf06fbb333f8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:49.983687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68008d6a-5cee-40ba-a96e-cf06fbb333f8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:50.000918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68008d6a-5cee-40ba-a96e-cf06fbb333f8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:50.002073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68008d6a-5cee-40ba-a96e-cf06fbb333f8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:50.003164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68008d6a-5cee-40ba-a96e-cf06fbb333f8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:50.004613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68008d6a-5cee-40ba-a96e-cf06fbb333f8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:50.005658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68008d6a-5cee-40ba-a96e-cf06fbb333f8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:50.006351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68008d6a-5cee-40ba-a96e-cf06fbb333f8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:50.199766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:50.201504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:50.232001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:50.234074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:50.236174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:50.237613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:50.239664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:50.241204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:50.294285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-68008d6a-5cee-40ba-a96e-cf06fbb333f8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:50.308759 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-68008d6a-5cee-40ba-a96e-cf06fbb333f8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.329259 Aug 27 05:17:50.324947 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2457/4914] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:49 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:50.339137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-132d9ce4-269b-498d-b79d-a4dc2ee2122d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:50.343696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-132d9ce4-269b-498d-b79d-a4dc2ee2122d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:50.365795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-132d9ce4-269b-498d-b79d-a4dc2ee2122d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:50.367074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-132d9ce4-269b-498d-b79d-a4dc2ee2122d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:50.367561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-132d9ce4-269b-498d-b79d-a4dc2ee2122d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:50.368308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-132d9ce4-269b-498d-b79d-a4dc2ee2122d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:50.368885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-132d9ce4-269b-498d-b79d-a4dc2ee2122d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:50.373126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-132d9ce4-269b-498d-b79d-a4dc2ee2122d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:50.644454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:50.649104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:50.662626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:50.664280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:50.672996 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d2a9fbf-925e-4098-a179-3b5d18cefdc4 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1654 microversion: 2.20 time: 0.503194 Aug 27 05:17:50.673607 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2458/4915] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:50 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1654 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:50.692665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-56b738b8-d634-40b9-96f6-05b2ae28a22c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:50.696640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-56b738b8-d634-40b9-96f6-05b2ae28a22c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:50.714890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56b738b8-d634-40b9-96f6-05b2ae28a22c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:50.716050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56b738b8-d634-40b9-96f6-05b2ae28a22c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:50.716719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56b738b8-d634-40b9-96f6-05b2ae28a22c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:50.719013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56b738b8-d634-40b9-96f6-05b2ae28a22c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:50.722319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56b738b8-d634-40b9-96f6-05b2ae28a22c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:50.725085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56b738b8-d634-40b9-96f6-05b2ae28a22c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:50.828348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-132d9ce4-269b-498d-b79d-a4dc2ee2122d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:50.842003 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-132d9ce4-269b-498d-b79d-a4dc2ee2122d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.508954 Aug 27 05:17:50.845402 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2458/4916] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:50 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:50.863246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1a432760-4be5-47ae-adfc-18fa8aa66c4f req-d0cdaebe-95e8-4ebc-a74e-90ac9d47475b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9219a13-89e0-41e4-ad6c-3f3b17da15b9", "name": "network-vif-plugged", "status": "completed", "tag": "293ddc90-e975-483a-bf8c-cdab8f0c658a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:50.892987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1a432760-4be5-47ae-adfc-18fa8aa66c4f req-d0cdaebe-95e8-4ebc-a74e-90ac9d47475b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:50.896091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1a432760-4be5-47ae-adfc-18fa8aa66c4f req-d0cdaebe-95e8-4ebc-a74e-90ac9d47475b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:50.897237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1a432760-4be5-47ae-adfc-18fa8aa66c4f req-d0cdaebe-95e8-4ebc-a74e-90ac9d47475b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:50.921255 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1a432760-4be5-47ae-adfc-18fa8aa66c4f req-d0cdaebe-95e8-4ebc-a74e-90ac9d47475b service nova] Creating event network-vif-plugged:293ddc90-e975-483a-bf8c-cdab8f0c658a for instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 on n-h2-820368-35 Aug 27 05:17:50.929245 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1a432760-4be5-47ae-adfc-18fa8aa66c4f req-d0cdaebe-95e8-4ebc-a74e-90ac9d47475b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081972 Aug 27 05:17:50.930522 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2459/4917] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:50.948166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e309a696-5dfc-4187-8d8e-f04e6ac0e995 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:50.950331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e309a696-5dfc-4187-8d8e-f04e6ac0e995 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:50.971890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e309a696-5dfc-4187-8d8e-f04e6ac0e995 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:50.975036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e309a696-5dfc-4187-8d8e-f04e6ac0e995 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:50.975780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e309a696-5dfc-4187-8d8e-f04e6ac0e995 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:50.990332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e309a696-5dfc-4187-8d8e-f04e6ac0e995 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:50.990873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e309a696-5dfc-4187-8d8e-f04e6ac0e995 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:50.992758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e309a696-5dfc-4187-8d8e-f04e6ac0e995 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:51.332668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-56b738b8-d634-40b9-96f6-05b2ae28a22c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:51.343673 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-56b738b8-d634-40b9-96f6-05b2ae28a22c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1521 microversion: 2.1 time: 0.665020 Aug 27 05:17:51.350308 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2459/4918] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:50 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:51.370952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c865e6be-ea89-42ad-ba86-b8f6e239822c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:51.371773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c865e6be-ea89-42ad-ba86-b8f6e239822c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:51.384917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c865e6be-ea89-42ad-ba86-b8f6e239822c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:51.385571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c865e6be-ea89-42ad-ba86-b8f6e239822c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:51.386097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c865e6be-ea89-42ad-ba86-b8f6e239822c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:51.386905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c865e6be-ea89-42ad-ba86-b8f6e239822c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:51.387538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c865e6be-ea89-42ad-ba86-b8f6e239822c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:51.388069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c865e6be-ea89-42ad-ba86-b8f6e239822c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:51.629165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e309a696-5dfc-4187-8d8e-f04e6ac0e995 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:51.647370 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e309a696-5dfc-4187-8d8e-f04e6ac0e995 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1315 microversion: 2.1 time: 0.715056 Aug 27 05:17:51.648146 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2460/4919] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:50 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:51.866587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c865e6be-ea89-42ad-ba86-b8f6e239822c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:51.879667 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c865e6be-ea89-42ad-ba86-b8f6e239822c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.525128 Aug 27 05:17:51.892555 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2460/4920] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:51 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:51.919839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-0b6c3e9a-2126-4731-a43e-e28f7b58c9ce req-234945ab-85c0-4a5e-96d8-bb7e15ac2c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08a333d-504a-41ad-a796-2069aecd4bd9", "name": "network-vif-deleted", "tag": "6e183864-02b7-4485-8c8f-1050892f3cb4"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:51.924226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:51.925407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:51.939725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0b6c3e9a-2126-4731-a43e-e28f7b58c9ce req-234945ab-85c0-4a5e-96d8-bb7e15ac2c96 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:51.941653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:51.942601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0b6c3e9a-2126-4731-a43e-e28f7b58c9ce req-234945ab-85c0-4a5e-96d8-bb7e15ac2c96 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:51.943332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:51.943973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:51.944604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0b6c3e9a-2126-4731-a43e-e28f7b58c9ce req-234945ab-85c0-4a5e-96d8-bb7e15ac2c96 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:51.945555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:51.949501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:51.950342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:51.974915 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-0b6c3e9a-2126-4731-a43e-e28f7b58c9ce req-234945ab-85c0-4a5e-96d8-bb7e15ac2c96 service nova] Creating event network-vif-deleted:6e183864-02b7-4485-8c8f-1050892f3cb4 for instance e08a333d-504a-41ad-a796-2069aecd4bd9 on n-h2-820368-35 Aug 27 05:17:51.987916 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-0b6c3e9a-2126-4731-a43e-e28f7b58c9ce req-234945ab-85c0-4a5e-96d8-bb7e15ac2c96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.336644 Aug 27 05:17:51.990278 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2461/4921] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:52.017910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:52.018767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:52.020091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:52.020832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lazy-loading 'fault' on Instance uuid e08a333d-504a-41ad-a796-2069aecd4bd9 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:17:52.096826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-375584079", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "dc52ef93-257f-431d-a3c4-4629a0c53bfc"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:52.113889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:52.124087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:52.154302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14ad24b744324d3e856a64b4c4979e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba630546e34472498c6e180a3ec2849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:52.160660 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3b8c3eb6-8cd8-46e2-a234-306b7d7d3457 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 200 len: 1370 microversion: 2.20 time: 0.261849 Aug 27 05:17:52.161931 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2461/4922] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:51 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:52.197240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] validate_networks() for [('dc52ef93-257f-431d-a3c4-4629a0c53bfc', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:17:52.376953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f65fc3ab-b6c2-4e38-b150-afacb83d8795 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:52.377603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f65fc3ab-b6c2-4e38-b150-afacb83d8795 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:52.395801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f65fc3ab-b6c2-4e38-b150-afacb83d8795 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:52.398402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f65fc3ab-b6c2-4e38-b150-afacb83d8795 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:52.399999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f65fc3ab-b6c2-4e38-b150-afacb83d8795 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:52.405145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f65fc3ab-b6c2-4e38-b150-afacb83d8795 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:52.406371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f65fc3ab-b6c2-4e38-b150-afacb83d8795 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:52.409891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f65fc3ab-b6c2-4e38-b150-afacb83d8795 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:53.303740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f65fc3ab-b6c2-4e38-b150-afacb83d8795 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:53.317835 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f65fc3ab-b6c2-4e38-b150-afacb83d8795 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1521 microversion: 2.1 time: 0.949367 Aug 27 05:17:53.322986 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2462/4923] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:52 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1521 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:17:53.352255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1148c22-e355-4e5f-88d3-94ed2890cdd3 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:53.354359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1148c22-e355-4e5f-88d3-94ed2890cdd3 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:53.369212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1148c22-e355-4e5f-88d3-94ed2890cdd3 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:53.370680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1148c22-e355-4e5f-88d3-94ed2890cdd3 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:53.373110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1148c22-e355-4e5f-88d3-94ed2890cdd3 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:53.374368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1148c22-e355-4e5f-88d3-94ed2890cdd3 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:53.377728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1148c22-e355-4e5f-88d3-94ed2890cdd3 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:53.379211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1148c22-e355-4e5f-88d3-94ed2890cdd3 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:53.786049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:17:53.796523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:17:53.797512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:17:53.799862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:17:53.800312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:17:53.810859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1148c22-e355-4e5f-88d3-94ed2890cdd3 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:53.826658 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1148c22-e355-4e5f-88d3-94ed2890cdd3 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1315 microversion: 2.1 time: 0.493918 Aug 27 05:17:53.828304 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2463/4924] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:53 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:53.828807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:53.831737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:53.833289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:53.834664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:53.835394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:53.836032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:53.836397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b5638602-aea0-44dd-8d9a-0518108e7cba req-be6be217-5072-4d55-afcd-e8246c421fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b7d845-61be-4eb2-8b0e-4dbd22280a9e", "name": "network-vif-plugged", "status": "completed", "tag": "223dc391-3c56-4447-bc18-64b08a368db2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:53.851981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b5638602-aea0-44dd-8d9a-0518108e7cba req-be6be217-5072-4d55-afcd-e8246c421fdd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:53.852903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b5638602-aea0-44dd-8d9a-0518108e7cba req-be6be217-5072-4d55-afcd-e8246c421fdd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:53.853596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b5638602-aea0-44dd-8d9a-0518108e7cba req-be6be217-5072-4d55-afcd-e8246c421fdd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:53.875901 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b5638602-aea0-44dd-8d9a-0518108e7cba req-be6be217-5072-4d55-afcd-e8246c421fdd service nova] Creating event network-vif-plugged:223dc391-3c56-4447-bc18-64b08a368db2 for instance e4b7d845-61be-4eb2-8b0e-4dbd22280a9e on n-h1-820368-35 Aug 27 05:17:53.882907 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b5638602-aea0-44dd-8d9a-0518108e7cba req-be6be217-5072-4d55-afcd-e8246c421fdd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052322 Aug 27 05:17:53.884241 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2464/4925] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:53.930514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:17:53.950974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for user dffafef392eb4e1fba13953f47b2d105 and project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:17:53.999825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:17:54.022171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:17:54.194596 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cda6b25c-d584-44d5-95b6-f00f6179909e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.104857 Aug 27 05:17:54.204684 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2462/4926] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:17:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:17:54.218166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1e4ff899-9930-49a5-8535-37998c98c754 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:54.218920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1e4ff899-9930-49a5-8535-37998c98c754 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:54.221118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:54.458792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1e4ff899-9930-49a5-8535-37998c98c754 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:54.486345 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1e4ff899-9930-49a5-8535-37998c98c754 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1214 microversion: 2.1 time: 0.279768 Aug 27 05:17:54.503607 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2463/4927] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:54 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1214 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:54.533170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e6959e4-4d19-42fb-bdb2-ca1b3ba613f0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:54.536292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e6959e4-4d19-42fb-bdb2-ca1b3ba613f0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:54.567882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e6959e4-4d19-42fb-bdb2-ca1b3ba613f0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:54.571120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e6959e4-4d19-42fb-bdb2-ca1b3ba613f0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:54.572339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e6959e4-4d19-42fb-bdb2-ca1b3ba613f0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:54.580454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e6959e4-4d19-42fb-bdb2-ca1b3ba613f0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:54.582249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e6959e4-4d19-42fb-bdb2-ca1b3ba613f0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:54.582948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e6959e4-4d19-42fb-bdb2-ca1b3ba613f0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:54.721583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:54.722741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:54.766448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:54.768549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:54.769601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:54.771352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:54.772428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:54.773363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:54.845420 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] HTTP exception thrown: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Request method failure captured: Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 HTTP/1.1 Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaZ9-FtmAk7CY1rYRFdtfey_9ZqVkOQebMp2rvOdv_ug4cOHxXVsFqO3XFHj76pE0qg7oAMNwotycwqxl3QYVs4AwIkneMP6l2SLwu3tidnzbgHgLI2JZIZnQbM876-3oWEfBRtKgfW3DxWssvfiH40pMATCqubkwx75lT72sP5NDt4 Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cba630546e34472498c6e180a3ec2849", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cba630546e34472498c6e180a3ec2849"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 14ad24b744324d3e856a64b4c4979e8a Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e08a333d-504a-41ad-a796-2069aecd4bd9'} Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:54.849283 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:17:54.859331 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:54.859331 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:54.859331 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:17:54.859331 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:17:54.859331 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:17:54.859331 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:17:54.859331 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:17:54.859331 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:17:54.865668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Returning 404 to user: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:17:54.867660 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6e58599a-2fdb-4fc1-94d5-e30df27eb3c0 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 404 len: 111 microversion: 2.20 time: 0.981735 Aug 27 05:17:54.869255 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2465/4928] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:53 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 111 bytes in 984 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:17:54.878827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8fd4a3fe-d63e-49d2-b712-c7e8353f3c66 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:54.880208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8fd4a3fe-d63e-49d2-b712-c7e8353f3c66 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:54.891891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd4a3fe-d63e-49d2-b712-c7e8353f3c66 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:54.893429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd4a3fe-d63e-49d2-b712-c7e8353f3c66 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:54.894471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd4a3fe-d63e-49d2-b712-c7e8353f3c66 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:54.896332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd4a3fe-d63e-49d2-b712-c7e8353f3c66 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:54.897620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd4a3fe-d63e-49d2-b712-c7e8353f3c66 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:54.898642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd4a3fe-d63e-49d2-b712-c7e8353f3c66 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:55.781473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e6959e4-4d19-42fb-bdb2-ca1b3ba613f0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:55.833598 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e6959e4-4d19-42fb-bdb2-ca1b3ba613f0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1506 microversion: 2.1 time: 1.327970 Aug 27 05:17:55.851118 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2464/4929] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:54 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1506 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:55.863014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-838c7880-7237-4b31-bb9d-39967438e2ed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '.version_select at 0x7fb5642f7dc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:55.934370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8fd4a3fe-d63e-49d2-b712-c7e8353f3c66 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:55.935243 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-838c7880-7237-4b31-bb9d-39967438e2ed tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409568921" status: 204 len: 0 microversion: 2.20 time: 0.092335 Aug 27 05:17:55.935745 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2465/4930] 10.222.0.58 () {60 vars in 1259 bytes} [Sat Aug 27 05:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409568921 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:17:55.957014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd80f9f3-6137-433d-9dd5-38e5a620b567 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:55.958622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dd80f9f3-6137-433d-9dd5-38e5a620b567 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:55.975548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd80f9f3-6137-433d-9dd5-38e5a620b567 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:55.976877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd80f9f3-6137-433d-9dd5-38e5a620b567 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:55.977957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd80f9f3-6137-433d-9dd5-38e5a620b567 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:55.979533 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8fd4a3fe-d63e-49d2-b712-c7e8353f3c66 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1315 microversion: 2.1 time: 1.108145 Aug 27 05:17:55.980272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd80f9f3-6137-433d-9dd5-38e5a620b567 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:55.981371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd80f9f3-6137-433d-9dd5-38e5a620b567 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:55.982535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd80f9f3-6137-433d-9dd5-38e5a620b567 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:55.984668 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2466/4931] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:54 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1315 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:56.012813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-94f3c3a6-b309-4fa2-b051-aa1ea39f3c28 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:56.015806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-94f3c3a6-b309-4fa2-b051-aa1ea39f3c28 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:56.055437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f3c3a6-b309-4fa2-b051-aa1ea39f3c28 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:56.056651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f3c3a6-b309-4fa2-b051-aa1ea39f3c28 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:56.059079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f3c3a6-b309-4fa2-b051-aa1ea39f3c28 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:56.062375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f3c3a6-b309-4fa2-b051-aa1ea39f3c28 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:56.067051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f3c3a6-b309-4fa2-b051-aa1ea39f3c28 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:56.068271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f3c3a6-b309-4fa2-b051-aa1ea39f3c28 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:56.976408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dd80f9f3-6137-433d-9dd5-38e5a620b567 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:56.990621 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd80f9f3-6137-433d-9dd5-38e5a620b567 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1218 microversion: 2.1 time: 1.046936 Aug 27 05:17:57.010560 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2466/4932] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:55 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1218 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:57.019679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-87b9948e-5207-44fe-b272-f5ae98a605ee tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:57.022290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-87b9948e-5207-44fe-b272-f5ae98a605ee tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:57.034040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87b9948e-5207-44fe-b272-f5ae98a605ee tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:57.047377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87b9948e-5207-44fe-b272-f5ae98a605ee tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:57.049480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87b9948e-5207-44fe-b272-f5ae98a605ee tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:57.052170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87b9948e-5207-44fe-b272-f5ae98a605ee tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:57.054458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87b9948e-5207-44fe-b272-f5ae98a605ee tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:57.057087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87b9948e-5207-44fe-b272-f5ae98a605ee tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:57.444472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-94f3c3a6-b309-4fa2-b051-aa1ea39f3c28 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:57.481808 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-94f3c3a6-b309-4fa2-b051-aa1ea39f3c28 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 200 len: 1506 microversion: 2.1 time: 1.494694 Aug 27 05:17:57.482645 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2467/4933] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:55 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 1506 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:57.548553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e33287fc-b0d3-4625-9417-7bad6079cd6d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:57.549559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e33287fc-b0d3-4625-9417-7bad6079cd6d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:57.596803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e33287fc-b0d3-4625-9417-7bad6079cd6d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:57.598156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e33287fc-b0d3-4625-9417-7bad6079cd6d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:57.599585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e33287fc-b0d3-4625-9417-7bad6079cd6d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:57.600380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e33287fc-b0d3-4625-9417-7bad6079cd6d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:57.600869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e33287fc-b0d3-4625-9417-7bad6079cd6d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:57.601335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e33287fc-b0d3-4625-9417-7bad6079cd6d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:57.725725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e33287fc-b0d3-4625-9417-7bad6079cd6d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:17:58.067046 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e33287fc-b0d3-4625-9417-7bad6079cd6d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 204 len: 0 microversion: 2.1 time: 0.528113 Aug 27 05:17:58.069150 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2468/4934] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:17:57 2022] DELETE /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:17:58.095913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-28376115-3fe9-43ce-9506-ea4165223ab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:58.096639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-28376115-3fe9-43ce-9506-ea4165223ab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:58.109636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28376115-3fe9-43ce-9506-ea4165223ab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:58.110518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28376115-3fe9-43ce-9506-ea4165223ab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:58.114356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28376115-3fe9-43ce-9506-ea4165223ab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:58.115213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28376115-3fe9-43ce-9506-ea4165223ab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:58.115714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28376115-3fe9-43ce-9506-ea4165223ab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:58.116177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28376115-3fe9-43ce-9506-ea4165223ab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:58.258700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-87b9948e-5207-44fe-b272-f5ae98a605ee tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:58.298664 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-87b9948e-5207-44fe-b272-f5ae98a605ee tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1503 microversion: 2.1 time: 1.286107 Aug 27 05:17:58.300138 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2467/4935] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:57 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1503 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:58.344012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6a1a2b2a-69d7-4005-9e0a-b3675a6dbea5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:58.344566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6a1a2b2a-69d7-4005-9e0a-b3675a6dbea5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:58.370240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a1a2b2a-69d7-4005-9e0a-b3675a6dbea5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:58.370789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a1a2b2a-69d7-4005-9e0a-b3675a6dbea5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:58.371349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a1a2b2a-69d7-4005-9e0a-b3675a6dbea5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:58.372815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a1a2b2a-69d7-4005-9e0a-b3675a6dbea5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:58.373449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a1a2b2a-69d7-4005-9e0a-b3675a6dbea5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:58.373904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a1a2b2a-69d7-4005-9e0a-b3675a6dbea5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:58.444925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:58.557254 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6a1a2b2a-69d7-4005-9e0a-b3675a6dbea5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.219150 Aug 27 05:17:58.559787 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2468/4936] 10.222.0.58 () {58 vars in 1296 bytes} [Sat Aug 27 05:17:58 2022] DELETE /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e/os-server-password => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:17:58.571665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1160434908", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "2aeab05f-61ed-48ec-a332-5b3d621869b3"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:17:58.693241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] validate_networks() for [('2aeab05f-61ed-48ec-a332-5b3d621869b3', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:17:58.801522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-28376115-3fe9-43ce-9506-ea4165223ab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:58.823370 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-28376115-3fe9-43ce-9506-ea4165223ab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1272 microversion: 2.1 time: 0.751953 Aug 27 05:17:58.835381 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2469/4937] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:58 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1272 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:17:58.856991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8cfdd379-8f1e-47d7-a540-c2c9103755d4 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:58.856991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8cfdd379-8f1e-47d7-a540-c2c9103755d4 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:58.881234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cfdd379-8f1e-47d7-a540-c2c9103755d4 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:58.881832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cfdd379-8f1e-47d7-a540-c2c9103755d4 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:58.882293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cfdd379-8f1e-47d7-a540-c2c9103755d4 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:58.883107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cfdd379-8f1e-47d7-a540-c2c9103755d4 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:58.883652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cfdd379-8f1e-47d7-a540-c2c9103755d4 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:58.884381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cfdd379-8f1e-47d7-a540-c2c9103755d4 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:58.951850 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8cfdd379-8f1e-47d7-a540-c2c9103755d4 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.114594 Aug 27 05:17:58.953625 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2470/4938] 10.222.0.58 () {58 vars in 1293 bytes} [Sat Aug 27 05:17:58 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e/os-server-password => generated 16 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:17:58.974308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-da9987fe-ffc8-4cfa-8d6b-fce9c94c14f7 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:58.975590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-da9987fe-ffc8-4cfa-8d6b-fce9c94c14f7 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:58.986859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da9987fe-ffc8-4cfa-8d6b-fce9c94c14f7 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:58.988463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da9987fe-ffc8-4cfa-8d6b-fce9c94c14f7 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:58.989250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da9987fe-ffc8-4cfa-8d6b-fce9c94c14f7 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:58.990363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da9987fe-ffc8-4cfa-8d6b-fce9c94c14f7 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:58.991283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da9987fe-ffc8-4cfa-8d6b-fce9c94c14f7 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:58.991935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da9987fe-ffc8-4cfa-8d6b-fce9c94c14f7 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:59.071650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-da9987fe-ffc8-4cfa-8d6b-fce9c94c14f7 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:17:59.212519 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-da9987fe-ffc8-4cfa-8d6b-fce9c94c14f7 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 204 len: 0 microversion: 2.1 time: 0.248852 Aug 27 05:17:59.213913 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2471/4939] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:17:58 2022] DELETE /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:17:59.225120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3fb2929f-bc5e-49c5-8592-2e771b9b297a tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:59.226611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3fb2929f-bc5e-49c5-8592-2e771b9b297a tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:59.237656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb2929f-bc5e-49c5-8592-2e771b9b297a tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:59.238605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb2929f-bc5e-49c5-8592-2e771b9b297a tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:59.239225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb2929f-bc5e-49c5-8592-2e771b9b297a tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:59.240573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb2929f-bc5e-49c5-8592-2e771b9b297a tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:59.242968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb2929f-bc5e-49c5-8592-2e771b9b297a tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:59.243699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb2929f-bc5e-49c5-8592-2e771b9b297a tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:00.110663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3fb2929f-bc5e-49c5-8592-2e771b9b297a tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:00.119807 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3fb2929f-bc5e-49c5-8592-2e771b9b297a tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1509 microversion: 2.1 time: 0.900878 Aug 27 05:18:00.120410 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2472/4940] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:17:59 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1509 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:00.147433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e19b015-020e-44da-8da3-26a95b6dd744 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:00.153940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e19b015-020e-44da-8da3-26a95b6dd744 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:00.176996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e19b015-020e-44da-8da3-26a95b6dd744 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:00.177799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e19b015-020e-44da-8da3-26a95b6dd744 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:00.178455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e19b015-020e-44da-8da3-26a95b6dd744 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:00.179435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e19b015-020e-44da-8da3-26a95b6dd744 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:00.180084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e19b015-020e-44da-8da3-26a95b6dd744 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:00.180692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e19b015-020e-44da-8da3-26a95b6dd744 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:00.216486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:00.464835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e19b015-020e-44da-8da3-26a95b6dd744 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:00.484319 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e19b015-020e-44da-8da3-26a95b6dd744 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1272 microversion: 2.1 time: 0.343567 Aug 27 05:18:00.485228 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2473/4941] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:00 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:01.029122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:18:01.030183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:18:01.031161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:18:01.031936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:18:01.032694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:18:01.052672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5ec647c4-2e1f-44d5-8021-118fce4dfe8d req-80ec8254-c309-47f3-a078-9fab4b79cbae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9219a13-89e0-41e4-ad6c-3f3b17da15b9", "name": "network-vif-deleted", "tag": "293ddc90-e975-483a-bf8c-cdab8f0c658a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:01.093076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5ec647c4-2e1f-44d5-8021-118fce4dfe8d req-80ec8254-c309-47f3-a078-9fab4b79cbae service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:01.093525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5ec647c4-2e1f-44d5-8021-118fce4dfe8d req-80ec8254-c309-47f3-a078-9fab4b79cbae service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:01.100882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5ec647c4-2e1f-44d5-8021-118fce4dfe8d req-80ec8254-c309-47f3-a078-9fab4b79cbae service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:01.122173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:01.122687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:01.134308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:01.146474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:01.151667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:01.158530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:01.183392 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5ec647c4-2e1f-44d5-8021-118fce4dfe8d req-80ec8254-c309-47f3-a078-9fab4b79cbae service nova] Creating event network-vif-deleted:293ddc90-e975-483a-bf8c-cdab8f0c658a for instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 on n-h2-820368-35 Aug 27 05:18:01.237387 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5ec647c4-2e1f-44d5-8021-118fce4dfe8d req-80ec8254-c309-47f3-a078-9fab4b79cbae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189780 Aug 27 05:18:01.247301 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2474/4942] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:01.274314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bee59789-7aad-4455-8215-b1d8626cd010 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:01.276255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bee59789-7aad-4455-8215-b1d8626cd010 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:01.289355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Getting quotas for project 39c2ef4112e84253b7924d7759080b9f. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:18:01.307338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Getting quotas for user a5ad6957c00747888364ff932074db8b and project 39c2ef4112e84253b7924d7759080b9f. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:18:01.309618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bee59789-7aad-4455-8215-b1d8626cd010 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:01.316622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bee59789-7aad-4455-8215-b1d8626cd010 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:01.318035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bee59789-7aad-4455-8215-b1d8626cd010 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:01.322622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bee59789-7aad-4455-8215-b1d8626cd010 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:01.326336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bee59789-7aad-4455-8215-b1d8626cd010 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:01.333433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bee59789-7aad-4455-8215-b1d8626cd010 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:01.398141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:18:01.421981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:18:01.586598 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eaa20aee-de71-479d-98cf-0afd872814fd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.023487 Aug 27 05:18:01.587533 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2469/4943] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:18:01.601713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89537bb6-2b11-4d16-babb-3f62ced9a4d1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:01.603758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89537bb6-2b11-4d16-babb-3f62ced9a4d1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:01.618491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89537bb6-2b11-4d16-babb-3f62ced9a4d1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:01.620368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89537bb6-2b11-4d16-babb-3f62ced9a4d1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:01.622425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89537bb6-2b11-4d16-babb-3f62ced9a4d1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:01.624575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89537bb6-2b11-4d16-babb-3f62ced9a4d1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:01.626516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89537bb6-2b11-4d16-babb-3f62ced9a4d1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:01.627696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89537bb6-2b11-4d16-babb-3f62ced9a4d1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:02.121915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bee59789-7aad-4455-8215-b1d8626cd010 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:02.148012 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bee59789-7aad-4455-8215-b1d8626cd010 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1509 microversion: 2.1 time: 0.897420 Aug 27 05:18:02.151641 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2475/4944] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:01 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1509 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:02.162976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1821fdf-2c71-4685-80c7-1d04ea56a60e tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:02.163805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d1821fdf-2c71-4685-80c7-1d04ea56a60e tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:02.938617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d1821fdf-2c71-4685-80c7-1d04ea56a60e tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:02.961647 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1821fdf-2c71-4685-80c7-1d04ea56a60e tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1218 microversion: 2.1 time: 0.802158 Aug 27 05:18:02.962642 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2476/4945] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:02 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1218 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:03.183293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89537bb6-2b11-4d16-babb-3f62ced9a4d1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:03.196824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4b4e6429-3585-42e8-bdda-a6ab4b0cce7f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:03.200443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4b4e6429-3585-42e8-bdda-a6ab4b0cce7f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:03.216194 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89537bb6-2b11-4d16-babb-3f62ced9a4d1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1314 microversion: 2.1 time: 1.626408 Aug 27 05:18:03.235346 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2470/4946] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:01 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1314 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:03.242047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4e6429-3585-42e8-bdda-a6ab4b0cce7f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:03.242047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4e6429-3585-42e8-bdda-a6ab4b0cce7f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:03.245142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4e6429-3585-42e8-bdda-a6ab4b0cce7f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:03.249288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4e6429-3585-42e8-bdda-a6ab4b0cce7f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:03.254225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4e6429-3585-42e8-bdda-a6ab4b0cce7f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:03.257245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4e6429-3585-42e8-bdda-a6ab4b0cce7f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:03.454405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d065ecf6-6c95-4903-b819-c3f0248e53a1 req-9aa35bf5-ec16-44ed-a19a-44b9a60fd7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b7d845-61be-4eb2-8b0e-4dbd22280a9e", "name": "network-vif-deleted", "tag": "223dc391-3c56-4447-bc18-64b08a368db2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:03.491989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d065ecf6-6c95-4903-b819-c3f0248e53a1 req-9aa35bf5-ec16-44ed-a19a-44b9a60fd7a2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:03.493132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d065ecf6-6c95-4903-b819-c3f0248e53a1 req-9aa35bf5-ec16-44ed-a19a-44b9a60fd7a2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:03.494303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d065ecf6-6c95-4903-b819-c3f0248e53a1 req-9aa35bf5-ec16-44ed-a19a-44b9a60fd7a2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:03.560068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4b4e6429-3585-42e8-bdda-a6ab4b0cce7f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:03.590778 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4b4e6429-3585-42e8-bdda-a6ab4b0cce7f tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1467 microversion: 2.1 time: 0.398880 Aug 27 05:18:03.592344 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2477/4947] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:03 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1467 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:04.020377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e5802cec-d87f-4fd3-ab5d-806f1be84c4f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:04.030783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e5802cec-d87f-4fd3-ab5d-806f1be84c4f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:04.081710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5802cec-d87f-4fd3-ab5d-806f1be84c4f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:04.085083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5802cec-d87f-4fd3-ab5d-806f1be84c4f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:04.086959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5802cec-d87f-4fd3-ab5d-806f1be84c4f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:04.092278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5802cec-d87f-4fd3-ab5d-806f1be84c4f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:04.097128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5802cec-d87f-4fd3-ab5d-806f1be84c4f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:04.099901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5802cec-d87f-4fd3-ab5d-806f1be84c4f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:04.196948 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d065ecf6-6c95-4903-b819-c3f0248e53a1 req-9aa35bf5-ec16-44ed-a19a-44b9a60fd7a2 service nova] Creating event network-vif-deleted:223dc391-3c56-4447-bc18-64b08a368db2 for instance e4b7d845-61be-4eb2-8b0e-4dbd22280a9e on n-h1-820368-35 Aug 27 05:18:04.203633 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d065ecf6-6c95-4903-b819-c3f0248e53a1 req-9aa35bf5-ec16-44ed-a19a-44b9a60fd7a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.759449 Aug 27 05:18:04.204779 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2471/4948] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:04.251008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c3152c3d-ec02-492d-a665-663bb5bfaefb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:04.252530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c3152c3d-ec02-492d-a665-663bb5bfaefb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:04.267572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3152c3d-ec02-492d-a665-663bb5bfaefb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:04.268812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3152c3d-ec02-492d-a665-663bb5bfaefb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:04.269424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3152c3d-ec02-492d-a665-663bb5bfaefb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:04.270329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3152c3d-ec02-492d-a665-663bb5bfaefb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:04.270956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3152c3d-ec02-492d-a665-663bb5bfaefb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:04.273559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3152c3d-ec02-492d-a665-663bb5bfaefb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:04.356755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5802cec-d87f-4fd3-ab5d-806f1be84c4f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:04.407413 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e5802cec-d87f-4fd3-ab5d-806f1be84c4f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1270 microversion: 2.1 time: 0.412498 Aug 27 05:18:04.408369 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2478/4949] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:03 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1270 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:04.621545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:04.626088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:04.658785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:04.663490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:04.665238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:04.677286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:04.678486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:04.679294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:04.837907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:04.844977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:04.852337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:04.853302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lazy-loading 'fault' on Instance uuid e4b7d845-61be-4eb2-8b0e-4dbd22280a9e {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:18:05.088782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dda26fd9ae485094e76750883d9758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd1d46e7abc4cad9a21b47f1197f09b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:05.103407 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b000180-68e4-4add-a76b-0220ebdddee5 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 200 len: 1305 microversion: 2.1 time: 0.492307 Aug 27 05:18:05.106530 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2479/4950] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:04 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 1305 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:05.464842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-508b8ce8-565e-4fa5-82ed-ed7bbabe929d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:05.467509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-508b8ce8-565e-4fa5-82ed-ed7bbabe929d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:05.507759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-508b8ce8-565e-4fa5-82ed-ed7bbabe929d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:05.512660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-508b8ce8-565e-4fa5-82ed-ed7bbabe929d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:05.515521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-508b8ce8-565e-4fa5-82ed-ed7bbabe929d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:05.521735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-508b8ce8-565e-4fa5-82ed-ed7bbabe929d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:05.524055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-508b8ce8-565e-4fa5-82ed-ed7bbabe929d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:05.530839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-508b8ce8-565e-4fa5-82ed-ed7bbabe929d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:05.585657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c3152c3d-ec02-492d-a665-663bb5bfaefb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:05.603313 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c3152c3d-ec02-492d-a665-663bb5bfaefb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1314 microversion: 2.1 time: 1.358002 Aug 27 05:18:05.605038 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2472/4951] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:04 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1314 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:06.127645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:06.128665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] [instance: e4b7d845-61be-4eb2-8b0e-4dbd22280a9e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:06.143210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:06.143788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:06.144240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:06.146881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:06.150581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:06.151250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:06.184128 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] HTTP exception thrown: Instance e4b7d845-61be-4eb2-8b0e-4dbd22280a9e could not be found. Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Request method failure captured: Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e HTTP/1.1 Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCajm9DFCw1NAIbzyyizQ8i1PiXUHhKuFAHX5mL5VsS3IfynowP3_I1BD8Bf9HY0Q0pi8EazZ9aELF1nNQiUJVeJADpnSFstK6HrKpwm9NjqluZWqzUc-IE0IdGAz7h0l3ZgqumM-gS_9havTNllD_xCwyhcf4nr6gEjNgdnIMpx9YUE Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 0dd1d46e7abc4cad9a21b47f1197f09b Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerPasswordTestJSON-947137965 Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dd1d46e7abc4cad9a21b47f1197f09b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dd1d46e7abc4cad9a21b47f1197f09b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dd1d46e7abc4cad9a21b47f1197f09b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dd1d46e7abc4cad9a21b47f1197f09b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerPasswordTestJSON-947137965 Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 0dd1d46e7abc4cad9a21b47f1197f09b Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerPasswordTestJSON-947137965 Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerPasswordTestJSON-947137965-project Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: c5dda26fd9ae485094e76750883d9758 Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerPasswordTestJSON-947137965-project Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance e4b7d845-61be-4eb2-8b0e-4dbd22280a9e could not be found. Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e4b7d845-61be-4eb2-8b0e-4dbd22280a9e'} Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4b7d845-61be-4eb2-8b0e-4dbd22280a9e could not be found. Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4b7d845-61be-4eb2-8b0e-4dbd22280a9e could not be found. Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:18:06.186332 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:06.191639 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:06.191639 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:18:06.191639 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:18:06.191639 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:18:06.191639 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:18:06.191639 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4b7d845-61be-4eb2-8b0e-4dbd22280a9e could not be found. Aug 27 05:18:06.191639 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:06.196995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] Returning 404 to user: Instance e4b7d845-61be-4eb2-8b0e-4dbd22280a9e could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:18:06.198098 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-55aa1462-5f9b-4f19-b466-41e3ee9a67b8 tempest-ServerPasswordTestJSON-947137965 tempest-ServerPasswordTestJSON-947137965-project] 10.222.0.58 "GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e" status: 404 len: 111 microversion: 2.1 time: 0.075061 Aug 27 05:18:06.203459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-508b8ce8-565e-4fa5-82ed-ed7bbabe929d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:06.206175 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2473/4952] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:06 2022] GET /compute/v2.1/servers/e4b7d845-61be-4eb2-8b0e-4dbd22280a9e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:18:06.221783 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-508b8ce8-565e-4fa5-82ed-ed7bbabe929d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1276 microversion: 2.1 time: 0.775729 Aug 27 05:18:06.222393 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2480/4953] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:05 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1276 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:06.469528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-489f80be-8250-42f7-952a-d34b853d98a5 req-a81921d5-c72c-4cf3-9f8f-ae4538e5ad99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5570542-581a-4be3-ac36-958065bdd4cd", "tag": "91d83644-e5b1-445e-a793-08d3bb22236b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:06.507489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-489f80be-8250-42f7-952a-d34b853d98a5 req-a81921d5-c72c-4cf3-9f8f-ae4538e5ad99 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:06.510826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-489f80be-8250-42f7-952a-d34b853d98a5 req-a81921d5-c72c-4cf3-9f8f-ae4538e5ad99 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:06.513284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-489f80be-8250-42f7-952a-d34b853d98a5 req-a81921d5-c72c-4cf3-9f8f-ae4538e5ad99 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:06.589529 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-489f80be-8250-42f7-952a-d34b853d98a5 req-a81921d5-c72c-4cf3-9f8f-ae4538e5ad99 service nova] Creating event network-changed:91d83644-e5b1-445e-a793-08d3bb22236b for instance a5570542-581a-4be3-ac36-958065bdd4cd on n-h2-820368-35 Aug 27 05:18:06.638324 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-489f80be-8250-42f7-952a-d34b853d98a5 req-a81921d5-c72c-4cf3-9f8f-ae4538e5ad99 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168609 Aug 27 05:18:06.641242 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2474/4954] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:06.649242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b7508b2-5c2f-4476-bf4f-3dd291f74793 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:06.650147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3b7508b2-5c2f-4476-bf4f-3dd291f74793 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:06.679445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b7508b2-5c2f-4476-bf4f-3dd291f74793 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:06.682384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b7508b2-5c2f-4476-bf4f-3dd291f74793 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:06.685255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b7508b2-5c2f-4476-bf4f-3dd291f74793 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:06.689513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b7508b2-5c2f-4476-bf4f-3dd291f74793 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:06.700690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b7508b2-5c2f-4476-bf4f-3dd291f74793 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:06.702208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b7508b2-5c2f-4476-bf4f-3dd291f74793 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:07.251589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c6df248d-d55c-4a7a-8dd1-c8db5aa47cd7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:07.252422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c6df248d-d55c-4a7a-8dd1-c8db5aa47cd7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:07.266530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6df248d-d55c-4a7a-8dd1-c8db5aa47cd7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:07.267231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6df248d-d55c-4a7a-8dd1-c8db5aa47cd7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:07.280001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6df248d-d55c-4a7a-8dd1-c8db5aa47cd7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:07.281361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6df248d-d55c-4a7a-8dd1-c8db5aa47cd7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:07.282318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6df248d-d55c-4a7a-8dd1-c8db5aa47cd7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:07.283105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6df248d-d55c-4a7a-8dd1-c8db5aa47cd7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:07.632143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3b7508b2-5c2f-4476-bf4f-3dd291f74793 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:07.648172 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3b7508b2-5c2f-4476-bf4f-3dd291f74793 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1314 microversion: 2.1 time: 1.005204 Aug 27 05:18:07.649039 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2481/4955] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:06 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1314 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:07.674385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c6df248d-d55c-4a7a-8dd1-c8db5aa47cd7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:07.688955 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c6df248d-d55c-4a7a-8dd1-c8db5aa47cd7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1276 microversion: 2.1 time: 0.444741 Aug 27 05:18:07.707174 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2475/4956] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:07 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1276 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:08.653282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:08.655305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:08.681781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d98c6510-9415-4504-8532-790e8da8918e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:08.683138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:08.688267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:08.691205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d98c6510-9415-4504-8532-790e8da8918e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:08.692341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:08.696575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:08.697370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:08.698064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:08.732745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d98c6510-9415-4504-8532-790e8da8918e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:08.733510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d98c6510-9415-4504-8532-790e8da8918e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:08.734158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d98c6510-9415-4504-8532-790e8da8918e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:08.735276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d98c6510-9415-4504-8532-790e8da8918e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:08.736320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d98c6510-9415-4504-8532-790e8da8918e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:08.739324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d98c6510-9415-4504-8532-790e8da8918e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:08.785879 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] HTTP exception thrown: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Request method failure captured: Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 HTTP/1.1 Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaZ9-FtmAk7CY1rYRFdtfey_9ZqVkOQebMp2rvOdv_ug4cOHxXVsFqO3XFHj76pE0qg7oAMNwotycwqxl3QYVs4AwIkneMP6l2SLwu3tidnzbgHgLI2JZIZnQbM876-3oWEfBRtKgfW3DxWssvfiH40pMATCqubkwx75lT72sP5NDt4 Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cba630546e34472498c6e180a3ec2849", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cba630546e34472498c6e180a3ec2849"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 14ad24b744324d3e856a64b4c4979e8a Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e08a333d-504a-41ad-a796-2069aecd4bd9'} Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:18:08.789400 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:18:08.799309 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:18:08.799309 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:18:08.799309 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:18:08.799309 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:18:08.799309 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:08.799309 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:18:08.799309 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:18:08.799309 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:18:08.799309 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:18:08.799309 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:18:08.799309 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:18:08.805778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Returning 404 to user: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:18:08.807415 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf838fd2-27ae-455d-8e6d-10f24cc17e77 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 404 len: 111 microversion: 2.20 time: 0.160059 Aug 27 05:18:08.812657 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2482/4957] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:18:08 2022] DELETE /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 05:18:08.831266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-02bc4876-e065-4c61-9100-84e3b5d6f0cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:08.835521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-02bc4876-e065-4c61-9100-84e3b5d6f0cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:08.855036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02bc4876-e065-4c61-9100-84e3b5d6f0cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:08.861968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02bc4876-e065-4c61-9100-84e3b5d6f0cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:08.865339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02bc4876-e065-4c61-9100-84e3b5d6f0cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:08.868327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02bc4876-e065-4c61-9100-84e3b5d6f0cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:08.870415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02bc4876-e065-4c61-9100-84e3b5d6f0cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:08.873172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02bc4876-e065-4c61-9100-84e3b5d6f0cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:09.803330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d98c6510-9415-4504-8532-790e8da8918e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:09.825133 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d98c6510-9415-4504-8532-790e8da8918e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1314 microversion: 2.1 time: 1.149379 Aug 27 05:18:09.840472 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2476/4958] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:08 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1314 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:09.846876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:09.847942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: e08a333d-504a-41ad-a796-2069aecd4bd9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:09.855461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:09.856250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:09.856968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:09.858005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:09.858728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:09.859460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:09.878657 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] HTTP exception thrown: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:18:09.878964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02bc4876-e065-4c61-9100-84e3b5d6f0cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Request method failure captured: Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 HTTP/1.1 Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaZ9-FtmAk7CY1rYRFdtfey_9ZqVkOQebMp2rvOdv_ug4cOHxXVsFqO3XFHj76pE0qg7oAMNwotycwqxl3QYVs4AwIkneMP6l2SLwu3tidnzbgHgLI2JZIZnQbM876-3oWEfBRtKgfW3DxWssvfiH40pMATCqubkwx75lT72sP5NDt4 Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cba630546e34472498c6e180a3ec2849", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cba630546e34472498c6e180a3ec2849"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 14ad24b744324d3e856a64b4c4979e8a Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e08a333d-504a-41ad-a796-2069aecd4bd9'} Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:09.883581 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:18:09.895983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:09.895983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:09.895983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:18:09.895983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:18:09.895983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:18:09.895983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:18:09.895983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. Aug 27 05:18:09.895983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:09.902868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Returning 404 to user: Instance e08a333d-504a-41ad-a796-2069aecd4bd9 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:18:09.903776 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-02bc4876-e065-4c61-9100-84e3b5d6f0cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1318 microversion: 2.1 time: 1.079139 Aug 27 05:18:09.904058 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6fcc86f-f4a7-4146-8582-7418fa1fea5e tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9" status: 404 len: 111 microversion: 2.20 time: 0.056744 Aug 27 05:18:09.904343 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2483/4959] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:08 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1318 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:09.906113 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2477/4960] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:09 2022] GET /compute/v2.1/servers/e08a333d-504a-41ad-a796-2069aecd4bd9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:18:10.858201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b968c33-7d89-4a81-ac75-4646b392f706 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:10.860195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b968c33-7d89-4a81-ac75-4646b392f706 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:10.944054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b968c33-7d89-4a81-ac75-4646b392f706 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:10.947628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b968c33-7d89-4a81-ac75-4646b392f706 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:10.948183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5719791a-5bcb-4cca-9b82-9147ad0e90b6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:10.951525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b968c33-7d89-4a81-ac75-4646b392f706 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:10.952397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5719791a-5bcb-4cca-9b82-9147ad0e90b6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:10.965628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b968c33-7d89-4a81-ac75-4646b392f706 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:10.974977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b968c33-7d89-4a81-ac75-4646b392f706 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:10.979971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b968c33-7d89-4a81-ac75-4646b392f706 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:11.011491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5719791a-5bcb-4cca-9b82-9147ad0e90b6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:11.012421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5719791a-5bcb-4cca-9b82-9147ad0e90b6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:11.016155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5719791a-5bcb-4cca-9b82-9147ad0e90b6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:11.017972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5719791a-5bcb-4cca-9b82-9147ad0e90b6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:11.021830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5719791a-5bcb-4cca-9b82-9147ad0e90b6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:11.026390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5719791a-5bcb-4cca-9b82-9147ad0e90b6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:11.224149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:11.359700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=14 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:12.092102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b968c33-7d89-4a81-ac75-4646b392f706 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:12.119129 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b968c33-7d89-4a81-ac75-4646b392f706 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1314 microversion: 2.1 time: 1.270752 Aug 27 05:18:12.124807 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2484/4961] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:10 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1314 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:12.130489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5719791a-5bcb-4cca-9b82-9147ad0e90b6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:12.144269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-6cffd5a1-80cb-4998-af3e-ae0612919c45 req-b971c116-163e-4675-a737-aab2e0e8ea2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f", "tag": "0e3c29c1-6ec1-4cf0-9b9d-57ff2724699d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:12.156500 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5719791a-5bcb-4cca-9b82-9147ad0e90b6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1318 microversion: 2.1 time: 1.225031 Aug 27 05:18:12.157093 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2478/4962] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:10 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1318 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:12.165171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6cffd5a1-80cb-4998-af3e-ae0612919c45 req-b971c116-163e-4675-a737-aab2e0e8ea2c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:12.165665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6cffd5a1-80cb-4998-af3e-ae0612919c45 req-b971c116-163e-4675-a737-aab2e0e8ea2c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:12.166976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6cffd5a1-80cb-4998-af3e-ae0612919c45 req-b971c116-163e-4675-a737-aab2e0e8ea2c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:12.214062 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-6cffd5a1-80cb-4998-af3e-ae0612919c45 req-b971c116-163e-4675-a737-aab2e0e8ea2c service nova] Creating event network-changed:0e3c29c1-6ec1-4cf0-9b9d-57ff2724699d for instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f on n-h1-820368-35 Aug 27 05:18:12.229378 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-6cffd5a1-80cb-4998-af3e-ae0612919c45 req-b971c116-163e-4675-a737-aab2e0e8ea2c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102841 Aug 27 05:18:12.233180 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2485/4963] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:13.162649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8714c61f-0a3c-46b5-b4fe-d984bc77534b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:13.164354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8714c61f-0a3c-46b5-b4fe-d984bc77534b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:13.180531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8714c61f-0a3c-46b5-b4fe-d984bc77534b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:13.182540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8714c61f-0a3c-46b5-b4fe-d984bc77534b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:13.185488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8714c61f-0a3c-46b5-b4fe-d984bc77534b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:13.187189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8714c61f-0a3c-46b5-b4fe-d984bc77534b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:13.188934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8714c61f-0a3c-46b5-b4fe-d984bc77534b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:13.190110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8714c61f-0a3c-46b5-b4fe-d984bc77534b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:13.205723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec657275-7e38-4977-9bad-9284e0a197df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:13.207982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec657275-7e38-4977-9bad-9284e0a197df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:13.217268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:13.236003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec657275-7e38-4977-9bad-9284e0a197df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:13.263841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec657275-7e38-4977-9bad-9284e0a197df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:13.264274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec657275-7e38-4977-9bad-9284e0a197df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:13.267572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec657275-7e38-4977-9bad-9284e0a197df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:13.270339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec657275-7e38-4977-9bad-9284e0a197df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:13.272156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec657275-7e38-4977-9bad-9284e0a197df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:13.889726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8714c61f-0a3c-46b5-b4fe-d984bc77534b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:13.907651 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8714c61f-0a3c-46b5-b4fe-d984bc77534b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1314 microversion: 2.1 time: 0.748456 Aug 27 05:18:13.909806 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2479/4964] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:13 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:14.007921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ec657275-7e38-4977-9bad-9284e0a197df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:14.042652 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec657275-7e38-4977-9bad-9284e0a197df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1318 microversion: 2.1 time: 0.849611 Aug 27 05:18:14.045290 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2486/4965] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:13 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1318 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:14.937156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3fd078fb-bb93-4bcf-8abc-7bb7bc4e1553 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:14.942074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3fd078fb-bb93-4bcf-8abc-7bb7bc4e1553 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:14.978870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fd078fb-bb93-4bcf-8abc-7bb7bc4e1553 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:14.996755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fd078fb-bb93-4bcf-8abc-7bb7bc4e1553 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:14.997587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fd078fb-bb93-4bcf-8abc-7bb7bc4e1553 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:14.998747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fd078fb-bb93-4bcf-8abc-7bb7bc4e1553 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:14.999432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fd078fb-bb93-4bcf-8abc-7bb7bc4e1553 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:15.000022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fd078fb-bb93-4bcf-8abc-7bb7bc4e1553 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:15.082782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5e0b4d37-b27c-4319-9b04-ff409d7437d9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:15.083923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5e0b4d37-b27c-4319-9b04-ff409d7437d9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:15.102142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0b4d37-b27c-4319-9b04-ff409d7437d9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:15.102658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0b4d37-b27c-4319-9b04-ff409d7437d9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:15.103134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0b4d37-b27c-4319-9b04-ff409d7437d9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:15.103891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0b4d37-b27c-4319-9b04-ff409d7437d9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:15.104442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0b4d37-b27c-4319-9b04-ff409d7437d9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:15.104886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e0b4d37-b27c-4319-9b04-ff409d7437d9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:15.806932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3fd078fb-bb93-4bcf-8abc-7bb7bc4e1553 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:15.839118 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3fd078fb-bb93-4bcf-8abc-7bb7bc4e1553 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1314 microversion: 2.1 time: 0.906378 Aug 27 05:18:15.842140 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2480/4966] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:14 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:15.955268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5e0b4d37-b27c-4319-9b04-ff409d7437d9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:15.972301 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5e0b4d37-b27c-4319-9b04-ff409d7437d9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1318 microversion: 2.1 time: 0.894248 Aug 27 05:18:15.972815 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2487/4967] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:15 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:16.866788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-68461512-d8b8-4381-8fc0-a8480c41fca1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:16.871239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68461512-d8b8-4381-8fc0-a8480c41fca1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:16.910504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68461512-d8b8-4381-8fc0-a8480c41fca1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:16.916390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68461512-d8b8-4381-8fc0-a8480c41fca1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:16.918214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68461512-d8b8-4381-8fc0-a8480c41fca1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:16.921300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68461512-d8b8-4381-8fc0-a8480c41fca1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:16.925025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68461512-d8b8-4381-8fc0-a8480c41fca1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:16.926302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68461512-d8b8-4381-8fc0-a8480c41fca1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:16.997112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9a67c75f-bbe3-41dc-afb9-5ab28f024e50 req-83b4ac31-535c-4bd8-a327-f3510789e5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5570542-581a-4be3-ac36-958065bdd4cd", "name": "network-vif-plugged", "status": "completed", "tag": "91d83644-e5b1-445e-a793-08d3bb22236b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:17.017355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9a67c75f-bbe3-41dc-afb9-5ab28f024e50 req-83b4ac31-535c-4bd8-a327-f3510789e5ef service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:17.017863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9a67c75f-bbe3-41dc-afb9-5ab28f024e50 req-83b4ac31-535c-4bd8-a327-f3510789e5ef service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:17.018294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9a67c75f-bbe3-41dc-afb9-5ab28f024e50 req-83b4ac31-535c-4bd8-a327-f3510789e5ef service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:17.040692 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9a67c75f-bbe3-41dc-afb9-5ab28f024e50 req-83b4ac31-535c-4bd8-a327-f3510789e5ef service nova] Creating event network-vif-plugged:91d83644-e5b1-445e-a793-08d3bb22236b for instance a5570542-581a-4be3-ac36-958065bdd4cd on n-h2-820368-35 Aug 27 05:18:17.053323 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9a67c75f-bbe3-41dc-afb9-5ab28f024e50 req-83b4ac31-535c-4bd8-a327-f3510789e5ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060698 Aug 27 05:18:17.054820 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2488/4968] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:17.065452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6abb672f-6b78-4583-9a6a-b713b1a83ea3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:17.066761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6abb672f-6b78-4583-9a6a-b713b1a83ea3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:17.079027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abb672f-6b78-4583-9a6a-b713b1a83ea3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:17.080380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abb672f-6b78-4583-9a6a-b713b1a83ea3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:17.081781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abb672f-6b78-4583-9a6a-b713b1a83ea3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:17.084747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abb672f-6b78-4583-9a6a-b713b1a83ea3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:17.086375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abb672f-6b78-4583-9a6a-b713b1a83ea3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:17.088267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abb672f-6b78-4583-9a6a-b713b1a83ea3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:18.279243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-68461512-d8b8-4381-8fc0-a8480c41fca1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:18.309914 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-68461512-d8b8-4381-8fc0-a8480c41fca1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1314 microversion: 2.1 time: 1.438104 Aug 27 05:18:18.315060 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2481/4969] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:16 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1314 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:18.465203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6abb672f-6b78-4583-9a6a-b713b1a83ea3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:18.481380 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6abb672f-6b78-4583-9a6a-b713b1a83ea3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1318 microversion: 2.1 time: 1.423785 Aug 27 05:18:18.482435 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2489/4970] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:17 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1318 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:18.508460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:18.510680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:18.530873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:18.534101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:18.536079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:18.541845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:18.548284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:18.550105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:18.623762 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] HTTP exception thrown: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Request method failure captured: Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c HTTP/1.1 Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaZ9-FtmAk7CY1rYRFdtfey_9ZqVkOQebMp2rvOdv_ug4cOHxXVsFqO3XFHj76pE0qg7oAMNwotycwqxl3QYVs4AwIkneMP6l2SLwu3tidnzbgHgLI2JZIZnQbM876-3oWEfBRtKgfW3DxWssvfiH40pMATCqubkwx75lT72sP5NDt4 Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cba630546e34472498c6e180a3ec2849", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cba630546e34472498c6e180a3ec2849"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 14ad24b744324d3e856a64b4c4979e8a Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '0dcbd54c-7e88-44d7-ad7b-be669acb1c7c'} Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:18:18.626785 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:18:18.636818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Returning 404 to user: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:18:18.640311 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4da687ec-cc61-42db-a5e6-661375fdb087 tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 404 len: 111 microversion: 2.20 time: 0.129312 Aug 27 05:18:18.641624 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2482/4971] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:18:18 2022] DELETE /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:18:18.649877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:18.651540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] [instance: 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:18.666467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:18.680018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:18.684361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:18.689123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:18.690459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:18.691169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:18.692016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:18.756033 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] HTTP exception thrown: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Request method failure captured: Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c HTTP/1.1 Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaZ9-FtmAk7CY1rYRFdtfey_9ZqVkOQebMp2rvOdv_ug4cOHxXVsFqO3XFHj76pE0qg7oAMNwotycwqxl3QYVs4AwIkneMP6l2SLwu3tidnzbgHgLI2JZIZnQbM876-3oWEfBRtKgfW3DxWssvfiH40pMATCqubkwx75lT72sP5NDt4 Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cba630546e34472498c6e180a3ec2849", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cba630546e34472498c6e180a3ec2849"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cba630546e34472498c6e180a3ec2849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: cba630546e34472498c6e180a3ec2849 Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-355553516 Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 14ad24b744324d3e856a64b4c4979e8a Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachVolumeShelveTestJSON-355553516-project Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '0dcbd54c-7e88-44d7-ad7b-be669acb1c7c'} Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:18:18.763832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:18:18.769571 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:18:18.769571 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:18:18.769571 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:18:18.769571 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:18:18.769571 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:18:18.769571 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:18:18.769571 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. Aug 27 05:18:18.769571 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:18:18.773606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] Returning 404 to user: Instance 0dcbd54c-7e88-44d7-ad7b-be669acb1c7c could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:18:18.776011 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e6ebda2f-c53e-4cf9-a8fd-523c80b63f3c tempest-AttachVolumeShelveTestJSON-355553516 tempest-AttachVolumeShelveTestJSON-355553516-project] 10.222.0.58 "GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c" status: 404 len: 111 microversion: 2.20 time: 0.132767 Aug 27 05:18:18.778264 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2490/4972] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:18 2022] GET /compute/v2.1/servers/0dcbd54c-7e88-44d7-ad7b-be669acb1c7c => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:18:19.342956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c1b24a06-e5f1-42ab-92bc-e12564fa5939 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:19.344224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c1b24a06-e5f1-42ab-92bc-e12564fa5939 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:19.364779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1b24a06-e5f1-42ab-92bc-e12564fa5939 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:19.377323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1b24a06-e5f1-42ab-92bc-e12564fa5939 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:19.378458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1b24a06-e5f1-42ab-92bc-e12564fa5939 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:19.385293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1b24a06-e5f1-42ab-92bc-e12564fa5939 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:19.386744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1b24a06-e5f1-42ab-92bc-e12564fa5939 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:19.387714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1b24a06-e5f1-42ab-92bc-e12564fa5939 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:19.537763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-924f5631-1806-465e-93d4-5400d4870cb9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:19.542103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-924f5631-1806-465e-93d4-5400d4870cb9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:19.564098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-924f5631-1806-465e-93d4-5400d4870cb9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:19.568412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-924f5631-1806-465e-93d4-5400d4870cb9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:19.570963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-924f5631-1806-465e-93d4-5400d4870cb9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:19.573262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-924f5631-1806-465e-93d4-5400d4870cb9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:19.579952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-924f5631-1806-465e-93d4-5400d4870cb9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:19.582293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-924f5631-1806-465e-93d4-5400d4870cb9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:20.584401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c1b24a06-e5f1-42ab-92bc-e12564fa5939 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:20.616443 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c1b24a06-e5f1-42ab-92bc-e12564fa5939 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1314 microversion: 2.1 time: 1.277639 Aug 27 05:18:20.618341 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2483/4973] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:19 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1314 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:21.004807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-924f5631-1806-465e-93d4-5400d4870cb9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:21.024767 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-924f5631-1806-465e-93d4-5400d4870cb9 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1318 microversion: 2.1 time: 1.515678 Aug 27 05:18:21.025497 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2491/4974] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:19 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1318 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:21.662918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-39d9d316-b552-464c-87d8-c808057986cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:21.667025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-39d9d316-b552-464c-87d8-c808057986cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:21.676478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39d9d316-b552-464c-87d8-c808057986cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:21.677360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39d9d316-b552-464c-87d8-c808057986cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:21.678122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39d9d316-b552-464c-87d8-c808057986cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:21.680500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39d9d316-b552-464c-87d8-c808057986cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:21.684293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39d9d316-b552-464c-87d8-c808057986cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:21.687297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39d9d316-b552-464c-87d8-c808057986cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:22.036569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-39d9d316-b552-464c-87d8-c808057986cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:22.050603 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-39d9d316-b552-464c-87d8-c808057986cd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1500 microversion: 2.1 time: 0.408710 Aug 27 05:18:22.061910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1c63b667-9c33-4057-b6aa-4f399d20b142 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:22.066103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1c63b667-9c33-4057-b6aa-4f399d20b142 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:22.066878 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2484/4975] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:21 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1500 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:22.079549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f49d5157-5374-422b-ad0e-fa9957f3e26b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:22.098961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c63b667-9c33-4057-b6aa-4f399d20b142 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:22.099878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c63b667-9c33-4057-b6aa-4f399d20b142 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:22.101924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f49d5157-5374-422b-ad0e-fa9957f3e26b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:22.103031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f49d5157-5374-422b-ad0e-fa9957f3e26b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:22.104038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f49d5157-5374-422b-ad0e-fa9957f3e26b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:22.107864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c63b667-9c33-4057-b6aa-4f399d20b142 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:22.109334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c63b667-9c33-4057-b6aa-4f399d20b142 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:22.113267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c63b667-9c33-4057-b6aa-4f399d20b142 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:22.114137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c63b667-9c33-4057-b6aa-4f399d20b142 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:22.197378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f49d5157-5374-422b-ad0e-fa9957f3e26b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Going to try to stop instance {{(pid=128548) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:18:22.365078 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f49d5157-5374-422b-ad0e-fa9957f3e26b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd/action" status: 202 len: 0 microversion: 2.1 time: 0.290828 Aug 27 05:18:22.369294 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2485/4976] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:18:22 2022] POST /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:18:22.412463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a2d028b4-e2c3-479d-9db8-8889c3e23e55 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:22.415869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a2d028b4-e2c3-479d-9db8-8889c3e23e55 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:22.432231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2d028b4-e2c3-479d-9db8-8889c3e23e55 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:22.433596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2d028b4-e2c3-479d-9db8-8889c3e23e55 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:22.434659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2d028b4-e2c3-479d-9db8-8889c3e23e55 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:22.437576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2d028b4-e2c3-479d-9db8-8889c3e23e55 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:22.438816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2d028b4-e2c3-479d-9db8-8889c3e23e55 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:22.439941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2d028b4-e2c3-479d-9db8-8889c3e23e55 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:22.740480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1c63b667-9c33-4057-b6aa-4f399d20b142 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:22.783352 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1c63b667-9c33-4057-b6aa-4f399d20b142 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1318 microversion: 2.1 time: 0.731253 Aug 27 05:18:22.784361 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2492/4977] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:22 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1318 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:22.981380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a2d028b4-e2c3-479d-9db8-8889c3e23e55 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:23.014312 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a2d028b4-e2c3-479d-9db8-8889c3e23e55 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 0.623744 Aug 27 05:18:23.016322 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2486/4978] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:22 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:23.232697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-519a80c2-0dfb-4e45-820e-01194ef9ca8c req-24996e43-ecd7-4785-bd10-fb2d88835353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f", "name": "network-vif-plugged", "status": "completed", "tag": "0e3c29c1-6ec1-4cf0-9b9d-57ff2724699d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:23.302459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-519a80c2-0dfb-4e45-820e-01194ef9ca8c req-24996e43-ecd7-4785-bd10-fb2d88835353 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:23.303622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-519a80c2-0dfb-4e45-820e-01194ef9ca8c req-24996e43-ecd7-4785-bd10-fb2d88835353 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:23.304403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-519a80c2-0dfb-4e45-820e-01194ef9ca8c req-24996e43-ecd7-4785-bd10-fb2d88835353 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:23.337337 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-519a80c2-0dfb-4e45-820e-01194ef9ca8c req-24996e43-ecd7-4785-bd10-fb2d88835353 service nova] Creating event network-vif-plugged:0e3c29c1-6ec1-4cf0-9b9d-57ff2724699d for instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f on n-h1-820368-35 Aug 27 05:18:23.362953 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-519a80c2-0dfb-4e45-820e-01194ef9ca8c req-24996e43-ecd7-4785-bd10-fb2d88835353 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141114 Aug 27 05:18:23.364369 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2493/4979] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:23.836211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-92d4a5d0-7fc3-46e8-93aa-4a6fe289bd3c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:23.842873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-92d4a5d0-7fc3-46e8-93aa-4a6fe289bd3c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:23.878789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d4a5d0-7fc3-46e8-93aa-4a6fe289bd3c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:23.880061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d4a5d0-7fc3-46e8-93aa-4a6fe289bd3c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:23.881187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d4a5d0-7fc3-46e8-93aa-4a6fe289bd3c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:23.882638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d4a5d0-7fc3-46e8-93aa-4a6fe289bd3c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:23.883962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d4a5d0-7fc3-46e8-93aa-4a6fe289bd3c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:23.885022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d4a5d0-7fc3-46e8-93aa-4a6fe289bd3c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:23.904783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:24.056379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f3f8e629-b6ce-4b9a-bd1f-f5376666b840 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:24.062385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f3f8e629-b6ce-4b9a-bd1f-f5376666b840 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:24.084920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3f8e629-b6ce-4b9a-bd1f-f5376666b840 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:24.085734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3f8e629-b6ce-4b9a-bd1f-f5376666b840 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:24.086507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3f8e629-b6ce-4b9a-bd1f-f5376666b840 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:24.093047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3f8e629-b6ce-4b9a-bd1f-f5376666b840 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:24.094189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3f8e629-b6ce-4b9a-bd1f-f5376666b840 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:24.099134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3f8e629-b6ce-4b9a-bd1f-f5376666b840 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:24.772229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f3f8e629-b6ce-4b9a-bd1f-f5376666b840 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:24.776129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:24.788361 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f3f8e629-b6ce-4b9a-bd1f-f5376666b840 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 0.742065 Aug 27 05:18:24.793937 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2494/4980] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:24 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:24.811711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-92d4a5d0-7fc3-46e8-93aa-4a6fe289bd3c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:24.850405 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-92d4a5d0-7fc3-46e8-93aa-4a6fe289bd3c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1318 microversion: 2.1 time: 1.028782 Aug 27 05:18:24.851613 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2487/4981] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:23 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1318 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:25.836377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a15de756-16d9-4ff3-82c0-660e69bca104 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:25.837113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a15de756-16d9-4ff3-82c0-660e69bca104 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:25.853217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15de756-16d9-4ff3-82c0-660e69bca104 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:25.853961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15de756-16d9-4ff3-82c0-660e69bca104 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:25.855180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15de756-16d9-4ff3-82c0-660e69bca104 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:25.858745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15de756-16d9-4ff3-82c0-660e69bca104 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:25.859289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15de756-16d9-4ff3-82c0-660e69bca104 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:25.862015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15de756-16d9-4ff3-82c0-660e69bca104 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:25.876430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-44105f6e-35d7-44d9-bb8d-625a3b130623 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:25.878139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-44105f6e-35d7-44d9-bb8d-625a3b130623 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:25.907511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:25.912525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44105f6e-35d7-44d9-bb8d-625a3b130623 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:25.915125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44105f6e-35d7-44d9-bb8d-625a3b130623 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:25.924202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44105f6e-35d7-44d9-bb8d-625a3b130623 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:25.925599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44105f6e-35d7-44d9-bb8d-625a3b130623 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:25.929995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44105f6e-35d7-44d9-bb8d-625a3b130623 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:25.930859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44105f6e-35d7-44d9-bb8d-625a3b130623 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:26.265333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-44105f6e-35d7-44d9-bb8d-625a3b130623 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:26.286029 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-44105f6e-35d7-44d9-bb8d-625a3b130623 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1318 microversion: 2.1 time: 0.414476 Aug 27 05:18:26.291192 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2488/4982] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:25 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:26.992564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a15de756-16d9-4ff3-82c0-660e69bca104 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:27.017847 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a15de756-16d9-4ff3-82c0-660e69bca104 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 1.189727 Aug 27 05:18:27.035910 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2495/4983] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:25 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:27.316383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4516e515-0058-4bd2-83b6-141ef21a40c7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:27.317132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4516e515-0058-4bd2-83b6-141ef21a40c7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:27.325597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4516e515-0058-4bd2-83b6-141ef21a40c7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:27.326107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4516e515-0058-4bd2-83b6-141ef21a40c7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:27.327854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4516e515-0058-4bd2-83b6-141ef21a40c7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:27.328651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4516e515-0058-4bd2-83b6-141ef21a40c7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:27.329183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4516e515-0058-4bd2-83b6-141ef21a40c7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:27.330572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4516e515-0058-4bd2-83b6-141ef21a40c7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:27.394301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1064522983", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": "none"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:27.518779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:18:27.522443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:18:27.524277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:18:27.527027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:18:27.528120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:18:27.546586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:27.547332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:27.547904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:27.548990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:27.549903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:27.550617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:27.580682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Getting quotas for project 12e4dacfa7414e4b830d8b1761eaf015. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:18:27.592887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Getting quotas for user 9aaf85e9423049ab810dd16e4ed78e8e and project 12e4dacfa7414e4b830d8b1761eaf015. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:18:27.608574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:18:27.611227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:18:27.737658 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1cd1de08-e18d-4d34-9345-8962203232be tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.644521 Aug 27 05:18:27.741366 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2489/4984] 10.222.0.58 () {62 vars in 1188 bytes} [Sat Aug 27 05:18:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 05:18:27.763250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d9421868-e4e7-4980-a95a-6ff01818694d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:27.763899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d9421868-e4e7-4980-a95a-6ff01818694d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:27.926569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d9421868-e4e7-4980-a95a-6ff01818694d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:27.943810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d9421868-e4e7-4980-a95a-6ff01818694d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:27.946804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d9421868-e4e7-4980-a95a-6ff01818694d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:27.951170 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d9421868-e4e7-4980-a95a-6ff01818694d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1278 microversion: 2.57 time: 0.200958 Aug 27 05:18:27.957816 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2490/4985] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:27 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:28.057049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8e516d5-5476-468e-af2e-394cd3270683 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:28.058609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8e516d5-5476-468e-af2e-394cd3270683 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:28.079730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e516d5-5476-468e-af2e-394cd3270683 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:28.080522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e516d5-5476-468e-af2e-394cd3270683 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:28.081152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e516d5-5476-468e-af2e-394cd3270683 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:28.082071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e516d5-5476-468e-af2e-394cd3270683 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:28.082732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e516d5-5476-468e-af2e-394cd3270683 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:28.083365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8e516d5-5476-468e-af2e-394cd3270683 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:28.126290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4516e515-0058-4bd2-83b6-141ef21a40c7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:28.145029 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4516e515-0058-4bd2-83b6-141ef21a40c7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1507 microversion: 2.1 time: 0.828642 Aug 27 05:18:28.146563 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2496/4986] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:27 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1507 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:28.174799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3a3a3151-8222-4b1c-97a8-1e2837d76784 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:28.176059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3a3a3151-8222-4b1c-97a8-1e2837d76784 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:28.186291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a3a3151-8222-4b1c-97a8-1e2837d76784 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:28.191519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a3a3151-8222-4b1c-97a8-1e2837d76784 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:28.195707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a3a3151-8222-4b1c-97a8-1e2837d76784 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:28.198378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a3a3151-8222-4b1c-97a8-1e2837d76784 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:28.201934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a3a3151-8222-4b1c-97a8-1e2837d76784 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:28.204539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a3a3151-8222-4b1c-97a8-1e2837d76784 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:28.709977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8e516d5-5476-468e-af2e-394cd3270683 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:28.734620 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8e516d5-5476-468e-af2e-394cd3270683 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 0.685396 Aug 27 05:18:28.738012 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2491/4987] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:28 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:28.975258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:28.975896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:28.994534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:29.003000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:29.010204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:29.011692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:29.013058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:29.013778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:29.056315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3a3a3151-8222-4b1c-97a8-1e2837d76784 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:29.071380 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3a3a3151-8222-4b1c-97a8-1e2837d76784 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1507 microversion: 2.1 time: 0.899600 Aug 27 05:18:29.075878 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2497/4988] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:28 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1507 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:29.114093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0fbb540e-64c5-480f-99ab-92987562f20c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:29.117061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0fbb540e-64c5-480f-99ab-92987562f20c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:29.133043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fbb540e-64c5-480f-99ab-92987562f20c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:29.134655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fbb540e-64c5-480f-99ab-92987562f20c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:29.134655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fbb540e-64c5-480f-99ab-92987562f20c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:29.135303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fbb540e-64c5-480f-99ab-92987562f20c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:29.137150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fbb540e-64c5-480f-99ab-92987562f20c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:29.139374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fbb540e-64c5-480f-99ab-92987562f20c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:29.243391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:29.310466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:29.321714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:29.327392 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c1068d3-a26e-4aac-a1eb-dd2a5bb66eb1 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1330 microversion: 2.57 time: 0.354421 Aug 27 05:18:29.333236 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2492/4989] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:28 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1330 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:18:29.338054 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0fbb540e-64c5-480f-99ab-92987562f20c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "PUT /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1079 microversion: 2.1 time: 0.228760 Aug 27 05:18:29.351668 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2498/4990] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:18:29 2022] PUT /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1079 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:29.366669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0e36ee66-301d-41e8-a8d7-36eaa5117972 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:29.368330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0e36ee66-301d-41e8-a8d7-36eaa5117972 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:29.385202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e36ee66-301d-41e8-a8d7-36eaa5117972 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:29.387049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e36ee66-301d-41e8-a8d7-36eaa5117972 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:29.387942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e36ee66-301d-41e8-a8d7-36eaa5117972 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:29.389718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e36ee66-301d-41e8-a8d7-36eaa5117972 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:29.390374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e36ee66-301d-41e8-a8d7-36eaa5117972 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:29.390977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e36ee66-301d-41e8-a8d7-36eaa5117972 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:29.786276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-81655b90-938a-47eb-8710-e01c9f09735e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:29.787059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-81655b90-938a-47eb-8710-e01c9f09735e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:29.796424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81655b90-938a-47eb-8710-e01c9f09735e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:29.801968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81655b90-938a-47eb-8710-e01c9f09735e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:29.802484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81655b90-938a-47eb-8710-e01c9f09735e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:29.803451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81655b90-938a-47eb-8710-e01c9f09735e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:29.804201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81655b90-938a-47eb-8710-e01c9f09735e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:29.807276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81655b90-938a-47eb-8710-e01c9f09735e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:30.067497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0e36ee66-301d-41e8-a8d7-36eaa5117972 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:30.079974 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0e36ee66-301d-41e8-a8d7-36eaa5117972 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1505 microversion: 2.1 time: 0.726665 Aug 27 05:18:30.086914 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2493/4991] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:29 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1505 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:30.113025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b8cffa1a-64dc-45ee-9421-a6cb291c9331 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:30.120504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b8cffa1a-64dc-45ee-9421-a6cb291c9331 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:30.145654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8cffa1a-64dc-45ee-9421-a6cb291c9331 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:30.148379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8cffa1a-64dc-45ee-9421-a6cb291c9331 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:30.152061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8cffa1a-64dc-45ee-9421-a6cb291c9331 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:30.153137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8cffa1a-64dc-45ee-9421-a6cb291c9331 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:30.154868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8cffa1a-64dc-45ee-9421-a6cb291c9331 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:30.156304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8cffa1a-64dc-45ee-9421-a6cb291c9331 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:30.684783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-81655b90-938a-47eb-8710-e01c9f09735e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:30.710990 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-81655b90-938a-47eb-8710-e01c9f09735e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 0.931327 Aug 27 05:18:30.724455 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2499/4992] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:29 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:30.738250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:30.742231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:30.789154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:30.790098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:30.793519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:30.794636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:30.795360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:30.796009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:30.837066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b8cffa1a-64dc-45ee-9421-a6cb291c9331 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:30.854224 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b8cffa1a-64dc-45ee-9421-a6cb291c9331 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1505 microversion: 2.1 time: 0.745453 Aug 27 05:18:30.855444 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2494/4993] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:30 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1505 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:30.893789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:30.897798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:30.913111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:30.914573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:30.915254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:30.916346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:30.917025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:30.917760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:31.086019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:31.153585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:31.156439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:31.173592 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3744a30a-4f7e-4186-9f89-10dd6af027a8 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1336 microversion: 2.57 time: 0.446839 Aug 27 05:18:31.175515 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2500/4994] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:30 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1336 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:31.218707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:18:31.228063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:18:31.236132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:18:31.236869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:18:31.242103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:18:31.477970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:31.502053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:31.507561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:31.512985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:31.516539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:31.524288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:31.530621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:31.639861 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6215e185-dfef-4813-8f46-58fd37699d6c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "POST /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f/action" status: 202 len: 1111 microversion: 2.1 time: 0.745708 Aug 27 05:18:31.641004 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2495/4995] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:18:30 2022] POST /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f/action => generated 1111 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 27 05:18:31.684886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c3ec41f-0ace-4ca6-a523-680782c33c43 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:31.688158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c3ec41f-0ace-4ca6-a523-680782c33c43 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:31.701628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3ec41f-0ace-4ca6-a523-680782c33c43 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:31.703666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3ec41f-0ace-4ca6-a523-680782c33c43 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:31.705064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3ec41f-0ace-4ca6-a523-680782c33c43 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:31.708565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3ec41f-0ace-4ca6-a523-680782c33c43 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:31.709760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3ec41f-0ace-4ca6-a523-680782c33c43 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:31.710834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3ec41f-0ace-4ca6-a523-680782c33c43 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:31.750105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc6201f2-7c28-4f69-8b7e-5b8520e6114d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:31.751237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dc6201f2-7c28-4f69-8b7e-5b8520e6114d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:31.778188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc6201f2-7c28-4f69-8b7e-5b8520e6114d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:31.784172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc6201f2-7c28-4f69-8b7e-5b8520e6114d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:31.785275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc6201f2-7c28-4f69-8b7e-5b8520e6114d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:31.787041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc6201f2-7c28-4f69-8b7e-5b8520e6114d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:31.794657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc6201f2-7c28-4f69-8b7e-5b8520e6114d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:31.795613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc6201f2-7c28-4f69-8b7e-5b8520e6114d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:32.642706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c3ec41f-0ace-4ca6-a523-680782c33c43 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:32.664904 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c3ec41f-0ace-4ca6-a523-680782c33c43 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1516 microversion: 2.1 time: 0.993454 Aug 27 05:18:32.667954 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2501/4996] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:31 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1516 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:32.685674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:32.686777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:32.715419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:32.716034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:32.717593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:32.718470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:32.719324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:32.721330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:32.798955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dc6201f2-7c28-4f69-8b7e-5b8520e6114d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:32.808594 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dc6201f2-7c28-4f69-8b7e-5b8520e6114d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 1.065704 Aug 27 05:18:32.819035 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2496/4997] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:31 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:32.924050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:32.959881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:32.968395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:32.973888 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-12ee8fca-637d-48b9-860f-837a1b292793 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1336 microversion: 2.57 time: 0.300612 Aug 27 05:18:32.977664 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2502/4998] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:32 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1336 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:33.691502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b73fd737-f72d-4385-b964-75fa49f5d0df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:33.692836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b73fd737-f72d-4385-b964-75fa49f5d0df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:33.728251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73fd737-f72d-4385-b964-75fa49f5d0df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:33.729244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73fd737-f72d-4385-b964-75fa49f5d0df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:33.736269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73fd737-f72d-4385-b964-75fa49f5d0df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:33.738254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73fd737-f72d-4385-b964-75fa49f5d0df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:33.739241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73fd737-f72d-4385-b964-75fa49f5d0df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:33.740110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b73fd737-f72d-4385-b964-75fa49f5d0df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:33.844587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3f2e2dc-e8e4-4fc8-8178-55272cd8b36c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:33.845669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e3f2e2dc-e8e4-4fc8-8178-55272cd8b36c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:33.920581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3f2e2dc-e8e4-4fc8-8178-55272cd8b36c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:33.922821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3f2e2dc-e8e4-4fc8-8178-55272cd8b36c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:33.930858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3f2e2dc-e8e4-4fc8-8178-55272cd8b36c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:33.932513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3f2e2dc-e8e4-4fc8-8178-55272cd8b36c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:33.933502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3f2e2dc-e8e4-4fc8-8178-55272cd8b36c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:33.936539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3f2e2dc-e8e4-4fc8-8178-55272cd8b36c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:34.718482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b73fd737-f72d-4385-b964-75fa49f5d0df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:34.761043 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b73fd737-f72d-4385-b964-75fa49f5d0df tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1516 microversion: 2.1 time: 1.074496 Aug 27 05:18:34.777775 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2497/4999] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:33 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1516 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:34.792910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:34.796207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:34.821975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:34.824765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:34.825420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:34.829883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:34.832884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:34.833672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:35.637983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:35.651650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:35.655376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:35.660401 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4e58d158-3671-428e-9040-9e95275d5fa6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1336 microversion: 2.57 time: 0.890975 Aug 27 05:18:35.671819 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2498/5000] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:34 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1336 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:35.789886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad4a8883-0604-4b76-90a4-3442ed6c72cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:35.790725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad4a8883-0604-4b76-90a4-3442ed6c72cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:35.807574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad4a8883-0604-4b76-90a4-3442ed6c72cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:35.813981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad4a8883-0604-4b76-90a4-3442ed6c72cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:35.814457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad4a8883-0604-4b76-90a4-3442ed6c72cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:35.815917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad4a8883-0604-4b76-90a4-3442ed6c72cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:35.816578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad4a8883-0604-4b76-90a4-3442ed6c72cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:35.817975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad4a8883-0604-4b76-90a4-3442ed6c72cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:36.473066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e3f2e2dc-e8e4-4fc8-8178-55272cd8b36c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:36.512352 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e3f2e2dc-e8e4-4fc8-8178-55272cd8b36c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 2.674917 Aug 27 05:18:36.514886 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2503/5001] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:33 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 2679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:36.698921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:36.699695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:36.710167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:36.710672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:36.714236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad4a8883-0604-4b76-90a4-3442ed6c72cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:36.715885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:36.717056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:36.717752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:36.719971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:36.728681 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad4a8883-0604-4b76-90a4-3442ed6c72cb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1516 microversion: 2.1 time: 0.946902 Aug 27 05:18:36.733639 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2499/5002] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:35 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1516 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:36.951539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:36.967364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:36.977194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:36.979845 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-06b4513f-4d6b-4d05-a2f2-6fdc48284852 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1357 microversion: 2.57 time: 0.285520 Aug 27 05:18:37.002904 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2504/5003] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:36 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1357 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:18:37.012331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:37.016217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:37.032471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:37.035561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:37.038552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:37.040705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:37.041683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:37.042333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:37.224434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:18:37.224873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:18:37.225363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:18:37.230284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:18:37.232614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:18:37.384600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:37.396218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:37.399629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:37.400623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:37.404932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:37.405877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:37.406508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:37.507845 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fe2e7312-2db2-4a1c-aa6f-83dbb75b1c94 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "POST /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61/action" status: 202 len: 1138 microversion: 2.57 time: 0.500562 Aug 27 05:18:37.536314 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2500/5004] 10.222.0.58 () {62 vars in 1320 bytes} [Sat Aug 27 05:18:37 2022] POST /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61/action => generated 1138 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 05:18:37.546935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:37.547877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:37.567155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:37.567751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:37.568127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:37.568872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:37.571435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f286aba-1c89-4662-bf11-fd3ecfbdcbb6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:37.572082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4f286aba-1c89-4662-bf11-fd3ecfbdcbb6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:37.575055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:37.576118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:37.589687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:37.602401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f286aba-1c89-4662-bf11-fd3ecfbdcbb6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:37.603187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f286aba-1c89-4662-bf11-fd3ecfbdcbb6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:37.604614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f286aba-1c89-4662-bf11-fd3ecfbdcbb6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:37.606291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f286aba-1c89-4662-bf11-fd3ecfbdcbb6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:37.611315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f286aba-1c89-4662-bf11-fd3ecfbdcbb6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:37.612229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f286aba-1c89-4662-bf11-fd3ecfbdcbb6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:37.704256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:37.933292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:38.499186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:38.524110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:38.529777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:38.560662 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-393d8326-5fd8-4bc8-bd85-c47be8a9bf2a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.992210 Aug 27 05:18:38.561787 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2505/5005] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:37 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:18:38.581072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-19001b3f-a891-4d56-94e2-73da215ed08a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:38.586554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-19001b3f-a891-4d56-94e2-73da215ed08a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:38.623342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19001b3f-a891-4d56-94e2-73da215ed08a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:38.625874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19001b3f-a891-4d56-94e2-73da215ed08a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:38.627572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19001b3f-a891-4d56-94e2-73da215ed08a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:38.637195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19001b3f-a891-4d56-94e2-73da215ed08a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:38.638268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19001b3f-a891-4d56-94e2-73da215ed08a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:38.639297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19001b3f-a891-4d56-94e2-73da215ed08a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:39.299018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-19001b3f-a891-4d56-94e2-73da215ed08a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:39.313430 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-19001b3f-a891-4d56-94e2-73da215ed08a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1516 microversion: 2.1 time: 0.747433 Aug 27 05:18:39.327694 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2506/5006] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:38 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1516 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:39.375336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f286aba-1c89-4662-bf11-fd3ecfbdcbb6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:39.385228 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f286aba-1c89-4662-bf11-fd3ecfbdcbb6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 1.829320 Aug 27 05:18:39.386407 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2501/5007] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:37 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:39.590733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:39.592037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:39.613427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:39.614470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:39.615493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:39.616761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:39.617521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:39.618178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:39.755306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:39.769665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:39.772105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:39.774259 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ea3b5312-a971-4554-9614-3b49f3b9d112 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.187268 Aug 27 05:18:39.776713 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2507/5008] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:39 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:40.345711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-098a6e02-9f59-4616-805c-18e2d284c323 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] Calling method '.version_select at 0x7fb56486a550>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:40.349714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60c0021f-321c-453b-b2b9-0a1527d5aab3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:40.351576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60c0021f-321c-453b-b2b9-0a1527d5aab3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:40.391717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60c0021f-321c-453b-b2b9-0a1527d5aab3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:40.392756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60c0021f-321c-453b-b2b9-0a1527d5aab3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:40.405362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60c0021f-321c-453b-b2b9-0a1527d5aab3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:40.407285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60c0021f-321c-453b-b2b9-0a1527d5aab3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:40.407978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60c0021f-321c-453b-b2b9-0a1527d5aab3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:40.408629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60c0021f-321c-453b-b2b9-0a1527d5aab3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:40.505683 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-098a6e02-9f59-4616-805c-18e2d284c323 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/5d42b1a5-47f7-4219-a9da-d408c0d3c11c" status: 200 len: 350 microversion: 2.1 time: 0.165293 Aug 27 05:18:40.521417 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2508/5009] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:18:40 2022] GET /compute/v2.1/os-volumes/5d42b1a5-47f7-4219-a9da-d408c0d3c11c => generated 350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:40.545102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d19b6fe-44c8-433b-b0a8-194f152d5d0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:40.546061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d19b6fe-44c8-433b-b0a8-194f152d5d0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:40.585965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d19b6fe-44c8-433b-b0a8-194f152d5d0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:40.586846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d19b6fe-44c8-433b-b0a8-194f152d5d0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:40.587681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d19b6fe-44c8-433b-b0a8-194f152d5d0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:40.611542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d19b6fe-44c8-433b-b0a8-194f152d5d0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:40.612515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d19b6fe-44c8-433b-b0a8-194f152d5d0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:40.619171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d19b6fe-44c8-433b-b0a8-194f152d5d0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:41.138493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d19b6fe-44c8-433b-b0a8-194f152d5d0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:41.148685 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d19b6fe-44c8-433b-b0a8-194f152d5d0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 0.625589 Aug 27 05:18:41.167227 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2509/5010] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:40 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:41.167227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:41.167227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:41.168035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-60c0021f-321c-453b-b2b9-0a1527d5aab3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:41.168257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:41.168257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:41.168257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:41.168257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:41.168257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:41.168257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:41.190595 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-60c0021f-321c-453b-b2b9-0a1527d5aab3 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1516 microversion: 2.1 time: 0.858683 Aug 27 05:18:41.205278 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2502/5011] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:40 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1516 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:41.314039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:41.324434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:41.331438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:41.333175 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-32544819-bf09-4345-ba9c-1b2f5d0b6c9f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.182228 Aug 27 05:18:41.351789 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2510/5012] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:41 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:42.188995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-21b5a9e2-71ec-444e-b650-ca8437c67462 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:42.189807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-21b5a9e2-71ec-444e-b650-ca8437c67462 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:42.200919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21b5a9e2-71ec-444e-b650-ca8437c67462 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:42.200919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21b5a9e2-71ec-444e-b650-ca8437c67462 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:42.200919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21b5a9e2-71ec-444e-b650-ca8437c67462 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:42.201458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21b5a9e2-71ec-444e-b650-ca8437c67462 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:42.202099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21b5a9e2-71ec-444e-b650-ca8437c67462 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:42.202721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21b5a9e2-71ec-444e-b650-ca8437c67462 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:42.230659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a377c1f7-5b56-4cbf-9ae8-5eae36a97dc4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:42.231433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a377c1f7-5b56-4cbf-9ae8-5eae36a97dc4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:42.246359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a377c1f7-5b56-4cbf-9ae8-5eae36a97dc4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:42.246868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a377c1f7-5b56-4cbf-9ae8-5eae36a97dc4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:42.254353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a377c1f7-5b56-4cbf-9ae8-5eae36a97dc4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:42.255264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a377c1f7-5b56-4cbf-9ae8-5eae36a97dc4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:42.256268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a377c1f7-5b56-4cbf-9ae8-5eae36a97dc4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:42.257218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a377c1f7-5b56-4cbf-9ae8-5eae36a97dc4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:42.571805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-21b5a9e2-71ec-444e-b650-ca8437c67462 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:42.587996 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-21b5a9e2-71ec-444e-b650-ca8437c67462 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 0.403996 Aug 27 05:18:42.591943 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2503/5013] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:42 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:42.596237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:42.596968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:42.621395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:42.622033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:42.622555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:42.623339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:42.623809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:42.624250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:42.675433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a377c1f7-5b56-4cbf-9ae8-5eae36a97dc4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:42.678861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:42.694190 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a377c1f7-5b56-4cbf-9ae8-5eae36a97dc4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1516 microversion: 2.1 time: 0.468134 Aug 27 05:18:42.712775 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2511/5014] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:42 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1516 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:42.738345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:42.768580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:42.771839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:42.773826 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cbeb6594-4c33-42fe-a75c-1c99692c68d2 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.182976 Aug 27 05:18:42.774842 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2504/5015] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:42 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:43.473900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-470e0863-d495-4544-8adc-2f625ec146d2 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] Calling method '.version_select at 0x7fb56405a550>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:43.606953 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-470e0863-d495-4544-8adc-2f625ec146d2 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/53729ce2-3c7b-4c7c-bb4b-1d8038b69b4f" status: 200 len: 350 microversion: 2.1 time: 0.139700 Aug 27 05:18:43.608987 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2512/5016] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:18:43 2022] GET /compute/v2.1/os-volumes/53729ce2-3c7b-4c7c-bb4b-1d8038b69b4f => generated 350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:18:43.620976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-31ce6fc9-0b8b-483d-8f41-a3012e109db4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:43.628188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-31ce6fc9-0b8b-483d-8f41-a3012e109db4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:43.660196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31ce6fc9-0b8b-483d-8f41-a3012e109db4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:43.660710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31ce6fc9-0b8b-483d-8f41-a3012e109db4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:43.661187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31ce6fc9-0b8b-483d-8f41-a3012e109db4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:43.661932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31ce6fc9-0b8b-483d-8f41-a3012e109db4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:43.662395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31ce6fc9-0b8b-483d-8f41-a3012e109db4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:43.663009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31ce6fc9-0b8b-483d-8f41-a3012e109db4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:43.726347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-67529c3f-1fba-4718-93a5-36e88512283a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:43.727498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-67529c3f-1fba-4718-93a5-36e88512283a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:43.768098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67529c3f-1fba-4718-93a5-36e88512283a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:43.770653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67529c3f-1fba-4718-93a5-36e88512283a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:43.771835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67529c3f-1fba-4718-93a5-36e88512283a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:43.774558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67529c3f-1fba-4718-93a5-36e88512283a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:43.781343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67529c3f-1fba-4718-93a5-36e88512283a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:43.784132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67529c3f-1fba-4718-93a5-36e88512283a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:44.574657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-67529c3f-1fba-4718-93a5-36e88512283a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:44.595706 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-67529c3f-1fba-4718-93a5-36e88512283a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1516 microversion: 2.1 time: 0.877969 Aug 27 05:18:44.596566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-31ce6fc9-0b8b-483d-8f41-a3012e109db4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:44.603589 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2513/5017] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:43 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1516 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:44.607358 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-31ce6fc9-0b8b-483d-8f41-a3012e109db4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 0.999036 Aug 27 05:18:44.609060 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2505/5018] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:43 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:44.617787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:44.618410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:44.627657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:44.630457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:44.631647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:44.633264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:44.635764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:44.636412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:44.905400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:44.927808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:44.936396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:44.939601 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b351155b-0529-409f-ba41-dd180afe1ad4 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.332866 Aug 27 05:18:44.941864 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2514/5019] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:44 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:45.632880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3753fcac-c81f-466e-932c-f6a108ea535a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:45.633914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3753fcac-c81f-466e-932c-f6a108ea535a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:45.642330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5bed8c1c-90a2-4720-b654-6100306fbd72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:45.643419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5bed8c1c-90a2-4720-b654-6100306fbd72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:45.645336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3753fcac-c81f-466e-932c-f6a108ea535a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:45.645986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3753fcac-c81f-466e-932c-f6a108ea535a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:45.646279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3753fcac-c81f-466e-932c-f6a108ea535a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:45.647013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3753fcac-c81f-466e-932c-f6a108ea535a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:45.647506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3753fcac-c81f-466e-932c-f6a108ea535a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:45.647952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3753fcac-c81f-466e-932c-f6a108ea535a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:45.689579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bed8c1c-90a2-4720-b654-6100306fbd72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:45.690097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bed8c1c-90a2-4720-b654-6100306fbd72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:45.693485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bed8c1c-90a2-4720-b654-6100306fbd72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:45.694578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bed8c1c-90a2-4720-b654-6100306fbd72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:45.699202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bed8c1c-90a2-4720-b654-6100306fbd72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:45.699901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5bed8c1c-90a2-4720-b654-6100306fbd72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:46.068701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3753fcac-c81f-466e-932c-f6a108ea535a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:46.080930 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3753fcac-c81f-466e-932c-f6a108ea535a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1516 microversion: 2.1 time: 0.456999 Aug 27 05:18:46.083473 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2506/5020] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:45 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1516 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:46.089585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:46.090831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:46.098477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:46.099309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:46.099989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:46.101582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:46.102231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:46.102840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:46.104260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5bed8c1c-90a2-4720-b654-6100306fbd72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:46.115654 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5bed8c1c-90a2-4720-b654-6100306fbd72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 0.479487 Aug 27 05:18:46.116948 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2515/5021] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:45 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:46.198432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:46.212275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:46.215285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:46.217519 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-46003313-dc26-449d-9970-66f1783f5c16 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.132582 Aug 27 05:18:46.218511 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2507/5022] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:46 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:46.503872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2c858e09-43d0-4a8d-957c-8d6362f2e110 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] Calling method '.version_select at 0x7fb565037670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:46.655731 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2c858e09-43d0-4a8d-957c-8d6362f2e110 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/20aa53ee-0621-42d0-a255-8cd7769c8a81" status: 200 len: 351 microversion: 2.1 time: 0.158146 Aug 27 05:18:46.656994 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2516/5023] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:18:46 2022] GET /compute/v2.1/os-volumes/20aa53ee-0621-42d0-a255-8cd7769c8a81 => generated 351 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:46.677544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ed2f139-abbf-4d8a-bb03-20b164a3c45f tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] Calling method '.version_select at 0x7fb56420f820>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:46.883309 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5ed2f139-abbf-4d8a-bb03-20b164a3c45f tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.212821 Aug 27 05:18:46.885234 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2508/5024] 10.222.0.58 () {58 vars in 1134 bytes} [Sat Aug 27 05:18:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:46.907790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d52c83b3-8f09-4b72-8627-da14c5e18d51 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] Calling method '.version_select at 0x7fb5695165e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:47.075181 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d52c83b3-8f09-4b72-8627-da14c5e18d51 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.177039 Aug 27 05:18:47.089683 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2517/5025] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 05:18:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:47.091544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89d3f03d-bc35-44dc-93c3-1f27f43840cc tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] Calling method '.version_select at 0x7fb56962e430>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:47.135956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f296517f-a9bc-41de-b2d5-3bb01bcee4aa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:47.138345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f296517f-a9bc-41de-b2d5-3bb01bcee4aa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:47.163892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f296517f-a9bc-41de-b2d5-3bb01bcee4aa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:47.164285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f296517f-a9bc-41de-b2d5-3bb01bcee4aa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:47.165947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f296517f-a9bc-41de-b2d5-3bb01bcee4aa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:47.168479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f296517f-a9bc-41de-b2d5-3bb01bcee4aa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:47.169334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f296517f-a9bc-41de-b2d5-3bb01bcee4aa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:47.169943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f296517f-a9bc-41de-b2d5-3bb01bcee4aa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:47.290384 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89d3f03d-bc35-44dc-93c3-1f27f43840cc tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.203925 Aug 27 05:18:47.304880 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2509/5026] 10.222.0.58 () {58 vars in 1134 bytes} [Sat Aug 27 05:18:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:47.318503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-420dbf7c-6710-49c4-a6fe-0c55caab4cb5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:47.320177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-420dbf7c-6710-49c4-a6fe-0c55caab4cb5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:47.339198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420dbf7c-6710-49c4-a6fe-0c55caab4cb5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:47.340225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420dbf7c-6710-49c4-a6fe-0c55caab4cb5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:47.340909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420dbf7c-6710-49c4-a6fe-0c55caab4cb5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:47.342307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420dbf7c-6710-49c4-a6fe-0c55caab4cb5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:47.343243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420dbf7c-6710-49c4-a6fe-0c55caab4cb5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:47.343945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420dbf7c-6710-49c4-a6fe-0c55caab4cb5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:47.706644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f296517f-a9bc-41de-b2d5-3bb01bcee4aa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:47.721922 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f296517f-a9bc-41de-b2d5-3bb01bcee4aa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1516 microversion: 2.1 time: 0.605317 Aug 27 05:18:47.724384 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2518/5027] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:47 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1516 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:47.750577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:47.751689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:47.761428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:47.762060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:47.762577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:47.763644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:47.764580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:47.765491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:47.809785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-420dbf7c-6710-49c4-a6fe-0c55caab4cb5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:47.839849 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-420dbf7c-6710-49c4-a6fe-0c55caab4cb5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1510 microversion: 2.1 time: 0.531714 Aug 27 05:18:47.843677 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2510/5028] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:47 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1510 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:47.873716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-77f003ba-7d7c-4d90-a6a7-78c652923d32 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] Calling method '.version_select at 0x7fb56969c1f0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:47.956670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:47.971215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:47.972833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:47.981243 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-81626890-5979-4836-a142-2165007b0f61 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.247606 Aug 27 05:18:47.982019 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2519/5029] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:47 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:48.132072 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-77f003ba-7d7c-4d90-a6a7-78c652923d32 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.267481 Aug 27 05:18:48.133184 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2511/5030] 10.222.0.58 () {58 vars in 1167 bytes} [Sat Aug 27 05:18:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:48.156741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-032f08cf-dc0d-4849-bf42-f60586530d52 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] Calling method '.version_select at 0x7fb565b31f70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:48.340527 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-032f08cf-dc0d-4849-bf42-f60586530d52 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.187962 Aug 27 05:18:48.342128 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2520/5031] 10.222.0.58 () {58 vars in 1170 bytes} [Sat Aug 27 05:18:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:48.358870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7848a3d7-18cb-438a-afa1-d88a76bb35d9 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] Calling method '.version_select at 0x7fb564223700>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:48.551696 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7848a3d7-18cb-438a-afa1-d88a76bb35d9 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.197711 Aug 27 05:18:48.558083 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2512/5032] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 05:18:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:48.574184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f9eadd1-c812-4f3e-80d5-0dd784fc7c33 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] Calling method '.version_select at 0x7fb565806280>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:48.699929 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f9eadd1-c812-4f3e-80d5-0dd784fc7c33 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.131294 Aug 27 05:18:48.722015 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2521/5033] 10.222.0.58 () {58 vars in 1188 bytes} [Sat Aug 27 05:18:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:48.724653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ee8bbd04-d3d0-448d-bd83-dbaf9ab5f006 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] Calling method '.version_select at 0x7fb56962e280>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:48.752979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e7c923b9-5d0e-49da-acad-a1d57f2eb4c6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:48.759403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e7c923b9-5d0e-49da-acad-a1d57f2eb4c6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:48.775447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=52 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:48.778006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c923b9-5d0e-49da-acad-a1d57f2eb4c6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:48.781518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c923b9-5d0e-49da-acad-a1d57f2eb4c6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:48.788002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c923b9-5d0e-49da-acad-a1d57f2eb4c6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:48.789110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c923b9-5d0e-49da-acad-a1d57f2eb4c6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:48.789862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c923b9-5d0e-49da-acad-a1d57f2eb4c6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:48.790526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c923b9-5d0e-49da-acad-a1d57f2eb4c6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:48.990511 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ee8bbd04-d3d0-448d-bd83-dbaf9ab5f006 tempest-VolumesTestJSON-530582359 tempest-VolumesTestJSON-530582359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.277900 Aug 27 05:18:49.003517 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2513/5034] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 05:18:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:49.025178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b1f0d9e2-150e-461e-a61b-20ce89e44a3a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:49.035865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b1f0d9e2-150e-461e-a61b-20ce89e44a3a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:49.059369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1f0d9e2-150e-461e-a61b-20ce89e44a3a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:49.060780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1f0d9e2-150e-461e-a61b-20ce89e44a3a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:49.061774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1f0d9e2-150e-461e-a61b-20ce89e44a3a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:49.062913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1f0d9e2-150e-461e-a61b-20ce89e44a3a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:49.064204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1f0d9e2-150e-461e-a61b-20ce89e44a3a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:49.064914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1f0d9e2-150e-461e-a61b-20ce89e44a3a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:49.422331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e7c923b9-5d0e-49da-acad-a1d57f2eb4c6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:49.435917 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e7c923b9-5d0e-49da-acad-a1d57f2eb4c6 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1516 microversion: 2.1 time: 0.686291 Aug 27 05:18:49.438708 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2522/5035] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:48 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1516 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:49.449445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:49.451132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:49.470527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:49.471816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:49.472542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:49.473860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:49.475063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:49.475983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:49.719820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:49.739680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:49.744913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:49.747880 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e5a31333-0f86-48f8-9f1a-7dea236915d5 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.307085 Aug 27 05:18:49.749027 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2523/5036] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:49 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:49.820076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b1f0d9e2-150e-461e-a61b-20ce89e44a3a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:49.836346 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b1f0d9e2-150e-461e-a61b-20ce89e44a3a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1487 microversion: 2.1 time: 0.831392 Aug 27 05:18:49.847619 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2514/5037] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:49 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1487 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:49.863712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-555c99dd-b23a-4ebf-b554-2ffc7abb5de5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:49.868654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-555c99dd-b23a-4ebf-b554-2ffc7abb5de5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:49.877133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555c99dd-b23a-4ebf-b554-2ffc7abb5de5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:49.877708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555c99dd-b23a-4ebf-b554-2ffc7abb5de5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:49.878189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555c99dd-b23a-4ebf-b554-2ffc7abb5de5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:49.880465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555c99dd-b23a-4ebf-b554-2ffc7abb5de5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:49.881287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555c99dd-b23a-4ebf-b554-2ffc7abb5de5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:49.882063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-555c99dd-b23a-4ebf-b554-2ffc7abb5de5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:49.969734 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-555c99dd-b23a-4ebf-b554-2ffc7abb5de5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 200 len: 137 microversion: 2.1 time: 0.109101 Aug 27 05:18:49.985202 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2524/5038] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:18:49 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 137 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:49.989354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d68a6251-6890-4315-a0f8-96e70fce81c7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:49.990737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d68a6251-6890-4315-a0f8-96e70fce81c7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:49.999491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d68a6251-6890-4315-a0f8-96e70fce81c7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:50.000402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d68a6251-6890-4315-a0f8-96e70fce81c7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:50.001051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d68a6251-6890-4315-a0f8-96e70fce81c7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:50.002176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d68a6251-6890-4315-a0f8-96e70fce81c7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:50.002997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d68a6251-6890-4315-a0f8-96e70fce81c7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:50.003682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d68a6251-6890-4315-a0f8-96e70fce81c7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:50.339814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d68a6251-6890-4315-a0f8-96e70fce81c7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:50.354037 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d68a6251-6890-4315-a0f8-96e70fce81c7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.373182 Aug 27 05:18:50.357300 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2515/5039] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:49 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:50.398360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f9f5b8f-2393-4467-a579-18a97b7eed6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:50.416233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0f9f5b8f-2393-4467-a579-18a97b7eed6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:50.430469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f9f5b8f-2393-4467-a579-18a97b7eed6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:50.430985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f9f5b8f-2393-4467-a579-18a97b7eed6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:50.431473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f9f5b8f-2393-4467-a579-18a97b7eed6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:50.432256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f9f5b8f-2393-4467-a579-18a97b7eed6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:50.432733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f9f5b8f-2393-4467-a579-18a97b7eed6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:50.439591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f9f5b8f-2393-4467-a579-18a97b7eed6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:50.473591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ffecc93-d062-4be4-94de-246c237417dd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:50.474385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6ffecc93-d062-4be4-94de-246c237417dd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:50.483455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffecc93-d062-4be4-94de-246c237417dd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:50.484043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffecc93-d062-4be4-94de-246c237417dd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:50.485033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffecc93-d062-4be4-94de-246c237417dd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:50.488369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffecc93-d062-4be4-94de-246c237417dd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:50.489467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffecc93-d062-4be4-94de-246c237417dd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:50.490284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ffecc93-d062-4be4-94de-246c237417dd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:50.762713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0f9f5b8f-2393-4467-a579-18a97b7eed6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:50.789872 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f9f5b8f-2393-4467-a579-18a97b7eed6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.401544 Aug 27 05:18:50.790467 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2525/5040] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:50 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:50.824752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:50.825397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:50.832432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:50.833191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:50.834070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:50.835259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:50.835955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:50.836620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:50.939146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6ffecc93-d062-4be4-94de-246c237417dd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:50.960104 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6ffecc93-d062-4be4-94de-246c237417dd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1522 microversion: 2.1 time: 0.491609 Aug 27 05:18:50.961084 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2516/5041] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:50 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:18:50.975011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01a43798-8b29-4d62-b37a-0f40944d143b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:50.975968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-01a43798-8b29-4d62-b37a-0f40944d143b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:50.989190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:50.996291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a43798-8b29-4d62-b37a-0f40944d143b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:50.996791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a43798-8b29-4d62-b37a-0f40944d143b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:50.999882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a43798-8b29-4d62-b37a-0f40944d143b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:51.003404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a43798-8b29-4d62-b37a-0f40944d143b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:51.004093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a43798-8b29-4d62-b37a-0f40944d143b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:51.004556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a43798-8b29-4d62-b37a-0f40944d143b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:51.005236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:51.008750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:51.015613 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7cb729ee-9fbb-4fa1-aa3c-efa949fe3283 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.211006 Aug 27 05:18:51.016953 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2526/5042] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:50 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:51.404989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-01a43798-8b29-4d62-b37a-0f40944d143b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:51.407911 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01a43798-8b29-4d62-b37a-0f40944d143b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.445442 Aug 27 05:18:51.413291 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2517/5043] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:50 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:51.455556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22ead532-ea1e-4dc6-bdc6-ab84c344710b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:51.466023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22ead532-ea1e-4dc6-bdc6-ab84c344710b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:51.483569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ead532-ea1e-4dc6-bdc6-ab84c344710b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:51.487057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ead532-ea1e-4dc6-bdc6-ab84c344710b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:51.488101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ead532-ea1e-4dc6-bdc6-ab84c344710b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:51.489951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ead532-ea1e-4dc6-bdc6-ab84c344710b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:51.492404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ead532-ea1e-4dc6-bdc6-ab84c344710b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:51.494596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ead532-ea1e-4dc6-bdc6-ab84c344710b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:51.927494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-22ead532-ea1e-4dc6-bdc6-ab84c344710b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:51.941991 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22ead532-ea1e-4dc6-bdc6-ab84c344710b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.498231 Aug 27 05:18:51.942654 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2527/5044] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:51 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:51.985462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f995ec1f-cb05-4485-b5ea-6a19f9699d08 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:51.986411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f995ec1f-cb05-4485-b5ea-6a19f9699d08 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:52.000796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f995ec1f-cb05-4485-b5ea-6a19f9699d08 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:52.003849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f995ec1f-cb05-4485-b5ea-6a19f9699d08 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:52.006772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f995ec1f-cb05-4485-b5ea-6a19f9699d08 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:52.010623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f995ec1f-cb05-4485-b5ea-6a19f9699d08 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:52.011379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f995ec1f-cb05-4485-b5ea-6a19f9699d08 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:52.012196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f995ec1f-cb05-4485-b5ea-6a19f9699d08 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:52.042926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:52.043989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:52.058369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:52.063669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:52.064377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:52.065416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:52.067282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:52.067913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:52.325948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:52.338630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:52.346943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:52.348779 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e57e46a0-7128-4d3b-b2c1-d7b5d186802a tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.310987 Aug 27 05:18:52.360740 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2528/5045] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:52 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:18:52.406928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2116201019", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "dc52ef93-257f-431d-a3c4-4629a0c53bfc"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:52.531284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] validate_networks() for [('dc52ef93-257f-431d-a3c4-4629a0c53bfc', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:18:52.768079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f995ec1f-cb05-4485-b5ea-6a19f9699d08 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:52.780118 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f995ec1f-cb05-4485-b5ea-6a19f9699d08 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1522 microversion: 2.1 time: 0.800282 Aug 27 05:18:52.782624 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2518/5046] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:51 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1522 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:53.318602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-8514db0b-5d6f-4d5a-8343-60d386d6d4f0 req-b3924aa3-6cea-4e52-b9ee-91564a1c2e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f", "name": "network-vif-unplugged", "status": "completed", "tag": "0e3c29c1-6ec1-4cf0-9b9d-57ff2724699d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:53.372623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8514db0b-5d6f-4d5a-8343-60d386d6d4f0 req-b3924aa3-6cea-4e52-b9ee-91564a1c2e92 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:53.373028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8514db0b-5d6f-4d5a-8343-60d386d6d4f0 req-b3924aa3-6cea-4e52-b9ee-91564a1c2e92 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:53.373474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8514db0b-5d6f-4d5a-8343-60d386d6d4f0 req-b3924aa3-6cea-4e52-b9ee-91564a1c2e92 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:53.393622 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-8514db0b-5d6f-4d5a-8343-60d386d6d4f0 req-b3924aa3-6cea-4e52-b9ee-91564a1c2e92 service nova] Creating event network-vif-unplugged:0e3c29c1-6ec1-4cf0-9b9d-57ff2724699d for instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f on n-h1-820368-35 Aug 27 05:18:53.405818 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-8514db0b-5d6f-4d5a-8343-60d386d6d4f0 req-b3924aa3-6cea-4e52-b9ee-91564a1c2e92 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094208 Aug 27 05:18:53.407304 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2519/5047] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:53.414494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:53.415816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:53.426699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:53.427739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:53.428577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:53.429798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:53.430601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:53.431434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:53.879492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:53.904369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:53.910272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:53.914469 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c7297fa-86b3-4894-9260-954c5fa0630f tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.504637 Aug 27 05:18:53.935497 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2520/5048] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:53 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:53.939735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-58d7cb4a-fb05-4f58-81e9-4106e9ae8597 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:53.942375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-58d7cb4a-fb05-4f58-81e9-4106e9ae8597 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:53.986119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d7cb4a-fb05-4f58-81e9-4106e9ae8597 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:53.987464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d7cb4a-fb05-4f58-81e9-4106e9ae8597 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:53.988169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d7cb4a-fb05-4f58-81e9-4106e9ae8597 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:53.989003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d7cb4a-fb05-4f58-81e9-4106e9ae8597 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:53.989479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d7cb4a-fb05-4f58-81e9-4106e9ae8597 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:53.989914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-58d7cb4a-fb05-4f58-81e9-4106e9ae8597 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:54.799810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-58d7cb4a-fb05-4f58-81e9-4106e9ae8597 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:54.813524 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-58d7cb4a-fb05-4f58-81e9-4106e9ae8597 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1522 microversion: 2.1 time: 0.891989 Aug 27 05:18:54.820880 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2521/5049] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:53 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1522 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:54.903451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:18:54.904197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:18:54.904413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:18:54.904738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:18:54.905178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:18:54.925402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:54.926343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:54.927038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:54.929488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:54.930370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:54.933617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:54.947110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:54.947916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:54.957780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:54.958620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:54.959315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:54.960903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:54.961589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:54.962253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:54.990625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:18:54.998690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for user dffafef392eb4e1fba13953f47b2d105 and project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:18:55.028690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:18:55.032371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:18:55.100498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:55.129600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:55.132795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:55.134994 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e8133d33-5114-43fc-898b-ea494fa45aab tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.194990 Aug 27 05:18:55.143877 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b00e7bc5-588e-4a8e-aabe-5eff5e704f17 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.780444 Aug 27 05:18:55.145096 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2529/5050] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:18:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:18:55.148021 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2522/5051] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:54 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:18:55.162114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-45f0dd47-69e1-48ed-816a-9867da7d68e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:55.162640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-45f0dd47-69e1-48ed-816a-9867da7d68e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:55.298259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-45f0dd47-69e1-48ed-816a-9867da7d68e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:55.307352 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-45f0dd47-69e1-48ed-816a-9867da7d68e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1215 microversion: 2.1 time: 0.149059 Aug 27 05:18:55.307958 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2530/5052] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:55 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:55.850777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-04d6b9c3-0db4-48bb-9f7e-f896e873fa7f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:55.857906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-04d6b9c3-0db4-48bb-9f7e-f896e873fa7f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:55.891761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04d6b9c3-0db4-48bb-9f7e-f896e873fa7f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:55.896100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04d6b9c3-0db4-48bb-9f7e-f896e873fa7f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:55.897388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04d6b9c3-0db4-48bb-9f7e-f896e873fa7f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:55.901177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04d6b9c3-0db4-48bb-9f7e-f896e873fa7f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:55.902414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04d6b9c3-0db4-48bb-9f7e-f896e873fa7f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:55.910937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04d6b9c3-0db4-48bb-9f7e-f896e873fa7f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:56.172030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:56.173062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:56.197215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04d6b9c3-0db4-48bb-9f7e-f896e873fa7f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:56.202207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:56.217762 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-04d6b9c3-0db4-48bb-9f7e-f896e873fa7f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1522 microversion: 2.1 time: 0.374817 Aug 27 05:18:56.219483 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2523/5053] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:55 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:56.221260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:56.222235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:56.222753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:56.224030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:56.233082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:56.233732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:56.335604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24443d6b-e0a4-46c9-8a23-dd5d3d2cd668 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:56.341508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-24443d6b-e0a4-46c9-8a23-dd5d3d2cd668 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:56.370373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:56.375853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24443d6b-e0a4-46c9-8a23-dd5d3d2cd668 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:56.380208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24443d6b-e0a4-46c9-8a23-dd5d3d2cd668 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:56.384170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24443d6b-e0a4-46c9-8a23-dd5d3d2cd668 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:56.387023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24443d6b-e0a4-46c9-8a23-dd5d3d2cd668 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:56.391559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24443d6b-e0a4-46c9-8a23-dd5d3d2cd668 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:56.393324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24443d6b-e0a4-46c9-8a23-dd5d3d2cd668 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:56.502796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:56.541474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:56.583194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:56.584688 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2229e421-aa47-4027-aff1-342c66f5b926 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.423933 Aug 27 05:18:56.585286 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2531/5054] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:56 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:18:56.626681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-24443d6b-e0a4-46c9-8a23-dd5d3d2cd668 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:56.642558 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-24443d6b-e0a4-46c9-8a23-dd5d3d2cd668 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1211 microversion: 2.1 time: 0.316331 Aug 27 05:18:56.643544 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2524/5055] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:56 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1211 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:57.254501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-81af6b98-8d8d-4b79-bbe5-0dd84c65930d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:57.256670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-81af6b98-8d8d-4b79-bbe5-0dd84c65930d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:57.271968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81af6b98-8d8d-4b79-bbe5-0dd84c65930d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:57.273497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81af6b98-8d8d-4b79-bbe5-0dd84c65930d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:57.274943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81af6b98-8d8d-4b79-bbe5-0dd84c65930d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:57.277429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81af6b98-8d8d-4b79-bbe5-0dd84c65930d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:57.278937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81af6b98-8d8d-4b79-bbe5-0dd84c65930d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:57.280215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81af6b98-8d8d-4b79-bbe5-0dd84c65930d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:57.627919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:57.638646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:57.656944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:57.659232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:57.660255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:57.661763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:57.664044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:57.665117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:57.844419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-81af6b98-8d8d-4b79-bbe5-0dd84c65930d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:57.872718 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-81af6b98-8d8d-4b79-bbe5-0dd84c65930d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1522 microversion: 2.1 time: 0.623403 Aug 27 05:18:57.879461 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2532/5056] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:57 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1522 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:57.905805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b22af6bd-35c2-48cb-b063-b0c482e5aa0d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:57.921264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b22af6bd-35c2-48cb-b063-b0c482e5aa0d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:57.945461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22af6bd-35c2-48cb-b063-b0c482e5aa0d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:57.948940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22af6bd-35c2-48cb-b063-b0c482e5aa0d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:57.950508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22af6bd-35c2-48cb-b063-b0c482e5aa0d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:57.952048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22af6bd-35c2-48cb-b063-b0c482e5aa0d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:57.953320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22af6bd-35c2-48cb-b063-b0c482e5aa0d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:57.957524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b22af6bd-35c2-48cb-b063-b0c482e5aa0d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:58.083427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:58.112526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:58.117263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:58.123178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d4000e45-e6e2-4e23-84a1-f7e19bd4ac4e tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.510730 Aug 27 05:18:58.127243 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2525/5057] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:57 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:18:58.267540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b22af6bd-35c2-48cb-b063-b0c482e5aa0d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:58.303425 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b22af6bd-35c2-48cb-b063-b0c482e5aa0d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1285 microversion: 2.1 time: 0.419821 Aug 27 05:18:58.305788 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2533/5058] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:57 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1285 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:58.504946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-881f4cc2-4647-4bfe-bcfb-3194c5e71a3e req-6b938f12-e1cf-46e9-955b-8622cbca351a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f", "name": "network-vif-plugged", "status": "completed", "tag": "0e3c29c1-6ec1-4cf0-9b9d-57ff2724699d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:18:58.558849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-881f4cc2-4647-4bfe-bcfb-3194c5e71a3e req-6b938f12-e1cf-46e9-955b-8622cbca351a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:58.562131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-881f4cc2-4647-4bfe-bcfb-3194c5e71a3e req-6b938f12-e1cf-46e9-955b-8622cbca351a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:58.569327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-881f4cc2-4647-4bfe-bcfb-3194c5e71a3e req-6b938f12-e1cf-46e9-955b-8622cbca351a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:58.614900 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-881f4cc2-4647-4bfe-bcfb-3194c5e71a3e req-6b938f12-e1cf-46e9-955b-8622cbca351a service nova] Creating event network-vif-plugged:0e3c29c1-6ec1-4cf0-9b9d-57ff2724699d for instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f on n-h1-820368-35 Aug 27 05:18:58.629915 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-881f4cc2-4647-4bfe-bcfb-3194c5e71a3e req-6b938f12-e1cf-46e9-955b-8622cbca351a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139560 Aug 27 05:18:58.635478 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2526/5059] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:18:58.909942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b05788a0-d281-4b5a-9538-aa4e4119d47d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:58.910818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b05788a0-d281-4b5a-9538-aa4e4119d47d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:58.928696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b05788a0-d281-4b5a-9538-aa4e4119d47d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:58.929496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b05788a0-d281-4b5a-9538-aa4e4119d47d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:58.933341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b05788a0-d281-4b5a-9538-aa4e4119d47d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:58.938498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b05788a0-d281-4b5a-9538-aa4e4119d47d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:58.941291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b05788a0-d281-4b5a-9538-aa4e4119d47d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:58.942027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b05788a0-d281-4b5a-9538-aa4e4119d47d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:59.185683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:59.186360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:59.204826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:59.205649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:59.206308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:59.207780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:59.208482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:59.209090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:59.255430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b05788a0-d281-4b5a-9538-aa4e4119d47d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:59.280491 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b05788a0-d281-4b5a-9538-aa4e4119d47d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1522 microversion: 2.1 time: 0.377045 Aug 27 05:18:59.294812 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2534/5060] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:58 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:18:59.353557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4eabfa06-3613-4a18-b704-66ad9873e400 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:18:59.360148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4eabfa06-3613-4a18-b704-66ad9873e400 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:18:59.401579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eabfa06-3613-4a18-b704-66ad9873e400 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:59.402433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eabfa06-3613-4a18-b704-66ad9873e400 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:59.403230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eabfa06-3613-4a18-b704-66ad9873e400 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:59.404510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eabfa06-3613-4a18-b704-66ad9873e400 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:18:59.405366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eabfa06-3613-4a18-b704-66ad9873e400 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:18:59.419820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eabfa06-3613-4a18-b704-66ad9873e400 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:18:59.498073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:59.942584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:59.966756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:59.974415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:59.977940 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5e54c5c1-d803-49d1-baea-e35880344cc3 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.798937 Aug 27 05:18:59.981359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4eabfa06-3613-4a18-b704-66ad9873e400 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:18:59.982973 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2527/5061] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:18:59 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:19:00.018518 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4eabfa06-3613-4a18-b704-66ad9873e400 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1273 microversion: 2.1 time: 0.674119 Aug 27 05:19:00.020016 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2535/5062] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:18:59 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1273 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:00.330948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-06edb644-216d-4e87-9ed4-0f8387a49e52 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:00.331967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-06edb644-216d-4e87-9ed4-0f8387a49e52 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:00.349706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06edb644-216d-4e87-9ed4-0f8387a49e52 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:00.353932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06edb644-216d-4e87-9ed4-0f8387a49e52 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:00.354648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06edb644-216d-4e87-9ed4-0f8387a49e52 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:00.357581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06edb644-216d-4e87-9ed4-0f8387a49e52 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:00.358634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06edb644-216d-4e87-9ed4-0f8387a49e52 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:00.360071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06edb644-216d-4e87-9ed4-0f8387a49e52 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:01.022957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:01.023895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:01.033693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:01.034511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:01.035840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:01.037138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:01.037907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:01.038477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:01.092530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-06edb644-216d-4e87-9ed4-0f8387a49e52 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:01.108077 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-06edb644-216d-4e87-9ed4-0f8387a49e52 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1522 microversion: 2.1 time: 0.782156 Aug 27 05:19:01.124048 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2528/5063] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:00 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1522 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:01.139208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3556659c-4a52-482a-b301-f5e074eb1463 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:01.142332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3556659c-4a52-482a-b301-f5e074eb1463 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:01.157908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3556659c-4a52-482a-b301-f5e074eb1463 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:01.159381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3556659c-4a52-482a-b301-f5e074eb1463 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:01.165360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3556659c-4a52-482a-b301-f5e074eb1463 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:01.167278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3556659c-4a52-482a-b301-f5e074eb1463 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:01.168183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3556659c-4a52-482a-b301-f5e074eb1463 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:01.169080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3556659c-4a52-482a-b301-f5e074eb1463 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:01.586439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:01.604179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:01.605812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:01.607101 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-adc65958-4ccb-44ba-90c6-33db8fd9e0ef tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.590951 Aug 27 05:19:01.611276 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2536/5064] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:01 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:19:01.882024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3556659c-4a52-482a-b301-f5e074eb1463 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:01.894981 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3556659c-4a52-482a-b301-f5e074eb1463 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1315 microversion: 2.1 time: 0.769149 Aug 27 05:19:01.901674 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2529/5065] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:01 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:02.138999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-875607ba-17f0-448d-88b5-3b46598f5a29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:02.140195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-875607ba-17f0-448d-88b5-3b46598f5a29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:02.149193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-875607ba-17f0-448d-88b5-3b46598f5a29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:02.150636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-875607ba-17f0-448d-88b5-3b46598f5a29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:02.156624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-875607ba-17f0-448d-88b5-3b46598f5a29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:02.157627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-875607ba-17f0-448d-88b5-3b46598f5a29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:02.158228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-875607ba-17f0-448d-88b5-3b46598f5a29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:02.158944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-875607ba-17f0-448d-88b5-3b46598f5a29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:02.455106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-875607ba-17f0-448d-88b5-3b46598f5a29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:02.474334 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-875607ba-17f0-448d-88b5-3b46598f5a29 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1507 microversion: 2.1 time: 0.341881 Aug 27 05:19:02.477241 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2537/5066] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:02 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:02.504059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d110193c-981a-4db4-bfa7-6b492f4f8dc7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:02.506556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d110193c-981a-4db4-bfa7-6b492f4f8dc7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:02.529516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d110193c-981a-4db4-bfa7-6b492f4f8dc7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:02.532692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d110193c-981a-4db4-bfa7-6b492f4f8dc7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:02.534744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d110193c-981a-4db4-bfa7-6b492f4f8dc7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:02.536324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d110193c-981a-4db4-bfa7-6b492f4f8dc7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:02.537693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d110193c-981a-4db4-bfa7-6b492f4f8dc7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:02.538725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d110193c-981a-4db4-bfa7-6b492f4f8dc7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:02.643433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:02.644624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:02.656027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:02.656773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:02.657691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:02.659020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:02.659632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:02.660235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:02.872720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:02.923749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:02.933508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:02.938498 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-37d23517-b284-4311-b204-80fd75f1063b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.306130 Aug 27 05:19:02.942601 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2538/5067] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:02 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:19:02.960516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-968fce3e-4352-4a5b-9bb8-e6f2e63d842f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:02.961521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-968fce3e-4352-4a5b-9bb8-e6f2e63d842f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:02.969486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968fce3e-4352-4a5b-9bb8-e6f2e63d842f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:02.970428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968fce3e-4352-4a5b-9bb8-e6f2e63d842f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:02.971025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968fce3e-4352-4a5b-9bb8-e6f2e63d842f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:02.972182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968fce3e-4352-4a5b-9bb8-e6f2e63d842f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:02.972975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968fce3e-4352-4a5b-9bb8-e6f2e63d842f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:02.973582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968fce3e-4352-4a5b-9bb8-e6f2e63d842f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:02.991802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d110193c-981a-4db4-bfa7-6b492f4f8dc7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:03.014016 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d110193c-981a-4db4-bfa7-6b492f4f8dc7 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 200 len: 1507 microversion: 2.1 time: 0.516302 Aug 27 05:19:03.018325 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2530/5068] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:02 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 1507 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:03.056188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9d3fa244-74e0-4284-933c-8c8d30bdfec1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:03.056713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9d3fa244-74e0-4284-933c-8c8d30bdfec1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:03.086509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3fa244-74e0-4284-933c-8c8d30bdfec1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:03.089573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3fa244-74e0-4284-933c-8c8d30bdfec1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:03.095611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3fa244-74e0-4284-933c-8c8d30bdfec1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:03.098957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3fa244-74e0-4284-933c-8c8d30bdfec1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:03.102267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3fa244-74e0-4284-933c-8c8d30bdfec1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:03.105064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3fa244-74e0-4284-933c-8c8d30bdfec1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:03.199823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9d3fa244-74e0-4284-933c-8c8d30bdfec1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:19:03.454917 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9d3fa244-74e0-4284-933c-8c8d30bdfec1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 204 len: 0 microversion: 2.1 time: 0.404316 Aug 27 05:19:03.460425 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2531/5069] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:19:03 2022] DELETE /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:19:03.465196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-968fce3e-4352-4a5b-9bb8-e6f2e63d842f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:03.505158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f5fc7abf-7828-442d-b62b-b937a3c8a4c5 req-2e932dff-47ac-41f5-96d5-7da19df2e2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef2bf712-7918-4d54-9359-83478697690e", "tag": "f36bee86-0fde-4560-8a15-bee0fd5fcfed"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:03.508011 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-968fce3e-4352-4a5b-9bb8-e6f2e63d842f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1315 microversion: 2.1 time: 0.563571 Aug 27 05:19:03.523997 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2539/5070] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:02 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:03.564099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f5fc7abf-7828-442d-b62b-b937a3c8a4c5 req-2e932dff-47ac-41f5-96d5-7da19df2e2cf service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:03.569947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f5fc7abf-7828-442d-b62b-b937a3c8a4c5 req-2e932dff-47ac-41f5-96d5-7da19df2e2cf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:03.570787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f5fc7abf-7828-442d-b62b-b937a3c8a4c5 req-2e932dff-47ac-41f5-96d5-7da19df2e2cf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:03.646862 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f5fc7abf-7828-442d-b62b-b937a3c8a4c5 req-2e932dff-47ac-41f5-96d5-7da19df2e2cf service nova] Creating event network-changed:f36bee86-0fde-4560-8a15-bee0fd5fcfed for instance ef2bf712-7918-4d54-9359-83478697690e on n-h2-820368-35 Aug 27 05:19:03.676601 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f5fc7abf-7828-442d-b62b-b937a3c8a4c5 req-2e932dff-47ac-41f5-96d5-7da19df2e2cf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213536 Aug 27 05:19:03.688666 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2532/5071] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:19:03.746563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1159457436", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "2aeab05f-61ed-48ec-a332-5b3d621869b3"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:03.845773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] validate_networks() for [('2aeab05f-61ed-48ec-a332-5b3d621869b3', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:19:03.998378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:03.999268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:04.019378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:04.020104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:04.020737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:04.021771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:04.022452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:04.023170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:04.133824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:04.143469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:04.145407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:04.146733 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7be38b38-7ec7-400a-bc98-06bcf1171435 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1366 microversion: 2.57 time: 0.153853 Aug 27 05:19:04.147433 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2533/5072] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:03 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:19:04.561955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ebdab924-09d0-4eff-bf70-5808c0f71ba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:04.562635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ebdab924-09d0-4eff-bf70-5808c0f71ba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:04.586994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebdab924-09d0-4eff-bf70-5808c0f71ba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:04.587862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebdab924-09d0-4eff-bf70-5808c0f71ba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:04.589469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebdab924-09d0-4eff-bf70-5808c0f71ba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:04.590474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebdab924-09d0-4eff-bf70-5808c0f71ba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:04.591244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebdab924-09d0-4eff-bf70-5808c0f71ba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:04.591892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ebdab924-09d0-4eff-bf70-5808c0f71ba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:04.680257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:19:04.682406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:19:04.683412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:19:04.684438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:19:04.685475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:19:04.700925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:04.702404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:04.703473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:04.706301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:04.707545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:04.708579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:04.747381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Getting quotas for project 39c2ef4112e84253b7924d7759080b9f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:19:04.761447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Getting quotas for user a5ad6957c00747888364ff932074db8b and project 39c2ef4112e84253b7924d7759080b9f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:19:04.786155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:19:04.789109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:19:04.868251 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-91ce8d30-39f7-4add-8d84-45e611a8f049 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122512 Aug 27 05:19:04.880636 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2540/5073] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:19:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:19:04.886976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ebdab924-09d0-4eff-bf70-5808c0f71ba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:04.889702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c888a991-9aea-4f39-822c-8f552cef9450 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:04.893931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c888a991-9aea-4f39-822c-8f552cef9450 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:04.899691 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ebdab924-09d0-4eff-bf70-5808c0f71ba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1315 microversion: 2.1 time: 0.354671 Aug 27 05:19:04.901757 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2534/5074] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:04 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:05.062017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c888a991-9aea-4f39-822c-8f552cef9450 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:05.073945 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c888a991-9aea-4f39-822c-8f552cef9450 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1218 microversion: 2.1 time: 0.191988 Aug 27 05:19:05.074569 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2541/5075] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:04 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1218 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:05.172177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:05.172900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:05.179975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:05.180719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:05.181443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:05.182590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:05.183390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:05.184310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:05.295183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:05.305587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:05.307430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:05.309171 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-26563129-9de8-4b2b-8565-d1fb39363077 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1384 microversion: 2.57 time: 0.141828 Aug 27 05:19:05.310384 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2535/5076] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:05 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1384 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:19:05.934234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fab72e82-cd92-4ed5-8fc6-0af077003c93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:05.934985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fab72e82-cd92-4ed5-8fc6-0af077003c93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:05.950235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fab72e82-cd92-4ed5-8fc6-0af077003c93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:05.951345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fab72e82-cd92-4ed5-8fc6-0af077003c93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:05.952892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fab72e82-cd92-4ed5-8fc6-0af077003c93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:05.955459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fab72e82-cd92-4ed5-8fc6-0af077003c93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:05.960280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fab72e82-cd92-4ed5-8fc6-0af077003c93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:05.961179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fab72e82-cd92-4ed5-8fc6-0af077003c93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:06.099471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1da63071-9329-453d-8142-ec73317bd2ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:06.100012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1da63071-9329-453d-8142-ec73317bd2ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:06.117074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1da63071-9329-453d-8142-ec73317bd2ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:06.125926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1da63071-9329-453d-8142-ec73317bd2ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:06.126897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1da63071-9329-453d-8142-ec73317bd2ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:06.128170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1da63071-9329-453d-8142-ec73317bd2ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:06.129059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1da63071-9329-453d-8142-ec73317bd2ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:06.130136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1da63071-9329-453d-8142-ec73317bd2ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:06.304044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1da63071-9329-453d-8142-ec73317bd2ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:06.320881 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1da63071-9329-453d-8142-ec73317bd2ae tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1214 microversion: 2.1 time: 0.228095 Aug 27 05:19:06.325851 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2536/5077] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:06 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1214 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:06.341282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:06.342678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:06.342832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fab72e82-cd92-4ed5-8fc6-0af077003c93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:06.354565 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fab72e82-cd92-4ed5-8fc6-0af077003c93 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1315 microversion: 2.1 time: 0.425032 Aug 27 05:19:06.355381 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2542/5078] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:05 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:06.363236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:06.363236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:06.363236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:06.363236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:06.363236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:06.363236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:06.588723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:06.604152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:06.606939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:06.609041 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae86e6a7-14af-414e-8b34-c7ef87e26671 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1372 microversion: 2.57 time: 0.272122 Aug 27 05:19:06.631612 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2537/5079] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:06 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1372 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:19:07.351498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-72cd0585-73c4-4e7f-8e40-46c7eaf8b07d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:07.352492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-72cd0585-73c4-4e7f-8e40-46c7eaf8b07d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:07.380884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d3083bad-5ea3-4014-a023-eda8b25fa950 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:07.381667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72cd0585-73c4-4e7f-8e40-46c7eaf8b07d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:07.382335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72cd0585-73c4-4e7f-8e40-46c7eaf8b07d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:07.382848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d3083bad-5ea3-4014-a023-eda8b25fa950 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:07.383059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72cd0585-73c4-4e7f-8e40-46c7eaf8b07d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:07.385137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72cd0585-73c4-4e7f-8e40-46c7eaf8b07d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:07.385961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72cd0585-73c4-4e7f-8e40-46c7eaf8b07d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:07.399445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-72cd0585-73c4-4e7f-8e40-46c7eaf8b07d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:07.403230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3083bad-5ea3-4014-a023-eda8b25fa950 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:07.403947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3083bad-5ea3-4014-a023-eda8b25fa950 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:07.404586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3083bad-5ea3-4014-a023-eda8b25fa950 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:07.412635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3083bad-5ea3-4014-a023-eda8b25fa950 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:07.413524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3083bad-5ea3-4014-a023-eda8b25fa950 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:07.414178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3083bad-5ea3-4014-a023-eda8b25fa950 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:07.547592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-72cd0585-73c4-4e7f-8e40-46c7eaf8b07d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:07.591467 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-72cd0585-73c4-4e7f-8e40-46c7eaf8b07d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1278 microversion: 2.1 time: 0.244763 Aug 27 05:19:07.593944 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2543/5080] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:07 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:07.646396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:07.647999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:07.663133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:07.663133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:07.663596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:07.666206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:07.666752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:07.667211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:07.862566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d3083bad-5ea3-4014-a023-eda8b25fa950 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:07.879988 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d3083bad-5ea3-4014-a023-eda8b25fa950 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1315 microversion: 2.1 time: 0.505625 Aug 27 05:19:07.891799 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2538/5081] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:07 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:07.913889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:07.937177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:07.940617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:07.941885 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf3d4f2e-6491-4483-9146-4323df94ef4b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1372 microversion: 2.57 time: 0.299793 Aug 27 05:19:07.959123 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2544/5082] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:07 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1372 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:19:08.458508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-dd2c6566-2fa5-44b8-a122-ac01e1c3ea8d req-a8982f3b-1579-4b01-9540-f6c1d3edfcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f", "name": "network-vif-deleted", "tag": "0e3c29c1-6ec1-4cf0-9b9d-57ff2724699d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:08.487500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dd2c6566-2fa5-44b8-a122-ac01e1c3ea8d req-a8982f3b-1579-4b01-9540-f6c1d3edfcab service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:08.488343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dd2c6566-2fa5-44b8-a122-ac01e1c3ea8d req-a8982f3b-1579-4b01-9540-f6c1d3edfcab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:08.488943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dd2c6566-2fa5-44b8-a122-ac01e1c3ea8d req-a8982f3b-1579-4b01-9540-f6c1d3edfcab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:08.505302 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-dd2c6566-2fa5-44b8-a122-ac01e1c3ea8d req-a8982f3b-1579-4b01-9540-f6c1d3edfcab service nova] Creating event network-vif-deleted:0e3c29c1-6ec1-4cf0-9b9d-57ff2724699d for instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f on n-h1-820368-35 Aug 27 05:19:08.530693 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-dd2c6566-2fa5-44b8-a122-ac01e1c3ea8d req-a8982f3b-1579-4b01-9540-f6c1d3edfcab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075613 Aug 27 05:19:08.531911 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2539/5083] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:19:08.624999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab5b58c6-fffd-4b21-8cc4-8916f18a0e49 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:08.626216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ab5b58c6-fffd-4b21-8cc4-8916f18a0e49 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:08.648213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab5b58c6-fffd-4b21-8cc4-8916f18a0e49 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:08.649108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab5b58c6-fffd-4b21-8cc4-8916f18a0e49 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:08.650359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab5b58c6-fffd-4b21-8cc4-8916f18a0e49 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:08.652322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab5b58c6-fffd-4b21-8cc4-8916f18a0e49 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:08.653322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab5b58c6-fffd-4b21-8cc4-8916f18a0e49 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:08.653973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab5b58c6-fffd-4b21-8cc4-8916f18a0e49 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:08.786384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ab5b58c6-fffd-4b21-8cc4-8916f18a0e49 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:08.796266 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ab5b58c6-fffd-4b21-8cc4-8916f18a0e49 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1278 microversion: 2.1 time: 0.175670 Aug 27 05:19:08.796866 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2545/5084] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:08 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:08.908778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-03041ce3-fe24-4a5e-9ac1-967d3c6d1fee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:08.910101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-03041ce3-fe24-4a5e-9ac1-967d3c6d1fee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:08.927171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03041ce3-fe24-4a5e-9ac1-967d3c6d1fee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:08.927667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03041ce3-fe24-4a5e-9ac1-967d3c6d1fee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:08.928692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03041ce3-fe24-4a5e-9ac1-967d3c6d1fee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:08.930042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03041ce3-fe24-4a5e-9ac1-967d3c6d1fee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:08.931469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03041ce3-fe24-4a5e-9ac1-967d3c6d1fee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:08.932563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03041ce3-fe24-4a5e-9ac1-967d3c6d1fee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:08.973498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:08.974134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:08.986003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:08.986845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:08.988159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:08.989111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:08.989802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:08.990460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:09.123807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:09.143180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:09.146153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:09.149138 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-71fb4c66-77ba-44fa-9070-67f176d3f95c tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1372 microversion: 2.57 time: 0.179982 Aug 27 05:19:09.151073 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2546/5085] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:08 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:19:09.248030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-03041ce3-fe24-4a5e-9ac1-967d3c6d1fee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:09.257648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:09.272873 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-03041ce3-fe24-4a5e-9ac1-967d3c6d1fee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1315 microversion: 2.1 time: 0.369611 Aug 27 05:19:09.274161 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2540/5086] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:08 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:09.826937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-944facee-57e5-41a0-bd3b-03c7f05876b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:09.828570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-944facee-57e5-41a0-bd3b-03c7f05876b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:09.848496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944facee-57e5-41a0-bd3b-03c7f05876b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:09.851041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944facee-57e5-41a0-bd3b-03c7f05876b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:09.857902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944facee-57e5-41a0-bd3b-03c7f05876b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:09.858809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944facee-57e5-41a0-bd3b-03c7f05876b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:09.860261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944facee-57e5-41a0-bd3b-03c7f05876b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:09.860261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-944facee-57e5-41a0-bd3b-03c7f05876b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:10.042200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-944facee-57e5-41a0-bd3b-03c7f05876b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:10.080080 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-944facee-57e5-41a0-bd3b-03c7f05876b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1288 microversion: 2.1 time: 0.259400 Aug 27 05:19:10.090740 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2547/5087] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:09 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1288 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:10.174360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:10.175634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:10.187890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:10.188634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:10.189401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:10.190478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:10.191105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:10.191684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:10.300017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-43f5d9b1-1389-4393-8c33-c90650f8cf2f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:10.304768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-43f5d9b1-1389-4393-8c33-c90650f8cf2f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:10.316695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43f5d9b1-1389-4393-8c33-c90650f8cf2f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:10.317387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43f5d9b1-1389-4393-8c33-c90650f8cf2f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:10.317856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43f5d9b1-1389-4393-8c33-c90650f8cf2f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:10.321382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43f5d9b1-1389-4393-8c33-c90650f8cf2f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:10.321382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43f5d9b1-1389-4393-8c33-c90650f8cf2f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:10.321382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43f5d9b1-1389-4393-8c33-c90650f8cf2f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:10.350123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:10.361923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:10.364475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:10.366381 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f31d1b49-1dc9-4cf3-9dc1-35dfcb4bfb2b tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1372 microversion: 2.57 time: 0.195373 Aug 27 05:19:10.367353 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2541/5088] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:10 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:19:10.920198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-43f5d9b1-1389-4393-8c33-c90650f8cf2f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:10.929517 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-43f5d9b1-1389-4393-8c33-c90650f8cf2f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1315 microversion: 2.1 time: 0.636765 Aug 27 05:19:10.944883 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2548/5089] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:10 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:11.112991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fc6c1bdd-9a1e-4497-9ab9-6a2cd9917b31 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:11.113640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fc6c1bdd-9a1e-4497-9ab9-6a2cd9917b31 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:11.130582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc6c1bdd-9a1e-4497-9ab9-6a2cd9917b31 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:11.131541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc6c1bdd-9a1e-4497-9ab9-6a2cd9917b31 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:11.132308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc6c1bdd-9a1e-4497-9ab9-6a2cd9917b31 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:11.133906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc6c1bdd-9a1e-4497-9ab9-6a2cd9917b31 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:11.134751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc6c1bdd-9a1e-4497-9ab9-6a2cd9917b31 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:11.135550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc6c1bdd-9a1e-4497-9ab9-6a2cd9917b31 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:11.387385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fc6c1bdd-9a1e-4497-9ab9-6a2cd9917b31 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:11.391443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:11.391844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:11.399302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:11.400600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:11.401287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:11.402433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:11.406817 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fc6c1bdd-9a1e-4497-9ab9-6a2cd9917b31 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1276 microversion: 2.1 time: 0.297755 Aug 27 05:19:11.408383 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2542/5090] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:11 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1276 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:11.410601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:11.412797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:11.658996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:11.685607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:11.691923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:11.698303 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c3595c59-b87d-490b-b2b7-1e637ba053ec tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1372 microversion: 2.57 time: 0.311181 Aug 27 05:19:11.705188 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2549/5091] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:11 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1372 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:19:11.954972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2948e6c7-c3ce-4d98-a381-a3630d99302b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:11.956082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2948e6c7-c3ce-4d98-a381-a3630d99302b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:11.964632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2948e6c7-c3ce-4d98-a381-a3630d99302b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:11.965242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2948e6c7-c3ce-4d98-a381-a3630d99302b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:11.965758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2948e6c7-c3ce-4d98-a381-a3630d99302b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:11.966563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2948e6c7-c3ce-4d98-a381-a3630d99302b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:11.967229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2948e6c7-c3ce-4d98-a381-a3630d99302b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:11.967694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2948e6c7-c3ce-4d98-a381-a3630d99302b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:12.430360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6e4ab69a-65f9-4cd4-a2ee-f5bd2cec74fa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:12.431561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6e4ab69a-65f9-4cd4-a2ee-f5bd2cec74fa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:12.449429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e4ab69a-65f9-4cd4-a2ee-f5bd2cec74fa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:12.450113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e4ab69a-65f9-4cd4-a2ee-f5bd2cec74fa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:12.454276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e4ab69a-65f9-4cd4-a2ee-f5bd2cec74fa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:12.455288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e4ab69a-65f9-4cd4-a2ee-f5bd2cec74fa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:12.455960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e4ab69a-65f9-4cd4-a2ee-f5bd2cec74fa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:12.456465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e4ab69a-65f9-4cd4-a2ee-f5bd2cec74fa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:12.461520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2948e6c7-c3ce-4d98-a381-a3630d99302b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:12.477347 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2948e6c7-c3ce-4d98-a381-a3630d99302b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1315 microversion: 2.1 time: 0.527960 Aug 27 05:19:12.481496 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2543/5092] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:11 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:12.728934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-59f44343-e06a-4cc4-a11e-bd926c087f64 req-9f9b182f-1710-4f4f-a127-a190abb119af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2bf712-7918-4d54-9359-83478697690e", "name": "network-vif-plugged", "status": "completed", "tag": "f36bee86-0fde-4560-8a15-bee0fd5fcfed"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:12.773599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-59f44343-e06a-4cc4-a11e-bd926c087f64 req-9f9b182f-1710-4f4f-a127-a190abb119af service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:12.817895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-59f44343-e06a-4cc4-a11e-bd926c087f64 req-9f9b182f-1710-4f4f-a127-a190abb119af service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:12.819745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-59f44343-e06a-4cc4-a11e-bd926c087f64 req-9f9b182f-1710-4f4f-a127-a190abb119af service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:12.853454 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-59f44343-e06a-4cc4-a11e-bd926c087f64 req-9f9b182f-1710-4f4f-a127-a190abb119af service nova] Creating event network-vif-plugged:f36bee86-0fde-4560-8a15-bee0fd5fcfed for instance ef2bf712-7918-4d54-9359-83478697690e on n-h2-820368-35 Aug 27 05:19:12.865206 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-59f44343-e06a-4cc4-a11e-bd926c087f64 req-9f9b182f-1710-4f4f-a127-a190abb119af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140261 Aug 27 05:19:12.868876 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2544/5093] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:19:12.882607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:12.884638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:12.897520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:12.898278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:12.899295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:12.901511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:12.902231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:12.904598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:13.064027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6e4ab69a-65f9-4cd4-a2ee-f5bd2cec74fa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:13.080734 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6e4ab69a-65f9-4cd4-a2ee-f5bd2cec74fa tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1318 microversion: 2.1 time: 0.654644 Aug 27 05:19:13.081954 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2550/5094] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:12 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:13.169504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:13.192503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:13.197161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:13.198710 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-52d81ec3-e90e-41f8-83a0-6ab61ffeae78 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1357 microversion: 2.57 time: 0.326935 Aug 27 05:19:13.199497 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2545/5095] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:12 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:19:13.231319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0ebf8aea-bdd8-4498-881e-1cba38beef4d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:13.231826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0ebf8aea-bdd8-4498-881e-1cba38beef4d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:13.239534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ebf8aea-bdd8-4498-881e-1cba38beef4d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:13.240431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ebf8aea-bdd8-4498-881e-1cba38beef4d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:13.241024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ebf8aea-bdd8-4498-881e-1cba38beef4d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:13.241902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ebf8aea-bdd8-4498-881e-1cba38beef4d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:13.242686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ebf8aea-bdd8-4498-881e-1cba38beef4d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:13.243633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ebf8aea-bdd8-4498-881e-1cba38beef4d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:13.281752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0ebf8aea-bdd8-4498-881e-1cba38beef4d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:19:13.413559 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0ebf8aea-bdd8-4498-881e-1cba38beef4d tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "DELETE /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 204 len: 0 microversion: 2.57 time: 0.186443 Aug 27 05:19:13.415186 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2551/5096] 10.222.0.58 () {60 vars in 1280 bytes} [Sat Aug 27 05:19:13 2022] DELETE /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:19:13.425289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:13.426422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:13.437935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:13.438804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:13.439513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:13.441199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:13.442065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:13.442796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:13.510472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-71f03a05-3e58-4354-b970-9bfd9f88e279 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:13.511780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-71f03a05-3e58-4354-b970-9bfd9f88e279 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:13.534275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f03a05-3e58-4354-b970-9bfd9f88e279 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:13.538886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f03a05-3e58-4354-b970-9bfd9f88e279 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:13.540045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f03a05-3e58-4354-b970-9bfd9f88e279 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:13.546772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f03a05-3e58-4354-b970-9bfd9f88e279 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:13.547431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f03a05-3e58-4354-b970-9bfd9f88e279 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:13.548213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71f03a05-3e58-4354-b970-9bfd9f88e279 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:13.566524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:13.630327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:13.660740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:13.662413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:13.663748 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8b585501-6265-403b-835e-0230813f98c6 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1363 microversion: 2.57 time: 0.243928 Aug 27 05:19:13.664334 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2546/5097] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:13 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:19:14.097222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71f03a05-3e58-4354-b970-9bfd9f88e279 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:14.122413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ff8604a-2e79-4148-8070-d7ced4ab0b2a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:14.125589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ff8604a-2e79-4148-8070-d7ced4ab0b2a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:14.130979 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-71f03a05-3e58-4354-b970-9bfd9f88e279 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1315 microversion: 2.1 time: 0.626439 Aug 27 05:19:14.132347 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2552/5098] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:13 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:14.150245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff8604a-2e79-4148-8070-d7ced4ab0b2a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:14.151840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff8604a-2e79-4148-8070-d7ced4ab0b2a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:14.151840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff8604a-2e79-4148-8070-d7ced4ab0b2a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:14.152999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff8604a-2e79-4148-8070-d7ced4ab0b2a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:14.153666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff8604a-2e79-4148-8070-d7ced4ab0b2a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:14.154197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ff8604a-2e79-4148-8070-d7ced4ab0b2a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:14.688890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:14.689603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:14.700940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:14.704961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:14.705564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:14.706024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:14.706774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:14.713400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:14.713977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:14.732237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:14.900264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:14.918129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:14.927977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:14.929366 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c844228e-0c2c-4d3b-a0eb-620721f47d82 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1363 microversion: 2.57 time: 0.245002 Aug 27 05:19:14.943459 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2553/5099] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:14 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:19:15.030861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7ff8604a-2e79-4148-8070-d7ced4ab0b2a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:15.053080 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ff8604a-2e79-4148-8070-d7ced4ab0b2a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1318 microversion: 2.1 time: 0.942163 Aug 27 05:19:15.056384 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2547/5100] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:14 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1318 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:15.095743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=16 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:15.157878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0fdcf1d5-f34d-46a8-8c77-fc6f59b25e3c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:15.158679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0fdcf1d5-f34d-46a8-8c77-fc6f59b25e3c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:15.174997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fdcf1d5-f34d-46a8-8c77-fc6f59b25e3c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:15.176277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fdcf1d5-f34d-46a8-8c77-fc6f59b25e3c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:15.177084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fdcf1d5-f34d-46a8-8c77-fc6f59b25e3c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:15.178447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fdcf1d5-f34d-46a8-8c77-fc6f59b25e3c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:15.180279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fdcf1d5-f34d-46a8-8c77-fc6f59b25e3c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:15.181288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fdcf1d5-f34d-46a8-8c77-fc6f59b25e3c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:15.725343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0fdcf1d5-f34d-46a8-8c77-fc6f59b25e3c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:15.744165 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0fdcf1d5-f34d-46a8-8c77-fc6f59b25e3c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1501 microversion: 2.1 time: 0.592162 Aug 27 05:19:15.744787 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2548/5101] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:15 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1501 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:15.768136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-54493d34-c758-43c8-9948-9ffa0702b446 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:15.772675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-54493d34-c758-43c8-9948-9ffa0702b446 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:15.784086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54493d34-c758-43c8-9948-9ffa0702b446 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:15.784763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54493d34-c758-43c8-9948-9ffa0702b446 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:15.785253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54493d34-c758-43c8-9948-9ffa0702b446 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:15.786070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54493d34-c758-43c8-9948-9ffa0702b446 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:15.786587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54493d34-c758-43c8-9948-9ffa0702b446 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:15.787131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54493d34-c758-43c8-9948-9ffa0702b446 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:15.793831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3931d1cc-05d1-45af-b5a9-4985c67b9f1e req-b19cd424-a49c-4a3b-ac3c-a8d4bf7e0bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ed2da7-e08f-482d-8f2b-453d9e82c1ab", "tag": "6a124679-c4ba-4398-94c1-b29605873991"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:15.816075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3931d1cc-05d1-45af-b5a9-4985c67b9f1e req-b19cd424-a49c-4a3b-ac3c-a8d4bf7e0bc5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:15.820367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3931d1cc-05d1-45af-b5a9-4985c67b9f1e req-b19cd424-a49c-4a3b-ac3c-a8d4bf7e0bc5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:15.820913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3931d1cc-05d1-45af-b5a9-4985c67b9f1e req-b19cd424-a49c-4a3b-ac3c-a8d4bf7e0bc5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:15.846837 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3931d1cc-05d1-45af-b5a9-4985c67b9f1e req-b19cd424-a49c-4a3b-ac3c-a8d4bf7e0bc5 service nova] Creating event network-changed:6a124679-c4ba-4398-94c1-b29605873991 for instance 96ed2da7-e08f-482d-8f2b-453d9e82c1ab on n-h1-820368-35 Aug 27 05:19:15.853697 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-54493d34-c758-43c8-9948-9ffa0702b446 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action" status: 200 len: 14 microversion: 2.1 time: 0.088810 Aug 27 05:19:15.855748 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2549/5102] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:15 2022] POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 05:19:15.859282 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3931d1cc-05d1-45af-b5a9-4985c67b9f1e req-b19cd424-a49c-4a3b-ac3c-a8d4bf7e0bc5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.772414 Aug 27 05:19:15.859282 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2554/5103] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:19:15.955779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:15.957359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:15.965721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:15.969260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:15.971219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:15.973418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:15.974572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:15.975282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:16.081256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-715f4ae3-9c51-4f1e-a57b-0393697e17cf tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:16.082807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:16.083376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-715f4ae3-9c51-4f1e-a57b-0393697e17cf tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:16.083991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:16.084448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:16.084915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lazy-loading 'fault' on Instance uuid 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:19:16.106777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-715f4ae3-9c51-4f1e-a57b-0393697e17cf tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:16.107730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-715f4ae3-9c51-4f1e-a57b-0393697e17cf tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:16.108648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-715f4ae3-9c51-4f1e-a57b-0393697e17cf tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:16.109854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-715f4ae3-9c51-4f1e-a57b-0393697e17cf tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:16.110857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-715f4ae3-9c51-4f1e-a57b-0393697e17cf tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:16.111679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-715f4ae3-9c51-4f1e-a57b-0393697e17cf tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:16.386643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:16.411728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:16.414012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf85e9423049ab810dd16e4ed78e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4dacfa7414e4b830d8b1761eaf015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:16.416220 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6ff9a6e0-efa6-4415-b984-dcef42c49710 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 200 len: 1368 microversion: 2.57 time: 0.465347 Aug 27 05:19:16.416958 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2555/5104] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:15 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 1368 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:19:16.738896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-715f4ae3-9c51-4f1e-a57b-0393697e17cf tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:16.762138 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-715f4ae3-9c51-4f1e-a57b-0393697e17cf tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1318 microversion: 2.1 time: 0.686007 Aug 27 05:19:16.763453 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2550/5105] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:16 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:16.871989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3fd320c7-943b-4b6c-8cc0-ff288da0697b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:16.879894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3fd320c7-943b-4b6c-8cc0-ff288da0697b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:16.895194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd320c7-943b-4b6c-8cc0-ff288da0697b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:16.896229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd320c7-943b-4b6c-8cc0-ff288da0697b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:16.900916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd320c7-943b-4b6c-8cc0-ff288da0697b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:16.902175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd320c7-943b-4b6c-8cc0-ff288da0697b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:16.904995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd320c7-943b-4b6c-8cc0-ff288da0697b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:16.907754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd320c7-943b-4b6c-8cc0-ff288da0697b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:16.979437 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3fd320c7-943b-4b6c-8cc0-ff288da0697b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action" status: 200 len: 14 microversion: 2.1 time: 0.110048 Aug 27 05:19:16.981817 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2556/5106] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:16 2022] POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:19:17.451661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:17.452284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] [instance: 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:17.471112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:17.472223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:17.473766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:17.475188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:17.477412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:17.479421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:17.514101 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] HTTP exception thrown: Instance 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 could not be found. Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Request method failure captured: Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 HTTP/1.1 Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCakihpHqDkIToOSr1Gy2i7inT0M3OEMFkT8Mi_anvo573De3JO2qSHvZ73tkdVgLyi6T9f25jpW7ZjygGDUQ7jUb7jSPJc1qqoSZMb61-y-JmZ77mkjjNmvGHOFf3u6gYhzAS1wFeqVT3V4jyY3fb0HitCMzl-YKVRN4L0dS5TOyYJc Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Openstack-Nova-Api-Version: 2.57 Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 12e4dacfa7414e4b830d8b1761eaf015 Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerShowV257Test-61736690 Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12e4dacfa7414e4b830d8b1761eaf015", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12e4dacfa7414e4b830d8b1761eaf015"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12e4dacfa7414e4b830d8b1761eaf015"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12e4dacfa7414e4b830d8b1761eaf015"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerShowV257Test-61736690 Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 12e4dacfa7414e4b830d8b1761eaf015 Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerShowV257Test-61736690 Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerShowV257Test-61736690-project Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9aaf85e9423049ab810dd16e4ed78e8e Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerShowV257Test-61736690-project Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 could not be found. Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '79d67ffc-bdc1-41f7-bcf0-6e4ec633db61'} Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 could not be found. Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 could not be found. Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:17.517287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:17.521732 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:17.521732 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:17.521732 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:17.521732 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:19:17.521732 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:19:17.521732 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 could not be found. Aug 27 05:19:17.521732 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:17.525444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] Returning 404 to user: Instance 79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:19:17.532404 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-387c15bc-d32b-4f68-bb09-617d05d6acd0 tempest-ServerShowV257Test-61736690 tempest-ServerShowV257Test-61736690-project] 10.222.0.58 "GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61" status: 404 len: 111 microversion: 2.57 time: 0.080899 Aug 27 05:19:17.533661 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2551/5107] 10.222.0.58 () {60 vars in 1277 bytes} [Sat Aug 27 05:19:17 2022] GET /compute/v2.1/servers/79d67ffc-bdc1-41f7-bcf0-6e4ec633db61 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:19:17.797536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-455b9587-764a-4e55-bfeb-06c8733044b4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:17.798615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-455b9587-764a-4e55-bfeb-06c8733044b4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:17.814049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455b9587-764a-4e55-bfeb-06c8733044b4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:17.817413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455b9587-764a-4e55-bfeb-06c8733044b4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:17.818114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455b9587-764a-4e55-bfeb-06c8733044b4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:17.819753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455b9587-764a-4e55-bfeb-06c8733044b4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:17.823018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455b9587-764a-4e55-bfeb-06c8733044b4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:17.823835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-455b9587-764a-4e55-bfeb-06c8733044b4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:17.991451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-380e95d2-6467-4b89-9e78-e5855f83979c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:17.994019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-380e95d2-6467-4b89-9e78-e5855f83979c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:18.007258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380e95d2-6467-4b89-9e78-e5855f83979c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:18.011893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380e95d2-6467-4b89-9e78-e5855f83979c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:18.012371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380e95d2-6467-4b89-9e78-e5855f83979c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:18.013144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380e95d2-6467-4b89-9e78-e5855f83979c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:18.013618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380e95d2-6467-4b89-9e78-e5855f83979c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:18.014062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-380e95d2-6467-4b89-9e78-e5855f83979c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:18.130648 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-380e95d2-6467-4b89-9e78-e5855f83979c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action" status: 200 len: 14 microversion: 2.1 time: 0.142887 Aug 27 05:19:18.139626 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2552/5108] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:17 2022] POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:19:18.191158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-455b9587-764a-4e55-bfeb-06c8733044b4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:18.201281 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-455b9587-764a-4e55-bfeb-06c8733044b4 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1318 microversion: 2.1 time: 0.410157 Aug 27 05:19:18.206315 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2557/5109] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:17 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:19.185813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-62d9fa27-0184-4e79-96c6-62f681e7cd05 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:19.192398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-62d9fa27-0184-4e79-96c6-62f681e7cd05 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:19.210422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62d9fa27-0184-4e79-96c6-62f681e7cd05 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:19.211819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62d9fa27-0184-4e79-96c6-62f681e7cd05 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:19.212893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62d9fa27-0184-4e79-96c6-62f681e7cd05 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:19.215426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62d9fa27-0184-4e79-96c6-62f681e7cd05 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:19.216733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62d9fa27-0184-4e79-96c6-62f681e7cd05 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:19.218403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62d9fa27-0184-4e79-96c6-62f681e7cd05 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:19.233753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-18e3b7e6-c8e1-403a-9044-85556861c9b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:19.236841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-18e3b7e6-c8e1-403a-9044-85556861c9b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:19.271778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e3b7e6-c8e1-403a-9044-85556861c9b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:19.272888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e3b7e6-c8e1-403a-9044-85556861c9b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:19.274301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e3b7e6-c8e1-403a-9044-85556861c9b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:19.278346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e3b7e6-c8e1-403a-9044-85556861c9b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:19.279694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e3b7e6-c8e1-403a-9044-85556861c9b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:19.280696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18e3b7e6-c8e1-403a-9044-85556861c9b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:19.342918 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-62d9fa27-0184-4e79-96c6-62f681e7cd05 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action" status: 200 len: 14 microversion: 2.1 time: 0.197167 Aug 27 05:19:19.344225 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2553/5110] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:19 2022] POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:19:19.820251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-18e3b7e6-c8e1-403a-9044-85556861c9b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:19.837956 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-18e3b7e6-c8e1-403a-9044-85556861c9b5 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1318 microversion: 2.1 time: 0.613890 Aug 27 05:19:19.841001 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2558/5111] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:19 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1318 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:20.355939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-efc0f0ef-80ac-40a0-87e2-56e94b5ba5e7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:20.358266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-efc0f0ef-80ac-40a0-87e2-56e94b5ba5e7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:20.373266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc0f0ef-80ac-40a0-87e2-56e94b5ba5e7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:20.374802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc0f0ef-80ac-40a0-87e2-56e94b5ba5e7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:20.377029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc0f0ef-80ac-40a0-87e2-56e94b5ba5e7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:20.380138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc0f0ef-80ac-40a0-87e2-56e94b5ba5e7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:20.380950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc0f0ef-80ac-40a0-87e2-56e94b5ba5e7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:20.381693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efc0f0ef-80ac-40a0-87e2-56e94b5ba5e7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:20.458016 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-efc0f0ef-80ac-40a0-87e2-56e94b5ba5e7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action" status: 200 len: 14 microversion: 2.1 time: 0.106281 Aug 27 05:19:20.460555 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2554/5112] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:20 2022] POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:19:20.862563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-726c68ca-523b-4821-b7cb-0f0ec662bc17 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:20.863485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-726c68ca-523b-4821-b7cb-0f0ec662bc17 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:20.873322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-726c68ca-523b-4821-b7cb-0f0ec662bc17 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:20.873927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-726c68ca-523b-4821-b7cb-0f0ec662bc17 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:20.874894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-726c68ca-523b-4821-b7cb-0f0ec662bc17 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:20.874894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-726c68ca-523b-4821-b7cb-0f0ec662bc17 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:20.875608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-726c68ca-523b-4821-b7cb-0f0ec662bc17 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:20.875897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-726c68ca-523b-4821-b7cb-0f0ec662bc17 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:21.015982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-667db3f5-2ef7-4a79-8b57-edc952cdecb9 tempest-ExtensionsTest-2007789739 tempest-ExtensionsTest-2007789739-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:21.017670 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-667db3f5-2ef7-4a79-8b57-edc952cdecb9 tempest-ExtensionsTest-2007789739 tempest-ExtensionsTest-2007789739-project] 10.222.0.58 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.229858 Aug 27 05:19:21.019005 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2559/5113] 10.222.0.58 () {58 vars in 1170 bytes} [Sat Aug 27 05:19:20 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:19:21.042306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5fbd21be-faad-45c0-9c12-91db3e2f91c1 tempest-ExtensionsTest-2007789739 tempest-ExtensionsTest-2007789739-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:21.054469 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5fbd21be-faad-45c0-9c12-91db3e2f91c1 tempest-ExtensionsTest-2007789739 tempest-ExtensionsTest-2007789739-project] 10.222.0.58 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.022870 Aug 27 05:19:21.056715 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2560/5114] 10.222.0.58 () {58 vars in 1134 bytes} [Sat Aug 27 05:19:21 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:19:21.473138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53a4aeee-9274-48d2-acbf-8006830a747a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:21.478250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-53a4aeee-9274-48d2-acbf-8006830a747a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:21.506452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a4aeee-9274-48d2-acbf-8006830a747a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:21.507893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-726c68ca-523b-4821-b7cb-0f0ec662bc17 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:21.511469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a4aeee-9274-48d2-acbf-8006830a747a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:21.513199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a4aeee-9274-48d2-acbf-8006830a747a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:21.514775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a4aeee-9274-48d2-acbf-8006830a747a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:21.528904 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-726c68ca-523b-4821-b7cb-0f0ec662bc17 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1318 microversion: 2.1 time: 0.664719 Aug 27 05:19:21.529582 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2555/5115] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:20 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1318 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:21.531969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a4aeee-9274-48d2-acbf-8006830a747a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:21.535392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a4aeee-9274-48d2-acbf-8006830a747a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:21.620156 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-53a4aeee-9274-48d2-acbf-8006830a747a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action" status: 200 len: 14 microversion: 2.1 time: 0.150880 Aug 27 05:19:21.621679 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2561/5116] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:21 2022] POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:19:22.299405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c51a7d1a-07b3-4758-b3f5-62b55a0871b6 req-c83f5959-813c-4957-823e-9466173879ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ed2da7-e08f-482d-8f2b-453d9e82c1ab", "name": "network-vif-plugged", "status": "completed", "tag": "6a124679-c4ba-4398-94c1-b29605873991"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:22.339214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c51a7d1a-07b3-4758-b3f5-62b55a0871b6 req-c83f5959-813c-4957-823e-9466173879ce service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:22.339725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c51a7d1a-07b3-4758-b3f5-62b55a0871b6 req-c83f5959-813c-4957-823e-9466173879ce service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:22.340178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c51a7d1a-07b3-4758-b3f5-62b55a0871b6 req-c83f5959-813c-4957-823e-9466173879ce service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:22.372188 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c51a7d1a-07b3-4758-b3f5-62b55a0871b6 req-c83f5959-813c-4957-823e-9466173879ce service nova] Creating event network-vif-plugged:6a124679-c4ba-4398-94c1-b29605873991 for instance 96ed2da7-e08f-482d-8f2b-453d9e82c1ab on n-h1-820368-35 Aug 27 05:19:22.390767 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c51a7d1a-07b3-4758-b3f5-62b55a0871b6 req-c83f5959-813c-4957-823e-9466173879ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100104 Aug 27 05:19:22.403208 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2556/5117] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:19:22.597321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9ca670a8-197c-4b26-9bd9-41d49ea2df9c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:22.600099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9ca670a8-197c-4b26-9bd9-41d49ea2df9c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:22.637241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca670a8-197c-4b26-9bd9-41d49ea2df9c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:22.638025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca670a8-197c-4b26-9bd9-41d49ea2df9c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:22.640887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca670a8-197c-4b26-9bd9-41d49ea2df9c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:22.641054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-81f5a20d-b48b-4d34-ad2f-4a608fad44e9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:22.642480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca670a8-197c-4b26-9bd9-41d49ea2df9c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:22.645073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca670a8-197c-4b26-9bd9-41d49ea2df9c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:22.646421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ca670a8-197c-4b26-9bd9-41d49ea2df9c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:22.663618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-81f5a20d-b48b-4d34-ad2f-4a608fad44e9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:22.704235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81f5a20d-b48b-4d34-ad2f-4a608fad44e9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:22.705697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81f5a20d-b48b-4d34-ad2f-4a608fad44e9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:22.706761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81f5a20d-b48b-4d34-ad2f-4a608fad44e9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:22.708762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81f5a20d-b48b-4d34-ad2f-4a608fad44e9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:22.709878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81f5a20d-b48b-4d34-ad2f-4a608fad44e9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:22.711322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-81f5a20d-b48b-4d34-ad2f-4a608fad44e9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:22.804515 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-81f5a20d-b48b-4d34-ad2f-4a608fad44e9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action" status: 200 len: 14 microversion: 2.1 time: 0.173826 Aug 27 05:19:22.805403 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2557/5118] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:22 2022] POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:19:23.341144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9ca670a8-197c-4b26-9bd9-41d49ea2df9c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:23.350075 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9ca670a8-197c-4b26-9bd9-41d49ea2df9c tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1318 microversion: 2.1 time: 0.784100 Aug 27 05:19:23.351216 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2562/5119] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:22 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1318 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:23.821172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2efbe964-8060-4634-8331-742e2d3c37fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:23.827472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2efbe964-8060-4634-8331-742e2d3c37fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:23.853019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2efbe964-8060-4634-8331-742e2d3c37fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:23.853611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2efbe964-8060-4634-8331-742e2d3c37fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:23.854325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2efbe964-8060-4634-8331-742e2d3c37fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:23.855204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2efbe964-8060-4634-8331-742e2d3c37fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:23.855749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2efbe964-8060-4634-8331-742e2d3c37fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:23.856259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2efbe964-8060-4634-8331-742e2d3c37fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:23.946192 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2efbe964-8060-4634-8331-742e2d3c37fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action" status: 200 len: 14 microversion: 2.1 time: 0.130442 Aug 27 05:19:23.947178 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2558/5120] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:23 2022] POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:19:24.381733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0a9e58ca-7dea-4cc7-8f1d-9591e3a6ffdd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:24.384311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0a9e58ca-7dea-4cc7-8f1d-9591e3a6ffdd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:24.404595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a9e58ca-7dea-4cc7-8f1d-9591e3a6ffdd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:24.407631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a9e58ca-7dea-4cc7-8f1d-9591e3a6ffdd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:24.409352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a9e58ca-7dea-4cc7-8f1d-9591e3a6ffdd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:24.411999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a9e58ca-7dea-4cc7-8f1d-9591e3a6ffdd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:24.416775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a9e58ca-7dea-4cc7-8f1d-9591e3a6ffdd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:24.417895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a9e58ca-7dea-4cc7-8f1d-9591e3a6ffdd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:24.752340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0a9e58ca-7dea-4cc7-8f1d-9591e3a6ffdd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:24.778034 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0a9e58ca-7dea-4cc7-8f1d-9591e3a6ffdd tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1318 microversion: 2.1 time: 0.404140 Aug 27 05:19:24.793774 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2563/5121] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:24 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:24.959395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6b1448e5-6408-4eda-9980-e90f693a9b26 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:24.964096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6b1448e5-6408-4eda-9980-e90f693a9b26 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:24.982555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1448e5-6408-4eda-9980-e90f693a9b26 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:24.983914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1448e5-6408-4eda-9980-e90f693a9b26 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:24.985871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1448e5-6408-4eda-9980-e90f693a9b26 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:24.987310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1448e5-6408-4eda-9980-e90f693a9b26 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:24.991202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1448e5-6408-4eda-9980-e90f693a9b26 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:24.991917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b1448e5-6408-4eda-9980-e90f693a9b26 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:25.108751 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6b1448e5-6408-4eda-9980-e90f693a9b26 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action" status: 200 len: 14 microversion: 2.1 time: 0.154370 Aug 27 05:19:25.112416 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2559/5122] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:24 2022] POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:19:25.827803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-70ef4c12-5a73-4294-be99-b5588255f1b0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:25.828492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-70ef4c12-5a73-4294-be99-b5588255f1b0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:25.842211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70ef4c12-5a73-4294-be99-b5588255f1b0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:25.842725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70ef4c12-5a73-4294-be99-b5588255f1b0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:25.845118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70ef4c12-5a73-4294-be99-b5588255f1b0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:25.850221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70ef4c12-5a73-4294-be99-b5588255f1b0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:25.850791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70ef4c12-5a73-4294-be99-b5588255f1b0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:25.851271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70ef4c12-5a73-4294-be99-b5588255f1b0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:26.132120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4e9a9bbc-9898-4233-a724-c28eef200916 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:26.137767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4e9a9bbc-9898-4233-a724-c28eef200916 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:26.149653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e9a9bbc-9898-4233-a724-c28eef200916 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:26.150756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e9a9bbc-9898-4233-a724-c28eef200916 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:26.151457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e9a9bbc-9898-4233-a724-c28eef200916 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:26.152455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e9a9bbc-9898-4233-a724-c28eef200916 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:26.153278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e9a9bbc-9898-4233-a724-c28eef200916 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:26.153931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e9a9bbc-9898-4233-a724-c28eef200916 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:26.227011 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4e9a9bbc-9898-4233-a724-c28eef200916 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action" status: 200 len: 14 microversion: 2.1 time: 0.109174 Aug 27 05:19:26.233658 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2560/5123] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:26 2022] POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:19:26.254011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-70ef4c12-5a73-4294-be99-b5588255f1b0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:26.273456 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-70ef4c12-5a73-4294-be99-b5588255f1b0 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1508 microversion: 2.1 time: 0.449555 Aug 27 05:19:26.277222 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2564/5124] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:25 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1508 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:26.332895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-483cad66-c353-40a4-84aa-5af2be6441eb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:26.339355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-483cad66-c353-40a4-84aa-5af2be6441eb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:26.379893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-483cad66-c353-40a4-84aa-5af2be6441eb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:26.384518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-483cad66-c353-40a4-84aa-5af2be6441eb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:26.385772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-483cad66-c353-40a4-84aa-5af2be6441eb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:26.389201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-483cad66-c353-40a4-84aa-5af2be6441eb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:26.391028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-483cad66-c353-40a4-84aa-5af2be6441eb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:26.393980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-483cad66-c353-40a4-84aa-5af2be6441eb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:26.787326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-483cad66-c353-40a4-84aa-5af2be6441eb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:26.811458 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-483cad66-c353-40a4-84aa-5af2be6441eb tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1508 microversion: 2.1 time: 0.495503 Aug 27 05:19:26.812324 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2561/5125] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:26 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1508 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:26.852828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f22ad499-5657-4130-8254-6607facf1a4d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:26.860490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f22ad499-5657-4130-8254-6607facf1a4d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:26.888955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:26.892573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f22ad499-5657-4130-8254-6607facf1a4d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:26.894813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f22ad499-5657-4130-8254-6607facf1a4d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:26.900499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f22ad499-5657-4130-8254-6607facf1a4d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:26.902856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f22ad499-5657-4130-8254-6607facf1a4d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:26.903888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f22ad499-5657-4130-8254-6607facf1a4d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:26.907804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f22ad499-5657-4130-8254-6607facf1a4d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:26.956742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:27.125564 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f22ad499-5657-4130-8254-6607facf1a4d tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "PUT /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1080 microversion: 2.1 time: 0.284950 Aug 27 05:19:27.142552 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2562/5126] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:19:26 2022] PUT /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1080 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:27.150828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8bb803c5-6dbf-4f45-a131-b220f24b228b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:27.153879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8bb803c5-6dbf-4f45-a131-b220f24b228b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:27.171136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bb803c5-6dbf-4f45-a131-b220f24b228b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:27.171637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bb803c5-6dbf-4f45-a131-b220f24b228b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:27.172080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bb803c5-6dbf-4f45-a131-b220f24b228b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:27.172816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bb803c5-6dbf-4f45-a131-b220f24b228b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:27.173276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bb803c5-6dbf-4f45-a131-b220f24b228b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:27.173709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8bb803c5-6dbf-4f45-a131-b220f24b228b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:27.382818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9d5266ec-0491-4373-b99d-fda2ec3991c4 tempest-ComputeTenantNetworksTest-1674081103 tempest-ComputeTenantNetworksTest-1674081103-project] Calling method '.version_select at 0x7fb565783ee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:27.856742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8bb803c5-6dbf-4f45-a131-b220f24b228b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:27.874615 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8bb803c5-6dbf-4f45-a131-b220f24b228b tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1506 microversion: 2.1 time: 0.730371 Aug 27 05:19:27.875279 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2563/5127] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:27 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1506 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:27.896362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f958938c-9d40-46cb-9deb-58fb60e663f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:27.907058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f958938c-9d40-46cb-9deb-58fb60e663f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:27.923893 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9d5266ec-0491-4373-b99d-fda2ec3991c4 tempest-ComputeTenantNetworksTest-1674081103 tempest-ComputeTenantNetworksTest-1674081103-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.121838 Aug 27 05:19:27.930918 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2565/5128] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 05:19:26 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:19:27.930918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-933ecdc4-dcea-43db-9edf-41a42900f018 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:27.931601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-933ecdc4-dcea-43db-9edf-41a42900f018 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:27.933454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f958938c-9d40-46cb-9deb-58fb60e663f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:27.934138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f958938c-9d40-46cb-9deb-58fb60e663f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:27.935270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f958938c-9d40-46cb-9deb-58fb60e663f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:27.942828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f958938c-9d40-46cb-9deb-58fb60e663f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:27.946471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f958938c-9d40-46cb-9deb-58fb60e663f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:27.947060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f958938c-9d40-46cb-9deb-58fb60e663f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:27.959564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-933ecdc4-dcea-43db-9edf-41a42900f018 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:27.960435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-933ecdc4-dcea-43db-9edf-41a42900f018 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:27.964990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-933ecdc4-dcea-43db-9edf-41a42900f018 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:27.967338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-933ecdc4-dcea-43db-9edf-41a42900f018 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:27.970843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-933ecdc4-dcea-43db-9edf-41a42900f018 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:27.975410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-933ecdc4-dcea-43db-9edf-41a42900f018 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:28.093881 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f958938c-9d40-46cb-9deb-58fb60e663f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action" status: 200 len: 16400 microversion: 2.1 time: 0.217233 Aug 27 05:19:28.095365 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2564/5129] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:27 2022] POST /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e/action => generated 16400 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:19:28.108771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c9f2c95-569e-4ac1-9790-e807c77b9885 tempest-ComputeTenantNetworksTest-1674081103 tempest-ComputeTenantNetworksTest-1674081103-project] Calling method '.version_select at 0x7fb56974df70>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:28.367141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-933ecdc4-dcea-43db-9edf-41a42900f018 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:28.381713 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-933ecdc4-dcea-43db-9edf-41a42900f018 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1506 microversion: 2.1 time: 0.455203 Aug 27 05:19:28.382317 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2566/5130] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:27 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:28.401489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e70bdedb-14b3-4491-9de6-565f656e4378 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:28.402374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e70bdedb-14b3-4491-9de6-565f656e4378 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:28.417938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e70bdedb-14b3-4491-9de6-565f656e4378 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:28.421573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e70bdedb-14b3-4491-9de6-565f656e4378 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:28.422099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e70bdedb-14b3-4491-9de6-565f656e4378 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:28.423241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e70bdedb-14b3-4491-9de6-565f656e4378 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:28.423717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e70bdedb-14b3-4491-9de6-565f656e4378 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:28.424149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e70bdedb-14b3-4491-9de6-565f656e4378 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:28.556922 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c9f2c95-569e-4ac1-9790-e807c77b9885 tempest-ComputeTenantNetworksTest-1674081103 tempest-ComputeTenantNetworksTest-1674081103-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks/22ef8f12-5b69-4bea-9121-6677035f22d4" status: 200 len: 140 microversion: 2.1 time: 0.460128 Aug 27 05:19:28.557522 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2565/5131] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 05:19:28 2022] GET /compute/v2.1/os-tenant-networks/22ef8f12-5b69-4bea-9121-6677035f22d4 => generated 140 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:19:28.568142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-50eaccc0-6888-46bb-8f13-46a917e02cd1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:28.575247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-50eaccc0-6888-46bb-8f13-46a917e02cd1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:28.615820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eaccc0-6888-46bb-8f13-46a917e02cd1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:28.617442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eaccc0-6888-46bb-8f13-46a917e02cd1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:28.621516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eaccc0-6888-46bb-8f13-46a917e02cd1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:28.622544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eaccc0-6888-46bb-8f13-46a917e02cd1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:28.623308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eaccc0-6888-46bb-8f13-46a917e02cd1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:28.625836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50eaccc0-6888-46bb-8f13-46a917e02cd1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:28.798292 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-50eaccc0-6888-46bb-8f13-46a917e02cd1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "PUT /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1082 microversion: 2.1 time: 0.238557 Aug 27 05:19:28.811552 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2566/5132] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:19:28 2022] PUT /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1082 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:28.830108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b6c8b14-a5d6-446d-b97f-a0f70901828a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:28.831549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b6c8b14-a5d6-446d-b97f-a0f70901828a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:28.842717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e70bdedb-14b3-4491-9de6-565f656e4378 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:28.846808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b14-a5d6-446d-b97f-a0f70901828a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:28.848829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b14-a5d6-446d-b97f-a0f70901828a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:28.850984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b14-a5d6-446d-b97f-a0f70901828a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:28.853120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b14-a5d6-446d-b97f-a0f70901828a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:28.854073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b14-a5d6-446d-b97f-a0f70901828a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:28.855505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b14-a5d6-446d-b97f-a0f70901828a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:28.881466 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e70bdedb-14b3-4491-9de6-565f656e4378 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.492990 Aug 27 05:19:28.884385 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2567/5133] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:28 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:28.918190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-07307ff7-4195-4ce1-8d5a-cc23b73fc934 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:28.921089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-07307ff7-4195-4ce1-8d5a-cc23b73fc934 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:28.936120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07307ff7-4195-4ce1-8d5a-cc23b73fc934 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:28.936876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07307ff7-4195-4ce1-8d5a-cc23b73fc934 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:28.937496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07307ff7-4195-4ce1-8d5a-cc23b73fc934 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:28.938805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07307ff7-4195-4ce1-8d5a-cc23b73fc934 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:28.939497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07307ff7-4195-4ce1-8d5a-cc23b73fc934 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:28.940069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07307ff7-4195-4ce1-8d5a-cc23b73fc934 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:29.551866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4b6c8b14-a5d6-446d-b97f-a0f70901828a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:29.569075 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b6c8b14-a5d6-446d-b97f-a0f70901828a tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1508 microversion: 2.1 time: 0.743430 Aug 27 05:19:29.575621 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2567/5134] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:28 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1508 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:29.609178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-44b1b600-f9bc-4c4b-859b-a7b9ec3c2247 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:29.610224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-44b1b600-f9bc-4c4b-859b-a7b9ec3c2247 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:29.626627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-07307ff7-4195-4ce1-8d5a-cc23b73fc934 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:29.632212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44b1b600-f9bc-4c4b-859b-a7b9ec3c2247 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:29.633821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44b1b600-f9bc-4c4b-859b-a7b9ec3c2247 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:29.636750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44b1b600-f9bc-4c4b-859b-a7b9ec3c2247 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:29.637541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44b1b600-f9bc-4c4b-859b-a7b9ec3c2247 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:29.639972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44b1b600-f9bc-4c4b-859b-a7b9ec3c2247 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:29.640458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44b1b600-f9bc-4c4b-859b-a7b9ec3c2247 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:29.646275 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-07307ff7-4195-4ce1-8d5a-cc23b73fc934 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.731786 Aug 27 05:19:29.647898 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2568/5135] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:28 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:29.673232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-33c17a72-85ba-442f-a117-6ce06aa72d6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:29.673987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-33c17a72-85ba-442f-a117-6ce06aa72d6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:29.687183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c17a72-85ba-442f-a117-6ce06aa72d6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:29.687757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c17a72-85ba-442f-a117-6ce06aa72d6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:29.688451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c17a72-85ba-442f-a117-6ce06aa72d6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:29.689543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c17a72-85ba-442f-a117-6ce06aa72d6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:29.691832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c17a72-85ba-442f-a117-6ce06aa72d6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:29.692591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33c17a72-85ba-442f-a117-6ce06aa72d6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.041007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-44b1b600-f9bc-4c4b-859b-a7b9ec3c2247 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:30.063984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-33c17a72-85ba-442f-a117-6ce06aa72d6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:30.076623 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-44b1b600-f9bc-4c4b-859b-a7b9ec3c2247 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1508 microversion: 2.1 time: 0.473165 Aug 27 05:19:30.080681 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2568/5136] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:29 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1508 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:30.083491 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-33c17a72-85ba-442f-a117-6ce06aa72d6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.414993 Aug 27 05:19:30.084738 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2569/5137] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:29 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:30.114473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e821c736-3c4d-4b02-a675-3ad5cb2c7c6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:30.115328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e821c736-3c4d-4b02-a675-3ad5cb2c7c6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:30.117524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-181ce426-a672-4e5b-9129-9ed04f4de084 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:30.118677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-181ce426-a672-4e5b-9129-9ed04f4de084 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:30.123216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e821c736-3c4d-4b02-a675-3ad5cb2c7c6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.123719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e821c736-3c4d-4b02-a675-3ad5cb2c7c6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.124202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e821c736-3c4d-4b02-a675-3ad5cb2c7c6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.125146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e821c736-3c4d-4b02-a675-3ad5cb2c7c6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.125767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e821c736-3c4d-4b02-a675-3ad5cb2c7c6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.126343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e821c736-3c4d-4b02-a675-3ad5cb2c7c6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.138569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-181ce426-a672-4e5b-9129-9ed04f4de084 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.141272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-181ce426-a672-4e5b-9129-9ed04f4de084 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.142118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-181ce426-a672-4e5b-9129-9ed04f4de084 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.143362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-181ce426-a672-4e5b-9129-9ed04f4de084 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.144450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-181ce426-a672-4e5b-9129-9ed04f4de084 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.146456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-181ce426-a672-4e5b-9129-9ed04f4de084 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.213732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-181ce426-a672-4e5b-9129-9ed04f4de084 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:19:30.405262 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-181ce426-a672-4e5b-9129-9ed04f4de084 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "DELETE /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 204 len: 0 microversion: 2.1 time: 0.294845 Aug 27 05:19:30.413325 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2569/5138] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:19:30 2022] DELETE /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:19:30.431055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-22acff1c-c963-4dd3-9118-6447ce506e47 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:30.433405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-22acff1c-c963-4dd3-9118-6447ce506e47 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:30.448231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22acff1c-c963-4dd3-9118-6447ce506e47 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.449009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22acff1c-c963-4dd3-9118-6447ce506e47 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.449774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22acff1c-c963-4dd3-9118-6447ce506e47 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.450667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22acff1c-c963-4dd3-9118-6447ce506e47 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.451210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22acff1c-c963-4dd3-9118-6447ce506e47 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.451711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-22acff1c-c963-4dd3-9118-6447ce506e47 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.508804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-22acff1c-c963-4dd3-9118-6447ce506e47 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:19:30.523301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e821c736-3c4d-4b02-a675-3ad5cb2c7c6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:30.534733 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e821c736-3c4d-4b02-a675-3ad5cb2c7c6b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.425603 Aug 27 05:19:30.536711 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2570/5139] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:30 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:30.559506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cee1e086-cc06-4342-9be6-cd939aeb8e6f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:30.560099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cee1e086-cc06-4342-9be6-cd939aeb8e6f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:30.584177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cee1e086-cc06-4342-9be6-cd939aeb8e6f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.584686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cee1e086-cc06-4342-9be6-cd939aeb8e6f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.585192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cee1e086-cc06-4342-9be6-cd939aeb8e6f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.585963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cee1e086-cc06-4342-9be6-cd939aeb8e6f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.586471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cee1e086-cc06-4342-9be6-cd939aeb8e6f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.586907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cee1e086-cc06-4342-9be6-cd939aeb8e6f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.616725 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.compute.api [None req-22acff1c-c963-4dd3-9118-6447ce506e47 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Instance is already in deleting state, ignoring this request Aug 27 05:19:30.618063 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-22acff1c-c963-4dd3-9118-6447ce506e47 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "DELETE /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 204 len: 0 microversion: 2.1 time: 0.195693 Aug 27 05:19:30.622099 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2570/5140] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:19:30 2022] DELETE /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:19:30.632240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1615874d-19a3-4a97-8128-3af9d2154780 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:30.635397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1615874d-19a3-4a97-8128-3af9d2154780 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:30.648571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1615874d-19a3-4a97-8128-3af9d2154780 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.649371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1615874d-19a3-4a97-8128-3af9d2154780 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.649817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1615874d-19a3-4a97-8128-3af9d2154780 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.650813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1615874d-19a3-4a97-8128-3af9d2154780 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.656935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1615874d-19a3-4a97-8128-3af9d2154780 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.659989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1615874d-19a3-4a97-8128-3af9d2154780 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.671243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cee1e086-cc06-4342-9be6-cd939aeb8e6f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Locking {{(pid=128547) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 27 05:19:30.689115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:30.753700 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cee1e086-cc06-4342-9be6-cd939aeb8e6f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.199332 Aug 27 05:19:30.754577 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2571/5141] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:30 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:19:30.775526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-01e7b40a-b703-4a50-bf11-4bc66920fc75 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:30.776614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-01e7b40a-b703-4a50-bf11-4bc66920fc75 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:30.799143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01e7b40a-b703-4a50-bf11-4bc66920fc75 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.800086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01e7b40a-b703-4a50-bf11-4bc66920fc75 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.800744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01e7b40a-b703-4a50-bf11-4bc66920fc75 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:30.802268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01e7b40a-b703-4a50-bf11-4bc66920fc75 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:30.803399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01e7b40a-b703-4a50-bf11-4bc66920fc75 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:30.804035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01e7b40a-b703-4a50-bf11-4bc66920fc75 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:31.243665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-01e7b40a-b703-4a50-bf11-4bc66920fc75 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:31.245752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1615874d-19a3-4a97-8128-3af9d2154780 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:31.259447 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-01e7b40a-b703-4a50-bf11-4bc66920fc75 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.498172 Aug 27 05:19:31.279679 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2572/5142] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:30 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:31.287587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4dcb65b8-6fe1-4b01-93f5-4104bff2231b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:31.296602 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1615874d-19a3-4a97-8128-3af9d2154780 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1514 microversion: 2.1 time: 0.667176 Aug 27 05:19:31.298353 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2571/5143] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:30 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1514 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:31.300369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4dcb65b8-6fe1-4b01-93f5-4104bff2231b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:31.301043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4dcb65b8-6fe1-4b01-93f5-4104bff2231b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:31.301677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4dcb65b8-6fe1-4b01-93f5-4104bff2231b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:31.372088 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-4dcb65b8-6fe1-4b01-93f5-4104bff2231b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] HTTP exception thrown: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 is locked Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4dcb65b8-6fe1-4b01-93f5-4104bff2231b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Request method failure captured: Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action HTTP/1.1 Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 15 Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaf_zdSPUeOsoTLkhLQL1vTlNucAU1rurQ76_s_7oXcF2ursFV7TaLgonjCe-LOZpl42-Z1nMf9A0p5HI8wh23R0xdPIBi9qQEbYtSOcmXJv69LplvzQOu4_pC3DspVSvoXd-nW5ckUmdD57wX3cw_UIfJKHPOT6Ts6e_rIaD18Ozyo Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_57e6b379f0d24ec8aa6da3c4f01bdd7a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: dffafef392eb4e1fba13953f47b2d105 Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: {"os-stop": {}} Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 is locked Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e5f4c359-6f7e-4009-a365-7b070eec11a9', 'body': {'os-stop': {}}} Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1469, in _stop_server Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 is locked Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1471, in _stop_server Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 is locked Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 is locked Aug 27 05:19:31.375693 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:31.385118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4dcb65b8-6fe1-4b01-93f5-4104bff2231b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Returning 409 to user: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 is locked {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:19:31.387522 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4dcb65b8-6fe1-4b01-93f5-4104bff2231b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 409 len: 107 microversion: 2.1 time: 0.105850 Aug 27 05:19:31.393244 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2573/5144] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:31 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 107 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:19:31.411569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01f53e06-4956-4a33-b1f6-063296f5f988 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:31.413727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-01f53e06-4956-4a33-b1f6-063296f5f988 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:31.434713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f53e06-4956-4a33-b1f6-063296f5f988 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:31.436049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f53e06-4956-4a33-b1f6-063296f5f988 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:31.437026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f53e06-4956-4a33-b1f6-063296f5f988 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:31.438544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f53e06-4956-4a33-b1f6-063296f5f988 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:31.439770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f53e06-4956-4a33-b1f6-063296f5f988 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:31.441568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f53e06-4956-4a33-b1f6-063296f5f988 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:31.536352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-01f53e06-4956-4a33-b1f6-063296f5f988 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Unlocking {{(pid=128548) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 05:19:31.668345 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01f53e06-4956-4a33-b1f6-063296f5f988 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.273172 Aug 27 05:19:31.671835 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2572/5145] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:31 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:19:31.681854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-523872ae-8860-4792-9311-917c35851a86 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:31.695854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-523872ae-8860-4792-9311-917c35851a86 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:31.696880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-523872ae-8860-4792-9311-917c35851a86 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:31.697467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-523872ae-8860-4792-9311-917c35851a86 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:31.748203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-523872ae-8860-4792-9311-917c35851a86 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Going to try to stop instance {{(pid=128547) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:19:31.857878 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-523872ae-8860-4792-9311-917c35851a86 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.180167 Aug 27 05:19:31.860060 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2574/5146] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:31 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:19:31.873759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c1a6b8eb-2156-477d-85e8-7e9a75e759cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:31.875506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c1a6b8eb-2156-477d-85e8-7e9a75e759cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:31.891786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1a6b8eb-2156-477d-85e8-7e9a75e759cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:31.893041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1a6b8eb-2156-477d-85e8-7e9a75e759cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:31.894277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1a6b8eb-2156-477d-85e8-7e9a75e759cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:31.895870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1a6b8eb-2156-477d-85e8-7e9a75e759cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:31.896978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1a6b8eb-2156-477d-85e8-7e9a75e759cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:31.897777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1a6b8eb-2156-477d-85e8-7e9a75e759cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:31.910118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=8,nova_cell1:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:32.292720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c1a6b8eb-2156-477d-85e8-7e9a75e759cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:32.313561 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c1a6b8eb-2156-477d-85e8-7e9a75e759cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.448673 Aug 27 05:19:32.314542 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2573/5147] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:31 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:32.345769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-edb07c84-7dec-4ba2-a501-4df3d2e74b37 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:32.350710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-edb07c84-7dec-4ba2-a501-4df3d2e74b37 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:32.370833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edb07c84-7dec-4ba2-a501-4df3d2e74b37 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:32.371609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edb07c84-7dec-4ba2-a501-4df3d2e74b37 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:32.372234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edb07c84-7dec-4ba2-a501-4df3d2e74b37 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:32.373360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edb07c84-7dec-4ba2-a501-4df3d2e74b37 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:32.375709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edb07c84-7dec-4ba2-a501-4df3d2e74b37 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:32.376355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edb07c84-7dec-4ba2-a501-4df3d2e74b37 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:32.889111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-edb07c84-7dec-4ba2-a501-4df3d2e74b37 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:32.903715 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-edb07c84-7dec-4ba2-a501-4df3d2e74b37 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1514 microversion: 2.1 time: 0.567081 Aug 27 05:19:32.904314 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2575/5148] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:32 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1514 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:33.339657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fcf823f0-32b7-4065-8046-c0267225fd2d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:33.341343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fcf823f0-32b7-4065-8046-c0267225fd2d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:33.349346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcf823f0-32b7-4065-8046-c0267225fd2d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:33.350226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcf823f0-32b7-4065-8046-c0267225fd2d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:33.350894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcf823f0-32b7-4065-8046-c0267225fd2d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:33.351925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcf823f0-32b7-4065-8046-c0267225fd2d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:33.352603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcf823f0-32b7-4065-8046-c0267225fd2d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:33.353261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcf823f0-32b7-4065-8046-c0267225fd2d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:33.934209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8360914e-b09b-47be-873a-64e679f99be8 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:33.937127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8360914e-b09b-47be-873a-64e679f99be8 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:33.957274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8360914e-b09b-47be-873a-64e679f99be8 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:33.958137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8360914e-b09b-47be-873a-64e679f99be8 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:33.963469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8360914e-b09b-47be-873a-64e679f99be8 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:33.964490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8360914e-b09b-47be-873a-64e679f99be8 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:33.965115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8360914e-b09b-47be-873a-64e679f99be8 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:33.965698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8360914e-b09b-47be-873a-64e679f99be8 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:34.084365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fcf823f0-32b7-4065-8046-c0267225fd2d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:34.106862 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fcf823f0-32b7-4065-8046-c0267225fd2d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.772750 Aug 27 05:19:34.121222 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2574/5149] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:33 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:34.196505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8360914e-b09b-47be-873a-64e679f99be8 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ad6957c00747888364ff932074db8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c2ef4112e84253b7924d7759080b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:34.202381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f08c8669-ca4f-47dd-9464-f9cdffd8757c req-674cc42c-c8f9-483e-b014-4b42b8285274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ed2da7-e08f-482d-8f2b-453d9e82c1ab", "name": "network-vif-deleted", "tag": "6a124679-c4ba-4398-94c1-b29605873991"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:34.220010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f08c8669-ca4f-47dd-9464-f9cdffd8757c req-674cc42c-c8f9-483e-b014-4b42b8285274 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:34.220972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f08c8669-ca4f-47dd-9464-f9cdffd8757c req-674cc42c-c8f9-483e-b014-4b42b8285274 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:34.222019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f08c8669-ca4f-47dd-9464-f9cdffd8757c req-674cc42c-c8f9-483e-b014-4b42b8285274 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:34.244397 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8360914e-b09b-47be-873a-64e679f99be8 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 200 len: 1472 microversion: 2.1 time: 0.316414 Aug 27 05:19:34.245660 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2576/5150] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:33 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 1472 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:34.273808 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f08c8669-ca4f-47dd-9464-f9cdffd8757c req-674cc42c-c8f9-483e-b014-4b42b8285274 service nova] Creating event network-vif-deleted:6a124679-c4ba-4398-94c1-b29605873991 for instance 96ed2da7-e08f-482d-8f2b-453d9e82c1ab on n-h1-820368-35 Aug 27 05:19:34.283381 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f08c8669-ca4f-47dd-9464-f9cdffd8757c req-674cc42c-c8f9-483e-b014-4b42b8285274 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090456 Aug 27 05:19:34.284347 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2575/5151] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:19:35.153734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b41277bf-11da-4f22-bf01-b3013eb686fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:35.155161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b41277bf-11da-4f22-bf01-b3013eb686fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:35.162564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b41277bf-11da-4f22-bf01-b3013eb686fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.163387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b41277bf-11da-4f22-bf01-b3013eb686fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.164001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b41277bf-11da-4f22-bf01-b3013eb686fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.165177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b41277bf-11da-4f22-bf01-b3013eb686fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.165798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b41277bf-11da-4f22-bf01-b3013eb686fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.166388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b41277bf-11da-4f22-bf01-b3013eb686fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.283063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:35.284948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 96ed2da7-e08f-482d-8f2b-453d9e82c1ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:35.298836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.304664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.305171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.305931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.306614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.307257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.359615 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] HTTP exception thrown: Instance 96ed2da7-e08f-482d-8f2b-453d9e82c1ab could not be found. Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Request method failure captured: Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab HTTP/1.1 Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCai-G6ef9xxfLHr2dwhs3kNOkW0a4KWc10TCa7qBWsDuwlbu0X3dbVlJ2lCWbJLwMnHWmk7bNrsvWEb0vlZM2F_zAuHV1C2puoq-8nilsy1P9_Vhk04unBGNBzkJzSWQ00tmHVZuqf1VbMNq0-a_PZj0JTU24n2qrRbj2zTP54VvFOE Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 39c2ef4112e84253b7924d7759080b9f Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_39c2ef4112e84253b7924d7759080b9f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 39c2ef4112e84253b7924d7759080b9f Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerDiskConfigTestJSON-1710720141-project Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: a5ad6957c00747888364ff932074db8b Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerDiskConfigTestJSON-1710720141-project Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 96ed2da7-e08f-482d-8f2b-453d9e82c1ab could not be found. Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '96ed2da7-e08f-482d-8f2b-453d9e82c1ab'} Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ed2da7-e08f-482d-8f2b-453d9e82c1ab could not be found. Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ed2da7-e08f-482d-8f2b-453d9e82c1ab could not be found. Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:35.366245 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.370468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.370468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:35.370468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:35.370468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:19:35.370468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:19:35.370468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ed2da7-e08f-482d-8f2b-453d9e82c1ab could not be found. Aug 27 05:19:35.370468 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.372320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Returning 404 to user: Instance 96ed2da7-e08f-482d-8f2b-453d9e82c1ab could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:19:35.373950 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e290656b-5f67-4bf2-af43-3b522dd5d4c1 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab" status: 404 len: 111 microversion: 2.1 time: 0.105516 Aug 27 05:19:35.375050 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2576/5152] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:35 2022] GET /compute/v2.1/servers/96ed2da7-e08f-482d-8f2b-453d9e82c1ab => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:19:35.381905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b41277bf-11da-4f22-bf01-b3013eb686fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:35.390441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:35.391349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:35.406091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.406308 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b41277bf-11da-4f22-bf01-b3013eb686fb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.256503 Aug 27 05:19:35.406903 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2577/5153] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:35 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:35.411519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.413148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.414886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.416237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.417196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.449856 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] HTTP exception thrown: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Request method failure captured: Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f HTTP/1.1 Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCai-G6ef9xxfLHr2dwhs3kNOkW0a4KWc10TCa7qBWsDuwlbu0X3dbVlJ2lCWbJLwMnHWmk7bNrsvWEb0vlZM2F_zAuHV1C2puoq-8nilsy1P9_Vhk04unBGNBzkJzSWQ00tmHVZuqf1VbMNq0-a_PZj0JTU24n2qrRbj2zTP54VvFOE Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 39c2ef4112e84253b7924d7759080b9f Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_39c2ef4112e84253b7924d7759080b9f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 39c2ef4112e84253b7924d7759080b9f Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerDiskConfigTestJSON-1710720141-project Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: a5ad6957c00747888364ff932074db8b Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerDiskConfigTestJSON-1710720141-project Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f'} Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:19:35.451530 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Returning 404 to user: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f339bb8-0dd7-4da3-a764-aa302bdef103 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 404 len: 111 microversion: 2.1 time: 0.068758 Aug 27 05:19:35.459475 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2577/5154] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:19:35 2022] DELETE /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:19:35.463968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:35.463968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:35.476518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.479074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.480144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.482923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.484166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.489427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.525739 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] HTTP exception thrown: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Request method failure captured: Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f HTTP/1.1 Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCai-G6ef9xxfLHr2dwhs3kNOkW0a4KWc10TCa7qBWsDuwlbu0X3dbVlJ2lCWbJLwMnHWmk7bNrsvWEb0vlZM2F_zAuHV1C2puoq-8nilsy1P9_Vhk04unBGNBzkJzSWQ00tmHVZuqf1VbMNq0-a_PZj0JTU24n2qrRbj2zTP54VvFOE Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 39c2ef4112e84253b7924d7759080b9f Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_39c2ef4112e84253b7924d7759080b9f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 39c2ef4112e84253b7924d7759080b9f Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerDiskConfigTestJSON-1710720141-project Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: a5ad6957c00747888364ff932074db8b Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerDiskConfigTestJSON-1710720141-project Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f'} Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:35.529111 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.533046 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.533046 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:35.533046 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:35.533046 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:19:35.533046 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:19:35.533046 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. Aug 27 05:19:35.533046 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.540190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Returning 404 to user: Instance 7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:19:35.541390 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3b685651-00e5-42de-b567-4ed1ea01212f tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f" status: 404 len: 111 microversion: 2.1 time: 0.083380 Aug 27 05:19:35.542113 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2578/5155] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:35 2022] GET /compute/v2.1/servers/7fe7cbfa-fc5b-46ba-96ff-d7a37aa1983f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:19:35.554362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:35.555671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:35.578359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.579021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.579524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.580241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.581686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.582324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.650025 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] HTTP exception thrown: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Request method failure captured: Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 HTTP/1.1 Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCai-G6ef9xxfLHr2dwhs3kNOkW0a4KWc10TCa7qBWsDuwlbu0X3dbVlJ2lCWbJLwMnHWmk7bNrsvWEb0vlZM2F_zAuHV1C2puoq-8nilsy1P9_Vhk04unBGNBzkJzSWQ00tmHVZuqf1VbMNq0-a_PZj0JTU24n2qrRbj2zTP54VvFOE Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 39c2ef4112e84253b7924d7759080b9f Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_39c2ef4112e84253b7924d7759080b9f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 39c2ef4112e84253b7924d7759080b9f Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerDiskConfigTestJSON-1710720141-project Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: a5ad6957c00747888364ff932074db8b Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerDiskConfigTestJSON-1710720141-project Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'c9219a13-89e0-41e4-ad6c-3f3b17da15b9'} Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:19:35.666271 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Returning 404 to user: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c83eefca-4a65-4629-bbb8-bd633ec6e085 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 404 len: 111 microversion: 2.1 time: 0.114438 Aug 27 05:19:35.673636 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2578/5156] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:19:35 2022] DELETE /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:19:35.675913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:35.676509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] [instance: c9219a13-89e0-41e4-ad6c-3f3b17da15b9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:35.696689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.697301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.701061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.702026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:35.705952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:35.706424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:35.742238 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] HTTP exception thrown: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Request method failure captured: Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 HTTP/1.1 Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCai-G6ef9xxfLHr2dwhs3kNOkW0a4KWc10TCa7qBWsDuwlbu0X3dbVlJ2lCWbJLwMnHWmk7bNrsvWEb0vlZM2F_zAuHV1C2puoq-8nilsy1P9_Vhk04unBGNBzkJzSWQ00tmHVZuqf1VbMNq0-a_PZj0JTU24n2qrRbj2zTP54VvFOE Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 39c2ef4112e84253b7924d7759080b9f Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_39c2ef4112e84253b7924d7759080b9f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39c2ef4112e84253b7924d7759080b9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 39c2ef4112e84253b7924d7759080b9f Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1710720141 Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerDiskConfigTestJSON-1710720141-project Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: a5ad6957c00747888364ff932074db8b Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerDiskConfigTestJSON-1710720141-project Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'c9219a13-89e0-41e4-ad6c-3f3b17da15b9'} Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:19:35.746107 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.749668 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:19:35.749668 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:19:35.749668 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:19:35.749668 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:19:35.749668 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:19:35.749668 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. Aug 27 05:19:35.749668 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:19:35.750031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] Returning 404 to user: Instance c9219a13-89e0-41e4-ad6c-3f3b17da15b9 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:19:35.751483 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba8e768a-70f1-4b48-8187-933a5262a653 tempest-ServerDiskConfigTestJSON-1710720141 tempest-ServerDiskConfigTestJSON-1710720141-project] 10.222.0.58 "GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9" status: 404 len: 111 microversion: 2.1 time: 0.083354 Aug 27 05:19:35.752070 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2579/5157] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:35 2022] GET /compute/v2.1/servers/c9219a13-89e0-41e4-ad6c-3f3b17da15b9 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:19:36.435759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e9663a4e-fd78-47bc-8660-af2e4aaad282 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:36.437067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e9663a4e-fd78-47bc-8660-af2e4aaad282 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:36.452824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9663a4e-fd78-47bc-8660-af2e4aaad282 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:36.453741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9663a4e-fd78-47bc-8660-af2e4aaad282 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:36.455150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9663a4e-fd78-47bc-8660-af2e4aaad282 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:36.456147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9663a4e-fd78-47bc-8660-af2e4aaad282 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:36.457017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9663a4e-fd78-47bc-8660-af2e4aaad282 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:36.457845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9663a4e-fd78-47bc-8660-af2e4aaad282 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:37.218684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e9663a4e-fd78-47bc-8660-af2e4aaad282 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:37.287225 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e9663a4e-fd78-47bc-8660-af2e4aaad282 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.856024 Aug 27 05:19:37.299792 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2579/5158] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:36 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:38.311052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-58f6c33e-0ab2-4583-9bcf-fc63cca1e4ea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:38.312258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-58f6c33e-0ab2-4583-9bcf-fc63cca1e4ea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:38.329127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58f6c33e-0ab2-4583-9bcf-fc63cca1e4ea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:38.329951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58f6c33e-0ab2-4583-9bcf-fc63cca1e4ea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:38.331519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58f6c33e-0ab2-4583-9bcf-fc63cca1e4ea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:38.332482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58f6c33e-0ab2-4583-9bcf-fc63cca1e4ea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:38.336481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58f6c33e-0ab2-4583-9bcf-fc63cca1e4ea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:38.337090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58f6c33e-0ab2-4583-9bcf-fc63cca1e4ea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:38.783439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-58f6c33e-0ab2-4583-9bcf-fc63cca1e4ea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:38.797783 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-58f6c33e-0ab2-4583-9bcf-fc63cca1e4ea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.490600 Aug 27 05:19:38.799131 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2580/5159] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:38 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:39.838716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5e143c69-2f3c-40e7-9d87-a3257e3b30c9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:39.840944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5e143c69-2f3c-40e7-9d87-a3257e3b30c9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:39.854705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e143c69-2f3c-40e7-9d87-a3257e3b30c9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:39.856335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e143c69-2f3c-40e7-9d87-a3257e3b30c9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:39.857286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e143c69-2f3c-40e7-9d87-a3257e3b30c9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:39.859043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e143c69-2f3c-40e7-9d87-a3257e3b30c9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:39.860068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e143c69-2f3c-40e7-9d87-a3257e3b30c9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:39.861007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e143c69-2f3c-40e7-9d87-a3257e3b30c9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:40.552755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5e143c69-2f3c-40e7-9d87-a3257e3b30c9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:40.566014 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5e143c69-2f3c-40e7-9d87-a3257e3b30c9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.746987 Aug 27 05:19:40.570044 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2580/5160] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:39 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:41.607826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de7e23af-494b-472e-8224-ccf5f1aaa03e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:41.610150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de7e23af-494b-472e-8224-ccf5f1aaa03e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:41.629530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7e23af-494b-472e-8224-ccf5f1aaa03e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:41.638663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7e23af-494b-472e-8224-ccf5f1aaa03e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:41.639604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7e23af-494b-472e-8224-ccf5f1aaa03e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:41.640710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7e23af-494b-472e-8224-ccf5f1aaa03e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:41.641408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7e23af-494b-472e-8224-ccf5f1aaa03e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:41.642087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7e23af-494b-472e-8224-ccf5f1aaa03e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:41.988452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de7e23af-494b-472e-8224-ccf5f1aaa03e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:42.028846 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de7e23af-494b-472e-8224-ccf5f1aaa03e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.428945 Aug 27 05:19:42.029901 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2581/5161] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:41 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:43.066691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fac0799b-5b65-418a-bc3e-85712ac8cc77 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:43.067684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fac0799b-5b65-418a-bc3e-85712ac8cc77 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:43.081037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fac0799b-5b65-418a-bc3e-85712ac8cc77 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:43.083146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fac0799b-5b65-418a-bc3e-85712ac8cc77 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:43.083768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fac0799b-5b65-418a-bc3e-85712ac8cc77 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:43.087977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fac0799b-5b65-418a-bc3e-85712ac8cc77 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:43.088654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fac0799b-5b65-418a-bc3e-85712ac8cc77 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:43.089288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fac0799b-5b65-418a-bc3e-85712ac8cc77 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:43.995751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fac0799b-5b65-418a-bc3e-85712ac8cc77 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:44.031366 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fac0799b-5b65-418a-bc3e-85712ac8cc77 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1655 microversion: 2.1 time: 0.966376 Aug 27 05:19:44.048272 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2581/5162] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:43 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1655 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:44.059905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a04c465c-5148-4644-8528-464abb7f65da tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:44.076626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a04c465c-5148-4644-8528-464abb7f65da tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:44.077040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a04c465c-5148-4644-8528-464abb7f65da tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:44.077663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a04c465c-5148-4644-8528-464abb7f65da tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:44.139856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a04c465c-5148-4644-8528-464abb7f65da tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Going to try to start instance {{(pid=128547) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 05:19:44.252705 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a04c465c-5148-4644-8528-464abb7f65da tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.200564 Aug 27 05:19:44.257615 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2582/5163] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:44 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:19:44.266333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e22142f0-cc42-45fd-9132-e111202fe018 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:44.267903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e22142f0-cc42-45fd-9132-e111202fe018 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:44.317928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e22142f0-cc42-45fd-9132-e111202fe018 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:44.327792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e22142f0-cc42-45fd-9132-e111202fe018 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:44.328253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e22142f0-cc42-45fd-9132-e111202fe018 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:44.329407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e22142f0-cc42-45fd-9132-e111202fe018 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:44.330163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e22142f0-cc42-45fd-9132-e111202fe018 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:44.330597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e22142f0-cc42-45fd-9132-e111202fe018 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:44.956439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e22142f0-cc42-45fd-9132-e111202fe018 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:44.974873 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e22142f0-cc42-45fd-9132-e111202fe018 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1664 microversion: 2.1 time: 0.716212 Aug 27 05:19:44.979138 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2582/5164] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:44 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1664 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:46.003708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1f0db24-c354-41e3-85be-0fd16367a5fa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:46.004520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1f0db24-c354-41e3-85be-0fd16367a5fa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:46.020967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=56 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:46.026341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1f0db24-c354-41e3-85be-0fd16367a5fa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:46.028820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1f0db24-c354-41e3-85be-0fd16367a5fa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:46.030352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1f0db24-c354-41e3-85be-0fd16367a5fa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:46.037659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1f0db24-c354-41e3-85be-0fd16367a5fa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:46.038408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1f0db24-c354-41e3-85be-0fd16367a5fa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:46.042919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1f0db24-c354-41e3-85be-0fd16367a5fa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:46.445260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1f0db24-c354-41e3-85be-0fd16367a5fa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:46.467271 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1f0db24-c354-41e3-85be-0fd16367a5fa tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1664 microversion: 2.1 time: 0.471242 Aug 27 05:19:46.473005 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2583/5165] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:45 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1664 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:47.580146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9d10a0b8-6114-4947-afdf-277cd12322c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:47.585059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9d10a0b8-6114-4947-afdf-277cd12322c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:47.626282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d10a0b8-6114-4947-afdf-277cd12322c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:47.630014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d10a0b8-6114-4947-afdf-277cd12322c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:47.634818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d10a0b8-6114-4947-afdf-277cd12322c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:47.641306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d10a0b8-6114-4947-afdf-277cd12322c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:47.644598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d10a0b8-6114-4947-afdf-277cd12322c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:47.646421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d10a0b8-6114-4947-afdf-277cd12322c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:48.811965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9d10a0b8-6114-4947-afdf-277cd12322c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:48.823693 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9d10a0b8-6114-4947-afdf-277cd12322c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1664 microversion: 2.1 time: 1.308794 Aug 27 05:19:48.833867 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2583/5166] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:47 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1664 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:49.698373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c242abb7-1f35-4435-8dec-b82e672fccb2 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: .version_select at 0x7fb5650d3310>, body: {"keypair": {"name": "tempest-keypair-976030842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqIkcAGxWjAm6IhZgLEt3Jgf85xf02uNscI1WVEJrng2LSg9POzKnzZUaxigwfoRwKrlBjopgXPaIjR/30ZuMI3RwCA9RcnkVmK1gpdh1kma8Mws3TvLlzKYZwqp1XfIA=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:49.746511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-c242abb7-1f35-4435-8dec-b82e672fccb2 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:19:49.755203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-c242abb7-1f35-4435-8dec-b82e672fccb2 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for user 43fc751d620242208608be8bc55ae86d and project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:19:49.799991 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c242abb7-1f35-4435-8dec-b82e672fccb2 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.724201 Aug 27 05:19:49.807766 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2584/5167] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:19:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:19:49.879725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab17c922-cb94-4fa0-9f61-37e51a97dabb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:49.882038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ab17c922-cb94-4fa0-9f61-37e51a97dabb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:49.897886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab17c922-cb94-4fa0-9f61-37e51a97dabb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:49.899726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab17c922-cb94-4fa0-9f61-37e51a97dabb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:49.900847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab17c922-cb94-4fa0-9f61-37e51a97dabb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:49.902468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab17c922-cb94-4fa0-9f61-37e51a97dabb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:49.903586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab17c922-cb94-4fa0-9f61-37e51a97dabb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:49.904664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab17c922-cb94-4fa0-9f61-37e51a97dabb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:50.761583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ab17c922-cb94-4fa0-9f61-37e51a97dabb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:50.790899 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ab17c922-cb94-4fa0-9f61-37e51a97dabb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.910562 Aug 27 05:19:50.794825 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2584/5168] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:49 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:50.823392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2f5cab7-9b42-4eef-8084-6990f455947b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:50.824106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b2f5cab7-9b42-4eef-8084-6990f455947b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:50.847539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5cab7-9b42-4eef-8084-6990f455947b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:50.847951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5cab7-9b42-4eef-8084-6990f455947b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:50.848402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5cab7-9b42-4eef-8084-6990f455947b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:50.849239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5cab7-9b42-4eef-8084-6990f455947b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:50.853265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5cab7-9b42-4eef-8084-6990f455947b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:50.854534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5cab7-9b42-4eef-8084-6990f455947b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:51.277761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b2f5cab7-9b42-4eef-8084-6990f455947b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:51.293031 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b2f5cab7-9b42-4eef-8084-6990f455947b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.476689 Aug 27 05:19:51.312508 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2585/5169] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:50 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:51.329885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5b9ed89e-a8bf-4766-901f-297d8a700b8a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:51.331721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5b9ed89e-a8bf-4766-901f-297d8a700b8a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:51.342746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b9ed89e-a8bf-4766-901f-297d8a700b8a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:51.343931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b9ed89e-a8bf-4766-901f-297d8a700b8a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:51.344794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b9ed89e-a8bf-4766-901f-297d8a700b8a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:51.345772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b9ed89e-a8bf-4766-901f-297d8a700b8a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:51.346450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b9ed89e-a8bf-4766-901f-297d8a700b8a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:51.347110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b9ed89e-a8bf-4766-901f-297d8a700b8a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:51.417688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5b9ed89e-a8bf-4766-901f-297d8a700b8a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Unlocking {{(pid=128548) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 05:19:51.499690 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5b9ed89e-a8bf-4766-901f-297d8a700b8a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.175034 Aug 27 05:19:51.503262 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2585/5170] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:51 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:19:51.516425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d2570b18-31cb-4ddf-8039-e192f27aea35 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:51.516610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d2570b18-31cb-4ddf-8039-e192f27aea35 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:51.525743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2570b18-31cb-4ddf-8039-e192f27aea35 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:51.527912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2570b18-31cb-4ddf-8039-e192f27aea35 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:51.528637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2570b18-31cb-4ddf-8039-e192f27aea35 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:51.529977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2570b18-31cb-4ddf-8039-e192f27aea35 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:51.531063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2570b18-31cb-4ddf-8039-e192f27aea35 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:51.532295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2570b18-31cb-4ddf-8039-e192f27aea35 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:52.184756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d2570b18-31cb-4ddf-8039-e192f27aea35 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:52.198380 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d2570b18-31cb-4ddf-8039-e192f27aea35 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.686630 Aug 27 05:19:52.199003 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2586/5171] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:51 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:52.225904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c3d214f5-06d5-42e1-8a71-5119bd20772f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:52.227214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c3d214f5-06d5-42e1-8a71-5119bd20772f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:52.254800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3d214f5-06d5-42e1-8a71-5119bd20772f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:52.255517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3d214f5-06d5-42e1-8a71-5119bd20772f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:52.256151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3d214f5-06d5-42e1-8a71-5119bd20772f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:52.257263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3d214f5-06d5-42e1-8a71-5119bd20772f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:52.258058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3d214f5-06d5-42e1-8a71-5119bd20772f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:52.258864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3d214f5-06d5-42e1-8a71-5119bd20772f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:52.802061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c3d214f5-06d5-42e1-8a71-5119bd20772f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:52.821704 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c3d214f5-06d5-42e1-8a71-5119bd20772f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.602427 Aug 27 05:19:52.822555 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2586/5172] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:52 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:52.863480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0c4c7f32-7dc8-4bdd-98da-417b405afa8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:52.864938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0c4c7f32-7dc8-4bdd-98da-417b405afa8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:52.880945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c4c7f32-7dc8-4bdd-98da-417b405afa8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:52.881845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c4c7f32-7dc8-4bdd-98da-417b405afa8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:52.882687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c4c7f32-7dc8-4bdd-98da-417b405afa8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:52.884433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c4c7f32-7dc8-4bdd-98da-417b405afa8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:52.885912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c4c7f32-7dc8-4bdd-98da-417b405afa8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:52.886698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c4c7f32-7dc8-4bdd-98da-417b405afa8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:53.302357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0c4c7f32-7dc8-4bdd-98da-417b405afa8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:53.309127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:53.331637 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0c4c7f32-7dc8-4bdd-98da-417b405afa8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.475981 Aug 27 05:19:53.357641 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2587/5173] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:52 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:53.365791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bf6b54c9-a6bf-469e-85a0-a7231fc03a61 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:53.367312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bf6b54c9-a6bf-469e-85a0-a7231fc03a61 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:53.381355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf6b54c9-a6bf-469e-85a0-a7231fc03a61 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:53.383604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf6b54c9-a6bf-469e-85a0-a7231fc03a61 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:53.384652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf6b54c9-a6bf-469e-85a0-a7231fc03a61 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:53.386145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf6b54c9-a6bf-469e-85a0-a7231fc03a61 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:53.387249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf6b54c9-a6bf-469e-85a0-a7231fc03a61 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:53.388223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf6b54c9-a6bf-469e-85a0-a7231fc03a61 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:53.570744 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bf6b54c9-a6bf-469e-85a0-a7231fc03a61 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.211178 Aug 27 05:19:53.574308 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2587/5174] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:53 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:19:53.592386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ff5b432a-e098-41e4-a495-35b97d56cfdf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:53.593635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ff5b432a-e098-41e4-a495-35b97d56cfdf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:53.629567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff5b432a-e098-41e4-a495-35b97d56cfdf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:53.631493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff5b432a-e098-41e4-a495-35b97d56cfdf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:53.633911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff5b432a-e098-41e4-a495-35b97d56cfdf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:53.638179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff5b432a-e098-41e4-a495-35b97d56cfdf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:53.639661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff5b432a-e098-41e4-a495-35b97d56cfdf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:53.641942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff5b432a-e098-41e4-a495-35b97d56cfdf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:54.686252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ff5b432a-e098-41e4-a495-35b97d56cfdf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:54.703791 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ff5b432a-e098-41e4-a495-35b97d56cfdf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1673 microversion: 2.1 time: 1.122576 Aug 27 05:19:54.707567 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2588/5175] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:53 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1673 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:55.507369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1453309930", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b22082a4-5b69-426a-b228-4ee7d0a48e79"}], "security_groups": [{"name": "tempest-securitygroup--451009706"}], "key_name": "tempest-keypair-976030842", "user_data": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:55.743746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df9437d6-c255-4ea7-9146-418ef4ebf1ac tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:55.744439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-df9437d6-c255-4ea7-9146-418ef4ebf1ac tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:55.752797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df9437d6-c255-4ea7-9146-418ef4ebf1ac tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:55.753683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df9437d6-c255-4ea7-9146-418ef4ebf1ac tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:55.754400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df9437d6-c255-4ea7-9146-418ef4ebf1ac tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:55.755350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df9437d6-c255-4ea7-9146-418ef4ebf1ac tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:55.755964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df9437d6-c255-4ea7-9146-418ef4ebf1ac tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:55.756549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df9437d6-c255-4ea7-9146-418ef4ebf1ac tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:55.932780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] validate_networks() for [('b22082a4-5b69-426a-b228-4ee7d0a48e79', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:19:56.797985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df9437d6-c255-4ea7-9146-418ef4ebf1ac tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:56.810336 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df9437d6-c255-4ea7-9146-418ef4ebf1ac tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1653 microversion: 2.1 time: 1.071584 Aug 27 05:19:56.811272 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2589/5176] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:55 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1653 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:56.861701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-157d6ff2-2458-4c08-9105-6d2c13385396 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:19:56.862492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-157d6ff2-2458-4c08-9105-6d2c13385396 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:56.888139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157d6ff2-2458-4c08-9105-6d2c13385396 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:56.888139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157d6ff2-2458-4c08-9105-6d2c13385396 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:56.888139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157d6ff2-2458-4c08-9105-6d2c13385396 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:56.888139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157d6ff2-2458-4c08-9105-6d2c13385396 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:56.888139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157d6ff2-2458-4c08-9105-6d2c13385396 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:56.888139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157d6ff2-2458-4c08-9105-6d2c13385396 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:57.089169 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-157d6ff2-2458-4c08-9105-6d2c13385396 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.231459 Aug 27 05:19:57.102223 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2590/5177] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:19:56 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:19:57.114719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-541bfa0f-3604-42de-935f-7738dbed54b1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:57.115601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-541bfa0f-3604-42de-935f-7738dbed54b1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:57.132787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541bfa0f-3604-42de-935f-7738dbed54b1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:57.133729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541bfa0f-3604-42de-935f-7738dbed54b1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:57.135425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541bfa0f-3604-42de-935f-7738dbed54b1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:57.141733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541bfa0f-3604-42de-935f-7738dbed54b1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:57.144433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541bfa0f-3604-42de-935f-7738dbed54b1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:57.146438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541bfa0f-3604-42de-935f-7738dbed54b1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:57.250835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:58.164325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-541bfa0f-3604-42de-935f-7738dbed54b1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:58.186875 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-541bfa0f-3604-42de-935f-7738dbed54b1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1660 microversion: 2.1 time: 1.087534 Aug 27 05:19:58.204489 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2591/5178] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:57 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1660 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:19:58.214254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:19:58.214710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:19:58.215290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:19:58.216296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:19:58.217119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:19:58.244535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:58.248436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:58.249353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:58.252332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:58.259182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:58.260369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:58.305129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:19:58.318300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for user 43fc751d620242208608be8bc55ae86d and project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:19:58.357059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:19:58.360774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:19:58.494923 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4e63e8f7-aa77-4ff5-955e-faacc9b52f6b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.995178 Aug 27 05:19:58.503801 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2588/5179] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:19:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 3005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:19:58.508868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-494ae7b9-1164-4ce4-af56-5b92578d11b1 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:58.509502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-494ae7b9-1164-4ce4-af56-5b92578d11b1 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:58.796850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-494ae7b9-1164-4ce4-af56-5b92578d11b1 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:58.822999 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-494ae7b9-1164-4ce4-af56-5b92578d11b1 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1241 microversion: 2.1 time: 0.310032 Aug 27 05:19:58.825894 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2592/5180] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:58 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1241 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:59.212575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bb9b16c4-361a-425c-bee6-4f5616939b33 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:59.213213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bb9b16c4-361a-425c-bee6-4f5616939b33 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:59.228431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb9b16c4-361a-425c-bee6-4f5616939b33 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:59.234394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb9b16c4-361a-425c-bee6-4f5616939b33 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:59.235032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb9b16c4-361a-425c-bee6-4f5616939b33 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:59.240572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb9b16c4-361a-425c-bee6-4f5616939b33 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:59.243193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb9b16c4-361a-425c-bee6-4f5616939b33 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:59.244492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb9b16c4-361a-425c-bee6-4f5616939b33 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:59.856853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-482852d3-4cdc-4bfc-bc4b-52b0b3fbc307 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:59.860584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bb9b16c4-361a-425c-bee6-4f5616939b33 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:19:59.864537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:19:59.888011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-482852d3-4cdc-4bfc-bc4b-52b0b3fbc307 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:59.894075 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bb9b16c4-361a-425c-bee6-4f5616939b33 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.687737 Aug 27 05:19:59.903489 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2589/5181] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:59 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:19:59.915288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482852d3-4cdc-4bfc-bc4b-52b0b3fbc307 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:59.917204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482852d3-4cdc-4bfc-bc4b-52b0b3fbc307 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:59.917991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482852d3-4cdc-4bfc-bc4b-52b0b3fbc307 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:59.926188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482852d3-4cdc-4bfc-bc4b-52b0b3fbc307 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:59.926620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab492b03-1ed6-42b1-b8e6-fc895c780b3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:19:59.927189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482852d3-4cdc-4bfc-bc4b-52b0b3fbc307 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:59.927389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ab492b03-1ed6-42b1-b8e6-fc895c780b3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:19:59.930248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482852d3-4cdc-4bfc-bc4b-52b0b3fbc307 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:59.952118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab492b03-1ed6-42b1-b8e6-fc895c780b3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:59.956052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab492b03-1ed6-42b1-b8e6-fc895c780b3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:59.958567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab492b03-1ed6-42b1-b8e6-fc895c780b3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:19:59.963877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab492b03-1ed6-42b1-b8e6-fc895c780b3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:19:59.967700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab492b03-1ed6-42b1-b8e6-fc895c780b3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:19:59.971179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab492b03-1ed6-42b1-b8e6-fc895c780b3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:00.344905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-482852d3-4cdc-4bfc-bc4b-52b0b3fbc307 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:00.389569 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-482852d3-4cdc-4bfc-bc4b-52b0b3fbc307 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1237 microversion: 2.1 time: 0.543973 Aug 27 05:20:00.391658 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2593/5182] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:59 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1237 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:00.591830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ab492b03-1ed6-42b1-b8e6-fc895c780b3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:00.621192 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ab492b03-1ed6-42b1-b8e6-fc895c780b3e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.705655 Aug 27 05:20:00.627067 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2590/5183] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:19:59 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:00.663507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c8e98217-79e7-4f7a-b468-b5287d103800 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:00.664295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c8e98217-79e7-4f7a-b468-b5287d103800 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:00.691441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8e98217-79e7-4f7a-b468-b5287d103800 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:00.692366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8e98217-79e7-4f7a-b468-b5287d103800 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:00.696971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8e98217-79e7-4f7a-b468-b5287d103800 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:00.699294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8e98217-79e7-4f7a-b468-b5287d103800 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:00.704496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8e98217-79e7-4f7a-b468-b5287d103800 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:00.704959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8e98217-79e7-4f7a-b468-b5287d103800 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:01.221480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c8e98217-79e7-4f7a-b468-b5287d103800 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:01.247082 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c8e98217-79e7-4f7a-b468-b5287d103800 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.595617 Aug 27 05:20:01.263363 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2594/5184] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:00 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:01.326613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3e3b2c55-9f97-449d-bbde-6d4f878b4790 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:01.326613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3e3b2c55-9f97-449d-bbde-6d4f878b4790 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:01.383676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e3b2c55-9f97-449d-bbde-6d4f878b4790 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:01.391493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e3b2c55-9f97-449d-bbde-6d4f878b4790 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:01.392898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e3b2c55-9f97-449d-bbde-6d4f878b4790 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:01.398215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e3b2c55-9f97-449d-bbde-6d4f878b4790 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:01.405154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e3b2c55-9f97-449d-bbde-6d4f878b4790 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:01.409320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e3b2c55-9f97-449d-bbde-6d4f878b4790 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:01.418353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-27cff750-4001-473c-ad6a-87929d1e5abb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:01.419890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-27cff750-4001-473c-ad6a-87929d1e5abb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:01.434541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27cff750-4001-473c-ad6a-87929d1e5abb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:01.435872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27cff750-4001-473c-ad6a-87929d1e5abb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:01.440916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27cff750-4001-473c-ad6a-87929d1e5abb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:01.442894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27cff750-4001-473c-ad6a-87929d1e5abb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:01.443608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27cff750-4001-473c-ad6a-87929d1e5abb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:01.447727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-27cff750-4001-473c-ad6a-87929d1e5abb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:02.293739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-27cff750-4001-473c-ad6a-87929d1e5abb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:02.307156 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-27cff750-4001-473c-ad6a-87929d1e5abb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1293 microversion: 2.1 time: 0.894710 Aug 27 05:20:02.308031 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2595/5185] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:01 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1293 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:02.940098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3e3b2c55-9f97-449d-bbde-6d4f878b4790 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:02.948721 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3e3b2c55-9f97-449d-bbde-6d4f878b4790 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 1.664337 Aug 27 05:20:02.951785 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2591/5186] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:01 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:02.997753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1c2dabad-924d-4116-a5e2-8b46b73c6a99 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:02.998964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1c2dabad-924d-4116-a5e2-8b46b73c6a99 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:03.009488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c2dabad-924d-4116-a5e2-8b46b73c6a99 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:03.010284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c2dabad-924d-4116-a5e2-8b46b73c6a99 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:03.011477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c2dabad-924d-4116-a5e2-8b46b73c6a99 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:03.012455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c2dabad-924d-4116-a5e2-8b46b73c6a99 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:03.013457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c2dabad-924d-4116-a5e2-8b46b73c6a99 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:03.014120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c2dabad-924d-4116-a5e2-8b46b73c6a99 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:03.346945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60be8a2f-71cb-4c95-887b-c8e48f1a874d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:03.348156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60be8a2f-71cb-4c95-887b-c8e48f1a874d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:03.358472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60be8a2f-71cb-4c95-887b-c8e48f1a874d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:03.359385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60be8a2f-71cb-4c95-887b-c8e48f1a874d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:03.360051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60be8a2f-71cb-4c95-887b-c8e48f1a874d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:03.361005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60be8a2f-71cb-4c95-887b-c8e48f1a874d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:03.362299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60be8a2f-71cb-4c95-887b-c8e48f1a874d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:03.362980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60be8a2f-71cb-4c95-887b-c8e48f1a874d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:03.486323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1c2dabad-924d-4116-a5e2-8b46b73c6a99 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:03.503909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-60be8a2f-71cb-4c95-887b-c8e48f1a874d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:03.523645 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-60be8a2f-71cb-4c95-887b-c8e48f1a874d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1299 microversion: 2.1 time: 0.185633 Aug 27 05:20:03.535897 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2592/5187] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:03 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1299 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:03.552598 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1c2dabad-924d-4116-a5e2-8b46b73c6a99 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.557363 Aug 27 05:20:03.567615 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2596/5188] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:02 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:03.631499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-200f15df-13b0-47cc-a11f-3c3f0000cff1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:03.632959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-200f15df-13b0-47cc-a11f-3c3f0000cff1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:03.650852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200f15df-13b0-47cc-a11f-3c3f0000cff1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:03.651552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200f15df-13b0-47cc-a11f-3c3f0000cff1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:03.653013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200f15df-13b0-47cc-a11f-3c3f0000cff1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:03.661503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200f15df-13b0-47cc-a11f-3c3f0000cff1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:03.663137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200f15df-13b0-47cc-a11f-3c3f0000cff1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:03.665061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200f15df-13b0-47cc-a11f-3c3f0000cff1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:04.564271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6f3a2841-4238-4763-8f75-9a7695125fcf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:04.565260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6f3a2841-4238-4763-8f75-9a7695125fcf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:04.583257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3a2841-4238-4763-8f75-9a7695125fcf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:04.583912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3a2841-4238-4763-8f75-9a7695125fcf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:04.584384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3a2841-4238-4763-8f75-9a7695125fcf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:04.585168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3a2841-4238-4763-8f75-9a7695125fcf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:04.585650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3a2841-4238-4763-8f75-9a7695125fcf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:04.587199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f3a2841-4238-4763-8f75-9a7695125fcf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:04.862373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6f3a2841-4238-4763-8f75-9a7695125fcf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:04.884527 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6f3a2841-4238-4763-8f75-9a7695125fcf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1299 microversion: 2.1 time: 0.325304 Aug 27 05:20:04.899426 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2597/5189] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:04 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1299 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:05.080034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-200f15df-13b0-47cc-a11f-3c3f0000cff1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:05.106855 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-200f15df-13b0-47cc-a11f-3c3f0000cff1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 1.479271 Aug 27 05:20:05.110744 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2593/5190] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:03 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:05.910790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-70da5137-9792-4e2d-9d92-a7b880606e28 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:05.912173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-70da5137-9792-4e2d-9d92-a7b880606e28 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:05.935698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70da5137-9792-4e2d-9d92-a7b880606e28 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:05.936355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70da5137-9792-4e2d-9d92-a7b880606e28 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:05.936836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70da5137-9792-4e2d-9d92-a7b880606e28 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:05.940042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70da5137-9792-4e2d-9d92-a7b880606e28 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:05.940461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70da5137-9792-4e2d-9d92-a7b880606e28 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:05.940905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70da5137-9792-4e2d-9d92-a7b880606e28 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:06.419474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-70da5137-9792-4e2d-9d92-a7b880606e28 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:06.432540 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-70da5137-9792-4e2d-9d92-a7b880606e28 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1366 microversion: 2.1 time: 0.527344 Aug 27 05:20:06.433856 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2598/5191] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:05 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1366 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:07.465128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65a63e9e-7fb0-4855-9571-667e21fe4d6f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:07.466005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-65a63e9e-7fb0-4855-9571-667e21fe4d6f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:07.490112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65a63e9e-7fb0-4855-9571-667e21fe4d6f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:07.490723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65a63e9e-7fb0-4855-9571-667e21fe4d6f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:07.493270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65a63e9e-7fb0-4855-9571-667e21fe4d6f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:07.496428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65a63e9e-7fb0-4855-9571-667e21fe4d6f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:07.498838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65a63e9e-7fb0-4855-9571-667e21fe4d6f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:07.499568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65a63e9e-7fb0-4855-9571-667e21fe4d6f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:08.040316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-65a63e9e-7fb0-4855-9571-667e21fe4d6f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:08.060730 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-65a63e9e-7fb0-4855-9571-667e21fe4d6f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1366 microversion: 2.1 time: 0.597647 Aug 27 05:20:08.062112 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2594/5192] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:07 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1366 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:09.073663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:09.078378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f35389ad-7f58-4682-a609-bb935f8407bc req-827b8571-2aa2-4eb7-8273-a0b4c5aae96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e12d584-d333-430d-aec1-67778b1f5575", "tag": "9ddfbd7c-1d05-4d8b-bac3-be7daad6a93e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:09.100152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a37e3c8c-9d94-4f80-865e-9d4453645bcc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:09.101568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a37e3c8c-9d94-4f80-865e-9d4453645bcc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:09.110749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f35389ad-7f58-4682-a609-bb935f8407bc req-827b8571-2aa2-4eb7-8273-a0b4c5aae96c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:09.111419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f35389ad-7f58-4682-a609-bb935f8407bc req-827b8571-2aa2-4eb7-8273-a0b4c5aae96c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:09.111861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f35389ad-7f58-4682-a609-bb935f8407bc req-827b8571-2aa2-4eb7-8273-a0b4c5aae96c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:09.118642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:09.121848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:09.132829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a37e3c8c-9d94-4f80-865e-9d4453645bcc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:09.134426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a37e3c8c-9d94-4f80-865e-9d4453645bcc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:09.137181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a37e3c8c-9d94-4f80-865e-9d4453645bcc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:09.138787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a37e3c8c-9d94-4f80-865e-9d4453645bcc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:09.140312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a37e3c8c-9d94-4f80-865e-9d4453645bcc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:09.142495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a37e3c8c-9d94-4f80-865e-9d4453645bcc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:09.146637 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f35389ad-7f58-4682-a609-bb935f8407bc req-827b8571-2aa2-4eb7-8273-a0b4c5aae96c service nova] Creating event network-changed:9ddfbd7c-1d05-4d8b-bac3-be7daad6a93e for instance 4e12d584-d333-430d-aec1-67778b1f5575 on n-h1-820368-35 Aug 27 05:20:09.189348 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f35389ad-7f58-4682-a609-bb935f8407bc req-827b8571-2aa2-4eb7-8273-a0b4c5aae96c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116024 Aug 27 05:20:09.190030 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2599/5193] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:20:09.773546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-400188041", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e3f0f994-1021-4267-a3e8-38550615143e"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:09.902532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] validate_networks() for [('e3f0f994-1021-4267-a3e8-38550615143e', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:20:10.543073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a37e3c8c-9d94-4f80-865e-9d4453645bcc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:10.567439 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a37e3c8c-9d94-4f80-865e-9d4453645bcc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1366 microversion: 2.1 time: 1.471899 Aug 27 05:20:10.588105 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2595/5194] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:09 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1366 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:11.596140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6cd91825-7f03-4bdc-bf98-3a4fbe234b4a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:11.597606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6cd91825-7f03-4bdc-bf98-3a4fbe234b4a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:11.617251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd91825-7f03-4bdc-bf98-3a4fbe234b4a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:11.617997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd91825-7f03-4bdc-bf98-3a4fbe234b4a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:11.621659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd91825-7f03-4bdc-bf98-3a4fbe234b4a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:11.623330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd91825-7f03-4bdc-bf98-3a4fbe234b4a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:11.624106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd91825-7f03-4bdc-bf98-3a4fbe234b4a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:11.624892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd91825-7f03-4bdc-bf98-3a4fbe234b4a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:11.639414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:20:11.640580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:20:11.641312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:20:11.641891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:20:11.642530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:20:11.666968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:11.668346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:11.671336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:11.676826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:11.679042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:11.680000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:11.741331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Getting quotas for project ae67351e57d741f58e35ee388c5ccadf. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:20:11.775360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Getting quotas for user 2a9ab1851ccf471dbff261bfeb5bbb44 and project ae67351e57d741f58e35ee388c5ccadf. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:20:11.812036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Going to run 2 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:20:11.817962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: df18d421-9a0a-4e32-afdd-53fcc12120c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:20:11.929037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=df18d421-9a0a-4e32-afdd-53fcc12120c7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:20:12.119481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6cd91825-7f03-4bdc-bf98-3a4fbe234b4a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:12.124996 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f330d7f5-e142-4da5-b2c6-b8f102cb6a88 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.540036 Aug 27 05:20:12.134554 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2600/5195] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:20:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:20:12.144671 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6cd91825-7f03-4bdc-bf98-3a4fbe234b4a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1366 microversion: 2.1 time: 0.554349 Aug 27 05:20:12.160542 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2596/5196] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:11 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1366 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:12.168529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-946069e8-567c-47ec-9de0-305c28ee38b6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:12.200800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-946069e8-567c-47ec-9de0-305c28ee38b6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:12.204357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-946069e8-567c-47ec-9de0-305c28ee38b6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Searching by: {'deleted': False, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:20:12.262327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-946069e8-567c-47ec-9de0-305c28ee38b6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:12.265198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-946069e8-567c-47ec-9de0-305c28ee38b6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:12.266393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-946069e8-567c-47ec-9de0-305c28ee38b6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:12.268446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-946069e8-567c-47ec-9de0-305c28ee38b6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:12.270715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-946069e8-567c-47ec-9de0-305c28ee38b6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:12.271821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-946069e8-567c-47ec-9de0-305c28ee38b6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:12.322051 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-946069e8-567c-47ec-9de0-305c28ee38b6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.181976 Aug 27 05:20:12.323503 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2601/5197] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 05:20:12 2022] GET /compute/v2.1/servers => generated 675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:20:12.336961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3121d2f4-65da-4341-b483-b827af71b0ca tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:12.337608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3121d2f4-65da-4341-b483-b827af71b0ca tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:12.613691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3121d2f4-65da-4341-b483-b827af71b0ca tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:12.640343 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3121d2f4-65da-4341-b483-b827af71b0ca tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1219 microversion: 2.1 time: 0.305209 Aug 27 05:20:12.644113 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2597/5198] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:12 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1219 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:13.172195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-92bdf0dc-7735-45b5-a249-84ba17e58436 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:13.173074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-92bdf0dc-7735-45b5-a249-84ba17e58436 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:13.190574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92bdf0dc-7735-45b5-a249-84ba17e58436 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:13.191116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92bdf0dc-7735-45b5-a249-84ba17e58436 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:13.192550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92bdf0dc-7735-45b5-a249-84ba17e58436 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:13.196171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92bdf0dc-7735-45b5-a249-84ba17e58436 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:13.196666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92bdf0dc-7735-45b5-a249-84ba17e58436 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:13.197110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92bdf0dc-7735-45b5-a249-84ba17e58436 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:13.671025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-16a257e4-cf61-4d8f-8313-92df22b0d284 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:13.671849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-16a257e4-cf61-4d8f-8313-92df22b0d284 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:13.681760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a257e4-cf61-4d8f-8313-92df22b0d284 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:13.682261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a257e4-cf61-4d8f-8313-92df22b0d284 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:13.682706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a257e4-cf61-4d8f-8313-92df22b0d284 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:13.689727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a257e4-cf61-4d8f-8313-92df22b0d284 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:13.690402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a257e4-cf61-4d8f-8313-92df22b0d284 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:13.692370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16a257e4-cf61-4d8f-8313-92df22b0d284 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:13.869813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-92bdf0dc-7735-45b5-a249-84ba17e58436 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:13.889019 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-92bdf0dc-7735-45b5-a249-84ba17e58436 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1366 microversion: 2.1 time: 0.722195 Aug 27 05:20:13.890542 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2602/5199] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:13 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1366 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:14.196448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-16a257e4-cf61-4d8f-8313-92df22b0d284 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:14.251077 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-16a257e4-cf61-4d8f-8313-92df22b0d284 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1223 microversion: 2.1 time: 0.578748 Aug 27 05:20:14.252283 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2598/5200] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:13 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1223 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:14.916791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c315686-c335-4143-93ce-efd1b123f1c3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:14.918277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c315686-c335-4143-93ce-efd1b123f1c3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:14.949592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c315686-c335-4143-93ce-efd1b123f1c3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:14.953223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c315686-c335-4143-93ce-efd1b123f1c3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:14.954354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c315686-c335-4143-93ce-efd1b123f1c3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:14.956065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c315686-c335-4143-93ce-efd1b123f1c3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:14.957395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c315686-c335-4143-93ce-efd1b123f1c3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:14.960508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c315686-c335-4143-93ce-efd1b123f1c3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:15.288498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b863e346-3671-4d05-a133-b08b57f6b8a5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:15.289203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b863e346-3671-4d05-a133-b08b57f6b8a5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:15.313924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b863e346-3671-4d05-a133-b08b57f6b8a5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:15.314666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b863e346-3671-4d05-a133-b08b57f6b8a5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:15.315662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b863e346-3671-4d05-a133-b08b57f6b8a5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:15.318248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b863e346-3671-4d05-a133-b08b57f6b8a5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:15.331112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b863e346-3671-4d05-a133-b08b57f6b8a5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:15.332755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b863e346-3671-4d05-a133-b08b57f6b8a5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:15.529419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b863e346-3671-4d05-a133-b08b57f6b8a5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:15.544030 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b863e346-3671-4d05-a133-b08b57f6b8a5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1271 microversion: 2.1 time: 0.265646 Aug 27 05:20:15.545452 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2599/5201] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:15 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1271 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:15.856955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c315686-c335-4143-93ce-efd1b123f1c3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:15.882127 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c315686-c335-4143-93ce-efd1b123f1c3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1366 microversion: 2.1 time: 0.969592 Aug 27 05:20:15.894362 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2603/5202] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:14 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1366 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:16.577920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88bc7183-8060-41c3-b3ba-4a6263bbbd5b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:16.579232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-88bc7183-8060-41c3-b3ba-4a6263bbbd5b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:16.589479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bc7183-8060-41c3-b3ba-4a6263bbbd5b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:16.593981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bc7183-8060-41c3-b3ba-4a6263bbbd5b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:16.595139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bc7183-8060-41c3-b3ba-4a6263bbbd5b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:16.598659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bc7183-8060-41c3-b3ba-4a6263bbbd5b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:16.603807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bc7183-8060-41c3-b3ba-4a6263bbbd5b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:16.604795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88bc7183-8060-41c3-b3ba-4a6263bbbd5b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:16.812683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-88bc7183-8060-41c3-b3ba-4a6263bbbd5b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:16.822636 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88bc7183-8060-41c3-b3ba-4a6263bbbd5b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1277 microversion: 2.1 time: 0.254137 Aug 27 05:20:16.830657 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2600/5203] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:16 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:16.926774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db21dfb9-0180-4a82-a503-4d840338ae7d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:16.928839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-db21dfb9-0180-4a82-a503-4d840338ae7d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:16.946341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=7 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:16.988506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db21dfb9-0180-4a82-a503-4d840338ae7d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:16.989137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db21dfb9-0180-4a82-a503-4d840338ae7d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:16.989807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db21dfb9-0180-4a82-a503-4d840338ae7d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:17.002455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db21dfb9-0180-4a82-a503-4d840338ae7d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:17.003560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db21dfb9-0180-4a82-a503-4d840338ae7d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:17.004189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db21dfb9-0180-4a82-a503-4d840338ae7d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:17.596729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-db21dfb9-0180-4a82-a503-4d840338ae7d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:17.642976 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db21dfb9-0180-4a82-a503-4d840338ae7d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1366 microversion: 2.1 time: 0.724860 Aug 27 05:20:17.652407 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2604/5204] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:16 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1366 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:17.873895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-893cef5f-cebf-4837-802b-55679470f25b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:17.874949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-893cef5f-cebf-4837-802b-55679470f25b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:17.911082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-893cef5f-cebf-4837-802b-55679470f25b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:17.911612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-893cef5f-cebf-4837-802b-55679470f25b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:17.912066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-893cef5f-cebf-4837-802b-55679470f25b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:17.913377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-893cef5f-cebf-4837-802b-55679470f25b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:17.913849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-893cef5f-cebf-4837-802b-55679470f25b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:17.914289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-893cef5f-cebf-4837-802b-55679470f25b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:18.075313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-893cef5f-cebf-4837-802b-55679470f25b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:18.095582 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-893cef5f-cebf-4837-802b-55679470f25b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1277 microversion: 2.1 time: 0.234244 Aug 27 05:20:18.113133 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2601/5205] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:17 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:18.694796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-661610d6-9dc7-4a5d-8a6f-21b4766db836 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:18.696064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-661610d6-9dc7-4a5d-8a6f-21b4766db836 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:18.723876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-661610d6-9dc7-4a5d-8a6f-21b4766db836 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:18.735437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-661610d6-9dc7-4a5d-8a6f-21b4766db836 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:18.736069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-661610d6-9dc7-4a5d-8a6f-21b4766db836 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:18.737040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-661610d6-9dc7-4a5d-8a6f-21b4766db836 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:18.738325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-661610d6-9dc7-4a5d-8a6f-21b4766db836 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:18.739053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-661610d6-9dc7-4a5d-8a6f-21b4766db836 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:19.059564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-661610d6-9dc7-4a5d-8a6f-21b4766db836 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:19.069153 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-661610d6-9dc7-4a5d-8a6f-21b4766db836 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1366 microversion: 2.1 time: 0.395723 Aug 27 05:20:19.078802 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2605/5206] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:18 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:19.144417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bfd6f0dd-b351-43b0-bafc-616543f01d59 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:19.145493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bfd6f0dd-b351-43b0-bafc-616543f01d59 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:19.181371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd6f0dd-b351-43b0-bafc-616543f01d59 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:19.193913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd6f0dd-b351-43b0-bafc-616543f01d59 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:19.198274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd6f0dd-b351-43b0-bafc-616543f01d59 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:19.200776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd6f0dd-b351-43b0-bafc-616543f01d59 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:19.206099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd6f0dd-b351-43b0-bafc-616543f01d59 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:19.207949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfd6f0dd-b351-43b0-bafc-616543f01d59 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:19.899026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bfd6f0dd-b351-43b0-bafc-616543f01d59 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:19.924364 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bfd6f0dd-b351-43b0-bafc-616543f01d59 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1277 microversion: 2.1 time: 0.794631 Aug 27 05:20:19.925416 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2602/5207] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:19 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1277 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:20.109079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e13c965a-1ef7-4042-9a8a-0b66349066cc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:20.110476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e13c965a-1ef7-4042-9a8a-0b66349066cc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:20.121600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13c965a-1ef7-4042-9a8a-0b66349066cc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:20.122335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13c965a-1ef7-4042-9a8a-0b66349066cc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:20.122931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13c965a-1ef7-4042-9a8a-0b66349066cc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:20.123998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13c965a-1ef7-4042-9a8a-0b66349066cc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:20.133618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13c965a-1ef7-4042-9a8a-0b66349066cc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:20.134166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13c965a-1ef7-4042-9a8a-0b66349066cc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:20.229912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:20.811893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e13c965a-1ef7-4042-9a8a-0b66349066cc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:20.828686 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e13c965a-1ef7-4042-9a8a-0b66349066cc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1366 microversion: 2.1 time: 0.734566 Aug 27 05:20:20.829897 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2606/5208] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:20 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1366 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:20.951998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eb4e7e27-c8cb-43b3-af28-2553d10ade75 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:20.952988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eb4e7e27-c8cb-43b3-af28-2553d10ade75 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:20.967216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb4e7e27-c8cb-43b3-af28-2553d10ade75 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:20.968163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb4e7e27-c8cb-43b3-af28-2553d10ade75 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:20.968868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb4e7e27-c8cb-43b3-af28-2553d10ade75 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:20.970418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb4e7e27-c8cb-43b3-af28-2553d10ade75 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:20.971198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb4e7e27-c8cb-43b3-af28-2553d10ade75 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:20.972241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eb4e7e27-c8cb-43b3-af28-2553d10ade75 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:21.024508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1293ddfa-9940-402b-8304-8b6d49c061a2 req-1ce62846-ddbf-4d7c-8572-184cad9cb664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e12d584-d333-430d-aec1-67778b1f5575", "name": "network-vif-plugged", "status": "completed", "tag": "9ddfbd7c-1d05-4d8b-bac3-be7daad6a93e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:21.066566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1293ddfa-9940-402b-8304-8b6d49c061a2 req-1ce62846-ddbf-4d7c-8572-184cad9cb664 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:21.072340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1293ddfa-9940-402b-8304-8b6d49c061a2 req-1ce62846-ddbf-4d7c-8572-184cad9cb664 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:21.072857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1293ddfa-9940-402b-8304-8b6d49c061a2 req-1ce62846-ddbf-4d7c-8572-184cad9cb664 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:21.110018 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1293ddfa-9940-402b-8304-8b6d49c061a2 req-1ce62846-ddbf-4d7c-8572-184cad9cb664 service nova] Creating event network-vif-plugged:9ddfbd7c-1d05-4d8b-bac3-be7daad6a93e for instance 4e12d584-d333-430d-aec1-67778b1f5575 on n-h1-820368-35 Aug 27 05:20:21.124826 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1293ddfa-9940-402b-8304-8b6d49c061a2 req-1ce62846-ddbf-4d7c-8572-184cad9cb664 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105836 Aug 27 05:20:21.127908 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2607/5209] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:20:21.716278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eb4e7e27-c8cb-43b3-af28-2553d10ade75 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:21.726259 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eb4e7e27-c8cb-43b3-af28-2553d10ade75 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1319 microversion: 2.1 time: 0.784035 Aug 27 05:20:21.732435 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2603/5210] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:20 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1319 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:21.857300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:21.862024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-573cc6e1-99fd-4051-b6c1-65a6d4f2a8ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:21.862977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-573cc6e1-99fd-4051-b6c1-65a6d4f2a8ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:21.881632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-4f5ac0e9-3198-4751-a908-d42dac2f5d26 req-78e9b2d0-da39-493a-a849-dd2066f5c39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df18d421-9a0a-4e32-afdd-53fcc12120c7", "tag": "d6e42016-2708-4205-9895-3cf6dfdcde96"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:21.888984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-573cc6e1-99fd-4051-b6c1-65a6d4f2a8ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:21.889475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-573cc6e1-99fd-4051-b6c1-65a6d4f2a8ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:21.901322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-573cc6e1-99fd-4051-b6c1-65a6d4f2a8ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:21.908940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-573cc6e1-99fd-4051-b6c1-65a6d4f2a8ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:21.918228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-573cc6e1-99fd-4051-b6c1-65a6d4f2a8ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:21.920548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-573cc6e1-99fd-4051-b6c1-65a6d4f2a8ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:21.925875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4f5ac0e9-3198-4751-a908-d42dac2f5d26 req-78e9b2d0-da39-493a-a849-dd2066f5c39b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:21.928380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4f5ac0e9-3198-4751-a908-d42dac2f5d26 req-78e9b2d0-da39-493a-a849-dd2066f5c39b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:21.929112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4f5ac0e9-3198-4751-a908-d42dac2f5d26 req-78e9b2d0-da39-493a-a849-dd2066f5c39b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:21.989819 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-4f5ac0e9-3198-4751-a908-d42dac2f5d26 req-78e9b2d0-da39-493a-a849-dd2066f5c39b service nova] Creating event network-changed:d6e42016-2708-4205-9895-3cf6dfdcde96 for instance df18d421-9a0a-4e32-afdd-53fcc12120c7 on n-h2-820368-35 Aug 27 05:20:21.999627 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-4f5ac0e9-3198-4751-a908-d42dac2f5d26 req-78e9b2d0-da39-493a-a849-dd2066f5c39b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122377 Aug 27 05:20:22.006428 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2604/5211] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:20:22.188319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-573cc6e1-99fd-4051-b6c1-65a6d4f2a8ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:22.204101 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-573cc6e1-99fd-4051-b6c1-65a6d4f2a8ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1366 microversion: 2.1 time: 0.346942 Aug 27 05:20:22.208331 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2608/5212] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:21 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:22.776915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:22.799778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e53f78d7-dc34-4251-8f19-0b67297a8c04 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:22.806982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e53f78d7-dc34-4251-8f19-0b67297a8c04 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:22.832863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e53f78d7-dc34-4251-8f19-0b67297a8c04 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:22.833480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e53f78d7-dc34-4251-8f19-0b67297a8c04 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:22.834073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e53f78d7-dc34-4251-8f19-0b67297a8c04 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:22.835216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e53f78d7-dc34-4251-8f19-0b67297a8c04 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:22.835787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e53f78d7-dc34-4251-8f19-0b67297a8c04 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:22.836389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e53f78d7-dc34-4251-8f19-0b67297a8c04 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:23.120378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e53f78d7-dc34-4251-8f19-0b67297a8c04 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:23.132916 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e53f78d7-dc34-4251-8f19-0b67297a8c04 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1319 microversion: 2.1 time: 0.361196 Aug 27 05:20:23.138903 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2605/5213] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:22 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:23.231672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1ce91ad-9725-4dcb-90a2-a13f72b57ec4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:23.234185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1ce91ad-9725-4dcb-90a2-a13f72b57ec4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:23.242388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:23.266095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1ce91ad-9725-4dcb-90a2-a13f72b57ec4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:23.267576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1ce91ad-9725-4dcb-90a2-a13f72b57ec4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:23.268334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1ce91ad-9725-4dcb-90a2-a13f72b57ec4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:23.269206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1ce91ad-9725-4dcb-90a2-a13f72b57ec4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:23.270140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1ce91ad-9725-4dcb-90a2-a13f72b57ec4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:23.270849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1ce91ad-9725-4dcb-90a2-a13f72b57ec4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:23.954624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1ce91ad-9725-4dcb-90a2-a13f72b57ec4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:23.963471 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1ce91ad-9725-4dcb-90a2-a13f72b57ec4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1366 microversion: 2.1 time: 0.737729 Aug 27 05:20:23.964097 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2609/5214] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:23 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1366 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:24.100195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d0a65a7e-8d8a-43e8-874b-4408ea287db7 req-24274be7-5f09-4bfb-b23d-1acb017e81c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7414ec4-d80b-47d7-b17d-80c18f4682bf", "tag": "5d8dad91-fc78-4541-91fe-08aee641af82"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:24.122259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d0a65a7e-8d8a-43e8-874b-4408ea287db7 req-24274be7-5f09-4bfb-b23d-1acb017e81c6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:24.122901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d0a65a7e-8d8a-43e8-874b-4408ea287db7 req-24274be7-5f09-4bfb-b23d-1acb017e81c6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:24.123268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d0a65a7e-8d8a-43e8-874b-4408ea287db7 req-24274be7-5f09-4bfb-b23d-1acb017e81c6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:24.151040 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d0a65a7e-8d8a-43e8-874b-4408ea287db7 req-24274be7-5f09-4bfb-b23d-1acb017e81c6 service nova] Creating event network-changed:5d8dad91-fc78-4541-91fe-08aee641af82 for instance d7414ec4-d80b-47d7-b17d-80c18f4682bf on n-h1-820368-35 Aug 27 05:20:24.160605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ea9a149-cdff-4468-ad4b-1b0d941f4385 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:24.161225 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d0a65a7e-8d8a-43e8-874b-4408ea287db7 req-24274be7-5f09-4bfb-b23d-1acb017e81c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064489 Aug 27 05:20:24.161446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6ea9a149-cdff-4468-ad4b-1b0d941f4385 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:24.167113 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2606/5215] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:20:24.174594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ea9a149-cdff-4468-ad4b-1b0d941f4385 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:24.175257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ea9a149-cdff-4468-ad4b-1b0d941f4385 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:24.177825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ea9a149-cdff-4468-ad4b-1b0d941f4385 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:24.179787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ea9a149-cdff-4468-ad4b-1b0d941f4385 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:24.180745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ea9a149-cdff-4468-ad4b-1b0d941f4385 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:24.182058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ea9a149-cdff-4468-ad4b-1b0d941f4385 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:24.564145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6ea9a149-cdff-4468-ad4b-1b0d941f4385 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:24.595610 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6ea9a149-cdff-4468-ad4b-1b0d941f4385 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1319 microversion: 2.1 time: 0.432150 Aug 27 05:20:24.609582 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2610/5216] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:24 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:24.991942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-76f11769-d2a6-4aad-b238-06537661dd54 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:24.992734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-76f11769-d2a6-4aad-b238-06537661dd54 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:25.000600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f11769-d2a6-4aad-b238-06537661dd54 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:25.001085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f11769-d2a6-4aad-b238-06537661dd54 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:25.001701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f11769-d2a6-4aad-b238-06537661dd54 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:25.003059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f11769-d2a6-4aad-b238-06537661dd54 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:25.003707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f11769-d2a6-4aad-b238-06537661dd54 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:25.004291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f11769-d2a6-4aad-b238-06537661dd54 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:25.207360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-76f11769-d2a6-4aad-b238-06537661dd54 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:25.218740 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-76f11769-d2a6-4aad-b238-06537661dd54 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1556 microversion: 2.1 time: 0.233334 Aug 27 05:20:25.237346 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2607/5217] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:24 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:25.253256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f999a8e1-b4b2-429b-be24-ef497f62e3b5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:25.253777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f999a8e1-b4b2-429b-be24-ef497f62e3b5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:25.276137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f999a8e1-b4b2-429b-be24-ef497f62e3b5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:25.276968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f999a8e1-b4b2-429b-be24-ef497f62e3b5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:25.277742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f999a8e1-b4b2-429b-be24-ef497f62e3b5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:25.278666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f999a8e1-b4b2-429b-be24-ef497f62e3b5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:25.279307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f999a8e1-b4b2-429b-be24-ef497f62e3b5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:25.279886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f999a8e1-b4b2-429b-be24-ef497f62e3b5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:25.470992 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f999a8e1-b4b2-429b-be24-ef497f62e3b5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227915 Aug 27 05:20:25.472511 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2611/5218] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:20:25 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:20:25.620059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a898b2ca-fc66-4332-9805-b27376a0608c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:25.621065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a898b2ca-fc66-4332-9805-b27376a0608c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:25.627814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a898b2ca-fc66-4332-9805-b27376a0608c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:25.628336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a898b2ca-fc66-4332-9805-b27376a0608c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:25.633795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a898b2ca-fc66-4332-9805-b27376a0608c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:25.634749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a898b2ca-fc66-4332-9805-b27376a0608c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:25.635425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a898b2ca-fc66-4332-9805-b27376a0608c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:25.636032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a898b2ca-fc66-4332-9805-b27376a0608c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:26.475821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a898b2ca-fc66-4332-9805-b27376a0608c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:26.478991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:26.488421 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a898b2ca-fc66-4332-9805-b27376a0608c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1319 microversion: 2.1 time: 0.876117 Aug 27 05:20:26.489029 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2608/5219] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:25 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1319 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:27.515781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0cce800e-5b7a-40dd-98ef-9b73ba626cf8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:27.516947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0cce800e-5b7a-40dd-98ef-9b73ba626cf8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:27.530630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cce800e-5b7a-40dd-98ef-9b73ba626cf8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:27.531176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cce800e-5b7a-40dd-98ef-9b73ba626cf8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:27.531975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cce800e-5b7a-40dd-98ef-9b73ba626cf8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:27.533297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cce800e-5b7a-40dd-98ef-9b73ba626cf8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:27.535445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cce800e-5b7a-40dd-98ef-9b73ba626cf8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:27.537512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cce800e-5b7a-40dd-98ef-9b73ba626cf8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:28.038091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0cce800e-5b7a-40dd-98ef-9b73ba626cf8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:28.052939 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0cce800e-5b7a-40dd-98ef-9b73ba626cf8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1319 microversion: 2.1 time: 0.541780 Aug 27 05:20:28.055049 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2612/5220] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:27 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1319 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:28.127724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-10a922ea-0a4c-4a86-ad51-998bc86d68c2 req-63b62753-075a-4125-8e77-923613bd4bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e12d584-d333-430d-aec1-67778b1f5575", "tag": "9ddfbd7c-1d05-4d8b-bac3-be7daad6a93e"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:28.161228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:28.163990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-10a922ea-0a4c-4a86-ad51-998bc86d68c2 req-63b62753-075a-4125-8e77-923613bd4bf8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:28.169228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-10a922ea-0a4c-4a86-ad51-998bc86d68c2 req-63b62753-075a-4125-8e77-923613bd4bf8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:28.171796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-10a922ea-0a4c-4a86-ad51-998bc86d68c2 req-63b62753-075a-4125-8e77-923613bd4bf8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:28.198910 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-10a922ea-0a4c-4a86-ad51-998bc86d68c2 req-63b62753-075a-4125-8e77-923613bd4bf8 service nova] Creating event network-changed:9ddfbd7c-1d05-4d8b-bac3-be7daad6a93e for instance 4e12d584-d333-430d-aec1-67778b1f5575 on n-h1-820368-35 Aug 27 05:20:28.207152 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-10a922ea-0a4c-4a86-ad51-998bc86d68c2 req-63b62753-075a-4125-8e77-923613bd4bf8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084048 Aug 27 05:20:28.208334 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2609/5221] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:20:29.075526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b56f2a80-72be-4fff-9d99-34105eee5d8e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:29.076153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b56f2a80-72be-4fff-9d99-34105eee5d8e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:29.098154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b56f2a80-72be-4fff-9d99-34105eee5d8e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:29.116026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b56f2a80-72be-4fff-9d99-34105eee5d8e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:29.116796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b56f2a80-72be-4fff-9d99-34105eee5d8e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:29.117766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b56f2a80-72be-4fff-9d99-34105eee5d8e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:29.118403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b56f2a80-72be-4fff-9d99-34105eee5d8e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:29.127363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b56f2a80-72be-4fff-9d99-34105eee5d8e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:30.147257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b56f2a80-72be-4fff-9d99-34105eee5d8e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:30.161726 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b56f2a80-72be-4fff-9d99-34105eee5d8e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1319 microversion: 2.1 time: 1.090199 Aug 27 05:20:30.165464 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2613/5222] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:29 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1319 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:31.200011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-12c39c2a-b3d0-4480-8094-64cafd3f2472 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:31.221204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-12c39c2a-b3d0-4480-8094-64cafd3f2472 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:31.239284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c39c2a-b3d0-4480-8094-64cafd3f2472 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:31.240911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c39c2a-b3d0-4480-8094-64cafd3f2472 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:31.243068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c39c2a-b3d0-4480-8094-64cafd3f2472 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:31.247833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c39c2a-b3d0-4480-8094-64cafd3f2472 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:31.249319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c39c2a-b3d0-4480-8094-64cafd3f2472 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:31.250057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12c39c2a-b3d0-4480-8094-64cafd3f2472 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:31.510924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-12c39c2a-b3d0-4480-8094-64cafd3f2472 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:31.520165 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-12c39c2a-b3d0-4480-8094-64cafd3f2472 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1319 microversion: 2.1 time: 0.338036 Aug 27 05:20:31.520905 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2610/5223] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:31 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:32.559123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2e109dbb-6ec3-49c9-a712-1dc3a064bd0b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:32.559975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2e109dbb-6ec3-49c9-a712-1dc3a064bd0b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:32.578008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e109dbb-6ec3-49c9-a712-1dc3a064bd0b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:32.588528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e109dbb-6ec3-49c9-a712-1dc3a064bd0b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:32.589551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e109dbb-6ec3-49c9-a712-1dc3a064bd0b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:32.590534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e109dbb-6ec3-49c9-a712-1dc3a064bd0b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:32.593524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e109dbb-6ec3-49c9-a712-1dc3a064bd0b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:32.594360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e109dbb-6ec3-49c9-a712-1dc3a064bd0b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:33.061544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2e109dbb-6ec3-49c9-a712-1dc3a064bd0b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:33.072595 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2e109dbb-6ec3-49c9-a712-1dc3a064bd0b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1319 microversion: 2.1 time: 0.532091 Aug 27 05:20:33.074857 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2614/5224] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:32 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:33.513619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-19516226-efc3-45a0-b3d2-5a1f97b84fd6 req-fdb4f6aa-566a-4c47-86ae-b42c6e0446a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df18d421-9a0a-4e32-afdd-53fcc12120c7", "name": "network-vif-plugged", "status": "completed", "tag": "d6e42016-2708-4205-9895-3cf6dfdcde96"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:33.567533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-19516226-efc3-45a0-b3d2-5a1f97b84fd6 req-fdb4f6aa-566a-4c47-86ae-b42c6e0446a3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:33.569888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-19516226-efc3-45a0-b3d2-5a1f97b84fd6 req-fdb4f6aa-566a-4c47-86ae-b42c6e0446a3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:33.571131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-19516226-efc3-45a0-b3d2-5a1f97b84fd6 req-fdb4f6aa-566a-4c47-86ae-b42c6e0446a3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:33.609699 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-19516226-efc3-45a0-b3d2-5a1f97b84fd6 req-fdb4f6aa-566a-4c47-86ae-b42c6e0446a3 service nova] Creating event network-vif-plugged:d6e42016-2708-4205-9895-3cf6dfdcde96 for instance df18d421-9a0a-4e32-afdd-53fcc12120c7 on n-h2-820368-35 Aug 27 05:20:33.632311 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-19516226-efc3-45a0-b3d2-5a1f97b84fd6 req-fdb4f6aa-566a-4c47-86ae-b42c6e0446a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124397 Aug 27 05:20:33.634431 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2611/5225] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:20:34.101259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-06e8c507-9009-40e8-ba57-82592509fba8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:34.102128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-06e8c507-9009-40e8-ba57-82592509fba8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:34.122380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06e8c507-9009-40e8-ba57-82592509fba8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:34.123060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06e8c507-9009-40e8-ba57-82592509fba8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:34.123760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06e8c507-9009-40e8-ba57-82592509fba8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:34.125962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06e8c507-9009-40e8-ba57-82592509fba8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:34.126604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06e8c507-9009-40e8-ba57-82592509fba8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:34.128701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06e8c507-9009-40e8-ba57-82592509fba8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:34.475933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-06e8c507-9009-40e8-ba57-82592509fba8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:34.497777 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-06e8c507-9009-40e8-ba57-82592509fba8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1319 microversion: 2.1 time: 0.404497 Aug 27 05:20:34.500806 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2615/5226] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:34 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:35.531743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-def4c3e8-66a2-4d54-ae9f-55318eee77ec tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:35.533942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-def4c3e8-66a2-4d54-ae9f-55318eee77ec tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:35.542315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-def4c3e8-66a2-4d54-ae9f-55318eee77ec tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:35.544029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-def4c3e8-66a2-4d54-ae9f-55318eee77ec tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:35.545337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-def4c3e8-66a2-4d54-ae9f-55318eee77ec tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:35.547014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-def4c3e8-66a2-4d54-ae9f-55318eee77ec tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:35.548443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-def4c3e8-66a2-4d54-ae9f-55318eee77ec tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:35.549306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-def4c3e8-66a2-4d54-ae9f-55318eee77ec tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:35.674817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1643b090-d3ca-4363-a027-bfa5e021d95f req-a19548db-d8e8-4c40-b71c-ca6424cf78a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7414ec4-d80b-47d7-b17d-80c18f4682bf", "name": "network-vif-plugged", "status": "completed", "tag": "5d8dad91-fc78-4541-91fe-08aee641af82"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:35.695749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1643b090-d3ca-4363-a027-bfa5e021d95f req-a19548db-d8e8-4c40-b71c-ca6424cf78a1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:35.696237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1643b090-d3ca-4363-a027-bfa5e021d95f req-a19548db-d8e8-4c40-b71c-ca6424cf78a1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:35.696678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1643b090-d3ca-4363-a027-bfa5e021d95f req-a19548db-d8e8-4c40-b71c-ca6424cf78a1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:35.724213 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1643b090-d3ca-4363-a027-bfa5e021d95f req-a19548db-d8e8-4c40-b71c-ca6424cf78a1 service nova] Creating event network-vif-plugged:5d8dad91-fc78-4541-91fe-08aee641af82 for instance d7414ec4-d80b-47d7-b17d-80c18f4682bf on n-h1-820368-35 Aug 27 05:20:35.747335 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1643b090-d3ca-4363-a027-bfa5e021d95f req-a19548db-d8e8-4c40-b71c-ca6424cf78a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076058 Aug 27 05:20:35.748318 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2616/5227] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:20:35.819954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-def4c3e8-66a2-4d54-ae9f-55318eee77ec tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:35.838248 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-def4c3e8-66a2-4d54-ae9f-55318eee77ec tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1319 microversion: 2.1 time: 0.312041 Aug 27 05:20:35.841156 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2612/5228] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:35 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:36.863834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf77cbde-cf9b-47fd-b0be-b93d93f84fc8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:36.864649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf77cbde-cf9b-47fd-b0be-b93d93f84fc8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:36.878719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf77cbde-cf9b-47fd-b0be-b93d93f84fc8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:36.881020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf77cbde-cf9b-47fd-b0be-b93d93f84fc8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:36.883279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf77cbde-cf9b-47fd-b0be-b93d93f84fc8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:36.891469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf77cbde-cf9b-47fd-b0be-b93d93f84fc8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:36.892300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf77cbde-cf9b-47fd-b0be-b93d93f84fc8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:36.892964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf77cbde-cf9b-47fd-b0be-b93d93f84fc8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:37.243541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cf77cbde-cf9b-47fd-b0be-b93d93f84fc8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:37.261778 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf77cbde-cf9b-47fd-b0be-b93d93f84fc8 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1319 microversion: 2.1 time: 0.403397 Aug 27 05:20:37.262834 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2617/5229] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:36 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:38.288428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c6f1e3cf-96e1-4cd5-bce4-223008353c5e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:38.289134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c6f1e3cf-96e1-4cd5-bce4-223008353c5e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:38.298904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6f1e3cf-96e1-4cd5-bce4-223008353c5e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:38.299786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6f1e3cf-96e1-4cd5-bce4-223008353c5e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:38.300441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6f1e3cf-96e1-4cd5-bce4-223008353c5e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:38.302166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6f1e3cf-96e1-4cd5-bce4-223008353c5e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:38.302820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6f1e3cf-96e1-4cd5-bce4-223008353c5e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:38.307034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6f1e3cf-96e1-4cd5-bce4-223008353c5e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:39.261949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c6f1e3cf-96e1-4cd5-bce4-223008353c5e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:39.272198 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c6f1e3cf-96e1-4cd5-bce4-223008353c5e tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 200 len: 1507 microversion: 2.1 time: 0.988884 Aug 27 05:20:39.287633 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2613/5230] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:38 2022] GET /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 1507 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:39.294203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d18aa134-6289-4f9f-8458-988af67aa3fb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:39.295506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d18aa134-6289-4f9f-8458-988af67aa3fb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: df18d421-9a0a-4e32-afdd-53fcc12120c7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:39.303377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d18aa134-6289-4f9f-8458-988af67aa3fb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:39.304142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d18aa134-6289-4f9f-8458-988af67aa3fb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:39.304922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d18aa134-6289-4f9f-8458-988af67aa3fb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:39.305854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d18aa134-6289-4f9f-8458-988af67aa3fb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:39.306468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d18aa134-6289-4f9f-8458-988af67aa3fb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:39.307050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d18aa134-6289-4f9f-8458-988af67aa3fb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:39.628926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d18aa134-6289-4f9f-8458-988af67aa3fb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:39.641999 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d18aa134-6289-4f9f-8458-988af67aa3fb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/df18d421-9a0a-4e32-afdd-53fcc12120c7" status: 200 len: 1507 microversion: 2.1 time: 0.351735 Aug 27 05:20:39.656878 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2618/5231] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:39 2022] GET /compute/v2.1/servers/df18d421-9a0a-4e32-afdd-53fcc12120c7 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:39.668590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-93d9b8f8-82df-4e38-9aef-a06e316952f1 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:39.673667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-93d9b8f8-82df-4e38-9aef-a06e316952f1 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: df18d421-9a0a-4e32-afdd-53fcc12120c7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:39.681334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d9b8f8-82df-4e38-9aef-a06e316952f1 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:39.682199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d9b8f8-82df-4e38-9aef-a06e316952f1 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:39.683238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d9b8f8-82df-4e38-9aef-a06e316952f1 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:39.684568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d9b8f8-82df-4e38-9aef-a06e316952f1 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:39.685309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d9b8f8-82df-4e38-9aef-a06e316952f1 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:39.685977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d9b8f8-82df-4e38-9aef-a06e316952f1 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:39.720612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-93d9b8f8-82df-4e38-9aef-a06e316952f1 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: df18d421-9a0a-4e32-afdd-53fcc12120c7] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:20:39.826392 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-93d9b8f8-82df-4e38-9aef-a06e316952f1 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/df18d421-9a0a-4e32-afdd-53fcc12120c7" status: 204 len: 0 microversion: 2.1 time: 0.162975 Aug 27 05:20:39.828375 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2614/5232] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:20:39 2022] DELETE /compute/v2.1/servers/df18d421-9a0a-4e32-afdd-53fcc12120c7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:20:39.840611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2c32744b-6191-405d-9797-9719726bbde0 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:39.841529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2c32744b-6191-405d-9797-9719726bbde0 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:39.856742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c32744b-6191-405d-9797-9719726bbde0 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:39.863652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c32744b-6191-405d-9797-9719726bbde0 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:39.864770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c32744b-6191-405d-9797-9719726bbde0 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:39.866276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c32744b-6191-405d-9797-9719726bbde0 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:39.866944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c32744b-6191-405d-9797-9719726bbde0 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:39.867410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c32744b-6191-405d-9797-9719726bbde0 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:39.905126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2c32744b-6191-405d-9797-9719726bbde0 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: d7414ec4-d80b-47d7-b17d-80c18f4682bf] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:20:40.076933 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2c32744b-6191-405d-9797-9719726bbde0 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf" status: 204 len: 0 microversion: 2.1 time: 0.243242 Aug 27 05:20:40.078382 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2619/5233] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:20:39 2022] DELETE /compute/v2.1/servers/d7414ec4-d80b-47d7-b17d-80c18f4682bf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:20:40.231816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1733930785", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e3f0f994-1021-4267-a3e8-38550615143e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:40.306665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] validate_networks() for [('e3f0f994-1021-4267-a3e8-38550615143e', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:20:41.089123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:20:41.089855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:20:41.090614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:20:41.091345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:20:41.092263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:20:41.110172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:41.110742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:41.111289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:41.112129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:41.112657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:41.113152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:41.137939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Getting quotas for project ae67351e57d741f58e35ee388c5ccadf. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:20:41.148340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Getting quotas for user 2a9ab1851ccf471dbff261bfeb5bbb44 and project ae67351e57d741f58e35ee388c5ccadf. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:20:41.175579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Going to run 2 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:20:41.178518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: c3182297-5251-436b-86bc-cea4f48958ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:20:41.222485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=c3182297-5251-436b-86bc-cea4f48958ac,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:20:41.313726 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1c1de636-590e-4d67-b0a9-bc2f84868801 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.091300 Aug 27 05:20:41.315043 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2615/5234] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:20:40 2022] POST /compute/v2.1/servers => generated 32 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 05:20:41.325192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b32d722-8bec-410f-93bd-d1dc1cada1a2 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:41.331342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b32d722-8bec-410f-93bd-d1dc1cada1a2 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:41.332493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b32d722-8bec-410f-93bd-d1dc1cada1a2 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Searching by: {'deleted': False, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:20:41.356311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b32d722-8bec-410f-93bd-d1dc1cada1a2 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:41.357171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b32d722-8bec-410f-93bd-d1dc1cada1a2 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:41.358076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b32d722-8bec-410f-93bd-d1dc1cada1a2 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:41.359081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b32d722-8bec-410f-93bd-d1dc1cada1a2 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:41.359799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b32d722-8bec-410f-93bd-d1dc1cada1a2 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:41.360470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b32d722-8bec-410f-93bd-d1dc1cada1a2 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:41.437341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-2b32d722-8bec-410f-93bd-d1dc1cada1a2 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:20:41.494674 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b32d722-8bec-410f-93bd-d1dc1cada1a2 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.174564 Aug 27 05:20:41.495885 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2620/5235] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 05:20:41 2022] GET /compute/v2.1/servers => generated 1335 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:41.514168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a5af066c-48e3-49e9-8c9e-4f385509b748 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:41.520602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a5af066c-48e3-49e9-8c9e-4f385509b748 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:42.031241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a5af066c-48e3-49e9-8c9e-4f385509b748 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:42.043445 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a5af066c-48e3-49e9-8c9e-4f385509b748 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1218 microversion: 2.1 time: 0.533241 Aug 27 05:20:42.053522 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2616/5236] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:41 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1218 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:43.087387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-605928bb-1f5b-4203-98ff-6305234039e7 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:43.094182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-605928bb-1f5b-4203-98ff-6305234039e7 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:43.131612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605928bb-1f5b-4203-98ff-6305234039e7 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:43.135682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605928bb-1f5b-4203-98ff-6305234039e7 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:43.138788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605928bb-1f5b-4203-98ff-6305234039e7 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:43.139666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605928bb-1f5b-4203-98ff-6305234039e7 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:43.141235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605928bb-1f5b-4203-98ff-6305234039e7 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:43.142309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-605928bb-1f5b-4203-98ff-6305234039e7 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:43.598533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-605928bb-1f5b-4203-98ff-6305234039e7 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:43.602419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-572bf9b7-5ec5-4b0b-8198-65d4dbb45c40 req-e8a3834e-7ee6-4487-bc49-f10d4b239dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7414ec4-d80b-47d7-b17d-80c18f4682bf", "name": "network-vif-deleted", "tag": "5d8dad91-fc78-4541-91fe-08aee641af82"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:43.617877 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-605928bb-1f5b-4203-98ff-6305234039e7 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1222 microversion: 2.1 time: 0.552241 Aug 27 05:20:43.620563 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2621/5237] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:43 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1222 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:43.632056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-572bf9b7-5ec5-4b0b-8198-65d4dbb45c40 req-e8a3834e-7ee6-4487-bc49-f10d4b239dd7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:43.632056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-572bf9b7-5ec5-4b0b-8198-65d4dbb45c40 req-e8a3834e-7ee6-4487-bc49-f10d4b239dd7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:43.632056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-572bf9b7-5ec5-4b0b-8198-65d4dbb45c40 req-e8a3834e-7ee6-4487-bc49-f10d4b239dd7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:43.644766 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-572bf9b7-5ec5-4b0b-8198-65d4dbb45c40 req-e8a3834e-7ee6-4487-bc49-f10d4b239dd7 service nova] Creating event network-vif-deleted:5d8dad91-fc78-4541-91fe-08aee641af82 for instance d7414ec4-d80b-47d7-b17d-80c18f4682bf on n-h1-820368-35 Aug 27 05:20:43.651499 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-572bf9b7-5ec5-4b0b-8198-65d4dbb45c40 req-e8a3834e-7ee6-4487-bc49-f10d4b239dd7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053827 Aug 27 05:20:43.653143 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2617/5238] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:20:44.448878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0b0490a7-c256-423d-af22-38fa58c29cbd req-af67c998-b8d2-4d0a-91e8-ec7f82bacb4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df18d421-9a0a-4e32-afdd-53fcc12120c7", "name": "network-vif-deleted", "tag": "d6e42016-2708-4205-9895-3cf6dfdcde96"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:44.484294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0b0490a7-c256-423d-af22-38fa58c29cbd req-af67c998-b8d2-4d0a-91e8-ec7f82bacb4c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:44.487525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0b0490a7-c256-423d-af22-38fa58c29cbd req-af67c998-b8d2-4d0a-91e8-ec7f82bacb4c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:44.494252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0b0490a7-c256-423d-af22-38fa58c29cbd req-af67c998-b8d2-4d0a-91e8-ec7f82bacb4c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:44.568131 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0b0490a7-c256-423d-af22-38fa58c29cbd req-af67c998-b8d2-4d0a-91e8-ec7f82bacb4c service nova] Creating event network-vif-deleted:d6e42016-2708-4205-9895-3cf6dfdcde96 for instance df18d421-9a0a-4e32-afdd-53fcc12120c7 on n-h2-820368-35 Aug 27 05:20:44.590879 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0b0490a7-c256-423d-af22-38fa58c29cbd req-af67c998-b8d2-4d0a-91e8-ec7f82bacb4c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143604 Aug 27 05:20:44.592614 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2622/5239] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:20:44.651738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-030e3698-da0a-42d4-976f-4d2a4c9a79c4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:44.654371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-030e3698-da0a-42d4-976f-4d2a4c9a79c4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:44.667775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-030e3698-da0a-42d4-976f-4d2a4c9a79c4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:44.668313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-030e3698-da0a-42d4-976f-4d2a4c9a79c4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:44.668742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-030e3698-da0a-42d4-976f-4d2a4c9a79c4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:44.672385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-030e3698-da0a-42d4-976f-4d2a4c9a79c4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:44.673044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-030e3698-da0a-42d4-976f-4d2a4c9a79c4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:44.684153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-030e3698-da0a-42d4-976f-4d2a4c9a79c4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:45.105146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-030e3698-da0a-42d4-976f-4d2a4c9a79c4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:45.127849 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-030e3698-da0a-42d4-976f-4d2a4c9a79c4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1278 microversion: 2.1 time: 0.486833 Aug 27 05:20:45.130577 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2618/5240] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:44 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1278 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:46.154561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-01df82d6-52f1-41cb-afa9-286bd4730b33 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:46.156109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-01df82d6-52f1-41cb-afa9-286bd4730b33 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:46.164453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01df82d6-52f1-41cb-afa9-286bd4730b33 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:46.165344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01df82d6-52f1-41cb-afa9-286bd4730b33 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:46.166067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01df82d6-52f1-41cb-afa9-286bd4730b33 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:46.167262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01df82d6-52f1-41cb-afa9-286bd4730b33 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:46.168034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01df82d6-52f1-41cb-afa9-286bd4730b33 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:46.168720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01df82d6-52f1-41cb-afa9-286bd4730b33 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:46.199467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:46.571570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-01df82d6-52f1-41cb-afa9-286bd4730b33 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:46.581343 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-01df82d6-52f1-41cb-afa9-286bd4730b33 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1276 microversion: 2.1 time: 0.431494 Aug 27 05:20:46.583894 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2623/5241] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:46 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1276 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:47.610429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e33c4e7d-60a4-48fa-9beb-970deabf21df tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:47.612457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e33c4e7d-60a4-48fa-9beb-970deabf21df tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:47.632656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e33c4e7d-60a4-48fa-9beb-970deabf21df tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:47.633419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e33c4e7d-60a4-48fa-9beb-970deabf21df tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:47.634044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e33c4e7d-60a4-48fa-9beb-970deabf21df tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:47.641232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e33c4e7d-60a4-48fa-9beb-970deabf21df tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:47.651409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e33c4e7d-60a4-48fa-9beb-970deabf21df tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:47.653317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e33c4e7d-60a4-48fa-9beb-970deabf21df tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:48.160077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e33c4e7d-60a4-48fa-9beb-970deabf21df tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:48.174668 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e33c4e7d-60a4-48fa-9beb-970deabf21df tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1318 microversion: 2.1 time: 0.571612 Aug 27 05:20:48.194460 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2619/5242] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:47 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:48.349339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1b666471-a51c-432f-b3d3-fe1fc833611d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:48.351880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1b666471-a51c-432f-b3d3-fe1fc833611d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:48.358195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:48.363019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b666471-a51c-432f-b3d3-fe1fc833611d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:48.363744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b666471-a51c-432f-b3d3-fe1fc833611d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:48.365064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b666471-a51c-432f-b3d3-fe1fc833611d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:48.365853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b666471-a51c-432f-b3d3-fe1fc833611d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:48.366389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b666471-a51c-432f-b3d3-fe1fc833611d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:48.366888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b666471-a51c-432f-b3d3-fe1fc833611d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:48.504228 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1b666471-a51c-432f-b3d3-fe1fc833611d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.160489 Aug 27 05:20:48.505586 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2624/5243] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:20:48 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:20:48.517664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-61d9e7b1-1e04-44ad-99e0-b767199e0519 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:48.518695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-61d9e7b1-1e04-44ad-99e0-b767199e0519 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:48.535899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d9e7b1-1e04-44ad-99e0-b767199e0519 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:48.535899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d9e7b1-1e04-44ad-99e0-b767199e0519 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:48.536853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d9e7b1-1e04-44ad-99e0-b767199e0519 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:48.537786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d9e7b1-1e04-44ad-99e0-b767199e0519 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:48.538272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d9e7b1-1e04-44ad-99e0-b767199e0519 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:48.539019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d9e7b1-1e04-44ad-99e0-b767199e0519 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:49.048414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-61d9e7b1-1e04-44ad-99e0-b767199e0519 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:49.061806 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-61d9e7b1-1e04-44ad-99e0-b767199e0519 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1670 microversion: 2.1 time: 0.550367 Aug 27 05:20:49.064169 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2620/5244] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:48 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1670 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:49.201028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-71e4163e-d21c-41c4-947f-b994b49d0c36 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:49.202000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-71e4163e-d21c-41c4-947f-b994b49d0c36 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:49.214774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e4163e-d21c-41c4-947f-b994b49d0c36 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:49.215571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e4163e-d21c-41c4-947f-b994b49d0c36 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:49.216514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e4163e-d21c-41c4-947f-b994b49d0c36 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:49.217973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e4163e-d21c-41c4-947f-b994b49d0c36 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:49.218669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e4163e-d21c-41c4-947f-b994b49d0c36 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:49.219368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e4163e-d21c-41c4-947f-b994b49d0c36 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:49.397164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6fb9c7b8-3bd0-4280-a6d6-db5acf7e093b req-8767bdff-a620-41b5-ba76-76615601ed02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3182297-5251-436b-86bc-cea4f48958ac", "tag": "e548ca4d-741b-44f0-8000-97916790d0a4"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:49.438582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6fb9c7b8-3bd0-4280-a6d6-db5acf7e093b req-8767bdff-a620-41b5-ba76-76615601ed02 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:49.439856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6fb9c7b8-3bd0-4280-a6d6-db5acf7e093b req-8767bdff-a620-41b5-ba76-76615601ed02 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:49.440971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6fb9c7b8-3bd0-4280-a6d6-db5acf7e093b req-8767bdff-a620-41b5-ba76-76615601ed02 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:49.478084 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6fb9c7b8-3bd0-4280-a6d6-db5acf7e093b req-8767bdff-a620-41b5-ba76-76615601ed02 service nova] Creating event network-changed:e548ca4d-741b-44f0-8000-97916790d0a4 for instance c3182297-5251-436b-86bc-cea4f48958ac on n-h2-820368-35 Aug 27 05:20:49.489693 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6fb9c7b8-3bd0-4280-a6d6-db5acf7e093b req-8767bdff-a620-41b5-ba76-76615601ed02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099219 Aug 27 05:20:49.491380 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2621/5245] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:20:49.769357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71e4163e-d21c-41c4-947f-b994b49d0c36 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:49.782769 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-71e4163e-d21c-41c4-947f-b994b49d0c36 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1318 microversion: 2.1 time: 0.587934 Aug 27 05:20:49.786843 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2625/5246] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:49 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:49.939423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-142e79b6-b074-4d6d-b928-dd49ae61d093 req-82944825-1614-4ad0-ad33-af4f21615e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586e6c8a-8548-4473-809c-cf5b5149daec", "tag": "0a2b0278-1430-4588-8997-3b6c196ac81c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:49.958816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-142e79b6-b074-4d6d-b928-dd49ae61d093 req-82944825-1614-4ad0-ad33-af4f21615e12 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:49.959668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-142e79b6-b074-4d6d-b928-dd49ae61d093 req-82944825-1614-4ad0-ad33-af4f21615e12 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:49.960265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-142e79b6-b074-4d6d-b928-dd49ae61d093 req-82944825-1614-4ad0-ad33-af4f21615e12 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:49.988254 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-142e79b6-b074-4d6d-b928-dd49ae61d093 req-82944825-1614-4ad0-ad33-af4f21615e12 service nova] Creating event network-changed:0a2b0278-1430-4588-8997-3b6c196ac81c for instance 586e6c8a-8548-4473-809c-cf5b5149daec on n-h1-820368-35 Aug 27 05:20:49.994262 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-142e79b6-b074-4d6d-b928-dd49ae61d093 req-82944825-1614-4ad0-ad33-af4f21615e12 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069763 Aug 27 05:20:49.996219 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2622/5247] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:20:50.106867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8e6e51b-3aa9-4a42-9457-130116560f6d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:50.107578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e8e6e51b-3aa9-4a42-9457-130116560f6d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:50.115972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8e6e51b-3aa9-4a42-9457-130116560f6d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:50.116562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8e6e51b-3aa9-4a42-9457-130116560f6d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:50.117104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8e6e51b-3aa9-4a42-9457-130116560f6d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:50.117888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8e6e51b-3aa9-4a42-9457-130116560f6d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:50.118421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8e6e51b-3aa9-4a42-9457-130116560f6d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:50.118954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8e6e51b-3aa9-4a42-9457-130116560f6d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:50.618558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e8e6e51b-3aa9-4a42-9457-130116560f6d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:50.630548 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e8e6e51b-3aa9-4a42-9457-130116560f6d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1670 microversion: 2.1 time: 0.528639 Aug 27 05:20:50.645156 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2626/5248] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:50 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1670 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:50.810711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-55aaa732-42ef-402a-8619-d636ba5b0757 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:50.811617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-55aaa732-42ef-402a-8619-d636ba5b0757 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:50.824945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aaa732-42ef-402a-8619-d636ba5b0757 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:50.826119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aaa732-42ef-402a-8619-d636ba5b0757 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:50.828342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aaa732-42ef-402a-8619-d636ba5b0757 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:50.830232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aaa732-42ef-402a-8619-d636ba5b0757 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:50.831701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aaa732-42ef-402a-8619-d636ba5b0757 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:50.832367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55aaa732-42ef-402a-8619-d636ba5b0757 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:51.125425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:51.330673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-55aaa732-42ef-402a-8619-d636ba5b0757 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:51.345485 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-55aaa732-42ef-402a-8619-d636ba5b0757 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1318 microversion: 2.1 time: 0.539845 Aug 27 05:20:51.346111 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2623/5249] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:50 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1318 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:51.657386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdfe0d0c-d7d6-45ef-8f52-22c80e6915f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:51.658010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cdfe0d0c-d7d6-45ef-8f52-22c80e6915f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:51.662019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:51.670160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdfe0d0c-d7d6-45ef-8f52-22c80e6915f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:51.670806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdfe0d0c-d7d6-45ef-8f52-22c80e6915f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:51.671567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdfe0d0c-d7d6-45ef-8f52-22c80e6915f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:51.672513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdfe0d0c-d7d6-45ef-8f52-22c80e6915f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:51.673130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdfe0d0c-d7d6-45ef-8f52-22c80e6915f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:51.673770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdfe0d0c-d7d6-45ef-8f52-22c80e6915f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:51.882839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdfe0d0c-d7d6-45ef-8f52-22c80e6915f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:51.891183 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cdfe0d0c-d7d6-45ef-8f52-22c80e6915f1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1675 microversion: 2.1 time: 0.238815 Aug 27 05:20:51.891834 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2627/5250] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:51 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:52.374712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f04c324-986f-456e-b92a-29feb45cf66f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:52.376635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3f04c324-986f-456e-b92a-29feb45cf66f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:52.380069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:52.391867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f04c324-986f-456e-b92a-29feb45cf66f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:52.396106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f04c324-986f-456e-b92a-29feb45cf66f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:52.396850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f04c324-986f-456e-b92a-29feb45cf66f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:52.397725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f04c324-986f-456e-b92a-29feb45cf66f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:52.399583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f04c324-986f-456e-b92a-29feb45cf66f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:52.400497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f04c324-986f-456e-b92a-29feb45cf66f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:52.832815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3f04c324-986f-456e-b92a-29feb45cf66f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:52.844202 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3f04c324-986f-456e-b92a-29feb45cf66f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1318 microversion: 2.1 time: 0.481930 Aug 27 05:20:52.846162 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2624/5251] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:52 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:52.914038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d122f875-f840-49b1-b623-a73790030ea4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:52.915393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d122f875-f840-49b1-b623-a73790030ea4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:52.925724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d122f875-f840-49b1-b623-a73790030ea4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:52.927032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d122f875-f840-49b1-b623-a73790030ea4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:52.928010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d122f875-f840-49b1-b623-a73790030ea4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:52.928960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d122f875-f840-49b1-b623-a73790030ea4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:52.929798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d122f875-f840-49b1-b623-a73790030ea4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:52.930461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d122f875-f840-49b1-b623-a73790030ea4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:53.389956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d122f875-f840-49b1-b623-a73790030ea4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:53.408016 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d122f875-f840-49b1-b623-a73790030ea4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1675 microversion: 2.1 time: 0.490153 Aug 27 05:20:53.412764 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2628/5252] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:52 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1675 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:53.868016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bf342442-bcd6-4e63-896c-9438e4c8cd45 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:53.869391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bf342442-bcd6-4e63-896c-9438e4c8cd45 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:53.883276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf342442-bcd6-4e63-896c-9438e4c8cd45 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:53.885880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf342442-bcd6-4e63-896c-9438e4c8cd45 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:53.887547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf342442-bcd6-4e63-896c-9438e4c8cd45 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:53.891029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf342442-bcd6-4e63-896c-9438e4c8cd45 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:53.892168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf342442-bcd6-4e63-896c-9438e4c8cd45 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:53.897382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf342442-bcd6-4e63-896c-9438e4c8cd45 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:54.344725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bf342442-bcd6-4e63-896c-9438e4c8cd45 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:54.352930 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bf342442-bcd6-4e63-896c-9438e4c8cd45 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1318 microversion: 2.1 time: 0.489155 Aug 27 05:20:54.369143 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2625/5253] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:53 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:54.435907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d633d5ea-d359-45e9-88c4-8042b7216d48 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:54.437097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d633d5ea-d359-45e9-88c4-8042b7216d48 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:54.445885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d633d5ea-d359-45e9-88c4-8042b7216d48 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:54.446743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d633d5ea-d359-45e9-88c4-8042b7216d48 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:54.447777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d633d5ea-d359-45e9-88c4-8042b7216d48 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:54.449253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d633d5ea-d359-45e9-88c4-8042b7216d48 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:54.449916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d633d5ea-d359-45e9-88c4-8042b7216d48 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:54.450548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d633d5ea-d359-45e9-88c4-8042b7216d48 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:54.953607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d633d5ea-d359-45e9-88c4-8042b7216d48 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:54.963119 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d633d5ea-d359-45e9-88c4-8042b7216d48 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1675 microversion: 2.1 time: 0.531368 Aug 27 05:20:54.964466 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2629/5254] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:54 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1675 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:55.378906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c5fb223-8d8b-43d1-a967-0c4628556802 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:55.379831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c5fb223-8d8b-43d1-a967-0c4628556802 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:55.402955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5fb223-8d8b-43d1-a967-0c4628556802 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:55.415227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5fb223-8d8b-43d1-a967-0c4628556802 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:55.416040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5fb223-8d8b-43d1-a967-0c4628556802 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:55.417145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5fb223-8d8b-43d1-a967-0c4628556802 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:55.417920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5fb223-8d8b-43d1-a967-0c4628556802 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:55.418548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c5fb223-8d8b-43d1-a967-0c4628556802 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:55.997590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e6e3857-2179-4fdd-9c73-e1357beb481b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:55.999251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e6e3857-2179-4fdd-9c73-e1357beb481b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:56.007641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6e3857-2179-4fdd-9c73-e1357beb481b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:56.008637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6e3857-2179-4fdd-9c73-e1357beb481b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:56.009226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6e3857-2179-4fdd-9c73-e1357beb481b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:56.010136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6e3857-2179-4fdd-9c73-e1357beb481b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:56.010748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6e3857-2179-4fdd-9c73-e1357beb481b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:56.011355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e6e3857-2179-4fdd-9c73-e1357beb481b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:56.418773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6c5fb223-8d8b-43d1-a967-0c4628556802 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:56.429089 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c5fb223-8d8b-43d1-a967-0c4628556802 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1318 microversion: 2.1 time: 1.055750 Aug 27 05:20:56.432487 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2626/5255] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:55 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1318 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:56.605389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e6e3857-2179-4fdd-9c73-e1357beb481b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:56.640156 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e6e3857-2179-4fdd-9c73-e1357beb481b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1675 microversion: 2.1 time: 0.646376 Aug 27 05:20:56.641594 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2630/5256] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:55 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1675 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:57.356675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-bd01fb89-e135-4d6b-9299-b0e29709428a req-651315d8-226a-4d80-92c9-5742bf275ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3182297-5251-436b-86bc-cea4f48958ac", "name": "network-vif-plugged", "status": "completed", "tag": "e548ca4d-741b-44f0-8000-97916790d0a4"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:57.367872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bd01fb89-e135-4d6b-9299-b0e29709428a req-651315d8-226a-4d80-92c9-5742bf275ffb service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:57.368566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bd01fb89-e135-4d6b-9299-b0e29709428a req-651315d8-226a-4d80-92c9-5742bf275ffb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:57.369319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bd01fb89-e135-4d6b-9299-b0e29709428a req-651315d8-226a-4d80-92c9-5742bf275ffb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:57.373748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:57.385233 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-bd01fb89-e135-4d6b-9299-b0e29709428a req-651315d8-226a-4d80-92c9-5742bf275ffb service nova] Creating event network-vif-plugged:e548ca4d-741b-44f0-8000-97916790d0a4 for instance c3182297-5251-436b-86bc-cea4f48958ac on n-h2-820368-35 Aug 27 05:20:57.394900 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-bd01fb89-e135-4d6b-9299-b0e29709428a req-651315d8-226a-4d80-92c9-5742bf275ffb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042040 Aug 27 05:20:57.395608 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2627/5257] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:20:57.454202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e4c1d72-0153-4674-b9a7-385d7eead1bd tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:57.454827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e4c1d72-0153-4674-b9a7-385d7eead1bd tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:57.462642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e4c1d72-0153-4674-b9a7-385d7eead1bd tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:57.463404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e4c1d72-0153-4674-b9a7-385d7eead1bd tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:57.464137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e4c1d72-0153-4674-b9a7-385d7eead1bd tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:57.465374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e4c1d72-0153-4674-b9a7-385d7eead1bd tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:57.466163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e4c1d72-0153-4674-b9a7-385d7eead1bd tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:57.466839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e4c1d72-0153-4674-b9a7-385d7eead1bd tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:57.664464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a0631781-bb5e-4d27-a7a5-03d9ccf3c500 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:57.665180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a0631781-bb5e-4d27-a7a5-03d9ccf3c500 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:57.672463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0631781-bb5e-4d27-a7a5-03d9ccf3c500 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:57.672952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0631781-bb5e-4d27-a7a5-03d9ccf3c500 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:57.673389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0631781-bb5e-4d27-a7a5-03d9ccf3c500 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:57.674098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0631781-bb5e-4d27-a7a5-03d9ccf3c500 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:57.674554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0631781-bb5e-4d27-a7a5-03d9ccf3c500 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:57.675363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0631781-bb5e-4d27-a7a5-03d9ccf3c500 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:57.994093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e4c1d72-0153-4674-b9a7-385d7eead1bd tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:58.003430 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e4c1d72-0153-4674-b9a7-385d7eead1bd tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1318 microversion: 2.1 time: 0.554783 Aug 27 05:20:58.004122 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2631/5258] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:57 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:20:58.140417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a0631781-bb5e-4d27-a7a5-03d9ccf3c500 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:58.152607 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a0631781-bb5e-4d27-a7a5-03d9ccf3c500 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.492854 Aug 27 05:20:58.153744 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2628/5259] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:57 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:20:59.030837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2ba6320c-67fe-4cc9-8ef5-855761b92cf6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:20:59.033257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2ba6320c-67fe-4cc9-8ef5-855761b92cf6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:20:59.056569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ba6320c-67fe-4cc9-8ef5-855761b92cf6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:59.057248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ba6320c-67fe-4cc9-8ef5-855761b92cf6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:59.057705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ba6320c-67fe-4cc9-8ef5-855761b92cf6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:59.058495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ba6320c-67fe-4cc9-8ef5-855761b92cf6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:59.058990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ba6320c-67fe-4cc9-8ef5-855761b92cf6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:59.059649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ba6320c-67fe-4cc9-8ef5-855761b92cf6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:59.419481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-846e4d7f-d26f-4383-8668-e0a0d2ce7c82 req-d7afd712-57c4-4b3f-9f23-3182830b9cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586e6c8a-8548-4473-809c-cf5b5149daec", "name": "network-vif-plugged", "status": "completed", "tag": "0a2b0278-1430-4588-8997-3b6c196ac81c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:20:59.428939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:20:59.438585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-846e4d7f-d26f-4383-8668-e0a0d2ce7c82 req-d7afd712-57c4-4b3f-9f23-3182830b9cec service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:20:59.439611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-846e4d7f-d26f-4383-8668-e0a0d2ce7c82 req-d7afd712-57c4-4b3f-9f23-3182830b9cec service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:20:59.440434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-846e4d7f-d26f-4383-8668-e0a0d2ce7c82 req-d7afd712-57c4-4b3f-9f23-3182830b9cec service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:20:59.473187 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-846e4d7f-d26f-4383-8668-e0a0d2ce7c82 req-d7afd712-57c4-4b3f-9f23-3182830b9cec service nova] Creating event network-vif-plugged:0a2b0278-1430-4588-8997-3b6c196ac81c for instance 586e6c8a-8548-4473-809c-cf5b5149daec on n-h1-820368-35 Aug 27 05:20:59.481830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-846e4d7f-d26f-4383-8668-e0a0d2ce7c82 req-d7afd712-57c4-4b3f-9f23-3182830b9cec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066489 Aug 27 05:20:59.483325 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2629/5260] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:20:59.499020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2ba6320c-67fe-4cc9-8ef5-855761b92cf6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:20:59.508211 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2ba6320c-67fe-4cc9-8ef5-855761b92cf6 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1318 microversion: 2.1 time: 0.484542 Aug 27 05:20:59.509454 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2632/5261] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:20:59 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:00.532444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-41978892-66d9-4690-85f5-6d5a8bde96eb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:00.533758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-41978892-66d9-4690-85f5-6d5a8bde96eb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:00.542169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41978892-66d9-4690-85f5-6d5a8bde96eb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:00.542887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41978892-66d9-4690-85f5-6d5a8bde96eb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:00.543786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41978892-66d9-4690-85f5-6d5a8bde96eb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:00.545304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41978892-66d9-4690-85f5-6d5a8bde96eb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:00.546021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41978892-66d9-4690-85f5-6d5a8bde96eb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:00.546625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41978892-66d9-4690-85f5-6d5a8bde96eb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:00.891820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-41978892-66d9-4690-85f5-6d5a8bde96eb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:00.901089 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-41978892-66d9-4690-85f5-6d5a8bde96eb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1318 microversion: 2.1 time: 0.374068 Aug 27 05:21:00.902516 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2630/5262] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:00 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:01.930645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1d833926-b152-4ce4-ab7b-d8d589fb91e5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:01.932274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1d833926-b152-4ce4-ab7b-d8d589fb91e5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:01.949809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d833926-b152-4ce4-ab7b-d8d589fb91e5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:01.952613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d833926-b152-4ce4-ab7b-d8d589fb91e5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:01.955586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d833926-b152-4ce4-ab7b-d8d589fb91e5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:01.956805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d833926-b152-4ce4-ab7b-d8d589fb91e5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:01.958010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d833926-b152-4ce4-ab7b-d8d589fb91e5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:01.961451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d833926-b152-4ce4-ab7b-d8d589fb91e5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:02.230992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1d833926-b152-4ce4-ab7b-d8d589fb91e5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:02.256271 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1d833926-b152-4ce4-ab7b-d8d589fb91e5 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 200 len: 1506 microversion: 2.1 time: 0.327208 Aug 27 05:21:02.259002 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2633/5263] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:01 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:02.282631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1d7cbcb1-93d5-4ea2-8750-f4da9b00401c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:02.283748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1d7cbcb1-93d5-4ea2-8750-f4da9b00401c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: c3182297-5251-436b-86bc-cea4f48958ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:02.300250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7cbcb1-93d5-4ea2-8750-f4da9b00401c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:02.301254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7cbcb1-93d5-4ea2-8750-f4da9b00401c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:02.303077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7cbcb1-93d5-4ea2-8750-f4da9b00401c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:02.304486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7cbcb1-93d5-4ea2-8750-f4da9b00401c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:02.306066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7cbcb1-93d5-4ea2-8750-f4da9b00401c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:02.306804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d7cbcb1-93d5-4ea2-8750-f4da9b00401c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:02.988164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1d7cbcb1-93d5-4ea2-8750-f4da9b00401c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:03.005821 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1d7cbcb1-93d5-4ea2-8750-f4da9b00401c tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac" status: 200 len: 1505 microversion: 2.1 time: 0.727632 Aug 27 05:21:03.006689 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2631/5264] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:02 2022] GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac => generated 1505 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:03.040837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9039e464-f4d8-4353-9b53-49ad6b51e2f4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:03.041380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9039e464-f4d8-4353-9b53-49ad6b51e2f4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: c3182297-5251-436b-86bc-cea4f48958ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:03.052663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9039e464-f4d8-4353-9b53-49ad6b51e2f4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:03.053177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9039e464-f4d8-4353-9b53-49ad6b51e2f4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:03.053627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9039e464-f4d8-4353-9b53-49ad6b51e2f4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:03.054368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9039e464-f4d8-4353-9b53-49ad6b51e2f4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:03.054833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9039e464-f4d8-4353-9b53-49ad6b51e2f4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:03.055438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9039e464-f4d8-4353-9b53-49ad6b51e2f4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:03.094459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9039e464-f4d8-4353-9b53-49ad6b51e2f4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: c3182297-5251-436b-86bc-cea4f48958ac] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:21:03.238073 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9039e464-f4d8-4353-9b53-49ad6b51e2f4 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac" status: 204 len: 0 microversion: 2.1 time: 0.208189 Aug 27 05:21:03.239659 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2634/5265] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:21:03 2022] DELETE /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:21:03.250702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60ea2bb2-2e77-4960-9a69-07ef0e4d56bb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:03.251745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60ea2bb2-2e77-4960-9a69-07ef0e4d56bb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:03.262034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ea2bb2-2e77-4960-9a69-07ef0e4d56bb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:03.262958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ea2bb2-2e77-4960-9a69-07ef0e4d56bb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:03.264255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ea2bb2-2e77-4960-9a69-07ef0e4d56bb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:03.265439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ea2bb2-2e77-4960-9a69-07ef0e4d56bb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:03.266197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ea2bb2-2e77-4960-9a69-07ef0e4d56bb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:03.266959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60ea2bb2-2e77-4960-9a69-07ef0e4d56bb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:03.340376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60ea2bb2-2e77-4960-9a69-07ef0e4d56bb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:21:03.456909 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-60ea2bb2-2e77-4960-9a69-07ef0e4d56bb tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "DELETE /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 204 len: 0 microversion: 2.1 time: 0.212742 Aug 27 05:21:03.461231 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2632/5266] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:21:03 2022] DELETE /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:21:03.474467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-050babe7-685f-4dcb-9dc6-6e490713c3fa tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:03.475340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-050babe7-685f-4dcb-9dc6-6e490713c3fa tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: c3182297-5251-436b-86bc-cea4f48958ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:03.482242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-050babe7-685f-4dcb-9dc6-6e490713c3fa tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:03.482901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-050babe7-685f-4dcb-9dc6-6e490713c3fa tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:03.483366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-050babe7-685f-4dcb-9dc6-6e490713c3fa tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:03.484230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-050babe7-685f-4dcb-9dc6-6e490713c3fa tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:03.484878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-050babe7-685f-4dcb-9dc6-6e490713c3fa tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:03.485303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-050babe7-685f-4dcb-9dc6-6e490713c3fa tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:03.689975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-050babe7-685f-4dcb-9dc6-6e490713c3fa tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:03.702504 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-050babe7-685f-4dcb-9dc6-6e490713c3fa tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac" status: 200 len: 1511 microversion: 2.1 time: 0.237122 Aug 27 05:21:03.703931 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2635/5267] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:03 2022] GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:04.743937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d04c0aee-8441-41dc-9fdc-a85241d05585 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:04.746277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d04c0aee-8441-41dc-9fdc-a85241d05585 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: c3182297-5251-436b-86bc-cea4f48958ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:04.757143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d04c0aee-8441-41dc-9fdc-a85241d05585 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:04.758204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d04c0aee-8441-41dc-9fdc-a85241d05585 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:04.758823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d04c0aee-8441-41dc-9fdc-a85241d05585 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:04.759735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d04c0aee-8441-41dc-9fdc-a85241d05585 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:04.760546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d04c0aee-8441-41dc-9fdc-a85241d05585 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:04.761433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d04c0aee-8441-41dc-9fdc-a85241d05585 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:04.962393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d04c0aee-8441-41dc-9fdc-a85241d05585 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:04.970227 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d04c0aee-8441-41dc-9fdc-a85241d05585 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac" status: 200 len: 1511 microversion: 2.1 time: 0.233368 Aug 27 05:21:04.974691 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2633/5268] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:04 2022] GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:05.819876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-bba6bd27-cba0-46e2-808d-55fd508e3b65 req-1f23bb7b-7bac-49e4-9781-e8c15a62ed94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586e6c8a-8548-4473-809c-cf5b5149daec", "name": "network-vif-deleted", "tag": "0a2b0278-1430-4588-8997-3b6c196ac81c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:05.852513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bba6bd27-cba0-46e2-808d-55fd508e3b65 req-1f23bb7b-7bac-49e4-9781-e8c15a62ed94 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:05.853091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bba6bd27-cba0-46e2-808d-55fd508e3b65 req-1f23bb7b-7bac-49e4-9781-e8c15a62ed94 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:05.853593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bba6bd27-cba0-46e2-808d-55fd508e3b65 req-1f23bb7b-7bac-49e4-9781-e8c15a62ed94 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:05.871908 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-bba6bd27-cba0-46e2-808d-55fd508e3b65 req-1f23bb7b-7bac-49e4-9781-e8c15a62ed94 service nova] Creating event network-vif-deleted:0a2b0278-1430-4588-8997-3b6c196ac81c for instance 586e6c8a-8548-4473-809c-cf5b5149daec on n-h1-820368-35 Aug 27 05:21:05.878169 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-bba6bd27-cba0-46e2-808d-55fd508e3b65 req-1f23bb7b-7bac-49e4-9781-e8c15a62ed94 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061984 Aug 27 05:21:05.879823 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2636/5269] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:21:05.993038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3eea818e-46ee-467a-acaa-b8e11d3fdd48 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:05.993802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3eea818e-46ee-467a-acaa-b8e11d3fdd48 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: c3182297-5251-436b-86bc-cea4f48958ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:06.009198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3eea818e-46ee-467a-acaa-b8e11d3fdd48 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:06.009874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3eea818e-46ee-467a-acaa-b8e11d3fdd48 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:06.012083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3eea818e-46ee-467a-acaa-b8e11d3fdd48 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:06.013441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3eea818e-46ee-467a-acaa-b8e11d3fdd48 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:06.014589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3eea818e-46ee-467a-acaa-b8e11d3fdd48 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:06.015562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3eea818e-46ee-467a-acaa-b8e11d3fdd48 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:06.237809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3eea818e-46ee-467a-acaa-b8e11d3fdd48 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:06.254782 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3eea818e-46ee-467a-acaa-b8e11d3fdd48 tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac" status: 200 len: 1511 microversion: 2.1 time: 0.265888 Aug 27 05:21:06.256174 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2634/5270] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:05 2022] GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:21:07.226887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b6a74d6a-d0c0-443d-9ad1-b03ba9eda34e req-bd027762-89ba-4da6-8e19-6d831d4e9230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3182297-5251-436b-86bc-cea4f48958ac", "name": "network-vif-deleted", "tag": "e548ca4d-741b-44f0-8000-97916790d0a4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:07.242556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b6a74d6a-d0c0-443d-9ad1-b03ba9eda34e req-bd027762-89ba-4da6-8e19-6d831d4e9230 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:07.243513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b6a74d6a-d0c0-443d-9ad1-b03ba9eda34e req-bd027762-89ba-4da6-8e19-6d831d4e9230 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:07.244560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b6a74d6a-d0c0-443d-9ad1-b03ba9eda34e req-bd027762-89ba-4da6-8e19-6d831d4e9230 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:07.262372 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b6a74d6a-d0c0-443d-9ad1-b03ba9eda34e req-bd027762-89ba-4da6-8e19-6d831d4e9230 service nova] Creating event network-vif-deleted:e548ca4d-741b-44f0-8000-97916790d0a4 for instance c3182297-5251-436b-86bc-cea4f48958ac on n-h2-820368-35 Aug 27 05:21:07.270371 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b6a74d6a-d0c0-443d-9ad1-b03ba9eda34e req-bd027762-89ba-4da6-8e19-6d831d4e9230 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049024 Aug 27 05:21:07.272555 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2637/5271] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:21:07.291801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-67a66ce4-deea-45ce-b704-a3556a9bdb8f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:07.292763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-67a66ce4-deea-45ce-b704-a3556a9bdb8f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: c3182297-5251-436b-86bc-cea4f48958ac] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:07.310466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67a66ce4-deea-45ce-b704-a3556a9bdb8f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:07.312934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67a66ce4-deea-45ce-b704-a3556a9bdb8f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:07.313966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67a66ce4-deea-45ce-b704-a3556a9bdb8f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:07.317044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67a66ce4-deea-45ce-b704-a3556a9bdb8f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:07.319318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67a66ce4-deea-45ce-b704-a3556a9bdb8f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:07.321279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67a66ce4-deea-45ce-b704-a3556a9bdb8f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:07.572462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-67a66ce4-deea-45ce-b704-a3556a9bdb8f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9ab1851ccf471dbff261bfeb5bbb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67351e57d741f58e35ee388c5ccadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:07.580729 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-67a66ce4-deea-45ce-b704-a3556a9bdb8f tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac" status: 200 len: 1303 microversion: 2.1 time: 0.298653 Aug 27 05:21:07.588569 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2635/5272] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:07 2022] GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac => generated 1303 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:21:08.638249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:08.639652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: c3182297-5251-436b-86bc-cea4f48958ac] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:08.652728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:08.653674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:08.654366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:08.655336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:08.656980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:08.657600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:08.690351 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] HTTP exception thrown: Instance c3182297-5251-436b-86bc-cea4f48958ac could not be found. Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Request method failure captured: Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac HTTP/1.1 Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCamJfHPdUKjOnzi7bG8tUrtHi6wIUeF-ipPNuYv9pM5lHPi44EHa2PBmum2dGE1hQGwyZQbf5Z9OA-6YmuFHIlIWGqxJXCEjGeiOetwLPwCseinW4ZypHReIPLJZtxgcoM79N1ZmBHHxKTYAX939IZ9eWvtHnZlH8yH_So0qu4Q-i_I Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: ae67351e57d741f58e35ee388c5ccadf Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-MultipleCreateTestJSON-1753163562 Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ae67351e57d741f58e35ee388c5ccadf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ae67351e57d741f58e35ee388c5ccadf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae67351e57d741f58e35ee388c5ccadf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae67351e57d741f58e35ee388c5ccadf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-MultipleCreateTestJSON-1753163562 Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: ae67351e57d741f58e35ee388c5ccadf Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1753163562 Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-MultipleCreateTestJSON-1753163562-project Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 2a9ab1851ccf471dbff261bfeb5bbb44 Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-MultipleCreateTestJSON-1753163562-project Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance c3182297-5251-436b-86bc-cea4f48958ac could not be found. Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'c3182297-5251-436b-86bc-cea4f48958ac'} Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3182297-5251-436b-86bc-cea4f48958ac could not be found. Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3182297-5251-436b-86bc-cea4f48958ac could not be found. Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:08.692513 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:08.701592 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:08.701592 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:08.701592 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:08.701592 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:21:08.701592 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:21:08.701592 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3182297-5251-436b-86bc-cea4f48958ac could not be found. Aug 27 05:21:08.701592 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:08.701592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Returning 404 to user: Instance c3182297-5251-436b-86bc-cea4f48958ac could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:21:08.701592 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f6cd52e9-2b2f-481e-8318-0e6869a7863b tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac" status: 404 len: 111 microversion: 2.1 time: 0.070880 Aug 27 05:21:08.701592 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2638/5273] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:08 2022] GET /compute/v2.1/servers/c3182297-5251-436b-86bc-cea4f48958ac => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:21:08.710738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:08.711401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] [instance: 586e6c8a-8548-4473-809c-cf5b5149daec] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:08.719074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:08.719628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:08.720069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:08.720793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:08.721249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:08.721684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:08.749076 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] HTTP exception thrown: Instance 586e6c8a-8548-4473-809c-cf5b5149daec could not be found. Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Request method failure captured: Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec HTTP/1.1 Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCamJfHPdUKjOnzi7bG8tUrtHi6wIUeF-ipPNuYv9pM5lHPi44EHa2PBmum2dGE1hQGwyZQbf5Z9OA-6YmuFHIlIWGqxJXCEjGeiOetwLPwCseinW4ZypHReIPLJZtxgcoM79N1ZmBHHxKTYAX939IZ9eWvtHnZlH8yH_So0qu4Q-i_I Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: ae67351e57d741f58e35ee388c5ccadf Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-MultipleCreateTestJSON-1753163562 Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ae67351e57d741f58e35ee388c5ccadf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ae67351e57d741f58e35ee388c5ccadf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae67351e57d741f58e35ee388c5ccadf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae67351e57d741f58e35ee388c5ccadf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-MultipleCreateTestJSON-1753163562 Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: ae67351e57d741f58e35ee388c5ccadf Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1753163562 Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-MultipleCreateTestJSON-1753163562-project Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 2a9ab1851ccf471dbff261bfeb5bbb44 Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-MultipleCreateTestJSON-1753163562-project Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 586e6c8a-8548-4473-809c-cf5b5149daec could not be found. Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '586e6c8a-8548-4473-809c-cf5b5149daec'} Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586e6c8a-8548-4473-809c-cf5b5149daec could not be found. Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586e6c8a-8548-4473-809c-cf5b5149daec could not be found. Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:08.751658 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:08.755898 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:08.755898 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:08.755898 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:08.755898 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:21:08.755898 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:21:08.755898 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586e6c8a-8548-4473-809c-cf5b5149daec could not be found. Aug 27 05:21:08.755898 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:08.757285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] Returning 404 to user: Instance 586e6c8a-8548-4473-809c-cf5b5149daec could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:21:08.759183 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6637d12f-ee85-4ce0-afe7-0a03b58753db tempest-MultipleCreateTestJSON-1753163562 tempest-MultipleCreateTestJSON-1753163562-project] 10.222.0.58 "GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec" status: 404 len: 111 microversion: 2.1 time: 0.056736 Aug 27 05:21:08.760481 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2636/5274] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:08 2022] GET /compute/v2.1/servers/586e6c8a-8548-4473-809c-cf5b5149daec => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:21:19.047787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:21:19.054749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:21:19.353865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a20efdef-9eb1-436f-a33b-98143adf2744 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-929187151", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:19.359714 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a20efdef-9eb1-436f-a33b-98143adf2744 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] HTTP exception thrown: min_count must be <= max_count Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a20efdef-9eb1-436f-a33b-98143adf2744 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Request method failure captured: Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 183 Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCanOnTEYZm3uR1QXLuBtGVbSHjK30BKakmqbTlY7QvVqW3rXKg689VsUUgOp9VS3S0gCDTzSOVxY25evJMJQEgUsnEswtyXHP7XkxQGczoFVELylLCg32a3v2Kx5XyFOMs4YmRZcOxLCfJi9KBvINPiVt8nlsN7TVpJvMh663X0C8UU Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 85026cab32ec40f9b673106d709f9ca9 Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_85026cab32ec40f9b673106d709f9ca9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 85026cab32ec40f9b673106d709f9ca9 Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-MultipleCreateNegativeTestJSON-1891082432-project Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 480b066cacb24ffcbff4ce80fb2ffbe2 Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1891082432-project Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-929187151", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: exception: min_count must be <= max_count Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-929187151', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 27 05:21:19.366041 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.369783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a20efdef-9eb1-436f-a33b-98143adf2744 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Returning 400 to user: min_count must be <= max_count {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:21:19.369783 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a20efdef-9eb1-436f-a33b-98143adf2744 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.329262 Aug 27 05:21:19.369783 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2639/5275] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:21:19 2022] POST /compute/v2.1/servers => generated 74 bytes in 331 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 05:21:19.487345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-624220d3-f08a-4162-9ce1-f0605d2dcc2d tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2050902691", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "max_count": 0}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-624220d3-f08a-4162-9ce1-f0605d2dcc2d tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Request method failure captured: Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 168 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCanOnTEYZm3uR1QXLuBtGVbSHjK30BKakmqbTlY7QvVqW3rXKg689VsUUgOp9VS3S0gCDTzSOVxY25evJMJQEgUsnEswtyXHP7XkxQGczoFVELylLCg32a3v2Kx5XyFOMs4YmRZcOxLCfJi9KBvINPiVt8nlsN7TVpJvMh663X0C8UU Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 85026cab32ec40f9b673106d709f9ca9 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_85026cab32ec40f9b673106d709f9ca9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 85026cab32ec40f9b673106d709f9ca9 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-MultipleCreateNegativeTestJSON-1891082432-project Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 480b066cacb24ffcbff4ce80fb2ffbe2 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1891082432-project Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2050902691", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "max_count": 0}} Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2050902691', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'max_count': 0}}} Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 0 Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:21:19.500095 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-624220d3-f08a-4162-9ce1-f0605d2dcc2d tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:21:19.504847 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-624220d3-f08a-4162-9ce1-f0605d2dcc2d tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021971 Aug 27 05:21:19.515928 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2637/5276] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:21:19 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:21:19.608811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f614e7b-e027-4151-8a8e-82ab1900bd18 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1288598222", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "max_count": 2.5}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f614e7b-e027-4151-8a8e-82ab1900bd18 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Request method failure captured: Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 170 Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCanOnTEYZm3uR1QXLuBtGVbSHjK30BKakmqbTlY7QvVqW3rXKg689VsUUgOp9VS3S0gCDTzSOVxY25evJMJQEgUsnEswtyXHP7XkxQGczoFVELylLCg32a3v2Kx5XyFOMs4YmRZcOxLCfJi9KBvINPiVt8nlsN7TVpJvMh663X0C8UU Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 85026cab32ec40f9b673106d709f9ca9 Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_85026cab32ec40f9b673106d709f9ca9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 85026cab32ec40f9b673106d709f9ca9 Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-MultipleCreateNegativeTestJSON-1891082432-project Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 480b066cacb24ffcbff4ce80fb2ffbe2 Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1891082432-project Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1288598222", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "max_count": 2.5}} Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1288598222', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'max_count': 2.5}}} Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:21:19.613927 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 05:21:19.617607 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.621863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f614e7b-e027-4151-8a8e-82ab1900bd18 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:21:19.626866 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8f614e7b-e027-4151-8a8e-82ab1900bd18 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022546 Aug 27 05:21:19.628127 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2640/5277] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:21:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:21:19.719799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-48c5c50b-50af-4fce-95a8-738bcb99f1c1 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1673401095", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "min_count": 0}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-48c5c50b-50af-4fce-95a8-738bcb99f1c1 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Request method failure captured: Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 168 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCanOnTEYZm3uR1QXLuBtGVbSHjK30BKakmqbTlY7QvVqW3rXKg689VsUUgOp9VS3S0gCDTzSOVxY25evJMJQEgUsnEswtyXHP7XkxQGczoFVELylLCg32a3v2Kx5XyFOMs4YmRZcOxLCfJi9KBvINPiVt8nlsN7TVpJvMh663X0C8UU Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 85026cab32ec40f9b673106d709f9ca9 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_85026cab32ec40f9b673106d709f9ca9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 85026cab32ec40f9b673106d709f9ca9 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-MultipleCreateNegativeTestJSON-1891082432-project Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 480b066cacb24ffcbff4ce80fb2ffbe2 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1891082432-project Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1673401095", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "min_count": 0}} Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1673401095', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'min_count': 0}}} Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 0 Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:21:19.726276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-48c5c50b-50af-4fce-95a8-738bcb99f1c1 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:21:19.733546 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-48c5c50b-50af-4fce-95a8-738bcb99f1c1 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013127 Aug 27 05:21:19.738825 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2638/5278] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:21:19 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:21:19.825897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-030496b7-ea61-48f2-b532-226b601d6d74 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-564123444", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "min_count": 2.5}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-030496b7-ea61-48f2-b532-226b601d6d74 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Request method failure captured: Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 169 Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCanOnTEYZm3uR1QXLuBtGVbSHjK30BKakmqbTlY7QvVqW3rXKg689VsUUgOp9VS3S0gCDTzSOVxY25evJMJQEgUsnEswtyXHP7XkxQGczoFVELylLCg32a3v2Kx5XyFOMs4YmRZcOxLCfJi9KBvINPiVt8nlsN7TVpJvMh663X0C8UU Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 85026cab32ec40f9b673106d709f9ca9 Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_85026cab32ec40f9b673106d709f9ca9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/85026cab32ec40f9b673106d709f9ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 85026cab32ec40f9b673106d709f9ca9 Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1891082432 Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-MultipleCreateNegativeTestJSON-1891082432-project Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 480b066cacb24ffcbff4ce80fb2ffbe2 Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1891082432-project Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-564123444", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "min_count": 2.5}} Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-564123444', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'min_count': 2.5}}} Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:21:19.830250 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-030496b7-ea61-48f2-b532-226b601d6d74 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:21:19.834083 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-030496b7-ea61-48f2-b532-226b601d6d74 tempest-MultipleCreateNegativeTestJSON-1891082432 tempest-MultipleCreateNegativeTestJSON-1891082432-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014241 Aug 27 05:21:19.838475 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2641/5279] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:21:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:21:34.994991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:21:34.997723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:21:35.214846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-801009693", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:35.288206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] validate_networks() for [('58430044-336b-431d-9342-f0f068464fb9', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:21:36.335483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:21:36.336970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:21:36.337629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:21:36.338215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:21:36.340219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:21:36.376823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:36.379530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:36.381153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:36.384702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:36.387311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:36.389213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:36.469589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Getting quotas for project db6268ab038142ebaeebf7b7e9f83652. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:21:36.476343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Getting quotas for user 3a3cf2d3ecdf4926b00d371bae8e40eb and project db6268ab038142ebaeebf7b7e9f83652. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:21:36.493877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:21:36.496338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:21:36.551739 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f8a4f722-06f9-407d-b3bb-04fbb8794704 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.559498 Aug 27 05:21:36.553029 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2639/5280] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:21:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:21:36.568411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-24e508f5-74aa-4f0f-b643-8e615ad8660e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:36.569675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-24e508f5-74aa-4f0f-b643-8e615ad8660e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:36.689997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-24e508f5-74aa-4f0f-b643-8e615ad8660e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:36.708069 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-24e508f5-74aa-4f0f-b643-8e615ad8660e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1213 microversion: 2.1 time: 0.147286 Aug 27 05:21:36.709047 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2642/5281] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:36 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:37.731622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce4695ce-047a-4985-8c18-c68684743892 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:37.733208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ce4695ce-047a-4985-8c18-c68684743892 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:37.750326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce4695ce-047a-4985-8c18-c68684743892 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:37.751252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce4695ce-047a-4985-8c18-c68684743892 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:37.751937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce4695ce-047a-4985-8c18-c68684743892 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:37.753504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce4695ce-047a-4985-8c18-c68684743892 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:37.754152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce4695ce-047a-4985-8c18-c68684743892 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:37.754844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce4695ce-047a-4985-8c18-c68684743892 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:37.939785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce4695ce-047a-4985-8c18-c68684743892 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:37.954529 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce4695ce-047a-4985-8c18-c68684743892 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1217 microversion: 2.1 time: 0.228436 Aug 27 05:21:37.955496 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2640/5282] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:37 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1217 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:38.981490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-07deb6f8-7334-4fc4-8718-0fbeee68e8fe tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:38.982792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-07deb6f8-7334-4fc4-8718-0fbeee68e8fe tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:39.006946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07deb6f8-7334-4fc4-8718-0fbeee68e8fe tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:39.011155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07deb6f8-7334-4fc4-8718-0fbeee68e8fe tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:39.011653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07deb6f8-7334-4fc4-8718-0fbeee68e8fe tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:39.013323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07deb6f8-7334-4fc4-8718-0fbeee68e8fe tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:39.013825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07deb6f8-7334-4fc4-8718-0fbeee68e8fe tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:39.019391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07deb6f8-7334-4fc4-8718-0fbeee68e8fe tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:39.208037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-07deb6f8-7334-4fc4-8718-0fbeee68e8fe tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:39.231586 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-07deb6f8-7334-4fc4-8718-0fbeee68e8fe tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1283 microversion: 2.1 time: 0.255303 Aug 27 05:21:39.232984 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2643/5283] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:38 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1283 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:40.258150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88d66b3e-d3f4-46e7-9cd3-8eebff28df08 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:40.259229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-88d66b3e-d3f4-46e7-9cd3-8eebff28df08 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:40.274064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88d66b3e-d3f4-46e7-9cd3-8eebff28df08 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:40.274812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88d66b3e-d3f4-46e7-9cd3-8eebff28df08 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:40.275730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88d66b3e-d3f4-46e7-9cd3-8eebff28df08 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:40.276781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88d66b3e-d3f4-46e7-9cd3-8eebff28df08 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:40.277490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88d66b3e-d3f4-46e7-9cd3-8eebff28df08 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:40.278288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88d66b3e-d3f4-46e7-9cd3-8eebff28df08 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:41.214501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-88d66b3e-d3f4-46e7-9cd3-8eebff28df08 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:41.226914 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88d66b3e-d3f4-46e7-9cd3-8eebff28df08 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1313 microversion: 2.1 time: 0.976325 Aug 27 05:21:41.232048 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2641/5284] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:40 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1313 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:41.607026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-15a4fb7f-137f-4931-aee7-c1a05e9e0f8b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:41.607669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-15a4fb7f-137f-4931-aee7-c1a05e9e0f8b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:41.622232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a4fb7f-137f-4931-aee7-c1a05e9e0f8b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:41.622754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a4fb7f-137f-4931-aee7-c1a05e9e0f8b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:41.623225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a4fb7f-137f-4931-aee7-c1a05e9e0f8b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:41.626927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a4fb7f-137f-4931-aee7-c1a05e9e0f8b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:41.627973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a4fb7f-137f-4931-aee7-c1a05e9e0f8b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:41.628420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15a4fb7f-137f-4931-aee7-c1a05e9e0f8b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:42.113001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-15a4fb7f-137f-4931-aee7-c1a05e9e0f8b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:42.124204 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-15a4fb7f-137f-4931-aee7-c1a05e9e0f8b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.520546 Aug 27 05:21:42.139136 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2644/5285] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:41 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:42.151957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3c162fe6-8ba8-479b-961b-c1150451aab1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:42.156594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3c162fe6-8ba8-479b-961b-c1150451aab1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:42.169809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c162fe6-8ba8-479b-961b-c1150451aab1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:42.170654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c162fe6-8ba8-479b-961b-c1150451aab1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:42.171334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c162fe6-8ba8-479b-961b-c1150451aab1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:42.172454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c162fe6-8ba8-479b-961b-c1150451aab1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:42.173100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c162fe6-8ba8-479b-961b-c1150451aab1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:42.175120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3c162fe6-8ba8-479b-961b-c1150451aab1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:42.252667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d6bc8ef-6f67-4823-a497-c64e08980529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:42.254497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7d6bc8ef-6f67-4823-a497-c64e08980529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:42.264730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d6bc8ef-6f67-4823-a497-c64e08980529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:42.265552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d6bc8ef-6f67-4823-a497-c64e08980529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:42.266220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d6bc8ef-6f67-4823-a497-c64e08980529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:42.267794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d6bc8ef-6f67-4823-a497-c64e08980529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:42.268808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d6bc8ef-6f67-4823-a497-c64e08980529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:42.269625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d6bc8ef-6f67-4823-a497-c64e08980529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:42.853076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3c162fe6-8ba8-479b-961b-c1150451aab1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:42.863015 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3c162fe6-8ba8-479b-961b-c1150451aab1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.717567 Aug 27 05:21:42.864100 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2642/5286] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:42 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:42.872702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7d6bc8ef-6f67-4823-a497-c64e08980529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:42.890419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d375567d-31db-4c16-bb96-6a2bf32baca9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:42.891145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d375567d-31db-4c16-bb96-6a2bf32baca9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:42.892562 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7d6bc8ef-6f67-4823-a497-c64e08980529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1313 microversion: 2.1 time: 0.644040 Aug 27 05:21:42.902305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d375567d-31db-4c16-bb96-6a2bf32baca9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:42.903471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d375567d-31db-4c16-bb96-6a2bf32baca9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:42.904120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d375567d-31db-4c16-bb96-6a2bf32baca9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:42.905081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d375567d-31db-4c16-bb96-6a2bf32baca9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:42.905712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d375567d-31db-4c16-bb96-6a2bf32baca9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:42.906293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d375567d-31db-4c16-bb96-6a2bf32baca9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:42.911453 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2645/5287] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:42 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1313 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:21:43.357751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3324b36b-19a0-4ddb-81a6-a56bd73d4efc req-db081e2b-8921-4bcc-8944-2f5b2a757a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026b42a7-c019-4db8-b5d2-42c82c212c1a", "tag": "b6ee8e9b-a599-4264-a984-05c7fc080a2f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:43.380254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d375567d-31db-4c16-bb96-6a2bf32baca9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:43.390817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3324b36b-19a0-4ddb-81a6-a56bd73d4efc req-db081e2b-8921-4bcc-8944-2f5b2a757a18 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:43.391396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3324b36b-19a0-4ddb-81a6-a56bd73d4efc req-db081e2b-8921-4bcc-8944-2f5b2a757a18 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:43.391871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3324b36b-19a0-4ddb-81a6-a56bd73d4efc req-db081e2b-8921-4bcc-8944-2f5b2a757a18 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:43.392102 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d375567d-31db-4c16-bb96-6a2bf32baca9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.503891 Aug 27 05:21:43.411910 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2643/5288] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:42 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:43.420454 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3324b36b-19a0-4ddb-81a6-a56bd73d4efc req-db081e2b-8921-4bcc-8944-2f5b2a757a18 service nova] Creating event network-changed:b6ee8e9b-a599-4264-a984-05c7fc080a2f for instance 026b42a7-c019-4db8-b5d2-42c82c212c1a on n-h1-820368-35 Aug 27 05:21:43.426574 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3324b36b-19a0-4ddb-81a6-a56bd73d4efc req-db081e2b-8921-4bcc-8944-2f5b2a757a18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073388 Aug 27 05:21:43.427900 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2646/5289] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:21:43.429447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f3f1c38-1d9a-4de2-a7a5-289fd70b1db7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:43.436219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3f3f1c38-1d9a-4de2-a7a5-289fd70b1db7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:43.450918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f3f1c38-1d9a-4de2-a7a5-289fd70b1db7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:43.453809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f3f1c38-1d9a-4de2-a7a5-289fd70b1db7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:43.454605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f3f1c38-1d9a-4de2-a7a5-289fd70b1db7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:43.457172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f3f1c38-1d9a-4de2-a7a5-289fd70b1db7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:43.459875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f3f1c38-1d9a-4de2-a7a5-289fd70b1db7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:43.462142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f3f1c38-1d9a-4de2-a7a5-289fd70b1db7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:43.928372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b65775d6-8770-4ed3-929a-df2fe3ce40ef tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:43.929032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b65775d6-8770-4ed3-929a-df2fe3ce40ef tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:43.948947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b65775d6-8770-4ed3-929a-df2fe3ce40ef tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:43.950111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b65775d6-8770-4ed3-929a-df2fe3ce40ef tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:43.951156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b65775d6-8770-4ed3-929a-df2fe3ce40ef tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:43.952754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b65775d6-8770-4ed3-929a-df2fe3ce40ef tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:43.953675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b65775d6-8770-4ed3-929a-df2fe3ce40ef tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:43.954320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b65775d6-8770-4ed3-929a-df2fe3ce40ef tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:44.573776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3f3f1c38-1d9a-4de2-a7a5-289fd70b1db7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:44.585556 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3f3f1c38-1d9a-4de2-a7a5-289fd70b1db7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 1.163564 Aug 27 05:21:44.601327 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2644/5290] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:43 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:44.640281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eebbea51-cd52-4506-b423-84cace2debc0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:44.644974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eebbea51-cd52-4506-b423-84cace2debc0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:44.661884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eebbea51-cd52-4506-b423-84cace2debc0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:44.662384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eebbea51-cd52-4506-b423-84cace2debc0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:44.662826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eebbea51-cd52-4506-b423-84cace2debc0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:44.665961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eebbea51-cd52-4506-b423-84cace2debc0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:44.666460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eebbea51-cd52-4506-b423-84cace2debc0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:44.666900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eebbea51-cd52-4506-b423-84cace2debc0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:44.724950 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eebbea51-cd52-4506-b423-84cace2debc0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/ips" status: 200 len: 150 microversion: 2.1 time: 0.122461 Aug 27 05:21:44.725952 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2645/5291] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:21:44 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/ips => generated 150 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:21:44.843468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1111922844", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "dc52ef93-257f-431d-a3c4-4629a0c53bfc"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:44.983847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] validate_networks() for [('dc52ef93-257f-431d-a3c4-4629a0c53bfc', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:21:45.010545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b65775d6-8770-4ed3-929a-df2fe3ce40ef tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:45.022098 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b65775d6-8770-4ed3-929a-df2fe3ce40ef tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1313 microversion: 2.1 time: 1.099339 Aug 27 05:21:45.026122 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2647/5292] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:43 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1313 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:45.975001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:21:45.975572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:21:45.975932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:21:45.976348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:21:45.976767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:21:45.994124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:45.994734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:45.995202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:45.996008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:45.996470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:45.996903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:46.039306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:21:46.052308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e426a54-62cd-4434-868b-178deb199b8a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:46.053552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3e426a54-62cd-4434-868b-178deb199b8a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:46.062808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for user dffafef392eb4e1fba13953f47b2d105 and project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:21:46.069127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e426a54-62cd-4434-868b-178deb199b8a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:46.073602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e426a54-62cd-4434-868b-178deb199b8a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:46.074557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e426a54-62cd-4434-868b-178deb199b8a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:46.075618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e426a54-62cd-4434-868b-178deb199b8a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:46.076309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e426a54-62cd-4434-868b-178deb199b8a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:46.076928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e426a54-62cd-4434-868b-178deb199b8a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:46.083996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:21:46.087164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:21:46.179638 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c859484-63be-44bf-8544-ac3d19939db3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.344472 Aug 27 05:21:46.181308 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2646/5293] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:21:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:21:46.218183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-04e92ea9-7e18-45e1-80c5-7b78b6e0f09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:46.222583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-04e92ea9-7e18-45e1-80c5-7b78b6e0f09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:46.391463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04e92ea9-7e18-45e1-80c5-7b78b6e0f09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:46.402762 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-04e92ea9-7e18-45e1-80c5-7b78b6e0f09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1215 microversion: 2.1 time: 0.213935 Aug 27 05:21:46.426651 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2647/5294] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:46 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:46.696073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:21:46.722682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3e426a54-62cd-4434-868b-178deb199b8a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:46.737452 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e426a54-62cd-4434-868b-178deb199b8a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1313 microversion: 2.1 time: 0.690631 Aug 27 05:21:46.752312 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2648/5295] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:46 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1313 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:47.433832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fefb0e9a-ff5d-43c3-873f-17e8b55d357b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:47.438201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fefb0e9a-ff5d-43c3-873f-17e8b55d357b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:47.456395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefb0e9a-ff5d-43c3-873f-17e8b55d357b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:47.457965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefb0e9a-ff5d-43c3-873f-17e8b55d357b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:47.459167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefb0e9a-ff5d-43c3-873f-17e8b55d357b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:47.461119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefb0e9a-ff5d-43c3-873f-17e8b55d357b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:47.462376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefb0e9a-ff5d-43c3-873f-17e8b55d357b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:47.463606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefb0e9a-ff5d-43c3-873f-17e8b55d357b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:47.654312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c3ddee84-73d2-434a-94f4-38935c04adce tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc243a4a-2e91-4757-95b5-c41f7d30e9f0"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:47.657291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c3ddee84-73d2-434a-94f4-38935c04adce tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:47.675559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3ddee84-73d2-434a-94f4-38935c04adce tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:47.676230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3ddee84-73d2-434a-94f4-38935c04adce tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:47.676972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3ddee84-73d2-434a-94f4-38935c04adce tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:47.677468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3ddee84-73d2-434a-94f4-38935c04adce tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:47.677976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3ddee84-73d2-434a-94f4-38935c04adce tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:47.678449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3ddee84-73d2-434a-94f4-38935c04adce tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:47.694044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fefb0e9a-ff5d-43c3-873f-17e8b55d357b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:47.713008 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fefb0e9a-ff5d-43c3-873f-17e8b55d357b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1267 microversion: 2.1 time: 0.289969 Aug 27 05:21:47.717118 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2648/5296] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:47 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:47.766013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8b392f81-254f-4814-850a-7fc507443a48 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:47.767184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8b392f81-254f-4814-850a-7fc507443a48 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:47.778815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b392f81-254f-4814-850a-7fc507443a48 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:47.779687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b392f81-254f-4814-850a-7fc507443a48 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:47.780510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b392f81-254f-4814-850a-7fc507443a48 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:47.781813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b392f81-254f-4814-850a-7fc507443a48 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:47.782613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b392f81-254f-4814-850a-7fc507443a48 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:47.783126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8b392f81-254f-4814-850a-7fc507443a48 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:48.260979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8b392f81-254f-4814-850a-7fc507443a48 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:48.273901 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8b392f81-254f-4814-850a-7fc507443a48 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1313 microversion: 2.1 time: 0.515224 Aug 27 05:21:48.274600 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2649/5297] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:47 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:48.696542 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c3ddee84-73d2-434a-94f4-38935c04adce tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.047733 Aug 27 05:21:48.718243 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2649/5298] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:21:47 2022] POST /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 194 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:21:48.747733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0bf4c2f6-0b5f-4e47-9539-68d25b7a65cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:48.749172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0bf4c2f6-0b5f-4e47-9539-68d25b7a65cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:48.772935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0bf4c2f6-0b5f-4e47-9539-68d25b7a65cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:48.775552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0bf4c2f6-0b5f-4e47-9539-68d25b7a65cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:48.777244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0bf4c2f6-0b5f-4e47-9539-68d25b7a65cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:48.779612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0bf4c2f6-0b5f-4e47-9539-68d25b7a65cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:48.784562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0bf4c2f6-0b5f-4e47-9539-68d25b7a65cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:48.785826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0bf4c2f6-0b5f-4e47-9539-68d25b7a65cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:49.008042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0bf4c2f6-0b5f-4e47-9539-68d25b7a65cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:49.037697 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0bf4c2f6-0b5f-4e47-9539-68d25b7a65cb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1273 microversion: 2.1 time: 0.294842 Aug 27 05:21:49.038189 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2650/5299] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:48 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:49.298095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-07c6668b-fbca-4fad-b179-01ff8beb0b56 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:49.300711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-07c6668b-fbca-4fad-b179-01ff8beb0b56 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:49.314628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c6668b-fbca-4fad-b179-01ff8beb0b56 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:49.315772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c6668b-fbca-4fad-b179-01ff8beb0b56 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:49.316765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c6668b-fbca-4fad-b179-01ff8beb0b56 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:49.317946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c6668b-fbca-4fad-b179-01ff8beb0b56 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:49.318641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c6668b-fbca-4fad-b179-01ff8beb0b56 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:49.319415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07c6668b-fbca-4fad-b179-01ff8beb0b56 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:50.069947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8358b4e0-45e9-4bab-833f-d612292538f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:50.075045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8358b4e0-45e9-4bab-833f-d612292538f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:50.120358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8358b4e0-45e9-4bab-833f-d612292538f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:50.120358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8358b4e0-45e9-4bab-833f-d612292538f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:50.123579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8358b4e0-45e9-4bab-833f-d612292538f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:50.124567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8358b4e0-45e9-4bab-833f-d612292538f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:50.124975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8358b4e0-45e9-4bab-833f-d612292538f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:50.125394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8358b4e0-45e9-4bab-833f-d612292538f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:50.660625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-07c6668b-fbca-4fad-b179-01ff8beb0b56 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:50.683015 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-07c6668b-fbca-4fad-b179-01ff8beb0b56 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1313 microversion: 2.1 time: 1.390525 Aug 27 05:21:50.707574 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2650/5300] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:49 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1313 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:50.716105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8358b4e0-45e9-4bab-833f-d612292538f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:50.731045 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8358b4e0-45e9-4bab-833f-d612292538f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1315 microversion: 2.1 time: 0.670981 Aug 27 05:21:50.732469 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2651/5301] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:50 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:51.720069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-da3bc9da-c1ef-4975-92d0-189781ee27c9 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:51.722208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-da3bc9da-c1ef-4975-92d0-189781ee27c9 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:51.737768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da3bc9da-c1ef-4975-92d0-189781ee27c9 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:51.740350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da3bc9da-c1ef-4975-92d0-189781ee27c9 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:51.741968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da3bc9da-c1ef-4975-92d0-189781ee27c9 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:51.746576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da3bc9da-c1ef-4975-92d0-189781ee27c9 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:51.747732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da3bc9da-c1ef-4975-92d0-189781ee27c9 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:51.750562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da3bc9da-c1ef-4975-92d0-189781ee27c9 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:51.766479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e6f0be4b-05dd-4865-9376-573e37af05a9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:51.771787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e6f0be4b-05dd-4865-9376-573e37af05a9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:51.825683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6f0be4b-05dd-4865-9376-573e37af05a9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:51.829195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6f0be4b-05dd-4865-9376-573e37af05a9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:51.831491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6f0be4b-05dd-4865-9376-573e37af05a9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:51.832269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6f0be4b-05dd-4865-9376-573e37af05a9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:51.839769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6f0be4b-05dd-4865-9376-573e37af05a9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:51.842344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6f0be4b-05dd-4865-9376-573e37af05a9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:52.536940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-da3bc9da-c1ef-4975-92d0-189781ee27c9 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:52.553744 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-da3bc9da-c1ef-4975-92d0-189781ee27c9 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1313 microversion: 2.1 time: 0.840980 Aug 27 05:21:52.584523 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2651/5302] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:51 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1313 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:52.596983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-91185aa5-5bad-430c-919b-630afe26afb8 req-13f8b823-5a7c-4b8c-a105-02d946a4b723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f751f91-a14d-4ce3-9b0c-168021a057ab", "tag": "a5fd331e-b6f2-418e-ac64-38398b561884"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:52.600833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e6f0be4b-05dd-4865-9376-573e37af05a9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:52.629125 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e6f0be4b-05dd-4865-9376-573e37af05a9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1315 microversion: 2.1 time: 0.872567 Aug 27 05:21:52.634152 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2652/5303] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:51 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:52.643472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-91185aa5-5bad-430c-919b-630afe26afb8 req-13f8b823-5a7c-4b8c-a105-02d946a4b723 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:52.644785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-91185aa5-5bad-430c-919b-630afe26afb8 req-13f8b823-5a7c-4b8c-a105-02d946a4b723 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:52.645386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-91185aa5-5bad-430c-919b-630afe26afb8 req-13f8b823-5a7c-4b8c-a105-02d946a4b723 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:52.660281 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-91185aa5-5bad-430c-919b-630afe26afb8 req-13f8b823-5a7c-4b8c-a105-02d946a4b723 service nova] Creating event network-changed:a5fd331e-b6f2-418e-ac64-38398b561884 for instance 2f751f91-a14d-4ce3-9b0c-168021a057ab on n-h2-820368-35 Aug 27 05:21:52.667038 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-91185aa5-5bad-430c-919b-630afe26afb8 req-13f8b823-5a7c-4b8c-a105-02d946a4b723 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079480 Aug 27 05:21:52.668226 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2652/5304] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:21:53.217130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-33b48f5d-0ce8-486a-9303-2acb3a46680b req-a2abd0f1-7a96-4ca4-92b5-98adfcefa887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026b42a7-c019-4db8-b5d2-42c82c212c1a", "name": "network-vif-plugged", "status": "completed", "tag": "b6ee8e9b-a599-4264-a984-05c7fc080a2f"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:53.242557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-33b48f5d-0ce8-486a-9303-2acb3a46680b req-a2abd0f1-7a96-4ca4-92b5-98adfcefa887 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:53.242993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-33b48f5d-0ce8-486a-9303-2acb3a46680b req-a2abd0f1-7a96-4ca4-92b5-98adfcefa887 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:53.243467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-33b48f5d-0ce8-486a-9303-2acb3a46680b req-a2abd0f1-7a96-4ca4-92b5-98adfcefa887 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:53.281434 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-33b48f5d-0ce8-486a-9303-2acb3a46680b req-a2abd0f1-7a96-4ca4-92b5-98adfcefa887 service nova] Creating event network-vif-plugged:b6ee8e9b-a599-4264-a984-05c7fc080a2f for instance 026b42a7-c019-4db8-b5d2-42c82c212c1a on n-h1-820368-35 Aug 27 05:21:53.290568 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-33b48f5d-0ce8-486a-9303-2acb3a46680b req-a2abd0f1-7a96-4ca4-92b5-98adfcefa887 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077478 Aug 27 05:21:53.304572 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2653/5305] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:21:53.580812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec7b35b7-e15d-4584-8ed8-cd9131345521 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:53.581669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec7b35b7-e15d-4584-8ed8-cd9131345521 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:53.591749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec7b35b7-e15d-4584-8ed8-cd9131345521 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:53.593307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec7b35b7-e15d-4584-8ed8-cd9131345521 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:53.594123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec7b35b7-e15d-4584-8ed8-cd9131345521 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:53.596613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec7b35b7-e15d-4584-8ed8-cd9131345521 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:53.598392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec7b35b7-e15d-4584-8ed8-cd9131345521 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:53.599050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec7b35b7-e15d-4584-8ed8-cd9131345521 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:53.653981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a05d6b23-9a33-4b50-8c5a-88c7e1b16686 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:53.654918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a05d6b23-9a33-4b50-8c5a-88c7e1b16686 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:53.663425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a05d6b23-9a33-4b50-8c5a-88c7e1b16686 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:53.673842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a05d6b23-9a33-4b50-8c5a-88c7e1b16686 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:53.674966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a05d6b23-9a33-4b50-8c5a-88c7e1b16686 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:53.676779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a05d6b23-9a33-4b50-8c5a-88c7e1b16686 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:53.680685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a05d6b23-9a33-4b50-8c5a-88c7e1b16686 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:53.681219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a05d6b23-9a33-4b50-8c5a-88c7e1b16686 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:54.025739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a05d6b23-9a33-4b50-8c5a-88c7e1b16686 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:54.041201 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a05d6b23-9a33-4b50-8c5a-88c7e1b16686 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1315 microversion: 2.1 time: 0.391293 Aug 27 05:21:54.047422 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2654/5306] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:53 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:21:54.067755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ec7b35b7-e15d-4584-8ed8-cd9131345521 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:54.079237 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec7b35b7-e15d-4584-8ed8-cd9131345521 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1313 microversion: 2.1 time: 0.504006 Aug 27 05:21:54.080947 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2653/5307] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:53 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:55.066318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd9b3787-c2d9-4e57-9122-84b97dd43953 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:55.078774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dd9b3787-c2d9-4e57-9122-84b97dd43953 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:55.103432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2ac9655d-9d03-4eb8-bfb9-b4ee2094033c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:55.103987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2ac9655d-9d03-4eb8-bfb9-b4ee2094033c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:55.116065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ac9655d-9d03-4eb8-bfb9-b4ee2094033c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:55.117717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ac9655d-9d03-4eb8-bfb9-b4ee2094033c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:55.120514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ac9655d-9d03-4eb8-bfb9-b4ee2094033c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:55.121433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ac9655d-9d03-4eb8-bfb9-b4ee2094033c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:55.121980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ac9655d-9d03-4eb8-bfb9-b4ee2094033c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:55.126025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9b3787-c2d9-4e57-9122-84b97dd43953 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:55.127711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9b3787-c2d9-4e57-9122-84b97dd43953 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:55.128184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ac9655d-9d03-4eb8-bfb9-b4ee2094033c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:55.129109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9b3787-c2d9-4e57-9122-84b97dd43953 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:55.130519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9b3787-c2d9-4e57-9122-84b97dd43953 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:55.131854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9b3787-c2d9-4e57-9122-84b97dd43953 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:55.133102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9b3787-c2d9-4e57-9122-84b97dd43953 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:55.710952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dd9b3787-c2d9-4e57-9122-84b97dd43953 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:55.720078 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd9b3787-c2d9-4e57-9122-84b97dd43953 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1315 microversion: 2.1 time: 0.661269 Aug 27 05:21:55.726256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2ac9655d-9d03-4eb8-bfb9-b4ee2094033c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:55.730849 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2655/5308] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:55 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:21:55.737480 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2ac9655d-9d03-4eb8-bfb9-b4ee2094033c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1313 microversion: 2.1 time: 0.638776 Aug 27 05:21:55.738544 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2654/5309] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:55 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1313 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:21:56.744726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17699fae-09c9-4610-964a-b4d8ae02a5c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:56.746153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-17699fae-09c9-4610-964a-b4d8ae02a5c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:56.750612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:21:56.755561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=14 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:21:56.776233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-af86bb49-98b6-4c03-9f9b-02a68d2ceed6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:56.777735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-af86bb49-98b6-4c03-9f9b-02a68d2ceed6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:56.794206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17699fae-09c9-4610-964a-b4d8ae02a5c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:56.799808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17699fae-09c9-4610-964a-b4d8ae02a5c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:56.802282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af86bb49-98b6-4c03-9f9b-02a68d2ceed6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:56.803059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17699fae-09c9-4610-964a-b4d8ae02a5c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:56.803954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af86bb49-98b6-4c03-9f9b-02a68d2ceed6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:56.807549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af86bb49-98b6-4c03-9f9b-02a68d2ceed6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:56.808516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17699fae-09c9-4610-964a-b4d8ae02a5c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:56.809712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af86bb49-98b6-4c03-9f9b-02a68d2ceed6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:56.810736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17699fae-09c9-4610-964a-b4d8ae02a5c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:56.811553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17699fae-09c9-4610-964a-b4d8ae02a5c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:56.816289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af86bb49-98b6-4c03-9f9b-02a68d2ceed6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:56.817286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af86bb49-98b6-4c03-9f9b-02a68d2ceed6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:57.257062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-17699fae-09c9-4610-964a-b4d8ae02a5c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:57.271152 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-17699fae-09c9-4610-964a-b4d8ae02a5c0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1315 microversion: 2.1 time: 0.527695 Aug 27 05:21:57.279524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-af86bb49-98b6-4c03-9f9b-02a68d2ceed6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:57.279880 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2656/5310] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:56 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:57.298479 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-af86bb49-98b6-4c03-9f9b-02a68d2ceed6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1499 microversion: 2.1 time: 0.526520 Aug 27 05:21:57.313971 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2655/5311] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:56 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1499 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:57.322385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f0d254ad-8534-4c8d-94b3-c17c07c85c7d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:57.327063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f0d254ad-8534-4c8d-94b3-c17c07c85c7d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:57.340636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0d254ad-8534-4c8d-94b3-c17c07c85c7d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:57.341553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0d254ad-8534-4c8d-94b3-c17c07c85c7d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:57.342221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0d254ad-8534-4c8d-94b3-c17c07c85c7d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:57.343245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0d254ad-8534-4c8d-94b3-c17c07c85c7d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:57.344057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0d254ad-8534-4c8d-94b3-c17c07c85c7d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:57.344705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0d254ad-8534-4c8d-94b3-c17c07c85c7d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:57.377704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-f0d254ad-8534-4c8d-94b3-c17c07c85c7d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lazy-loading 'flavor' on Instance uuid 026b42a7-c019-4db8-b5d2-42c82c212c1a {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:21:57.467232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:21:57.499552 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f0d254ad-8534-4c8d-94b3-c17c07c85c7d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "POST /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a/action" status: 200 len: 32 microversion: 2.1 time: 0.181870 Aug 27 05:21:57.501252 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2657/5312] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:21:57 2022] POST /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:21:57.511163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-20eef311-b45c-4b61-943e-fa156d4def00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:57.511875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-20eef311-b45c-4b61-943e-fa156d4def00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:57.524321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20eef311-b45c-4b61-943e-fa156d4def00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:57.527432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20eef311-b45c-4b61-943e-fa156d4def00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:57.532144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20eef311-b45c-4b61-943e-fa156d4def00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:57.543772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20eef311-b45c-4b61-943e-fa156d4def00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:57.544891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20eef311-b45c-4b61-943e-fa156d4def00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:57.545835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20eef311-b45c-4b61-943e-fa156d4def00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:58.058137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-20eef311-b45c-4b61-943e-fa156d4def00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:58.071398 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-20eef311-b45c-4b61-943e-fa156d4def00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.563325 Aug 27 05:21:58.072867 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2656/5313] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:57 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:58.304613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e694fed-803f-4d22-a368-b92d7ee659c5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:58.305510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e694fed-803f-4d22-a368-b92d7ee659c5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:58.313902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e694fed-803f-4d22-a368-b92d7ee659c5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:58.314796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e694fed-803f-4d22-a368-b92d7ee659c5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:58.315428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e694fed-803f-4d22-a368-b92d7ee659c5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:58.316412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e694fed-803f-4d22-a368-b92d7ee659c5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:58.316962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e694fed-803f-4d22-a368-b92d7ee659c5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:58.317600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e694fed-803f-4d22-a368-b92d7ee659c5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:59.038025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e694fed-803f-4d22-a368-b92d7ee659c5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:59.057904 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e694fed-803f-4d22-a368-b92d7ee659c5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1315 microversion: 2.1 time: 0.761757 Aug 27 05:21:59.058761 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2658/5314] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:58 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:21:59.093344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0b413147-9e86-49e8-9fed-1ae6dbfddeeb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:21:59.094808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0b413147-9e86-49e8-9fed-1ae6dbfddeeb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:21:59.116981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b413147-9e86-49e8-9fed-1ae6dbfddeeb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:59.117614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b413147-9e86-49e8-9fed-1ae6dbfddeeb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:59.118478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b413147-9e86-49e8-9fed-1ae6dbfddeeb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:59.119375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b413147-9e86-49e8-9fed-1ae6dbfddeeb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:59.119974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b413147-9e86-49e8-9fed-1ae6dbfddeeb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:59.120555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b413147-9e86-49e8-9fed-1ae6dbfddeeb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:59.305686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b1bdeb38-adda-4e62-a6c2-04bfdae4e162 req-523e781e-cdf8-4f92-8174-d721a74dcded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f751f91-a14d-4ce3-9b0c-168021a057ab", "name": "network-vif-plugged", "status": "completed", "tag": "a5fd331e-b6f2-418e-ac64-38398b561884"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:21:59.321663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b1bdeb38-adda-4e62-a6c2-04bfdae4e162 req-523e781e-cdf8-4f92-8174-d721a74dcded service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:21:59.322686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b1bdeb38-adda-4e62-a6c2-04bfdae4e162 req-523e781e-cdf8-4f92-8174-d721a74dcded service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:21:59.322686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b1bdeb38-adda-4e62-a6c2-04bfdae4e162 req-523e781e-cdf8-4f92-8174-d721a74dcded service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:21:59.409763 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b1bdeb38-adda-4e62-a6c2-04bfdae4e162 req-523e781e-cdf8-4f92-8174-d721a74dcded service nova] Creating event network-vif-plugged:a5fd331e-b6f2-418e-ac64-38398b561884 for instance 2f751f91-a14d-4ce3-9b0c-168021a057ab on n-h2-820368-35 Aug 27 05:21:59.424291 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b1bdeb38-adda-4e62-a6c2-04bfdae4e162 req-523e781e-cdf8-4f92-8174-d721a74dcded service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120632 Aug 27 05:21:59.426597 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2659/5315] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:21:59.720308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0b413147-9e86-49e8-9fed-1ae6dbfddeeb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:21:59.733931 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0b413147-9e86-49e8-9fed-1ae6dbfddeeb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.640866 Aug 27 05:21:59.734755 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2657/5316] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:21:59 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:00.082517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-99f3b652-084f-45ab-a1b4-e9ae173ad676 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:00.083355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-99f3b652-084f-45ab-a1b4-e9ae173ad676 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:00.090765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3b652-084f-45ab-a1b4-e9ae173ad676 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:00.091300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3b652-084f-45ab-a1b4-e9ae173ad676 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:00.091865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3b652-084f-45ab-a1b4-e9ae173ad676 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:00.092574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3b652-084f-45ab-a1b4-e9ae173ad676 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:00.093729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3b652-084f-45ab-a1b4-e9ae173ad676 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:00.094194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99f3b652-084f-45ab-a1b4-e9ae173ad676 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:00.410226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-99f3b652-084f-45ab-a1b4-e9ae173ad676 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:00.424931 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-99f3b652-084f-45ab-a1b4-e9ae173ad676 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1315 microversion: 2.1 time: 0.348390 Aug 27 05:22:00.426032 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2660/5317] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:00 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:00.754404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-922bf821-a931-491a-983c-bd96a584c734 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:00.755662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-922bf821-a931-491a-983c-bd96a584c734 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:00.775646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922bf821-a931-491a-983c-bd96a584c734 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:00.776942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922bf821-a931-491a-983c-bd96a584c734 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:00.777566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922bf821-a931-491a-983c-bd96a584c734 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:00.778455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922bf821-a931-491a-983c-bd96a584c734 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:00.779111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922bf821-a931-491a-983c-bd96a584c734 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:00.779782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-922bf821-a931-491a-983c-bd96a584c734 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:01.046965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-922bf821-a931-491a-983c-bd96a584c734 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:01.059277 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-922bf821-a931-491a-983c-bd96a584c734 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.308557 Aug 27 05:22:01.061995 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2658/5318] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:00 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:01.449771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8a7d1d16-1207-4d52-9c5f-089d9ce11697 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:01.449771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8a7d1d16-1207-4d52-9c5f-089d9ce11697 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:01.464205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7d1d16-1207-4d52-9c5f-089d9ce11697 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:01.465026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7d1d16-1207-4d52-9c5f-089d9ce11697 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:01.465633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7d1d16-1207-4d52-9c5f-089d9ce11697 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:01.466532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7d1d16-1207-4d52-9c5f-089d9ce11697 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:01.467182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7d1d16-1207-4d52-9c5f-089d9ce11697 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:01.467773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a7d1d16-1207-4d52-9c5f-089d9ce11697 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:01.689587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8a7d1d16-1207-4d52-9c5f-089d9ce11697 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:01.711194 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8a7d1d16-1207-4d52-9c5f-089d9ce11697 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1502 microversion: 2.1 time: 0.268641 Aug 27 05:22:01.715035 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2661/5319] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:01 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1502 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:01.738595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ca434114-b69e-4182-a227-71d460a47821 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:01.739593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ca434114-b69e-4182-a227-71d460a47821 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:01.748720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca434114-b69e-4182-a227-71d460a47821 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:01.749351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca434114-b69e-4182-a227-71d460a47821 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:01.750023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca434114-b69e-4182-a227-71d460a47821 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:01.750828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca434114-b69e-4182-a227-71d460a47821 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:01.751421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca434114-b69e-4182-a227-71d460a47821 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:01.752060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca434114-b69e-4182-a227-71d460a47821 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:01.775958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:01.957608 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.network.security_group_api [None req-ca434114-b69e-4182-a227-71d460a47821 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Removing security group 725d80bb-37e7-4263-b2c2-b87a11549d67 from port a5fd331e-b6f2-418e-ac64-38398b561884 Aug 27 05:22:02.087168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-086c7e78-4a51-45ca-b394-07030280e467 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:02.088690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-086c7e78-4a51-45ca-b394-07030280e467 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:02.095004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-086c7e78-4a51-45ca-b394-07030280e467 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:02.096278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-086c7e78-4a51-45ca-b394-07030280e467 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:02.096729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-086c7e78-4a51-45ca-b394-07030280e467 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:02.097684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-086c7e78-4a51-45ca-b394-07030280e467 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:02.098120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-086c7e78-4a51-45ca-b394-07030280e467 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:02.098559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-086c7e78-4a51-45ca-b394-07030280e467 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:02.425984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-086c7e78-4a51-45ca-b394-07030280e467 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:02.434716 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-086c7e78-4a51-45ca-b394-07030280e467 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.352075 Aug 27 05:22:02.436281 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2662/5320] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:02 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:02.527450 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ca434114-b69e-4182-a227-71d460a47821 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab/action" status: 202 len: 0 microversion: 2.1 time: 0.794458 Aug 27 05:22:02.528206 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2659/5321] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:22:01 2022] POST /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:22:02.541109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ab617457-64e8-424b-9dca-c59ba7554e09 req-9e98f783-70e6-4292-9b4b-e3e73be5fcfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f751f91-a14d-4ce3-9b0c-168021a057ab", "tag": "a5fd331e-b6f2-418e-ac64-38398b561884"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:02.554844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c79a6e55-9bdf-472b-8f99-2463c89dfea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:02.559520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c79a6e55-9bdf-472b-8f99-2463c89dfea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:02.578366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ab617457-64e8-424b-9dca-c59ba7554e09 req-9e98f783-70e6-4292-9b4b-e3e73be5fcfa service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:02.579370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ab617457-64e8-424b-9dca-c59ba7554e09 req-9e98f783-70e6-4292-9b4b-e3e73be5fcfa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:02.580633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ab617457-64e8-424b-9dca-c59ba7554e09 req-9e98f783-70e6-4292-9b4b-e3e73be5fcfa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:02.581375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c79a6e55-9bdf-472b-8f99-2463c89dfea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:02.581881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c79a6e55-9bdf-472b-8f99-2463c89dfea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:02.583476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c79a6e55-9bdf-472b-8f99-2463c89dfea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:02.584230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c79a6e55-9bdf-472b-8f99-2463c89dfea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:02.586318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c79a6e55-9bdf-472b-8f99-2463c89dfea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:02.588624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c79a6e55-9bdf-472b-8f99-2463c89dfea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:02.609716 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ab617457-64e8-424b-9dca-c59ba7554e09 req-9e98f783-70e6-4292-9b4b-e3e73be5fcfa service nova] Creating event network-changed:a5fd331e-b6f2-418e-ac64-38398b561884 for instance 2f751f91-a14d-4ce3-9b0c-168021a057ab on n-h2-820368-35 Aug 27 05:22:02.635537 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ab617457-64e8-424b-9dca-c59ba7554e09 req-9e98f783-70e6-4292-9b4b-e3e73be5fcfa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099178 Aug 27 05:22:02.636180 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2660/5322] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:22:02.735900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c79a6e55-9bdf-472b-8f99-2463c89dfea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:02.753518 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c79a6e55-9bdf-472b-8f99-2463c89dfea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1460 microversion: 2.1 time: 0.220435 Aug 27 05:22:02.767121 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2663/5323] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:02 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1460 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:02.779744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-59d832a3-79c7-4f4a-9256-932cdc06d7b9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:02.781518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-59d832a3-79c7-4f4a-9256-932cdc06d7b9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:02.790001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59d832a3-79c7-4f4a-9256-932cdc06d7b9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:02.790928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59d832a3-79c7-4f4a-9256-932cdc06d7b9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:02.791924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59d832a3-79c7-4f4a-9256-932cdc06d7b9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:02.792910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59d832a3-79c7-4f4a-9256-932cdc06d7b9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:02.793713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59d832a3-79c7-4f4a-9256-932cdc06d7b9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:02.794468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59d832a3-79c7-4f4a-9256-932cdc06d7b9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:02.985678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-59d832a3-79c7-4f4a-9256-932cdc06d7b9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:02.994445 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-59d832a3-79c7-4f4a-9256-932cdc06d7b9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.220659 Aug 27 05:22:02.996051 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2661/5324] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:02 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:03.019153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-64338d72-c1b9-4dc9-9d21-aaa45cf583bf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:03.019801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-64338d72-c1b9-4dc9-9d21-aaa45cf583bf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:03.026256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64338d72-c1b9-4dc9-9d21-aaa45cf583bf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:03.026753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64338d72-c1b9-4dc9-9d21-aaa45cf583bf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:03.027306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64338d72-c1b9-4dc9-9d21-aaa45cf583bf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:03.028034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64338d72-c1b9-4dc9-9d21-aaa45cf583bf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:03.028681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64338d72-c1b9-4dc9-9d21-aaa45cf583bf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:03.029129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64338d72-c1b9-4dc9-9d21-aaa45cf583bf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:03.196483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-64338d72-c1b9-4dc9-9d21-aaa45cf583bf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:03.229744 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-64338d72-c1b9-4dc9-9d21-aaa45cf583bf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.215034 Aug 27 05:22:03.230765 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2664/5325] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:03 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:03.254499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1568ff67-c149-472c-bc05-4662834a8c2b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:03.255954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1568ff67-c149-472c-bc05-4662834a8c2b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:03.271206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1568ff67-c149-472c-bc05-4662834a8c2b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:03.271878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1568ff67-c149-472c-bc05-4662834a8c2b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:03.272401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1568ff67-c149-472c-bc05-4662834a8c2b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:03.275506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1568ff67-c149-472c-bc05-4662834a8c2b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:03.277521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1568ff67-c149-472c-bc05-4662834a8c2b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:03.277984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1568ff67-c149-472c-bc05-4662834a8c2b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:03.458530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-05c52e2d-28b1-4380-b57d-6efcf14c29f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:03.459313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-05c52e2d-28b1-4380-b57d-6efcf14c29f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:03.467852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c52e2d-28b1-4380-b57d-6efcf14c29f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:03.468626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c52e2d-28b1-4380-b57d-6efcf14c29f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:03.469230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c52e2d-28b1-4380-b57d-6efcf14c29f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:03.470119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c52e2d-28b1-4380-b57d-6efcf14c29f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:03.471388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c52e2d-28b1-4380-b57d-6efcf14c29f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:03.471969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c52e2d-28b1-4380-b57d-6efcf14c29f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:03.636240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1568ff67-c149-472c-bc05-4662834a8c2b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:03.651510 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1568ff67-c149-472c-bc05-4662834a8c2b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.400855 Aug 27 05:22:03.652771 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2662/5326] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:03 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:03.679762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-157f92a1-3e6d-4b99-837b-a3e274cb97dd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:03.680770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-157f92a1-3e6d-4b99-837b-a3e274cb97dd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:03.687188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157f92a1-3e6d-4b99-837b-a3e274cb97dd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:03.687774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157f92a1-3e6d-4b99-837b-a3e274cb97dd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:03.688550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157f92a1-3e6d-4b99-837b-a3e274cb97dd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:03.690368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157f92a1-3e6d-4b99-837b-a3e274cb97dd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:03.691073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157f92a1-3e6d-4b99-837b-a3e274cb97dd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:03.691739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-157f92a1-3e6d-4b99-837b-a3e274cb97dd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:03.897398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-05c52e2d-28b1-4380-b57d-6efcf14c29f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:03.906742 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-05c52e2d-28b1-4380-b57d-6efcf14c29f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.453106 Aug 27 05:22:03.907479 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2665/5327] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:03 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:04.171593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-157f92a1-3e6d-4b99-837b-a3e274cb97dd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:04.185260 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-157f92a1-3e6d-4b99-837b-a3e274cb97dd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.510052 Aug 27 05:22:04.186160 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2663/5328] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:03 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:04.408993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2060137879", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "dc52ef93-257f-431d-a3c4-4629a0c53bfc"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:04.505969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] validate_networks() for [('dc52ef93-257f-431d-a3c4-4629a0c53bfc', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:22:04.680252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ac0647d-90a4-4591-9000-cff0deafb688 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: .version_select at 0x7fb5656d6c10>, body: {"keypair": {"name": "tempest-keypair-1168499899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2jW13Q7QekTKHhfUUTcAHui2Pc6BKUiOogKj/xrfjSZ0Oo1Di0DismIYT9Znlp24CQtJ9Yp7D4MGgZDYZ5qREVWSYPnoN0tyraudSt/FEertQLeNMbHXxW467PPiraLg=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:04.703051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-4ac0647d-90a4-4591-9000-cff0deafb688 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:22:04.714061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-4ac0647d-90a4-4591-9000-cff0deafb688 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for user 43fc751d620242208608be8bc55ae86d and project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:22:04.778616 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ac0647d-90a4-4591-9000-cff0deafb688 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116688 Aug 27 05:22:04.780212 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2664/5329] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:22:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:22:04.933664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f87e0594-c018-4859-9bbc-1a25e33ed46e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:04.934588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f87e0594-c018-4859-9bbc-1a25e33ed46e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:04.947121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f87e0594-c018-4859-9bbc-1a25e33ed46e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:04.948254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f87e0594-c018-4859-9bbc-1a25e33ed46e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:04.948954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f87e0594-c018-4859-9bbc-1a25e33ed46e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:04.950250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f87e0594-c018-4859-9bbc-1a25e33ed46e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:04.951059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f87e0594-c018-4859-9bbc-1a25e33ed46e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:04.952175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f87e0594-c018-4859-9bbc-1a25e33ed46e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:06.154909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f87e0594-c018-4859-9bbc-1a25e33ed46e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:06.171157 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f87e0594-c018-4859-9bbc-1a25e33ed46e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 1.243251 Aug 27 05:22:06.172106 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2665/5330] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:04 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:06.537487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:22:06.538060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:22:06.538060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:22:06.538531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:22:06.538879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:22:06.541629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:06.557791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:06.558283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:06.559605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:06.560807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:06.561520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:06.564026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:06.586745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:22:06.599562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Getting quotas for user dffafef392eb4e1fba13953f47b2d105 and project 57e6b379f0d24ec8aa6da3c4f01bdd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:22:06.613383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:22:06.615480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:22:06.682374 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-12a8b3ff-93f0-438e-a80a-17865ce4b2c2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.278087 Aug 27 05:22:06.694214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1a184a34-40b4-479e-aa60-970746a96395 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:06.695534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1a184a34-40b4-479e-aa60-970746a96395 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:06.701419 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2666/5331] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:22:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:22:06.703795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:06.891241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1a184a34-40b4-479e-aa60-970746a96395 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:06.901907 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1a184a34-40b4-479e-aa60-970746a96395 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1215 microversion: 2.1 time: 0.211668 Aug 27 05:22:06.903765 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2666/5332] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:06 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:07.195149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5346fbb1-b909-4812-8744-e4bd8e751609 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:07.196671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5346fbb1-b909-4812-8744-e4bd8e751609 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:07.207531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5346fbb1-b909-4812-8744-e4bd8e751609 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:07.208279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5346fbb1-b909-4812-8744-e4bd8e751609 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:07.209155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5346fbb1-b909-4812-8744-e4bd8e751609 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:07.210258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5346fbb1-b909-4812-8744-e4bd8e751609 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:07.211313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5346fbb1-b909-4812-8744-e4bd8e751609 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:07.212062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5346fbb1-b909-4812-8744-e4bd8e751609 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:07.664628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5346fbb1-b909-4812-8744-e4bd8e751609 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:07.685197 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5346fbb1-b909-4812-8744-e4bd8e751609 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.494517 Aug 27 05:22:07.699289 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2667/5333] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:07 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:07.932915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3a1fca50-266b-4184-ac49-ee86b0d1fcbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:07.935918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3a1fca50-266b-4184-ac49-ee86b0d1fcbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:07.948024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a1fca50-266b-4184-ac49-ee86b0d1fcbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:07.949331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a1fca50-266b-4184-ac49-ee86b0d1fcbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:07.949952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a1fca50-266b-4184-ac49-ee86b0d1fcbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:07.951496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a1fca50-266b-4184-ac49-ee86b0d1fcbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:07.952869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a1fca50-266b-4184-ac49-ee86b0d1fcbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:07.953480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a1fca50-266b-4184-ac49-ee86b0d1fcbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:08.063167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3a1fca50-266b-4184-ac49-ee86b0d1fcbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:08.081429 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3a1fca50-266b-4184-ac49-ee86b0d1fcbd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1267 microversion: 2.1 time: 0.160122 Aug 27 05:22:08.083658 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2667/5334] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:07 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:08.710217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb7e44a8-3285-45fa-a017-583bf28f644e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:08.711549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cb7e44a8-3285-45fa-a017-583bf28f644e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:08.722810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7e44a8-3285-45fa-a017-583bf28f644e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:08.728031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7e44a8-3285-45fa-a017-583bf28f644e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:08.728760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7e44a8-3285-45fa-a017-583bf28f644e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:08.729798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7e44a8-3285-45fa-a017-583bf28f644e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:08.730429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7e44a8-3285-45fa-a017-583bf28f644e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:08.731036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb7e44a8-3285-45fa-a017-583bf28f644e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:09.106239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d7864ce3-7b5f-4e00-b6bc-1e26c6e59266 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:09.107741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d7864ce3-7b5f-4e00-b6bc-1e26c6e59266 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:09.116036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7864ce3-7b5f-4e00-b6bc-1e26c6e59266 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:09.116946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7864ce3-7b5f-4e00-b6bc-1e26c6e59266 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:09.117628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7864ce3-7b5f-4e00-b6bc-1e26c6e59266 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:09.119375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7864ce3-7b5f-4e00-b6bc-1e26c6e59266 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:09.120108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7864ce3-7b5f-4e00-b6bc-1e26c6e59266 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:09.120787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7864ce3-7b5f-4e00-b6bc-1e26c6e59266 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:09.169071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb7e44a8-3285-45fa-a017-583bf28f644e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:09.181841 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb7e44a8-3285-45fa-a017-583bf28f644e tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.475478 Aug 27 05:22:09.183792 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2668/5335] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:08 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:09.226253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d7864ce3-7b5f-4e00-b6bc-1e26c6e59266 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:09.296789 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d7864ce3-7b5f-4e00-b6bc-1e26c6e59266 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1273 microversion: 2.1 time: 0.194104 Aug 27 05:22:09.299433 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2668/5336] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:09 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:10.207720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b3768106-3e86-4ca7-abb7-4e5ef4ca212f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:10.208364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b3768106-3e86-4ca7-abb7-4e5ef4ca212f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:10.219801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3768106-3e86-4ca7-abb7-4e5ef4ca212f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:10.220879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3768106-3e86-4ca7-abb7-4e5ef4ca212f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:10.221337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3768106-3e86-4ca7-abb7-4e5ef4ca212f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:10.222115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3768106-3e86-4ca7-abb7-4e5ef4ca212f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:10.228679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3768106-3e86-4ca7-abb7-4e5ef4ca212f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:10.229176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3768106-3e86-4ca7-abb7-4e5ef4ca212f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:10.319687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-34b8a180-17a2-46aa-b793-c18f4754d9f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:10.322295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-34b8a180-17a2-46aa-b793-c18f4754d9f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:10.338199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34b8a180-17a2-46aa-b793-c18f4754d9f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:10.340288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34b8a180-17a2-46aa-b793-c18f4754d9f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:10.341649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34b8a180-17a2-46aa-b793-c18f4754d9f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:10.343753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34b8a180-17a2-46aa-b793-c18f4754d9f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:10.344434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34b8a180-17a2-46aa-b793-c18f4754d9f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:10.350181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34b8a180-17a2-46aa-b793-c18f4754d9f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:10.647996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b3768106-3e86-4ca7-abb7-4e5ef4ca212f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:10.659039 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b3768106-3e86-4ca7-abb7-4e5ef4ca212f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.458358 Aug 27 05:22:10.661157 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2669/5337] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:10 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:10.667897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1289363465", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b22082a4-5b69-426a-b228-4ee7d0a48e79"}], "security_groups": [{"name": "tempest-securitygroup--1455197868"}], "key_name": "tempest-keypair-1168499899", "user_data": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:10.761347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-34b8a180-17a2-46aa-b793-c18f4754d9f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:10.777333 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-34b8a180-17a2-46aa-b793-c18f4754d9f5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1315 microversion: 2.1 time: 0.461710 Aug 27 05:22:10.778597 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2669/5338] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:10 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:10.920662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] validate_networks() for [('b22082a4-5b69-426a-b228-4ee7d0a48e79', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:22:11.264329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9b6a4570-213d-41a0-a647-5bcc6d81db0a req-2cf207a5-e38a-437e-9321-7a6fe94b0eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abb808f-5833-4af2-ae6b-577b3e60b285", "tag": "c21e77ce-5581-44cf-a085-9b6e6e7c151c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:11.283446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9b6a4570-213d-41a0-a647-5bcc6d81db0a req-2cf207a5-e38a-437e-9321-7a6fe94b0eca service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:11.285371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9b6a4570-213d-41a0-a647-5bcc6d81db0a req-2cf207a5-e38a-437e-9321-7a6fe94b0eca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:11.287206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9b6a4570-213d-41a0-a647-5bcc6d81db0a req-2cf207a5-e38a-437e-9321-7a6fe94b0eca service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:11.307981 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9b6a4570-213d-41a0-a647-5bcc6d81db0a req-2cf207a5-e38a-437e-9321-7a6fe94b0eca service nova] Creating event network-changed:c21e77ce-5581-44cf-a085-9b6e6e7c151c for instance 2abb808f-5833-4af2-ae6b-577b3e60b285 on n-h1-820368-35 Aug 27 05:22:11.313100 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9b6a4570-213d-41a0-a647-5bcc6d81db0a req-2cf207a5-e38a-437e-9321-7a6fe94b0eca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052819 Aug 27 05:22:11.314671 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2670/5339] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:22:11.691274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1f7caab7-289b-4674-a66a-142799d82e72 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:11.692930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1f7caab7-289b-4674-a66a-142799d82e72 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:11.707581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f7caab7-289b-4674-a66a-142799d82e72 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:11.708937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f7caab7-289b-4674-a66a-142799d82e72 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:11.709771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f7caab7-289b-4674-a66a-142799d82e72 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:11.711040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f7caab7-289b-4674-a66a-142799d82e72 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:11.711869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f7caab7-289b-4674-a66a-142799d82e72 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:11.712580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f7caab7-289b-4674-a66a-142799d82e72 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:11.907299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:22:11.908323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:22:11.908764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:22:11.909719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:22:11.909719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:22:11.926448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:11.926448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:11.926448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:11.926448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:11.926448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:11.926448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:11.951823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:22:11.957168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for user 43fc751d620242208608be8bc55ae86d and project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:22:11.986317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:22:11.989312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:22:12.077658 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a4c138cb-0c32-4b74-a7ef-7f736a0d9af9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.415022 Aug 27 05:22:12.078301 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2670/5340] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:22:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:22:12.095502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-413189c7-fae2-4522-a090-c3dacc211390 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:12.098489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-413189c7-fae2-4522-a090-c3dacc211390 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:12.110519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-413189c7-fae2-4522-a090-c3dacc211390 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:12.111702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-413189c7-fae2-4522-a090-c3dacc211390 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:12.112309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-413189c7-fae2-4522-a090-c3dacc211390 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:12.113191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-413189c7-fae2-4522-a090-c3dacc211390 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:12.113802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-413189c7-fae2-4522-a090-c3dacc211390 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:12.114419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-413189c7-fae2-4522-a090-c3dacc211390 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:12.263244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1f7caab7-289b-4674-a66a-142799d82e72 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:12.298260 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1f7caab7-289b-4674-a66a-142799d82e72 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.613776 Aug 27 05:22:12.317261 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2671/5341] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:11 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:12.333362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-12c9a462-3574-46a7-993e-ba3f59f55993 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:12.334365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-12c9a462-3574-46a7-993e-ba3f59f55993 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:12.472852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-413189c7-fae2-4522-a090-c3dacc211390 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:12.492658 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-413189c7-fae2-4522-a090-c3dacc211390 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1315 microversion: 2.1 time: 0.413153 Aug 27 05:22:12.493818 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2671/5342] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:12 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:12.512349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-12c9a462-3574-46a7-993e-ba3f59f55993 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:12.535806 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-12c9a462-3574-46a7-993e-ba3f59f55993 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1242 microversion: 2.1 time: 0.216537 Aug 27 05:22:12.536954 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2672/5343] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:12 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1242 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:13.322276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b2ad5d0-3b18-47d4-bcb0-a1146db6ca40 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:13.322902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3b2ad5d0-3b18-47d4-bcb0-a1146db6ca40 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:13.331952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b2ad5d0-3b18-47d4-bcb0-a1146db6ca40 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:13.332934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b2ad5d0-3b18-47d4-bcb0-a1146db6ca40 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:13.333451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b2ad5d0-3b18-47d4-bcb0-a1146db6ca40 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:13.334605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b2ad5d0-3b18-47d4-bcb0-a1146db6ca40 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:13.335405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b2ad5d0-3b18-47d4-bcb0-a1146db6ca40 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:13.336050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b2ad5d0-3b18-47d4-bcb0-a1146db6ca40 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:13.521057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f4ea79ae-0675-4722-9c79-635e0b13f959 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:13.522536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f4ea79ae-0675-4722-9c79-635e0b13f959 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:13.538557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4ea79ae-0675-4722-9c79-635e0b13f959 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:13.539682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4ea79ae-0675-4722-9c79-635e0b13f959 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:13.540207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4ea79ae-0675-4722-9c79-635e0b13f959 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:13.541192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4ea79ae-0675-4722-9c79-635e0b13f959 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:13.541717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4ea79ae-0675-4722-9c79-635e0b13f959 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:13.542347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4ea79ae-0675-4722-9c79-635e0b13f959 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:13.950214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3b2ad5d0-3b18-47d4-bcb0-a1146db6ca40 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:13.965861 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3b2ad5d0-3b18-47d4-bcb0-a1146db6ca40 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.647725 Aug 27 05:22:13.980043 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2672/5344] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:13 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:13.987680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f4ea79ae-0675-4722-9c79-635e0b13f959 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:13.989417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-687a838d-e2b8-41f4-b354-ff33ce194299 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:13.990180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-687a838d-e2b8-41f4-b354-ff33ce194299 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:14.005145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-687a838d-e2b8-41f4-b354-ff33ce194299 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:14.005817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-687a838d-e2b8-41f4-b354-ff33ce194299 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:14.006411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-687a838d-e2b8-41f4-b354-ff33ce194299 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:14.007645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-687a838d-e2b8-41f4-b354-ff33ce194299 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:14.008470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-687a838d-e2b8-41f4-b354-ff33ce194299 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:14.009204 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f4ea79ae-0675-4722-9c79-635e0b13f959 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1315 microversion: 2.1 time: 0.494266 Aug 27 05:22:14.009544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-687a838d-e2b8-41f4-b354-ff33ce194299 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:14.023466 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2673/5345] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:13 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:14.146040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-687a838d-e2b8-41f4-b354-ff33ce194299 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:14.162778 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-687a838d-e2b8-41f4-b354-ff33ce194299 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1300 microversion: 2.1 time: 0.194453 Aug 27 05:22:14.177218 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2673/5346] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:13 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:14.988631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-02024810-53bc-433d-aa92-7a33110072f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:14.989189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-02024810-53bc-433d-aa92-7a33110072f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:15.001720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02024810-53bc-433d-aa92-7a33110072f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:15.002238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02024810-53bc-433d-aa92-7a33110072f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:15.002691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02024810-53bc-433d-aa92-7a33110072f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:15.003472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02024810-53bc-433d-aa92-7a33110072f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:15.003942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02024810-53bc-433d-aa92-7a33110072f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:15.004694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02024810-53bc-433d-aa92-7a33110072f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:15.034962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d979f243-f95f-4634-ae5e-8a0261d6d72a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:15.036848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d979f243-f95f-4634-ae5e-8a0261d6d72a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:15.057910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d979f243-f95f-4634-ae5e-8a0261d6d72a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:15.059713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d979f243-f95f-4634-ae5e-8a0261d6d72a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:15.060565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d979f243-f95f-4634-ae5e-8a0261d6d72a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:15.061671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d979f243-f95f-4634-ae5e-8a0261d6d72a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:15.065167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d979f243-f95f-4634-ae5e-8a0261d6d72a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:15.066875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d979f243-f95f-4634-ae5e-8a0261d6d72a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:15.919000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d979f243-f95f-4634-ae5e-8a0261d6d72a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:15.933062 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d979f243-f95f-4634-ae5e-8a0261d6d72a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1315 microversion: 2.1 time: 0.905254 Aug 27 05:22:15.933781 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2674/5347] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:15 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1315 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:15.940853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d93fb254-f266-4902-a90d-212b785f17f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:15.941412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d93fb254-f266-4902-a90d-212b785f17f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:15.953153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d93fb254-f266-4902-a90d-212b785f17f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:15.953664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d93fb254-f266-4902-a90d-212b785f17f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:15.954147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d93fb254-f266-4902-a90d-212b785f17f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:15.954895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d93fb254-f266-4902-a90d-212b785f17f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:15.955384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d93fb254-f266-4902-a90d-212b785f17f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:15.955823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d93fb254-f266-4902-a90d-212b785f17f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:15.993291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:16.016347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02024810-53bc-433d-aa92-7a33110072f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:16.035688 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-02024810-53bc-433d-aa92-7a33110072f4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 1.051025 Aug 27 05:22:16.039858 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2674/5348] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:14 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:16.594288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d93fb254-f266-4902-a90d-212b785f17f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:16.619382 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d93fb254-f266-4902-a90d-212b785f17f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1368 microversion: 2.1 time: 0.683861 Aug 27 05:22:16.621045 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2675/5349] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:15 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1368 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:16.954246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c2553cf3-17a2-4fe4-b9a2-63c5a242622f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:16.954869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c2553cf3-17a2-4fe4-b9a2-63c5a242622f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:16.963805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2553cf3-17a2-4fe4-b9a2-63c5a242622f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:16.965116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2553cf3-17a2-4fe4-b9a2-63c5a242622f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:16.965724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2553cf3-17a2-4fe4-b9a2-63c5a242622f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:16.966614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2553cf3-17a2-4fe4-b9a2-63c5a242622f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:16.967261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2553cf3-17a2-4fe4-b9a2-63c5a242622f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:16.967870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2553cf3-17a2-4fe4-b9a2-63c5a242622f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:17.061252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7f3cd72e-8874-4ed7-820c-1f3f15987770 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:17.062240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7f3cd72e-8874-4ed7-820c-1f3f15987770 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:17.077381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f3cd72e-8874-4ed7-820c-1f3f15987770 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:17.080522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f3cd72e-8874-4ed7-820c-1f3f15987770 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:17.081729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f3cd72e-8874-4ed7-820c-1f3f15987770 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:17.086435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f3cd72e-8874-4ed7-820c-1f3f15987770 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:17.090363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f3cd72e-8874-4ed7-820c-1f3f15987770 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:17.091010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f3cd72e-8874-4ed7-820c-1f3f15987770 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:17.373425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c2553cf3-17a2-4fe4-b9a2-63c5a242622f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:17.404906 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c2553cf3-17a2-4fe4-b9a2-63c5a242622f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1315 microversion: 2.1 time: 0.454815 Aug 27 05:22:17.408288 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2675/5350] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:16 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:17.515286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-bab56cd8-e281-43ba-9129-1c0dedc1edf9 req-4c20155f-be3c-4745-b50a-dc6903ccdcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b65010e-acb1-46b6-8da9-b4fef757aa02", "tag": "084f17e4-c2d4-4f2f-8393-00bf8618d810"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:17.551467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7f3cd72e-8874-4ed7-820c-1f3f15987770 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:17.558624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bab56cd8-e281-43ba-9129-1c0dedc1edf9 req-4c20155f-be3c-4745-b50a-dc6903ccdcb5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:17.560710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bab56cd8-e281-43ba-9129-1c0dedc1edf9 req-4c20155f-be3c-4745-b50a-dc6903ccdcb5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:17.571418 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7f3cd72e-8874-4ed7-820c-1f3f15987770 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.514626 Aug 27 05:22:17.572301 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2676/5351] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:17 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:17.572587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bab56cd8-e281-43ba-9129-1c0dedc1edf9 req-4c20155f-be3c-4745-b50a-dc6903ccdcb5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:17.609813 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-bab56cd8-e281-43ba-9129-1c0dedc1edf9 req-4c20155f-be3c-4745-b50a-dc6903ccdcb5 service nova] Creating event network-changed:084f17e4-c2d4-4f2f-8393-00bf8618d810 for instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 on n-h2-820368-35 Aug 27 05:22:17.621363 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-bab56cd8-e281-43ba-9129-1c0dedc1edf9 req-4c20155f-be3c-4745-b50a-dc6903ccdcb5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111967 Aug 27 05:22:17.622580 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2676/5352] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:22:17.643470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65995c60-543d-4c11-9cbb-8a611697ebbf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:17.644736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-65995c60-543d-4c11-9cbb-8a611697ebbf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:17.660700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65995c60-543d-4c11-9cbb-8a611697ebbf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:17.665130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65995c60-543d-4c11-9cbb-8a611697ebbf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:17.665860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65995c60-543d-4c11-9cbb-8a611697ebbf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:17.669192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65995c60-543d-4c11-9cbb-8a611697ebbf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:17.670133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65995c60-543d-4c11-9cbb-8a611697ebbf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:17.673660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65995c60-543d-4c11-9cbb-8a611697ebbf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:18.076691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-65995c60-543d-4c11-9cbb-8a611697ebbf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:18.090378 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-65995c60-543d-4c11-9cbb-8a611697ebbf tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1368 microversion: 2.1 time: 0.451748 Aug 27 05:22:18.091643 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2677/5353] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:17 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1368 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:18.185225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-92722ae3-c63d-4141-afd2-bd7ced86e063 req-06c82194-a90c-4b31-add2-e79cd3f0959e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abb808f-5833-4af2-ae6b-577b3e60b285", "name": "network-vif-plugged", "status": "completed", "tag": "c21e77ce-5581-44cf-a085-9b6e6e7c151c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:18.215936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-92722ae3-c63d-4141-afd2-bd7ced86e063 req-06c82194-a90c-4b31-add2-e79cd3f0959e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:18.218754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-92722ae3-c63d-4141-afd2-bd7ced86e063 req-06c82194-a90c-4b31-add2-e79cd3f0959e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:18.220523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-92722ae3-c63d-4141-afd2-bd7ced86e063 req-06c82194-a90c-4b31-add2-e79cd3f0959e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:18.256855 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-92722ae3-c63d-4141-afd2-bd7ced86e063 req-06c82194-a90c-4b31-add2-e79cd3f0959e service nova] Creating event network-vif-plugged:c21e77ce-5581-44cf-a085-9b6e6e7c151c for instance 2abb808f-5833-4af2-ae6b-577b3e60b285 on n-h1-820368-35 Aug 27 05:22:18.273215 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-92722ae3-c63d-4141-afd2-bd7ced86e063 req-06c82194-a90c-4b31-add2-e79cd3f0959e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103665 Aug 27 05:22:18.275249 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2677/5354] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:22:18.430076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a648d35e-e364-4b10-866c-51db61c814fc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:18.430706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a648d35e-e364-4b10-866c-51db61c814fc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:18.446974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a648d35e-e364-4b10-866c-51db61c814fc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:18.447625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a648d35e-e364-4b10-866c-51db61c814fc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:18.454602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a648d35e-e364-4b10-866c-51db61c814fc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:18.456174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a648d35e-e364-4b10-866c-51db61c814fc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:18.457599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a648d35e-e364-4b10-866c-51db61c814fc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:18.458352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a648d35e-e364-4b10-866c-51db61c814fc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:18.594514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-971128df-5e07-4b93-9717-ea197dc86b17 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:18.595844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-971128df-5e07-4b93-9717-ea197dc86b17 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:18.604587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-971128df-5e07-4b93-9717-ea197dc86b17 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:18.605080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-971128df-5e07-4b93-9717-ea197dc86b17 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:18.605519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-971128df-5e07-4b93-9717-ea197dc86b17 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:18.606228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-971128df-5e07-4b93-9717-ea197dc86b17 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:18.609101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-971128df-5e07-4b93-9717-ea197dc86b17 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:18.609708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-971128df-5e07-4b93-9717-ea197dc86b17 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:19.019730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-971128df-5e07-4b93-9717-ea197dc86b17 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:19.025564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a648d35e-e364-4b10-866c-51db61c814fc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:19.030134 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-971128df-5e07-4b93-9717-ea197dc86b17 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.440102 Aug 27 05:22:19.030960 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2678/5355] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:18 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:19.038493 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a648d35e-e364-4b10-866c-51db61c814fc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1315 microversion: 2.1 time: 0.612226 Aug 27 05:22:19.039473 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2678/5356] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:18 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:19.112693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0638bf70-acd0-4adb-9534-d1faa8934a83 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:19.113841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0638bf70-acd0-4adb-9534-d1faa8934a83 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:19.120862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0638bf70-acd0-4adb-9534-d1faa8934a83 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:19.121364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0638bf70-acd0-4adb-9534-d1faa8934a83 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:19.121869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0638bf70-acd0-4adb-9534-d1faa8934a83 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:19.122589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0638bf70-acd0-4adb-9534-d1faa8934a83 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:19.123259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0638bf70-acd0-4adb-9534-d1faa8934a83 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:19.123953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0638bf70-acd0-4adb-9534-d1faa8934a83 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:19.325107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0638bf70-acd0-4adb-9534-d1faa8934a83 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:19.346767 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0638bf70-acd0-4adb-9534-d1faa8934a83 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1368 microversion: 2.1 time: 0.236179 Aug 27 05:22:19.348880 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2679/5357] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:19 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:20.056156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f3633eb4-1091-4e8c-9a5b-c5e389fab869 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:20.056945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f3633eb4-1091-4e8c-9a5b-c5e389fab869 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:20.061216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-78396584-0215-4f97-9ae1-dec6b3449ddb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:20.061898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-78396584-0215-4f97-9ae1-dec6b3449ddb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:20.071276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78396584-0215-4f97-9ae1-dec6b3449ddb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:20.071481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3633eb4-1091-4e8c-9a5b-c5e389fab869 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:20.072283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78396584-0215-4f97-9ae1-dec6b3449ddb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:20.072451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3633eb4-1091-4e8c-9a5b-c5e389fab869 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:20.072728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78396584-0215-4f97-9ae1-dec6b3449ddb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:20.073699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78396584-0215-4f97-9ae1-dec6b3449ddb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:20.074162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3633eb4-1091-4e8c-9a5b-c5e389fab869 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:20.076639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3633eb4-1091-4e8c-9a5b-c5e389fab869 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:20.076797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78396584-0215-4f97-9ae1-dec6b3449ddb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:20.077369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3633eb4-1091-4e8c-9a5b-c5e389fab869 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:20.077922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3633eb4-1091-4e8c-9a5b-c5e389fab869 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:20.080947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78396584-0215-4f97-9ae1-dec6b3449ddb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:20.538479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-78396584-0215-4f97-9ae1-dec6b3449ddb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:20.555795 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-78396584-0215-4f97-9ae1-dec6b3449ddb tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1315 microversion: 2.1 time: 0.499292 Aug 27 05:22:20.557162 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2680/5358] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:20 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:20.582879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-11ba0439-8ed6-4795-a1cf-a12cc661dca9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:20.592890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-11ba0439-8ed6-4795-a1cf-a12cc661dca9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:20.613974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11ba0439-8ed6-4795-a1cf-a12cc661dca9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:20.622524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11ba0439-8ed6-4795-a1cf-a12cc661dca9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:20.623304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11ba0439-8ed6-4795-a1cf-a12cc661dca9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:20.624313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11ba0439-8ed6-4795-a1cf-a12cc661dca9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:20.625030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11ba0439-8ed6-4795-a1cf-a12cc661dca9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:20.627320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11ba0439-8ed6-4795-a1cf-a12cc661dca9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:20.661373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f3633eb4-1091-4e8c-9a5b-c5e389fab869 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:20.669498 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f3633eb4-1091-4e8c-9a5b-c5e389fab869 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.618852 Aug 27 05:22:20.672228 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2679/5359] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:20 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:21.004803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-11ba0439-8ed6-4795-a1cf-a12cc661dca9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:21.020028 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-11ba0439-8ed6-4795-a1cf-a12cc661dca9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1368 microversion: 2.1 time: 0.460996 Aug 27 05:22:21.020812 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2681/5360] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:20 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1368 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:21.587548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fe2f1df0-c9a3-454c-a2c3-75c206c355e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:21.589484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fe2f1df0-c9a3-454c-a2c3-75c206c355e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:21.617597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2f1df0-c9a3-454c-a2c3-75c206c355e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:21.618117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2f1df0-c9a3-454c-a2c3-75c206c355e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:21.618575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2f1df0-c9a3-454c-a2c3-75c206c355e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:21.619346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2f1df0-c9a3-454c-a2c3-75c206c355e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:21.620217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2f1df0-c9a3-454c-a2c3-75c206c355e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:21.620217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe2f1df0-c9a3-454c-a2c3-75c206c355e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:21.709873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a798f2c-d3d5-4ae0-ab6a-063314370682 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:21.711810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6a798f2c-d3d5-4ae0-ab6a-063314370682 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:21.731512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a798f2c-d3d5-4ae0-ab6a-063314370682 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:21.732026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a798f2c-d3d5-4ae0-ab6a-063314370682 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:21.734308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a798f2c-d3d5-4ae0-ab6a-063314370682 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:21.735674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a798f2c-d3d5-4ae0-ab6a-063314370682 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:21.739285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a798f2c-d3d5-4ae0-ab6a-063314370682 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:21.740483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a798f2c-d3d5-4ae0-ab6a-063314370682 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:21.768561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:21.936587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:21.975896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=12 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:22.143372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6a798f2c-d3d5-4ae0-ab6a-063314370682 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:22.155068 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6a798f2c-d3d5-4ae0-ab6a-063314370682 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.465472 Aug 27 05:22:22.170632 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2682/5361] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:21 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:22.170632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d88c7e97-cf93-4460-8eb8-94829dd9e7c8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:22.170632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d88c7e97-cf93-4460-8eb8-94829dd9e7c8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:22.183224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fe2f1df0-c9a3-454c-a2c3-75c206c355e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:22.191398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d88c7e97-cf93-4460-8eb8-94829dd9e7c8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:22.192618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d88c7e97-cf93-4460-8eb8-94829dd9e7c8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:22.193744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d88c7e97-cf93-4460-8eb8-94829dd9e7c8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:22.195334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d88c7e97-cf93-4460-8eb8-94829dd9e7c8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:22.196434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d88c7e97-cf93-4460-8eb8-94829dd9e7c8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:22.197139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d88c7e97-cf93-4460-8eb8-94829dd9e7c8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:22.208484 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fe2f1df0-c9a3-454c-a2c3-75c206c355e1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1502 microversion: 2.1 time: 0.625518 Aug 27 05:22:22.211961 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2680/5362] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:21 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1502 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:22.234095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-29cdd120-3d19-4eb3-a8c9-31fa80233ee8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:22.234647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-29cdd120-3d19-4eb3-a8c9-31fa80233ee8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:22.241494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29cdd120-3d19-4eb3-a8c9-31fa80233ee8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:22.242155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29cdd120-3d19-4eb3-a8c9-31fa80233ee8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:22.242602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29cdd120-3d19-4eb3-a8c9-31fa80233ee8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:22.243501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29cdd120-3d19-4eb3-a8c9-31fa80233ee8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:22.243958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29cdd120-3d19-4eb3-a8c9-31fa80233ee8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:22.244382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29cdd120-3d19-4eb3-a8c9-31fa80233ee8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:22.339259 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-29cdd120-3d19-4eb3-a8c9-31fa80233ee8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285/action" status: 202 len: 0 microversion: 2.1 time: 0.109957 Aug 27 05:22:22.341397 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2681/5363] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:22:22 2022] POST /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:22:22.352634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ca759432-3945-4adc-86d6-1a6d912a763c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:22.353407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ca759432-3945-4adc-86d6-1a6d912a763c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:22.369786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca759432-3945-4adc-86d6-1a6d912a763c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:22.370720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca759432-3945-4adc-86d6-1a6d912a763c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:22.371561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca759432-3945-4adc-86d6-1a6d912a763c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:22.372505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca759432-3945-4adc-86d6-1a6d912a763c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:22.373157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca759432-3945-4adc-86d6-1a6d912a763c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:22.373775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca759432-3945-4adc-86d6-1a6d912a763c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:22.518316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:22.590081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d88c7e97-cf93-4460-8eb8-94829dd9e7c8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:22.611320 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d88c7e97-cf93-4460-8eb8-94829dd9e7c8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1368 microversion: 2.1 time: 0.451162 Aug 27 05:22:22.615118 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2683/5364] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:22 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1368 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:22.684457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ca759432-3945-4adc-86d6-1a6d912a763c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:22.697348 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ca759432-3945-4adc-86d6-1a6d912a763c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1507 microversion: 2.1 time: 0.350258 Aug 27 05:22:22.699988 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2682/5365] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:22 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1507 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:23.184757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-20356c98-9854-4143-af2d-8e228f462529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:23.185376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-20356c98-9854-4143-af2d-8e228f462529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:23.195633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20356c98-9854-4143-af2d-8e228f462529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:23.196542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20356c98-9854-4143-af2d-8e228f462529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:23.197317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20356c98-9854-4143-af2d-8e228f462529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:23.198439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20356c98-9854-4143-af2d-8e228f462529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:23.199509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20356c98-9854-4143-af2d-8e228f462529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:23.200152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20356c98-9854-4143-af2d-8e228f462529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:23.473894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-20356c98-9854-4143-af2d-8e228f462529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:23.495835 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-20356c98-9854-4143-af2d-8e228f462529 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.315815 Aug 27 05:22:23.496962 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2684/5366] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:23 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:23.637142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7cbb6a53-4541-473d-b21d-f1ae1955318d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:23.637833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7cbb6a53-4541-473d-b21d-f1ae1955318d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:23.652636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a53-4541-473d-b21d-f1ae1955318d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:23.653734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a53-4541-473d-b21d-f1ae1955318d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:23.655401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a53-4541-473d-b21d-f1ae1955318d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:23.656154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a53-4541-473d-b21d-f1ae1955318d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:23.656616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a53-4541-473d-b21d-f1ae1955318d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:23.657598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a53-4541-473d-b21d-f1ae1955318d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:23.722386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-810aa064-a63f-4e7f-a42c-0d7115f0b364 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:23.723461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-810aa064-a63f-4e7f-a42c-0d7115f0b364 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:23.736493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-810aa064-a63f-4e7f-a42c-0d7115f0b364 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:23.745023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-810aa064-a63f-4e7f-a42c-0d7115f0b364 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:23.745592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-810aa064-a63f-4e7f-a42c-0d7115f0b364 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:23.746473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-810aa064-a63f-4e7f-a42c-0d7115f0b364 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:23.747848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-810aa064-a63f-4e7f-a42c-0d7115f0b364 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:23.749059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-810aa064-a63f-4e7f-a42c-0d7115f0b364 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:24.129709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7cbb6a53-4541-473d-b21d-f1ae1955318d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:24.148715 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7cbb6a53-4541-473d-b21d-f1ae1955318d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1368 microversion: 2.1 time: 0.515589 Aug 27 05:22:24.164430 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2683/5367] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:23 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1368 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:24.189939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-810aa064-a63f-4e7f-a42c-0d7115f0b364 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:24.200449 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-810aa064-a63f-4e7f-a42c-0d7115f0b364 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1487 microversion: 2.1 time: 0.483598 Aug 27 05:22:24.212955 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2685/5368] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:23 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1487 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:24.233694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6cd3a945-d9dc-4358-9532-ad570c4c3e51 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:24.234442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6cd3a945-d9dc-4358-9532-ad570c4c3e51 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:24.244485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd3a945-d9dc-4358-9532-ad570c4c3e51 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:24.245377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd3a945-d9dc-4358-9532-ad570c4c3e51 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:24.246085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd3a945-d9dc-4358-9532-ad570c4c3e51 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:24.247411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd3a945-d9dc-4358-9532-ad570c4c3e51 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:24.247554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd3a945-d9dc-4358-9532-ad570c4c3e51 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:24.248061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cd3a945-d9dc-4358-9532-ad570c4c3e51 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:24.278504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-6cd3a945-d9dc-4358-9532-ad570c4c3e51 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lazy-loading 'flavor' on Instance uuid 2abb808f-5833-4af2-ae6b-577b3e60b285 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:22:24.519541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf898f6c-b801-4dec-a710-6b39f0114ceb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:24.520738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf898f6c-b801-4dec-a710-6b39f0114ceb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:24.531668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf898f6c-b801-4dec-a710-6b39f0114ceb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:24.535926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf898f6c-b801-4dec-a710-6b39f0114ceb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:24.537699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf898f6c-b801-4dec-a710-6b39f0114ceb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:24.542025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf898f6c-b801-4dec-a710-6b39f0114ceb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:24.542548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf898f6c-b801-4dec-a710-6b39f0114ceb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:24.543031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf898f6c-b801-4dec-a710-6b39f0114ceb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:24.543191 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6cd3a945-d9dc-4358-9532-ad570c4c3e51 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285/action" status: 202 len: 0 microversion: 2.1 time: 0.313019 Aug 27 05:22:24.544187 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2684/5369] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:22:24 2022] POST /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:22:24.575374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6205e3d-75bb-48d7-a54d-4559a3ddae4e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:24.576095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6205e3d-75bb-48d7-a54d-4559a3ddae4e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:24.600358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6205e3d-75bb-48d7-a54d-4559a3ddae4e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:24.602196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6205e3d-75bb-48d7-a54d-4559a3ddae4e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:24.604070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6205e3d-75bb-48d7-a54d-4559a3ddae4e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:24.606049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6205e3d-75bb-48d7-a54d-4559a3ddae4e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:24.614376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6205e3d-75bb-48d7-a54d-4559a3ddae4e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:24.616367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6205e3d-75bb-48d7-a54d-4559a3ddae4e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:24.922469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6205e3d-75bb-48d7-a54d-4559a3ddae4e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:24.930661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cf898f6c-b801-4dec-a710-6b39f0114ceb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:24.941269 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf898f6c-b801-4dec-a710-6b39f0114ceb tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.426597 Aug 27 05:22:24.943880 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6205e3d-75bb-48d7-a54d-4559a3ddae4e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1493 microversion: 2.1 time: 0.380843 Aug 27 05:22:24.944500 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2686/5370] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:24 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:24.962649 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2685/5371] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:24 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1493 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:25.183119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb640599-ef9b-42a8-8845-87eaaa9857ef tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:25.183860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb640599-ef9b-42a8-8845-87eaaa9857ef tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:25.191946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb640599-ef9b-42a8-8845-87eaaa9857ef tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:25.194848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb640599-ef9b-42a8-8845-87eaaa9857ef tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:25.195732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb640599-ef9b-42a8-8845-87eaaa9857ef tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:25.196717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb640599-ef9b-42a8-8845-87eaaa9857ef tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:25.197564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb640599-ef9b-42a8-8845-87eaaa9857ef tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:25.198425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb640599-ef9b-42a8-8845-87eaaa9857ef tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:25.553921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb640599-ef9b-42a8-8845-87eaaa9857ef tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:25.577109 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb640599-ef9b-42a8-8845-87eaaa9857ef tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1368 microversion: 2.1 time: 0.405995 Aug 27 05:22:25.578349 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2687/5372] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:25 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1368 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:25.968102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-05c19b1b-ec8a-4867-9965-9dcdfa8307dc tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:25.969569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-05c19b1b-ec8a-4867-9965-9dcdfa8307dc tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:25.974698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f510dafb-2109-4812-a424-459ede5e1f3c req-6461d5df-9c17-4c00-83aa-209e351c45d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b65010e-acb1-46b6-8da9-b4fef757aa02", "name": "network-vif-plugged", "status": "completed", "tag": "084f17e4-c2d4-4f2f-8393-00bf8618d810"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:25.977852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c19b1b-ec8a-4867-9965-9dcdfa8307dc tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:25.979584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c19b1b-ec8a-4867-9965-9dcdfa8307dc tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:25.980285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c19b1b-ec8a-4867-9965-9dcdfa8307dc tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:25.981713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c19b1b-ec8a-4867-9965-9dcdfa8307dc tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:25.982692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c19b1b-ec8a-4867-9965-9dcdfa8307dc tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:25.983369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05c19b1b-ec8a-4867-9965-9dcdfa8307dc tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:25.999873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f510dafb-2109-4812-a424-459ede5e1f3c req-6461d5df-9c17-4c00-83aa-209e351c45d7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:26.000479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f510dafb-2109-4812-a424-459ede5e1f3c req-6461d5df-9c17-4c00-83aa-209e351c45d7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:26.002380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f510dafb-2109-4812-a424-459ede5e1f3c req-6461d5df-9c17-4c00-83aa-209e351c45d7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:26.033816 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f510dafb-2109-4812-a424-459ede5e1f3c req-6461d5df-9c17-4c00-83aa-209e351c45d7 service nova] Creating event network-vif-plugged:084f17e4-c2d4-4f2f-8393-00bf8618d810 for instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 on n-h2-820368-35 Aug 27 05:22:26.041091 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f510dafb-2109-4812-a424-459ede5e1f3c req-6461d5df-9c17-4c00-83aa-209e351c45d7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071298 Aug 27 05:22:26.042330 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2688/5373] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:22:26.050503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-42d66f19-b810-4270-855b-9f6b79fb67d7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:26.051468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-42d66f19-b810-4270-855b-9f6b79fb67d7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:26.065203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d66f19-b810-4270-855b-9f6b79fb67d7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:26.066033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d66f19-b810-4270-855b-9f6b79fb67d7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:26.066704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d66f19-b810-4270-855b-9f6b79fb67d7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:26.067744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d66f19-b810-4270-855b-9f6b79fb67d7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:26.072794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d66f19-b810-4270-855b-9f6b79fb67d7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:26.073581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42d66f19-b810-4270-855b-9f6b79fb67d7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:26.798318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-05c19b1b-ec8a-4867-9965-9dcdfa8307dc tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:26.809970 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-05c19b1b-ec8a-4867-9965-9dcdfa8307dc tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.846624 Aug 27 05:22:26.810843 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2686/5374] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:25 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:26.818945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb266245-e418-4ad4-a757-5d3bb911117d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:26.819831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cb266245-e418-4ad4-a757-5d3bb911117d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:26.836433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb266245-e418-4ad4-a757-5d3bb911117d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:26.837167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb266245-e418-4ad4-a757-5d3bb911117d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:26.837783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb266245-e418-4ad4-a757-5d3bb911117d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:26.838700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb266245-e418-4ad4-a757-5d3bb911117d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:26.839417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb266245-e418-4ad4-a757-5d3bb911117d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:26.839852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb266245-e418-4ad4-a757-5d3bb911117d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:27.044974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-42d66f19-b810-4270-855b-9f6b79fb67d7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:27.055193 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-42d66f19-b810-4270-855b-9f6b79fb67d7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1493 microversion: 2.1 time: 1.011305 Aug 27 05:22:27.056354 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2689/5375] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:26 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1493 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:27.156425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb266245-e418-4ad4-a757-5d3bb911117d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:27.169844 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb266245-e418-4ad4-a757-5d3bb911117d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1368 microversion: 2.1 time: 0.356847 Aug 27 05:22:27.172270 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2687/5376] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:26 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1368 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:27.838266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-94a5d1b2-a6cc-45d5-8ea7-5da406cfde6f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:27.839274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-94a5d1b2-a6cc-45d5-8ea7-5da406cfde6f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:27.854359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94a5d1b2-a6cc-45d5-8ea7-5da406cfde6f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:27.860385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94a5d1b2-a6cc-45d5-8ea7-5da406cfde6f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:27.861125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94a5d1b2-a6cc-45d5-8ea7-5da406cfde6f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:27.862112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94a5d1b2-a6cc-45d5-8ea7-5da406cfde6f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:27.862612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94a5d1b2-a6cc-45d5-8ea7-5da406cfde6f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:27.863115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94a5d1b2-a6cc-45d5-8ea7-5da406cfde6f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:28.079907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a45d2ebe-fbd0-4769-9fe9-25317c640efc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:28.080588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a45d2ebe-fbd0-4769-9fe9-25317c640efc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:28.093848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45d2ebe-fbd0-4769-9fe9-25317c640efc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:28.104999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45d2ebe-fbd0-4769-9fe9-25317c640efc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:28.106234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45d2ebe-fbd0-4769-9fe9-25317c640efc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:28.109410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45d2ebe-fbd0-4769-9fe9-25317c640efc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:28.110136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45d2ebe-fbd0-4769-9fe9-25317c640efc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:28.110706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45d2ebe-fbd0-4769-9fe9-25317c640efc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:28.115754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-94a5d1b2-a6cc-45d5-8ea7-5da406cfde6f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:28.148417 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-94a5d1b2-a6cc-45d5-8ea7-5da406cfde6f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1505 microversion: 2.1 time: 0.314079 Aug 27 05:22:28.158614 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2690/5377] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:27 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:28.211265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7e04f866-6f42-4ef5-a0ee-284567ea1539 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:28.212540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7e04f866-6f42-4ef5-a0ee-284567ea1539 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:28.233868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e04f866-6f42-4ef5-a0ee-284567ea1539 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:28.234382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e04f866-6f42-4ef5-a0ee-284567ea1539 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:28.235339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e04f866-6f42-4ef5-a0ee-284567ea1539 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:28.239898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e04f866-6f42-4ef5-a0ee-284567ea1539 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:28.240404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e04f866-6f42-4ef5-a0ee-284567ea1539 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:28.244752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e04f866-6f42-4ef5-a0ee-284567ea1539 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:28.977097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7e04f866-6f42-4ef5-a0ee-284567ea1539 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:28.993965 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7e04f866-6f42-4ef5-a0ee-284567ea1539 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1559 microversion: 2.1 time: 0.804200 Aug 27 05:22:28.997346 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2691/5378] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:28 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1559 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:29.019815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a45d2ebe-fbd0-4769-9fe9-25317c640efc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:29.036549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0a5fa962-c396-45cf-ab76-c5d2d8e02e3f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:29.037799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0a5fa962-c396-45cf-ab76-c5d2d8e02e3f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:29.044138 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a45d2ebe-fbd0-4769-9fe9-25317c640efc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1493 microversion: 2.1 time: 0.968780 Aug 27 05:22:29.050411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a5fa962-c396-45cf-ab76-c5d2d8e02e3f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:29.054069 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2688/5379] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:28 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1493 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:29.056065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a5fa962-c396-45cf-ab76-c5d2d8e02e3f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:29.057260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a5fa962-c396-45cf-ab76-c5d2d8e02e3f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:29.059807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a5fa962-c396-45cf-ab76-c5d2d8e02e3f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:29.060479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a5fa962-c396-45cf-ab76-c5d2d8e02e3f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:29.061783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a5fa962-c396-45cf-ab76-c5d2d8e02e3f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:29.182531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-718dd6de-f54c-4131-b1e8-a9c6e63f748f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:29.183297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-718dd6de-f54c-4131-b1e8-a9c6e63f748f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:29.195028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-718dd6de-f54c-4131-b1e8-a9c6e63f748f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:29.202767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-718dd6de-f54c-4131-b1e8-a9c6e63f748f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:29.208674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-718dd6de-f54c-4131-b1e8-a9c6e63f748f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:29.210739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-718dd6de-f54c-4131-b1e8-a9c6e63f748f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:29.212129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-718dd6de-f54c-4131-b1e8-a9c6e63f748f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:29.212899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-718dd6de-f54c-4131-b1e8-a9c6e63f748f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:29.264193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:29.384045 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0a5fa962-c396-45cf-ab76-c5d2d8e02e3f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.353528 Aug 27 05:22:29.385715 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2692/5380] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:22:29 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02/os-interface => generated 285 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:22:29.621557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-718dd6de-f54c-4131-b1e8-a9c6e63f748f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:29.639213 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-718dd6de-f54c-4131-b1e8-a9c6e63f748f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1485 microversion: 2.1 time: 0.460733 Aug 27 05:22:29.639989 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2689/5381] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:29 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1485 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:29.858289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1304992415", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:29.926112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] validate_networks() for [('58430044-336b-431d-9342-f0f068464fb9', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:22:30.091945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b3880964-4056-416c-b2ec-b0c7f4e56779 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:30.093175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b3880964-4056-416c-b2ec-b0c7f4e56779 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:30.109763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3880964-4056-416c-b2ec-b0c7f4e56779 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:30.112613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3880964-4056-416c-b2ec-b0c7f4e56779 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:30.113076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3880964-4056-416c-b2ec-b0c7f4e56779 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:30.113825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3880964-4056-416c-b2ec-b0c7f4e56779 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:30.115668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3880964-4056-416c-b2ec-b0c7f4e56779 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:30.119075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b3880964-4056-416c-b2ec-b0c7f4e56779 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:31.123781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b3880964-4056-416c-b2ec-b0c7f4e56779 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:31.137595 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b3880964-4056-416c-b2ec-b0c7f4e56779 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1514 microversion: 2.1 time: 1.049890 Aug 27 05:22:31.138208 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2690/5382] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:30 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1514 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:31.551127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:22:31.552684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:22:31.553548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:22:31.554730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:22:31.555995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:22:31.591984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:31.596454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:31.598286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:31.602980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:31.605904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:31.607640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:31.641559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Getting quotas for project db6268ab038142ebaeebf7b7e9f83652. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:22:31.648013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Getting quotas for user 3a3cf2d3ecdf4926b00d371bae8e40eb and project db6268ab038142ebaeebf7b7e9f83652. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:22:31.664423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:22:31.667039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:22:31.728701 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [6103e528-015b-4e02-a557-6b8e58910c8a] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:22:32.169576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-92c03868-001c-42bf-99e9-f30a718bcaa5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:32.170231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-92c03868-001c-42bf-99e9-f30a718bcaa5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:32.185521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92c03868-001c-42bf-99e9-f30a718bcaa5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:32.186358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92c03868-001c-42bf-99e9-f30a718bcaa5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:32.187183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92c03868-001c-42bf-99e9-f30a718bcaa5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:32.192037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92c03868-001c-42bf-99e9-f30a718bcaa5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:32.192757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92c03868-001c-42bf-99e9-f30a718bcaa5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:32.193343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92c03868-001c-42bf-99e9-f30a718bcaa5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:32.737002 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [6103e528-015b-4e02-a557-6b8e58910c8a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47448. Aug 27 05:22:32.742697 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-06264b2e-7b2b-449a-ac00-08ee80c7ca1a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.896779 Aug 27 05:22:32.743643 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2693/5383] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:22:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:22:32.756081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-92c03868-001c-42bf-99e9-f30a718bcaa5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:32.760250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40cdb75e-378e-41b1-9fd0-4de20454367d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:32.766958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-40cdb75e-378e-41b1-9fd0-4de20454367d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:32.781397 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-92c03868-001c-42bf-99e9-f30a718bcaa5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1514 microversion: 2.1 time: 0.613324 Aug 27 05:22:32.799012 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2691/5384] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:32 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1514 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:32.993831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-40cdb75e-378e-41b1-9fd0-4de20454367d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:33.001193 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40cdb75e-378e-41b1-9fd0-4de20454367d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1214 microversion: 2.1 time: 0.250382 Aug 27 05:22:33.006552 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2694/5385] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:32 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1214 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:33.101941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-9e0cb57b-247d-41b2-a208-c52606da77b3 req-ebd35674-098d-4c2d-8bf8-9d4fa94d6195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b65010e-acb1-46b6-8da9-b4fef757aa02", "tag": "084f17e4-c2d4-4f2f-8393-00bf8618d810"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:33.128150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9e0cb57b-247d-41b2-a208-c52606da77b3 req-ebd35674-098d-4c2d-8bf8-9d4fa94d6195 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:33.129851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9e0cb57b-247d-41b2-a208-c52606da77b3 req-ebd35674-098d-4c2d-8bf8-9d4fa94d6195 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:33.132668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9e0cb57b-247d-41b2-a208-c52606da77b3 req-ebd35674-098d-4c2d-8bf8-9d4fa94d6195 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:33.154101 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-9e0cb57b-247d-41b2-a208-c52606da77b3 req-ebd35674-098d-4c2d-8bf8-9d4fa94d6195 service nova] Creating event network-changed:084f17e4-c2d4-4f2f-8393-00bf8618d810 for instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 on n-h2-820368-35 Aug 27 05:22:33.167360 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-9e0cb57b-247d-41b2-a208-c52606da77b3 req-ebd35674-098d-4c2d-8bf8-9d4fa94d6195 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066905 Aug 27 05:22:33.169952 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2692/5386] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:22:33.820665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2cfa1d9b-c314-4bc0-9621-fcb4c2a18ea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:33.821449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2cfa1d9b-c314-4bc0-9621-fcb4c2a18ea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:33.835726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfa1d9b-c314-4bc0-9621-fcb4c2a18ea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:33.836225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfa1d9b-c314-4bc0-9621-fcb4c2a18ea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:33.836666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfa1d9b-c314-4bc0-9621-fcb4c2a18ea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:33.837392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfa1d9b-c314-4bc0-9621-fcb4c2a18ea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:33.837844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfa1d9b-c314-4bc0-9621-fcb4c2a18ea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:33.838273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cfa1d9b-c314-4bc0-9621-fcb4c2a18ea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:34.025208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e06f85c0-34f6-4035-b28e-b610ec16d659 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:34.026237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e06f85c0-34f6-4035-b28e-b610ec16d659 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:34.254945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2cfa1d9b-c314-4bc0-9621-fcb4c2a18ea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:34.270141 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2cfa1d9b-c314-4bc0-9621-fcb4c2a18ea1 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1514 microversion: 2.1 time: 0.464048 Aug 27 05:22:34.275403 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2695/5387] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:33 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1514 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:34.302283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e06f85c0-34f6-4035-b28e-b610ec16d659 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:34.311659 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e06f85c0-34f6-4035-b28e-b610ec16d659 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1214 microversion: 2.1 time: 0.290895 Aug 27 05:22:34.312951 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2693/5388] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:34 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1214 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:34.566864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-23033219-e422-4365-847b-894cb36b3aca req-7c467e9e-243d-4f8b-b1bb-fdad5d72d92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abb808f-5833-4af2-ae6b-577b3e60b285", "name": "network-vif-plugged", "status": "completed", "tag": "c21e77ce-5581-44cf-a085-9b6e6e7c151c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:34.594950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-23033219-e422-4365-847b-894cb36b3aca req-7c467e9e-243d-4f8b-b1bb-fdad5d72d92a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:34.595468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-23033219-e422-4365-847b-894cb36b3aca req-7c467e9e-243d-4f8b-b1bb-fdad5d72d92a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:34.595896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-23033219-e422-4365-847b-894cb36b3aca req-7c467e9e-243d-4f8b-b1bb-fdad5d72d92a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:34.664482 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-23033219-e422-4365-847b-894cb36b3aca req-7c467e9e-243d-4f8b-b1bb-fdad5d72d92a service nova] Creating event network-vif-plugged:c21e77ce-5581-44cf-a085-9b6e6e7c151c for instance 2abb808f-5833-4af2-ae6b-577b3e60b285 on n-h1-820368-35 Aug 27 05:22:34.708306 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-23033219-e422-4365-847b-894cb36b3aca req-7c467e9e-243d-4f8b-b1bb-fdad5d72d92a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143080 Aug 27 05:22:34.710224 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2696/5389] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:22:35.296113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0637d05a-b81a-4bab-b7ad-c57df5fd499b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:35.296392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0637d05a-b81a-4bab-b7ad-c57df5fd499b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:35.311281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0637d05a-b81a-4bab-b7ad-c57df5fd499b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:35.311865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0637d05a-b81a-4bab-b7ad-c57df5fd499b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:35.317000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0637d05a-b81a-4bab-b7ad-c57df5fd499b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:35.317632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0637d05a-b81a-4bab-b7ad-c57df5fd499b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:35.321062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0637d05a-b81a-4bab-b7ad-c57df5fd499b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:35.323682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0637d05a-b81a-4bab-b7ad-c57df5fd499b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:35.337805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6f1537bb-bfef-43f7-be2f-e208cabc6d64 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:35.339130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6f1537bb-bfef-43f7-be2f-e208cabc6d64 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:35.358172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f1537bb-bfef-43f7-be2f-e208cabc6d64 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:35.365141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f1537bb-bfef-43f7-be2f-e208cabc6d64 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:35.367021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f1537bb-bfef-43f7-be2f-e208cabc6d64 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:35.370978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f1537bb-bfef-43f7-be2f-e208cabc6d64 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:35.372911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f1537bb-bfef-43f7-be2f-e208cabc6d64 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:35.373523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f1537bb-bfef-43f7-be2f-e208cabc6d64 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:35.582451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6f1537bb-bfef-43f7-be2f-e208cabc6d64 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:35.617261 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6f1537bb-bfef-43f7-be2f-e208cabc6d64 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1266 microversion: 2.1 time: 0.285259 Aug 27 05:22:35.617886 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2697/5390] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:35 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:35.731468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0637d05a-b81a-4bab-b7ad-c57df5fd499b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:35.741769 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0637d05a-b81a-4bab-b7ad-c57df5fd499b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.451282 Aug 27 05:22:35.744483 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2694/5391] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:35 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:36.646021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d2a7244a-3f40-4906-b6a5-d23e2c418b0c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:36.648406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d2a7244a-3f40-4906-b6a5-d23e2c418b0c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:36.686684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2a7244a-3f40-4906-b6a5-d23e2c418b0c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:36.687701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2a7244a-3f40-4906-b6a5-d23e2c418b0c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:36.699873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2a7244a-3f40-4906-b6a5-d23e2c418b0c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:36.705162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2a7244a-3f40-4906-b6a5-d23e2c418b0c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:36.706537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2a7244a-3f40-4906-b6a5-d23e2c418b0c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:36.708751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2a7244a-3f40-4906-b6a5-d23e2c418b0c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:36.773213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e04d02a2-6d9e-4bc1-ac12-2137fa77fab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:36.775081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e04d02a2-6d9e-4bc1-ac12-2137fa77fab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:36.831891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:36.835133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e04d02a2-6d9e-4bc1-ac12-2137fa77fab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:36.835933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e04d02a2-6d9e-4bc1-ac12-2137fa77fab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:36.836644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e04d02a2-6d9e-4bc1-ac12-2137fa77fab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:36.856364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e04d02a2-6d9e-4bc1-ac12-2137fa77fab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:36.857087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e04d02a2-6d9e-4bc1-ac12-2137fa77fab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:36.857999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e04d02a2-6d9e-4bc1-ac12-2137fa77fab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:37.511236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d2a7244a-3f40-4906-b6a5-d23e2c418b0c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:37.530842 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d2a7244a-3f40-4906-b6a5-d23e2c418b0c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1272 microversion: 2.1 time: 0.894497 Aug 27 05:22:37.534943 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2698/5392] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:36 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1272 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:37.897780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e04d02a2-6d9e-4bc1-ac12-2137fa77fab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:37.923988 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e04d02a2-6d9e-4bc1-ac12-2137fa77fab8 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 1.146316 Aug 27 05:22:37.927559 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2695/5393] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:36 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:38.563600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-213223fe-f8dd-41d2-a9ea-2a2d32ad3fd7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:38.564217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-213223fe-f8dd-41d2-a9ea-2a2d32ad3fd7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:38.583939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:38.599961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213223fe-f8dd-41d2-a9ea-2a2d32ad3fd7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:38.601865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213223fe-f8dd-41d2-a9ea-2a2d32ad3fd7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:38.606922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213223fe-f8dd-41d2-a9ea-2a2d32ad3fd7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:38.616179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213223fe-f8dd-41d2-a9ea-2a2d32ad3fd7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:38.617798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213223fe-f8dd-41d2-a9ea-2a2d32ad3fd7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:38.618842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-213223fe-f8dd-41d2-a9ea-2a2d32ad3fd7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:38.960731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bdb53665-00a0-4c31-bd0c-5092eb4ab497 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:38.961709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bdb53665-00a0-4c31-bd0c-5092eb4ab497 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:38.980227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdb53665-00a0-4c31-bd0c-5092eb4ab497 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:38.980753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdb53665-00a0-4c31-bd0c-5092eb4ab497 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:38.981209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdb53665-00a0-4c31-bd0c-5092eb4ab497 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:38.986097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdb53665-00a0-4c31-bd0c-5092eb4ab497 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:38.986595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdb53665-00a0-4c31-bd0c-5092eb4ab497 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:38.987040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bdb53665-00a0-4c31-bd0c-5092eb4ab497 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:39.751556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-213223fe-f8dd-41d2-a9ea-2a2d32ad3fd7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:39.773241 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-213223fe-f8dd-41d2-a9ea-2a2d32ad3fd7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1314 microversion: 2.1 time: 1.206960 Aug 27 05:22:39.777142 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2699/5394] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:38 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1314 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:40.075845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bdb53665-00a0-4c31-bd0c-5092eb4ab497 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:40.089682 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bdb53665-00a0-4c31-bd0c-5092eb4ab497 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 1.129566 Aug 27 05:22:40.107313 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2696/5395] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:38 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:40.803464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f20c182d-4214-407d-8334-e1226c699f8d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:40.804839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f20c182d-4214-407d-8334-e1226c699f8d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:40.829493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f20c182d-4214-407d-8334-e1226c699f8d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:40.836547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f20c182d-4214-407d-8334-e1226c699f8d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:40.837594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f20c182d-4214-407d-8334-e1226c699f8d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:40.838664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f20c182d-4214-407d-8334-e1226c699f8d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:40.839379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f20c182d-4214-407d-8334-e1226c699f8d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:40.843153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f20c182d-4214-407d-8334-e1226c699f8d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:41.121834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3215d444-fb96-4c5a-93b7-f16c28a47810 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:41.123223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3215d444-fb96-4c5a-93b7-f16c28a47810 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:41.156078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3215d444-fb96-4c5a-93b7-f16c28a47810 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:41.157133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3215d444-fb96-4c5a-93b7-f16c28a47810 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:41.157826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3215d444-fb96-4c5a-93b7-f16c28a47810 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:41.158815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3215d444-fb96-4c5a-93b7-f16c28a47810 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:41.159524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3215d444-fb96-4c5a-93b7-f16c28a47810 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:41.160198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3215d444-fb96-4c5a-93b7-f16c28a47810 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:41.617135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f20c182d-4214-407d-8334-e1226c699f8d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:41.634113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:41.641257 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f20c182d-4214-407d-8334-e1226c699f8d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1314 microversion: 2.1 time: 0.842203 Aug 27 05:22:41.645198 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2700/5396] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:40 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1314 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:41.780915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3215d444-fb96-4c5a-93b7-f16c28a47810 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:41.810407 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3215d444-fb96-4c5a-93b7-f16c28a47810 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.695229 Aug 27 05:22:41.811406 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2697/5397] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:41 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:41.998256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-39d9dee9-4446-4e13-9d39-3cc74f5ee108 req-7c376a70-3bf5-42d3-9346-5bdd8fba3192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "721805e0-68e3-41ab-9404-d4646c45a7a6", "tag": "1c4dc8f7-81e9-4068-916f-9e9bdf9ae238"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:42.035032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-39d9dee9-4446-4e13-9d39-3cc74f5ee108 req-7c376a70-3bf5-42d3-9346-5bdd8fba3192 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:42.035746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-39d9dee9-4446-4e13-9d39-3cc74f5ee108 req-7c376a70-3bf5-42d3-9346-5bdd8fba3192 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:42.036198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-39d9dee9-4446-4e13-9d39-3cc74f5ee108 req-7c376a70-3bf5-42d3-9346-5bdd8fba3192 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:42.072003 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-39d9dee9-4446-4e13-9d39-3cc74f5ee108 req-7c376a70-3bf5-42d3-9346-5bdd8fba3192 service nova] Creating event network-changed:1c4dc8f7-81e9-4068-916f-9e9bdf9ae238 for instance 721805e0-68e3-41ab-9404-d4646c45a7a6 on n-h1-820368-35 Aug 27 05:22:42.090261 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-39d9dee9-4446-4e13-9d39-3cc74f5ee108 req-7c376a70-3bf5-42d3-9346-5bdd8fba3192 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099170 Aug 27 05:22:42.091551 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2701/5398] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:22:42.667416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-34f04256-654d-488c-910a-ef3014bcf7a0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:42.668064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-34f04256-654d-488c-910a-ef3014bcf7a0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:42.691174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34f04256-654d-488c-910a-ef3014bcf7a0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:42.691174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34f04256-654d-488c-910a-ef3014bcf7a0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:42.694116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34f04256-654d-488c-910a-ef3014bcf7a0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:42.695012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34f04256-654d-488c-910a-ef3014bcf7a0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:42.695605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34f04256-654d-488c-910a-ef3014bcf7a0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:42.696234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34f04256-654d-488c-910a-ef3014bcf7a0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:42.838696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2fa5625c-fdf9-4be4-917f-8af65c22a22d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:42.839628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2fa5625c-fdf9-4be4-917f-8af65c22a22d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:42.849351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fa5625c-fdf9-4be4-917f-8af65c22a22d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:42.852957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fa5625c-fdf9-4be4-917f-8af65c22a22d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:42.853619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fa5625c-fdf9-4be4-917f-8af65c22a22d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:42.857003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fa5625c-fdf9-4be4-917f-8af65c22a22d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:42.861079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fa5625c-fdf9-4be4-917f-8af65c22a22d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:42.862089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fa5625c-fdf9-4be4-917f-8af65c22a22d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:43.000995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:43.161883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-34f04256-654d-488c-910a-ef3014bcf7a0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:43.182618 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-34f04256-654d-488c-910a-ef3014bcf7a0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1314 microversion: 2.1 time: 0.516169 Aug 27 05:22:43.199818 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2698/5399] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:42 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:43.450970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2fa5625c-fdf9-4be4-917f-8af65c22a22d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:43.470086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:43.474701 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2fa5625c-fdf9-4be4-917f-8af65c22a22d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.640266 Aug 27 05:22:43.497744 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2702/5400] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:42 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:44.212183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-31097f57-4ebf-48d4-8827-f1cb4e8cb453 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:44.217848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-31097f57-4ebf-48d4-8827-f1cb4e8cb453 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:44.246187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31097f57-4ebf-48d4-8827-f1cb4e8cb453 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:44.248098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31097f57-4ebf-48d4-8827-f1cb4e8cb453 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:44.248760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31097f57-4ebf-48d4-8827-f1cb4e8cb453 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:44.249562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31097f57-4ebf-48d4-8827-f1cb4e8cb453 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:44.250654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31097f57-4ebf-48d4-8827-f1cb4e8cb453 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:44.251137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31097f57-4ebf-48d4-8827-f1cb4e8cb453 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:44.308251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:44.512074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e357a6b8-6cd8-47a9-bf0e-81e50d938d8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:44.513961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e357a6b8-6cd8-47a9-bf0e-81e50d938d8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:44.517748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-31097f57-4ebf-48d4-8827-f1cb4e8cb453 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:44.527865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e357a6b8-6cd8-47a9-bf0e-81e50d938d8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:44.528057 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-31097f57-4ebf-48d4-8827-f1cb4e8cb453 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1314 microversion: 2.1 time: 0.324787 Aug 27 05:22:44.528559 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2699/5401] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:44 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:44.529394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e357a6b8-6cd8-47a9-bf0e-81e50d938d8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:44.530208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e357a6b8-6cd8-47a9-bf0e-81e50d938d8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:44.531807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e357a6b8-6cd8-47a9-bf0e-81e50d938d8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:44.532536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e357a6b8-6cd8-47a9-bf0e-81e50d938d8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:44.533202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e357a6b8-6cd8-47a9-bf0e-81e50d938d8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:44.761562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e357a6b8-6cd8-47a9-bf0e-81e50d938d8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:44.776614 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e357a6b8-6cd8-47a9-bf0e-81e50d938d8c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.272169 Aug 27 05:22:44.790870 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2703/5402] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:44 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:45.570963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-655e03d8-2eaa-41ff-8880-55b89773a01c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:45.576009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-655e03d8-2eaa-41ff-8880-55b89773a01c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:45.610577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-655e03d8-2eaa-41ff-8880-55b89773a01c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:45.617936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-655e03d8-2eaa-41ff-8880-55b89773a01c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:45.619809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-655e03d8-2eaa-41ff-8880-55b89773a01c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:45.636553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-655e03d8-2eaa-41ff-8880-55b89773a01c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:45.640623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-655e03d8-2eaa-41ff-8880-55b89773a01c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:45.641974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-655e03d8-2eaa-41ff-8880-55b89773a01c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:45.803265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-90d583e8-3d9f-4aa7-bc42-d9f8ac9c5e03 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:45.804068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-90d583e8-3d9f-4aa7-bc42-d9f8ac9c5e03 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:45.819545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90d583e8-3d9f-4aa7-bc42-d9f8ac9c5e03 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:45.820857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90d583e8-3d9f-4aa7-bc42-d9f8ac9c5e03 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:45.822050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90d583e8-3d9f-4aa7-bc42-d9f8ac9c5e03 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:45.823649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90d583e8-3d9f-4aa7-bc42-d9f8ac9c5e03 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:45.824715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90d583e8-3d9f-4aa7-bc42-d9f8ac9c5e03 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:45.825710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90d583e8-3d9f-4aa7-bc42-d9f8ac9c5e03 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:45.934180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-655e03d8-2eaa-41ff-8880-55b89773a01c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:45.942969 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-655e03d8-2eaa-41ff-8880-55b89773a01c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1314 microversion: 2.1 time: 0.381758 Aug 27 05:22:45.944302 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2700/5403] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:45 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:46.147738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-90d583e8-3d9f-4aa7-bc42-d9f8ac9c5e03 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:46.203573 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-90d583e8-3d9f-4aa7-bc42-d9f8ac9c5e03 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.399033 Aug 27 05:22:46.218050 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2704/5404] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:45 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:46.985184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3736aa7e-11e3-441b-a348-6c13953d6840 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:46.986566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3736aa7e-11e3-441b-a348-6c13953d6840 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:47.004007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3736aa7e-11e3-441b-a348-6c13953d6840 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:47.004796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3736aa7e-11e3-441b-a348-6c13953d6840 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:47.005607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3736aa7e-11e3-441b-a348-6c13953d6840 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:47.012510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3736aa7e-11e3-441b-a348-6c13953d6840 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:47.013282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3736aa7e-11e3-441b-a348-6c13953d6840 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:47.014382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3736aa7e-11e3-441b-a348-6c13953d6840 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:47.231649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2aa07e71-ba3a-4280-99ba-982c96a389b0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:47.233800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2aa07e71-ba3a-4280-99ba-982c96a389b0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:47.246744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aa07e71-ba3a-4280-99ba-982c96a389b0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:47.249089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aa07e71-ba3a-4280-99ba-982c96a389b0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:47.251302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aa07e71-ba3a-4280-99ba-982c96a389b0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:47.253195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aa07e71-ba3a-4280-99ba-982c96a389b0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:47.254092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aa07e71-ba3a-4280-99ba-982c96a389b0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:47.254760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aa07e71-ba3a-4280-99ba-982c96a389b0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:47.824512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3736aa7e-11e3-441b-a348-6c13953d6840 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:47.844179 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3736aa7e-11e3-441b-a348-6c13953d6840 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1314 microversion: 2.1 time: 0.866257 Aug 27 05:22:47.854387 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2701/5405] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:46 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:48.068313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2aa07e71-ba3a-4280-99ba-982c96a389b0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:48.097831 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2aa07e71-ba3a-4280-99ba-982c96a389b0 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.871936 Aug 27 05:22:48.098917 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2705/5406] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:47 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:48.891947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-321ae23f-75d7-486f-9145-721360b3cc69 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:48.915354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-321ae23f-75d7-486f-9145-721360b3cc69 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:48.915354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-321ae23f-75d7-486f-9145-721360b3cc69 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:48.915354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-321ae23f-75d7-486f-9145-721360b3cc69 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:48.915354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-321ae23f-75d7-486f-9145-721360b3cc69 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:48.915354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-321ae23f-75d7-486f-9145-721360b3cc69 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:48.915354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-321ae23f-75d7-486f-9145-721360b3cc69 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:48.918437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-321ae23f-75d7-486f-9145-721360b3cc69 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:49.140246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c3d5a35b-1722-4f19-bb36-229ccbb4efdd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:49.141064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c3d5a35b-1722-4f19-bb36-229ccbb4efdd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:49.159068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3d5a35b-1722-4f19-bb36-229ccbb4efdd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:49.160085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3d5a35b-1722-4f19-bb36-229ccbb4efdd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:49.162424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3d5a35b-1722-4f19-bb36-229ccbb4efdd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:49.165170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3d5a35b-1722-4f19-bb36-229ccbb4efdd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:49.168566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3d5a35b-1722-4f19-bb36-229ccbb4efdd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:49.169611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3d5a35b-1722-4f19-bb36-229ccbb4efdd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:49.569498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-321ae23f-75d7-486f-9145-721360b3cc69 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:49.585602 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-321ae23f-75d7-486f-9145-721360b3cc69 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1314 microversion: 2.1 time: 0.698167 Aug 27 05:22:49.590344 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2702/5407] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:48 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:49.713587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c3d5a35b-1722-4f19-bb36-229ccbb4efdd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:49.725233 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c3d5a35b-1722-4f19-bb36-229ccbb4efdd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.591254 Aug 27 05:22:49.728030 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2706/5408] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:49 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:50.627754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6b590a8e-cec0-42b9-8068-22e3f6131c58 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:50.629070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6b590a8e-cec0-42b9-8068-22e3f6131c58 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:50.653432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b590a8e-cec0-42b9-8068-22e3f6131c58 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:50.654343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b590a8e-cec0-42b9-8068-22e3f6131c58 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:50.656456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b590a8e-cec0-42b9-8068-22e3f6131c58 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:50.657626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b590a8e-cec0-42b9-8068-22e3f6131c58 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:50.659236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b590a8e-cec0-42b9-8068-22e3f6131c58 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:50.661956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6b590a8e-cec0-42b9-8068-22e3f6131c58 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:50.775261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3db84a01-c2a0-44fe-aaed-06c0fddf75d6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:50.776408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3db84a01-c2a0-44fe-aaed-06c0fddf75d6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:50.821292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db84a01-c2a0-44fe-aaed-06c0fddf75d6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:50.835292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db84a01-c2a0-44fe-aaed-06c0fddf75d6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:50.836490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db84a01-c2a0-44fe-aaed-06c0fddf75d6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:50.844618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db84a01-c2a0-44fe-aaed-06c0fddf75d6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:50.867111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db84a01-c2a0-44fe-aaed-06c0fddf75d6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:50.873518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3db84a01-c2a0-44fe-aaed-06c0fddf75d6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:51.094829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6b590a8e-cec0-42b9-8068-22e3f6131c58 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:51.146694 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6b590a8e-cec0-42b9-8068-22e3f6131c58 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1314 microversion: 2.1 time: 0.516504 Aug 27 05:22:51.155641 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2703/5409] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:50 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:51.475802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3db84a01-c2a0-44fe-aaed-06c0fddf75d6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:51.509339 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3db84a01-c2a0-44fe-aaed-06c0fddf75d6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.741245 Aug 27 05:22:51.510787 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2707/5410] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:50 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:52.198048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8fa37067-52f2-44a2-8418-26d15a8b2148 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:52.199370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8fa37067-52f2-44a2-8418-26d15a8b2148 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:52.228666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa37067-52f2-44a2-8418-26d15a8b2148 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:52.235735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa37067-52f2-44a2-8418-26d15a8b2148 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:52.236338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa37067-52f2-44a2-8418-26d15a8b2148 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:52.237138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa37067-52f2-44a2-8418-26d15a8b2148 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:52.237630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa37067-52f2-44a2-8418-26d15a8b2148 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:52.238076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fa37067-52f2-44a2-8418-26d15a8b2148 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:52.569427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-08565ce6-7eb1-44d3-acb4-4020457ba7a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:52.570975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-08565ce6-7eb1-44d3-acb4-4020457ba7a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:52.619584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08565ce6-7eb1-44d3-acb4-4020457ba7a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:52.621788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08565ce6-7eb1-44d3-acb4-4020457ba7a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:52.624572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08565ce6-7eb1-44d3-acb4-4020457ba7a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:52.627488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08565ce6-7eb1-44d3-acb4-4020457ba7a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:52.634790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08565ce6-7eb1-44d3-acb4-4020457ba7a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:52.638022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-08565ce6-7eb1-44d3-acb4-4020457ba7a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:52.807403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8fa37067-52f2-44a2-8418-26d15a8b2148 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:52.838535 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8fa37067-52f2-44a2-8418-26d15a8b2148 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1314 microversion: 2.1 time: 0.631924 Aug 27 05:22:52.842604 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2704/5411] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:52 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:53.477418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-08565ce6-7eb1-44d3-acb4-4020457ba7a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:53.487653 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-08565ce6-7eb1-44d3-acb4-4020457ba7a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.957397 Aug 27 05:22:53.488529 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2708/5412] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:52 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:53.869940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-95e22f5c-f43b-45e6-9ac9-0200959f2789 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:53.870606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-95e22f5c-f43b-45e6-9ac9-0200959f2789 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:53.886430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95e22f5c-f43b-45e6-9ac9-0200959f2789 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:53.886931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95e22f5c-f43b-45e6-9ac9-0200959f2789 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:53.887402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95e22f5c-f43b-45e6-9ac9-0200959f2789 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:53.889254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95e22f5c-f43b-45e6-9ac9-0200959f2789 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:53.889713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95e22f5c-f43b-45e6-9ac9-0200959f2789 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:53.890685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95e22f5c-f43b-45e6-9ac9-0200959f2789 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:54.071613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-3b76c987-f119-42aa-bbce-a1e03d4a1ea3 req-2e6197fc-b6cf-416f-bc28-66b89c0d5fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721805e0-68e3-41ab-9404-d4646c45a7a6", "name": "network-vif-plugged", "status": "completed", "tag": "1c4dc8f7-81e9-4068-916f-9e9bdf9ae238"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:54.096349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3b76c987-f119-42aa-bbce-a1e03d4a1ea3 req-2e6197fc-b6cf-416f-bc28-66b89c0d5fa7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:54.096867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3b76c987-f119-42aa-bbce-a1e03d4a1ea3 req-2e6197fc-b6cf-416f-bc28-66b89c0d5fa7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:54.097314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3b76c987-f119-42aa-bbce-a1e03d4a1ea3 req-2e6197fc-b6cf-416f-bc28-66b89c0d5fa7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:54.160836 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-3b76c987-f119-42aa-bbce-a1e03d4a1ea3 req-2e6197fc-b6cf-416f-bc28-66b89c0d5fa7 service nova] Creating event network-vif-plugged:1c4dc8f7-81e9-4068-916f-9e9bdf9ae238 for instance 721805e0-68e3-41ab-9404-d4646c45a7a6 on n-h1-820368-35 Aug 27 05:22:54.178370 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-3b76c987-f119-42aa-bbce-a1e03d4a1ea3 req-2e6197fc-b6cf-416f-bc28-66b89c0d5fa7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.230605 Aug 27 05:22:54.183131 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2705/5413] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:22:54.537422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc813ced-107e-4bdc-9494-46f9f1432889 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:54.545267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dc813ced-107e-4bdc-9494-46f9f1432889 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:54.564306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc813ced-107e-4bdc-9494-46f9f1432889 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:54.565526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc813ced-107e-4bdc-9494-46f9f1432889 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:54.566512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc813ced-107e-4bdc-9494-46f9f1432889 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:54.568003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc813ced-107e-4bdc-9494-46f9f1432889 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:54.569252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc813ced-107e-4bdc-9494-46f9f1432889 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:54.570685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc813ced-107e-4bdc-9494-46f9f1432889 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:55.046811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-95e22f5c-f43b-45e6-9ac9-0200959f2789 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:55.063359 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-95e22f5c-f43b-45e6-9ac9-0200959f2789 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1314 microversion: 2.1 time: 1.198479 Aug 27 05:22:55.074857 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2709/5414] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:53 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1314 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:55.370085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dc813ced-107e-4bdc-9494-46f9f1432889 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:55.384417 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dc813ced-107e-4bdc-9494-46f9f1432889 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.857244 Aug 27 05:22:55.388893 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2706/5415] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:54 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:56.099724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1722ece-5923-407e-b2a5-ac078667e3e0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:56.101675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1722ece-5923-407e-b2a5-ac078667e3e0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:56.129258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1722ece-5923-407e-b2a5-ac078667e3e0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:56.136561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1722ece-5923-407e-b2a5-ac078667e3e0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:56.138180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1722ece-5923-407e-b2a5-ac078667e3e0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:56.141382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1722ece-5923-407e-b2a5-ac078667e3e0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:56.143530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1722ece-5923-407e-b2a5-ac078667e3e0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:56.146856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1722ece-5923-407e-b2a5-ac078667e3e0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:56.414573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3bc2b2ef-3aff-4e63-ae24-64dfdbefe6fd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:56.415362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3bc2b2ef-3aff-4e63-ae24-64dfdbefe6fd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:56.445330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc2b2ef-3aff-4e63-ae24-64dfdbefe6fd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:56.448223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc2b2ef-3aff-4e63-ae24-64dfdbefe6fd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:56.448726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc2b2ef-3aff-4e63-ae24-64dfdbefe6fd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:56.452966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc2b2ef-3aff-4e63-ae24-64dfdbefe6fd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:56.453478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc2b2ef-3aff-4e63-ae24-64dfdbefe6fd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:56.457414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3bc2b2ef-3aff-4e63-ae24-64dfdbefe6fd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:57.497598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1722ece-5923-407e-b2a5-ac078667e3e0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:57.524354 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1722ece-5923-407e-b2a5-ac078667e3e0 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1314 microversion: 2.1 time: 1.428599 Aug 27 05:22:57.527361 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2710/5416] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:56 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1314 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:57.616788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3bc2b2ef-3aff-4e63-ae24-64dfdbefe6fd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:57.629958 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3bc2b2ef-3aff-4e63-ae24-64dfdbefe6fd tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 1.223811 Aug 27 05:22:57.631021 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2707/5417] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:56 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:58.553418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5a2e2070-b4ab-4860-8056-b508e6f04b0d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:58.554881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5a2e2070-b4ab-4860-8056-b508e6f04b0d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:58.573513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2e2070-b4ab-4860-8056-b508e6f04b0d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:58.577411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2e2070-b4ab-4860-8056-b508e6f04b0d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:58.580930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2e2070-b4ab-4860-8056-b508e6f04b0d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:58.584005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2e2070-b4ab-4860-8056-b508e6f04b0d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:58.594116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2e2070-b4ab-4860-8056-b508e6f04b0d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:58.594955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a2e2070-b4ab-4860-8056-b508e6f04b0d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:58.656677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a5045fa5-cf8e-41f0-8669-27ddcfb9e751 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:58.658131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a5045fa5-cf8e-41f0-8669-27ddcfb9e751 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:58.674389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5045fa5-cf8e-41f0-8669-27ddcfb9e751 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:58.682869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5045fa5-cf8e-41f0-8669-27ddcfb9e751 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:58.686191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5045fa5-cf8e-41f0-8669-27ddcfb9e751 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:58.690311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5045fa5-cf8e-41f0-8669-27ddcfb9e751 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:58.706606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5045fa5-cf8e-41f0-8669-27ddcfb9e751 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:58.709227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5045fa5-cf8e-41f0-8669-27ddcfb9e751 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:58.832602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:22:59.224660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5a2e2070-b4ab-4860-8056-b508e6f04b0d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:59.266061 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5a2e2070-b4ab-4860-8056-b508e6f04b0d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1500 microversion: 2.1 time: 0.718397 Aug 27 05:22:59.269798 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2711/5418] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:58 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1500 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:22:59.295209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-70481440-68b0-4c2f-842d-7de051bd0977 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:22:59.298819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-70481440-68b0-4c2f-842d-7de051bd0977 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:59.318636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70481440-68b0-4c2f-842d-7de051bd0977 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:59.319375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70481440-68b0-4c2f-842d-7de051bd0977 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:59.319849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70481440-68b0-4c2f-842d-7de051bd0977 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:59.320615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70481440-68b0-4c2f-842d-7de051bd0977 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:59.321108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70481440-68b0-4c2f-842d-7de051bd0977 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:59.321527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70481440-68b0-4c2f-842d-7de051bd0977 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:59.366140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-70481440-68b0-4c2f-842d-7de051bd0977 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lazy-loading 'flavor' on Instance uuid 721805e0-68e3-41ab-9404-d4646c45a7a6 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:22:59.588394 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-70481440-68b0-4c2f-842d-7de051bd0977 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "POST /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6/action" status: 200 len: 32 microversion: 2.1 time: 0.296204 Aug 27 05:22:59.591193 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2712/5419] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:22:59 2022] POST /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6/action => generated 32 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:22:59.636640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a5045fa5-cf8e-41f0-8669-27ddcfb9e751 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:22:59.649032 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a5045fa5-cf8e-41f0-8669-27ddcfb9e751 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.997403 Aug 27 05:22:59.651113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3526a3a8-183f-4cc9-9722-0d1f46d5d286 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:22:59.653592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3526a3a8-183f-4cc9-9722-0d1f46d5d286 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:22:59.654991 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2708/5420] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:58 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:22:59.686099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3526a3a8-183f-4cc9-9722-0d1f46d5d286 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:59.687419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3526a3a8-183f-4cc9-9722-0d1f46d5d286 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:59.689108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3526a3a8-183f-4cc9-9722-0d1f46d5d286 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:22:59.690031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3526a3a8-183f-4cc9-9722-0d1f46d5d286 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:22:59.691026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3526a3a8-183f-4cc9-9722-0d1f46d5d286 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:22:59.691845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3526a3a8-183f-4cc9-9722-0d1f46d5d286 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:00.684568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6911c39b-275e-41db-a455-28da9cececea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:00.687526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6911c39b-275e-41db-a455-28da9cececea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:00.742021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6911c39b-275e-41db-a455-28da9cececea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:00.749123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6911c39b-275e-41db-a455-28da9cececea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:00.752249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6911c39b-275e-41db-a455-28da9cececea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:00.761451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6911c39b-275e-41db-a455-28da9cececea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:00.765847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6911c39b-275e-41db-a455-28da9cececea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:00.770361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6911c39b-275e-41db-a455-28da9cececea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:01.261282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3526a3a8-183f-4cc9-9722-0d1f46d5d286 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:01.285813 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3526a3a8-183f-4cc9-9722-0d1f46d5d286 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 1.682971 Aug 27 05:23:01.289250 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2713/5421] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:22:59 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:01.873748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6911c39b-275e-41db-a455-28da9cececea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:01.891891 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6911c39b-275e-41db-a455-28da9cececea tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 1.214973 Aug 27 05:23:01.892539 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2709/5422] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:00 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:02.341908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9f1bfcd1-9709-4486-87e8-eb2234a8426f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:02.346392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9f1bfcd1-9709-4486-87e8-eb2234a8426f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:02.388924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f1bfcd1-9709-4486-87e8-eb2234a8426f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:02.391358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f1bfcd1-9709-4486-87e8-eb2234a8426f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:02.393289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f1bfcd1-9709-4486-87e8-eb2234a8426f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:02.394984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f1bfcd1-9709-4486-87e8-eb2234a8426f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:02.396197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f1bfcd1-9709-4486-87e8-eb2234a8426f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:02.398922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f1bfcd1-9709-4486-87e8-eb2234a8426f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:02.817890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9f1bfcd1-9709-4486-87e8-eb2234a8426f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:02.830462 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9f1bfcd1-9709-4486-87e8-eb2234a8426f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.499363 Aug 27 05:23:02.851814 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2714/5423] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:02 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:02.931777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-21648682-7125-43c0-8f51-a10756ad3226 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:02.932811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-21648682-7125-43c0-8f51-a10756ad3226 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:02.964298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21648682-7125-43c0-8f51-a10756ad3226 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:02.965245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21648682-7125-43c0-8f51-a10756ad3226 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:02.966064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21648682-7125-43c0-8f51-a10756ad3226 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:02.967209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21648682-7125-43c0-8f51-a10756ad3226 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:02.967802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21648682-7125-43c0-8f51-a10756ad3226 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:02.968173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-21648682-7125-43c0-8f51-a10756ad3226 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:03.330322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-21648682-7125-43c0-8f51-a10756ad3226 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:03.347599 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-21648682-7125-43c0-8f51-a10756ad3226 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.423279 Aug 27 05:23:03.349581 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2710/5424] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:02 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:03.861349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e10b0a9-77e8-49c1-b120-fb4fc7528321 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:03.861970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e10b0a9-77e8-49c1-b120-fb4fc7528321 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:03.873680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e10b0a9-77e8-49c1-b120-fb4fc7528321 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:03.874704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e10b0a9-77e8-49c1-b120-fb4fc7528321 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:03.875179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e10b0a9-77e8-49c1-b120-fb4fc7528321 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:03.881913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e10b0a9-77e8-49c1-b120-fb4fc7528321 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:03.883512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e10b0a9-77e8-49c1-b120-fb4fc7528321 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:03.884143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e10b0a9-77e8-49c1-b120-fb4fc7528321 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:04.219284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e10b0a9-77e8-49c1-b120-fb4fc7528321 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:04.229854 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e10b0a9-77e8-49c1-b120-fb4fc7528321 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.372814 Aug 27 05:23:04.234567 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2715/5425] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:03 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:04.392107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-09d4111d-e44e-49e4-a346-5eb5967457ad tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:04.393011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-09d4111d-e44e-49e4-a346-5eb5967457ad tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:04.401812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09d4111d-e44e-49e4-a346-5eb5967457ad tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:04.402611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09d4111d-e44e-49e4-a346-5eb5967457ad tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:04.403296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09d4111d-e44e-49e4-a346-5eb5967457ad tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:04.404330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09d4111d-e44e-49e4-a346-5eb5967457ad tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:04.404955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09d4111d-e44e-49e4-a346-5eb5967457ad tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:04.406130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-09d4111d-e44e-49e4-a346-5eb5967457ad tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:04.756430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-09d4111d-e44e-49e4-a346-5eb5967457ad tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:04.766055 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-09d4111d-e44e-49e4-a346-5eb5967457ad tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1509 microversion: 2.1 time: 0.384815 Aug 27 05:23:04.767342 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2711/5426] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:04 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1509 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:05.256011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5506227f-f656-4e80-8684-132132fe36c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:05.256644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5506227f-f656-4e80-8684-132132fe36c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:05.269858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5506227f-f656-4e80-8684-132132fe36c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:05.270667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5506227f-f656-4e80-8684-132132fe36c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:05.271279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5506227f-f656-4e80-8684-132132fe36c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:05.272230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5506227f-f656-4e80-8684-132132fe36c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:05.272698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5506227f-f656-4e80-8684-132132fe36c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:05.273135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5506227f-f656-4e80-8684-132132fe36c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:05.565513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5506227f-f656-4e80-8684-132132fe36c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:05.578858 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5506227f-f656-4e80-8684-132132fe36c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.327533 Aug 27 05:23:05.580956 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2716/5427] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:05 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:05.797418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c970f321-e6cd-4c96-8dfe-86f917cc3124 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:05.798186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c970f321-e6cd-4c96-8dfe-86f917cc3124 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:05.829276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c970f321-e6cd-4c96-8dfe-86f917cc3124 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:05.829972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c970f321-e6cd-4c96-8dfe-86f917cc3124 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:05.830745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c970f321-e6cd-4c96-8dfe-86f917cc3124 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:05.832042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c970f321-e6cd-4c96-8dfe-86f917cc3124 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:05.832833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c970f321-e6cd-4c96-8dfe-86f917cc3124 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:05.833568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c970f321-e6cd-4c96-8dfe-86f917cc3124 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:06.440672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c970f321-e6cd-4c96-8dfe-86f917cc3124 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:06.455383 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c970f321-e6cd-4c96-8dfe-86f917cc3124 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1506 microversion: 2.1 time: 0.668344 Aug 27 05:23:06.472288 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2712/5428] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:05 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:06.601713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f4f74d9-000a-497a-9ce1-026b2da0723a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:06.602331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f4f74d9-000a-497a-9ce1-026b2da0723a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:06.610810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f4f74d9-000a-497a-9ce1-026b2da0723a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:06.611672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f4f74d9-000a-497a-9ce1-026b2da0723a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:06.612263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f4f74d9-000a-497a-9ce1-026b2da0723a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:06.613169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f4f74d9-000a-497a-9ce1-026b2da0723a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:06.613777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f4f74d9-000a-497a-9ce1-026b2da0723a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:06.614495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f4f74d9-000a-497a-9ce1-026b2da0723a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:06.637588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:07.063813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5f4f74d9-000a-497a-9ce1-026b2da0723a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:07.085282 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f4f74d9-000a-497a-9ce1-026b2da0723a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.487552 Aug 27 05:23:07.101468 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2717/5429] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:06 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:07.488202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f83934e7-04af-4280-8798-946a0c99f69d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:07.489270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f83934e7-04af-4280-8798-946a0c99f69d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:07.504457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=36 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:07.519402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83934e7-04af-4280-8798-946a0c99f69d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:07.521750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83934e7-04af-4280-8798-946a0c99f69d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:07.523548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83934e7-04af-4280-8798-946a0c99f69d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:07.524330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83934e7-04af-4280-8798-946a0c99f69d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:07.524816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83934e7-04af-4280-8798-946a0c99f69d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:07.525264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f83934e7-04af-4280-8798-946a0c99f69d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:08.121112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a5388803-1c7f-4d79-973d-3d8889423d01 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:08.122951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a5388803-1c7f-4d79-973d-3d8889423d01 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:08.130836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5388803-1c7f-4d79-973d-3d8889423d01 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:08.131387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5388803-1c7f-4d79-973d-3d8889423d01 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:08.132304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5388803-1c7f-4d79-973d-3d8889423d01 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:08.133326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5388803-1c7f-4d79-973d-3d8889423d01 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:08.133800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5388803-1c7f-4d79-973d-3d8889423d01 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:08.134457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5388803-1c7f-4d79-973d-3d8889423d01 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:08.237505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f83934e7-04af-4280-8798-946a0c99f69d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:08.247565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f83934e7-04af-4280-8798-946a0c99f69d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1506 microversion: 2.1 time: 0.770531 Aug 27 05:23:08.248532 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2713/5430] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:07 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1506 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:08.444527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a5388803-1c7f-4d79-973d-3d8889423d01 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:08.461897 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a5388803-1c7f-4d79-973d-3d8889423d01 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.345023 Aug 27 05:23:08.463801 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2718/5431] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:08 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:09.270854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a0f83269-59e2-4a13-aa58-625b2cac17f3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:09.272739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a0f83269-59e2-4a13-aa58-625b2cac17f3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:09.296317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0f83269-59e2-4a13-aa58-625b2cac17f3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:09.297798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0f83269-59e2-4a13-aa58-625b2cac17f3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:09.299569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0f83269-59e2-4a13-aa58-625b2cac17f3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:09.301606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0f83269-59e2-4a13-aa58-625b2cac17f3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:09.304332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0f83269-59e2-4a13-aa58-625b2cac17f3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:09.306116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0f83269-59e2-4a13-aa58-625b2cac17f3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:09.499992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-78804d77-7f87-4514-987a-1c86420f8d39 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:09.501217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-78804d77-7f87-4514-987a-1c86420f8d39 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:09.512499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=40 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:09.521539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78804d77-7f87-4514-987a-1c86420f8d39 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:09.522548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78804d77-7f87-4514-987a-1c86420f8d39 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:09.523415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78804d77-7f87-4514-987a-1c86420f8d39 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:09.534128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78804d77-7f87-4514-987a-1c86420f8d39 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:09.535306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78804d77-7f87-4514-987a-1c86420f8d39 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:09.536630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78804d77-7f87-4514-987a-1c86420f8d39 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:09.858639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a0f83269-59e2-4a13-aa58-625b2cac17f3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:09.877753 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a0f83269-59e2-4a13-aa58-625b2cac17f3 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1506 microversion: 2.1 time: 0.612905 Aug 27 05:23:09.878621 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2714/5432] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:09 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:09.951247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-78804d77-7f87-4514-987a-1c86420f8d39 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:09.965827 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-78804d77-7f87-4514-987a-1c86420f8d39 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.475014 Aug 27 05:23:09.982550 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2719/5433] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:09 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:10.138465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5a6fb18e-e09d-4c6b-9390-a9ead8f9ac65 req-e1c5b7a1-c889-4077-9b82-27b1312b6820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abb808f-5833-4af2-ae6b-577b3e60b285", "name": "network-vif-unplugged", "status": "completed", "tag": "c21e77ce-5581-44cf-a085-9b6e6e7c151c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:10.152849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5a6fb18e-e09d-4c6b-9390-a9ead8f9ac65 req-e1c5b7a1-c889-4077-9b82-27b1312b6820 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:10.153681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5a6fb18e-e09d-4c6b-9390-a9ead8f9ac65 req-e1c5b7a1-c889-4077-9b82-27b1312b6820 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:10.154663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5a6fb18e-e09d-4c6b-9390-a9ead8f9ac65 req-e1c5b7a1-c889-4077-9b82-27b1312b6820 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:10.193517 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-5a6fb18e-e09d-4c6b-9390-a9ead8f9ac65 req-e1c5b7a1-c889-4077-9b82-27b1312b6820 service nova] Creating event network-vif-unplugged:c21e77ce-5581-44cf-a085-9b6e6e7c151c for instance 2abb808f-5833-4af2-ae6b-577b3e60b285 on n-h1-820368-35 Aug 27 05:23:10.211583 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5a6fb18e-e09d-4c6b-9390-a9ead8f9ac65 req-e1c5b7a1-c889-4077-9b82-27b1312b6820 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078953 Aug 27 05:23:10.212666 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2715/5434] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:10.904242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ebaa170-61a8-4f52-a2e2-ff4cc4ea347d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:10.904980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4ebaa170-61a8-4f52-a2e2-ff4cc4ea347d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:10.923349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ebaa170-61a8-4f52-a2e2-ff4cc4ea347d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:10.924570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ebaa170-61a8-4f52-a2e2-ff4cc4ea347d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:10.925037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ebaa170-61a8-4f52-a2e2-ff4cc4ea347d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:10.932681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ebaa170-61a8-4f52-a2e2-ff4cc4ea347d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:10.936974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ebaa170-61a8-4f52-a2e2-ff4cc4ea347d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:10.937716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ebaa170-61a8-4f52-a2e2-ff4cc4ea347d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:10.995531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-95a25884-8043-4bee-aaa8-64def3f938c2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:10.998474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-95a25884-8043-4bee-aaa8-64def3f938c2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:11.028609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95a25884-8043-4bee-aaa8-64def3f938c2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:11.030020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95a25884-8043-4bee-aaa8-64def3f938c2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:11.031034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95a25884-8043-4bee-aaa8-64def3f938c2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:11.033012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95a25884-8043-4bee-aaa8-64def3f938c2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:11.035980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95a25884-8043-4bee-aaa8-64def3f938c2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:11.036924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95a25884-8043-4bee-aaa8-64def3f938c2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:11.545080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ebaa170-61a8-4f52-a2e2-ff4cc4ea347d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:11.602038 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ebaa170-61a8-4f52-a2e2-ff4cc4ea347d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 200 len: 1449 microversion: 2.1 time: 0.681112 Aug 27 05:23:11.610851 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2720/5435] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:10 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 1449 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:11.626916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aa6a668e-b8ea-412d-a1a1-d5a652b10b0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:11.627761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aa6a668e-b8ea-412d-a1a1-d5a652b10b0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:11.639706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa6a668e-b8ea-412d-a1a1-d5a652b10b0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:11.641165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa6a668e-b8ea-412d-a1a1-d5a652b10b0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:11.641966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa6a668e-b8ea-412d-a1a1-d5a652b10b0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:11.642706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa6a668e-b8ea-412d-a1a1-d5a652b10b0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:11.643253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa6a668e-b8ea-412d-a1a1-d5a652b10b0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:11.643692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa6a668e-b8ea-412d-a1a1-d5a652b10b0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:11.992936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-95a25884-8043-4bee-aaa8-64def3f938c2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:12.012898 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-95a25884-8043-4bee-aaa8-64def3f938c2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 1.024616 Aug 27 05:23:12.015564 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2716/5436] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:10 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:12.327508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aa6a668e-b8ea-412d-a1a1-d5a652b10b0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:12.349583 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aa6a668e-b8ea-412d-a1a1-d5a652b10b0e tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.727890 Aug 27 05:23:12.350872 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2721/5437] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:11 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:12.400070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4b4eee53-a14f-493e-80c4-ec46dd94fc1c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:12.405461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4b4eee53-a14f-493e-80c4-ec46dd94fc1c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:12.432382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4eee53-a14f-493e-80c4-ec46dd94fc1c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:12.434306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4eee53-a14f-493e-80c4-ec46dd94fc1c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:12.437355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4eee53-a14f-493e-80c4-ec46dd94fc1c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:12.439873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4eee53-a14f-493e-80c4-ec46dd94fc1c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:12.440741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4eee53-a14f-493e-80c4-ec46dd94fc1c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:12.441398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b4eee53-a14f-493e-80c4-ec46dd94fc1c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:12.581908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1210583918", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "9ebbdaa0-954b-4b02-8283-baa876b46b43"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:12.683487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] validate_networks() for [('9ebbdaa0-954b-4b02-8283-baa876b46b43', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:23:12.762401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4b4eee53-a14f-493e-80c4-ec46dd94fc1c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:12.775118 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4b4eee53-a14f-493e-80c4-ec46dd94fc1c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.383805 Aug 27 05:23:12.777058 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2722/5438] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:12 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:12.812422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3f94aebb-5020-4f27-a159-133e0f14364b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:12.813309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3f94aebb-5020-4f27-a159-133e0f14364b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:12.820629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f94aebb-5020-4f27-a159-133e0f14364b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:12.821492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f94aebb-5020-4f27-a159-133e0f14364b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:12.822170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f94aebb-5020-4f27-a159-133e0f14364b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:12.823124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f94aebb-5020-4f27-a159-133e0f14364b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:12.823779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f94aebb-5020-4f27-a159-133e0f14364b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:12.824399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f94aebb-5020-4f27-a159-133e0f14364b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:13.272825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f94aebb-5020-4f27-a159-133e0f14364b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:13.288380 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3f94aebb-5020-4f27-a159-133e0f14364b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.480859 Aug 27 05:23:13.289852 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2723/5439] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:12 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:13.308103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-231484ca-f9af-4c71-9f97-4ca8d9efd790 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:13.309164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-231484ca-f9af-4c71-9f97-4ca8d9efd790 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:13.318515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-231484ca-f9af-4c71-9f97-4ca8d9efd790 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:13.319378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-231484ca-f9af-4c71-9f97-4ca8d9efd790 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:13.320018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-231484ca-f9af-4c71-9f97-4ca8d9efd790 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:13.320968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-231484ca-f9af-4c71-9f97-4ca8d9efd790 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:13.321629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-231484ca-f9af-4c71-9f97-4ca8d9efd790 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:13.322428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-231484ca-f9af-4c71-9f97-4ca8d9efd790 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:13.655988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-231484ca-f9af-4c71-9f97-4ca8d9efd790 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:13.677713 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-231484ca-f9af-4c71-9f97-4ca8d9efd790 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.384875 Aug 27 05:23:13.692710 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2724/5440] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:13 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:13.692710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f0369c26-aa8c-4a5d-8a4c-5f821add61e2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:13.692710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f0369c26-aa8c-4a5d-8a4c-5f821add61e2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:13.695529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0369c26-aa8c-4a5d-8a4c-5f821add61e2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:13.696262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0369c26-aa8c-4a5d-8a4c-5f821add61e2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:13.696905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0369c26-aa8c-4a5d-8a4c-5f821add61e2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:13.697838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0369c26-aa8c-4a5d-8a4c-5f821add61e2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:13.698489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0369c26-aa8c-4a5d-8a4c-5f821add61e2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:13.699152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0369c26-aa8c-4a5d-8a4c-5f821add61e2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:13.734691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:23:13.735448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:23:13.736747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:23:13.737174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:23:13.737824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:23:13.749195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:13.749717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:13.750187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:13.751224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:13.752241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:13.753209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:13.818585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Getting quotas for project 547667fb95ff48be9cd32217fc8be158. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:23:13.825659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Getting quotas for user 61b701aa5d2f4fd99bd24c11a86d6b82 and project 547667fb95ff48be9cd32217fc8be158. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:23:13.845877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:23:13.848746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:23:13.942167 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0544408f-feaf-466a-99ed-fd74b6d3b066 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.668192 Aug 27 05:23:13.943574 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2717/5441] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:23:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:23:13.955005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ef3b86c1-4965-40de-a3ee-0246636b57dc tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:13.955939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ef3b86c1-4965-40de-a3ee-0246636b57dc tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:14.054086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ef3b86c1-4965-40de-a3ee-0246636b57dc tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:14.077218 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ef3b86c1-4965-40de-a3ee-0246636b57dc tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1214 microversion: 2.1 time: 0.125747 Aug 27 05:23:14.079124 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2718/5442] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:13 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:14.113863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f0369c26-aa8c-4a5d-8a4c-5f821add61e2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:14.129972 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f0369c26-aa8c-4a5d-8a4c-5f821add61e2 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.449873 Aug 27 05:23:14.131170 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2725/5443] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:13 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:14.171719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6018e109-84c5-47fc-b154-07295374d5c4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:14.209581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6018e109-84c5-47fc-b154-07295374d5c4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:14.210481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6018e109-84c5-47fc-b154-07295374d5c4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:14.211324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6018e109-84c5-47fc-b154-07295374d5c4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:14.279488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6018e109-84c5-47fc-b154-07295374d5c4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Going to try to stop instance {{(pid=128548) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:23:14.452392 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6018e109-84c5-47fc-b154-07295374d5c4 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.288877 Aug 27 05:23:14.457863 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2719/5444] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:23:14 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:23:14.472360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a38bfedd-ed30-45cb-9231-a7cb128b764c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:14.473560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a38bfedd-ed30-45cb-9231-a7cb128b764c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:14.518909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38bfedd-ed30-45cb-9231-a7cb128b764c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:14.519897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38bfedd-ed30-45cb-9231-a7cb128b764c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:14.520993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38bfedd-ed30-45cb-9231-a7cb128b764c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:14.522610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38bfedd-ed30-45cb-9231-a7cb128b764c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:14.526237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38bfedd-ed30-45cb-9231-a7cb128b764c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:14.529181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38bfedd-ed30-45cb-9231-a7cb128b764c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:14.709875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0218895b-b753-404d-9610-ade8b813990b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:14.710822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0218895b-b753-404d-9610-ade8b813990b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:14.725808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0218895b-b753-404d-9610-ade8b813990b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:14.726488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0218895b-b753-404d-9610-ade8b813990b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:14.727968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0218895b-b753-404d-9610-ade8b813990b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:14.729362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0218895b-b753-404d-9610-ade8b813990b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:14.730171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0218895b-b753-404d-9610-ade8b813990b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:14.733554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0218895b-b753-404d-9610-ade8b813990b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:15.009893 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:23:15.010930 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 05:23:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 (ip 10.222.0.58) !!! Aug 27 05:23:15.103489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a38bfedd-ed30-45cb-9231-a7cb128b764c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:15.138890 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a38bfedd-ed30-45cb-9231-a7cb128b764c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.675592 Aug 27 05:23:15.141116 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2726/5445] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:14 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:15.150028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4f22e22-8a2f-4a52-970d-c1229c1744e4 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:15.151212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4f22e22-8a2f-4a52-970d-c1229c1744e4 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:15.180010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4f22e22-8a2f-4a52-970d-c1229c1744e4 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:15.180571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4f22e22-8a2f-4a52-970d-c1229c1744e4 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:15.181021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4f22e22-8a2f-4a52-970d-c1229c1744e4 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:15.182023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4f22e22-8a2f-4a52-970d-c1229c1744e4 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:15.182249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4f22e22-8a2f-4a52-970d-c1229c1744e4 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:15.182672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4f22e22-8a2f-4a52-970d-c1229c1744e4 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:15.243136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0218895b-b753-404d-9610-ade8b813990b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:15.256725 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0218895b-b753-404d-9610-ade8b813990b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.553000 Aug 27 05:23:15.267272 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2720/5446] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:14 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:15.309093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b4f22e22-8a2f-4a52-970d-c1229c1744e4 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:15.338874 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4f22e22-8a2f-4a52-970d-c1229c1744e4 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1210 microversion: 2.1 time: 0.195605 Aug 27 05:23:15.348332 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2727/5447] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:15 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1210 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:16.180824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b5b68cfe-e729-4ca5-b65d-2e837d78f850 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:16.182918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b5b68cfe-e729-4ca5-b65d-2e837d78f850 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:16.233989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5b68cfe-e729-4ca5-b65d-2e837d78f850 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:16.238329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5b68cfe-e729-4ca5-b65d-2e837d78f850 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:16.238518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5b68cfe-e729-4ca5-b65d-2e837d78f850 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:16.253710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5b68cfe-e729-4ca5-b65d-2e837d78f850 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:16.256042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5b68cfe-e729-4ca5-b65d-2e837d78f850 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:16.256784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b5b68cfe-e729-4ca5-b65d-2e837d78f850 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:16.300693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-86344be7-a460-416f-b153-fa0f82d03ab2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:16.303321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-86344be7-a460-416f-b153-fa0f82d03ab2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:16.334477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86344be7-a460-416f-b153-fa0f82d03ab2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:16.335323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86344be7-a460-416f-b153-fa0f82d03ab2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:16.335770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86344be7-a460-416f-b153-fa0f82d03ab2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:16.336492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86344be7-a460-416f-b153-fa0f82d03ab2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:16.336959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86344be7-a460-416f-b153-fa0f82d03ab2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:16.337395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86344be7-a460-416f-b153-fa0f82d03ab2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:16.823160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b5b68cfe-e729-4ca5-b65d-2e837d78f850 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:16.833379 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b5b68cfe-e729-4ca5-b65d-2e837d78f850 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.665706 Aug 27 05:23:16.834811 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2721/5448] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:16 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:16.846468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2af4730c-e253-4347-8f8d-9ff183e590a5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:16.848794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2af4730c-e253-4347-8f8d-9ff183e590a5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:16.868238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86344be7-a460-416f-b153-fa0f82d03ab2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:16.872860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4730c-e253-4347-8f8d-9ff183e590a5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:16.874511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4730c-e253-4347-8f8d-9ff183e590a5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:16.877181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4730c-e253-4347-8f8d-9ff183e590a5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:16.878122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4730c-e253-4347-8f8d-9ff183e590a5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:16.878742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4730c-e253-4347-8f8d-9ff183e590a5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:16.879863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af4730c-e253-4347-8f8d-9ff183e590a5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:16.882574 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-86344be7-a460-416f-b153-fa0f82d03ab2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.589693 Aug 27 05:23:16.887802 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2728/5449] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:16 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:17.078498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2af4730c-e253-4347-8f8d-9ff183e590a5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:17.091533 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2af4730c-e253-4347-8f8d-9ff183e590a5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1272 microversion: 2.1 time: 0.253050 Aug 27 05:23:17.105445 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2722/5450] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:16 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:17.873128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bbd0d08b-38de-4ac6-9c0d-337d1031b81a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:17.874176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bbd0d08b-38de-4ac6-9c0d-337d1031b81a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:17.885917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbd0d08b-38de-4ac6-9c0d-337d1031b81a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:17.886433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbd0d08b-38de-4ac6-9c0d-337d1031b81a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:17.886954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbd0d08b-38de-4ac6-9c0d-337d1031b81a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:17.888179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbd0d08b-38de-4ac6-9c0d-337d1031b81a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:17.889128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbd0d08b-38de-4ac6-9c0d-337d1031b81a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:17.889828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bbd0d08b-38de-4ac6-9c0d-337d1031b81a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:17.926286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-948ca2b5-9c46-4617-a827-9561d9780934 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:17.927082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-948ca2b5-9c46-4617-a827-9561d9780934 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:17.939075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948ca2b5-9c46-4617-a827-9561d9780934 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:17.939605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948ca2b5-9c46-4617-a827-9561d9780934 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:17.940057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948ca2b5-9c46-4617-a827-9561d9780934 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:17.943439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948ca2b5-9c46-4617-a827-9561d9780934 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:17.943990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948ca2b5-9c46-4617-a827-9561d9780934 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:17.944430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948ca2b5-9c46-4617-a827-9561d9780934 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:18.779281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bbd0d08b-38de-4ac6-9c0d-337d1031b81a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:18.824225 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bbd0d08b-38de-4ac6-9c0d-337d1031b81a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.952232 Aug 27 05:23:18.826070 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2729/5451] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:17 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:18.845893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ac5bd95a-a4fd-4b00-96c1-b24dd6502628 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:18.846852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ac5bd95a-a4fd-4b00-96c1-b24dd6502628 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:18.857089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac5bd95a-a4fd-4b00-96c1-b24dd6502628 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:18.857766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac5bd95a-a4fd-4b00-96c1-b24dd6502628 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:18.858217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac5bd95a-a4fd-4b00-96c1-b24dd6502628 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:18.858971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac5bd95a-a4fd-4b00-96c1-b24dd6502628 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:18.859472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac5bd95a-a4fd-4b00-96c1-b24dd6502628 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:18.860026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac5bd95a-a4fd-4b00-96c1-b24dd6502628 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:18.980648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-948ca2b5-9c46-4617-a827-9561d9780934 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:18.992104 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-948ca2b5-9c46-4617-a827-9561d9780934 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 1.069075 Aug 27 05:23:18.993462 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2723/5452] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:17 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:19.184481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ac5bd95a-a4fd-4b00-96c1-b24dd6502628 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:19.209808 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ac5bd95a-a4fd-4b00-96c1-b24dd6502628 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1314 microversion: 2.1 time: 0.381332 Aug 27 05:23:19.225216 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2730/5453] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:18 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:19.580277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f6f4b068-7296-4f7b-8d62-087979111735 req-343f41aa-8375-4eba-9db8-d44cd6f5a7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76770e46-1e02-436c-ae09-4a770da79b88", "tag": "8decb08f-c993-49dc-a4c6-a94190131d0d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:19.591756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f6f4b068-7296-4f7b-8d62-087979111735 req-343f41aa-8375-4eba-9db8-d44cd6f5a7a4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:19.593802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f6f4b068-7296-4f7b-8d62-087979111735 req-343f41aa-8375-4eba-9db8-d44cd6f5a7a4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:19.594426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f6f4b068-7296-4f7b-8d62-087979111735 req-343f41aa-8375-4eba-9db8-d44cd6f5a7a4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:19.611795 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f6f4b068-7296-4f7b-8d62-087979111735 req-343f41aa-8375-4eba-9db8-d44cd6f5a7a4 service nova] Creating event network-changed:8decb08f-c993-49dc-a4c6-a94190131d0d for instance 76770e46-1e02-436c-ae09-4a770da79b88 on n-h2-820368-35 Aug 27 05:23:19.618297 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f6f4b068-7296-4f7b-8d62-087979111735 req-343f41aa-8375-4eba-9db8-d44cd6f5a7a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.455536 Aug 27 05:23:19.619796 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2724/5454] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:19.856059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-76e87ea2-9b0d-436e-aef7-0744830f09ed tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:19.858220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-76e87ea2-9b0d-436e-aef7-0744830f09ed tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:19.869828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e87ea2-9b0d-436e-aef7-0744830f09ed tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:19.870953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e87ea2-9b0d-436e-aef7-0744830f09ed tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:19.871940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e87ea2-9b0d-436e-aef7-0744830f09ed tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:19.872983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e87ea2-9b0d-436e-aef7-0744830f09ed tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:19.874333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e87ea2-9b0d-436e-aef7-0744830f09ed tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:19.875022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76e87ea2-9b0d-436e-aef7-0744830f09ed tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:20.018968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-370efb15-f49f-49dd-9767-98cbd002a3a4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:20.020496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-370efb15-f49f-49dd-9767-98cbd002a3a4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:20.028585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-370efb15-f49f-49dd-9767-98cbd002a3a4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:20.029524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-370efb15-f49f-49dd-9767-98cbd002a3a4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:20.030086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-370efb15-f49f-49dd-9767-98cbd002a3a4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:20.030932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-370efb15-f49f-49dd-9767-98cbd002a3a4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:20.031499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-370efb15-f49f-49dd-9767-98cbd002a3a4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:20.032049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-370efb15-f49f-49dd-9767-98cbd002a3a4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:20.191574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-76e87ea2-9b0d-436e-aef7-0744830f09ed tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:20.212560 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-76e87ea2-9b0d-436e-aef7-0744830f09ed tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.362420 Aug 27 05:23:20.226589 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2731/5455] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:19 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:20.258930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3761ad13-0355-4a94-b46d-03a0ac04ff58 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:20.260154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3761ad13-0355-4a94-b46d-03a0ac04ff58 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:20.272604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3761ad13-0355-4a94-b46d-03a0ac04ff58 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:20.273688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3761ad13-0355-4a94-b46d-03a0ac04ff58 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:20.275347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3761ad13-0355-4a94-b46d-03a0ac04ff58 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:20.276398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3761ad13-0355-4a94-b46d-03a0ac04ff58 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:20.278741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3761ad13-0355-4a94-b46d-03a0ac04ff58 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:20.278741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3761ad13-0355-4a94-b46d-03a0ac04ff58 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:20.368399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-370efb15-f49f-49dd-9767-98cbd002a3a4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:20.383977 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-370efb15-f49f-49dd-9767-98cbd002a3a4 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.369254 Aug 27 05:23:20.397370 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2725/5456] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:20 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:20.525274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3761ad13-0355-4a94-b46d-03a0ac04ff58 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:20.538053 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3761ad13-0355-4a94-b46d-03a0ac04ff58 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1314 microversion: 2.1 time: 0.302603 Aug 27 05:23:20.538593 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2732/5457] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:20 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:21.274797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-53188133-0391-46b4-8af8-1a08e484eba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:21.276772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-53188133-0391-46b4-8af8-1a08e484eba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:21.291524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53188133-0391-46b4-8af8-1a08e484eba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:21.292398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53188133-0391-46b4-8af8-1a08e484eba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:21.293174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53188133-0391-46b4-8af8-1a08e484eba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:21.294423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53188133-0391-46b4-8af8-1a08e484eba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:21.295840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53188133-0391-46b4-8af8-1a08e484eba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:21.296831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53188133-0391-46b4-8af8-1a08e484eba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:21.422198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-21d37982-9a28-4e0a-9a37-5aa1c90f70c5 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:21.425986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-21d37982-9a28-4e0a-9a37-5aa1c90f70c5 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:21.439881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21d37982-9a28-4e0a-9a37-5aa1c90f70c5 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:21.441221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21d37982-9a28-4e0a-9a37-5aa1c90f70c5 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:21.442917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21d37982-9a28-4e0a-9a37-5aa1c90f70c5 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:21.444612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21d37982-9a28-4e0a-9a37-5aa1c90f70c5 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:21.446337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21d37982-9a28-4e0a-9a37-5aa1c90f70c5 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:21.447384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21d37982-9a28-4e0a-9a37-5aa1c90f70c5 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:21.548114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-53188133-0391-46b4-8af8-1a08e484eba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:21.564957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:21.570970 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-53188133-0391-46b4-8af8-1a08e484eba5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.303521 Aug 27 05:23:21.572601 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2726/5458] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:21 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:21.593755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bb4624c6-fe9b-42f3-a812-79600cafce5e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:21.595646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bb4624c6-fe9b-42f3-a812-79600cafce5e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:21.611644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb4624c6-fe9b-42f3-a812-79600cafce5e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:21.612987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb4624c6-fe9b-42f3-a812-79600cafce5e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:21.614794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb4624c6-fe9b-42f3-a812-79600cafce5e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:21.615849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb4624c6-fe9b-42f3-a812-79600cafce5e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:21.617398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb4624c6-fe9b-42f3-a812-79600cafce5e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:21.618125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb4624c6-fe9b-42f3-a812-79600cafce5e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:21.830352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-21d37982-9a28-4e0a-9a37-5aa1c90f70c5 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:21.846004 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-21d37982-9a28-4e0a-9a37-5aa1c90f70c5 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.442568 Aug 27 05:23:21.848888 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2733/5459] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:21 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:21.909228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bb4624c6-fe9b-42f3-a812-79600cafce5e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:21.928452 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bb4624c6-fe9b-42f3-a812-79600cafce5e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1314 microversion: 2.1 time: 0.354364 Aug 27 05:23:21.929410 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2727/5460] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:21 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:22.608679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1b3aa89e-b3d6-413d-a7c7-1359e434dde7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:22.609918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1b3aa89e-b3d6-413d-a7c7-1359e434dde7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:22.617531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b3aa89e-b3d6-413d-a7c7-1359e434dde7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:22.618283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b3aa89e-b3d6-413d-a7c7-1359e434dde7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:22.618783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b3aa89e-b3d6-413d-a7c7-1359e434dde7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:22.619464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b3aa89e-b3d6-413d-a7c7-1359e434dde7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:22.619925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b3aa89e-b3d6-413d-a7c7-1359e434dde7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:22.620357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b3aa89e-b3d6-413d-a7c7-1359e434dde7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:22.625358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:22.871577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5353279e-f541-454b-9819-faccac626e00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:22.872449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5353279e-f541-454b-9819-faccac626e00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:22.887733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5353279e-f541-454b-9819-faccac626e00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:22.889305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5353279e-f541-454b-9819-faccac626e00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:22.890528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5353279e-f541-454b-9819-faccac626e00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:22.892070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5353279e-f541-454b-9819-faccac626e00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:22.893416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5353279e-f541-454b-9819-faccac626e00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:22.894131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5353279e-f541-454b-9819-faccac626e00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:22.940708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1b3aa89e-b3d6-413d-a7c7-1359e434dde7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:22.956446 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1b3aa89e-b3d6-413d-a7c7-1359e434dde7 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.351785 Aug 27 05:23:22.957498 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2734/5461] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:22 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:22.965606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a75f23c-de00-4d7f-9b14-7e24914a7e16 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:22.966709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6a75f23c-de00-4d7f-9b14-7e24914a7e16 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:22.979914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a75f23c-de00-4d7f-9b14-7e24914a7e16 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:22.981325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a75f23c-de00-4d7f-9b14-7e24914a7e16 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:22.982148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a75f23c-de00-4d7f-9b14-7e24914a7e16 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:22.983892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a75f23c-de00-4d7f-9b14-7e24914a7e16 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:22.984474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a75f23c-de00-4d7f-9b14-7e24914a7e16 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:22.985129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a75f23c-de00-4d7f-9b14-7e24914a7e16 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:23.156415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5353279e-f541-454b-9819-faccac626e00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:23.168659 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5353279e-f541-454b-9819-faccac626e00 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.302129 Aug 27 05:23:23.169518 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2728/5462] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:22 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:23.209479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6a75f23c-de00-4d7f-9b14-7e24914a7e16 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:23.218319 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6a75f23c-de00-4d7f-9b14-7e24914a7e16 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1314 microversion: 2.1 time: 0.259347 Aug 27 05:23:23.218902 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2735/5463] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:22 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:23.991495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1786656c-53cb-493a-90cf-77f388f3ce22 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:23.992128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1786656c-53cb-493a-90cf-77f388f3ce22 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:23.999330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:24.002221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1786656c-53cb-493a-90cf-77f388f3ce22 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:24.002952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1786656c-53cb-493a-90cf-77f388f3ce22 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:24.003734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1786656c-53cb-493a-90cf-77f388f3ce22 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:24.004737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1786656c-53cb-493a-90cf-77f388f3ce22 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:24.005370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1786656c-53cb-493a-90cf-77f388f3ce22 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:24.005975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1786656c-53cb-493a-90cf-77f388f3ce22 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:24.066029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:24.210921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-76092d5f-bf43-4796-b5f6-7c0dec00566a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:24.214664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-76092d5f-bf43-4796-b5f6-7c0dec00566a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:24.246231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76092d5f-bf43-4796-b5f6-7c0dec00566a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:24.247626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76092d5f-bf43-4796-b5f6-7c0dec00566a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:24.248706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76092d5f-bf43-4796-b5f6-7c0dec00566a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:24.250498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76092d5f-bf43-4796-b5f6-7c0dec00566a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:24.251693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76092d5f-bf43-4796-b5f6-7c0dec00566a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:24.252787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76092d5f-bf43-4796-b5f6-7c0dec00566a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:24.280605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1786656c-53cb-493a-90cf-77f388f3ce22 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:24.303661 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1786656c-53cb-493a-90cf-77f388f3ce22 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1678 microversion: 2.1 time: 0.315829 Aug 27 05:23:24.308350 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2729/5464] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:23 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1678 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:24.325743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f801da80-2175-4d76-86e0-a3a2ba97462b tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:24.326886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f801da80-2175-4d76-86e0-a3a2ba97462b tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:24.352642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f801da80-2175-4d76-86e0-a3a2ba97462b tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:24.353154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f801da80-2175-4d76-86e0-a3a2ba97462b tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:24.353679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f801da80-2175-4d76-86e0-a3a2ba97462b tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:24.354521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f801da80-2175-4d76-86e0-a3a2ba97462b tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:24.355057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f801da80-2175-4d76-86e0-a3a2ba97462b tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:24.355669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f801da80-2175-4d76-86e0-a3a2ba97462b tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:24.660351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-76092d5f-bf43-4796-b5f6-7c0dec00566a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:24.673041 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-76092d5f-bf43-4796-b5f6-7c0dec00566a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.471979 Aug 27 05:23:24.674246 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2736/5465] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:24 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:24.738790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f801da80-2175-4d76-86e0-a3a2ba97462b tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:24.758728 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f801da80-2175-4d76-86e0-a3a2ba97462b tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1314 microversion: 2.1 time: 0.445688 Aug 27 05:23:24.759933 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2730/5466] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:24 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:25.337210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b957af42-6ea4-4173-af7e-62c12fa4536b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:25.338694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b957af42-6ea4-4173-af7e-62c12fa4536b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:25.347155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b957af42-6ea4-4173-af7e-62c12fa4536b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:25.348089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b957af42-6ea4-4173-af7e-62c12fa4536b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:25.348956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b957af42-6ea4-4173-af7e-62c12fa4536b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:25.350278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b957af42-6ea4-4173-af7e-62c12fa4536b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:25.351556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b957af42-6ea4-4173-af7e-62c12fa4536b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:25.352226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b957af42-6ea4-4173-af7e-62c12fa4536b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:25.555348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b957af42-6ea4-4173-af7e-62c12fa4536b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:25.572255 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b957af42-6ea4-4173-af7e-62c12fa4536b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1655 microversion: 2.1 time: 0.240393 Aug 27 05:23:25.573684 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2737/5467] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:25 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1655 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:25.596602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d20b5381-f5ca-4e94-98f0-cd5c852a307f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:25.607876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d20b5381-f5ca-4e94-98f0-cd5c852a307f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:25.608944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d20b5381-f5ca-4e94-98f0-cd5c852a307f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:25.609894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d20b5381-f5ca-4e94-98f0-cd5c852a307f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:25.644796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d20b5381-f5ca-4e94-98f0-cd5c852a307f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Going to try to start instance {{(pid=128548) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 05:23:25.697383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-98fe3892-2091-4fa8-a538-cf4a470d071f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:25.698179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-98fe3892-2091-4fa8-a538-cf4a470d071f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:25.711228 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d20b5381-f5ca-4e94-98f0-cd5c852a307f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.118939 Aug 27 05:23:25.712991 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2731/5468] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:23:25 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:23:25.713423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe3892-2091-4fa8-a538-cf4a470d071f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:25.714254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe3892-2091-4fa8-a538-cf4a470d071f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:25.719006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe3892-2091-4fa8-a538-cf4a470d071f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:25.725439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe3892-2091-4fa8-a538-cf4a470d071f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:25.726182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe3892-2091-4fa8-a538-cf4a470d071f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:25.726832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98fe3892-2091-4fa8-a538-cf4a470d071f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:25.757869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd1ee054-7ca1-4075-b970-268c264bad28 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:25.759036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd1ee054-7ca1-4075-b970-268c264bad28 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:25.797856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1ee054-7ca1-4075-b970-268c264bad28 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:25.798500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1ee054-7ca1-4075-b970-268c264bad28 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:25.799571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1ee054-7ca1-4075-b970-268c264bad28 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:25.802061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1ee054-7ca1-4075-b970-268c264bad28 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:25.806141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1ee054-7ca1-4075-b970-268c264bad28 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:25.806967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd1ee054-7ca1-4075-b970-268c264bad28 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:26.240113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd1ee054-7ca1-4075-b970-268c264bad28 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:26.259509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-98fe3892-2091-4fa8-a538-cf4a470d071f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:26.260997 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd1ee054-7ca1-4075-b970-268c264bad28 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1664 microversion: 2.1 time: 0.525503 Aug 27 05:23:26.275252 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-98fe3892-2091-4fa8-a538-cf4a470d071f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.582319 Aug 27 05:23:26.276028 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2738/5469] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:25 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:26.282166 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2732/5470] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:25 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1664 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:26.308517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f59a79ab-ae85-4474-baa6-a37a5ad8bd56 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:26.317654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f59a79ab-ae85-4474-baa6-a37a5ad8bd56 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:26.344874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f59a79ab-ae85-4474-baa6-a37a5ad8bd56 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:26.344874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f59a79ab-ae85-4474-baa6-a37a5ad8bd56 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:26.344874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f59a79ab-ae85-4474-baa6-a37a5ad8bd56 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:26.344874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f59a79ab-ae85-4474-baa6-a37a5ad8bd56 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:26.347514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f59a79ab-ae85-4474-baa6-a37a5ad8bd56 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:26.348911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f59a79ab-ae85-4474-baa6-a37a5ad8bd56 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:26.873548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f59a79ab-ae85-4474-baa6-a37a5ad8bd56 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:26.885151 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f59a79ab-ae85-4474-baa6-a37a5ad8bd56 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1314 microversion: 2.1 time: 0.596033 Aug 27 05:23:26.886245 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2739/5471] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:26 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:26.955045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-accbbcef-a115-4c39-82b7-aa8aa912a1ac req-77dcef30-740d-4ec4-add6-895eb56dffb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76770e46-1e02-436c-ae09-4a770da79b88", "name": "network-vif-plugged", "status": "completed", "tag": "8decb08f-c993-49dc-a4c6-a94190131d0d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:26.986735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-accbbcef-a115-4c39-82b7-aa8aa912a1ac req-77dcef30-740d-4ec4-add6-895eb56dffb6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:26.987354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-accbbcef-a115-4c39-82b7-aa8aa912a1ac req-77dcef30-740d-4ec4-add6-895eb56dffb6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:26.988086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-accbbcef-a115-4c39-82b7-aa8aa912a1ac req-77dcef30-740d-4ec4-add6-895eb56dffb6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:27.026078 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-accbbcef-a115-4c39-82b7-aa8aa912a1ac req-77dcef30-740d-4ec4-add6-895eb56dffb6 service nova] Creating event network-vif-plugged:8decb08f-c993-49dc-a4c6-a94190131d0d for instance 76770e46-1e02-436c-ae09-4a770da79b88 on n-h2-820368-35 Aug 27 05:23:27.039862 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-accbbcef-a115-4c39-82b7-aa8aa912a1ac req-77dcef30-740d-4ec4-add6-895eb56dffb6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092628 Aug 27 05:23:27.043456 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2733/5472] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:27.306842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-503f3b09-19ee-459d-a0ab-eeb93f88f62f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:27.307968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-503f3b09-19ee-459d-a0ab-eeb93f88f62f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:27.315437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0c1f0d9c-396f-47dc-b6d2-2c3f084db009 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:27.316513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0c1f0d9c-396f-47dc-b6d2-2c3f084db009 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:27.321162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-503f3b09-19ee-459d-a0ab-eeb93f88f62f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:27.324699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-503f3b09-19ee-459d-a0ab-eeb93f88f62f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:27.325380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-503f3b09-19ee-459d-a0ab-eeb93f88f62f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:27.328140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-503f3b09-19ee-459d-a0ab-eeb93f88f62f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:27.329715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-503f3b09-19ee-459d-a0ab-eeb93f88f62f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:27.339547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-503f3b09-19ee-459d-a0ab-eeb93f88f62f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:27.343122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c1f0d9c-396f-47dc-b6d2-2c3f084db009 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:27.361577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c1f0d9c-396f-47dc-b6d2-2c3f084db009 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:27.364347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c1f0d9c-396f-47dc-b6d2-2c3f084db009 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:27.365158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c1f0d9c-396f-47dc-b6d2-2c3f084db009 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:27.365653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c1f0d9c-396f-47dc-b6d2-2c3f084db009 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:27.366230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c1f0d9c-396f-47dc-b6d2-2c3f084db009 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:28.334582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0c1f0d9c-396f-47dc-b6d2-2c3f084db009 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:28.349278 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0c1f0d9c-396f-47dc-b6d2-2c3f084db009 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 1.048418 Aug 27 05:23:28.351166 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2740/5473] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:27 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:28.356976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ade20780-9fd5-4a42-89de-8d2406d59f3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:28.357655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ade20780-9fd5-4a42-89de-8d2406d59f3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:28.370973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade20780-9fd5-4a42-89de-8d2406d59f3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:28.372232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade20780-9fd5-4a42-89de-8d2406d59f3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:28.373250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade20780-9fd5-4a42-89de-8d2406d59f3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:28.374522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade20780-9fd5-4a42-89de-8d2406d59f3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:28.375605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade20780-9fd5-4a42-89de-8d2406d59f3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:28.376214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ade20780-9fd5-4a42-89de-8d2406d59f3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:28.381871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-503f3b09-19ee-459d-a0ab-eeb93f88f62f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:28.401909 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-503f3b09-19ee-459d-a0ab-eeb93f88f62f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1664 microversion: 2.1 time: 1.099152 Aug 27 05:23:28.406750 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2734/5474] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:27 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1664 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:28.696497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ade20780-9fd5-4a42-89de-8d2406d59f3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:28.716404 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ade20780-9fd5-4a42-89de-8d2406d59f3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1314 microversion: 2.1 time: 0.363265 Aug 27 05:23:28.718085 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2741/5475] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:28 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:29.394912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4e98e5d8-d5e2-4800-ba04-08574614a995 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:29.396936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4e98e5d8-d5e2-4800-ba04-08574614a995 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:29.408929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98e5d8-d5e2-4800-ba04-08574614a995 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:29.412379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98e5d8-d5e2-4800-ba04-08574614a995 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:29.412879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98e5d8-d5e2-4800-ba04-08574614a995 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:29.413652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98e5d8-d5e2-4800-ba04-08574614a995 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:29.414131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98e5d8-d5e2-4800-ba04-08574614a995 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:29.414570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98e5d8-d5e2-4800-ba04-08574614a995 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:29.425416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-339179aa-9090-4175-b024-3731321c3e90 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:29.427223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-339179aa-9090-4175-b024-3731321c3e90 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:29.444728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339179aa-9090-4175-b024-3731321c3e90 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:29.458619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339179aa-9090-4175-b024-3731321c3e90 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:29.467216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339179aa-9090-4175-b024-3731321c3e90 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:29.468272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339179aa-9090-4175-b024-3731321c3e90 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:29.468907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339179aa-9090-4175-b024-3731321c3e90 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:29.469816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339179aa-9090-4175-b024-3731321c3e90 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:30.022341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-339179aa-9090-4175-b024-3731321c3e90 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:30.028172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4e98e5d8-d5e2-4800-ba04-08574614a995 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:30.045334 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4e98e5d8-d5e2-4800-ba04-08574614a995 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.670426 Aug 27 05:23:30.046557 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2735/5476] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:29 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:30.049907 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-339179aa-9090-4175-b024-3731321c3e90 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.629486 Aug 27 05:23:30.050619 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2742/5477] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:29 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:30.065931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-20b3a408-350e-4435-94e9-970e611397fe tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:30.066670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-20b3a408-350e-4435-94e9-970e611397fe tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:30.074518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b3a408-350e-4435-94e9-970e611397fe tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:30.075118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b3a408-350e-4435-94e9-970e611397fe tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:30.076591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b3a408-350e-4435-94e9-970e611397fe tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:30.078452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b3a408-350e-4435-94e9-970e611397fe tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:30.079412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b3a408-350e-4435-94e9-970e611397fe tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:30.080757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20b3a408-350e-4435-94e9-970e611397fe tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:30.088709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57faaba5-b158-429b-b771-fb8fb1a5769c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:30.090463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-57faaba5-b158-429b-b771-fb8fb1a5769c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:30.103435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57faaba5-b158-429b-b771-fb8fb1a5769c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:30.104209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57faaba5-b158-429b-b771-fb8fb1a5769c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:30.105122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57faaba5-b158-429b-b771-fb8fb1a5769c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:30.106524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57faaba5-b158-429b-b771-fb8fb1a5769c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:30.108226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57faaba5-b158-429b-b771-fb8fb1a5769c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:30.109308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57faaba5-b158-429b-b771-fb8fb1a5769c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:30.540400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-57faaba5-b158-429b-b771-fb8fb1a5769c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:30.556616 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-57faaba5-b158-429b-b771-fb8fb1a5769c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.475469 Aug 27 05:23:30.557434 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2743/5478] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:30 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:30.559395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-20b3a408-350e-4435-94e9-970e611397fe tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:30.577162 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-20b3a408-350e-4435-94e9-970e611397fe tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1498 microversion: 2.1 time: 0.528726 Aug 27 05:23:30.577958 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2736/5479] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:30 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1498 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:30.604980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-92ae81ab-8b7c-4c7e-9383-dd0eeaebf843 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:30.605676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-92ae81ab-8b7c-4c7e-9383-dd0eeaebf843 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:30.632498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92ae81ab-8b7c-4c7e-9383-dd0eeaebf843 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:30.633018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92ae81ab-8b7c-4c7e-9383-dd0eeaebf843 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:30.633517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92ae81ab-8b7c-4c7e-9383-dd0eeaebf843 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:30.636519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92ae81ab-8b7c-4c7e-9383-dd0eeaebf843 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:30.636995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92ae81ab-8b7c-4c7e-9383-dd0eeaebf843 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:30.639328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92ae81ab-8b7c-4c7e-9383-dd0eeaebf843 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:31.071375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-92ae81ab-8b7c-4c7e-9383-dd0eeaebf843 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:31.085023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-08f03a68-9da4-456d-8481-4ea2e2ad5d6a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:31.086237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-08f03a68-9da4-456d-8481-4ea2e2ad5d6a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:31.100957 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-92ae81ab-8b7c-4c7e-9383-dd0eeaebf843 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.507700 Aug 27 05:23:31.106405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08f03a68-9da4-456d-8481-4ea2e2ad5d6a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:31.107775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08f03a68-9da4-456d-8481-4ea2e2ad5d6a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:31.109308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08f03a68-9da4-456d-8481-4ea2e2ad5d6a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:31.110080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08f03a68-9da4-456d-8481-4ea2e2ad5d6a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:31.112075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08f03a68-9da4-456d-8481-4ea2e2ad5d6a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:31.112075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08f03a68-9da4-456d-8481-4ea2e2ad5d6a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:31.133510 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2744/5480] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:30 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:31.152837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-192f5f1e-a861-4112-b313-27474b055813 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:31.154045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-192f5f1e-a861-4112-b313-27474b055813 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:31.180105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192f5f1e-a861-4112-b313-27474b055813 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:31.181163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192f5f1e-a861-4112-b313-27474b055813 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:31.181994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192f5f1e-a861-4112-b313-27474b055813 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:31.184964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192f5f1e-a861-4112-b313-27474b055813 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:31.186359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192f5f1e-a861-4112-b313-27474b055813 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:31.191588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192f5f1e-a861-4112-b313-27474b055813 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:31.574695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-08f03a68-9da4-456d-8481-4ea2e2ad5d6a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:31.587461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-192f5f1e-a861-4112-b313-27474b055813 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:31.599347 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-08f03a68-9da4-456d-8481-4ea2e2ad5d6a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.527509 Aug 27 05:23:31.600719 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-192f5f1e-a861-4112-b313-27474b055813 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.464047 Aug 27 05:23:31.619394 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2737/5481] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:31 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:31.620564 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2745/5482] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:31 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:31.640074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f1e34ab5-7133-4825-be1b-fdc289819f7d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:31.641001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f1e34ab5-7133-4825-be1b-fdc289819f7d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:31.648321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1e34ab5-7133-4825-be1b-fdc289819f7d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:31.648580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1e34ab5-7133-4825-be1b-fdc289819f7d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:31.649199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1e34ab5-7133-4825-be1b-fdc289819f7d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:31.650061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1e34ab5-7133-4825-be1b-fdc289819f7d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:31.650528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1e34ab5-7133-4825-be1b-fdc289819f7d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:31.650954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1e34ab5-7133-4825-be1b-fdc289819f7d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:31.868494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f1e34ab5-7133-4825-be1b-fdc289819f7d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:31.879343 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f1e34ab5-7133-4825-be1b-fdc289819f7d tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.243043 Aug 27 05:23:31.880576 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2738/5483] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:31 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:31.922524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bca5ac54-fd94-4df4-a7cc-7cab67eae09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:31.923875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bca5ac54-fd94-4df4-a7cc-7cab67eae09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:31.939848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bca5ac54-fd94-4df4-a7cc-7cab67eae09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:31.941330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bca5ac54-fd94-4df4-a7cc-7cab67eae09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:31.942428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bca5ac54-fd94-4df4-a7cc-7cab67eae09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:31.944792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bca5ac54-fd94-4df4-a7cc-7cab67eae09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:31.946156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bca5ac54-fd94-4df4-a7cc-7cab67eae09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:31.947592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bca5ac54-fd94-4df4-a7cc-7cab67eae09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:31.993504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-bca5ac54-fd94-4df4-a7cc-7cab67eae09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lazy-loading 'flavor' on Instance uuid e5f4c359-6f7e-4009-a365-7b070eec11a9 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:23:32.122019 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bca5ac54-fd94-4df4-a7cc-7cab67eae09b tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.209653 Aug 27 05:23:32.124327 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2746/5484] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:23:31 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:23:32.133966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bc1ba430-ec0c-437b-ae7c-2581c40d90f9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:32.134996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bc1ba430-ec0c-437b-ae7c-2581c40d90f9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:32.154710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc1ba430-ec0c-437b-ae7c-2581c40d90f9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:32.155725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc1ba430-ec0c-437b-ae7c-2581c40d90f9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:32.157554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc1ba430-ec0c-437b-ae7c-2581c40d90f9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:32.162094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc1ba430-ec0c-437b-ae7c-2581c40d90f9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:32.163732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc1ba430-ec0c-437b-ae7c-2581c40d90f9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:32.166831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc1ba430-ec0c-437b-ae7c-2581c40d90f9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:32.496234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bc1ba430-ec0c-437b-ae7c-2581c40d90f9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:32.505469 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bc1ba430-ec0c-437b-ae7c-2581c40d90f9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1676 microversion: 2.1 time: 0.375734 Aug 27 05:23:32.506441 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2739/5485] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:32 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1676 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:32.633460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ccf6a629-19d1-4952-ae5a-2eac2c8859b8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:32.636031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ccf6a629-19d1-4952-ae5a-2eac2c8859b8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:32.648240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccf6a629-19d1-4952-ae5a-2eac2c8859b8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:32.648857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccf6a629-19d1-4952-ae5a-2eac2c8859b8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:32.649308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccf6a629-19d1-4952-ae5a-2eac2c8859b8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:32.650042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccf6a629-19d1-4952-ae5a-2eac2c8859b8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:32.650758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccf6a629-19d1-4952-ae5a-2eac2c8859b8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:32.651543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ccf6a629-19d1-4952-ae5a-2eac2c8859b8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:32.890164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ccf6a629-19d1-4952-ae5a-2eac2c8859b8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:32.900160 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ccf6a629-19d1-4952-ae5a-2eac2c8859b8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1486 microversion: 2.1 time: 0.276299 Aug 27 05:23:32.920687 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2747/5486] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:32 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1486 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:32.928539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88170ca8-2a93-4cb4-9467-ac83f7c9770d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:32.929668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-88170ca8-2a93-4cb4-9467-ac83f7c9770d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:32.951345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88170ca8-2a93-4cb4-9467-ac83f7c9770d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:32.952595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88170ca8-2a93-4cb4-9467-ac83f7c9770d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:32.954076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88170ca8-2a93-4cb4-9467-ac83f7c9770d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:32.955662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88170ca8-2a93-4cb4-9467-ac83f7c9770d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:32.956520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88170ca8-2a93-4cb4-9467-ac83f7c9770d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:32.957884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88170ca8-2a93-4cb4-9467-ac83f7c9770d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:33.123916 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88170ca8-2a93-4cb4-9467-ac83f7c9770d tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "POST /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6/action" status: 202 len: 0 microversion: 2.1 time: 0.198649 Aug 27 05:23:33.135914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec53a764-2722-4762-a3af-8031b7b4950f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:33.136537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec53a764-2722-4762-a3af-8031b7b4950f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:33.139795 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2740/5487] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:23:32 2022] POST /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:23:33.150335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec53a764-2722-4762-a3af-8031b7b4950f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:33.152262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec53a764-2722-4762-a3af-8031b7b4950f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:33.153512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec53a764-2722-4762-a3af-8031b7b4950f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:33.156451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec53a764-2722-4762-a3af-8031b7b4950f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:33.157279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec53a764-2722-4762-a3af-8031b7b4950f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:33.158341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec53a764-2722-4762-a3af-8031b7b4950f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:33.536079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-140fdd4b-3b30-4cca-8851-6501efcdb379 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:33.537285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-140fdd4b-3b30-4cca-8851-6501efcdb379 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:33.551787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-140fdd4b-3b30-4cca-8851-6501efcdb379 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:33.558744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-140fdd4b-3b30-4cca-8851-6501efcdb379 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:33.561269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-140fdd4b-3b30-4cca-8851-6501efcdb379 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:33.566013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-140fdd4b-3b30-4cca-8851-6501efcdb379 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:33.568407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-140fdd4b-3b30-4cca-8851-6501efcdb379 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:33.573582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-140fdd4b-3b30-4cca-8851-6501efcdb379 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:33.618615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ec53a764-2722-4762-a3af-8031b7b4950f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:33.641724 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec53a764-2722-4762-a3af-8031b7b4950f tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1494 microversion: 2.1 time: 0.511553 Aug 27 05:23:33.651668 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2748/5488] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:33 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1494 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:33.943828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-140fdd4b-3b30-4cca-8851-6501efcdb379 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:33.962957 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-140fdd4b-3b30-4cca-8851-6501efcdb379 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1659 microversion: 2.1 time: 0.431179 Aug 27 05:23:33.965463 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2741/5489] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:33 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1659 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:33.986964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c7f0d0e9-50fc-47e4-bd0e-13341cfc01db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:33.987799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c7f0d0e9-50fc-47e4-bd0e-13341cfc01db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:33.994380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7f0d0e9-50fc-47e4-bd0e-13341cfc01db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:33.995237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7f0d0e9-50fc-47e4-bd0e-13341cfc01db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:33.996287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7f0d0e9-50fc-47e4-bd0e-13341cfc01db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:33.997229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7f0d0e9-50fc-47e4-bd0e-13341cfc01db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:33.998447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7f0d0e9-50fc-47e4-bd0e-13341cfc01db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:33.999141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7f0d0e9-50fc-47e4-bd0e-13341cfc01db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:34.003651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:34.114722 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c7f0d0e9-50fc-47e4-bd0e-13341cfc01db tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action" status: 202 len: 0 microversion: 2.1 time: 0.130749 Aug 27 05:23:34.121873 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2749/5490] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:23:33 2022] POST /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:23:34.126622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c905be3b-c240-44c9-8c11-52a468163a72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:34.132331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c905be3b-c240-44c9-8c11-52a468163a72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:34.150401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c905be3b-c240-44c9-8c11-52a468163a72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:34.155238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c905be3b-c240-44c9-8c11-52a468163a72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:34.156906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c905be3b-c240-44c9-8c11-52a468163a72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:34.158193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c905be3b-c240-44c9-8c11-52a468163a72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:34.159020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c905be3b-c240-44c9-8c11-52a468163a72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:34.160115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c905be3b-c240-44c9-8c11-52a468163a72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:34.165805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:34.523196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c905be3b-c240-44c9-8c11-52a468163a72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:34.542434 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c905be3b-c240-44c9-8c11-52a468163a72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1665 microversion: 2.1 time: 0.419841 Aug 27 05:23:34.548260 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2742/5491] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:34 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1665 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:34.678787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cbb22ef8-4423-4769-86af-d5f0f8d0110a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:34.680726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cbb22ef8-4423-4769-86af-d5f0f8d0110a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:34.699256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbb22ef8-4423-4769-86af-d5f0f8d0110a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:34.700178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbb22ef8-4423-4769-86af-d5f0f8d0110a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:34.700947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbb22ef8-4423-4769-86af-d5f0f8d0110a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:34.702243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbb22ef8-4423-4769-86af-d5f0f8d0110a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:34.703026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbb22ef8-4423-4769-86af-d5f0f8d0110a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:34.704125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbb22ef8-4423-4769-86af-d5f0f8d0110a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:34.940683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cbb22ef8-4423-4769-86af-d5f0f8d0110a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:34.953424 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cbb22ef8-4423-4769-86af-d5f0f8d0110a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1494 microversion: 2.1 time: 0.277084 Aug 27 05:23:34.954265 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2750/5492] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:34 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1494 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:35.057240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e702d74-d06b-454d-8046-33e9470df230 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:35.058024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2e702d74-d06b-454d-8046-33e9470df230 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:35.068088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e702d74-d06b-454d-8046-33e9470df230 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.068975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e702d74-d06b-454d-8046-33e9470df230 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.071354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e702d74-d06b-454d-8046-33e9470df230 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:35.072153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e702d74-d06b-454d-8046-33e9470df230 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.072815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e702d74-d06b-454d-8046-33e9470df230 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.073439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e702d74-d06b-454d-8046-33e9470df230 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:35.105864 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2e702d74-d06b-454d-8046-33e9470df230 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02/ips" status: 200 len: 150 microversion: 2.1 time: 0.052850 Aug 27 05:23:35.106810 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2743/5493] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:23:35 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:35.127752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc243a4a-2e91-4757-95b5-c41f7d30e9f0"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:35.130784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:35.143112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.144690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.145545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:35.148782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.149558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.150476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:35.306286 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Invalid volume: volume fc243a4a-2e91-4757-95b5-c41f7d30e9f0 is already attached to instances: 4e12d584-d333-430d-aec1-67778b1f5575 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02/os-volume_attachments HTTP/1.1 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 74 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: {"volumeAttachment": {"volumeId": "fc243a4a-2e91-4757-95b5-c41f7d30e9f0"}} Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid volume: volume fc243a4a-2e91-4757-95b5-c41f7d30e9f0 is already attached to instances: 4e12d584-d333-430d-aec1-67778b1f5575 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'server_id': '2b65010e-acb1-46b6-8da9-b4fef757aa02', 'body': {'volumeAttachment': {'volumeId': 'fc243a4a-2e91-4757-95b5-c41f7d30e9f0'}}} Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fc243a4a-2e91-4757-95b5-c41f7d30e9f0 is already attached to instances: 4e12d584-d333-430d-aec1-67778b1f5575 Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:23:35.309873 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fc243a4a-2e91-4757-95b5-c41f7d30e9f0 is already attached to instances: 4e12d584-d333-430d-aec1-67778b1f5575 Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fc243a4a-2e91-4757-95b5-c41f7d30e9f0 is already attached to instances: 4e12d584-d333-430d-aec1-67778b1f5575 Aug 27 05:23:35.319132 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:35.328094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 400 to user: Invalid volume: volume fc243a4a-2e91-4757-95b5-c41f7d30e9f0 is already attached to instances: 4e12d584-d333-430d-aec1-67778b1f5575 {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:23:35.328094 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7b187491-534b-4886-b9ea-796989b6b038 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.202788 Aug 27 05:23:35.329856 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2751/5494] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:23:35 2022] POST /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02/os-volume_attachments => generated 174 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:23:35.341833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-788ffc20-11ba-445b-b803-478960dc757e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:35.342665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-788ffc20-11ba-445b-b803-478960dc757e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:35.369191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788ffc20-11ba-445b-b803-478960dc757e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.370039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788ffc20-11ba-445b-b803-478960dc757e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.370837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788ffc20-11ba-445b-b803-478960dc757e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:35.372138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788ffc20-11ba-445b-b803-478960dc757e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.373552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788ffc20-11ba-445b-b803-478960dc757e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.374336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-788ffc20-11ba-445b-b803-478960dc757e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:35.433108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-011f25e5-ac06-46d8-a79c-6217581e056d tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:35.438362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-011f25e5-ac06-46d8-a79c-6217581e056d tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:35.457193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-788ffc20-11ba-445b-b803-478960dc757e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:23:35.458810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011f25e5-ac06-46d8-a79c-6217581e056d tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.462857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011f25e5-ac06-46d8-a79c-6217581e056d tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.463728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011f25e5-ac06-46d8-a79c-6217581e056d tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:35.465036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011f25e5-ac06-46d8-a79c-6217581e056d tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.469460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011f25e5-ac06-46d8-a79c-6217581e056d tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.470383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-011f25e5-ac06-46d8-a79c-6217581e056d tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:35.541576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-011f25e5-ac06-46d8-a79c-6217581e056d tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:23:35.722273 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-788ffc20-11ba-445b-b803-478960dc757e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 204 len: 0 microversion: 2.1 time: 0.384941 Aug 27 05:23:35.724444 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-011f25e5-ac06-46d8-a79c-6217581e056d tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "DELETE /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 204 len: 0 microversion: 2.1 time: 0.298277 Aug 27 05:23:35.726020 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2752/5496] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:23:35 2022] DELETE /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:23:35.730147 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2744/5496] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:23:35 2022] DELETE /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:23:35.742162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af95d556-8152-4200-bb90-81b4357dbea2 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:35.744390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-af95d556-8152-4200-bb90-81b4357dbea2 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:35.755632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af95d556-8152-4200-bb90-81b4357dbea2 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.756830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af95d556-8152-4200-bb90-81b4357dbea2 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.757730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af95d556-8152-4200-bb90-81b4357dbea2 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:35.758653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af95d556-8152-4200-bb90-81b4357dbea2 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.759366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af95d556-8152-4200-bb90-81b4357dbea2 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.760236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af95d556-8152-4200-bb90-81b4357dbea2 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:36.079202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b7716b3-6c0e-47ed-b298-bd99106fcdce tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:36.081271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8b7716b3-6c0e-47ed-b298-bd99106fcdce tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:36.090227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7716b3-6c0e-47ed-b298-bd99106fcdce tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:36.091958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7716b3-6c0e-47ed-b298-bd99106fcdce tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:36.092930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7716b3-6c0e-47ed-b298-bd99106fcdce tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:36.094411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7716b3-6c0e-47ed-b298-bd99106fcdce tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:36.095429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7716b3-6c0e-47ed-b298-bd99106fcdce tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:36.096359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b7716b3-6c0e-47ed-b298-bd99106fcdce tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:36.322575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af95d556-8152-4200-bb90-81b4357dbea2 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:36.346872 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af95d556-8152-4200-bb90-81b4357dbea2 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1504 microversion: 2.1 time: 0.611901 Aug 27 05:23:36.349649 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2745/5497] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:35 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1504 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:36.360845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f97c62fd-e7cc-47d4-9cfc-a73a7816bed0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:36.362416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f97c62fd-e7cc-47d4-9cfc-a73a7816bed0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:36.370072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f97c62fd-e7cc-47d4-9cfc-a73a7816bed0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:36.371062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f97c62fd-e7cc-47d4-9cfc-a73a7816bed0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:36.371895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f97c62fd-e7cc-47d4-9cfc-a73a7816bed0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:36.373355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f97c62fd-e7cc-47d4-9cfc-a73a7816bed0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:36.373816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f97c62fd-e7cc-47d4-9cfc-a73a7816bed0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:36.374429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f97c62fd-e7cc-47d4-9cfc-a73a7816bed0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:36.654448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b7716b3-6c0e-47ed-b298-bd99106fcdce tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:36.664203 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b7716b3-6c0e-47ed-b298-bd99106fcdce tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1665 microversion: 2.1 time: 0.935711 Aug 27 05:23:36.665789 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2753/5498] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:35 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1665 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:36.670245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-30b32e5a-487a-4c95-8e96-8283bab87af2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:36.670882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-30b32e5a-487a-4c95-8e96-8283bab87af2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:36.700135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30b32e5a-487a-4c95-8e96-8283bab87af2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:36.702035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30b32e5a-487a-4c95-8e96-8283bab87af2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:36.702826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30b32e5a-487a-4c95-8e96-8283bab87af2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:36.704148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30b32e5a-487a-4c95-8e96-8283bab87af2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:36.705015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30b32e5a-487a-4c95-8e96-8283bab87af2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:36.705749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30b32e5a-487a-4c95-8e96-8283bab87af2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:36.948952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f97c62fd-e7cc-47d4-9cfc-a73a7816bed0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:36.971323 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f97c62fd-e7cc-47d4-9cfc-a73a7816bed0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1683 microversion: 2.1 time: 0.618358 Aug 27 05:23:36.980629 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2746/5499] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:36 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1683 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:37.204785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-30b32e5a-487a-4c95-8e96-8283bab87af2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:37.217702 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-30b32e5a-487a-4c95-8e96-8283bab87af2 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1494 microversion: 2.1 time: 0.551031 Aug 27 05:23:37.218707 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2754/5500] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:36 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1494 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:37.385075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2dcbb3f8-397f-46b3-942f-e69979a897b5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:37.387720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2dcbb3f8-397f-46b3-942f-e69979a897b5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:37.397111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dcbb3f8-397f-46b3-942f-e69979a897b5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:37.397999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dcbb3f8-397f-46b3-942f-e69979a897b5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:37.400000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dcbb3f8-397f-46b3-942f-e69979a897b5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:37.400896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dcbb3f8-397f-46b3-942f-e69979a897b5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:37.401523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dcbb3f8-397f-46b3-942f-e69979a897b5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:37.402020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2dcbb3f8-397f-46b3-942f-e69979a897b5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:37.638518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2dcbb3f8-397f-46b3-942f-e69979a897b5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:37.652351 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2dcbb3f8-397f-46b3-942f-e69979a897b5 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1504 microversion: 2.1 time: 0.275800 Aug 27 05:23:37.655024 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2747/5501] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:37 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:37.703136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1306f9e-fe6c-432e-ac89-1991f51bb97c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:37.704289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d1306f9e-fe6c-432e-ac89-1991f51bb97c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:37.733441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1306f9e-fe6c-432e-ac89-1991f51bb97c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:37.734359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1306f9e-fe6c-432e-ac89-1991f51bb97c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:37.746886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1306f9e-fe6c-432e-ac89-1991f51bb97c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:37.752892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1306f9e-fe6c-432e-ac89-1991f51bb97c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:37.753894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1306f9e-fe6c-432e-ac89-1991f51bb97c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:37.754785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1306f9e-fe6c-432e-ac89-1991f51bb97c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.015131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-710c1336-962a-4654-9c9e-52a45221f8b9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:38.015723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-710c1336-962a-4654-9c9e-52a45221f8b9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:38.019013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:38.029631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-710c1336-962a-4654-9c9e-52a45221f8b9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.030215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-710c1336-962a-4654-9c9e-52a45221f8b9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.030636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-710c1336-962a-4654-9c9e-52a45221f8b9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.031607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-710c1336-962a-4654-9c9e-52a45221f8b9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.038618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-710c1336-962a-4654-9c9e-52a45221f8b9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.040845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-710c1336-962a-4654-9c9e-52a45221f8b9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.043076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d1306f9e-fe6c-432e-ac89-1991f51bb97c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:38.052531 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1306f9e-fe6c-432e-ac89-1991f51bb97c tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.355703 Aug 27 05:23:38.063774 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2755/5502] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:37 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:38.090459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9c7d6563-8136-4f90-b759-b7f75b0028cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:38.092101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9c7d6563-8136-4f90-b759-b7f75b0028cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:38.103964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c7d6563-8136-4f90-b759-b7f75b0028cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.104882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c7d6563-8136-4f90-b759-b7f75b0028cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.109134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c7d6563-8136-4f90-b759-b7f75b0028cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.110235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c7d6563-8136-4f90-b759-b7f75b0028cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.112203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c7d6563-8136-4f90-b759-b7f75b0028cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.113068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c7d6563-8136-4f90-b759-b7f75b0028cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.417614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-710c1336-962a-4654-9c9e-52a45221f8b9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:38.436440 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-710c1336-962a-4654-9c9e-52a45221f8b9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1683 microversion: 2.1 time: 0.424834 Aug 27 05:23:38.437854 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2748/5503] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:38 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1683 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:38.449041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce96c107-2d48-460b-b021-b6dbc647887b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:38.452051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ce96c107-2d48-460b-b021-b6dbc647887b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:38.465234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce96c107-2d48-460b-b021-b6dbc647887b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.465711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9c7d6563-8136-4f90-b759-b7f75b0028cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:38.467914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce96c107-2d48-460b-b021-b6dbc647887b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.469105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce96c107-2d48-460b-b021-b6dbc647887b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.472552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce96c107-2d48-460b-b021-b6dbc647887b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.473535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce96c107-2d48-460b-b021-b6dbc647887b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.474401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce96c107-2d48-460b-b021-b6dbc647887b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.482430 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9c7d6563-8136-4f90-b759-b7f75b0028cc tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1668 microversion: 2.1 time: 0.402003 Aug 27 05:23:38.495873 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2756/5504] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:38 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1668 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:38.526749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:38.528339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:38.538273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.539441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.540264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.541318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.542087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.542910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.611189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:23:38.625972 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.compute.api [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Working on deleting snapshot 81fa3642-986e-4b8e-9992-54d61c400287 from shelved instance... Aug 27 05:23:38.746982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce96c107-2d48-460b-b021-b6dbc647887b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:38.759003 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce96c107-2d48-460b-b021-b6dbc647887b tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1500 microversion: 2.1 time: 0.318780 Aug 27 05:23:38.760963 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2749/5505] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:38 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1500 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:38.766892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c2f6e40d-2214-42f4-87be-8b1c8837c296 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:38.768451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c2f6e40d-2214-42f4-87be-8b1c8837c296 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:38.791855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f6e40d-2214-42f4-87be-8b1c8837c296 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.792858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f6e40d-2214-42f4-87be-8b1c8837c296 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.793889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f6e40d-2214-42f4-87be-8b1c8837c296 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.795217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f6e40d-2214-42f4-87be-8b1c8837c296 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.796154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f6e40d-2214-42f4-87be-8b1c8837c296 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.796836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f6e40d-2214-42f4-87be-8b1c8837c296 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:39.076762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c2f6e40d-2214-42f4-87be-8b1c8837c296 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:39.087337 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c2f6e40d-2214-42f4-87be-8b1c8837c296 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1504 microversion: 2.1 time: 0.324496 Aug 27 05:23:39.088811 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2750/5506] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:38 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:39.100384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-71f9e58b-0fbd-4619-8484-10abcae4afc3 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:39.101516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-71f9e58b-0fbd-4619-8484-10abcae4afc3 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:39.111229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71f9e58b-0fbd-4619-8484-10abcae4afc3 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:39.112045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71f9e58b-0fbd-4619-8484-10abcae4afc3 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:39.112772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71f9e58b-0fbd-4619-8484-10abcae4afc3 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:39.113948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71f9e58b-0fbd-4619-8484-10abcae4afc3 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:39.114629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71f9e58b-0fbd-4619-8484-10abcae4afc3 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:39.115506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71f9e58b-0fbd-4619-8484-10abcae4afc3 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:39.189761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-71f9e58b-0fbd-4619-8484-10abcae4afc3 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:23:39.353645 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-71f9e58b-0fbd-4619-8484-10abcae4afc3 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "DELETE /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 204 len: 0 microversion: 2.1 time: 0.258626 Aug 27 05:23:39.354559 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2751/5507] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:23:39 2022] DELETE /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:23:39.375832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a55baa5d-33ac-4c40-92f9-cc0cd7ace005 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:39.378091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a55baa5d-33ac-4c40-92f9-cc0cd7ace005 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:39.408140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a55baa5d-33ac-4c40-92f9-cc0cd7ace005 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:39.408653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a55baa5d-33ac-4c40-92f9-cc0cd7ace005 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:39.409141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a55baa5d-33ac-4c40-92f9-cc0cd7ace005 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:39.409877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a55baa5d-33ac-4c40-92f9-cc0cd7ace005 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:39.410333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a55baa5d-33ac-4c40-92f9-cc0cd7ace005 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:39.410766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a55baa5d-33ac-4c40-92f9-cc0cd7ace005 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:39.678222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a55baa5d-33ac-4c40-92f9-cc0cd7ace005 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:39.695305 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a55baa5d-33ac-4c40-92f9-cc0cd7ace005 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.332585 Aug 27 05:23:39.720949 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2752/5508] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:39 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:39.732997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a167b42-70b1-4d4e-bccb-49c742948495 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:39.734367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a167b42-70b1-4d4e-bccb-49c742948495 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:39.743599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a167b42-70b1-4d4e-bccb-49c742948495 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:39.744887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a167b42-70b1-4d4e-bccb-49c742948495 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:39.745743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a167b42-70b1-4d4e-bccb-49c742948495 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:39.746762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a167b42-70b1-4d4e-bccb-49c742948495 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:39.747853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a167b42-70b1-4d4e-bccb-49c742948495 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:39.748606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a167b42-70b1-4d4e-bccb-49c742948495 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:39.799252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:39.814185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Doing local delete in cell ecb88950-d60d-4522-a7e8-290241d8d9e1(cell1) {{(pid=128547) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 05:23:39.816127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:39.816738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:39.817784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:39.818547 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.compute.api [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 05:23:39.831941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] deallocate_for_instance() {{(pid=128547) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 05:23:40.038026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1a167b42-70b1-4d4e-bccb-49c742948495 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:40.053319 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a167b42-70b1-4d4e-bccb-49c742948495 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1683 microversion: 2.1 time: 0.333029 Aug 27 05:23:40.054023 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2753/5509] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:39 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1683 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:40.126231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1338658a-8bc0-4777-98d6-419f7bb9db3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:40.127929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1338658a-8bc0-4777-98d6-419f7bb9db3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:40.142925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1338658a-8bc0-4777-98d6-419f7bb9db3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:40.144161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1338658a-8bc0-4777-98d6-419f7bb9db3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:40.145109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1338658a-8bc0-4777-98d6-419f7bb9db3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:40.147524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1338658a-8bc0-4777-98d6-419f7bb9db3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:40.148759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1338658a-8bc0-4777-98d6-419f7bb9db3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:40.149953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1338658a-8bc0-4777-98d6-419f7bb9db3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:40.445383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1338658a-8bc0-4777-98d6-419f7bb9db3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:40.468224 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1338658a-8bc0-4777-98d6-419f7bb9db3e tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1504 microversion: 2.1 time: 0.348729 Aug 27 05:23:40.472230 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2754/5510] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:40 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1504 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:40.734917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b8775f0-1863-4a64-bc8e-0a360391a8f6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:40.735936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b8775f0-1863-4a64-bc8e-0a360391a8f6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:40.753418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8775f0-1863-4a64-bc8e-0a360391a8f6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:40.754090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8775f0-1863-4a64-bc8e-0a360391a8f6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:40.754803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8775f0-1863-4a64-bc8e-0a360391a8f6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:40.755691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8775f0-1863-4a64-bc8e-0a360391a8f6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:40.756282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8775f0-1863-4a64-bc8e-0a360391a8f6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:40.757564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8775f0-1863-4a64-bc8e-0a360391a8f6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:40.811985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Updating instance_info_cache with network_info: [] {{(pid=128547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 05:23:41.134708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4b8775f0-1863-4a64-bc8e-0a360391a8f6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:41.143253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:41.150434 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b8775f0-1863-4a64-bc8e-0a360391a8f6 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.420171 Aug 27 05:23:41.151052 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2755/5511] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:40 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:41.171032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-48958468-92f9-4e42-a6ca-3b9752c0973b req-91b74347-95de-4763-a128-9e1196fe7472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abb808f-5833-4af2-ae6b-577b3e60b285", "name": "network-vif-deleted", "tag": "c21e77ce-5581-44cf-a085-9b6e6e7c151c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:41.206896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-48958468-92f9-4e42-a6ca-3b9752c0973b req-91b74347-95de-4763-a128-9e1196fe7472 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.207688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-48958468-92f9-4e42-a6ca-3b9752c0973b req-91b74347-95de-4763-a128-9e1196fe7472 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.208452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-48958468-92f9-4e42-a6ca-3b9752c0973b req-91b74347-95de-4763-a128-9e1196fe7472 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.230328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.compute.server_external_events [req-48958468-92f9-4e42-a6ca-3b9752c0973b req-91b74347-95de-4763-a128-9e1196fe7472 service nova] Unable to find a host for instance 2abb808f-5833-4af2-ae6b-577b3e60b285. Dropping event network-vif-deleted {{(pid=128548) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 05:23:41.231543 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-48958468-92f9-4e42-a6ca-3b9752c0973b req-91b74347-95de-4763-a128-9e1196fe7472 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.079052 Aug 27 05:23:41.235796 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2756/5512] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 05:23:41.251005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a59e132e-9ca7-4417-9f87-dfbd6a2c0717 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:41.252344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a59e132e-9ca7-4417-9f87-dfbd6a2c0717 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:41.273398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a59e132e-9ca7-4417-9f87-dfbd6a2c0717 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.274210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a59e132e-9ca7-4417-9f87-dfbd6a2c0717 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.274923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a59e132e-9ca7-4417-9f87-dfbd6a2c0717 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.279566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a59e132e-9ca7-4417-9f87-dfbd6a2c0717 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.283508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a59e132e-9ca7-4417-9f87-dfbd6a2c0717 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.284535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=14,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:41.284944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a59e132e-9ca7-4417-9f87-dfbd6a2c0717 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.333670 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-49040658-dfd2-49c0-a750-47bef76bf4cf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 204 len: 0 microversion: 2.1 time: 2.814499 Aug 27 05:23:41.334747 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2757/5513] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:23:38 2022] DELETE /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 0 bytes in 2817 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:23:41.341786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0541273d-66c1-4ff5-9ad7-f52765d7e582 req-3578d20a-917d-4f09-ba96-1983137407d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76770e46-1e02-436c-ae09-4a770da79b88", "name": "network-vif-deleted", "tag": "8decb08f-c993-49dc-a4c6-a94190131d0d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:41.355260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0541273d-66c1-4ff5-9ad7-f52765d7e582 req-3578d20a-917d-4f09-ba96-1983137407d4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.356506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0541273d-66c1-4ff5-9ad7-f52765d7e582 req-3578d20a-917d-4f09-ba96-1983137407d4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.357177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0541273d-66c1-4ff5-9ad7-f52765d7e582 req-3578d20a-917d-4f09-ba96-1983137407d4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.371652 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0541273d-66c1-4ff5-9ad7-f52765d7e582 req-3578d20a-917d-4f09-ba96-1983137407d4 service nova] Creating event network-vif-deleted:8decb08f-c993-49dc-a4c6-a94190131d0d for instance 76770e46-1e02-436c-ae09-4a770da79b88 on n-h2-820368-35 Aug 27 05:23:41.379821 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0541273d-66c1-4ff5-9ad7-f52765d7e582 req-3578d20a-917d-4f09-ba96-1983137407d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043564 Aug 27 05:23:41.380900 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2758/5514] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:41.389714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:41.391031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2abb808f-5833-4af2-ae6b-577b3e60b285] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:41.403910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.405678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.406133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.406858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.407521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.407951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.424097 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] HTTP exception thrown: Instance 2abb808f-5833-4af2-ae6b-577b3e60b285 could not be found. Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Request method failure captured: Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 HTTP/1.1 Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaf_zdSPUeOsoTLkhLQL1vTlNucAU1rurQ76_s_7oXcF2ursFV7TaLgonjCe-LOZpl42-Z1nMf9A0p5HI8wh23R0xdPIBi9qQEbYtSOcmXJv69LplvzQOu4_pC3DspVSvoXd-nW5ckUmdD57wX3cw_UIfJKHPOT6Ts6e_rIaD18Ozyo Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_57e6b379f0d24ec8aa6da3c4f01bdd7a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: dffafef392eb4e1fba13953f47b2d105 Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 2abb808f-5833-4af2-ae6b-577b3e60b285 could not be found. Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '2abb808f-5833-4af2-ae6b-577b3e60b285'} Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2abb808f-5833-4af2-ae6b-577b3e60b285 could not be found. Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abb808f-5833-4af2-ae6b-577b3e60b285 could not be found. Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:41.425878 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:41.430093 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:41.430093 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:41.430093 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:41.430093 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:23:41.430093 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:23:41.430093 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abb808f-5833-4af2-ae6b-577b3e60b285 could not be found. Aug 27 05:23:41.430093 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:41.430093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Returning 404 to user: Instance 2abb808f-5833-4af2-ae6b-577b3e60b285 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:23:41.430093 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3ba3e095-63a3-4aea-92bc-6ac2e5162f1f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285" status: 404 len: 111 microversion: 2.1 time: 0.045235 Aug 27 05:23:41.430093 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2759/5515] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:41 2022] GET /compute/v2.1/servers/2abb808f-5833-4af2-ae6b-577b3e60b285 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:23:41.442168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69d1115e-c5a5-4eef-b4d1-1cbd783b08a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:41.442803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-69d1115e-c5a5-4eef-b4d1-1cbd783b08a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:41.468022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69d1115e-c5a5-4eef-b4d1-1cbd783b08a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.469820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69d1115e-c5a5-4eef-b4d1-1cbd783b08a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.472369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69d1115e-c5a5-4eef-b4d1-1cbd783b08a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.475574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69d1115e-c5a5-4eef-b4d1-1cbd783b08a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.476245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69d1115e-c5a5-4eef-b4d1-1cbd783b08a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.476783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69d1115e-c5a5-4eef-b4d1-1cbd783b08a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.519512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-69d1115e-c5a5-4eef-b4d1-1cbd783b08a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:23:41.539439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a59e132e-9ca7-4417-9f87-dfbd6a2c0717 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:41.548520 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a59e132e-9ca7-4417-9f87-dfbd6a2c0717 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1683 microversion: 2.1 time: 0.311281 Aug 27 05:23:41.551715 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2757/5516] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:41 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1683 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:41.584522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:41.585292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:41.593184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.593866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.594652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.595398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.596086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.596715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.669740 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-69d1115e-c5a5-4eef-b4d1-1cbd783b08a5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 204 len: 0 microversion: 2.1 time: 0.231618 Aug 27 05:23:41.673787 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2760/5517] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:23:41 2022] DELETE /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:23:41.674439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.675044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.675507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.676542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lazy-loading 'fault' on Instance uuid 76770e46-1e02-436c-ae09-4a770da79b88 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:23:41.687251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e8f15ff-4fb3-4142-8298-c02f9703bb1a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:41.689734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1e8f15ff-4fb3-4142-8298-c02f9703bb1a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:41.699745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e8f15ff-4fb3-4142-8298-c02f9703bb1a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.700555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e8f15ff-4fb3-4142-8298-c02f9703bb1a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.701392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e8f15ff-4fb3-4142-8298-c02f9703bb1a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.702304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e8f15ff-4fb3-4142-8298-c02f9703bb1a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.703068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e8f15ff-4fb3-4142-8298-c02f9703bb1a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.703680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e8f15ff-4fb3-4142-8298-c02f9703bb1a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.739425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:41.751341 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5bc0fecf-81ad-404c-8e69-afe1cbddc755 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1304 microversion: 2.1 time: 0.195554 Aug 27 05:23:41.765661 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2758/5518] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:41 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1304 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:42.194056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eda6c575-e76e-4285-851a-571d1a0217f8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:42.195111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eda6c575-e76e-4285-851a-571d1a0217f8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:42.207983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eda6c575-e76e-4285-851a-571d1a0217f8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:42.208795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eda6c575-e76e-4285-851a-571d1a0217f8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:42.209270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eda6c575-e76e-4285-851a-571d1a0217f8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:42.210123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eda6c575-e76e-4285-851a-571d1a0217f8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:42.211785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eda6c575-e76e-4285-851a-571d1a0217f8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:42.213631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eda6c575-e76e-4285-851a-571d1a0217f8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:42.454225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1e8f15ff-4fb3-4142-8298-c02f9703bb1a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:42.475640 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e8f15ff-4fb3-4142-8298-c02f9703bb1a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1466 microversion: 2.1 time: 0.797040 Aug 27 05:23:42.478209 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2761/5519] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:41 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1466 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:42.578305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eda6c575-e76e-4285-851a-571d1a0217f8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:42.595249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-84071906-2e23-462e-b27c-92b8285e5359 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:42.596179 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eda6c575-e76e-4285-851a-571d1a0217f8 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1506 microversion: 2.1 time: 0.425878 Aug 27 05:23:42.598145 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2759/5520] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:42 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:42.600682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-84071906-2e23-462e-b27c-92b8285e5359 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:42.623521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84071906-2e23-462e-b27c-92b8285e5359 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:42.624315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84071906-2e23-462e-b27c-92b8285e5359 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:42.625072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84071906-2e23-462e-b27c-92b8285e5359 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:42.626586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84071906-2e23-462e-b27c-92b8285e5359 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:42.627942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84071906-2e23-462e-b27c-92b8285e5359 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:42.628845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84071906-2e23-462e-b27c-92b8285e5359 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:42.773797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-84071906-2e23-462e-b27c-92b8285e5359 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:42.795780 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-84071906-2e23-462e-b27c-92b8285e5359 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1615 microversion: 2.1 time: 0.210275 Aug 27 05:23:42.797358 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2762/5521] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:42 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1615 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:42.819729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:42.821890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:42.852413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:42.853831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:42.856052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:42.858705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:42.861157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:42.865528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:42.974127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:42.975550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:42.976211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:42.976954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lazy-loading 'fault' on Instance uuid 76770e46-1e02-436c-ae09-4a770da79b88 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:23:43.048717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b701aa5d2f4fd99bd24c11a86d6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547667fb95ff48be9cd32217fc8be158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:43.073990 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2b36203b-5d05-4137-a1f2-2fc1d181a8ad tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 200 len: 1304 microversion: 2.1 time: 0.280896 Aug 27 05:23:43.087826 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2760/5522] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:42 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:43.480561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-36ff8f2b-3fbd-45f1-9cb6-81b64ec272b7 req-6a54b223-1970-4c85-ae32-2fb3686e57e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b65010e-acb1-46b6-8da9-b4fef757aa02", "name": "network-vif-deleted", "tag": "084f17e4-c2d4-4f2f-8393-00bf8618d810"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:43.515574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-108b83e8-7bda-4e95-ab4f-6a31ef8a7c78 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:43.519533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-108b83e8-7bda-4e95-ab4f-6a31ef8a7c78 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:43.532017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-36ff8f2b-3fbd-45f1-9cb6-81b64ec272b7 req-6a54b223-1970-4c85-ae32-2fb3686e57e1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:43.533233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-36ff8f2b-3fbd-45f1-9cb6-81b64ec272b7 req-6a54b223-1970-4c85-ae32-2fb3686e57e1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:43.534327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-36ff8f2b-3fbd-45f1-9cb6-81b64ec272b7 req-6a54b223-1970-4c85-ae32-2fb3686e57e1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:43.549906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-108b83e8-7bda-4e95-ab4f-6a31ef8a7c78 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:43.550990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-108b83e8-7bda-4e95-ab4f-6a31ef8a7c78 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:43.551916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-108b83e8-7bda-4e95-ab4f-6a31ef8a7c78 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:43.553336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-108b83e8-7bda-4e95-ab4f-6a31ef8a7c78 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:43.556241 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-36ff8f2b-3fbd-45f1-9cb6-81b64ec272b7 req-6a54b223-1970-4c85-ae32-2fb3686e57e1 service nova] Creating event network-vif-deleted:084f17e4-c2d4-4f2f-8393-00bf8618d810 for instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 on n-h2-820368-35 Aug 27 05:23:43.556590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-108b83e8-7bda-4e95-ab4f-6a31ef8a7c78 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:43.557871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-108b83e8-7bda-4e95-ab4f-6a31ef8a7c78 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:43.563823 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-36ff8f2b-3fbd-45f1-9cb6-81b64ec272b7 req-6a54b223-1970-4c85-ae32-2fb3686e57e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106056 Aug 27 05:23:43.564795 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2763/5523] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:43.641039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-95ddafc7-fc12-4f65-bc73-3c996a9f354a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:43.648141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-95ddafc7-fc12-4f65-bc73-3c996a9f354a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:43.684224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95ddafc7-fc12-4f65-bc73-3c996a9f354a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:43.686266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95ddafc7-fc12-4f65-bc73-3c996a9f354a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:43.689516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95ddafc7-fc12-4f65-bc73-3c996a9f354a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:43.692749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95ddafc7-fc12-4f65-bc73-3c996a9f354a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:43.696428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95ddafc7-fc12-4f65-bc73-3c996a9f354a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:43.702401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95ddafc7-fc12-4f65-bc73-3c996a9f354a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:44.042897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-95ddafc7-fc12-4f65-bc73-3c996a9f354a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:44.082393 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-95ddafc7-fc12-4f65-bc73-3c996a9f354a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1464 microversion: 2.1 time: 0.449014 Aug 27 05:23:44.086311 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2764/5524] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:43 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1464 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:44.120302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:44.131608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:44.139553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-108b83e8-7bda-4e95-ab4f-6a31ef8a7c78 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:44.145476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:44.146523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:44.148061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:44.148891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:44.151852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:44.152918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:44.180716 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-108b83e8-7bda-4e95-ab4f-6a31ef8a7c78 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1466 microversion: 2.1 time: 0.674462 Aug 27 05:23:44.187203 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2761/5525] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:43 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1466 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:44.211133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d63126fa-4a67-4cbd-a3e4-84dcfbdf228c req-b25b2eea-2db8-48ff-bf59-f49117e5ea71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721805e0-68e3-41ab-9404-d4646c45a7a6", "name": "network-vif-deleted", "tag": "1c4dc8f7-81e9-4068-916f-9e9bdf9ae238"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:44.212902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:44.213530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:44.213996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:44.217676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lazy-loading 'fault' on Instance uuid 2b65010e-acb1-46b6-8da9-b4fef757aa02 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:23:44.235695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d63126fa-4a67-4cbd-a3e4-84dcfbdf228c req-b25b2eea-2db8-48ff-bf59-f49117e5ea71 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:44.241730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d63126fa-4a67-4cbd-a3e4-84dcfbdf228c req-b25b2eea-2db8-48ff-bf59-f49117e5ea71 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:44.246880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d63126fa-4a67-4cbd-a3e4-84dcfbdf228c req-b25b2eea-2db8-48ff-bf59-f49117e5ea71 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:44.276010 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d63126fa-4a67-4cbd-a3e4-84dcfbdf228c req-b25b2eea-2db8-48ff-bf59-f49117e5ea71 service nova] Creating event network-vif-deleted:1c4dc8f7-81e9-4068-916f-9e9bdf9ae238 for instance 721805e0-68e3-41ab-9404-d4646c45a7a6 on n-h1-820368-35 Aug 27 05:23:44.286812 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d63126fa-4a67-4cbd-a3e4-84dcfbdf228c req-b25b2eea-2db8-48ff-bf59-f49117e5ea71 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101907 Aug 27 05:23:44.288705 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2762/5526] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:44.302176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:44.305823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] [instance: 76770e46-1e02-436c-ae09-4a770da79b88] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:44.307879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:44.321877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:44.323512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:44.324538 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f1479ebb-87a9-48ed-84fc-f19834a2a722 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 200 len: 1332 microversion: 2.1 time: 0.236490 Aug 27 05:23:44.325382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:44.327209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:44.329070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:44.330577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:44.348501 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2765/5527] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:44 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 1332 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:44.366930 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] HTTP exception thrown: Instance 76770e46-1e02-436c-ae09-4a770da79b88 could not be found. Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Request method failure captured: Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 HTTP/1.1 Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCao9wZf7WUbordL2FzIQiNE81-cQhxCbxmofI7codJkQrshysmiv4yh_ErbbSDhzUJcC8zuyT8NIlXc2oyBzPC04uRQ0_6eX6akSXpNAD0tcXLnASlTrsMpCH9HBDKORM1nOSkaj3LYtxT2I16mIkDmbkyM3I8Is3xBpFhkB7kCWTGY Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 547667fb95ff48be9cd32217fc8be158 Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesActionsTest-468161504 Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_547667fb95ff48be9cd32217fc8be158", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/547667fb95ff48be9cd32217fc8be158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547667fb95ff48be9cd32217fc8be158"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547667fb95ff48be9cd32217fc8be158"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesActionsTest-468161504 Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 547667fb95ff48be9cd32217fc8be158 Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesActionsTest-468161504 Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesActionsTest-468161504-project Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 61b701aa5d2f4fd99bd24c11a86d6b82 Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesActionsTest-468161504-project Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 76770e46-1e02-436c-ae09-4a770da79b88 could not be found. Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '76770e46-1e02-436c-ae09-4a770da79b88'} Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76770e46-1e02-436c-ae09-4a770da79b88 could not be found. Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76770e46-1e02-436c-ae09-4a770da79b88 could not be found. Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:44.381546 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:44.387345 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:44.387345 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:44.387345 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:44.387345 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:23:44.387345 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:23:44.387345 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76770e46-1e02-436c-ae09-4a770da79b88 could not be found. Aug 27 05:23:44.387345 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:44.389779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] Returning 404 to user: Instance 76770e46-1e02-436c-ae09-4a770da79b88 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:23:44.394576 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b7ada5da-b5ef-41ff-b24d-56f793b8ba35 tempest-VolumesActionsTest-468161504 tempest-VolumesActionsTest-468161504-project] 10.222.0.58 "GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88" status: 404 len: 111 microversion: 2.1 time: 0.103590 Aug 27 05:23:44.395927 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2763/5528] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:44 2022] GET /compute/v2.1/servers/76770e46-1e02-436c-ae09-4a770da79b88 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:23:45.119942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:45.125041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:45.147562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:45.150410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:45.151286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:45.152739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:45.155653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:45.156305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:45.227372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-48baae28-1bdf-4b79-a56a-a6ccaac0b202 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:45.228673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-48baae28-1bdf-4b79-a56a-a6ccaac0b202 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:45.242748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48baae28-1bdf-4b79-a56a-a6ccaac0b202 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:45.246625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48baae28-1bdf-4b79-a56a-a6ccaac0b202 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:45.247907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48baae28-1bdf-4b79-a56a-a6ccaac0b202 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:45.249452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48baae28-1bdf-4b79-a56a-a6ccaac0b202 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:45.251956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48baae28-1bdf-4b79-a56a-a6ccaac0b202 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:45.253205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48baae28-1bdf-4b79-a56a-a6ccaac0b202 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:45.289609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:45.290815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:45.292780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:45.294119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lazy-loading 'fault' on Instance uuid 721805e0-68e3-41ab-9404-d4646c45a7a6 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:23:45.500151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:45.538793 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d6f3c7e9-82f8-4caa-8af7-91c9b881e40c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 200 len: 1304 microversion: 2.1 time: 0.425044 Aug 27 05:23:45.546623 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2766/5529] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:45 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 1304 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:45.561690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:45.563054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:45.579139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:45.582677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:45.584555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:45.587553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:45.588080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:45.588717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:45.618069 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 HTTP/1.1 Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '2b65010e-acb1-46b6-8da9-b4fef757aa02'} Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:45.620194 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:45.625341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:45.625341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:45.625341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:45.625341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:23:45.625341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:23:45.625341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:23:45.625341 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:45.626975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:23:45.628361 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7016eb6c-d5e5-4828-9e7b-d3a29f8d2832 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 404 len: 111 microversion: 2.1 time: 0.080320 Aug 27 05:23:45.633558 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2767/5530] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:45 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:23:45.639366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-af1e0334-6fd8-4b01-a151-8c1e6d3901b5 req-eff2d8f8-6efa-4289-8a7a-6613b5d4e214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f751f91-a14d-4ce3-9b0c-168021a057ab", "name": "network-vif-deleted", "tag": "a5fd331e-b6f2-418e-ac64-38398b561884"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:45.656381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-af1e0334-6fd8-4b01-a151-8c1e6d3901b5 req-eff2d8f8-6efa-4289-8a7a-6613b5d4e214 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:45.659450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-af1e0334-6fd8-4b01-a151-8c1e6d3901b5 req-eff2d8f8-6efa-4289-8a7a-6613b5d4e214 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:45.660201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-af1e0334-6fd8-4b01-a151-8c1e6d3901b5 req-eff2d8f8-6efa-4289-8a7a-6613b5d4e214 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:45.688443 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-af1e0334-6fd8-4b01-a151-8c1e6d3901b5 req-eff2d8f8-6efa-4289-8a7a-6613b5d4e214 service nova] Creating event network-vif-deleted:a5fd331e-b6f2-418e-ac64-38398b561884 for instance 2f751f91-a14d-4ce3-9b0c-168021a057ab on n-h2-820368-35 Aug 27 05:23:45.699704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-48baae28-1bdf-4b79-a56a-a6ccaac0b202 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:45.706090 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-af1e0334-6fd8-4b01-a151-8c1e6d3901b5 req-eff2d8f8-6efa-4289-8a7a-6613b5d4e214 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070885 Aug 27 05:23:45.719930 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2768/5531] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:45.726179 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-48baae28-1bdf-4b79-a56a-a6ccaac0b202 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1466 microversion: 2.1 time: 0.504117 Aug 27 05:23:45.728863 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2764/5532] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:45 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1466 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:45.733564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1eeb0a6-1d7b-43fa-a4dd-f4dde9d365fb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '.version_select at 0x7fb5640e3040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:45.788315 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1eeb0a6-1d7b-43fa-a4dd-f4dde9d365fb tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1168499899" status: 202 len: 0 microversion: 2.1 time: 0.060331 Aug 27 05:23:45.792994 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2769/5533] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 05:23:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1168499899 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:23:46.572065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:46.572984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 721805e0-68e3-41ab-9404-d4646c45a7a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:46.594722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:46.595564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:46.596186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:46.597128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:46.597767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:46.598365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:46.635904 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] HTTP exception thrown: Instance 721805e0-68e3-41ab-9404-d4646c45a7a6 could not be found. Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Request method failure captured: Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 HTTP/1.1 Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaneUp1sANw2s6q49j2yeP3gVRauxTZsAmb5pkKuy9hKqLOeHdjR-xf1d_3sPa6UBalY_HpSbb5_AH0Ngot_SJlq0sJx-zqrjgDoB53_86yH5g_CRcaK0kIt4-SSJ-1HvyMEe6VF9gE_bC2peDPu3PQo8xGg5I0cBZ8lchS94E4KgM4 Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: db6268ab038142ebaeebf7b7e9f83652 Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerRescueTestJSON-31955421 Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_db6268ab038142ebaeebf7b7e9f83652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/db6268ab038142ebaeebf7b7e9f83652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db6268ab038142ebaeebf7b7e9f83652"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db6268ab038142ebaeebf7b7e9f83652"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerRescueTestJSON-31955421 Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: db6268ab038142ebaeebf7b7e9f83652 Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerRescueTestJSON-31955421 Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerRescueTestJSON-31955421-project Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 3a3cf2d3ecdf4926b00d371bae8e40eb Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerRescueTestJSON-31955421-project Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 721805e0-68e3-41ab-9404-d4646c45a7a6 could not be found. Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '721805e0-68e3-41ab-9404-d4646c45a7a6'} Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 721805e0-68e3-41ab-9404-d4646c45a7a6 could not be found. Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 721805e0-68e3-41ab-9404-d4646c45a7a6 could not be found. Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:46.637820 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:46.641777 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:46.641777 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:46.641777 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:46.641777 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:23:46.641777 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:23:46.641777 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 721805e0-68e3-41ab-9404-d4646c45a7a6 could not be found. Aug 27 05:23:46.641777 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:46.643715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Returning 404 to user: Instance 721805e0-68e3-41ab-9404-d4646c45a7a6 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:23:46.645241 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-420d0bc8-6c65-47c6-a815-68cf6b8988c7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6" status: 404 len: 111 microversion: 2.1 time: 0.078886 Aug 27 05:23:46.656199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a0fafb3-801f-458e-8431-6ba3b6d62a41 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:46.657588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a0fafb3-801f-458e-8431-6ba3b6d62a41 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:46.661883 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2765/5534] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:46 2022] GET /compute/v2.1/servers/721805e0-68e3-41ab-9404-d4646c45a7a6 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:23:46.686594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0fafb3-801f-458e-8431-6ba3b6d62a41 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:46.687960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0fafb3-801f-458e-8431-6ba3b6d62a41 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:46.688428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0fafb3-801f-458e-8431-6ba3b6d62a41 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:46.689196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0fafb3-801f-458e-8431-6ba3b6d62a41 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:46.695788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0fafb3-801f-458e-8431-6ba3b6d62a41 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:46.696680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a0fafb3-801f-458e-8431-6ba3b6d62a41 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:46.752116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a0fafb3-801f-458e-8431-6ba3b6d62a41 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:23:46.795587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:46.804807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:46.819807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:46.820724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:46.823229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:46.827324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:46.828288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:46.829157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:46.939082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:46.939969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:46.947383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:46.954692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lazy-loading 'fault' on Instance uuid 2f751f91-a14d-4ce3-9b0c-168021a057ab {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:23:47.029346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:47.038973 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-807b04b7-c1ee-48ba-bae0-d6a2f054d43a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 200 len: 1305 microversion: 2.1 time: 0.280547 Aug 27 05:23:47.055968 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2766/5535] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:46 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 1305 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:47.073857 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a0fafb3-801f-458e-8431-6ba3b6d62a41 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "DELETE /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 204 len: 0 microversion: 2.1 time: 0.422509 Aug 27 05:23:47.080952 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2770/5536] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:23:46 2022] DELETE /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:23:47.087859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-efadb361-115d-4929-ad7f-f5bc17da635c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:47.088834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-efadb361-115d-4929-ad7f-f5bc17da635c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:47.097506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efadb361-115d-4929-ad7f-f5bc17da635c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:47.098002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efadb361-115d-4929-ad7f-f5bc17da635c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:47.098631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efadb361-115d-4929-ad7f-f5bc17da635c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:47.099646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efadb361-115d-4929-ad7f-f5bc17da635c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:47.100356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efadb361-115d-4929-ad7f-f5bc17da635c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:47.101116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efadb361-115d-4929-ad7f-f5bc17da635c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:47.494631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-efadb361-115d-4929-ad7f-f5bc17da635c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:47.513873 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-efadb361-115d-4929-ad7f-f5bc17da635c tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1491 microversion: 2.1 time: 0.430916 Aug 27 05:23:47.528719 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2767/5537] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:47 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1491 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:47.641780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db0fae93-5750-4457-9157-c111a108dc11 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:47.643406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-db0fae93-5750-4457-9157-c111a108dc11 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:47.656285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db0fae93-5750-4457-9157-c111a108dc11 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:47.657306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db0fae93-5750-4457-9157-c111a108dc11 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:47.657306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db0fae93-5750-4457-9157-c111a108dc11 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:47.658070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db0fae93-5750-4457-9157-c111a108dc11 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:47.659265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db0fae93-5750-4457-9157-c111a108dc11 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:47.659922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db0fae93-5750-4457-9157-c111a108dc11 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:47.822886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-db0fae93-5750-4457-9157-c111a108dc11 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lazy-loading 'services' on Instance uuid 4e12d584-d333-430d-aec1-67778b1f5575 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:23:47.969823 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db0fae93-5750-4457-9157-c111a108dc11 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments/fc243a4a-2e91-4757-95b5-c41f7d30e9f0" status: 202 len: 0 microversion: 2.1 time: 0.336823 Aug 27 05:23:47.970994 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2771/5538] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:23:47 2022] DELETE /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments/fc243a4a-2e91-4757-95b5-c41f7d30e9f0 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:23:47.983960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5547553c-e4d4-4af0-9ad8-edeb6007a59b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:47.986977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5547553c-e4d4-4af0-9ad8-edeb6007a59b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:48.014155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5547553c-e4d4-4af0-9ad8-edeb6007a59b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.014979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5547553c-e4d4-4af0-9ad8-edeb6007a59b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.015880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5547553c-e4d4-4af0-9ad8-edeb6007a59b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.017198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5547553c-e4d4-4af0-9ad8-edeb6007a59b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.018047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5547553c-e4d4-4af0-9ad8-edeb6007a59b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.018835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5547553c-e4d4-4af0-9ad8-edeb6007a59b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.076261 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5547553c-e4d4-4af0-9ad8-edeb6007a59b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097823 Aug 27 05:23:48.077453 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2768/5539] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:23:47 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:48.087180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:48.089243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: 2f751f91-a14d-4ce3-9b0c-168021a057ab] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:48.104860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.106872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.107697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.109098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.113322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.115068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.145977 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] HTTP exception thrown: Instance 2f751f91-a14d-4ce3-9b0c-168021a057ab could not be found. Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Request method failure captured: Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab HTTP/1.1 Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaf_zdSPUeOsoTLkhLQL1vTlNucAU1rurQ76_s_7oXcF2ursFV7TaLgonjCe-LOZpl42-Z1nMf9A0p5HI8wh23R0xdPIBi9qQEbYtSOcmXJv69LplvzQOu4_pC3DspVSvoXd-nW5ckUmdD57wX3cw_UIfJKHPOT6Ts6e_rIaD18Ozyo Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_57e6b379f0d24ec8aa6da3c4f01bdd7a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: dffafef392eb4e1fba13953f47b2d105 Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 2f751f91-a14d-4ce3-9b0c-168021a057ab could not be found. Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '2f751f91-a14d-4ce3-9b0c-168021a057ab'} Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f751f91-a14d-4ce3-9b0c-168021a057ab could not be found. Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f751f91-a14d-4ce3-9b0c-168021a057ab could not be found. Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:48.149624 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:48.154879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:48.154879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:48.154879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:48.154879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:23:48.154879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:23:48.154879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f751f91-a14d-4ce3-9b0c-168021a057ab could not be found. Aug 27 05:23:48.154879 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:48.154879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Returning 404 to user: Instance 2f751f91-a14d-4ce3-9b0c-168021a057ab could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:23:48.154879 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3ed4db38-8357-4594-b46b-19f5d8105474 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab" status: 404 len: 111 microversion: 2.1 time: 0.081741 Aug 27 05:23:48.155567 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2772/5540] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:48 2022] GET /compute/v2.1/servers/2f751f91-a14d-4ce3-9b0c-168021a057ab => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:23:48.164008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8687488-967a-459c-b69c-cc12a9c7519a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:48.164548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8687488-967a-459c-b69c-cc12a9c7519a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:48.174169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8687488-967a-459c-b69c-cc12a9c7519a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.174739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8687488-967a-459c-b69c-cc12a9c7519a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.175322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8687488-967a-459c-b69c-cc12a9c7519a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.176173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8687488-967a-459c-b69c-cc12a9c7519a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.176778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8687488-967a-459c-b69c-cc12a9c7519a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.177365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8687488-967a-459c-b69c-cc12a9c7519a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.218889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8687488-967a-459c-b69c-cc12a9c7519a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:23:48.349726 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8687488-967a-459c-b69c-cc12a9c7519a tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 204 len: 0 microversion: 2.1 time: 0.189709 Aug 27 05:23:48.351006 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2769/5541] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:23:48 2022] DELETE /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:23:48.364335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-20cacef2-9e46-4b20-80da-ebe4e67833ee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:48.365739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-20cacef2-9e46-4b20-80da-ebe4e67833ee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:48.398669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20cacef2-9e46-4b20-80da-ebe4e67833ee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.399973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20cacef2-9e46-4b20-80da-ebe4e67833ee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.408945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20cacef2-9e46-4b20-80da-ebe4e67833ee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.410546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20cacef2-9e46-4b20-80da-ebe4e67833ee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.412720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20cacef2-9e46-4b20-80da-ebe4e67833ee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.413914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20cacef2-9e46-4b20-80da-ebe4e67833ee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.545576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b9e7487-50ee-49c1-bc53-5a30a53280d7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:48.546712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b9e7487-50ee-49c1-bc53-5a30a53280d7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:48.581095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b9e7487-50ee-49c1-bc53-5a30a53280d7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.581646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b9e7487-50ee-49c1-bc53-5a30a53280d7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.584987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b9e7487-50ee-49c1-bc53-5a30a53280d7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.588936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b9e7487-50ee-49c1-bc53-5a30a53280d7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.592319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b9e7487-50ee-49c1-bc53-5a30a53280d7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.592814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b9e7487-50ee-49c1-bc53-5a30a53280d7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.637965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-20cacef2-9e46-4b20-80da-ebe4e67833ee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:48.645292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:DELETE=2,nova_cell1:SELECT=89,nova_cell1:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:48.653259 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-20cacef2-9e46-4b20-80da-ebe4e67833ee tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1507 microversion: 2.1 time: 0.297471 Aug 27 05:23:48.654977 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2773/5542] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:48 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1507 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:49.072228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4b9e7487-50ee-49c1-bc53-5a30a53280d7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:49.093170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-90aa07a2-0cb6-4f52-8f9b-df083b38d6bd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:49.097373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-90aa07a2-0cb6-4f52-8f9b-df083b38d6bd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:49.111868 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b9e7487-50ee-49c1-bc53-5a30a53280d7 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1491 microversion: 2.1 time: 0.573613 Aug 27 05:23:49.115847 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2770/5543] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:48 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1491 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:49.124799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90aa07a2-0cb6-4f52-8f9b-df083b38d6bd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:49.125302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90aa07a2-0cb6-4f52-8f9b-df083b38d6bd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:49.125752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90aa07a2-0cb6-4f52-8f9b-df083b38d6bd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:49.126474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90aa07a2-0cb6-4f52-8f9b-df083b38d6bd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:49.126950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90aa07a2-0cb6-4f52-8f9b-df083b38d6bd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:49.146165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90aa07a2-0cb6-4f52-8f9b-df083b38d6bd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:49.252216 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-90aa07a2-0cb6-4f52-8f9b-df083b38d6bd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161301 Aug 27 05:23:49.255040 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2774/5544] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:23:49 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:23:49.689349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c598f5c-b541-4565-b73a-dd9f15a9c679 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:49.690353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c598f5c-b541-4565-b73a-dd9f15a9c679 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:49.703926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c598f5c-b541-4565-b73a-dd9f15a9c679 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:49.705024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c598f5c-b541-4565-b73a-dd9f15a9c679 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:49.706967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c598f5c-b541-4565-b73a-dd9f15a9c679 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:49.708049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c598f5c-b541-4565-b73a-dd9f15a9c679 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:49.710665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c598f5c-b541-4565-b73a-dd9f15a9c679 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:49.711780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c598f5c-b541-4565-b73a-dd9f15a9c679 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:50.146360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c0587f45-0ac5-4a1b-b208-211512e659ac tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:50.147030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c0587f45-0ac5-4a1b-b208-211512e659ac tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:50.163653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0587f45-0ac5-4a1b-b208-211512e659ac tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:50.164177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0587f45-0ac5-4a1b-b208-211512e659ac tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:50.167130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0587f45-0ac5-4a1b-b208-211512e659ac tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:50.171409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0587f45-0ac5-4a1b-b208-211512e659ac tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:50.171817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0587f45-0ac5-4a1b-b208-211512e659ac tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:50.172290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c0587f45-0ac5-4a1b-b208-211512e659ac tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:50.794641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c598f5c-b541-4565-b73a-dd9f15a9c679 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:50.842631 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c598f5c-b541-4565-b73a-dd9f15a9c679 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1507 microversion: 2.1 time: 1.153327 Aug 27 05:23:50.847479 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2771/5545] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:49 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1507 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:50.878796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-921b9390-cf62-4375-a4d5-96c256dbc4dc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:50.891558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-921b9390-cf62-4375-a4d5-96c256dbc4dc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:50.943969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-921b9390-cf62-4375-a4d5-96c256dbc4dc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:50.945182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-921b9390-cf62-4375-a4d5-96c256dbc4dc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:50.951903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-921b9390-cf62-4375-a4d5-96c256dbc4dc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:50.953201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c0587f45-0ac5-4a1b-b208-211512e659ac tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:50.957696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-921b9390-cf62-4375-a4d5-96c256dbc4dc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:50.958527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-921b9390-cf62-4375-a4d5-96c256dbc4dc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:50.959323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-921b9390-cf62-4375-a4d5-96c256dbc4dc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:50.976846 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c0587f45-0ac5-4a1b-b208-211512e659ac tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1491 microversion: 2.1 time: 0.834728 Aug 27 05:23:51.000485 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2775/5546] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:50 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1491 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:51.071539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:51.171340 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-921b9390-cf62-4375-a4d5-96c256dbc4dc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.317864 Aug 27 05:23:51.175540 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2772/5547] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:23:50 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 197 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:51.478065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-a0de4a3b-c930-45ad-ad3d-9ada924c1fde req-454ecf67-870c-46fd-8a56-80aa920f6766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2bf712-7918-4d54-9359-83478697690e", "name": "network-vif-deleted", "tag": "f36bee86-0fde-4560-8a15-bee0fd5fcfed"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:51.547146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a0de4a3b-c930-45ad-ad3d-9ada924c1fde req-454ecf67-870c-46fd-8a56-80aa920f6766 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:51.571516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a0de4a3b-c930-45ad-ad3d-9ada924c1fde req-454ecf67-870c-46fd-8a56-80aa920f6766 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:51.578741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a0de4a3b-c930-45ad-ad3d-9ada924c1fde req-454ecf67-870c-46fd-8a56-80aa920f6766 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:51.617082 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-a0de4a3b-c930-45ad-ad3d-9ada924c1fde req-454ecf67-870c-46fd-8a56-80aa920f6766 service nova] Creating event network-vif-deleted:f36bee86-0fde-4560-8a15-bee0fd5fcfed for instance ef2bf712-7918-4d54-9359-83478697690e on n-h2-820368-35 Aug 27 05:23:51.664159 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-a0de4a3b-c930-45ad-ad3d-9ada924c1fde req-454ecf67-870c-46fd-8a56-80aa920f6766 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164304 Aug 27 05:23:51.667209 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2776/5548] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 05:23:51.883202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:51.884591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:51.903990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:51.904666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:51.912040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:51.917957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:51.918650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:51.919471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:52.025687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-505f1142-46f3-48e2-b104-9f537bcde80a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:52.026971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-505f1142-46f3-48e2-b104-9f537bcde80a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:52.051395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-505f1142-46f3-48e2-b104-9f537bcde80a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:52.052889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-505f1142-46f3-48e2-b104-9f537bcde80a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:52.056534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-505f1142-46f3-48e2-b104-9f537bcde80a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:52.061182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-505f1142-46f3-48e2-b104-9f537bcde80a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:52.063514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-505f1142-46f3-48e2-b104-9f537bcde80a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:52.066722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-505f1142-46f3-48e2-b104-9f537bcde80a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:52.087805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:52.093671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:52.094723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:52.102119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lazy-loading 'fault' on Instance uuid ef2bf712-7918-4d54-9359-83478697690e {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:23:52.327046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:52.351907 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e8c3159e-bbe9-4ccb-9f25-1c8f6015ccd9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 200 len: 1305 microversion: 2.1 time: 0.470742 Aug 27 05:23:52.354743 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2773/5549] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:51 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 1305 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:23:52.364807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4fc93353-28cb-44f4-88b3-7fa42b506bdd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:52.369668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4fc93353-28cb-44f4-88b3-7fa42b506bdd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:52.407076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fc93353-28cb-44f4-88b3-7fa42b506bdd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:52.408576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fc93353-28cb-44f4-88b3-7fa42b506bdd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:52.411816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fc93353-28cb-44f4-88b3-7fa42b506bdd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:52.414072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fc93353-28cb-44f4-88b3-7fa42b506bdd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:52.414790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fc93353-28cb-44f4-88b3-7fa42b506bdd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:52.416875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fc93353-28cb-44f4-88b3-7fa42b506bdd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:52.459536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-505f1142-46f3-48e2-b104-9f537bcde80a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:52.477929 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-505f1142-46f3-48e2-b104-9f537bcde80a tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1449 microversion: 2.1 time: 0.455521 Aug 27 05:23:52.480270 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2777/5550] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:52 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1449 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:52.579805 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4fc93353-28cb-44f4-88b3-7fa42b506bdd tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.223454 Aug 27 05:23:52.583516 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2774/5551] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:23:52 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:52.610731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1ee078be-39f6-494a-a6d0-bf4ae1563462 req-0fd740b6-1013-441b-bbd5-01f49751d96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026b42a7-c019-4db8-b5d2-42c82c212c1a", "name": "network-vif-deleted", "tag": "b6ee8e9b-a599-4264-a984-05c7fc080a2f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:52.654162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1ee078be-39f6-494a-a6d0-bf4ae1563462 req-0fd740b6-1013-441b-bbd5-01f49751d96e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:52.657363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1ee078be-39f6-494a-a6d0-bf4ae1563462 req-0fd740b6-1013-441b-bbd5-01f49751d96e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:52.658337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1ee078be-39f6-494a-a6d0-bf4ae1563462 req-0fd740b6-1013-441b-bbd5-01f49751d96e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:52.702299 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1ee078be-39f6-494a-a6d0-bf4ae1563462 req-0fd740b6-1013-441b-bbd5-01f49751d96e service nova] Creating event network-vif-deleted:b6ee8e9b-a599-4264-a984-05c7fc080a2f for instance 026b42a7-c019-4db8-b5d2-42c82c212c1a on n-h1-820368-35 Aug 27 05:23:52.712484 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1ee078be-39f6-494a-a6d0-bf4ae1563462 req-0fd740b6-1013-441b-bbd5-01f49751d96e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105648 Aug 27 05:23:52.716168 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2778/5552] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:53.394018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:53.397251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: ef2bf712-7918-4d54-9359-83478697690e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:53.435141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.439233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.440481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.442614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.470806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.475983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.504233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:53.505791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:53.526346 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] HTTP exception thrown: Instance ef2bf712-7918-4d54-9359-83478697690e could not be found. Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Request method failure captured: Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e HTTP/1.1 Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaf_zdSPUeOsoTLkhLQL1vTlNucAU1rurQ76_s_7oXcF2ursFV7TaLgonjCe-LOZpl42-Z1nMf9A0p5HI8wh23R0xdPIBi9qQEbYtSOcmXJv69LplvzQOu4_pC3DspVSvoXd-nW5ckUmdD57wX3cw_UIfJKHPOT6Ts6e_rIaD18Ozyo Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_57e6b379f0d24ec8aa6da3c4f01bdd7a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: dffafef392eb4e1fba13953f47b2d105 Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance ef2bf712-7918-4d54-9359-83478697690e could not be found. Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'ef2bf712-7918-4d54-9359-83478697690e'} Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef2bf712-7918-4d54-9359-83478697690e could not be found. Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef2bf712-7918-4d54-9359-83478697690e could not be found. Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:53.529827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:53.538068 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:53.538068 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:53.538068 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:53.538068 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:23:53.538068 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:23:53.538068 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef2bf712-7918-4d54-9359-83478697690e could not be found. Aug 27 05:23:53.538068 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:23:53.540480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Returning 404 to user: Instance ef2bf712-7918-4d54-9359-83478697690e could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:23:53.541140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.542350 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2af8d855-dc2c-4614-be34-d78153d3f420 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e" status: 404 len: 111 microversion: 2.1 time: 0.162496 Aug 27 05:23:53.542988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.549063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.550105 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2775/5553] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:53 2022] GET /compute/v2.1/servers/ef2bf712-7918-4d54-9359-83478697690e => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:23:53.550421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.553226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.556740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.559986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1acff1a8-ada5-4751-8d60-578f72f00e72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:53.561105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1acff1a8-ada5-4751-8d60-578f72f00e72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:53.569097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1acff1a8-ada5-4751-8d60-578f72f00e72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.570373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1acff1a8-ada5-4751-8d60-578f72f00e72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.571401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1acff1a8-ada5-4751-8d60-578f72f00e72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.572701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1acff1a8-ada5-4751-8d60-578f72f00e72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.573376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1acff1a8-ada5-4751-8d60-578f72f00e72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.574044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1acff1a8-ada5-4751-8d60-578f72f00e72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.662835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1acff1a8-ada5-4751-8d60-578f72f00e72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:23:53.680536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.682757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.685089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.687771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lazy-loading 'fault' on Instance uuid 026b42a7-c019-4db8-b5d2-42c82c212c1a {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:23:53.816003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3cf2d3ecdf4926b00d371bae8e40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6268ab038142ebaeebf7b7e9f83652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:53.827950 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-91685e44-7f92-4c1a-b0e1-5ba20da5f552 tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 200 len: 1303 microversion: 2.1 time: 0.326781 Aug 27 05:23:53.830909 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2779/5554] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:53 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 1303 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:53.848183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-939d6162-5567-45fa-ba96-3b89ac8ead2e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:53.851004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-939d6162-5567-45fa-ba96-3b89ac8ead2e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:53.864936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-939d6162-5567-45fa-ba96-3b89ac8ead2e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.868611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-939d6162-5567-45fa-ba96-3b89ac8ead2e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.870423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-939d6162-5567-45fa-ba96-3b89ac8ead2e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.871506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-939d6162-5567-45fa-ba96-3b89ac8ead2e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.875182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-939d6162-5567-45fa-ba96-3b89ac8ead2e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.876201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-939d6162-5567-45fa-ba96-3b89ac8ead2e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.910109 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1acff1a8-ada5-4751-8d60-578f72f00e72 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 204 len: 0 microversion: 2.1 time: 0.357686 Aug 27 05:23:53.914499 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2776/5555] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:23:53 2022] DELETE /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:23:53.925924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88c6fa9b-6273-4a85-87d8-18f60ae49827 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:53.926952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-88c6fa9b-6273-4a85-87d8-18f60ae49827 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:53.933895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88c6fa9b-6273-4a85-87d8-18f60ae49827 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.934804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88c6fa9b-6273-4a85-87d8-18f60ae49827 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.935774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88c6fa9b-6273-4a85-87d8-18f60ae49827 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.936767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88c6fa9b-6273-4a85-87d8-18f60ae49827 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.937409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88c6fa9b-6273-4a85-87d8-18f60ae49827 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.939134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88c6fa9b-6273-4a85-87d8-18f60ae49827 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.958851 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-939d6162-5567-45fa-ba96-3b89ac8ead2e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125919 Aug 27 05:23:53.964738 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2780/5556] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:23:53 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:54.429850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-88c6fa9b-6273-4a85-87d8-18f60ae49827 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:54.467140 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88c6fa9b-6273-4a85-87d8-18f60ae49827 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1493 microversion: 2.1 time: 0.546691 Aug 27 05:23:54.471616 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2777/5557] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:53 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1493 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:54.858993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:54.859907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] [instance: 026b42a7-c019-4db8-b5d2-42c82c212c1a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:54.899658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:54.901217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:54.906889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:54.908040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:54.910347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:54.913330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:54.977564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f0e259c7-1e78-49b4-ac77-adfd52ba224c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:54.981786 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] HTTP exception thrown: Instance 026b42a7-c019-4db8-b5d2-42c82c212c1a could not be found. Aug 27 05:23:54.988419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f0e259c7-1e78-49b4-ac77-adfd52ba224c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Request method failure captured: Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a HTTP/1.1 Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaneUp1sANw2s6q49j2yeP3gVRauxTZsAmb5pkKuy9hKqLOeHdjR-xf1d_3sPa6UBalY_HpSbb5_AH0Ngot_SJlq0sJx-zqrjgDoB53_86yH5g_CRcaK0kIt4-SSJ-1HvyMEe6VF9gE_bC2peDPu3PQo8xGg5I0cBZ8lchS94E4KgM4 Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: db6268ab038142ebaeebf7b7e9f83652 Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerRescueTestJSON-31955421 Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_db6268ab038142ebaeebf7b7e9f83652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/db6268ab038142ebaeebf7b7e9f83652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db6268ab038142ebaeebf7b7e9f83652"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db6268ab038142ebaeebf7b7e9f83652"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerRescueTestJSON-31955421 Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: db6268ab038142ebaeebf7b7e9f83652 Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerRescueTestJSON-31955421 Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerRescueTestJSON-31955421-project Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 3a3cf2d3ecdf4926b00d371bae8e40eb Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerRescueTestJSON-31955421-project Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 026b42a7-c019-4db8-b5d2-42c82c212c1a could not be found. Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '026b42a7-c019-4db8-b5d2-42c82c212c1a'} Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026b42a7-c019-4db8-b5d2-42c82c212c1a could not be found. Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026b42a7-c019-4db8-b5d2-42c82c212c1a could not be found. Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:54.993098 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:55.001545 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:55.001545 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:55.001545 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:55.001545 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:23:55.001545 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:23:55.001545 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026b42a7-c019-4db8-b5d2-42c82c212c1a could not be found. Aug 27 05:23:55.001545 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:55.005450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] Returning 404 to user: Instance 026b42a7-c019-4db8-b5d2-42c82c212c1a could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:23:55.011008 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb0e4d83-b4bc-4977-b695-3213c15d23bf tempest-ServerRescueTestJSON-31955421 tempest-ServerRescueTestJSON-31955421-project] 10.222.0.58 "GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a" status: 404 len: 111 microversion: 2.1 time: 0.156145 Aug 27 05:23:55.014811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0e259c7-1e78-49b4-ac77-adfd52ba224c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:55.017607 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2781/5558] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:54 2022] GET /compute/v2.1/servers/026b42a7-c019-4db8-b5d2-42c82c212c1a => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:23:55.018502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0e259c7-1e78-49b4-ac77-adfd52ba224c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:55.043595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0e259c7-1e78-49b4-ac77-adfd52ba224c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:55.058966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0e259c7-1e78-49b4-ac77-adfd52ba224c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:55.060636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0e259c7-1e78-49b4-ac77-adfd52ba224c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:55.066571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f0e259c7-1e78-49b4-ac77-adfd52ba224c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:55.239718 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f0e259c7-1e78-49b4-ac77-adfd52ba224c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.270860 Aug 27 05:23:55.260297 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2778/5559] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:23:54 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 197 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:55.495302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-382e2446-f87a-4c2a-898d-88f763521e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:55.496032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-382e2446-f87a-4c2a-898d-88f763521e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:55.537025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-382e2446-f87a-4c2a-898d-88f763521e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:55.540321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-382e2446-f87a-4c2a-898d-88f763521e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:55.544754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-382e2446-f87a-4c2a-898d-88f763521e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:55.548123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-382e2446-f87a-4c2a-898d-88f763521e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:55.548630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-382e2446-f87a-4c2a-898d-88f763521e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:55.549174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-382e2446-f87a-4c2a-898d-88f763521e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:56.034098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-382e2446-f87a-4c2a-898d-88f763521e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:56.052720 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-382e2446-f87a-4c2a-898d-88f763521e36 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1493 microversion: 2.1 time: 0.561418 Aug 27 05:23:56.078554 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2782/5560] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:55 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1493 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:56.281498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c63c2d1-2925-41e5-95fd-77421e81e370 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:56.284501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c63c2d1-2925-41e5-95fd-77421e81e370 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:56.304886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c63c2d1-2925-41e5-95fd-77421e81e370 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:56.306101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c63c2d1-2925-41e5-95fd-77421e81e370 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:56.307666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c63c2d1-2925-41e5-95fd-77421e81e370 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:56.313270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c63c2d1-2925-41e5-95fd-77421e81e370 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:56.314641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c63c2d1-2925-41e5-95fd-77421e81e370 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:56.316106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c63c2d1-2925-41e5-95fd-77421e81e370 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:56.413920 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c63c2d1-2925-41e5-95fd-77421e81e370 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139586 Aug 27 05:23:56.424705 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2779/5561] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:23:56 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:57.102403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-868f8086-8c54-4382-b7c7-22c9984d7c01 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:57.103330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-868f8086-8c54-4382-b7c7-22c9984d7c01 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:57.144270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-868f8086-8c54-4382-b7c7-22c9984d7c01 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:57.147137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-868f8086-8c54-4382-b7c7-22c9984d7c01 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:57.148844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-868f8086-8c54-4382-b7c7-22c9984d7c01 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:57.149837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-868f8086-8c54-4382-b7c7-22c9984d7c01 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:57.152493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-868f8086-8c54-4382-b7c7-22c9984d7c01 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:57.154391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-868f8086-8c54-4382-b7c7-22c9984d7c01 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:57.214323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-cd6bcd67-5582-48d7-9bc2-1dfc567005bd req-4a1d26d4-9413-49b4-88a7-0805509f859d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5570542-581a-4be3-ac36-958065bdd4cd", "name": "network-vif-deleted", "tag": "91d83644-e5b1-445e-a793-08d3bb22236b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:57.254841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cd6bcd67-5582-48d7-9bc2-1dfc567005bd req-4a1d26d4-9413-49b4-88a7-0805509f859d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:57.261806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cd6bcd67-5582-48d7-9bc2-1dfc567005bd req-4a1d26d4-9413-49b4-88a7-0805509f859d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:57.262952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cd6bcd67-5582-48d7-9bc2-1dfc567005bd req-4a1d26d4-9413-49b4-88a7-0805509f859d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:57.332209 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-cd6bcd67-5582-48d7-9bc2-1dfc567005bd req-4a1d26d4-9413-49b4-88a7-0805509f859d service nova] Creating event network-vif-deleted:91d83644-e5b1-445e-a793-08d3bb22236b for instance a5570542-581a-4be3-ac36-958065bdd4cd on n-h2-820368-35 Aug 27 05:23:57.360197 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-cd6bcd67-5582-48d7-9bc2-1dfc567005bd req-4a1d26d4-9413-49b4-88a7-0805509f859d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151879 Aug 27 05:23:57.366488 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2780/5562] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:57.446909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e0df768a-7255-4dfd-a6c4-413a2c0ae33f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:57.454377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-868f8086-8c54-4382-b7c7-22c9984d7c01 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:57.460894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e0df768a-7255-4dfd-a6c4-413a2c0ae33f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:57.493383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0df768a-7255-4dfd-a6c4-413a2c0ae33f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:57.494145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0df768a-7255-4dfd-a6c4-413a2c0ae33f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:57.498644 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-868f8086-8c54-4382-b7c7-22c9984d7c01 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 200 len: 1451 microversion: 2.1 time: 0.397271 Aug 27 05:23:57.510944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0df768a-7255-4dfd-a6c4-413a2c0ae33f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:57.512411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0df768a-7255-4dfd-a6c4-413a2c0ae33f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:57.521545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0df768a-7255-4dfd-a6c4-413a2c0ae33f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:57.523653 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2783/5563] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:57 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 1451 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:57.523993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0df768a-7255-4dfd-a6c4-413a2c0ae33f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:57.737500 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e0df768a-7255-4dfd-a6c4-413a2c0ae33f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.284960 Aug 27 05:23:57.740233 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2781/5564] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:23:57 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 197 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:58.536947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:58.538381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: a5570542-581a-4be3-ac36-958065bdd4cd] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:58.546320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:58.547050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:58.547710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:58.548604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:58.549222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:58.549804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:58.581911 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] HTTP exception thrown: Instance a5570542-581a-4be3-ac36-958065bdd4cd could not be found. Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Request method failure captured: Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd HTTP/1.1 Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaf_zdSPUeOsoTLkhLQL1vTlNucAU1rurQ76_s_7oXcF2ursFV7TaLgonjCe-LOZpl42-Z1nMf9A0p5HI8wh23R0xdPIBi9qQEbYtSOcmXJv69LplvzQOu4_pC3DspVSvoXd-nW5ckUmdD57wX3cw_UIfJKHPOT6Ts6e_rIaD18Ozyo Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_57e6b379f0d24ec8aa6da3c4f01bdd7a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: dffafef392eb4e1fba13953f47b2d105 Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance a5570542-581a-4be3-ac36-958065bdd4cd could not be found. Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'a5570542-581a-4be3-ac36-958065bdd4cd'} Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5570542-581a-4be3-ac36-958065bdd4cd could not be found. Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5570542-581a-4be3-ac36-958065bdd4cd could not be found. Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:23:58.588691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:58.596823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:23:58.596823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:23:58.596823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:23:58.596823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:23:58.596823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:23:58.596823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5570542-581a-4be3-ac36-958065bdd4cd could not be found. Aug 27 05:23:58.596823 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:23:58.596823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Returning 404 to user: Instance a5570542-581a-4be3-ac36-958065bdd4cd could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:23:58.596823 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6a6df2d3-6943-4514-9917-6bfdb1122388 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd" status: 404 len: 111 microversion: 2.1 time: 0.062894 Aug 27 05:23:58.600523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0c31a59e-41b1-4406-bb04-f1f9fe6d4fe9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:58.600523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c31a59e-41b1-4406-bb04-f1f9fe6d4fe9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:58.614563 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2784/5565] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:58 2022] GET /compute/v2.1/servers/a5570542-581a-4be3-ac36-958065bdd4cd => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:23:58.616065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c31a59e-41b1-4406-bb04-f1f9fe6d4fe9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:58.616470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c31a59e-41b1-4406-bb04-f1f9fe6d4fe9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:58.616920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c31a59e-41b1-4406-bb04-f1f9fe6d4fe9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:58.617645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c31a59e-41b1-4406-bb04-f1f9fe6d4fe9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:58.618162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c31a59e-41b1-4406-bb04-f1f9fe6d4fe9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:58.618871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c31a59e-41b1-4406-bb04-f1f9fe6d4fe9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:58.696344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c31a59e-41b1-4406-bb04-f1f9fe6d4fe9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:23:58.756308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-120ac657-7eee-4a7a-8dab-52621d1c8dd6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:58.759040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-120ac657-7eee-4a7a-8dab-52621d1c8dd6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:58.788994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-120ac657-7eee-4a7a-8dab-52621d1c8dd6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:58.789758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-120ac657-7eee-4a7a-8dab-52621d1c8dd6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:58.790358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-120ac657-7eee-4a7a-8dab-52621d1c8dd6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:58.791287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-120ac657-7eee-4a7a-8dab-52621d1c8dd6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:58.791904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-120ac657-7eee-4a7a-8dab-52621d1c8dd6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:58.792539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-120ac657-7eee-4a7a-8dab-52621d1c8dd6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:58.892091 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-120ac657-7eee-4a7a-8dab-52621d1c8dd6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143857 Aug 27 05:23:58.899970 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2785/5566] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:23:58 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:58.917358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:58.928325 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0c31a59e-41b1-4406-bb04-f1f9fe6d4fe9 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 204 len: 0 microversion: 2.1 time: 0.332919 Aug 27 05:23:58.939409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-375fde24-f9aa-4d11-b5a8-1676792fed4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:58.941137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-375fde24-f9aa-4d11-b5a8-1676792fed4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:58.943202 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2782/5567] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:23:58 2022] DELETE /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:23:58.953803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375fde24-f9aa-4d11-b5a8-1676792fed4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:58.955001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375fde24-f9aa-4d11-b5a8-1676792fed4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:58.956040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375fde24-f9aa-4d11-b5a8-1676792fed4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:58.957589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375fde24-f9aa-4d11-b5a8-1676792fed4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:58.958678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375fde24-f9aa-4d11-b5a8-1676792fed4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:58.959602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-375fde24-f9aa-4d11-b5a8-1676792fed4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:59.452002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-375fde24-f9aa-4d11-b5a8-1676792fed4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:59.461951 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-375fde24-f9aa-4d11-b5a8-1676792fed4f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1674 microversion: 2.1 time: 0.527834 Aug 27 05:23:59.472162 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2786/5568] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:58 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1674 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:59.913287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-73eb9280-f992-4a4d-aa5a-0d5e83447dc8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:59.915875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-73eb9280-f992-4a4d-aa5a-0d5e83447dc8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:59.941752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73eb9280-f992-4a4d-aa5a-0d5e83447dc8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:59.942270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73eb9280-f992-4a4d-aa5a-0d5e83447dc8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:59.942725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73eb9280-f992-4a4d-aa5a-0d5e83447dc8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:59.943509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73eb9280-f992-4a4d-aa5a-0d5e83447dc8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:59.943981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73eb9280-f992-4a4d-aa5a-0d5e83447dc8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:59.944428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73eb9280-f992-4a4d-aa5a-0d5e83447dc8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:00.016493 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-73eb9280-f992-4a4d-aa5a-0d5e83447dc8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108407 Aug 27 05:24:00.021667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2783/5569] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:23:59 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:24:00.499976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b813897f-2d43-4206-a5a1-1f5adc28202f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:00.501235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b813897f-2d43-4206-a5a1-1f5adc28202f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:00.520390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b813897f-2d43-4206-a5a1-1f5adc28202f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:00.521287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b813897f-2d43-4206-a5a1-1f5adc28202f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:00.521901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b813897f-2d43-4206-a5a1-1f5adc28202f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:00.522947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b813897f-2d43-4206-a5a1-1f5adc28202f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:00.523599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b813897f-2d43-4206-a5a1-1f5adc28202f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:00.524186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b813897f-2d43-4206-a5a1-1f5adc28202f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:01.029032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cce88a7f-be2f-4d09-bbc0-13e061d053fe tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:01.031939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cce88a7f-be2f-4d09-bbc0-13e061d053fe tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:01.051890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce88a7f-be2f-4d09-bbc0-13e061d053fe tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:01.054884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce88a7f-be2f-4d09-bbc0-13e061d053fe tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:01.055546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce88a7f-be2f-4d09-bbc0-13e061d053fe tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:01.061034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce88a7f-be2f-4d09-bbc0-13e061d053fe tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:01.061713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce88a7f-be2f-4d09-bbc0-13e061d053fe tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:01.062330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cce88a7f-be2f-4d09-bbc0-13e061d053fe tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:01.123896 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cce88a7f-be2f-4d09-bbc0-13e061d053fe tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099183 Aug 27 05:24:01.129872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b813897f-2d43-4206-a5a1-1f5adc28202f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:01.132722 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2784/5570] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:24:01 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:24:01.144008 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b813897f-2d43-4206-a5a1-1f5adc28202f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1674 microversion: 2.1 time: 0.650669 Aug 27 05:24:01.145046 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2787/5571] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:00 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1674 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:02.140887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e69eaa2e-fbd0-41fd-9f3a-e01d76f03ef6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:02.143305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e69eaa2e-fbd0-41fd-9f3a-e01d76f03ef6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:02.171678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57aaeab6-fd02-483f-b9a1-8a00e810a0e5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:02.172410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e69eaa2e-fbd0-41fd-9f3a-e01d76f03ef6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:02.172410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e69eaa2e-fbd0-41fd-9f3a-e01d76f03ef6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:02.172771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e69eaa2e-fbd0-41fd-9f3a-e01d76f03ef6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:02.172948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-57aaeab6-fd02-483f-b9a1-8a00e810a0e5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:02.173475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e69eaa2e-fbd0-41fd-9f3a-e01d76f03ef6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:02.173935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e69eaa2e-fbd0-41fd-9f3a-e01d76f03ef6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:02.174370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e69eaa2e-fbd0-41fd-9f3a-e01d76f03ef6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:02.203031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57aaeab6-fd02-483f-b9a1-8a00e810a0e5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:02.205113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57aaeab6-fd02-483f-b9a1-8a00e810a0e5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:02.206873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57aaeab6-fd02-483f-b9a1-8a00e810a0e5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:02.209479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57aaeab6-fd02-483f-b9a1-8a00e810a0e5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:02.210967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57aaeab6-fd02-483f-b9a1-8a00e810a0e5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:02.216102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57aaeab6-fd02-483f-b9a1-8a00e810a0e5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:02.256634 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e69eaa2e-fbd0-41fd-9f3a-e01d76f03ef6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122941 Aug 27 05:24:02.263533 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2785/5572] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:24:02 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:24:02.410294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4532cb9e-029b-4974-b472-668067e0fb4f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:02.410969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4532cb9e-029b-4974-b472-668067e0fb4f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:02.422333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4532cb9e-029b-4974-b472-668067e0fb4f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:02.423413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4532cb9e-029b-4974-b472-668067e0fb4f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:02.424222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4532cb9e-029b-4974-b472-668067e0fb4f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:02.425717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4532cb9e-029b-4974-b472-668067e0fb4f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:02.426347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4532cb9e-029b-4974-b472-668067e0fb4f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:02.427265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4532cb9e-029b-4974-b472-668067e0fb4f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:02.508922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4532cb9e-029b-4974-b472-668067e0fb4f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:24:02.516243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:02.693994 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4532cb9e-029b-4974-b472-668067e0fb4f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 204 len: 0 microversion: 2.1 time: 0.296582 Aug 27 05:24:02.698228 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2786/5573] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:24:02 2022] DELETE /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:24:02.706575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-359f69d6-b549-40d5-9658-747832271fa8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:02.707519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-359f69d6-b549-40d5-9658-747832271fa8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:02.714795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-359f69d6-b549-40d5-9658-747832271fa8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:02.716209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-359f69d6-b549-40d5-9658-747832271fa8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:02.716916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-359f69d6-b549-40d5-9658-747832271fa8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:02.717883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-359f69d6-b549-40d5-9658-747832271fa8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:02.718574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-359f69d6-b549-40d5-9658-747832271fa8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:02.719632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-359f69d6-b549-40d5-9658-747832271fa8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:02.836331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-57aaeab6-fd02-483f-b9a1-8a00e810a0e5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:02.850690 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-57aaeab6-fd02-483f-b9a1-8a00e810a0e5 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1674 microversion: 2.1 time: 0.684636 Aug 27 05:24:02.865694 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2788/5574] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:02 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1674 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:24:03.206484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-359f69d6-b549-40d5-9658-747832271fa8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:03.238353 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-359f69d6-b549-40d5-9658-747832271fa8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1681 microversion: 2.1 time: 0.536945 Aug 27 05:24:03.259547 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2787/5575] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:02 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1681 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:03.883762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8baf757-83ae-484c-99c9-24539ca6dcbf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:03.885171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e8baf757-83ae-484c-99c9-24539ca6dcbf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:03.904538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8baf757-83ae-484c-99c9-24539ca6dcbf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:03.907808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8baf757-83ae-484c-99c9-24539ca6dcbf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:03.908913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8baf757-83ae-484c-99c9-24539ca6dcbf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:03.910077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8baf757-83ae-484c-99c9-24539ca6dcbf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:03.912743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8baf757-83ae-484c-99c9-24539ca6dcbf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:03.915344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8baf757-83ae-484c-99c9-24539ca6dcbf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:04.097719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e8baf757-83ae-484c-99c9-24539ca6dcbf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:04.114470 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e8baf757-83ae-484c-99c9-24539ca6dcbf tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1606 microversion: 2.1 time: 0.240713 Aug 27 05:24:04.115119 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2789/5576] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:03 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1606 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:04.288156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d1ee7038-5fd1-4468-9eb0-9b38cb8a0c88 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:04.289024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d1ee7038-5fd1-4468-9eb0-9b38cb8a0c88 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:04.310203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1ee7038-5fd1-4468-9eb0-9b38cb8a0c88 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:04.310702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1ee7038-5fd1-4468-9eb0-9b38cb8a0c88 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:04.311168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1ee7038-5fd1-4468-9eb0-9b38cb8a0c88 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:04.311887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1ee7038-5fd1-4468-9eb0-9b38cb8a0c88 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:04.312349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1ee7038-5fd1-4468-9eb0-9b38cb8a0c88 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:04.314259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1ee7038-5fd1-4468-9eb0-9b38cb8a0c88 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:05.140004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e5ab4b1e-e846-48bc-9a61-0f7bff8cd893 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:05.140808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e5ab4b1e-e846-48bc-9a61-0f7bff8cd893 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:05.150161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5ab4b1e-e846-48bc-9a61-0f7bff8cd893 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:05.151531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5ab4b1e-e846-48bc-9a61-0f7bff8cd893 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:05.152139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5ab4b1e-e846-48bc-9a61-0f7bff8cd893 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:05.153381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5ab4b1e-e846-48bc-9a61-0f7bff8cd893 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:05.154019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5ab4b1e-e846-48bc-9a61-0f7bff8cd893 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:05.154801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5ab4b1e-e846-48bc-9a61-0f7bff8cd893 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:05.204949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d1ee7038-5fd1-4468-9eb0-9b38cb8a0c88 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:05.215008 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d1ee7038-5fd1-4468-9eb0-9b38cb8a0c88 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1681 microversion: 2.1 time: 0.938041 Aug 27 05:24:05.226584 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2788/5577] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:04 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1681 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:05.313157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d366a015-e375-490e-ac29-b67463941420 req-45f8b5ca-308e-415c-bb13-4709d65b66d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f4c359-6f7e-4009-a365-7b070eec11a9", "name": "network-vif-deleted", "tag": "2a4e09b9-01c8-433a-8d9e-e93f9888b163"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:05.328632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d366a015-e375-490e-ac29-b67463941420 req-45f8b5ca-308e-415c-bb13-4709d65b66d0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:05.329348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d366a015-e375-490e-ac29-b67463941420 req-45f8b5ca-308e-415c-bb13-4709d65b66d0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:05.330372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d366a015-e375-490e-ac29-b67463941420 req-45f8b5ca-308e-415c-bb13-4709d65b66d0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:05.371056 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d366a015-e375-490e-ac29-b67463941420 req-45f8b5ca-308e-415c-bb13-4709d65b66d0 service nova] Creating event network-vif-deleted:2a4e09b9-01c8-433a-8d9e-e93f9888b163 for instance e5f4c359-6f7e-4009-a365-7b070eec11a9 on n-h2-820368-35 Aug 27 05:24:05.382094 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d366a015-e375-490e-ac29-b67463941420 req-45f8b5ca-308e-415c-bb13-4709d65b66d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079092 Aug 27 05:24:05.392020 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2789/5578] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 05:24:05.455673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5ab4b1e-e846-48bc-9a61-0f7bff8cd893 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:05.488354 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e5ab4b1e-e846-48bc-9a61-0f7bff8cd893 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1606 microversion: 2.1 time: 0.347694 Aug 27 05:24:05.506532 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2790/5579] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:05 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1606 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:24:06.250056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0634e299-081f-492a-ad0a-b3b30d968604 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:06.252766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0634e299-081f-492a-ad0a-b3b30d968604 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:06.276958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0634e299-081f-492a-ad0a-b3b30d968604 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:06.279849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0634e299-081f-492a-ad0a-b3b30d968604 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:06.282238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0634e299-081f-492a-ad0a-b3b30d968604 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:06.283878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0634e299-081f-492a-ad0a-b3b30d968604 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:06.284977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0634e299-081f-492a-ad0a-b3b30d968604 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:06.287714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0634e299-081f-492a-ad0a-b3b30d968604 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:06.517949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:06.519225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:06.549383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:06.554487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:06.555311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:06.562121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:06.564291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:06.565522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:06.721220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:06.723102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:06.737159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:06.741120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lazy-loading 'fault' on Instance uuid e5f4c359-6f7e-4009-a365-7b070eec11a9 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:24:07.400076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffafef392eb4e1fba13953f47b2d105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e6b379f0d24ec8aa6da3c4f01bdd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:07.408241 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb0a8097-d27c-4300-971f-9de31b3bc11f tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 200 len: 1327 microversion: 2.1 time: 0.894211 Aug 27 05:24:07.415370 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2791/5580] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:06 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 1327 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:24:07.663789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0634e299-081f-492a-ad0a-b3b30d968604 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:07.679853 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0634e299-081f-492a-ad0a-b3b30d968604 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1681 microversion: 2.1 time: 1.434668 Aug 27 05:24:07.681541 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2790/5581] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:06 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1681 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:08.450829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:08.451520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] [instance: e5f4c359-6f7e-4009-a365-7b070eec11a9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:08.484951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:08.487029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:08.488234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:08.505277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:08.506106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:08.511298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:08.588506 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] HTTP exception thrown: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 could not be found. Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Request method failure captured: Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 HTTP/1.1 Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaf_zdSPUeOsoTLkhLQL1vTlNucAU1rurQ76_s_7oXcF2ursFV7TaLgonjCe-LOZpl42-Z1nMf9A0p5HI8wh23R0xdPIBi9qQEbYtSOcmXJv69LplvzQOu4_pC3DspVSvoXd-nW5ckUmdD57wX3cw_UIfJKHPOT6Ts6e_rIaD18Ozyo Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_57e6b379f0d24ec8aa6da3c4f01bdd7a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57e6b379f0d24ec8aa6da3c4f01bdd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 57e6b379f0d24ec8aa6da3c4f01bdd7a Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-1943900600 Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: dffafef392eb4e1fba13953f47b2d105 Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-1943900600-project Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 could not be found. Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e5f4c359-6f7e-4009-a365-7b070eec11a9'} Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 could not be found. Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 could not be found. Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:24:08.595081 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:24:08.603423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:24:08.603423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:24:08.603423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:24:08.603423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:24:08.603423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:24:08.603423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 could not be found. Aug 27 05:24:08.603423 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:24:08.606409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Returning 404 to user: Instance e5f4c359-6f7e-4009-a365-7b070eec11a9 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:24:08.608544 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f07ed0f2-2945-460d-a478-1339f3655b25 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9" status: 404 len: 111 microversion: 2.1 time: 0.165847 Aug 27 05:24:08.609870 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2792/5582] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:08 2022] GET /compute/v2.1/servers/e5f4c359-6f7e-4009-a365-7b070eec11a9 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:24:08.619285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97acddda-bd6f-46d4-8b60-ad0bfe4be8a6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] Calling method '.version_select at 0x7fb5696075e0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:08.684947 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-97acddda-bd6f-46d4-8b60-ad0bfe4be8a6 tempest-ServerActionsTestJSON-1943900600 tempest-ServerActionsTestJSON-1943900600-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107615364" status: 202 len: 0 microversion: 2.1 time: 0.070831 Aug 27 05:24:08.689188 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2791/5583] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 05:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107615364 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:24:08.708618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5c5b6e2d-ef8e-40e5-aed5-282b075169f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:08.709265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5c5b6e2d-ef8e-40e5-aed5-282b075169f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:08.722233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:08.733985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c5b6e2d-ef8e-40e5-aed5-282b075169f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:08.735705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c5b6e2d-ef8e-40e5-aed5-282b075169f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:08.736228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c5b6e2d-ef8e-40e5-aed5-282b075169f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:08.737011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c5b6e2d-ef8e-40e5-aed5-282b075169f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:08.744466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c5b6e2d-ef8e-40e5-aed5-282b075169f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:08.745281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c5b6e2d-ef8e-40e5-aed5-282b075169f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:08.837236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:08.984980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5c5b6e2d-ef8e-40e5-aed5-282b075169f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:08.999005 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5c5b6e2d-ef8e-40e5-aed5-282b075169f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1614 microversion: 2.1 time: 0.295995 Aug 27 05:24:09.000475 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2793/5584] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:08 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1614 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:09.756108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-0a763cb7-6fe2-4606-a181-37553f76e29e req-e4321d19-b537-48fd-825c-60153824e6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e12d584-d333-430d-aec1-67778b1f5575", "name": "network-vif-deleted", "tag": "9ddfbd7c-1d05-4d8b-bac3-be7daad6a93e"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:09.814757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0a763cb7-6fe2-4606-a181-37553f76e29e req-e4321d19-b537-48fd-825c-60153824e6c2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:09.817984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0a763cb7-6fe2-4606-a181-37553f76e29e req-e4321d19-b537-48fd-825c-60153824e6c2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:09.818666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0a763cb7-6fe2-4606-a181-37553f76e29e req-e4321d19-b537-48fd-825c-60153824e6c2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:09.839559 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-0a763cb7-6fe2-4606-a181-37553f76e29e req-e4321d19-b537-48fd-825c-60153824e6c2 service nova] Creating event network-vif-deleted:9ddfbd7c-1d05-4d8b-bac3-be7daad6a93e for instance 4e12d584-d333-430d-aec1-67778b1f5575 on n-h1-820368-35 Aug 27 05:24:09.849826 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-0a763cb7-6fe2-4606-a181-37553f76e29e req-e4321d19-b537-48fd-825c-60153824e6c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130171 Aug 27 05:24:09.853519 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2792/5585] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:24:10.035518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:10.036281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:10.053302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:10.055837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:10.056503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:10.059180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:10.061482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:10.064146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:10.187753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:10.189589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:10.190353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:10.191200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lazy-loading 'fault' on Instance uuid 4e12d584-d333-430d-aec1-67778b1f5575 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:24:10.319744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:10.356437 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-92e9cc63-d12a-494a-aca1-ab5b2705be75 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 200 len: 1331 microversion: 2.1 time: 0.327474 Aug 27 05:24:10.361426 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2794/5586] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:10 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 1331 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:11.406041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:11.406693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:11.440828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:11.441345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:11.441801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:11.452155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:11.452155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:11.452155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:11.513668 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 HTTP/1.1 Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '4e12d584-d333-430d-aec1-67778b1f5575'} Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:24:11.515420 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:24:11.519518 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:24:11.519518 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:24:11.519518 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:24:11.519518 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:24:11.519518 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:24:11.519518 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:24:11.519518 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:24:11.519518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:24:11.519518 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-253ea8e1-82ce-4827-8ca7-c5fc991a8f81 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 404 len: 111 microversion: 2.1 time: 0.131731 Aug 27 05:24:11.519518 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2793/5587] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:11 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:24:11.526617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-264bd9d3-7d6b-402a-a457-9fafba0e994d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '.version_select at 0x7fb5640e7ca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:11.587020 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-264bd9d3-7d6b-402a-a457-9fafba0e994d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976030842" status: 202 len: 0 microversion: 2.1 time: 0.062369 Aug 27 05:24:11.595992 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2795/5588] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 05:24:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976030842 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:24:13.744524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0467994b-4326-4fd3-9cbf-225350beb3d0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: .version_select at 0x7fb56456db80>, body: {"keypair": {"name": "tempest-keypair-2084209992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI4Lu70ZDBhMB/jQWauTWdZd7JGGEK5xmFHa/lq8I3PVMjxypgEFUjkUcTcltXDH7RizAI8Z/DlkruZli0EpV851QdrN7hItug1GD+I8Lyeo565n30/8lSyO3fCrPP8zg=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:13.805318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0467994b-4326-4fd3-9cbf-225350beb3d0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:24:13.816146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0467994b-4326-4fd3-9cbf-225350beb3d0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for user 43fc751d620242208608be8bc55ae86d and project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:24:13.880877 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0467994b-4326-4fd3-9cbf-225350beb3d0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140356 Aug 27 05:24:13.882838 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2794/5589] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:24:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:24:19.360471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1388328468", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b22082a4-5b69-426a-b228-4ee7d0a48e79"}], "security_groups": [{"name": "tempest-securitygroup--1231395952"}], "key_name": "tempest-keypair-2084209992", "user_data": "}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:19.743481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] validate_networks() for [('b22082a4-5b69-426a-b228-4ee7d0a48e79', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:24:20.333893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=12 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:23.178064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:24:23.180103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:24:23.180968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:24:23.182143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:24:23.182870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:24:23.272720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:23.273535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:23.274257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:23.299334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:23.300436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:23.301188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:23.445288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:24:23.484704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for user 43fc751d620242208608be8bc55ae86d and project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:24:23.545031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:24:23.558620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:24:23.750086 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c9986241-18af-437b-87a7-0a231c142501 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.394370 Aug 27 05:24:23.762833 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2796/5590] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:24:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 4408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:24:23.775178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d4ddf535-7309-40d7-9e83-7ec27f328d5e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:23.775945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d4ddf535-7309-40d7-9e83-7ec27f328d5e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:23.784285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:23.870350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:24.083771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d4ddf535-7309-40d7-9e83-7ec27f328d5e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:24.095992 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d4ddf535-7309-40d7-9e83-7ec27f328d5e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1242 microversion: 2.1 time: 0.324743 Aug 27 05:24:24.119866 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2795/5591] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:23 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1242 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:25.130453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-659699fb-71c8-40b0-839c-5421140f9cfc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:25.134767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-659699fb-71c8-40b0-839c-5421140f9cfc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:25.178047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-659699fb-71c8-40b0-839c-5421140f9cfc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:25.178790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-659699fb-71c8-40b0-839c-5421140f9cfc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:25.179801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-659699fb-71c8-40b0-839c-5421140f9cfc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:25.182490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-659699fb-71c8-40b0-839c-5421140f9cfc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:25.186905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-659699fb-71c8-40b0-839c-5421140f9cfc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:25.188511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-659699fb-71c8-40b0-839c-5421140f9cfc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:25.411858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-659699fb-71c8-40b0-839c-5421140f9cfc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:25.468747 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-659699fb-71c8-40b0-839c-5421140f9cfc tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1246 microversion: 2.1 time: 0.345364 Aug 27 05:24:25.497875 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2797/5592] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:25 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1246 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:26.501487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad9d4076-b99f-465d-ba97-9b6167da0d22 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:26.503200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad9d4076-b99f-465d-ba97-9b6167da0d22 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:26.530113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad9d4076-b99f-465d-ba97-9b6167da0d22 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:26.538234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad9d4076-b99f-465d-ba97-9b6167da0d22 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:26.538680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad9d4076-b99f-465d-ba97-9b6167da0d22 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:26.541779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad9d4076-b99f-465d-ba97-9b6167da0d22 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:26.544906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad9d4076-b99f-465d-ba97-9b6167da0d22 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:26.545365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad9d4076-b99f-465d-ba97-9b6167da0d22 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:26.704174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad9d4076-b99f-465d-ba97-9b6167da0d22 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:26.728195 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad9d4076-b99f-465d-ba97-9b6167da0d22 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1312 microversion: 2.1 time: 0.234311 Aug 27 05:24:26.734454 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2796/5593] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:26 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1312 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:27.759751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f19b8cdc-3b22-4e62-a33a-f819ac5b4ec7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:27.760543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f19b8cdc-3b22-4e62-a33a-f819ac5b4ec7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:27.771343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19b8cdc-3b22-4e62-a33a-f819ac5b4ec7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:27.771936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19b8cdc-3b22-4e62-a33a-f819ac5b4ec7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:27.772589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19b8cdc-3b22-4e62-a33a-f819ac5b4ec7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:27.773475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19b8cdc-3b22-4e62-a33a-f819ac5b4ec7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:27.778146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19b8cdc-3b22-4e62-a33a-f819ac5b4ec7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:27.778868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f19b8cdc-3b22-4e62-a33a-f819ac5b4ec7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:28.826557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f19b8cdc-3b22-4e62-a33a-f819ac5b4ec7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:28.866335 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f19b8cdc-3b22-4e62-a33a-f819ac5b4ec7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1368 microversion: 2.1 time: 1.118851 Aug 27 05:24:28.900660 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2798/5594] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:27 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1368 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:29.275248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-628753157", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:29.458868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] validate_networks() for [('7906d3ee-5380-4aa1-a43a-a0d97ee78a9e', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:24:29.909229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-67ca8e41-a141-4b05-8e4e-67ea065e8f08 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:29.910089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-67ca8e41-a141-4b05-8e4e-67ea065e8f08 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:29.931157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67ca8e41-a141-4b05-8e4e-67ea065e8f08 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:29.931647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67ca8e41-a141-4b05-8e4e-67ea065e8f08 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:29.932098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67ca8e41-a141-4b05-8e4e-67ea065e8f08 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:29.932869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67ca8e41-a141-4b05-8e4e-67ea065e8f08 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:29.942224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67ca8e41-a141-4b05-8e4e-67ea065e8f08 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:29.942792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67ca8e41-a141-4b05-8e4e-67ea065e8f08 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:30.609324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-67ca8e41-a141-4b05-8e4e-67ea065e8f08 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:30.627663 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-67ca8e41-a141-4b05-8e4e-67ea065e8f08 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1368 microversion: 2.1 time: 0.722497 Aug 27 05:24:30.642634 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2799/5595] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:29 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1368 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:31.069375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:24:31.069888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:24:31.070285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:24:31.070764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:24:31.071215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:24:31.075779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:31.094702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:31.095297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:31.095662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:31.096435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:31.096895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:31.097323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:31.201580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Getting quotas for project 7730f8c3034043dfb2063a05216b8287. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:24:31.242117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Getting quotas for user 5a97d2893d334fc8960af526195cd0cd and project 7730f8c3034043dfb2063a05216b8287. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:24:31.326606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:24:31.329059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:24:31.555830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd9831bf-55d2-4391-9f63-17dde3e1b68f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.881868 Aug 27 05:24:31.568726 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2797/5596] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:24:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:24:31.580136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b94018cb-7105-4cc2-b671-58e1925f9465 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:31.580773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b94018cb-7105-4cc2-b671-58e1925f9465 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:31.773556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b67eaacb-39de-48e5-870a-2fb545aa192a req-a2942013-86b4-44a4-8680-1e8c8e6d5eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1ccbd70-94c1-4f11-aca0-2d8d2afe8626", "tag": "1a192ad8-f44d-4230-9a8e-fc72cfd1341c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:31.794469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b94018cb-7105-4cc2-b671-58e1925f9465 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:31.803529 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b94018cb-7105-4cc2-b671-58e1925f9465 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1216 microversion: 2.1 time: 0.233560 Aug 27 05:24:31.804137 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2798/5597] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:31 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1216 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:31.829193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b67eaacb-39de-48e5-870a-2fb545aa192a req-a2942013-86b4-44a4-8680-1e8c8e6d5eaf service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:31.837606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b67eaacb-39de-48e5-870a-2fb545aa192a req-a2942013-86b4-44a4-8680-1e8c8e6d5eaf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:31.839520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b67eaacb-39de-48e5-870a-2fb545aa192a req-a2942013-86b4-44a4-8680-1e8c8e6d5eaf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:31.847100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9ac99ed3-d80e-4d5f-990f-c454a9719f29 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:31.848036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9ac99ed3-d80e-4d5f-990f-c454a9719f29 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:31.885237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac99ed3-d80e-4d5f-990f-c454a9719f29 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:31.887696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac99ed3-d80e-4d5f-990f-c454a9719f29 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:31.892805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac99ed3-d80e-4d5f-990f-c454a9719f29 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:31.895921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac99ed3-d80e-4d5f-990f-c454a9719f29 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:31.896657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac99ed3-d80e-4d5f-990f-c454a9719f29 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:31.897482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9ac99ed3-d80e-4d5f-990f-c454a9719f29 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:31.899452 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b67eaacb-39de-48e5-870a-2fb545aa192a req-a2942013-86b4-44a4-8680-1e8c8e6d5eaf service nova] Creating event network-changed:1a192ad8-f44d-4230-9a8e-fc72cfd1341c for instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 on n-h1-820368-35 Aug 27 05:24:31.920507 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b67eaacb-39de-48e5-870a-2fb545aa192a req-a2942013-86b4-44a4-8680-1e8c8e6d5eaf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.503385 Aug 27 05:24:31.924107 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2800/5598] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:24:32.689867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9ac99ed3-d80e-4d5f-990f-c454a9719f29 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:32.709018 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9ac99ed3-d80e-4d5f-990f-c454a9719f29 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1368 microversion: 2.1 time: 0.894762 Aug 27 05:24:32.723464 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2799/5599] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:31 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1368 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:32.834447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d20cdccf-0b85-4378-b0b5-634f025f6ee6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:32.844941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d20cdccf-0b85-4378-b0b5-634f025f6ee6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:32.876637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d20cdccf-0b85-4378-b0b5-634f025f6ee6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:32.877902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d20cdccf-0b85-4378-b0b5-634f025f6ee6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:32.879364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d20cdccf-0b85-4378-b0b5-634f025f6ee6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:32.889761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d20cdccf-0b85-4378-b0b5-634f025f6ee6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:32.891170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d20cdccf-0b85-4378-b0b5-634f025f6ee6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:32.892163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d20cdccf-0b85-4378-b0b5-634f025f6ee6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:33.086009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d20cdccf-0b85-4378-b0b5-634f025f6ee6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:33.106634 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d20cdccf-0b85-4378-b0b5-634f025f6ee6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1220 microversion: 2.1 time: 0.284837 Aug 27 05:24:33.120824 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2801/5600] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:32 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1220 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:33.732245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7fdb0059-12d8-42f7-a135-72c2c271c058 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:33.732886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7fdb0059-12d8-42f7-a135-72c2c271c058 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:33.750601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fdb0059-12d8-42f7-a135-72c2c271c058 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:33.751128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fdb0059-12d8-42f7-a135-72c2c271c058 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:33.751587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fdb0059-12d8-42f7-a135-72c2c271c058 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:33.752310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fdb0059-12d8-42f7-a135-72c2c271c058 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:33.752766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fdb0059-12d8-42f7-a135-72c2c271c058 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:33.753183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7fdb0059-12d8-42f7-a135-72c2c271c058 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:34.146035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb86c53d-2973-4c65-b883-0ec7d907a6f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:34.146790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bb86c53d-2973-4c65-b883-0ec7d907a6f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:34.165049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:34.168667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:34.175602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb86c53d-2973-4c65-b883-0ec7d907a6f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:34.187177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb86c53d-2973-4c65-b883-0ec7d907a6f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:34.188812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb86c53d-2973-4c65-b883-0ec7d907a6f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:34.196682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb86c53d-2973-4c65-b883-0ec7d907a6f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:34.201606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb86c53d-2973-4c65-b883-0ec7d907a6f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:34.202804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb86c53d-2973-4c65-b883-0ec7d907a6f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:34.270488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7fdb0059-12d8-42f7-a135-72c2c271c058 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:34.288809 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7fdb0059-12d8-42f7-a135-72c2c271c058 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1368 microversion: 2.1 time: 0.560522 Aug 27 05:24:34.307562 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2800/5601] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:33 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1368 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:34.341683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb86c53d-2973-4c65-b883-0ec7d907a6f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:34.359575 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb86c53d-2973-4c65-b883-0ec7d907a6f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1276 microversion: 2.1 time: 0.220475 Aug 27 05:24:34.360553 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2802/5602] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:34 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:35.312543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7dad4816-83d4-4470-9b11-93d87160604e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:35.313418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7dad4816-83d4-4470-9b11-93d87160604e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:35.334624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dad4816-83d4-4470-9b11-93d87160604e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:35.335507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dad4816-83d4-4470-9b11-93d87160604e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:35.337026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dad4816-83d4-4470-9b11-93d87160604e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:35.337947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dad4816-83d4-4470-9b11-93d87160604e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:35.348141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dad4816-83d4-4470-9b11-93d87160604e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:35.349061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dad4816-83d4-4470-9b11-93d87160604e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:35.387248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f82d253d-6353-40db-a8a3-8082f2e55de9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:35.388849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f82d253d-6353-40db-a8a3-8082f2e55de9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:35.413683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f82d253d-6353-40db-a8a3-8082f2e55de9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:35.414499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f82d253d-6353-40db-a8a3-8082f2e55de9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:35.425431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f82d253d-6353-40db-a8a3-8082f2e55de9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:35.427042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f82d253d-6353-40db-a8a3-8082f2e55de9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:35.427805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f82d253d-6353-40db-a8a3-8082f2e55de9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:35.428472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f82d253d-6353-40db-a8a3-8082f2e55de9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:35.700054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f82d253d-6353-40db-a8a3-8082f2e55de9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:35.718213 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f82d253d-6353-40db-a8a3-8082f2e55de9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1274 microversion: 2.1 time: 0.331419 Aug 27 05:24:35.723384 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2803/5603] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:35 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1274 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:36.043440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7dad4816-83d4-4470-9b11-93d87160604e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:36.052827 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7dad4816-83d4-4470-9b11-93d87160604e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1368 microversion: 2.1 time: 0.746608 Aug 27 05:24:36.054107 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2801/5604] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:35 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1368 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:24:36.743017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c78be97f-eb06-4182-80e6-7035189c93a8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:36.743682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c78be97f-eb06-4182-80e6-7035189c93a8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:36.763821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78be97f-eb06-4182-80e6-7035189c93a8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:36.764604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78be97f-eb06-4182-80e6-7035189c93a8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:36.767773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78be97f-eb06-4182-80e6-7035189c93a8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:36.784370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78be97f-eb06-4182-80e6-7035189c93a8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:36.786706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78be97f-eb06-4182-80e6-7035189c93a8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:36.787469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c78be97f-eb06-4182-80e6-7035189c93a8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:37.084144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ec3e595b-2051-442d-9564-2dc991d3ab8e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:37.085498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ec3e595b-2051-442d-9564-2dc991d3ab8e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:37.099902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3e595b-2051-442d-9564-2dc991d3ab8e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:37.101786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3e595b-2051-442d-9564-2dc991d3ab8e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:37.105483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3e595b-2051-442d-9564-2dc991d3ab8e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:37.106629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3e595b-2051-442d-9564-2dc991d3ab8e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:37.107556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3e595b-2051-442d-9564-2dc991d3ab8e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:37.108559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec3e595b-2051-442d-9564-2dc991d3ab8e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:37.917828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c78be97f-eb06-4182-80e6-7035189c93a8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:37.929801 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c78be97f-eb06-4182-80e6-7035189c93a8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1316 microversion: 2.1 time: 1.190765 Aug 27 05:24:37.931453 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2804/5605] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:36 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1316 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:38.012238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ec3e595b-2051-442d-9564-2dc991d3ab8e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:38.051837 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ec3e595b-2051-442d-9564-2dc991d3ab8e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1368 microversion: 2.1 time: 0.954915 Aug 27 05:24:38.053915 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2802/5606] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:37 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1368 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:38.957751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d8221365-f3dd-4d14-8fe0-db4b422e8b93 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:38.959123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d8221365-f3dd-4d14-8fe0-db4b422e8b93 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:38.968187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:38.975610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8221365-f3dd-4d14-8fe0-db4b422e8b93 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:38.978295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8221365-f3dd-4d14-8fe0-db4b422e8b93 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:38.980797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8221365-f3dd-4d14-8fe0-db4b422e8b93 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:38.982034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8221365-f3dd-4d14-8fe0-db4b422e8b93 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:38.984121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8221365-f3dd-4d14-8fe0-db4b422e8b93 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:38.985529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8221365-f3dd-4d14-8fe0-db4b422e8b93 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:39.074345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0b382706-12b2-453e-b3dc-12db7335b167 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:39.075040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0b382706-12b2-453e-b3dc-12db7335b167 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:39.089621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b382706-12b2-453e-b3dc-12db7335b167 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:39.090296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b382706-12b2-453e-b3dc-12db7335b167 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:39.090763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b382706-12b2-453e-b3dc-12db7335b167 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:39.094921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b382706-12b2-453e-b3dc-12db7335b167 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:39.095555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b382706-12b2-453e-b3dc-12db7335b167 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:39.096148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0b382706-12b2-453e-b3dc-12db7335b167 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:40.260974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0b382706-12b2-453e-b3dc-12db7335b167 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:40.282449 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0b382706-12b2-453e-b3dc-12db7335b167 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1368 microversion: 2.1 time: 1.210330 Aug 27 05:24:40.284917 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2803/5607] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:39 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1368 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:40.309996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b225da34-78de-4e62-a794-47962bd585d6 req-30dff712-77f5-4098-afc1-4b9189e636c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1ccbd70-94c1-4f11-aca0-2d8d2afe8626", "name": "network-vif-plugged", "status": "completed", "tag": "1a192ad8-f44d-4230-9a8e-fc72cfd1341c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:40.354792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b225da34-78de-4e62-a794-47962bd585d6 req-30dff712-77f5-4098-afc1-4b9189e636c3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:40.358146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b225da34-78de-4e62-a794-47962bd585d6 req-30dff712-77f5-4098-afc1-4b9189e636c3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:40.360417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b225da34-78de-4e62-a794-47962bd585d6 req-30dff712-77f5-4098-afc1-4b9189e636c3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:40.393612 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b225da34-78de-4e62-a794-47962bd585d6 req-30dff712-77f5-4098-afc1-4b9189e636c3 service nova] Creating event network-vif-plugged:1a192ad8-f44d-4230-9a8e-fc72cfd1341c for instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 on n-h1-820368-35 Aug 27 05:24:40.409397 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b225da34-78de-4e62-a794-47962bd585d6 req-30dff712-77f5-4098-afc1-4b9189e636c3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119041 Aug 27 05:24:40.413280 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2804/5608] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:24:40.421271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d8221365-f3dd-4d14-8fe0-db4b422e8b93 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:40.437433 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d8221365-f3dd-4d14-8fe0-db4b422e8b93 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1316 microversion: 2.1 time: 1.482562 Aug 27 05:24:40.438741 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2805/5609] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:38 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1316 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:40.597425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-eb670aa8-56a6-4e9b-b8dc-01612e2d26f3 req-f7e02da7-65f3-487f-a3c9-fada728fafd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64999ba4-bbd9-4d23-9a4c-0caf8eb677b4", "tag": "e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:40.634189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-eb670aa8-56a6-4e9b-b8dc-01612e2d26f3 req-f7e02da7-65f3-487f-a3c9-fada728fafd5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:40.636364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-eb670aa8-56a6-4e9b-b8dc-01612e2d26f3 req-f7e02da7-65f3-487f-a3c9-fada728fafd5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:40.636819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-eb670aa8-56a6-4e9b-b8dc-01612e2d26f3 req-f7e02da7-65f3-487f-a3c9-fada728fafd5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:40.672144 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-eb670aa8-56a6-4e9b-b8dc-01612e2d26f3 req-f7e02da7-65f3-487f-a3c9-fada728fafd5 service nova] Creating event network-changed:e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf for instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 on n-h2-820368-35 Aug 27 05:24:40.697058 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-eb670aa8-56a6-4e9b-b8dc-01612e2d26f3 req-f7e02da7-65f3-487f-a3c9-fada728fafd5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104513 Aug 27 05:24:40.697738 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2805/5610] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:24:41.306375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f3462aa0-a3d9-4da1-a6c4-b9219d391e3a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:41.308592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f3462aa0-a3d9-4da1-a6c4-b9219d391e3a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:41.342752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3462aa0-a3d9-4da1-a6c4-b9219d391e3a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:41.346283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3462aa0-a3d9-4da1-a6c4-b9219d391e3a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:41.351924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3462aa0-a3d9-4da1-a6c4-b9219d391e3a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:41.365745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3462aa0-a3d9-4da1-a6c4-b9219d391e3a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:41.367584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3462aa0-a3d9-4da1-a6c4-b9219d391e3a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:41.370351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3462aa0-a3d9-4da1-a6c4-b9219d391e3a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:41.476388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-83f72962-10e6-40f6-acfb-987b8a6b6169 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:41.477997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-83f72962-10e6-40f6-acfb-987b8a6b6169 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:41.510984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:41.516229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f72962-10e6-40f6-acfb-987b8a6b6169 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:41.518061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f72962-10e6-40f6-acfb-987b8a6b6169 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:41.527351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f72962-10e6-40f6-acfb-987b8a6b6169 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:41.532380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f72962-10e6-40f6-acfb-987b8a6b6169 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:41.538973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f72962-10e6-40f6-acfb-987b8a6b6169 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:41.540546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83f72962-10e6-40f6-acfb-987b8a6b6169 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:41.798340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=10 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:42.480021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f3462aa0-a3d9-4da1-a6c4-b9219d391e3a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:42.491227 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f3462aa0-a3d9-4da1-a6c4-b9219d391e3a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1368 microversion: 2.1 time: 1.188688 Aug 27 05:24:42.493431 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2806/5611] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:41 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1368 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:42.529982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-83f72962-10e6-40f6-acfb-987b8a6b6169 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:42.575917 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-83f72962-10e6-40f6-acfb-987b8a6b6169 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1316 microversion: 2.1 time: 1.082346 Aug 27 05:24:42.579465 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2806/5612] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:41 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1316 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:43.523129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-56aa33bc-7369-4b2b-849f-7641305f8f03 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:43.524017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-56aa33bc-7369-4b2b-849f-7641305f8f03 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:43.561757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56aa33bc-7369-4b2b-849f-7641305f8f03 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:43.562272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56aa33bc-7369-4b2b-849f-7641305f8f03 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:43.569005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56aa33bc-7369-4b2b-849f-7641305f8f03 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:43.570163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56aa33bc-7369-4b2b-849f-7641305f8f03 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:43.570936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56aa33bc-7369-4b2b-849f-7641305f8f03 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:43.578457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56aa33bc-7369-4b2b-849f-7641305f8f03 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:43.604855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4370946b-7bc4-48ee-8c4c-7f942798bd6a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:43.606159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4370946b-7bc4-48ee-8c4c-7f942798bd6a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:43.634668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4370946b-7bc4-48ee-8c4c-7f942798bd6a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:43.641446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4370946b-7bc4-48ee-8c4c-7f942798bd6a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:43.642253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4370946b-7bc4-48ee-8c4c-7f942798bd6a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:43.643305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4370946b-7bc4-48ee-8c4c-7f942798bd6a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:43.643952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4370946b-7bc4-48ee-8c4c-7f942798bd6a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:43.644748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4370946b-7bc4-48ee-8c4c-7f942798bd6a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:44.061735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-56aa33bc-7369-4b2b-849f-7641305f8f03 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:44.074270 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-56aa33bc-7369-4b2b-849f-7641305f8f03 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1558 microversion: 2.1 time: 0.559232 Aug 27 05:24:44.079252 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2807/5613] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:43 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1558 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:44.097595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1eb9abcd-60c0-4b3e-ac3d-fab9f9439d41 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:44.098519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1eb9abcd-60c0-4b3e-ac3d-fab9f9439d41 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:44.113295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb9abcd-60c0-4b3e-ac3d-fab9f9439d41 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:44.116927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb9abcd-60c0-4b3e-ac3d-fab9f9439d41 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:44.119358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb9abcd-60c0-4b3e-ac3d-fab9f9439d41 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:44.119358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb9abcd-60c0-4b3e-ac3d-fab9f9439d41 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:44.119358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb9abcd-60c0-4b3e-ac3d-fab9f9439d41 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:44.122351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb9abcd-60c0-4b3e-ac3d-fab9f9439d41 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:44.294579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4370946b-7bc4-48ee-8c4c-7f942798bd6a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:44.306686 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1eb9abcd-60c0-4b3e-ac3d-fab9f9439d41 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213882 Aug 27 05:24:44.307475 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4370946b-7bc4-48ee-8c4c-7f942798bd6a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1316 microversion: 2.1 time: 0.707763 Aug 27 05:24:44.308128 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2808/5614] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:24:44 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-interface => generated 284 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:24:44.308914 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2807/5615] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:43 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1316 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:45.341102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c03b93f0-94c2-4092-b478-b55dc48cfe61 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:45.342172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c03b93f0-94c2-4092-b478-b55dc48cfe61 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:45.351641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03b93f0-94c2-4092-b478-b55dc48cfe61 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:45.359194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03b93f0-94c2-4092-b478-b55dc48cfe61 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:45.362004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03b93f0-94c2-4092-b478-b55dc48cfe61 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:45.363114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03b93f0-94c2-4092-b478-b55dc48cfe61 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:45.363744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03b93f0-94c2-4092-b478-b55dc48cfe61 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:45.371028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c03b93f0-94c2-4092-b478-b55dc48cfe61 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:46.576469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c03b93f0-94c2-4092-b478-b55dc48cfe61 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:46.593058 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c03b93f0-94c2-4092-b478-b55dc48cfe61 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1316 microversion: 2.1 time: 1.256072 Aug 27 05:24:46.594271 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2809/5616] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:45 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1316 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:47.617411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5819861-e984-4d2b-aaf6-525e808f5e59 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:47.618052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c5819861-e984-4d2b-aaf6-525e808f5e59 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:47.642262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5819861-e984-4d2b-aaf6-525e808f5e59 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:47.645879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5819861-e984-4d2b-aaf6-525e808f5e59 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:47.646532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5819861-e984-4d2b-aaf6-525e808f5e59 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:47.647502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5819861-e984-4d2b-aaf6-525e808f5e59 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:47.648129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5819861-e984-4d2b-aaf6-525e808f5e59 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:47.648723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5819861-e984-4d2b-aaf6-525e808f5e59 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:48.253392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c5819861-e984-4d2b-aaf6-525e808f5e59 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:48.270651 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5819861-e984-4d2b-aaf6-525e808f5e59 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1316 microversion: 2.1 time: 0.657218 Aug 27 05:24:48.273274 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2808/5617] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:47 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:48.849138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-311a0b79-850b-4f4d-8bdb-e32d98c10f87 req-ece349b6-366b-40d4-b213-85de30895e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1ccbd70-94c1-4f11-aca0-2d8d2afe8626", "tag": "1a192ad8-f44d-4230-9a8e-fc72cfd1341c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:48.878480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-311a0b79-850b-4f4d-8bdb-e32d98c10f87 req-ece349b6-366b-40d4-b213-85de30895e92 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:48.879496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-311a0b79-850b-4f4d-8bdb-e32d98c10f87 req-ece349b6-366b-40d4-b213-85de30895e92 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:48.880144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-311a0b79-850b-4f4d-8bdb-e32d98c10f87 req-ece349b6-366b-40d4-b213-85de30895e92 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:48.911571 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-311a0b79-850b-4f4d-8bdb-e32d98c10f87 req-ece349b6-366b-40d4-b213-85de30895e92 service nova] Creating event network-changed:1a192ad8-f44d-4230-9a8e-fc72cfd1341c for instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 on n-h1-820368-35 Aug 27 05:24:48.924524 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-311a0b79-850b-4f4d-8bdb-e32d98c10f87 req-ece349b6-366b-40d4-b213-85de30895e92 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081908 Aug 27 05:24:48.925142 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2810/5618] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:24:49.297170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8a8044ba-c1d3-4f74-bec6-87c4d3309577 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:49.297947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8a8044ba-c1d3-4f74-bec6-87c4d3309577 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:49.326519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a8044ba-c1d3-4f74-bec6-87c4d3309577 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:49.326965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a8044ba-c1d3-4f74-bec6-87c4d3309577 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:49.327444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a8044ba-c1d3-4f74-bec6-87c4d3309577 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:49.328171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a8044ba-c1d3-4f74-bec6-87c4d3309577 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:49.328709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a8044ba-c1d3-4f74-bec6-87c4d3309577 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:49.329255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a8044ba-c1d3-4f74-bec6-87c4d3309577 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:49.889796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8a8044ba-c1d3-4f74-bec6-87c4d3309577 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:49.906601 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8a8044ba-c1d3-4f74-bec6-87c4d3309577 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1316 microversion: 2.1 time: 0.613314 Aug 27 05:24:49.912678 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2809/5619] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:49 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1316 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:50.942735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b0358494-3c0c-4d8b-9c84-74548ac2a539 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:50.943747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b0358494-3c0c-4d8b-9c84-74548ac2a539 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:50.960827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0358494-3c0c-4d8b-9c84-74548ac2a539 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:50.963632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0358494-3c0c-4d8b-9c84-74548ac2a539 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:50.965259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0358494-3c0c-4d8b-9c84-74548ac2a539 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:50.968888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0358494-3c0c-4d8b-9c84-74548ac2a539 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:50.971294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0358494-3c0c-4d8b-9c84-74548ac2a539 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:50.972229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0358494-3c0c-4d8b-9c84-74548ac2a539 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:51.033939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=77 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:51.353062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b0358494-3c0c-4d8b-9c84-74548ac2a539 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:51.362638 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b0358494-3c0c-4d8b-9c84-74548ac2a539 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1316 microversion: 2.1 time: 0.428352 Aug 27 05:24:51.370041 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2811/5620] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:50 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:52.396908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-956ecf76-c9c9-4a6e-a940-bdef8fc7b876 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:52.404797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-956ecf76-c9c9-4a6e-a940-bdef8fc7b876 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:52.405201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5ced0ab0-d2cf-40d6-af13-f4927b6c9813 req-61dae86a-fafd-4f33-99ca-24f04c60d8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64999ba4-bbd9-4d23-9a4c-0caf8eb677b4", "name": "network-vif-plugged", "status": "completed", "tag": "e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:52.428404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-956ecf76-c9c9-4a6e-a940-bdef8fc7b876 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:52.435822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-956ecf76-c9c9-4a6e-a940-bdef8fc7b876 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:52.436563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-956ecf76-c9c9-4a6e-a940-bdef8fc7b876 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:52.439594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5ced0ab0-d2cf-40d6-af13-f4927b6c9813 req-61dae86a-fafd-4f33-99ca-24f04c60d8ea service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:52.441412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-956ecf76-c9c9-4a6e-a940-bdef8fc7b876 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:52.442933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-956ecf76-c9c9-4a6e-a940-bdef8fc7b876 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:52.444216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-956ecf76-c9c9-4a6e-a940-bdef8fc7b876 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:52.449500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5ced0ab0-d2cf-40d6-af13-f4927b6c9813 req-61dae86a-fafd-4f33-99ca-24f04c60d8ea service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:52.450393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5ced0ab0-d2cf-40d6-af13-f4927b6c9813 req-61dae86a-fafd-4f33-99ca-24f04c60d8ea service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:52.504957 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5ced0ab0-d2cf-40d6-af13-f4927b6c9813 req-61dae86a-fafd-4f33-99ca-24f04c60d8ea service nova] Creating event network-vif-plugged:e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf for instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 on n-h2-820368-35 Aug 27 05:24:52.524650 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5ced0ab0-d2cf-40d6-af13-f4927b6c9813 req-61dae86a-fafd-4f33-99ca-24f04c60d8ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134818 Aug 27 05:24:52.526222 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2812/5621] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:24:53.712058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-705236052", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "3068fa54-110e-47f9-9ecf-f3ddf8a887b0"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:53.910774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] validate_networks() for [('3068fa54-110e-47f9-9ecf-f3ddf8a887b0', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:24:54.095345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-956ecf76-c9c9-4a6e-a940-bdef8fc7b876 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:54.103271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=71 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:54.109974 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-956ecf76-c9c9-4a6e-a940-bdef8fc7b876 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1316 microversion: 2.1 time: 1.723048 Aug 27 05:24:54.112336 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2810/5622] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:52 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1316 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:54.956722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:24:54.957827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:24:54.958370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:24:54.958611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:24:54.959254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:24:54.977609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:54.979672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:54.981555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:54.982557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:54.985404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:54.986066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:55.025826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Getting quotas for project f401eeab36464806bd39c3205e3e1747. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:24:55.033169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Getting quotas for user fa7761c0abd1446f8748001e7aff032c and project f401eeab36464806bd39c3205e3e1747. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:24:55.047762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:24:55.051414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:24:55.130621 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a28e9b23-6a1d-4ec6-a5a7-cbe38fd2ad10 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.781875 Aug 27 05:24:55.138067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c70817e8-404a-4b25-96d9-8a411ce69c0a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:55.138730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c70817e8-404a-4b25-96d9-8a411ce69c0a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:55.144367 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2813/5623] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:24:55.159344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70817e8-404a-4b25-96d9-8a411ce69c0a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:55.159732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70817e8-404a-4b25-96d9-8a411ce69c0a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:55.162254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-693a64a8-b43e-41c7-bd91-88f9c33c8b7a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:55.163762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-693a64a8-b43e-41c7-bd91-88f9c33c8b7a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:55.167349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70817e8-404a-4b25-96d9-8a411ce69c0a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:55.168319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70817e8-404a-4b25-96d9-8a411ce69c0a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:55.170927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70817e8-404a-4b25-96d9-8a411ce69c0a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:55.171566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70817e8-404a-4b25-96d9-8a411ce69c0a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:55.427379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-693a64a8-b43e-41c7-bd91-88f9c33c8b7a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:55.439886 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-693a64a8-b43e-41c7-bd91-88f9c33c8b7a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1224 microversion: 2.1 time: 0.287741 Aug 27 05:24:55.451197 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2814/5624] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:55 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1224 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:24:55.702296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c70817e8-404a-4b25-96d9-8a411ce69c0a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:55.716327 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c70817e8-404a-4b25-96d9-8a411ce69c0a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.584994 Aug 27 05:24:55.747911 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2811/5625] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:55 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:24:55.914455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1807859260", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:56.020472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] validate_networks() for [('7906d3ee-5380-4aa1-a43a-a0d97ee78a9e', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:24:56.465046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d79ebedd-8f51-49a6-b268-4de326e4cc97 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:56.466500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d79ebedd-8f51-49a6-b268-4de326e4cc97 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:56.492702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d79ebedd-8f51-49a6-b268-4de326e4cc97 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:56.493577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d79ebedd-8f51-49a6-b268-4de326e4cc97 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:56.494783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d79ebedd-8f51-49a6-b268-4de326e4cc97 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:56.496346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d79ebedd-8f51-49a6-b268-4de326e4cc97 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:56.499473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d79ebedd-8f51-49a6-b268-4de326e4cc97 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:56.500401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d79ebedd-8f51-49a6-b268-4de326e4cc97 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:56.639366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d79ebedd-8f51-49a6-b268-4de326e4cc97 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:56.654093 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d79ebedd-8f51-49a6-b268-4de326e4cc97 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1220 microversion: 2.1 time: 0.193682 Aug 27 05:24:56.655414 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2812/5626] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:56 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1220 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:24:57.681062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c6350932-69ed-419a-b0bf-bb977556a0de tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:57.682850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c6350932-69ed-419a-b0bf-bb977556a0de tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:57.708302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6350932-69ed-419a-b0bf-bb977556a0de tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:57.708821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6350932-69ed-419a-b0bf-bb977556a0de tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:57.709279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6350932-69ed-419a-b0bf-bb977556a0de tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:57.710026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6350932-69ed-419a-b0bf-bb977556a0de tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:57.710492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6350932-69ed-419a-b0bf-bb977556a0de tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:57.718271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6350932-69ed-419a-b0bf-bb977556a0de tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:57.927245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c6350932-69ed-419a-b0bf-bb977556a0de tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:57.943297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:24:57.944324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:24:57.944975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:24:57.945587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:24:57.946264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:24:57.952909 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c6350932-69ed-419a-b0bf-bb977556a0de tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1282 microversion: 2.1 time: 0.276084 Aug 27 05:24:57.959996 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2813/5627] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:57 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1282 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:57.976743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:57.983133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:57.993134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:57.994858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:57.998018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:57.998741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:58.086275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Getting quotas for project 7730f8c3034043dfb2063a05216b8287. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:24:58.139024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Getting quotas for user 5a97d2893d334fc8960af526195cd0cd and project 7730f8c3034043dfb2063a05216b8287. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:24:58.244733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:24:58.263606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:24:58.454834 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e76468b7-b848-4e0b-acb4-f302ca12d8ff tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.546601 Aug 27 05:24:58.469955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1d68df46-e946-4340-9e8d-eb8b3c77beb4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:58.470839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1d68df46-e946-4340-9e8d-eb8b3c77beb4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:58.482529 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2815/5628] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:24:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:24:58.774382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1d68df46-e946-4340-9e8d-eb8b3c77beb4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:58.791565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1d68df46-e946-4340-9e8d-eb8b3c77beb4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1217 microversion: 2.1 time: 0.327986 Aug 27 05:24:58.792174 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2814/5629] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:58 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1217 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:58.983185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df99d0b9-16e9-43e3-adc5-2a29d08e8aaf tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:58.984786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-df99d0b9-16e9-43e3-adc5-2a29d08e8aaf tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:58.999583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df99d0b9-16e9-43e3-adc5-2a29d08e8aaf tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:59.000892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df99d0b9-16e9-43e3-adc5-2a29d08e8aaf tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:59.001580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df99d0b9-16e9-43e3-adc5-2a29d08e8aaf tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:59.002755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df99d0b9-16e9-43e3-adc5-2a29d08e8aaf tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:59.003612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df99d0b9-16e9-43e3-adc5-2a29d08e8aaf tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:59.004319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df99d0b9-16e9-43e3-adc5-2a29d08e8aaf tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:59.362932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df99d0b9-16e9-43e3-adc5-2a29d08e8aaf tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:59.372543 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df99d0b9-16e9-43e3-adc5-2a29d08e8aaf tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1324 microversion: 2.1 time: 0.394483 Aug 27 05:24:59.392321 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2816/5630] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:58 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1324 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:59.818978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dc67183d-b536-4b14-a815-c7c327488872 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:59.819692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dc67183d-b536-4b14-a815-c7c327488872 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:59.848037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc67183d-b536-4b14-a815-c7c327488872 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:59.848443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc67183d-b536-4b14-a815-c7c327488872 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:59.849814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc67183d-b536-4b14-a815-c7c327488872 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:59.849814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc67183d-b536-4b14-a815-c7c327488872 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:59.863703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc67183d-b536-4b14-a815-c7c327488872 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:59.864124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dc67183d-b536-4b14-a815-c7c327488872 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:00.280391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dc67183d-b536-4b14-a815-c7c327488872 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:00.289637 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dc67183d-b536-4b14-a815-c7c327488872 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1213 microversion: 2.1 time: 0.474370 Aug 27 05:25:00.322481 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2815/5631] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:59 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1213 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:00.395368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-281f5d34-a785-4f80-8e23-25cc2689d9c7 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:00.396101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-281f5d34-a785-4f80-8e23-25cc2689d9c7 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:00.405399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-281f5d34-a785-4f80-8e23-25cc2689d9c7 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:00.405904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-281f5d34-a785-4f80-8e23-25cc2689d9c7 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:00.406352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-281f5d34-a785-4f80-8e23-25cc2689d9c7 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:00.420844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-281f5d34-a785-4f80-8e23-25cc2689d9c7 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:00.421597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-281f5d34-a785-4f80-8e23-25cc2689d9c7 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:00.427592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-281f5d34-a785-4f80-8e23-25cc2689d9c7 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:00.642386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-a0caffc1-2a38-492e-9e31-0b8f0713a410 req-e89d1c58-eeba-4f58-a776-9e87d4dae18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdf322d-348f-47ee-b340-32a3bc3f7c4b", "tag": "f88057ae-6b64-4c96-b15e-50c695676d6e"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:00.654803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a0caffc1-2a38-492e-9e31-0b8f0713a410 req-e89d1c58-eeba-4f58-a776-9e87d4dae18a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:00.655751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a0caffc1-2a38-492e-9e31-0b8f0713a410 req-e89d1c58-eeba-4f58-a776-9e87d4dae18a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:00.656397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a0caffc1-2a38-492e-9e31-0b8f0713a410 req-e89d1c58-eeba-4f58-a776-9e87d4dae18a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:00.672388 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-a0caffc1-2a38-492e-9e31-0b8f0713a410 req-e89d1c58-eeba-4f58-a776-9e87d4dae18a service nova] Creating event network-changed:f88057ae-6b64-4c96-b15e-50c695676d6e for instance cfdf322d-348f-47ee-b340-32a3bc3f7c4b on n-h2-820368-35 Aug 27 05:25:00.680751 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-a0caffc1-2a38-492e-9e31-0b8f0713a410 req-e89d1c58-eeba-4f58-a776-9e87d4dae18a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042507 Aug 27 05:25:00.682731 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2816/5632] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:25:00.748152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-281f5d34-a785-4f80-8e23-25cc2689d9c7 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:00.761773 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-281f5d34-a785-4f80-8e23-25cc2689d9c7 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1324 microversion: 2.1 time: 0.370002 Aug 27 05:25:00.776411 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2817/5633] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:00 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:01.328925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eeb46814-e2ce-4d97-be2b-48ba1b8d29d8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:01.332565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eeb46814-e2ce-4d97-be2b-48ba1b8d29d8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:01.346038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:01.349626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eeb46814-e2ce-4d97-be2b-48ba1b8d29d8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:01.351265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eeb46814-e2ce-4d97-be2b-48ba1b8d29d8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:01.353890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eeb46814-e2ce-4d97-be2b-48ba1b8d29d8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:01.362600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eeb46814-e2ce-4d97-be2b-48ba1b8d29d8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:01.363394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eeb46814-e2ce-4d97-be2b-48ba1b8d29d8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:01.364295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eeb46814-e2ce-4d97-be2b-48ba1b8d29d8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:01.788566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0b7852c5-9633-4a33-9387-3678ac87da9d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:01.790325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0b7852c5-9633-4a33-9387-3678ac87da9d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:01.816261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b7852c5-9633-4a33-9387-3678ac87da9d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:01.817042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b7852c5-9633-4a33-9387-3678ac87da9d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:01.817672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b7852c5-9633-4a33-9387-3678ac87da9d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:01.818443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eeb46814-e2ce-4d97-be2b-48ba1b8d29d8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:01.818944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b7852c5-9633-4a33-9387-3678ac87da9d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:01.819631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b7852c5-9633-4a33-9387-3678ac87da9d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:01.820219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b7852c5-9633-4a33-9387-3678ac87da9d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:01.832891 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eeb46814-e2ce-4d97-be2b-48ba1b8d29d8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1275 microversion: 2.1 time: 0.521951 Aug 27 05:25:01.833956 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2817/5634] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:01 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1275 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:02.478659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0b7852c5-9633-4a33-9387-3678ac87da9d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:02.489605 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0b7852c5-9633-4a33-9387-3678ac87da9d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1324 microversion: 2.1 time: 0.711097 Aug 27 05:25:02.492763 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2818/5635] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:01 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1324 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:02.856286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-210ab951-671c-45ca-b99f-34a38bc66aea tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:02.857614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-210ab951-671c-45ca-b99f-34a38bc66aea tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:02.865906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210ab951-671c-45ca-b99f-34a38bc66aea tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:02.866664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210ab951-671c-45ca-b99f-34a38bc66aea tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:02.867304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210ab951-671c-45ca-b99f-34a38bc66aea tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:02.868331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210ab951-671c-45ca-b99f-34a38bc66aea tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:02.869187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210ab951-671c-45ca-b99f-34a38bc66aea tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:02.869855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-210ab951-671c-45ca-b99f-34a38bc66aea tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:02.986960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-210ab951-671c-45ca-b99f-34a38bc66aea tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:02.996802 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-210ab951-671c-45ca-b99f-34a38bc66aea tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1275 microversion: 2.1 time: 0.145509 Aug 27 05:25:03.007182 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2818/5636] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:02 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1275 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:03.514552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-141727aa-d5d7-4c70-b5d0-53f9894b1a24 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:03.515858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-141727aa-d5d7-4c70-b5d0-53f9894b1a24 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:03.526711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141727aa-d5d7-4c70-b5d0-53f9894b1a24 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:03.527246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141727aa-d5d7-4c70-b5d0-53f9894b1a24 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:03.527687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141727aa-d5d7-4c70-b5d0-53f9894b1a24 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:03.528408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141727aa-d5d7-4c70-b5d0-53f9894b1a24 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:03.528866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141727aa-d5d7-4c70-b5d0-53f9894b1a24 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:03.529297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-141727aa-d5d7-4c70-b5d0-53f9894b1a24 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:04.025480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-152c988b-2692-4aec-b9e3-d3aae2c16d46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:04.027520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-152c988b-2692-4aec-b9e3-d3aae2c16d46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:04.044286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152c988b-2692-4aec-b9e3-d3aae2c16d46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:04.046140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152c988b-2692-4aec-b9e3-d3aae2c16d46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:04.047866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152c988b-2692-4aec-b9e3-d3aae2c16d46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:04.048588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-141727aa-d5d7-4c70-b5d0-53f9894b1a24 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:04.050120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152c988b-2692-4aec-b9e3-d3aae2c16d46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:04.050779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152c988b-2692-4aec-b9e3-d3aae2c16d46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:04.053304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-152c988b-2692-4aec-b9e3-d3aae2c16d46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:04.068122 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-141727aa-d5d7-4c70-b5d0-53f9894b1a24 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1324 microversion: 2.1 time: 0.557807 Aug 27 05:25:04.080477 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2819/5637] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:03 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1324 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:04.494346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-152c988b-2692-4aec-b9e3-d3aae2c16d46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:04.503608 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-152c988b-2692-4aec-b9e3-d3aae2c16d46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1317 microversion: 2.1 time: 0.485537 Aug 27 05:25:04.504399 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2819/5638] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:04 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:05.101203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5b19b989-1fa9-42da-bffd-306376c19d1c tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:05.102055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5b19b989-1fa9-42da-bffd-306376c19d1c tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:05.122198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b19b989-1fa9-42da-bffd-306376c19d1c tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:05.122720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b19b989-1fa9-42da-bffd-306376c19d1c tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:05.123154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b19b989-1fa9-42da-bffd-306376c19d1c tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:05.123995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b19b989-1fa9-42da-bffd-306376c19d1c tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:05.124727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b19b989-1fa9-42da-bffd-306376c19d1c tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:05.125494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b19b989-1fa9-42da-bffd-306376c19d1c tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:05.186230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-0ab386b2-c136-4f56-b9ca-26af9d4c0b0c req-b450d974-f06a-4020-adee-769c63354584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e01c08d1-46fc-4e59-88f8-e22358700d09", "tag": "fcf5026e-f0eb-4b0e-b9c4-bb43a385088d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:05.223033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0ab386b2-c136-4f56-b9ca-26af9d4c0b0c req-b450d974-f06a-4020-adee-769c63354584 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:05.223634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0ab386b2-c136-4f56-b9ca-26af9d4c0b0c req-b450d974-f06a-4020-adee-769c63354584 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:05.224559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0ab386b2-c136-4f56-b9ca-26af9d4c0b0c req-b450d974-f06a-4020-adee-769c63354584 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:05.258010 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-0ab386b2-c136-4f56-b9ca-26af9d4c0b0c req-b450d974-f06a-4020-adee-769c63354584 service nova] Creating event network-changed:fcf5026e-f0eb-4b0e-b9c4-bb43a385088d for instance e01c08d1-46fc-4e59-88f8-e22358700d09 on n-h1-820368-35 Aug 27 05:25:05.267184 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-0ab386b2-c136-4f56-b9ca-26af9d4c0b0c req-b450d974-f06a-4020-adee-769c63354584 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098209 Aug 27 05:25:05.276897 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2820/5639] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:05.530481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-064f518c-c93f-430f-b279-3eff897bc064 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:05.531524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-064f518c-c93f-430f-b279-3eff897bc064 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:05.551121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-064f518c-c93f-430f-b279-3eff897bc064 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:05.551902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-064f518c-c93f-430f-b279-3eff897bc064 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:05.552505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-064f518c-c93f-430f-b279-3eff897bc064 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:05.554020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-064f518c-c93f-430f-b279-3eff897bc064 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:05.554502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-064f518c-c93f-430f-b279-3eff897bc064 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:05.554947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-064f518c-c93f-430f-b279-3eff897bc064 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:05.800576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5b19b989-1fa9-42da-bffd-306376c19d1c tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:05.818169 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5b19b989-1fa9-42da-bffd-306376c19d1c tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1324 microversion: 2.1 time: 0.718014 Aug 27 05:25:05.820594 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2820/5640] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:05 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1324 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:06.029713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-064f518c-c93f-430f-b279-3eff897bc064 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:06.041810 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-064f518c-c93f-430f-b279-3eff897bc064 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1317 microversion: 2.1 time: 0.513844 Aug 27 05:25:06.044199 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2821/5641] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:05 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:06.947861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3552eb07-0fcb-4c51-acda-272ca427a8df tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:06.948963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3552eb07-0fcb-4c51-acda-272ca427a8df tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:06.960822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3552eb07-0fcb-4c51-acda-272ca427a8df tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:06.966577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3552eb07-0fcb-4c51-acda-272ca427a8df tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:06.970572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3552eb07-0fcb-4c51-acda-272ca427a8df tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:06.974108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3552eb07-0fcb-4c51-acda-272ca427a8df tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:06.976245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3552eb07-0fcb-4c51-acda-272ca427a8df tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:06.977869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3552eb07-0fcb-4c51-acda-272ca427a8df tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:07.164964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c240866-6582-4555-889b-e369c2e0519e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Action: 'create', calling method: .version_select at 0x7fb55ff61ee0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-358125036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhlKK+FBzFk9c4WB+7jZC/h+Yc9tjkhbDcXCr5r9DWPU3KlCj6Nhm93IewTJFdzjP9qwh4vXPuA7M+PJkQUSORTxDTc4J03m+IbP4yHk7ffmSeJlHCStmTB4IMNh6iNaQ=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:07.183656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-8c240866-6582-4555-889b-e369c2e0519e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Getting quotas for project 28b18ee854244b3998616cf5f5a05fcf. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:25:07.194184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-8c240866-6582-4555-889b-e369c2e0519e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Getting quotas for user 1ad2e05d9d024047acfe2ce68950b68e and project 28b18ee854244b3998616cf5f5a05fcf. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:25:07.225316 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c240866-6582-4555-889b-e369c2e0519e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.378334 Aug 27 05:25:07.225885 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2821/5642] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:25:06 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:07.231184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5c2e8f0e-efb3-4790-9b18-cecaca407bf3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:07.232078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5c2e8f0e-efb3-4790-9b18-cecaca407bf3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:07.240642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c2e8f0e-efb3-4790-9b18-cecaca407bf3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:07.241345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c2e8f0e-efb3-4790-9b18-cecaca407bf3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:07.241947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c2e8f0e-efb3-4790-9b18-cecaca407bf3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:07.242838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c2e8f0e-efb3-4790-9b18-cecaca407bf3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:07.243535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c2e8f0e-efb3-4790-9b18-cecaca407bf3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:07.244145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c2e8f0e-efb3-4790-9b18-cecaca407bf3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:07.422958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3552eb07-0fcb-4c51-acda-272ca427a8df tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:07.438645 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3552eb07-0fcb-4c51-acda-272ca427a8df tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1324 microversion: 2.1 time: 0.498755 Aug 27 05:25:07.450615 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2822/5643] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:06 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1324 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:07.603572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5c2e8f0e-efb3-4790-9b18-cecaca407bf3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:07.618888 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5c2e8f0e-efb3-4790-9b18-cecaca407bf3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1317 microversion: 2.1 time: 0.391346 Aug 27 05:25:07.621860 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2822/5644] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:07 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:07.637288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-97cb8275-e2f7-459b-95a7-e867a5737bb7 req-726551d7-cda6-490d-b2a6-451b6067a47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdf322d-348f-47ee-b340-32a3bc3f7c4b", "name": "network-vif-plugged", "status": "completed", "tag": "f88057ae-6b64-4c96-b15e-50c695676d6e"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:07.661375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-97cb8275-e2f7-459b-95a7-e867a5737bb7 req-726551d7-cda6-490d-b2a6-451b6067a47d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:07.662152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-97cb8275-e2f7-459b-95a7-e867a5737bb7 req-726551d7-cda6-490d-b2a6-451b6067a47d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:07.662751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-97cb8275-e2f7-459b-95a7-e867a5737bb7 req-726551d7-cda6-490d-b2a6-451b6067a47d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:07.690460 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-97cb8275-e2f7-459b-95a7-e867a5737bb7 req-726551d7-cda6-490d-b2a6-451b6067a47d service nova] Creating event network-vif-plugged:f88057ae-6b64-4c96-b15e-50c695676d6e for instance cfdf322d-348f-47ee-b340-32a3bc3f7c4b on n-h2-820368-35 Aug 27 05:25:07.701225 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-97cb8275-e2f7-459b-95a7-e867a5737bb7 req-726551d7-cda6-490d-b2a6-451b6067a47d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067861 Aug 27 05:25:07.702428 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2823/5645] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:08.465607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e974ce5-c474-48e7-8bc4-c4dce422a60a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:08.466865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e974ce5-c474-48e7-8bc4-c4dce422a60a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:08.470017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:08.478157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e974ce5-c474-48e7-8bc4-c4dce422a60a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:08.478792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e974ce5-c474-48e7-8bc4-c4dce422a60a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:08.479527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e974ce5-c474-48e7-8bc4-c4dce422a60a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:08.480501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e974ce5-c474-48e7-8bc4-c4dce422a60a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:08.481152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e974ce5-c474-48e7-8bc4-c4dce422a60a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:08.481787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e974ce5-c474-48e7-8bc4-c4dce422a60a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:08.643014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e9d92ba5-fc50-429c-a03d-6eb2afa076b9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:08.644593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e9d92ba5-fc50-429c-a03d-6eb2afa076b9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:08.655313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9d92ba5-fc50-429c-a03d-6eb2afa076b9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:08.656077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9d92ba5-fc50-429c-a03d-6eb2afa076b9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:08.656692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9d92ba5-fc50-429c-a03d-6eb2afa076b9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:08.657433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9d92ba5-fc50-429c-a03d-6eb2afa076b9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:08.657904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9d92ba5-fc50-429c-a03d-6eb2afa076b9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:08.658335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9d92ba5-fc50-429c-a03d-6eb2afa076b9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:08.779175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:09.009573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e974ce5-c474-48e7-8bc4-c4dce422a60a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:09.018895 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e974ce5-c474-48e7-8bc4-c4dce422a60a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1324 microversion: 2.1 time: 0.557082 Aug 27 05:25:09.019459 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2823/5646] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:08 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1324 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:09.191722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e9d92ba5-fc50-429c-a03d-6eb2afa076b9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:09.221852 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e9d92ba5-fc50-429c-a03d-6eb2afa076b9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1317 microversion: 2.1 time: 0.583919 Aug 27 05:25:09.227898 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2824/5647] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:08 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:10.042122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e32c8a4-b1bd-4a03-b14a-39fca9e8a6b1 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.042953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3e32c8a4-b1bd-4a03-b14a-39fca9e8a6b1 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:10.046008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=7 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:10.052261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e32c8a4-b1bd-4a03-b14a-39fca9e8a6b1 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.052755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e32c8a4-b1bd-4a03-b14a-39fca9e8a6b1 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.053192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e32c8a4-b1bd-4a03-b14a-39fca9e8a6b1 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.053909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e32c8a4-b1bd-4a03-b14a-39fca9e8a6b1 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.054601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e32c8a4-b1bd-4a03-b14a-39fca9e8a6b1 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.055030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e32c8a4-b1bd-4a03-b14a-39fca9e8a6b1 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.247748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9853bb39-ca37-4fe3-a226-38177aa134ba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.248478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9853bb39-ca37-4fe3-a226-38177aa134ba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:10.261099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9853bb39-ca37-4fe3-a226-38177aa134ba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.261865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9853bb39-ca37-4fe3-a226-38177aa134ba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.262530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9853bb39-ca37-4fe3-a226-38177aa134ba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.263556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9853bb39-ca37-4fe3-a226-38177aa134ba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.265615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9853bb39-ca37-4fe3-a226-38177aa134ba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.266148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9853bb39-ca37-4fe3-a226-38177aa134ba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.583637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3e32c8a4-b1bd-4a03-b14a-39fca9e8a6b1 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:10.596230 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e32c8a4-b1bd-4a03-b14a-39fca9e8a6b1 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1520 microversion: 2.1 time: 0.558635 Aug 27 05:25:10.599888 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2824/5648] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:10 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:10.626778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.627783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:10.642435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.643271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.643903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.644803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.645420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.649352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.668308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9853bb39-ca37-4fe3-a226-38177aa134ba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:10.676123 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9853bb39-ca37-4fe3-a226-38177aa134ba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1317 microversion: 2.1 time: 0.432855 Aug 27 05:25:10.680221 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2825/5649] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:10 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:10.700110 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] HTTP exception thrown: Instance is not a member of specified network Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Request method failure captured: Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b/ips/invalid HTTP/1.1 Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqlQvX3AChyIg0jWbwHZVVpbfKHoXMvgCiMCu_5URFpJV3Ek5RTNkfDfLkQTssbsV_6FUge4ohbwmbitILzRUDcTlkOSIm8PSk1wWyorz1KL1zQzfTbemuqwIx6lhe86oZF_nA5j7NU7kRQWMvq8Js8KgeSo8LufoxzIXUejYE8Yrg Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: f401eeab36464806bd39c3205e3e1747 Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1531651396 Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f401eeab36464806bd39c3205e3e1747", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f401eeab36464806bd39c3205e3e1747"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f401eeab36464806bd39c3205e3e1747"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f401eeab36464806bd39c3205e3e1747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1531651396 Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: f401eeab36464806bd39c3205e3e1747 Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1531651396 Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerAddressesNegativeTestJSON-1531651396-project Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: fa7761c0abd1446f8748001e7aff032c Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1531651396-project Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance is not a member of specified network Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'server_id': 'cfdf322d-348f-47ee-b340-32a3bc3f7c4b', 'id': 'invalid'} Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 27 05:25:10.714443 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.719028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:10.720225 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e5560239-3e3d-43d4-8ecf-2405877435cb tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.098301 Aug 27 05:25:10.730792 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2825/5650] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 05:25:10 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b/ips/invalid => generated 91 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 05:25:10.739222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a102d54-17a7-439d-9253-dc71c23e9d2d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.740388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a102d54-17a7-439d-9253-dc71c23e9d2d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Failed to fetch instance by id 999 {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 05:25:10.742049 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-1a102d54-17a7-439d-9253-dc71c23e9d2d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] HTTP exception thrown: Instance 999 could not be found. Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a102d54-17a7-439d-9253-dc71c23e9d2d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Request method failure captured: Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqlQvX3AChyIg0jWbwHZVVpbfKHoXMvgCiMCu_5URFpJV3Ek5RTNkfDfLkQTssbsV_6FUge4ohbwmbitILzRUDcTlkOSIm8PSk1wWyorz1KL1zQzfTbemuqwIx6lhe86oZF_nA5j7NU7kRQWMvq8Js8KgeSo8LufoxzIXUejYE8Yrg Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: f401eeab36464806bd39c3205e3e1747 Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1531651396 Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f401eeab36464806bd39c3205e3e1747", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f401eeab36464806bd39c3205e3e1747"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f401eeab36464806bd39c3205e3e1747"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f401eeab36464806bd39c3205e3e1747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1531651396 Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: f401eeab36464806bd39c3205e3e1747 Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1531651396 Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerAddressesNegativeTestJSON-1531651396-project Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: fa7761c0abd1446f8748001e7aff032c Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1531651396-project Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 999 could not be found. Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'server_id': '999'} Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 05:25:10.745055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.754516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a102d54-17a7-439d-9253-dc71c23e9d2d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:10.755539 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a102d54-17a7-439d-9253-dc71c23e9d2d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.024596 Aug 27 05:25:10.762919 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2826/5651] 10.222.0.58 () {58 vars in 1149 bytes} [Sat Aug 27 05:25:10 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:25:10.769839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7c4f0943-2f62-4a97-bccb-a8609a3bcf61 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.770515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7c4f0943-2f62-4a97-bccb-a8609a3bcf61 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:10.783620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4f0943-2f62-4a97-bccb-a8609a3bcf61 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.784132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4f0943-2f62-4a97-bccb-a8609a3bcf61 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.784586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4f0943-2f62-4a97-bccb-a8609a3bcf61 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.787182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4f0943-2f62-4a97-bccb-a8609a3bcf61 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.789832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4f0943-2f62-4a97-bccb-a8609a3bcf61 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.790911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c4f0943-2f62-4a97-bccb-a8609a3bcf61 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.857930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7c4f0943-2f62-4a97-bccb-a8609a3bcf61 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:25:11.075781 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7c4f0943-2f62-4a97-bccb-a8609a3bcf61 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 204 len: 0 microversion: 2.1 time: 0.309959 Aug 27 05:25:11.076912 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2826/5652] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:25:10 2022] DELETE /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:25:11.089302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-425a30f9-cf0a-4ee4-9c9a-26f906a6a0a3 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:11.090475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-425a30f9-cf0a-4ee4-9c9a-26f906a6a0a3 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:11.108528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-425a30f9-cf0a-4ee4-9c9a-26f906a6a0a3 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:11.112345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-425a30f9-cf0a-4ee4-9c9a-26f906a6a0a3 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:11.115359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-425a30f9-cf0a-4ee4-9c9a-26f906a6a0a3 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:11.120945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-425a30f9-cf0a-4ee4-9c9a-26f906a6a0a3 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:11.123617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-425a30f9-cf0a-4ee4-9c9a-26f906a6a0a3 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:11.125768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-425a30f9-cf0a-4ee4-9c9a-26f906a6a0a3 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:11.700257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8833e490-4159-4e8b-84ab-55da53c77ae7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:11.701689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8833e490-4159-4e8b-84ab-55da53c77ae7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:11.709444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8833e490-4159-4e8b-84ab-55da53c77ae7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:11.709960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8833e490-4159-4e8b-84ab-55da53c77ae7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:11.710950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8833e490-4159-4e8b-84ab-55da53c77ae7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:11.711760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8833e490-4159-4e8b-84ab-55da53c77ae7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:11.713291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8833e490-4159-4e8b-84ab-55da53c77ae7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:11.713949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8833e490-4159-4e8b-84ab-55da53c77ae7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:12.220527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-425a30f9-cf0a-4ee4-9c9a-26f906a6a0a3 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:12.243323 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-425a30f9-cf0a-4ee4-9c9a-26f906a6a0a3 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1526 microversion: 2.1 time: 1.156131 Aug 27 05:25:12.246346 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2827/5653] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:11 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1526 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:12.372737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8833e490-4159-4e8b-84ab-55da53c77ae7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:12.384876 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8833e490-4159-4e8b-84ab-55da53c77ae7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1317 microversion: 2.1 time: 0.689741 Aug 27 05:25:12.389119 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2827/5654] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:11 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:13.274397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0fc4e554-df26-4e24-8019-d195a52d2955 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:13.275992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0fc4e554-df26-4e24-8019-d195a52d2955 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:13.289171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fc4e554-df26-4e24-8019-d195a52d2955 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:13.290161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fc4e554-df26-4e24-8019-d195a52d2955 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:13.291163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fc4e554-df26-4e24-8019-d195a52d2955 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:13.292402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fc4e554-df26-4e24-8019-d195a52d2955 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:13.293741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fc4e554-df26-4e24-8019-d195a52d2955 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:13.296737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0fc4e554-df26-4e24-8019-d195a52d2955 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:13.423579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8aa1a40-d8e1-4cfd-b4a8-66e5afa4bafb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:13.425925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e8aa1a40-d8e1-4cfd-b4a8-66e5afa4bafb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:13.439960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aa1a40-d8e1-4cfd-b4a8-66e5afa4bafb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:13.441177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aa1a40-d8e1-4cfd-b4a8-66e5afa4bafb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:13.442011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aa1a40-d8e1-4cfd-b4a8-66e5afa4bafb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:13.443014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aa1a40-d8e1-4cfd-b4a8-66e5afa4bafb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:13.444010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aa1a40-d8e1-4cfd-b4a8-66e5afa4bafb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:13.444698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aa1a40-d8e1-4cfd-b4a8-66e5afa4bafb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:14.147527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e8aa1a40-d8e1-4cfd-b4a8-66e5afa4bafb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:14.157156 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e8aa1a40-d8e1-4cfd-b4a8-66e5afa4bafb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1317 microversion: 2.1 time: 0.745018 Aug 27 05:25:14.158596 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2828/5655] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:13 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:14.167696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0fc4e554-df26-4e24-8019-d195a52d2955 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:14.199803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-cd47b62f-6fbd-4b0f-96be-1a3b6256ef67 req-661be199-55b9-4a91-a3af-6529441afa68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01c08d1-46fc-4e59-88f8-e22358700d09", "name": "network-vif-plugged", "status": "completed", "tag": "fcf5026e-f0eb-4b0e-b9c4-bb43a385088d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:14.203856 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0fc4e554-df26-4e24-8019-d195a52d2955 tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1526 microversion: 2.1 time: 0.933196 Aug 27 05:25:14.208294 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2828/5656] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:13 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1526 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:14.232423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cd47b62f-6fbd-4b0f-96be-1a3b6256ef67 req-661be199-55b9-4a91-a3af-6529441afa68 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:14.233218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cd47b62f-6fbd-4b0f-96be-1a3b6256ef67 req-661be199-55b9-4a91-a3af-6529441afa68 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:14.234201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cd47b62f-6fbd-4b0f-96be-1a3b6256ef67 req-661be199-55b9-4a91-a3af-6529441afa68 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:14.260764 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-cd47b62f-6fbd-4b0f-96be-1a3b6256ef67 req-661be199-55b9-4a91-a3af-6529441afa68 service nova] Creating event network-vif-plugged:fcf5026e-f0eb-4b0e-b9c4-bb43a385088d for instance e01c08d1-46fc-4e59-88f8-e22358700d09 on n-h1-820368-35 Aug 27 05:25:14.277259 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-cd47b62f-6fbd-4b0f-96be-1a3b6256ef67 req-661be199-55b9-4a91-a3af-6529441afa68 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114258 Aug 27 05:25:14.280210 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2829/5657] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:14.590831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-8b3bec81-721a-4aec-8c63-3210fab802a0 req-eb4007d4-e485-4f58-ae3a-705286eaa5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdf322d-348f-47ee-b340-32a3bc3f7c4b", "name": "network-vif-deleted", "tag": "f88057ae-6b64-4c96-b15e-50c695676d6e"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:14.648612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8b3bec81-721a-4aec-8c63-3210fab802a0 req-eb4007d4-e485-4f58-ae3a-705286eaa5a2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:14.653452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8b3bec81-721a-4aec-8c63-3210fab802a0 req-eb4007d4-e485-4f58-ae3a-705286eaa5a2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:14.654851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8b3bec81-721a-4aec-8c63-3210fab802a0 req-eb4007d4-e485-4f58-ae3a-705286eaa5a2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:14.718831 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-8b3bec81-721a-4aec-8c63-3210fab802a0 req-eb4007d4-e485-4f58-ae3a-705286eaa5a2 service nova] Creating event network-vif-deleted:f88057ae-6b64-4c96-b15e-50c695676d6e for instance cfdf322d-348f-47ee-b340-32a3bc3f7c4b on n-h2-820368-35 Aug 27 05:25:14.743329 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-8b3bec81-721a-4aec-8c63-3210fab802a0 req-eb4007d4-e485-4f58-ae3a-705286eaa5a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167898 Aug 27 05:25:14.745005 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2829/5658] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:15.197040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c026d898-9e0b-4479-afe9-339f36748652 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:15.197952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c026d898-9e0b-4479-afe9-339f36748652 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:15.216445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c026d898-9e0b-4479-afe9-339f36748652 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:15.218663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c026d898-9e0b-4479-afe9-339f36748652 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:15.219157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c026d898-9e0b-4479-afe9-339f36748652 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:15.222200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c026d898-9e0b-4479-afe9-339f36748652 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:15.222747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c026d898-9e0b-4479-afe9-339f36748652 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:15.223230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c026d898-9e0b-4479-afe9-339f36748652 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:15.233172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:15.234071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:15.251702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:15.255518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:15.257462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:15.258464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:15.261856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:15.263665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:15.393302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:15.416671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:15.418784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:15.419835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lazy-loading 'fault' on Instance uuid cfdf322d-348f-47ee-b340-32a3bc3f7c4b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:25:15.686986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7761c0abd1446f8748001e7aff032c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401eeab36464806bd39c3205e3e1747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:15.708705 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cd64c8d6-54ab-4d0e-9ed6-8a054752fd6a tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 200 len: 1314 microversion: 2.1 time: 0.480919 Aug 27 05:25:15.711997 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2830/5659] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:15 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:15.920984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c026d898-9e0b-4479-afe9-339f36748652 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:15.932630 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c026d898-9e0b-4479-afe9-339f36748652 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1317 microversion: 2.1 time: 0.741760 Aug 27 05:25:15.948593 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2830/5660] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:15 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1317 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:16.740986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:16.753622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] [instance: cfdf322d-348f-47ee-b340-32a3bc3f7c4b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:16.797043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:16.803706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:16.804679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:16.816868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:16.820192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:16.821443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:16.894695 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] HTTP exception thrown: Instance cfdf322d-348f-47ee-b340-32a3bc3f7c4b could not be found. Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Request method failure captured: Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b HTTP/1.1 Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqlQvX3AChyIg0jWbwHZVVpbfKHoXMvgCiMCu_5URFpJV3Ek5RTNkfDfLkQTssbsV_6FUge4ohbwmbitILzRUDcTlkOSIm8PSk1wWyorz1KL1zQzfTbemuqwIx6lhe86oZF_nA5j7NU7kRQWMvq8Js8KgeSo8LufoxzIXUejYE8Yrg Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: f401eeab36464806bd39c3205e3e1747 Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1531651396 Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f401eeab36464806bd39c3205e3e1747", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f401eeab36464806bd39c3205e3e1747"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f401eeab36464806bd39c3205e3e1747"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f401eeab36464806bd39c3205e3e1747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1531651396 Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: f401eeab36464806bd39c3205e3e1747 Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1531651396 Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerAddressesNegativeTestJSON-1531651396-project Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: fa7761c0abd1446f8748001e7aff032c Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1531651396-project Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance cfdf322d-348f-47ee-b340-32a3bc3f7c4b could not be found. Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'cfdf322d-348f-47ee-b340-32a3bc3f7c4b'} Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfdf322d-348f-47ee-b340-32a3bc3f7c4b could not be found. Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfdf322d-348f-47ee-b340-32a3bc3f7c4b could not be found. Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:16.897085 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:16.903012 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:16.903012 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:16.903012 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:16.903012 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:16.903012 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:16.903012 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:16.903012 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfdf322d-348f-47ee-b340-32a3bc3f7c4b could not be found. Aug 27 05:25:16.903012 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:16.903012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] Returning 404 to user: Instance cfdf322d-348f-47ee-b340-32a3bc3f7c4b could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:16.907269 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4722a5ea-4828-43d0-a09c-67f002717d1d tempest-ServerAddressesNegativeTestJSON-1531651396 tempest-ServerAddressesNegativeTestJSON-1531651396-project] 10.222.0.58 "GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b" status: 404 len: 111 microversion: 2.1 time: 0.176558 Aug 27 05:25:16.908007 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2831/5661] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:16 2022] GET /compute/v2.1/servers/cfdf322d-348f-47ee-b340-32a3bc3f7c4b => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:25:16.954406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-da314b19-8228-4c0e-8df3-1f38864e283f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:16.955118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-da314b19-8228-4c0e-8df3-1f38864e283f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:16.965062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da314b19-8228-4c0e-8df3-1f38864e283f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:16.971857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da314b19-8228-4c0e-8df3-1f38864e283f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:16.976316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da314b19-8228-4c0e-8df3-1f38864e283f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:16.977545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da314b19-8228-4c0e-8df3-1f38864e283f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:16.978223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da314b19-8228-4c0e-8df3-1f38864e283f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:16.979724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da314b19-8228-4c0e-8df3-1f38864e283f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:17.054226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:17.203234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=18 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:18.087079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-da314b19-8228-4c0e-8df3-1f38864e283f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:18.099522 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-da314b19-8228-4c0e-8df3-1f38864e283f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1505 microversion: 2.1 time: 1.145970 Aug 27 05:25:18.101273 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2831/5662] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:16 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1505 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:18.128742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-60eac944-5b56-4526-99c7-1805f7aea476 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:18.130075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60eac944-5b56-4526-99c7-1805f7aea476 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:18.140997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60eac944-5b56-4526-99c7-1805f7aea476 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:18.141694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60eac944-5b56-4526-99c7-1805f7aea476 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:18.142850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60eac944-5b56-4526-99c7-1805f7aea476 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:18.143803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60eac944-5b56-4526-99c7-1805f7aea476 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:18.144481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60eac944-5b56-4526-99c7-1805f7aea476 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:18.145097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-60eac944-5b56-4526-99c7-1805f7aea476 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:18.188070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:18.198104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-60eac944-5b56-4526-99c7-1805f7aea476 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:25:18.419792 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-60eac944-5b56-4526-99c7-1805f7aea476 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 204 len: 0 microversion: 2.1 time: 0.299389 Aug 27 05:25:18.421568 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2832/5663] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:25:18 2022] DELETE /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:25:18.429649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23523561-35d1-4afb-a971-67a8ee202de0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:18.431365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-23523561-35d1-4afb-a971-67a8ee202de0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:18.441836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23523561-35d1-4afb-a971-67a8ee202de0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:18.449229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23523561-35d1-4afb-a971-67a8ee202de0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:18.450428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23523561-35d1-4afb-a971-67a8ee202de0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:18.453510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23523561-35d1-4afb-a971-67a8ee202de0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:18.454864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23523561-35d1-4afb-a971-67a8ee202de0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:18.456181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23523561-35d1-4afb-a971-67a8ee202de0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:19.063809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23523561-35d1-4afb-a971-67a8ee202de0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:19.082155 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-23523561-35d1-4afb-a971-67a8ee202de0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1511 microversion: 2.1 time: 0.656316 Aug 27 05:25:19.086409 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2832/5664] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:18 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1511 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:20.112869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d864aeab-a8b0-4d02-b050-98942546f623 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:20.116664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d864aeab-a8b0-4d02-b050-98942546f623 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:20.139867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d864aeab-a8b0-4d02-b050-98942546f623 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:20.141324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d864aeab-a8b0-4d02-b050-98942546f623 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:20.142420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d864aeab-a8b0-4d02-b050-98942546f623 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:20.144136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d864aeab-a8b0-4d02-b050-98942546f623 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:20.145346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d864aeab-a8b0-4d02-b050-98942546f623 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:20.146011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d864aeab-a8b0-4d02-b050-98942546f623 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:20.588298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d864aeab-a8b0-4d02-b050-98942546f623 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:20.614026 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d864aeab-a8b0-4d02-b050-98942546f623 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1511 microversion: 2.1 time: 0.507507 Aug 27 05:25:20.633260 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2833/5665] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:20 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1511 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:21.646124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d932c717-f92d-4bf7-8639-ec44ab544564 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:21.646859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d932c717-f92d-4bf7-8639-ec44ab544564 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:21.673651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d932c717-f92d-4bf7-8639-ec44ab544564 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:21.674267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d932c717-f92d-4bf7-8639-ec44ab544564 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:21.674734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d932c717-f92d-4bf7-8639-ec44ab544564 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:21.678746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d932c717-f92d-4bf7-8639-ec44ab544564 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:21.679303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d932c717-f92d-4bf7-8639-ec44ab544564 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:21.679759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d932c717-f92d-4bf7-8639-ec44ab544564 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:22.600466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d932c717-f92d-4bf7-8639-ec44ab544564 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:22.622388 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d932c717-f92d-4bf7-8639-ec44ab544564 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1511 microversion: 2.1 time: 0.980318 Aug 27 05:25:22.641395 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2833/5666] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:21 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1511 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:22.695967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-958a58f8-73ce-4ade-9348-4eccd606b852 req-1581960e-5f54-44df-b56a-e03db541e39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01c08d1-46fc-4e59-88f8-e22358700d09", "name": "network-vif-deleted", "tag": "fcf5026e-f0eb-4b0e-b9c4-bb43a385088d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:22.721055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-958a58f8-73ce-4ade-9348-4eccd606b852 req-1581960e-5f54-44df-b56a-e03db541e39c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:22.722071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-958a58f8-73ce-4ade-9348-4eccd606b852 req-1581960e-5f54-44df-b56a-e03db541e39c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:22.724380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-958a58f8-73ce-4ade-9348-4eccd606b852 req-1581960e-5f54-44df-b56a-e03db541e39c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:22.770023 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-958a58f8-73ce-4ade-9348-4eccd606b852 req-1581960e-5f54-44df-b56a-e03db541e39c service nova] Creating event network-vif-deleted:fcf5026e-f0eb-4b0e-b9c4-bb43a385088d for instance e01c08d1-46fc-4e59-88f8-e22358700d09 on n-h1-820368-35 Aug 27 05:25:22.782008 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-958a58f8-73ce-4ade-9348-4eccd606b852 req-1581960e-5f54-44df-b56a-e03db541e39c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092209 Aug 27 05:25:22.786060 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2834/5667] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:23.647646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:23.650177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:23.658465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:23.659291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:23.659929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:23.660871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:23.661495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:23.662098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:23.710330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:23.711125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:23.712206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:23.712674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lazy-loading 'fault' on Instance uuid e01c08d1-46fc-4e59-88f8-e22358700d09 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:25:23.810310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:23.846490 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-21a36a49-df0a-44bd-becc-11be25f7d64b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 200 len: 1307 microversion: 2.1 time: 0.203532 Aug 27 05:25:23.851822 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2834/5668] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:23 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:24.876237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:24.877460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:24.893810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:24.894623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:24.901381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:24.907780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:24.908403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:24.909317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:24.946575 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 HTTP/1.1 Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e01c08d1-46fc-4e59-88f8-e22358700d09'} Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:24.953307 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:24.958642 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:24.958642 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:24.958642 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:24.958642 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:24.958642 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:24.958642 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:25:24.958642 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:24.958642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:24.958642 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-649c248b-381b-477a-83c6-921a694ca981 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 404 len: 111 microversion: 2.1 time: 0.083346 Aug 27 05:25:24.965144 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2835/5669] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:24 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:25:24.972884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3dd5564a-f7dc-4077-aa79-78e4f5bbb734 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:24.973497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3dd5564a-f7dc-4077-aa79-78e4f5bbb734 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:24.993512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd5564a-f7dc-4077-aa79-78e4f5bbb734 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:24.999065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd5564a-f7dc-4077-aa79-78e4f5bbb734 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:25.000464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd5564a-f7dc-4077-aa79-78e4f5bbb734 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:25.001672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd5564a-f7dc-4077-aa79-78e4f5bbb734 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:25.002333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd5564a-f7dc-4077-aa79-78e4f5bbb734 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:25.003855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3dd5564a-f7dc-4077-aa79-78e4f5bbb734 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:25.686910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3dd5564a-f7dc-4077-aa79-78e4f5bbb734 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:25.702133 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3dd5564a-f7dc-4077-aa79-78e4f5bbb734 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.733110 Aug 27 05:25:25.723535 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2835/5670] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:24 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:25.996383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-464d3529-69e4-4338-a088-abce133b6d1f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-464d3529-69e4-4338-a088-abce133b6d1f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 163 Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": 12345, "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 12345 Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:25:26.000454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-464d3529-69e4-4338-a088-abce133b6d1f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:26.006500 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-464d3529-69e4-4338-a088-abce133b6d1f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.010515 Aug 27 05:25:26.010750 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2836/5671] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:25 2022] POST /compute/v2.1/servers => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:25:26.019915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8976f1be-5058-42d2-bc4a-966d6d24d388 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:26.019915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8976f1be-5058-42d2-bc4a-966d6d24d388 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:26.029969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8976f1be-5058-42d2-bc4a-966d6d24d388 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:26.030467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8976f1be-5058-42d2-bc4a-966d6d24d388 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:26.040404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8976f1be-5058-42d2-bc4a-966d6d24d388 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:26.041210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8976f1be-5058-42d2-bc4a-966d6d24d388 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:26.041698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8976f1be-5058-42d2-bc4a-966d6d24d388 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:26.042144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8976f1be-5058-42d2-bc4a-966d6d24d388 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:26.284575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1611286681-access_point-1143856059", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "b1f08b54-5fb5-4a54-a9a8-49a1dd46482d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-358125036", "security_groups": [{"name": "tempest-secgroup_access--464604014"}, {"name": "tempest-secgroup_general--1707310154"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:26.591876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8976f1be-5058-42d2-bc4a-966d6d24d388 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:26.600167 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8976f1be-5058-42d2-bc4a-966d6d24d388 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.584959 Aug 27 05:25:26.621071 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2836/5672] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:26 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:26.626281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-541f07eb-7b82-4f46-89a9-77e5e324ef83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:26.640063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-541f07eb-7b82-4f46-89a9-77e5e324ef83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:26.646799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541f07eb-7b82-4f46-89a9-77e5e324ef83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:26.647669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541f07eb-7b82-4f46-89a9-77e5e324ef83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:26.648285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541f07eb-7b82-4f46-89a9-77e5e324ef83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:26.649288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541f07eb-7b82-4f46-89a9-77e5e324ef83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:26.649912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541f07eb-7b82-4f46-89a9-77e5e324ef83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:26.650511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-541f07eb-7b82-4f46-89a9-77e5e324ef83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:26.918192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] validate_networks() for [('b1f08b54-5fb5-4a54-a9a8-49a1dd46482d', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:25:27.286832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-541f07eb-7b82-4f46-89a9-77e5e324ef83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:27.306663 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-541f07eb-7b82-4f46-89a9-77e5e324ef83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.677922 Aug 27 05:25:27.307395 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2837/5673] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:26 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:28.413110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:25:28.413954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:25:28.414251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:25:28.414701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:25:28.419707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:25:28.479477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:28.488685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:28.490046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:28.492057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:28.495246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:28.496718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:28.553429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Getting quotas for project 28b18ee854244b3998616cf5f5a05fcf. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:25:28.562868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Getting quotas for user 1ad2e05d9d024047acfe2ce68950b68e and project 28b18ee854244b3998616cf5f5a05fcf. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:25:28.592840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:25:28.596169 n-d-820368-35 devstack@n-api.service[128548]: WARNING nova.utils [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1611286681-access_point-1143856059 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1611286681-ac Aug 27 05:25:28.597336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:25:28.658807 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9aa756a7-4fb4-4f1b-a310-a98a34a1c6f0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.381036 Aug 27 05:25:28.660483 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2837/5674] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:26 2022] POST /compute/v2.1/servers => generated 457 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:25:28.672486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1454d19b-e491-4a7d-9abf-9a15f17465e0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:28.673108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1454d19b-e491-4a7d-9abf-9a15f17465e0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:28.866355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1454d19b-e491-4a7d-9abf-9a15f17465e0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:28.892595 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1454d19b-e491-4a7d-9abf-9a15f17465e0 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1294 microversion: 2.1 time: 0.222890 Aug 27 05:25:28.893618 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2838/5675] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:28 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1294 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:29.944280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b01009e9-ccb5-4f7c-8a4c-4d95cdf36a7e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:29.945569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b01009e9-ccb5-4f7c-8a4c-4d95cdf36a7e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:30.299395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b01009e9-ccb5-4f7c-8a4c-4d95cdf36a7e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:30.321951 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b01009e9-ccb5-4f7c-8a4c-4d95cdf36a7e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1294 microversion: 2.1 time: 0.389746 Aug 27 05:25:30.331205 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2838/5676] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:29 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1294 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:31.358239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b6d6840-688f-4505-b4b1-66b6da9c9ae7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:31.360258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3b6d6840-688f-4505-b4b1-66b6da9c9ae7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:31.401861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b6d6840-688f-4505-b4b1-66b6da9c9ae7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:31.402977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b6d6840-688f-4505-b4b1-66b6da9c9ae7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:31.403817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b6d6840-688f-4505-b4b1-66b6da9c9ae7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:31.405299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b6d6840-688f-4505-b4b1-66b6da9c9ae7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:31.408139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b6d6840-688f-4505-b4b1-66b6da9c9ae7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:31.413054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b6d6840-688f-4505-b4b1-66b6da9c9ae7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:31.545883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af3f0b02-f687-4eb6-8291-8e0b641c234e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-691513824", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fa4e98ff-ef97-46cf-8cec-b55d097a383a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:31.587332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:31.628622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3b6d6840-688f-4505-b4b1-66b6da9c9ae7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:31.655456 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3b6d6840-688f-4505-b4b1-66b6da9c9ae7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1346 microversion: 2.1 time: 0.309298 Aug 27 05:25:31.662815 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2839/5677] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:31 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1346 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:31.767428 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-af3f0b02-f687-4eb6-8291-8e0b641c234e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Block Device fa4e98ff-ef97-46cf-8cec-b55d097a383a is not bootable. Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af3f0b02-f687-4eb6-8291-8e0b641c234e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 357 Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-691513824", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fa4e98ff-ef97-46cf-8cec-b55d097a383a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: exception: Block Device fa4e98ff-ef97-46cf-8cec-b55d097a383a is not bootable. Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-691513824', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'fa4e98ff-ef97-46cf-8cec-b55d097a383a'}], 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device fa4e98ff-ef97-46cf-8cec-b55d097a383a is not bootable. Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:31.775384 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device fa4e98ff-ef97-46cf-8cec-b55d097a383a is not bootable. Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device fa4e98ff-ef97-46cf-8cec-b55d097a383a is not bootable. Aug 27 05:25:31.779849 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:31.781136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af3f0b02-f687-4eb6-8291-8e0b641c234e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Block Device fa4e98ff-ef97-46cf-8cec-b55d097a383a is not bootable. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:31.782858 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af3f0b02-f687-4eb6-8291-8e0b641c234e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.241123 Aug 27 05:25:31.784542 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2839/5678] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:31 2022] POST /compute/v2.1/servers => generated 110 bytes in 244 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:25:31.800968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-89c2b6a5-38c5-4444-9062-6b5505d1d0ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:31.804797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-89c2b6a5-38c5-4444-9062-6b5505d1d0ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:31.814639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89c2b6a5-38c5-4444-9062-6b5505d1d0ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:31.816373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89c2b6a5-38c5-4444-9062-6b5505d1d0ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:31.817055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89c2b6a5-38c5-4444-9062-6b5505d1d0ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:31.818256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89c2b6a5-38c5-4444-9062-6b5505d1d0ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:31.818927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89c2b6a5-38c5-4444-9062-6b5505d1d0ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:31.819612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89c2b6a5-38c5-4444-9062-6b5505d1d0ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:32.193582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-89c2b6a5-38c5-4444-9062-6b5505d1d0ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:32.202445 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-89c2b6a5-38c5-4444-9062-6b5505d1d0ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.411810 Aug 27 05:25:32.203658 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2840/5679] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:31 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:32.233836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b12913a4-dbde-4409-afdc-2f5030172d40 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:32.235357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b12913a4-dbde-4409-afdc-2f5030172d40 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:32.245889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b12913a4-dbde-4409-afdc-2f5030172d40 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:32.248190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b12913a4-dbde-4409-afdc-2f5030172d40 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:32.248803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b12913a4-dbde-4409-afdc-2f5030172d40 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:32.249473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b12913a4-dbde-4409-afdc-2f5030172d40 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:32.250113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b12913a4-dbde-4409-afdc-2f5030172d40 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:32.253493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b12913a4-dbde-4409-afdc-2f5030172d40 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:32.681538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b12913a4-dbde-4409-afdc-2f5030172d40 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:32.691657 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b12913a4-dbde-4409-afdc-2f5030172d40 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.463192 Aug 27 05:25:32.712325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3863072c-0987-4f1c-a41c-666d61d1cf21 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:32.712325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3863072c-0987-4f1c-a41c-666d61d1cf21 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:32.713255 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2840/5680] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:32 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:32.723758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3863072c-0987-4f1c-a41c-666d61d1cf21 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:32.724280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3863072c-0987-4f1c-a41c-666d61d1cf21 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:32.724737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3863072c-0987-4f1c-a41c-666d61d1cf21 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:32.728887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3863072c-0987-4f1c-a41c-666d61d1cf21 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:32.731415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3863072c-0987-4f1c-a41c-666d61d1cf21 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:32.731878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3863072c-0987-4f1c-a41c-666d61d1cf21 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:32.972933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3863072c-0987-4f1c-a41c-666d61d1cf21 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:32.983189 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3863072c-0987-4f1c-a41c-666d61d1cf21 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1352 microversion: 2.1 time: 0.303005 Aug 27 05:25:32.985897 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2841/5681] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:32 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1352 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:34.015555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ee04fae2-48c3-449a-96cb-e1b6a6d57fd7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:34.016983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ee04fae2-48c3-449a-96cb-e1b6a6d57fd7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:34.032993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee04fae2-48c3-449a-96cb-e1b6a6d57fd7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:34.033783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee04fae2-48c3-449a-96cb-e1b6a6d57fd7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:34.035364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee04fae2-48c3-449a-96cb-e1b6a6d57fd7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:34.036281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee04fae2-48c3-449a-96cb-e1b6a6d57fd7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:34.036917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee04fae2-48c3-449a-96cb-e1b6a6d57fd7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:34.037533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee04fae2-48c3-449a-96cb-e1b6a6d57fd7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:34.573525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ee04fae2-48c3-449a-96cb-e1b6a6d57fd7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:34.585579 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ee04fae2-48c3-449a-96cb-e1b6a6d57fd7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1471 microversion: 2.1 time: 0.575227 Aug 27 05:25:34.591441 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2841/5682] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:34 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1471 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:35.491740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-645c40ad-c205-413d-99fc-d8fca2b06ed1 req-db744c1e-16fa-42c3-8dc2-e46c11fce787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6625a4-fa42-41a0-8664-65bb32081817", "tag": "256e99b8-b009-4f0e-8458-fb3d127ff19e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:35.533264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-645c40ad-c205-413d-99fc-d8fca2b06ed1 req-db744c1e-16fa-42c3-8dc2-e46c11fce787 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:35.535803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-645c40ad-c205-413d-99fc-d8fca2b06ed1 req-db744c1e-16fa-42c3-8dc2-e46c11fce787 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:35.536466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-645c40ad-c205-413d-99fc-d8fca2b06ed1 req-db744c1e-16fa-42c3-8dc2-e46c11fce787 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:35.566682 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-645c40ad-c205-413d-99fc-d8fca2b06ed1 req-db744c1e-16fa-42c3-8dc2-e46c11fce787 service nova] Creating event network-changed:256e99b8-b009-4f0e-8458-fb3d127ff19e for instance 1e6625a4-fa42-41a0-8664-65bb32081817 on n-h1-820368-35 Aug 27 05:25:35.580823 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-645c40ad-c205-413d-99fc-d8fca2b06ed1 req-db744c1e-16fa-42c3-8dc2-e46c11fce787 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117671 Aug 27 05:25:35.581566 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2842/5683] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:35.618586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-72dd0cb9-de6f-4579-bfa6-af82d9dbf8eb tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:35.620437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-72dd0cb9-de6f-4579-bfa6-af82d9dbf8eb tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:35.653585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dd0cb9-de6f-4579-bfa6-af82d9dbf8eb tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:35.657272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dd0cb9-de6f-4579-bfa6-af82d9dbf8eb tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:35.659615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dd0cb9-de6f-4579-bfa6-af82d9dbf8eb tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:35.660820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dd0cb9-de6f-4579-bfa6-af82d9dbf8eb tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:35.663580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dd0cb9-de6f-4579-bfa6-af82d9dbf8eb tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:35.669674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dd0cb9-de6f-4579-bfa6-af82d9dbf8eb tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:35.795968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b226355b-d6f0-48ac-bd19-75b26f349c80 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1170754598", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "destination_type": "local"}, {"source_type": "volume", "uuid": "a7de3de5-abd3-40ce-a96f-690805f503ff", "destination_type": "invalid"}], "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b226355b-d6f0-48ac-bd19-75b26f349c80 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 495 Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1170754598", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "destination_type": "local"}, {"source_type": "volume", "uuid": "a7de3de5-abd3-40ce-a96f-690805f503ff", "destination_type": "invalid"}], "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1170754598', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'a7de3de5-abd3-40ce-a96f-690805f503ff', 'destination_type': 'invalid'}], 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:35.806444 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 05:25:35.814419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:35.822414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b226355b-d6f0-48ac-bd19-75b26f349c80 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:35.822414 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b226355b-d6f0-48ac-bd19-75b26f349c80 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.034246 Aug 27 05:25:35.822414 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2843/5684] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:35 2022] POST /compute/v2.1/servers => generated 155 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:25:35.833771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-468f21e9-cef9-4c1a-8791-d4fa79099589 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:35.834680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-468f21e9-cef9-4c1a-8791-d4fa79099589 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:35.855316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-468f21e9-cef9-4c1a-8791-d4fa79099589 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:35.856203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-468f21e9-cef9-4c1a-8791-d4fa79099589 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:35.856938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-468f21e9-cef9-4c1a-8791-d4fa79099589 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:35.858203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-468f21e9-cef9-4c1a-8791-d4fa79099589 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:35.858890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-468f21e9-cef9-4c1a-8791-d4fa79099589 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:35.859755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-468f21e9-cef9-4c1a-8791-d4fa79099589 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:36.223022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-468f21e9-cef9-4c1a-8791-d4fa79099589 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:36.233844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-72dd0cb9-de6f-4579-bfa6-af82d9dbf8eb tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:36.237430 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-468f21e9-cef9-4c1a-8791-d4fa79099589 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.410608 Aug 27 05:25:36.240398 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2844/5685] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:35 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:36.267426 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-72dd0cb9-de6f-4579-bfa6-af82d9dbf8eb tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1471 microversion: 2.1 time: 0.656736 Aug 27 05:25:36.288322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c5502f49-59d5-488b-a72c-6204f34b7df2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:36.288951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c5502f49-59d5-488b-a72c-6204f34b7df2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:36.292604 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2842/5686] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:35 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1471 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:36.298065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5502f49-59d5-488b-a72c-6204f34b7df2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:36.298874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5502f49-59d5-488b-a72c-6204f34b7df2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:36.299356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5502f49-59d5-488b-a72c-6204f34b7df2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:36.300073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5502f49-59d5-488b-a72c-6204f34b7df2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:36.300532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5502f49-59d5-488b-a72c-6204f34b7df2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:36.301195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5502f49-59d5-488b-a72c-6204f34b7df2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:36.838384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c5502f49-59d5-488b-a72c-6204f34b7df2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:36.857133 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c5502f49-59d5-488b-a72c-6204f34b7df2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.575723 Aug 27 05:25:36.858569 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2845/5687] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:36 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:36.994709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ccbe66c1-8660-480e-8ac6-8946ba26e789 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1208533872", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ccbe66c1-8660-480e-8ac6-8946ba26e789 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 492 Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1208533872", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1208533872', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:37.010276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ccbe66c1-8660-480e-8ac6-8946ba26e789 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:37.013324 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ccbe66c1-8660-480e-8ac6-8946ba26e789 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.026371 Aug 27 05:25:37.016884 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2843/5688] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:36 2022] POST /compute/v2.1/servers => generated 624 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:25:37.028219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd9cd0ad-1f21-4d28-87b3-9d965ba62d30 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:37.030021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd9cd0ad-1f21-4d28-87b3-9d965ba62d30 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:37.039714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd9cd0ad-1f21-4d28-87b3-9d965ba62d30 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:37.041267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd9cd0ad-1f21-4d28-87b3-9d965ba62d30 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:37.041949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd9cd0ad-1f21-4d28-87b3-9d965ba62d30 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:37.043625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd9cd0ad-1f21-4d28-87b3-9d965ba62d30 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:37.044413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd9cd0ad-1f21-4d28-87b3-9d965ba62d30 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:37.045091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd9cd0ad-1f21-4d28-87b3-9d965ba62d30 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:37.295462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-199227c6-5f85-4a51-888f-657238741028 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:37.296080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-199227c6-5f85-4a51-888f-657238741028 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:37.327508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-199227c6-5f85-4a51-888f-657238741028 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:37.339738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-199227c6-5f85-4a51-888f-657238741028 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:37.342438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-199227c6-5f85-4a51-888f-657238741028 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:37.345135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-199227c6-5f85-4a51-888f-657238741028 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:37.352462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-199227c6-5f85-4a51-888f-657238741028 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:37.355003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-199227c6-5f85-4a51-888f-657238741028 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:37.427270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dd9cd0ad-1f21-4d28-87b3-9d965ba62d30 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:37.452332 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd9cd0ad-1f21-4d28-87b3-9d965ba62d30 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.433539 Aug 27 05:25:37.453373 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2846/5689] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:37 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:37.489133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-374c88fa-00f4-4feb-8cf6-7a2edfe8e718 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:37.489771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-374c88fa-00f4-4feb-8cf6-7a2edfe8e718 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:37.500636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-374c88fa-00f4-4feb-8cf6-7a2edfe8e718 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:37.503508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-374c88fa-00f4-4feb-8cf6-7a2edfe8e718 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:37.503971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-374c88fa-00f4-4feb-8cf6-7a2edfe8e718 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:37.504769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-374c88fa-00f4-4feb-8cf6-7a2edfe8e718 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:37.505245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-374c88fa-00f4-4feb-8cf6-7a2edfe8e718 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:37.505688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-374c88fa-00f4-4feb-8cf6-7a2edfe8e718 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:37.917909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-199227c6-5f85-4a51-888f-657238741028 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:37.954180 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-199227c6-5f85-4a51-888f-657238741028 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1471 microversion: 2.1 time: 0.653846 Aug 27 05:25:37.955418 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2844/5690] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:37 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1471 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:38.015050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-374c88fa-00f4-4feb-8cf6-7a2edfe8e718 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:38.026134 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-374c88fa-00f4-4feb-8cf6-7a2edfe8e718 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.541666 Aug 27 05:25:38.028117 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2847/5691] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:37 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:38.152498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-878919db-e372-414b-93a8-f4e0422e461e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-878919db-e372-414b-93a8-f4e0422e461e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 416 Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:38.172966 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:25:38.176254 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:38.177951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-878919db-e372-414b-93a8-f4e0422e461e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:38.181233 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-878919db-e372-414b-93a8-f4e0422e461e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.034824 Aug 27 05:25:38.181233 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2845/5692] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:38 2022] POST /compute/v2.1/servers => generated 619 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:25:38.190477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-291f1d44-d9e3-4ecf-86a9-36b5dd5407b4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:38.193121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-291f1d44-d9e3-4ecf-86a9-36b5dd5407b4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:38.204647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-291f1d44-d9e3-4ecf-86a9-36b5dd5407b4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:38.208160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-291f1d44-d9e3-4ecf-86a9-36b5dd5407b4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:38.208916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-291f1d44-d9e3-4ecf-86a9-36b5dd5407b4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:38.209885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-291f1d44-d9e3-4ecf-86a9-36b5dd5407b4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:38.210660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-291f1d44-d9e3-4ecf-86a9-36b5dd5407b4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:38.211965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-291f1d44-d9e3-4ecf-86a9-36b5dd5407b4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:38.621131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-291f1d44-d9e3-4ecf-86a9-36b5dd5407b4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:38.634352 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-291f1d44-d9e3-4ecf-86a9-36b5dd5407b4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.447883 Aug 27 05:25:38.635561 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2848/5693] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:38 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:38.679502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:38.699268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ddc01630-5faa-4b06-aac8-4c068e78dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:38.704569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ddc01630-5faa-4b06-aac8-4c068e78dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:38.741524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddc01630-5faa-4b06-aac8-4c068e78dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:38.742442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddc01630-5faa-4b06-aac8-4c068e78dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:38.743269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddc01630-5faa-4b06-aac8-4c068e78dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:38.755030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddc01630-5faa-4b06-aac8-4c068e78dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:38.756859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddc01630-5faa-4b06-aac8-4c068e78dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:38.759406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ddc01630-5faa-4b06-aac8-4c068e78dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:38.994506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf5da914-3841-4563-874d-d1e1a4d68b60 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:39.003398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf5da914-3841-4563-874d-d1e1a4d68b60 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:39.038138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:39.042568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5da914-3841-4563-874d-d1e1a4d68b60 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:39.044027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5da914-3841-4563-874d-d1e1a4d68b60 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:39.045269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5da914-3841-4563-874d-d1e1a4d68b60 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:39.046259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5da914-3841-4563-874d-d1e1a4d68b60 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:39.046914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5da914-3841-4563-874d-d1e1a4d68b60 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:39.047590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5da914-3841-4563-874d-d1e1a4d68b60 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:39.139651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ddc01630-5faa-4b06-aac8-4c068e78dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:39.169775 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ddc01630-5faa-4b06-aac8-4c068e78dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.493969 Aug 27 05:25:39.172104 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2846/5694] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:38 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:39.332421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5bcd2be7-b6ce-416d-b90f-90b903a261cf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-77745105", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": -1, "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:39.376332 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-5bcd2be7-b6ce-416d-b90f-90b903a261cf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Flavor -1 could not be found. Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5bcd2be7-b6ce-416d-b90f-90b903a261cf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 204 Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-77745105", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": -1, "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: exception: Flavor -1 could not be found. Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-77745105', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': -1, 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:39.385503 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:39.389739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5bcd2be7-b6ce-416d-b90f-90b903a261cf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:39.391650 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5bcd2be7-b6ce-416d-b90f-90b903a261cf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.063558 Aug 27 05:25:39.395601 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2847/5695] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:39 2022] POST /compute/v2.1/servers => generated 73 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 05:25:39.422619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d0110eb-d2c1-4981-9ed8-1ddd36858347 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:39.423373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7d0110eb-d2c1-4981-9ed8-1ddd36858347 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:39.449482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d0110eb-d2c1-4981-9ed8-1ddd36858347 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:39.455335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d0110eb-d2c1-4981-9ed8-1ddd36858347 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:39.457262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d0110eb-d2c1-4981-9ed8-1ddd36858347 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:39.458465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d0110eb-d2c1-4981-9ed8-1ddd36858347 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:39.463392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d0110eb-d2c1-4981-9ed8-1ddd36858347 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:39.464146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d0110eb-d2c1-4981-9ed8-1ddd36858347 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:39.552573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cf5da914-3841-4563-874d-d1e1a4d68b60 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:39.569462 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf5da914-3841-4563-874d-d1e1a4d68b60 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1471 microversion: 2.1 time: 0.589887 Aug 27 05:25:39.584405 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2849/5696] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:38 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1471 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:39.806952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7d0110eb-d2c1-4981-9ed8-1ddd36858347 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:39.829365 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d0110eb-d2c1-4981-9ed8-1ddd36858347 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.420849 Aug 27 05:25:39.830160 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2848/5697] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:39 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:39.903416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ef2ae959-a71b-4d18-8246-ff8b222efd8c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:39.904357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ef2ae959-a71b-4d18-8246-ff8b222efd8c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:39.917599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef2ae959-a71b-4d18-8246-ff8b222efd8c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:39.918283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef2ae959-a71b-4d18-8246-ff8b222efd8c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:39.920044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef2ae959-a71b-4d18-8246-ff8b222efd8c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:39.922255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef2ae959-a71b-4d18-8246-ff8b222efd8c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:39.924593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef2ae959-a71b-4d18-8246-ff8b222efd8c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:39.925133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef2ae959-a71b-4d18-8246-ff8b222efd8c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:39.939949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:40.457385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ef2ae959-a71b-4d18-8246-ff8b222efd8c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:40.469242 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ef2ae959-a71b-4d18-8246-ff8b222efd8c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.570843 Aug 27 05:25:40.478390 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2850/5698] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:39 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:40.591176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-445475aa-7e15-4760-ba92-51b4a7a2daeb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-435588987", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:40.598603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d2bb2b86-b296-431d-b070-c1f1af900741 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:40.599422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d2bb2b86-b296-431d-b070-c1f1af900741 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:40.602056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-445475aa-7e15-4760-ba92-51b4a7a2daeb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 172 Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-435588987", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-435588987', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi -1 Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:25:40.630560 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 05:25:40.636266 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:40.641570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-445475aa-7e15-4760-ba92-51b4a7a2daeb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:40.643290 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-445475aa-7e15-4760-ba92-51b4a7a2daeb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.057173 Aug 27 05:25:40.646368 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2849/5699] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:40 2022] POST /compute/v2.1/servers => generated 145 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:25:40.653605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:40.654361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2bb2b86-b296-431d-b070-c1f1af900741 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:40.656251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2bb2b86-b296-431d-b070-c1f1af900741 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:40.661219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2bb2b86-b296-431d-b070-c1f1af900741 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:40.669553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2bb2b86-b296-431d-b070-c1f1af900741 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:40.673043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2bb2b86-b296-431d-b070-c1f1af900741 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:40.675240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2bb2b86-b296-431d-b070-c1f1af900741 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:40.690208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-000f53f7-146b-426a-a78a-f3274ca01756 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:40.694863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-000f53f7-146b-426a-a78a-f3274ca01756 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:40.748482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000f53f7-146b-426a-a78a-f3274ca01756 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:40.750988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000f53f7-146b-426a-a78a-f3274ca01756 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:40.752757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000f53f7-146b-426a-a78a-f3274ca01756 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:40.754964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000f53f7-146b-426a-a78a-f3274ca01756 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:40.756230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000f53f7-146b-426a-a78a-f3274ca01756 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:40.757380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-000f53f7-146b-426a-a78a-f3274ca01756 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:41.290650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-000f53f7-146b-426a-a78a-f3274ca01756 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:41.326237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d2bb2b86-b296-431d-b070-c1f1af900741 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:41.327414 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-000f53f7-146b-426a-a78a-f3274ca01756 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.674607 Aug 27 05:25:41.329790 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2850/5700] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:40 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:41.350515 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d2bb2b86-b296-431d-b070-c1f1af900741 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1471 microversion: 2.1 time: 0.753330 Aug 27 05:25:41.351877 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2851/5701] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:40 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1471 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:41.361889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7f1a0b1b-54d6-4102-ba5f-dedeff8db2db tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:41.363111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7f1a0b1b-54d6-4102-ba5f-dedeff8db2db tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:41.391004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f1a0b1b-54d6-4102-ba5f-dedeff8db2db tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:41.392368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f1a0b1b-54d6-4102-ba5f-dedeff8db2db tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:41.393462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f1a0b1b-54d6-4102-ba5f-dedeff8db2db tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:41.394957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f1a0b1b-54d6-4102-ba5f-dedeff8db2db tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:41.395956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f1a0b1b-54d6-4102-ba5f-dedeff8db2db tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:41.397272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7f1a0b1b-54d6-4102-ba5f-dedeff8db2db tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:41.753707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7f1a0b1b-54d6-4102-ba5f-dedeff8db2db tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:41.783935 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7f1a0b1b-54d6-4102-ba5f-dedeff8db2db tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.425161 Aug 27 05:25:41.787452 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2851/5702] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:41 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:41.892336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8b2401f-9378-4859-ad19-152a6a465078 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1487447225", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:41.897901 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-b8b2401f-9378-4859-ad19-152a6a465078 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8b2401f-9378-4859-ad19-152a6a465078 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 216 Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1487447225", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1487447225', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:41.909530 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:41.913451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:41.913451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:41.913451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:41.913451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:41.913451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:41.913451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 05:25:41.913451 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:41.913451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8b2401f-9378-4859-ad19-152a6a465078 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:41.919582 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8b2401f-9378-4859-ad19-152a6a465078 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.032567 Aug 27 05:25:41.923693 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2852/5703] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:41 2022] POST /compute/v2.1/servers => generated 123 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:25:41.933011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b23fd9e5-c45e-44ae-8eb1-9cdcf228a4fc tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:41.933845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b23fd9e5-c45e-44ae-8eb1-9cdcf228a4fc tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:41.951081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b23fd9e5-c45e-44ae-8eb1-9cdcf228a4fc tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:41.952001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b23fd9e5-c45e-44ae-8eb1-9cdcf228a4fc tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:41.952752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b23fd9e5-c45e-44ae-8eb1-9cdcf228a4fc tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:41.954125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b23fd9e5-c45e-44ae-8eb1-9cdcf228a4fc tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:41.954920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b23fd9e5-c45e-44ae-8eb1-9cdcf228a4fc tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:41.955687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b23fd9e5-c45e-44ae-8eb1-9cdcf228a4fc tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:42.263623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b23fd9e5-c45e-44ae-8eb1-9cdcf228a4fc tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:42.273705 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b23fd9e5-c45e-44ae-8eb1-9cdcf228a4fc tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.344925 Aug 27 05:25:42.275800 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2852/5704] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:41 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:42.308324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ce5c4a16-b1f3-42cf-aea2-581f01307ac3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:42.309863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ce5c4a16-b1f3-42cf-aea2-581f01307ac3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:42.321839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce5c4a16-b1f3-42cf-aea2-581f01307ac3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:42.322639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce5c4a16-b1f3-42cf-aea2-581f01307ac3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:42.323987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce5c4a16-b1f3-42cf-aea2-581f01307ac3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:42.325243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce5c4a16-b1f3-42cf-aea2-581f01307ac3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:42.325906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce5c4a16-b1f3-42cf-aea2-581f01307ac3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:42.326537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce5c4a16-b1f3-42cf-aea2-581f01307ac3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:42.383792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-23a91a29-4a24-4012-bac2-8e5d14c78cfa tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:42.384733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-23a91a29-4a24-4012-bac2-8e5d14c78cfa tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:42.424993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23a91a29-4a24-4012-bac2-8e5d14c78cfa tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:42.427678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23a91a29-4a24-4012-bac2-8e5d14c78cfa tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:42.432533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23a91a29-4a24-4012-bac2-8e5d14c78cfa tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:42.434461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23a91a29-4a24-4012-bac2-8e5d14c78cfa tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:42.435542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23a91a29-4a24-4012-bac2-8e5d14c78cfa tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:42.436571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-23a91a29-4a24-4012-bac2-8e5d14c78cfa tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:42.689661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ce5c4a16-b1f3-42cf-aea2-581f01307ac3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:42.712075 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ce5c4a16-b1f3-42cf-aea2-581f01307ac3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.410158 Aug 27 05:25:42.717302 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2853/5705] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:42 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:42.833520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2b5655f-924c-4273-a238-aaa8c4295d5f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2131954034", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "key_name": "tempest-key-2039417469", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:42.869863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-23a91a29-4a24-4012-bac2-8e5d14c78cfa tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:42.887206 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-23a91a29-4a24-4012-bac2-8e5d14c78cfa tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1471 microversion: 2.1 time: 0.509295 Aug 27 05:25:42.909318 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2853/5706] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:42 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1471 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:42.959731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-b2b5655f-924c-4273-a238-aaa8c4295d5f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] validate_networks() for [('7906d3ee-5380-4aa1-a43a-a0d97ee78a9e', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:25:43.447412 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-b2b5655f-924c-4273-a238-aaa8c4295d5f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Invalid key_name provided. Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2b5655f-924c-4273-a238-aaa8c4295d5f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 247 Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2131954034", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "key_name": "tempest-key-2039417469", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid key_name provided. Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2131954034', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'key_name': 'tempest-key-2039417469', 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2039417469 not found for user 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:43.456204 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 27 05:25:43.462730 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:43.474904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2b5655f-924c-4273-a238-aaa8c4295d5f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Invalid key_name provided. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:43.477694 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b2b5655f-924c-4273-a238-aaa8c4295d5f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.648321 Aug 27 05:25:43.478942 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2854/5707] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:42 2022] POST /compute/v2.1/servers => generated 70 bytes in 651 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 27 05:25:43.490616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4824a649-0d58-40e2-b683-99184cf46beb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:43.491624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4824a649-0d58-40e2-b683-99184cf46beb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:43.508725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4824a649-0d58-40e2-b683-99184cf46beb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:43.512202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4824a649-0d58-40e2-b683-99184cf46beb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:43.513064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4824a649-0d58-40e2-b683-99184cf46beb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:43.514239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4824a649-0d58-40e2-b683-99184cf46beb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:43.514730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4824a649-0d58-40e2-b683-99184cf46beb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:43.517260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4824a649-0d58-40e2-b683-99184cf46beb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:43.833257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4824a649-0d58-40e2-b683-99184cf46beb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:43.854562 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4824a649-0d58-40e2-b683-99184cf46beb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.367970 Aug 27 05:25:43.856713 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2854/5708] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:43 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:43.878197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3d2b7811-8eca-4a27-87a0-da1449c4c25d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:43.879724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3d2b7811-8eca-4a27-87a0-da1449c4c25d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:43.887685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d2b7811-8eca-4a27-87a0-da1449c4c25d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:43.888609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d2b7811-8eca-4a27-87a0-da1449c4c25d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:43.889436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d2b7811-8eca-4a27-87a0-da1449c4c25d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:43.890403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d2b7811-8eca-4a27-87a0-da1449c4c25d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:43.891113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d2b7811-8eca-4a27-87a0-da1449c4c25d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:43.891776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d2b7811-8eca-4a27-87a0-da1449c4c25d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:43.994159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-588166805", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:44.073411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] validate_networks() for [('90541b9e-a822-49f6-8d67-5dca5d9b304a', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:25:44.287555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3d2b7811-8eca-4a27-87a0-da1449c4c25d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:44.303418 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3d2b7811-8eca-4a27-87a0-da1449c4c25d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.428734 Aug 27 05:25:44.305539 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2855/5709] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:43 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:44.316556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-96a31eb2-a3c6-486a-aa47-9dff8a263cf8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:44.318125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-96a31eb2-a3c6-486a-aa47-9dff8a263cf8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:44.332454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96a31eb2-a3c6-486a-aa47-9dff8a263cf8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:44.333623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96a31eb2-a3c6-486a-aa47-9dff8a263cf8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:44.334682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96a31eb2-a3c6-486a-aa47-9dff8a263cf8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:44.336294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96a31eb2-a3c6-486a-aa47-9dff8a263cf8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:44.337403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96a31eb2-a3c6-486a-aa47-9dff8a263cf8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:44.338447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96a31eb2-a3c6-486a-aa47-9dff8a263cf8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:44.378249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:44.648097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-96a31eb2-a3c6-486a-aa47-9dff8a263cf8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:44.661730 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-96a31eb2-a3c6-486a-aa47-9dff8a263cf8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1471 microversion: 2.1 time: 0.354148 Aug 27 05:25:44.663520 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2856/5710] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:44 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1471 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:44.671135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65213dae-2f3f-473b-9bce-0cf8a68c3074 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1360677684", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:44.935430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.security_group_api [None req-65213dae-2f3f-473b-9bce-0cf8a68c3074 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Neutron security group does_not_exist not found {{(pid=128548) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 27 05:25:44.939213 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-65213dae-2f3f-473b-9bce-0cf8a68c3074 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 27 05:25:44.940539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:25:44.941033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:25:44.941716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:25:44.942361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:25:44.942855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65213dae-2f3f-473b-9bce-0cf8a68c3074 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 258 Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1360677684", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1360677684', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 27 05:25:44.948875 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 27 05:25:44.953795 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:44.969270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:44.969270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:44.969270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:44.969270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:44.969270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:44.969270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:44.970146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65213dae-2f3f-473b-9bce-0cf8a68c3074 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:44.970146 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-65213dae-2f3f-473b-9bce-0cf8a68c3074 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.295819 Aug 27 05:25:44.973041 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2857/5711] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:44 2022] POST /compute/v2.1/servers => generated 106 bytes in 309 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:25:44.979399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8babed5-ed2a-424a-9179-763256a726b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:44.980426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8babed5-ed2a-424a-9179-763256a726b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:44.982091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Getting quotas for project 43652021c7e84156955f4bdaf72aabba. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:25:44.988366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8babed5-ed2a-424a-9179-763256a726b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:44.989316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8babed5-ed2a-424a-9179-763256a726b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:44.990026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8babed5-ed2a-424a-9179-763256a726b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:44.991311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8babed5-ed2a-424a-9179-763256a726b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:44.992581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8babed5-ed2a-424a-9179-763256a726b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:44.992996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Getting quotas for user f80e7dad058f44b9967a5a2f95123a9f and project 43652021c7e84156955f4bdaf72aabba. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:25:44.993518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8babed5-ed2a-424a-9179-763256a726b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:45.009714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:25:45.012232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:25:45.112875 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2dab78d0-e428-4677-9811-09e95197a104 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.387625 Aug 27 05:25:45.127777 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2855/5712] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:25:45.138496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a368daca-431c-4d4d-9d2e-dbba30a69eea tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:45.139486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a368daca-431c-4d4d-9d2e-dbba30a69eea tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:45.304535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a368daca-431c-4d4d-9d2e-dbba30a69eea tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:45.316210 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a368daca-431c-4d4d-9d2e-dbba30a69eea tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1221 microversion: 2.1 time: 0.185809 Aug 27 05:25:45.320458 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2856/5713] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:45 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1221 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:45.352948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8babed5-ed2a-424a-9179-763256a726b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:45.366288 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8babed5-ed2a-424a-9179-763256a726b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.391528 Aug 27 05:25:45.370144 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2858/5714] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:44 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:45.399623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b00ed8d2-5c43-4156-9fa5-510de93dd7cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:45.400779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b00ed8d2-5c43-4156-9fa5-510de93dd7cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:45.411178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00ed8d2-5c43-4156-9fa5-510de93dd7cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:45.411686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00ed8d2-5c43-4156-9fa5-510de93dd7cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:45.412131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00ed8d2-5c43-4156-9fa5-510de93dd7cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:45.412868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00ed8d2-5c43-4156-9fa5-510de93dd7cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:45.413329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00ed8d2-5c43-4156-9fa5-510de93dd7cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:45.414394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00ed8d2-5c43-4156-9fa5-510de93dd7cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:45.482359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1032871976", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:45.648012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] validate_networks() for [('90541b9e-a822-49f6-8d67-5dca5d9b304a', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:25:45.947617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b00ed8d2-5c43-4156-9fa5-510de93dd7cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:45.960235 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b00ed8d2-5c43-4156-9fa5-510de93dd7cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.565477 Aug 27 05:25:45.966510 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2857/5715] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:45 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:45.977507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f61054f7-5f64-4ce1-a01a-153d4524ccba tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:45.978372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f61054f7-5f64-4ce1-a01a-153d4524ccba tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:45.994739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f61054f7-5f64-4ce1-a01a-153d4524ccba tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:45.995813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f61054f7-5f64-4ce1-a01a-153d4524ccba tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:45.998463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f61054f7-5f64-4ce1-a01a-153d4524ccba tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:46.003284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f61054f7-5f64-4ce1-a01a-153d4524ccba tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:46.009838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f61054f7-5f64-4ce1-a01a-153d4524ccba tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:46.011005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f61054f7-5f64-4ce1-a01a-153d4524ccba tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:46.503037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f61054f7-5f64-4ce1-a01a-153d4524ccba tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:46.516517 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f61054f7-5f64-4ce1-a01a-153d4524ccba tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1471 microversion: 2.1 time: 0.548532 Aug 27 05:25:46.519913 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2858/5716] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:45 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1471 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:46.529282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2064a49f-777b-4ea0-bb44-560819ff9324 req-e1a11d06-b6ef-44e0-b807-ea981f33c245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6625a4-fa42-41a0-8664-65bb32081817", "name": "network-vif-plugged", "status": "completed", "tag": "256e99b8-b009-4f0e-8458-fb3d127ff19e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:46.555251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2064a49f-777b-4ea0-bb44-560819ff9324 req-e1a11d06-b6ef-44e0-b807-ea981f33c245 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:46.555987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2064a49f-777b-4ea0-bb44-560819ff9324 req-e1a11d06-b6ef-44e0-b807-ea981f33c245 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:46.556638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2064a49f-777b-4ea0-bb44-560819ff9324 req-e1a11d06-b6ef-44e0-b807-ea981f33c245 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:46.579594 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2064a49f-777b-4ea0-bb44-560819ff9324 req-e1a11d06-b6ef-44e0-b807-ea981f33c245 service nova] Creating event network-vif-plugged:256e99b8-b009-4f0e-8458-fb3d127ff19e for instance 1e6625a4-fa42-41a0-8664-65bb32081817 on n-h1-820368-35 Aug 27 05:25:46.588366 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2064a49f-777b-4ea0-bb44-560819ff9324 req-e1a11d06-b6ef-44e0-b807-ea981f33c245 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062733 Aug 27 05:25:46.589649 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2859/5717] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:46.602546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f7146979-321b-403c-ab64-4e996368a4cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:46.613732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f7146979-321b-403c-ab64-4e996368a4cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 262cb8a7-4917-4aae-a962-edb1fb35453b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:46.621461 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f7146979-321b-403c-ab64-4e996368a4cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 262cb8a7-4917-4aae-a962-edb1fb35453b could not be found. Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f7146979-321b-403c-ab64-4e996368a4cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/262cb8a7-4917-4aae-a962-edb1fb35453b HTTP/1.1 Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 262cb8a7-4917-4aae-a962-edb1fb35453b could not be found. Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '262cb8a7-4917-4aae-a962-edb1fb35453b'} Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262cb8a7-4917-4aae-a962-edb1fb35453b could not be found. Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262cb8a7-4917-4aae-a962-edb1fb35453b could not be found. Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:46.623749 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:46.627800 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:46.627800 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:46.627800 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:46.627800 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:46.627800 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:46.627800 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:46.627800 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262cb8a7-4917-4aae-a962-edb1fb35453b could not be found. Aug 27 05:25:46.627800 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:46.630352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f7146979-321b-403c-ab64-4e996368a4cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 262cb8a7-4917-4aae-a962-edb1fb35453b could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:46.631761 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f7146979-321b-403c-ab64-4e996368a4cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/262cb8a7-4917-4aae-a962-edb1fb35453b" status: 404 len: 111 microversion: 2.1 time: 0.040779 Aug 27 05:25:46.634484 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2860/5718] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:25:46 2022] DELETE /compute/v2.1/servers/262cb8a7-4917-4aae-a962-edb1fb35453b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:25:46.648640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aaf5bd2b-75c6-4fb5-a57d-88c9322c72d5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:46.651820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aaf5bd2b-75c6-4fb5-a57d-88c9322c72d5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:46.672344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aaf5bd2b-75c6-4fb5-a57d-88c9322c72d5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:46.676749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aaf5bd2b-75c6-4fb5-a57d-88c9322c72d5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:46.677538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aaf5bd2b-75c6-4fb5-a57d-88c9322c72d5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:46.678517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aaf5bd2b-75c6-4fb5-a57d-88c9322c72d5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:46.681793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aaf5bd2b-75c6-4fb5-a57d-88c9322c72d5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:46.684273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aaf5bd2b-75c6-4fb5-a57d-88c9322c72d5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:47.255016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aaf5bd2b-75c6-4fb5-a57d-88c9322c72d5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:47.266776 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aaf5bd2b-75c6-4fb5-a57d-88c9322c72d5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.624223 Aug 27 05:25:47.290898 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2861/5719] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:46 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:47.316360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-483d7dbe-83f1-4bf8-beca-175a32c2e4dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:47.317178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-483d7dbe-83f1-4bf8-beca-175a32c2e4dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:47.337562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-483d7dbe-83f1-4bf8-beca-175a32c2e4dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:47.338393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-483d7dbe-83f1-4bf8-beca-175a32c2e4dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:47.339028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-483d7dbe-83f1-4bf8-beca-175a32c2e4dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:47.342666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-483d7dbe-83f1-4bf8-beca-175a32c2e4dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:47.345581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-483d7dbe-83f1-4bf8-beca-175a32c2e4dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:47.346879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-483d7dbe-83f1-4bf8-beca-175a32c2e4dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:47.497978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:25:47.499713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:25:47.501311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:25:47.503009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:25:47.507068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:25:47.600867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:47.607492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:47.611053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:47.615833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:47.617275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:47.627701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:47.702644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Getting quotas for project 43652021c7e84156955f4bdaf72aabba. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:25:47.711600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Getting quotas for user f80e7dad058f44b9967a5a2f95123a9f and project 43652021c7e84156955f4bdaf72aabba. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:25:47.729602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:25:47.735945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-483d7dbe-83f1-4bf8-beca-175a32c2e4dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:47.738364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:25:47.750112 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-483d7dbe-83f1-4bf8-beca-175a32c2e4dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.457727 Aug 27 05:25:47.754193 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2862/5720] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:47 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:47.764652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8bb3df6-a709-40ed-a754-a10706d03b87 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:47.766739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8bb3df6-a709-40ed-a754-a10706d03b87 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:47.783047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8bb3df6-a709-40ed-a754-a10706d03b87 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:47.784690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8bb3df6-a709-40ed-a754-a10706d03b87 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:47.787751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8bb3df6-a709-40ed-a754-a10706d03b87 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:47.789370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8bb3df6-a709-40ed-a754-a10706d03b87 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:47.790815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8bb3df6-a709-40ed-a754-a10706d03b87 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:47.792070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8bb3df6-a709-40ed-a754-a10706d03b87 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:47.811912 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-13145bdd-92be-4f2a-84c2-a039cb8516c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.343096 Aug 27 05:25:47.814094 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2859/5721] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:25:47.822421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f1a01e7-9653-4457-86dd-22c9c6c94dc0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:47.840675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f1a01e7-9653-4457-86dd-22c9c6c94dc0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 05:25:47.843341 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-0f1a01e7-9653-4457-86dd-22c9c6c94dc0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f1a01e7-9653-4457-86dd-22c9c6c94dc0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 9223372036854775808 could not be found. Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '9223372036854775808'} Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:47.846547 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:47.850604 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:47.850604 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:47.850604 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:47.850604 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 27 05:25:47.850604 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:47.852362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f1a01e7-9653-4457-86dd-22c9c6c94dc0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:47.853431 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f1a01e7-9653-4457-86dd-22c9c6c94dc0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.036601 Aug 27 05:25:47.855642 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2860/5722] 10.222.0.58 () {58 vars in 1188 bytes} [Sat Aug 27 05:25:47 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:25:47.860800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4733682c-afb7-4872-986a-6f1e11c1d2fa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:47.885446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4733682c-afb7-4872-986a-6f1e11c1d2fa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:48.051787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4733682c-afb7-4872-986a-6f1e11c1d2fa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:48.061214 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4733682c-afb7-4872-986a-6f1e11c1d2fa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1222 microversion: 2.1 time: 0.204310 Aug 27 05:25:48.064193 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2861/5723] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:47 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1222 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:48.077205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-decbcaa5-03fd-4e94-bada-58d408a7a2c2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:48.078290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-decbcaa5-03fd-4e94-bada-58d408a7a2c2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:48.104063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-decbcaa5-03fd-4e94-bada-58d408a7a2c2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:48.105246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-decbcaa5-03fd-4e94-bada-58d408a7a2c2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:48.105999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-decbcaa5-03fd-4e94-bada-58d408a7a2c2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:48.111810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-decbcaa5-03fd-4e94-bada-58d408a7a2c2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:48.112549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-decbcaa5-03fd-4e94-bada-58d408a7a2c2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:48.114682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-decbcaa5-03fd-4e94-bada-58d408a7a2c2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:48.296756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8bb3df6-a709-40ed-a754-a10706d03b87 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:48.310414 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8bb3df6-a709-40ed-a754-a10706d03b87 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1471 microversion: 2.1 time: 0.554204 Aug 27 05:25:48.312764 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2863/5724] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:47 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1471 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:48.432386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-decbcaa5-03fd-4e94-bada-58d408a7a2c2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:48.443762 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-decbcaa5-03fd-4e94-bada-58d408a7a2c2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.377010 Aug 27 05:25:48.444356 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2862/5725] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:48 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:48.489764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b9205dfb-2fc7-44e6-9627-fe4b2226237e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:48.490685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b9205dfb-2fc7-44e6-9627-fe4b2226237e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:48.502952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9205dfb-2fc7-44e6-9627-fe4b2226237e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:48.504263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9205dfb-2fc7-44e6-9627-fe4b2226237e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:48.505178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9205dfb-2fc7-44e6-9627-fe4b2226237e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:48.508332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9205dfb-2fc7-44e6-9627-fe4b2226237e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:48.509338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9205dfb-2fc7-44e6-9627-fe4b2226237e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:48.509967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9205dfb-2fc7-44e6-9627-fe4b2226237e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:48.808887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b9205dfb-2fc7-44e6-9627-fe4b2226237e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:48.817474 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b9205dfb-2fc7-44e6-9627-fe4b2226237e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.331590 Aug 27 05:25:48.827863 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2864/5726] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:48 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:48.861488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3727bead-9a5e-4d4b-b35c-34b61aa2deba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:48.864510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3727bead-9a5e-4d4b-b35c-34b61aa2deba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Failed to fetch instance by id -1 {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 05:25:48.865831 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-3727bead-9a5e-4d4b-b35c-34b61aa2deba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance -1 could not be found. Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3727bead-9a5e-4d4b-b35c-34b61aa2deba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance -1 could not be found. Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '-1'} Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:48.870287 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:48.884639 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:48.884639 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:48.884639 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 27 05:25:48.884639 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:48.887678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3727bead-9a5e-4d4b-b35c-34b61aa2deba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:48.895105 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3727bead-9a5e-4d4b-b35c-34b61aa2deba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.045508 Aug 27 05:25:48.896332 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2863/5727] 10.222.0.58 () {58 vars in 1137 bytes} [Sat Aug 27 05:25:48 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:25:48.916014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2eee0afb-dae0-45aa-baef-77ee52d7d024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:48.916881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2eee0afb-dae0-45aa-baef-77ee52d7d024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:48.926301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eee0afb-dae0-45aa-baef-77ee52d7d024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:48.927035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eee0afb-dae0-45aa-baef-77ee52d7d024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:48.928042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eee0afb-dae0-45aa-baef-77ee52d7d024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:48.928954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eee0afb-dae0-45aa-baef-77ee52d7d024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:48.930024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eee0afb-dae0-45aa-baef-77ee52d7d024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:48.930824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eee0afb-dae0-45aa-baef-77ee52d7d024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.104621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f2bec2b-c3cd-4c79-b892-7900e6068679 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:49.105241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3f2bec2b-c3cd-4c79-b892-7900e6068679 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:49.136093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f2bec2b-c3cd-4c79-b892-7900e6068679 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.137120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f2bec2b-c3cd-4c79-b892-7900e6068679 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.137302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f2bec2b-c3cd-4c79-b892-7900e6068679 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.148775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f2bec2b-c3cd-4c79-b892-7900e6068679 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.149284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f2bec2b-c3cd-4c79-b892-7900e6068679 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.149731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f2bec2b-c3cd-4c79-b892-7900e6068679 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.259389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2eee0afb-dae0-45aa-baef-77ee52d7d024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:49.293498 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2eee0afb-dae0-45aa-baef-77ee52d7d024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.380781 Aug 27 05:25:49.297822 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2865/5728] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:48 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:49.323346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3f2bec2b-c3cd-4c79-b892-7900e6068679 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:49.333105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d1ab7f5-45ea-46d6-87dc-81d14b845f7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:49.335167 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3f2bec2b-c3cd-4c79-b892-7900e6068679 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1226 microversion: 2.1 time: 0.236694 Aug 27 05:25:49.336350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d1ab7f5-45ea-46d6-87dc-81d14b845f7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:49.336953 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2864/5729] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:49 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1226 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:49.342978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-255f3f3a-56b9-4b16-bfef-e12a358f6558 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:49.343954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-255f3f3a-56b9-4b16-bfef-e12a358f6558 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:49.352925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-255f3f3a-56b9-4b16-bfef-e12a358f6558 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.353678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-255f3f3a-56b9-4b16-bfef-e12a358f6558 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.354471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-255f3f3a-56b9-4b16-bfef-e12a358f6558 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.355385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-255f3f3a-56b9-4b16-bfef-e12a358f6558 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.356004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-255f3f3a-56b9-4b16-bfef-e12a358f6558 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.356594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-255f3f3a-56b9-4b16-bfef-e12a358f6558 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.368616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1ab7f5-45ea-46d6-87dc-81d14b845f7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.382712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1ab7f5-45ea-46d6-87dc-81d14b845f7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.386045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1ab7f5-45ea-46d6-87dc-81d14b845f7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.390870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1ab7f5-45ea-46d6-87dc-81d14b845f7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.395205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1ab7f5-45ea-46d6-87dc-81d14b845f7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.398980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d1ab7f5-45ea-46d6-87dc-81d14b845f7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.675781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-255f3f3a-56b9-4b16-bfef-e12a358f6558 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:49.691624 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-255f3f3a-56b9-4b16-bfef-e12a358f6558 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1643 microversion: 2.1 time: 0.353124 Aug 27 05:25:49.694532 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2865/5730] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:49 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1643 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:49.737493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-233d398a-c2a8-4e1b-adff-123152d8579b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:49.738532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-233d398a-c2a8-4e1b-adff-123152d8579b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:49.768254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-233d398a-c2a8-4e1b-adff-123152d8579b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.769066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-233d398a-c2a8-4e1b-adff-123152d8579b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.771714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-233d398a-c2a8-4e1b-adff-123152d8579b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.774876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-233d398a-c2a8-4e1b-adff-123152d8579b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.775722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-233d398a-c2a8-4e1b-adff-123152d8579b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.778962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d1ab7f5-45ea-46d6-87dc-81d14b845f7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:49.779931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-233d398a-c2a8-4e1b-adff-123152d8579b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.795887 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d1ab7f5-45ea-46d6-87dc-81d14b845f7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.473985 Aug 27 05:25:49.796838 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2866/5731] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:49 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:49.826975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c33a456b-f130-4541-9de8-e7c1d3839641 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:49.827934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c33a456b-f130-4541-9de8-e7c1d3839641 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 38a65752-d9d5-4c48-9eb6-692b1cb19787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:49.838526 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-c33a456b-f130-4541-9de8-e7c1d3839641 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 38a65752-d9d5-4c48-9eb6-692b1cb19787 could not be found. Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c33a456b-f130-4541-9de8-e7c1d3839641 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/38a65752-d9d5-4c48-9eb6-692b1cb19787/action HTTP/1.1 Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 19 Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: {"forceDelete": {}} Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 38a65752-d9d5-4c48-9eb6-692b1cb19787 could not be found. Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '38a65752-d9d5-4c48-9eb6-692b1cb19787', 'body': {'forceDelete': {}}} Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38a65752-d9d5-4c48-9eb6-692b1cb19787 could not be found. Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38a65752-d9d5-4c48-9eb6-692b1cb19787 could not be found. Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:49.849764 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:49.855653 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:49.855653 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:49.855653 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38a65752-d9d5-4c48-9eb6-692b1cb19787 could not be found. Aug 27 05:25:49.855653 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:49.857514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c33a456b-f130-4541-9de8-e7c1d3839641 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 38a65752-d9d5-4c48-9eb6-692b1cb19787 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:49.858656 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c33a456b-f130-4541-9de8-e7c1d3839641 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/38a65752-d9d5-4c48-9eb6-692b1cb19787/action" status: 404 len: 111 microversion: 2.1 time: 0.036330 Aug 27 05:25:49.859929 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2867/5732] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:25:49 2022] POST /compute/v2.1/servers/38a65752-d9d5-4c48-9eb6-692b1cb19787/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:25:49.885395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d5ad9fb-6a0f-4aaa-94a7-4e08021409c1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:49.887359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d5ad9fb-6a0f-4aaa-94a7-4e08021409c1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:49.923338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5ad9fb-6a0f-4aaa-94a7-4e08021409c1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.923601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5ad9fb-6a0f-4aaa-94a7-4e08021409c1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.924655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5ad9fb-6a0f-4aaa-94a7-4e08021409c1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.926962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5ad9fb-6a0f-4aaa-94a7-4e08021409c1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.928971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5ad9fb-6a0f-4aaa-94a7-4e08021409c1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.931008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d5ad9fb-6a0f-4aaa-94a7-4e08021409c1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:50.174538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-233d398a-c2a8-4e1b-adff-123152d8579b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:50.210384 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-233d398a-c2a8-4e1b-adff-123152d8579b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1643 microversion: 2.1 time: 0.479099 Aug 27 05:25:50.213722 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2866/5733] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:49 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1643 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:50.243507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bda734bc-13e3-48f9-bb47-d7fd22acd474 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:50.244354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bda734bc-13e3-48f9-bb47-d7fd22acd474 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:50.251397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bda734bc-13e3-48f9-bb47-d7fd22acd474 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:50.251960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bda734bc-13e3-48f9-bb47-d7fd22acd474 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:50.252403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bda734bc-13e3-48f9-bb47-d7fd22acd474 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:50.253140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bda734bc-13e3-48f9-bb47-d7fd22acd474 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:50.253597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bda734bc-13e3-48f9-bb47-d7fd22acd474 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:50.254084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bda734bc-13e3-48f9-bb47-d7fd22acd474 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:50.344371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d5ad9fb-6a0f-4aaa-94a7-4e08021409c1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:50.363003 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d5ad9fb-6a0f-4aaa-94a7-4e08021409c1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.498666 Aug 27 05:25:50.364713 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2868/5734] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:49 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:50.371753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b40ddf76-866b-4903-b9d1-68b019be020d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:50.373278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b40ddf76-866b-4903-b9d1-68b019be020d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:50.385196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b40ddf76-866b-4903-b9d1-68b019be020d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:50.386605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b40ddf76-866b-4903-b9d1-68b019be020d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:50.387474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b40ddf76-866b-4903-b9d1-68b019be020d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:50.388498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b40ddf76-866b-4903-b9d1-68b019be020d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:50.389184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b40ddf76-866b-4903-b9d1-68b019be020d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:50.390314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b40ddf76-866b-4903-b9d1-68b019be020d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:50.673956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b40ddf76-866b-4903-b9d1-68b019be020d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:50.686572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b40ddf76-866b-4903-b9d1-68b019be020d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1282 microversion: 2.1 time: 0.317322 Aug 27 05:25:50.699659 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2869/5735] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:50 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1282 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:50.716205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf5f4f68-0b12-4c23-8311-0348fca66268 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:50.716825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf5f4f68-0b12-4c23-8311-0348fca66268 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:50.732152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5f4f68-0b12-4c23-8311-0348fca66268 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:50.732649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5f4f68-0b12-4c23-8311-0348fca66268 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:50.736179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5f4f68-0b12-4c23-8311-0348fca66268 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:50.736997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5f4f68-0b12-4c23-8311-0348fca66268 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:50.737473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5f4f68-0b12-4c23-8311-0348fca66268 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:50.737908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf5f4f68-0b12-4c23-8311-0348fca66268 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:51.331786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cf5f4f68-0b12-4c23-8311-0348fca66268 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:51.353083 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf5f4f68-0b12-4c23-8311-0348fca66268 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.649343 Aug 27 05:25:51.354204 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2870/5736] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:50 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:51.391735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-598a882c-e65a-4cce-8ea1-44c3dd85f2dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:51.394777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-598a882c-e65a-4cce-8ea1-44c3dd85f2dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 75412286-bf1b-4504-a218-986099a328f5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:51.406791 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-598a882c-e65a-4cce-8ea1-44c3dd85f2dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 75412286-bf1b-4504-a218-986099a328f5 could not be found. Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-598a882c-e65a-4cce-8ea1-44c3dd85f2dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/75412286-bf1b-4504-a218-986099a328f5/action HTTP/1.1 Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 39 Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: {"os-getConsoleOutput": {"length": 10}} Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 75412286-bf1b-4504-a218-986099a328f5 could not be found. Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '75412286-bf1b-4504-a218-986099a328f5', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75412286-bf1b-4504-a218-986099a328f5 could not be found. Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75412286-bf1b-4504-a218-986099a328f5 could not be found. Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:51.419619 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:51.428295 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:51.428295 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:51.428295 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:51.428295 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:51.428295 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75412286-bf1b-4504-a218-986099a328f5 could not be found. Aug 27 05:25:51.428295 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:51.428295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-598a882c-e65a-4cce-8ea1-44c3dd85f2dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 75412286-bf1b-4504-a218-986099a328f5 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:51.428295 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-598a882c-e65a-4cce-8ea1-44c3dd85f2dd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/75412286-bf1b-4504-a218-986099a328f5/action" status: 404 len: 111 microversion: 2.1 time: 0.034387 Aug 27 05:25:51.428295 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2871/5737] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:25:51 2022] POST /compute/v2.1/servers/75412286-bf1b-4504-a218-986099a328f5/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:25:51.434710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d9f2ff68-6cde-4f25-9495-ef46c0ca5551 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:51.437576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d9f2ff68-6cde-4f25-9495-ef46c0ca5551 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:51.455911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9f2ff68-6cde-4f25-9495-ef46c0ca5551 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:51.456485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9f2ff68-6cde-4f25-9495-ef46c0ca5551 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:51.457049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9f2ff68-6cde-4f25-9495-ef46c0ca5551 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:51.458035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9f2ff68-6cde-4f25-9495-ef46c0ca5551 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:51.458567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9f2ff68-6cde-4f25-9495-ef46c0ca5551 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:51.460986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9f2ff68-6cde-4f25-9495-ef46c0ca5551 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:51.582370 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bda734bc-13e3-48f9-bb47-d7fd22acd474 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1796 microversion: 2.1 time: 1.343017 Aug 27 05:25:51.599630 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2867/5738] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:50 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1796 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:51.716285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7368e62c-59ab-44dd-864c-f37032dee409 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:51.717611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7368e62c-59ab-44dd-864c-f37032dee409 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:51.745659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7368e62c-59ab-44dd-864c-f37032dee409 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:51.746759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7368e62c-59ab-44dd-864c-f37032dee409 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:51.747800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7368e62c-59ab-44dd-864c-f37032dee409 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:51.751619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7368e62c-59ab-44dd-864c-f37032dee409 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:51.753149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7368e62c-59ab-44dd-864c-f37032dee409 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:51.756395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7368e62c-59ab-44dd-864c-f37032dee409 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:52.026770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7368e62c-59ab-44dd-864c-f37032dee409 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:52.040211 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7368e62c-59ab-44dd-864c-f37032dee409 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1280 microversion: 2.1 time: 0.330673 Aug 27 05:25:52.042673 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2868/5739] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:51 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1280 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:52.210918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d9f2ff68-6cde-4f25-9495-ef46c0ca5551 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:52.222135 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d9f2ff68-6cde-4f25-9495-ef46c0ca5551 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.791798 Aug 27 05:25:52.230349 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2872/5740] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:51 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:52.260064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6de98c0e-1f34-4e27-934c-7ddde2cdc64c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:52.260697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6de98c0e-1f34-4e27-934c-7ddde2cdc64c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:52.298136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6de98c0e-1f34-4e27-934c-7ddde2cdc64c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:52.298675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6de98c0e-1f34-4e27-934c-7ddde2cdc64c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:52.299440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6de98c0e-1f34-4e27-934c-7ddde2cdc64c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:52.299965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6de98c0e-1f34-4e27-934c-7ddde2cdc64c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:52.300423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6de98c0e-1f34-4e27-934c-7ddde2cdc64c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:52.300923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6de98c0e-1f34-4e27-934c-7ddde2cdc64c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:52.896803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6de98c0e-1f34-4e27-934c-7ddde2cdc64c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:52.924404 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6de98c0e-1f34-4e27-934c-7ddde2cdc64c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.671329 Aug 27 05:25:52.934272 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2869/5741] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:52 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:52.963656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-188d26e2-9d4e-4483-8daa-4fbc3e453742 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:52.965062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-188d26e2-9d4e-4483-8daa-4fbc3e453742 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 867c58df-1d8e-4511-8af3-ff6a8e57ba1f] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:52.980220 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-188d26e2-9d4e-4483-8daa-4fbc3e453742 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 867c58df-1d8e-4511-8af3-ff6a8e57ba1f could not be found. Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-188d26e2-9d4e-4483-8daa-4fbc3e453742 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/867c58df-1d8e-4511-8af3-ff6a8e57ba1f HTTP/1.1 Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 867c58df-1d8e-4511-8af3-ff6a8e57ba1f could not be found. Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '867c58df-1d8e-4511-8af3-ff6a8e57ba1f'} Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 867c58df-1d8e-4511-8af3-ff6a8e57ba1f could not be found. Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 867c58df-1d8e-4511-8af3-ff6a8e57ba1f could not be found. Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:52.984333 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:52.988474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:52.988474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:52.988474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:52.988474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 867c58df-1d8e-4511-8af3-ff6a8e57ba1f could not be found. Aug 27 05:25:52.988474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:25:52.992280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-188d26e2-9d4e-4483-8daa-4fbc3e453742 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 867c58df-1d8e-4511-8af3-ff6a8e57ba1f could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:53.000855 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-188d26e2-9d4e-4483-8daa-4fbc3e453742 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/867c58df-1d8e-4511-8af3-ff6a8e57ba1f" status: 404 len: 111 microversion: 2.1 time: 0.038202 Aug 27 05:25:53.007412 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2873/5742] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:52 2022] GET /compute/v2.1/servers/867c58df-1d8e-4511-8af3-ff6a8e57ba1f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:25:53.022190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-53560434-5992-4e2a-b4bf-01f1102a0b1e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:53.024386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-53560434-5992-4e2a-b4bf-01f1102a0b1e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:53.066065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53560434-5992-4e2a-b4bf-01f1102a0b1e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:53.066925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53560434-5992-4e2a-b4bf-01f1102a0b1e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:53.067758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53560434-5992-4e2a-b4bf-01f1102a0b1e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:53.069342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53560434-5992-4e2a-b4bf-01f1102a0b1e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:53.072512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3860edfe-0917-4ddf-8ab9-e8478d29fe19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:53.073305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3860edfe-0917-4ddf-8ab9-e8478d29fe19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:53.085474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53560434-5992-4e2a-b4bf-01f1102a0b1e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:53.087198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53560434-5992-4e2a-b4bf-01f1102a0b1e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:53.109362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3860edfe-0917-4ddf-8ab9-e8478d29fe19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:53.112022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3860edfe-0917-4ddf-8ab9-e8478d29fe19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:53.115552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3860edfe-0917-4ddf-8ab9-e8478d29fe19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:53.119976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3860edfe-0917-4ddf-8ab9-e8478d29fe19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:53.120639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3860edfe-0917-4ddf-8ab9-e8478d29fe19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:53.121220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3860edfe-0917-4ddf-8ab9-e8478d29fe19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:54.152599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3860edfe-0917-4ddf-8ab9-e8478d29fe19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:54.165952 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3860edfe-0917-4ddf-8ab9-e8478d29fe19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1322 microversion: 2.1 time: 1.097958 Aug 27 05:25:54.170602 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2874/5743] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:53 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1322 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:54.293798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-53560434-5992-4e2a-b4bf-01f1102a0b1e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:54.312650 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-53560434-5992-4e2a-b4bf-01f1102a0b1e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 1.303860 Aug 27 05:25:54.314024 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2870/5744] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:53 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:54.347348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-41274c41-115a-4896-a993-804fbf30b538 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:54.347985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-41274c41-115a-4896-a993-804fbf30b538 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:54.360234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41274c41-115a-4896-a993-804fbf30b538 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:54.360734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41274c41-115a-4896-a993-804fbf30b538 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:54.361182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41274c41-115a-4896-a993-804fbf30b538 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:54.361899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41274c41-115a-4896-a993-804fbf30b538 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:54.362361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41274c41-115a-4896-a993-804fbf30b538 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:54.362787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41274c41-115a-4896-a993-804fbf30b538 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:54.368300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:54.671171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-41274c41-115a-4896-a993-804fbf30b538 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:54.679764 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-41274c41-115a-4896-a993-804fbf30b538 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.339400 Aug 27 05:25:54.695397 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2875/5745] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:54 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:55.036621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e33858c7-81d5-4968-be47-5222656e5aaf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-639765286", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e33858c7-81d5-4968-be47-5222656e5aaf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 237 Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-639765286", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-639765286', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:55.055973 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 05:25:55.068350 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:55.077806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e33858c7-81d5-4968-be47-5222656e5aaf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:55.077806 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e33858c7-81d5-4968-be47-5222656e5aaf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.043380 Aug 27 05:25:55.082279 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2871/5746] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:55 2022] POST /compute/v2.1/servers => generated 139 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:25:55.101179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bdc1e220-6b73-416b-89a8-8bbd3b0d8fae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:55.104888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bdc1e220-6b73-416b-89a8-8bbd3b0d8fae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:55.119326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:55.156318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc1e220-6b73-416b-89a8-8bbd3b0d8fae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:55.161106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc1e220-6b73-416b-89a8-8bbd3b0d8fae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:55.162051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc1e220-6b73-416b-89a8-8bbd3b0d8fae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:55.163156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc1e220-6b73-416b-89a8-8bbd3b0d8fae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:55.169736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc1e220-6b73-416b-89a8-8bbd3b0d8fae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:55.170892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc1e220-6b73-416b-89a8-8bbd3b0d8fae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:55.217805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c1f8e0ff-ef84-4dd8-9e79-254e987140ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:55.219904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c1f8e0ff-ef84-4dd8-9e79-254e987140ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:55.300022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f8e0ff-ef84-4dd8-9e79-254e987140ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:55.301930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f8e0ff-ef84-4dd8-9e79-254e987140ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:55.303276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f8e0ff-ef84-4dd8-9e79-254e987140ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:55.305074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f8e0ff-ef84-4dd8-9e79-254e987140ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:55.306200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f8e0ff-ef84-4dd8-9e79-254e987140ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:55.308375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f8e0ff-ef84-4dd8-9e79-254e987140ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:55.315561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:55.785798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c1f8e0ff-ef84-4dd8-9e79-254e987140ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:55.815769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bdc1e220-6b73-416b-89a8-8bbd3b0d8fae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:55.817585 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c1f8e0ff-ef84-4dd8-9e79-254e987140ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1322 microversion: 2.1 time: 0.608246 Aug 27 05:25:55.819214 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2872/5747] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:55 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:55.835801 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bdc1e220-6b73-416b-89a8-8bbd3b0d8fae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.745297 Aug 27 05:25:55.837523 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2876/5748] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:55 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:55.856385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-251dbacb-3f0d-4a8d-a36b-79fdb972a295 req-426b2920-555b-402b-99e7-7fc9e4b20c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5f3e93-46ed-46f2-87c0-fffa21768054", "tag": "fae9025b-5089-43bd-9fca-bf7a53a79ed4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:55.865370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6719124d-a41a-4c5a-b845-71ea2a8c8aa3 req-bc127a9c-3520-4fe6-8364-bc93bb53f024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e03e5d6-756e-4532-9b5e-e8bdd38865ef", "tag": "ef797e9a-6c46-4590-8201-2ba2d15a214d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:55.884795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-251dbacb-3f0d-4a8d-a36b-79fdb972a295 req-426b2920-555b-402b-99e7-7fc9e4b20c7a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:55.884795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-251dbacb-3f0d-4a8d-a36b-79fdb972a295 req-426b2920-555b-402b-99e7-7fc9e4b20c7a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:55.887242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-251dbacb-3f0d-4a8d-a36b-79fdb972a295 req-426b2920-555b-402b-99e7-7fc9e4b20c7a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:55.914347 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-251dbacb-3f0d-4a8d-a36b-79fdb972a295 req-426b2920-555b-402b-99e7-7fc9e4b20c7a service nova] Creating event network-changed:fae9025b-5089-43bd-9fca-bf7a53a79ed4 for instance dc5f3e93-46ed-46f2-87c0-fffa21768054 on n-h2-820368-35 Aug 27 05:25:55.922753 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-251dbacb-3f0d-4a8d-a36b-79fdb972a295 req-426b2920-555b-402b-99e7-7fc9e4b20c7a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081878 Aug 27 05:25:55.923724 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2877/5749] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:55.939176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-51e28ff0-c158-491d-b8e6-fc6432499728 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:55.945210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-51e28ff0-c158-491d-b8e6-fc6432499728 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:55.968317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6719124d-a41a-4c5a-b845-71ea2a8c8aa3 req-bc127a9c-3520-4fe6-8364-bc93bb53f024 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:55.971399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51e28ff0-c158-491d-b8e6-fc6432499728 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:55.971568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6719124d-a41a-4c5a-b845-71ea2a8c8aa3 req-bc127a9c-3520-4fe6-8364-bc93bb53f024 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:55.972052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6719124d-a41a-4c5a-b845-71ea2a8c8aa3 req-bc127a9c-3520-4fe6-8364-bc93bb53f024 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:55.972380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51e28ff0-c158-491d-b8e6-fc6432499728 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:55.972975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51e28ff0-c158-491d-b8e6-fc6432499728 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:55.976649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51e28ff0-c158-491d-b8e6-fc6432499728 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:55.977436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51e28ff0-c158-491d-b8e6-fc6432499728 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:55.978050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51e28ff0-c158-491d-b8e6-fc6432499728 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:55.999134 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6719124d-a41a-4c5a-b845-71ea2a8c8aa3 req-bc127a9c-3520-4fe6-8364-bc93bb53f024 service nova] Creating event network-changed:ef797e9a-6c46-4590-8201-2ba2d15a214d for instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef on n-h1-820368-35 Aug 27 05:25:56.010895 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6719124d-a41a-4c5a-b845-71ea2a8c8aa3 req-bc127a9c-3520-4fe6-8364-bc93bb53f024 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189030 Aug 27 05:25:56.012950 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2873/5750] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:56.289997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-51e28ff0-c158-491d-b8e6-fc6432499728 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:56.315257 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-51e28ff0-c158-491d-b8e6-fc6432499728 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.382134 Aug 27 05:25:56.332158 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2878/5751] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:55 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:56.771995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-85eaaeed-04ac-48ae-b839-d5b26b3d2bd2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1648411428", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-85eaaeed-04ac-48ae-b839-d5b26b3d2bd2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 235 Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1648411428", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1648411428', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:56.780544 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 05:25:56.784908 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:56.787788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-85eaaeed-04ac-48ae-b839-d5b26b3d2bd2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:56.788881 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-85eaaeed-04ac-48ae-b839-d5b26b3d2bd2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.028463 Aug 27 05:25:56.790038 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2874/5752] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:56 2022] POST /compute/v2.1/servers => generated 133 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:25:56.802930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8050c156-f320-4c72-870e-7f8f03afdf46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:56.803583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8050c156-f320-4c72-870e-7f8f03afdf46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:56.821431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8050c156-f320-4c72-870e-7f8f03afdf46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:56.823551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8050c156-f320-4c72-870e-7f8f03afdf46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:56.824914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8050c156-f320-4c72-870e-7f8f03afdf46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:56.827981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8050c156-f320-4c72-870e-7f8f03afdf46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:56.829260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8050c156-f320-4c72-870e-7f8f03afdf46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:56.832323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8050c156-f320-4c72-870e-7f8f03afdf46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:56.869476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bec83528-cffa-4ca0-835b-65ceca120680 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:56.871138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bec83528-cffa-4ca0-835b-65ceca120680 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:56.897043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bec83528-cffa-4ca0-835b-65ceca120680 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:56.898453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bec83528-cffa-4ca0-835b-65ceca120680 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:56.908525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bec83528-cffa-4ca0-835b-65ceca120680 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:56.908837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bec83528-cffa-4ca0-835b-65ceca120680 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:56.909695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bec83528-cffa-4ca0-835b-65ceca120680 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:56.910449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bec83528-cffa-4ca0-835b-65ceca120680 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:57.329622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8050c156-f320-4c72-870e-7f8f03afdf46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:57.344196 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8050c156-f320-4c72-870e-7f8f03afdf46 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.547879 Aug 27 05:25:57.346268 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2879/5753] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:56 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:57.394605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5b546ad6-81cb-4b2b-adac-cc77e7ed3888 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:57.395354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5b546ad6-81cb-4b2b-adac-cc77e7ed3888 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:57.430659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b546ad6-81cb-4b2b-adac-cc77e7ed3888 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:57.431484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b546ad6-81cb-4b2b-adac-cc77e7ed3888 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:57.432191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b546ad6-81cb-4b2b-adac-cc77e7ed3888 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:57.433360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b546ad6-81cb-4b2b-adac-cc77e7ed3888 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:57.444905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b546ad6-81cb-4b2b-adac-cc77e7ed3888 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:57.448606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bec83528-cffa-4ca0-835b-65ceca120680 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:57.451529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b546ad6-81cb-4b2b-adac-cc77e7ed3888 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:57.472508 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bec83528-cffa-4ca0-835b-65ceca120680 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1322 microversion: 2.1 time: 0.609556 Aug 27 05:25:57.479647 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2875/5754] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:56 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:57.814235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5b546ad6-81cb-4b2b-adac-cc77e7ed3888 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:57.824084 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5b546ad6-81cb-4b2b-adac-cc77e7ed3888 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.437519 Aug 27 05:25:57.839128 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2880/5755] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:57 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:57.851768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b9529586-348f-493c-9938-ba17f37d9f0f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:57.853130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b9529586-348f-493c-9938-ba17f37d9f0f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 8021fb28-f01d-4d3a-bd5d-963961a21e45] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:57.861943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:57.866011 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-b9529586-348f-493c-9938-ba17f37d9f0f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 8021fb28-f01d-4d3a-bd5d-963961a21e45 could not be found. Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b9529586-348f-493c-9938-ba17f37d9f0f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/8021fb28-f01d-4d3a-bd5d-963961a21e45/action HTTP/1.1 Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 13 Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: {"pause": {}} Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 8021fb28-f01d-4d3a-bd5d-963961a21e45 could not be found. Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '8021fb28-f01d-4d3a-bd5d-963961a21e45', 'body': {'pause': {}}} Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8021fb28-f01d-4d3a-bd5d-963961a21e45 could not be found. Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8021fb28-f01d-4d3a-bd5d-963961a21e45 could not be found. Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:57.874612 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:57.895863 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:57.895863 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:57.895863 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8021fb28-f01d-4d3a-bd5d-963961a21e45 could not be found. Aug 27 05:25:57.895863 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:25:57.897321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b9529586-348f-493c-9938-ba17f37d9f0f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 8021fb28-f01d-4d3a-bd5d-963961a21e45 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:57.904092 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b9529586-348f-493c-9938-ba17f37d9f0f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/8021fb28-f01d-4d3a-bd5d-963961a21e45/action" status: 404 len: 111 microversion: 2.1 time: 0.058164 Aug 27 05:25:57.905741 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2876/5756] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:25:57 2022] POST /compute/v2.1/servers/8021fb28-f01d-4d3a-bd5d-963961a21e45/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:25:57.916681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b88930e3-6d6b-44bc-8d91-87d031104ad2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:57.917626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b88930e3-6d6b-44bc-8d91-87d031104ad2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:57.932690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b88930e3-6d6b-44bc-8d91-87d031104ad2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:57.933600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b88930e3-6d6b-44bc-8d91-87d031104ad2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:57.935394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b88930e3-6d6b-44bc-8d91-87d031104ad2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:57.938946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b88930e3-6d6b-44bc-8d91-87d031104ad2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:57.939876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b88930e3-6d6b-44bc-8d91-87d031104ad2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:57.940537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b88930e3-6d6b-44bc-8d91-87d031104ad2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:58.014024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-37dee3a6-e950-4507-88b7-fcd00c86ff55 req-b5bf1fe7-2d22-4bc5-b7b6-b48cee17f93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6625a4-fa42-41a0-8664-65bb32081817", "tag": "256e99b8-b009-4f0e-8458-fb3d127ff19e"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:58.041057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-37dee3a6-e950-4507-88b7-fcd00c86ff55 req-b5bf1fe7-2d22-4bc5-b7b6-b48cee17f93f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:58.044563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-37dee3a6-e950-4507-88b7-fcd00c86ff55 req-b5bf1fe7-2d22-4bc5-b7b6-b48cee17f93f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:58.045307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-37dee3a6-e950-4507-88b7-fcd00c86ff55 req-b5bf1fe7-2d22-4bc5-b7b6-b48cee17f93f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:58.079378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:58.089647 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-37dee3a6-e950-4507-88b7-fcd00c86ff55 req-b5bf1fe7-2d22-4bc5-b7b6-b48cee17f93f service nova] Creating event network-changed:256e99b8-b009-4f0e-8458-fb3d127ff19e for instance 1e6625a4-fa42-41a0-8664-65bb32081817 on n-h1-820368-35 Aug 27 05:25:58.106374 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-37dee3a6-e950-4507-88b7-fcd00c86ff55 req-b5bf1fe7-2d22-4bc5-b7b6-b48cee17f93f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094984 Aug 27 05:25:58.109337 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2877/5757] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:58.518251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c4eeafcd-354c-4117-a29b-bc9d7867ac38 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:58.522991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c4eeafcd-354c-4117-a29b-bc9d7867ac38 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:58.551967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b88930e3-6d6b-44bc-8d91-87d031104ad2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:58.566600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4eeafcd-354c-4117-a29b-bc9d7867ac38 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:58.568559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4eeafcd-354c-4117-a29b-bc9d7867ac38 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:58.570196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4eeafcd-354c-4117-a29b-bc9d7867ac38 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:58.572159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4eeafcd-354c-4117-a29b-bc9d7867ac38 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:58.573701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4eeafcd-354c-4117-a29b-bc9d7867ac38 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:58.575012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4eeafcd-354c-4117-a29b-bc9d7867ac38 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:58.579979 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b88930e3-6d6b-44bc-8d91-87d031104ad2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.670004 Aug 27 05:25:58.608898 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2881/5758] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:57 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:58.624543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d6fb6ebe-67be-43db-a995-02a0f454a240 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:58.628024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d6fb6ebe-67be-43db-a995-02a0f454a240 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:58.651533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6fb6ebe-67be-43db-a995-02a0f454a240 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:58.652535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6fb6ebe-67be-43db-a995-02a0f454a240 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:58.653499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6fb6ebe-67be-43db-a995-02a0f454a240 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:58.654534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6fb6ebe-67be-43db-a995-02a0f454a240 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:58.655759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6fb6ebe-67be-43db-a995-02a0f454a240 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:58.657548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6fb6ebe-67be-43db-a995-02a0f454a240 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:59.182640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c4eeafcd-354c-4117-a29b-bc9d7867ac38 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:59.199987 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c4eeafcd-354c-4117-a29b-bc9d7867ac38 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1322 microversion: 2.1 time: 0.695775 Aug 27 05:25:59.201249 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2878/5759] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:58 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1322 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:59.237896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d6fb6ebe-67be-43db-a995-02a0f454a240 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:59.271640 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d6fb6ebe-67be-43db-a995-02a0f454a240 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.655663 Aug 27 05:25:59.291443 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2882/5760] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:58 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:59.317602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e7f6e8d7-6529-4535-8562-c3baad80bfd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:59.318693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e7f6e8d7-6529-4535-8562-c3baad80bfd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:59.330784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7f6e8d7-6529-4535-8562-c3baad80bfd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:59.331422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7f6e8d7-6529-4535-8562-c3baad80bfd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:59.332059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7f6e8d7-6529-4535-8562-c3baad80bfd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:59.333339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7f6e8d7-6529-4535-8562-c3baad80bfd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:59.334216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7f6e8d7-6529-4535-8562-c3baad80bfd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:59.335327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e7f6e8d7-6529-4535-8562-c3baad80bfd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:59.573474 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e7f6e8d7-6529-4535-8562-c3baad80bfd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 202 len: 0 microversion: 2.1 time: 0.260421 Aug 27 05:25:59.580730 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2879/5761] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:25:59 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:25:59.586568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9f705156-5407-4c49-bae8-f5498d97a05e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:59.587652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9f705156-5407-4c49-bae8-f5498d97a05e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:59.661353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f705156-5407-4c49-bae8-f5498d97a05e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:59.666652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f705156-5407-4c49-bae8-f5498d97a05e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:59.674214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f705156-5407-4c49-bae8-f5498d97a05e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:59.681618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f705156-5407-4c49-bae8-f5498d97a05e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:59.682777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f705156-5407-4c49-bae8-f5498d97a05e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:59.683823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f705156-5407-4c49-bae8-f5498d97a05e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:00.237058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6723ff20-1759-4ce1-a47a-d46aaae077c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:00.238391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6723ff20-1759-4ce1-a47a-d46aaae077c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:00.258087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9f705156-5407-4c49-bae8-f5498d97a05e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:00.260434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6723ff20-1759-4ce1-a47a-d46aaae077c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:00.260997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6723ff20-1759-4ce1-a47a-d46aaae077c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:00.261542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6723ff20-1759-4ce1-a47a-d46aaae077c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:00.273009 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9f705156-5407-4c49-bae8-f5498d97a05e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1509 microversion: 2.1 time: 0.693602 Aug 27 05:26:00.273599 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2883/5762] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:59 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1509 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:00.292541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6723ff20-1759-4ce1-a47a-d46aaae077c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:00.295171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6723ff20-1759-4ce1-a47a-d46aaae077c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:00.302734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6723ff20-1759-4ce1-a47a-d46aaae077c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:00.679459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6723ff20-1759-4ce1-a47a-d46aaae077c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:00.697528 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6723ff20-1759-4ce1-a47a-d46aaae077c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1322 microversion: 2.1 time: 0.465754 Aug 27 05:26:00.703238 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2880/5763] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:00 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:01.298054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53789905-a8df-4f6d-bad7-09dbac995b5d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:01.299286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-53789905-a8df-4f6d-bad7-09dbac995b5d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:01.312502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53789905-a8df-4f6d-bad7-09dbac995b5d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:01.313665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53789905-a8df-4f6d-bad7-09dbac995b5d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:01.314704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53789905-a8df-4f6d-bad7-09dbac995b5d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:01.316013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53789905-a8df-4f6d-bad7-09dbac995b5d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:01.318175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53789905-a8df-4f6d-bad7-09dbac995b5d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:01.318175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53789905-a8df-4f6d-bad7-09dbac995b5d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:01.734198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3d19978c-fc8d-45c4-86ff-15a997899a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:01.735369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3d19978c-fc8d-45c4-86ff-15a997899a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:01.775947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:01.777756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-53789905-a8df-4f6d-bad7-09dbac995b5d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:01.779862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d19978c-fc8d-45c4-86ff-15a997899a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:01.781235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d19978c-fc8d-45c4-86ff-15a997899a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:01.782278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d19978c-fc8d-45c4-86ff-15a997899a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:01.783889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d19978c-fc8d-45c4-86ff-15a997899a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:01.789585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d19978c-fc8d-45c4-86ff-15a997899a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:01.790686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d19978c-fc8d-45c4-86ff-15a997899a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:01.791670 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-53789905-a8df-4f6d-bad7-09dbac995b5d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1489 microversion: 2.1 time: 0.500639 Aug 27 05:26:01.793557 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2884/5764] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:01 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1489 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:01.804107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:01.833586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:01.834430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:01.845335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:01.846901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:01.847816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:01.849634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:01.850374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:01.850974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:01.884077 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Cannot 'pause' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state paused Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action HTTP/1.1 Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 13 Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: {"pause": {}} Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: exception: Cannot 'pause' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state paused Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '64999ba4-bbd9-4d23-9a4c-0caf8eb677b4', 'body': {'pause': {}}} Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 in vm_state paused. Cannot pause while the instance is in this state. Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state paused Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:01.886259 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:01.890936 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:01.890936 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:01.890936 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:01.890936 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state paused Aug 27 05:26:01.890936 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:01.892633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 409 to user: Cannot 'pause' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state paused {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:01.894049 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a6e4cf09-6663-46c1-931e-cbb556bb8e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 409 len: 143 microversion: 2.1 time: 0.065698 Aug 27 05:26:01.896187 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2885/5765] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:01 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 143 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 05:26:01.907701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3fd53c01-790f-495e-894b-4053f2364472 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:01.908709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3fd53c01-790f-495e-894b-4053f2364472 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:01.918667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd53c01-790f-495e-894b-4053f2364472 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:01.919498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd53c01-790f-495e-894b-4053f2364472 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:01.920232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd53c01-790f-495e-894b-4053f2364472 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:01.921630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd53c01-790f-495e-894b-4053f2364472 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:01.923198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd53c01-790f-495e-894b-4053f2364472 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:01.924524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fd53c01-790f-495e-894b-4053f2364472 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:02.018902 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3fd53c01-790f-495e-894b-4053f2364472 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 202 len: 0 microversion: 2.1 time: 0.115431 Aug 27 05:26:02.019886 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2886/5766] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:01 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:26:02.043126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d890b110-d121-4bde-92d9-d9c50ce5d055 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:02.044779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d890b110-d121-4bde-92d9-d9c50ce5d055 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:02.056774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d890b110-d121-4bde-92d9-d9c50ce5d055 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:02.058157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d890b110-d121-4bde-92d9-d9c50ce5d055 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:02.059193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d890b110-d121-4bde-92d9-d9c50ce5d055 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:02.060145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d890b110-d121-4bde-92d9-d9c50ce5d055 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:02.060802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d890b110-d121-4bde-92d9-d9c50ce5d055 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:02.061401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d890b110-d121-4bde-92d9-d9c50ce5d055 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:02.071338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3d19978c-fc8d-45c4-86ff-15a997899a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:02.083635 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3d19978c-fc8d-45c4-86ff-15a997899a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1322 microversion: 2.1 time: 0.359311 Aug 27 05:26:02.096529 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2881/5767] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:01 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:02.302506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d890b110-d121-4bde-92d9-d9c50ce5d055 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:02.315258 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d890b110-d121-4bde-92d9-d9c50ce5d055 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1496 microversion: 2.1 time: 0.290474 Aug 27 05:26:02.316599 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2887/5768] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:02 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1496 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:03.115237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab6ea9bb-8001-428e-9638-210704454931 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:03.117051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ab6ea9bb-8001-428e-9638-210704454931 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:03.127921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab6ea9bb-8001-428e-9638-210704454931 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:03.129514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab6ea9bb-8001-428e-9638-210704454931 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:03.130300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab6ea9bb-8001-428e-9638-210704454931 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:03.132132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab6ea9bb-8001-428e-9638-210704454931 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:03.132928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab6ea9bb-8001-428e-9638-210704454931 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:03.133693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab6ea9bb-8001-428e-9638-210704454931 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:03.327868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ab6ea9bb-8001-428e-9638-210704454931 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:03.338605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-31d97a1d-814e-4f85-bf60-a55ec708b7e2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:03.340369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-31d97a1d-814e-4f85-bf60-a55ec708b7e2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:03.344690 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ab6ea9bb-8001-428e-9638-210704454931 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1322 microversion: 2.1 time: 0.233998 Aug 27 05:26:03.347063 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2882/5769] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:03 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:03.350577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d97a1d-814e-4f85-bf60-a55ec708b7e2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:03.351493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d97a1d-814e-4f85-bf60-a55ec708b7e2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:03.352120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d97a1d-814e-4f85-bf60-a55ec708b7e2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:03.353260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d97a1d-814e-4f85-bf60-a55ec708b7e2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:03.353790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d97a1d-814e-4f85-bf60-a55ec708b7e2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:03.355105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d97a1d-814e-4f85-bf60-a55ec708b7e2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:03.555598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-31d97a1d-814e-4f85-bf60-a55ec708b7e2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:03.565257 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-31d97a1d-814e-4f85-bf60-a55ec708b7e2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.231003 Aug 27 05:26:03.565848 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2888/5770] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:03 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:03.587528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-94eb62f3-f91f-440f-816b-618f5fc98e1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:03.588439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-94eb62f3-f91f-440f-816b-618f5fc98e1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:03.597842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94eb62f3-f91f-440f-816b-618f5fc98e1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:03.598600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94eb62f3-f91f-440f-816b-618f5fc98e1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:03.599207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94eb62f3-f91f-440f-816b-618f5fc98e1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:03.599912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94eb62f3-f91f-440f-816b-618f5fc98e1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:03.600966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94eb62f3-f91f-440f-816b-618f5fc98e1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:03.601392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94eb62f3-f91f-440f-816b-618f5fc98e1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:03.893717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-94eb62f3-f91f-440f-816b-618f5fc98e1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:03.913815 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-94eb62f3-f91f-440f-816b-618f5fc98e1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.327742 Aug 27 05:26:03.931893 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2883/5771] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:03 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:03.939725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:03.945128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:03.956635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:03.957934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:03.971133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:03.979306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:03.980178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:03.983193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:04.015042 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09/action HTTP/1.1 Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 28 Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: {"reboot": {"type": "SOFT"}} Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e01c08d1-46fc-4e59-88f8-e22358700d09', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1043, in _action_reboot Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:26:04.020130 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:26:04.029012 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:04.033321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:04.035306 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-140481cc-6ac0-4d04-9c3a-293316edc024 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09/action" status: 404 len: 111 microversion: 2.1 time: 0.102909 Aug 27 05:26:04.040823 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2889/5772] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:03 2022] POST /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09/action => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:26:04.054768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-016971d4-04b7-4ffb-8875-4f8e4bbd9d1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:04.056212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-016971d4-04b7-4ffb-8875-4f8e4bbd9d1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:04.070172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-016971d4-04b7-4ffb-8875-4f8e4bbd9d1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.071691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-016971d4-04b7-4ffb-8875-4f8e4bbd9d1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.071896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-016971d4-04b7-4ffb-8875-4f8e4bbd9d1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:04.075139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-016971d4-04b7-4ffb-8875-4f8e4bbd9d1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.076326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-016971d4-04b7-4ffb-8875-4f8e4bbd9d1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.077388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-016971d4-04b7-4ffb-8875-4f8e4bbd9d1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:04.304047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3c6992b4-b71d-481d-956e-c2d4af6d2a50 req-53da5cad-3cd5-484a-a856-f61ca1f51357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5f3e93-46ed-46f2-87c0-fffa21768054", "name": "network-vif-plugged", "status": "completed", "tag": "fae9025b-5089-43bd-9fca-bf7a53a79ed4"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:04.340682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3c6992b4-b71d-481d-956e-c2d4af6d2a50 req-53da5cad-3cd5-484a-a856-f61ca1f51357 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.345729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3c6992b4-b71d-481d-956e-c2d4af6d2a50 req-53da5cad-3cd5-484a-a856-f61ca1f51357 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.347334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3c6992b4-b71d-481d-956e-c2d4af6d2a50 req-53da5cad-3cd5-484a-a856-f61ca1f51357 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:04.356892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-016971d4-04b7-4ffb-8875-4f8e4bbd9d1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:04.371926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-016971d4-04b7-4ffb-8875-4f8e4bbd9d1d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.325822 Aug 27 05:26:04.373365 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2884/5773] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:04 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:04.382498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4a264409-36da-4967-ba2b-667b95789803 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:04.383598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4a264409-36da-4967-ba2b-667b95789803 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:04.396691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a264409-36da-4967-ba2b-667b95789803 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.398078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a264409-36da-4967-ba2b-667b95789803 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.399220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a264409-36da-4967-ba2b-667b95789803 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:04.400671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a264409-36da-4967-ba2b-667b95789803 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.401834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a264409-36da-4967-ba2b-667b95789803 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.402566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a264409-36da-4967-ba2b-667b95789803 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:04.406743 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3c6992b4-b71d-481d-956e-c2d4af6d2a50 req-53da5cad-3cd5-484a-a856-f61ca1f51357 service nova] Creating event network-vif-plugged:fae9025b-5089-43bd-9fca-bf7a53a79ed4 for instance dc5f3e93-46ed-46f2-87c0-fffa21768054 on n-h2-820368-35 Aug 27 05:26:04.444286 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3c6992b4-b71d-481d-956e-c2d4af6d2a50 req-53da5cad-3cd5-484a-a856-f61ca1f51357 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171379 Aug 27 05:26:04.448205 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2890/5774] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:26:04.457213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-69fac3d7-299f-4463-9450-b8fc483dd25e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:04.458214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-69fac3d7-299f-4463-9450-b8fc483dd25e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:04.466725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fac3d7-299f-4463-9450-b8fc483dd25e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.467547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fac3d7-299f-4463-9450-b8fc483dd25e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.468193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fac3d7-299f-4463-9450-b8fc483dd25e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:04.469128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fac3d7-299f-4463-9450-b8fc483dd25e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.469763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fac3d7-299f-4463-9450-b8fc483dd25e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.470359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-69fac3d7-299f-4463-9450-b8fc483dd25e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:04.694460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4a264409-36da-4967-ba2b-667b95789803 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:04.711971 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4a264409-36da-4967-ba2b-667b95789803 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1322 microversion: 2.1 time: 0.337023 Aug 27 05:26:04.712586 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2885/5775] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:04 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:04.767055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-69fac3d7-299f-4463-9450-b8fc483dd25e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:04.779266 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-69fac3d7-299f-4463-9450-b8fc483dd25e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.329359 Aug 27 05:26:04.790568 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2891/5776] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:04 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:04.814154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab0e8f1a-c84d-4dbf-a662-2e8dc80e21e4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:04.816637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ab0e8f1a-c84d-4dbf-a662-2e8dc80e21e4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 2bc928f4-0fbd-43e2-84b4-14180cb5908c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:04.828919 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-ab0e8f1a-c84d-4dbf-a662-2e8dc80e21e4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 2bc928f4-0fbd-43e2-84b4-14180cb5908c could not be found. Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab0e8f1a-c84d-4dbf-a662-2e8dc80e21e4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/2bc928f4-0fbd-43e2-84b4-14180cb5908c/action HTTP/1.1 Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 28 Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: {"reboot": {"type": "SOFT"}} Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 2bc928f4-0fbd-43e2-84b4-14180cb5908c could not be found. Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2bc928f4-0fbd-43e2-84b4-14180cb5908c', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc928f4-0fbd-43e2-84b4-14180cb5908c could not be found. Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1043, in _action_reboot Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:04.830481 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc928f4-0fbd-43e2-84b4-14180cb5908c could not be found. Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc928f4-0fbd-43e2-84b4-14180cb5908c could not be found. Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab0e8f1a-c84d-4dbf-a662-2e8dc80e21e4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 2bc928f4-0fbd-43e2-84b4-14180cb5908c could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:04.838745 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ab0e8f1a-c84d-4dbf-a662-2e8dc80e21e4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/2bc928f4-0fbd-43e2-84b4-14180cb5908c/action" status: 404 len: 111 microversion: 2.1 time: 0.022312 Aug 27 05:26:04.841745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-be5fed68-9dd5-44df-9399-3b99e887fae8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:04.842379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-be5fed68-9dd5-44df-9399-3b99e887fae8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:04.846835 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2886/5777] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:04 2022] POST /compute/v2.1/servers/2bc928f4-0fbd-43e2-84b4-14180cb5908c/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:26:04.854908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be5fed68-9dd5-44df-9399-3b99e887fae8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.863582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be5fed68-9dd5-44df-9399-3b99e887fae8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.863582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be5fed68-9dd5-44df-9399-3b99e887fae8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:04.863582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be5fed68-9dd5-44df-9399-3b99e887fae8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.863582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be5fed68-9dd5-44df-9399-3b99e887fae8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.863582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be5fed68-9dd5-44df-9399-3b99e887fae8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:05.221129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-be5fed68-9dd5-44df-9399-3b99e887fae8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:05.238799 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-be5fed68-9dd5-44df-9399-3b99e887fae8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.398393 Aug 27 05:26:05.260477 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2892/5778] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:04 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:05.274616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a095dc08-273a-46a1-9977-2ffec9aa2f70 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:05.275342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a095dc08-273a-46a1-9977-2ffec9aa2f70 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:05.295938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a095dc08-273a-46a1-9977-2ffec9aa2f70 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:05.296463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a095dc08-273a-46a1-9977-2ffec9aa2f70 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:05.296915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a095dc08-273a-46a1-9977-2ffec9aa2f70 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:05.298861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a095dc08-273a-46a1-9977-2ffec9aa2f70 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:05.299730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a095dc08-273a-46a1-9977-2ffec9aa2f70 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:05.300357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a095dc08-273a-46a1-9977-2ffec9aa2f70 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:05.643104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a095dc08-273a-46a1-9977-2ffec9aa2f70 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:05.658511 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a095dc08-273a-46a1-9977-2ffec9aa2f70 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.393272 Aug 27 05:26:05.659956 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2887/5779] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:05 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:05.696314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:05.702202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:05.731670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:05.733475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:05.734184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:05.734812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:05.735777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:05.736408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:05.737657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:05.742644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:05.748853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c55b18e4-36fe-41aa-8951-5f417cbf4a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:05.751286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c55b18e4-36fe-41aa-8951-5f417cbf4a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:05.772907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c55b18e4-36fe-41aa-8951-5f417cbf4a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:05.783893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c55b18e4-36fe-41aa-8951-5f417cbf4a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:05.785011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c55b18e4-36fe-41aa-8951-5f417cbf4a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:05.787477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c55b18e4-36fe-41aa-8951-5f417cbf4a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:05.789324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c55b18e4-36fe-41aa-8951-5f417cbf4a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:05.790028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c55b18e4-36fe-41aa-8951-5f417cbf4a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:05.792471 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09/action HTTP/1.1 Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 65 Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e01c08d1-46fc-4e59-88f8-e22358700d09', 'body': {'rebuild': {'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f'}}} Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 05:26:05.795371 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1183, in _action_rebuild Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:26:05.803392 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:05.807284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:05.809054 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-51215fcc-4051-4488-a377-3108fbde6f44 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09/action" status: 404 len: 111 microversion: 2.1 time: 0.124021 Aug 27 05:26:05.815511 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2893/5780] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:05 2022] POST /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09/action => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:26:05.827593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c2fcc494-1a63-4ffc-b4ee-72830aa95fba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:05.828458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c2fcc494-1a63-4ffc-b4ee-72830aa95fba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:05.854276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2fcc494-1a63-4ffc-b4ee-72830aa95fba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:05.855281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2fcc494-1a63-4ffc-b4ee-72830aa95fba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:05.856177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2fcc494-1a63-4ffc-b4ee-72830aa95fba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:05.858119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2fcc494-1a63-4ffc-b4ee-72830aa95fba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:05.864347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2fcc494-1a63-4ffc-b4ee-72830aa95fba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:05.865591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2fcc494-1a63-4ffc-b4ee-72830aa95fba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:06.408048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c2fcc494-1a63-4ffc-b4ee-72830aa95fba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:06.422591 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c2fcc494-1a63-4ffc-b4ee-72830aa95fba tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.600367 Aug 27 05:26:06.424520 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2894/5781] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:05 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:06.467304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c55b18e4-36fe-41aa-8951-5f417cbf4a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:06.474209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-99be54cf-0aba-40d2-b788-35f27ca3562f req-ccb62d1b-74a3-42cf-8691-d3662fb77fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e03e5d6-756e-4532-9b5e-e8bdd38865ef", "name": "network-vif-plugged", "status": "completed", "tag": "ef797e9a-6c46-4590-8201-2ba2d15a214d"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:06.491388 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c55b18e4-36fe-41aa-8951-5f417cbf4a85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1322 microversion: 2.1 time: 0.754439 Aug 27 05:26:06.492384 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2888/5782] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:05 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1322 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:06.499003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-99be54cf-0aba-40d2-b788-35f27ca3562f req-ccb62d1b-74a3-42cf-8691-d3662fb77fda service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:06.499910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-99be54cf-0aba-40d2-b788-35f27ca3562f req-ccb62d1b-74a3-42cf-8691-d3662fb77fda service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:06.500692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-99be54cf-0aba-40d2-b788-35f27ca3562f req-ccb62d1b-74a3-42cf-8691-d3662fb77fda service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:06.513306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae843293-329c-4ee8-a49a-b4e01e8ddc79 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:06.514449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae843293-329c-4ee8-a49a-b4e01e8ddc79 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:06.536963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae843293-329c-4ee8-a49a-b4e01e8ddc79 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:06.537479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae843293-329c-4ee8-a49a-b4e01e8ddc79 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:06.539059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae843293-329c-4ee8-a49a-b4e01e8ddc79 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:06.540262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae843293-329c-4ee8-a49a-b4e01e8ddc79 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:06.541016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae843293-329c-4ee8-a49a-b4e01e8ddc79 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:06.541721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae843293-329c-4ee8-a49a-b4e01e8ddc79 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:06.551007 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-99be54cf-0aba-40d2-b788-35f27ca3562f req-ccb62d1b-74a3-42cf-8691-d3662fb77fda service nova] Creating event network-vif-plugged:ef797e9a-6c46-4590-8201-2ba2d15a214d for instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef on n-h1-820368-35 Aug 27 05:26:06.561404 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-99be54cf-0aba-40d2-b788-35f27ca3562f req-ccb62d1b-74a3-42cf-8691-d3662fb77fda service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101154 Aug 27 05:26:06.574141 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2895/5783] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:26:07.132625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae843293-329c-4ee8-a49a-b4e01e8ddc79 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:07.159701 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae843293-329c-4ee8-a49a-b4e01e8ddc79 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.662066 Aug 27 05:26:07.163463 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2889/5784] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:06 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:07.223253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ccee4301-7e01-42f9-a5b8-29222e6d7987 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:07.242367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ccee4301-7e01-42f9-a5b8-29222e6d7987 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 2a2ae826-d5bf-4ca2-b13d-b78fd227d6f3] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:07.264578 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-ccee4301-7e01-42f9-a5b8-29222e6d7987 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 2a2ae826-d5bf-4ca2-b13d-b78fd227d6f3 could not be found. Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ccee4301-7e01-42f9-a5b8-29222e6d7987 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/2a2ae826-d5bf-4ca2-b13d-b78fd227d6f3/action HTTP/1.1 Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 65 Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 2a2ae826-d5bf-4ca2-b13d-b78fd227d6f3 could not be found. Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2a2ae826-d5bf-4ca2-b13d-b78fd227d6f3', 'body': {'rebuild': {'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f'}}} Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a2ae826-d5bf-4ca2-b13d-b78fd227d6f3 could not be found. Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1183, in _action_rebuild Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 05:26:07.275033 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a2ae826-d5bf-4ca2-b13d-b78fd227d6f3 could not be found. Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a2ae826-d5bf-4ca2-b13d-b78fd227d6f3 could not be found. Aug 27 05:26:07.282931 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:07.286003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ccee4301-7e01-42f9-a5b8-29222e6d7987 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 2a2ae826-d5bf-4ca2-b13d-b78fd227d6f3 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:07.287237 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ccee4301-7e01-42f9-a5b8-29222e6d7987 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/2a2ae826-d5bf-4ca2-b13d-b78fd227d6f3/action" status: 404 len: 111 microversion: 2.1 time: 0.071952 Aug 27 05:26:07.288499 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2890/5785] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:07 2022] POST /compute/v2.1/servers/2a2ae826-d5bf-4ca2-b13d-b78fd227d6f3/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:26:07.298710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d53de2f7-f3c0-4d39-89ec-faef228d8094 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:07.304312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d53de2f7-f3c0-4d39-89ec-faef228d8094 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:07.321965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d53de2f7-f3c0-4d39-89ec-faef228d8094 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:07.323033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d53de2f7-f3c0-4d39-89ec-faef228d8094 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:07.326653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d53de2f7-f3c0-4d39-89ec-faef228d8094 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:07.327824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d53de2f7-f3c0-4d39-89ec-faef228d8094 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:07.328541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d53de2f7-f3c0-4d39-89ec-faef228d8094 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:07.329212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d53de2f7-f3c0-4d39-89ec-faef228d8094 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:07.783935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d53de2f7-f3c0-4d39-89ec-faef228d8094 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:07.800041 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d53de2f7-f3c0-4d39-89ec-faef228d8094 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.505087 Aug 27 05:26:07.818202 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2891/5786] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:07 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:07.819518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5af0934d-1d38-49ee-bc09-2cd7af641d37 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:07.819518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5af0934d-1d38-49ee-bc09-2cd7af641d37 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:07.822622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-87830568-5a6e-490f-a7e0-99e653b2dba5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:07.824261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-87830568-5a6e-490f-a7e0-99e653b2dba5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:07.834368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5af0934d-1d38-49ee-bc09-2cd7af641d37 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:07.835422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5af0934d-1d38-49ee-bc09-2cd7af641d37 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:07.835867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5af0934d-1d38-49ee-bc09-2cd7af641d37 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:07.836799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5af0934d-1d38-49ee-bc09-2cd7af641d37 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:07.837260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5af0934d-1d38-49ee-bc09-2cd7af641d37 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:07.837506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87830568-5a6e-490f-a7e0-99e653b2dba5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:07.837679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5af0934d-1d38-49ee-bc09-2cd7af641d37 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:07.838377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87830568-5a6e-490f-a7e0-99e653b2dba5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:07.838965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87830568-5a6e-490f-a7e0-99e653b2dba5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:07.839876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87830568-5a6e-490f-a7e0-99e653b2dba5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:07.840491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87830568-5a6e-490f-a7e0-99e653b2dba5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:07.841424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87830568-5a6e-490f-a7e0-99e653b2dba5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:07.904291 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5af0934d-1d38-49ee-bc09-2cd7af641d37 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/ips" status: 200 len: 149 microversion: 2.1 time: 0.820979 Aug 27 05:26:07.906123 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2896/5787] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:26:07 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/ips => generated 149 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:07.915998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2673da57-73a4-4dfe-8438-a3e771ce16d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:07.940396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2673da57-73a4-4dfe-8438-a3e771ce16d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:07.955852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2673da57-73a4-4dfe-8438-a3e771ce16d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:07.957791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2673da57-73a4-4dfe-8438-a3e771ce16d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:07.958921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2673da57-73a4-4dfe-8438-a3e771ce16d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:07.962362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2673da57-73a4-4dfe-8438-a3e771ce16d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:07.963555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2673da57-73a4-4dfe-8438-a3e771ce16d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:07.964611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2673da57-73a4-4dfe-8438-a3e771ce16d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:08.254435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-87830568-5a6e-490f-a7e0-99e653b2dba5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:08.268594 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-87830568-5a6e-490f-a7e0-99e653b2dba5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1322 microversion: 2.1 time: 0.455589 Aug 27 05:26:08.269620 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2892/5788] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:07 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:08.365480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2673da57-73a4-4dfe-8438-a3e771ce16d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:08.383752 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2673da57-73a4-4dfe-8438-a3e771ce16d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.475168 Aug 27 05:26:08.385493 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2897/5789] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:07 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:08.421236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-423e907d-caa3-49f7-a559-6bc4e5892753 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:08.422166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-423e907d-caa3-49f7-a559-6bc4e5892753 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64f3cde8-07cd-4ff7-a21d-8ef3502cdd96] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:08.437185 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-423e907d-caa3-49f7-a559-6bc4e5892753 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 64f3cde8-07cd-4ff7-a21d-8ef3502cdd96 could not be found. Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-423e907d-caa3-49f7-a559-6bc4e5892753 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/64f3cde8-07cd-4ff7-a21d-8ef3502cdd96/action HTTP/1.1 Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 15 Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: {"restore": {}} Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 64f3cde8-07cd-4ff7-a21d-8ef3502cdd96 could not be found. Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '64f3cde8-07cd-4ff7-a21d-8ef3502cdd96', 'body': {'restore': {}}} Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f3cde8-07cd-4ff7-a21d-8ef3502cdd96 could not be found. Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f3cde8-07cd-4ff7-a21d-8ef3502cdd96 could not be found. Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:08.441872 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:08.447799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:08.447799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:08.447799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f3cde8-07cd-4ff7-a21d-8ef3502cdd96 could not be found. Aug 27 05:26:08.447799 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:08.450140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-423e907d-caa3-49f7-a559-6bc4e5892753 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 64f3cde8-07cd-4ff7-a21d-8ef3502cdd96 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:08.452592 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-423e907d-caa3-49f7-a559-6bc4e5892753 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64f3cde8-07cd-4ff7-a21d-8ef3502cdd96/action" status: 404 len: 111 microversion: 2.1 time: 0.041719 Aug 27 05:26:08.457389 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2893/5790] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:08 2022] POST /compute/v2.1/servers/64f3cde8-07cd-4ff7-a21d-8ef3502cdd96/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:26:08.464581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-54f89823-9669-4cd6-a472-d1c53ece8810 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:08.465472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-54f89823-9669-4cd6-a472-d1c53ece8810 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:08.474398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f89823-9669-4cd6-a472-d1c53ece8810 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:08.475173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f89823-9669-4cd6-a472-d1c53ece8810 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:08.475803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f89823-9669-4cd6-a472-d1c53ece8810 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:08.476717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f89823-9669-4cd6-a472-d1c53ece8810 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:08.477336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f89823-9669-4cd6-a472-d1c53ece8810 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:08.477928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f89823-9669-4cd6-a472-d1c53ece8810 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:08.737284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-54f89823-9669-4cd6-a472-d1c53ece8810 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:08.747359 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-54f89823-9669-4cd6-a472-d1c53ece8810 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.287751 Aug 27 05:26:08.748001 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2898/5791] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:08 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:08.777159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-691d9b46-2ba4-4514-88bc-6293f7a6acd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:08.777976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-691d9b46-2ba4-4514-88bc-6293f7a6acd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:08.800884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-691d9b46-2ba4-4514-88bc-6293f7a6acd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:08.802279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-691d9b46-2ba4-4514-88bc-6293f7a6acd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:08.806588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-691d9b46-2ba4-4514-88bc-6293f7a6acd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:08.811199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-691d9b46-2ba4-4514-88bc-6293f7a6acd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:08.812346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-691d9b46-2ba4-4514-88bc-6293f7a6acd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:08.813292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-691d9b46-2ba4-4514-88bc-6293f7a6acd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.094041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-691d9b46-2ba4-4514-88bc-6293f7a6acd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:09.108690 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-691d9b46-2ba4-4514-88bc-6293f7a6acd7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.335840 Aug 27 05:26:09.109674 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2894/5792] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:08 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:09.151977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:09.153055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:09.171473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.172576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.173302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.174361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.175277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.178464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.223210 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Cannot 'restore' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action HTTP/1.1 Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 15 Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: {"restore": {}} Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: exception: Cannot 'restore' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '64999ba4-bbd9-4d23-9a4c-0caf8eb677b4', 'body': {'restore': {}}} Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 in vm_state active. Cannot restore while the instance is in this state. Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:09.226274 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:09.237601 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:09.237601 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:09.237601 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:09.237601 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:26:09.237601 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:09.237601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 409 to user: Cannot 'restore' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:09.237601 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7147ab05-727b-4a67-8ff8-a6f86d8f65ed tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 409 len: 145 microversion: 2.1 time: 0.085118 Aug 27 05:26:09.241277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b3c4daf-9083-4153-9df3-f63ddaaf6c3a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:09.241616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b3c4daf-9083-4153-9df3-f63ddaaf6c3a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:09.245828 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2899/5793] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:09 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 145 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:26:09.257834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3c4daf-9083-4153-9df3-f63ddaaf6c3a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.259814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3c4daf-9083-4153-9df3-f63ddaaf6c3a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.260846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3c4daf-9083-4153-9df3-f63ddaaf6c3a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.262639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3c4daf-9083-4153-9df3-f63ddaaf6c3a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.263825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3c4daf-9083-4153-9df3-f63ddaaf6c3a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.264849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3c4daf-9083-4153-9df3-f63ddaaf6c3a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.306525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57ae4e3f-28ca-4339-88b3-87e1fb965cb4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:09.307166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-57ae4e3f-28ca-4339-88b3-87e1fb965cb4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:09.322075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ae4e3f-28ca-4339-88b3-87e1fb965cb4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.323380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ae4e3f-28ca-4339-88b3-87e1fb965cb4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.324404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ae4e3f-28ca-4339-88b3-87e1fb965cb4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.326120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ae4e3f-28ca-4339-88b3-87e1fb965cb4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.327069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ae4e3f-28ca-4339-88b3-87e1fb965cb4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.328085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57ae4e3f-28ca-4339-88b3-87e1fb965cb4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.563210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4b3c4daf-9083-4153-9df3-f63ddaaf6c3a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:09.586485 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b3c4daf-9083-4153-9df3-f63ddaaf6c3a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.351136 Aug 27 05:26:09.587700 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2895/5794] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:09 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:09.625372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5577e8f4-ea53-44da-b9ab-3023ab951778 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:09.626476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5577e8f4-ea53-44da-b9ab-3023ab951778 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:09.637012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5577e8f4-ea53-44da-b9ab-3023ab951778 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.637559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5577e8f4-ea53-44da-b9ab-3023ab951778 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.643813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5577e8f4-ea53-44da-b9ab-3023ab951778 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.644972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5577e8f4-ea53-44da-b9ab-3023ab951778 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.645614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5577e8f4-ea53-44da-b9ab-3023ab951778 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.646232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5577e8f4-ea53-44da-b9ab-3023ab951778 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.661610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-57ae4e3f-28ca-4339-88b3-87e1fb965cb4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:09.676968 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-57ae4e3f-28ca-4339-88b3-87e1fb965cb4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1517 microversion: 2.1 time: 0.375574 Aug 27 05:26:09.679243 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2900/5795] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:09 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1517 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:09.724493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4fae742b-eebf-4246-8e1e-9584787f4024 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:09.736726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4fae742b-eebf-4246-8e1e-9584787f4024 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:09.753660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fae742b-eebf-4246-8e1e-9584787f4024 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.758419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fae742b-eebf-4246-8e1e-9584787f4024 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.759558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fae742b-eebf-4246-8e1e-9584787f4024 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.765055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fae742b-eebf-4246-8e1e-9584787f4024 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.766467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fae742b-eebf-4246-8e1e-9584787f4024 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.769213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4fae742b-eebf-4246-8e1e-9584787f4024 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.919895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-4fae742b-eebf-4246-8e1e-9584787f4024 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lazy-loading 'flavor' on Instance uuid 2e03e5d6-756e-4532-9b5e-e8bdd38865ef {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:26:10.103149 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4fae742b-eebf-4246-8e1e-9584787f4024 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef/action" status: 200 len: 32 microversion: 2.1 time: 0.399430 Aug 27 05:26:10.103875 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2901/5796] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:09 2022] POST /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef/action => generated 32 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:26:10.118913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-326793e4-6d58-4035-a3d5-4ef86202a90c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:10.120247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-326793e4-6d58-4035-a3d5-4ef86202a90c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:10.135803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-326793e4-6d58-4035-a3d5-4ef86202a90c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:10.136801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-326793e4-6d58-4035-a3d5-4ef86202a90c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:10.137544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-326793e4-6d58-4035-a3d5-4ef86202a90c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:10.138850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-326793e4-6d58-4035-a3d5-4ef86202a90c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:10.139809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-326793e4-6d58-4035-a3d5-4ef86202a90c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:10.140826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-326793e4-6d58-4035-a3d5-4ef86202a90c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:10.720361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5577e8f4-ea53-44da-b9ab-3023ab951778 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:10.733531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-326793e4-6d58-4035-a3d5-4ef86202a90c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:10.734257 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5577e8f4-ea53-44da-b9ab-3023ab951778 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 1.117860 Aug 27 05:26:10.735384 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2896/5797] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:09 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:10.764674 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-326793e4-6d58-4035-a3d5-4ef86202a90c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.652046 Aug 27 05:26:10.766037 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2902/5798] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:10 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:10.794782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5058602-a763-43a5-b4ca-66c1782ae8d4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:10.795675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e5058602-a763-43a5-b4ca-66c1782ae8d4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: f796f06e-83cf-4f9e-9500-5fff879fdc75] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:10.813770 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-e5058602-a763-43a5-b4ca-66c1782ae8d4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance f796f06e-83cf-4f9e-9500-5fff879fdc75 could not be found. Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5058602-a763-43a5-b4ca-66c1782ae8d4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/f796f06e-83cf-4f9e-9500-5fff879fdc75/action HTTP/1.1 Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 14 Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: {"resume": {}} Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance f796f06e-83cf-4f9e-9500-5fff879fdc75 could not be found. Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'f796f06e-83cf-4f9e-9500-5fff879fdc75', 'body': {'resume': {}}} Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f796f06e-83cf-4f9e-9500-5fff879fdc75 could not be found. Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f796f06e-83cf-4f9e-9500-5fff879fdc75 could not be found. Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:10.823119 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:10.831916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:10.831916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:10.831916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f796f06e-83cf-4f9e-9500-5fff879fdc75 could not be found. Aug 27 05:26:10.831916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.831916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5058602-a763-43a5-b4ca-66c1782ae8d4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance f796f06e-83cf-4f9e-9500-5fff879fdc75 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:10.831916 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e5058602-a763-43a5-b4ca-66c1782ae8d4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/f796f06e-83cf-4f9e-9500-5fff879fdc75/action" status: 404 len: 111 microversion: 2.1 time: 0.034904 Aug 27 05:26:10.831916 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2897/5799] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:10 2022] POST /compute/v2.1/servers/f796f06e-83cf-4f9e-9500-5fff879fdc75/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:26:10.842031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-590bcf32-4ae4-463e-a704-10c98d85d4e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:10.843326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-590bcf32-4ae4-463e-a704-10c98d85d4e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:10.859817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-590bcf32-4ae4-463e-a704-10c98d85d4e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:10.860155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-590bcf32-4ae4-463e-a704-10c98d85d4e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:10.861349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-590bcf32-4ae4-463e-a704-10c98d85d4e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:10.863186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-590bcf32-4ae4-463e-a704-10c98d85d4e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:10.864857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-590bcf32-4ae4-463e-a704-10c98d85d4e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:10.866222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-590bcf32-4ae4-463e-a704-10c98d85d4e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:11.040181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c77a4ed-aa81-45af-85f1-67a4363cd80e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd82a6bd-176f-47df-ae68-e5fa0571446d"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:11.047665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c77a4ed-aa81-45af-85f1-67a4363cd80e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:11.063265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c77a4ed-aa81-45af-85f1-67a4363cd80e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:11.069935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c77a4ed-aa81-45af-85f1-67a4363cd80e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:11.070964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c77a4ed-aa81-45af-85f1-67a4363cd80e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:11.072668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c77a4ed-aa81-45af-85f1-67a4363cd80e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:11.073684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c77a4ed-aa81-45af-85f1-67a4363cd80e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:11.074648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c77a4ed-aa81-45af-85f1-67a4363cd80e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:11.231281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-590bcf32-4ae4-463e-a704-10c98d85d4e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:11.262581 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-590bcf32-4ae4-463e-a704-10c98d85d4e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.428550 Aug 27 05:26:11.263758 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2903/5800] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:10 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:11.286914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6c253196-4eda-4667-b104-cccbe3a2f82b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:11.288048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6c253196-4eda-4667-b104-cccbe3a2f82b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:11.296824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c253196-4eda-4667-b104-cccbe3a2f82b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:11.297735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c253196-4eda-4667-b104-cccbe3a2f82b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:11.298595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c253196-4eda-4667-b104-cccbe3a2f82b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:11.299791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c253196-4eda-4667-b104-cccbe3a2f82b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:11.300557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c253196-4eda-4667-b104-cccbe3a2f82b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:11.301243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c253196-4eda-4667-b104-cccbe3a2f82b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:11.519659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6c253196-4eda-4667-b104-cccbe3a2f82b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:11.540005 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6c253196-4eda-4667-b104-cccbe3a2f82b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.257744 Aug 27 05:26:11.542003 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2904/5801] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:11 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:11.595386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:11.598055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:11.620362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:11.622346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:11.635176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:11.637103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:11.638088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:11.639239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:11.691890 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Cannot 'resume' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action HTTP/1.1 Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 14 Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: {"resume": {}} Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: exception: Cannot 'resume' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '64999ba4-bbd9-4d23-9a4c-0caf8eb677b4', 'body': {'resume': {}}} Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 in vm_state active. Cannot resume while the instance is in this state. Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:11.696136 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:11.704664 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:11.704664 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:11.704664 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:11.704664 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:11.704664 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:11.704664 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:26:11.704664 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:11.704664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 409 to user: Cannot 'resume' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:11.704664 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d40d850a-a138-4e9a-948f-e6dcdf258330 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 409 len: 144 microversion: 2.1 time: 0.115845 Aug 27 05:26:11.704664 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2905/5802] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:11 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 144 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:26:11.713212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5f2bac2-3c17-492c-bfdf-6fa6304ce280 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:11.726557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b5f2bac2-3c17-492c-bfdf-6fa6304ce280 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:11.736280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f2bac2-3c17-492c-bfdf-6fa6304ce280 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:11.737202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f2bac2-3c17-492c-bfdf-6fa6304ce280 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:11.737202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f2bac2-3c17-492c-bfdf-6fa6304ce280 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:11.737941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f2bac2-3c17-492c-bfdf-6fa6304ce280 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:11.738622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f2bac2-3c17-492c-bfdf-6fa6304ce280 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:11.739181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f2bac2-3c17-492c-bfdf-6fa6304ce280 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:11.767237 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c77a4ed-aa81-45af-85f1-67a4363cd80e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.734746 Aug 27 05:26:11.777033 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2898/5803] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:26:11 2022] POST /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments => generated 194 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:11.798576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8b7fd25-8cdc-42ac-99e1-99a79d9b3440 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:11.799323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8b7fd25-8cdc-42ac-99e1-99a79d9b3440 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:11.813564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8b7fd25-8cdc-42ac-99e1-99a79d9b3440 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:11.814289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8b7fd25-8cdc-42ac-99e1-99a79d9b3440 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:11.815060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8b7fd25-8cdc-42ac-99e1-99a79d9b3440 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:11.816856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8b7fd25-8cdc-42ac-99e1-99a79d9b3440 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:11.817515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8b7fd25-8cdc-42ac-99e1-99a79d9b3440 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:11.818502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8b7fd25-8cdc-42ac-99e1-99a79d9b3440 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:12.167859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5f2bac2-3c17-492c-bfdf-6fa6304ce280 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:12.176338 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5f2bac2-3c17-492c-bfdf-6fa6304ce280 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.470373 Aug 27 05:26:12.176935 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2906/5804] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:11 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:12.205069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-871f1621-d873-4c6c-a4ca-eeada8bd4d5c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:12.205742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-871f1621-d873-4c6c-a4ca-eeada8bd4d5c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:12.214623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-871f1621-d873-4c6c-a4ca-eeada8bd4d5c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:12.215227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-871f1621-d873-4c6c-a4ca-eeada8bd4d5c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:12.215971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-871f1621-d873-4c6c-a4ca-eeada8bd4d5c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:12.217209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-871f1621-d873-4c6c-a4ca-eeada8bd4d5c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:12.223896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-871f1621-d873-4c6c-a4ca-eeada8bd4d5c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:12.226704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-871f1621-d873-4c6c-a4ca-eeada8bd4d5c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:12.294156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d8b7fd25-8cdc-42ac-99e1-99a79d9b3440 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:12.309363 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8b7fd25-8cdc-42ac-99e1-99a79d9b3440 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.513729 Aug 27 05:26:12.312597 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2899/5805] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:11 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:12.663326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-871f1621-d873-4c6c-a4ca-eeada8bd4d5c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:12.680868 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-871f1621-d873-4c6c-a4ca-eeada8bd4d5c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.480330 Aug 27 05:26:12.682760 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2907/5806] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:12 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:12.750282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a93474b4-965e-45ee-b2ca-5dc3d08541cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a93474b4-965e-45ee-b2ca-5dc3d08541cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 160 Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "7906d3ee-5380-4aa1-a43a-a0d97ee78a9e"}]}} Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'body': {'server': {'name': '', 'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f', 'flavorRef': '452', 'networks': [{'uuid': '7906d3ee-5380-4aa1-a43a-a0d97ee78a9e'}]}}} Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi '' Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:26:12.759630 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a93474b4-965e-45ee-b2ca-5dc3d08541cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a93474b4-965e-45ee-b2ca-5dc3d08541cb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.019327 Aug 27 05:26:12.773157 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2900/5807] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:26:12 2022] POST /compute/v2.1/servers => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:26:12.776646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a9a601bb-f781-4c34-81e1-56f6b21afac0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:12.776646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a9a601bb-f781-4c34-81e1-56f6b21afac0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:12.821963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a601bb-f781-4c34-81e1-56f6b21afac0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:12.822481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a601bb-f781-4c34-81e1-56f6b21afac0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:12.822929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a601bb-f781-4c34-81e1-56f6b21afac0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:12.823696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a601bb-f781-4c34-81e1-56f6b21afac0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:12.824154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a601bb-f781-4c34-81e1-56f6b21afac0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:12.824584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a601bb-f781-4c34-81e1-56f6b21afac0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:13.105577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a9a601bb-f781-4c34-81e1-56f6b21afac0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:13.120848 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a9a601bb-f781-4c34-81e1-56f6b21afac0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.353330 Aug 27 05:26:13.132236 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2908/5808] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:12 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:13.161839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7693077d-b172-415b-a0c8-64893b386f2b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:13.163898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7693077d-b172-415b-a0c8-64893b386f2b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:13.177509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7693077d-b172-415b-a0c8-64893b386f2b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:13.179407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7693077d-b172-415b-a0c8-64893b386f2b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:13.180485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7693077d-b172-415b-a0c8-64893b386f2b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:13.182078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7693077d-b172-415b-a0c8-64893b386f2b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:13.184094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7693077d-b172-415b-a0c8-64893b386f2b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:13.186155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7693077d-b172-415b-a0c8-64893b386f2b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:13.233899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:13.342181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0fd856ee-4d62-431d-8299-0758fc11b3e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:13.346811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0fd856ee-4d62-431d-8299-0758fc11b3e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:13.378671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fd856ee-4d62-431d-8299-0758fc11b3e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:13.379298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fd856ee-4d62-431d-8299-0758fc11b3e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:13.382274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fd856ee-4d62-431d-8299-0758fc11b3e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:13.383803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fd856ee-4d62-431d-8299-0758fc11b3e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:13.384450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fd856ee-4d62-431d-8299-0758fc11b3e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:13.385328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0fd856ee-4d62-431d-8299-0758fc11b3e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:13.493001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7693077d-b172-415b-a0c8-64893b386f2b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:13.515322 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7693077d-b172-415b-a0c8-64893b386f2b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.360723 Aug 27 05:26:13.517543 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2901/5809] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:13 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:13.555142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-949f1577-c632-4d93-ad65-872985d8dc13 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:13.556124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-949f1577-c632-4d93-ad65-872985d8dc13 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: a8a74e7a-fceb-4daf-854a-5e0a869ce284] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:13.582093 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-949f1577-c632-4d93-ad65-872985d8dc13 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance a8a74e7a-fceb-4daf-854a-5e0a869ce284 could not be found. Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-949f1577-c632-4d93-ad65-872985d8dc13 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/a8a74e7a-fceb-4daf-854a-5e0a869ce284/action HTTP/1.1 Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 14 Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: {"shelve": {}} Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance a8a74e7a-fceb-4daf-854a-5e0a869ce284 could not be found. Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'a8a74e7a-fceb-4daf-854a-5e0a869ce284', 'body': {'shelve': {}}} Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a74e7a-fceb-4daf-854a-5e0a869ce284 could not be found. Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a74e7a-fceb-4daf-854a-5e0a869ce284 could not be found. Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:13.594981 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:13.603551 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:13.603551 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:13.603551 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a74e7a-fceb-4daf-854a-5e0a869ce284 could not be found. Aug 27 05:26:13.603551 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:13.605309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-949f1577-c632-4d93-ad65-872985d8dc13 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance a8a74e7a-fceb-4daf-854a-5e0a869ce284 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:13.606904 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-949f1577-c632-4d93-ad65-872985d8dc13 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/a8a74e7a-fceb-4daf-854a-5e0a869ce284/action" status: 404 len: 111 microversion: 2.1 time: 0.058738 Aug 27 05:26:13.623243 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2902/5810] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:13 2022] POST /compute/v2.1/servers/a8a74e7a-fceb-4daf-854a-5e0a869ce284/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:26:13.640964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e39f3de9-da81-4839-99c5-207c0e268c7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:13.642471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e39f3de9-da81-4839-99c5-207c0e268c7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:13.658621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e39f3de9-da81-4839-99c5-207c0e268c7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:13.662200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e39f3de9-da81-4839-99c5-207c0e268c7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:13.666175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e39f3de9-da81-4839-99c5-207c0e268c7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:13.667292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e39f3de9-da81-4839-99c5-207c0e268c7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:13.667941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e39f3de9-da81-4839-99c5-207c0e268c7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:13.668579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e39f3de9-da81-4839-99c5-207c0e268c7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:13.791656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0fd856ee-4d62-431d-8299-0758fc11b3e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:13.837989 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0fd856ee-4d62-431d-8299-0758fc11b3e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.495696 Aug 27 05:26:13.843342 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2909/5811] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:13 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:13.926734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e39f3de9-da81-4839-99c5-207c0e268c7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:13.937395 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e39f3de9-da81-4839-99c5-207c0e268c7d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.312051 Aug 27 05:26:13.955876 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2903/5812] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:13 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:13.973513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-38554b96-5bcf-43a3-9ef8-77398434f715 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:13.974571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-38554b96-5bcf-43a3-9ef8-77398434f715 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:13.983210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38554b96-5bcf-43a3-9ef8-77398434f715 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:13.984033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38554b96-5bcf-43a3-9ef8-77398434f715 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:13.984692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38554b96-5bcf-43a3-9ef8-77398434f715 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:13.985612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38554b96-5bcf-43a3-9ef8-77398434f715 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:13.986477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38554b96-5bcf-43a3-9ef8-77398434f715 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:13.987150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38554b96-5bcf-43a3-9ef8-77398434f715 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:14.022860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:14.422030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-38554b96-5bcf-43a3-9ef8-77398434f715 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:14.445303 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-38554b96-5bcf-43a3-9ef8-77398434f715 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.475688 Aug 27 05:26:14.487737 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2910/5813] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:13 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:14.493815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-991dc87b-25b9-496c-a684-fa931525b37d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:14.495418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-991dc87b-25b9-496c-a684-fa931525b37d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:14.509678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-991dc87b-25b9-496c-a684-fa931525b37d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:14.514124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-991dc87b-25b9-496c-a684-fa931525b37d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:14.517555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-991dc87b-25b9-496c-a684-fa931525b37d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:14.519263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-991dc87b-25b9-496c-a684-fa931525b37d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:14.519764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-991dc87b-25b9-496c-a684-fa931525b37d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:14.526435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-991dc87b-25b9-496c-a684-fa931525b37d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:14.622792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-991dc87b-25b9-496c-a684-fa931525b37d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lazy-loading 'flavor' on Instance uuid 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:26:14.863054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-86a08956-12b5-4bd8-8a86-b7bb6f0ab737 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:14.863968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-86a08956-12b5-4bd8-8a86-b7bb6f0ab737 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:14.877019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a08956-12b5-4bd8-8a86-b7bb6f0ab737 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:14.877529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a08956-12b5-4bd8-8a86-b7bb6f0ab737 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:14.879310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a08956-12b5-4bd8-8a86-b7bb6f0ab737 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:14.882921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a08956-12b5-4bd8-8a86-b7bb6f0ab737 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:14.883883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a08956-12b5-4bd8-8a86-b7bb6f0ab737 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:14.884574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a08956-12b5-4bd8-8a86-b7bb6f0ab737 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:15.073197 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-991dc87b-25b9-496c-a684-fa931525b37d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 202 len: 0 microversion: 2.1 time: 0.577741 Aug 27 05:26:15.079250 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2904/5814] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:14 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:26:15.103240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e10413fa-e321-4049-a5c5-b76b00f77b91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:15.105458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e10413fa-e321-4049-a5c5-b76b00f77b91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:15.154378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10413fa-e321-4049-a5c5-b76b00f77b91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:15.154962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10413fa-e321-4049-a5c5-b76b00f77b91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:15.158444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10413fa-e321-4049-a5c5-b76b00f77b91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:15.161036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10413fa-e321-4049-a5c5-b76b00f77b91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:15.161778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10413fa-e321-4049-a5c5-b76b00f77b91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:15.162511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e10413fa-e321-4049-a5c5-b76b00f77b91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:15.469256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86a08956-12b5-4bd8-8a86-b7bb6f0ab737 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:15.492404 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-86a08956-12b5-4bd8-8a86-b7bb6f0ab737 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.633128 Aug 27 05:26:15.508302 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2911/5815] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:14 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:15.544506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e10413fa-e321-4049-a5c5-b76b00f77b91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:15.562962 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e10413fa-e321-4049-a5c5-b76b00f77b91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.480664 Aug 27 05:26:15.565973 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2905/5816] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:15 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:16.533040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bfd5f4aa-03f5-4421-8248-40bbe61d846a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:16.534269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bfd5f4aa-03f5-4421-8248-40bbe61d846a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:16.542125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfd5f4aa-03f5-4421-8248-40bbe61d846a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:16.542671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfd5f4aa-03f5-4421-8248-40bbe61d846a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:16.542937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfd5f4aa-03f5-4421-8248-40bbe61d846a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:16.543981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfd5f4aa-03f5-4421-8248-40bbe61d846a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:16.544603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfd5f4aa-03f5-4421-8248-40bbe61d846a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:16.545213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfd5f4aa-03f5-4421-8248-40bbe61d846a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:16.593742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c28fe68e-f465-4ce4-bba0-f19c3daff761 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:16.594896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c28fe68e-f465-4ce4-bba0-f19c3daff761 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:16.623037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c28fe68e-f465-4ce4-bba0-f19c3daff761 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:16.623964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c28fe68e-f465-4ce4-bba0-f19c3daff761 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:16.624752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c28fe68e-f465-4ce4-bba0-f19c3daff761 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:16.634367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c28fe68e-f465-4ce4-bba0-f19c3daff761 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:16.642333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c28fe68e-f465-4ce4-bba0-f19c3daff761 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:16.643404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c28fe68e-f465-4ce4-bba0-f19c3daff761 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:17.014761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bfd5f4aa-03f5-4421-8248-40bbe61d846a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:17.026617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c28fe68e-f465-4ce4-bba0-f19c3daff761 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:17.034721 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c28fe68e-f465-4ce4-bba0-f19c3daff761 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.448874 Aug 27 05:26:17.035958 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2906/5817] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:16 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:17.039456 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bfd5f4aa-03f5-4421-8248-40bbe61d846a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.510215 Aug 27 05:26:17.040215 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2912/5818] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:16 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:18.057119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5f6ca20e-9223-4a61-a6bc-10ced074a75b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:18.057948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5f6ca20e-9223-4a61-a6bc-10ced074a75b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:18.069520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-256cd6b4-0151-4c58-9de0-aeafcc915690 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:18.070405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-256cd6b4-0151-4c58-9de0-aeafcc915690 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:18.084433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f6ca20e-9223-4a61-a6bc-10ced074a75b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:18.085029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f6ca20e-9223-4a61-a6bc-10ced074a75b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:18.085476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f6ca20e-9223-4a61-a6bc-10ced074a75b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:18.086202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f6ca20e-9223-4a61-a6bc-10ced074a75b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:18.086660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f6ca20e-9223-4a61-a6bc-10ced074a75b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:18.087082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5f6ca20e-9223-4a61-a6bc-10ced074a75b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:18.088303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-256cd6b4-0151-4c58-9de0-aeafcc915690 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:18.091281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-256cd6b4-0151-4c58-9de0-aeafcc915690 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:18.092259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-256cd6b4-0151-4c58-9de0-aeafcc915690 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:18.095569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-256cd6b4-0151-4c58-9de0-aeafcc915690 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:18.096905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-256cd6b4-0151-4c58-9de0-aeafcc915690 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:18.097986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-256cd6b4-0151-4c58-9de0-aeafcc915690 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:18.307006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5f6ca20e-9223-4a61-a6bc-10ced074a75b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:18.319824 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5f6ca20e-9223-4a61-a6bc-10ced074a75b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.266982 Aug 27 05:26:18.335500 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2907/5819] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:18 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:18.357447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-256cd6b4-0151-4c58-9de0-aeafcc915690 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:18.366320 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-256cd6b4-0151-4c58-9de0-aeafcc915690 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.300757 Aug 27 05:26:18.366910 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2913/5820] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:18 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:19.344474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6d24c6fc-57ff-4de1-ba2c-e860c6ed428d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:19.345728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6d24c6fc-57ff-4de1-ba2c-e860c6ed428d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:19.354238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d24c6fc-57ff-4de1-ba2c-e860c6ed428d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:19.354774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d24c6fc-57ff-4de1-ba2c-e860c6ed428d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:19.355287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d24c6fc-57ff-4de1-ba2c-e860c6ed428d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:19.356033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d24c6fc-57ff-4de1-ba2c-e860c6ed428d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:19.356552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d24c6fc-57ff-4de1-ba2c-e860c6ed428d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:19.356974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6d24c6fc-57ff-4de1-ba2c-e860c6ed428d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:19.396388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a439baa3-b49e-443c-a637-5370ee86cd4a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:19.411196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a439baa3-b49e-443c-a637-5370ee86cd4a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:19.436855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a439baa3-b49e-443c-a637-5370ee86cd4a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:19.438100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a439baa3-b49e-443c-a637-5370ee86cd4a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:19.439505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a439baa3-b49e-443c-a637-5370ee86cd4a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:19.442559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a439baa3-b49e-443c-a637-5370ee86cd4a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:19.445702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a439baa3-b49e-443c-a637-5370ee86cd4a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:19.447005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a439baa3-b49e-443c-a637-5370ee86cd4a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:19.649169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6d24c6fc-57ff-4de1-ba2c-e860c6ed428d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:19.682026 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6d24c6fc-57ff-4de1-ba2c-e860c6ed428d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.337363 Aug 27 05:26:19.683189 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2908/5821] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:19 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:19.821699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a439baa3-b49e-443c-a637-5370ee86cd4a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:19.837939 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a439baa3-b49e-443c-a637-5370ee86cd4a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.451587 Aug 27 05:26:19.851202 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2914/5822] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:19 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:20.703807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aa9ddfba-e55b-43e3-a0f4-edce9b2aae98 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:20.704444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aa9ddfba-e55b-43e3-a0f4-edce9b2aae98 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:20.712375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa9ddfba-e55b-43e3-a0f4-edce9b2aae98 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:20.713009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa9ddfba-e55b-43e3-a0f4-edce9b2aae98 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:20.713544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa9ddfba-e55b-43e3-a0f4-edce9b2aae98 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:20.714571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa9ddfba-e55b-43e3-a0f4-edce9b2aae98 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:20.715168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa9ddfba-e55b-43e3-a0f4-edce9b2aae98 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:20.716052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aa9ddfba-e55b-43e3-a0f4-edce9b2aae98 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:20.867551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d974d92-6188-4d0d-aa05-e9432f63a107 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:20.869321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d974d92-6188-4d0d-aa05-e9432f63a107 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:20.879388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d974d92-6188-4d0d-aa05-e9432f63a107 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:20.880061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d974d92-6188-4d0d-aa05-e9432f63a107 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:20.880999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d974d92-6188-4d0d-aa05-e9432f63a107 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:20.881852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d974d92-6188-4d0d-aa05-e9432f63a107 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:20.882548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d974d92-6188-4d0d-aa05-e9432f63a107 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:20.883247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d974d92-6188-4d0d-aa05-e9432f63a107 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:20.898982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aa9ddfba-e55b-43e3-a0f4-edce9b2aae98 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:20.913311 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aa9ddfba-e55b-43e3-a0f4-edce9b2aae98 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.212996 Aug 27 05:26:20.914710 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2909/5823] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:20 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:21.076989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d974d92-6188-4d0d-aa05-e9432f63a107 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:21.090097 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d974d92-6188-4d0d-aa05-e9432f63a107 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.230457 Aug 27 05:26:21.104972 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2915/5824] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:20 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:21.151944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-165228692", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:21.217892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:26:21.527677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:26:21.528108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:26:21.528603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:26:21.529015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:26:21.529437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:26:21.539591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:21.540071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:21.540507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:21.541259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:21.542167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:21.542167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:21.563007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Getting quotas for project 7bd389e577244b3fae5134f269e9582b. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:26:21.568583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Getting quotas for user 513aeed198ce433aa9c04131147ceca0 and project 7bd389e577244b3fae5134f269e9582b. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:26:21.583660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:26:21.586006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:26:21.666414 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-114f1819-016b-4fec-b473-6a7147ee1c2c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519591 Aug 27 05:26:21.667135 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2910/5825] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:26:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:26:21.678626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dbc11516-fefa-415f-a5e8-292999790ac2 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:21.679282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dbc11516-fefa-415f-a5e8-292999790ac2 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:21.746541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dbc11516-fefa-415f-a5e8-292999790ac2 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:21.758910 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dbc11516-fefa-415f-a5e8-292999790ac2 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1213 microversion: 2.1 time: 0.084313 Aug 27 05:26:21.759921 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2916/5826] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:21 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:21.938697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-53c19fa5-4531-4fd5-91e7-2857b057847e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:21.939397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-53c19fa5-4531-4fd5-91e7-2857b057847e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:21.947308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53c19fa5-4531-4fd5-91e7-2857b057847e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:21.947807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53c19fa5-4531-4fd5-91e7-2857b057847e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:21.948260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53c19fa5-4531-4fd5-91e7-2857b057847e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:21.948968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53c19fa5-4531-4fd5-91e7-2857b057847e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:21.949426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53c19fa5-4531-4fd5-91e7-2857b057847e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:21.949884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53c19fa5-4531-4fd5-91e7-2857b057847e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:22.126275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3852664d-9fef-4a2a-9445-4ff989fec5b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:22.127645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3852664d-9fef-4a2a-9445-4ff989fec5b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:22.129082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-53c19fa5-4531-4fd5-91e7-2857b057847e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:22.139439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3852664d-9fef-4a2a-9445-4ff989fec5b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:22.140266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3852664d-9fef-4a2a-9445-4ff989fec5b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:22.141314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3852664d-9fef-4a2a-9445-4ff989fec5b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:22.142465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3852664d-9fef-4a2a-9445-4ff989fec5b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:22.143387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3852664d-9fef-4a2a-9445-4ff989fec5b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:22.144113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3852664d-9fef-4a2a-9445-4ff989fec5b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:22.144293 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-53c19fa5-4531-4fd5-91e7-2857b057847e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.209118 Aug 27 05:26:22.154200 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2911/5827] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:21 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:22.346173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3852664d-9fef-4a2a-9445-4ff989fec5b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:22.359469 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3852664d-9fef-4a2a-9445-4ff989fec5b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.240563 Aug 27 05:26:22.372021 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2917/5828] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:22 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:22.793822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fa60c930-9eb6-42ee-8724-f3643725f34e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:22.794562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fa60c930-9eb6-42ee-8724-f3643725f34e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:22.801389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa60c930-9eb6-42ee-8724-f3643725f34e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:22.802005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa60c930-9eb6-42ee-8724-f3643725f34e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:22.803194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa60c930-9eb6-42ee-8724-f3643725f34e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:22.804128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa60c930-9eb6-42ee-8724-f3643725f34e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:22.804792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa60c930-9eb6-42ee-8724-f3643725f34e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:22.805329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa60c930-9eb6-42ee-8724-f3643725f34e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:22.870952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fa60c930-9eb6-42ee-8724-f3643725f34e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:22.879001 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fa60c930-9eb6-42ee-8724-f3643725f34e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1265 microversion: 2.1 time: 0.091748 Aug 27 05:26:22.879610 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2912/5829] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:22 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:23.178830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-05d386dc-fc56-4b60-bb11-847038ef59d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:23.179847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-05d386dc-fc56-4b60-bb11-847038ef59d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:23.193681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d386dc-fc56-4b60-bb11-847038ef59d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:23.194535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d386dc-fc56-4b60-bb11-847038ef59d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:23.195321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d386dc-fc56-4b60-bb11-847038ef59d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:23.196515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d386dc-fc56-4b60-bb11-847038ef59d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:23.197264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d386dc-fc56-4b60-bb11-847038ef59d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:23.198260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05d386dc-fc56-4b60-bb11-847038ef59d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:23.391486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-05d386dc-fc56-4b60-bb11-847038ef59d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:23.399173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-afc27b28-c448-44b5-b9c5-294d1f4c9c12 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:23.400035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-afc27b28-c448-44b5-b9c5-294d1f4c9c12 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:23.406298 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-05d386dc-fc56-4b60-bb11-847038ef59d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.235443 Aug 27 05:26:23.407343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc27b28-c448-44b5-b9c5-294d1f4c9c12 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:23.407744 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2918/5830] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:23 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:23.408200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc27b28-c448-44b5-b9c5-294d1f4c9c12 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:23.408766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc27b28-c448-44b5-b9c5-294d1f4c9c12 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:23.409606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc27b28-c448-44b5-b9c5-294d1f4c9c12 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:23.410202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc27b28-c448-44b5-b9c5-294d1f4c9c12 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:23.410707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc27b28-c448-44b5-b9c5-294d1f4c9c12 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:23.597086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-afc27b28-c448-44b5-b9c5-294d1f4c9c12 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:23.610090 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-afc27b28-c448-44b5-b9c5-294d1f4c9c12 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.224401 Aug 27 05:26:23.610696 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2913/5831] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:23 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:23.900969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2776448e-e936-4263-b078-15c4c54a8ce9 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:23.901598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2776448e-e936-4263-b078-15c4c54a8ce9 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:23.909544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2776448e-e936-4263-b078-15c4c54a8ce9 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:23.910048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2776448e-e936-4263-b078-15c4c54a8ce9 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:23.910492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2776448e-e936-4263-b078-15c4c54a8ce9 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:23.911260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2776448e-e936-4263-b078-15c4c54a8ce9 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:23.911725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2776448e-e936-4263-b078-15c4c54a8ce9 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:23.912208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2776448e-e936-4263-b078-15c4c54a8ce9 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:23.984801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2776448e-e936-4263-b078-15c4c54a8ce9 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:23.997014 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2776448e-e936-4263-b078-15c4c54a8ce9 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1271 microversion: 2.1 time: 0.099984 Aug 27 05:26:23.997653 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2919/5832] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:23 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:24.432240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b2cd2787-e3db-441b-9789-7a0290fb7e7f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:24.433817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b2cd2787-e3db-441b-9789-7a0290fb7e7f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:24.449348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2cd2787-e3db-441b-9789-7a0290fb7e7f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:24.450207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2cd2787-e3db-441b-9789-7a0290fb7e7f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:24.450963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2cd2787-e3db-441b-9789-7a0290fb7e7f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:24.453049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2cd2787-e3db-441b-9789-7a0290fb7e7f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:24.453787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2cd2787-e3db-441b-9789-7a0290fb7e7f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:24.454501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2cd2787-e3db-441b-9789-7a0290fb7e7f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:24.641335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-97682cb5-84c4-4482-989f-132fd7e41f2b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:24.642885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-97682cb5-84c4-4482-989f-132fd7e41f2b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:24.657924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97682cb5-84c4-4482-989f-132fd7e41f2b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:24.659038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97682cb5-84c4-4482-989f-132fd7e41f2b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:24.659804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97682cb5-84c4-4482-989f-132fd7e41f2b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:24.661482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97682cb5-84c4-4482-989f-132fd7e41f2b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:24.664919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97682cb5-84c4-4482-989f-132fd7e41f2b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:24.665896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97682cb5-84c4-4482-989f-132fd7e41f2b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:24.713611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b2cd2787-e3db-441b-9789-7a0290fb7e7f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:24.729657 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b2cd2787-e3db-441b-9789-7a0290fb7e7f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.302997 Aug 27 05:26:24.731159 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2914/5833] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:24 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:24.944242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-97682cb5-84c4-4482-989f-132fd7e41f2b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:24.955500 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-97682cb5-84c4-4482-989f-132fd7e41f2b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.325146 Aug 27 05:26:24.956192 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2920/5834] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:24 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:25.023812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-19418e9b-b8d4-44b3-b94d-669eb020c977 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:25.024663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-19418e9b-b8d4-44b3-b94d-669eb020c977 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:25.035673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19418e9b-b8d4-44b3-b94d-669eb020c977 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:25.037624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19418e9b-b8d4-44b3-b94d-669eb020c977 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:25.039409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19418e9b-b8d4-44b3-b94d-669eb020c977 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:25.041725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19418e9b-b8d4-44b3-b94d-669eb020c977 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:25.042825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19418e9b-b8d4-44b3-b94d-669eb020c977 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:25.043848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19418e9b-b8d4-44b3-b94d-669eb020c977 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:25.259871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-19418e9b-b8d4-44b3-b94d-669eb020c977 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:25.273010 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-19418e9b-b8d4-44b3-b94d-669eb020c977 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1313 microversion: 2.1 time: 0.256750 Aug 27 05:26:25.274284 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2915/5835] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:25 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:25.509394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-31e6f478-1241-422d-b37a-3c96f2150f99 req-be11e1fa-8635-4f4e-9c01-fe20b270aabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f8027a-674b-4177-a4d4-142882d951f2", "tag": "0ae50be4-4489-44b4-ac20-ce1d211d31ba"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:25.520277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-31e6f478-1241-422d-b37a-3c96f2150f99 req-be11e1fa-8635-4f4e-9c01-fe20b270aabd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:25.521219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-31e6f478-1241-422d-b37a-3c96f2150f99 req-be11e1fa-8635-4f4e-9c01-fe20b270aabd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:25.521697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-31e6f478-1241-422d-b37a-3c96f2150f99 req-be11e1fa-8635-4f4e-9c01-fe20b270aabd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:25.534144 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-31e6f478-1241-422d-b37a-3c96f2150f99 req-be11e1fa-8635-4f4e-9c01-fe20b270aabd service nova] Creating event network-changed:0ae50be4-4489-44b4-ac20-ce1d211d31ba for instance 83f8027a-674b-4177-a4d4-142882d951f2 on n-h2-820368-35 Aug 27 05:26:25.540775 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-31e6f478-1241-422d-b37a-3c96f2150f99 req-be11e1fa-8635-4f4e-9c01-fe20b270aabd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038019 Aug 27 05:26:25.541847 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2921/5836] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:25.763782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-efab522e-fca7-44c1-998b-292878a7f329 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:25.765499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-efab522e-fca7-44c1-998b-292878a7f329 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:25.777267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efab522e-fca7-44c1-998b-292878a7f329 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:25.778335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efab522e-fca7-44c1-998b-292878a7f329 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:25.779266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efab522e-fca7-44c1-998b-292878a7f329 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:25.780237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efab522e-fca7-44c1-998b-292878a7f329 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:25.781240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efab522e-fca7-44c1-998b-292878a7f329 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:25.781962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efab522e-fca7-44c1-998b-292878a7f329 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:25.969610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-efab522e-fca7-44c1-998b-292878a7f329 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:25.979738 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-efab522e-fca7-44c1-998b-292878a7f329 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.222201 Aug 27 05:26:25.980727 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2916/5837] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:25 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:25.997658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-990a7fb6-eee2-426b-9168-36db894825d2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:25.999228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-990a7fb6-eee2-426b-9168-36db894825d2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:26.008149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-990a7fb6-eee2-426b-9168-36db894825d2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:26.008643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-990a7fb6-eee2-426b-9168-36db894825d2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:26.009078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-990a7fb6-eee2-426b-9168-36db894825d2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:26.011470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-990a7fb6-eee2-426b-9168-36db894825d2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:26.011470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-990a7fb6-eee2-426b-9168-36db894825d2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:26.011470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-990a7fb6-eee2-426b-9168-36db894825d2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:26.211106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-990a7fb6-eee2-426b-9168-36db894825d2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:26.223680 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-990a7fb6-eee2-426b-9168-36db894825d2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.242134 Aug 27 05:26:26.226246 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2922/5838] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:25 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:26.307826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-853f12a1-e98d-42d4-9220-567d61d72a5c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:26.308533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-853f12a1-e98d-42d4-9220-567d61d72a5c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:26.319958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853f12a1-e98d-42d4-9220-567d61d72a5c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:26.320484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853f12a1-e98d-42d4-9220-567d61d72a5c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:26.320923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853f12a1-e98d-42d4-9220-567d61d72a5c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:26.321644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853f12a1-e98d-42d4-9220-567d61d72a5c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:26.322102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853f12a1-e98d-42d4-9220-567d61d72a5c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:26.322533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853f12a1-e98d-42d4-9220-567d61d72a5c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:26.498223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-853f12a1-e98d-42d4-9220-567d61d72a5c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:26.501146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:26.510073 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-853f12a1-e98d-42d4-9220-567d61d72a5c tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1313 microversion: 2.1 time: 0.208036 Aug 27 05:26:26.510750 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2917/5839] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:26 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:26.765952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd82a6bd-176f-47df-ae68-e5fa0571446d"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:26.770113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:26.781290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:26.782147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:26.782829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:26.784017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:26.784756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:26.785526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:26.894099 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Invalid volume: volume dd82a6bd-176f-47df-ae68-e5fa0571446d is already attached to instances: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments HTTP/1.1 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 74 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: {"volumeAttachment": {"volumeId": "dd82a6bd-176f-47df-ae68-e5fa0571446d"}} Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid volume: volume dd82a6bd-176f-47df-ae68-e5fa0571446d is already attached to instances: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'server_id': 'c1ccbd70-94c1-4f11-aca0-2d8d2afe8626', 'body': {'volumeAttachment': {'volumeId': 'dd82a6bd-176f-47df-ae68-e5fa0571446d'}}} Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dd82a6bd-176f-47df-ae68-e5fa0571446d is already attached to instances: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:26.897338 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dd82a6bd-176f-47df-ae68-e5fa0571446d is already attached to instances: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dd82a6bd-176f-47df-ae68-e5fa0571446d is already attached to instances: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 400 to user: Invalid volume: volume dd82a6bd-176f-47df-ae68-e5fa0571446d is already attached to instances: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-690559a1-53e7-415d-881f-b282aac38fd0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.140609 Aug 27 05:26:26.905832 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2923/5840] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:26:26 2022] POST /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments => generated 174 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:26:26.989616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-159a338c-26d6-4acb-bd66-da3d06461b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:26.990980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-159a338c-26d6-4acb-bd66-da3d06461b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:27.005237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-159a338c-26d6-4acb-bd66-da3d06461b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.006598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-159a338c-26d6-4acb-bd66-da3d06461b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.007129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-159a338c-26d6-4acb-bd66-da3d06461b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.008321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-159a338c-26d6-4acb-bd66-da3d06461b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.009102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-159a338c-26d6-4acb-bd66-da3d06461b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.009847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-159a338c-26d6-4acb-bd66-da3d06461b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.015660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0aa65e43-0bae-4572-86d9-3da02dc62d7b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:27.018293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0aa65e43-0bae-4572-86d9-3da02dc62d7b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:27.028783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aa65e43-0bae-4572-86d9-3da02dc62d7b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.029604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aa65e43-0bae-4572-86d9-3da02dc62d7b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.030426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aa65e43-0bae-4572-86d9-3da02dc62d7b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.031796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aa65e43-0bae-4572-86d9-3da02dc62d7b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.032724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aa65e43-0bae-4572-86d9-3da02dc62d7b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.033509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aa65e43-0bae-4572-86d9-3da02dc62d7b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.137929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-159a338c-26d6-4acb-bd66-da3d06461b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lazy-loading 'services' on Instance uuid c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:26:27.197168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0aa65e43-0bae-4572-86d9-3da02dc62d7b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:27.206478 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0aa65e43-0bae-4572-86d9-3da02dc62d7b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.198359 Aug 27 05:26:27.207492 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2924/5841] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:27 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:27.248666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-20321d3c-0891-4606-8c5d-09c38f5162a0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:27.249617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-20321d3c-0891-4606-8c5d-09c38f5162a0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:27.255371 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-159a338c-26d6-4acb-bd66-da3d06461b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments/dd82a6bd-176f-47df-ae68-e5fa0571446d" status: 202 len: 0 microversion: 2.1 time: 0.272745 Aug 27 05:26:27.257660 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2918/5842] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:26:26 2022] DELETE /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments/dd82a6bd-176f-47df-ae68-e5fa0571446d => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:26:27.258003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20321d3c-0891-4606-8c5d-09c38f5162a0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.258528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20321d3c-0891-4606-8c5d-09c38f5162a0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.259205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20321d3c-0891-4606-8c5d-09c38f5162a0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.260272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20321d3c-0891-4606-8c5d-09c38f5162a0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.260938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20321d3c-0891-4606-8c5d-09c38f5162a0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.261543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20321d3c-0891-4606-8c5d-09c38f5162a0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.273214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-de5258b0-24c3-48b5-af7a-48b9a71af83c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:27.275787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-de5258b0-24c3-48b5-af7a-48b9a71af83c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:27.283541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de5258b0-24c3-48b5-af7a-48b9a71af83c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.285048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de5258b0-24c3-48b5-af7a-48b9a71af83c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.286439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de5258b0-24c3-48b5-af7a-48b9a71af83c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.287452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de5258b0-24c3-48b5-af7a-48b9a71af83c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.288166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de5258b0-24c3-48b5-af7a-48b9a71af83c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.288835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de5258b0-24c3-48b5-af7a-48b9a71af83c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.345801 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-de5258b0-24c3-48b5-af7a-48b9a71af83c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076857 Aug 27 05:26:27.349202 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2919/5843] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:26:27 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:27.478130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-20321d3c-0891-4606-8c5d-09c38f5162a0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:27.498721 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-20321d3c-0891-4606-8c5d-09c38f5162a0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.251878 Aug 27 05:26:27.499893 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2925/5844] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:27 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:27.542457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1c9f9820-c517-45e7-b8c7-37551b3b8150 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:27.543249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1c9f9820-c517-45e7-b8c7-37551b3b8150 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:27.550372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c9f9820-c517-45e7-b8c7-37551b3b8150 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.550853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c9f9820-c517-45e7-b8c7-37551b3b8150 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.551326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c9f9820-c517-45e7-b8c7-37551b3b8150 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.552018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c9f9820-c517-45e7-b8c7-37551b3b8150 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.553213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c9f9820-c517-45e7-b8c7-37551b3b8150 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.553646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c9f9820-c517-45e7-b8c7-37551b3b8150 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.704161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1c9f9820-c517-45e7-b8c7-37551b3b8150 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:27.713347 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1c9f9820-c517-45e7-b8c7-37551b3b8150 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1313 microversion: 2.1 time: 0.178061 Aug 27 05:26:27.713937 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2920/5845] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:27 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:28.234077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5a49f710-45b0-4558-a3ef-fba18f95bd83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:28.234653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5a49f710-45b0-4558-a3ef-fba18f95bd83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:28.244403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a49f710-45b0-4558-a3ef-fba18f95bd83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:28.245260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a49f710-45b0-4558-a3ef-fba18f95bd83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:28.245982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a49f710-45b0-4558-a3ef-fba18f95bd83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:28.247535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a49f710-45b0-4558-a3ef-fba18f95bd83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:28.248213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a49f710-45b0-4558-a3ef-fba18f95bd83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:28.248774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a49f710-45b0-4558-a3ef-fba18f95bd83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:28.366693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-398d7b44-87bd-47ac-b376-8d930f78e6b6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:28.373106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-398d7b44-87bd-47ac-b376-8d930f78e6b6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:28.384818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-398d7b44-87bd-47ac-b376-8d930f78e6b6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:28.385618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-398d7b44-87bd-47ac-b376-8d930f78e6b6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:28.386337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-398d7b44-87bd-47ac-b376-8d930f78e6b6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:28.388226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-398d7b44-87bd-47ac-b376-8d930f78e6b6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:28.389051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-398d7b44-87bd-47ac-b376-8d930f78e6b6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:28.389902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-398d7b44-87bd-47ac-b376-8d930f78e6b6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:28.468272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5a49f710-45b0-4558-a3ef-fba18f95bd83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:28.486055 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5a49f710-45b0-4558-a3ef-fba18f95bd83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.256077 Aug 27 05:26:28.487535 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-398d7b44-87bd-47ac-b376-8d930f78e6b6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130973 Aug 27 05:26:28.503250 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2926/5846] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:28 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:28.506983 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2921/5847] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:26:28 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:28.531229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-896e49d4-8867-483d-91ea-7355fe2d1b14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:28.532452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-896e49d4-8867-483d-91ea-7355fe2d1b14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:28.547955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-896e49d4-8867-483d-91ea-7355fe2d1b14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:28.548712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-896e49d4-8867-483d-91ea-7355fe2d1b14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:28.549393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-896e49d4-8867-483d-91ea-7355fe2d1b14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:28.550294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-896e49d4-8867-483d-91ea-7355fe2d1b14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:28.550942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-896e49d4-8867-483d-91ea-7355fe2d1b14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:28.551549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-896e49d4-8867-483d-91ea-7355fe2d1b14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:28.741213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6a4aae13-c8db-4c95-a57c-63f7625b8fae tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:28.742268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6a4aae13-c8db-4c95-a57c-63f7625b8fae tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:28.751209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4aae13-c8db-4c95-a57c-63f7625b8fae tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:28.752796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4aae13-c8db-4c95-a57c-63f7625b8fae tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:28.753415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4aae13-c8db-4c95-a57c-63f7625b8fae tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:28.754940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4aae13-c8db-4c95-a57c-63f7625b8fae tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:28.755898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4aae13-c8db-4c95-a57c-63f7625b8fae tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:28.756497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4aae13-c8db-4c95-a57c-63f7625b8fae tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:28.798177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-896e49d4-8867-483d-91ea-7355fe2d1b14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:28.820557 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-896e49d4-8867-483d-91ea-7355fe2d1b14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.296473 Aug 27 05:26:28.821904 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2927/5848] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:28 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:28.971338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6a4aae13-c8db-4c95-a57c-63f7625b8fae tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:28.988486 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6a4aae13-c8db-4c95-a57c-63f7625b8fae tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1313 microversion: 2.1 time: 0.255360 Aug 27 05:26:28.989317 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2922/5849] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:28 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:29.516774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7ae8f2b8-c4c9-4a22-9deb-e261f1a24209 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:29.518989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f67f37a-8dd0-47ba-9126-79f510efc9da tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:29.520024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7ae8f2b8-c4c9-4a22-9deb-e261f1a24209 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:29.525186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f67f37a-8dd0-47ba-9126-79f510efc9da tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:29.536249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ae8f2b8-c4c9-4a22-9deb-e261f1a24209 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:29.538132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f67f37a-8dd0-47ba-9126-79f510efc9da tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:29.538554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ae8f2b8-c4c9-4a22-9deb-e261f1a24209 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:29.538769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f67f37a-8dd0-47ba-9126-79f510efc9da tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:29.539238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f67f37a-8dd0-47ba-9126-79f510efc9da tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:29.540005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f67f37a-8dd0-47ba-9126-79f510efc9da tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:29.540504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f67f37a-8dd0-47ba-9126-79f510efc9da tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:29.540925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ae8f2b8-c4c9-4a22-9deb-e261f1a24209 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:29.541132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f67f37a-8dd0-47ba-9126-79f510efc9da tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:29.542673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ae8f2b8-c4c9-4a22-9deb-e261f1a24209 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:29.543801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ae8f2b8-c4c9-4a22-9deb-e261f1a24209 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:29.544819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ae8f2b8-c4c9-4a22-9deb-e261f1a24209 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:29.579394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:29.590648 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f67f37a-8dd0-47ba-9126-79f510efc9da tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079465 Aug 27 05:26:29.591973 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2923/5850] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:26:29 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:29.760869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7ae8f2b8-c4c9-4a22-9deb-e261f1a24209 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:29.770371 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7ae8f2b8-c4c9-4a22-9deb-e261f1a24209 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1531 microversion: 2.1 time: 0.259893 Aug 27 05:26:29.771481 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2928/5851] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:29 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1531 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:29.862918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a2035213-0381-4df1-ac19-91f69de36fa6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:29.863610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a2035213-0381-4df1-ac19-91f69de36fa6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:29.887353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2035213-0381-4df1-ac19-91f69de36fa6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:29.887353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2035213-0381-4df1-ac19-91f69de36fa6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:29.887353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2035213-0381-4df1-ac19-91f69de36fa6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:29.887353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2035213-0381-4df1-ac19-91f69de36fa6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:29.887353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2035213-0381-4df1-ac19-91f69de36fa6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:29.887353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2035213-0381-4df1-ac19-91f69de36fa6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.017276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-61f44224-bef5-49bd-8f22-afc180de353a tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:30.018036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-61f44224-bef5-49bd-8f22-afc180de353a tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:30.032410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61f44224-bef5-49bd-8f22-afc180de353a tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.035234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61f44224-bef5-49bd-8f22-afc180de353a tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.038824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61f44224-bef5-49bd-8f22-afc180de353a tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.039957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61f44224-bef5-49bd-8f22-afc180de353a tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.040256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61f44224-bef5-49bd-8f22-afc180de353a tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.040761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-61f44224-bef5-49bd-8f22-afc180de353a tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.288884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a2035213-0381-4df1-ac19-91f69de36fa6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:30.311432 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a2035213-0381-4df1-ac19-91f69de36fa6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.459446 Aug 27 05:26:30.312914 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2924/5852] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:29 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:30.317237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-61f44224-bef5-49bd-8f22-afc180de353a tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:30.334478 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-61f44224-bef5-49bd-8f22-afc180de353a tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1313 microversion: 2.1 time: 0.323650 Aug 27 05:26:30.336056 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2929/5853] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:30 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:30.611335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f7b4846d-d133-470e-b87a-11cb9fd9c3e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:30.613744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f7b4846d-d133-470e-b87a-11cb9fd9c3e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:30.616427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:30.623427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7b4846d-d133-470e-b87a-11cb9fd9c3e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.624122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7b4846d-d133-470e-b87a-11cb9fd9c3e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.624960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7b4846d-d133-470e-b87a-11cb9fd9c3e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.625811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7b4846d-d133-470e-b87a-11cb9fd9c3e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.626372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7b4846d-d133-470e-b87a-11cb9fd9c3e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.627076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7b4846d-d133-470e-b87a-11cb9fd9c3e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.680238 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f7b4846d-d133-470e-b87a-11cb9fd9c3e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072988 Aug 27 05:26:30.680840 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2925/5854] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:26:30 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:30.806275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ba78883-298b-4fcc-8acf-e28ae8ef306c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:30.807243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3ba78883-298b-4fcc-8acf-e28ae8ef306c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:30.816998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba78883-298b-4fcc-8acf-e28ae8ef306c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.818430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba78883-298b-4fcc-8acf-e28ae8ef306c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.819010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba78883-298b-4fcc-8acf-e28ae8ef306c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.819990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba78883-298b-4fcc-8acf-e28ae8ef306c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.820533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba78883-298b-4fcc-8acf-e28ae8ef306c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.821059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ba78883-298b-4fcc-8acf-e28ae8ef306c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:31.015221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3ba78883-298b-4fcc-8acf-e28ae8ef306c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:31.032980 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3ba78883-298b-4fcc-8acf-e28ae8ef306c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1531 microversion: 2.1 time: 0.234279 Aug 27 05:26:31.047200 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2930/5855] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:30 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1531 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:31.342432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c001a100-aefb-4f89-bd41-a06b2b6c1129 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:31.343903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c001a100-aefb-4f89-bd41-a06b2b6c1129 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:31.355051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c001a100-aefb-4f89-bd41-a06b2b6c1129 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:31.356075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c001a100-aefb-4f89-bd41-a06b2b6c1129 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:31.357167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c001a100-aefb-4f89-bd41-a06b2b6c1129 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:31.358685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c001a100-aefb-4f89-bd41-a06b2b6c1129 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:31.359616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c001a100-aefb-4f89-bd41-a06b2b6c1129 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:31.360337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c001a100-aefb-4f89-bd41-a06b2b6c1129 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:31.362578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-519a648a-5ff2-4704-a699-8c2267af34fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:31.363325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-519a648a-5ff2-4704-a699-8c2267af34fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:31.372808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-519a648a-5ff2-4704-a699-8c2267af34fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:31.373693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-519a648a-5ff2-4704-a699-8c2267af34fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:31.374414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-519a648a-5ff2-4704-a699-8c2267af34fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:31.375530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-519a648a-5ff2-4704-a699-8c2267af34fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:31.376198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-519a648a-5ff2-4704-a699-8c2267af34fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:31.376828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-519a648a-5ff2-4704-a699-8c2267af34fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:31.563407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:31.576080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:31.639803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-519a648a-5ff2-4704-a699-8c2267af34fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:31.657645 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-519a648a-5ff2-4704-a699-8c2267af34fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1313 microversion: 2.1 time: 0.299089 Aug 27 05:26:31.659627 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2931/5856] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:31 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:31.677296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c001a100-aefb-4f89-bd41-a06b2b6c1129 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:31.686998 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c001a100-aefb-4f89-bd41-a06b2b6c1129 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.352163 Aug 27 05:26:31.689242 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2926/5857] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:31 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:31.694261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fc58e25a-c10d-4978-944b-f501235e8145 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:31.696897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fc58e25a-c10d-4978-944b-f501235e8145 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:31.706510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc58e25a-c10d-4978-944b-f501235e8145 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:31.707260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc58e25a-c10d-4978-944b-f501235e8145 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:31.708106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc58e25a-c10d-4978-944b-f501235e8145 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:31.710090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc58e25a-c10d-4978-944b-f501235e8145 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:31.710743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc58e25a-c10d-4978-944b-f501235e8145 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:31.711411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc58e25a-c10d-4978-944b-f501235e8145 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:31.753004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:31.758229 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fc58e25a-c10d-4978-944b-f501235e8145 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068588 Aug 27 05:26:31.759760 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2932/5858] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:26:31 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:32.062822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d35d5f8-fd77-4187-9522-6d763c9c7666 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:32.063766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7d35d5f8-fd77-4187-9522-6d763c9c7666 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:32.071452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d35d5f8-fd77-4187-9522-6d763c9c7666 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:32.071952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d35d5f8-fd77-4187-9522-6d763c9c7666 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:32.072408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d35d5f8-fd77-4187-9522-6d763c9c7666 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:32.073134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d35d5f8-fd77-4187-9522-6d763c9c7666 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:32.073600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d35d5f8-fd77-4187-9522-6d763c9c7666 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:32.074089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d35d5f8-fd77-4187-9522-6d763c9c7666 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:32.266485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7d35d5f8-fd77-4187-9522-6d763c9c7666 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:32.283683 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d35d5f8-fd77-4187-9522-6d763c9c7666 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1531 microversion: 2.1 time: 0.225512 Aug 27 05:26:32.284803 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2927/5859] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:32 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1531 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:32.694717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c6a4be31-4e51-4854-8edc-f2318c00d4e1 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:32.696158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c6a4be31-4e51-4854-8edc-f2318c00d4e1 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:32.706874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a4be31-4e51-4854-8edc-f2318c00d4e1 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:32.716870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fa79aebe-f069-4a1f-af81-f99dbb7d6d9f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:32.718913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fa79aebe-f069-4a1f-af81-f99dbb7d6d9f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:32.723445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a4be31-4e51-4854-8edc-f2318c00d4e1 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:32.724349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a4be31-4e51-4854-8edc-f2318c00d4e1 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:32.730791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a4be31-4e51-4854-8edc-f2318c00d4e1 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:32.732855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a4be31-4e51-4854-8edc-f2318c00d4e1 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:32.733829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a4be31-4e51-4854-8edc-f2318c00d4e1 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:32.741027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa79aebe-f069-4a1f-af81-f99dbb7d6d9f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:32.746632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa79aebe-f069-4a1f-af81-f99dbb7d6d9f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:32.747668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa79aebe-f069-4a1f-af81-f99dbb7d6d9f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:32.751483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa79aebe-f069-4a1f-af81-f99dbb7d6d9f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:32.753807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa79aebe-f069-4a1f-af81-f99dbb7d6d9f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:32.756488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa79aebe-f069-4a1f-af81-f99dbb7d6d9f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:33.117832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fa79aebe-f069-4a1f-af81-f99dbb7d6d9f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:33.142652 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fa79aebe-f069-4a1f-af81-f99dbb7d6d9f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.426484 Aug 27 05:26:33.144783 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2928/5860] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:32 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:33.155812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-52d0af95-7aed-4415-8889-d46f128c6ef1 req-40388d79-75c0-4e30-9ee1-540e901dfd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64999ba4-bbd9-4d23-9a4c-0caf8eb677b4", "name": "network-vif-plugged", "status": "completed", "tag": "e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:33.193191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52d0af95-7aed-4415-8889-d46f128c6ef1 req-40388d79-75c0-4e30-9ee1-540e901dfd80 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:33.197369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52d0af95-7aed-4415-8889-d46f128c6ef1 req-40388d79-75c0-4e30-9ee1-540e901dfd80 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:33.197834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52d0af95-7aed-4415-8889-d46f128c6ef1 req-40388d79-75c0-4e30-9ee1-540e901dfd80 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:33.212259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c6a4be31-4e51-4854-8edc-f2318c00d4e1 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:33.225473 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c6a4be31-4e51-4854-8edc-f2318c00d4e1 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1313 microversion: 2.1 time: 0.546295 Aug 27 05:26:33.235180 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2933/5861] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:32 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:33.235505 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-52d0af95-7aed-4415-8889-d46f128c6ef1 req-40388d79-75c0-4e30-9ee1-540e901dfd80 service nova] Creating event network-vif-plugged:e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf for instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 on n-h2-820368-35 Aug 27 05:26:33.238812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0abf1fb7-ea3a-4279-954d-a21b45b211e0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:33.241660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0abf1fb7-ea3a-4279-954d-a21b45b211e0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:33.245744 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-52d0af95-7aed-4415-8889-d46f128c6ef1 req-40388d79-75c0-4e30-9ee1-540e901dfd80 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099243 Aug 27 05:26:33.246399 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2929/5862] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:33.251772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0abf1fb7-ea3a-4279-954d-a21b45b211e0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:33.252273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0abf1fb7-ea3a-4279-954d-a21b45b211e0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:33.252718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0abf1fb7-ea3a-4279-954d-a21b45b211e0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:33.253440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0abf1fb7-ea3a-4279-954d-a21b45b211e0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:33.253891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0abf1fb7-ea3a-4279-954d-a21b45b211e0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:33.254317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0abf1fb7-ea3a-4279-954d-a21b45b211e0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:33.296489 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0abf1fb7-ea3a-4279-954d-a21b45b211e0 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067723 Aug 27 05:26:33.297363 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2934/5863] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:26:33 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:33.310978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7e0373bf-d61f-4f68-8576-8ebd74648644 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:33.311742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7e0373bf-d61f-4f68-8576-8ebd74648644 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:33.319069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e0373bf-d61f-4f68-8576-8ebd74648644 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:33.319585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e0373bf-d61f-4f68-8576-8ebd74648644 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:33.320260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e0373bf-d61f-4f68-8576-8ebd74648644 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:33.320989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e0373bf-d61f-4f68-8576-8ebd74648644 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:33.321454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e0373bf-d61f-4f68-8576-8ebd74648644 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:33.321894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e0373bf-d61f-4f68-8576-8ebd74648644 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:33.521976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7e0373bf-d61f-4f68-8576-8ebd74648644 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:33.535392 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7e0373bf-d61f-4f68-8576-8ebd74648644 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1531 microversion: 2.1 time: 0.229532 Aug 27 05:26:33.537246 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2930/5864] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:33 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1531 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:34.184119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-433c7abd-a06c-4b3f-9ea2-a84431859114 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:34.185447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-433c7abd-a06c-4b3f-9ea2-a84431859114 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:34.196978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433c7abd-a06c-4b3f-9ea2-a84431859114 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.197681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433c7abd-a06c-4b3f-9ea2-a84431859114 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.198427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433c7abd-a06c-4b3f-9ea2-a84431859114 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.200050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433c7abd-a06c-4b3f-9ea2-a84431859114 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.200810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433c7abd-a06c-4b3f-9ea2-a84431859114 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.201535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-433c7abd-a06c-4b3f-9ea2-a84431859114 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.252927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ded0aa4-52b2-470e-bad2-5cf6da0e38fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:34.254136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ded0aa4-52b2-470e-bad2-5cf6da0e38fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:34.267530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded0aa4-52b2-470e-bad2-5cf6da0e38fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.268843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded0aa4-52b2-470e-bad2-5cf6da0e38fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.269711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded0aa4-52b2-470e-bad2-5cf6da0e38fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.271658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded0aa4-52b2-470e-bad2-5cf6da0e38fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.272536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded0aa4-52b2-470e-bad2-5cf6da0e38fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.273353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ded0aa4-52b2-470e-bad2-5cf6da0e38fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.415129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-433c7abd-a06c-4b3f-9ea2-a84431859114 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:34.444228 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-433c7abd-a06c-4b3f-9ea2-a84431859114 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.264214 Aug 27 05:26:34.446581 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2935/5865] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:34 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:34.465419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fd73bd4d-c6e3-433d-9fd7-13edd544b570 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:34.472740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fd73bd4d-c6e3-433d-9fd7-13edd544b570 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:34.482940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ded0aa4-52b2-470e-bad2-5cf6da0e38fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:34.484174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd73bd4d-c6e3-433d-9fd7-13edd544b570 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.484972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd73bd4d-c6e3-433d-9fd7-13edd544b570 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.485728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd73bd4d-c6e3-433d-9fd7-13edd544b570 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.487063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd73bd4d-c6e3-433d-9fd7-13edd544b570 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.488588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd73bd4d-c6e3-433d-9fd7-13edd544b570 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.490721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd73bd4d-c6e3-433d-9fd7-13edd544b570 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.499005 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ded0aa4-52b2-470e-bad2-5cf6da0e38fc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1313 microversion: 2.1 time: 0.249718 Aug 27 05:26:34.499988 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2931/5866] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:34 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:34.540198 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fd73bd4d-c6e3-433d-9fd7-13edd544b570 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091483 Aug 27 05:26:34.540711 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2936/5867] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:26:34 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:26:34.566409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bf321382-2718-44fe-b744-4af17315274f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:34.567040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bf321382-2718-44fe-b744-4af17315274f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:34.574288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf321382-2718-44fe-b744-4af17315274f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.575064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf321382-2718-44fe-b744-4af17315274f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.575800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf321382-2718-44fe-b744-4af17315274f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.576750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf321382-2718-44fe-b744-4af17315274f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.577190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf321382-2718-44fe-b744-4af17315274f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.577808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf321382-2718-44fe-b744-4af17315274f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.635138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d958314-37fe-4fcc-8a01-487c5819fc32 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:34.635679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7d958314-37fe-4fcc-8a01-487c5819fc32 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:34.641927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d958314-37fe-4fcc-8a01-487c5819fc32 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.642417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d958314-37fe-4fcc-8a01-487c5819fc32 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.642853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d958314-37fe-4fcc-8a01-487c5819fc32 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.643605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d958314-37fe-4fcc-8a01-487c5819fc32 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.644060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d958314-37fe-4fcc-8a01-487c5819fc32 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.644492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d958314-37fe-4fcc-8a01-487c5819fc32 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.676845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7d958314-37fe-4fcc-8a01-487c5819fc32 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:26:34.769325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bf321382-2718-44fe-b744-4af17315274f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:34.778932 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bf321382-2718-44fe-b744-4af17315274f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1531 microversion: 2.1 time: 0.215726 Aug 27 05:26:34.778932 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2932/5868] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:34 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1531 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:34.791735 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7d958314-37fe-4fcc-8a01-487c5819fc32 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 204 len: 0 microversion: 2.1 time: 0.160424 Aug 27 05:26:34.793444 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2937/5869] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:26:34 2022] DELETE /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:26:34.807067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0c4b7bc2-6880-4f90-b6d5-49b8064eea4e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:34.807705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c4b7bc2-6880-4f90-b6d5-49b8064eea4e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:34.813929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c4b7bc2-6880-4f90-b6d5-49b8064eea4e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.814415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c4b7bc2-6880-4f90-b6d5-49b8064eea4e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.814853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c4b7bc2-6880-4f90-b6d5-49b8064eea4e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.815599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c4b7bc2-6880-4f90-b6d5-49b8064eea4e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.816049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c4b7bc2-6880-4f90-b6d5-49b8064eea4e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.816495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c4b7bc2-6880-4f90-b6d5-49b8064eea4e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.987049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0c4b7bc2-6880-4f90-b6d5-49b8064eea4e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:34.995948 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0c4b7bc2-6880-4f90-b6d5-49b8064eea4e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1682 microversion: 2.1 time: 0.192826 Aug 27 05:26:34.996530 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2933/5870] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:34 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:35.262990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5d6d35ae-74e9-46dd-90a7-f5db610fc3f0 req-734a49b7-0bef-4883-a6b0-4a49f568129b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f8027a-674b-4177-a4d4-142882d951f2", "name": "network-vif-plugged", "status": "completed", "tag": "0ae50be4-4489-44b4-ac20-ce1d211d31ba"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:35.275807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5d6d35ae-74e9-46dd-90a7-f5db610fc3f0 req-734a49b7-0bef-4883-a6b0-4a49f568129b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:35.276280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5d6d35ae-74e9-46dd-90a7-f5db610fc3f0 req-734a49b7-0bef-4883-a6b0-4a49f568129b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:35.276715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5d6d35ae-74e9-46dd-90a7-f5db610fc3f0 req-734a49b7-0bef-4883-a6b0-4a49f568129b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:35.290620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5d6d35ae-74e9-46dd-90a7-f5db610fc3f0 req-734a49b7-0bef-4883-a6b0-4a49f568129b service nova] Creating event network-vif-plugged:0ae50be4-4489-44b4-ac20-ce1d211d31ba for instance 83f8027a-674b-4177-a4d4-142882d951f2 on n-h2-820368-35 Aug 27 05:26:35.295661 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5d6d35ae-74e9-46dd-90a7-f5db610fc3f0 req-734a49b7-0bef-4883-a6b0-4a49f568129b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036706 Aug 27 05:26:35.296269 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2938/5871] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:35.487067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bc5b875d-1ae2-4ec4-a1bd-60caf1d015d1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:35.490233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bc5b875d-1ae2-4ec4-a1bd-60caf1d015d1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:35.510744 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:26:35.511212 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 05:26:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef (ip 10.222.0.58) !!! Aug 27 05:26:35.518007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc5b875d-1ae2-4ec4-a1bd-60caf1d015d1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:35.518457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc5b875d-1ae2-4ec4-a1bd-60caf1d015d1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:35.520075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc5b875d-1ae2-4ec4-a1bd-60caf1d015d1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:35.520075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc5b875d-1ae2-4ec4-a1bd-60caf1d015d1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:35.520312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc5b875d-1ae2-4ec4-a1bd-60caf1d015d1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:35.521235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc5b875d-1ae2-4ec4-a1bd-60caf1d015d1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:35.537859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ee92b73-c851-400b-830e-37e63fc48a3f tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:35.539681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3ee92b73-c851-400b-830e-37e63fc48a3f tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:35.543354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:35.547609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:35.563603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ee92b73-c851-400b-830e-37e63fc48a3f tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:35.565268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ee92b73-c851-400b-830e-37e63fc48a3f tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:35.567054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ee92b73-c851-400b-830e-37e63fc48a3f tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:35.569707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ee92b73-c851-400b-830e-37e63fc48a3f tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:35.570910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ee92b73-c851-400b-830e-37e63fc48a3f tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:35.571937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ee92b73-c851-400b-830e-37e63fc48a3f tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:35.777249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bc5b875d-1ae2-4ec4-a1bd-60caf1d015d1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:35.794696 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bc5b875d-1ae2-4ec4-a1bd-60caf1d015d1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.319917 Aug 27 05:26:35.807350 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2934/5872] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:35 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:35.823263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3148bf3d-42e6-481e-ad86-597654b4672f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:35.826822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3148bf3d-42e6-481e-ad86-597654b4672f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:35.841046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3148bf3d-42e6-481e-ad86-597654b4672f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:35.841971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3148bf3d-42e6-481e-ad86-597654b4672f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:35.843905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3148bf3d-42e6-481e-ad86-597654b4672f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:35.846964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3148bf3d-42e6-481e-ad86-597654b4672f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:35.847908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3148bf3d-42e6-481e-ad86-597654b4672f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:35.848731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3148bf3d-42e6-481e-ad86-597654b4672f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:35.875012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3ee92b73-c851-400b-830e-37e63fc48a3f tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:35.886287 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3ee92b73-c851-400b-830e-37e63fc48a3f tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1313 microversion: 2.1 time: 0.360068 Aug 27 05:26:35.887706 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2939/5873] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:35 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:36.021610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5cf5a6b4-c7ad-42bd-92c0-611a2a474910 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:36.024165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5cf5a6b4-c7ad-42bd-92c0-611a2a474910 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:36.047617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cf5a6b4-c7ad-42bd-92c0-611a2a474910 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:36.049897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cf5a6b4-c7ad-42bd-92c0-611a2a474910 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:36.051013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cf5a6b4-c7ad-42bd-92c0-611a2a474910 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:36.054311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cf5a6b4-c7ad-42bd-92c0-611a2a474910 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:36.056256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cf5a6b4-c7ad-42bd-92c0-611a2a474910 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:36.057118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5cf5a6b4-c7ad-42bd-92c0-611a2a474910 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:36.084746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3148bf3d-42e6-481e-ad86-597654b4672f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:36.095956 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3148bf3d-42e6-481e-ad86-597654b4672f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.281380 Aug 27 05:26:36.112095 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2935/5874] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:35 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:36.296451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5cf5a6b4-c7ad-42bd-92c0-611a2a474910 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:36.309661 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5cf5a6b4-c7ad-42bd-92c0-611a2a474910 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1682 microversion: 2.1 time: 0.294969 Aug 27 05:26:36.324170 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2940/5875] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:36 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1682 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:36.828633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8acc4ce-8a01-4321-a9ad-97979f8b4c1e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:36.829486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8acc4ce-8a01-4321-a9ad-97979f8b4c1e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:36.875273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8acc4ce-8a01-4321-a9ad-97979f8b4c1e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:36.876349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8acc4ce-8a01-4321-a9ad-97979f8b4c1e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:36.878151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8acc4ce-8a01-4321-a9ad-97979f8b4c1e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:36.881816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8acc4ce-8a01-4321-a9ad-97979f8b4c1e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:36.884239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8acc4ce-8a01-4321-a9ad-97979f8b4c1e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:36.885756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8acc4ce-8a01-4321-a9ad-97979f8b4c1e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:36.916899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-091b0ed8-ef79-43a5-8044-cc5063550208 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:36.917760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-091b0ed8-ef79-43a5-8044-cc5063550208 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:36.978150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-091b0ed8-ef79-43a5-8044-cc5063550208 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:36.978967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-091b0ed8-ef79-43a5-8044-cc5063550208 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:36.979543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-091b0ed8-ef79-43a5-8044-cc5063550208 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:36.980780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-091b0ed8-ef79-43a5-8044-cc5063550208 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:36.981617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-091b0ed8-ef79-43a5-8044-cc5063550208 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:37.006598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-091b0ed8-ef79-43a5-8044-cc5063550208 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:37.256077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d8acc4ce-8a01-4321-a9ad-97979f8b4c1e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:37.271291 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8acc4ce-8a01-4321-a9ad-97979f8b4c1e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.448295 Aug 27 05:26:37.277367 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2936/5876] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:36 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:37.283351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1d506c2e-7ba7-4881-af73-fe9b6ae00a65 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:37.290521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1d506c2e-7ba7-4881-af73-fe9b6ae00a65 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:37.315152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d506c2e-7ba7-4881-af73-fe9b6ae00a65 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:37.324351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d506c2e-7ba7-4881-af73-fe9b6ae00a65 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:37.324351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d506c2e-7ba7-4881-af73-fe9b6ae00a65 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:37.324351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d506c2e-7ba7-4881-af73-fe9b6ae00a65 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:37.324351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d506c2e-7ba7-4881-af73-fe9b6ae00a65 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:37.324351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d506c2e-7ba7-4881-af73-fe9b6ae00a65 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:37.402098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-091b0ed8-ef79-43a5-8044-cc5063550208 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:37.441132 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-091b0ed8-ef79-43a5-8044-cc5063550208 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1462 microversion: 2.1 time: 0.530334 Aug 27 05:26:37.467141 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2941/5877] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:36 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1462 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:37.504018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e49335cf-c060-433e-a37f-c81cebcc8386 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:37.506049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e49335cf-c060-433e-a37f-c81cebcc8386 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:37.519278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e49335cf-c060-433e-a37f-c81cebcc8386 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:37.520100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e49335cf-c060-433e-a37f-c81cebcc8386 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:37.526084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e49335cf-c060-433e-a37f-c81cebcc8386 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:37.530900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e49335cf-c060-433e-a37f-c81cebcc8386 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:37.532679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e49335cf-c060-433e-a37f-c81cebcc8386 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:37.537170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e49335cf-c060-433e-a37f-c81cebcc8386 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:37.544306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1d506c2e-7ba7-4881-af73-fe9b6ae00a65 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:37.555800 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1d506c2e-7ba7-4881-af73-fe9b6ae00a65 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.276354 Aug 27 05:26:37.556909 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2937/5878] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:37 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:37.563703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ace0dbb8-d688-49c9-a28c-5b51e7057204 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c39b409-1911-495e-828d-e3b71922ae9d", "device": "/dev/sdb"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:37.566997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ace0dbb8-d688-49c9-a28c-5b51e7057204 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:37.575200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ace0dbb8-d688-49c9-a28c-5b51e7057204 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:37.576057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ace0dbb8-d688-49c9-a28c-5b51e7057204 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:37.576615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ace0dbb8-d688-49c9-a28c-5b51e7057204 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:37.577468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ace0dbb8-d688-49c9-a28c-5b51e7057204 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:37.578349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ace0dbb8-d688-49c9-a28c-5b51e7057204 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:37.579286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ace0dbb8-d688-49c9-a28c-5b51e7057204 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:38.002874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e49335cf-c060-433e-a37f-c81cebcc8386 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:38.016565 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e49335cf-c060-433e-a37f-c81cebcc8386 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1682 microversion: 2.1 time: 0.554297 Aug 27 05:26:38.019460 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2942/5879] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:37 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1682 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:38.248865 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ace0dbb8-d688-49c9-a28c-5b51e7057204 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "POST /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688566 Aug 27 05:26:38.263025 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2938/5880] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:26:37 2022] POST /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:38.317053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b32613c-9151-4831-8279-9e81a9b5e098 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:38.329540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6b32613c-9151-4831-8279-9e81a9b5e098 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:38.349489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b32613c-9151-4831-8279-9e81a9b5e098 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:38.353423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b32613c-9151-4831-8279-9e81a9b5e098 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:38.354547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b32613c-9151-4831-8279-9e81a9b5e098 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:38.356180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b32613c-9151-4831-8279-9e81a9b5e098 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:38.357453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b32613c-9151-4831-8279-9e81a9b5e098 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:38.358548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b32613c-9151-4831-8279-9e81a9b5e098 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:38.587523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8ed2c3e-c452-4e74-b73f-5c2649547558 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:38.588255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8ed2c3e-c452-4e74-b73f-5c2649547558 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:38.610479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8ed2c3e-c452-4e74-b73f-5c2649547558 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:38.611028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8ed2c3e-c452-4e74-b73f-5c2649547558 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:38.611528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8ed2c3e-c452-4e74-b73f-5c2649547558 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:38.612286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8ed2c3e-c452-4e74-b73f-5c2649547558 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:38.612750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8ed2c3e-c452-4e74-b73f-5c2649547558 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:38.613187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8ed2c3e-c452-4e74-b73f-5c2649547558 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:38.999409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6b32613c-9151-4831-8279-9e81a9b5e098 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:39.025674 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b32613c-9151-4831-8279-9e81a9b5e098 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.715113 Aug 27 05:26:39.048020 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2943/5881] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:38 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:39.056420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c6f6aa6f-7901-4445-8b7d-c9ce4f8f6c93 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:39.058754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c6f6aa6f-7901-4445-8b7d-c9ce4f8f6c93 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:39.066433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6f6aa6f-7901-4445-8b7d-c9ce4f8f6c93 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:39.067360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6f6aa6f-7901-4445-8b7d-c9ce4f8f6c93 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:39.068767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6f6aa6f-7901-4445-8b7d-c9ce4f8f6c93 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:39.070875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6f6aa6f-7901-4445-8b7d-c9ce4f8f6c93 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:39.072027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6f6aa6f-7901-4445-8b7d-c9ce4f8f6c93 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:39.073814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6f6aa6f-7901-4445-8b7d-c9ce4f8f6c93 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:39.113444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:39.211148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8ed2c3e-c452-4e74-b73f-5c2649547558 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:39.247611 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8ed2c3e-c452-4e74-b73f-5c2649547558 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.664486 Aug 27 05:26:39.256949 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2939/5882] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:38 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:39.297040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c6f6aa6f-7901-4445-8b7d-c9ce4f8f6c93 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:39.331749 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c6f6aa6f-7901-4445-8b7d-c9ce4f8f6c93 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1614 microversion: 2.1 time: 0.269005 Aug 27 05:26:39.333992 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2944/5883] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:39 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1614 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:39.728772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6ce45748-401a-468e-9d91-6777913cf7a5 req-b34977a4-10f1-4348-93e6-13faca609cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1ccbd70-94c1-4f11-aca0-2d8d2afe8626", "name": "network-vif-deleted", "tag": "1a192ad8-f44d-4230-9a8e-fc72cfd1341c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:39.811508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6ce45748-401a-468e-9d91-6777913cf7a5 req-b34977a4-10f1-4348-93e6-13faca609cc3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:39.819573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6ce45748-401a-468e-9d91-6777913cf7a5 req-b34977a4-10f1-4348-93e6-13faca609cc3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:39.820354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6ce45748-401a-468e-9d91-6777913cf7a5 req-b34977a4-10f1-4348-93e6-13faca609cc3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:39.858458 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6ce45748-401a-468e-9d91-6777913cf7a5 req-b34977a4-10f1-4348-93e6-13faca609cc3 service nova] Creating event network-vif-deleted:1a192ad8-f44d-4230-9a8e-fc72cfd1341c for instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 on n-h1-820368-35 Aug 27 05:26:39.881078 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6ce45748-401a-468e-9d91-6777913cf7a5 req-b34977a4-10f1-4348-93e6-13faca609cc3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162727 Aug 27 05:26:39.884883 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2940/5884] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:40.071946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ca236222-1dc6-4cd6-9b97-62fb0f203f8a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:40.073067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ca236222-1dc6-4cd6-9b97-62fb0f203f8a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:40.100583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca236222-1dc6-4cd6-9b97-62fb0f203f8a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:40.101194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca236222-1dc6-4cd6-9b97-62fb0f203f8a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:40.105378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca236222-1dc6-4cd6-9b97-62fb0f203f8a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:40.106225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca236222-1dc6-4cd6-9b97-62fb0f203f8a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:40.108138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca236222-1dc6-4cd6-9b97-62fb0f203f8a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:40.109075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca236222-1dc6-4cd6-9b97-62fb0f203f8a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:40.287886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f594d17f-3be0-4a9b-a767-ec9ab2b0b7e6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:40.288760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f594d17f-3be0-4a9b-a767-ec9ab2b0b7e6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:40.313927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f594d17f-3be0-4a9b-a767-ec9ab2b0b7e6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:40.313927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f594d17f-3be0-4a9b-a767-ec9ab2b0b7e6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:40.315141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f594d17f-3be0-4a9b-a767-ec9ab2b0b7e6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:40.317981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f594d17f-3be0-4a9b-a767-ec9ab2b0b7e6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:40.322108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f594d17f-3be0-4a9b-a767-ec9ab2b0b7e6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:40.322592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f594d17f-3be0-4a9b-a767-ec9ab2b0b7e6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:40.624858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ca236222-1dc6-4cd6-9b97-62fb0f203f8a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:40.652967 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ca236222-1dc6-4cd6-9b97-62fb0f203f8a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.596189 Aug 27 05:26:40.655106 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2945/5885] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:40 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:40.700674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:40.709604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:40.724475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:40.725950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:40.728665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:40.730397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:40.731703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:40.732776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:40.829804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:40.831483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:40.832589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:40.835941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lazy-loading 'fault' on Instance uuid c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:26:40.951846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:40.977479 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cd39a665-b2d2-43d9-bef9-9a31e1d1345b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 200 len: 1332 microversion: 2.1 time: 0.306450 Aug 27 05:26:40.980339 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2946/5886] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:40 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 1332 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:41.376506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f594d17f-3be0-4a9b-a767-ec9ab2b0b7e6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:41.390222 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f594d17f-3be0-4a9b-a767-ec9ab2b0b7e6 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 1.108053 Aug 27 05:26:41.414956 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2941/5887] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:40 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:41.700595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3fb4f1dc-ff41-4783-9f74-4c4a5a4f39e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:41.703183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3fb4f1dc-ff41-4783-9f74-4c4a5a4f39e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:41.718035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb4f1dc-ff41-4783-9f74-4c4a5a4f39e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:41.720141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb4f1dc-ff41-4783-9f74-4c4a5a4f39e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:41.729915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb4f1dc-ff41-4783-9f74-4c4a5a4f39e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:41.731243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb4f1dc-ff41-4783-9f74-4c4a5a4f39e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:41.732163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb4f1dc-ff41-4783-9f74-4c4a5a4f39e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:41.732952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3fb4f1dc-ff41-4783-9f74-4c4a5a4f39e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:42.009284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:42.010280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:42.039672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:42.040477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:42.041279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:42.042775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:42.043796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:42.044742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:42.107078 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 HTTP/1.1 Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'c1ccbd70-94c1-4f11-aca0-2d8d2afe8626'} Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:42.112040 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:42.131258 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:42.131258 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:42.131258 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:42.131258 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:42.131258 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:42.131258 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:26:42.131258 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:42.131258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:42.131258 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f052e87-cf9a-4cab-ab93-d4995bb4fce4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 404 len: 111 microversion: 2.1 time: 0.113908 Aug 27 05:26:42.131258 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2942/5888] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:41 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:26:42.140069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-32f5fdae-0566-4ceb-b9b8-aebd836e2d21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '.version_select at 0x7fb56416d5e0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:42.172005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3fb4f1dc-ff41-4783-9f74-4c4a5a4f39e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:42.192142 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-32f5fdae-0566-4ceb-b9b8-aebd836e2d21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084209992" status: 202 len: 0 microversion: 2.1 time: 0.061594 Aug 27 05:26:42.199300 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2943/5889] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 05:26:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084209992 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:26:42.212843 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3fb4f1dc-ff41-4783-9f74-4c4a5a4f39e5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.516062 Aug 27 05:26:42.232044 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2947/5890] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:41 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:42.434334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aec807a6-27c5-48eb-84f1-c6c86a417b54 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:42.435429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aec807a6-27c5-48eb-84f1-c6c86a417b54 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:42.461751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec807a6-27c5-48eb-84f1-c6c86a417b54 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:42.463039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec807a6-27c5-48eb-84f1-c6c86a417b54 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:42.463834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec807a6-27c5-48eb-84f1-c6c86a417b54 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:42.465078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec807a6-27c5-48eb-84f1-c6c86a417b54 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:42.465836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec807a6-27c5-48eb-84f1-c6c86a417b54 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:42.466572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aec807a6-27c5-48eb-84f1-c6c86a417b54 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:43.243809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2ea5b164-24b3-4bfa-90ce-c75cc8736fcb tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:43.244428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2ea5b164-24b3-4bfa-90ce-c75cc8736fcb tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:43.263675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea5b164-24b3-4bfa-90ce-c75cc8736fcb tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:43.264291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea5b164-24b3-4bfa-90ce-c75cc8736fcb tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:43.264740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea5b164-24b3-4bfa-90ce-c75cc8736fcb tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:43.285235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea5b164-24b3-4bfa-90ce-c75cc8736fcb tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:43.285912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea5b164-24b3-4bfa-90ce-c75cc8736fcb tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:43.286500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea5b164-24b3-4bfa-90ce-c75cc8736fcb tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:43.467808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aec807a6-27c5-48eb-84f1-c6c86a417b54 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:43.490393 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aec807a6-27c5-48eb-84f1-c6c86a417b54 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 1.064306 Aug 27 05:26:43.492570 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2944/5891] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:42 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:43.830945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2ea5b164-24b3-4bfa-90ce-c75cc8736fcb tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:43.851691 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2ea5b164-24b3-4bfa-90ce-c75cc8736fcb tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.613083 Aug 27 05:26:43.854156 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2948/5892] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:43 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:44.124491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0aabb2de-309b-4582-ae2e-e96b575cdad7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: .version_select at 0x7fb564157af0>, body: {"keypair": {"name": "tempest-keypair-1229346458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOkQ8uaK01OOUiO7H4STJY1qiMwjt/kPZ7b9dbJDQsMVmi8KhZXbwctIk5itfQwm/T4bLUk8gHAqe+jeAJb/79TvSkek/AVp2fR+0KgJoLeqjZ8dowqCBTJhiTTvt+7nA=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:44.172666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0aabb2de-309b-4582-ae2e-e96b575cdad7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:26:44.187030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0aabb2de-309b-4582-ae2e-e96b575cdad7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for user 43fc751d620242208608be8bc55ae86d and project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:26:44.235855 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0aabb2de-309b-4582-ae2e-e96b575cdad7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113061 Aug 27 05:26:44.245422 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2945/5893] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:26:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:44.519506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cb5885ff-09b5-4eaa-9f44-dec8e97c6959 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:44.521069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cb5885ff-09b5-4eaa-9f44-dec8e97c6959 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:44.544798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb5885ff-09b5-4eaa-9f44-dec8e97c6959 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:44.545446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb5885ff-09b5-4eaa-9f44-dec8e97c6959 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:44.545992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb5885ff-09b5-4eaa-9f44-dec8e97c6959 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:44.561213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb5885ff-09b5-4eaa-9f44-dec8e97c6959 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:44.562773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb5885ff-09b5-4eaa-9f44-dec8e97c6959 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:44.563265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb5885ff-09b5-4eaa-9f44-dec8e97c6959 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:44.886092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-94bd17be-bebb-4da0-92a3-986976368b49 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:44.888620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-94bd17be-bebb-4da0-92a3-986976368b49 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:44.916274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cb5885ff-09b5-4eaa-9f44-dec8e97c6959 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:44.945553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94bd17be-bebb-4da0-92a3-986976368b49 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:44.960580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94bd17be-bebb-4da0-92a3-986976368b49 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:44.965082 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cb5885ff-09b5-4eaa-9f44-dec8e97c6959 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.449841 Aug 27 05:26:44.966232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94bd17be-bebb-4da0-92a3-986976368b49 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:44.971217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94bd17be-bebb-4da0-92a3-986976368b49 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:44.974543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94bd17be-bebb-4da0-92a3-986976368b49 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:44.978013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94bd17be-bebb-4da0-92a3-986976368b49 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:44.978641 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2949/5894] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:44 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:45.596848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-94bd17be-bebb-4da0-92a3-986976368b49 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:45.614016 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-94bd17be-bebb-4da0-92a3-986976368b49 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1523 microversion: 2.1 time: 0.734583 Aug 27 05:26:45.618980 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2946/5895] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:44 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1523 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:45.997368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-74b665f1-7307-41e9-bcaf-fe51f06aee91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:45.999185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-74b665f1-7307-41e9-bcaf-fe51f06aee91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:46.021609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74b665f1-7307-41e9-bcaf-fe51f06aee91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:46.022439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74b665f1-7307-41e9-bcaf-fe51f06aee91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:46.023627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74b665f1-7307-41e9-bcaf-fe51f06aee91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:46.024830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74b665f1-7307-41e9-bcaf-fe51f06aee91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:46.025607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74b665f1-7307-41e9-bcaf-fe51f06aee91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:46.026462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-74b665f1-7307-41e9-bcaf-fe51f06aee91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:46.642357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1c2c4d50-68dc-47ad-b4e1-a9e55ddf014b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:46.643998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1c2c4d50-68dc-47ad-b4e1-a9e55ddf014b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:46.679316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c2c4d50-68dc-47ad-b4e1-a9e55ddf014b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:46.687294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c2c4d50-68dc-47ad-b4e1-a9e55ddf014b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:46.688092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c2c4d50-68dc-47ad-b4e1-a9e55ddf014b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:46.689190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c2c4d50-68dc-47ad-b4e1-a9e55ddf014b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:46.693875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c2c4d50-68dc-47ad-b4e1-a9e55ddf014b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:46.695924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c2c4d50-68dc-47ad-b4e1-a9e55ddf014b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:47.235467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1c2c4d50-68dc-47ad-b4e1-a9e55ddf014b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:47.247115 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1c2c4d50-68dc-47ad-b4e1-a9e55ddf014b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1503 microversion: 2.1 time: 0.609632 Aug 27 05:26:47.248047 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2947/5896] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:46 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1503 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:47.280349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b71d5ad-b9e5-4b94-9c09-3c726be86120 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:47.281776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b71d5ad-b9e5-4b94-9c09-3c726be86120 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:47.310112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b71d5ad-b9e5-4b94-9c09-3c726be86120 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:47.311570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b71d5ad-b9e5-4b94-9c09-3c726be86120 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:47.312634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b71d5ad-b9e5-4b94-9c09-3c726be86120 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:47.335136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b71d5ad-b9e5-4b94-9c09-3c726be86120 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:47.347552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b71d5ad-b9e5-4b94-9c09-3c726be86120 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:47.348427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b71d5ad-b9e5-4b94-9c09-3c726be86120 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:47.377080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-74b665f1-7307-41e9-bcaf-fe51f06aee91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:47.389416 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-74b665f1-7307-41e9-bcaf-fe51f06aee91 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 1.396816 Aug 27 05:26:47.390683 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2950/5897] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:45 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:47.584377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-979103767", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b22082a4-5b69-426a-b228-4ee7d0a48e79"}], "security_groups": [{"name": "tempest-securitygroup--381554393"}], "key_name": "tempest-keypair-1229346458", "user_data": "}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:47.839742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4b71d5ad-b9e5-4b94-9c09-3c726be86120 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:47.851431 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b71d5ad-b9e5-4b94-9c09-3c726be86120 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1515 microversion: 2.1 time: 0.573442 Aug 27 05:26:47.863621 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2948/5898] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:47 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1515 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:47.874630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c580b3b0-a9d8-40f2-8e4e-883420d1df67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:47.877853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c580b3b0-a9d8-40f2-8e4e-883420d1df67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 8b08594c-ec55-4e8f-8961-f9ef4c2ddb73] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:47.893603 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c580b3b0-a9d8-40f2-8e4e-883420d1df67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] HTTP exception thrown: Instance 8b08594c-ec55-4e8f-8961-f9ef4c2ddb73 could not be found. Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c580b3b0-a9d8-40f2-8e4e-883420d1df67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Request method failure captured: Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/8b08594c-ec55-4e8f-8961-f9ef4c2ddb73/action HTTP/1.1 Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 14 Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCarXzQEeWD_yg-Yv3x-e6u_WeJK0H4zHIc0K2ifAeEz5lrEXCdSGI--LvFU55RmwGwdxJyIQb1oGJryeM85dpPE-6Bdt7QpTLIjsEre7jimq6F9GiGD3yK_ZjeKRtTqhKCIODh0xkoCo04wlC3mPfhPebArjlTk0PKLudgc3mohZyhg Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_43652021c7e84156955f4bdaf72aabba", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: f80e7dad058f44b9967a5a2f95123a9f Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: {"rescue": {}} Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 8b08594c-ec55-4e8f-8961-f9ef4c2ddb73 could not be found. Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '8b08594c-ec55-4e8f-8961-f9ef4c2ddb73', 'body': {'rescue': {}}} Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b08594c-ec55-4e8f-8961-f9ef4c2ddb73 could not be found. Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b08594c-ec55-4e8f-8961-f9ef4c2ddb73 could not be found. Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:47.900822 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:47.915478 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:47.915478 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:47.915478 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:47.915478 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:47.915478 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b08594c-ec55-4e8f-8961-f9ef4c2ddb73 could not be found. Aug 27 05:26:47.915478 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:47.915478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c580b3b0-a9d8-40f2-8e4e-883420d1df67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Returning 404 to user: Instance 8b08594c-ec55-4e8f-8961-f9ef4c2ddb73 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:47.915478 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c580b3b0-a9d8-40f2-8e4e-883420d1df67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/8b08594c-ec55-4e8f-8961-f9ef4c2ddb73/action" status: 404 len: 111 microversion: 2.1 time: 0.042067 Aug 27 05:26:47.925280 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2949/5899] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:47 2022] POST /compute/v2.1/servers/8b08594c-ec55-4e8f-8961-f9ef4c2ddb73/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:26:47.945496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f22edda-0c57-4998-9754-399ccb3d6728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:47.947082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f22edda-0c57-4998-9754-399ccb3d6728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:47.986214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f22edda-0c57-4998-9754-399ccb3d6728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:47.987320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f22edda-0c57-4998-9754-399ccb3d6728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:47.988328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f22edda-0c57-4998-9754-399ccb3d6728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:47.989936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f22edda-0c57-4998-9754-399ccb3d6728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:47.991259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f22edda-0c57-4998-9754-399ccb3d6728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:47.992389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f22edda-0c57-4998-9754-399ccb3d6728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:48.026106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] validate_networks() for [('b22082a4-5b69-426a-b228-4ee7d0a48e79', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:26:48.230159 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f22edda-0c57-4998-9754-399ccb3d6728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/action" status: 202 len: 0 microversion: 2.1 time: 0.300399 Aug 27 05:26:48.232579 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2950/5900] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:47 2022] POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:26:48.256329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6744a35c-d2a3-479b-b358-0343b95f4cce tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:48.268928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6744a35c-d2a3-479b-b358-0343b95f4cce tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:48.294302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6744a35c-d2a3-479b-b358-0343b95f4cce tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:48.295652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6744a35c-d2a3-479b-b358-0343b95f4cce tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:48.296842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6744a35c-d2a3-479b-b358-0343b95f4cce tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:48.298497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6744a35c-d2a3-479b-b358-0343b95f4cce tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:48.299729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6744a35c-d2a3-479b-b358-0343b95f4cce tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:48.300814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6744a35c-d2a3-479b-b358-0343b95f4cce tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:48.782298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6744a35c-d2a3-479b-b358-0343b95f4cce tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:48.808802 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6744a35c-d2a3-479b-b358-0343b95f4cce tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1520 microversion: 2.1 time: 0.570083 Aug 27 05:26:48.810759 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2951/5901] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:48 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1520 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:48.838338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5beef07-67c0-48e5-8df6-950cf355238e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:48.839418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e5beef07-67c0-48e5-8df6-950cf355238e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:48.847619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5beef07-67c0-48e5-8df6-950cf355238e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:48.850092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5beef07-67c0-48e5-8df6-950cf355238e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:48.850788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5beef07-67c0-48e5-8df6-950cf355238e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:48.851890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5beef07-67c0-48e5-8df6-950cf355238e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:48.852800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5beef07-67c0-48e5-8df6-950cf355238e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:48.853662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5beef07-67c0-48e5-8df6-950cf355238e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:49.249786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e5beef07-67c0-48e5-8df6-950cf355238e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:49.268133 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e5beef07-67c0-48e5-8df6-950cf355238e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.437573 Aug 27 05:26:49.277374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:26:49.279355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:26:49.279757 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2952/5902] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:48 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:49.287031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:26:49.289261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:26:49.298284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:26:49.315348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:49.320823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:49.322040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:49.323137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:49.323874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:49.324495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:49.368092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:26:49.384025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Getting quotas for user 43fc751d620242208608be8bc55ae86d and project d70b9f70261e4f15a6d6d740c66e4cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:26:49.426908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:26:49.430915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:26:49.526097 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f91c1b23-bbbc-49da-99e2-dfad30bb59ed tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.951180 Aug 27 05:26:49.534117 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2951/5903] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:26:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:26:49.546626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-539348b0-d824-44ee-ac6b-6ff4674446f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:49.547839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-539348b0-d824-44ee-ac6b-6ff4674446f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:49.701991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-539348b0-d824-44ee-ac6b-6ff4674446f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:49.726819 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-539348b0-d824-44ee-ac6b-6ff4674446f8 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1241 microversion: 2.1 time: 0.187338 Aug 27 05:26:49.728427 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2953/5904] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:49 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1241 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:49.835480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2e1d8c11-a2b9-4f7b-976f-44d98cdc0d05 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:49.836232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2e1d8c11-a2b9-4f7b-976f-44d98cdc0d05 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:49.846625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1d8c11-a2b9-4f7b-976f-44d98cdc0d05 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:49.847443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1d8c11-a2b9-4f7b-976f-44d98cdc0d05 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:49.847815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1d8c11-a2b9-4f7b-976f-44d98cdc0d05 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:49.849758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1d8c11-a2b9-4f7b-976f-44d98cdc0d05 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:49.852174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1d8c11-a2b9-4f7b-976f-44d98cdc0d05 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:49.852655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1d8c11-a2b9-4f7b-976f-44d98cdc0d05 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.161654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2e1d8c11-a2b9-4f7b-976f-44d98cdc0d05 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:50.221754 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2e1d8c11-a2b9-4f7b-976f-44d98cdc0d05 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1500 microversion: 2.1 time: 0.390032 Aug 27 05:26:50.227336 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2952/5905] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:49 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1500 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:50.258453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:50.263274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:50.285037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.287023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.288280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.289933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.291156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.292289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.314545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8455906d-7afd-45de-b321-f50c7a7b7f01 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:50.320091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8455906d-7afd-45de-b321-f50c7a7b7f01 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:50.342723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:50.347882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8455906d-7afd-45de-b321-f50c7a7b7f01 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.353026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lazy-loading 'flavor' on Instance uuid dc5f3e93-46ed-46f2-87c0-fffa21768054 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:26:50.359377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8455906d-7afd-45de-b321-f50c7a7b7f01 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.364920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8455906d-7afd-45de-b321-f50c7a7b7f01 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.369568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8455906d-7afd-45de-b321-f50c7a7b7f01 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.375669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8455906d-7afd-45de-b321-f50c7a7b7f01 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.378562 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] HTTP exception thrown: Cannot 'rescue' instance dc5f3e93-46ed-46f2-87c0-fffa21768054 while it is in vm_state paused Aug 27 05:26:50.379838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8455906d-7afd-45de-b321-f50c7a7b7f01 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Request method failure captured: Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/action HTTP/1.1 Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 14 Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCarXzQEeWD_yg-Yv3x-e6u_WeJK0H4zHIc0K2ifAeEz5lrEXCdSGI--LvFU55RmwGwdxJyIQb1oGJryeM85dpPE-6Bdt7QpTLIjsEre7jimq6F9GiGD3yK_ZjeKRtTqhKCIODh0xkoCo04wlC3mPfhPebArjlTk0PKLudgc3mohZyhg Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_43652021c7e84156955f4bdaf72aabba", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: f80e7dad058f44b9967a5a2f95123a9f Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: {"rescue": {}} Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot 'rescue' instance dc5f3e93-46ed-46f2-87c0-fffa21768054 while it is in vm_state paused Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'dc5f3e93-46ed-46f2-87c0-fffa21768054', 'body': {'rescue': {}}} Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dc5f3e93-46ed-46f2-87c0-fffa21768054 in vm_state paused. Cannot rescue while the instance is in this state. Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance dc5f3e93-46ed-46f2-87c0-fffa21768054 while it is in vm_state paused Aug 27 05:26:50.381276 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:50.390867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:50.390867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:50.390867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:50.390867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:50.390867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:50.390867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:50.390867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:50.390867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance dc5f3e93-46ed-46f2-87c0-fffa21768054 while it is in vm_state paused Aug 27 05:26:50.390867 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:26:50.390867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Returning 409 to user: Cannot 'rescue' instance dc5f3e93-46ed-46f2-87c0-fffa21768054 while it is in vm_state paused {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:50.390867 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f29b915c-53d3-4e88-907b-321c1a0376aa tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/action" status: 409 len: 144 microversion: 2.1 time: 0.132452 Aug 27 05:26:50.398349 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2954/5906] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:50 2022] POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/action => generated 144 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:26:50.408024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-29b3f794-fc78-4ba6-8ab5-68ea139927cd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:50.409754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-29b3f794-fc78-4ba6-8ab5-68ea139927cd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:50.419209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29b3f794-fc78-4ba6-8ab5-68ea139927cd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.419829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29b3f794-fc78-4ba6-8ab5-68ea139927cd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.420393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29b3f794-fc78-4ba6-8ab5-68ea139927cd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.421213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29b3f794-fc78-4ba6-8ab5-68ea139927cd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.421702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29b3f794-fc78-4ba6-8ab5-68ea139927cd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.422147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-29b3f794-fc78-4ba6-8ab5-68ea139927cd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.568959 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-29b3f794-fc78-4ba6-8ab5-68ea139927cd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/action" status: 202 len: 0 microversion: 2.1 time: 0.170002 Aug 27 05:26:50.575952 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2955/5907] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:50 2022] POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:26:50.591245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a3bd5be-7186-4af9-8c04-bb5567012d27 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:50.593830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a3bd5be-7186-4af9-8c04-bb5567012d27 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:50.608996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a3bd5be-7186-4af9-8c04-bb5567012d27 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.610717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a3bd5be-7186-4af9-8c04-bb5567012d27 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.612305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a3bd5be-7186-4af9-8c04-bb5567012d27 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.613810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a3bd5be-7186-4af9-8c04-bb5567012d27 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.614652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a3bd5be-7186-4af9-8c04-bb5567012d27 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.615602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a3bd5be-7186-4af9-8c04-bb5567012d27 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.816689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8455906d-7afd-45de-b321-f50c7a7b7f01 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:50.828274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8455906d-7afd-45de-b321-f50c7a7b7f01 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.523407 Aug 27 05:26:50.835746 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2953/5908] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:50 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:50.855381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4fa901b-e843-4304-b603-fe362b17f967 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:50.856435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4fa901b-e843-4304-b603-fe362b17f967 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:50.866313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4fa901b-e843-4304-b603-fe362b17f967 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.867876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4fa901b-e843-4304-b603-fe362b17f967 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.870801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4fa901b-e843-4304-b603-fe362b17f967 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.872241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4fa901b-e843-4304-b603-fe362b17f967 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.873549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4fa901b-e843-4304-b603-fe362b17f967 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.878839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4fa901b-e843-4304-b603-fe362b17f967 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.950496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1a3bd5be-7186-4af9-8c04-bb5567012d27 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:50.990459 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a3bd5be-7186-4af9-8c04-bb5567012d27 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1507 microversion: 2.1 time: 0.402383 Aug 27 05:26:51.000068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b4fa901b-e843-4304-b603-fe362b17f967 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:51.015842 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2956/5909] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:50 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:51.034609 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4fa901b-e843-4304-b603-fe362b17f967 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1237 microversion: 2.1 time: 0.195842 Aug 27 05:26:51.035816 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2954/5910] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:50 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1237 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:51.871924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-19e78666-5a20-4a55-af14-d1babb85bc6b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:51.872546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-19e78666-5a20-4a55-af14-d1babb85bc6b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:51.886975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19e78666-5a20-4a55-af14-d1babb85bc6b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:51.889803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19e78666-5a20-4a55-af14-d1babb85bc6b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:51.890947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19e78666-5a20-4a55-af14-d1babb85bc6b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:51.892365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19e78666-5a20-4a55-af14-d1babb85bc6b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:51.893265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19e78666-5a20-4a55-af14-d1babb85bc6b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:51.894012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19e78666-5a20-4a55-af14-d1babb85bc6b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:52.027071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a465c3ab-f849-48cf-bcc7-3ab52ab209c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:52.027071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a465c3ab-f849-48cf-bcc7-3ab52ab209c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:52.047879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a465c3ab-f849-48cf-bcc7-3ab52ab209c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:52.051140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a465c3ab-f849-48cf-bcc7-3ab52ab209c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:52.052445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a465c3ab-f849-48cf-bcc7-3ab52ab209c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:52.054127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a465c3ab-f849-48cf-bcc7-3ab52ab209c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:52.057061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a465c3ab-f849-48cf-bcc7-3ab52ab209c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:52.057911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a465c3ab-f849-48cf-bcc7-3ab52ab209c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:52.356821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-19e78666-5a20-4a55-af14-d1babb85bc6b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:52.383926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-19e78666-5a20-4a55-af14-d1babb85bc6b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.515607 Aug 27 05:26:52.395979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a465c3ab-f849-48cf-bcc7-3ab52ab209c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:52.396440 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2957/5911] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:51 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:52.406950 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a465c3ab-f849-48cf-bcc7-3ab52ab209c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1515 microversion: 2.1 time: 0.379016 Aug 27 05:26:52.406950 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2955/5912] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:52 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1515 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:52.433715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-68cd353b-852d-445a-aa72-36ce4d148882 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:52.434845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68cd353b-852d-445a-aa72-36ce4d148882 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:52.487535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68cd353b-852d-445a-aa72-36ce4d148882 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:52.494061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68cd353b-852d-445a-aa72-36ce4d148882 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:52.498508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68cd353b-852d-445a-aa72-36ce4d148882 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:52.499920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68cd353b-852d-445a-aa72-36ce4d148882 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:52.503461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68cd353b-852d-445a-aa72-36ce4d148882 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:52.504881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68cd353b-852d-445a-aa72-36ce4d148882 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:52.639135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-68cd353b-852d-445a-aa72-36ce4d148882 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:52.654938 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-68cd353b-852d-445a-aa72-36ce4d148882 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1299 microversion: 2.1 time: 0.256148 Aug 27 05:26:52.672060 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2958/5913] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:52 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1299 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:53.415200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e810d910-31d0-43d7-bedb-bcdd12282380 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:53.417086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e810d910-31d0-43d7-bedb-bcdd12282380 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:53.430684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e810d910-31d0-43d7-bedb-bcdd12282380 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:53.435787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e810d910-31d0-43d7-bedb-bcdd12282380 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:53.436589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e810d910-31d0-43d7-bedb-bcdd12282380 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:53.437450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e810d910-31d0-43d7-bedb-bcdd12282380 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:53.438148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e810d910-31d0-43d7-bedb-bcdd12282380 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:53.442973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e810d910-31d0-43d7-bedb-bcdd12282380 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:53.680325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8dfc68a2-47dd-4ba4-91bb-6a181966f34d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:53.680994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8dfc68a2-47dd-4ba4-91bb-6a181966f34d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:53.698508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dfc68a2-47dd-4ba4-91bb-6a181966f34d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:53.712155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dfc68a2-47dd-4ba4-91bb-6a181966f34d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:53.713232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dfc68a2-47dd-4ba4-91bb-6a181966f34d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:53.714610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dfc68a2-47dd-4ba4-91bb-6a181966f34d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:53.720191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dfc68a2-47dd-4ba4-91bb-6a181966f34d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:53.721298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8dfc68a2-47dd-4ba4-91bb-6a181966f34d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:53.740487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e810d910-31d0-43d7-bedb-bcdd12282380 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:53.749911 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e810d910-31d0-43d7-bedb-bcdd12282380 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.339060 Aug 27 05:26:53.752390 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2956/5914] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:53 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:54.039737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8dfc68a2-47dd-4ba4-91bb-6a181966f34d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:54.052814 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8dfc68a2-47dd-4ba4-91bb-6a181966f34d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1366 microversion: 2.1 time: 0.376439 Aug 27 05:26:54.054371 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2959/5915] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:53 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:54.780240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c57af209-2939-4f4b-acc9-bdfa34f1d02a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:54.784833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c57af209-2939-4f4b-acc9-bdfa34f1d02a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:54.803333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c57af209-2939-4f4b-acc9-bdfa34f1d02a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:54.804205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c57af209-2939-4f4b-acc9-bdfa34f1d02a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:54.805048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c57af209-2939-4f4b-acc9-bdfa34f1d02a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:54.806250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c57af209-2939-4f4b-acc9-bdfa34f1d02a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:54.808709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c57af209-2939-4f4b-acc9-bdfa34f1d02a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:54.809847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c57af209-2939-4f4b-acc9-bdfa34f1d02a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:55.077891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-932ecb3c-1ce0-4a47-8045-ca4cb11ebb33 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:55.078657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-932ecb3c-1ce0-4a47-8045-ca4cb11ebb33 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:55.091522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-932ecb3c-1ce0-4a47-8045-ca4cb11ebb33 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:55.093450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-932ecb3c-1ce0-4a47-8045-ca4cb11ebb33 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:55.094206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-932ecb3c-1ce0-4a47-8045-ca4cb11ebb33 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:55.096257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-932ecb3c-1ce0-4a47-8045-ca4cb11ebb33 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:55.097618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-932ecb3c-1ce0-4a47-8045-ca4cb11ebb33 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:55.102154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-932ecb3c-1ce0-4a47-8045-ca4cb11ebb33 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:55.297454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c57af209-2939-4f4b-acc9-bdfa34f1d02a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:55.307789 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c57af209-2939-4f4b-acc9-bdfa34f1d02a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.537964 Aug 27 05:26:55.315265 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2957/5916] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:54 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:55.339634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-fa8fb2ee-3917-48cf-b102-52a7c4361af4 req-8bb33867-f043-4733-a9bd-a4bd89a452c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "778fae4c-132e-4000-9d06-3741a2cb627d", "tag": "b91252b2-16b9-4df2-94ea-253d93a6cff3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:55.350842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fa8fb2ee-3917-48cf-b102-52a7c4361af4 req-8bb33867-f043-4733-a9bd-a4bd89a452c4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:55.351666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fa8fb2ee-3917-48cf-b102-52a7c4361af4 req-8bb33867-f043-4733-a9bd-a4bd89a452c4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:55.352639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fa8fb2ee-3917-48cf-b102-52a7c4361af4 req-8bb33867-f043-4733-a9bd-a4bd89a452c4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:55.371132 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-fa8fb2ee-3917-48cf-b102-52a7c4361af4 req-8bb33867-f043-4733-a9bd-a4bd89a452c4 service nova] Creating event network-changed:b91252b2-16b9-4df2-94ea-253d93a6cff3 for instance 778fae4c-132e-4000-9d06-3741a2cb627d on n-h1-820368-35 Aug 27 05:26:55.378796 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-fa8fb2ee-3917-48cf-b102-52a7c4361af4 req-8bb33867-f043-4733-a9bd-a4bd89a452c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046544 Aug 27 05:26:55.380283 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2958/5917] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:26:55.428017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5603331e-f6e0-4808-9bb4-d4d5ab07804b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:55.435937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5603331e-f6e0-4808-9bb4-d4d5ab07804b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:55.446842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5603331e-f6e0-4808-9bb4-d4d5ab07804b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:55.447982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5603331e-f6e0-4808-9bb4-d4d5ab07804b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:55.448851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5603331e-f6e0-4808-9bb4-d4d5ab07804b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:55.450417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5603331e-f6e0-4808-9bb4-d4d5ab07804b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:55.456039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-932ecb3c-1ce0-4a47-8045-ca4cb11ebb33 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:55.462608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5603331e-f6e0-4808-9bb4-d4d5ab07804b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:55.463357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5603331e-f6e0-4808-9bb4-d4d5ab07804b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:55.475533 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-932ecb3c-1ce0-4a47-8045-ca4cb11ebb33 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1366 microversion: 2.1 time: 0.398967 Aug 27 05:26:55.476174 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2960/5918] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:55 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:55.504888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-5603331e-f6e0-4808-9bb4-d4d5ab07804b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lazy-loading 'flavor' on Instance uuid dc5f3e93-46ed-46f2-87c0-fffa21768054 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:26:55.633272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:55.648567 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5603331e-f6e0-4808-9bb4-d4d5ab07804b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/action" status: 200 len: 32 microversion: 2.1 time: 0.230717 Aug 27 05:26:55.656190 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2959/5919] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:55 2022] POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/action => generated 32 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 05:26:55.668122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1d262f31-7e2d-48a8-9ac4-28cbe9a88b2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:55.669779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1d262f31-7e2d-48a8-9ac4-28cbe9a88b2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:55.684827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d262f31-7e2d-48a8-9ac4-28cbe9a88b2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:55.685403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d262f31-7e2d-48a8-9ac4-28cbe9a88b2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:55.686303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d262f31-7e2d-48a8-9ac4-28cbe9a88b2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:55.689208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d262f31-7e2d-48a8-9ac4-28cbe9a88b2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:55.690252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d262f31-7e2d-48a8-9ac4-28cbe9a88b2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:55.691286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1d262f31-7e2d-48a8-9ac4-28cbe9a88b2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:55.968652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1d262f31-7e2d-48a8-9ac4-28cbe9a88b2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:55.987179 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1d262f31-7e2d-48a8-9ac4-28cbe9a88b2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.326986 Aug 27 05:26:55.988408 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2961/5920] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:55 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:56.345661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a46f03fa-923a-4f28-ad22-8da485efe504 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:56.346612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a46f03fa-923a-4f28-ad22-8da485efe504 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:56.363443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a46f03fa-923a-4f28-ad22-8da485efe504 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:56.364680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a46f03fa-923a-4f28-ad22-8da485efe504 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:56.365690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a46f03fa-923a-4f28-ad22-8da485efe504 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:56.367277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a46f03fa-923a-4f28-ad22-8da485efe504 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:56.368307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a46f03fa-923a-4f28-ad22-8da485efe504 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:56.369320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a46f03fa-923a-4f28-ad22-8da485efe504 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:56.509350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-92f8080a-ab7e-44f8-9adb-48b55b3bba90 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:56.512852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-92f8080a-ab7e-44f8-9adb-48b55b3bba90 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:56.525621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92f8080a-ab7e-44f8-9adb-48b55b3bba90 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:56.526895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92f8080a-ab7e-44f8-9adb-48b55b3bba90 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:56.527968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92f8080a-ab7e-44f8-9adb-48b55b3bba90 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:56.529110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92f8080a-ab7e-44f8-9adb-48b55b3bba90 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:56.529918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92f8080a-ab7e-44f8-9adb-48b55b3bba90 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:56.530902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92f8080a-ab7e-44f8-9adb-48b55b3bba90 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:56.756263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a46f03fa-923a-4f28-ad22-8da485efe504 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:56.767659 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a46f03fa-923a-4f28-ad22-8da485efe504 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.434198 Aug 27 05:26:56.780592 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2960/5921] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:56 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:56.843391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-92f8080a-ab7e-44f8-9adb-48b55b3bba90 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:56.855036 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-92f8080a-ab7e-44f8-9adb-48b55b3bba90 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1366 microversion: 2.1 time: 0.353612 Aug 27 05:26:56.855916 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2962/5922] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:56 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:57.028266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b917f1f9-2dd9-4457-94c2-7b539a2c0a42 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:57.029158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b917f1f9-2dd9-4457-94c2-7b539a2c0a42 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:57.039516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b917f1f9-2dd9-4457-94c2-7b539a2c0a42 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:57.040107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b917f1f9-2dd9-4457-94c2-7b539a2c0a42 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:57.040800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b917f1f9-2dd9-4457-94c2-7b539a2c0a42 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:57.041963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b917f1f9-2dd9-4457-94c2-7b539a2c0a42 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:57.042702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b917f1f9-2dd9-4457-94c2-7b539a2c0a42 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:57.043367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b917f1f9-2dd9-4457-94c2-7b539a2c0a42 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:57.301386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b917f1f9-2dd9-4457-94c2-7b539a2c0a42 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:57.317605 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b917f1f9-2dd9-4457-94c2-7b539a2c0a42 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.293905 Aug 27 05:26:57.319965 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2961/5923] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:57 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:57.798574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89a8657a-6a5e-4d31-8153-f140e1d61993 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:57.804556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89a8657a-6a5e-4d31-8153-f140e1d61993 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:57.827987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8657a-6a5e-4d31-8153-f140e1d61993 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:57.829203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8657a-6a5e-4d31-8153-f140e1d61993 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:57.830228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8657a-6a5e-4d31-8153-f140e1d61993 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:57.832075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8657a-6a5e-4d31-8153-f140e1d61993 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:57.833214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8657a-6a5e-4d31-8153-f140e1d61993 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:57.834289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8657a-6a5e-4d31-8153-f140e1d61993 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:57.901779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-00fbfafb-44e6-4d7c-be41-2a58aa7313ae tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:57.903900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-00fbfafb-44e6-4d7c-be41-2a58aa7313ae tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:57.945243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00fbfafb-44e6-4d7c-be41-2a58aa7313ae tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:57.945773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00fbfafb-44e6-4d7c-be41-2a58aa7313ae tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:57.946500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00fbfafb-44e6-4d7c-be41-2a58aa7313ae tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:57.947012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00fbfafb-44e6-4d7c-be41-2a58aa7313ae tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:57.947513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00fbfafb-44e6-4d7c-be41-2a58aa7313ae tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:57.947952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00fbfafb-44e6-4d7c-be41-2a58aa7313ae tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:58.234127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89a8657a-6a5e-4d31-8153-f140e1d61993 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:58.263171 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89a8657a-6a5e-4d31-8153-f140e1d61993 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.472847 Aug 27 05:26:58.270770 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2963/5924] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:57 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:58.349675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-25cdb0f8-255f-4c05-9abc-5abc86a51747 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:58.350990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-25cdb0f8-255f-4c05-9abc-5abc86a51747 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:58.359672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cdb0f8-255f-4c05-9abc-5abc86a51747 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:58.360862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cdb0f8-255f-4c05-9abc-5abc86a51747 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:58.360862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cdb0f8-255f-4c05-9abc-5abc86a51747 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:58.361298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cdb0f8-255f-4c05-9abc-5abc86a51747 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:58.366583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cdb0f8-255f-4c05-9abc-5abc86a51747 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:58.368575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25cdb0f8-255f-4c05-9abc-5abc86a51747 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:58.385139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-00fbfafb-44e6-4d7c-be41-2a58aa7313ae tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:58.412637 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-00fbfafb-44e6-4d7c-be41-2a58aa7313ae tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1366 microversion: 2.1 time: 0.515282 Aug 27 05:26:58.416688 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2962/5925] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:57 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:58.776958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-25cdb0f8-255f-4c05-9abc-5abc86a51747 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:58.826016 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-25cdb0f8-255f-4c05-9abc-5abc86a51747 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.482592 Aug 27 05:26:58.835602 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2964/5926] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:58 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:59.313306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb3f409e-01b6-4ac0-a17d-82dc2664acb8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:59.314242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb3f409e-01b6-4ac0-a17d-82dc2664acb8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:59.339811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:59.344721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb3f409e-01b6-4ac0-a17d-82dc2664acb8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:59.345513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb3f409e-01b6-4ac0-a17d-82dc2664acb8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:59.346142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb3f409e-01b6-4ac0-a17d-82dc2664acb8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:59.348720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb3f409e-01b6-4ac0-a17d-82dc2664acb8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:59.349380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb3f409e-01b6-4ac0-a17d-82dc2664acb8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:59.351773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb3f409e-01b6-4ac0-a17d-82dc2664acb8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:59.419539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:59.462454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9880f31-e69f-415a-8b3f-705aa440f555 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:59.463696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c9880f31-e69f-415a-8b3f-705aa440f555 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:59.475488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9880f31-e69f-415a-8b3f-705aa440f555 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:59.476335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9880f31-e69f-415a-8b3f-705aa440f555 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:59.478394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9880f31-e69f-415a-8b3f-705aa440f555 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:59.480391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9880f31-e69f-415a-8b3f-705aa440f555 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:59.481862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9880f31-e69f-415a-8b3f-705aa440f555 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:59.483563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9880f31-e69f-415a-8b3f-705aa440f555 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:59.711209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:59.888225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c9880f31-e69f-415a-8b3f-705aa440f555 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:59.912900 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c9880f31-e69f-415a-8b3f-705aa440f555 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1366 microversion: 2.1 time: 0.454925 Aug 27 05:26:59.922536 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2965/5927] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:59 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:59.942701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2ce532cb-acd5-42de-9618-62446e5d3b9c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:59.953462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2ce532cb-acd5-42de-9618-62446e5d3b9c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:59.971326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce532cb-acd5-42de-9618-62446e5d3b9c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:59.972133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce532cb-acd5-42de-9618-62446e5d3b9c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:59.973296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce532cb-acd5-42de-9618-62446e5d3b9c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:59.976470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce532cb-acd5-42de-9618-62446e5d3b9c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:59.977470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce532cb-acd5-42de-9618-62446e5d3b9c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:59.979878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce532cb-acd5-42de-9618-62446e5d3b9c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:59.987189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb3f409e-01b6-4ac0-a17d-82dc2664acb8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:00.012959 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb3f409e-01b6-4ac0-a17d-82dc2664acb8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.704655 Aug 27 05:27:00.013573 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2963/5928] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:59 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:00.276095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2ce532cb-acd5-42de-9618-62446e5d3b9c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:00.294410 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2ce532cb-acd5-42de-9618-62446e5d3b9c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.366164 Aug 27 05:27:00.296011 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2966/5929] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:59 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:00.949594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29b6c34f-717e-438d-9575-3278fc7cfbac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:00.954015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-29b6c34f-717e-438d-9575-3278fc7cfbac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:00.982047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29b6c34f-717e-438d-9575-3278fc7cfbac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:00.982561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29b6c34f-717e-438d-9575-3278fc7cfbac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:00.993580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29b6c34f-717e-438d-9575-3278fc7cfbac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:00.993580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29b6c34f-717e-438d-9575-3278fc7cfbac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:00.993580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29b6c34f-717e-438d-9575-3278fc7cfbac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:00.993580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29b6c34f-717e-438d-9575-3278fc7cfbac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:01.061372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4e98a0a9-d37f-4ddc-a7c3-96ce013be8e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:01.063601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4e98a0a9-d37f-4ddc-a7c3-96ce013be8e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:01.078744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:01.082605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98a0a9-d37f-4ddc-a7c3-96ce013be8e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:01.083923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98a0a9-d37f-4ddc-a7c3-96ce013be8e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:01.085727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98a0a9-d37f-4ddc-a7c3-96ce013be8e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:01.087459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98a0a9-d37f-4ddc-a7c3-96ce013be8e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:01.089103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98a0a9-d37f-4ddc-a7c3-96ce013be8e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:01.090439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e98a0a9-d37f-4ddc-a7c3-96ce013be8e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:01.344119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-29b6c34f-717e-438d-9575-3278fc7cfbac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:01.369651 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-29b6c34f-717e-438d-9575-3278fc7cfbac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1366 microversion: 2.1 time: 0.424094 Aug 27 05:27:01.395594 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2964/5930] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:00 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:01.411697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4a73f172-fcb1-4378-8e98-c05eeb721b22 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:01.413970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4a73f172-fcb1-4378-8e98-c05eeb721b22 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:01.429852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a73f172-fcb1-4378-8e98-c05eeb721b22 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:01.433862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a73f172-fcb1-4378-8e98-c05eeb721b22 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:01.436438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a73f172-fcb1-4378-8e98-c05eeb721b22 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:01.438008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a73f172-fcb1-4378-8e98-c05eeb721b22 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:01.446422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a73f172-fcb1-4378-8e98-c05eeb721b22 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:01.447538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a73f172-fcb1-4378-8e98-c05eeb721b22 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:01.450219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4e98a0a9-d37f-4ddc-a7c3-96ce013be8e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:01.487241 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4e98a0a9-d37f-4ddc-a7c3-96ce013be8e1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1526 microversion: 2.1 time: 0.435015 Aug 27 05:27:01.500080 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2967/5931] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:01 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1526 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:01.769638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4a73f172-fcb1-4378-8e98-c05eeb721b22 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:01.779286 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4a73f172-fcb1-4378-8e98-c05eeb721b22 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.382040 Aug 27 05:27:01.780147 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2965/5932] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:01 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:02.421897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b818bd2-d39b-4308-85df-e34298ddcd63 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:02.424402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b818bd2-d39b-4308-85df-e34298ddcd63 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:02.436513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b818bd2-d39b-4308-85df-e34298ddcd63 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:02.437521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b818bd2-d39b-4308-85df-e34298ddcd63 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:02.438378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b818bd2-d39b-4308-85df-e34298ddcd63 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:02.440016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b818bd2-d39b-4308-85df-e34298ddcd63 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:02.441150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b818bd2-d39b-4308-85df-e34298ddcd63 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:02.442881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b818bd2-d39b-4308-85df-e34298ddcd63 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:02.525617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c397fc0c-feaf-4ebd-8a7b-8cd4a3924171 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:02.527708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c397fc0c-feaf-4ebd-8a7b-8cd4a3924171 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:02.543874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c397fc0c-feaf-4ebd-8a7b-8cd4a3924171 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:02.547706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c397fc0c-feaf-4ebd-8a7b-8cd4a3924171 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:02.548948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c397fc0c-feaf-4ebd-8a7b-8cd4a3924171 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:02.550635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c397fc0c-feaf-4ebd-8a7b-8cd4a3924171 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:02.552313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c397fc0c-feaf-4ebd-8a7b-8cd4a3924171 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:02.553433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c397fc0c-feaf-4ebd-8a7b-8cd4a3924171 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:02.856195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4b818bd2-d39b-4308-85df-e34298ddcd63 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:02.878048 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b818bd2-d39b-4308-85df-e34298ddcd63 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1366 microversion: 2.1 time: 0.462735 Aug 27 05:27:02.880170 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2968/5933] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:02 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:02.888966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f071d934-9e94-4208-9884-7454deecaaa2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:02.890719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f071d934-9e94-4208-9884-7454deecaaa2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:02.900022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f071d934-9e94-4208-9884-7454deecaaa2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:02.900888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f071d934-9e94-4208-9884-7454deecaaa2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:02.901556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f071d934-9e94-4208-9884-7454deecaaa2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:02.902537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f071d934-9e94-4208-9884-7454deecaaa2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:02.903917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f071d934-9e94-4208-9884-7454deecaaa2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:02.904617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f071d934-9e94-4208-9884-7454deecaaa2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:02.905705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c397fc0c-feaf-4ebd-8a7b-8cd4a3924171 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:02.920436 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c397fc0c-feaf-4ebd-8a7b-8cd4a3924171 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1508 microversion: 2.1 time: 0.401598 Aug 27 05:27:02.922523 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2966/5934] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:02 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1508 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:02.937451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5d43a404-91c6-4c4a-919e-f05b9223663a req-b66d941c-4a75-49f5-8b32-ce9afd89620c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "778fae4c-132e-4000-9d06-3741a2cb627d", "name": "network-vif-plugged", "status": "completed", "tag": "b91252b2-16b9-4df2-94ea-253d93a6cff3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:02.985296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5d43a404-91c6-4c4a-919e-f05b9223663a req-b66d941c-4a75-49f5-8b32-ce9afd89620c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:02.986506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5d43a404-91c6-4c4a-919e-f05b9223663a req-b66d941c-4a75-49f5-8b32-ce9afd89620c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:02.997987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5d43a404-91c6-4c4a-919e-f05b9223663a req-b66d941c-4a75-49f5-8b32-ce9afd89620c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:03.031771 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5d43a404-91c6-4c4a-919e-f05b9223663a req-b66d941c-4a75-49f5-8b32-ce9afd89620c service nova] Creating event network-vif-plugged:b91252b2-16b9-4df2-94ea-253d93a6cff3 for instance 778fae4c-132e-4000-9d06-3741a2cb627d on n-h1-820368-35 Aug 27 05:27:03.082934 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5d43a404-91c6-4c4a-919e-f05b9223663a req-b66d941c-4a75-49f5-8b32-ce9afd89620c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155044 Aug 27 05:27:03.085810 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2967/5935] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:03.163165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f071d934-9e94-4208-9884-7454deecaaa2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:03.168191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:03.180074 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f071d934-9e94-4208-9884-7454deecaaa2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.297585 Aug 27 05:27:03.181029 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2969/5936] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:02 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:03.911526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-099214df-ccc1-4f4c-bdd6-4c2bcb9246c7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:03.912359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-099214df-ccc1-4f4c-bdd6-4c2bcb9246c7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:03.920450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-099214df-ccc1-4f4c-bdd6-4c2bcb9246c7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:03.921084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-099214df-ccc1-4f4c-bdd6-4c2bcb9246c7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:03.922182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-099214df-ccc1-4f4c-bdd6-4c2bcb9246c7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:03.923447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-099214df-ccc1-4f4c-bdd6-4c2bcb9246c7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:03.924302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-099214df-ccc1-4f4c-bdd6-4c2bcb9246c7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:03.925026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-099214df-ccc1-4f4c-bdd6-4c2bcb9246c7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:03.952399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb1cf732-be4e-48c1-8922-eff44cf4ef77 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:03.955179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cb1cf732-be4e-48c1-8922-eff44cf4ef77 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:03.968826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1cf732-be4e-48c1-8922-eff44cf4ef77 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:03.970003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1cf732-be4e-48c1-8922-eff44cf4ef77 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:03.970990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1cf732-be4e-48c1-8922-eff44cf4ef77 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:03.972778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1cf732-be4e-48c1-8922-eff44cf4ef77 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:03.973937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1cf732-be4e-48c1-8922-eff44cf4ef77 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:03.975230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb1cf732-be4e-48c1-8922-eff44cf4ef77 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:04.266479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb1cf732-be4e-48c1-8922-eff44cf4ef77 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:04.285091 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb1cf732-be4e-48c1-8922-eff44cf4ef77 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1508 microversion: 2.1 time: 0.340069 Aug 27 05:27:04.286020 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2970/5937] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:03 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:04.294842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01a18e0d-5702-4f68-aee0-f6004d1821f7 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:04.296283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-01a18e0d-5702-4f68-aee0-f6004d1821f7 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:04.308313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a18e0d-5702-4f68-aee0-f6004d1821f7 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:04.309512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a18e0d-5702-4f68-aee0-f6004d1821f7 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:04.310814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a18e0d-5702-4f68-aee0-f6004d1821f7 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:04.312457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a18e0d-5702-4f68-aee0-f6004d1821f7 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:04.313542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a18e0d-5702-4f68-aee0-f6004d1821f7 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:04.314446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01a18e0d-5702-4f68-aee0-f6004d1821f7 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:04.371471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-099214df-ccc1-4f4c-bdd6-4c2bcb9246c7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:04.387956 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-099214df-ccc1-4f4c-bdd6-4c2bcb9246c7 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1366 microversion: 2.1 time: 0.480540 Aug 27 05:27:04.388926 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2968/5938] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:03 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:04.746386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-01a18e0d-5702-4f68-aee0-f6004d1821f7 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:04.774043 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01a18e0d-5702-4f68-aee0-f6004d1821f7 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.486037 Aug 27 05:27:04.783376 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2971/5939] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:04 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:05.183295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7246288e-66ae-40ec-998f-92b28bee96ef req-647540a2-cf01-47ed-bf89-72c179620b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64999ba4-bbd9-4d23-9a4c-0caf8eb677b4", "name": "network-vif-unplugged", "status": "completed", "tag": "e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:05.244866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7246288e-66ae-40ec-998f-92b28bee96ef req-647540a2-cf01-47ed-bf89-72c179620b89 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:05.246811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7246288e-66ae-40ec-998f-92b28bee96ef req-647540a2-cf01-47ed-bf89-72c179620b89 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:05.248467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7246288e-66ae-40ec-998f-92b28bee96ef req-647540a2-cf01-47ed-bf89-72c179620b89 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:05.290292 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7246288e-66ae-40ec-998f-92b28bee96ef req-647540a2-cf01-47ed-bf89-72c179620b89 service nova] Creating event network-vif-unplugged:e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf for instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 on n-h2-820368-35 Aug 27 05:27:05.311763 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7246288e-66ae-40ec-998f-92b28bee96ef req-647540a2-cf01-47ed-bf89-72c179620b89 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136741 Aug 27 05:27:05.314319 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2969/5940] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:05.345463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-039991b9-dd0e-4011-b1cd-4d4f918b528c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:05.346522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-039991b9-dd0e-4011-b1cd-4d4f918b528c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:05.354388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-039991b9-dd0e-4011-b1cd-4d4f918b528c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:05.355222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-039991b9-dd0e-4011-b1cd-4d4f918b528c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:05.356046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-039991b9-dd0e-4011-b1cd-4d4f918b528c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:05.356937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-039991b9-dd0e-4011-b1cd-4d4f918b528c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:05.358346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-039991b9-dd0e-4011-b1cd-4d4f918b528c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:05.359243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-039991b9-dd0e-4011-b1cd-4d4f918b528c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:05.442662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ac423a5-2898-42f9-b9d8-002eea348362 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:05.446319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ac423a5-2898-42f9-b9d8-002eea348362 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:05.458844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ac423a5-2898-42f9-b9d8-002eea348362 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:05.460749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ac423a5-2898-42f9-b9d8-002eea348362 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:05.461536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ac423a5-2898-42f9-b9d8-002eea348362 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:05.471473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ac423a5-2898-42f9-b9d8-002eea348362 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:05.473252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ac423a5-2898-42f9-b9d8-002eea348362 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:05.474847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ac423a5-2898-42f9-b9d8-002eea348362 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:06.218227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1ac423a5-2898-42f9-b9d8-002eea348362 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:06.234831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-039991b9-dd0e-4011-b1cd-4d4f918b528c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:06.240128 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ac423a5-2898-42f9-b9d8-002eea348362 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1557 microversion: 2.1 time: 0.810534 Aug 27 05:27:06.245030 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2970/5941] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:05 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1557 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:06.256457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6f2d7b52-0622-4286-ad93-43684bfc3ad0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:06.257231 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-039991b9-dd0e-4011-b1cd-4d4f918b528c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1511 microversion: 2.1 time: 0.915520 Aug 27 05:27:06.258251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6f2d7b52-0622-4286-ad93-43684bfc3ad0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:06.271916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:06.276857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f2d7b52-0622-4286-ad93-43684bfc3ad0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:06.278308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f2d7b52-0622-4286-ad93-43684bfc3ad0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:06.279402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f2d7b52-0622-4286-ad93-43684bfc3ad0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:06.291669 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2972/5942] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:05 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1511 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:06.294342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f2d7b52-0622-4286-ad93-43684bfc3ad0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:06.295799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f2d7b52-0622-4286-ad93-43684bfc3ad0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:06.305169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f2d7b52-0622-4286-ad93-43684bfc3ad0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:06.307454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c781352b-7470-4c6a-9cb7-e4c288ebf8f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:06.312402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c781352b-7470-4c6a-9cb7-e4c288ebf8f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:06.347147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c781352b-7470-4c6a-9cb7-e4c288ebf8f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:06.347147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c781352b-7470-4c6a-9cb7-e4c288ebf8f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:06.348463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c781352b-7470-4c6a-9cb7-e4c288ebf8f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:06.352512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c781352b-7470-4c6a-9cb7-e4c288ebf8f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:06.353439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c781352b-7470-4c6a-9cb7-e4c288ebf8f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:06.354074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c781352b-7470-4c6a-9cb7-e4c288ebf8f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:06.583714 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c781352b-7470-4c6a-9cb7-e4c288ebf8f5 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.302147 Aug 27 05:27:06.584384 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2973/5943] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:27:06 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-interface => generated 285 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:06.600074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e24eed7-a480-4615-9b07-c600b291ee92 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:06.601516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e24eed7-a480-4615-9b07-c600b291ee92 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:06.626805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e24eed7-a480-4615-9b07-c600b291ee92 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:06.630048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e24eed7-a480-4615-9b07-c600b291ee92 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:06.631191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e24eed7-a480-4615-9b07-c600b291ee92 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:06.639241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e24eed7-a480-4615-9b07-c600b291ee92 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:06.643307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e24eed7-a480-4615-9b07-c600b291ee92 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:06.649786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e24eed7-a480-4615-9b07-c600b291ee92 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:06.853783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6f2d7b52-0622-4286-ad93-43684bfc3ad0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:06.872981 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6f2d7b52-0622-4286-ad93-43684bfc3ad0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.618294 Aug 27 05:27:06.879812 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2971/5944] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:06 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:07.049440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e24eed7-a480-4615-9b07-c600b291ee92 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:07.063568 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e24eed7-a480-4615-9b07-c600b291ee92 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1451 microversion: 2.1 time: 0.476955 Aug 27 05:27:07.064901 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2974/5945] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:06 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1451 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:07.164670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:07.165251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:07.185720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.186288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.186738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.192282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.192812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.193250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.260341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lazy-loading 'flavor' on Instance uuid 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:27:07.289186 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Cannot 'shelve' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state shelved_offloaded Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action HTTP/1.1 Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 14 Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: {"shelve": {}} Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: exception: Cannot 'shelve' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state shelved_offloaded Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '64999ba4-bbd9-4d23-9a4c-0caf8eb677b4', 'body': {'shelve': {}}} Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:27:07.300765 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state shelved_offloaded Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state shelved_offloaded Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 409 to user: Cannot 'shelve' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state shelved_offloaded {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bfdc5097-621e-4882-8050-c329b8bff6af tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 409 len: 155 microversion: 2.1 time: 0.146113 Aug 27 05:27:07.310786 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2972/5946] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:07 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 155 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:27:07.332878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a9ca4102-b613-4184-8fa6-7ff3c1fb4d22 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:07.335494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a9ca4102-b613-4184-8fa6-7ff3c1fb4d22 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:07.346908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ca4102-b613-4184-8fa6-7ff3c1fb4d22 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.348441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ca4102-b613-4184-8fa6-7ff3c1fb4d22 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.350903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ca4102-b613-4184-8fa6-7ff3c1fb4d22 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.352667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ca4102-b613-4184-8fa6-7ff3c1fb4d22 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.353811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ca4102-b613-4184-8fa6-7ff3c1fb4d22 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.354886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9ca4102-b613-4184-8fa6-7ff3c1fb4d22 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.482155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a9ca4102-b613-4184-8fa6-7ff3c1fb4d22 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128548) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 05:27:07.646515 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a9ca4102-b613-4184-8fa6-7ff3c1fb4d22 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 202 len: 0 microversion: 2.1 time: 0.333683 Aug 27 05:27:07.647997 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2975/5947] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:07 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:27:07.661509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9b655eb-e2d8-419b-ad51-7ba53fb918fa tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:07.663422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9b655eb-e2d8-419b-ad51-7ba53fb918fa tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:07.690377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9b655eb-e2d8-419b-ad51-7ba53fb918fa tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.693402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9b655eb-e2d8-419b-ad51-7ba53fb918fa tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.694512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9b655eb-e2d8-419b-ad51-7ba53fb918fa tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.698156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9b655eb-e2d8-419b-ad51-7ba53fb918fa tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.700641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9b655eb-e2d8-419b-ad51-7ba53fb918fa tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.702839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9b655eb-e2d8-419b-ad51-7ba53fb918fa tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.952487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ada9a868-f685-42ea-a361-15a7aa4d737b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:07.953121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ada9a868-f685-42ea-a361-15a7aa4d737b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:07.983701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ada9a868-f685-42ea-a361-15a7aa4d737b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.991871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ada9a868-f685-42ea-a361-15a7aa4d737b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.993426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ada9a868-f685-42ea-a361-15a7aa4d737b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.997216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ada9a868-f685-42ea-a361-15a7aa4d737b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.998748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ada9a868-f685-42ea-a361-15a7aa4d737b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:08.000169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ada9a868-f685-42ea-a361-15a7aa4d737b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:08.125520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f9b655eb-e2d8-419b-ad51-7ba53fb918fa tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:08.135791 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9b655eb-e2d8-419b-ad51-7ba53fb918fa tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1459 microversion: 2.1 time: 0.481057 Aug 27 05:27:08.137204 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2973/5948] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:07 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1459 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:08.438873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ada9a868-f685-42ea-a361-15a7aa4d737b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:08.464168 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ada9a868-f685-42ea-a361-15a7aa4d737b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.527804 Aug 27 05:27:08.476327 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2976/5949] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:07 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:08.991293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-521d6b39-e2f9-4542-abc6-3cff34c7b4e0 req-f3d476de-e948-4148-b676-2c27c852f44f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "778fae4c-132e-4000-9d06-3741a2cb627d", "tag": "b91252b2-16b9-4df2-94ea-253d93a6cff3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:09.005122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-521d6b39-e2f9-4542-abc6-3cff34c7b4e0 req-f3d476de-e948-4148-b676-2c27c852f44f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:09.006577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-521d6b39-e2f9-4542-abc6-3cff34c7b4e0 req-f3d476de-e948-4148-b676-2c27c852f44f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:09.007315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-521d6b39-e2f9-4542-abc6-3cff34c7b4e0 req-f3d476de-e948-4148-b676-2c27c852f44f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:09.131982 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-521d6b39-e2f9-4542-abc6-3cff34c7b4e0 req-f3d476de-e948-4148-b676-2c27c852f44f service nova] Creating event network-changed:b91252b2-16b9-4df2-94ea-253d93a6cff3 for instance 778fae4c-132e-4000-9d06-3741a2cb627d on n-h1-820368-35 Aug 27 05:27:09.146185 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-521d6b39-e2f9-4542-abc6-3cff34c7b4e0 req-f3d476de-e948-4148-b676-2c27c852f44f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160471 Aug 27 05:27:09.149662 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2974/5950] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:09.158871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce04bf7d-68cb-4e64-b223-ee01a7f04854 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:09.160546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ce04bf7d-68cb-4e64-b223-ee01a7f04854 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:09.170553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce04bf7d-68cb-4e64-b223-ee01a7f04854 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:09.171351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce04bf7d-68cb-4e64-b223-ee01a7f04854 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:09.171976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce04bf7d-68cb-4e64-b223-ee01a7f04854 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:09.172779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce04bf7d-68cb-4e64-b223-ee01a7f04854 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:09.173329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce04bf7d-68cb-4e64-b223-ee01a7f04854 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:09.173827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce04bf7d-68cb-4e64-b223-ee01a7f04854 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:09.507714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-85a68a28-2638-447b-b46f-44cc1784d998 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:09.511415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-85a68a28-2638-447b-b46f-44cc1784d998 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:09.545300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a68a28-2638-447b-b46f-44cc1784d998 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:09.548251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a68a28-2638-447b-b46f-44cc1784d998 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:09.549014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a68a28-2638-447b-b46f-44cc1784d998 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:09.554985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a68a28-2638-447b-b46f-44cc1784d998 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:09.555975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a68a28-2638-447b-b46f-44cc1784d998 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:09.556720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a68a28-2638-447b-b46f-44cc1784d998 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:10.201161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce04bf7d-68cb-4e64-b223-ee01a7f04854 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:10.215884 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce04bf7d-68cb-4e64-b223-ee01a7f04854 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1459 microversion: 2.1 time: 1.058077 Aug 27 05:27:10.230686 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2977/5951] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:09 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1459 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:10.263889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-85a68a28-2638-447b-b46f-44cc1784d998 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:10.275584 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-85a68a28-2638-447b-b46f-44cc1784d998 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.779446 Aug 27 05:27:10.278057 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2975/5952] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:09 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:11.244969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8404b330-04ad-4dce-b341-c3c035feca1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:11.246037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8404b330-04ad-4dce-b341-c3c035feca1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:11.258930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8404b330-04ad-4dce-b341-c3c035feca1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:11.260099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8404b330-04ad-4dce-b341-c3c035feca1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:11.261214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8404b330-04ad-4dce-b341-c3c035feca1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:11.262676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8404b330-04ad-4dce-b341-c3c035feca1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:11.263748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8404b330-04ad-4dce-b341-c3c035feca1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:11.264720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8404b330-04ad-4dce-b341-c3c035feca1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:11.318029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2fb561e1-2e97-4d63-b50e-38201ed1515e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:11.319253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2fb561e1-2e97-4d63-b50e-38201ed1515e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:11.353365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fb561e1-2e97-4d63-b50e-38201ed1515e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:11.360092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fb561e1-2e97-4d63-b50e-38201ed1515e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:11.369124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fb561e1-2e97-4d63-b50e-38201ed1515e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:11.371416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fb561e1-2e97-4d63-b50e-38201ed1515e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:11.390121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fb561e1-2e97-4d63-b50e-38201ed1515e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:11.390914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2fb561e1-2e97-4d63-b50e-38201ed1515e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:11.785585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8404b330-04ad-4dce-b341-c3c035feca1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:11.833709 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8404b330-04ad-4dce-b341-c3c035feca1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1459 microversion: 2.1 time: 0.597420 Aug 27 05:27:11.839369 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2978/5953] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:11 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1459 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:11.863653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2fb561e1-2e97-4d63-b50e-38201ed1515e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:11.881572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2fb561e1-2e97-4d63-b50e-38201ed1515e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1501 microversion: 2.1 time: 0.568156 Aug 27 05:27:11.882407 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2976/5954] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:11 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1501 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:11.914779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23887f1e-d6cb-49b6-bf99-cf3ccd897db3"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:11.923196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:11.932161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:11.932729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:11.933542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:11.934436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:11.935172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:11.935965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:11.987740 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] HTTP exception thrown: Cannot 'attach_volume' instance dc5f3e93-46ed-46f2-87c0-fffa21768054 while it is in vm_state rescued Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Request method failure captured: Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/os-volume_attachments HTTP/1.1 Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 74 Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCarXzQEeWD_yg-Yv3x-e6u_WeJK0H4zHIc0K2ifAeEz5lrEXCdSGI--LvFU55RmwGwdxJyIQb1oGJryeM85dpPE-6Bdt7QpTLIjsEre7jimq6F9GiGD3yK_ZjeKRtTqhKCIODh0xkoCo04wlC3mPfhPebArjlTk0PKLudgc3mohZyhg Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_43652021c7e84156955f4bdaf72aabba", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: f80e7dad058f44b9967a5a2f95123a9f Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: {"volumeAttachment": {"volumeId": "23887f1e-d6cb-49b6-bf99-cf3ccd897db3"}} Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot 'attach_volume' instance dc5f3e93-46ed-46f2-87c0-fffa21768054 while it is in vm_state rescued Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'server_id': 'dc5f3e93-46ed-46f2-87c0-fffa21768054', 'body': {'volumeAttachment': {'volumeId': '23887f1e-d6cb-49b6-bf99-cf3ccd897db3'}}} Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dc5f3e93-46ed-46f2-87c0-fffa21768054 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 27 05:27:11.991025 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dc5f3e93-46ed-46f2-87c0-fffa21768054 while it is in vm_state rescued Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dc5f3e93-46ed-46f2-87c0-fffa21768054 while it is in vm_state rescued Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Returning 409 to user: Cannot 'attach_volume' instance dc5f3e93-46ed-46f2-87c0-fffa21768054 while it is in vm_state rescued {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ab9f8c55-ba24-41df-8eec-fd93b9805826 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.088167 Aug 27 05:27:12.007227 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2979/5955] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:27:11 2022] POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:27:12.010779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-07959c40-7d23-4a12-87ed-7ce549d18a44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:12.010779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-07959c40-7d23-4a12-87ed-7ce549d18a44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:12.015048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07959c40-7d23-4a12-87ed-7ce549d18a44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:12.015559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07959c40-7d23-4a12-87ed-7ce549d18a44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:12.015874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07959c40-7d23-4a12-87ed-7ce549d18a44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:12.017792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07959c40-7d23-4a12-87ed-7ce549d18a44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:12.018260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07959c40-7d23-4a12-87ed-7ce549d18a44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:12.018992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07959c40-7d23-4a12-87ed-7ce549d18a44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:12.119775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:12.174084 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-07959c40-7d23-4a12-87ed-7ce549d18a44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/action" status: 202 len: 0 microversion: 2.1 time: 0.172533 Aug 27 05:27:12.180650 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2977/5956] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:11 2022] POST /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:27:12.192686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6a9e39cf-95ff-45d8-bbd1-ed6e6b0ac7c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:12.195744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6a9e39cf-95ff-45d8-bbd1-ed6e6b0ac7c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:12.234714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9e39cf-95ff-45d8-bbd1-ed6e6b0ac7c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:12.236577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9e39cf-95ff-45d8-bbd1-ed6e6b0ac7c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:12.237618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9e39cf-95ff-45d8-bbd1-ed6e6b0ac7c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:12.241627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9e39cf-95ff-45d8-bbd1-ed6e6b0ac7c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:12.242686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9e39cf-95ff-45d8-bbd1-ed6e6b0ac7c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:12.243693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a9e39cf-95ff-45d8-bbd1-ed6e6b0ac7c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:12.584700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6a9e39cf-95ff-45d8-bbd1-ed6e6b0ac7c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:12.594096 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6a9e39cf-95ff-45d8-bbd1-ed6e6b0ac7c8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1509 microversion: 2.1 time: 0.411108 Aug 27 05:27:12.608829 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2980/5957] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:12 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1509 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:12.882013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cb1a2ef4-e681-449e-937e-9cbe8cb42ea8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:12.883588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cb1a2ef4-e681-449e-937e-9cbe8cb42ea8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:12.898359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ef4-e681-449e-937e-9cbe8cb42ea8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:12.899575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ef4-e681-449e-937e-9cbe8cb42ea8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:12.900981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ef4-e681-449e-937e-9cbe8cb42ea8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:12.902478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ef4-e681-449e-937e-9cbe8cb42ea8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:12.903641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ef4-e681-449e-937e-9cbe8cb42ea8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:12.904594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ef4-e681-449e-937e-9cbe8cb42ea8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:13.149553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cb1a2ef4-e681-449e-937e-9cbe8cb42ea8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:13.166170 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cb1a2ef4-e681-449e-937e-9cbe8cb42ea8 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.293672 Aug 27 05:27:13.167593 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2978/5958] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:12 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:13.628336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d3e2f619-85ac-4bfe-b12e-961bc20cfb14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:13.631919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d3e2f619-85ac-4bfe-b12e-961bc20cfb14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:13.646137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e2f619-85ac-4bfe-b12e-961bc20cfb14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:13.647642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e2f619-85ac-4bfe-b12e-961bc20cfb14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:13.648877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e2f619-85ac-4bfe-b12e-961bc20cfb14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:13.650776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e2f619-85ac-4bfe-b12e-961bc20cfb14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:13.651866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e2f619-85ac-4bfe-b12e-961bc20cfb14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:13.653108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e2f619-85ac-4bfe-b12e-961bc20cfb14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:13.865598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d3e2f619-85ac-4bfe-b12e-961bc20cfb14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:13.888680 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d3e2f619-85ac-4bfe-b12e-961bc20cfb14 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1509 microversion: 2.1 time: 0.272161 Aug 27 05:27:13.904016 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2981/5959] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:13 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1509 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:14.182336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f1f9b13b-450c-4f29-a988-7380d12180f3 req-a9d4033a-4424-4440-b5f8-1cd8486a25df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64999ba4-bbd9-4d23-9a4c-0caf8eb677b4", "tag": "e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:14.225458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-700c8026-3dcd-491a-93b4-641fde9dfdcd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:14.229210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-700c8026-3dcd-491a-93b4-641fde9dfdcd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:14.234673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f1f9b13b-450c-4f29-a988-7380d12180f3 req-a9d4033a-4424-4440-b5f8-1cd8486a25df service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:14.235996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f1f9b13b-450c-4f29-a988-7380d12180f3 req-a9d4033a-4424-4440-b5f8-1cd8486a25df service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:14.237031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f1f9b13b-450c-4f29-a988-7380d12180f3 req-a9d4033a-4424-4440-b5f8-1cd8486a25df service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:14.264193 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f1f9b13b-450c-4f29-a988-7380d12180f3 req-a9d4033a-4424-4440-b5f8-1cd8486a25df service nova] Creating event network-changed:e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf for instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 on n-h1-820368-35 Aug 27 05:27:14.266636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-700c8026-3dcd-491a-93b4-641fde9dfdcd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:14.267164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-700c8026-3dcd-491a-93b4-641fde9dfdcd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:14.267706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-700c8026-3dcd-491a-93b4-641fde9dfdcd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:14.268423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-700c8026-3dcd-491a-93b4-641fde9dfdcd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:14.276984 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f1f9b13b-450c-4f29-a988-7380d12180f3 req-a9d4033a-4424-4440-b5f8-1cd8486a25df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103616 Aug 27 05:27:14.278330 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2979/5960] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:14.279982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-700c8026-3dcd-491a-93b4-641fde9dfdcd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:14.280764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-700c8026-3dcd-491a-93b4-641fde9dfdcd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:14.726423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-700c8026-3dcd-491a-93b4-641fde9dfdcd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:14.751008 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-700c8026-3dcd-491a-93b4-641fde9dfdcd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.545001 Aug 27 05:27:14.752633 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2982/5961] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:14 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:14.920785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23eb2b2b-074f-44bb-aea9-b7593e2192d8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:14.924893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-23eb2b2b-074f-44bb-aea9-b7593e2192d8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:14.947235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23eb2b2b-074f-44bb-aea9-b7593e2192d8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:14.948433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23eb2b2b-074f-44bb-aea9-b7593e2192d8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:14.949499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23eb2b2b-074f-44bb-aea9-b7593e2192d8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:14.951167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23eb2b2b-074f-44bb-aea9-b7593e2192d8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:14.952548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23eb2b2b-074f-44bb-aea9-b7593e2192d8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:14.954799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23eb2b2b-074f-44bb-aea9-b7593e2192d8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:15.415472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23eb2b2b-074f-44bb-aea9-b7593e2192d8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:15.430070 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-23eb2b2b-074f-44bb-aea9-b7593e2192d8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1509 microversion: 2.1 time: 0.521996 Aug 27 05:27:15.431383 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2980/5962] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:14 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1509 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:15.794557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b6840105-98f5-430b-a8d3-a809a2211bbe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:15.795599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b6840105-98f5-430b-a8d3-a809a2211bbe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:15.817252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6840105-98f5-430b-a8d3-a809a2211bbe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:15.818079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6840105-98f5-430b-a8d3-a809a2211bbe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:15.818860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6840105-98f5-430b-a8d3-a809a2211bbe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:15.820160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6840105-98f5-430b-a8d3-a809a2211bbe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:15.820975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6840105-98f5-430b-a8d3-a809a2211bbe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:15.821748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b6840105-98f5-430b-a8d3-a809a2211bbe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:16.477271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-66e8a8e1-5849-46eb-ad00-67ef33adcc44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:16.482758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-66e8a8e1-5849-46eb-ad00-67ef33adcc44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:16.526238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e8a8e1-5849-46eb-ad00-67ef33adcc44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:16.530463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e8a8e1-5849-46eb-ad00-67ef33adcc44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:16.531555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e8a8e1-5849-46eb-ad00-67ef33adcc44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:16.536488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e8a8e1-5849-46eb-ad00-67ef33adcc44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:16.538832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e8a8e1-5849-46eb-ad00-67ef33adcc44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:16.542094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-66e8a8e1-5849-46eb-ad00-67ef33adcc44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:16.573130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b6840105-98f5-430b-a8d3-a809a2211bbe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:16.583401 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b6840105-98f5-430b-a8d3-a809a2211bbe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.794904 Aug 27 05:27:16.603505 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2983/5963] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:15 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:17.062191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-66e8a8e1-5849-46eb-ad00-67ef33adcc44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:17.086032 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-66e8a8e1-5849-46eb-ad00-67ef33adcc44 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1515 microversion: 2.1 time: 0.623385 Aug 27 05:27:17.089898 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2981/5964] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:16 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1515 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:17.629788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ff9e64df-e767-427c-9ed9-9baadffba9b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:17.632183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ff9e64df-e767-427c-9ed9-9baadffba9b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:17.668606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff9e64df-e767-427c-9ed9-9baadffba9b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:17.672688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff9e64df-e767-427c-9ed9-9baadffba9b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:17.681049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff9e64df-e767-427c-9ed9-9baadffba9b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:17.682720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff9e64df-e767-427c-9ed9-9baadffba9b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:17.685023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff9e64df-e767-427c-9ed9-9baadffba9b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:17.690273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff9e64df-e767-427c-9ed9-9baadffba9b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:18.232568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ff9e64df-e767-427c-9ed9-9baadffba9b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:18.264239 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ff9e64df-e767-427c-9ed9-9baadffba9b7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.655084 Aug 27 05:27:18.269209 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2984/5965] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:17 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:19.296588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2988f898-caad-4395-815a-08aae218d544 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:19.298259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2988f898-caad-4395-815a-08aae218d544 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:19.319131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988f898-caad-4395-815a-08aae218d544 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:19.320243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988f898-caad-4395-815a-08aae218d544 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:19.321151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988f898-caad-4395-815a-08aae218d544 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:19.322643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988f898-caad-4395-815a-08aae218d544 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:19.329075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988f898-caad-4395-815a-08aae218d544 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:19.330590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2988f898-caad-4395-815a-08aae218d544 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:19.702939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2988f898-caad-4395-815a-08aae218d544 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:19.717961 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2988f898-caad-4395-815a-08aae218d544 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.425596 Aug 27 05:27:19.718938 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2982/5966] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:19 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:20.480521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce3a336a-ea3d-4cd2-a636-a553fa9dd8c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'create', calling method: .version_select at 0x7fb5641a01f0>, body: {"keypair": {"name": "tempest-keypair-428524482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz2ivSn7C+CCDffkj4kg2MPILJEiLjH6uf81Xrxa0byfNeldebKAsl97O+vcXIdh2RHfDsSY+RGfZqpqlkRUwZWI1bI2/XkyIVA2tcdouerz4COoyXoDh14ws9it/2v0g=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:20.517243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ce3a336a-ea3d-4cd2-a636-a553fa9dd8c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Getting quotas for project 43652021c7e84156955f4bdaf72aabba. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:27:20.547399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-ce3a336a-ea3d-4cd2-a636-a553fa9dd8c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Getting quotas for user f80e7dad058f44b9967a5a2f95123a9f and project 43652021c7e84156955f4bdaf72aabba. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:27:20.617578 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce3a336a-ea3d-4cd2-a636-a553fa9dd8c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141365 Aug 27 05:27:20.620153 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2985/5967] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:27:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:20.775216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd3d282d-6ec0-4e58-a097-7eae01923654 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:20.779538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd3d282d-6ec0-4e58-a097-7eae01923654 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:20.835015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd3d282d-6ec0-4e58-a097-7eae01923654 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:20.837796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd3d282d-6ec0-4e58-a097-7eae01923654 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:20.841728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd3d282d-6ec0-4e58-a097-7eae01923654 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:20.848020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd3d282d-6ec0-4e58-a097-7eae01923654 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:20.852007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd3d282d-6ec0-4e58-a097-7eae01923654 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:20.855030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd3d282d-6ec0-4e58-a097-7eae01923654 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:21.514589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dd3d282d-6ec0-4e58-a097-7eae01923654 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:21.534124 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd3d282d-6ec0-4e58-a097-7eae01923654 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.777919 Aug 27 05:27:21.555979 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2983/5968] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:20 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:22.580745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1630f29d-9682-415f-b2c1-0b10488eb0a9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:22.586743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1630f29d-9682-415f-b2c1-0b10488eb0a9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:22.637162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1630f29d-9682-415f-b2c1-0b10488eb0a9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:22.642105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1630f29d-9682-415f-b2c1-0b10488eb0a9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:22.642924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1630f29d-9682-415f-b2c1-0b10488eb0a9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:22.654017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1630f29d-9682-415f-b2c1-0b10488eb0a9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:22.661573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1630f29d-9682-415f-b2c1-0b10488eb0a9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:22.667779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1630f29d-9682-415f-b2c1-0b10488eb0a9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:23.240953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1630f29d-9682-415f-b2c1-0b10488eb0a9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:23.284038 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1630f29d-9682-415f-b2c1-0b10488eb0a9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.713972 Aug 27 05:27:23.286040 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2986/5969] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:22 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:24.327217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fe308233-8229-410f-8c19-ec0b95091c7e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:24.333134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fe308233-8229-410f-8c19-ec0b95091c7e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:24.394677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe308233-8229-410f-8c19-ec0b95091c7e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:24.396983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe308233-8229-410f-8c19-ec0b95091c7e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:24.399689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe308233-8229-410f-8c19-ec0b95091c7e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:24.404236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe308233-8229-410f-8c19-ec0b95091c7e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:24.404721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe308233-8229-410f-8c19-ec0b95091c7e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:24.405217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe308233-8229-410f-8c19-ec0b95091c7e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:24.781076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fe308233-8229-410f-8c19-ec0b95091c7e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:24.814255 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fe308233-8229-410f-8c19-ec0b95091c7e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.505791 Aug 27 05:27:24.816957 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2984/5970] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:24 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:24.976489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1812579008", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90541b9e-a822-49f6-8d67-5dca5d9b304a"}], "security_groups": [{"name": "tempest-securitygroup--737503948"}], "key_name": "tempest-keypair-428524482", "user_data": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:25.303928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] validate_networks() for [('90541b9e-a822-49f6-8d67-5dca5d9b304a', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:27:25.843746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4952bd6f-e756-40ff-b585-4979556297d9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:25.844768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4952bd6f-e756-40ff-b585-4979556297d9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:25.885119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4952bd6f-e756-40ff-b585-4979556297d9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:25.885957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4952bd6f-e756-40ff-b585-4979556297d9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:25.886714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4952bd6f-e756-40ff-b585-4979556297d9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:25.898435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4952bd6f-e756-40ff-b585-4979556297d9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:25.900079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4952bd6f-e756-40ff-b585-4979556297d9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:25.901050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4952bd6f-e756-40ff-b585-4979556297d9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:26.480570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4952bd6f-e756-40ff-b585-4979556297d9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:26.522539 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4952bd6f-e756-40ff-b585-4979556297d9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.684415 Aug 27 05:27:26.526391 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2985/5971] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:25 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:26.569098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:27:26.571066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:27:26.580927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:27:26.581941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:27:26.583068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:27:26.601301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:26.602757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:26.603905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:26.605622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:26.606666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:26.607708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:26.635932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:26.689569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Getting quotas for project 43652021c7e84156955f4bdaf72aabba. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:27:26.722605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Getting quotas for user f80e7dad058f44b9967a5a2f95123a9f and project 43652021c7e84156955f4bdaf72aabba. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:27:26.770390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:27:26.775634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:27:26.911358 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-12b8b740-62bc-4054-94b5-e307fd98d176 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.958557 Aug 27 05:27:26.919582 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2987/5972] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:27:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 1968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:27:26.933464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5c18fd4f-4973-4237-bca8-296a62ec4135 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:26.937365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5c18fd4f-4973-4237-bca8-296a62ec4135 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:27.217714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5c18fd4f-4973-4237-bca8-296a62ec4135 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:27.246039 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5c18fd4f-4973-4237-bca8-296a62ec4135 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1245 microversion: 2.1 time: 0.320396 Aug 27 05:27:27.251673 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2986/5973] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:26 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1245 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:27.568029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1344cdef-ec5c-4838-929e-b86d46850696 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:27.575565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1344cdef-ec5c-4838-929e-b86d46850696 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:27.607076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1344cdef-ec5c-4838-929e-b86d46850696 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:27.607869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1344cdef-ec5c-4838-929e-b86d46850696 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:27.616712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1344cdef-ec5c-4838-929e-b86d46850696 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:27.618328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1344cdef-ec5c-4838-929e-b86d46850696 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:27.619437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1344cdef-ec5c-4838-929e-b86d46850696 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:27.621099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1344cdef-ec5c-4838-929e-b86d46850696 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:28.271454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1344cdef-ec5c-4838-929e-b86d46850696 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:28.301047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3acaaad3-d38e-4c47-bf79-a494f3143c67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:28.305792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3acaaad3-d38e-4c47-bf79-a494f3143c67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:28.317721 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1344cdef-ec5c-4838-929e-b86d46850696 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.752361 Aug 27 05:27:28.333687 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2988/5974] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:27 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:28.363655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3acaaad3-d38e-4c47-bf79-a494f3143c67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:28.369671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3acaaad3-d38e-4c47-bf79-a494f3143c67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:28.370593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3acaaad3-d38e-4c47-bf79-a494f3143c67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:28.371736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3acaaad3-d38e-4c47-bf79-a494f3143c67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:28.372497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3acaaad3-d38e-4c47-bf79-a494f3143c67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:28.373198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3acaaad3-d38e-4c47-bf79-a494f3143c67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:28.536472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3acaaad3-d38e-4c47-bf79-a494f3143c67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:28.552487 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3acaaad3-d38e-4c47-bf79-a494f3143c67 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1249 microversion: 2.1 time: 0.261165 Aug 27 05:27:28.554423 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2987/5975] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:28 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1249 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:29.365823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-67621944-7b9e-403f-a9b3-21bc299ea226 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:29.368112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-67621944-7b9e-403f-a9b3-21bc299ea226 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:29.392073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67621944-7b9e-403f-a9b3-21bc299ea226 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:29.397289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67621944-7b9e-403f-a9b3-21bc299ea226 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:29.398079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67621944-7b9e-403f-a9b3-21bc299ea226 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:29.404674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67621944-7b9e-403f-a9b3-21bc299ea226 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:29.405471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67621944-7b9e-403f-a9b3-21bc299ea226 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:29.411028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-67621944-7b9e-403f-a9b3-21bc299ea226 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:29.599618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2ea73991-f25f-49b3-9420-16ff8ec9bbc2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:29.602061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2ea73991-f25f-49b3-9420-16ff8ec9bbc2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:29.620708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea73991-f25f-49b3-9420-16ff8ec9bbc2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:29.621429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea73991-f25f-49b3-9420-16ff8ec9bbc2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:29.621996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea73991-f25f-49b3-9420-16ff8ec9bbc2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:29.622894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea73991-f25f-49b3-9420-16ff8ec9bbc2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:29.623525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea73991-f25f-49b3-9420-16ff8ec9bbc2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:29.624030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2ea73991-f25f-49b3-9420-16ff8ec9bbc2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:29.860439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-67621944-7b9e-403f-a9b3-21bc299ea226 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:29.864378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2ea73991-f25f-49b3-9420-16ff8ec9bbc2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:29.870191 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-67621944-7b9e-403f-a9b3-21bc299ea226 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.509770 Aug 27 05:27:29.870803 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2989/5976] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:29 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:29.894081 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2ea73991-f25f-49b3-9420-16ff8ec9bbc2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1297 microversion: 2.1 time: 0.305259 Aug 27 05:27:29.894685 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2988/5977] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:29 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1297 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:30.905497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-18b3ec39-30cd-45c9-8233-05f6fe4a916f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:30.906890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-18b3ec39-30cd-45c9-8233-05f6fe4a916f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:30.914372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b3ec39-30cd-45c9-8233-05f6fe4a916f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:30.915026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b3ec39-30cd-45c9-8233-05f6fe4a916f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:30.915744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b3ec39-30cd-45c9-8233-05f6fe4a916f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:30.916568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b3ec39-30cd-45c9-8233-05f6fe4a916f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:30.917310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b3ec39-30cd-45c9-8233-05f6fe4a916f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:30.917848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18b3ec39-30cd-45c9-8233-05f6fe4a916f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:30.934695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7ac9bbf3-ebee-4bea-9249-ffd047b45d3b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:30.936882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7ac9bbf3-ebee-4bea-9249-ffd047b45d3b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:30.950901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ac9bbf3-ebee-4bea-9249-ffd047b45d3b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:30.952783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ac9bbf3-ebee-4bea-9249-ffd047b45d3b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:30.954463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ac9bbf3-ebee-4bea-9249-ffd047b45d3b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:30.956719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ac9bbf3-ebee-4bea-9249-ffd047b45d3b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:30.957621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ac9bbf3-ebee-4bea-9249-ffd047b45d3b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:30.958728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ac9bbf3-ebee-4bea-9249-ffd047b45d3b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:31.063966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7ac9bbf3-ebee-4bea-9249-ffd047b45d3b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:31.076888 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7ac9bbf3-ebee-4bea-9249-ffd047b45d3b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1297 microversion: 2.1 time: 0.148968 Aug 27 05:27:31.077877 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2989/5978] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:30 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1297 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:31.156936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18b3ec39-30cd-45c9-8233-05f6fe4a916f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:31.168509 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-18b3ec39-30cd-45c9-8233-05f6fe4a916f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.268082 Aug 27 05:27:31.169622 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2990/5979] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:30 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:32.107006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8985187e-45a6-491e-8f6b-aa0575926191 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:32.115642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8985187e-45a6-491e-8f6b-aa0575926191 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:32.136564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8985187e-45a6-491e-8f6b-aa0575926191 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:32.137517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8985187e-45a6-491e-8f6b-aa0575926191 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:32.138760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8985187e-45a6-491e-8f6b-aa0575926191 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:32.139730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8985187e-45a6-491e-8f6b-aa0575926191 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:32.140521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8985187e-45a6-491e-8f6b-aa0575926191 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:32.141263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8985187e-45a6-491e-8f6b-aa0575926191 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:32.205768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-07febbf7-e618-4c6e-b2ef-d442bedc427a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:32.207380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-07febbf7-e618-4c6e-b2ef-d442bedc427a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:32.236637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:32.239934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07febbf7-e618-4c6e-b2ef-d442bedc427a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:32.241181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07febbf7-e618-4c6e-b2ef-d442bedc427a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:32.242166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07febbf7-e618-4c6e-b2ef-d442bedc427a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:32.243740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07febbf7-e618-4c6e-b2ef-d442bedc427a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:32.249920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07febbf7-e618-4c6e-b2ef-d442bedc427a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:32.250943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07febbf7-e618-4c6e-b2ef-d442bedc427a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:32.371272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8985187e-45a6-491e-8f6b-aa0575926191 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:32.388709 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8985187e-45a6-491e-8f6b-aa0575926191 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1297 microversion: 2.1 time: 0.288024 Aug 27 05:27:32.391588 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2990/5980] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:32 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1297 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:32.641416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-07febbf7-e618-4c6e-b2ef-d442bedc427a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:32.667830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-07febbf7-e618-4c6e-b2ef-d442bedc427a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.457855 Aug 27 05:27:32.669083 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2991/5981] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:32 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:33.430070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d080b8b-3a66-460b-a369-d241c24741e1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:33.431576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3d080b8b-3a66-460b-a369-d241c24741e1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:33.452000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d080b8b-3a66-460b-a369-d241c24741e1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:33.452411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d080b8b-3a66-460b-a369-d241c24741e1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:33.452864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d080b8b-3a66-460b-a369-d241c24741e1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:33.453591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d080b8b-3a66-460b-a369-d241c24741e1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:33.457148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d080b8b-3a66-460b-a369-d241c24741e1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:33.462795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d080b8b-3a66-460b-a369-d241c24741e1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:33.609684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d080b8b-3a66-460b-a369-d241c24741e1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:33.627451 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d080b8b-3a66-460b-a369-d241c24741e1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1305 microversion: 2.1 time: 0.203071 Aug 27 05:27:33.639720 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2991/5982] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:33 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1305 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:33.707650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c82c8a72-9aa5-4384-9b52-01773411ac19 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:33.708594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c82c8a72-9aa5-4384-9b52-01773411ac19 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:33.721108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82c8a72-9aa5-4384-9b52-01773411ac19 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:33.723120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82c8a72-9aa5-4384-9b52-01773411ac19 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:33.727291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82c8a72-9aa5-4384-9b52-01773411ac19 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:33.729112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82c8a72-9aa5-4384-9b52-01773411ac19 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:33.730226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82c8a72-9aa5-4384-9b52-01773411ac19 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:33.731334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82c8a72-9aa5-4384-9b52-01773411ac19 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:34.097207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c82c8a72-9aa5-4384-9b52-01773411ac19 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:34.129543 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c82c8a72-9aa5-4384-9b52-01773411ac19 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.417818 Aug 27 05:27:34.155867 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2992/5983] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:33 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:34.677153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-919a4218-9e64-4787-a840-b2ad7d61f85b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:34.686011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-919a4218-9e64-4787-a840-b2ad7d61f85b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:34.711517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-919a4218-9e64-4787-a840-b2ad7d61f85b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:34.712841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-919a4218-9e64-4787-a840-b2ad7d61f85b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:34.713826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-919a4218-9e64-4787-a840-b2ad7d61f85b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:34.715432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-919a4218-9e64-4787-a840-b2ad7d61f85b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:34.716895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-919a4218-9e64-4787-a840-b2ad7d61f85b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:34.717855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-919a4218-9e64-4787-a840-b2ad7d61f85b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:34.915870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-919a4218-9e64-4787-a840-b2ad7d61f85b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:34.929498 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-919a4218-9e64-4787-a840-b2ad7d61f85b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1305 microversion: 2.1 time: 0.261686 Aug 27 05:27:34.938358 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2992/5984] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:34 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1305 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:35.161148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aac0afd5-0446-4bcc-876d-4023bca97266 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:35.162543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aac0afd5-0446-4bcc-876d-4023bca97266 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:35.176358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac0afd5-0446-4bcc-876d-4023bca97266 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:35.178145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac0afd5-0446-4bcc-876d-4023bca97266 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:35.178996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac0afd5-0446-4bcc-876d-4023bca97266 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:35.182033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac0afd5-0446-4bcc-876d-4023bca97266 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:35.183686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac0afd5-0446-4bcc-876d-4023bca97266 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:35.184321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac0afd5-0446-4bcc-876d-4023bca97266 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:35.599154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aac0afd5-0446-4bcc-876d-4023bca97266 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:35.619045 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aac0afd5-0446-4bcc-876d-4023bca97266 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.462115 Aug 27 05:27:35.620149 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2993/5985] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:35 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:36.017539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-28328274-b157-4cad-9cfd-e8e3e74da453 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:36.023215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-28328274-b157-4cad-9cfd-e8e3e74da453 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:36.102211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28328274-b157-4cad-9cfd-e8e3e74da453 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:36.108674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28328274-b157-4cad-9cfd-e8e3e74da453 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:36.112382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28328274-b157-4cad-9cfd-e8e3e74da453 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:36.115882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28328274-b157-4cad-9cfd-e8e3e74da453 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:36.123908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28328274-b157-4cad-9cfd-e8e3e74da453 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:36.128925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28328274-b157-4cad-9cfd-e8e3e74da453 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:36.359115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-28328274-b157-4cad-9cfd-e8e3e74da453 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:36.394754 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-28328274-b157-4cad-9cfd-e8e3e74da453 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1305 microversion: 2.1 time: 0.424823 Aug 27 05:27:36.396630 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2993/5986] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:35 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1305 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:36.671970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5db6159e-5fc9-4a38-9d0a-975f6efb6962 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:36.673257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5db6159e-5fc9-4a38-9d0a-975f6efb6962 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:36.705149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:36.717634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5db6159e-5fc9-4a38-9d0a-975f6efb6962 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:36.733260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5db6159e-5fc9-4a38-9d0a-975f6efb6962 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:36.735811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5db6159e-5fc9-4a38-9d0a-975f6efb6962 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:36.741356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5db6159e-5fc9-4a38-9d0a-975f6efb6962 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:36.743020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5db6159e-5fc9-4a38-9d0a-975f6efb6962 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:36.743685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5db6159e-5fc9-4a38-9d0a-975f6efb6962 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:36.837806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=10 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:37.191567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5db6159e-5fc9-4a38-9d0a-975f6efb6962 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:37.203595 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5db6159e-5fc9-4a38-9d0a-975f6efb6962 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.558314 Aug 27 05:27:37.206349 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2994/5987] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:36 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:37.437418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-11b26c0f-e7aa-461e-9793-60051c7d1fe2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:37.440915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-11b26c0f-e7aa-461e-9793-60051c7d1fe2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:37.475925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:37.484001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=48 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:37.487702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11b26c0f-e7aa-461e-9793-60051c7d1fe2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:37.498622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11b26c0f-e7aa-461e-9793-60051c7d1fe2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:37.502567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11b26c0f-e7aa-461e-9793-60051c7d1fe2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:37.506360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11b26c0f-e7aa-461e-9793-60051c7d1fe2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:37.513806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11b26c0f-e7aa-461e-9793-60051c7d1fe2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:37.516026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-11b26c0f-e7aa-461e-9793-60051c7d1fe2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:37.761294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-11b26c0f-e7aa-461e-9793-60051c7d1fe2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:37.776371 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-11b26c0f-e7aa-461e-9793-60051c7d1fe2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1303 microversion: 2.1 time: 0.344683 Aug 27 05:27:37.780168 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2994/5988] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:37 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1303 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:38.242560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fe829c05-50ac-4ee6-af59-68de87033ff9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:38.244085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fe829c05-50ac-4ee6-af59-68de87033ff9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:38.278214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe829c05-50ac-4ee6-af59-68de87033ff9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:38.279110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe829c05-50ac-4ee6-af59-68de87033ff9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:38.279935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe829c05-50ac-4ee6-af59-68de87033ff9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:38.281681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe829c05-50ac-4ee6-af59-68de87033ff9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:38.282331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe829c05-50ac-4ee6-af59-68de87033ff9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:38.282823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe829c05-50ac-4ee6-af59-68de87033ff9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:38.670825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fe829c05-50ac-4ee6-af59-68de87033ff9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:38.682908 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fe829c05-50ac-4ee6-af59-68de87033ff9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.447141 Aug 27 05:27:38.685411 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2995/5989] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:38 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:38.817000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5f5193c-267e-4002-8823-e17823147f85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:38.818497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b5f5193c-267e-4002-8823-e17823147f85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:38.842042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f5193c-267e-4002-8823-e17823147f85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:38.847534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f5193c-267e-4002-8823-e17823147f85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:38.848724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f5193c-267e-4002-8823-e17823147f85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:38.851310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f5193c-267e-4002-8823-e17823147f85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:38.853779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f5193c-267e-4002-8823-e17823147f85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:38.854533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f5193c-267e-4002-8823-e17823147f85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:39.057738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5f5193c-267e-4002-8823-e17823147f85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:39.061355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:39.084416 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5f5193c-267e-4002-8823-e17823147f85 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1303 microversion: 2.1 time: 0.271464 Aug 27 05:27:39.088759 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2995/5990] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:38 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1303 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:39.767879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2610e488-2e3f-457b-8979-920fcc64c23d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:39.768833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2610e488-2e3f-457b-8979-920fcc64c23d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:39.780774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2610e488-2e3f-457b-8979-920fcc64c23d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:39.781284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2610e488-2e3f-457b-8979-920fcc64c23d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:39.782021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2610e488-2e3f-457b-8979-920fcc64c23d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:39.782773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2610e488-2e3f-457b-8979-920fcc64c23d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:39.786644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2610e488-2e3f-457b-8979-920fcc64c23d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:39.787404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2610e488-2e3f-457b-8979-920fcc64c23d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:40.113345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9700f7f9-b00a-4fbd-b008-026fb16cc8e0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:40.114312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9700f7f9-b00a-4fbd-b008-026fb16cc8e0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:40.133778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9700f7f9-b00a-4fbd-b008-026fb16cc8e0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:40.142218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9700f7f9-b00a-4fbd-b008-026fb16cc8e0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:40.143842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9700f7f9-b00a-4fbd-b008-026fb16cc8e0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:40.145099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9700f7f9-b00a-4fbd-b008-026fb16cc8e0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:40.146204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9700f7f9-b00a-4fbd-b008-026fb16cc8e0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:40.146826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9700f7f9-b00a-4fbd-b008-026fb16cc8e0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:40.220016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2610e488-2e3f-457b-8979-920fcc64c23d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:40.230491 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2610e488-2e3f-457b-8979-920fcc64c23d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.467368 Aug 27 05:27:40.235329 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2996/5991] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:39 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:40.431473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9700f7f9-b00a-4fbd-b008-026fb16cc8e0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:40.448614 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9700f7f9-b00a-4fbd-b008-026fb16cc8e0 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1370 microversion: 2.1 time: 0.341799 Aug 27 05:27:40.449214 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2996/5992] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:40 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1370 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:41.259811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e36164b-0e0d-43cb-830a-5b90e69adbad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:41.263166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b8b82179-6449-40fa-a459-78f4ed16b369 req-d5a20380-daf8-4c65-97f4-c181159226cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64999ba4-bbd9-4d23-9a4c-0caf8eb677b4", "name": "network-vif-plugged", "status": "completed", "tag": "e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:41.263902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3e36164b-0e0d-43cb-830a-5b90e69adbad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:41.286424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e36164b-0e0d-43cb-830a-5b90e69adbad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:41.291800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e36164b-0e0d-43cb-830a-5b90e69adbad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:41.294090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e36164b-0e0d-43cb-830a-5b90e69adbad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:41.301104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b8b82179-6449-40fa-a459-78f4ed16b369 req-d5a20380-daf8-4c65-97f4-c181159226cc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:41.303670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e36164b-0e0d-43cb-830a-5b90e69adbad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:41.304377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e36164b-0e0d-43cb-830a-5b90e69adbad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:41.308462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e36164b-0e0d-43cb-830a-5b90e69adbad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:41.316159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b8b82179-6449-40fa-a459-78f4ed16b369 req-d5a20380-daf8-4c65-97f4-c181159226cc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:41.317211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b8b82179-6449-40fa-a459-78f4ed16b369 req-d5a20380-daf8-4c65-97f4-c181159226cc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:41.349991 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b8b82179-6449-40fa-a459-78f4ed16b369 req-d5a20380-daf8-4c65-97f4-c181159226cc service nova] Creating event network-vif-plugged:e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf for instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 on n-h1-820368-35 Aug 27 05:27:41.375967 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b8b82179-6449-40fa-a459-78f4ed16b369 req-d5a20380-daf8-4c65-97f4-c181159226cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130391 Aug 27 05:27:41.383251 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2997/5993] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:27:41.524522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b9b15a99-af87-417d-a578-4100ce06c05e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:41.528286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b9b15a99-af87-417d-a578-4100ce06c05e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:41.558203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9b15a99-af87-417d-a578-4100ce06c05e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:41.560884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9b15a99-af87-417d-a578-4100ce06c05e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:41.562613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9b15a99-af87-417d-a578-4100ce06c05e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:41.566171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9b15a99-af87-417d-a578-4100ce06c05e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:41.568447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9b15a99-af87-417d-a578-4100ce06c05e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:41.570506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9b15a99-af87-417d-a578-4100ce06c05e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:42.071589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b9b15a99-af87-417d-a578-4100ce06c05e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:42.072373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3e36164b-0e0d-43cb-830a-5b90e69adbad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:42.127741 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b9b15a99-af87-417d-a578-4100ce06c05e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1370 microversion: 2.1 time: 0.644985 Aug 27 05:27:42.129318 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2998/5994] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:41 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1370 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:42.162736 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e36164b-0e0d-43cb-830a-5b90e69adbad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 0.907602 Aug 27 05:27:42.172613 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2997/5995] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:41 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:42.486626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1604349467", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "b14b911f-7aa6-41c6-87f3-0260951c195f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-358125036", "security_groups": []}, "os:scheduler_hints": {"different_host": ["1e6625a4-fa42-41a0-8664-65bb32081817"]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:42.635338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] validate_networks() for [('b14b911f-7aa6-41c6-87f3-0260951c195f', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:27:43.082586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b2b02b2d-6416-4b35-a256-331cfa85e498 req-e5a20c98-5007-4f14-8615-c5bbd1569347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8bceb6-cc73-4f2e-8858-e02d8fb84f37", "tag": "c7190bb7-8036-47e7-83f7-27efbe7164a7"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:43.133853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b2b02b2d-6416-4b35-a256-331cfa85e498 req-e5a20c98-5007-4f14-8615-c5bbd1569347 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:43.135174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b2b02b2d-6416-4b35-a256-331cfa85e498 req-e5a20c98-5007-4f14-8615-c5bbd1569347 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:43.136313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b2b02b2d-6416-4b35-a256-331cfa85e498 req-e5a20c98-5007-4f14-8615-c5bbd1569347 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:43.228790 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b2b02b2d-6416-4b35-a256-331cfa85e498 req-e5a20c98-5007-4f14-8615-c5bbd1569347 service nova] Creating event network-changed:c7190bb7-8036-47e7-83f7-27efbe7164a7 for instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 on n-h1-820368-35 Aug 27 05:27:43.235473 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b2b02b2d-6416-4b35-a256-331cfa85e498 req-e5a20c98-5007-4f14-8615-c5bbd1569347 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162169 Aug 27 05:27:43.237018 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2998/5996] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:27:43.243192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3a6dd96a-f2c9-4aab-bff2-11ad3c06d864 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:43.244297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3a6dd96a-f2c9-4aab-bff2-11ad3c06d864 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:43.256060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a6dd96a-f2c9-4aab-bff2-11ad3c06d864 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:43.256768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a6dd96a-f2c9-4aab-bff2-11ad3c06d864 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:43.257247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a6dd96a-f2c9-4aab-bff2-11ad3c06d864 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:43.258931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a6dd96a-f2c9-4aab-bff2-11ad3c06d864 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:43.259617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a6dd96a-f2c9-4aab-bff2-11ad3c06d864 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:43.260251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3a6dd96a-f2c9-4aab-bff2-11ad3c06d864 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:43.872676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3a6dd96a-f2c9-4aab-bff2-11ad3c06d864 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:43.894847 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3a6dd96a-f2c9-4aab-bff2-11ad3c06d864 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1370 microversion: 2.1 time: 0.656162 Aug 27 05:27:43.895823 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 2999/5997] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:43 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1370 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:43.907917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f1bed5e-6852-439a-89b8-bb1d240c9ead tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:43.933077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8f1bed5e-6852-439a-89b8-bb1d240c9ead tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:43.959767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f1bed5e-6852-439a-89b8-bb1d240c9ead tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:43.969719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f1bed5e-6852-439a-89b8-bb1d240c9ead tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:43.971490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f1bed5e-6852-439a-89b8-bb1d240c9ead tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:43.973149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f1bed5e-6852-439a-89b8-bb1d240c9ead tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:43.974262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f1bed5e-6852-439a-89b8-bb1d240c9ead tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:43.979518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f1bed5e-6852-439a-89b8-bb1d240c9ead tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:44.036863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:27:44.038116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:27:44.042290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:27:44.042746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:27:44.043621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:27:44.071960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:44.074764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:44.076830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:44.081655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:44.083452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:44.084850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:44.127162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Getting quotas for project 28b18ee854244b3998616cf5f5a05fcf. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:27:44.134478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Getting quotas for user 1ad2e05d9d024047acfe2ce68950b68e and project 28b18ee854244b3998616cf5f5a05fcf. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:27:44.151304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:27:44.154629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:27:44.336717 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ce2be86-23b9-4389-8d67-7cf593ff0149 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.856607 Aug 27 05:27:44.345818 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 2999/5998] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:27:42 2022] POST /compute/v2.1/servers => generated 361 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:27:44.358992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cfda5e54-77e3-4113-aad3-2c2e745875ed tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:44.359602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cfda5e54-77e3-4113-aad3-2c2e745875ed tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:45.038694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8f1bed5e-6852-439a-89b8-bb1d240c9ead tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:45.054266 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8f1bed5e-6852-439a-89b8-bb1d240c9ead tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1517 microversion: 2.1 time: 1.153207 Aug 27 05:27:45.055018 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3000/5999] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:43 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1517 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:45.072670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-05058430-c89e-40fc-93ad-63320fb771e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:45.073424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-05058430-c89e-40fc-93ad-63320fb771e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:45.083579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05058430-c89e-40fc-93ad-63320fb771e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:45.084175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05058430-c89e-40fc-93ad-63320fb771e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:45.084704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05058430-c89e-40fc-93ad-63320fb771e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:45.085522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05058430-c89e-40fc-93ad-63320fb771e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:45.089239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05058430-c89e-40fc-93ad-63320fb771e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:45.089450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05058430-c89e-40fc-93ad-63320fb771e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:45.094069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cfda5e54-77e3-4113-aad3-2c2e745875ed tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:45.124034 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cfda5e54-77e3-4113-aad3-2c2e745875ed tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1241 microversion: 2.1 time: 0.765039 Aug 27 05:27:45.127766 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3000/6000] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:44 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1241 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:45.503274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-05058430-c89e-40fc-93ad-63320fb771e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:45.530624 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-05058430-c89e-40fc-93ad-63320fb771e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1370 microversion: 2.1 time: 0.472821 Aug 27 05:27:45.540415 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3001/6001] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:45 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1370 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:46.095029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-15044358-267b-4478-854f-5d2e517e49b5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:46.097819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-15044358-267b-4478-854f-5d2e517e49b5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:46.133831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15044358-267b-4478-854f-5d2e517e49b5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:46.135473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15044358-267b-4478-854f-5d2e517e49b5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:46.137452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15044358-267b-4478-854f-5d2e517e49b5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:46.140627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15044358-267b-4478-854f-5d2e517e49b5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:46.144384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15044358-267b-4478-854f-5d2e517e49b5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:46.146279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15044358-267b-4478-854f-5d2e517e49b5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:46.172509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b7aaf540-b6cf-4879-95e3-bdb199a9aa1d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:46.179018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b7aaf540-b6cf-4879-95e3-bdb199a9aa1d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:46.239914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7aaf540-b6cf-4879-95e3-bdb199a9aa1d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:46.246808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7aaf540-b6cf-4879-95e3-bdb199a9aa1d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:46.253617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7aaf540-b6cf-4879-95e3-bdb199a9aa1d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:46.257954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7aaf540-b6cf-4879-95e3-bdb199a9aa1d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:46.263435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7aaf540-b6cf-4879-95e3-bdb199a9aa1d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:46.269570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7aaf540-b6cf-4879-95e3-bdb199a9aa1d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:46.601962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b7aaf540-b6cf-4879-95e3-bdb199a9aa1d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:46.621459 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b7aaf540-b6cf-4879-95e3-bdb199a9aa1d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1245 microversion: 2.1 time: 0.461081 Aug 27 05:27:46.622067 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3002/6002] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:46 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1245 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:46.648672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0da1cc2d-86f2-44fa-b2bd-d9d580285e76 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:46.649354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0da1cc2d-86f2-44fa-b2bd-d9d580285e76 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:46.672634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0da1cc2d-86f2-44fa-b2bd-d9d580285e76 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:46.673157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0da1cc2d-86f2-44fa-b2bd-d9d580285e76 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:46.678447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0da1cc2d-86f2-44fa-b2bd-d9d580285e76 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:46.679384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0da1cc2d-86f2-44fa-b2bd-d9d580285e76 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:46.679914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0da1cc2d-86f2-44fa-b2bd-d9d580285e76 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:46.680391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0da1cc2d-86f2-44fa-b2bd-d9d580285e76 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:46.812198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15044358-267b-4478-854f-5d2e517e49b5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:46.853296 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-15044358-267b-4478-854f-5d2e517e49b5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.765639 Aug 27 05:27:46.859027 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3001/6003] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:46 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:46.894540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-79420b7f-4679-40a2-aa61-e300534bf4d2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:46.898526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-79420b7f-4679-40a2-aa61-e300534bf4d2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:46.936017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79420b7f-4679-40a2-aa61-e300534bf4d2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:46.937459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79420b7f-4679-40a2-aa61-e300534bf4d2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:46.940367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79420b7f-4679-40a2-aa61-e300534bf4d2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:46.945772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79420b7f-4679-40a2-aa61-e300534bf4d2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:46.948755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79420b7f-4679-40a2-aa61-e300534bf4d2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:46.951736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-79420b7f-4679-40a2-aa61-e300534bf4d2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:47.156433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0da1cc2d-86f2-44fa-b2bd-d9d580285e76 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:47.186808 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0da1cc2d-86f2-44fa-b2bd-d9d580285e76 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1370 microversion: 2.1 time: 0.549867 Aug 27 05:27:47.187839 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3003/6004] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:46 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1370 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:47.314036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-79420b7f-4679-40a2-aa61-e300534bf4d2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:47.332182 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-79420b7f-4679-40a2-aa61-e300534bf4d2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.445685 Aug 27 05:27:47.333674 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3002/6005] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:46 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:47.396083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-30a1c761-d09a-42e8-a2ed-52009fd5a87f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:47.397257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-30a1c761-d09a-42e8-a2ed-52009fd5a87f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:47.414328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30a1c761-d09a-42e8-a2ed-52009fd5a87f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:47.415456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30a1c761-d09a-42e8-a2ed-52009fd5a87f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:47.416204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30a1c761-d09a-42e8-a2ed-52009fd5a87f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:47.416991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30a1c761-d09a-42e8-a2ed-52009fd5a87f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:47.417545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30a1c761-d09a-42e8-a2ed-52009fd5a87f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:47.418155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30a1c761-d09a-42e8-a2ed-52009fd5a87f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:47.667347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-efa0e3e3-499e-4d65-b5bf-02332d962349 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:47.668955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-efa0e3e3-499e-4d65-b5bf-02332d962349 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:47.702702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efa0e3e3-499e-4d65-b5bf-02332d962349 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:47.704131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efa0e3e3-499e-4d65-b5bf-02332d962349 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:47.705832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efa0e3e3-499e-4d65-b5bf-02332d962349 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:47.708888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efa0e3e3-499e-4d65-b5bf-02332d962349 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:47.709311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efa0e3e3-499e-4d65-b5bf-02332d962349 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:47.709782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efa0e3e3-499e-4d65-b5bf-02332d962349 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:47.800024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-30a1c761-d09a-42e8-a2ed-52009fd5a87f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:47.821666 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-30a1c761-d09a-42e8-a2ed-52009fd5a87f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.435778 Aug 27 05:27:47.823615 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3004/6006] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:47 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:47.864892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f700d9ad-53c4-4749-800c-48893a310248 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:47.878765 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f700d9ad-53c4-4749-800c-48893a310248 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance bb412459-f741-4f06-b81d-6c62547933d0 has no mapping to a cell. Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f700d9ad-53c4-4749-800c-48893a310248 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/bb412459-f741-4f06-b81d-6c62547933d0/action HTTP/1.1 Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 15 Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: {"os-stop": {}} Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance bb412459-f741-4f06-b81d-6c62547933d0 has no mapping to a cell. Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'bb412459-f741-4f06-b81d-6c62547933d0', 'body': {'os-stop': {}}} Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1431, in _get_instance Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance bb412459-f741-4f06-b81d-6c62547933d0 has no mapping to a cell. Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1464, in _stop_server Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1438, in _get_instance Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:27:47.896337 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb412459-f741-4f06-b81d-6c62547933d0 has no mapping to a cell. Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb412459-f741-4f06-b81d-6c62547933d0 has no mapping to a cell. Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f700d9ad-53c4-4749-800c-48893a310248 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance bb412459-f741-4f06-b81d-6c62547933d0 has no mapping to a cell. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f700d9ad-53c4-4749-800c-48893a310248 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/bb412459-f741-4f06-b81d-6c62547933d0/action" status: 404 len: 117 microversion: 2.1 time: 0.038572 Aug 27 05:27:47.905335 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3005/6007] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:47 2022] POST /compute/v2.1/servers/bb412459-f741-4f06-b81d-6c62547933d0/action => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:27:47.909321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-32b8c015-1af3-4908-9143-56606ed440ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:47.909948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-32b8c015-1af3-4908-9143-56606ed440ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:47.946673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32b8c015-1af3-4908-9143-56606ed440ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:47.947807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32b8c015-1af3-4908-9143-56606ed440ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:47.949664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32b8c015-1af3-4908-9143-56606ed440ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:47.951317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32b8c015-1af3-4908-9143-56606ed440ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:47.954752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32b8c015-1af3-4908-9143-56606ed440ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:47.956068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32b8c015-1af3-4908-9143-56606ed440ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:47.999726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-efa0e3e3-499e-4d65-b5bf-02332d962349 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:48.057322 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-efa0e3e3-499e-4d65-b5bf-02332d962349 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1301 microversion: 2.1 time: 0.381012 Aug 27 05:27:48.059802 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3003/6008] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:47 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1301 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:48.216206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b8283de5-d5ab-4125-b1df-b2d1ec38062f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:48.216855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b8283de5-d5ab-4125-b1df-b2d1ec38062f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:48.244062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-32b8c015-1af3-4908-9143-56606ed440ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:48.254320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8283de5-d5ab-4125-b1df-b2d1ec38062f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:48.261715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8283de5-d5ab-4125-b1df-b2d1ec38062f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:48.262515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8283de5-d5ab-4125-b1df-b2d1ec38062f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:48.267932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8283de5-d5ab-4125-b1df-b2d1ec38062f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:48.269236 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-32b8c015-1af3-4908-9143-56606ed440ee tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.361578 Aug 27 05:27:48.270286 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3006/6009] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:47 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:48.284227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8283de5-d5ab-4125-b1df-b2d1ec38062f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:48.294751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8283de5-d5ab-4125-b1df-b2d1ec38062f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:48.296193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8d8f60b-1fa7-4f64-b41a-3ec38fa9c51d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:48.297315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f8d8f60b-1fa7-4f64-b41a-3ec38fa9c51d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:48.309887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8d8f60b-1fa7-4f64-b41a-3ec38fa9c51d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:48.310414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8d8f60b-1fa7-4f64-b41a-3ec38fa9c51d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:48.310867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8d8f60b-1fa7-4f64-b41a-3ec38fa9c51d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:48.311649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8d8f60b-1fa7-4f64-b41a-3ec38fa9c51d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:48.312110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8d8f60b-1fa7-4f64-b41a-3ec38fa9c51d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:48.312544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8d8f60b-1fa7-4f64-b41a-3ec38fa9c51d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:48.942732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f8d8f60b-1fa7-4f64-b41a-3ec38fa9c51d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:48.945759 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8d8f60b-1fa7-4f64-b41a-3ec38fa9c51d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.653792 Aug 27 05:27:48.946496 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3007/6010] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:48 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:48.994224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b8283de5-d5ab-4125-b1df-b2d1ec38062f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:49.009038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-52e60def-8c7c-4744-b851-cd31f574de4f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:49.014093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-52e60def-8c7c-4744-b851-cd31f574de4f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e8c14217-c4eb-4d06-8565-05c26bae6008] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:49.021773 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b8283de5-d5ab-4125-b1df-b2d1ec38062f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1370 microversion: 2.1 time: 0.811685 Aug 27 05:27:49.024871 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3004/6011] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:48 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1370 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:49.040352 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-52e60def-8c7c-4744-b851-cd31f574de4f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance e8c14217-c4eb-4d06-8565-05c26bae6008 could not be found. Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-52e60def-8c7c-4744-b851-cd31f574de4f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/e8c14217-c4eb-4d06-8565-05c26bae6008/action HTTP/1.1 Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 15 Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: {"suspend": {}} Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e8c14217-c4eb-4d06-8565-05c26bae6008 could not be found. Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e8c14217-c4eb-4d06-8565-05c26bae6008', 'body': {'suspend': {}}} Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c14217-c4eb-4d06-8565-05c26bae6008 could not be found. Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c14217-c4eb-4d06-8565-05c26bae6008 could not be found. Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:49.046447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:49.059349 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:27:49.059349 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:27:49.059349 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c14217-c4eb-4d06-8565-05c26bae6008 could not be found. Aug 27 05:27:49.059349 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:27:49.067701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-52e60def-8c7c-4744-b851-cd31f574de4f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance e8c14217-c4eb-4d06-8565-05c26bae6008 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:27:49.069980 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-52e60def-8c7c-4744-b851-cd31f574de4f tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/e8c14217-c4eb-4d06-8565-05c26bae6008/action" status: 404 len: 111 microversion: 2.1 time: 0.069573 Aug 27 05:27:49.071658 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3008/6012] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:48 2022] POST /compute/v2.1/servers/e8c14217-c4eb-4d06-8565-05c26bae6008/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:27:49.088757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c1eb8c13-74a2-4f66-9a3e-6a65a3ab6b4b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:49.089036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-25b495f8-0d34-4499-aa88-c4dca36586b2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:49.090336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-25b495f8-0d34-4499-aa88-c4dca36586b2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:49.091122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c1eb8c13-74a2-4f66-9a3e-6a65a3ab6b4b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:49.104031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c13-74a2-4f66-9a3e-6a65a3ab6b4b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:49.104679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b495f8-0d34-4499-aa88-c4dca36586b2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:49.105614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b495f8-0d34-4499-aa88-c4dca36586b2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:49.105791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c13-74a2-4f66-9a3e-6a65a3ab6b4b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:49.106624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b495f8-0d34-4499-aa88-c4dca36586b2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:49.107614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c13-74a2-4f66-9a3e-6a65a3ab6b4b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:49.109112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b495f8-0d34-4499-aa88-c4dca36586b2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:49.109112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b495f8-0d34-4499-aa88-c4dca36586b2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:49.110913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b495f8-0d34-4499-aa88-c4dca36586b2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:49.123588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c13-74a2-4f66-9a3e-6a65a3ab6b4b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:49.125105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c13-74a2-4f66-9a3e-6a65a3ab6b4b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:49.128998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1eb8c13-74a2-4f66-9a3e-6a65a3ab6b4b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:49.248170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1eb8c13-74a2-4f66-9a3e-6a65a3ab6b4b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:49.259616 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c1eb8c13-74a2-4f66-9a3e-6a65a3ab6b4b tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1299 microversion: 2.1 time: 0.177558 Aug 27 05:27:49.277008 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3009/6013] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:49 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:49.530672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-25b495f8-0d34-4499-aa88-c4dca36586b2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:49.590661 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-25b495f8-0d34-4499-aa88-c4dca36586b2 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.512924 Aug 27 05:27:49.597998 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3005/6014] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:49 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:49.643161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c4dd1572-4e5d-480e-a801-881f2d91f3d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:49.644155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c4dd1572-4e5d-480e-a801-881f2d91f3d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:49.668752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dd1572-4e5d-480e-a801-881f2d91f3d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:49.669575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dd1572-4e5d-480e-a801-881f2d91f3d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:49.670260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dd1572-4e5d-480e-a801-881f2d91f3d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:49.671563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dd1572-4e5d-480e-a801-881f2d91f3d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:49.675183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dd1572-4e5d-480e-a801-881f2d91f3d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:49.675901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4dd1572-4e5d-480e-a801-881f2d91f3d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:50.067310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d2d930c-2113-469b-8329-b79edc7e4c6f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:50.068200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d2d930c-2113-469b-8329-b79edc7e4c6f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:50.102731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d2d930c-2113-469b-8329-b79edc7e4c6f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:50.103930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d2d930c-2113-469b-8329-b79edc7e4c6f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:50.104668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d2d930c-2113-469b-8329-b79edc7e4c6f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:50.105856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d2d930c-2113-469b-8329-b79edc7e4c6f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:50.106658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d2d930c-2113-469b-8329-b79edc7e4c6f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:50.107340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d2d930c-2113-469b-8329-b79edc7e4c6f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:50.185787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4dd1572-4e5d-480e-a801-881f2d91f3d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:50.203045 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c4dd1572-4e5d-480e-a801-881f2d91f3d3 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.564344 Aug 27 05:27:50.214943 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3010/6015] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:49 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:50.249228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a94dfcf1-6890-4e99-993e-7920bcf7d3d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:50.251041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a94dfcf1-6890-4e99-993e-7920bcf7d3d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:50.266627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a94dfcf1-6890-4e99-993e-7920bcf7d3d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:50.268253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a94dfcf1-6890-4e99-993e-7920bcf7d3d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:50.269635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a94dfcf1-6890-4e99-993e-7920bcf7d3d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:50.271449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a94dfcf1-6890-4e99-993e-7920bcf7d3d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:50.272646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a94dfcf1-6890-4e99-993e-7920bcf7d3d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:50.273809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a94dfcf1-6890-4e99-993e-7920bcf7d3d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:50.372433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-a94dfcf1-6890-4e99-993e-7920bcf7d3d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lazy-loading 'flavor' on Instance uuid 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:27:50.472885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8d2d930c-2113-469b-8329-b79edc7e4c6f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:50.476788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:50.493819 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d2d930c-2113-469b-8329-b79edc7e4c6f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1370 microversion: 2.1 time: 0.431118 Aug 27 05:27:50.504080 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3006/6016] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:50 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1370 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:50.522606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6cedc20b-4405-4baf-b5f4-0df2ede6908a tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:50.523744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6cedc20b-4405-4baf-b5f4-0df2ede6908a tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:50.531269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cedc20b-4405-4baf-b5f4-0df2ede6908a tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:50.532065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cedc20b-4405-4baf-b5f4-0df2ede6908a tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:50.532701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cedc20b-4405-4baf-b5f4-0df2ede6908a tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:50.534957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cedc20b-4405-4baf-b5f4-0df2ede6908a tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:50.536077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cedc20b-4405-4baf-b5f4-0df2ede6908a tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:50.536780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6cedc20b-4405-4baf-b5f4-0df2ede6908a tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:50.590764 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a94dfcf1-6890-4e99-993e-7920bcf7d3d7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 202 len: 0 microversion: 2.1 time: 0.345637 Aug 27 05:27:50.596221 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3011/6017] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:50 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:27:50.644367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8aabc17-067c-4f87-9b89-a4e7c5eacda1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:50.649695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e8aabc17-067c-4f87-9b89-a4e7c5eacda1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:50.681442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aabc17-067c-4f87-9b89-a4e7c5eacda1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:50.685000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aabc17-067c-4f87-9b89-a4e7c5eacda1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:50.686242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aabc17-067c-4f87-9b89-a4e7c5eacda1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:50.687835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aabc17-067c-4f87-9b89-a4e7c5eacda1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:50.688758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aabc17-067c-4f87-9b89-a4e7c5eacda1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:50.690540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8aabc17-067c-4f87-9b89-a4e7c5eacda1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:50.746193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6cedc20b-4405-4baf-b5f4-0df2ede6908a tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:50.806205 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6cedc20b-4405-4baf-b5f4-0df2ede6908a tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1299 microversion: 2.1 time: 0.294384 Aug 27 05:27:50.813210 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3007/6018] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:50 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1299 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:51.106619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e8aabc17-067c-4f87-9b89-a4e7c5eacda1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:51.132358 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e8aabc17-067c-4f87-9b89-a4e7c5eacda1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1512 microversion: 2.1 time: 0.522231 Aug 27 05:27:51.135644 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3012/6019] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:50 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1512 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:51.385337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-bbd32f5d-0887-4c47-b159-0bb0d7276d7e req-0a88de04-b6d8-432a-8f69-9440aaf6b11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a5fd42-8696-4dd7-80e1-af477f29a175", "tag": "ef5697f4-a9d4-4bff-b019-ca3cf6a6f8f1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:51.406822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bbd32f5d-0887-4c47-b159-0bb0d7276d7e req-0a88de04-b6d8-432a-8f69-9440aaf6b11a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:51.408704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bbd32f5d-0887-4c47-b159-0bb0d7276d7e req-0a88de04-b6d8-432a-8f69-9440aaf6b11a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:51.409683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bbd32f5d-0887-4c47-b159-0bb0d7276d7e req-0a88de04-b6d8-432a-8f69-9440aaf6b11a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:51.430573 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-bbd32f5d-0887-4c47-b159-0bb0d7276d7e req-0a88de04-b6d8-432a-8f69-9440aaf6b11a service nova] Creating event network-changed:ef5697f4-a9d4-4bff-b019-ca3cf6a6f8f1 for instance b8a5fd42-8696-4dd7-80e1-af477f29a175 on n-h2-820368-35 Aug 27 05:27:51.440521 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-bbd32f5d-0887-4c47-b159-0bb0d7276d7e req-0a88de04-b6d8-432a-8f69-9440aaf6b11a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065780 Aug 27 05:27:51.441527 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3008/6020] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:27:51.522473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c3a05e38-5fb6-4681-a920-3cc44aceab19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:51.523242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c3a05e38-5fb6-4681-a920-3cc44aceab19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:51.533792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3a05e38-5fb6-4681-a920-3cc44aceab19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:51.533792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3a05e38-5fb6-4681-a920-3cc44aceab19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:51.534474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3a05e38-5fb6-4681-a920-3cc44aceab19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:51.536455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3a05e38-5fb6-4681-a920-3cc44aceab19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:51.537457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3a05e38-5fb6-4681-a920-3cc44aceab19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:51.538052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c3a05e38-5fb6-4681-a920-3cc44aceab19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:51.591384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:51.850324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f09ee76-bc0a-4a82-9719-a6d4033144c8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:51.851268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3f09ee76-bc0a-4a82-9719-a6d4033144c8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:51.865411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c3a05e38-5fb6-4681-a920-3cc44aceab19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:51.870185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f09ee76-bc0a-4a82-9719-a6d4033144c8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:51.870709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f09ee76-bc0a-4a82-9719-a6d4033144c8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:51.879922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f09ee76-bc0a-4a82-9719-a6d4033144c8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:51.882127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f09ee76-bc0a-4a82-9719-a6d4033144c8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:51.883033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f09ee76-bc0a-4a82-9719-a6d4033144c8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:51.883720 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c3a05e38-5fb6-4681-a920-3cc44aceab19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1370 microversion: 2.1 time: 0.367399 Aug 27 05:27:51.883948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f09ee76-bc0a-4a82-9719-a6d4033144c8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:51.886084 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3013/6021] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:51 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1370 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:52.094016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3f09ee76-bc0a-4a82-9719-a6d4033144c8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:52.110252 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3f09ee76-bc0a-4a82-9719-a6d4033144c8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1299 microversion: 2.1 time: 0.265244 Aug 27 05:27:52.129325 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3009/6022] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:51 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1299 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:52.165026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-45ae85ff-ec3b-4e9e-b15f-352ca7d71c14 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:52.166620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-45ae85ff-ec3b-4e9e-b15f-352ca7d71c14 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:52.175455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45ae85ff-ec3b-4e9e-b15f-352ca7d71c14 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.176678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45ae85ff-ec3b-4e9e-b15f-352ca7d71c14 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.177750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45ae85ff-ec3b-4e9e-b15f-352ca7d71c14 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:52.178892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45ae85ff-ec3b-4e9e-b15f-352ca7d71c14 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.180591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45ae85ff-ec3b-4e9e-b15f-352ca7d71c14 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.181573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45ae85ff-ec3b-4e9e-b15f-352ca7d71c14 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:52.463133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-45ae85ff-ec3b-4e9e-b15f-352ca7d71c14 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:52.476008 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-45ae85ff-ec3b-4e9e-b15f-352ca7d71c14 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1495 microversion: 2.1 time: 0.316133 Aug 27 05:27:52.477219 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3014/6023] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:52 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1495 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:52.515988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:52.518073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:52.530991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.531868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.532310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:52.534675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.536500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.536856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:52.576948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lazy-loading 'flavor' on Instance uuid 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:27:52.598374 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Cannot 'suspend' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state suspended Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action HTTP/1.1 Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 15 Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: {"suspend": {}} Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot 'suspend' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state suspended Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '64999ba4-bbd9-4d23-9a4c-0caf8eb677b4', 'body': {'suspend': {}}} Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 27 05:27:52.600628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state suspended Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state suspended Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 409 to user: Cannot 'suspend' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state suspended {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f99f4359-71c9-4b23-96e1-732938a2301b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 409 len: 148 microversion: 2.1 time: 0.095277 Aug 27 05:27:52.611728 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3010/6024] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:52 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 148 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 05:27:52.622331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1215e8de-3c52-4e21-8a70-327658d480f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:52.623244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1215e8de-3c52-4e21-8a70-327658d480f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:52.641858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1215e8de-3c52-4e21-8a70-327658d480f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.643690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1215e8de-3c52-4e21-8a70-327658d480f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.644480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1215e8de-3c52-4e21-8a70-327658d480f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:52.645908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1215e8de-3c52-4e21-8a70-327658d480f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.646736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1215e8de-3c52-4e21-8a70-327658d480f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.647570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1215e8de-3c52-4e21-8a70-327658d480f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:52.832265 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1215e8de-3c52-4e21-8a70-327658d480f1 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 202 len: 0 microversion: 2.1 time: 0.216612 Aug 27 05:27:52.838041 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3015/6025] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:52 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:27:52.843374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bb02163e-0ea0-484e-90d4-bafd76631e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:52.844002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bb02163e-0ea0-484e-90d4-bafd76631e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:52.852138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb02163e-0ea0-484e-90d4-bafd76631e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.852637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb02163e-0ea0-484e-90d4-bafd76631e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.853072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb02163e-0ea0-484e-90d4-bafd76631e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:52.854018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb02163e-0ea0-484e-90d4-bafd76631e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.854678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb02163e-0ea0-484e-90d4-bafd76631e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.855128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb02163e-0ea0-484e-90d4-bafd76631e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:52.928662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f51d45c1-fa2a-4c3b-a33a-c9f22abf0e5d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:52.928662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f51d45c1-fa2a-4c3b-a33a-c9f22abf0e5d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:52.949104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51d45c1-fa2a-4c3b-a33a-c9f22abf0e5d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.949612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51d45c1-fa2a-4c3b-a33a-c9f22abf0e5d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.951184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51d45c1-fa2a-4c3b-a33a-c9f22abf0e5d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:52.957281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51d45c1-fa2a-4c3b-a33a-c9f22abf0e5d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.958052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51d45c1-fa2a-4c3b-a33a-c9f22abf0e5d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.958797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f51d45c1-fa2a-4c3b-a33a-c9f22abf0e5d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:53.085900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bb02163e-0ea0-484e-90d4-bafd76631e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:53.101727 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bb02163e-0ea0-484e-90d4-bafd76631e3e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1501 microversion: 2.1 time: 0.261805 Aug 27 05:27:53.103283 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3011/6026] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:52 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1501 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:53.148733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dda823d2-97a9-40cb-887c-d337af975eec tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:53.150833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dda823d2-97a9-40cb-887c-d337af975eec tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:53.177901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dda823d2-97a9-40cb-887c-d337af975eec tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:53.179237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dda823d2-97a9-40cb-887c-d337af975eec tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:53.180311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dda823d2-97a9-40cb-887c-d337af975eec tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:53.181912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dda823d2-97a9-40cb-887c-d337af975eec tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:53.185626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dda823d2-97a9-40cb-887c-d337af975eec tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:53.186951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dda823d2-97a9-40cb-887c-d337af975eec tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:53.416277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dda823d2-97a9-40cb-887c-d337af975eec tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:53.426483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f51d45c1-fa2a-4c3b-a33a-c9f22abf0e5d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:53.435427 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dda823d2-97a9-40cb-887c-d337af975eec tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1299 microversion: 2.1 time: 0.293133 Aug 27 05:27:53.436045 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3012/6027] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:53 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1299 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:53.447462 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f51d45c1-fa2a-4c3b-a33a-c9f22abf0e5d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1370 microversion: 2.1 time: 0.518825 Aug 27 05:27:53.460408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5fca873b-f6c7-46bf-9c14-4a33238a233d req-dd327b83-267e-46e1-85c2-368bb76c47a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8bceb6-cc73-4f2e-8858-e02d8fb84f37", "name": "network-vif-plugged", "status": "completed", "tag": "c7190bb7-8036-47e7-83f7-27efbe7164a7"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:53.461440 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3016/6028] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:52 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1370 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:53.480386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5fca873b-f6c7-46bf-9c14-4a33238a233d req-dd327b83-267e-46e1-85c2-368bb76c47a8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:53.481605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5fca873b-f6c7-46bf-9c14-4a33238a233d req-dd327b83-267e-46e1-85c2-368bb76c47a8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:53.482918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5fca873b-f6c7-46bf-9c14-4a33238a233d req-dd327b83-267e-46e1-85c2-368bb76c47a8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:53.537175 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-5fca873b-f6c7-46bf-9c14-4a33238a233d req-dd327b83-267e-46e1-85c2-368bb76c47a8 service nova] Creating event network-vif-plugged:c7190bb7-8036-47e7-83f7-27efbe7164a7 for instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 on n-h1-820368-35 Aug 27 05:27:53.552059 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5fca873b-f6c7-46bf-9c14-4a33238a233d req-dd327b83-267e-46e1-85c2-368bb76c47a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111687 Aug 27 05:27:53.553357 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3013/6029] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:54.143316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-80c127e9-bc46-4d7d-8e48-3ecaa2b107fd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:54.144526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80c127e9-bc46-4d7d-8e48-3ecaa2b107fd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:54.156545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80c127e9-bc46-4d7d-8e48-3ecaa2b107fd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.157563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80c127e9-bc46-4d7d-8e48-3ecaa2b107fd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.159003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80c127e9-bc46-4d7d-8e48-3ecaa2b107fd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.160420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80c127e9-bc46-4d7d-8e48-3ecaa2b107fd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.161293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80c127e9-bc46-4d7d-8e48-3ecaa2b107fd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.162112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80c127e9-bc46-4d7d-8e48-3ecaa2b107fd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.428522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-80c127e9-bc46-4d7d-8e48-3ecaa2b107fd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:54.443776 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-80c127e9-bc46-4d7d-8e48-3ecaa2b107fd tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1501 microversion: 2.1 time: 0.306352 Aug 27 05:27:54.444422 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3017/6030] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:54 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1501 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:54.458789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:54.463462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e3c8fa27-0472-4bcc-844e-1191152c8b56 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:54.464564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e3c8fa27-0472-4bcc-844e-1191152c8b56 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:54.474069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-0472-4bcc-844e-1191152c8b56 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.474932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-0472-4bcc-844e-1191152c8b56 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.475613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-0472-4bcc-844e-1191152c8b56 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.476200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fcd610a2-67be-4845-bd84-b5f6e77c4366 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:54.476845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fcd610a2-67be-4845-bd84-b5f6e77c4366 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:54.477395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-0472-4bcc-844e-1191152c8b56 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.478042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-0472-4bcc-844e-1191152c8b56 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.478663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-0472-4bcc-844e-1191152c8b56 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.500001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcd610a2-67be-4845-bd84-b5f6e77c4366 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.500656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcd610a2-67be-4845-bd84-b5f6e77c4366 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.501123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcd610a2-67be-4845-bd84-b5f6e77c4366 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.501947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcd610a2-67be-4845-bd84-b5f6e77c4366 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.508147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcd610a2-67be-4845-bd84-b5f6e77c4366 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.508621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcd610a2-67be-4845-bd84-b5f6e77c4366 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.854767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fcd610a2-67be-4845-bd84-b5f6e77c4366 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:54.873831 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fcd610a2-67be-4845-bd84-b5f6e77c4366 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1299 microversion: 2.1 time: 0.402669 Aug 27 05:27:54.875393 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3018/6031] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:54 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1299 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:54.988862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e3c8fa27-0472-4bcc-844e-1191152c8b56 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:55.004769 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e3c8fa27-0472-4bcc-844e-1191152c8b56 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1370 microversion: 2.1 time: 0.546434 Aug 27 05:27:55.019807 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3014/6032] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:54 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1370 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:55.477988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f315732d-bf15-44cb-b5db-bc440b230148 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:55.481719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f315732d-bf15-44cb-b5db-bc440b230148 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:55.503771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f315732d-bf15-44cb-b5db-bc440b230148 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:55.506988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f315732d-bf15-44cb-b5db-bc440b230148 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:55.507771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f315732d-bf15-44cb-b5db-bc440b230148 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:55.508677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f315732d-bf15-44cb-b5db-bc440b230148 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:55.509445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f315732d-bf15-44cb-b5db-bc440b230148 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:55.510082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f315732d-bf15-44cb-b5db-bc440b230148 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:55.902723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f315732d-bf15-44cb-b5db-bc440b230148 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:55.909895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bfb1630b-99eb-4169-8fa7-2349c02ce04e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:55.920630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bfb1630b-99eb-4169-8fa7-2349c02ce04e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:55.926082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:55.937079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfb1630b-99eb-4169-8fa7-2349c02ce04e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:55.941102 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f315732d-bf15-44cb-b5db-bc440b230148 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1501 microversion: 2.1 time: 0.472288 Aug 27 05:27:55.942349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfb1630b-99eb-4169-8fa7-2349c02ce04e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:55.944110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfb1630b-99eb-4169-8fa7-2349c02ce04e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:55.944233 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3019/6033] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:55 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1501 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:55.944804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfb1630b-99eb-4169-8fa7-2349c02ce04e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:55.945744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfb1630b-99eb-4169-8fa7-2349c02ce04e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:55.946422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bfb1630b-99eb-4169-8fa7-2349c02ce04e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:56.043714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-321d1290-5f22-437a-b6ca-008bdfb36206 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:56.049589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-321d1290-5f22-437a-b6ca-008bdfb36206 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:56.061840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321d1290-5f22-437a-b6ca-008bdfb36206 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:56.063436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321d1290-5f22-437a-b6ca-008bdfb36206 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:56.064670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321d1290-5f22-437a-b6ca-008bdfb36206 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:56.064881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bfb1630b-99eb-4169-8fa7-2349c02ce04e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:56.067592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321d1290-5f22-437a-b6ca-008bdfb36206 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:56.071125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321d1290-5f22-437a-b6ca-008bdfb36206 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:56.072180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321d1290-5f22-437a-b6ca-008bdfb36206 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:56.077962 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bfb1630b-99eb-4169-8fa7-2349c02ce04e tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1299 microversion: 2.1 time: 0.176517 Aug 27 05:27:56.080719 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3015/6034] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:55 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:56.306627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-321d1290-5f22-437a-b6ca-008bdfb36206 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:56.324105 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-321d1290-5f22-437a-b6ca-008bdfb36206 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1565 microversion: 2.1 time: 0.292714 Aug 27 05:27:56.324964 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3020/6035] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:56 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1565 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:56.351479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fa102a32-d94c-4e49-9c7a-821925c74779 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:56.352304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fa102a32-d94c-4e49-9c7a-821925c74779 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:56.360353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa102a32-d94c-4e49-9c7a-821925c74779 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:56.361263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa102a32-d94c-4e49-9c7a-821925c74779 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:56.361963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa102a32-d94c-4e49-9c7a-821925c74779 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:56.364061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa102a32-d94c-4e49-9c7a-821925c74779 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:56.365012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa102a32-d94c-4e49-9c7a-821925c74779 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:56.366286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa102a32-d94c-4e49-9c7a-821925c74779 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:56.540897 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fa102a32-d94c-4e49-9c7a-821925c74779 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.193761 Aug 27 05:27:56.551983 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3016/6036] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:27:56 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-interface => generated 285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:27:56.984235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b766fdad-054d-42c5-944b-06feea31dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:56.991115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b766fdad-054d-42c5-944b-06feea31dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:57.016636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b766fdad-054d-42c5-944b-06feea31dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:57.020243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b766fdad-054d-42c5-944b-06feea31dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:57.022854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b766fdad-054d-42c5-944b-06feea31dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:57.028168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b766fdad-054d-42c5-944b-06feea31dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:57.028910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b766fdad-054d-42c5-944b-06feea31dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:57.031130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b766fdad-054d-42c5-944b-06feea31dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:57.114127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e62c331-dc78-470c-a446-fdd6d8f5aae8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:57.114944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2e62c331-dc78-470c-a446-fdd6d8f5aae8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:57.167910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e62c331-dc78-470c-a446-fdd6d8f5aae8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:57.168824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e62c331-dc78-470c-a446-fdd6d8f5aae8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:57.169671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e62c331-dc78-470c-a446-fdd6d8f5aae8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:57.171022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e62c331-dc78-470c-a446-fdd6d8f5aae8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:57.182224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e62c331-dc78-470c-a446-fdd6d8f5aae8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:57.185046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e62c331-dc78-470c-a446-fdd6d8f5aae8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:57.417795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b766fdad-054d-42c5-944b-06feea31dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:57.453485 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b766fdad-054d-42c5-944b-06feea31dbfe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.477463 Aug 27 05:27:57.455526 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3021/6037] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:56 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:57.495225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d7cb6033-4a20-4851-ada2-7b0b186c4596 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:57.496384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d7cb6033-4a20-4851-ada2-7b0b186c4596 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:57.510936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2e62c331-dc78-470c-a446-fdd6d8f5aae8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:57.519797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7cb6033-4a20-4851-ada2-7b0b186c4596 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:57.520873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7cb6033-4a20-4851-ada2-7b0b186c4596 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:57.521733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7cb6033-4a20-4851-ada2-7b0b186c4596 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:57.522814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7cb6033-4a20-4851-ada2-7b0b186c4596 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:57.523823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7cb6033-4a20-4851-ada2-7b0b186c4596 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:57.524486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7cb6033-4a20-4851-ada2-7b0b186c4596 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:57.556181 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2e62c331-dc78-470c-a446-fdd6d8f5aae8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1299 microversion: 2.1 time: 0.451581 Aug 27 05:27:57.558825 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3017/6038] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:57 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1299 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:57.789420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d7cb6033-4a20-4851-ada2-7b0b186c4596 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:57.821620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d7cb6033-4a20-4851-ada2-7b0b186c4596 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.337533 Aug 27 05:27:57.822866 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3022/6039] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:57 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:57.850290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d79b099-d027-4bbc-aeb8-1ca3c62686e5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:57.856986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7d79b099-d027-4bbc-aeb8-1ca3c62686e5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 0a109110-fda1-439a-81d1-8e7dd8acba3f] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:57.870403 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-7d79b099-d027-4bbc-aeb8-1ca3c62686e5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 0a109110-fda1-439a-81d1-8e7dd8acba3f could not be found. Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d79b099-d027-4bbc-aeb8-1ca3c62686e5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/0a109110-fda1-439a-81d1-8e7dd8acba3f/action HTTP/1.1 Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 15 Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: {"unpause": {}} Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 0a109110-fda1-439a-81d1-8e7dd8acba3f could not be found. Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '0a109110-fda1-439a-81d1-8e7dd8acba3f', 'body': {'unpause': {}}} Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a109110-fda1-439a-81d1-8e7dd8acba3f could not be found. Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a109110-fda1-439a-81d1-8e7dd8acba3f could not be found. Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:57.872216 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:57.883855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:27:57.883855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:27:57.883855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a109110-fda1-439a-81d1-8e7dd8acba3f could not be found. Aug 27 05:27:57.883855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:57.883855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d79b099-d027-4bbc-aeb8-1ca3c62686e5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 0a109110-fda1-439a-81d1-8e7dd8acba3f could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:27:57.883855 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d79b099-d027-4bbc-aeb8-1ca3c62686e5 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/0a109110-fda1-439a-81d1-8e7dd8acba3f/action" status: 404 len: 111 microversion: 2.1 time: 0.035440 Aug 27 05:27:57.883855 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3018/6040] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:57 2022] POST /compute/v2.1/servers/0a109110-fda1-439a-81d1-8e7dd8acba3f/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:27:57.917327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-62f578fb-0413-40fc-9683-53496f3e68ae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:57.918241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-62f578fb-0413-40fc-9683-53496f3e68ae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:57.935550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f578fb-0413-40fc-9683-53496f3e68ae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:57.935550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f578fb-0413-40fc-9683-53496f3e68ae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:57.938597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f578fb-0413-40fc-9683-53496f3e68ae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:57.942534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f578fb-0413-40fc-9683-53496f3e68ae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:57.942891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f578fb-0413-40fc-9683-53496f3e68ae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:57.943510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f578fb-0413-40fc-9683-53496f3e68ae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.201614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-62f578fb-0413-40fc-9683-53496f3e68ae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:58.249304 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-62f578fb-0413-40fc-9683-53496f3e68ae tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.362629 Aug 27 05:27:58.251929 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3023/6041] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:57 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:58.280344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d0617a6-777e-4e6a-aaac-53492c6b4f0b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:58.290306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d0617a6-777e-4e6a-aaac-53492c6b4f0b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:58.305816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0617a6-777e-4e6a-aaac-53492c6b4f0b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.306323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0617a6-777e-4e6a-aaac-53492c6b4f0b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.306775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0617a6-777e-4e6a-aaac-53492c6b4f0b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.307574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0617a6-777e-4e6a-aaac-53492c6b4f0b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.308051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0617a6-777e-4e6a-aaac-53492c6b4f0b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.308493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0617a6-777e-4e6a-aaac-53492c6b4f0b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.556594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ae271e1e-c750-415f-9732-9089e93c65d9 req-4c4f973e-d3b5-414a-add0-6cfd944939e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8bceb6-cc73-4f2e-8858-e02d8fb84f37", "tag": "c7190bb7-8036-47e7-83f7-27efbe7164a7"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:58.577637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ae271e1e-c750-415f-9732-9089e93c65d9 req-4c4f973e-d3b5-414a-add0-6cfd944939e5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.582295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ae271e1e-c750-415f-9732-9089e93c65d9 req-4c4f973e-d3b5-414a-add0-6cfd944939e5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.583272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ae271e1e-c750-415f-9732-9089e93c65d9 req-4c4f973e-d3b5-414a-add0-6cfd944939e5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.615978 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ae271e1e-c750-415f-9732-9089e93c65d9 req-4c4f973e-d3b5-414a-add0-6cfd944939e5 service nova] Creating event network-changed:c7190bb7-8036-47e7-83f7-27efbe7164a7 for instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 on n-h1-820368-35 Aug 27 05:27:58.624137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d0617a6-777e-4e6a-aaac-53492c6b4f0b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:58.628942 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ae271e1e-c750-415f-9732-9089e93c65d9 req-4c4f973e-d3b5-414a-add0-6cfd944939e5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076710 Aug 27 05:27:58.630325 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3024/6042] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:27:58.638100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9ce630ff-56f3-415a-bb57-68f381613e05 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:58.639647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9ce630ff-56f3-415a-bb57-68f381613e05 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:58.641864 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d0617a6-777e-4e6a-aaac-53492c6b4f0b tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.367368 Aug 27 05:27:58.643938 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3019/6043] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:58 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:58.668451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:58.669002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:58.670411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ce630ff-56f3-415a-bb57-68f381613e05 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.671411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ce630ff-56f3-415a-bb57-68f381613e05 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.672137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ce630ff-56f3-415a-bb57-68f381613e05 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.673457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ce630ff-56f3-415a-bb57-68f381613e05 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.674197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ce630ff-56f3-415a-bb57-68f381613e05 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.675125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ce630ff-56f3-415a-bb57-68f381613e05 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.682728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.683489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.684160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.691962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.692754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.693547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.731739 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Cannot 'unpause' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action HTTP/1.1 Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 15 Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: {"unpause": {}} Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot 'unpause' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '64999ba4-bbd9-4d23-9a4c-0caf8eb677b4', 'body': {'unpause': {}}} Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 in vm_state active. Cannot unpause while the instance is in this state. Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:58.738744 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:58.743861 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:58.743861 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:27:58.743861 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:27:58.743861 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:27:58.743861 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.745245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 409 to user: Cannot 'unpause' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:27:58.746477 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-190785d9-508b-4a5d-841f-ef64e52447fe tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 409 len: 145 microversion: 2.1 time: 0.082066 Aug 27 05:27:58.747724 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3020/6044] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:58 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 145 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 05:27:58.766879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a9f35c93-ed52-4340-9d85-dea09f5d933e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:58.771626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a9f35c93-ed52-4340-9d85-dea09f5d933e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:58.791578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9f35c93-ed52-4340-9d85-dea09f5d933e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.792090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9f35c93-ed52-4340-9d85-dea09f5d933e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.794854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9f35c93-ed52-4340-9d85-dea09f5d933e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.795075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9ce630ff-56f3-415a-bb57-68f381613e05 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:58.795676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9f35c93-ed52-4340-9d85-dea09f5d933e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.796164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9f35c93-ed52-4340-9d85-dea09f5d933e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.796609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9f35c93-ed52-4340-9d85-dea09f5d933e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.807808 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9ce630ff-56f3-415a-bb57-68f381613e05 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1299 microversion: 2.1 time: 0.175460 Aug 27 05:27:58.824919 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3025/6045] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:58 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1299 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:59.152206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a9f35c93-ed52-4340-9d85-dea09f5d933e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:59.192252 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a9f35c93-ed52-4340-9d85-dea09f5d933e tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.434552 Aug 27 05:27:59.227184 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3021/6046] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:58 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:59.262373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-195aae65-0efb-405a-b4b9-f0f71a26a449 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:59.263714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-195aae65-0efb-405a-b4b9-f0f71a26a449 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:59.277274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-195aae65-0efb-405a-b4b9-f0f71a26a449 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:59.278273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-195aae65-0efb-405a-b4b9-f0f71a26a449 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:59.280647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-195aae65-0efb-405a-b4b9-f0f71a26a449 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:59.282324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-195aae65-0efb-405a-b4b9-f0f71a26a449 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:59.283992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-195aae65-0efb-405a-b4b9-f0f71a26a449 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:59.285435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-195aae65-0efb-405a-b4b9-f0f71a26a449 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:59.595674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-195aae65-0efb-405a-b4b9-f0f71a26a449 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:59.614105 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-195aae65-0efb-405a-b4b9-f0f71a26a449 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.367304 Aug 27 05:27:59.615450 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3026/6047] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:59 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:59.653383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-682f9ff7-81f9-429a-b744-b1dc06d5dc83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:59.654384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-682f9ff7-81f9-429a-b744-b1dc06d5dc83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 24634d88-baa5-4dd0-9c89-3e2304fd28ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:59.671601 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-682f9ff7-81f9-429a-b744-b1dc06d5dc83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 24634d88-baa5-4dd0-9c89-3e2304fd28ae could not be found. Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-682f9ff7-81f9-429a-b744-b1dc06d5dc83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/24634d88-baa5-4dd0-9c89-3e2304fd28ae/action HTTP/1.1 Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 18 Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: {"unshelve": null} Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 24634d88-baa5-4dd0-9c89-3e2304fd28ae could not be found. Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '24634d88-baa5-4dd0-9c89-3e2304fd28ae', 'body': {'unshelve': None}} Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24634d88-baa5-4dd0-9c89-3e2304fd28ae could not be found. Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24634d88-baa5-4dd0-9c89-3e2304fd28ae could not be found. Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:59.683124 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:59.689372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:59.689372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:59.689372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:59.689372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:59.689372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:27:59.689372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:27:59.689372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24634d88-baa5-4dd0-9c89-3e2304fd28ae could not be found. Aug 27 05:27:59.689372 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:27:59.689372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-682f9ff7-81f9-429a-b744-b1dc06d5dc83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 24634d88-baa5-4dd0-9c89-3e2304fd28ae could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:27:59.689372 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-682f9ff7-81f9-429a-b744-b1dc06d5dc83 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/24634d88-baa5-4dd0-9c89-3e2304fd28ae/action" status: 404 len: 111 microversion: 2.1 time: 0.041014 Aug 27 05:27:59.701420 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3022/6048] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:59 2022] POST /compute/v2.1/servers/24634d88-baa5-4dd0-9c89-3e2304fd28ae/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:27:59.710566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8195297-4ff3-4068-8c22-7956da2db334 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:59.714239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f8195297-4ff3-4068-8c22-7956da2db334 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:59.748000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8195297-4ff3-4068-8c22-7956da2db334 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:59.749447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8195297-4ff3-4068-8c22-7956da2db334 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:59.750445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8195297-4ff3-4068-8c22-7956da2db334 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:59.752755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8195297-4ff3-4068-8c22-7956da2db334 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:59.753497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8195297-4ff3-4068-8c22-7956da2db334 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:59.754393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8195297-4ff3-4068-8c22-7956da2db334 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:59.836151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-978055c9-5270-4e75-9f50-b2759362c367 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:59.837194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-978055c9-5270-4e75-9f50-b2759362c367 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:59.848465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978055c9-5270-4e75-9f50-b2759362c367 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:59.851558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978055c9-5270-4e75-9f50-b2759362c367 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:59.852244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978055c9-5270-4e75-9f50-b2759362c367 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:59.854806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978055c9-5270-4e75-9f50-b2759362c367 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:59.855545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978055c9-5270-4e75-9f50-b2759362c367 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:59.856210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-978055c9-5270-4e75-9f50-b2759362c367 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:00.177961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-978055c9-5270-4e75-9f50-b2759362c367 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:00.192521 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-978055c9-5270-4e75-9f50-b2759362c367 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1299 microversion: 2.1 time: 0.360586 Aug 27 05:28:00.196638 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3023/6049] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:59 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1299 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:00.265519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f8195297-4ff3-4068-8c22-7956da2db334 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:00.281754 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8195297-4ff3-4068-8c22-7956da2db334 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.584208 Aug 27 05:28:00.283211 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3027/6050] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:59 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:28:00.328817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1503b907-3b83-44e4-b7ca-dbede590bfe9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:00.334314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1503b907-3b83-44e4-b7ca-dbede590bfe9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:00.370273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503b907-3b83-44e4-b7ca-dbede590bfe9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:00.371784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503b907-3b83-44e4-b7ca-dbede590bfe9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:00.372644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503b907-3b83-44e4-b7ca-dbede590bfe9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:00.373997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503b907-3b83-44e4-b7ca-dbede590bfe9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:00.375279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503b907-3b83-44e4-b7ca-dbede590bfe9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:00.377210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1503b907-3b83-44e4-b7ca-dbede590bfe9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:00.613878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-a2cceeb7-e194-4cf2-927a-51cf118109fe req-8cef1ea3-3270-42e5-8aba-01360810ce1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a5fd42-8696-4dd7-80e1-af477f29a175", "name": "network-vif-plugged", "status": "completed", "tag": "ef5697f4-a9d4-4bff-b019-ca3cf6a6f8f1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:00.651525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a2cceeb7-e194-4cf2-927a-51cf118109fe req-8cef1ea3-3270-42e5-8aba-01360810ce1f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:00.653801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a2cceeb7-e194-4cf2-927a-51cf118109fe req-8cef1ea3-3270-42e5-8aba-01360810ce1f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:00.657123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a2cceeb7-e194-4cf2-927a-51cf118109fe req-8cef1ea3-3270-42e5-8aba-01360810ce1f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:00.681357 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-a2cceeb7-e194-4cf2-927a-51cf118109fe req-8cef1ea3-3270-42e5-8aba-01360810ce1f service nova] Creating event network-vif-plugged:ef5697f4-a9d4-4bff-b019-ca3cf6a6f8f1 for instance b8a5fd42-8696-4dd7-80e1-af477f29a175 on n-h2-820368-35 Aug 27 05:28:00.689621 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-a2cceeb7-e194-4cf2-927a-51cf118109fe req-8cef1ea3-3270-42e5-8aba-01360810ce1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.486661 Aug 27 05:28:00.690449 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3024/6051] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:00.702415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1503b907-3b83-44e4-b7ca-dbede590bfe9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:00.714325 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1503b907-3b83-44e4-b7ca-dbede590bfe9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.402596 Aug 27 05:28:00.737851 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3028/6052] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:00 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:00.759395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:00.760899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:00.791144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:00.791144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:00.791822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:00.793170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:00.794030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:00.794809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:00.859383 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Cannot 'unshelve' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action HTTP/1.1 Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 18 Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: {"unshelve": null} Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot 'unshelve' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '64999ba4-bbd9-4d23-9a4c-0caf8eb677b4', 'body': {'unshelve': None}} Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 in vm_state active. Cannot unshelve while the instance is in this state. Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:28:00.863529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 409 to user: Cannot 'unshelve' instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 while it is in vm_state active {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-935a284a-37bf-4854-a801-890d2306f5ce tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action" status: 409 len: 146 microversion: 2.1 time: 0.119910 Aug 27 05:28:00.883418 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3025/6053] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:28:00 2022] POST /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4/action => generated 146 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:28:00.887913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd4be7ba-cdb8-4df4-806c-e1e53567d8a7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:00.889467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd4be7ba-cdb8-4df4-806c-e1e53567d8a7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:00.915923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4be7ba-cdb8-4df4-806c-e1e53567d8a7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:00.916808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4be7ba-cdb8-4df4-806c-e1e53567d8a7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:00.917556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4be7ba-cdb8-4df4-806c-e1e53567d8a7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:00.918879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4be7ba-cdb8-4df4-806c-e1e53567d8a7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:00.919898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4be7ba-cdb8-4df4-806c-e1e53567d8a7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:00.920553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd4be7ba-cdb8-4df4-806c-e1e53567d8a7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:01.233250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dd4be7ba-cdb8-4df4-806c-e1e53567d8a7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:01.243125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d65290b-00e7-4e1f-87e3-edcc9e14cbf5 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:01.245122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0d65290b-00e7-4e1f-87e3-edcc9e14cbf5 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:01.248028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:01.263669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d65290b-00e7-4e1f-87e3-edcc9e14cbf5 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:01.267821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d65290b-00e7-4e1f-87e3-edcc9e14cbf5 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:01.269280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d65290b-00e7-4e1f-87e3-edcc9e14cbf5 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:01.271221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d65290b-00e7-4e1f-87e3-edcc9e14cbf5 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:01.272652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d65290b-00e7-4e1f-87e3-edcc9e14cbf5 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:01.273660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d65290b-00e7-4e1f-87e3-edcc9e14cbf5 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:01.282496 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd4be7ba-cdb8-4df4-806c-e1e53567d8a7 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.402685 Aug 27 05:28:01.284972 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3029/6054] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:00 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:28:01.314746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-62dd8fc3-c11b-4708-87b7-f7c746bd5384 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:01.320687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-62dd8fc3-c11b-4708-87b7-f7c746bd5384 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:01.344989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62dd8fc3-c11b-4708-87b7-f7c746bd5384 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:01.348923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62dd8fc3-c11b-4708-87b7-f7c746bd5384 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:01.350417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62dd8fc3-c11b-4708-87b7-f7c746bd5384 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:01.352914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62dd8fc3-c11b-4708-87b7-f7c746bd5384 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:01.354238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62dd8fc3-c11b-4708-87b7-f7c746bd5384 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:01.355199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62dd8fc3-c11b-4708-87b7-f7c746bd5384 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:01.549081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d65290b-00e7-4e1f-87e3-edcc9e14cbf5 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:01.565054 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0d65290b-00e7-4e1f-87e3-edcc9e14cbf5 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1299 microversion: 2.1 time: 0.332539 Aug 27 05:28:01.567334 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3026/6055] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:01 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1299 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:01.688834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-62dd8fc3-c11b-4708-87b7-f7c746bd5384 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:01.702806 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-62dd8fc3-c11b-4708-87b7-f7c746bd5384 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.395441 Aug 27 05:28:01.703774 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3030/6056] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:01 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:01.738539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b540ff37-e6d7-4f04-8443-fb714bf548b0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1717249369_updated"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:01.745691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b540ff37-e6d7-4f04-8443-fb714bf548b0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: c6f1fa79-40ee-4016-a0d1-38c88b4c3c71] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:01.756975 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-b540ff37-e6d7-4f04-8443-fb714bf548b0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance c6f1fa79-40ee-4016-a0d1-38c88b4c3c71 could not be found. Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b540ff37-e6d7-4f04-8443-fb714bf548b0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: request: PUT /compute/v2.1/servers/c6f1fa79-40ee-4016-a0d1-38c88b4c3c71 HTTP/1.1 Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 81 Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1717249369_updated"}} Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance c6f1fa79-40ee-4016-a0d1-38c88b4c3c71 could not be found. Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'c6f1fa79-40ee-4016-a0d1-38c88b4c3c71', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1717249369_updated'}}} Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f1fa79-40ee-4016-a0d1-38c88b4c3c71 could not be found. Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 916, in update Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 05:28:01.760500 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f1fa79-40ee-4016-a0d1-38c88b4c3c71 could not be found. Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f1fa79-40ee-4016-a0d1-38c88b4c3c71 could not be found. Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b540ff37-e6d7-4f04-8443-fb714bf548b0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance c6f1fa79-40ee-4016-a0d1-38c88b4c3c71 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:28:01.765011 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b540ff37-e6d7-4f04-8443-fb714bf548b0 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "PUT /compute/v2.1/servers/c6f1fa79-40ee-4016-a0d1-38c88b4c3c71" status: 404 len: 111 microversion: 2.1 time: 0.034212 Aug 27 05:28:01.766346 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3027/6057] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:28:01 2022] PUT /compute/v2.1/servers/c6f1fa79-40ee-4016-a0d1-38c88b4c3c71 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:28:01.780575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3549b513-1a76-4dba-9add-862dda26c3bf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:01.789198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3549b513-1a76-4dba-9add-862dda26c3bf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:01.805454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3549b513-1a76-4dba-9add-862dda26c3bf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:01.806952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3549b513-1a76-4dba-9add-862dda26c3bf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:01.807157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3549b513-1a76-4dba-9add-862dda26c3bf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:01.808483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3549b513-1a76-4dba-9add-862dda26c3bf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:01.809731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3549b513-1a76-4dba-9add-862dda26c3bf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:01.810521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3549b513-1a76-4dba-9add-862dda26c3bf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:02.045839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3549b513-1a76-4dba-9add-862dda26c3bf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:02.060002 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3549b513-1a76-4dba-9add-862dda26c3bf tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.288287 Aug 27 05:28:02.061287 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3031/6058] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:01 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:28:02.090768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d1488735-643d-4818-8cb0-4081fc345f20 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:02.091841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d1488735-643d-4818-8cb0-4081fc345f20 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:02.104673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1488735-643d-4818-8cb0-4081fc345f20 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:02.105539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1488735-643d-4818-8cb0-4081fc345f20 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:02.106334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1488735-643d-4818-8cb0-4081fc345f20 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:02.107893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1488735-643d-4818-8cb0-4081fc345f20 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:02.108935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1488735-643d-4818-8cb0-4081fc345f20 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:02.110106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d1488735-643d-4818-8cb0-4081fc345f20 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:02.326512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d1488735-643d-4818-8cb0-4081fc345f20 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:02.338058 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d1488735-643d-4818-8cb0-4081fc345f20 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.252041 Aug 27 05:28:02.338639 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3028/6059] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:02 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:02.362392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3fab147-0bf5-4e57-aaea-eaa7f345fd7a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3fab147-0bf5-4e57-aaea-eaa7f345fd7a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: request: PUT /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 HTTP/1.1 Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 280 Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '64999ba4-bbd9-4d23-9a4c-0caf8eb677b4', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:02.372734 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3fab147-0bf5-4e57-aaea-eaa7f345fd7a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:28:02.380463 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e3fab147-0bf5-4e57-aaea-eaa7f345fd7a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "PUT /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 400 len: 619 microversion: 2.1 time: 0.018947 Aug 27 05:28:02.384354 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3032/6060] 10.222.0.58 () {60 vars in 1257 bytes} [Sat Aug 27 05:28:02 2022] PUT /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:28:02.391734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e719fe44-afaf-451e-afa3-0dd8f6ce5d0d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:02.393156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e719fe44-afaf-451e-afa3-0dd8f6ce5d0d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:02.405786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:02.409347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e719fe44-afaf-451e-afa3-0dd8f6ce5d0d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:02.410299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e719fe44-afaf-451e-afa3-0dd8f6ce5d0d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:02.410928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e719fe44-afaf-451e-afa3-0dd8f6ce5d0d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:02.412933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e719fe44-afaf-451e-afa3-0dd8f6ce5d0d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:02.413912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e719fe44-afaf-451e-afa3-0dd8f6ce5d0d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:02.414952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e719fe44-afaf-451e-afa3-0dd8f6ce5d0d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:02.448920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:02.611855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e4d36b7b-d87e-4891-af88-689cc436c0a8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:02.612972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e4d36b7b-d87e-4891-af88-689cc436c0a8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:02.631620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4d36b7b-d87e-4891-af88-689cc436c0a8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:02.633152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4d36b7b-d87e-4891-af88-689cc436c0a8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:02.634316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4d36b7b-d87e-4891-af88-689cc436c0a8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:02.636149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4d36b7b-d87e-4891-af88-689cc436c0a8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:02.638555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4d36b7b-d87e-4891-af88-689cc436c0a8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:02.640047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4d36b7b-d87e-4891-af88-689cc436c0a8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:02.685664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e719fe44-afaf-451e-afa3-0dd8f6ce5d0d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:02.749282 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e719fe44-afaf-451e-afa3-0dd8f6ce5d0d tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.366050 Aug 27 05:28:02.760455 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3029/6061] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:02 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:02.797525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-393dc623-8038-4ac9-8ac9-fc6a436b3132 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:02.799121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-393dc623-8038-4ac9-8ac9-fc6a436b3132 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:02.814340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-393dc623-8038-4ac9-8ac9-fc6a436b3132 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:02.815251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-393dc623-8038-4ac9-8ac9-fc6a436b3132 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:02.815978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-393dc623-8038-4ac9-8ac9-fc6a436b3132 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:02.817093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-393dc623-8038-4ac9-8ac9-fc6a436b3132 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:02.817998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-393dc623-8038-4ac9-8ac9-fc6a436b3132 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:02.819337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-393dc623-8038-4ac9-8ac9-fc6a436b3132 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:02.873305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e4d36b7b-d87e-4891-af88-689cc436c0a8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:02.890875 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e4d36b7b-d87e-4891-af88-689cc436c0a8 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1299 microversion: 2.1 time: 0.287336 Aug 27 05:28:02.893169 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3033/6062] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:02 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1299 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:03.031345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-393dc623-8038-4ac9-8ac9-fc6a436b3132 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:03.049102 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-393dc623-8038-4ac9-8ac9-fc6a436b3132 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.265498 Aug 27 05:28:03.049814 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3030/6063] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:02 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:28:03.079029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53f4d2b2-11a7-47c4-9ad7-75dc074c9c08 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53f4d2b2-11a7-47c4-9ad7-75dc074c9c08 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: request: PUT /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 HTTP/1.1 Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 24 Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: {"server": {"name": ""}} Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '64999ba4-bbd9-4d23-9a4c-0caf8eb677b4', 'body': {'server': {'name': ''}}} Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi '' Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:28:03.084045 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 05:28:03.092634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:03.092634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:03.092634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:03.092634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:03.092634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:03.092634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:03.092634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:28:03.092634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:28:03.092634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 05:28:03.092634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:03.097420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53f4d2b2-11a7-47c4-9ad7-75dc074c9c08 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:28:03.098952 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-53f4d2b2-11a7-47c4-9ad7-75dc074c9c08 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "PUT /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 400 len: 108 microversion: 2.1 time: 0.024827 Aug 27 05:28:03.099983 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3034/6064] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:28:03 2022] PUT /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 05:28:03.113164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a304484e-4f66-4263-8fd2-2735546f9ae4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:03.116360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a304484e-4f66-4263-8fd2-2735546f9ae4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:03.139696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a304484e-4f66-4263-8fd2-2735546f9ae4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:03.140982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a304484e-4f66-4263-8fd2-2735546f9ae4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:03.140982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a304484e-4f66-4263-8fd2-2735546f9ae4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:03.146628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a304484e-4f66-4263-8fd2-2735546f9ae4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:03.146628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a304484e-4f66-4263-8fd2-2735546f9ae4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:03.146628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a304484e-4f66-4263-8fd2-2735546f9ae4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:03.370479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a304484e-4f66-4263-8fd2-2735546f9ae4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:03.384301 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a304484e-4f66-4263-8fd2-2735546f9ae4 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1504 microversion: 2.1 time: 0.277768 Aug 27 05:28:03.387299 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3031/6065] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:03 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:03.915148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b608e02-6692-435b-a4b5-45ff8a036a7d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:03.915983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b608e02-6692-435b-a4b5-45ff8a036a7d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:03.930278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b608e02-6692-435b-a4b5-45ff8a036a7d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:03.931205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b608e02-6692-435b-a4b5-45ff8a036a7d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:03.931838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b608e02-6692-435b-a4b5-45ff8a036a7d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:03.933282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b608e02-6692-435b-a4b5-45ff8a036a7d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:03.934151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b608e02-6692-435b-a4b5-45ff8a036a7d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:03.934989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b608e02-6692-435b-a4b5-45ff8a036a7d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:04.087413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b608e02-6692-435b-a4b5-45ff8a036a7d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:04.102172 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b608e02-6692-435b-a4b5-45ff8a036a7d tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1472 microversion: 2.1 time: 0.192522 Aug 27 05:28:04.104159 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3035/6066] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:03 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:04.141756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6950a57d-45f0-41fc-b032-8be5f36d91fe tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:04.143291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6950a57d-45f0-41fc-b032-8be5f36d91fe tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:04.159141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6950a57d-45f0-41fc-b032-8be5f36d91fe tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:04.160812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6950a57d-45f0-41fc-b032-8be5f36d91fe tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:04.162229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6950a57d-45f0-41fc-b032-8be5f36d91fe tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:04.163861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6950a57d-45f0-41fc-b032-8be5f36d91fe tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:04.165333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6950a57d-45f0-41fc-b032-8be5f36d91fe tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:04.166600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6950a57d-45f0-41fc-b032-8be5f36d91fe tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:04.317221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6950a57d-45f0-41fc-b032-8be5f36d91fe tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:04.334458 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6950a57d-45f0-41fc-b032-8be5f36d91fe tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1472 microversion: 2.1 time: 0.199899 Aug 27 05:28:04.335567 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3032/6067] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:04 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:04.370284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-92178756-cfed-47cd-858c-c18125136954 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:04.372659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-92178756-cfed-47cd-858c-c18125136954 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:04.385639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92178756-cfed-47cd-858c-c18125136954 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:04.392614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92178756-cfed-47cd-858c-c18125136954 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:04.397976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92178756-cfed-47cd-858c-c18125136954 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:04.399299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92178756-cfed-47cd-858c-c18125136954 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:04.399938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92178756-cfed-47cd-858c-c18125136954 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:04.400569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92178756-cfed-47cd-858c-c18125136954 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:04.600595 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-92178756-cfed-47cd-858c-c18125136954 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1625 microversion: 2.1 time: 0.238768 Aug 27 05:28:04.602540 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3036/6068] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:04 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1625 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:04.637958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a6c29ad7-d7e5-4780-a5af-dcd60cbb9aa8 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:04.639647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a6c29ad7-d7e5-4780-a5af-dcd60cbb9aa8 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:04.653093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c29ad7-d7e5-4780-a5af-dcd60cbb9aa8 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:04.654467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c29ad7-d7e5-4780-a5af-dcd60cbb9aa8 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:04.655677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c29ad7-d7e5-4780-a5af-dcd60cbb9aa8 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:04.658008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c29ad7-d7e5-4780-a5af-dcd60cbb9aa8 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:04.659271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c29ad7-d7e5-4780-a5af-dcd60cbb9aa8 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:04.660453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6c29ad7-d7e5-4780-a5af-dcd60cbb9aa8 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:04.895535 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a6c29ad7-d7e5-4780-a5af-dcd60cbb9aa8 tempest-TestSecurityGroupsBasicOps-1763204045 tempest-TestSecurityGroupsBasicOps-1763204045-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1915 microversion: 2.1 time: 0.262074 Aug 27 05:28:04.896612 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3033/6069] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:04 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1915 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:28:05.062469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c95eba31-7c97-4b5b-8de6-7a518c8f9b85 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:05.063348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c95eba31-7c97-4b5b-8de6-7a518c8f9b85 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:05.076160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95eba31-7c97-4b5b-8de6-7a518c8f9b85 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:05.077962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95eba31-7c97-4b5b-8de6-7a518c8f9b85 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:05.078781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95eba31-7c97-4b5b-8de6-7a518c8f9b85 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:05.080145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95eba31-7c97-4b5b-8de6-7a518c8f9b85 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:05.080992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95eba31-7c97-4b5b-8de6-7a518c8f9b85 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:05.081694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c95eba31-7c97-4b5b-8de6-7a518c8f9b85 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:05.115005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c95eba31-7c97-4b5b-8de6-7a518c8f9b85 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:28:05.297417 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c95eba31-7c97-4b5b-8de6-7a518c8f9b85 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 204 len: 0 microversion: 2.1 time: 0.241842 Aug 27 05:28:05.303254 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3037/6070] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:28:05 2022] DELETE /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:28:05.314622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-886b929d-de79-49f2-970d-3c8af29dc7fd tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:05.319392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-886b929d-de79-49f2-970d-3c8af29dc7fd tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:05.331769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-886b929d-de79-49f2-970d-3c8af29dc7fd tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:05.333167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-886b929d-de79-49f2-970d-3c8af29dc7fd tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:05.334110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-886b929d-de79-49f2-970d-3c8af29dc7fd tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:05.335618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-886b929d-de79-49f2-970d-3c8af29dc7fd tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:05.336787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-886b929d-de79-49f2-970d-3c8af29dc7fd tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:05.337703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-886b929d-de79-49f2-970d-3c8af29dc7fd tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:05.503692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-886b929d-de79-49f2-970d-3c8af29dc7fd tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:05.522566 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-886b929d-de79-49f2-970d-3c8af29dc7fd tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1478 microversion: 2.1 time: 0.216521 Aug 27 05:28:05.523527 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3034/6071] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:05 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1478 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:06.546584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4c987da9-4001-4fb5-ac13-81c7c6d9ced7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:06.547608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4c987da9-4001-4fb5-ac13-81c7c6d9ced7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:06.563024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c987da9-4001-4fb5-ac13-81c7c6d9ced7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:06.572036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c987da9-4001-4fb5-ac13-81c7c6d9ced7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:06.572431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c987da9-4001-4fb5-ac13-81c7c6d9ced7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:06.573350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c987da9-4001-4fb5-ac13-81c7c6d9ced7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:06.573884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c987da9-4001-4fb5-ac13-81c7c6d9ced7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:06.574327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c987da9-4001-4fb5-ac13-81c7c6d9ced7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:06.775728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4c987da9-4001-4fb5-ac13-81c7c6d9ced7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:06.790020 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4c987da9-4001-4fb5-ac13-81c7c6d9ced7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1478 microversion: 2.1 time: 0.247495 Aug 27 05:28:06.791136 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3038/6072] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:06 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1478 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:07.817501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5b3d2d6a-8d18-4951-9f9f-a003548f985f tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:07.818255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5b3d2d6a-8d18-4951-9f9f-a003548f985f tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:07.831952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3d2d6a-8d18-4951-9f9f-a003548f985f tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:07.837677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3d2d6a-8d18-4951-9f9f-a003548f985f tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:07.838853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3d2d6a-8d18-4951-9f9f-a003548f985f tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:07.839887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3d2d6a-8d18-4951-9f9f-a003548f985f tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:07.840531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3d2d6a-8d18-4951-9f9f-a003548f985f tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:07.842403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b3d2d6a-8d18-4951-9f9f-a003548f985f tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:07.957106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5b3d2d6a-8d18-4951-9f9f-a003548f985f tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:07.967849 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5b3d2d6a-8d18-4951-9f9f-a003548f985f tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1478 microversion: 2.1 time: 0.157283 Aug 27 05:28:07.968646 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3035/6073] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:07 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1478 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:28:09.001000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-20167489-b4b2-468e-8e4b-121b8cc33181 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:09.005235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-20167489-b4b2-468e-8e4b-121b8cc33181 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:09.031471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:09.042928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20167489-b4b2-468e-8e4b-121b8cc33181 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:09.043966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20167489-b4b2-468e-8e4b-121b8cc33181 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:09.045050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20167489-b4b2-468e-8e4b-121b8cc33181 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:09.046659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20167489-b4b2-468e-8e4b-121b8cc33181 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:09.047787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20167489-b4b2-468e-8e4b-121b8cc33181 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:09.055845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20167489-b4b2-468e-8e4b-121b8cc33181 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:09.081866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b22563f1-4115-4eb4-8d69-340e1bb419ce req-c223c579-b5f6-419b-8dbf-a618c47ebfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a5fd42-8696-4dd7-80e1-af477f29a175", "name": "network-vif-deleted", "tag": "ef5697f4-a9d4-4bff-b019-ca3cf6a6f8f1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:09.139544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b22563f1-4115-4eb4-8d69-340e1bb419ce req-c223c579-b5f6-419b-8dbf-a618c47ebfe9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:09.140236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b22563f1-4115-4eb4-8d69-340e1bb419ce req-c223c579-b5f6-419b-8dbf-a618c47ebfe9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:09.140770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b22563f1-4115-4eb4-8d69-340e1bb419ce req-c223c579-b5f6-419b-8dbf-a618c47ebfe9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:09.174766 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b22563f1-4115-4eb4-8d69-340e1bb419ce req-c223c579-b5f6-419b-8dbf-a618c47ebfe9 service nova] Creating event network-vif-deleted:ef5697f4-a9d4-4bff-b019-ca3cf6a6f8f1 for instance b8a5fd42-8696-4dd7-80e1-af477f29a175 on n-h2-820368-35 Aug 27 05:28:09.195008 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b22563f1-4115-4eb4-8d69-340e1bb419ce req-c223c579-b5f6-419b-8dbf-a618c47ebfe9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134919 Aug 27 05:28:09.197104 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3036/6074] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:09.297194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-20167489-b4b2-468e-8e4b-121b8cc33181 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:09.346524 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-20167489-b4b2-468e-8e4b-121b8cc33181 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 200 len: 1478 microversion: 2.1 time: 0.355514 Aug 27 05:28:09.347489 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3039/6075] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:08 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 1478 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:10.389579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:10.391427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: b8a5fd42-8696-4dd7-80e1-af477f29a175] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:10.404216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:10.405455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:10.406629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:10.408226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:10.409348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:10.410373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:10.442417 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] HTTP exception thrown: Instance b8a5fd42-8696-4dd7-80e1-af477f29a175 could not be found. Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Request method failure captured: Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 HTTP/1.1 Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqwuEaA1mryCwxLOEvy6aaSZTN6LoTzwrzj_BOewWtonzg7myc23IadyNog0b8FTJ_j43C9wFvwr1dNj3W_JjWLJeRZmHeHJUOBj77_qIXL6peGdy3jrCNuiVGoTM9ghTGn7soEO_FHFb5l1qpk3-0_ZzQzao2c03SCErIxSueEKxo Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 28b18ee854244b3998616cf5f5a05fcf Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1611286681 Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_28b18ee854244b3998616cf5f5a05fcf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/28b18ee854244b3998616cf5f5a05fcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/28b18ee854244b3998616cf5f5a05fcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/28b18ee854244b3998616cf5f5a05fcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1611286681 Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 28b18ee854244b3998616cf5f5a05fcf Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1611286681 Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestSecurityGroupsBasicOps-1611286681-project Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 1ad2e05d9d024047acfe2ce68950b68e Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1611286681-project Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance b8a5fd42-8696-4dd7-80e1-af477f29a175 could not be found. Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'b8a5fd42-8696-4dd7-80e1-af477f29a175'} Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a5fd42-8696-4dd7-80e1-af477f29a175 could not be found. Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a5fd42-8696-4dd7-80e1-af477f29a175 could not be found. Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:10.446049 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:10.455664 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:10.455664 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:10.455664 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:10.455664 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:10.455664 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:28:10.455664 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:28:10.455664 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a5fd42-8696-4dd7-80e1-af477f29a175 could not be found. Aug 27 05:28:10.455664 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:10.456810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Returning 404 to user: Instance b8a5fd42-8696-4dd7-80e1-af477f29a175 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:28:10.458171 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c9443e4-9903-4911-8360-27770e4c47bf tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175" status: 404 len: 111 microversion: 2.1 time: 0.074687 Aug 27 05:28:10.459589 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3037/6076] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:10 2022] GET /compute/v2.1/servers/b8a5fd42-8696-4dd7-80e1-af477f29a175 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:28:11.648059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:11.649363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:11.658247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:11.659202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:11.660232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:11.660770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:11.661271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:11.661999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:11.712531 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 HTTP/1.1 Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e01c08d1-46fc-4e59-88f8-e22358700d09'} Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:28:11.714954 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e9b8c716-495f-47fb-9f37-aea8c6b3e6ad tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 404 len: 111 microversion: 2.1 time: 0.073464 Aug 27 05:28:11.724051 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3040/6077] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:28:11 2022] DELETE /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:28:11.727736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:11.729240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: e01c08d1-46fc-4e59-88f8-e22358700d09] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:11.737229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:11.738242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:11.738971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:11.740050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:11.740858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:11.742234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:11.789952 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 HTTP/1.1 Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e01c08d1-46fc-4e59-88f8-e22358700d09'} Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:11.792473 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:11.797022 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:11.797022 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:11.797022 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:11.797022 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:28:11.797022 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:28:11.797022 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. Aug 27 05:28:11.797022 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:28:11.800472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance e01c08d1-46fc-4e59-88f8-e22358700d09 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:28:11.801729 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e5a6dcbb-93ab-43f2-8805-7405b3532f36 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09" status: 404 len: 111 microversion: 2.1 time: 0.078772 Aug 27 05:28:11.804894 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3038/6078] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:11 2022] GET /compute/v2.1/servers/e01c08d1-46fc-4e59-88f8-e22358700d09 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:28:11.824644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-160afa3c-397a-447f-8c4f-1d5a3c4312bb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:11.828832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-160afa3c-397a-447f-8c4f-1d5a3c4312bb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:11.864528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-160afa3c-397a-447f-8c4f-1d5a3c4312bb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:11.868680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-160afa3c-397a-447f-8c4f-1d5a3c4312bb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:11.882267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-160afa3c-397a-447f-8c4f-1d5a3c4312bb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:11.884954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-160afa3c-397a-447f-8c4f-1d5a3c4312bb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:11.886487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-160afa3c-397a-447f-8c4f-1d5a3c4312bb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:11.888302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-160afa3c-397a-447f-8c4f-1d5a3c4312bb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:11.978712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-160afa3c-397a-447f-8c4f-1d5a3c4312bb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:28:12.241433 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-160afa3c-397a-447f-8c4f-1d5a3c4312bb tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 204 len: 0 microversion: 2.1 time: 0.427874 Aug 27 05:28:12.246688 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3041/6079] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:28:11 2022] DELETE /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:28:12.259142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-06bac170-c5ed-419a-a198-e430144d5e53 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:12.260001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-06bac170-c5ed-419a-a198-e430144d5e53 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:12.280120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06bac170-c5ed-419a-a198-e430144d5e53 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:12.280666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06bac170-c5ed-419a-a198-e430144d5e53 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:12.281133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06bac170-c5ed-419a-a198-e430144d5e53 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:12.282559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06bac170-c5ed-419a-a198-e430144d5e53 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:12.283308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06bac170-c5ed-419a-a198-e430144d5e53 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:12.284125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06bac170-c5ed-419a-a198-e430144d5e53 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:12.816015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-06bac170-c5ed-419a-a198-e430144d5e53 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:12.833514 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-06bac170-c5ed-419a-a198-e430144d5e53 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.580129 Aug 27 05:28:12.844214 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3039/6080] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:12 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:13.867479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d6ec4978-7f43-439e-9fb4-9a998afe2ad9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:13.869030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d6ec4978-7f43-439e-9fb4-9a998afe2ad9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:13.878108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6ec4978-7f43-439e-9fb4-9a998afe2ad9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:13.878616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6ec4978-7f43-439e-9fb4-9a998afe2ad9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:13.879406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6ec4978-7f43-439e-9fb4-9a998afe2ad9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:13.880960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6ec4978-7f43-439e-9fb4-9a998afe2ad9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:13.881943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6ec4978-7f43-439e-9fb4-9a998afe2ad9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:13.882755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6ec4978-7f43-439e-9fb4-9a998afe2ad9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:14.210740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d6ec4978-7f43-439e-9fb4-9a998afe2ad9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:14.252885 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d6ec4978-7f43-439e-9fb4-9a998afe2ad9 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1510 microversion: 2.1 time: 0.388340 Aug 27 05:28:14.259580 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3042/6081] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:13 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:28:15.291318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-30edb52b-1d19-428f-b633-84e18a247c18 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:15.292321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-30edb52b-1d19-428f-b633-84e18a247c18 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:15.308847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30edb52b-1d19-428f-b633-84e18a247c18 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:15.309710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30edb52b-1d19-428f-b633-84e18a247c18 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:15.310270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30edb52b-1d19-428f-b633-84e18a247c18 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:15.311179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30edb52b-1d19-428f-b633-84e18a247c18 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:15.312761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30edb52b-1d19-428f-b633-84e18a247c18 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:15.317568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30edb52b-1d19-428f-b633-84e18a247c18 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:15.810536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-30edb52b-1d19-428f-b633-84e18a247c18 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:15.829964 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-30edb52b-1d19-428f-b633-84e18a247c18 tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1468 microversion: 2.1 time: 0.542833 Aug 27 05:28:15.849409 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3040/6082] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:15 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1468 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:16.026029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0fc2fa05-f74c-4836-b1bd-8d28c1bf19a5 req-b4217b18-eff9-42cb-8331-7a5ab074e59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64999ba4-bbd9-4d23-9a4c-0caf8eb677b4", "name": "network-vif-deleted", "tag": "e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:16.056942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0fc2fa05-f74c-4836-b1bd-8d28c1bf19a5 req-b4217b18-eff9-42cb-8331-7a5ab074e59a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:16.058156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0fc2fa05-f74c-4836-b1bd-8d28c1bf19a5 req-b4217b18-eff9-42cb-8331-7a5ab074e59a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:16.059249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0fc2fa05-f74c-4836-b1bd-8d28c1bf19a5 req-b4217b18-eff9-42cb-8331-7a5ab074e59a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:16.100827 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0fc2fa05-f74c-4836-b1bd-8d28c1bf19a5 req-b4217b18-eff9-42cb-8331-7a5ab074e59a service nova] Creating event network-vif-deleted:e2ff10fb-32e6-41fe-9b7c-68e6f3ddf3bf for instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 on n-h1-820368-35 Aug 27 05:28:16.123892 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0fc2fa05-f74c-4836-b1bd-8d28c1bf19a5 req-b4217b18-eff9-42cb-8331-7a5ab074e59a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098273 Aug 27 05:28:16.126428 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3043/6083] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:16.861515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:16.863794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:16.900701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:16.901924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:16.903056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:16.904758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:16.906003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:16.907797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:17.045608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:17.046440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:17.047216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:17.049259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lazy-loading 'fault' on Instance uuid 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:28:17.155727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a97d2893d334fc8960af526195cd0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7730f8c3034043dfb2063a05216b8287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:17.175788 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c74807a1-b8d3-4147-8ce0-7049cb11a94c tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 200 len: 1306 microversion: 2.1 time: 0.321043 Aug 27 05:28:17.178261 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3041/6084] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:16 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 1306 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:18.212381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:18.215657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] [instance: 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:18.242874 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:28:18.243538 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 05:28:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 (ip 10.222.0.58) !!! Aug 27 05:28:18.250126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:18.251635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:18.252372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:18.253451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:18.254195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:18.255293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:18.279292 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] HTTP exception thrown: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 could not be found. Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Request method failure captured: Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 HTTP/1.1 Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqLnLcaLR5F7nQzm_eYke_adkEGhkkZmH1KWuqXb6UkzOCYyECPuT8G7rsAGxkawYGQBZf_XmOQyYS6zWEGZYyZphV1OgH34xdwjVUAKVR-yz9S49dmopyWwEaAICy1Dna2R5zaX7YhM38jakAwrVb0GlEVhavv10C4Kv9pbmmsasQ Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7730f8c3034043dfb2063a05216b8287", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7730f8c3034043dfb2063a05216b8287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7730f8c3034043dfb2063a05216b8287 Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-933915648 Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 5a97d2893d334fc8960af526195cd0cd Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-933915648-project Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 could not be found. Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '64999ba4-bbd9-4d23-9a4c-0caf8eb677b4'} Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 could not be found. Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 could not be found. Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:18.281631 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:18.287244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:18.287244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:18.287244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:18.287244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:28:18.287244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:28:18.287244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 could not be found. Aug 27 05:28:18.287244 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:18.289767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] Returning 404 to user: Instance 64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:28:18.291337 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-edf48118-39db-459c-8a7f-d297ed15fb1a tempest-ServersNegativeTestJSON-933915648 tempest-ServersNegativeTestJSON-933915648-project] 10.222.0.58 "GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4" status: 404 len: 111 microversion: 2.1 time: 0.087911 Aug 27 05:28:18.292348 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3044/6085] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:18 2022] GET /compute/v2.1/servers/64999ba4-bbd9-4d23-9a4c-0caf8eb677b4 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:28:20.846693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-570af4aa-d723-4649-9002-b1f24986f4b7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:20.847864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-570af4aa-d723-4649-9002-b1f24986f4b7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:20.855611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-679b79f4-77d2-4bc9-9708-fae4a3db862b req-c9c1e77d-7f30-432f-a14a-c7bdcccdc40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6625a4-fa42-41a0-8664-65bb32081817", "tag": "256e99b8-b009-4f0e-8458-fb3d127ff19e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:20.868614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-570af4aa-d723-4649-9002-b1f24986f4b7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:20.869766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-570af4aa-d723-4649-9002-b1f24986f4b7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:20.870461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-570af4aa-d723-4649-9002-b1f24986f4b7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:20.871602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-570af4aa-d723-4649-9002-b1f24986f4b7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:20.877634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-570af4aa-d723-4649-9002-b1f24986f4b7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:20.878375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-570af4aa-d723-4649-9002-b1f24986f4b7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:20.933361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-679b79f4-77d2-4bc9-9708-fae4a3db862b req-c9c1e77d-7f30-432f-a14a-c7bdcccdc40a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:20.934558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-679b79f4-77d2-4bc9-9708-fae4a3db862b req-c9c1e77d-7f30-432f-a14a-c7bdcccdc40a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:20.935369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-679b79f4-77d2-4bc9-9708-fae4a3db862b req-c9c1e77d-7f30-432f-a14a-c7bdcccdc40a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:20.977293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-570af4aa-d723-4649-9002-b1f24986f4b7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:28:20.983836 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-679b79f4-77d2-4bc9-9708-fae4a3db862b req-c9c1e77d-7f30-432f-a14a-c7bdcccdc40a service nova] Creating event network-changed:256e99b8-b009-4f0e-8458-fb3d127ff19e for instance 1e6625a4-fa42-41a0-8664-65bb32081817 on n-h1-820368-35 Aug 27 05:28:21.014543 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-679b79f4-77d2-4bc9-9708-fae4a3db862b req-c9c1e77d-7f30-432f-a14a-c7bdcccdc40a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162001 Aug 27 05:28:21.023259 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3045/6086] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:21.246467 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-570af4aa-d723-4649-9002-b1f24986f4b7 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 204 len: 0 microversion: 2.1 time: 0.401853 Aug 27 05:28:21.251174 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3042/6087] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:28:20 2022] DELETE /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:28:21.275061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f695b276-d4aa-49fe-89b1-b33576769689 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:21.279851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f695b276-d4aa-49fe-89b1-b33576769689 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:21.310038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f695b276-d4aa-49fe-89b1-b33576769689 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:21.316075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f695b276-d4aa-49fe-89b1-b33576769689 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:21.319378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f695b276-d4aa-49fe-89b1-b33576769689 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:21.323962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f695b276-d4aa-49fe-89b1-b33576769689 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:21.326625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f695b276-d4aa-49fe-89b1-b33576769689 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:21.330830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f695b276-d4aa-49fe-89b1-b33576769689 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:21.961511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f695b276-d4aa-49fe-89b1-b33576769689 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:21.975017 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f695b276-d4aa-49fe-89b1-b33576769689 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1768 microversion: 2.1 time: 0.715697 Aug 27 05:28:21.980543 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3046/6088] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:21 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1768 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:23.032766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8ff6818d-9232-45f2-af70-09d14bbf70f6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:23.034002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8ff6818d-9232-45f2-af70-09d14bbf70f6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:23.049095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ff6818d-9232-45f2-af70-09d14bbf70f6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:23.050363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ff6818d-9232-45f2-af70-09d14bbf70f6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:23.051395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ff6818d-9232-45f2-af70-09d14bbf70f6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:23.052833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ff6818d-9232-45f2-af70-09d14bbf70f6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:23.053920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ff6818d-9232-45f2-af70-09d14bbf70f6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:23.054985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ff6818d-9232-45f2-af70-09d14bbf70f6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:23.672955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8ff6818d-9232-45f2-af70-09d14bbf70f6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:23.698667 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8ff6818d-9232-45f2-af70-09d14bbf70f6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1768 microversion: 2.1 time: 0.670064 Aug 27 05:28:23.702317 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3043/6089] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:23 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1768 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:24.488235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-35c5109e-0059-4f80-bc25-27978cd7a9b4 req-9616df0f-276e-4257-a04c-96116232a266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6625a4-fa42-41a0-8664-65bb32081817", "name": "network-vif-deleted", "tag": "256e99b8-b009-4f0e-8458-fb3d127ff19e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:24.518718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-35c5109e-0059-4f80-bc25-27978cd7a9b4 req-9616df0f-276e-4257-a04c-96116232a266 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:24.519538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-35c5109e-0059-4f80-bc25-27978cd7a9b4 req-9616df0f-276e-4257-a04c-96116232a266 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:24.520257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-35c5109e-0059-4f80-bc25-27978cd7a9b4 req-9616df0f-276e-4257-a04c-96116232a266 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:24.535851 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-35c5109e-0059-4f80-bc25-27978cd7a9b4 req-9616df0f-276e-4257-a04c-96116232a266 service nova] Creating event network-vif-deleted:256e99b8-b009-4f0e-8458-fb3d127ff19e for instance 1e6625a4-fa42-41a0-8664-65bb32081817 on n-h1-820368-35 Aug 27 05:28:24.562177 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-35c5109e-0059-4f80-bc25-27978cd7a9b4 req-9616df0f-276e-4257-a04c-96116232a266 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080540 Aug 27 05:28:24.564727 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3047/6090] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:28:24.734503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:24.741435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:24.800242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:24.801393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:24.802288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:24.805415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:24.806646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:24.816189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:24.901470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:24.902309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:24.903416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:24.905012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lazy-loading 'fault' on Instance uuid 1e6625a4-fa42-41a0-8664-65bb32081817 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:28:25.048952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad2e05d9d024047acfe2ce68950b68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b18ee854244b3998616cf5f5a05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:25.074506 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 200 len: 1384 microversion: 2.1 time: 0.340451 Aug 27 05:28:25.076586 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3044/6091] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:24 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 1384 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:26.114422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:26.122976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] [instance: 1e6625a4-fa42-41a0-8664-65bb32081817] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:26.151513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:26.153671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:26.155122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:26.158420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:26.161267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:26.162916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:26.213955 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] HTTP exception thrown: Instance 1e6625a4-fa42-41a0-8664-65bb32081817 could not be found. Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Request method failure captured: Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 HTTP/1.1 Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaqwuEaA1mryCwxLOEvy6aaSZTN6LoTzwrzj_BOewWtonzg7myc23IadyNog0b8FTJ_j43C9wFvwr1dNj3W_JjWLJeRZmHeHJUOBj77_qIXL6peGdy3jrCNuiVGoTM9ghTGn7soEO_FHFb5l1qpk3-0_ZzQzao2c03SCErIxSueEKxo Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 28b18ee854244b3998616cf5f5a05fcf Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1611286681 Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_28b18ee854244b3998616cf5f5a05fcf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/28b18ee854244b3998616cf5f5a05fcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/28b18ee854244b3998616cf5f5a05fcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/28b18ee854244b3998616cf5f5a05fcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1611286681 Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 28b18ee854244b3998616cf5f5a05fcf Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1611286681 Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestSecurityGroupsBasicOps-1611286681-project Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 1ad2e05d9d024047acfe2ce68950b68e Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1611286681-project Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 1e6625a4-fa42-41a0-8664-65bb32081817 could not be found. Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '1e6625a4-fa42-41a0-8664-65bb32081817'} Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6625a4-fa42-41a0-8664-65bb32081817 could not be found. Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6625a4-fa42-41a0-8664-65bb32081817 could not be found. Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:26.216756 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:28:26.227131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:26.227131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:28:26.227131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:28:26.227131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:28:26.227131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:28:26.227131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:28:26.227131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6625a4-fa42-41a0-8664-65bb32081817 could not be found. Aug 27 05:28:26.227131 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:28:26.227131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Returning 404 to user: Instance 1e6625a4-fa42-41a0-8664-65bb32081817 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:28:26.227131 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8fd2196e-38ea-4208-b48f-5390ea0b38c4 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817" status: 404 len: 111 microversion: 2.1 time: 0.126875 Aug 27 05:28:26.228757 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3048/6092] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:26 2022] GET /compute/v2.1/servers/1e6625a4-fa42-41a0-8664-65bb32081817 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:28:29.848695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:29.849718 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b14a1c61-4f2b-4b86-ab98-67bdfc60f5d6 tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001485 Aug 27 05:28:29.860420 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3045/6093] 10.222.0.58 () {56 vars in 886 bytes} [Sat Aug 27 05:28:29 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 27 05:28:34.143535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2af9d1ff-5e40-4b2e-8408-af4931224ddc tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] Calling method '.version_select at 0x7fb5647d1a60>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:34.201617 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2af9d1ff-5e40-4b2e-8408-af4931224ddc tempest-TestSecurityGroupsBasicOps-1611286681 tempest-TestSecurityGroupsBasicOps-1611286681-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-358125036" status: 202 len: 0 microversion: 2.1 time: 0.065588 Aug 27 05:28:34.202720 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3049/6094] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:28:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-358125036 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:28:37.809672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b47acdaf-3b36-485b-ac89-176957784369 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:37.810506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b47acdaf-3b36-485b-ac89-176957784369 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:37.813859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:37.814268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:37.842957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b47acdaf-3b36-485b-ac89-176957784369 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:37.845777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b47acdaf-3b36-485b-ac89-176957784369 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:37.848873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b47acdaf-3b36-485b-ac89-176957784369 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:37.857314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b47acdaf-3b36-485b-ac89-176957784369 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:37.858006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b47acdaf-3b36-485b-ac89-176957784369 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:37.858636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b47acdaf-3b36-485b-ac89-176957784369 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:37.939134 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b47acdaf-3b36-485b-ac89-176957784369 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/ips" status: 200 len: 150 microversion: 2.1 time: 0.135033 Aug 27 05:28:37.945129 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3046/6095] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:28:37 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/ips => generated 150 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:42.915850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf1f813f-e8ce-4d2e-a06e-329d61d1c767 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "672a768f-77f5-4f57-a702-3bcb1080b2ee"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:42.919658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf1f813f-e8ce-4d2e-a06e-329d61d1c767 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:42.928899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:42.931080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:42.947124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1f813f-e8ce-4d2e-a06e-329d61d1c767 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:42.947483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1f813f-e8ce-4d2e-a06e-329d61d1c767 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:42.947842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1f813f-e8ce-4d2e-a06e-329d61d1c767 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:42.949347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1f813f-e8ce-4d2e-a06e-329d61d1c767 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:42.949756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1f813f-e8ce-4d2e-a06e-329d61d1c767 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:42.950617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf1f813f-e8ce-4d2e-a06e-329d61d1c767 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:43.884212 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf1f813f-e8ce-4d2e-a06e-329d61d1c767 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "POST /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.968275 Aug 27 05:28:43.886318 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3050/6096] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:28:42 2022] POST /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 194 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:45.322841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24eb8a2c-5e12-4fe0-a67a-34afde1dd476 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:45.323508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-24eb8a2c-5e12-4fe0-a67a-34afde1dd476 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:45.342325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb8a2c-5e12-4fe0-a67a-34afde1dd476 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:45.342943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb8a2c-5e12-4fe0-a67a-34afde1dd476 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:45.343461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb8a2c-5e12-4fe0-a67a-34afde1dd476 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:45.344223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb8a2c-5e12-4fe0-a67a-34afde1dd476 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:45.344688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb8a2c-5e12-4fe0-a67a-34afde1dd476 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:45.345172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24eb8a2c-5e12-4fe0-a67a-34afde1dd476 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:45.631530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-24eb8a2c-5e12-4fe0-a67a-34afde1dd476 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lazy-loading 'services' on Instance uuid 83f8027a-674b-4177-a4d4-142882d951f2 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:28:46.068875 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-24eb8a2c-5e12-4fe0-a67a-34afde1dd476 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "DELETE /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2/os-volume_attachments/5c39b409-1911-495e-828d-e3b71922ae9d" status: 202 len: 0 microversion: 2.1 time: 0.759736 Aug 27 05:28:46.069478 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3047/6097] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:28:45 2022] DELETE /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2/os-volume_attachments/5c39b409-1911-495e-828d-e3b71922ae9d => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:28:47.882989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0872e052-cc24-4d28-bde0-febb417d4dc9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Action: 'create', calling method: .version_select at 0x7fb565783ee0>, body: {"keypair": {"name": "tempest-keypair-1764532653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJ01uEfqYfBHxwHKVqa/zhiky+F+gnE3oRYc10cTDvZC7rB3BAbbpeThqOoG0SqEq3XaqYFbOO/dwzgJcQ6oIk3RW0+QHwQNgx6iAjTpw0hKXO6mD8NVYZ+5anFOzBEEw=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:47.934936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0872e052-cc24-4d28-bde0-febb417d4dc9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Getting quotas for project cbeac3d8b40a422b97699e81f5ce198f. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:28:47.946617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0872e052-cc24-4d28-bde0-febb417d4dc9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Getting quotas for user 4b3cce7ee28e4f2da7f840c917b893df and project cbeac3d8b40a422b97699e81f5ce198f. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:28:48.009818 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0872e052-cc24-4d28-bde0-febb417d4dc9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.421966 Aug 27 05:28:48.022572 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3051/6098] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:28:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:51.433578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-222799884", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60ab6058-53a4-4df9-adac-b4686bb85340"}], "security_groups": [{"name": "tempest-securitygroup--1548637507"}], "key_name": "tempest-keypair-1764532653", "user_data": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:51.759777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] validate_networks() for [('60ab6058-53a4-4df9-adac-b4686bb85340', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:28:52.759987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:28:52.760726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:28:52.761303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:28:52.763978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:28:52.764855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:28:52.802315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:52.802835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:52.803324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:52.808512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:52.808731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:52.809466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:52.867901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Getting quotas for project cbeac3d8b40a422b97699e81f5ce198f. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:28:52.903809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Getting quotas for user 4b3cce7ee28e4f2da7f840c917b893df and project cbeac3d8b40a422b97699e81f5ce198f. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:28:52.942401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:28:52.949511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:28:53.059505 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d25cbd57-6101-4d82-bd55-38599a3fc8f2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.632984 Aug 27 05:28:53.060544 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3048/6099] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:28:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:28:53.077463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d99b9a0-67b1-4b73-bbad-535f3338d349 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:53.078270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d99b9a0-67b1-4b73-bbad-535f3338d349 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:53.246656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d99b9a0-67b1-4b73-bbad-535f3338d349 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:53.263828 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d99b9a0-67b1-4b73-bbad-535f3338d349 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1237 microversion: 2.1 time: 0.193396 Aug 27 05:28:53.271285 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3052/6100] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:53 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1237 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:54.351654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5b09a5ad-e3f0-48c6-b388-98c168288bd0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:54.354239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5b09a5ad-e3f0-48c6-b388-98c168288bd0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:54.425395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b09a5ad-e3f0-48c6-b388-98c168288bd0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:54.426271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b09a5ad-e3f0-48c6-b388-98c168288bd0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:54.427050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b09a5ad-e3f0-48c6-b388-98c168288bd0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:54.428320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b09a5ad-e3f0-48c6-b388-98c168288bd0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:54.429132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b09a5ad-e3f0-48c6-b388-98c168288bd0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:54.429898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b09a5ad-e3f0-48c6-b388-98c168288bd0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:54.682854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5b09a5ad-e3f0-48c6-b388-98c168288bd0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:54.697769 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5b09a5ad-e3f0-48c6-b388-98c168288bd0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1241 microversion: 2.1 time: 0.395205 Aug 27 05:28:54.699301 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3049/6101] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:54 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1241 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:55.735371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de7fecb4-6d51-43b5-bf32-2ff859ecbd58 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:55.736628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de7fecb4-6d51-43b5-bf32-2ff859ecbd58 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:55.759629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:55.766091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7fecb4-6d51-43b5-bf32-2ff859ecbd58 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:55.766613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7fecb4-6d51-43b5-bf32-2ff859ecbd58 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:55.767068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7fecb4-6d51-43b5-bf32-2ff859ecbd58 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:55.770319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7fecb4-6d51-43b5-bf32-2ff859ecbd58 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:55.770761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7fecb4-6d51-43b5-bf32-2ff859ecbd58 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:55.771270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de7fecb4-6d51-43b5-bf32-2ff859ecbd58 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:55.971916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de7fecb4-6d51-43b5-bf32-2ff859ecbd58 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:55.988713 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de7fecb4-6d51-43b5-bf32-2ff859ecbd58 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1295 microversion: 2.1 time: 0.259186 Aug 27 05:28:55.993719 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3053/6102] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:55 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1295 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:57.015648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-218ce95a-31b7-4fb7-82f2-b5ad587f99b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:57.016301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-218ce95a-31b7-4fb7-82f2-b5ad587f99b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:57.024940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-218ce95a-31b7-4fb7-82f2-b5ad587f99b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:57.025480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-218ce95a-31b7-4fb7-82f2-b5ad587f99b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:57.026048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-218ce95a-31b7-4fb7-82f2-b5ad587f99b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:57.027002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-218ce95a-31b7-4fb7-82f2-b5ad587f99b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:57.027504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-218ce95a-31b7-4fb7-82f2-b5ad587f99b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:57.027948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-218ce95a-31b7-4fb7-82f2-b5ad587f99b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:57.577841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-218ce95a-31b7-4fb7-82f2-b5ad587f99b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:57.595895 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-218ce95a-31b7-4fb7-82f2-b5ad587f99b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1363 microversion: 2.1 time: 0.585196 Aug 27 05:28:57.609196 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3050/6103] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:57 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1363 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:58.489790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b0399fbf-6b36-43e4-85c1-bf88df231832 req-0ac35dea-d5fc-49d5-95e1-ac5130398def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a68fe3-998d-48a4-bb1b-38b743a81bd2", "tag": "6a989aa8-53e7-456e-b6de-7425f0969d81"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:58.518240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b0399fbf-6b36-43e4-85c1-bf88df231832 req-0ac35dea-d5fc-49d5-95e1-ac5130398def service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:58.523323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b0399fbf-6b36-43e4-85c1-bf88df231832 req-0ac35dea-d5fc-49d5-95e1-ac5130398def service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:58.524412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b0399fbf-6b36-43e4-85c1-bf88df231832 req-0ac35dea-d5fc-49d5-95e1-ac5130398def service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:58.557646 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b0399fbf-6b36-43e4-85c1-bf88df231832 req-0ac35dea-d5fc-49d5-95e1-ac5130398def service nova] Creating event network-changed:6a989aa8-53e7-456e-b6de-7425f0969d81 for instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 on n-h2-820368-35 Aug 27 05:28:58.568648 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b0399fbf-6b36-43e4-85c1-bf88df231832 req-0ac35dea-d5fc-49d5-95e1-ac5130398def service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.547794 Aug 27 05:28:58.569928 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3054/6104] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:28:58.618675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0c1e098b-6fdf-47ba-8610-7b43df8bf67a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:58.619602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c1e098b-6fdf-47ba-8610-7b43df8bf67a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:58.631123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c1e098b-6fdf-47ba-8610-7b43df8bf67a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:58.633806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c1e098b-6fdf-47ba-8610-7b43df8bf67a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:58.635512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c1e098b-6fdf-47ba-8610-7b43df8bf67a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:58.637723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c1e098b-6fdf-47ba-8610-7b43df8bf67a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:58.638630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c1e098b-6fdf-47ba-8610-7b43df8bf67a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:58.642999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c1e098b-6fdf-47ba-8610-7b43df8bf67a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:59.022086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0c1e098b-6fdf-47ba-8610-7b43df8bf67a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:59.051418 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0c1e098b-6fdf-47ba-8610-7b43df8bf67a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1363 microversion: 2.1 time: 0.436667 Aug 27 05:28:59.053450 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3051/6105] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:58 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1363 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:28:59.343647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1420b1ea-e149-4933-9a23-12b33ca936dc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:59.345330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1420b1ea-e149-4933-9a23-12b33ca936dc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:59.375427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1420b1ea-e149-4933-9a23-12b33ca936dc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:59.376930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1420b1ea-e149-4933-9a23-12b33ca936dc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:59.381540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1420b1ea-e149-4933-9a23-12b33ca936dc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:59.388355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1420b1ea-e149-4933-9a23-12b33ca936dc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:59.392490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1420b1ea-e149-4933-9a23-12b33ca936dc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:59.393291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1420b1ea-e149-4933-9a23-12b33ca936dc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:59.497595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1420b1ea-e149-4933-9a23-12b33ca936dc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:28:59.702611 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1420b1ea-e149-4933-9a23-12b33ca936dc tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "DELETE /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 204 len: 0 microversion: 2.1 time: 0.375150 Aug 27 05:28:59.703792 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3055/6106] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:28:59 2022] DELETE /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:28:59.713566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ccd090b-f8bc-475d-9a7d-7fa8453bf268 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:59.714422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0ccd090b-f8bc-475d-9a7d-7fa8453bf268 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:59.725150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ccd090b-f8bc-475d-9a7d-7fa8453bf268 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:59.726000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ccd090b-f8bc-475d-9a7d-7fa8453bf268 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:59.726968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ccd090b-f8bc-475d-9a7d-7fa8453bf268 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:59.729562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ccd090b-f8bc-475d-9a7d-7fa8453bf268 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:59.732051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ccd090b-f8bc-475d-9a7d-7fa8453bf268 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:59.732739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ccd090b-f8bc-475d-9a7d-7fa8453bf268 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:59.975987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0ccd090b-f8bc-475d-9a7d-7fa8453bf268 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:59.987401 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ccd090b-f8bc-475d-9a7d-7fa8453bf268 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1514 microversion: 2.1 time: 0.277759 Aug 27 05:28:59.988555 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3052/6107] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:59 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:00.079667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-312d0201-74fe-4928-93da-64846fef0826 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:00.084784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-312d0201-74fe-4928-93da-64846fef0826 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:00.110491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-312d0201-74fe-4928-93da-64846fef0826 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:00.111686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-312d0201-74fe-4928-93da-64846fef0826 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:00.112639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-312d0201-74fe-4928-93da-64846fef0826 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:00.114300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-312d0201-74fe-4928-93da-64846fef0826 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:00.116927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-312d0201-74fe-4928-93da-64846fef0826 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:00.123656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-312d0201-74fe-4928-93da-64846fef0826 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:00.553725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-312d0201-74fe-4928-93da-64846fef0826 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:00.565423 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-312d0201-74fe-4928-93da-64846fef0826 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1363 microversion: 2.1 time: 0.493926 Aug 27 05:29:00.573650 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3056/6108] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:00 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1363 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:01.022117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2a65cf71-3326-436e-a053-6ae5bbcbf796 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:01.022799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2a65cf71-3326-436e-a053-6ae5bbcbf796 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:01.052969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a65cf71-3326-436e-a053-6ae5bbcbf796 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:01.054210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a65cf71-3326-436e-a053-6ae5bbcbf796 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:01.055782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a65cf71-3326-436e-a053-6ae5bbcbf796 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:01.059842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a65cf71-3326-436e-a053-6ae5bbcbf796 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:01.063041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a65cf71-3326-436e-a053-6ae5bbcbf796 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:01.064702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a65cf71-3326-436e-a053-6ae5bbcbf796 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:01.621316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9609270a-a238-4fc2-ad4c-5fd71351feeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:01.623140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9609270a-a238-4fc2-ad4c-5fd71351feeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:01.650098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9609270a-a238-4fc2-ad4c-5fd71351feeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:01.653977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9609270a-a238-4fc2-ad4c-5fd71351feeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:01.656009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9609270a-a238-4fc2-ad4c-5fd71351feeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:01.657931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9609270a-a238-4fc2-ad4c-5fd71351feeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:01.660258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9609270a-a238-4fc2-ad4c-5fd71351feeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:01.663392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9609270a-a238-4fc2-ad4c-5fd71351feeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:01.719878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2a65cf71-3326-436e-a053-6ae5bbcbf796 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:01.755946 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2a65cf71-3326-436e-a053-6ae5bbcbf796 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1468 microversion: 2.1 time: 0.736510 Aug 27 05:29:01.762058 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3053/6109] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:01 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1468 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:02.149811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9609270a-a238-4fc2-ad4c-5fd71351feeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:02.169681 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9609270a-a238-4fc2-ad4c-5fd71351feeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1363 microversion: 2.1 time: 0.560742 Aug 27 05:29:02.171553 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3057/6110] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:01 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1363 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:02.797100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-858538e0-5410-488f-94f0-de9a4544c1aa tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:02.797642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-858538e0-5410-488f-94f0-de9a4544c1aa tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:02.827221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-858538e0-5410-488f-94f0-de9a4544c1aa tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:02.834139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-858538e0-5410-488f-94f0-de9a4544c1aa tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:02.840982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-858538e0-5410-488f-94f0-de9a4544c1aa tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:02.842662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-858538e0-5410-488f-94f0-de9a4544c1aa tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:02.843724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-858538e0-5410-488f-94f0-de9a4544c1aa tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:02.845848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-858538e0-5410-488f-94f0-de9a4544c1aa tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:02.847720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:02.922404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:03.205027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1690ce7f-6588-428b-a98b-e97aeefb0c97 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:03.206617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1690ce7f-6588-428b-a98b-e97aeefb0c97 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:03.231969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1690ce7f-6588-428b-a98b-e97aeefb0c97 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:03.234146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1690ce7f-6588-428b-a98b-e97aeefb0c97 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:03.234856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1690ce7f-6588-428b-a98b-e97aeefb0c97 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:03.237122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1690ce7f-6588-428b-a98b-e97aeefb0c97 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:03.239317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1690ce7f-6588-428b-a98b-e97aeefb0c97 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:03.240050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1690ce7f-6588-428b-a98b-e97aeefb0c97 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:03.263629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:03.463482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-858538e0-5410-488f-94f0-de9a4544c1aa tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:03.474379 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-858538e0-5410-488f-94f0-de9a4544c1aa tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1468 microversion: 2.1 time: 0.684051 Aug 27 05:29:03.478595 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3054/6111] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:02 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1468 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:03.776208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1690ce7f-6588-428b-a98b-e97aeefb0c97 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:03.793573 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1690ce7f-6588-428b-a98b-e97aeefb0c97 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1363 microversion: 2.1 time: 0.594358 Aug 27 05:29:03.796078 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3058/6112] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:03 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1363 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:04.507414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-57aac957-e618-482d-9382-3d41a155dc0e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:04.508279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-57aac957-e618-482d-9382-3d41a155dc0e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:04.520862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57aac957-e618-482d-9382-3d41a155dc0e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:04.521361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57aac957-e618-482d-9382-3d41a155dc0e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:04.521795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57aac957-e618-482d-9382-3d41a155dc0e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:04.531506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57aac957-e618-482d-9382-3d41a155dc0e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:04.536841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57aac957-e618-482d-9382-3d41a155dc0e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:04.537547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57aac957-e618-482d-9382-3d41a155dc0e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:04.828633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-86d5343c-4bbf-45de-9407-cb71bdaae4a5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:04.829487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-86d5343c-4bbf-45de-9407-cb71bdaae4a5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:04.841354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86d5343c-4bbf-45de-9407-cb71bdaae4a5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:04.843064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86d5343c-4bbf-45de-9407-cb71bdaae4a5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:04.844473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86d5343c-4bbf-45de-9407-cb71bdaae4a5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:04.846892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86d5343c-4bbf-45de-9407-cb71bdaae4a5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:04.847911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86d5343c-4bbf-45de-9407-cb71bdaae4a5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:04.848308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86d5343c-4bbf-45de-9407-cb71bdaae4a5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:05.009693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-57aac957-e618-482d-9382-3d41a155dc0e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:05.023902 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-57aac957-e618-482d-9382-3d41a155dc0e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1468 microversion: 2.1 time: 0.522881 Aug 27 05:29:05.025162 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3055/6113] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:04 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1468 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:05.481578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86d5343c-4bbf-45de-9407-cb71bdaae4a5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:05.497464 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-86d5343c-4bbf-45de-9407-cb71bdaae4a5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1363 microversion: 2.1 time: 0.679008 Aug 27 05:29:05.499549 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3059/6114] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:04 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1363 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:05.776048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5d4b5995-025b-4335-9f75-b1b8e4aa0f13 req-2f8679c7-1e7d-4b28-99dd-6a021db1361e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f8027a-674b-4177-a4d4-142882d951f2", "name": "network-vif-deleted", "tag": "0ae50be4-4489-44b4-ac20-ce1d211d31ba"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:05.807692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5d4b5995-025b-4335-9f75-b1b8e4aa0f13 req-2f8679c7-1e7d-4b28-99dd-6a021db1361e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:05.812273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5d4b5995-025b-4335-9f75-b1b8e4aa0f13 req-2f8679c7-1e7d-4b28-99dd-6a021db1361e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:05.812902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5d4b5995-025b-4335-9f75-b1b8e4aa0f13 req-2f8679c7-1e7d-4b28-99dd-6a021db1361e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:05.861527 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-5d4b5995-025b-4335-9f75-b1b8e4aa0f13 req-2f8679c7-1e7d-4b28-99dd-6a021db1361e service nova] Creating event network-vif-deleted:0ae50be4-4489-44b4-ac20-ce1d211d31ba for instance 83f8027a-674b-4177-a4d4-142882d951f2 on n-h2-820368-35 Aug 27 05:29:05.900300 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5d4b5995-025b-4335-9f75-b1b8e4aa0f13 req-2f8679c7-1e7d-4b28-99dd-6a021db1361e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117466 Aug 27 05:29:05.901935 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3056/6115] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:06.061579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:06.062232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:06.079137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:06.080564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:06.083032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:06.086327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:06.088580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:06.096460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:06.233393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:06.233899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:06.234477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:06.234804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lazy-loading 'fault' on Instance uuid 83f8027a-674b-4177-a4d4-142882d951f2 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:29:06.369192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513aeed198ce433aa9c04131147ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd389e577244b3fae5134f269e9582b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:06.386234 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b423039d-f5da-40ef-8d56-902c6f840d3e tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 200 len: 1303 microversion: 2.1 time: 0.328232 Aug 27 05:29:06.401067 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3060/6116] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:06 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 1303 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:06.521311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3d02a254-ad8c-4b87-8ae5-caf8f8636666 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:06.522513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3d02a254-ad8c-4b87-8ae5-caf8f8636666 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:06.541396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d02a254-ad8c-4b87-8ae5-caf8f8636666 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:06.541909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d02a254-ad8c-4b87-8ae5-caf8f8636666 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:06.542362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d02a254-ad8c-4b87-8ae5-caf8f8636666 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:06.543129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d02a254-ad8c-4b87-8ae5-caf8f8636666 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:06.543596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d02a254-ad8c-4b87-8ae5-caf8f8636666 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:06.546557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d02a254-ad8c-4b87-8ae5-caf8f8636666 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:07.385718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3d02a254-ad8c-4b87-8ae5-caf8f8636666 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:07.405333 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3d02a254-ad8c-4b87-8ae5-caf8f8636666 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1363 microversion: 2.1 time: 0.888193 Aug 27 05:29:07.419666 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3057/6117] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:06 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1363 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:07.433030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:07.433774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] [instance: 83f8027a-674b-4177-a4d4-142882d951f2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:07.481502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:07.482019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:07.482475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:07.489750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:07.491694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:07.492996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:07.537556 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] HTTP exception thrown: Instance 83f8027a-674b-4177-a4d4-142882d951f2 could not be found. Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Request method failure captured: Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 HTTP/1.1 Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCar6iVOT-oUvzidlzr4HF-RKQxJTgzvl_MYieySC-gx7s9Ly9a9aFeXvYa1tREYUH6wmENZqINS4yxDTP2750kx_mCLcE7HU1U94bGA0Cgm5oKBXm-jcKRQgVNZljWCbzic_a797wGipwKWIQm8BYoshe9IfCwNYC4vXkrUR4jFupZA Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 7bd389e577244b3fae5134f269e9582b Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-VolumesBackupsTest-827407517 Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7bd389e577244b3fae5134f269e9582b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7bd389e577244b3fae5134f269e9582b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7bd389e577244b3fae5134f269e9582b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7bd389e577244b3fae5134f269e9582b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-VolumesBackupsTest-827407517 Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 7bd389e577244b3fae5134f269e9582b Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-VolumesBackupsTest-827407517 Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-VolumesBackupsTest-827407517-project Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 513aeed198ce433aa9c04131147ceca0 Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-VolumesBackupsTest-827407517-project Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 83f8027a-674b-4177-a4d4-142882d951f2 could not be found. Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '83f8027a-674b-4177-a4d4-142882d951f2'} Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f8027a-674b-4177-a4d4-142882d951f2 could not be found. Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f8027a-674b-4177-a4d4-142882d951f2 could not be found. Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:07.539643 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:07.545869 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:07.545869 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:07.545869 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:07.545869 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:07.545869 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:07.545869 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f8027a-674b-4177-a4d4-142882d951f2 could not be found. Aug 27 05:29:07.545869 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:07.554714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] Returning 404 to user: Instance 83f8027a-674b-4177-a4d4-142882d951f2 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:07.555707 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b0335a13-e261-4240-bbf8-be08823d19c5 tempest-VolumesBackupsTest-827407517 tempest-VolumesBackupsTest-827407517-project] 10.222.0.58 "GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2" status: 404 len: 111 microversion: 2.1 time: 0.133870 Aug 27 05:29:07.568003 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3061/6118] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:07 2022] GET /compute/v2.1/servers/83f8027a-674b-4177-a4d4-142882d951f2 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:07.660047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-ac31dc75-9d0a-4355-b291-1f7049e1e288 req-5e9264dd-19d2-4f52-a5ae-d13028b30e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a68fe3-998d-48a4-bb1b-38b743a81bd2", "name": "network-vif-plugged", "status": "completed", "tag": "6a989aa8-53e7-456e-b6de-7425f0969d81"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:07.695677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ac31dc75-9d0a-4355-b291-1f7049e1e288 req-5e9264dd-19d2-4f52-a5ae-d13028b30e08 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:07.696176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ac31dc75-9d0a-4355-b291-1f7049e1e288 req-5e9264dd-19d2-4f52-a5ae-d13028b30e08 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:07.697517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ac31dc75-9d0a-4355-b291-1f7049e1e288 req-5e9264dd-19d2-4f52-a5ae-d13028b30e08 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:07.745317 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-ac31dc75-9d0a-4355-b291-1f7049e1e288 req-5e9264dd-19d2-4f52-a5ae-d13028b30e08 service nova] Creating event network-vif-plugged:6a989aa8-53e7-456e-b6de-7425f0969d81 for instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 on n-h2-820368-35 Aug 27 05:29:07.756536 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-ac31dc75-9d0a-4355-b291-1f7049e1e288 req-5e9264dd-19d2-4f52-a5ae-d13028b30e08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099007 Aug 27 05:29:07.758330 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3058/6119] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:08.433420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bdf85ac2-855a-4bbb-8aa4-7bf66577b332 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:08.435188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bdf85ac2-855a-4bbb-8aa4-7bf66577b332 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:08.449956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf85ac2-855a-4bbb-8aa4-7bf66577b332 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:08.450473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf85ac2-855a-4bbb-8aa4-7bf66577b332 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:08.450930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf85ac2-855a-4bbb-8aa4-7bf66577b332 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:08.451756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf85ac2-855a-4bbb-8aa4-7bf66577b332 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:08.452189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf85ac2-855a-4bbb-8aa4-7bf66577b332 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:08.452632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdf85ac2-855a-4bbb-8aa4-7bf66577b332 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:08.791528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bdf85ac2-855a-4bbb-8aa4-7bf66577b332 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:08.807232 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bdf85ac2-855a-4bbb-8aa4-7bf66577b332 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1363 microversion: 2.1 time: 0.377571 Aug 27 05:29:08.819143 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3062/6120] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:08 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:09.434287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89b0f8ca-7849-4bd0-9a38-f0344933d404 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:09.435133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89b0f8ca-7849-4bd0-9a38-f0344933d404 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:09.462277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:09.471440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89b0f8ca-7849-4bd0-9a38-f0344933d404 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:09.471953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89b0f8ca-7849-4bd0-9a38-f0344933d404 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:09.472404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89b0f8ca-7849-4bd0-9a38-f0344933d404 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:09.482940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89b0f8ca-7849-4bd0-9a38-f0344933d404 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:09.495487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89b0f8ca-7849-4bd0-9a38-f0344933d404 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:09.496563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89b0f8ca-7849-4bd0-9a38-f0344933d404 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:09.566072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:09.769049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-89b0f8ca-7849-4bd0-9a38-f0344933d404 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lazy-loading 'services' on Instance uuid 778fae4c-132e-4000-9d06-3741a2cb627d {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:29:09.831551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-257c4dbe-1788-4c21-b670-01b42c5d3cee tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:09.832626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-257c4dbe-1788-4c21-b670-01b42c5d3cee tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:09.850686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-257c4dbe-1788-4c21-b670-01b42c5d3cee tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:09.852744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-257c4dbe-1788-4c21-b670-01b42c5d3cee tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:09.853241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-257c4dbe-1788-4c21-b670-01b42c5d3cee tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:09.854011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-257c4dbe-1788-4c21-b670-01b42c5d3cee tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:09.854493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-257c4dbe-1788-4c21-b670-01b42c5d3cee tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:09.854934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-257c4dbe-1788-4c21-b670-01b42c5d3cee tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:10.021782 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89b0f8ca-7849-4bd0-9a38-f0344933d404 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments/672a768f-77f5-4f57-a702-3bcb1080b2ee" status: 202 len: 0 microversion: 2.1 time: 0.603964 Aug 27 05:29:10.023803 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3059/6121] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:29:09 2022] DELETE /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments/672a768f-77f5-4f57-a702-3bcb1080b2ee => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:29:10.064684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e471e6c6-aa33-45aa-bebf-36c471bb507b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:10.071465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e471e6c6-aa33-45aa-bebf-36c471bb507b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:10.113582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e471e6c6-aa33-45aa-bebf-36c471bb507b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:10.114573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e471e6c6-aa33-45aa-bebf-36c471bb507b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:10.115239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e471e6c6-aa33-45aa-bebf-36c471bb507b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:10.116201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e471e6c6-aa33-45aa-bebf-36c471bb507b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:10.117174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e471e6c6-aa33-45aa-bebf-36c471bb507b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:10.118276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e471e6c6-aa33-45aa-bebf-36c471bb507b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:10.248065 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e471e6c6-aa33-45aa-bebf-36c471bb507b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202554 Aug 27 05:29:10.250100 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3060/6122] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:10 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:10.427914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-257c4dbe-1788-4c21-b670-01b42c5d3cee tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:10.444120 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-257c4dbe-1788-4c21-b670-01b42c5d3cee tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1548 microversion: 2.1 time: 0.616731 Aug 27 05:29:10.447171 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3063/6123] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:09 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1548 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:10.475614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b0f57089-414c-4c20-b57d-9a9d533d07d0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:10.476437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b0f57089-414c-4c20-b57d-9a9d533d07d0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:10.496792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f57089-414c-4c20-b57d-9a9d533d07d0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:10.501603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f57089-414c-4c20-b57d-9a9d533d07d0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:10.507175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f57089-414c-4c20-b57d-9a9d533d07d0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:10.509879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f57089-414c-4c20-b57d-9a9d533d07d0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:10.510707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f57089-414c-4c20-b57d-9a9d533d07d0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:10.511065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f57089-414c-4c20-b57d-9a9d533d07d0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:10.708270 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b0f57089-414c-4c20-b57d-9a9d533d07d0 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238503 Aug 27 05:29:10.709554 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3061/6124] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:29:10 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:29:11.267983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b92edb97-4317-47af-b52b-ed102be12823 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:11.271827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b92edb97-4317-47af-b52b-ed102be12823 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:11.321848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92edb97-4317-47af-b52b-ed102be12823 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:11.322700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92edb97-4317-47af-b52b-ed102be12823 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:11.323502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92edb97-4317-47af-b52b-ed102be12823 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:11.324772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92edb97-4317-47af-b52b-ed102be12823 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:11.325624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92edb97-4317-47af-b52b-ed102be12823 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:11.338159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92edb97-4317-47af-b52b-ed102be12823 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:11.518196 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b92edb97-4317-47af-b52b-ed102be12823 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.259055 Aug 27 05:29:11.525190 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3064/6125] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:11 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:12.555440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-59a6295e-4558-4770-a100-097926359970 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:12.559003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-59a6295e-4558-4770-a100-097926359970 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:12.575261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a6295e-4558-4770-a100-097926359970 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:12.584486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a6295e-4558-4770-a100-097926359970 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:12.585177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a6295e-4558-4770-a100-097926359970 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:12.587149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a6295e-4558-4770-a100-097926359970 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:12.589905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a6295e-4558-4770-a100-097926359970 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:12.590962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-59a6295e-4558-4770-a100-097926359970 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:12.733361 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-59a6295e-4558-4770-a100-097926359970 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199089 Aug 27 05:29:12.735341 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3062/6126] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:12 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:13.302270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1823014166", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a8662850-dbfb-42fe-a136-77bf3b056cdf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "58a22fcb-5b07-4d83-8df1-2b6fed6fe046"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:13.352286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:13.463654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] validate_networks() for [('58a22fcb-5b07-4d83-8df1-2b6fed6fe046', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:29:13.747900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9444869a-a506-4b00-bed8-f44805c6173e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:13.750176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9444869a-a506-4b00-bed8-f44805c6173e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:13.770496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9444869a-a506-4b00-bed8-f44805c6173e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:13.771151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9444869a-a506-4b00-bed8-f44805c6173e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:13.771918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9444869a-a506-4b00-bed8-f44805c6173e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:13.773032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9444869a-a506-4b00-bed8-f44805c6173e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:13.773895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9444869a-a506-4b00-bed8-f44805c6173e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:13.774604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9444869a-a506-4b00-bed8-f44805c6173e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:13.932787 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9444869a-a506-4b00-bed8-f44805c6173e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190376 Aug 27 05:29:13.940962 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3063/6127] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:13 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:29:13.957380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-97e3f241-928c-468f-82b4-3f776cead7fa req-3092e064-5a65-457e-9068-d7cd52dba370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a68fe3-998d-48a4-bb1b-38b743a81bd2", "tag": "6a989aa8-53e7-456e-b6de-7425f0969d81"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:13.994463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-97e3f241-928c-468f-82b4-3f776cead7fa req-3092e064-5a65-457e-9068-d7cd52dba370 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:13.995716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-97e3f241-928c-468f-82b4-3f776cead7fa req-3092e064-5a65-457e-9068-d7cd52dba370 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:14.007265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-97e3f241-928c-468f-82b4-3f776cead7fa req-3092e064-5a65-457e-9068-d7cd52dba370 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:14.045793 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-97e3f241-928c-468f-82b4-3f776cead7fa req-3092e064-5a65-457e-9068-d7cd52dba370 service nova] Creating event network-changed:6a989aa8-53e7-456e-b6de-7425f0969d81 for instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 on n-h2-820368-35 Aug 27 05:29:14.071995 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-97e3f241-928c-468f-82b4-3f776cead7fa req-3092e064-5a65-457e-9068-d7cd52dba370 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114369 Aug 27 05:29:14.073021 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3064/6128] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:14.956440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-801b870a-2ee7-417a-8797-64b302402b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:14.959781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-801b870a-2ee7-417a-8797-64b302402b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:14.989026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-801b870a-2ee7-417a-8797-64b302402b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:14.989944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-801b870a-2ee7-417a-8797-64b302402b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:14.990689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-801b870a-2ee7-417a-8797-64b302402b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:14.999050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-801b870a-2ee7-417a-8797-64b302402b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:14.999590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-801b870a-2ee7-417a-8797-64b302402b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:15.000022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-801b870a-2ee7-417a-8797-64b302402b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:15.094807 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-801b870a-2ee7-417a-8797-64b302402b7b tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144628 Aug 27 05:29:15.112632 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3065/6129] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:14 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:29:15.338360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:29:15.339575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:29:15.340257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:29:15.340953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:29:15.341596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:29:15.375840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:15.379726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:15.381241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:15.388111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:15.391809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:15.392717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:15.467627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:29:15.486942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for user 007b4762bf8c436fb783d84380c01932 and project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:29:15.668668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:29:15.671424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8662850-dbfb-42fe-a136-77bf3b056cdf',volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:29:16.123914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-43a2142b-22ff-43bc-9cee-9a96d3447013 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:16.126145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-43a2142b-22ff-43bc-9cee-9a96d3447013 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:16.136503 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-92c4d892-75a5-4f9b-b48c-f55811cfe50a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.837890 Aug 27 05:29:16.146342 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3065/6130] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:29:16.151342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43a2142b-22ff-43bc-9cee-9a96d3447013 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:16.151941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43a2142b-22ff-43bc-9cee-9a96d3447013 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:16.152404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43a2142b-22ff-43bc-9cee-9a96d3447013 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:16.153163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43a2142b-22ff-43bc-9cee-9a96d3447013 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:16.153632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43a2142b-22ff-43bc-9cee-9a96d3447013 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:16.157864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-43a2142b-22ff-43bc-9cee-9a96d3447013 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:16.182434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2426102-066e-48ac-8d60-5d5b57755532 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:16.183080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b2426102-066e-48ac-8d60-5d5b57755532 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:16.300986 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-43a2142b-22ff-43bc-9cee-9a96d3447013 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169881 Aug 27 05:29:16.311792 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3066/6131] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:16 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:16.421041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b2426102-066e-48ac-8d60-5d5b57755532 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:16.433469 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b2426102-066e-48ac-8d60-5d5b57755532 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1057 microversion: 2.1 time: 0.280105 Aug 27 05:29:16.436319 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3066/6132] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:16 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1057 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:17.314506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-18216943-ce03-47c2-a9f2-fb976dd22dad tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:17.319466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-18216943-ce03-47c2-a9f2-fb976dd22dad tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:17.345311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18216943-ce03-47c2-a9f2-fb976dd22dad tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:17.348570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18216943-ce03-47c2-a9f2-fb976dd22dad tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:17.349791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18216943-ce03-47c2-a9f2-fb976dd22dad tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:17.355797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18216943-ce03-47c2-a9f2-fb976dd22dad tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:17.358119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18216943-ce03-47c2-a9f2-fb976dd22dad tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:17.358743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18216943-ce03-47c2-a9f2-fb976dd22dad tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:17.455013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7bc223a7-e861-462e-9374-d6892bdb9dc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:17.456345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7bc223a7-e861-462e-9374-d6892bdb9dc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:17.475328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc223a7-e861-462e-9374-d6892bdb9dc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:17.480080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc223a7-e861-462e-9374-d6892bdb9dc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:17.480624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc223a7-e861-462e-9374-d6892bdb9dc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:17.485333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc223a7-e861-462e-9374-d6892bdb9dc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:17.487957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc223a7-e861-462e-9374-d6892bdb9dc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:17.488704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc223a7-e861-462e-9374-d6892bdb9dc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:17.536121 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-18216943-ce03-47c2-a9f2-fb976dd22dad tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226099 Aug 27 05:29:17.541778 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3067/6133] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:17 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:17.706174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7bc223a7-e861-462e-9374-d6892bdb9dc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:17.724030 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7bc223a7-e861-462e-9374-d6892bdb9dc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1107 microversion: 2.1 time: 0.264682 Aug 27 05:29:17.730384 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3067/6134] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:17 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1107 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:18.550349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f4ca38c-a101-44d5-807f-80fdd650988f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:18.553543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f4ca38c-a101-44d5-807f-80fdd650988f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:18.569166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4ca38c-a101-44d5-807f-80fdd650988f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.573787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4ca38c-a101-44d5-807f-80fdd650988f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.574529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4ca38c-a101-44d5-807f-80fdd650988f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.575300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4ca38c-a101-44d5-807f-80fdd650988f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.575757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4ca38c-a101-44d5-807f-80fdd650988f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.582144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f4ca38c-a101-44d5-807f-80fdd650988f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.674691 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f4ca38c-a101-44d5-807f-80fdd650988f tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128501 Aug 27 05:29:18.683892 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3068/6135] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:18 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:18.749778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d7a74cbe-cc4c-4fe9-a8e0-7ca535e502a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:18.750409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d7a74cbe-cc4c-4fe9-a8e0-7ca535e502a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:18.775335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7a74cbe-cc4c-4fe9-a8e0-7ca535e502a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.776360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7a74cbe-cc4c-4fe9-a8e0-7ca535e502a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.777023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7a74cbe-cc4c-4fe9-a8e0-7ca535e502a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.778023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7a74cbe-cc4c-4fe9-a8e0-7ca535e502a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.778703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7a74cbe-cc4c-4fe9-a8e0-7ca535e502a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.779460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7a74cbe-cc4c-4fe9-a8e0-7ca535e502a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:19.082619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d7a74cbe-cc4c-4fe9-a8e0-7ca535e502a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:19.096228 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d7a74cbe-cc4c-4fe9-a8e0-7ca535e502a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1163 microversion: 2.1 time: 0.351400 Aug 27 05:29:19.096623 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3068/6136] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:18 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1163 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:19.702615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5d2185dc-290f-4247-99b7-04f76e5ed6e6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:19.705695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5d2185dc-290f-4247-99b7-04f76e5ed6e6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:19.733603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2185dc-290f-4247-99b7-04f76e5ed6e6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:19.734114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2185dc-290f-4247-99b7-04f76e5ed6e6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:19.734624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2185dc-290f-4247-99b7-04f76e5ed6e6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:19.735447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2185dc-290f-4247-99b7-04f76e5ed6e6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:19.735914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2185dc-290f-4247-99b7-04f76e5ed6e6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:19.736642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d2185dc-290f-4247-99b7-04f76e5ed6e6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:19.872109 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5d2185dc-290f-4247-99b7-04f76e5ed6e6 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179738 Aug 27 05:29:19.879117 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3069/6137] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:19 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:20.134036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a949775a-4101-4c3c-a639-f808add2dce1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:20.135190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a949775a-4101-4c3c-a639-f808add2dce1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:20.161461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a949775a-4101-4c3c-a639-f808add2dce1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:20.162358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a949775a-4101-4c3c-a639-f808add2dce1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:20.163617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a949775a-4101-4c3c-a639-f808add2dce1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:20.172082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a949775a-4101-4c3c-a639-f808add2dce1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:20.172907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a949775a-4101-4c3c-a639-f808add2dce1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:20.173582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a949775a-4101-4c3c-a639-f808add2dce1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:20.305810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a949775a-4101-4c3c-a639-f808add2dce1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:20.316302 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a949775a-4101-4c3c-a639-f808add2dce1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1173 microversion: 2.1 time: 0.195448 Aug 27 05:29:20.330138 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3069/6138] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:20 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1173 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:20.890534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-660c7ca6-ee89-49a0-b289-178e248f80a9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:20.898864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-660c7ca6-ee89-49a0-b289-178e248f80a9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:20.938498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660c7ca6-ee89-49a0-b289-178e248f80a9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:20.940181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660c7ca6-ee89-49a0-b289-178e248f80a9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:20.947672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660c7ca6-ee89-49a0-b289-178e248f80a9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:20.952896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660c7ca6-ee89-49a0-b289-178e248f80a9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:20.954789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660c7ca6-ee89-49a0-b289-178e248f80a9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:20.964531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660c7ca6-ee89-49a0-b289-178e248f80a9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:21.112097 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-660c7ca6-ee89-49a0-b289-178e248f80a9 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.229182 Aug 27 05:29:21.114102 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3070/6139] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:20 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:21.356827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a4d2b791-edb7-4e77-96ac-488f15bb43c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:21.358909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a4d2b791-edb7-4e77-96ac-488f15bb43c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:21.412683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d2b791-edb7-4e77-96ac-488f15bb43c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:21.421104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d2b791-edb7-4e77-96ac-488f15bb43c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:21.422395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d2b791-edb7-4e77-96ac-488f15bb43c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:21.423252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d2b791-edb7-4e77-96ac-488f15bb43c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:21.423918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d2b791-edb7-4e77-96ac-488f15bb43c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:21.432128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4d2b791-edb7-4e77-96ac-488f15bb43c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:21.511874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:22.007786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a4d2b791-edb7-4e77-96ac-488f15bb43c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:22.052400 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a4d2b791-edb7-4e77-96ac-488f15bb43c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1215 microversion: 2.1 time: 0.698248 Aug 27 05:29:22.087573 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3070/6140] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:21 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1215 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:22.131494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a8ca4a4d-2d32-4cae-9e62-31f530fca58c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:22.134571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a8ca4a4d-2d32-4cae-9e62-31f530fca58c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:22.150226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8ca4a4d-2d32-4cae-9e62-31f530fca58c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:22.155552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8ca4a4d-2d32-4cae-9e62-31f530fca58c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:22.156120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8ca4a4d-2d32-4cae-9e62-31f530fca58c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:22.161113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8ca4a4d-2d32-4cae-9e62-31f530fca58c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:22.162564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8ca4a4d-2d32-4cae-9e62-31f530fca58c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:22.163240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8ca4a4d-2d32-4cae-9e62-31f530fca58c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:22.257472 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a8ca4a4d-2d32-4cae-9e62-31f530fca58c tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134393 Aug 27 05:29:22.261718 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3071/6141] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:22 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:22.581475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3f9b236d-6a07-4c43-9b5f-14eae956bc6b req-d9760974-cadf-47f3-a522-845e98e744f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f598e5-06e2-4066-9b21-b53033cae353", "tag": "0836c3fb-f6c0-4f9a-9405-04eba3fd3001"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:22.625805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3f9b236d-6a07-4c43-9b5f-14eae956bc6b req-d9760974-cadf-47f3-a522-845e98e744f4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:22.643863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3f9b236d-6a07-4c43-9b5f-14eae956bc6b req-d9760974-cadf-47f3-a522-845e98e744f4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:22.645595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3f9b236d-6a07-4c43-9b5f-14eae956bc6b req-d9760974-cadf-47f3-a522-845e98e744f4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:22.686759 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3f9b236d-6a07-4c43-9b5f-14eae956bc6b req-d9760974-cadf-47f3-a522-845e98e744f4 service nova] Creating event network-changed:0836c3fb-f6c0-4f9a-9405-04eba3fd3001 for instance 31f598e5-06e2-4066-9b21-b53033cae353 on n-h1-820368-35 Aug 27 05:29:22.721951 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3f9b236d-6a07-4c43-9b5f-14eae956bc6b req-d9760974-cadf-47f3-a522-845e98e744f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151347 Aug 27 05:29:22.727677 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3071/6142] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:29:23.094184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4c86c173-2fb0-412c-87a5-5f2cd4e29908 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:23.095182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4c86c173-2fb0-412c-87a5-5f2cd4e29908 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:23.105198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c86c173-2fb0-412c-87a5-5f2cd4e29908 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:23.107603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c86c173-2fb0-412c-87a5-5f2cd4e29908 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:23.109341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c86c173-2fb0-412c-87a5-5f2cd4e29908 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:23.112089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c86c173-2fb0-412c-87a5-5f2cd4e29908 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:23.114716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c86c173-2fb0-412c-87a5-5f2cd4e29908 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:23.115440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c86c173-2fb0-412c-87a5-5f2cd4e29908 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:23.272430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-16f5fd6d-314b-4291-a069-a40f8e4299ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:23.276174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-16f5fd6d-314b-4291-a069-a40f8e4299ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:23.307845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16f5fd6d-314b-4291-a069-a40f8e4299ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:23.308649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16f5fd6d-314b-4291-a069-a40f8e4299ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:23.310665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16f5fd6d-314b-4291-a069-a40f8e4299ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:23.313070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16f5fd6d-314b-4291-a069-a40f8e4299ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:23.317236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16f5fd6d-314b-4291-a069-a40f8e4299ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:23.321053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-16f5fd6d-314b-4291-a069-a40f8e4299ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:23.410769 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-16f5fd6d-314b-4291-a069-a40f8e4299ff tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.143301 Aug 27 05:29:23.412688 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3072/6143] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:29:23 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 05:29:23.605392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-88e3588e-fbd1-4858-853d-59fef0c9ab3d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:23.606150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-88e3588e-fbd1-4858-853d-59fef0c9ab3d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:23.618411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4c86c173-2fb0-412c-87a5-5f2cd4e29908 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:23.627396 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4c86c173-2fb0-412c-87a5-5f2cd4e29908 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1215 microversion: 2.1 time: 0.537699 Aug 27 05:29:23.630624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88e3588e-fbd1-4858-853d-59fef0c9ab3d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:23.632531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88e3588e-fbd1-4858-853d-59fef0c9ab3d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:23.637079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88e3588e-fbd1-4858-853d-59fef0c9ab3d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:23.639492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88e3588e-fbd1-4858-853d-59fef0c9ab3d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:23.640224 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3072/6144] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:23 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1215 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:23.647836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88e3588e-fbd1-4858-853d-59fef0c9ab3d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:23.648519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88e3588e-fbd1-4858-853d-59fef0c9ab3d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:23.746228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-88e3588e-fbd1-4858-853d-59fef0c9ab3d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:29:23.962918 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-88e3588e-fbd1-4858-853d-59fef0c9ab3d tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 204 len: 0 microversion: 2.1 time: 0.364073 Aug 27 05:29:23.963838 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3073/6145] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:29:23 2022] DELETE /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:29:23.973421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b07e5b31-2c84-4bbb-8f89-b2cb5d259d50 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:23.974059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b07e5b31-2c84-4bbb-8f89-b2cb5d259d50 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:23.992333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b07e5b31-2c84-4bbb-8f89-b2cb5d259d50 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:23.992849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b07e5b31-2c84-4bbb-8f89-b2cb5d259d50 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:23.993302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b07e5b31-2c84-4bbb-8f89-b2cb5d259d50 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:23.994035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b07e5b31-2c84-4bbb-8f89-b2cb5d259d50 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:23.994499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b07e5b31-2c84-4bbb-8f89-b2cb5d259d50 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:23.994935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b07e5b31-2c84-4bbb-8f89-b2cb5d259d50 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:24.276696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b07e5b31-2c84-4bbb-8f89-b2cb5d259d50 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:24.289258 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b07e5b31-2c84-4bbb-8f89-b2cb5d259d50 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1681 microversion: 2.1 time: 0.320800 Aug 27 05:29:24.289769 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3073/6146] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:23 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1681 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:24.667042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-39cd7b92-c74c-4e51-8654-55f15560d7d9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:24.668127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-39cd7b92-c74c-4e51-8654-55f15560d7d9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:24.690184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39cd7b92-c74c-4e51-8654-55f15560d7d9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:24.691770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39cd7b92-c74c-4e51-8654-55f15560d7d9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:24.692713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39cd7b92-c74c-4e51-8654-55f15560d7d9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:24.695425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39cd7b92-c74c-4e51-8654-55f15560d7d9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:24.697553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39cd7b92-c74c-4e51-8654-55f15560d7d9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:24.698259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39cd7b92-c74c-4e51-8654-55f15560d7d9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:25.053003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-39cd7b92-c74c-4e51-8654-55f15560d7d9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:25.071191 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-39cd7b92-c74c-4e51-8654-55f15560d7d9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1215 microversion: 2.1 time: 0.409598 Aug 27 05:29:25.077825 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3074/6147] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:24 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1215 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:25.327945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd13ef2c-7c44-465d-8c61-5aecb1011b21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:25.329670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd13ef2c-7c44-465d-8c61-5aecb1011b21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:25.338377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd13ef2c-7c44-465d-8c61-5aecb1011b21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:25.338799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd13ef2c-7c44-465d-8c61-5aecb1011b21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:25.339572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd13ef2c-7c44-465d-8c61-5aecb1011b21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:25.340624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd13ef2c-7c44-465d-8c61-5aecb1011b21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:25.341705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd13ef2c-7c44-465d-8c61-5aecb1011b21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:25.342371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd13ef2c-7c44-465d-8c61-5aecb1011b21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:25.783810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd13ef2c-7c44-465d-8c61-5aecb1011b21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:25.809572 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd13ef2c-7c44-465d-8c61-5aecb1011b21 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1681 microversion: 2.1 time: 0.500124 Aug 27 05:29:25.813501 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3074/6148] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:25 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1681 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:26.120284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c06166be-6f6e-4508-941d-eb391c457f3f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:26.125569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c06166be-6f6e-4508-941d-eb391c457f3f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:26.134839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:26.157808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c06166be-6f6e-4508-941d-eb391c457f3f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:26.158593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c06166be-6f6e-4508-941d-eb391c457f3f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:26.159284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c06166be-6f6e-4508-941d-eb391c457f3f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:26.161431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c06166be-6f6e-4508-941d-eb391c457f3f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:26.166043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c06166be-6f6e-4508-941d-eb391c457f3f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:26.166698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c06166be-6f6e-4508-941d-eb391c457f3f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:26.428429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:26.643903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c06166be-6f6e-4508-941d-eb391c457f3f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:26.657106 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c06166be-6f6e-4508-941d-eb391c457f3f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1215 microversion: 2.1 time: 0.549686 Aug 27 05:29:26.659568 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3075/6149] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:26 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1215 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:26.835380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f95069e-ffae-4fa4-a3ec-9f12d56260ac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:26.837225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3f95069e-ffae-4fa4-a3ec-9f12d56260ac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:26.861807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f95069e-ffae-4fa4-a3ec-9f12d56260ac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:26.867517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f95069e-ffae-4fa4-a3ec-9f12d56260ac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:26.868444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f95069e-ffae-4fa4-a3ec-9f12d56260ac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:26.869590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f95069e-ffae-4fa4-a3ec-9f12d56260ac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:26.870279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f95069e-ffae-4fa4-a3ec-9f12d56260ac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:26.873478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f95069e-ffae-4fa4-a3ec-9f12d56260ac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:27.317166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3f95069e-ffae-4fa4-a3ec-9f12d56260ac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:27.335220 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3f95069e-ffae-4fa4-a3ec-9f12d56260ac tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1681 microversion: 2.1 time: 0.506544 Aug 27 05:29:27.339076 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3075/6150] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:26 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1681 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:27.492009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4da97180-3952-4e26-9b7c-a1f272b31478 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4acb96a5-05b9-495b-8ee4-f5ae107c2065"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:27.495103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4da97180-3952-4e26-9b7c-a1f272b31478 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:27.511297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4da97180-3952-4e26-9b7c-a1f272b31478 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:27.511811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4da97180-3952-4e26-9b7c-a1f272b31478 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:27.512252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4da97180-3952-4e26-9b7c-a1f272b31478 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:27.513019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4da97180-3952-4e26-9b7c-a1f272b31478 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:27.513494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4da97180-3952-4e26-9b7c-a1f272b31478 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:27.513909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4da97180-3952-4e26-9b7c-a1f272b31478 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:27.684295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3360e07d-b3de-4f7c-b338-f48fc2fe6b7b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:27.686090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3360e07d-b3de-4f7c-b338-f48fc2fe6b7b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:27.694245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3360e07d-b3de-4f7c-b338-f48fc2fe6b7b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:27.697642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3360e07d-b3de-4f7c-b338-f48fc2fe6b7b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:27.701107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3360e07d-b3de-4f7c-b338-f48fc2fe6b7b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:27.708344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3360e07d-b3de-4f7c-b338-f48fc2fe6b7b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:27.709202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3360e07d-b3de-4f7c-b338-f48fc2fe6b7b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:27.710687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3360e07d-b3de-4f7c-b338-f48fc2fe6b7b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:27.722599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:28.123409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3360e07d-b3de-4f7c-b338-f48fc2fe6b7b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:28.143541 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3360e07d-b3de-4f7c-b338-f48fc2fe6b7b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1215 microversion: 2.1 time: 0.463205 Aug 27 05:29:28.151452 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3076/6151] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:27 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1215 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:28.253559 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4da97180-3952-4e26-9b7c-a1f272b31478 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765405 Aug 27 05:29:28.254926 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3076/6152] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:29:27 2022] POST /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:28.362823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3050c377-91a5-4a02-b2fb-79984b8f18f3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:28.365926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3050c377-91a5-4a02-b2fb-79984b8f18f3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:28.381963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3050c377-91a5-4a02-b2fb-79984b8f18f3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:28.383665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3050c377-91a5-4a02-b2fb-79984b8f18f3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:28.385767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3050c377-91a5-4a02-b2fb-79984b8f18f3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:28.389031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3050c377-91a5-4a02-b2fb-79984b8f18f3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:28.390492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3050c377-91a5-4a02-b2fb-79984b8f18f3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:28.392335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3050c377-91a5-4a02-b2fb-79984b8f18f3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:28.461012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-eba5e5d4-cf0d-4345-b258-bea9f8697206 req-eb4887f6-c108-4350-b2f0-3e718cb1ab44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "778fae4c-132e-4000-9d06-3741a2cb627d", "name": "network-vif-deleted", "tag": "b91252b2-16b9-4df2-94ea-253d93a6cff3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:28.493463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-eba5e5d4-cf0d-4345-b258-bea9f8697206 req-eb4887f6-c108-4350-b2f0-3e718cb1ab44 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:28.494112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-eba5e5d4-cf0d-4345-b258-bea9f8697206 req-eb4887f6-c108-4350-b2f0-3e718cb1ab44 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:28.494751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-eba5e5d4-cf0d-4345-b258-bea9f8697206 req-eb4887f6-c108-4350-b2f0-3e718cb1ab44 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:28.531873 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-eba5e5d4-cf0d-4345-b258-bea9f8697206 req-eb4887f6-c108-4350-b2f0-3e718cb1ab44 service nova] Creating event network-vif-deleted:b91252b2-16b9-4df2-94ea-253d93a6cff3 for instance 778fae4c-132e-4000-9d06-3741a2cb627d on n-h1-820368-35 Aug 27 05:29:28.543547 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-eba5e5d4-cf0d-4345-b258-bea9f8697206 req-eb4887f6-c108-4350-b2f0-3e718cb1ab44 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087835 Aug 27 05:29:28.545502 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3077/6153] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:28.648469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3050c377-91a5-4a02-b2fb-79984b8f18f3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fc751d620242208608be8bc55ae86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70b9f70261e4f15a6d6d740c66e4cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:28.667188 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3050c377-91a5-4a02-b2fb-79984b8f18f3 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 200 len: 1614 microversion: 2.1 time: 0.300116 Aug 27 05:29:28.671264 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3077/6154] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:28 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 1614 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:29.174655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-41823743-3090-428b-9e27-935eb9496fbc tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:29.175355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-41823743-3090-428b-9e27-935eb9496fbc tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:29.195396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41823743-3090-428b-9e27-935eb9496fbc tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:29.196124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41823743-3090-428b-9e27-935eb9496fbc tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:29.196603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41823743-3090-428b-9e27-935eb9496fbc tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:29.197376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41823743-3090-428b-9e27-935eb9496fbc tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:29.197851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41823743-3090-428b-9e27-935eb9496fbc tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:29.198292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-41823743-3090-428b-9e27-935eb9496fbc tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:29.515293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-41823743-3090-428b-9e27-935eb9496fbc tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:29.524428 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-41823743-3090-428b-9e27-935eb9496fbc tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1215 microversion: 2.1 time: 0.354933 Aug 27 05:29:29.535315 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3078/6155] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:29 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1215 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:29.692838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:29.693781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:29.703391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:29.704297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:29.704830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:29.705790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:29.706317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:29.706815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:29.731847 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d HTTP/1.1 Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '778fae4c-132e-4000-9d06-3741a2cb627d'} Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:29.733755 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:29.738529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:29.738529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:29.738529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:29.738529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:29.738529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:29.738529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:29.738529 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:29.741364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:29.743127 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e1e5dd58-bbde-4fcb-b257-3085ec8f8922 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 404 len: 111 microversion: 2.1 time: 0.054650 Aug 27 05:29:29.744038 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3078/6156] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:29 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:29.754676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-12c399f6-3bc5-479f-bc89-aa7e35790112 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '.version_select at 0x7fb56490d040>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:29.802510 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-12c399f6-3bc5-479f-bc89-aa7e35790112 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229346458" status: 202 len: 0 microversion: 2.1 time: 0.052954 Aug 27 05:29:29.803718 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3079/6157] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 05:29:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229346458 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:29:30.550851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e0ef8e8f-f363-4ab5-988e-a153d4c2a250 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:30.552063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e0ef8e8f-f363-4ab5-988e-a153d4c2a250 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:30.569804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0ef8e8f-f363-4ab5-988e-a153d4c2a250 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:30.570353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0ef8e8f-f363-4ab5-988e-a153d4c2a250 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:30.570806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0ef8e8f-f363-4ab5-988e-a153d4c2a250 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:30.579304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0ef8e8f-f363-4ab5-988e-a153d4c2a250 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:30.579840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0ef8e8f-f363-4ab5-988e-a153d4c2a250 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:30.580258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0ef8e8f-f363-4ab5-988e-a153d4c2a250 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:31.658889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e0ef8e8f-f363-4ab5-988e-a153d4c2a250 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:31.673150 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e0ef8e8f-f363-4ab5-988e-a153d4c2a250 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1215 microversion: 2.1 time: 1.126447 Aug 27 05:29:31.691903 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3079/6158] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:30 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1215 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:32.700949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-af3f3c6e-c90f-41b8-a467-22fb3c21bff0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:32.701619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-af3f3c6e-c90f-41b8-a467-22fb3c21bff0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:32.720771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3f3c6e-c90f-41b8-a467-22fb3c21bff0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:32.721615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3f3c6e-c90f-41b8-a467-22fb3c21bff0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:32.722351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3f3c6e-c90f-41b8-a467-22fb3c21bff0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:32.724779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3f3c6e-c90f-41b8-a467-22fb3c21bff0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:32.725622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3f3c6e-c90f-41b8-a467-22fb3c21bff0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:32.726392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af3f3c6e-c90f-41b8-a467-22fb3c21bff0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:32.966706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-af3f3c6e-c90f-41b8-a467-22fb3c21bff0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:32.978390 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-af3f3c6e-c90f-41b8-a467-22fb3c21bff0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1203 microversion: 2.1 time: 0.288193 Aug 27 05:29:32.979381 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3080/6159] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:32 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1203 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:34.013837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-de7b706c-b587-4574-b19d-2f369080ea43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:34.017542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-de7b706c-b587-4574-b19d-2f369080ea43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:34.036470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7b706c-b587-4574-b19d-2f369080ea43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:34.037318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7b706c-b587-4574-b19d-2f369080ea43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:34.038363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7b706c-b587-4574-b19d-2f369080ea43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:34.039543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7b706c-b587-4574-b19d-2f369080ea43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:34.040259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7b706c-b587-4574-b19d-2f369080ea43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:34.040894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de7b706c-b587-4574-b19d-2f369080ea43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:34.318990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-de7b706c-b587-4574-b19d-2f369080ea43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:34.327765 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-de7b706c-b587-4574-b19d-2f369080ea43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1203 microversion: 2.1 time: 0.326509 Aug 27 05:29:34.329091 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3080/6160] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:33 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1203 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:35.351127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b3f9b86d-c185-4e4e-b4e7-52bfc2fde9c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:35.352554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b3f9b86d-c185-4e4e-b4e7-52bfc2fde9c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:35.362947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3f9b86d-c185-4e4e-b4e7-52bfc2fde9c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:35.363671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3f9b86d-c185-4e4e-b4e7-52bfc2fde9c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:35.364126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3f9b86d-c185-4e4e-b4e7-52bfc2fde9c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:35.364851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3f9b86d-c185-4e4e-b4e7-52bfc2fde9c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:35.365310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3f9b86d-c185-4e4e-b4e7-52bfc2fde9c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:35.365784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3f9b86d-c185-4e4e-b4e7-52bfc2fde9c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:35.594428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b3f9b86d-c185-4e4e-b4e7-52bfc2fde9c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:35.604114 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b3f9b86d-c185-4e4e-b4e7-52bfc2fde9c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1203 microversion: 2.1 time: 0.258286 Aug 27 05:29:35.604827 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3081/6161] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:35 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1203 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:36.633713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6e78370-1b8c-4405-8e9c-984ea8b8072f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:36.634572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6e78370-1b8c-4405-8e9c-984ea8b8072f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:36.643163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6e78370-1b8c-4405-8e9c-984ea8b8072f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:36.644073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6e78370-1b8c-4405-8e9c-984ea8b8072f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:36.644667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6e78370-1b8c-4405-8e9c-984ea8b8072f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:36.646395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6e78370-1b8c-4405-8e9c-984ea8b8072f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:36.647206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6e78370-1b8c-4405-8e9c-984ea8b8072f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:36.647742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6e78370-1b8c-4405-8e9c-984ea8b8072f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:36.912324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6e78370-1b8c-4405-8e9c-984ea8b8072f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:36.925767 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6e78370-1b8c-4405-8e9c-984ea8b8072f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1203 microversion: 2.1 time: 0.296340 Aug 27 05:29:36.927259 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3081/6162] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:36 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1203 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:37.947604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eee12c6c-0a75-4f12-9daa-e164d4cc4cdf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:37.948237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eee12c6c-0a75-4f12-9daa-e164d4cc4cdf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:37.962128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eee12c6c-0a75-4f12-9daa-e164d4cc4cdf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:37.967834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eee12c6c-0a75-4f12-9daa-e164d4cc4cdf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:37.969906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eee12c6c-0a75-4f12-9daa-e164d4cc4cdf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:37.970696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eee12c6c-0a75-4f12-9daa-e164d4cc4cdf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:37.971222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eee12c6c-0a75-4f12-9daa-e164d4cc4cdf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:37.971731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eee12c6c-0a75-4f12-9daa-e164d4cc4cdf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:38.170199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eee12c6c-0a75-4f12-9daa-e164d4cc4cdf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:38.181360 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eee12c6c-0a75-4f12-9daa-e164d4cc4cdf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1203 microversion: 2.1 time: 0.237420 Aug 27 05:29:38.182895 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3082/6163] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:37 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1203 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:38.419440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:38.420906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:38.429247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:38.431384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:38.431384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:38.431384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:38.431751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:38.432083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:38.446913 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d HTTP/1.1 Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '778fae4c-132e-4000-9d06-3741a2cb627d'} Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:38.448827 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:38.454471 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c39a5b0a-e9a6-40e4-8719-faa6baba546e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 404 len: 111 microversion: 2.1 time: 0.036360 Aug 27 05:29:38.455643 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3082/6164] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:29:38 2022] DELETE /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:38.461522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:38.462274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 778fae4c-132e-4000-9d06-3741a2cb627d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:38.469682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:38.470275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:38.470940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:38.476549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:38.477613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:38.478387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:38.493897 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d HTTP/1.1 Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '778fae4c-132e-4000-9d06-3741a2cb627d'} Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:38.495859 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:38.504821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:38.504821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:38.504821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:38.504821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:38.504821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:38.504821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. Aug 27 05:29:38.504821 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:38.504821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance 778fae4c-132e-4000-9d06-3741a2cb627d could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:38.504821 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fbf28aa3-b753-47bf-8d07-3a32ba5f74e4 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d" status: 404 len: 111 microversion: 2.1 time: 0.040850 Aug 27 05:29:38.504821 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3083/6165] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:38 2022] GET /compute/v2.1/servers/778fae4c-132e-4000-9d06-3741a2cb627d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:39.203506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c6054216-8c2a-4519-88e4-28df3508935a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:39.204134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c6054216-8c2a-4519-88e4-28df3508935a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:39.210961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6054216-8c2a-4519-88e4-28df3508935a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:39.211922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6054216-8c2a-4519-88e4-28df3508935a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:39.212375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6054216-8c2a-4519-88e4-28df3508935a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:39.213159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6054216-8c2a-4519-88e4-28df3508935a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:39.213626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6054216-8c2a-4519-88e4-28df3508935a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:39.214066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6054216-8c2a-4519-88e4-28df3508935a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:39.383117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c6054216-8c2a-4519-88e4-28df3508935a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:39.393117 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c6054216-8c2a-4519-88e4-28df3508935a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1203 microversion: 2.1 time: 0.193958 Aug 27 05:29:39.408529 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3083/6166] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:39 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1203 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:40.422877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d39124ab-7d99-41ae-a92e-ae97a4ebd5a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:40.424637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d39124ab-7d99-41ae-a92e-ae97a4ebd5a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:40.454923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d39124ab-7d99-41ae-a92e-ae97a4ebd5a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:40.455900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d39124ab-7d99-41ae-a92e-ae97a4ebd5a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:40.456694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d39124ab-7d99-41ae-a92e-ae97a4ebd5a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:40.458004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d39124ab-7d99-41ae-a92e-ae97a4ebd5a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:40.465324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d39124ab-7d99-41ae-a92e-ae97a4ebd5a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:40.470811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d39124ab-7d99-41ae-a92e-ae97a4ebd5a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:40.695619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d39124ab-7d99-41ae-a92e-ae97a4ebd5a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:40.705784 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d39124ab-7d99-41ae-a92e-ae97a4ebd5a0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1203 microversion: 2.1 time: 0.293880 Aug 27 05:29:40.707168 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3084/6167] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:40 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1203 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:41.739977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1aa69e1e-263c-4277-9ad5-7dbb2bdb23ba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:41.750925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1aa69e1e-263c-4277-9ad5-7dbb2bdb23ba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:41.770593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=50 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:41.772259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1aa69e1e-263c-4277-9ad5-7dbb2bdb23ba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:41.773081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1aa69e1e-263c-4277-9ad5-7dbb2bdb23ba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:41.773745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1aa69e1e-263c-4277-9ad5-7dbb2bdb23ba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:41.776695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1aa69e1e-263c-4277-9ad5-7dbb2bdb23ba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:41.779172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1aa69e1e-263c-4277-9ad5-7dbb2bdb23ba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:41.780741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1aa69e1e-263c-4277-9ad5-7dbb2bdb23ba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:41.841715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e939f077-5f87-4cc9-a3b6-0645037ed66e req-065bd640-def4-4b6b-93ed-7f1186e53819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f598e5-06e2-4066-9b21-b53033cae353", "name": "network-vif-plugged", "status": "completed", "tag": "0836c3fb-f6c0-4f9a-9405-04eba3fd3001"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:41.868314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e939f077-5f87-4cc9-a3b6-0645037ed66e req-065bd640-def4-4b6b-93ed-7f1186e53819 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:41.868807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e939f077-5f87-4cc9-a3b6-0645037ed66e req-065bd640-def4-4b6b-93ed-7f1186e53819 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:41.873046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e939f077-5f87-4cc9-a3b6-0645037ed66e req-065bd640-def4-4b6b-93ed-7f1186e53819 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:41.931881 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e939f077-5f87-4cc9-a3b6-0645037ed66e req-065bd640-def4-4b6b-93ed-7f1186e53819 service nova] Creating event network-vif-plugged:0836c3fb-f6c0-4f9a-9405-04eba3fd3001 for instance 31f598e5-06e2-4066-9b21-b53033cae353 on n-h1-820368-35 Aug 27 05:29:41.941194 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e939f077-5f87-4cc9-a3b6-0645037ed66e req-065bd640-def4-4b6b-93ed-7f1186e53819 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103611 Aug 27 05:29:41.950052 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3085/6168] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:29:42.151245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1aa69e1e-263c-4277-9ad5-7dbb2bdb23ba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:42.163466 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1aa69e1e-263c-4277-9ad5-7dbb2bdb23ba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1203 microversion: 2.1 time: 0.428243 Aug 27 05:29:42.164662 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3084/6169] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:41 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1203 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:43.038601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:43.039728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:43.054670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:43.055479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:43.056086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:43.056987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:43.057654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:43.058246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:43.124770 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 HTTP/1.1 Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'c1ccbd70-94c1-4f11-aca0-2d8d2afe8626'} Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:43.132329 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:43.142430 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:29:43.142430 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.142430 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:43.142430 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.142430 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.142430 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:43.142430 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:43.142430 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:43.142430 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:43.142430 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:29:43.142430 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.147335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:43.151033 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8bfa78cb-826b-419a-9035-1856034e601e tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 404 len: 111 microversion: 2.1 time: 0.118671 Aug 27 05:29:43.153592 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3086/6170] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:29:43 2022] DELETE /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:43.166250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:43.168305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: c1ccbd70-94c1-4f11-aca0-2d8d2afe8626] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:43.179236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:43.181161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:43.181916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:43.183106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:43.183738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:43.184946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:43.193647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdd5eabf-b37a-473d-a703-aa4d90cf0285 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:43.194494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cdd5eabf-b37a-473d-a703-aa4d90cf0285 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:43.207031 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 HTTP/1.1 Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'c1ccbd70-94c1-4f11-aca0-2d8d2afe8626'} Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:43.209540 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.214972 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.214972 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:43.214972 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:43.214972 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:43.214972 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:43.214972 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. Aug 27 05:29:43.214972 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.216772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:43.217805 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5e916928-b11f-49c0-b4bc-64d70a5da191 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626" status: 404 len: 111 microversion: 2.1 time: 0.056307 Aug 27 05:29:43.218113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd5eabf-b37a-473d-a703-aa4d90cf0285 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:43.222585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd5eabf-b37a-473d-a703-aa4d90cf0285 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:43.222781 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3085/6171] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:43 2022] GET /compute/v2.1/servers/c1ccbd70-94c1-4f11-aca0-2d8d2afe8626 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:43.224017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd5eabf-b37a-473d-a703-aa4d90cf0285 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:43.226906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd5eabf-b37a-473d-a703-aa4d90cf0285 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:43.227583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd5eabf-b37a-473d-a703-aa4d90cf0285 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:43.228941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdd5eabf-b37a-473d-a703-aa4d90cf0285 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:43.229119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:43.230139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:43.239903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:43.240650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:43.243716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:43.244901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:43.245610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:43.247374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:43.269963 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 HTTP/1.1 Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2b65010e-acb1-46b6-8da9-b4fef757aa02'} Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:43.271983 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:43.277414 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:29:43.277414 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.277414 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:43.277414 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.277414 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.277414 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:43.277414 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:43.277414 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:43.277414 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:43.277414 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:29:43.277414 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.281058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:43.282429 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a81ae56-f8f0-479e-81c0-64ce4bfa1b14 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 404 len: 111 microversion: 2.1 time: 0.058221 Aug 27 05:29:43.284428 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3086/6172] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:29:43 2022] DELETE /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:43.293713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:43.294908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 2b65010e-acb1-46b6-8da9-b4fef757aa02] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:43.306374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:43.307228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:43.308034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:43.311666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:43.313208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:43.313866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:43.342931 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 HTTP/1.1 Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2b65010e-acb1-46b6-8da9-b4fef757aa02'} Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:43.345144 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.350525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:43.350525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:43.350525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:43.350525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:43.350525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:43.350525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. Aug 27 05:29:43.350525 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:43.352030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance 2b65010e-acb1-46b6-8da9-b4fef757aa02 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:43.353516 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b88b933d-5043-4af5-ab9a-238ba2d3de13 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02" status: 404 len: 111 microversion: 2.1 time: 0.064757 Aug 27 05:29:43.354701 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3087/6173] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:43 2022] GET /compute/v2.1/servers/2b65010e-acb1-46b6-8da9-b4fef757aa02 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:43.525914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdd5eabf-b37a-473d-a703-aa4d90cf0285 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:43.545094 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cdd5eabf-b37a-473d-a703-aa4d90cf0285 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1203 microversion: 2.1 time: 0.354325 Aug 27 05:29:43.547005 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3087/6174] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:43 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1203 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:44.505348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a459b96-5e43-406f-bc86-de1675de1fc6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:44.509604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a459b96-5e43-406f-bc86-de1675de1fc6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:44.520105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a459b96-5e43-406f-bc86-de1675de1fc6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:44.520863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a459b96-5e43-406f-bc86-de1675de1fc6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:44.521748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a459b96-5e43-406f-bc86-de1675de1fc6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:44.522824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a459b96-5e43-406f-bc86-de1675de1fc6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:44.523977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a459b96-5e43-406f-bc86-de1675de1fc6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:44.524919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a459b96-5e43-406f-bc86-de1675de1fc6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:44.576326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9ffb80de-adf0-467e-aefb-75f43841ba95 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:44.576892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9ffb80de-adf0-467e-aefb-75f43841ba95 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:44.594827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:44.600585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-1a459b96-5e43-406f-bc86-de1675de1fc6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lazy-loading 'flavor' on Instance uuid be8bceb6-cc73-4f2e-8858-e02d8fb84f37 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:29:44.607112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ffb80de-adf0-467e-aefb-75f43841ba95 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:44.608329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ffb80de-adf0-467e-aefb-75f43841ba95 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:44.609441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ffb80de-adf0-467e-aefb-75f43841ba95 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:44.611071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ffb80de-adf0-467e-aefb-75f43841ba95 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:44.612294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ffb80de-adf0-467e-aefb-75f43841ba95 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:44.613403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ffb80de-adf0-467e-aefb-75f43841ba95 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:44.645542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:44.880569 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a459b96-5e43-406f-bc86-de1675de1fc6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/action" status: 200 len: 32 microversion: 2.1 time: 0.382266 Aug 27 05:29:44.882722 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3088/6175] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:29:44 2022] POST /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:29:44.903983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e53f25f-6142-4f5f-b44a-1f6ab766221b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:44.907429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e53f25f-6142-4f5f-b44a-1f6ab766221b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:44.917626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e53f25f-6142-4f5f-b44a-1f6ab766221b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:44.918547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e53f25f-6142-4f5f-b44a-1f6ab766221b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:44.919733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e53f25f-6142-4f5f-b44a-1f6ab766221b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:44.921006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e53f25f-6142-4f5f-b44a-1f6ab766221b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:44.921746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e53f25f-6142-4f5f-b44a-1f6ab766221b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:44.922419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e53f25f-6142-4f5f-b44a-1f6ab766221b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:44.929815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9ffb80de-adf0-467e-aefb-75f43841ba95 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:44.947053 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9ffb80de-adf0-467e-aefb-75f43841ba95 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1391 microversion: 2.1 time: 0.381873 Aug 27 05:29:44.947708 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3088/6176] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:44 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1391 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:44.983895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2f981107-f97f-4624-8fcb-a8977a171337 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:44.984641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2f981107-f97f-4624-8fcb-a8977a171337 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:44.996151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f981107-f97f-4624-8fcb-a8977a171337 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:44.997202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f981107-f97f-4624-8fcb-a8977a171337 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:45.005717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f981107-f97f-4624-8fcb-a8977a171337 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:45.006814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f981107-f97f-4624-8fcb-a8977a171337 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:45.008056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f981107-f97f-4624-8fcb-a8977a171337 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:45.008675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f981107-f97f-4624-8fcb-a8977a171337 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:45.412164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e53f25f-6142-4f5f-b44a-1f6ab766221b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:45.434973 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e53f25f-6142-4f5f-b44a-1f6ab766221b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.543120 Aug 27 05:29:45.445942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2f981107-f97f-4624-8fcb-a8977a171337 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:45.447779 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3089/6177] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:44 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:45.468183 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2f981107-f97f-4624-8fcb-a8977a171337 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1391 microversion: 2.1 time: 0.488236 Aug 27 05:29:45.468795 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3089/6178] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:44 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1391 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:45.497742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-50cc3c84-6a3d-439d-a196-973a65e936aa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:45.498543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-50cc3c84-6a3d-439d-a196-973a65e936aa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:45.514288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50cc3c84-6a3d-439d-a196-973a65e936aa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:45.515288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50cc3c84-6a3d-439d-a196-973a65e936aa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:45.515572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50cc3c84-6a3d-439d-a196-973a65e936aa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:45.516579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50cc3c84-6a3d-439d-a196-973a65e936aa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:45.517308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50cc3c84-6a3d-439d-a196-973a65e936aa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:45.517757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50cc3c84-6a3d-439d-a196-973a65e936aa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:45.835735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-50cc3c84-6a3d-439d-a196-973a65e936aa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:45.856953 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-50cc3c84-6a3d-439d-a196-973a65e936aa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1391 microversion: 2.1 time: 0.364471 Aug 27 05:29:45.858099 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3090/6179] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:45 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1391 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:45.885005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d51c53b4-5702-4b05-90d4-9ed98a237e50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:45.887053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d51c53b4-5702-4b05-90d4-9ed98a237e50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:45.900846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d51c53b4-5702-4b05-90d4-9ed98a237e50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:45.902377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d51c53b4-5702-4b05-90d4-9ed98a237e50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:45.903328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d51c53b4-5702-4b05-90d4-9ed98a237e50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:45.905159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d51c53b4-5702-4b05-90d4-9ed98a237e50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:45.905925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d51c53b4-5702-4b05-90d4-9ed98a237e50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:45.906702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d51c53b4-5702-4b05-90d4-9ed98a237e50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:45.944409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d51c53b4-5702-4b05-90d4-9ed98a237e50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:29:46.089078 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d51c53b4-5702-4b05-90d4-9ed98a237e50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 204 len: 0 microversion: 2.1 time: 0.211798 Aug 27 05:29:46.090521 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3090/6180] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:29:45 2022] DELETE /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:29:46.106503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e7b487f-a9e2-4057-817e-38ce82fbd705 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:46.107675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2e7b487f-a9e2-4057-817e-38ce82fbd705 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:46.114952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e7b487f-a9e2-4057-817e-38ce82fbd705 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:46.115779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e7b487f-a9e2-4057-817e-38ce82fbd705 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:46.116454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e7b487f-a9e2-4057-817e-38ce82fbd705 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:46.117521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e7b487f-a9e2-4057-817e-38ce82fbd705 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:46.118170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e7b487f-a9e2-4057-817e-38ce82fbd705 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:46.118890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e7b487f-a9e2-4057-817e-38ce82fbd705 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:46.400679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2e7b487f-a9e2-4057-817e-38ce82fbd705 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:46.435115 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2e7b487f-a9e2-4057-817e-38ce82fbd705 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1397 microversion: 2.1 time: 0.337102 Aug 27 05:29:46.452027 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3091/6181] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:46 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1397 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:46.473558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-096ba3a3-6a56-49a3-999b-24304c48e43d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:46.474631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-096ba3a3-6a56-49a3-999b-24304c48e43d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:46.481908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096ba3a3-6a56-49a3-999b-24304c48e43d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:46.482736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096ba3a3-6a56-49a3-999b-24304c48e43d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:46.483248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096ba3a3-6a56-49a3-999b-24304c48e43d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:46.483926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096ba3a3-6a56-49a3-999b-24304c48e43d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:46.484816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096ba3a3-6a56-49a3-999b-24304c48e43d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:46.484816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-096ba3a3-6a56-49a3-999b-24304c48e43d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:46.748981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-096ba3a3-6a56-49a3-999b-24304c48e43d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:46.770941 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-096ba3a3-6a56-49a3-999b-24304c48e43d tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.301973 Aug 27 05:29:46.772077 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3091/6182] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:46 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:47.467824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90acbbb2-1a02-47e2-93d7-dd8da803a46a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:47.469463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-90acbbb2-1a02-47e2-93d7-dd8da803a46a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:47.479574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90acbbb2-1a02-47e2-93d7-dd8da803a46a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:47.479574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90acbbb2-1a02-47e2-93d7-dd8da803a46a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:47.480334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90acbbb2-1a02-47e2-93d7-dd8da803a46a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:47.481178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90acbbb2-1a02-47e2-93d7-dd8da803a46a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:47.481551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90acbbb2-1a02-47e2-93d7-dd8da803a46a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:47.481995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90acbbb2-1a02-47e2-93d7-dd8da803a46a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:47.674504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-90acbbb2-1a02-47e2-93d7-dd8da803a46a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:47.686231 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90acbbb2-1a02-47e2-93d7-dd8da803a46a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1397 microversion: 2.1 time: 0.224099 Aug 27 05:29:47.687132 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3092/6183] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:47 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1397 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:47.812780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd241463-b5fd-445f-80b4-54bda2ed8728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:47.814918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cd241463-b5fd-445f-80b4-54bda2ed8728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:47.830672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd241463-b5fd-445f-80b4-54bda2ed8728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:47.832047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd241463-b5fd-445f-80b4-54bda2ed8728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:47.833326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd241463-b5fd-445f-80b4-54bda2ed8728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:47.835262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd241463-b5fd-445f-80b4-54bda2ed8728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:47.836516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd241463-b5fd-445f-80b4-54bda2ed8728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:47.837628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd241463-b5fd-445f-80b4-54bda2ed8728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:48.019855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:48.021696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:48.029012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cd241463-b5fd-445f-80b4-54bda2ed8728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:48.030669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:48.031840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:48.032473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:48.033191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:48.033833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:48.034264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:48.038450 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cd241463-b5fd-445f-80b4-54bda2ed8728 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.233727 Aug 27 05:29:48.051271 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3092/6184] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:47 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:48.060595 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 HTTP/1.1 Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '4e12d584-d333-430d-aec1-67778b1f5575'} Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:48.062399 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:48.066975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:29:48.066975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:48.066975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:48.066975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:48.066975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:48.066975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:48.066975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:48.066975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:48.066975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:48.066975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:29:48.066975 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:29:48.069915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:48.070885 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-14012e27-0a0c-44fb-b90b-49cb3c577b6a tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 404 len: 111 microversion: 2.1 time: 0.057125 Aug 27 05:29:48.072151 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3093/6185] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:29:48 2022] DELETE /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:29:48.080708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:48.081331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] [instance: 4e12d584-d333-430d-aec1-67778b1f5575] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:48.088182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:48.088688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:48.089134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:48.089845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:48.090347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:48.090777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:48.112631 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] HTTP exception thrown: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Request method failure captured: Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 HTTP/1.1 Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCal0eGkGTrzaikvOX4V4sb-2K1R185Hg1FMmeKYaqsq4Lm0MGOb5jVnGzB3iaErCFStIzxRWZ75aA13ECcE7I5zjulCCZ34vvenEnSnlYKiDyt-xKYgLKdjdgm_2sm3iNVDTWrtzZ4_DfZNM50X_VDN3j3WLWMaxCP_LhPFdxr6Xtjw Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d70b9f70261e4f15a6d6d740c66e4cb8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d70b9f70261e4f15a6d6d740c66e4cb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: d70b9f70261e4f15a6d6d740c66e4cb8 Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-643435841 Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 43fc751d620242208608be8bc55ae86d Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachVolumeNegativeTest-643435841-project Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '4e12d584-d333-430d-aec1-67778b1f5575'} Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:48.115851 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:48.123746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:48.123746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:48.123746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:48.123746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:48.123746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:48.123746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. Aug 27 05:29:48.123746 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:48.126771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] Returning 404 to user: Instance 4e12d584-d333-430d-aec1-67778b1f5575 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:48.126771 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e3993e71-367f-4156-9eb8-6feedb6e5566 tempest-AttachVolumeNegativeTest-643435841 tempest-AttachVolumeNegativeTest-643435841-project] 10.222.0.58 "GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575" status: 404 len: 111 microversion: 2.1 time: 0.049984 Aug 27 05:29:48.127797 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3093/6186] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:48 2022] GET /compute/v2.1/servers/4e12d584-d333-430d-aec1-67778b1f5575 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:48.707789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7765c426-a13f-400a-8f96-e43b1acd7b25 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:48.709070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7765c426-a13f-400a-8f96-e43b1acd7b25 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:48.718411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7765c426-a13f-400a-8f96-e43b1acd7b25 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:48.719212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7765c426-a13f-400a-8f96-e43b1acd7b25 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:48.720020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7765c426-a13f-400a-8f96-e43b1acd7b25 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:48.721360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7765c426-a13f-400a-8f96-e43b1acd7b25 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:48.722088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7765c426-a13f-400a-8f96-e43b1acd7b25 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:48.722698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7765c426-a13f-400a-8f96-e43b1acd7b25 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:48.999394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7765c426-a13f-400a-8f96-e43b1acd7b25 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:49.002304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:49.013628 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7765c426-a13f-400a-8f96-e43b1acd7b25 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1355 microversion: 2.1 time: 0.309780 Aug 27 05:29:49.039917 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3094/6187] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:48 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1355 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:49.063337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-62339ee5-3b8f-499c-b8e9-18ab659f9990 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:49.065669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-62339ee5-3b8f-499c-b8e9-18ab659f9990 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:49.101418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62339ee5-3b8f-499c-b8e9-18ab659f9990 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:49.103371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62339ee5-3b8f-499c-b8e9-18ab659f9990 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:49.104267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62339ee5-3b8f-499c-b8e9-18ab659f9990 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:49.108611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62339ee5-3b8f-499c-b8e9-18ab659f9990 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:49.110084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62339ee5-3b8f-499c-b8e9-18ab659f9990 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:49.110781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62339ee5-3b8f-499c-b8e9-18ab659f9990 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:49.496841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-62339ee5-3b8f-499c-b8e9-18ab659f9990 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:49.521377 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-62339ee5-3b8f-499c-b8e9-18ab659f9990 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.462104 Aug 27 05:29:49.522833 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3094/6188] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:49 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:49.557772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-41c09218-5f21-4422-9c41-9326ebe49efa req-9930afcb-c602-42c4-8568-766ef3a70e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f598e5-06e2-4066-9b21-b53033cae353", "name": "network-vif-deleted", "tag": "0836c3fb-f6c0-4f9a-9405-04eba3fd3001"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:49.580019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-41c09218-5f21-4422-9c41-9326ebe49efa req-9930afcb-c602-42c4-8568-766ef3a70e06 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:49.581029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-41c09218-5f21-4422-9c41-9326ebe49efa req-9930afcb-c602-42c4-8568-766ef3a70e06 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:49.582105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-41c09218-5f21-4422-9c41-9326ebe49efa req-9930afcb-c602-42c4-8568-766ef3a70e06 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:49.612149 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-41c09218-5f21-4422-9c41-9326ebe49efa req-9930afcb-c602-42c4-8568-766ef3a70e06 service nova] Creating event network-vif-deleted:0836c3fb-f6c0-4f9a-9405-04eba3fd3001 for instance 31f598e5-06e2-4066-9b21-b53033cae353 on n-h1-820368-35 Aug 27 05:29:49.619485 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-41c09218-5f21-4422-9c41-9326ebe49efa req-9930afcb-c602-42c4-8568-766ef3a70e06 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.546697 Aug 27 05:29:49.621501 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3095/6189] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:29:50.069270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-211794ac-b251-4578-a035-359283890a0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:50.070566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-211794ac-b251-4578-a035-359283890a0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:50.078503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211794ac-b251-4578-a035-359283890a0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:50.079582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211794ac-b251-4578-a035-359283890a0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:50.080222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211794ac-b251-4578-a035-359283890a0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:50.081206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211794ac-b251-4578-a035-359283890a0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:50.082027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211794ac-b251-4578-a035-359283890a0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:50.082794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-211794ac-b251-4578-a035-359283890a0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:50.167605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-211794ac-b251-4578-a035-359283890a0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:50.179741 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-211794ac-b251-4578-a035-359283890a0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1188 microversion: 2.1 time: 0.114287 Aug 27 05:29:50.181009 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3095/6190] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:50 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:50.547547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-853c2605-1c4a-44fb-a3fa-de32988da788 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:50.548514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-853c2605-1c4a-44fb-a3fa-de32988da788 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:50.563921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853c2605-1c4a-44fb-a3fa-de32988da788 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:50.565385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853c2605-1c4a-44fb-a3fa-de32988da788 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:50.566977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853c2605-1c4a-44fb-a3fa-de32988da788 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:50.568156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853c2605-1c4a-44fb-a3fa-de32988da788 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:50.568929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853c2605-1c4a-44fb-a3fa-de32988da788 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:50.569833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-853c2605-1c4a-44fb-a3fa-de32988da788 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:50.784231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-853c2605-1c4a-44fb-a3fa-de32988da788 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:50.806855 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-853c2605-1c4a-44fb-a3fa-de32988da788 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.265133 Aug 27 05:29:50.811345 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3096/6191] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:50 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:51.211285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3473a55d-799c-41fc-b9c2-76d2ab298849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:51.216651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3473a55d-799c-41fc-b9c2-76d2ab298849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:51.243235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3473a55d-799c-41fc-b9c2-76d2ab298849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:51.243765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3473a55d-799c-41fc-b9c2-76d2ab298849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:51.244219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3473a55d-799c-41fc-b9c2-76d2ab298849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:51.244999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3473a55d-799c-41fc-b9c2-76d2ab298849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:51.248913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3473a55d-799c-41fc-b9c2-76d2ab298849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:51.252278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3473a55d-799c-41fc-b9c2-76d2ab298849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:51.428979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3473a55d-799c-41fc-b9c2-76d2ab298849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:51.452374 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3473a55d-799c-41fc-b9c2-76d2ab298849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1188 microversion: 2.1 time: 0.248830 Aug 27 05:29:51.455014 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3096/6192] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:51 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1188 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:51.828796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d9d409b-d760-47a4-88c2-39395b523e79 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:51.829655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d9d409b-d760-47a4-88c2-39395b523e79 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:51.852151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d9d409b-d760-47a4-88c2-39395b523e79 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:51.852674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d9d409b-d760-47a4-88c2-39395b523e79 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:51.853134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d9d409b-d760-47a4-88c2-39395b523e79 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:51.853871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d9d409b-d760-47a4-88c2-39395b523e79 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:51.854523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d9d409b-d760-47a4-88c2-39395b523e79 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:51.855149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d9d409b-d760-47a4-88c2-39395b523e79 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:52.189208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8d9d409b-d760-47a4-88c2-39395b523e79 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:52.216388 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d9d409b-d760-47a4-88c2-39395b523e79 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.391429 Aug 27 05:29:52.217958 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3097/6193] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:51 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:52.479477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b5ef2c8-25aa-445a-927f-ca30e9b31ff5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:52.484646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b5ef2c8-25aa-445a-927f-ca30e9b31ff5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:52.496835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b5ef2c8-25aa-445a-927f-ca30e9b31ff5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:52.497635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b5ef2c8-25aa-445a-927f-ca30e9b31ff5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:52.498159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b5ef2c8-25aa-445a-927f-ca30e9b31ff5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:52.498957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b5ef2c8-25aa-445a-927f-ca30e9b31ff5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:52.500280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b5ef2c8-25aa-445a-927f-ca30e9b31ff5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:52.500966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b5ef2c8-25aa-445a-927f-ca30e9b31ff5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:52.671294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b5ef2c8-25aa-445a-927f-ca30e9b31ff5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:52.685368 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b5ef2c8-25aa-445a-927f-ca30e9b31ff5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1188 microversion: 2.1 time: 0.210597 Aug 27 05:29:52.686322 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3097/6194] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:52 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1188 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:53.247166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6385f5db-a559-4034-b290-f4296639b303 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:53.248549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6385f5db-a559-4034-b290-f4296639b303 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:53.267518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6385f5db-a559-4034-b290-f4296639b303 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:53.268043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6385f5db-a559-4034-b290-f4296639b303 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:53.268507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6385f5db-a559-4034-b290-f4296639b303 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:53.271083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6385f5db-a559-4034-b290-f4296639b303 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:53.274297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6385f5db-a559-4034-b290-f4296639b303 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:53.275970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6385f5db-a559-4034-b290-f4296639b303 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:53.619786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6385f5db-a559-4034-b290-f4296639b303 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:53.644009 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6385f5db-a559-4034-b290-f4296639b303 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.399721 Aug 27 05:29:53.645804 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3098/6195] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:53 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:53.710735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dc0b3ef0-1886-4d14-8408-8655f04e678f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:53.711527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dc0b3ef0-1886-4d14-8408-8655f04e678f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:53.724416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc0b3ef0-1886-4d14-8408-8655f04e678f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:53.725920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc0b3ef0-1886-4d14-8408-8655f04e678f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:53.727301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc0b3ef0-1886-4d14-8408-8655f04e678f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:53.728370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc0b3ef0-1886-4d14-8408-8655f04e678f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:53.730467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc0b3ef0-1886-4d14-8408-8655f04e678f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:53.731491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dc0b3ef0-1886-4d14-8408-8655f04e678f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:53.846825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dc0b3ef0-1886-4d14-8408-8655f04e678f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:53.858414 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dc0b3ef0-1886-4d14-8408-8655f04e678f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1188 microversion: 2.1 time: 0.153888 Aug 27 05:29:53.859652 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3098/6196] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:53 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1188 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:54.684539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3fce645a-e527-48a8-8742-3bda986c0809 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:54.688411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3fce645a-e527-48a8-8742-3bda986c0809 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:54.705665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fce645a-e527-48a8-8742-3bda986c0809 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:54.706506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fce645a-e527-48a8-8742-3bda986c0809 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:54.707213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fce645a-e527-48a8-8742-3bda986c0809 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:54.709321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fce645a-e527-48a8-8742-3bda986c0809 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:54.711890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fce645a-e527-48a8-8742-3bda986c0809 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:54.713107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fce645a-e527-48a8-8742-3bda986c0809 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:54.882680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-953c291b-6e11-4323-87fb-ca238e39e05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:54.884075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-953c291b-6e11-4323-87fb-ca238e39e05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:54.902700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-953c291b-6e11-4323-87fb-ca238e39e05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:54.903397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-953c291b-6e11-4323-87fb-ca238e39e05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:54.905248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-953c291b-6e11-4323-87fb-ca238e39e05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:54.906127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-953c291b-6e11-4323-87fb-ca238e39e05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:54.909491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-953c291b-6e11-4323-87fb-ca238e39e05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:54.910100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-953c291b-6e11-4323-87fb-ca238e39e05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:54.986015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3fce645a-e527-48a8-8742-3bda986c0809 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:54.995997 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3fce645a-e527-48a8-8742-3bda986c0809 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.321701 Aug 27 05:29:55.010721 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3099/6197] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:54 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:55.031461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-953c291b-6e11-4323-87fb-ca238e39e05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:55.040366 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-953c291b-6e11-4323-87fb-ca238e39e05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1188 microversion: 2.1 time: 0.163733 Aug 27 05:29:55.041987 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3099/6198] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:54 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1188 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:56.018784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70e16369-29d2-4ba6-b05d-d6948cebdc55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:56.019731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-70e16369-29d2-4ba6-b05d-d6948cebdc55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:56.025090 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:29:56.025321 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 05:29:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 (ip 10.222.0.58) !!! Aug 27 05:29:56.040462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e16369-29d2-4ba6-b05d-d6948cebdc55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:56.041203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e16369-29d2-4ba6-b05d-d6948cebdc55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:56.041844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e16369-29d2-4ba6-b05d-d6948cebdc55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:56.042756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e16369-29d2-4ba6-b05d-d6948cebdc55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:56.044081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e16369-29d2-4ba6-b05d-d6948cebdc55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:56.044685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70e16369-29d2-4ba6-b05d-d6948cebdc55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:56.074550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:56.076451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:56.084918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:56.086057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:56.086853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:56.088052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:56.090347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:56.091066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:56.133542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:56.134391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:56.135074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:56.136006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lazy-loading 'fault' on Instance uuid 31f598e5-06e2-4066-9b21-b53033cae353 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:29:56.229921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:56.252932 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d29da61-6d9c-43d3-a258-4679f33e153c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 200 len: 1193 microversion: 2.1 time: 0.182760 Aug 27 05:29:56.270868 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3100/6199] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:56 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 1193 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:56.315028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-70e16369-29d2-4ba6-b05d-d6948cebdc55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:56.338075 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70e16369-29d2-4ba6-b05d-d6948cebdc55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.323786 Aug 27 05:29:56.338818 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3100/6200] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:56 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:57.283211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:57.287311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 31f598e5-06e2-4066-9b21-b53033cae353] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:57.301499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:57.305897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:57.309362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:57.310795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:57.311510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:57.312215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:57.332157 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 31f598e5-06e2-4066-9b21-b53033cae353 could not be found. Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 HTTP/1.1 Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 31f598e5-06e2-4066-9b21-b53033cae353 could not be found. Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '31f598e5-06e2-4066-9b21-b53033cae353'} Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f598e5-06e2-4066-9b21-b53033cae353 could not be found. Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f598e5-06e2-4066-9b21-b53033cae353 could not be found. Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:57.334399 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:57.341092 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:57.341092 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:57.341092 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:57.341092 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:57.341092 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:57.341092 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f598e5-06e2-4066-9b21-b53033cae353 could not be found. Aug 27 05:29:57.341092 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:29:57.342675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 31f598e5-06e2-4066-9b21-b53033cae353 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:57.343616 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d8e7a25c-7354-4bb6-99d8-6a3550108466 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353" status: 404 len: 111 microversion: 2.1 time: 0.069633 Aug 27 05:29:57.347745 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3101/6201] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:57 2022] GET /compute/v2.1/servers/31f598e5-06e2-4066-9b21-b53033cae353 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:57.372953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d80e694-df1b-45cc-bf58-96f52fa6037e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:57.375191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d80e694-df1b-45cc-bf58-96f52fa6037e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:57.392452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d80e694-df1b-45cc-bf58-96f52fa6037e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:57.393234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d80e694-df1b-45cc-bf58-96f52fa6037e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:57.393690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d80e694-df1b-45cc-bf58-96f52fa6037e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:57.394513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d80e694-df1b-45cc-bf58-96f52fa6037e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:57.395027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d80e694-df1b-45cc-bf58-96f52fa6037e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:57.395427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d80e694-df1b-45cc-bf58-96f52fa6037e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:57.643618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d80e694-df1b-45cc-bf58-96f52fa6037e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:57.661051 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d80e694-df1b-45cc-bf58-96f52fa6037e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.295472 Aug 27 05:29:57.661990 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3101/6202] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:57 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:58.682719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dda4c9ce-6b25-4492-80a6-9f73a9b98556 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:58.683451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dda4c9ce-6b25-4492-80a6-9f73a9b98556 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:58.708893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dda4c9ce-6b25-4492-80a6-9f73a9b98556 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:58.709618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dda4c9ce-6b25-4492-80a6-9f73a9b98556 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:58.710289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dda4c9ce-6b25-4492-80a6-9f73a9b98556 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:58.711660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dda4c9ce-6b25-4492-80a6-9f73a9b98556 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:58.712343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dda4c9ce-6b25-4492-80a6-9f73a9b98556 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:58.712937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dda4c9ce-6b25-4492-80a6-9f73a9b98556 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:58.952378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dda4c9ce-6b25-4492-80a6-9f73a9b98556 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:58.972823 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dda4c9ce-6b25-4492-80a6-9f73a9b98556 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.293880 Aug 27 05:29:58.974091 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3102/6203] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:58 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:59.999295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f8648104-420e-414c-988a-ce870823b7c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:00.000034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f8648104-420e-414c-988a-ce870823b7c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:00.026126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8648104-420e-414c-988a-ce870823b7c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:00.027959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8648104-420e-414c-988a-ce870823b7c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:00.029389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8648104-420e-414c-988a-ce870823b7c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:00.030318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8648104-420e-414c-988a-ce870823b7c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:00.030901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8648104-420e-414c-988a-ce870823b7c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:00.031506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8648104-420e-414c-988a-ce870823b7c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:00.289969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f8648104-420e-414c-988a-ce870823b7c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:00.300228 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f8648104-420e-414c-988a-ce870823b7c3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.306381 Aug 27 05:30:00.301295 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3102/6204] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:59 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:01.322768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-64542e2e-743a-48ab-8c70-df6039a5f67c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:01.324672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-64542e2e-743a-48ab-8c70-df6039a5f67c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:01.334984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64542e2e-743a-48ab-8c70-df6039a5f67c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:01.336469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64542e2e-743a-48ab-8c70-df6039a5f67c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:01.337315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64542e2e-743a-48ab-8c70-df6039a5f67c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:01.338772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64542e2e-743a-48ab-8c70-df6039a5f67c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:01.340163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64542e2e-743a-48ab-8c70-df6039a5f67c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:01.340977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64542e2e-743a-48ab-8c70-df6039a5f67c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:01.532389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-64542e2e-743a-48ab-8c70-df6039a5f67c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:01.542723 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-64542e2e-743a-48ab-8c70-df6039a5f67c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.223982 Aug 27 05:30:01.544158 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3103/6205] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:01 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:02.570387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4213267a-6771-40b4-bfea-c47ea3f181ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:02.571852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4213267a-6771-40b4-bfea-c47ea3f181ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:02.609662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4213267a-6771-40b4-bfea-c47ea3f181ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:02.610234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4213267a-6771-40b4-bfea-c47ea3f181ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:02.610684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4213267a-6771-40b4-bfea-c47ea3f181ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:02.616795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4213267a-6771-40b4-bfea-c47ea3f181ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:02.622148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4213267a-6771-40b4-bfea-c47ea3f181ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:02.627838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4213267a-6771-40b4-bfea-c47ea3f181ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:02.910556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4213267a-6771-40b4-bfea-c47ea3f181ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:02.936704 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4213267a-6771-40b4-bfea-c47ea3f181ed tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.371635 Aug 27 05:30:02.937352 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3103/6206] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:02 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:03.969055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-63880dd2-44d1-4b90-a393-e9a5097fefaf tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:03.969694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-63880dd2-44d1-4b90-a393-e9a5097fefaf tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:03.990132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63880dd2-44d1-4b90-a393-e9a5097fefaf tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:03.990640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63880dd2-44d1-4b90-a393-e9a5097fefaf tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:03.991147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63880dd2-44d1-4b90-a393-e9a5097fefaf tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:03.991852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63880dd2-44d1-4b90-a393-e9a5097fefaf tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:03.992501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63880dd2-44d1-4b90-a393-e9a5097fefaf tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:03.993118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63880dd2-44d1-4b90-a393-e9a5097fefaf tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:04.052014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:04.264367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-63880dd2-44d1-4b90-a393-e9a5097fefaf tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:04.278432 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-63880dd2-44d1-4b90-a393-e9a5097fefaf tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.312915 Aug 27 05:30:04.286072 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3104/6207] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:03 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:05.307300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f71dbdcd-3251-447a-b59a-267b65b02cd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:05.309796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f71dbdcd-3251-447a-b59a-267b65b02cd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:05.324369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71dbdcd-3251-447a-b59a-267b65b02cd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:05.325897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71dbdcd-3251-447a-b59a-267b65b02cd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:05.326779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71dbdcd-3251-447a-b59a-267b65b02cd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:05.327845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71dbdcd-3251-447a-b59a-267b65b02cd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:05.328820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71dbdcd-3251-447a-b59a-267b65b02cd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:05.329586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f71dbdcd-3251-447a-b59a-267b65b02cd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:05.554458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f71dbdcd-3251-447a-b59a-267b65b02cd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:05.576137 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f71dbdcd-3251-447a-b59a-267b65b02cd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.275284 Aug 27 05:30:05.577710 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3104/6208] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:05 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:06.248074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1637932499", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4da57328-a03e-4507-a689-a8da41fcc790", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "58a22fcb-5b07-4d83-8df1-2b6fed6fe046"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:06.369787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] validate_networks() for [('58a22fcb-5b07-4d83-8df1-2b6fed6fe046', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:30:06.598347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7710a415-72a6-4357-bd26-20930318b74b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:06.598963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7710a415-72a6-4357-bd26-20930318b74b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:06.610695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7710a415-72a6-4357-bd26-20930318b74b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:06.611810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7710a415-72a6-4357-bd26-20930318b74b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:06.614629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7710a415-72a6-4357-bd26-20930318b74b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:06.616632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7710a415-72a6-4357-bd26-20930318b74b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:06.617353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7710a415-72a6-4357-bd26-20930318b74b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:06.618580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7710a415-72a6-4357-bd26-20930318b74b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:07.029849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7710a415-72a6-4357-bd26-20930318b74b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:07.046864 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7710a415-72a6-4357-bd26-20930318b74b tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.452696 Aug 27 05:30:07.063135 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3105/6209] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:06 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:07.122107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:30:07.122562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:30:07.122920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:30:07.123360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:30:07.123817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:30:07.135573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:07.136098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:07.136548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:07.137302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:07.137766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:07.138194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:07.168869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:30:07.180044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for user 007b4762bf8c436fb783d84380c01932 and project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:30:07.258830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:30:07.262202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4da57328-a03e-4507-a689-a8da41fcc790',volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:30:07.477944 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-918f0fb6-e0a0-40a2-b9c9-fa776f4697e3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.237945 Aug 27 05:30:07.479346 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3105/6210] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:30:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:30:07.490743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78401f82-d5a5-4619-8160-f2657edfc31e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:07.491722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-78401f82-d5a5-4619-8160-f2657edfc31e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:07.554533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-78401f82-d5a5-4619-8160-f2657edfc31e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:07.565445 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-78401f82-d5a5-4619-8160-f2657edfc31e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1057 microversion: 2.1 time: 0.078808 Aug 27 05:30:07.566737 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3106/6211] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:07 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1057 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:08.070240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4f4e4bc4-5d35-47a8-89c7-6ae9a69541b5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:08.070869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4f4e4bc4-5d35-47a8-89c7-6ae9a69541b5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:08.083451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f4e4bc4-5d35-47a8-89c7-6ae9a69541b5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:08.084916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f4e4bc4-5d35-47a8-89c7-6ae9a69541b5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:08.085902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f4e4bc4-5d35-47a8-89c7-6ae9a69541b5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:08.086974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f4e4bc4-5d35-47a8-89c7-6ae9a69541b5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:08.087811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f4e4bc4-5d35-47a8-89c7-6ae9a69541b5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:08.088514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f4e4bc4-5d35-47a8-89c7-6ae9a69541b5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:08.318392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4f4e4bc4-5d35-47a8-89c7-6ae9a69541b5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:08.334307 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4f4e4bc4-5d35-47a8-89c7-6ae9a69541b5 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.266125 Aug 27 05:30:08.334307 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3106/6212] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:08 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:08.589803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ca6e7c94-e42e-47c3-905d-b26a00465a56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:08.590421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ca6e7c94-e42e-47c3-905d-b26a00465a56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:08.598894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c94-e42e-47c3-905d-b26a00465a56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:08.599649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c94-e42e-47c3-905d-b26a00465a56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:08.600294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c94-e42e-47c3-905d-b26a00465a56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:08.601202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c94-e42e-47c3-905d-b26a00465a56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:08.601842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c94-e42e-47c3-905d-b26a00465a56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:08.602449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c94-e42e-47c3-905d-b26a00465a56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:08.716068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ca6e7c94-e42e-47c3-905d-b26a00465a56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:08.733536 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ca6e7c94-e42e-47c3-905d-b26a00465a56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1099 microversion: 2.1 time: 0.148917 Aug 27 05:30:08.734651 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3107/6213] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:08 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1099 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:09.358389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b1384367-45f8-4fac-a81e-5b25ba9ad661 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:09.360141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b1384367-45f8-4fac-a81e-5b25ba9ad661 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:09.370040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1384367-45f8-4fac-a81e-5b25ba9ad661 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:09.370558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1384367-45f8-4fac-a81e-5b25ba9ad661 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:09.370956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1384367-45f8-4fac-a81e-5b25ba9ad661 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:09.371919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1384367-45f8-4fac-a81e-5b25ba9ad661 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:09.372694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1384367-45f8-4fac-a81e-5b25ba9ad661 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:09.373291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1384367-45f8-4fac-a81e-5b25ba9ad661 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:09.644503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b1384367-45f8-4fac-a81e-5b25ba9ad661 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:09.674473 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b1384367-45f8-4fac-a81e-5b25ba9ad661 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.320642 Aug 27 05:30:09.675383 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3107/6214] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:09 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:09.759403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e1e52aaa-8e35-4e47-8dba-a0bc729a6007 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:09.760791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e1e52aaa-8e35-4e47-8dba-a0bc729a6007 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:09.773119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e52aaa-8e35-4e47-8dba-a0bc729a6007 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:09.788067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e52aaa-8e35-4e47-8dba-a0bc729a6007 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:09.788637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e52aaa-8e35-4e47-8dba-a0bc729a6007 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:09.790503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e52aaa-8e35-4e47-8dba-a0bc729a6007 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:09.796088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e52aaa-8e35-4e47-8dba-a0bc729a6007 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:09.796850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e1e52aaa-8e35-4e47-8dba-a0bc729a6007 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:09.895580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e1e52aaa-8e35-4e47-8dba-a0bc729a6007 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:09.905893 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e1e52aaa-8e35-4e47-8dba-a0bc729a6007 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1099 microversion: 2.1 time: 0.151777 Aug 27 05:30:09.907080 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3108/6215] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:09 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1099 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:10.696563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-841e8141-7c8e-414c-a0db-c6afa838be2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:10.697194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-841e8141-7c8e-414c-a0db-c6afa838be2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:10.716267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-841e8141-7c8e-414c-a0db-c6afa838be2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:10.716778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-841e8141-7c8e-414c-a0db-c6afa838be2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:10.717226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-841e8141-7c8e-414c-a0db-c6afa838be2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:10.718166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-841e8141-7c8e-414c-a0db-c6afa838be2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:10.718807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-841e8141-7c8e-414c-a0db-c6afa838be2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:10.719484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-841e8141-7c8e-414c-a0db-c6afa838be2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:10.933674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e0a6106-3b8d-41aa-a92f-3e21e07ef94d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:10.934368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9e0a6106-3b8d-41aa-a92f-3e21e07ef94d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:10.960957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e0a6106-3b8d-41aa-a92f-3e21e07ef94d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:10.976959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e0a6106-3b8d-41aa-a92f-3e21e07ef94d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:10.977570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e0a6106-3b8d-41aa-a92f-3e21e07ef94d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:10.978442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e0a6106-3b8d-41aa-a92f-3e21e07ef94d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:10.981400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e0a6106-3b8d-41aa-a92f-3e21e07ef94d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:10.983435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e0a6106-3b8d-41aa-a92f-3e21e07ef94d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:11.100053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-841e8141-7c8e-414c-a0db-c6afa838be2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:11.115628 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-841e8141-7c8e-414c-a0db-c6afa838be2c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1736 microversion: 2.1 time: 0.418805 Aug 27 05:30:11.129794 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3108/6216] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:10 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1736 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:11.141685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9e0a6106-3b8d-41aa-a92f-3e21e07ef94d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:11.151330 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9e0a6106-3b8d-41aa-a92f-3e21e07ef94d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1099 microversion: 2.1 time: 0.223538 Aug 27 05:30:11.153190 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3109/6217] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:10 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1099 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:12.163714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-014d3cb3-c5e6-4068-855a-a7686d140654 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:12.167820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-014d3cb3-c5e6-4068-855a-a7686d140654 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:12.182370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-54d9087c-ea18-43b5-a93f-2d6817d24c90 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:12.188353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-54d9087c-ea18-43b5-a93f-2d6817d24c90 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:12.220658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-014d3cb3-c5e6-4068-855a-a7686d140654 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:12.224743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=54 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:12.226252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-014d3cb3-c5e6-4068-855a-a7686d140654 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:12.227971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-014d3cb3-c5e6-4068-855a-a7686d140654 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:12.231614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-014d3cb3-c5e6-4068-855a-a7686d140654 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:12.232820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54d9087c-ea18-43b5-a93f-2d6817d24c90 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:12.233676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-014d3cb3-c5e6-4068-855a-a7686d140654 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:12.234555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54d9087c-ea18-43b5-a93f-2d6817d24c90 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:12.236065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-014d3cb3-c5e6-4068-855a-a7686d140654 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:12.237277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54d9087c-ea18-43b5-a93f-2d6817d24c90 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:12.240067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54d9087c-ea18-43b5-a93f-2d6817d24c90 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:12.256078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54d9087c-ea18-43b5-a93f-2d6817d24c90 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:12.256938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54d9087c-ea18-43b5-a93f-2d6817d24c90 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:12.837692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-54d9087c-ea18-43b5-a93f-2d6817d24c90 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:12.851003 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-54d9087c-ea18-43b5-a93f-2d6817d24c90 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1173 microversion: 2.1 time: 0.677714 Aug 27 05:30:12.863281 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3110/6218] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:12 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1173 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:12.997356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-014d3cb3-c5e6-4068-855a-a7686d140654 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:13.018314 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-014d3cb3-c5e6-4068-855a-a7686d140654 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1716 microversion: 2.1 time: 0.881965 Aug 27 05:30:13.018957 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3109/6219] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:12 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1716 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:13.253708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:13.254628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:13.263215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:13.263752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:13.264137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:13.279420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:13.279935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:13.280616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:13.476583 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] HTTP exception thrown: Cannot 'detach_volume' instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 while it is in vm_state rescued Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Request method failure captured: Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments/4acb96a5-05b9-495b-8ee4-f5ae107c2065 HTTP/1.1 Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCarXzQEeWD_yg-Yv3x-e6u_WeJK0H4zHIc0K2ifAeEz5lrEXCdSGI--LvFU55RmwGwdxJyIQb1oGJryeM85dpPE-6Bdt7QpTLIjsEre7jimq6F9GiGD3yK_ZjeKRtTqhKCIODh0xkoCo04wlC3mPfhPebArjlTk0PKLudgc3mohZyhg Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_43652021c7e84156955f4bdaf72aabba", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: f80e7dad058f44b9967a5a2f95123a9f Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot 'detach_volume' instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 while it is in vm_state rescued Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'server_id': 'be8bceb6-cc73-4f2e-8858-e02d8fb84f37', 'id': '4acb96a5-05b9-495b-8ee4-f5ae107c2065'} Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 while it is in vm_state rescued Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:30:13.481386 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:13.486632 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:30:13.486632 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:30:13.486632 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:30:13.486632 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:30:13.486632 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 while it is in vm_state rescued Aug 27 05:30:13.486632 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:30:13.486632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Returning 409 to user: Cannot 'detach_volume' instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 while it is in vm_state rescued {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:30:13.488100 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ce7ff04-4392-40a6-b1c6-ebe989ec6517 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments/4acb96a5-05b9-495b-8ee4-f5ae107c2065" status: 409 len: 152 microversion: 2.1 time: 0.240131 Aug 27 05:30:13.491782 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3111/6220] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:30:13 2022] DELETE /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments/4acb96a5-05b9-495b-8ee4-f5ae107c2065 => generated 152 bytes in 243 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:30:13.499775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bc8d05b2-95c0-458f-901a-d905c4951424 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:13.500323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bc8d05b2-95c0-458f-901a-d905c4951424 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:13.509261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc8d05b2-95c0-458f-901a-d905c4951424 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:13.509760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc8d05b2-95c0-458f-901a-d905c4951424 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:13.510205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc8d05b2-95c0-458f-901a-d905c4951424 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:13.511040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc8d05b2-95c0-458f-901a-d905c4951424 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:13.511533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc8d05b2-95c0-458f-901a-d905c4951424 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:13.511960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc8d05b2-95c0-458f-901a-d905c4951424 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:13.621298 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bc8d05b2-95c0-458f-901a-d905c4951424 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/action" status: 202 len: 0 microversion: 2.1 time: 0.124390 Aug 27 05:30:13.622430 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3110/6221] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:30:13 2022] POST /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:30:13.638372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-36d80781-2359-4a01-864e-9a45372ef5e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:13.639580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-36d80781-2359-4a01-864e-9a45372ef5e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:13.647896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36d80781-2359-4a01-864e-9a45372ef5e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:13.648690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36d80781-2359-4a01-864e-9a45372ef5e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:13.650310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36d80781-2359-4a01-864e-9a45372ef5e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:13.652311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36d80781-2359-4a01-864e-9a45372ef5e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:13.653210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36d80781-2359-4a01-864e-9a45372ef5e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:13.653836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36d80781-2359-4a01-864e-9a45372ef5e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:13.875259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9e9cb05-e7ac-4983-94fc-044da91ce0a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:13.875794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9e9cb05-e7ac-4983-94fc-044da91ce0a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:13.891598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9e9cb05-e7ac-4983-94fc-044da91ce0a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:13.898401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9e9cb05-e7ac-4983-94fc-044da91ce0a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:13.899438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9e9cb05-e7ac-4983-94fc-044da91ce0a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:13.900370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9e9cb05-e7ac-4983-94fc-044da91ce0a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:13.901007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9e9cb05-e7ac-4983-94fc-044da91ce0a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:13.902378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9e9cb05-e7ac-4983-94fc-044da91ce0a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:14.227162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-36d80781-2359-4a01-864e-9a45372ef5e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:14.250179 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-36d80781-2359-4a01-864e-9a45372ef5e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1724 microversion: 2.1 time: 0.621176 Aug 27 05:30:14.253112 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3112/6222] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:13 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1724 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:14.650265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f9e9cb05-e7ac-4983-94fc-044da91ce0a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:14.678284 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9e9cb05-e7ac-4983-94fc-044da91ce0a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1215 microversion: 2.1 time: 0.807827 Aug 27 05:30:14.697132 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3111/6223] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:13 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1215 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:15.274292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-005085e9-e787-47f4-bb9e-c96f754720c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:15.274905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-005085e9-e787-47f4-bb9e-c96f754720c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:15.299417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-005085e9-e787-47f4-bb9e-c96f754720c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:15.300070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-005085e9-e787-47f4-bb9e-c96f754720c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:15.300536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-005085e9-e787-47f4-bb9e-c96f754720c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:15.304369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-005085e9-e787-47f4-bb9e-c96f754720c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:15.304937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-005085e9-e787-47f4-bb9e-c96f754720c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:15.305285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-005085e9-e787-47f4-bb9e-c96f754720c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:15.319839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:15.636101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-005085e9-e787-47f4-bb9e-c96f754720c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:15.648967 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-005085e9-e787-47f4-bb9e-c96f754720c1 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1724 microversion: 2.1 time: 0.378684 Aug 27 05:30:15.652838 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3113/6224] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:15 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:15.727701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd2490a0-3221-41d0-ad85-045c3194f192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:15.728329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd2490a0-3221-41d0-ad85-045c3194f192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:15.731815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:15.748495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd2490a0-3221-41d0-ad85-045c3194f192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:15.749692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd2490a0-3221-41d0-ad85-045c3194f192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:15.751457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd2490a0-3221-41d0-ad85-045c3194f192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:15.753527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd2490a0-3221-41d0-ad85-045c3194f192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:15.756281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd2490a0-3221-41d0-ad85-045c3194f192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:15.757908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd2490a0-3221-41d0-ad85-045c3194f192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:16.012242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dd2490a0-3221-41d0-ad85-045c3194f192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:16.021348 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd2490a0-3221-41d0-ad85-045c3194f192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1215 microversion: 2.1 time: 0.299202 Aug 27 05:30:16.025378 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3112/6225] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:15 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1215 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:16.320478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-30e4cb35-b176-48ed-9e83-f5a4c276408b req-45a17442-0a78-4c49-aab2-27cce827943f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "279d0af1-f822-4315-a8bb-065114b8016b", "tag": "32f8d6b4-6589-4ab0-9ff9-b9dab19c0cce"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:16.338032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-30e4cb35-b176-48ed-9e83-f5a4c276408b req-45a17442-0a78-4c49-aab2-27cce827943f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:16.338513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-30e4cb35-b176-48ed-9e83-f5a4c276408b req-45a17442-0a78-4c49-aab2-27cce827943f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:16.342509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-30e4cb35-b176-48ed-9e83-f5a4c276408b req-45a17442-0a78-4c49-aab2-27cce827943f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:16.373241 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-30e4cb35-b176-48ed-9e83-f5a4c276408b req-45a17442-0a78-4c49-aab2-27cce827943f service nova] Creating event network-changed:32f8d6b4-6589-4ab0-9ff9-b9dab19c0cce for instance 279d0af1-f822-4315-a8bb-065114b8016b on n-h1-820368-35 Aug 27 05:30:16.385622 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-30e4cb35-b176-48ed-9e83-f5a4c276408b req-45a17442-0a78-4c49-aab2-27cce827943f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069145 Aug 27 05:30:16.387356 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3114/6226] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:16.676336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-30c86de8-cd28-48f9-96a4-ff79e8d5e2c2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:16.677019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-30c86de8-cd28-48f9-96a4-ff79e8d5e2c2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:16.692594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30c86de8-cd28-48f9-96a4-ff79e8d5e2c2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:16.693253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30c86de8-cd28-48f9-96a4-ff79e8d5e2c2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:16.693725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30c86de8-cd28-48f9-96a4-ff79e8d5e2c2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:16.697300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30c86de8-cd28-48f9-96a4-ff79e8d5e2c2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:16.697793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30c86de8-cd28-48f9-96a4-ff79e8d5e2c2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:16.698283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30c86de8-cd28-48f9-96a4-ff79e8d5e2c2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:17.047454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d2d4f795-1b5c-45a6-9d93-b6b361b1df9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:17.058421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d2d4f795-1b5c-45a6-9d93-b6b361b1df9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:17.071995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2d4f795-1b5c-45a6-9d93-b6b361b1df9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:17.075877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2d4f795-1b5c-45a6-9d93-b6b361b1df9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:17.078797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2d4f795-1b5c-45a6-9d93-b6b361b1df9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:17.079779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2d4f795-1b5c-45a6-9d93-b6b361b1df9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:17.080406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2d4f795-1b5c-45a6-9d93-b6b361b1df9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:17.089686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2d4f795-1b5c-45a6-9d93-b6b361b1df9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:17.120237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-30c86de8-cd28-48f9-96a4-ff79e8d5e2c2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:17.136338 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-30c86de8-cd28-48f9-96a4-ff79e8d5e2c2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1724 microversion: 2.1 time: 0.467738 Aug 27 05:30:17.141581 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3113/6227] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:16 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1724 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:17.561933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:17.712371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d2d4f795-1b5c-45a6-9d93-b6b361b1df9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:17.726459 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d2d4f795-1b5c-45a6-9d93-b6b361b1df9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1215 microversion: 2.1 time: 0.684232 Aug 27 05:30:17.743242 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3115/6228] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:17 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1215 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:18.162739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb5aa1ad-b54a-4f66-8143-8f10396f00fd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:18.163632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bb5aa1ad-b54a-4f66-8143-8f10396f00fd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:18.174935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:18.176127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:18.184903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb5aa1ad-b54a-4f66-8143-8f10396f00fd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:18.186586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb5aa1ad-b54a-4f66-8143-8f10396f00fd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:18.187598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb5aa1ad-b54a-4f66-8143-8f10396f00fd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:18.189319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb5aa1ad-b54a-4f66-8143-8f10396f00fd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:18.192321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb5aa1ad-b54a-4f66-8143-8f10396f00fd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:18.193783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb5aa1ad-b54a-4f66-8143-8f10396f00fd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:18.609754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb5aa1ad-b54a-4f66-8143-8f10396f00fd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:18.621072 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb5aa1ad-b54a-4f66-8143-8f10396f00fd tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1730 microversion: 2.1 time: 0.463027 Aug 27 05:30:18.622153 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3114/6229] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:18 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1730 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:18.646628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c5c2c4d-6833-4a36-af93-694e5b45532e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:18.648800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c5c2c4d-6833-4a36-af93-694e5b45532e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:18.672066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c5c2c4d-6833-4a36-af93-694e5b45532e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:18.675577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c5c2c4d-6833-4a36-af93-694e5b45532e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:18.677397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c5c2c4d-6833-4a36-af93-694e5b45532e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:18.680858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c5c2c4d-6833-4a36-af93-694e5b45532e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:18.681970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c5c2c4d-6833-4a36-af93-694e5b45532e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:18.684283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c5c2c4d-6833-4a36-af93-694e5b45532e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:18.760246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ef4232aa-9251-41cf-90a6-314621a272c0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:18.769703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ef4232aa-9251-41cf-90a6-314621a272c0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:18.793337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef4232aa-9251-41cf-90a6-314621a272c0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:18.793847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef4232aa-9251-41cf-90a6-314621a272c0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:18.795329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef4232aa-9251-41cf-90a6-314621a272c0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:18.857782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef4232aa-9251-41cf-90a6-314621a272c0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:18.861909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef4232aa-9251-41cf-90a6-314621a272c0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:18.876285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ef4232aa-9251-41cf-90a6-314621a272c0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:18.933646 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c5c2c4d-6833-4a36-af93-694e5b45532e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.293078 Aug 27 05:30:18.934455 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3116/6230] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:30:18 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-interface => generated 285 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:19.270467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ef4232aa-9251-41cf-90a6-314621a272c0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:19.281772 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ef4232aa-9251-41cf-90a6-314621a272c0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1215 microversion: 2.1 time: 0.535315 Aug 27 05:30:19.296442 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3115/6231] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:18 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1215 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:20.311370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e553e18-983c-4163-a75f-fecb8b685d59 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:20.312532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e553e18-983c-4163-a75f-fecb8b685d59 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:20.330412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e553e18-983c-4163-a75f-fecb8b685d59 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:20.331139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e553e18-983c-4163-a75f-fecb8b685d59 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:20.345869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e553e18-983c-4163-a75f-fecb8b685d59 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:20.346905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e553e18-983c-4163-a75f-fecb8b685d59 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:20.363274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e553e18-983c-4163-a75f-fecb8b685d59 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:20.364307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e553e18-983c-4163-a75f-fecb8b685d59 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:20.864401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c4b4c96a-ad11-4af5-81dd-4a5812f64254 req-0c1460ac-b804-4852-b436-c49b98deb8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8bceb6-cc73-4f2e-8858-e02d8fb84f37", "tag": "c7190bb7-8036-47e7-83f7-27efbe7164a7"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:20.876753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c4b4c96a-ad11-4af5-81dd-4a5812f64254 req-0c1460ac-b804-4852-b436-c49b98deb8e6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:20.877415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c4b4c96a-ad11-4af5-81dd-4a5812f64254 req-0c1460ac-b804-4852-b436-c49b98deb8e6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:20.877994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c4b4c96a-ad11-4af5-81dd-4a5812f64254 req-0c1460ac-b804-4852-b436-c49b98deb8e6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:20.903870 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c4b4c96a-ad11-4af5-81dd-4a5812f64254 req-0c1460ac-b804-4852-b436-c49b98deb8e6 service nova] Creating event network-changed:c7190bb7-8036-47e7-83f7-27efbe7164a7 for instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 on n-h1-820368-35 Aug 27 05:30:20.920966 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c4b4c96a-ad11-4af5-81dd-4a5812f64254 req-0c1460ac-b804-4852-b436-c49b98deb8e6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060742 Aug 27 05:30:20.921632 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3116/6232] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:20.979240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e553e18-983c-4163-a75f-fecb8b685d59 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:20.990132 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e553e18-983c-4163-a75f-fecb8b685d59 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1215 microversion: 2.1 time: 0.684355 Aug 27 05:30:20.990734 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3117/6233] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:20 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1215 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:22.021376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ab9165a-441a-4d77-a1dc-f65ec07b2bca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:22.023347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6ab9165a-441a-4d77-a1dc-f65ec07b2bca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:22.040491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab9165a-441a-4d77-a1dc-f65ec07b2bca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:22.052792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab9165a-441a-4d77-a1dc-f65ec07b2bca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:22.055816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab9165a-441a-4d77-a1dc-f65ec07b2bca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:22.060837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab9165a-441a-4d77-a1dc-f65ec07b2bca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:22.061591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab9165a-441a-4d77-a1dc-f65ec07b2bca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:22.063467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab9165a-441a-4d77-a1dc-f65ec07b2bca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:22.369563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6ab9165a-441a-4d77-a1dc-f65ec07b2bca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:22.384971 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6ab9165a-441a-4d77-a1dc-f65ec07b2bca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1215 microversion: 2.1 time: 0.369778 Aug 27 05:30:22.389373 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3117/6234] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:22 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1215 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:22.947555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1d1615a0-57a9-41ce-a54e-b066f73994cd req-4fe7462c-d160-4a77-98b0-62bdc80ab62a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8bceb6-cc73-4f2e-8858-e02d8fb84f37", "tag": "c7190bb7-8036-47e7-83f7-27efbe7164a7"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:22.969023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1d1615a0-57a9-41ce-a54e-b066f73994cd req-4fe7462c-d160-4a77-98b0-62bdc80ab62a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:22.970182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1d1615a0-57a9-41ce-a54e-b066f73994cd req-4fe7462c-d160-4a77-98b0-62bdc80ab62a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:22.971228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1d1615a0-57a9-41ce-a54e-b066f73994cd req-4fe7462c-d160-4a77-98b0-62bdc80ab62a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:23.008657 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1d1615a0-57a9-41ce-a54e-b066f73994cd req-4fe7462c-d160-4a77-98b0-62bdc80ab62a service nova] Creating event network-changed:c7190bb7-8036-47e7-83f7-27efbe7164a7 for instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 on n-h1-820368-35 Aug 27 05:30:23.013800 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1d1615a0-57a9-41ce-a54e-b066f73994cd req-4fe7462c-d160-4a77-98b0-62bdc80ab62a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069748 Aug 27 05:30:23.013800 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3118/6235] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:23.413889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db809b4a-bb65-41f9-b836-e428fc6187c5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:23.414595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-db809b4a-bb65-41f9-b836-e428fc6187c5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:23.423729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db809b4a-bb65-41f9-b836-e428fc6187c5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:23.424500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db809b4a-bb65-41f9-b836-e428fc6187c5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:23.425513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db809b4a-bb65-41f9-b836-e428fc6187c5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:23.426406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db809b4a-bb65-41f9-b836-e428fc6187c5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:23.427037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db809b4a-bb65-41f9-b836-e428fc6187c5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:23.428262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db809b4a-bb65-41f9-b836-e428fc6187c5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:23.691641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-db809b4a-bb65-41f9-b836-e428fc6187c5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:23.735858 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db809b4a-bb65-41f9-b836-e428fc6187c5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1203 microversion: 2.1 time: 0.324697 Aug 27 05:30:23.737796 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3118/6236] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:23 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1203 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:24.775597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2861e4c2-e533-4395-b774-388cfb24a42b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:24.777986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2861e4c2-e533-4395-b774-388cfb24a42b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:24.810741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2861e4c2-e533-4395-b774-388cfb24a42b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:24.826621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2861e4c2-e533-4395-b774-388cfb24a42b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:24.827831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2861e4c2-e533-4395-b774-388cfb24a42b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:24.831383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2861e4c2-e533-4395-b774-388cfb24a42b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:24.832465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2861e4c2-e533-4395-b774-388cfb24a42b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:24.834564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2861e4c2-e533-4395-b774-388cfb24a42b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:25.303235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2861e4c2-e533-4395-b774-388cfb24a42b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:25.335638 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2861e4c2-e533-4395-b774-388cfb24a42b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1203 microversion: 2.1 time: 0.565974 Aug 27 05:30:25.343147 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3119/6237] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:24 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1203 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:26.365506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a16e1123-7e66-4b8c-8d73-4b73613b6fb1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:26.367019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a16e1123-7e66-4b8c-8d73-4b73613b6fb1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:26.379547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a16e1123-7e66-4b8c-8d73-4b73613b6fb1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:26.380384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a16e1123-7e66-4b8c-8d73-4b73613b6fb1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:26.381031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a16e1123-7e66-4b8c-8d73-4b73613b6fb1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:26.382379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a16e1123-7e66-4b8c-8d73-4b73613b6fb1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:26.383100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a16e1123-7e66-4b8c-8d73-4b73613b6fb1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:26.383923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a16e1123-7e66-4b8c-8d73-4b73613b6fb1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:26.745199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6fac6e41-411f-4293-816e-5be0d5d48526 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:26.746179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6fac6e41-411f-4293-816e-5be0d5d48526 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:26.750569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a16e1123-7e66-4b8c-8d73-4b73613b6fb1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:26.769530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fac6e41-411f-4293-816e-5be0d5d48526 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:26.771237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fac6e41-411f-4293-816e-5be0d5d48526 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:26.771998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fac6e41-411f-4293-816e-5be0d5d48526 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:26.772125 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a16e1123-7e66-4b8c-8d73-4b73613b6fb1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1203 microversion: 2.1 time: 0.410292 Aug 27 05:30:26.772642 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3119/6238] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:26 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1203 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:26.787880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fac6e41-411f-4293-816e-5be0d5d48526 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:26.789090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fac6e41-411f-4293-816e-5be0d5d48526 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:26.789710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fac6e41-411f-4293-816e-5be0d5d48526 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:26.846887 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6fac6e41-411f-4293-816e-5be0d5d48526 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/ips" status: 200 len: 145 microversion: 2.1 time: 0.107002 Aug 27 05:30:26.852091 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3120/6239] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:30:26 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/ips => generated 145 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:27.800420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b2f5f8c7-3970-4c1a-b0f1-00012f8a0e34 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:27.800420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b2f5f8c7-3970-4c1a-b0f1-00012f8a0e34 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:27.813337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5f8c7-3970-4c1a-b0f1-00012f8a0e34 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:27.813900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5f8c7-3970-4c1a-b0f1-00012f8a0e34 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:27.818299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5f8c7-3970-4c1a-b0f1-00012f8a0e34 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:27.819284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5f8c7-3970-4c1a-b0f1-00012f8a0e34 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:27.819780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5f8c7-3970-4c1a-b0f1-00012f8a0e34 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:27.820245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b2f5f8c7-3970-4c1a-b0f1-00012f8a0e34 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:28.197677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b2f5f8c7-3970-4c1a-b0f1-00012f8a0e34 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:28.206409 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b2f5f8c7-3970-4c1a-b0f1-00012f8a0e34 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1203 microversion: 2.1 time: 0.416549 Aug 27 05:30:28.207599 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3120/6240] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:27 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1203 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:29.231990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4dd171a5-705a-4e57-b30e-e71094d7cd68 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:29.233295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4dd171a5-705a-4e57-b30e-e71094d7cd68 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:29.248512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dd171a5-705a-4e57-b30e-e71094d7cd68 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:29.250742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dd171a5-705a-4e57-b30e-e71094d7cd68 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:29.251452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dd171a5-705a-4e57-b30e-e71094d7cd68 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:29.254965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dd171a5-705a-4e57-b30e-e71094d7cd68 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:29.255691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dd171a5-705a-4e57-b30e-e71094d7cd68 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:29.256344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dd171a5-705a-4e57-b30e-e71094d7cd68 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:29.582397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4dd171a5-705a-4e57-b30e-e71094d7cd68 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:29.598873 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4dd171a5-705a-4e57-b30e-e71094d7cd68 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1203 microversion: 2.1 time: 0.372640 Aug 27 05:30:29.600927 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3121/6241] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:29 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1203 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:30.392217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-70d55273-0d80-41a5-affc-bad5e2f62624 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61b6452d-e3c5-4a1a-9954-e59cfbe8da9c"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:30.395453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-70d55273-0d80-41a5-affc-bad5e2f62624 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:30.404430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70d55273-0d80-41a5-affc-bad5e2f62624 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:30.405283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70d55273-0d80-41a5-affc-bad5e2f62624 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:30.405933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70d55273-0d80-41a5-affc-bad5e2f62624 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:30.407071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70d55273-0d80-41a5-affc-bad5e2f62624 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:30.408154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70d55273-0d80-41a5-affc-bad5e2f62624 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:30.408882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70d55273-0d80-41a5-affc-bad5e2f62624 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:30.433221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:30.630016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02bc1617-5c50-4a50-9d6d-cc8e09264f41 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:30.631572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-02bc1617-5c50-4a50-9d6d-cc8e09264f41 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:30.646786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02bc1617-5c50-4a50-9d6d-cc8e09264f41 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:30.647795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02bc1617-5c50-4a50-9d6d-cc8e09264f41 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:30.648424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02bc1617-5c50-4a50-9d6d-cc8e09264f41 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:30.649959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02bc1617-5c50-4a50-9d6d-cc8e09264f41 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:30.651357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02bc1617-5c50-4a50-9d6d-cc8e09264f41 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:30.651997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02bc1617-5c50-4a50-9d6d-cc8e09264f41 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:30.874364 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-70d55273-0d80-41a5-affc-bad5e2f62624 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "POST /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486047 Aug 27 05:30:30.895547 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3121/6242] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:30:30 2022] POST /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:30.930442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02bc1617-5c50-4a50-9d6d-cc8e09264f41 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:30.944259 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-02bc1617-5c50-4a50-9d6d-cc8e09264f41 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1203 microversion: 2.1 time: 0.318006 Aug 27 05:30:30.945553 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3122/6243] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:30 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1203 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:31.967657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65c61f16-0b78-4ee1-ae54-f74e851dc2a7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:31.969341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-65c61f16-0b78-4ee1-ae54-f74e851dc2a7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:31.981605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65c61f16-0b78-4ee1-ae54-f74e851dc2a7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:31.986418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65c61f16-0b78-4ee1-ae54-f74e851dc2a7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:31.989131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65c61f16-0b78-4ee1-ae54-f74e851dc2a7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:31.990109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65c61f16-0b78-4ee1-ae54-f74e851dc2a7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:31.990745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65c61f16-0b78-4ee1-ae54-f74e851dc2a7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:31.991352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65c61f16-0b78-4ee1-ae54-f74e851dc2a7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:32.278565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-65c61f16-0b78-4ee1-ae54-f74e851dc2a7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:32.289478 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-65c61f16-0b78-4ee1-ae54-f74e851dc2a7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1203 microversion: 2.1 time: 0.326524 Aug 27 05:30:32.290575 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3122/6244] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:31 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1203 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:33.329078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e2876e8c-a132-45b3-bc5d-11f2d80ae4df tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:33.331181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e2876e8c-a132-45b3-bc5d-11f2d80ae4df tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:33.340483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2876e8c-a132-45b3-bc5d-11f2d80ae4df tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:33.343109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2876e8c-a132-45b3-bc5d-11f2d80ae4df tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:33.343579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2876e8c-a132-45b3-bc5d-11f2d80ae4df tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:33.346352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2876e8c-a132-45b3-bc5d-11f2d80ae4df tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:33.346835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2876e8c-a132-45b3-bc5d-11f2d80ae4df tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:33.347925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e2876e8c-a132-45b3-bc5d-11f2d80ae4df tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:33.633182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e2876e8c-a132-45b3-bc5d-11f2d80ae4df tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:33.653381 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e2876e8c-a132-45b3-bc5d-11f2d80ae4df tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1203 microversion: 2.1 time: 0.336974 Aug 27 05:30:33.658444 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3123/6245] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:33 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1203 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:34.120272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f44f4ec5-d366-4343-b6a0-66776d2e858f req-9edbe5bb-714a-40ac-9027-9c7673cdc5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279d0af1-f822-4315-a8bb-065114b8016b", "name": "network-vif-plugged", "status": "completed", "tag": "32f8d6b4-6589-4ab0-9ff9-b9dab19c0cce"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:34.141423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f44f4ec5-d366-4343-b6a0-66776d2e858f req-9edbe5bb-714a-40ac-9027-9c7673cdc5af service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:34.141928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f44f4ec5-d366-4343-b6a0-66776d2e858f req-9edbe5bb-714a-40ac-9027-9c7673cdc5af service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:34.142377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f44f4ec5-d366-4343-b6a0-66776d2e858f req-9edbe5bb-714a-40ac-9027-9c7673cdc5af service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:34.174790 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f44f4ec5-d366-4343-b6a0-66776d2e858f req-9edbe5bb-714a-40ac-9027-9c7673cdc5af service nova] Creating event network-vif-plugged:32f8d6b4-6589-4ab0-9ff9-b9dab19c0cce for instance 279d0af1-f822-4315-a8bb-065114b8016b on n-h1-820368-35 Aug 27 05:30:34.186796 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f44f4ec5-d366-4343-b6a0-66776d2e858f req-9edbe5bb-714a-40ac-9027-9c7673cdc5af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070835 Aug 27 05:30:34.190036 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3123/6246] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:34.681476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c40cf501-c259-4cd5-8207-0a19709835b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:34.682754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c40cf501-c259-4cd5-8207-0a19709835b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:34.695754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c40cf501-c259-4cd5-8207-0a19709835b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:34.696328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c40cf501-c259-4cd5-8207-0a19709835b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:34.696836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c40cf501-c259-4cd5-8207-0a19709835b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:34.707824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c40cf501-c259-4cd5-8207-0a19709835b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:34.708398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c40cf501-c259-4cd5-8207-0a19709835b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:34.708910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c40cf501-c259-4cd5-8207-0a19709835b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:34.951076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c40cf501-c259-4cd5-8207-0a19709835b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:34.962354 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c40cf501-c259-4cd5-8207-0a19709835b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1203 microversion: 2.1 time: 0.286629 Aug 27 05:30:34.964256 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3124/6247] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:34 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1203 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:35.987835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fb939fc1-9bed-49fc-a127-d3b186980f36 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:35.988626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fb939fc1-9bed-49fc-a127-d3b186980f36 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:36.002481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb939fc1-9bed-49fc-a127-d3b186980f36 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:36.006861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb939fc1-9bed-49fc-a127-d3b186980f36 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:36.007539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb939fc1-9bed-49fc-a127-d3b186980f36 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:36.008513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb939fc1-9bed-49fc-a127-d3b186980f36 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:36.009160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb939fc1-9bed-49fc-a127-d3b186980f36 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:36.009797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb939fc1-9bed-49fc-a127-d3b186980f36 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:36.227977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fb939fc1-9bed-49fc-a127-d3b186980f36 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:36.272148 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fb939fc1-9bed-49fc-a127-d3b186980f36 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1203 microversion: 2.1 time: 0.290123 Aug 27 05:30:36.288855 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3124/6248] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:35 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1203 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:37.298560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2c2dc427-e6b8-44ca-90f0-7e96e7759a31 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:37.299478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2c2dc427-e6b8-44ca-90f0-7e96e7759a31 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:37.312476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c2dc427-e6b8-44ca-90f0-7e96e7759a31 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:37.316534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c2dc427-e6b8-44ca-90f0-7e96e7759a31 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:37.317300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c2dc427-e6b8-44ca-90f0-7e96e7759a31 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:37.319398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c2dc427-e6b8-44ca-90f0-7e96e7759a31 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:37.320650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c2dc427-e6b8-44ca-90f0-7e96e7759a31 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:37.323689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c2dc427-e6b8-44ca-90f0-7e96e7759a31 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:37.866181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2c2dc427-e6b8-44ca-90f0-7e96e7759a31 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:37.887288 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2c2dc427-e6b8-44ca-90f0-7e96e7759a31 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1391 microversion: 2.1 time: 0.594313 Aug 27 05:30:37.899448 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3125/6249] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:37 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1391 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:37.918651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-43bc5174-b119-4aff-bd34-94ba69e66e56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:37.921190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-43bc5174-b119-4aff-bd34-94ba69e66e56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:37.937332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43bc5174-b119-4aff-bd34-94ba69e66e56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:37.944242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43bc5174-b119-4aff-bd34-94ba69e66e56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:37.945126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43bc5174-b119-4aff-bd34-94ba69e66e56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:37.947059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43bc5174-b119-4aff-bd34-94ba69e66e56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:37.948551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43bc5174-b119-4aff-bd34-94ba69e66e56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:37.949306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43bc5174-b119-4aff-bd34-94ba69e66e56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:38.387787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-43bc5174-b119-4aff-bd34-94ba69e66e56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:38.409645 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-43bc5174-b119-4aff-bd34-94ba69e66e56 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1391 microversion: 2.1 time: 0.499757 Aug 27 05:30:38.432258 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3125/6250] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:37 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1391 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:38.451933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5057b8e3-f74f-449a-b860-c1eeb363044b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:38.453180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5057b8e3-f74f-449a-b860-c1eeb363044b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:38.463147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5057b8e3-f74f-449a-b860-c1eeb363044b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:38.463906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5057b8e3-f74f-449a-b860-c1eeb363044b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:38.464531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5057b8e3-f74f-449a-b860-c1eeb363044b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:38.465457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5057b8e3-f74f-449a-b860-c1eeb363044b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:38.466066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5057b8e3-f74f-449a-b860-c1eeb363044b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:38.466648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5057b8e3-f74f-449a-b860-c1eeb363044b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:38.895486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5057b8e3-f74f-449a-b860-c1eeb363044b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:38.904438 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5057b8e3-f74f-449a-b860-c1eeb363044b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1391 microversion: 2.1 time: 0.456832 Aug 27 05:30:38.925420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6238c8db-6a5c-4c77-9b45-94b6067f6d02 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:38.926483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6238c8db-6a5c-4c77-9b45-94b6067f6d02 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:38.945633 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3126/6251] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:38 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1391 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:38.950581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6238c8db-6a5c-4c77-9b45-94b6067f6d02 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:38.951326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6238c8db-6a5c-4c77-9b45-94b6067f6d02 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:38.951924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6238c8db-6a5c-4c77-9b45-94b6067f6d02 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:38.958279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6238c8db-6a5c-4c77-9b45-94b6067f6d02 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:38.958919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6238c8db-6a5c-4c77-9b45-94b6067f6d02 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:38.959540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6238c8db-6a5c-4c77-9b45-94b6067f6d02 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:39.027731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6238c8db-6a5c-4c77-9b45-94b6067f6d02 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:30:39.313603 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6238c8db-6a5c-4c77-9b45-94b6067f6d02 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 204 len: 0 microversion: 2.1 time: 0.390183 Aug 27 05:30:39.316120 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3126/6252] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:30:38 2022] DELETE /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:30:39.325199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b1a47b9-4499-4350-aeb1-2e035b040df7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:39.326604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3b1a47b9-4499-4350-aeb1-2e035b040df7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:39.333600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b1a47b9-4499-4350-aeb1-2e035b040df7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:39.334314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b1a47b9-4499-4350-aeb1-2e035b040df7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:39.334991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b1a47b9-4499-4350-aeb1-2e035b040df7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:39.336000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b1a47b9-4499-4350-aeb1-2e035b040df7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:39.336936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b1a47b9-4499-4350-aeb1-2e035b040df7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:39.337895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b1a47b9-4499-4350-aeb1-2e035b040df7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:39.871914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3b1a47b9-4499-4350-aeb1-2e035b040df7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:39.881767 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3b1a47b9-4499-4350-aeb1-2e035b040df7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1397 microversion: 2.1 time: 0.560596 Aug 27 05:30:39.882365 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3127/6253] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:39 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1397 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:40.920737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d6de96d0-db37-4477-87ff-e443a89a53bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:40.921480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d6de96d0-db37-4477-87ff-e443a89a53bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:40.929478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6de96d0-db37-4477-87ff-e443a89a53bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:40.929982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6de96d0-db37-4477-87ff-e443a89a53bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:40.930436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6de96d0-db37-4477-87ff-e443a89a53bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:40.931265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6de96d0-db37-4477-87ff-e443a89a53bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:40.932281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6de96d0-db37-4477-87ff-e443a89a53bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:40.932768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6de96d0-db37-4477-87ff-e443a89a53bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:41.330683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d6de96d0-db37-4477-87ff-e443a89a53bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:41.350996 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d6de96d0-db37-4477-87ff-e443a89a53bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1397 microversion: 2.1 time: 0.435983 Aug 27 05:30:41.369877 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3127/6254] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:40 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1397 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:42.395222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7359387d-babb-481f-a907-536482ebe360 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:42.396433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-4cad02b4-2e0d-449e-ad7c-2d22150c051f req-6e9b5bf5-da9d-4d6f-a7ed-13aca14aeb63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279d0af1-f822-4315-a8bb-065114b8016b", "name": "network-vif-deleted", "tag": "32f8d6b4-6589-4ab0-9ff9-b9dab19c0cce"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:42.397229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7359387d-babb-481f-a907-536482ebe360 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:42.424577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=36 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:42.429965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7359387d-babb-481f-a907-536482ebe360 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:42.430866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4cad02b4-2e0d-449e-ad7c-2d22150c051f req-6e9b5bf5-da9d-4d6f-a7ed-13aca14aeb63 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:42.431985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4cad02b4-2e0d-449e-ad7c-2d22150c051f req-6e9b5bf5-da9d-4d6f-a7ed-13aca14aeb63 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:42.436318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4cad02b4-2e0d-449e-ad7c-2d22150c051f req-6e9b5bf5-da9d-4d6f-a7ed-13aca14aeb63 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:42.437566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7359387d-babb-481f-a907-536482ebe360 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:42.438212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7359387d-babb-481f-a907-536482ebe360 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:42.439153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7359387d-babb-481f-a907-536482ebe360 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:42.439914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7359387d-babb-481f-a907-536482ebe360 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:42.440503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7359387d-babb-481f-a907-536482ebe360 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:42.463989 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-4cad02b4-2e0d-449e-ad7c-2d22150c051f req-6e9b5bf5-da9d-4d6f-a7ed-13aca14aeb63 service nova] Creating event network-vif-deleted:32f8d6b4-6589-4ab0-9ff9-b9dab19c0cce for instance 279d0af1-f822-4315-a8bb-065114b8016b on n-h1-820368-35 Aug 27 05:30:42.470841 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-4cad02b4-2e0d-449e-ad7c-2d22150c051f req-6e9b5bf5-da9d-4d6f-a7ed-13aca14aeb63 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080179 Aug 27 05:30:42.475251 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3128/6255] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:42.700192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7359387d-babb-481f-a907-536482ebe360 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:42.721496 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7359387d-babb-481f-a907-536482ebe360 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1188 microversion: 2.1 time: 0.331326 Aug 27 05:30:42.722935 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3128/6256] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:42 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:43.749027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-195a4ca8-df45-4314-a2e4-234e750ddb0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:43.763438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-195a4ca8-df45-4314-a2e4-234e750ddb0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:43.772072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-195a4ca8-df45-4314-a2e4-234e750ddb0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:43.772885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-195a4ca8-df45-4314-a2e4-234e750ddb0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:43.773516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-195a4ca8-df45-4314-a2e4-234e750ddb0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:43.774483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-195a4ca8-df45-4314-a2e4-234e750ddb0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:43.775210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-195a4ca8-df45-4314-a2e4-234e750ddb0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:43.775932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-195a4ca8-df45-4314-a2e4-234e750ddb0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:43.942925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-195a4ca8-df45-4314-a2e4-234e750ddb0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:43.952719 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-195a4ca8-df45-4314-a2e4-234e750ddb0b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1188 microversion: 2.1 time: 0.210231 Aug 27 05:30:43.966769 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3129/6257] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:43 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1188 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:44.975431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba93b0f1-81e8-420c-b125-d4df46b84416 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:44.976069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba93b0f1-81e8-420c-b125-d4df46b84416 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:44.994923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba93b0f1-81e8-420c-b125-d4df46b84416 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:44.995576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba93b0f1-81e8-420c-b125-d4df46b84416 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:44.996104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba93b0f1-81e8-420c-b125-d4df46b84416 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:44.997016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba93b0f1-81e8-420c-b125-d4df46b84416 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:44.997560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba93b0f1-81e8-420c-b125-d4df46b84416 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:44.998072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba93b0f1-81e8-420c-b125-d4df46b84416 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:45.155827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ba93b0f1-81e8-420c-b125-d4df46b84416 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:45.175749 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba93b0f1-81e8-420c-b125-d4df46b84416 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1188 microversion: 2.1 time: 0.204419 Aug 27 05:30:45.177359 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3129/6258] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:44 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1188 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:45.841877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ad3c8d2-de4b-4d28-b618-3500818a0f0b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:45.852374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ad3c8d2-de4b-4d28-b618-3500818a0f0b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:45.853648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ad3c8d2-de4b-4d28-b618-3500818a0f0b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:45.854246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ad3c8d2-de4b-4d28-b618-3500818a0f0b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:45.880043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=86 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:45.884694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5ad3c8d2-de4b-4d28-b618-3500818a0f0b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Going to try to stop instance {{(pid=128548) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:30:45.980593 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5ad3c8d2-de4b-4d28-b618-3500818a0f0b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "POST /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.141738 Aug 27 05:30:45.985770 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3130/6259] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:30:45 2022] POST /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:30:45.990778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-048807f7-bb9a-4cbe-b361-a66979e069ca tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:45.991558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-048807f7-bb9a-4cbe-b361-a66979e069ca tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:45.995217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:46.008816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-048807f7-bb9a-4cbe-b361-a66979e069ca tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:46.017665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-048807f7-bb9a-4cbe-b361-a66979e069ca tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:46.018451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-048807f7-bb9a-4cbe-b361-a66979e069ca tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:46.019465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-048807f7-bb9a-4cbe-b361-a66979e069ca tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:46.020144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-048807f7-bb9a-4cbe-b361-a66979e069ca tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:46.020810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-048807f7-bb9a-4cbe-b361-a66979e069ca tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:46.200238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a13d6257-f6c7-4f56-b1f3-c59eff412518 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:46.201012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a13d6257-f6c7-4f56-b1f3-c59eff412518 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:46.213225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a13d6257-f6c7-4f56-b1f3-c59eff412518 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:46.213862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a13d6257-f6c7-4f56-b1f3-c59eff412518 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:46.214308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a13d6257-f6c7-4f56-b1f3-c59eff412518 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:46.219418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a13d6257-f6c7-4f56-b1f3-c59eff412518 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:46.220330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a13d6257-f6c7-4f56-b1f3-c59eff412518 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:46.220786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a13d6257-f6c7-4f56-b1f3-c59eff412518 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:46.292423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-048807f7-bb9a-4cbe-b361-a66979e069ca tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:46.302089 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-048807f7-bb9a-4cbe-b361-a66979e069ca tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.315086 Aug 27 05:30:46.308334 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3130/6260] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:45 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:46.338480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a13d6257-f6c7-4f56-b1f3-c59eff412518 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:46.347273 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a13d6257-f6c7-4f56-b1f3-c59eff412518 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1188 microversion: 2.1 time: 0.152292 Aug 27 05:30:46.347871 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3131/6261] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:46 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1188 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:47.330163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-992359d7-1246-4dd6-afb4-31904c87b5d9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:47.330686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-992359d7-1246-4dd6-afb4-31904c87b5d9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:47.341874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-992359d7-1246-4dd6-afb4-31904c87b5d9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:47.347417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-992359d7-1246-4dd6-afb4-31904c87b5d9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:47.348018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-992359d7-1246-4dd6-afb4-31904c87b5d9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:47.348793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-992359d7-1246-4dd6-afb4-31904c87b5d9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:47.349279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-992359d7-1246-4dd6-afb4-31904c87b5d9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:47.349715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-992359d7-1246-4dd6-afb4-31904c87b5d9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:47.371318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-26317d7e-bf76-4b06-8973-1916454fd14f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:47.372017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-26317d7e-bf76-4b06-8973-1916454fd14f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:47.382563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26317d7e-bf76-4b06-8973-1916454fd14f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:47.383074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26317d7e-bf76-4b06-8973-1916454fd14f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:47.387550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26317d7e-bf76-4b06-8973-1916454fd14f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:47.388817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26317d7e-bf76-4b06-8973-1916454fd14f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:47.389297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26317d7e-bf76-4b06-8973-1916454fd14f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:47.396078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26317d7e-bf76-4b06-8973-1916454fd14f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:47.525577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-26317d7e-bf76-4b06-8973-1916454fd14f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:47.541779 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-26317d7e-bf76-4b06-8973-1916454fd14f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1188 microversion: 2.1 time: 0.177408 Aug 27 05:30:47.551061 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3132/6262] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:47 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1188 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:47.571472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-992359d7-1246-4dd6-afb4-31904c87b5d9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:47.581830 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-992359d7-1246-4dd6-afb4-31904c87b5d9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.255500 Aug 27 05:30:47.587232 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3131/6263] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:47 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:48.578584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-85fd9ba4-a2f6-4fde-99ad-8c1bb942f992 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:48.580996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-85fd9ba4-a2f6-4fde-99ad-8c1bb942f992 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:48.600023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85fd9ba4-a2f6-4fde-99ad-8c1bb942f992 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:48.602343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85fd9ba4-a2f6-4fde-99ad-8c1bb942f992 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:48.605634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85fd9ba4-a2f6-4fde-99ad-8c1bb942f992 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:48.608807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85fd9ba4-a2f6-4fde-99ad-8c1bb942f992 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:48.610316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85fd9ba4-a2f6-4fde-99ad-8c1bb942f992 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:48.612969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-85fd9ba4-a2f6-4fde-99ad-8c1bb942f992 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:48.614243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a440dda2-a551-4344-b980-60975ccf5e4f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:48.614947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a440dda2-a551-4344-b980-60975ccf5e4f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:48.639440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a440dda2-a551-4344-b980-60975ccf5e4f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:48.640246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a440dda2-a551-4344-b980-60975ccf5e4f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:48.645085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a440dda2-a551-4344-b980-60975ccf5e4f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:48.648560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a440dda2-a551-4344-b980-60975ccf5e4f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:48.649231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a440dda2-a551-4344-b980-60975ccf5e4f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:48.650378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a440dda2-a551-4344-b980-60975ccf5e4f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:48.715346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-85fd9ba4-a2f6-4fde-99ad-8c1bb942f992 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:48.728967 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-85fd9ba4-a2f6-4fde-99ad-8c1bb942f992 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 200 len: 1188 microversion: 2.1 time: 0.157991 Aug 27 05:30:48.730388 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3133/6264] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:48 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 1188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:48.997899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a440dda2-a551-4344-b980-60975ccf5e4f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:49.010364 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a440dda2-a551-4344-b980-60975ccf5e4f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.400754 Aug 27 05:30:49.011977 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3132/6265] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:48 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:49.754954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:49.756256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 279d0af1-f822-4315-a8bb-065114b8016b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:49.773883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:49.774659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:49.775862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:49.776804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:49.777568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:49.778795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:49.800711 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 279d0af1-f822-4315-a8bb-065114b8016b could not be found. Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b HTTP/1.1 Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 279d0af1-f822-4315-a8bb-065114b8016b could not be found. Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '279d0af1-f822-4315-a8bb-065114b8016b'} Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 279d0af1-f822-4315-a8bb-065114b8016b could not be found. Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 279d0af1-f822-4315-a8bb-065114b8016b could not be found. Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:30:49.803308 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:30:49.807574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:49.807574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:30:49.807574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:30:49.807574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:30:49.807574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:30:49.807574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 279d0af1-f822-4315-a8bb-065114b8016b could not be found. Aug 27 05:30:49.807574 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:30:49.808905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 279d0af1-f822-4315-a8bb-065114b8016b could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:30:49.810692 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4074fa08-ddbc-442f-ac8d-fb3e53ff1107 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b" status: 404 len: 111 microversion: 2.1 time: 0.059958 Aug 27 05:30:49.811320 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3134/6266] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:49 2022] GET /compute/v2.1/servers/279d0af1-f822-4315-a8bb-065114b8016b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:30:50.050282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3d12888-b49c-4dc9-b156-e3fcbd4c7f79 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:50.051043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e3d12888-b49c-4dc9-b156-e3fcbd4c7f79 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:50.061538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3d12888-b49c-4dc9-b156-e3fcbd4c7f79 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:50.066607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3d12888-b49c-4dc9-b156-e3fcbd4c7f79 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:50.067201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3d12888-b49c-4dc9-b156-e3fcbd4c7f79 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:50.068489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3d12888-b49c-4dc9-b156-e3fcbd4c7f79 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:50.069329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3d12888-b49c-4dc9-b156-e3fcbd4c7f79 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:50.070335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3d12888-b49c-4dc9-b156-e3fcbd4c7f79 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:50.387293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e3d12888-b49c-4dc9-b156-e3fcbd4c7f79 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:50.398180 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e3d12888-b49c-4dc9-b156-e3fcbd4c7f79 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.352547 Aug 27 05:30:50.406146 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3133/6267] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:50 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:51.434899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-766f015a-bd9c-4477-b03d-2f5827895930 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:51.435886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-766f015a-bd9c-4477-b03d-2f5827895930 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:51.476655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-766f015a-bd9c-4477-b03d-2f5827895930 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:51.477571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-766f015a-bd9c-4477-b03d-2f5827895930 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:51.478801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-766f015a-bd9c-4477-b03d-2f5827895930 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:51.480342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-766f015a-bd9c-4477-b03d-2f5827895930 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:51.485645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-766f015a-bd9c-4477-b03d-2f5827895930 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:51.486789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-766f015a-bd9c-4477-b03d-2f5827895930 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:51.666780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-766f015a-bd9c-4477-b03d-2f5827895930 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:51.679337 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-766f015a-bd9c-4477-b03d-2f5827895930 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.251784 Aug 27 05:30:51.680276 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3135/6268] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:51 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:52.711151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-34d28914-9e54-4404-a25d-5f354fd55169 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:52.714721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-34d28914-9e54-4404-a25d-5f354fd55169 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:52.729428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34d28914-9e54-4404-a25d-5f354fd55169 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:52.730343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34d28914-9e54-4404-a25d-5f354fd55169 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:52.731110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34d28914-9e54-4404-a25d-5f354fd55169 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:52.732091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34d28914-9e54-4404-a25d-5f354fd55169 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:52.732696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34d28914-9e54-4404-a25d-5f354fd55169 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:52.734230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34d28914-9e54-4404-a25d-5f354fd55169 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:52.940137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-34d28914-9e54-4404-a25d-5f354fd55169 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:52.952526 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-34d28914-9e54-4404-a25d-5f354fd55169 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.253885 Aug 27 05:30:52.958033 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3134/6269] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:52 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:53.975816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c3ba8e61-9a2f-4478-b3fc-0ece2c9f7541 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:53.977189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c3ba8e61-9a2f-4478-b3fc-0ece2c9f7541 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:53.998508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ba8e61-9a2f-4478-b3fc-0ece2c9f7541 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:53.999283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ba8e61-9a2f-4478-b3fc-0ece2c9f7541 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:54.000001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ba8e61-9a2f-4478-b3fc-0ece2c9f7541 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:54.000918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ba8e61-9a2f-4478-b3fc-0ece2c9f7541 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:54.001539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ba8e61-9a2f-4478-b3fc-0ece2c9f7541 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:54.002131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ba8e61-9a2f-4478-b3fc-0ece2c9f7541 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:54.391481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c3ba8e61-9a2f-4478-b3fc-0ece2c9f7541 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:54.406666 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c3ba8e61-9a2f-4478-b3fc-0ece2c9f7541 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.430685 Aug 27 05:30:54.419529 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3136/6270] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:53 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:55.440281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-499bf360-dfa4-4aa9-8e22-a203b654bec9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:55.441667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-499bf360-dfa4-4aa9-8e22-a203b654bec9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:55.489645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-499bf360-dfa4-4aa9-8e22-a203b654bec9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:55.490663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-499bf360-dfa4-4aa9-8e22-a203b654bec9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:55.492736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-499bf360-dfa4-4aa9-8e22-a203b654bec9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:55.494206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-499bf360-dfa4-4aa9-8e22-a203b654bec9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:55.495740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-499bf360-dfa4-4aa9-8e22-a203b654bec9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:55.496945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-499bf360-dfa4-4aa9-8e22-a203b654bec9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:55.771421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-499bf360-dfa4-4aa9-8e22-a203b654bec9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:55.775680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:55.789865 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-499bf360-dfa4-4aa9-8e22-a203b654bec9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.356435 Aug 27 05:30:55.791497 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3135/6271] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:55 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:56.820054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-324e997b-63a9-425d-b7e9-fe9fc2e645d6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:56.822010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-324e997b-63a9-425d-b7e9-fe9fc2e645d6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:56.831511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-324e997b-63a9-425d-b7e9-fe9fc2e645d6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:56.832420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-324e997b-63a9-425d-b7e9-fe9fc2e645d6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:56.833006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-324e997b-63a9-425d-b7e9-fe9fc2e645d6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:56.834118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-324e997b-63a9-425d-b7e9-fe9fc2e645d6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:56.834720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-324e997b-63a9-425d-b7e9-fe9fc2e645d6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:56.835601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-324e997b-63a9-425d-b7e9-fe9fc2e645d6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:57.166618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-324e997b-63a9-425d-b7e9-fe9fc2e645d6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:57.178715 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-324e997b-63a9-425d-b7e9-fe9fc2e645d6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.362682 Aug 27 05:30:57.179654 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3137/6272] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:56 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:58.201905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68f48edd-99c9-4e10-bf4b-13111b66eb65 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:58.202531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68f48edd-99c9-4e10-bf4b-13111b66eb65 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:58.216305 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68f48edd-99c9-4e10-bf4b-13111b66eb65 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:58.217825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68f48edd-99c9-4e10-bf4b-13111b66eb65 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:58.222463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68f48edd-99c9-4e10-bf4b-13111b66eb65 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:58.225245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68f48edd-99c9-4e10-bf4b-13111b66eb65 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:58.225967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68f48edd-99c9-4e10-bf4b-13111b66eb65 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:58.228186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68f48edd-99c9-4e10-bf4b-13111b66eb65 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:58.428359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68f48edd-99c9-4e10-bf4b-13111b66eb65 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:58.443309 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68f48edd-99c9-4e10-bf4b-13111b66eb65 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.245583 Aug 27 05:30:58.444385 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3136/6273] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:58 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:59.469619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5242eefb-8ae3-4195-8c02-9ea83a411240 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:59.471289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5242eefb-8ae3-4195-8c02-9ea83a411240 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:59.480642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5242eefb-8ae3-4195-8c02-9ea83a411240 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:59.482776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5242eefb-8ae3-4195-8c02-9ea83a411240 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:59.483786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5242eefb-8ae3-4195-8c02-9ea83a411240 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:59.484755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5242eefb-8ae3-4195-8c02-9ea83a411240 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:59.485550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5242eefb-8ae3-4195-8c02-9ea83a411240 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:59.486206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5242eefb-8ae3-4195-8c02-9ea83a411240 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:59.774310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5242eefb-8ae3-4195-8c02-9ea83a411240 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:59.787668 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5242eefb-8ae3-4195-8c02-9ea83a411240 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.323111 Aug 27 05:30:59.791877 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3138/6274] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:59 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:00.812684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4a7de1d9-47ec-41c6-9bb0-159def7f768f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:00.813310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4a7de1d9-47ec-41c6-9bb0-159def7f768f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:00.824320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a7de1d9-47ec-41c6-9bb0-159def7f768f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:00.824820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a7de1d9-47ec-41c6-9bb0-159def7f768f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:00.825265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a7de1d9-47ec-41c6-9bb0-159def7f768f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:00.825981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a7de1d9-47ec-41c6-9bb0-159def7f768f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:00.826434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a7de1d9-47ec-41c6-9bb0-159def7f768f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:00.826879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a7de1d9-47ec-41c6-9bb0-159def7f768f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:01.141679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4a7de1d9-47ec-41c6-9bb0-159def7f768f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:01.151114 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4a7de1d9-47ec-41c6-9bb0-159def7f768f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.342473 Aug 27 05:31:01.151900 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3137/6275] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:00 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:02.173071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d9d770d-986c-4e0a-9da2-3357e70ad93a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:02.174365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d9d770d-986c-4e0a-9da2-3357e70ad93a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:02.192322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d9d770d-986c-4e0a-9da2-3357e70ad93a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:02.193341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d9d770d-986c-4e0a-9da2-3357e70ad93a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:02.194011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d9d770d-986c-4e0a-9da2-3357e70ad93a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:02.194926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d9d770d-986c-4e0a-9da2-3357e70ad93a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:02.195585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d9d770d-986c-4e0a-9da2-3357e70ad93a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:02.196788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d9d770d-986c-4e0a-9da2-3357e70ad93a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:02.453359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d9d770d-986c-4e0a-9da2-3357e70ad93a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:02.464092 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d9d770d-986c-4e0a-9da2-3357e70ad93a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.294971 Aug 27 05:31:02.479546 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3139/6276] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:02 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:03.487344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ce2e5e1-e9be-44c9-8eea-9620ab20e228 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:03.488604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6ce2e5e1-e9be-44c9-8eea-9620ab20e228 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:03.507237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ce2e5e1-e9be-44c9-8eea-9620ab20e228 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:03.507747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ce2e5e1-e9be-44c9-8eea-9620ab20e228 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:03.508200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ce2e5e1-e9be-44c9-8eea-9620ab20e228 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:03.508956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ce2e5e1-e9be-44c9-8eea-9620ab20e228 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:03.509416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ce2e5e1-e9be-44c9-8eea-9620ab20e228 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:03.509850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ce2e5e1-e9be-44c9-8eea-9620ab20e228 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:03.835906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6ce2e5e1-e9be-44c9-8eea-9620ab20e228 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:03.845241 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6ce2e5e1-e9be-44c9-8eea-9620ab20e228 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.362469 Aug 27 05:31:03.846952 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3138/6277] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:03 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:04.872391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f323e81-b9d9-4ae2-a5a4-d2379b4f6c40 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:04.873193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4f323e81-b9d9-4ae2-a5a4-d2379b4f6c40 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:04.891816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f323e81-b9d9-4ae2-a5a4-d2379b4f6c40 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:04.894998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f323e81-b9d9-4ae2-a5a4-d2379b4f6c40 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:04.895761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f323e81-b9d9-4ae2-a5a4-d2379b4f6c40 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:04.899854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f323e81-b9d9-4ae2-a5a4-d2379b4f6c40 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:04.900491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f323e81-b9d9-4ae2-a5a4-d2379b4f6c40 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:04.901073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f323e81-b9d9-4ae2-a5a4-d2379b4f6c40 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:05.241919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f323e81-b9d9-4ae2-a5a4-d2379b4f6c40 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:05.298841 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f323e81-b9d9-4ae2-a5a4-d2379b4f6c40 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.431063 Aug 27 05:31:05.326679 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3140/6278] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:04 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:31:06.324592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-99ab679a-6dab-4930-918c-3a5ebbca7a95 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:06.325307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-99ab679a-6dab-4930-918c-3a5ebbca7a95 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:06.344546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99ab679a-6dab-4930-918c-3a5ebbca7a95 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:06.345047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99ab679a-6dab-4930-918c-3a5ebbca7a95 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:06.345497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99ab679a-6dab-4930-918c-3a5ebbca7a95 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:06.346220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99ab679a-6dab-4930-918c-3a5ebbca7a95 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:06.346774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99ab679a-6dab-4930-918c-3a5ebbca7a95 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:06.349738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99ab679a-6dab-4930-918c-3a5ebbca7a95 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:06.638360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-99ab679a-6dab-4930-918c-3a5ebbca7a95 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:06.650024 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-99ab679a-6dab-4930-918c-3a5ebbca7a95 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1723 microversion: 2.1 time: 0.331467 Aug 27 05:31:06.650623 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3139/6279] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:06 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:31:07.675656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bc0e6d73-ee1a-47b5-807a-c49bfae5f08a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:07.677792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bc0e6d73-ee1a-47b5-807a-c49bfae5f08a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:07.690881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc0e6d73-ee1a-47b5-807a-c49bfae5f08a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:07.691328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc0e6d73-ee1a-47b5-807a-c49bfae5f08a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:07.691785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc0e6d73-ee1a-47b5-807a-c49bfae5f08a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:07.694043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc0e6d73-ee1a-47b5-807a-c49bfae5f08a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:07.694690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc0e6d73-ee1a-47b5-807a-c49bfae5f08a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:07.695543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc0e6d73-ee1a-47b5-807a-c49bfae5f08a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:08.339292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bc0e6d73-ee1a-47b5-807a-c49bfae5f08a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:08.350127 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bc0e6d73-ee1a-47b5-807a-c49bfae5f08a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1700 microversion: 2.1 time: 0.678792 Aug 27 05:31:08.352574 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3141/6280] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:07 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1700 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:08.376455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ff393fe2-0bbd-45e5-aefe-dbd05fff723d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:31:08.386492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff393fe2-0bbd-45e5-aefe-dbd05fff723d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:08.387751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff393fe2-0bbd-45e5-aefe-dbd05fff723d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:08.388668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff393fe2-0bbd-45e5-aefe-dbd05fff723d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:08.441205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ff393fe2-0bbd-45e5-aefe-dbd05fff723d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Going to try to start instance {{(pid=128547) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 05:31:08.535732 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ff393fe2-0bbd-45e5-aefe-dbd05fff723d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "POST /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.167553 Aug 27 05:31:08.537035 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3140/6281] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:31:08 2022] POST /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:31:08.554616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-40f29ce3-99e6-41fa-a881-c552378d3a96 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:08.556454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-40f29ce3-99e6-41fa-a881-c552378d3a96 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:08.580111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40f29ce3-99e6-41fa-a881-c552378d3a96 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:08.580513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40f29ce3-99e6-41fa-a881-c552378d3a96 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:08.588436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40f29ce3-99e6-41fa-a881-c552378d3a96 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:08.589759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40f29ce3-99e6-41fa-a881-c552378d3a96 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:08.590436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40f29ce3-99e6-41fa-a881-c552378d3a96 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:08.591070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-40f29ce3-99e6-41fa-a881-c552378d3a96 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:09.028206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-40f29ce3-99e6-41fa-a881-c552378d3a96 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:09.046282 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-40f29ce3-99e6-41fa-a881-c552378d3a96 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1709 microversion: 2.1 time: 0.503052 Aug 27 05:31:09.050061 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3142/6282] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:08 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1709 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:10.073674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-09150d5f-5c6c-4d7d-8b2d-b28314f7dbb8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:10.075142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-09150d5f-5c6c-4d7d-8b2d-b28314f7dbb8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:10.085798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09150d5f-5c6c-4d7d-8b2d-b28314f7dbb8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:10.086693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09150d5f-5c6c-4d7d-8b2d-b28314f7dbb8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:10.087705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09150d5f-5c6c-4d7d-8b2d-b28314f7dbb8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:10.089012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09150d5f-5c6c-4d7d-8b2d-b28314f7dbb8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:10.093407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09150d5f-5c6c-4d7d-8b2d-b28314f7dbb8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:10.094242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09150d5f-5c6c-4d7d-8b2d-b28314f7dbb8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:10.321304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-09150d5f-5c6c-4d7d-8b2d-b28314f7dbb8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:10.348568 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-09150d5f-5c6c-4d7d-8b2d-b28314f7dbb8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1709 microversion: 2.1 time: 0.279909 Aug 27 05:31:10.350581 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3141/6283] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:10 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1709 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:11.376467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3a314633-b422-4bb0-bd50-f3b3b60e8609 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:11.377937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3a314633-b422-4bb0-bd50-f3b3b60e8609 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:11.388293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a314633-b422-4bb0-bd50-f3b3b60e8609 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:11.396620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a314633-b422-4bb0-bd50-f3b3b60e8609 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:11.396620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a314633-b422-4bb0-bd50-f3b3b60e8609 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:11.396620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a314633-b422-4bb0-bd50-f3b3b60e8609 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:11.396620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a314633-b422-4bb0-bd50-f3b3b60e8609 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:11.396620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a314633-b422-4bb0-bd50-f3b3b60e8609 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:11.840064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3a314633-b422-4bb0-bd50-f3b3b60e8609 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:11.852624 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3a314633-b422-4bb0-bd50-f3b3b60e8609 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1713 microversion: 2.1 time: 0.479763 Aug 27 05:31:11.855642 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3143/6284] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:11 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1713 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:24.358057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-792880f2-8f01-4536-a60b-4711de58946a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:24.359778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-792880f2-8f01-4536-a60b-4711de58946a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:24.366699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=23 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:31:24.367428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:31:24.369402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792880f2-8f01-4536-a60b-4711de58946a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:24.370113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792880f2-8f01-4536-a60b-4711de58946a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:24.370680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792880f2-8f01-4536-a60b-4711de58946a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:24.371625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792880f2-8f01-4536-a60b-4711de58946a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:24.372083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792880f2-8f01-4536-a60b-4711de58946a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:24.372977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-792880f2-8f01-4536-a60b-4711de58946a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:24.527444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-792880f2-8f01-4536-a60b-4711de58946a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lazy-loading 'services' on Instance uuid be8bceb6-cc73-4f2e-8858-e02d8fb84f37 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:31:24.707267 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-792880f2-8f01-4536-a60b-4711de58946a tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments/4acb96a5-05b9-495b-8ee4-f5ae107c2065" status: 202 len: 0 microversion: 2.1 time: 0.352813 Aug 27 05:31:24.718146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e6d85298-8fa5-4bfe-8b93-da00fef4b502 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:24.721637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e6d85298-8fa5-4bfe-8b93-da00fef4b502 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:24.729732 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3142/6285] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:31:24 2022] DELETE /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments/4acb96a5-05b9-495b-8ee4-f5ae107c2065 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:31:24.744790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=31 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:31:24.748189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:31:24.750847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6d85298-8fa5-4bfe-8b93-da00fef4b502 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:24.751681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6d85298-8fa5-4bfe-8b93-da00fef4b502 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:24.752401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6d85298-8fa5-4bfe-8b93-da00fef4b502 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:24.753911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6d85298-8fa5-4bfe-8b93-da00fef4b502 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:24.754576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6d85298-8fa5-4bfe-8b93-da00fef4b502 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:24.755238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6d85298-8fa5-4bfe-8b93-da00fef4b502 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:24.826222 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e6d85298-8fa5-4bfe-8b93-da00fef4b502 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112089 Aug 27 05:31:24.829172 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3144/6286] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:31:24 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:31:25.844580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5fcde6e9-6e42-4191-ba71-f5ef432d849c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:25.847619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5fcde6e9-6e42-4191-ba71-f5ef432d849c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:25.865568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fcde6e9-6e42-4191-ba71-f5ef432d849c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:25.865873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fcde6e9-6e42-4191-ba71-f5ef432d849c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:25.866317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fcde6e9-6e42-4191-ba71-f5ef432d849c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:25.867812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fcde6e9-6e42-4191-ba71-f5ef432d849c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:25.869549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fcde6e9-6e42-4191-ba71-f5ef432d849c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:25.870189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fcde6e9-6e42-4191-ba71-f5ef432d849c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:25.960222 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5fcde6e9-6e42-4191-ba71-f5ef432d849c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121378 Aug 27 05:31:25.975444 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3143/6287] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:31:25 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:31:26.532284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1097821568", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "031e03f8-f3eb-4192-b8a8-4a1ab819cce7", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "58a22fcb-5b07-4d83-8df1-2b6fed6fe046"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:31:26.710414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] validate_networks() for [('58a22fcb-5b07-4d83-8df1-2b6fed6fe046', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:31:26.984671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2e3dbe2-bcdd-413a-b35b-9f428879af6c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:26.987690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a2e3dbe2-bcdd-413a-b35b-9f428879af6c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:27.002116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e3dbe2-bcdd-413a-b35b-9f428879af6c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:27.002597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e3dbe2-bcdd-413a-b35b-9f428879af6c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:27.004023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e3dbe2-bcdd-413a-b35b-9f428879af6c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:27.005405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e3dbe2-bcdd-413a-b35b-9f428879af6c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:27.006090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e3dbe2-bcdd-413a-b35b-9f428879af6c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:27.007035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2e3dbe2-bcdd-413a-b35b-9f428879af6c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:27.058139 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2e3dbe2-bcdd-413a-b35b-9f428879af6c tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079339 Aug 27 05:31:27.059842 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3144/6288] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:31:26 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:31:27.464574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:31:27.465307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:31:27.466730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:31:27.467775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:31:27.468916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:31:27.479852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:27.480693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:27.481349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:27.482289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:27.482957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:27.483828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:27.510451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:31:27.517182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for user 007b4762bf8c436fb783d84380c01932 and project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:31:27.565047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:31:27.568000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='031e03f8-f3eb-4192-b8a8-4a1ab819cce7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:31:27.708901 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b8dab383-402e-4cda-b5a3-e7d398bfcba3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182014 Aug 27 05:31:27.714302 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3145/6289] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:31:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:31:27.745679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c63deae-8406-4a76-bca7-3bde6b775612 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:27.751026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c63deae-8406-4a76-bca7-3bde6b775612 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:27.907179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c63deae-8406-4a76-bca7-3bde6b775612 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:27.922306 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c63deae-8406-4a76-bca7-3bde6b775612 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1057 microversion: 2.1 time: 0.201894 Aug 27 05:31:27.924101 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3145/6290] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:27 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1057 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:28.080011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-75c4dfc2-bc83-4ef5-8203-754fa6e5f95e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:28.084621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-75c4dfc2-bc83-4ef5-8203-754fa6e5f95e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:28.113994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75c4dfc2-bc83-4ef5-8203-754fa6e5f95e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:28.114502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75c4dfc2-bc83-4ef5-8203-754fa6e5f95e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:28.114947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75c4dfc2-bc83-4ef5-8203-754fa6e5f95e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:28.115894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75c4dfc2-bc83-4ef5-8203-754fa6e5f95e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:28.116441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75c4dfc2-bc83-4ef5-8203-754fa6e5f95e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:28.117616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75c4dfc2-bc83-4ef5-8203-754fa6e5f95e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:28.157255 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-75c4dfc2-bc83-4ef5-8203-754fa6e5f95e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088718 Aug 27 05:31:28.163209 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3146/6291] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:31:28 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:31:28.945104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-034fb92d-36cc-41fc-9204-48ec11663d62 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:28.946290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-034fb92d-36cc-41fc-9204-48ec11663d62 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:28.965164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034fb92d-36cc-41fc-9204-48ec11663d62 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:28.965725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034fb92d-36cc-41fc-9204-48ec11663d62 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:28.966173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034fb92d-36cc-41fc-9204-48ec11663d62 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:28.966897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034fb92d-36cc-41fc-9204-48ec11663d62 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:28.967758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034fb92d-36cc-41fc-9204-48ec11663d62 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:28.968291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-034fb92d-36cc-41fc-9204-48ec11663d62 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:29.173330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0496fe93-6445-4c73-b82c-d7f11eb0ceda tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:29.177903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0496fe93-6445-4c73-b82c-d7f11eb0ceda tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:29.187443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-034fb92d-36cc-41fc-9204-48ec11663d62 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:29.190523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0496fe93-6445-4c73-b82c-d7f11eb0ceda tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:29.191383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0496fe93-6445-4c73-b82c-d7f11eb0ceda tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:29.192863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0496fe93-6445-4c73-b82c-d7f11eb0ceda tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:29.193827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0496fe93-6445-4c73-b82c-d7f11eb0ceda tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:29.195701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0496fe93-6445-4c73-b82c-d7f11eb0ceda tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:29.196368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0496fe93-6445-4c73-b82c-d7f11eb0ceda tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:29.200418 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-034fb92d-36cc-41fc-9204-48ec11663d62 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1109 microversion: 2.1 time: 0.259241 Aug 27 05:31:29.201032 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3146/6292] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:28 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1109 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:29.243173 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0496fe93-6445-4c73-b82c-d7f11eb0ceda tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074128 Aug 27 05:31:29.244144 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3147/6293] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:31:29 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:31:30.225142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b9741404-dada-4864-83e5-961bf0f81f9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:30.225798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b9741404-dada-4864-83e5-961bf0f81f9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:30.234143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9741404-dada-4864-83e5-961bf0f81f9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:30.235377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9741404-dada-4864-83e5-961bf0f81f9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:30.236002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9741404-dada-4864-83e5-961bf0f81f9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:30.237604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9741404-dada-4864-83e5-961bf0f81f9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:30.238874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9741404-dada-4864-83e5-961bf0f81f9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:30.239802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9741404-dada-4864-83e5-961bf0f81f9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:30.266114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c6489159-b45a-46e9-b93c-845b77819add tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:30.271557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c6489159-b45a-46e9-b93c-845b77819add tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:30.284235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6489159-b45a-46e9-b93c-845b77819add tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:30.284733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6489159-b45a-46e9-b93c-845b77819add tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:30.285182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6489159-b45a-46e9-b93c-845b77819add tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:30.285899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6489159-b45a-46e9-b93c-845b77819add tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:30.286533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6489159-b45a-46e9-b93c-845b77819add tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:30.289914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c6489159-b45a-46e9-b93c-845b77819add tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:30.360577 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c6489159-b45a-46e9-b93c-845b77819add tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107973 Aug 27 05:31:30.362126 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3148/6294] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:31:30 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:31:30.435614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b9741404-dada-4864-83e5-961bf0f81f9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:30.444360 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b9741404-dada-4864-83e5-961bf0f81f9d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1127 microversion: 2.1 time: 0.224367 Aug 27 05:31:30.445873 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3147/6295] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:30 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1127 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:31.376271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-096105dc-0123-4338-b6d8-20f339bf93b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:31.378806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-096105dc-0123-4338-b6d8-20f339bf93b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:31.415933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-096105dc-0123-4338-b6d8-20f339bf93b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:31.416483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-096105dc-0123-4338-b6d8-20f339bf93b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:31.416939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-096105dc-0123-4338-b6d8-20f339bf93b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:31.422248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-096105dc-0123-4338-b6d8-20f339bf93b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:31.423745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-096105dc-0123-4338-b6d8-20f339bf93b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:31.431553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-096105dc-0123-4338-b6d8-20f339bf93b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:31.471810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ec563cc-f4c6-437a-9ef2-f8648147143f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:31.472922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ec563cc-f4c6-437a-9ef2-f8648147143f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:31.519303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ec563cc-f4c6-437a-9ef2-f8648147143f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:31.519718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ec563cc-f4c6-437a-9ef2-f8648147143f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:31.520165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ec563cc-f4c6-437a-9ef2-f8648147143f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:31.520911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ec563cc-f4c6-437a-9ef2-f8648147143f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:31.521374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ec563cc-f4c6-437a-9ef2-f8648147143f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:31.521806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ec563cc-f4c6-437a-9ef2-f8648147143f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:31.587763 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-096105dc-0123-4338-b6d8-20f339bf93b8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209857 Aug 27 05:31:31.589022 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3149/6296] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:31:31 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:31:31.916927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1ec563cc-f4c6-437a-9ef2-f8648147143f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:31.942265 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ec563cc-f4c6-437a-9ef2-f8648147143f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.478524 Aug 27 05:31:31.969668 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3148/6297] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:31 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:32.534339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-8a4dbafc-a7b8-4ecb-a8fa-4e367f456955 req-c5bd6647-0ffc-4311-8f05-7b95393d8bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57ba86d-b2e0-4524-a40d-967e6d55bdfb", "tag": "b9dff5fe-a03b-41c7-9cc6-0c248096eecd"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:31:32.560046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8a4dbafc-a7b8-4ecb-a8fa-4e367f456955 req-c5bd6647-0ffc-4311-8f05-7b95393d8bd3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:32.560635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8a4dbafc-a7b8-4ecb-a8fa-4e367f456955 req-c5bd6647-0ffc-4311-8f05-7b95393d8bd3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:32.561082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8a4dbafc-a7b8-4ecb-a8fa-4e367f456955 req-c5bd6647-0ffc-4311-8f05-7b95393d8bd3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:32.594127 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-8a4dbafc-a7b8-4ecb-a8fa-4e367f456955 req-c5bd6647-0ffc-4311-8f05-7b95393d8bd3 service nova] Creating event network-changed:b9dff5fe-a03b-41c7-9cc6-0c248096eecd for instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb on n-h1-820368-35 Aug 27 05:31:32.602042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cc6103f8-3b56-411e-a6d0-ed04433bd243 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:32.605463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cc6103f8-3b56-411e-a6d0-ed04433bd243 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:32.626984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc6103f8-3b56-411e-a6d0-ed04433bd243 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:32.629502 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-8a4dbafc-a7b8-4ecb-a8fa-4e367f456955 req-c5bd6647-0ffc-4311-8f05-7b95393d8bd3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100587 Aug 27 05:31:32.630083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc6103f8-3b56-411e-a6d0-ed04433bd243 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:32.643338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc6103f8-3b56-411e-a6d0-ed04433bd243 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:32.645780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc6103f8-3b56-411e-a6d0-ed04433bd243 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:32.646199 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3150/6298] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:31:32.646872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc6103f8-3b56-411e-a6d0-ed04433bd243 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:32.647506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc6103f8-3b56-411e-a6d0-ed04433bd243 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:32.726765 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cc6103f8-3b56-411e-a6d0-ed04433bd243 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129519 Aug 27 05:31:32.727377 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3149/6299] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:31:32 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 05:31:32.873802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:31:32.876546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:32.905258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:32.906366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:32.907730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:32.908694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:32.909314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:32.910183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:32.954532 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] HTTP exception thrown: Cannot 'reboot' instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef while it is in vm_state rescued Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Request method failure captured: Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef/action HTTP/1.1 Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 28 Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCarXzQEeWD_yg-Yv3x-e6u_WeJK0H4zHIc0K2ifAeEz5lrEXCdSGI--LvFU55RmwGwdxJyIQb1oGJryeM85dpPE-6Bdt7QpTLIjsEre7jimq6F9GiGD3yK_ZjeKRtTqhKCIODh0xkoCo04wlC3mPfhPebArjlTk0PKLudgc3mohZyhg Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_43652021c7e84156955f4bdaf72aabba", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: f80e7dad058f44b9967a5a2f95123a9f Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: {"reboot": {"type": "HARD"}} Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: exception: Cannot 'reboot' instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef while it is in vm_state rescued Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2e03e5d6-756e-4532-9b5e-e8bdd38865ef', 'body': {'reboot': {'type': 'HARD'}}} Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1059, in _action_reboot Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1063, in _action_reboot Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:31:32.957862 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef while it is in vm_state rescued Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef while it is in vm_state rescued Aug 27 05:31:32.962715 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:31:32.971470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Returning 409 to user: Cannot 'reboot' instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef while it is in vm_state rescued {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:31:32.972784 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ec02fc41-2f57-452c-88de-706cb7793614 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef/action" status: 409 len: 145 microversion: 2.1 time: 0.103723 Aug 27 05:31:32.973899 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3151/6300] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:31:32 2022] POST /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef/action => generated 145 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:31:32.985690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:31:32.994582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:32.999163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e65d624e-150e-410a-84da-259dec6561cd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:33.001093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e65d624e-150e-410a-84da-259dec6561cd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:33.012352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:33.014501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:33.016326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:33.018724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:33.020098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:33.021869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:33.023578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e65d624e-150e-410a-84da-259dec6561cd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:33.024268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e65d624e-150e-410a-84da-259dec6561cd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:33.024879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e65d624e-150e-410a-84da-259dec6561cd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:33.026930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e65d624e-150e-410a-84da-259dec6561cd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:33.028022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e65d624e-150e-410a-84da-259dec6561cd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:33.029011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e65d624e-150e-410a-84da-259dec6561cd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:33.084459 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] HTTP exception thrown: Cannot 'rebuild' instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef while it is in vm_state rescued Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Request method failure captured: Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef/action HTTP/1.1 Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 65 Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCarXzQEeWD_yg-Yv3x-e6u_WeJK0H4zHIc0K2ifAeEz5lrEXCdSGI--LvFU55RmwGwdxJyIQb1oGJryeM85dpPE-6Bdt7QpTLIjsEre7jimq6F9GiGD3yK_ZjeKRtTqhKCIODh0xkoCo04wlC3mPfhPebArjlTk0PKLudgc3mohZyhg Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_43652021c7e84156955f4bdaf72aabba", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: f80e7dad058f44b9967a5a2f95123a9f Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: exception: Cannot 'rebuild' instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef while it is in vm_state rescued Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '2e03e5d6-756e-4532-9b5e-e8bdd38865ef', 'body': {'rebuild': {'imageRef': '596ae1e8-61a9-43bf-be37-48ea5ff9a76f'}}} Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1243, in _action_rebuild Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:31:33.095346 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1251, in _action_rebuild Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef while it is in vm_state rescued Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef while it is in vm_state rescued Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Returning 409 to user: Cannot 'rebuild' instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef while it is in vm_state rescued {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:31:33.102439 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a763da5-d2ed-436d-b0d1-e534d2e78874 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "POST /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef/action" status: 409 len: 146 microversion: 2.1 time: 0.118923 Aug 27 05:31:33.115639 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3150/6301] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:31:32 2022] POST /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef/action => generated 146 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:31:33.136594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e891392-3d1c-4e2b-9d7b-270f9c046f60 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:33.139640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e891392-3d1c-4e2b-9d7b-270f9c046f60 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:33.157754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e891392-3d1c-4e2b-9d7b-270f9c046f60 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:33.158567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e891392-3d1c-4e2b-9d7b-270f9c046f60 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:33.159207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e891392-3d1c-4e2b-9d7b-270f9c046f60 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:33.160065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e891392-3d1c-4e2b-9d7b-270f9c046f60 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:33.161075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e891392-3d1c-4e2b-9d7b-270f9c046f60 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:33.161774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e891392-3d1c-4e2b-9d7b-270f9c046f60 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:33.200416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e891392-3d1c-4e2b-9d7b-270f9c046f60 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:31:33.369776 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e891392-3d1c-4e2b-9d7b-270f9c046f60 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 204 len: 0 microversion: 2.1 time: 0.244028 Aug 27 05:31:33.370637 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3151/6302] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:31:33 2022] DELETE /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:31:33.384161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d0a98f41-42ef-48b6-8314-a988a0344bd2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:33.388779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d0a98f41-42ef-48b6-8314-a988a0344bd2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:33.401731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a98f41-42ef-48b6-8314-a988a0344bd2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:33.402785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a98f41-42ef-48b6-8314-a988a0344bd2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:33.403510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a98f41-42ef-48b6-8314-a988a0344bd2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:33.404532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a98f41-42ef-48b6-8314-a988a0344bd2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:33.405219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a98f41-42ef-48b6-8314-a988a0344bd2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:33.406007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0a98f41-42ef-48b6-8314-a988a0344bd2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:33.469950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e65d624e-150e-410a-84da-259dec6561cd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:33.484178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e65d624e-150e-410a-84da-259dec6561cd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.492201 Aug 27 05:31:33.485928 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3152/6303] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:32 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:33.692780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d0a98f41-42ef-48b6-8314-a988a0344bd2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:33.715131 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d0a98f41-42ef-48b6-8314-a988a0344bd2 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1690 microversion: 2.1 time: 0.335994 Aug 27 05:31:33.716244 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3152/6304] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:33 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1690 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:34.506541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ecf1712-5819-41e7-a920-305725a9bc73 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:34.508040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0ecf1712-5819-41e7-a920-305725a9bc73 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:34.523014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ecf1712-5819-41e7-a920-305725a9bc73 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:34.523776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ecf1712-5819-41e7-a920-305725a9bc73 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:34.524442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ecf1712-5819-41e7-a920-305725a9bc73 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:34.525281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ecf1712-5819-41e7-a920-305725a9bc73 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:34.529378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ecf1712-5819-41e7-a920-305725a9bc73 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:34.529971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ecf1712-5819-41e7-a920-305725a9bc73 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:34.716971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0ecf1712-5819-41e7-a920-305725a9bc73 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:34.726623 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ecf1712-5819-41e7-a920-305725a9bc73 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.224342 Aug 27 05:31:34.736140 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3153/6305] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:34 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:34.737574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f559295-1573-42fb-9d37-b26712c3c1e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:34.738041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8f559295-1573-42fb-9d37-b26712c3c1e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:34.747792 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f559295-1573-42fb-9d37-b26712c3c1e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:34.748710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f559295-1573-42fb-9d37-b26712c3c1e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:34.751369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f559295-1573-42fb-9d37-b26712c3c1e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:34.752408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f559295-1573-42fb-9d37-b26712c3c1e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:34.753311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f559295-1573-42fb-9d37-b26712c3c1e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:34.753921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f559295-1573-42fb-9d37-b26712c3c1e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:34.968708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8f559295-1573-42fb-9d37-b26712c3c1e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:34.983742 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8f559295-1573-42fb-9d37-b26712c3c1e6 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1690 microversion: 2.1 time: 0.249982 Aug 27 05:31:34.986603 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3153/6306] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:34 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1690 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:35.756767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3d80aec-e563-474a-970c-207c7d7bfdee tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:35.758196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a3d80aec-e563-474a-970c-207c7d7bfdee tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:35.779398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3d80aec-e563-474a-970c-207c7d7bfdee tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:35.784962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3d80aec-e563-474a-970c-207c7d7bfdee tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:35.786511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3d80aec-e563-474a-970c-207c7d7bfdee tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:35.787893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3d80aec-e563-474a-970c-207c7d7bfdee tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:35.788818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3d80aec-e563-474a-970c-207c7d7bfdee tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:35.789534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3d80aec-e563-474a-970c-207c7d7bfdee tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:36.010703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9d69f956-fb18-487f-b5fa-285509e2a335 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:36.012499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9d69f956-fb18-487f-b5fa-285509e2a335 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:36.019915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d69f956-fb18-487f-b5fa-285509e2a335 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:36.020638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d69f956-fb18-487f-b5fa-285509e2a335 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:36.021239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d69f956-fb18-487f-b5fa-285509e2a335 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:36.023457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d69f956-fb18-487f-b5fa-285509e2a335 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:36.024086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d69f956-fb18-487f-b5fa-285509e2a335 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:36.024668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d69f956-fb18-487f-b5fa-285509e2a335 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:36.087162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a3d80aec-e563-474a-970c-207c7d7bfdee tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:36.104395 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a3d80aec-e563-474a-970c-207c7d7bfdee tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.351710 Aug 27 05:31:36.106902 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3154/6307] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:35 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:36.507947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9d69f956-fb18-487f-b5fa-285509e2a335 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:36.520074 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9d69f956-fb18-487f-b5fa-285509e2a335 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1690 microversion: 2.1 time: 0.512627 Aug 27 05:31:36.543984 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3154/6308] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:36 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1690 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:31:37.135203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b97cc656-0a9c-4494-b92d-bb52ccdaabae tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:37.135920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b97cc656-0a9c-4494-b92d-bb52ccdaabae tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:37.151019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b97cc656-0a9c-4494-b92d-bb52ccdaabae tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:37.152108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b97cc656-0a9c-4494-b92d-bb52ccdaabae tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:37.152785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b97cc656-0a9c-4494-b92d-bb52ccdaabae tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:37.153757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b97cc656-0a9c-4494-b92d-bb52ccdaabae tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:37.154626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b97cc656-0a9c-4494-b92d-bb52ccdaabae tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:37.155641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b97cc656-0a9c-4494-b92d-bb52ccdaabae tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:37.499499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:31:37.544907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:31:37.548330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c59561be-7139-4e02-9d34-f9dd5a499fd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:37.549501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c59561be-7139-4e02-9d34-f9dd5a499fd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:37.580140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c59561be-7139-4e02-9d34-f9dd5a499fd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:37.580992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c59561be-7139-4e02-9d34-f9dd5a499fd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:37.581814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c59561be-7139-4e02-9d34-f9dd5a499fd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:37.582517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c59561be-7139-4e02-9d34-f9dd5a499fd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:37.582996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c59561be-7139-4e02-9d34-f9dd5a499fd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:37.584350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c59561be-7139-4e02-9d34-f9dd5a499fd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:37.913397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:31:38.290543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c59561be-7139-4e02-9d34-f9dd5a499fd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:38.311218 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c59561be-7139-4e02-9d34-f9dd5a499fd8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1690 microversion: 2.1 time: 0.766679 Aug 27 05:31:38.312376 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3155/6309] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:37 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1690 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:38.469338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b97cc656-0a9c-4494-b92d-bb52ccdaabae tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:38.490609 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b97cc656-0a9c-4494-b92d-bb52ccdaabae tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 1.358901 Aug 27 05:31:38.492766 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3155/6310] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:37 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:39.359878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e2e0328a-d051-47f1-846d-3c813cde4a62 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:39.369599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e2e0328a-d051-47f1-846d-3c813cde4a62 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:39.403024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2e0328a-d051-47f1-846d-3c813cde4a62 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:39.412024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2e0328a-d051-47f1-846d-3c813cde4a62 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:39.415423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2e0328a-d051-47f1-846d-3c813cde4a62 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:39.416990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2e0328a-d051-47f1-846d-3c813cde4a62 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:39.418225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2e0328a-d051-47f1-846d-3c813cde4a62 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:39.420377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e2e0328a-d051-47f1-846d-3c813cde4a62 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:39.527962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4cc0e4e2-6b69-4aeb-879b-d5a7154e2647 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:39.540862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4cc0e4e2-6b69-4aeb-879b-d5a7154e2647 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:39.570044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cc0e4e2-6b69-4aeb-879b-d5a7154e2647 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:39.570926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cc0e4e2-6b69-4aeb-879b-d5a7154e2647 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:39.572549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cc0e4e2-6b69-4aeb-879b-d5a7154e2647 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:39.573759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cc0e4e2-6b69-4aeb-879b-d5a7154e2647 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:39.575115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cc0e4e2-6b69-4aeb-879b-d5a7154e2647 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:39.576475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4cc0e4e2-6b69-4aeb-879b-d5a7154e2647 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:39.614150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e2e0328a-d051-47f1-846d-3c813cde4a62 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:39.629072 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e2e0328a-d051-47f1-846d-3c813cde4a62 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1623 microversion: 2.1 time: 0.295906 Aug 27 05:31:39.630398 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3156/6311] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:39 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1623 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:40.410865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-6c8b23af-1c9d-4ae2-84e6-21492bf4b1d5 req-eed906f1-3695-4660-8183-26d1712a29c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8bceb6-cc73-4f2e-8858-e02d8fb84f37", "name": "network-vif-deleted", "tag": "c7190bb7-8036-47e7-83f7-27efbe7164a7"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:31:40.437983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6c8b23af-1c9d-4ae2-84e6-21492bf4b1d5 req-eed906f1-3695-4660-8183-26d1712a29c9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:40.438827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6c8b23af-1c9d-4ae2-84e6-21492bf4b1d5 req-eed906f1-3695-4660-8183-26d1712a29c9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:40.456577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6c8b23af-1c9d-4ae2-84e6-21492bf4b1d5 req-eed906f1-3695-4660-8183-26d1712a29c9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:40.497057 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-6c8b23af-1c9d-4ae2-84e6-21492bf4b1d5 req-eed906f1-3695-4660-8183-26d1712a29c9 service nova] Creating event network-vif-deleted:c7190bb7-8036-47e7-83f7-27efbe7164a7 for instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 on n-h1-820368-35 Aug 27 05:31:40.511410 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-6c8b23af-1c9d-4ae2-84e6-21492bf4b1d5 req-eed906f1-3695-4660-8183-26d1712a29c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102515 Aug 27 05:31:40.513130 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3157/6312] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:31:40.513781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4cc0e4e2-6b69-4aeb-879b-d5a7154e2647 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:40.526332 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4cc0e4e2-6b69-4aeb-879b-d5a7154e2647 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 1.015356 Aug 27 05:31:40.549894 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3156/6313] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:39 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:40.663047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:40.664274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:40.683378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:40.684512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:40.685354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:40.686216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:40.687291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:40.688391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:40.695459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:31:40.792786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:40.793694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:40.794363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:40.795003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lazy-loading 'fault' on Instance uuid be8bceb6-cc73-4f2e-8858-e02d8fb84f37 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:31:40.926093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:40.935545 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4df28704-da78-4642-85b3-9f96a6c98783 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 200 len: 1335 microversion: 2.1 time: 0.276912 Aug 27 05:31:40.940263 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3158/6314] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:40 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 1335 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:41.575571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2a76dddd-45d1-42c3-946f-bb1c952b6b47 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:41.576844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2a76dddd-45d1-42c3-946f-bb1c952b6b47 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:41.594197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a76dddd-45d1-42c3-946f-bb1c952b6b47 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:41.595019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a76dddd-45d1-42c3-946f-bb1c952b6b47 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:41.595593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a76dddd-45d1-42c3-946f-bb1c952b6b47 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:41.597139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a76dddd-45d1-42c3-946f-bb1c952b6b47 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:41.597612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a76dddd-45d1-42c3-946f-bb1c952b6b47 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:41.598207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a76dddd-45d1-42c3-946f-bb1c952b6b47 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:41.977062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:41.977776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: be8bceb6-cc73-4f2e-8858-e02d8fb84f37] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:41.997860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:42.002308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:42.003569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:42.009266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2a76dddd-45d1-42c3-946f-bb1c952b6b47 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:42.009593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:42.014358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:42.020926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:42.029915 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2a76dddd-45d1-42c3-946f-bb1c952b6b47 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.458541 Aug 27 05:31:42.035176 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3157/6315] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:41 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:42.065740 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] HTTP exception thrown: Instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 could not be found. Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Request method failure captured: Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 HTTP/1.1 Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCarXzQEeWD_yg-Yv3x-e6u_WeJK0H4zHIc0K2ifAeEz5lrEXCdSGI--LvFU55RmwGwdxJyIQb1oGJryeM85dpPE-6Bdt7QpTLIjsEre7jimq6F9GiGD3yK_ZjeKRtTqhKCIODh0xkoCo04wlC3mPfhPebArjlTk0PKLudgc3mohZyhg Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_43652021c7e84156955f4bdaf72aabba", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: f80e7dad058f44b9967a5a2f95123a9f Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 could not be found. Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'be8bceb6-cc73-4f2e-8858-e02d8fb84f37'} Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 could not be found. Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 could not be found. Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:42.068586 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:31:42.073374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:42.073374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:42.073374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:31:42.073374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:31:42.073374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:31:42.073374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:31:42.073374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 could not be found. Aug 27 05:31:42.073374 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:42.077349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Returning 404 to user: Instance be8bceb6-cc73-4f2e-8858-e02d8fb84f37 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:31:42.079334 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-369ab874-1295-419b-a278-d6cdc8126e2f tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37" status: 404 len: 111 microversion: 2.1 time: 0.112895 Aug 27 05:31:42.081504 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3159/6316] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:41 2022] GET /compute/v2.1/servers/be8bceb6-cc73-4f2e-8858-e02d8fb84f37 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:31:42.091375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-12c74d83-cdf6-4a14-a4da-ee777931d334 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '.version_select at 0x7fb564ae84c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:42.158169 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-12c74d83-cdf6-4a14-a4da-ee777931d334 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-428524482" status: 202 len: 0 microversion: 2.1 time: 0.070915 Aug 27 05:31:42.161453 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3158/6317] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 05:31:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-428524482 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:31:43.069764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22570e83-9b5b-44b0-b2a8-ecb3e966e185 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:43.070907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22570e83-9b5b-44b0-b2a8-ecb3e966e185 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:43.090526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22570e83-9b5b-44b0-b2a8-ecb3e966e185 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:43.091435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22570e83-9b5b-44b0-b2a8-ecb3e966e185 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:43.092031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22570e83-9b5b-44b0-b2a8-ecb3e966e185 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:43.092948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22570e83-9b5b-44b0-b2a8-ecb3e966e185 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:43.093413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22570e83-9b5b-44b0-b2a8-ecb3e966e185 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:43.094030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22570e83-9b5b-44b0-b2a8-ecb3e966e185 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:43.571794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-22570e83-9b5b-44b0-b2a8-ecb3e966e185 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:43.582604 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22570e83-9b5b-44b0-b2a8-ecb3e966e185 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.516634 Aug 27 05:31:43.584519 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3160/6318] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:43 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:44.611824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-698f1cd6-15ff-4f19-9611-7e22a8cd569f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:44.613102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-698f1cd6-15ff-4f19-9611-7e22a8cd569f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:44.624325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-698f1cd6-15ff-4f19-9611-7e22a8cd569f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:44.624845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-698f1cd6-15ff-4f19-9611-7e22a8cd569f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:44.625298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-698f1cd6-15ff-4f19-9611-7e22a8cd569f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:44.626032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-698f1cd6-15ff-4f19-9611-7e22a8cd569f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:44.626503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-698f1cd6-15ff-4f19-9611-7e22a8cd569f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:44.626972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-698f1cd6-15ff-4f19-9611-7e22a8cd569f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:44.845436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-698f1cd6-15ff-4f19-9611-7e22a8cd569f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:44.856808 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-698f1cd6-15ff-4f19-9611-7e22a8cd569f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.251917 Aug 27 05:31:44.869142 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3159/6319] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:44 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:45.882775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-19dd327d-b513-4185-81dd-b6b95bac7d2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:45.888046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-19dd327d-b513-4185-81dd-b6b95bac7d2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:45.916153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19dd327d-b513-4185-81dd-b6b95bac7d2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:45.917930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19dd327d-b513-4185-81dd-b6b95bac7d2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:45.918460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19dd327d-b513-4185-81dd-b6b95bac7d2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:45.921899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19dd327d-b513-4185-81dd-b6b95bac7d2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:45.922298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19dd327d-b513-4185-81dd-b6b95bac7d2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:45.929789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19dd327d-b513-4185-81dd-b6b95bac7d2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:46.624605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-19dd327d-b513-4185-81dd-b6b95bac7d2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:46.635852 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-19dd327d-b513-4185-81dd-b6b95bac7d2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.761411 Aug 27 05:31:46.637927 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3161/6320] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:45 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:47.676455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f385fc6-895f-43b2-aec4-4f1eb136bf1a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:47.678143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1f385fc6-895f-43b2-aec4-4f1eb136bf1a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:47.690793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f385fc6-895f-43b2-aec4-4f1eb136bf1a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:47.691955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f385fc6-895f-43b2-aec4-4f1eb136bf1a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:47.692717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f385fc6-895f-43b2-aec4-4f1eb136bf1a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:47.694728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f385fc6-895f-43b2-aec4-4f1eb136bf1a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:47.695575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f385fc6-895f-43b2-aec4-4f1eb136bf1a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:47.696328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f385fc6-895f-43b2-aec4-4f1eb136bf1a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:47.900319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1f385fc6-895f-43b2-aec4-4f1eb136bf1a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:47.914582 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1f385fc6-895f-43b2-aec4-4f1eb136bf1a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.245308 Aug 27 05:31:47.916068 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3160/6321] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:47 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:48.937664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14fd0959-0a5a-4795-bdbd-ac7446d5430d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:48.938545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14fd0959-0a5a-4795-bdbd-ac7446d5430d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:48.949587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0959-0a5a-4795-bdbd-ac7446d5430d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:48.951480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0959-0a5a-4795-bdbd-ac7446d5430d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:48.952240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0959-0a5a-4795-bdbd-ac7446d5430d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:48.953331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0959-0a5a-4795-bdbd-ac7446d5430d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:48.954321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0959-0a5a-4795-bdbd-ac7446d5430d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:48.955079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fd0959-0a5a-4795-bdbd-ac7446d5430d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:49.153383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14fd0959-0a5a-4795-bdbd-ac7446d5430d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:49.164805 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14fd0959-0a5a-4795-bdbd-ac7446d5430d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.230925 Aug 27 05:31:49.166323 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3162/6322] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:48 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:50.201128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fef9f973-525f-4a3c-8ef8-882eea10f824 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:50.202784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fef9f973-525f-4a3c-8ef8-882eea10f824 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:50.222013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9f973-525f-4a3c-8ef8-882eea10f824 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:50.223044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9f973-525f-4a3c-8ef8-882eea10f824 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:50.223573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9f973-525f-4a3c-8ef8-882eea10f824 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:50.224953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9f973-525f-4a3c-8ef8-882eea10f824 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:50.225715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9f973-525f-4a3c-8ef8-882eea10f824 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:50.226592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef9f973-525f-4a3c-8ef8-882eea10f824 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:50.602502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fef9f973-525f-4a3c-8ef8-882eea10f824 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:50.619480 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fef9f973-525f-4a3c-8ef8-882eea10f824 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.421946 Aug 27 05:31:50.621161 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3161/6323] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:50 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:51.643010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9c84c6d4-2cb4-46d1-aa9d-a638c93074e9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:51.643911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9c84c6d4-2cb4-46d1-aa9d-a638c93074e9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:51.653398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c84c6d4-2cb4-46d1-aa9d-a638c93074e9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:51.656705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c84c6d4-2cb4-46d1-aa9d-a638c93074e9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:51.657291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c84c6d4-2cb4-46d1-aa9d-a638c93074e9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:51.659807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c84c6d4-2cb4-46d1-aa9d-a638c93074e9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:51.661265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c84c6d4-2cb4-46d1-aa9d-a638c93074e9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:51.661809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9c84c6d4-2cb4-46d1-aa9d-a638c93074e9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:51.903154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9c84c6d4-2cb4-46d1-aa9d-a638c93074e9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:51.929978 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9c84c6d4-2cb4-46d1-aa9d-a638c93074e9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.291662 Aug 27 05:31:51.931754 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3163/6324] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:51 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:52.736814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7dc878b0-830c-4a8a-8f7d-c59e0855cad3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:52.744591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7dc878b0-830c-4a8a-8f7d-c59e0855cad3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:52.758083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc878b0-830c-4a8a-8f7d-c59e0855cad3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:52.759282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc878b0-830c-4a8a-8f7d-c59e0855cad3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:52.760150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc878b0-830c-4a8a-8f7d-c59e0855cad3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:52.761319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc878b0-830c-4a8a-8f7d-c59e0855cad3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:52.762631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc878b0-830c-4a8a-8f7d-c59e0855cad3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:52.763888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dc878b0-830c-4a8a-8f7d-c59e0855cad3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:52.813900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7dc878b0-830c-4a8a-8f7d-c59e0855cad3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:31:52.842604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:31:52.973405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2d606744-4594-4e12-b589-050b31455e12 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:52.975782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2d606744-4594-4e12-b589-050b31455e12 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:53.023996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d606744-4594-4e12-b589-050b31455e12 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:53.023996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d606744-4594-4e12-b589-050b31455e12 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:53.025501 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7dc878b0-830c-4a8a-8f7d-c59e0855cad3 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 204 len: 0 microversion: 2.1 time: 0.303367 Aug 27 05:31:53.026097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d606744-4594-4e12-b589-050b31455e12 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:53.028417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d606744-4594-4e12-b589-050b31455e12 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:53.029736 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3162/6325] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:31:52 2022] DELETE /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:31:53.030235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d606744-4594-4e12-b589-050b31455e12 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:53.031602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d606744-4594-4e12-b589-050b31455e12 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:53.063438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d3df73bd-5e09-4fa0-b6d6-2785bf039d96 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:53.063438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d3df73bd-5e09-4fa0-b6d6-2785bf039d96 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:53.086312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3df73bd-5e09-4fa0-b6d6-2785bf039d96 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:53.088235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3df73bd-5e09-4fa0-b6d6-2785bf039d96 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:53.089132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3df73bd-5e09-4fa0-b6d6-2785bf039d96 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:53.091963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3df73bd-5e09-4fa0-b6d6-2785bf039d96 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:53.093240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3df73bd-5e09-4fa0-b6d6-2785bf039d96 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:53.094321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3df73bd-5e09-4fa0-b6d6-2785bf039d96 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:53.296061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2d606744-4594-4e12-b589-050b31455e12 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:53.313262 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2d606744-4594-4e12-b589-050b31455e12 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.353849 Aug 27 05:31:53.316154 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3164/6326] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:52 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:53.332264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d3df73bd-5e09-4fa0-b6d6-2785bf039d96 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:53.340869 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d3df73bd-5e09-4fa0-b6d6-2785bf039d96 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1509 microversion: 2.1 time: 0.306137 Aug 27 05:31:53.355612 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3163/6327] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:53 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:54.338437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba642735-489e-4979-9bdf-0cc7fcaaf69e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:54.341095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba642735-489e-4979-9bdf-0cc7fcaaf69e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:54.353605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba642735-489e-4979-9bdf-0cc7fcaaf69e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:54.357507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba642735-489e-4979-9bdf-0cc7fcaaf69e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:54.372462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a23a3630-4008-4570-af61-feb59d8f8474 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:54.374179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a23a3630-4008-4570-af61-feb59d8f8474 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:54.377807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba642735-489e-4979-9bdf-0cc7fcaaf69e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:54.381022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba642735-489e-4979-9bdf-0cc7fcaaf69e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:54.382100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba642735-489e-4979-9bdf-0cc7fcaaf69e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:54.382757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba642735-489e-4979-9bdf-0cc7fcaaf69e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:54.394256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a23a3630-4008-4570-af61-feb59d8f8474 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:54.394769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a23a3630-4008-4570-af61-feb59d8f8474 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:54.395398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a23a3630-4008-4570-af61-feb59d8f8474 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:54.396430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a23a3630-4008-4570-af61-feb59d8f8474 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:54.397610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a23a3630-4008-4570-af61-feb59d8f8474 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:54.397916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a23a3630-4008-4570-af61-feb59d8f8474 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:54.887231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a23a3630-4008-4570-af61-feb59d8f8474 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:54.907976 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a23a3630-4008-4570-af61-feb59d8f8474 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 200 len: 1509 microversion: 2.1 time: 0.547108 Aug 27 05:31:54.908350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ba642735-489e-4979-9bdf-0cc7fcaaf69e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:54.909922 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3164/6328] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:54 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 1509 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:54.930716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d9a5a227-89db-4b64-b3ad-3adb5eb9ae85 req-6b46dc50-6cee-4d13-87e7-294df93bb1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e03e5d6-756e-4532-9b5e-e8bdd38865ef", "name": "network-vif-deleted", "tag": "ef797e9a-6c46-4590-8201-2ba2d15a214d"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:31:54.933562 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba642735-489e-4979-9bdf-0cc7fcaaf69e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.601183 Aug 27 05:31:54.941156 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3165/6329] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:54 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:31:54.945626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:31:54.966873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d9a5a227-89db-4b64-b3ad-3adb5eb9ae85 req-6b46dc50-6cee-4d13-87e7-294df93bb1f8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:54.968381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d9a5a227-89db-4b64-b3ad-3adb5eb9ae85 req-6b46dc50-6cee-4d13-87e7-294df93bb1f8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:54.969443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d9a5a227-89db-4b64-b3ad-3adb5eb9ae85 req-6b46dc50-6cee-4d13-87e7-294df93bb1f8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:55.001199 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d9a5a227-89db-4b64-b3ad-3adb5eb9ae85 req-6b46dc50-6cee-4d13-87e7-294df93bb1f8 service nova] Creating event network-vif-deleted:ef797e9a-6c46-4590-8201-2ba2d15a214d for instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef on n-h1-820368-35 Aug 27 05:31:55.010498 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d9a5a227-89db-4b64-b3ad-3adb5eb9ae85 req-6b46dc50-6cee-4d13-87e7-294df93bb1f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098367 Aug 27 05:31:55.015918 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3165/6330] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:31:55.936086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:55.937048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: 2e03e5d6-756e-4532-9b5e-e8bdd38865ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:55.940575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:31:55.946740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:55.947268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:55.947788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:55.948591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:55.949056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:55.949659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:55.962726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-915f1161-ec17-4ae5-8198-71ec774b65de tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:55.963493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-915f1161-ec17-4ae5-8198-71ec774b65de tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:55.985376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-915f1161-ec17-4ae5-8198-71ec774b65de tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:55.986322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-915f1161-ec17-4ae5-8198-71ec774b65de tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:55.986449 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] HTTP exception thrown: Instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef could not be found. Aug 27 05:31:55.987162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-915f1161-ec17-4ae5-8198-71ec774b65de tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:55.988334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-915f1161-ec17-4ae5-8198-71ec774b65de tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:55.989216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-915f1161-ec17-4ae5-8198-71ec774b65de tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:55.990193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-915f1161-ec17-4ae5-8198-71ec774b65de tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Request method failure captured: Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef HTTP/1.1 Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCarXzQEeWD_yg-Yv3x-e6u_WeJK0H4zHIc0K2ifAeEz5lrEXCdSGI--LvFU55RmwGwdxJyIQb1oGJryeM85dpPE-6Bdt7QpTLIjsEre7jimq6F9GiGD3yK_ZjeKRtTqhKCIODh0xkoCo04wlC3mPfhPebArjlTk0PKLudgc3mohZyhg Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_43652021c7e84156955f4bdaf72aabba", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: f80e7dad058f44b9967a5a2f95123a9f Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef could not be found. Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '2e03e5d6-756e-4532-9b5e-e8bdd38865ef'} Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef could not be found. Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef could not be found. Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:55.991674 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:31:56.000621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:56.000621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:31:56.000621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:31:56.000621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:31:56.000621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:31:56.000621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:31:56.000621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef could not be found. Aug 27 05:31:56.000621 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:31:56.007141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Returning 404 to user: Instance 2e03e5d6-756e-4532-9b5e-e8bdd38865ef could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:31:56.007141 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0c3981ad-38d9-4e75-800f-3f8d1206b1b4 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef" status: 404 len: 111 microversion: 2.1 time: 0.074745 Aug 27 05:31:56.010435 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3166/6331] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:55 2022] GET /compute/v2.1/servers/2e03e5d6-756e-4532-9b5e-e8bdd38865ef => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:31:56.020682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c65c3e13-e47b-442f-aa22-ecc7c0a86d19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:56.022613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c65c3e13-e47b-442f-aa22-ecc7c0a86d19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:56.036565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c65c3e13-e47b-442f-aa22-ecc7c0a86d19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:56.036565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c65c3e13-e47b-442f-aa22-ecc7c0a86d19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:56.036565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c65c3e13-e47b-442f-aa22-ecc7c0a86d19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:56.038444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c65c3e13-e47b-442f-aa22-ecc7c0a86d19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:56.039269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c65c3e13-e47b-442f-aa22-ecc7c0a86d19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:56.040318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c65c3e13-e47b-442f-aa22-ecc7c0a86d19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:56.089509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c65c3e13-e47b-442f-aa22-ecc7c0a86d19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:31:56.241796 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c65c3e13-e47b-442f-aa22-ecc7c0a86d19 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 204 len: 0 microversion: 2.1 time: 0.228380 Aug 27 05:31:56.242733 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3167/6332] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:31:56 2022] DELETE /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:31:56.253890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd44580d-ae02-46a5-894b-57ff66d363a8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:56.254882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cd44580d-ae02-46a5-894b-57ff66d363a8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:56.262635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd44580d-ae02-46a5-894b-57ff66d363a8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:56.263605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd44580d-ae02-46a5-894b-57ff66d363a8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:56.264381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd44580d-ae02-46a5-894b-57ff66d363a8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:56.265985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd44580d-ae02-46a5-894b-57ff66d363a8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:56.266709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd44580d-ae02-46a5-894b-57ff66d363a8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:56.267529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd44580d-ae02-46a5-894b-57ff66d363a8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:56.299873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-915f1161-ec17-4ae5-8198-71ec774b65de tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:56.308833 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-915f1161-ec17-4ae5-8198-71ec774b65de tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.351561 Aug 27 05:31:56.310088 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3166/6333] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:55 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:31:56.471966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cd44580d-ae02-46a5-894b-57ff66d363a8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:56.496086 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cd44580d-ae02-46a5-894b-57ff66d363a8 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.247879 Aug 27 05:31:56.497782 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3168/6334] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:56 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:57.342866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c88f8614-b635-49ab-8e8b-b74cbf7842bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:57.344746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c88f8614-b635-49ab-8e8b-b74cbf7842bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:57.357204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c88f8614-b635-49ab-8e8b-b74cbf7842bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:57.357755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c88f8614-b635-49ab-8e8b-b74cbf7842bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:57.358522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c88f8614-b635-49ab-8e8b-b74cbf7842bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:57.359301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c88f8614-b635-49ab-8e8b-b74cbf7842bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:57.359773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c88f8614-b635-49ab-8e8b-b74cbf7842bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:57.360211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c88f8614-b635-49ab-8e8b-b74cbf7842bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:57.538400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-113aa9b6-9a34-4ca6-9999-2e3c37752ea9 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:57.539582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-113aa9b6-9a34-4ca6-9999-2e3c37752ea9 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:57.540077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c88f8614-b635-49ab-8e8b-b74cbf7842bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:57.551529 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c88f8614-b635-49ab-8e8b-b74cbf7842bf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.214533 Aug 27 05:31:57.552353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-113aa9b6-9a34-4ca6-9999-2e3c37752ea9 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:57.552999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-113aa9b6-9a34-4ca6-9999-2e3c37752ea9 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:57.559010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-113aa9b6-9a34-4ca6-9999-2e3c37752ea9 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:57.559010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-113aa9b6-9a34-4ca6-9999-2e3c37752ea9 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:57.559010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-113aa9b6-9a34-4ca6-9999-2e3c37752ea9 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:57.559010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-113aa9b6-9a34-4ca6-9999-2e3c37752ea9 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:57.565840 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3167/6335] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:57 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:57.816446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-113aa9b6-9a34-4ca6-9999-2e3c37752ea9 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:57.827858 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-113aa9b6-9a34-4ca6-9999-2e3c37752ea9 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.296964 Aug 27 05:31:57.839735 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3169/6336] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:57 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:31:58.575621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-00b5f21c-881a-4246-aef8-df867df24ea9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:58.576765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-00b5f21c-881a-4246-aef8-df867df24ea9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:58.587592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b5f21c-881a-4246-aef8-df867df24ea9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:58.588617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b5f21c-881a-4246-aef8-df867df24ea9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:58.589397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b5f21c-881a-4246-aef8-df867df24ea9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:58.590795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b5f21c-881a-4246-aef8-df867df24ea9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:58.591785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b5f21c-881a-4246-aef8-df867df24ea9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:58.592697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b5f21c-881a-4246-aef8-df867df24ea9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:58.838697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-00b5f21c-881a-4246-aef8-df867df24ea9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:58.854825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ef848ba-6574-4964-bc4b-962023b0671e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:58.856764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ef848ba-6574-4964-bc4b-962023b0671e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:58.865635 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-00b5f21c-881a-4246-aef8-df867df24ea9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.285206 Aug 27 05:31:58.871133 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3168/6337] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:58 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:31:58.890124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef848ba-6574-4964-bc4b-962023b0671e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:58.897252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef848ba-6574-4964-bc4b-962023b0671e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:58.900195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef848ba-6574-4964-bc4b-962023b0671e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:58.905461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef848ba-6574-4964-bc4b-962023b0671e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:58.906502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef848ba-6574-4964-bc4b-962023b0671e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:58.907734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef848ba-6574-4964-bc4b-962023b0671e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:59.167123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1ef848ba-6574-4964-bc4b-962023b0671e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:31:59.182595 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ef848ba-6574-4964-bc4b-962023b0671e tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1521 microversion: 2.1 time: 0.333258 Aug 27 05:31:59.195976 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3170/6338] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:58 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:31:59.622723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6d408cd9-6a34-4cd6-9561-f654d00f4b8f req-06d58424-8c27-4b91-b697-87497301ba82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5f3e93-46ed-46f2-87c0-fffa21768054", "name": "network-vif-deleted", "tag": "fae9025b-5089-43bd-9fca-bf7a53a79ed4"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:31:59.635614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6d408cd9-6a34-4cd6-9561-f654d00f4b8f req-06d58424-8c27-4b91-b697-87497301ba82 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:59.636530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6d408cd9-6a34-4cd6-9561-f654d00f4b8f req-06d58424-8c27-4b91-b697-87497301ba82 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:59.637298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6d408cd9-6a34-4cd6-9561-f654d00f4b8f req-06d58424-8c27-4b91-b697-87497301ba82 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:59.667310 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6d408cd9-6a34-4cd6-9561-f654d00f4b8f req-06d58424-8c27-4b91-b697-87497301ba82 service nova] Creating event network-vif-deleted:fae9025b-5089-43bd-9fca-bf7a53a79ed4 for instance dc5f3e93-46ed-46f2-87c0-fffa21768054 on n-h2-820368-35 Aug 27 05:31:59.679899 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6d408cd9-6a34-4cd6-9561-f654d00f4b8f req-06d58424-8c27-4b91-b697-87497301ba82 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060472 Aug 27 05:31:59.682010 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3169/6339] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:31:59.904018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-703f093a-1a41-4da5-b98a-b7deb1b1737e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:31:59.911274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-703f093a-1a41-4da5-b98a-b7deb1b1737e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:31:59.944328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-703f093a-1a41-4da5-b98a-b7deb1b1737e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:59.948451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-703f093a-1a41-4da5-b98a-b7deb1b1737e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:59.950268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-703f093a-1a41-4da5-b98a-b7deb1b1737e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:31:59.956784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-703f093a-1a41-4da5-b98a-b7deb1b1737e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:31:59.960695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-703f093a-1a41-4da5-b98a-b7deb1b1737e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:31:59.962768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-703f093a-1a41-4da5-b98a-b7deb1b1737e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:00.337479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:00.337479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:00.337479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:00.337479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:00.337479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:00.337479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:00.337479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:00.337479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:00.423176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:00.424143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:00.432659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:00.439000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lazy-loading 'fault' on Instance uuid dc5f3e93-46ed-46f2-87c0-fffa21768054 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:32:00.469509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-703f093a-1a41-4da5-b98a-b7deb1b1737e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:00.484763 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-703f093a-1a41-4da5-b98a-b7deb1b1737e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.595131 Aug 27 05:32:00.485783 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3171/6340] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:31:59 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:00.632459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80e7dad058f44b9967a5a2f95123a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43652021c7e84156955f4bdaf72aabba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:00.656984 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-49ca819f-e071-4fc0-8d22-2b36685a8e55 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 200 len: 1311 microversion: 2.1 time: 0.437953 Aug 27 05:32:00.658535 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3170/6341] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:00 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 1311 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:01.515325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d3d9a105-28d1-4b6f-ac2d-9e0bbe668f1b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:01.524595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d3d9a105-28d1-4b6f-ac2d-9e0bbe668f1b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:01.531159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d9a105-28d1-4b6f-ac2d-9e0bbe668f1b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:01.531781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d9a105-28d1-4b6f-ac2d-9e0bbe668f1b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:01.532234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d9a105-28d1-4b6f-ac2d-9e0bbe668f1b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:01.532980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d9a105-28d1-4b6f-ac2d-9e0bbe668f1b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:01.533498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d9a105-28d1-4b6f-ac2d-9e0bbe668f1b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:01.534134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d3d9a105-28d1-4b6f-ac2d-9e0bbe668f1b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:01.684305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:01.685729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] [instance: dc5f3e93-46ed-46f2-87c0-fffa21768054] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:01.701342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:01.704445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:01.705226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:01.706832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:01.711001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:01.711780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:01.738732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d3d9a105-28d1-4b6f-ac2d-9e0bbe668f1b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:01.741262 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] HTTP exception thrown: Instance dc5f3e93-46ed-46f2-87c0-fffa21768054 could not be found. Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Request method failure captured: Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 HTTP/1.1 Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCarXzQEeWD_yg-Yv3x-e6u_WeJK0H4zHIc0K2ifAeEz5lrEXCdSGI--LvFU55RmwGwdxJyIQb1oGJryeM85dpPE-6Bdt7QpTLIjsEre7jimq6F9GiGD3yK_ZjeKRtTqhKCIODh0xkoCo04wlC3mPfhPebArjlTk0PKLudgc3mohZyhg Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_43652021c7e84156955f4bdaf72aabba", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/43652021c7e84156955f4bdaf72aabba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 43652021c7e84156955f4bdaf72aabba Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-198571360 Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: f80e7dad058f44b9967a5a2f95123a9f Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-198571360-project Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance dc5f3e93-46ed-46f2-87c0-fffa21768054 could not be found. Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'dc5f3e93-46ed-46f2-87c0-fffa21768054'} Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5f3e93-46ed-46f2-87c0-fffa21768054 could not be found. Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5f3e93-46ed-46f2-87c0-fffa21768054 could not be found. Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:01.744606 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:01.748317 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:01.748317 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:01.748317 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:01.748317 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:01.748317 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:32:01.748317 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:32:01.748317 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5f3e93-46ed-46f2-87c0-fffa21768054 could not be found. Aug 27 05:32:01.748317 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:01.751487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] Returning 404 to user: Instance dc5f3e93-46ed-46f2-87c0-fffa21768054 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:32:01.753876 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-00b590ee-c1ba-4232-9ad0-998ed3cb6e32 tempest-ServerRescueNegativeTestJSON-198571360 tempest-ServerRescueNegativeTestJSON-198571360-project] 10.222.0.58 "GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054" status: 404 len: 111 microversion: 2.1 time: 0.074106 Aug 27 05:32:01.754707 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d3d9a105-28d1-4b6f-ac2d-9e0bbe668f1b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.251754 Aug 27 05:32:01.755556 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3172/6342] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:01 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:32:01.755764 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3171/6343] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:01 2022] GET /compute/v2.1/servers/dc5f3e93-46ed-46f2-87c0-fffa21768054 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:32:02.792007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3c02827-0b55-426c-9d07-94962a71df15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:02.792645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e3c02827-0b55-426c-9d07-94962a71df15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:02.811011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3c02827-0b55-426c-9d07-94962a71df15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:02.811560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3c02827-0b55-426c-9d07-94962a71df15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:02.812021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3c02827-0b55-426c-9d07-94962a71df15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:02.812761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3c02827-0b55-426c-9d07-94962a71df15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:02.813239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3c02827-0b55-426c-9d07-94962a71df15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:02.813678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3c02827-0b55-426c-9d07-94962a71df15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:03.137322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e3c02827-0b55-426c-9d07-94962a71df15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:03.148025 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e3c02827-0b55-426c-9d07-94962a71df15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1169 microversion: 2.1 time: 0.359884 Aug 27 05:32:03.164414 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3173/6344] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:02 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1169 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:04.179078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01b33932-fdb9-4a8e-bb9e-e03556bc3115 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:04.180780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-01b33932-fdb9-4a8e-bb9e-e03556bc3115 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:04.191398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01b33932-fdb9-4a8e-bb9e-e03556bc3115 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:04.192173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01b33932-fdb9-4a8e-bb9e-e03556bc3115 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:04.193068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01b33932-fdb9-4a8e-bb9e-e03556bc3115 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:04.194999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01b33932-fdb9-4a8e-bb9e-e03556bc3115 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:04.195973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01b33932-fdb9-4a8e-bb9e-e03556bc3115 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:04.196851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01b33932-fdb9-4a8e-bb9e-e03556bc3115 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:04.488889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-01b33932-fdb9-4a8e-bb9e-e03556bc3115 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:04.501427 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01b33932-fdb9-4a8e-bb9e-e03556bc3115 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1203 microversion: 2.1 time: 0.331860 Aug 27 05:32:04.503177 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3172/6345] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:04 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1203 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:05.535980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b090510d-59ea-45c3-b8e3-443fcf422e77 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:05.537975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b090510d-59ea-45c3-b8e3-443fcf422e77 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:05.569916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b090510d-59ea-45c3-b8e3-443fcf422e77 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:05.570751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b090510d-59ea-45c3-b8e3-443fcf422e77 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:05.583629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b090510d-59ea-45c3-b8e3-443fcf422e77 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:05.584858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b090510d-59ea-45c3-b8e3-443fcf422e77 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:05.585540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b090510d-59ea-45c3-b8e3-443fcf422e77 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:05.586371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b090510d-59ea-45c3-b8e3-443fcf422e77 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:05.592587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:06.753517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b090510d-59ea-45c3-b8e3-443fcf422e77 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:06.766730 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b090510d-59ea-45c3-b8e3-443fcf422e77 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1203 microversion: 2.1 time: 1.234652 Aug 27 05:32:06.780691 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3174/6346] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:05 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1203 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:07.289776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5e51f83e-3dcf-4773-8760-0aefb269d69a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:07.290513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5e51f83e-3dcf-4773-8760-0aefb269d69a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:07.303632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e51f83e-3dcf-4773-8760-0aefb269d69a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:07.304145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e51f83e-3dcf-4773-8760-0aefb269d69a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:07.309131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e51f83e-3dcf-4773-8760-0aefb269d69a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:07.309131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e51f83e-3dcf-4773-8760-0aefb269d69a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:07.313605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e51f83e-3dcf-4773-8760-0aefb269d69a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:07.314082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5e51f83e-3dcf-4773-8760-0aefb269d69a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:07.517899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-5e51f83e-3dcf-4773-8760-0aefb269d69a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lazy-loading 'services' on Instance uuid e6a68fe3-998d-48a4-bb1b-38b743a81bd2 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:32:07.661886 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5e51f83e-3dcf-4773-8760-0aefb269d69a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/os-volume_attachments/61b6452d-e3c5-4a1a-9954-e59cfbe8da9c" status: 202 len: 0 microversion: 2.1 time: 0.376123 Aug 27 05:32:07.671564 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3173/6347] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:32:07 2022] DELETE /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/os-volume_attachments/61b6452d-e3c5-4a1a-9954-e59cfbe8da9c => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:32:07.794059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a3129292-896b-4161-a86d-c505920b5c64 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:07.794740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a3129292-896b-4161-a86d-c505920b5c64 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:07.841409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3129292-896b-4161-a86d-c505920b5c64 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:07.844944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3129292-896b-4161-a86d-c505920b5c64 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:07.850716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3129292-896b-4161-a86d-c505920b5c64 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:07.856872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3129292-896b-4161-a86d-c505920b5c64 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:07.861643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3129292-896b-4161-a86d-c505920b5c64 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:07.862141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a3129292-896b-4161-a86d-c505920b5c64 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:08.272437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a3129292-896b-4161-a86d-c505920b5c64 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:08.298289 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a3129292-896b-4161-a86d-c505920b5c64 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1203 microversion: 2.1 time: 0.509918 Aug 27 05:32:08.300786 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3175/6348] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:07 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1203 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:09.339077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-957001f2-7cdb-483d-9ac9-15a691218ede tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:09.340595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-957001f2-7cdb-483d-9ac9-15a691218ede tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:09.398085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-957001f2-7cdb-483d-9ac9-15a691218ede tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:09.402448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-957001f2-7cdb-483d-9ac9-15a691218ede tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:09.403560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-957001f2-7cdb-483d-9ac9-15a691218ede tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:09.404926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-957001f2-7cdb-483d-9ac9-15a691218ede tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:09.405820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-957001f2-7cdb-483d-9ac9-15a691218ede tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:09.406561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-957001f2-7cdb-483d-9ac9-15a691218ede tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:09.811390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-957001f2-7cdb-483d-9ac9-15a691218ede tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:09.828238 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-957001f2-7cdb-483d-9ac9-15a691218ede tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1203 microversion: 2.1 time: 0.505984 Aug 27 05:32:09.829668 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3174/6349] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:09 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1203 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:10.895030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-36b679da-6881-42cc-b858-d8102228e887 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:10.900665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-36b679da-6881-42cc-b858-d8102228e887 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:10.928319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b679da-6881-42cc-b858-d8102228e887 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:10.929544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b679da-6881-42cc-b858-d8102228e887 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:10.931960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b679da-6881-42cc-b858-d8102228e887 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:10.935910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b679da-6881-42cc-b858-d8102228e887 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:10.939208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b679da-6881-42cc-b858-d8102228e887 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:10.940257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b679da-6881-42cc-b858-d8102228e887 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:11.257647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-36b679da-6881-42cc-b858-d8102228e887 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:11.273772 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-36b679da-6881-42cc-b858-d8102228e887 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1203 microversion: 2.1 time: 0.420572 Aug 27 05:32:11.275620 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3176/6350] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:10 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1203 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:12.300971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1902369a-9765-4137-a096-bb345c221582 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:12.303209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1902369a-9765-4137-a096-bb345c221582 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:12.328257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1902369a-9765-4137-a096-bb345c221582 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:12.330177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1902369a-9765-4137-a096-bb345c221582 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:12.336336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1902369a-9765-4137-a096-bb345c221582 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:12.341225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1902369a-9765-4137-a096-bb345c221582 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:12.344545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1902369a-9765-4137-a096-bb345c221582 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:12.345513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1902369a-9765-4137-a096-bb345c221582 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:12.837683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1902369a-9765-4137-a096-bb345c221582 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:12.848240 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1902369a-9765-4137-a096-bb345c221582 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1203 microversion: 2.1 time: 0.551676 Aug 27 05:32:12.854948 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3175/6351] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:12 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1203 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:13.889002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c42b89d4-b272-4f73-9d5b-a651f5ab8ff2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:13.889780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c42b89d4-b272-4f73-9d5b-a651f5ab8ff2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:13.908730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42b89d4-b272-4f73-9d5b-a651f5ab8ff2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:13.909210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42b89d4-b272-4f73-9d5b-a651f5ab8ff2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:13.909783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42b89d4-b272-4f73-9d5b-a651f5ab8ff2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:13.910673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42b89d4-b272-4f73-9d5b-a651f5ab8ff2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:13.911075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42b89d4-b272-4f73-9d5b-a651f5ab8ff2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:13.912202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c42b89d4-b272-4f73-9d5b-a651f5ab8ff2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:14.093682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-057696a3-833c-425f-84a1-c059ab6b3774 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Action: 'create', calling method: .version_select at 0x7fb564843670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1097118771", "metadata": {"Type": "work"}}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:14.202767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c42b89d4-b272-4f73-9d5b-a651f5ab8ff2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:14.218575 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c42b89d4-b272-4f73-9d5b-a651f5ab8ff2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1203 microversion: 2.1 time: 0.333595 Aug 27 05:32:14.220046 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3176/6352] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:13 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1203 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:15.103279 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-057696a3-833c-425f-84a1-c059ab6b3774 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.302798 Aug 27 05:32:15.114423 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3177/6353] 10.222.0.58 () {60 vars in 1156 bytes} [Sat Aug 27 05:32:13 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1305 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 05:32:15.123582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-508f50d5-dc3b-412f-b1d5-157137888ba8 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Calling method '.version_select at 0x7fb56506dd30>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:15.244551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d262b877-756d-4bbf-987a-bc32acc61859 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:15.246339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d262b877-756d-4bbf-987a-bc32acc61859 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:15.261917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d262b877-756d-4bbf-987a-bc32acc61859 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:15.263132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d262b877-756d-4bbf-987a-bc32acc61859 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:15.263911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d262b877-756d-4bbf-987a-bc32acc61859 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:15.265514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d262b877-756d-4bbf-987a-bc32acc61859 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:15.269074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d262b877-756d-4bbf-987a-bc32acc61859 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:15.270392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d262b877-756d-4bbf-987a-bc32acc61859 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:15.271899 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-508f50d5-dc3b-412f-b1d5-157137888ba8 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9" status: 200 len: 353 microversion: 2.1 time: 0.154847 Aug 27 05:32:15.273402 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3177/6354] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:32:15 2022] GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:15.655550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d262b877-756d-4bbf-987a-bc32acc61859 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:15.683002 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d262b877-756d-4bbf-987a-bc32acc61859 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1203 microversion: 2.1 time: 0.443660 Aug 27 05:32:15.689935 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3178/6355] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:15 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1203 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:16.302738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e7154bd-0caf-4b6d-a0b4-6b83b7123c48 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Calling method '.version_select at 0x7fb565413ca0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:16.619320 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9e7154bd-0caf-4b6d-a0b4-6b83b7123c48 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9" status: 200 len: 353 microversion: 2.1 time: 0.330202 Aug 27 05:32:16.621229 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3178/6356] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:32:16 2022] GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 => generated 353 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:16.739640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f139c632-8636-4309-9b55-de81e91b80d4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:16.746785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f139c632-8636-4309-9b55-de81e91b80d4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:16.794583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f139c632-8636-4309-9b55-de81e91b80d4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:16.795337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f139c632-8636-4309-9b55-de81e91b80d4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:16.796130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f139c632-8636-4309-9b55-de81e91b80d4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:16.797396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f139c632-8636-4309-9b55-de81e91b80d4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:16.798228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f139c632-8636-4309-9b55-de81e91b80d4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:16.804300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f139c632-8636-4309-9b55-de81e91b80d4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:16.930879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-fe189987-36b3-4a79-960e-4c9f7068d659 req-a60833c6-f776-4620-98df-794f51b434d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57ba86d-b2e0-4524-a40d-967e6d55bdfb", "name": "network-vif-plugged", "status": "completed", "tag": "b9dff5fe-a03b-41c7-9cc6-0c248096eecd"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:17.023990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fe189987-36b3-4a79-960e-4c9f7068d659 req-a60833c6-f776-4620-98df-794f51b434d5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:17.033291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fe189987-36b3-4a79-960e-4c9f7068d659 req-a60833c6-f776-4620-98df-794f51b434d5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:17.034975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fe189987-36b3-4a79-960e-4c9f7068d659 req-a60833c6-f776-4620-98df-794f51b434d5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:17.120932 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-fe189987-36b3-4a79-960e-4c9f7068d659 req-a60833c6-f776-4620-98df-794f51b434d5 service nova] Creating event network-vif-plugged:b9dff5fe-a03b-41c7-9cc6-0c248096eecd for instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb on n-h1-820368-35 Aug 27 05:32:17.137908 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-fe189987-36b3-4a79-960e-4c9f7068d659 req-a60833c6-f776-4620-98df-794f51b434d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214082 Aug 27 05:32:17.144645 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3179/6357] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:17.174948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f139c632-8636-4309-9b55-de81e91b80d4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:17.191146 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f139c632-8636-4309-9b55-de81e91b80d4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1203 microversion: 2.1 time: 0.465496 Aug 27 05:32:17.193454 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3179/6358] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:16 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1203 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:17.643982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-50f27e60-a0a6-44b4-bbc1-6fe4dbe9bc10 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Calling method '.version_select at 0x7fb5645724c0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:17.733336 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-50f27e60-a0a6-44b4-bbc1-6fe4dbe9bc10 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9" status: 200 len: 354 microversion: 2.1 time: 0.094592 Aug 27 05:32:17.735147 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3180/6359] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:32:17 2022] GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:17.749009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ae174411-2b36-48a9-b493-e70148bddf07 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Calling method '.version_select at 0x7fb5652e1dc0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:17.839992 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ae174411-2b36-48a9-b493-e70148bddf07 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9" status: 200 len: 354 microversion: 2.1 time: 0.095172 Aug 27 05:32:17.841228 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3180/6360] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:32:17 2022] GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:17.880945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8cb82e2a-0baf-490a-9c1b-a9776555ef64 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Calling method '.version_select at 0x7fb564ed5700>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:18.026710 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8cb82e2a-0baf-490a-9c1b-a9776555ef64 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9" status: 202 len: 0 microversion: 2.1 time: 0.153529 Aug 27 05:32:18.028396 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3181/6361] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:32:17 2022] DELETE /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:32:18.051873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6778e768-6110-4ad3-8847-f58925165b7d tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Calling method '.version_select at 0x7fb565008af0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:18.185571 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6778e768-6110-4ad3-8847-f58925165b7d tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9" status: 200 len: 353 microversion: 2.1 time: 0.140156 Aug 27 05:32:18.186169 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3181/6362] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:32:18 2022] GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:32:18.214064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-55ea246e-8939-4980-bbea-42b087f8739e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:18.214763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-55ea246e-8939-4980-bbea-42b087f8739e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:18.223683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ea246e-8939-4980-bbea-42b087f8739e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:18.224237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ea246e-8939-4980-bbea-42b087f8739e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:18.224685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ea246e-8939-4980-bbea-42b087f8739e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:18.225427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ea246e-8939-4980-bbea-42b087f8739e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:18.225898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ea246e-8939-4980-bbea-42b087f8739e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:18.226335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ea246e-8939-4980-bbea-42b087f8739e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:18.400095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d309dcd-93c6-487e-8f74-b0762e186ad9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:18.417710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d309dcd-93c6-487e-8f74-b0762e186ad9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:18.419910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d309dcd-93c6-487e-8f74-b0762e186ad9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:18.422406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d309dcd-93c6-487e-8f74-b0762e186ad9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:18.515242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d309dcd-93c6-487e-8f74-b0762e186ad9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Going to try to stop instance {{(pid=128547) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:32:18.581726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-55ea246e-8939-4980-bbea-42b087f8739e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:18.590160 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-55ea246e-8939-4980-bbea-42b087f8739e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1203 microversion: 2.1 time: 0.380183 Aug 27 05:32:18.590754 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3182/6363] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:18 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1203 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:32:18.643030 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d309dcd-93c6-487e-8f74-b0762e186ad9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "POST /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.247523 Aug 27 05:32:18.644906 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3182/6364] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:32:18 2022] POST /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:32:18.652991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ef49928f-4cd8-462f-8af5-3728ee26b4f7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:18.654273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ef49928f-4cd8-462f-8af5-3728ee26b4f7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:18.664372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef49928f-4cd8-462f-8af5-3728ee26b4f7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:18.665827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef49928f-4cd8-462f-8af5-3728ee26b4f7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:18.666769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef49928f-4cd8-462f-8af5-3728ee26b4f7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:18.668277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef49928f-4cd8-462f-8af5-3728ee26b4f7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:18.669784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef49928f-4cd8-462f-8af5-3728ee26b4f7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:18.670882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef49928f-4cd8-462f-8af5-3728ee26b4f7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:19.008284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ef49928f-4cd8-462f-8af5-3728ee26b4f7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:19.020288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:19.030467 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ef49928f-4cd8-462f-8af5-3728ee26b4f7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1677 microversion: 2.1 time: 0.380069 Aug 27 05:32:19.032351 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3183/6365] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:18 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1677 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:19.211788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2c908150-e110-43ba-a5d4-421c8dc82cca tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Calling method '.version_select at 0x7fb56963df70>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:19.317223 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2c908150-e110-43ba-a5d4-421c8dc82cca tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9" status: 200 len: 353 microversion: 2.1 time: 0.116536 Aug 27 05:32:19.319133 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3183/6366] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:32:19 2022] GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:19.625817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-28a63b9a-5f52-4c11-9e23-ef971da21957 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:19.626526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-28a63b9a-5f52-4c11-9e23-ef971da21957 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:19.650065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a63b9a-5f52-4c11-9e23-ef971da21957 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:19.650587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a63b9a-5f52-4c11-9e23-ef971da21957 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:19.651241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a63b9a-5f52-4c11-9e23-ef971da21957 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:19.652158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a63b9a-5f52-4c11-9e23-ef971da21957 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:19.652774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a63b9a-5f52-4c11-9e23-ef971da21957 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:19.653357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a63b9a-5f52-4c11-9e23-ef971da21957 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:20.008305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-28a63b9a-5f52-4c11-9e23-ef971da21957 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:20.024427 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-28a63b9a-5f52-4c11-9e23-ef971da21957 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1390 microversion: 2.1 time: 0.404016 Aug 27 05:32:20.026152 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3184/6367] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:19 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1390 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:20.057959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad450e72-261f-4aeb-8179-200ae6125e32 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:20.059194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ad450e72-261f-4aeb-8179-200ae6125e32 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:20.061000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7303f5bd-1399-4564-b02d-9df9133adc12 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:20.062013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7303f5bd-1399-4564-b02d-9df9133adc12 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:20.073295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad450e72-261f-4aeb-8179-200ae6125e32 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:20.074105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad450e72-261f-4aeb-8179-200ae6125e32 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:20.074858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad450e72-261f-4aeb-8179-200ae6125e32 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:20.076068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad450e72-261f-4aeb-8179-200ae6125e32 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:20.076400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7303f5bd-1399-4564-b02d-9df9133adc12 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:20.077515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7303f5bd-1399-4564-b02d-9df9133adc12 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:20.078199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7303f5bd-1399-4564-b02d-9df9133adc12 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:20.079516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7303f5bd-1399-4564-b02d-9df9133adc12 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:20.080233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7303f5bd-1399-4564-b02d-9df9133adc12 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:20.080867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7303f5bd-1399-4564-b02d-9df9133adc12 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:20.100447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad450e72-261f-4aeb-8179-200ae6125e32 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:20.102551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad450e72-261f-4aeb-8179-200ae6125e32 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:20.439778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7303f5bd-1399-4564-b02d-9df9133adc12 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:20.457775 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7303f5bd-1399-4564-b02d-9df9133adc12 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1677 microversion: 2.1 time: 0.403007 Aug 27 05:32:20.460117 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3185/6368] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:20 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1677 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:20.467727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-245bc981-e8b7-4d3e-9f78-e0b7fdfe95f2 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Calling method '.version_select at 0x7fb5650c78b0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:20.491563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ad450e72-261f-4aeb-8179-200ae6125e32 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:20.505968 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ad450e72-261f-4aeb-8179-200ae6125e32 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1390 microversion: 2.1 time: 0.453322 Aug 27 05:32:20.507569 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3184/6369] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:20 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1390 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:20.556338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d851c7cd-7ab1-46ee-8421-cdbf56a507a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:20.557320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d851c7cd-7ab1-46ee-8421-cdbf56a507a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:20.587569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d851c7cd-7ab1-46ee-8421-cdbf56a507a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:20.588582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d851c7cd-7ab1-46ee-8421-cdbf56a507a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:20.590728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d851c7cd-7ab1-46ee-8421-cdbf56a507a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:20.592728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d851c7cd-7ab1-46ee-8421-cdbf56a507a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:20.594460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d851c7cd-7ab1-46ee-8421-cdbf56a507a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:20.597751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d851c7cd-7ab1-46ee-8421-cdbf56a507a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:20.613535 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-245bc981-e8b7-4d3e-9f78-e0b7fdfe95f2 tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9" status: 200 len: 353 microversion: 2.1 time: 0.151456 Aug 27 05:32:20.614273 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3186/6370] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:32:20 2022] GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:20.899338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d851c7cd-7ab1-46ee-8421-cdbf56a507a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:20.913164 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d851c7cd-7ab1-46ee-8421-cdbf56a507a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1390 microversion: 2.1 time: 0.361764 Aug 27 05:32:20.914555 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3185/6371] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:20 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1390 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:32:21.045603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-de51129a-a158-4f5d-89a9-86d78703cc05 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:21.046279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-de51129a-a158-4f5d-89a9-86d78703cc05 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:21.069210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de51129a-a158-4f5d-89a9-86d78703cc05 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:21.073043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de51129a-a158-4f5d-89a9-86d78703cc05 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:21.073878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de51129a-a158-4f5d-89a9-86d78703cc05 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:21.075480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de51129a-a158-4f5d-89a9-86d78703cc05 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:21.076509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de51129a-a158-4f5d-89a9-86d78703cc05 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:21.077377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de51129a-a158-4f5d-89a9-86d78703cc05 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:21.113418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-de51129a-a158-4f5d-89a9-86d78703cc05 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:32:21.339360 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-de51129a-a158-4f5d-89a9-86d78703cc05 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 204 len: 0 microversion: 2.1 time: 0.298649 Aug 27 05:32:21.341011 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3187/6372] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:32:21 2022] DELETE /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:32:21.355593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cbe93480-4984-4b19-960d-88a543ebe6c7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:21.357119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cbe93480-4984-4b19-960d-88a543ebe6c7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:21.370945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbe93480-4984-4b19-960d-88a543ebe6c7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:21.371955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbe93480-4984-4b19-960d-88a543ebe6c7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:21.372619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbe93480-4984-4b19-960d-88a543ebe6c7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:21.373743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbe93480-4984-4b19-960d-88a543ebe6c7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:21.374462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbe93480-4984-4b19-960d-88a543ebe6c7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:21.375122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbe93480-4984-4b19-960d-88a543ebe6c7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:21.490913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d26b7e3a-15f3-479f-9c3f-b861f67c23f3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:21.492934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d26b7e3a-15f3-479f-9c3f-b861f67c23f3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:21.517164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d26b7e3a-15f3-479f-9c3f-b861f67c23f3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:21.518624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d26b7e3a-15f3-479f-9c3f-b861f67c23f3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:21.519527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d26b7e3a-15f3-479f-9c3f-b861f67c23f3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:21.537362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d26b7e3a-15f3-479f-9c3f-b861f67c23f3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:21.537362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d26b7e3a-15f3-479f-9c3f-b861f67c23f3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:21.537362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d26b7e3a-15f3-479f-9c3f-b861f67c23f3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:21.941025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cbe93480-4984-4b19-960d-88a543ebe6c7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:21.955852 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cbe93480-4984-4b19-960d-88a543ebe6c7 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1396 microversion: 2.1 time: 0.608548 Aug 27 05:32:21.957119 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3186/6373] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:21 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1396 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:21.972484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-43a4790e-8646-424e-b793-27c7587d58ef tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Calling method '.version_select at 0x7fb56512cee0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:22.077939 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-43a4790e-8646-424e-b793-27c7587d58ef tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] HTTP exception thrown: Volume ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 could not be found. Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-43a4790e-8646-424e-b793-27c7587d58ef tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Request method failure captured: Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 HTTP/1.1 Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaxdeBRR08pJ5ircBc-dcOv-g1P6COD_hGF3YeX6kZ3lfeq2HEgiB5GVw09j8RCnvbnNlbJtJ3btK2JaHeRVC9ycJz188VqETjMm7i30WIU_EZxPwnfCSBi7Ax7AqNPJaEXrx8IGnQcDRn6gHoT7GT6E0D6JE2DGdI0t3AA7iIGluh8 Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: caccd6c21c5e42a3a7cfdf9a9e958b99 Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-VolumesGetTestJSON-564674028 Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_caccd6c21c5e42a3a7cfdf9a9e958b99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/caccd6c21c5e42a3a7cfdf9a9e958b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/caccd6c21c5e42a3a7cfdf9a9e958b99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/caccd6c21c5e42a3a7cfdf9a9e958b99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-VolumesGetTestJSON-564674028 Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: caccd6c21c5e42a3a7cfdf9a9e958b99 Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-VolumesGetTestJSON-564674028 Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-VolumesGetTestJSON-564674028-project Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 1c3ef4d32cfb4b1383c411615e961083 Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-VolumesGetTestJSON-564674028-project Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: method: Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: exception: Volume ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 could not be found. Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'ebb57022-7c12-4816-8ab6-c8cb8bcdcca9'} Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 could not be found. (HTTP 404) (Request-ID: req-90917926-cdac-4c97-a274-8798c14c9a47) Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 05:32:22.080059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 could not be found. Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 could not be found. Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 could not be found. Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-43a4790e-8646-424e-b793-27c7587d58ef tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] Returning 404 to user: Volume ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-43a4790e-8646-424e-b793-27c7587d58ef tempest-VolumesGetTestJSON-564674028 tempest-VolumesGetTestJSON-564674028-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9" status: 404 len: 109 microversion: 2.1 time: 0.123249 Aug 27 05:32:22.084438 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3187/6374] 10.222.0.58 () {58 vars in 1245 bytes} [Sat Aug 27 05:32:21 2022] GET /compute/v2.1/os-volumes/ebb57022-7c12-4816-8ab6-c8cb8bcdcca9 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:32:22.092244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d26b7e3a-15f3-479f-9c3f-b861f67c23f3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:22.111302 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d26b7e3a-15f3-479f-9c3f-b861f67c23f3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1677 microversion: 2.1 time: 0.628969 Aug 27 05:32:22.131227 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3188/6375] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:21 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1677 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:23.000080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fc5e4d7a-8caf-4de8-83f4-d1bde3c402c6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:23.002625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fc5e4d7a-8caf-4de8-83f4-d1bde3c402c6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:23.014235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc5e4d7a-8caf-4de8-83f4-d1bde3c402c6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:23.015800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc5e4d7a-8caf-4de8-83f4-d1bde3c402c6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:23.017202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc5e4d7a-8caf-4de8-83f4-d1bde3c402c6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:23.018573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc5e4d7a-8caf-4de8-83f4-d1bde3c402c6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:23.020031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc5e4d7a-8caf-4de8-83f4-d1bde3c402c6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:23.021977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc5e4d7a-8caf-4de8-83f4-d1bde3c402c6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:23.154213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5a48cad8-52ae-4602-b689-6b161003fdd5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:23.156080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5a48cad8-52ae-4602-b689-6b161003fdd5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:23.187528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a48cad8-52ae-4602-b689-6b161003fdd5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:23.189340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a48cad8-52ae-4602-b689-6b161003fdd5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:23.195488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a48cad8-52ae-4602-b689-6b161003fdd5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:23.198396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a48cad8-52ae-4602-b689-6b161003fdd5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:23.202555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a48cad8-52ae-4602-b689-6b161003fdd5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:23.206544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a48cad8-52ae-4602-b689-6b161003fdd5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:24.026489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5a48cad8-52ae-4602-b689-6b161003fdd5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:24.043734 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5a48cad8-52ae-4602-b689-6b161003fdd5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1677 microversion: 2.1 time: 0.896013 Aug 27 05:32:24.053891 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3189/6376] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:23 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1677 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:32:24.279025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fc5e4d7a-8caf-4de8-83f4-d1bde3c402c6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:24.290237 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fc5e4d7a-8caf-4de8-83f4-d1bde3c402c6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1396 microversion: 2.1 time: 1.305168 Aug 27 05:32:24.292161 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3188/6377] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:22 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1396 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:24.913230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-89bb332f-8eaa-4c7b-a19b-bbec5f042323 req-fed5aca3-16e2-4710-8802-1e116d5038c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57ba86d-b2e0-4524-a40d-967e6d55bdfb", "name": "network-vif-deleted", "tag": "b9dff5fe-a03b-41c7-9cc6-0c248096eecd"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:24.970468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-89bb332f-8eaa-4c7b-a19b-bbec5f042323 req-fed5aca3-16e2-4710-8802-1e116d5038c7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:24.971825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-89bb332f-8eaa-4c7b-a19b-bbec5f042323 req-fed5aca3-16e2-4710-8802-1e116d5038c7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:24.986154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-89bb332f-8eaa-4c7b-a19b-bbec5f042323 req-fed5aca3-16e2-4710-8802-1e116d5038c7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:25.035059 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-89bb332f-8eaa-4c7b-a19b-bbec5f042323 req-fed5aca3-16e2-4710-8802-1e116d5038c7 service nova] Creating event network-vif-deleted:b9dff5fe-a03b-41c7-9cc6-0c248096eecd for instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb on n-h1-820368-35 Aug 27 05:32:25.053160 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-89bb332f-8eaa-4c7b-a19b-bbec5f042323 req-fed5aca3-16e2-4710-8802-1e116d5038c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164716 Aug 27 05:32:25.054923 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3190/6378] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:25.083599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-977b99f1-f84d-4df1-9bf0-1ef67ab77ba1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:25.084490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-977b99f1-f84d-4df1-9bf0-1ef67ab77ba1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:25.144236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977b99f1-f84d-4df1-9bf0-1ef67ab77ba1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:25.154130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977b99f1-f84d-4df1-9bf0-1ef67ab77ba1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:25.155366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977b99f1-f84d-4df1-9bf0-1ef67ab77ba1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:25.157542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977b99f1-f84d-4df1-9bf0-1ef67ab77ba1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:25.158579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977b99f1-f84d-4df1-9bf0-1ef67ab77ba1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:25.159508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-977b99f1-f84d-4df1-9bf0-1ef67ab77ba1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:25.323493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fc887755-0298-4bb0-bd7c-70dc270d9cdb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:25.325759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fc887755-0298-4bb0-bd7c-70dc270d9cdb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:25.378104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc887755-0298-4bb0-bd7c-70dc270d9cdb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:25.378638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc887755-0298-4bb0-bd7c-70dc270d9cdb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:25.379129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc887755-0298-4bb0-bd7c-70dc270d9cdb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:25.380429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc887755-0298-4bb0-bd7c-70dc270d9cdb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:25.384170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc887755-0298-4bb0-bd7c-70dc270d9cdb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:25.384895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc887755-0298-4bb0-bd7c-70dc270d9cdb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:25.646632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fc887755-0298-4bb0-bd7c-70dc270d9cdb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:25.673407 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fc887755-0298-4bb0-bd7c-70dc270d9cdb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1188 microversion: 2.1 time: 0.357177 Aug 27 05:32:25.680083 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3191/6379] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:25 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1188 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:25.740854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-977b99f1-f84d-4df1-9bf0-1ef67ab77ba1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:25.758547 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-977b99f1-f84d-4df1-9bf0-1ef67ab77ba1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1677 microversion: 2.1 time: 0.687608 Aug 27 05:32:25.778767 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3189/6380] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:25 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1677 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:26.714160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd554074-e3da-469b-a0d0-daa683119666 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:26.715277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd554074-e3da-469b-a0d0-daa683119666 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:26.740845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:26.746477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd554074-e3da-469b-a0d0-daa683119666 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:26.748475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd554074-e3da-469b-a0d0-daa683119666 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:26.749353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd554074-e3da-469b-a0d0-daa683119666 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:26.767194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd554074-e3da-469b-a0d0-daa683119666 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:26.769468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd554074-e3da-469b-a0d0-daa683119666 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:26.770218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd554074-e3da-469b-a0d0-daa683119666 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:26.802910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d50080b5-e8f7-48f6-8c7e-c625b4aa189e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:26.802910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d50080b5-e8f7-48f6-8c7e-c625b4aa189e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:26.820197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:26.826046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d50080b5-e8f7-48f6-8c7e-c625b4aa189e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:26.827699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d50080b5-e8f7-48f6-8c7e-c625b4aa189e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:26.831540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d50080b5-e8f7-48f6-8c7e-c625b4aa189e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:26.832511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d50080b5-e8f7-48f6-8c7e-c625b4aa189e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:26.834729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d50080b5-e8f7-48f6-8c7e-c625b4aa189e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:26.835479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d50080b5-e8f7-48f6-8c7e-c625b4aa189e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:26.977265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd554074-e3da-469b-a0d0-daa683119666 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:26.985669 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd554074-e3da-469b-a0d0-daa683119666 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1188 microversion: 2.1 time: 0.278928 Aug 27 05:32:26.989882 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3192/6381] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:26 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1188 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:27.271067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d50080b5-e8f7-48f6-8c7e-c625b4aa189e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:27.301453 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d50080b5-e8f7-48f6-8c7e-c625b4aa189e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1677 microversion: 2.1 time: 0.511743 Aug 27 05:32:27.303877 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3190/6382] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:26 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1677 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:32:28.029181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a63b002b-d0bb-429c-9b0e-4e82409a5eca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:28.031646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a63b002b-d0bb-429c-9b0e-4e82409a5eca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:28.048412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a63b002b-d0bb-429c-9b0e-4e82409a5eca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:28.052422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a63b002b-d0bb-429c-9b0e-4e82409a5eca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:28.053728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a63b002b-d0bb-429c-9b0e-4e82409a5eca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:28.055479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a63b002b-d0bb-429c-9b0e-4e82409a5eca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:28.056702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a63b002b-d0bb-429c-9b0e-4e82409a5eca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:28.058829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a63b002b-d0bb-429c-9b0e-4e82409a5eca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:28.214010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a63b002b-d0bb-429c-9b0e-4e82409a5eca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:28.244621 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a63b002b-d0bb-429c-9b0e-4e82409a5eca tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1188 microversion: 2.1 time: 0.228480 Aug 27 05:32:28.249153 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3193/6383] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:28 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1188 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:28.331940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2324e797-c32f-47ae-9c06-7bf144a26e0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:28.334617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2324e797-c32f-47ae-9c06-7bf144a26e0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:28.344192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2324e797-c32f-47ae-9c06-7bf144a26e0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:28.345081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2324e797-c32f-47ae-9c06-7bf144a26e0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:28.345748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2324e797-c32f-47ae-9c06-7bf144a26e0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:28.346710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2324e797-c32f-47ae-9c06-7bf144a26e0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:28.347606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2324e797-c32f-47ae-9c06-7bf144a26e0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:28.348337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2324e797-c32f-47ae-9c06-7bf144a26e0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:28.550987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2324e797-c32f-47ae-9c06-7bf144a26e0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:28.573508 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2324e797-c32f-47ae-9c06-7bf144a26e0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1677 microversion: 2.1 time: 0.249578 Aug 27 05:32:28.577168 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3191/6384] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:28 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1677 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:29.266912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b41e55cb-526b-44d2-a603-cafc58655b00 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:29.267574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b41e55cb-526b-44d2-a603-cafc58655b00 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:29.289884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b41e55cb-526b-44d2-a603-cafc58655b00 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:29.290393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b41e55cb-526b-44d2-a603-cafc58655b00 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:29.290878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b41e55cb-526b-44d2-a603-cafc58655b00 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:29.293805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b41e55cb-526b-44d2-a603-cafc58655b00 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:29.294504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b41e55cb-526b-44d2-a603-cafc58655b00 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:29.295007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b41e55cb-526b-44d2-a603-cafc58655b00 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:29.494283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b41e55cb-526b-44d2-a603-cafc58655b00 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:29.563220 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b41e55cb-526b-44d2-a603-cafc58655b00 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1188 microversion: 2.1 time: 0.299472 Aug 27 05:32:29.571148 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3194/6385] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:29 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:29.618339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-36b1e098-c05b-4459-b2da-dc19b9fdcfe2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:29.618932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-36b1e098-c05b-4459-b2da-dc19b9fdcfe2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:29.653746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b1e098-c05b-4459-b2da-dc19b9fdcfe2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:29.656950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b1e098-c05b-4459-b2da-dc19b9fdcfe2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:29.658455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b1e098-c05b-4459-b2da-dc19b9fdcfe2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:29.661258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b1e098-c05b-4459-b2da-dc19b9fdcfe2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:29.662422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b1e098-c05b-4459-b2da-dc19b9fdcfe2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:29.663641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36b1e098-c05b-4459-b2da-dc19b9fdcfe2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:30.028790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-36b1e098-c05b-4459-b2da-dc19b9fdcfe2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:30.042317 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-36b1e098-c05b-4459-b2da-dc19b9fdcfe2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1654 microversion: 2.1 time: 0.433926 Aug 27 05:32:30.049423 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3192/6386] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:29 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1654 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:30.089384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f7543fd1-04a1-4fe7-ae34-d084fd21ecef tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:30.121907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7543fd1-04a1-4fe7-ae34-d084fd21ecef tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:30.121907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7543fd1-04a1-4fe7-ae34-d084fd21ecef tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:30.121907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7543fd1-04a1-4fe7-ae34-d084fd21ecef tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:30.172053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f7543fd1-04a1-4fe7-ae34-d084fd21ecef tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Going to try to start instance {{(pid=128548) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 05:32:30.281353 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f7543fd1-04a1-4fe7-ae34-d084fd21ecef tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "POST /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.200390 Aug 27 05:32:30.283750 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3195/6387] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:32:30 2022] POST /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:32:30.293660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-26ff845b-0d18-4fb3-b8f6-52766b7ff969 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:30.294531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-26ff845b-0d18-4fb3-b8f6-52766b7ff969 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:30.311469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ff845b-0d18-4fb3-b8f6-52766b7ff969 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:30.313406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ff845b-0d18-4fb3-b8f6-52766b7ff969 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:30.313942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ff845b-0d18-4fb3-b8f6-52766b7ff969 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:30.318992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ff845b-0d18-4fb3-b8f6-52766b7ff969 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:30.320177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ff845b-0d18-4fb3-b8f6-52766b7ff969 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:30.335476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-26ff845b-0d18-4fb3-b8f6-52766b7ff969 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:30.588864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9db07f62-6530-4eb7-ba89-32b951ac259a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:30.589937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9db07f62-6530-4eb7-ba89-32b951ac259a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:30.628243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9db07f62-6530-4eb7-ba89-32b951ac259a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:30.628750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9db07f62-6530-4eb7-ba89-32b951ac259a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:30.629183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9db07f62-6530-4eb7-ba89-32b951ac259a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:30.630119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9db07f62-6530-4eb7-ba89-32b951ac259a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:30.630734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9db07f62-6530-4eb7-ba89-32b951ac259a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:30.631561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9db07f62-6530-4eb7-ba89-32b951ac259a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:30.921676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9db07f62-6530-4eb7-ba89-32b951ac259a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:30.948155 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9db07f62-6530-4eb7-ba89-32b951ac259a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1188 microversion: 2.1 time: 0.356654 Aug 27 05:32:30.961309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-26ff845b-0d18-4fb3-b8f6-52766b7ff969 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:30.968896 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3196/6388] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:30 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1188 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:30.984351 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-26ff845b-0d18-4fb3-b8f6-52766b7ff969 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1663 microversion: 2.1 time: 0.695748 Aug 27 05:32:30.985273 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3193/6389] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:30 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1663 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:32:31.987454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-193baa81-b25d-44fb-b391-b1ecb8523b85 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:31.991721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-193baa81-b25d-44fb-b391-b1ecb8523b85 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:32.025467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b1ab4a04-dfad-4fa2-934e-0d70ee86dc6c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:32.028831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b1ab4a04-dfad-4fa2-934e-0d70ee86dc6c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:32.037962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-193baa81-b25d-44fb-b391-b1ecb8523b85 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:32.042708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-193baa81-b25d-44fb-b391-b1ecb8523b85 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:32.043643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-193baa81-b25d-44fb-b391-b1ecb8523b85 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:32.044488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-193baa81-b25d-44fb-b391-b1ecb8523b85 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:32.045942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-193baa81-b25d-44fb-b391-b1ecb8523b85 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:32.046411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-193baa81-b25d-44fb-b391-b1ecb8523b85 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:32.060244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ab4a04-dfad-4fa2-934e-0d70ee86dc6c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:32.060756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ab4a04-dfad-4fa2-934e-0d70ee86dc6c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:32.061200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ab4a04-dfad-4fa2-934e-0d70ee86dc6c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:32.062054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ab4a04-dfad-4fa2-934e-0d70ee86dc6c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:32.062610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ab4a04-dfad-4fa2-934e-0d70ee86dc6c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:32.063048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ab4a04-dfad-4fa2-934e-0d70ee86dc6c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:32.184854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-193baa81-b25d-44fb-b391-b1ecb8523b85 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:32.216175 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-193baa81-b25d-44fb-b391-b1ecb8523b85 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1188 microversion: 2.1 time: 0.242633 Aug 27 05:32:32.217267 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3197/6390] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:31 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1188 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:32.446148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b1ab4a04-dfad-4fa2-934e-0d70ee86dc6c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:32.452601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:32.460552 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b1ab4a04-dfad-4fa2-934e-0d70ee86dc6c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1663 microversion: 2.1 time: 0.449830 Aug 27 05:32:32.463187 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3194/6391] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:32 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1663 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:32:33.268749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e6fd3960-7d54-4712-a020-f07dbcd21882 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:33.271939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e6fd3960-7d54-4712-a020-f07dbcd21882 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:33.294162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6fd3960-7d54-4712-a020-f07dbcd21882 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:33.294942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6fd3960-7d54-4712-a020-f07dbcd21882 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:33.296122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6fd3960-7d54-4712-a020-f07dbcd21882 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:33.297779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6fd3960-7d54-4712-a020-f07dbcd21882 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:33.298754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6fd3960-7d54-4712-a020-f07dbcd21882 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:33.299800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6fd3960-7d54-4712-a020-f07dbcd21882 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:33.495453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0dcca9e4-b55f-4488-a4d7-c708a70bf574 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:33.497217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0dcca9e4-b55f-4488-a4d7-c708a70bf574 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:33.509542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e6fd3960-7d54-4712-a020-f07dbcd21882 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:33.517389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcca9e4-b55f-4488-a4d7-c708a70bf574 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:33.518269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcca9e4-b55f-4488-a4d7-c708a70bf574 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:33.519037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcca9e4-b55f-4488-a4d7-c708a70bf574 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:33.521256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcca9e4-b55f-4488-a4d7-c708a70bf574 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:33.523310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcca9e4-b55f-4488-a4d7-c708a70bf574 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:33.524395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dcca9e4-b55f-4488-a4d7-c708a70bf574 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:33.527654 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e6fd3960-7d54-4712-a020-f07dbcd21882 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 200 len: 1188 microversion: 2.1 time: 0.276873 Aug 27 05:32:33.528377 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3198/6392] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:33 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 1188 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:33.876065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0dcca9e4-b55f-4488-a4d7-c708a70bf574 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:33.894974 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0dcca9e4-b55f-4488-a4d7-c708a70bf574 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1667 microversion: 2.1 time: 0.410922 Aug 27 05:32:33.898430 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3195/6393] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:33 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1667 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:34.558317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:34.560038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:34.568745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:34.569396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:34.570080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:34.571312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:34.571993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:34.572415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:34.588382 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb HTTP/1.1 Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'b57ba86d-b2e0-4524-a40d-967e6d55bdfb'} Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:34.590087 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:34.594855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:34.594855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:34.594855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:34.594855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:32:34.594855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:32:34.594855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:34.594855 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:34.594855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:32:34.594855 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a414f67f-526e-4851-9452-f710e7092531 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 404 len: 111 microversion: 2.1 time: 0.038128 Aug 27 05:32:34.594855 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3199/6394] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:34 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:32:44.577426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:44.578011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:44.588165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=11 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:44.588866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:44.592079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:44.592588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:44.593086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:44.594255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:44.594777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:44.595482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:44.618731 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb HTTP/1.1 Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'b57ba86d-b2e0-4524-a40d-967e6d55bdfb'} Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:32:44.620385 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:32:44.627805 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a346f03-faa4-4f56-a3b4-1b4ea40e65fd tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 404 len: 111 microversion: 2.1 time: 0.056479 Aug 27 05:32:44.635697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:44.636505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: b57ba86d-b2e0-4524-a40d-967e6d55bdfb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:44.639176 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3196/6395] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:32:44 2022] DELETE /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:32:44.644480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=15 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:44.647792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:44.665952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:44.669341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:44.670145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:44.671754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:44.673723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:44.674636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:44.703418 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb HTTP/1.1 Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'b57ba86d-b2e0-4524-a40d-967e6d55bdfb'} Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:44.705323 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:44.709576 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:44.709576 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:44.709576 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:44.709576 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:32:44.709576 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:32:44.709576 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. Aug 27 05:32:44.709576 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:32:44.711704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance b57ba86d-b2e0-4524-a40d-967e6d55bdfb could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:32:44.712818 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd78f6aa-1761-4f13-be93-e53157b64bd4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb" status: 404 len: 111 microversion: 2.1 time: 0.085117 Aug 27 05:32:44.713398 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3200/6396] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:44 2022] GET /compute/v2.1/servers/b57ba86d-b2e0-4524-a40d-967e6d55bdfb => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:32:45.796530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b54a0d4b-e101-47ac-8856-d4758b36edfa tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Action: 'create', calling method: .version_select at 0x7fb5656b0d30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-339607465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmkkd+ZuDHRX8+FRO2Vzh9ca4jcjhFTxACbvYYwQxRI/5hFoM6EQtWVl+BU4ZFDayUmHtA7nnV22aAiwaHhhPUYcl9lhKN4XCFyifSJoFrIYDPvRWVHL65e4UyqOd3zYQ=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:45.859797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-b54a0d4b-e101-47ac-8856-d4758b36edfa tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Getting quotas for project 980e6bf120f3490bbda7d9754366febc. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:32:45.877167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-b54a0d4b-e101-47ac-8856-d4758b36edfa tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Getting quotas for user 383b51103d4047a7a76cedfd05806c82 and project 980e6bf120f3490bbda7d9754366febc. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:32:45.943699 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b54a0d4b-e101-47ac-8856-d4758b36edfa tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.152752 Aug 27 05:32:45.945617 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3197/6397] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:32:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:32:48.111606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1653074766", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d309eb8e-b5a2-4f71-adb0-3ec47ea4dad8", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-339607465", "security_groups": [{"name": "tempest-secgroup-smoke-1141851189"}], "networks": [{"uuid": "9930ac05-ef24-44e3-aa54-54d6b365c4d6"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:48.360925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] validate_networks() for [('9930ac05-ef24-44e3-aa54-54d6b365c4d6', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:32:49.190045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:32:49.190735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:32:49.192040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:32:49.192894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:32:49.193230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:32:49.225679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:49.229049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:49.229747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:49.232679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:49.235538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:49.236514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:49.269099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Getting quotas for project 980e6bf120f3490bbda7d9754366febc. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:32:49.275477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Getting quotas for user 383b51103d4047a7a76cedfd05806c82 and project 980e6bf120f3490bbda7d9754366febc. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:32:49.419221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:32:49.423731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d309eb8e-b5a2-4f71-adb0-3ec47ea4dad8',volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:32:49.689524 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e3d0dfac-85e7-4394-a177-90d4ed47a95b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.573590 Aug 27 05:32:49.695821 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3201/6398] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:32:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:32:49.702079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6d6bbdc5-122b-47a1-8ea4-06e9aa95f957 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:49.704919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6d6bbdc5-122b-47a1-8ea4-06e9aa95f957 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:49.805758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6d6bbdc5-122b-47a1-8ea4-06e9aa95f957 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:49.821329 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6d6bbdc5-122b-47a1-8ea4-06e9aa95f957 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1098 microversion: 2.1 time: 0.121779 Aug 27 05:32:49.824426 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3198/6399] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:49 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1098 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:50.845781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ed5e61b3-24c2-4daa-97d0-1cd6e6b4cef8 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:50.847155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ed5e61b3-24c2-4daa-97d0-1cd6e6b4cef8 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:51.052180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ed5e61b3-24c2-4daa-97d0-1cd6e6b4cef8 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:51.060303 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ed5e61b3-24c2-4daa-97d0-1cd6e6b4cef8 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1098 microversion: 2.1 time: 0.218539 Aug 27 05:32:51.063977 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3202/6400] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:50 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1098 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:52.089994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b73735be-0e92-4bcf-99ac-4142e35d8ac3 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:52.093380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b73735be-0e92-4bcf-99ac-4142e35d8ac3 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:52.140053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b73735be-0e92-4bcf-99ac-4142e35d8ac3 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:52.140827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b73735be-0e92-4bcf-99ac-4142e35d8ac3 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:52.141535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b73735be-0e92-4bcf-99ac-4142e35d8ac3 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:52.142872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b73735be-0e92-4bcf-99ac-4142e35d8ac3 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:52.149557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b73735be-0e92-4bcf-99ac-4142e35d8ac3 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:52.150472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b73735be-0e92-4bcf-99ac-4142e35d8ac3 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:52.345908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b73735be-0e92-4bcf-99ac-4142e35d8ac3 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:52.380452 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b73735be-0e92-4bcf-99ac-4142e35d8ac3 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1148 microversion: 2.1 time: 0.297753 Aug 27 05:32:52.381263 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3199/6401] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:52 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1148 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:53.410304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ae9aa85-1392-4338-8cfc-7ef7a7ee94f1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:53.414313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ae9aa85-1392-4338-8cfc-7ef7a7ee94f1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:53.440253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae9aa85-1392-4338-8cfc-7ef7a7ee94f1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:53.442567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae9aa85-1392-4338-8cfc-7ef7a7ee94f1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:53.443810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae9aa85-1392-4338-8cfc-7ef7a7ee94f1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:53.445604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae9aa85-1392-4338-8cfc-7ef7a7ee94f1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:53.447616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae9aa85-1392-4338-8cfc-7ef7a7ee94f1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:53.448724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ae9aa85-1392-4338-8cfc-7ef7a7ee94f1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:53.630081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ae9aa85-1392-4338-8cfc-7ef7a7ee94f1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:53.651913 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ae9aa85-1392-4338-8cfc-7ef7a7ee94f1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1140 microversion: 2.1 time: 0.250593 Aug 27 05:32:53.653338 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3203/6402] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:53 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1140 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:54.678891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7c646388-4233-4696-b5d3-363c8ea2ccac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:54.680869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7c646388-4233-4696-b5d3-363c8ea2ccac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:54.719520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c646388-4233-4696-b5d3-363c8ea2ccac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:54.722963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c646388-4233-4696-b5d3-363c8ea2ccac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:54.723599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c646388-4233-4696-b5d3-363c8ea2ccac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:54.751669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c646388-4233-4696-b5d3-363c8ea2ccac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:54.764006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c646388-4233-4696-b5d3-363c8ea2ccac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:54.764710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7c646388-4233-4696-b5d3-363c8ea2ccac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:55.067357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7c646388-4233-4696-b5d3-363c8ea2ccac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:55.124968 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7c646388-4233-4696-b5d3-363c8ea2ccac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1214 microversion: 2.1 time: 0.448667 Aug 27 05:32:55.132895 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3200/6403] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:54 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1214 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:56.162999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d0a65ae-7c73-4c54-8c1e-f6c62d405555 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:56.164345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0d0a65ae-7c73-4c54-8c1e-f6c62d405555 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:56.205565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0a65ae-7c73-4c54-8c1e-f6c62d405555 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:56.206072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0a65ae-7c73-4c54-8c1e-f6c62d405555 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:56.206557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0a65ae-7c73-4c54-8c1e-f6c62d405555 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:56.207333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0a65ae-7c73-4c54-8c1e-f6c62d405555 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:56.207801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0a65ae-7c73-4c54-8c1e-f6c62d405555 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:56.208245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0a65ae-7c73-4c54-8c1e-f6c62d405555 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:56.608936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d0a65ae-7c73-4c54-8c1e-f6c62d405555 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:56.621572 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0d0a65ae-7c73-4c54-8c1e-f6c62d405555 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1214 microversion: 2.1 time: 0.468843 Aug 27 05:32:56.626172 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3204/6404] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:56 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1214 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:57.650734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5477c80d-12c8-4f21-9d7f-90f2cb401f91 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:57.652124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5477c80d-12c8-4f21-9d7f-90f2cb401f91 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:57.658428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5477c80d-12c8-4f21-9d7f-90f2cb401f91 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:57.661558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5477c80d-12c8-4f21-9d7f-90f2cb401f91 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:57.664811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5477c80d-12c8-4f21-9d7f-90f2cb401f91 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:57.665992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5477c80d-12c8-4f21-9d7f-90f2cb401f91 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:57.667033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5477c80d-12c8-4f21-9d7f-90f2cb401f91 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:57.673387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5477c80d-12c8-4f21-9d7f-90f2cb401f91 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:58.111798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5477c80d-12c8-4f21-9d7f-90f2cb401f91 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:58.131937 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5477c80d-12c8-4f21-9d7f-90f2cb401f91 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1282 microversion: 2.1 time: 0.485483 Aug 27 05:32:58.146571 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3201/6405] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:57 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1282 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:32:58.802107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-9232e629-c01a-4a8e-b695-e6b9ddab80c7 req-d513dd10-cc34-48f8-8e70-6e64787b0031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e01a82-da3c-4bdb-b1ba-5412768d1794", "tag": "29a7d263-ffaa-4df1-8cd7-6b0662f519c3"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:58.834308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9232e629-c01a-4a8e-b695-e6b9ddab80c7 req-d513dd10-cc34-48f8-8e70-6e64787b0031 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:58.838030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9232e629-c01a-4a8e-b695-e6b9ddab80c7 req-d513dd10-cc34-48f8-8e70-6e64787b0031 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:58.840023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9232e629-c01a-4a8e-b695-e6b9ddab80c7 req-d513dd10-cc34-48f8-8e70-6e64787b0031 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:58.872315 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-9232e629-c01a-4a8e-b695-e6b9ddab80c7 req-d513dd10-cc34-48f8-8e70-6e64787b0031 service nova] Creating event network-changed:29a7d263-ffaa-4df1-8cd7-6b0662f519c3 for instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 on n-h1-820368-35 Aug 27 05:32:58.885031 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-9232e629-c01a-4a8e-b695-e6b9ddab80c7 req-d513dd10-cc34-48f8-8e70-6e64787b0031 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087493 Aug 27 05:32:58.886037 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3205/6406] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:59.154845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-78601721-521d-4d74-9274-8c5ea0671517 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:59.155543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-78601721-521d-4d74-9274-8c5ea0671517 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:59.177085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78601721-521d-4d74-9274-8c5ea0671517 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:59.182304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78601721-521d-4d74-9274-8c5ea0671517 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:59.182860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78601721-521d-4d74-9274-8c5ea0671517 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:59.185889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78601721-521d-4d74-9274-8c5ea0671517 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:59.186720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78601721-521d-4d74-9274-8c5ea0671517 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:59.187217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78601721-521d-4d74-9274-8c5ea0671517 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:59.649736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-78601721-521d-4d74-9274-8c5ea0671517 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:59.672098 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-78601721-521d-4d74-9274-8c5ea0671517 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1282 microversion: 2.1 time: 0.517667 Aug 27 05:32:59.683562 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3202/6407] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:59 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1282 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:00.705549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9eaada5b-f124-468b-9963-6a32fef82418 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:00.706828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9eaada5b-f124-468b-9963-6a32fef82418 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:00.709131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:00.748170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9eaada5b-f124-468b-9963-6a32fef82418 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:00.756345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9eaada5b-f124-468b-9963-6a32fef82418 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:00.759727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9eaada5b-f124-468b-9963-6a32fef82418 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:00.762297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9eaada5b-f124-468b-9963-6a32fef82418 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:00.765186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9eaada5b-f124-468b-9963-6a32fef82418 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:00.765915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9eaada5b-f124-468b-9963-6a32fef82418 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:01.060284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:01.151528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9eaada5b-f124-468b-9963-6a32fef82418 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:01.184555 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9eaada5b-f124-468b-9963-6a32fef82418 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1282 microversion: 2.1 time: 0.471440 Aug 27 05:33:01.194924 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3206/6408] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:00 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1282 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:02.225995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ff820ebc-9dd5-49cd-81c7-e737945b4fb6 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:02.226884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ff820ebc-9dd5-49cd-81c7-e737945b4fb6 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:02.230823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:02.281871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff820ebc-9dd5-49cd-81c7-e737945b4fb6 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:02.282652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff820ebc-9dd5-49cd-81c7-e737945b4fb6 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:02.284135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff820ebc-9dd5-49cd-81c7-e737945b4fb6 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:02.293307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff820ebc-9dd5-49cd-81c7-e737945b4fb6 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:02.295506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff820ebc-9dd5-49cd-81c7-e737945b4fb6 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:02.297376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff820ebc-9dd5-49cd-81c7-e737945b4fb6 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:02.620150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ff820ebc-9dd5-49cd-81c7-e737945b4fb6 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:02.635277 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ff820ebc-9dd5-49cd-81c7-e737945b4fb6 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1282 microversion: 2.1 time: 0.411105 Aug 27 05:33:02.636313 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3203/6409] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:02 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1282 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:03.664561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-160d6121-770e-4910-b24f-8652b285d41a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:03.665883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-160d6121-770e-4910-b24f-8652b285d41a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:03.674634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-160d6121-770e-4910-b24f-8652b285d41a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:03.675996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-160d6121-770e-4910-b24f-8652b285d41a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:03.676613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-160d6121-770e-4910-b24f-8652b285d41a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:03.677479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-160d6121-770e-4910-b24f-8652b285d41a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:03.678196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-160d6121-770e-4910-b24f-8652b285d41a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:03.678775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-160d6121-770e-4910-b24f-8652b285d41a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:04.298773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-160d6121-770e-4910-b24f-8652b285d41a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:04.326356 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-160d6121-770e-4910-b24f-8652b285d41a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1282 microversion: 2.1 time: 0.666704 Aug 27 05:33:04.329583 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3207/6410] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:03 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1282 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:05.350937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a92647a-6e69-493b-819f-1902f44840ef tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:05.372912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6a92647a-6e69-493b-819f-1902f44840ef tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:05.406707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a92647a-6e69-493b-819f-1902f44840ef tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:05.408020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a92647a-6e69-493b-819f-1902f44840ef tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:05.416622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a92647a-6e69-493b-819f-1902f44840ef tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:05.417850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a92647a-6e69-493b-819f-1902f44840ef tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:05.420385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a92647a-6e69-493b-819f-1902f44840ef tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:05.421193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a92647a-6e69-493b-819f-1902f44840ef tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:05.836923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6a92647a-6e69-493b-819f-1902f44840ef tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:05.859016 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6a92647a-6e69-493b-819f-1902f44840ef tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1270 microversion: 2.1 time: 0.503540 Aug 27 05:33:05.864048 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3204/6411] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:05 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1270 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:06.890103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a92336c1-dca1-4a48-bcf9-3f068511f463 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:06.890103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a92336c1-dca1-4a48-bcf9-3f068511f463 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:06.900477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a92336c1-dca1-4a48-bcf9-3f068511f463 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:06.900981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a92336c1-dca1-4a48-bcf9-3f068511f463 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:06.901857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a92336c1-dca1-4a48-bcf9-3f068511f463 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:06.903534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a92336c1-dca1-4a48-bcf9-3f068511f463 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:06.905015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a92336c1-dca1-4a48-bcf9-3f068511f463 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:06.906055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a92336c1-dca1-4a48-bcf9-3f068511f463 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:07.200121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a92336c1-dca1-4a48-bcf9-3f068511f463 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:07.242791 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a92336c1-dca1-4a48-bcf9-3f068511f463 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1270 microversion: 2.1 time: 0.358161 Aug 27 05:33:07.246858 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3208/6412] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:06 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1270 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:08.283226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29dd3482-976c-48f1-a26a-666167bdb163 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:08.284879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-29dd3482-976c-48f1-a26a-666167bdb163 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:08.307904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29dd3482-976c-48f1-a26a-666167bdb163 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:08.308556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29dd3482-976c-48f1-a26a-666167bdb163 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:08.309191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29dd3482-976c-48f1-a26a-666167bdb163 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:08.310285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29dd3482-976c-48f1-a26a-666167bdb163 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:08.310767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29dd3482-976c-48f1-a26a-666167bdb163 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:08.311474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29dd3482-976c-48f1-a26a-666167bdb163 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:08.560783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-29dd3482-976c-48f1-a26a-666167bdb163 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:08.576957 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-29dd3482-976c-48f1-a26a-666167bdb163 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1270 microversion: 2.1 time: 0.301596 Aug 27 05:33:08.578286 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3205/6413] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:08 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1270 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:09.612276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-39bca9c9-a630-4d77-8f64-f9e54ab22fa0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:09.614915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-39bca9c9-a630-4d77-8f64-f9e54ab22fa0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:09.642900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39bca9c9-a630-4d77-8f64-f9e54ab22fa0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:09.644566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39bca9c9-a630-4d77-8f64-f9e54ab22fa0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:09.647681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39bca9c9-a630-4d77-8f64-f9e54ab22fa0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:09.653229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39bca9c9-a630-4d77-8f64-f9e54ab22fa0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:09.654306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39bca9c9-a630-4d77-8f64-f9e54ab22fa0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:09.655054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39bca9c9-a630-4d77-8f64-f9e54ab22fa0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:09.912939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-39bca9c9-a630-4d77-8f64-f9e54ab22fa0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:09.931634 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-39bca9c9-a630-4d77-8f64-f9e54ab22fa0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1270 microversion: 2.1 time: 0.327054 Aug 27 05:33:09.932592 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3209/6414] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:09 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1270 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:10.959400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6254552a-6ea1-4abc-95e3-043d2784b289 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:10.960666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6254552a-6ea1-4abc-95e3-043d2784b289 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:10.970843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6254552a-6ea1-4abc-95e3-043d2784b289 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:10.972166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6254552a-6ea1-4abc-95e3-043d2784b289 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:10.972791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6254552a-6ea1-4abc-95e3-043d2784b289 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:10.973708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6254552a-6ea1-4abc-95e3-043d2784b289 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:10.974332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6254552a-6ea1-4abc-95e3-043d2784b289 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:10.975225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6254552a-6ea1-4abc-95e3-043d2784b289 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:11.326555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6254552a-6ea1-4abc-95e3-043d2784b289 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:11.334670 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6254552a-6ea1-4abc-95e3-043d2784b289 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1270 microversion: 2.1 time: 0.384724 Aug 27 05:33:11.339370 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3206/6415] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:10 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1270 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:12.369039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c785d8b3-6bf2-408f-a99a-cce86b3ce31a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:12.369949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c785d8b3-6bf2-408f-a99a-cce86b3ce31a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:12.389151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c785d8b3-6bf2-408f-a99a-cce86b3ce31a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:12.390295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c785d8b3-6bf2-408f-a99a-cce86b3ce31a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:12.391077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c785d8b3-6bf2-408f-a99a-cce86b3ce31a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:12.392342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c785d8b3-6bf2-408f-a99a-cce86b3ce31a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:12.394540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c785d8b3-6bf2-408f-a99a-cce86b3ce31a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:12.395232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c785d8b3-6bf2-408f-a99a-cce86b3ce31a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:12.638827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c785d8b3-6bf2-408f-a99a-cce86b3ce31a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:12.665763 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c785d8b3-6bf2-408f-a99a-cce86b3ce31a tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1270 microversion: 2.1 time: 0.284574 Aug 27 05:33:12.665763 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3210/6416] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:12 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1270 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:13.694134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6be37c78-6872-46e3-b1d0-14a9606e3382 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:13.695647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6be37c78-6872-46e3-b1d0-14a9606e3382 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:13.710047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6be37c78-6872-46e3-b1d0-14a9606e3382 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:13.710872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6be37c78-6872-46e3-b1d0-14a9606e3382 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:13.711561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6be37c78-6872-46e3-b1d0-14a9606e3382 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:13.712481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6be37c78-6872-46e3-b1d0-14a9606e3382 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:13.713147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6be37c78-6872-46e3-b1d0-14a9606e3382 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:13.713688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6be37c78-6872-46e3-b1d0-14a9606e3382 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:14.222276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6be37c78-6872-46e3-b1d0-14a9606e3382 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:14.241101 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6be37c78-6872-46e3-b1d0-14a9606e3382 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1270 microversion: 2.1 time: 0.557747 Aug 27 05:33:14.242739 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3207/6417] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:13 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1270 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:15.269535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6e495b74-c13c-4de4-afb9-99bcd76513f0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:15.270754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6e495b74-c13c-4de4-afb9-99bcd76513f0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:15.285693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:15.287312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e495b74-c13c-4de4-afb9-99bcd76513f0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:15.287870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e495b74-c13c-4de4-afb9-99bcd76513f0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:15.298577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e495b74-c13c-4de4-afb9-99bcd76513f0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:15.299665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e495b74-c13c-4de4-afb9-99bcd76513f0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:15.300362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e495b74-c13c-4de4-afb9-99bcd76513f0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:15.301004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e495b74-c13c-4de4-afb9-99bcd76513f0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:15.330071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=49 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:15.568907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6e495b74-c13c-4de4-afb9-99bcd76513f0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:15.568907 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6e495b74-c13c-4de4-afb9-99bcd76513f0 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1270 microversion: 2.1 time: 0.285482 Aug 27 05:33:15.568907 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3211/6418] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:15 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1270 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:16.588882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-38f3df65-8d95-4944-aebc-1fee0f633f24 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:16.589548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-38f3df65-8d95-4944-aebc-1fee0f633f24 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:16.596358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:16.598964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38f3df65-8d95-4944-aebc-1fee0f633f24 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:16.599564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38f3df65-8d95-4944-aebc-1fee0f633f24 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:16.600292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38f3df65-8d95-4944-aebc-1fee0f633f24 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:16.601093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38f3df65-8d95-4944-aebc-1fee0f633f24 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:16.601623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38f3df65-8d95-4944-aebc-1fee0f633f24 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:16.602255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-38f3df65-8d95-4944-aebc-1fee0f633f24 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:16.608369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=57 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:16.890974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-38f3df65-8d95-4944-aebc-1fee0f633f24 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:16.901483 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-38f3df65-8d95-4944-aebc-1fee0f633f24 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1270 microversion: 2.1 time: 0.317240 Aug 27 05:33:16.904745 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3208/6419] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:16 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1270 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:17.542412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f8d80754-9eb5-4230-b492-316e48b22979 req-0e4bf556-7909-460c-87f4-50cacc1c4e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e01a82-da3c-4bdb-b1ba-5412768d1794", "name": "network-vif-plugged", "status": "completed", "tag": "29a7d263-ffaa-4df1-8cd7-6b0662f519c3"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:17.566966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f8d80754-9eb5-4230-b492-316e48b22979 req-0e4bf556-7909-460c-87f4-50cacc1c4e01 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:17.568010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f8d80754-9eb5-4230-b492-316e48b22979 req-0e4bf556-7909-460c-87f4-50cacc1c4e01 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:17.568662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f8d80754-9eb5-4230-b492-316e48b22979 req-0e4bf556-7909-460c-87f4-50cacc1c4e01 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:17.593426 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f8d80754-9eb5-4230-b492-316e48b22979 req-0e4bf556-7909-460c-87f4-50cacc1c4e01 service nova] Creating event network-vif-plugged:29a7d263-ffaa-4df1-8cd7-6b0662f519c3 for instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 on n-h1-820368-35 Aug 27 05:33:17.614429 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f8d80754-9eb5-4230-b492-316e48b22979 req-0e4bf556-7909-460c-87f4-50cacc1c4e01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.520852 Aug 27 05:33:17.621647 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3212/6420] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:33:17.876555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46449c70-0e03-4249-b6fc-089dd99365e6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'create', calling method: .version_select at 0x7fb5650dc820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-343815109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCfgsGyBoXzm6J6ZbtmjJ8XS18rs5Z8TEqM7i4B2DS2LwlXLCbhHYoo7rzsZ5xFtM+bB/kIbLNJPyZP7VwHdgMtmyWuRK0PnZAcMn6rwk1pCNqKcoApC8I6sVKcJta3ZA=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:17.928290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0c050758-e692-427c-bece-0311244537cc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:17.930743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c050758-e692-427c-bece-0311244537cc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:17.936477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-46449c70-0e03-4249-b6fc-089dd99365e6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:33:17.938793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c050758-e692-427c-bece-0311244537cc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:17.939714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c050758-e692-427c-bece-0311244537cc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:17.941132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c050758-e692-427c-bece-0311244537cc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:17.942496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c050758-e692-427c-bece-0311244537cc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:17.943285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c050758-e692-427c-bece-0311244537cc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:17.944237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c050758-e692-427c-bece-0311244537cc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:17.951795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-46449c70-0e03-4249-b6fc-089dd99365e6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for user 9d30f8e6a45046dfb2a9325ebd45e99a and project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:33:17.984925 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-46449c70-0e03-4249-b6fc-089dd99365e6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.556312 Aug 27 05:33:17.986567 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3209/6421] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:33:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:33:18.202625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0c050758-e692-427c-bece-0311244537cc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:18.224735 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0c050758-e692-427c-bece-0311244537cc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1270 microversion: 2.1 time: 0.301645 Aug 27 05:33:18.235536 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3213/6422] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:17 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1270 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:19.272970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e237f6f3-abc3-4fc1-9671-57c52efbb174 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:19.276030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e237f6f3-abc3-4fc1-9671-57c52efbb174 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:19.294840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e237f6f3-abc3-4fc1-9671-57c52efbb174 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:19.295644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e237f6f3-abc3-4fc1-9671-57c52efbb174 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:19.297115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e237f6f3-abc3-4fc1-9671-57c52efbb174 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:19.300042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e237f6f3-abc3-4fc1-9671-57c52efbb174 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:19.300814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e237f6f3-abc3-4fc1-9671-57c52efbb174 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:19.301439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e237f6f3-abc3-4fc1-9671-57c52efbb174 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:19.425467 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:33:19.425968 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 05:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 (ip 10.222.0.58) !!! Aug 27 05:33:19.591299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e237f6f3-abc3-4fc1-9671-57c52efbb174 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:19.608211 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e237f6f3-abc3-4fc1-9671-57c52efbb174 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1270 microversion: 2.1 time: 0.346794 Aug 27 05:33:19.609065 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3210/6423] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:19 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1270 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:20.632283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d9a22a91-4a7b-42e3-a909-af033bdd56ac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:20.632932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d9a22a91-4a7b-42e3-a909-af033bdd56ac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:20.645325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-4a7b-42e3-a909-af033bdd56ac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:20.660209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-4a7b-42e3-a909-af033bdd56ac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:20.661065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-4a7b-42e3-a909-af033bdd56ac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:20.662265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-4a7b-42e3-a909-af033bdd56ac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:20.662956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-4a7b-42e3-a909-af033bdd56ac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:20.664019 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-4a7b-42e3-a909-af033bdd56ac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:20.973127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d9a22a91-4a7b-42e3-a909-af033bdd56ac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:20.981376 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d9a22a91-4a7b-42e3-a909-af033bdd56ac tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1459 microversion: 2.1 time: 0.356260 Aug 27 05:33:20.993229 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3214/6424] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:20 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1459 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:21.019294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-da42cac5-eee3-4b37-aba0-aac055bba6d1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:21.020149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-da42cac5-eee3-4b37-aba0-aac055bba6d1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:21.039986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da42cac5-eee3-4b37-aba0-aac055bba6d1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:21.040492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da42cac5-eee3-4b37-aba0-aac055bba6d1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:21.040944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da42cac5-eee3-4b37-aba0-aac055bba6d1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:21.041677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da42cac5-eee3-4b37-aba0-aac055bba6d1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:21.042145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da42cac5-eee3-4b37-aba0-aac055bba6d1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:21.042585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-da42cac5-eee3-4b37-aba0-aac055bba6d1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:21.805056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-da42cac5-eee3-4b37-aba0-aac055bba6d1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:21.813671 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-da42cac5-eee3-4b37-aba0-aac055bba6d1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1459 microversion: 2.1 time: 0.799466 Aug 27 05:33:21.817844 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3211/6425] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:21 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1459 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:27.187659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-543719855", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2f9ac4ba-494f-4f2d-84a6-c74b4e08197e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "58a22fcb-5b07-4d83-8df1-2b6fed6fe046"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:27.358986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] validate_networks() for [('58a22fcb-5b07-4d83-8df1-2b6fed6fe046', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:33:28.369243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:33:28.370218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:33:28.370218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:33:28.370601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:33:28.371028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:33:28.390306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:28.390812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:28.391298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:28.395471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:28.395965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:28.396416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:28.437682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:33:28.454352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for user 007b4762bf8c436fb783d84380c01932 and project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:33:28.609625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f5e52588-b862-41ed-a749-10b2cd85e29a req-a36420e5-b756-41c0-8699-4a28ef49aab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e01a82-da3c-4bdb-b1ba-5412768d1794", "tag": "29a7d263-ffaa-4df1-8cd7-6b0662f519c3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:28.626685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:33:28.630345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2f9ac4ba-494f-4f2d-84a6-c74b4e08197e',volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:33:28.631723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:28.648024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f5e52588-b862-41ed-a749-10b2cd85e29a req-a36420e5-b756-41c0-8699-4a28ef49aab5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:28.649092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f5e52588-b862-41ed-a749-10b2cd85e29a req-a36420e5-b756-41c0-8699-4a28ef49aab5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:28.649866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f5e52588-b862-41ed-a749-10b2cd85e29a req-a36420e5-b756-41c0-8699-4a28ef49aab5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:28.683969 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f5e52588-b862-41ed-a749-10b2cd85e29a req-a36420e5-b756-41c0-8699-4a28ef49aab5 service nova] Creating event network-changed:29a7d263-ffaa-4df1-8cd7-6b0662f519c3 for instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 on n-h1-820368-35 Aug 27 05:33:28.728160 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f5e52588-b862-41ed-a749-10b2cd85e29a req-a36420e5-b756-41c0-8699-4a28ef49aab5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122694 Aug 27 05:33:28.732135 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3212/6426] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:33:28.984022 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f6f4396d-1b2f-475d-92a2-165197b6573d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.800387 Aug 27 05:33:28.986895 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3215/6427] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:33:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:33:28.996914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fae73961-5996-4aea-bf74-f02e56c6a14b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:28.998361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fae73961-5996-4aea-bf74-f02e56c6a14b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:29.463269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-06f8be06-d0da-45a8-ae0d-9219e0d49b3a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:29.473360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-06f8be06-d0da-45a8-ae0d-9219e0d49b3a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:29.495344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06f8be06-d0da-45a8-ae0d-9219e0d49b3a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:29.497685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06f8be06-d0da-45a8-ae0d-9219e0d49b3a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:29.498335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06f8be06-d0da-45a8-ae0d-9219e0d49b3a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:29.501297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06f8be06-d0da-45a8-ae0d-9219e0d49b3a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:29.503988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06f8be06-d0da-45a8-ae0d-9219e0d49b3a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:29.506750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-06f8be06-d0da-45a8-ae0d-9219e0d49b3a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:29.542675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fae73961-5996-4aea-bf74-f02e56c6a14b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:29.552150 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fae73961-5996-4aea-bf74-f02e56c6a14b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1070 microversion: 2.1 time: 0.559551 Aug 27 05:33:29.552764 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3213/6428] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:28 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1070 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:29.689420 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-06f8be06-d0da-45a8-ae0d-9219e0d49b3a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.263346 Aug 27 05:33:29.702300 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3216/6429] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:33:29 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2/os-volume_attachments => generated 25 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:33:29.870075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a85043d9-d2fc-42c3-a242-e6274699140b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:29.873002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a85043d9-d2fc-42c3-a242-e6274699140b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:29.890926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85043d9-d2fc-42c3-a242-e6274699140b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:29.892413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85043d9-d2fc-42c3-a242-e6274699140b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:29.892413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85043d9-d2fc-42c3-a242-e6274699140b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:29.892638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85043d9-d2fc-42c3-a242-e6274699140b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:29.899505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85043d9-d2fc-42c3-a242-e6274699140b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:29.901200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85043d9-d2fc-42c3-a242-e6274699140b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:29.933371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a85043d9-d2fc-42c3-a242-e6274699140b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:33:30.030475 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a85043d9-d2fc-42c3-a242-e6274699140b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 204 len: 0 microversion: 2.1 time: 0.168148 Aug 27 05:33:30.031435 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3214/6430] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:33:29 2022] DELETE /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:33:30.058202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-508711b8-8699-46dc-bb5a-f745127eb14c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:30.060335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-508711b8-8699-46dc-bb5a-f745127eb14c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:30.107741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-508711b8-8699-46dc-bb5a-f745127eb14c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:30.109574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-508711b8-8699-46dc-bb5a-f745127eb14c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:30.114270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-508711b8-8699-46dc-bb5a-f745127eb14c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:30.115343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-508711b8-8699-46dc-bb5a-f745127eb14c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:30.116453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-508711b8-8699-46dc-bb5a-f745127eb14c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:30.117730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-508711b8-8699-46dc-bb5a-f745127eb14c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:30.578271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-42e83226-dab5-45df-844d-4e599a1d4c83 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:30.579223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-42e83226-dab5-45df-844d-4e599a1d4c83 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:30.598682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42e83226-dab5-45df-844d-4e599a1d4c83 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:30.603915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42e83226-dab5-45df-844d-4e599a1d4c83 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:30.604671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42e83226-dab5-45df-844d-4e599a1d4c83 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:30.605703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42e83226-dab5-45df-844d-4e599a1d4c83 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:30.616013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42e83226-dab5-45df-844d-4e599a1d4c83 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:30.616720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-42e83226-dab5-45df-844d-4e599a1d4c83 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:30.867058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-508711b8-8699-46dc-bb5a-f745127eb14c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:30.885956 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-508711b8-8699-46dc-bb5a-f745127eb14c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1673 microversion: 2.1 time: 0.848812 Aug 27 05:33:30.888716 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3217/6431] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:30 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1673 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:31.006724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-42e83226-dab5-45df-844d-4e599a1d4c83 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:31.022735 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-42e83226-dab5-45df-844d-4e599a1d4c83 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1168 microversion: 2.1 time: 0.451867 Aug 27 05:33:31.035214 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3215/6432] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:30 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1168 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:31.810174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2049680654", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "6d9e21c0-0ea1-41e4-8e01-696fddf45e0f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-343815109", "security_groups": [{"name": "tempest-secgroup-smoke-1856990784"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:31.910068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-86f51da2-eef8-4d89-ab76-f2315c02a098 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:31.910694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-86f51da2-eef8-4d89-ab76-f2315c02a098 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:31.928308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86f51da2-eef8-4d89-ab76-f2315c02a098 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:31.928843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86f51da2-eef8-4d89-ab76-f2315c02a098 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:31.929280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86f51da2-eef8-4d89-ab76-f2315c02a098 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:31.930036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86f51da2-eef8-4d89-ab76-f2315c02a098 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:31.930504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86f51da2-eef8-4d89-ab76-f2315c02a098 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:31.941020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86f51da2-eef8-4d89-ab76-f2315c02a098 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:32.368382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] validate_networks() for [('6d9e21c0-0ea1-41e4-8e01-696fddf45e0f', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:33:32.723909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86f51da2-eef8-4d89-ab76-f2315c02a098 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:32.738143 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-86f51da2-eef8-4d89-ab76-f2315c02a098 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1673 microversion: 2.1 time: 0.832955 Aug 27 05:33:32.739361 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3216/6433] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:31 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1673 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:32.759738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aac4c5e1-4f84-4dce-9b6c-6d30e2550950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:32.760430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aac4c5e1-4f84-4dce-9b6c-6d30e2550950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:32.780581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aac4c5e1-4f84-4dce-9b6c-6d30e2550950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:32.781220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aac4c5e1-4f84-4dce-9b6c-6d30e2550950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:32.781685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aac4c5e1-4f84-4dce-9b6c-6d30e2550950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:32.786182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aac4c5e1-4f84-4dce-9b6c-6d30e2550950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:32.786695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aac4c5e1-4f84-4dce-9b6c-6d30e2550950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:32.788491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aac4c5e1-4f84-4dce-9b6c-6d30e2550950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:32.922572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-aac4c5e1-4f84-4dce-9b6c-6d30e2550950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:32.939866 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aac4c5e1-4f84-4dce-9b6c-6d30e2550950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1186 microversion: 2.1 time: 0.193123 Aug 27 05:33:32.940531 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3217/6434] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:32 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1186 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:32.951842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8c186cda-8dae-43e4-896a-b249805d6401 req-a6235fad-86f5-4b4d-8869-ddd1ccedf833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e01a82-da3c-4bdb-b1ba-5412768d1794", "tag": "29a7d263-ffaa-4df1-8cd7-6b0662f519c3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:32.980523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8c186cda-8dae-43e4-896a-b249805d6401 req-a6235fad-86f5-4b4d-8869-ddd1ccedf833 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:32.981021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8c186cda-8dae-43e4-896a-b249805d6401 req-a6235fad-86f5-4b4d-8869-ddd1ccedf833 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:32.981475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8c186cda-8dae-43e4-896a-b249805d6401 req-a6235fad-86f5-4b4d-8869-ddd1ccedf833 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:33.007672 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8c186cda-8dae-43e4-896a-b249805d6401 req-a6235fad-86f5-4b4d-8869-ddd1ccedf833 service nova] Creating event network-changed:29a7d263-ffaa-4df1-8cd7-6b0662f519c3 for instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 on n-h1-820368-35 Aug 27 05:33:33.023357 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8c186cda-8dae-43e4-896a-b249805d6401 req-a6235fad-86f5-4b4d-8869-ddd1ccedf833 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081420 Aug 27 05:33:33.023986 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3218/6435] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:33:33.775699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1be34883-1701-4b3b-9ae7-09577b75d2b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:33.777998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1be34883-1701-4b3b-9ae7-09577b75d2b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:33.795005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1be34883-1701-4b3b-9ae7-09577b75d2b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:33.795901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1be34883-1701-4b3b-9ae7-09577b75d2b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:33.799858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1be34883-1701-4b3b-9ae7-09577b75d2b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:33.804435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1be34883-1701-4b3b-9ae7-09577b75d2b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:33.808215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1be34883-1701-4b3b-9ae7-09577b75d2b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:33.809082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1be34883-1701-4b3b-9ae7-09577b75d2b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:33.867043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:33:33.868297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:33:33.870536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:33:33.872946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:33:33.873620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:33:33.897717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:33.898588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:33.899467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:33.928920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:33.931775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:33.940171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:33.988382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:33:33.998314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for user 9d30f8e6a45046dfb2a9325ebd45e99a and project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:33:34.014206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:33:34.017065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:33:34.077005 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-419a28f3-ccaa-4295-bca1-1b19829e2471 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.271937 Aug 27 05:33:34.084829 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3218/6436] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:33:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 2281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:33:34.097924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0cd02ffa-b3f8-4139-96a8-a5f397253acf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:34.099610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0cd02ffa-b3f8-4139-96a8-a5f397253acf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:34.108607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0cd02ffa-b3f8-4139-96a8-a5f397253acf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:34.110112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0cd02ffa-b3f8-4139-96a8-a5f397253acf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:34.111810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0cd02ffa-b3f8-4139-96a8-a5f397253acf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:34.112831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0cd02ffa-b3f8-4139-96a8-a5f397253acf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:34.113473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0cd02ffa-b3f8-4139-96a8-a5f397253acf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:34.114070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0cd02ffa-b3f8-4139-96a8-a5f397253acf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:34.332755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0cd02ffa-b3f8-4139-96a8-a5f397253acf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:34.353253 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0cd02ffa-b3f8-4139-96a8-a5f397253acf tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1186 microversion: 2.1 time: 0.266721 Aug 27 05:33:34.358113 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3219/6437] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:34 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1186 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:34.373448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8b98a7ae-4ae8-4a75-a48d-96057755d651 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:34.384828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8b98a7ae-4ae8-4a75-a48d-96057755d651 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:34.402998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1be34883-1701-4b3b-9ae7-09577b75d2b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:34.419439 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1be34883-1701-4b3b-9ae7-09577b75d2b9 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1673 microversion: 2.1 time: 0.646891 Aug 27 05:33:34.422722 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3219/6438] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:33 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1673 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:34.546647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8b98a7ae-4ae8-4a75-a48d-96057755d651 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:34.555576 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8b98a7ae-4ae8-4a75-a48d-96057755d651 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1266 microversion: 2.1 time: 0.187995 Aug 27 05:33:34.571082 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3220/6439] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:34 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:35.068203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0c8e84bf-2d26-4eb8-8f17-886c7cf14c3e req-f5bc1e52-3909-4c28-bad3-7bf541ab0ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e01a82-da3c-4bdb-b1ba-5412768d1794", "tag": "29a7d263-ffaa-4df1-8cd7-6b0662f519c3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:35.092155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c8e84bf-2d26-4eb8-8f17-886c7cf14c3e req-f5bc1e52-3909-4c28-bad3-7bf541ab0ad8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:35.093490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c8e84bf-2d26-4eb8-8f17-886c7cf14c3e req-f5bc1e52-3909-4c28-bad3-7bf541ab0ad8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:35.094162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c8e84bf-2d26-4eb8-8f17-886c7cf14c3e req-f5bc1e52-3909-4c28-bad3-7bf541ab0ad8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:35.118004 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0c8e84bf-2d26-4eb8-8f17-886c7cf14c3e req-f5bc1e52-3909-4c28-bad3-7bf541ab0ad8 service nova] Creating event network-changed:29a7d263-ffaa-4df1-8cd7-6b0662f519c3 for instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 on n-h1-820368-35 Aug 27 05:33:35.154959 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0c8e84bf-2d26-4eb8-8f17-886c7cf14c3e req-f5bc1e52-3909-4c28-bad3-7bf541ab0ad8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088811 Aug 27 05:33:35.159419 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3220/6440] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:33:35.391285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65029fdd-23d3-419f-874b-959ebb5f9024 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:35.392094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-65029fdd-23d3-419f-874b-959ebb5f9024 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:35.445714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1548f175-c284-457f-b16d-9cc0c403d44d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:35.447332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1548f175-c284-457f-b16d-9cc0c403d44d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:35.449614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65029fdd-23d3-419f-874b-959ebb5f9024 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:35.461155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1548f175-c284-457f-b16d-9cc0c403d44d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:35.461655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1548f175-c284-457f-b16d-9cc0c403d44d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:35.462374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1548f175-c284-457f-b16d-9cc0c403d44d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:35.462804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1548f175-c284-457f-b16d-9cc0c403d44d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:35.471805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65029fdd-23d3-419f-874b-959ebb5f9024 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:35.473464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1548f175-c284-457f-b16d-9cc0c403d44d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:35.473925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1548f175-c284-457f-b16d-9cc0c403d44d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:35.481035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65029fdd-23d3-419f-874b-959ebb5f9024 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:35.483315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65029fdd-23d3-419f-874b-959ebb5f9024 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:35.484402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65029fdd-23d3-419f-874b-959ebb5f9024 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:35.485877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65029fdd-23d3-419f-874b-959ebb5f9024 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:35.799479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1548f175-c284-457f-b16d-9cc0c403d44d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:35.835582 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1548f175-c284-457f-b16d-9cc0c403d44d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1605 microversion: 2.1 time: 0.383458 Aug 27 05:33:35.871325 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3221/6441] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:35 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1605 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:35.898003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3ffe11e7-ea16-488f-8525-5652d9779dd0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:35.898617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3ffe11e7-ea16-488f-8525-5652d9779dd0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:35.941778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ffe11e7-ea16-488f-8525-5652d9779dd0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:35.942303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ffe11e7-ea16-488f-8525-5652d9779dd0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:35.942678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ffe11e7-ea16-488f-8525-5652d9779dd0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:35.943773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ffe11e7-ea16-488f-8525-5652d9779dd0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:35.944452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ffe11e7-ea16-488f-8525-5652d9779dd0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:35.944945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3ffe11e7-ea16-488f-8525-5652d9779dd0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:36.117159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3ffe11e7-ea16-488f-8525-5652d9779dd0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:36.131219 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3ffe11e7-ea16-488f-8525-5652d9779dd0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1318 microversion: 2.1 time: 0.258208 Aug 27 05:33:36.132757 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3222/6442] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:35 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:36.283717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-65029fdd-23d3-419f-874b-959ebb5f9024 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:36.304510 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-65029fdd-23d3-419f-874b-959ebb5f9024 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1228 microversion: 2.1 time: 0.924767 Aug 27 05:33:36.333762 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3221/6443] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:35 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1228 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:36.873823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:36.874584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:36.900468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:36.903620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:36.904125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:36.904904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:36.905386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:36.905822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:37.029367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:37.029839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:37.030344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:37.030742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lazy-loading 'fault' on Instance uuid e6a68fe3-998d-48a4-bb1b-38b743a81bd2 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:33:37.166211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-522bf322-1588-4dc8-ba66-928e152c27bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:37.166960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-522bf322-1588-4dc8-ba66-928e152c27bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:37.183640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-522bf322-1588-4dc8-ba66-928e152c27bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:37.184152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-522bf322-1588-4dc8-ba66-928e152c27bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:37.184597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-522bf322-1588-4dc8-ba66-928e152c27bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:37.185328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-522bf322-1588-4dc8-ba66-928e152c27bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:37.185785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-522bf322-1588-4dc8-ba66-928e152c27bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:37.186215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-522bf322-1588-4dc8-ba66-928e152c27bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:37.768990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:37.778615 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a6ff3e56-f16e-4824-a541-56a9a0c0236c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 200 len: 1327 microversion: 2.1 time: 0.912641 Aug 27 05:33:37.799996 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3223/6444] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:36 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 1327 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:37.822109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-d4bfcca7-4a88-4fe9-8896-b7886d90f335 req-11986b27-9e76-4c54-9a58-8c44c231aae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a68fe3-998d-48a4-bb1b-38b743a81bd2", "name": "network-vif-deleted", "tag": "6a989aa8-53e7-456e-b6de-7425f0969d81"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:37.858269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d4bfcca7-4a88-4fe9-8896-b7886d90f335 req-11986b27-9e76-4c54-9a58-8c44c231aae4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:37.870776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d4bfcca7-4a88-4fe9-8896-b7886d90f335 req-11986b27-9e76-4c54-9a58-8c44c231aae4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:37.875015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d4bfcca7-4a88-4fe9-8896-b7886d90f335 req-11986b27-9e76-4c54-9a58-8c44c231aae4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:37.915446 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-d4bfcca7-4a88-4fe9-8896-b7886d90f335 req-11986b27-9e76-4c54-9a58-8c44c231aae4 service nova] Creating event network-vif-deleted:6a989aa8-53e7-456e-b6de-7425f0969d81 for instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 on n-h2-820368-35 Aug 27 05:33:37.931352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-522bf322-1588-4dc8-ba66-928e152c27bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:37.941711 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-d4bfcca7-4a88-4fe9-8896-b7886d90f335 req-11986b27-9e76-4c54-9a58-8c44c231aae4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142767 Aug 27 05:33:37.946573 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3224/6445] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:33:37.968549 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-522bf322-1588-4dc8-ba66-928e152c27bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1324 microversion: 2.1 time: 0.810325 Aug 27 05:33:37.975866 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3222/6446] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:37 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1324 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:37.980893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0cb22880-8a4d-4433-bc7f-d409a3a41d45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:37.986505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0cb22880-8a4d-4433-bc7f-d409a3a41d45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:38.016133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb22880-8a4d-4433-bc7f-d409a3a41d45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:38.018014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb22880-8a4d-4433-bc7f-d409a3a41d45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:38.019319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb22880-8a4d-4433-bc7f-d409a3a41d45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:38.020368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb22880-8a4d-4433-bc7f-d409a3a41d45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:38.022172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb22880-8a4d-4433-bc7f-d409a3a41d45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:38.023935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cb22880-8a4d-4433-bc7f-d409a3a41d45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:38.822542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:38.832553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:38.878259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:38.888494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:38.892490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:38.901194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:38.904831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:38.905609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:38.966071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0cb22880-8a4d-4433-bc7f-d409a3a41d45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:38.981313 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] HTTP exception thrown: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Request method failure captured: Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 HTTP/1.1 Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauPZ_8MmWes7gl6tV_JRf9QA_aspbvSANYihradzXzjtw0hbkTfuWAjZsRSRcaon5Hq9AyDBopuISwteUa5JA2u1YCrg6N4UhDWXjSSqemlFni_CkbNutlZkTZXRGUxc3-mhEYXqq4e-ANoMhAqEmJqeQLKLBeLDGTv3BMP7Y5xGCA Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cbeac3d8b40a422b97699e81f5ce198f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 4b3cce7ee28e4f2da7f840c917b893df Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e6a68fe3-998d-48a4-bb1b-38b743a81bd2'} Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:33:38.983059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:33:38.990628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:33:38.990628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:33:38.990628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:33:38.990628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:33:38.990628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:33:38.990628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:33:38.990628 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:33:38.990628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Returning 404 to user: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:33:38.991878 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0cb22880-8a4d-4433-bc7f-d409a3a41d45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1228 microversion: 2.1 time: 1.036275 Aug 27 05:33:38.996338 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3225/6447] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:37 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1228 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:39.003020 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4fbbb6b8-1c81-42f7-8dae-937191b7d7b4 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 404 len: 111 microversion: 2.1 time: 0.190525 Aug 27 05:33:39.013201 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3223/6448] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:38 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:33:39.044398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1d106e99-9c3a-4f11-a63d-bc21b34e04c8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '.version_select at 0x7fb564be9310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:39.059001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-319e3537-fdf6-46b1-abd3-0a2cf95671c3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:39.060355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-319e3537-fdf6-46b1-abd3-0a2cf95671c3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:39.091409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319e3537-fdf6-46b1-abd3-0a2cf95671c3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:39.095228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319e3537-fdf6-46b1-abd3-0a2cf95671c3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:39.096527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319e3537-fdf6-46b1-abd3-0a2cf95671c3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:39.097453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319e3537-fdf6-46b1-abd3-0a2cf95671c3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:39.099236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319e3537-fdf6-46b1-abd3-0a2cf95671c3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:39.100535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319e3537-fdf6-46b1-abd3-0a2cf95671c3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:39.136551 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1d106e99-9c3a-4f11-a63d-bc21b34e04c8 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764532653" status: 202 len: 0 microversion: 2.1 time: 0.118040 Aug 27 05:33:39.152302 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3224/6449] 10.222.0.58 () {58 vars in 1221 bytes} [Sat Aug 27 05:33:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764532653 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:33:39.333420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-319e3537-fdf6-46b1-abd3-0a2cf95671c3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:39.345373 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-319e3537-fdf6-46b1-abd3-0a2cf95671c3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1324 microversion: 2.1 time: 0.347411 Aug 27 05:33:39.355414 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3226/6450] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:38 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1324 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:40.016482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c1f63997-71ad-4e0c-88bd-3e900c8ff164 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:40.018425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c1f63997-71ad-4e0c-88bd-3e900c8ff164 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:40.037917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f63997-71ad-4e0c-88bd-3e900c8ff164 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:40.039982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f63997-71ad-4e0c-88bd-3e900c8ff164 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:40.041116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f63997-71ad-4e0c-88bd-3e900c8ff164 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:40.043468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f63997-71ad-4e0c-88bd-3e900c8ff164 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:40.051840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f63997-71ad-4e0c-88bd-3e900c8ff164 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:40.052760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1f63997-71ad-4e0c-88bd-3e900c8ff164 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:40.394884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ab55510-3adc-4351-828d-7b65f0e0aded tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:40.400901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6ab55510-3adc-4351-828d-7b65f0e0aded tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:40.428868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:40.431609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab55510-3adc-4351-828d-7b65f0e0aded tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:40.448498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab55510-3adc-4351-828d-7b65f0e0aded tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:40.450257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab55510-3adc-4351-828d-7b65f0e0aded tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:40.453253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab55510-3adc-4351-828d-7b65f0e0aded tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:40.455760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab55510-3adc-4351-828d-7b65f0e0aded tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:40.462057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6ab55510-3adc-4351-828d-7b65f0e0aded tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:40.530048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:40.632933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c1f63997-71ad-4e0c-88bd-3e900c8ff164 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:40.643663 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c1f63997-71ad-4e0c-88bd-3e900c8ff164 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1228 microversion: 2.1 time: 0.632044 Aug 27 05:33:40.651464 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3225/6451] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:40 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1228 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:40.687167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6ab55510-3adc-4351-828d-7b65f0e0aded tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:40.709134 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6ab55510-3adc-4351-828d-7b65f0e0aded tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1324 microversion: 2.1 time: 0.336494 Aug 27 05:33:40.723568 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3227/6452] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:40 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1324 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:40.989331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-2a9db129-18ce-40b7-add4-70a1618617fe req-cbd9ae72-3bd3-4b8b-845c-86d8a00a0d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33cc6c27-67cc-4387-86c1-fabed764ee90", "tag": "5fa91af8-9c32-4562-b809-01a03545c9dc"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:41.027696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2a9db129-18ce-40b7-add4-70a1618617fe req-cbd9ae72-3bd3-4b8b-845c-86d8a00a0d5a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:41.033304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2a9db129-18ce-40b7-add4-70a1618617fe req-cbd9ae72-3bd3-4b8b-845c-86d8a00a0d5a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:41.034994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2a9db129-18ce-40b7-add4-70a1618617fe req-cbd9ae72-3bd3-4b8b-845c-86d8a00a0d5a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:41.079284 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-2a9db129-18ce-40b7-add4-70a1618617fe req-cbd9ae72-3bd3-4b8b-845c-86d8a00a0d5a service nova] Creating event network-changed:5fa91af8-9c32-4562-b809-01a03545c9dc for instance 33cc6c27-67cc-4387-86c1-fabed764ee90 on n-h2-820368-35 Aug 27 05:33:41.090911 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-2a9db129-18ce-40b7-add4-70a1618617fe req-cbd9ae72-3bd3-4b8b-845c-86d8a00a0d5a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108706 Aug 27 05:33:41.098541 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3226/6453] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:33:41.250428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2bca9a0a-8fe7-40de-ae67-60241382b34f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Action: 'create', calling method: .version_select at 0x7fb5650919d0>, body: {"keypair": {"name": "tempest-keypair-531044678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMgLLsPN4FKH5abXPm7UdCit5VxhaIWzUa1VjgYB80SQtaXxV7XKtuDup1BcyaKl9H7yo/qkxpcpR7DEHyon9NbDRjzlCgm3Vhh70tBik0YPMJCNxMB9xyct8lYyo0XiQ=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:41.286520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-2bca9a0a-8fe7-40de-ae67-60241382b34f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Getting quotas for project cbeac3d8b40a422b97699e81f5ce198f. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:33:41.300688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-2bca9a0a-8fe7-40de-ae67-60241382b34f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Getting quotas for user 4b3cce7ee28e4f2da7f840c917b893df and project cbeac3d8b40a422b97699e81f5ce198f. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:33:41.341202 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2bca9a0a-8fe7-40de-ae67-60241382b34f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107133 Aug 27 05:33:41.349478 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3228/6454] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:33:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:33:41.698865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f93fb1d3-6b28-459e-97fc-d0420f77118c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:41.705536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f93fb1d3-6b28-459e-97fc-d0420f77118c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:41.733420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d0662486-d68a-4f28-bb23-3354086753dd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:41.734044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d0662486-d68a-4f28-bb23-3354086753dd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:41.737590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f93fb1d3-6b28-459e-97fc-d0420f77118c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:41.739439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f93fb1d3-6b28-459e-97fc-d0420f77118c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:41.741271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f93fb1d3-6b28-459e-97fc-d0420f77118c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:41.742766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f93fb1d3-6b28-459e-97fc-d0420f77118c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:41.743875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f93fb1d3-6b28-459e-97fc-d0420f77118c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:41.744793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f93fb1d3-6b28-459e-97fc-d0420f77118c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:41.749891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0662486-d68a-4f28-bb23-3354086753dd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:41.750392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0662486-d68a-4f28-bb23-3354086753dd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:41.750833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0662486-d68a-4f28-bb23-3354086753dd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:41.752427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0662486-d68a-4f28-bb23-3354086753dd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:41.752891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0662486-d68a-4f28-bb23-3354086753dd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:41.753321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0662486-d68a-4f28-bb23-3354086753dd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:42.118804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d0662486-d68a-4f28-bb23-3354086753dd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:42.130104 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d0662486-d68a-4f28-bb23-3354086753dd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1392 microversion: 2.1 time: 0.401644 Aug 27 05:33:42.136174 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3229/6455] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:41 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1392 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:42.207689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f93fb1d3-6b28-459e-97fc-d0420f77118c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:42.217414 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f93fb1d3-6b28-459e-97fc-d0420f77118c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1228 microversion: 2.1 time: 0.526224 Aug 27 05:33:42.219720 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3227/6456] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:41 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1228 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:43.163165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0b16d90f-c756-405f-b25c-4667d4b2f58b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:43.163979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0b16d90f-c756-405f-b25c-4667d4b2f58b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:43.179995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b16d90f-c756-405f-b25c-4667d4b2f58b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:43.180497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b16d90f-c756-405f-b25c-4667d4b2f58b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:43.183058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b16d90f-c756-405f-b25c-4667d4b2f58b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:43.184164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b16d90f-c756-405f-b25c-4667d4b2f58b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:43.185509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b16d90f-c756-405f-b25c-4667d4b2f58b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:43.186112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b16d90f-c756-405f-b25c-4667d4b2f58b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:43.247743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4a1dc918-d9bc-421f-b347-576bc2f4b348 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:43.248354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4a1dc918-d9bc-421f-b347-576bc2f4b348 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:43.266090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a1dc918-d9bc-421f-b347-576bc2f4b348 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:43.266588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a1dc918-d9bc-421f-b347-576bc2f4b348 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:43.267290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a1dc918-d9bc-421f-b347-576bc2f4b348 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:43.276669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a1dc918-d9bc-421f-b347-576bc2f4b348 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:43.277845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a1dc918-d9bc-421f-b347-576bc2f4b348 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:43.278961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a1dc918-d9bc-421f-b347-576bc2f4b348 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:43.962084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:44.106637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0b16d90f-c756-405f-b25c-4667d4b2f58b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:44.121386 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0b16d90f-c756-405f-b25c-4667d4b2f58b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1392 microversion: 2.1 time: 0.964282 Aug 27 05:33:44.122640 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3230/6457] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:43 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1392 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:44.128984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4a1dc918-d9bc-421f-b347-576bc2f4b348 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:44.151555 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4a1dc918-d9bc-421f-b347-576bc2f4b348 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1228 microversion: 2.1 time: 0.908959 Aug 27 05:33:44.154135 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3228/6458] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:43 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1228 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:44.966684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f46b6fdb-e851-4a17-9d3a-5a466e323950 req-a52e1197-6580-49e9-95e4-4b1b5e6d5711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06b8d48-3bfb-4137-bfd0-1619ccff91c9", "tag": "b26fae87-aabc-4649-a0ea-bffbb357ae83"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:45.000397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f46b6fdb-e851-4a17-9d3a-5a466e323950 req-a52e1197-6580-49e9-95e4-4b1b5e6d5711 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:45.000977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f46b6fdb-e851-4a17-9d3a-5a466e323950 req-a52e1197-6580-49e9-95e4-4b1b5e6d5711 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:45.002300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f46b6fdb-e851-4a17-9d3a-5a466e323950 req-a52e1197-6580-49e9-95e4-4b1b5e6d5711 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:45.028125 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f46b6fdb-e851-4a17-9d3a-5a466e323950 req-a52e1197-6580-49e9-95e4-4b1b5e6d5711 service nova] Creating event network-changed:b26fae87-aabc-4649-a0ea-bffbb357ae83 for instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 on n-h1-820368-35 Aug 27 05:33:45.038500 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f46b6fdb-e851-4a17-9d3a-5a466e323950 req-a52e1197-6580-49e9-95e4-4b1b5e6d5711 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076572 Aug 27 05:33:45.039752 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3231/6459] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:33:45.166362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b4f585ea-91f8-410b-a496-07f08b506773 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:45.168995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b4f585ea-91f8-410b-a496-07f08b506773 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:45.185974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-108f9413-0e28-4461-b932-b97f75fe6465 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:45.187033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-108f9413-0e28-4461-b932-b97f75fe6465 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:45.200698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=14 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:45.205025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4f585ea-91f8-410b-a496-07f08b506773 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:45.209890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4f585ea-91f8-410b-a496-07f08b506773 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:45.211345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-108f9413-0e28-4461-b932-b97f75fe6465 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:45.216409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4f585ea-91f8-410b-a496-07f08b506773 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:45.217853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4f585ea-91f8-410b-a496-07f08b506773 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:45.218263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-108f9413-0e28-4461-b932-b97f75fe6465 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:45.219061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-108f9413-0e28-4461-b932-b97f75fe6465 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:45.221407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-108f9413-0e28-4461-b932-b97f75fe6465 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:45.221664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4f585ea-91f8-410b-a496-07f08b506773 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:45.222263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b4f585ea-91f8-410b-a496-07f08b506773 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:45.223046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-108f9413-0e28-4461-b932-b97f75fe6465 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:45.223647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-108f9413-0e28-4461-b932-b97f75fe6465 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:45.805861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-108f9413-0e28-4461-b932-b97f75fe6465 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:45.811691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b4f585ea-91f8-410b-a496-07f08b506773 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:45.815353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=80 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:45.828402 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-108f9413-0e28-4461-b932-b97f75fe6465 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1228 microversion: 2.1 time: 0.648721 Aug 27 05:33:45.830082 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b4f585ea-91f8-410b-a496-07f08b506773 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1392 microversion: 2.1 time: 0.667325 Aug 27 05:33:45.847213 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3232/6460] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:45 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1228 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:45.847493 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3229/6461] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:45 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1392 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:45.995026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1366188977", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60ab6058-53a4-4df9-adac-b4686bb85340"}], "security_groups": [{"name": "tempest-securitygroup--456264708"}], "key_name": "tempest-keypair-531044678", "user_data": "}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:46.164073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] validate_networks() for [('60ab6058-53a4-4df9-adac-b4686bb85340', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:33:46.852492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:33:46.853164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:33:46.853885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:33:46.854087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f47fb3f-1693-4d82-ab52-5b09978ab2c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:46.854524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:33:46.854874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:33:46.855596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f47fb3f-1693-4d82-ab52-5b09978ab2c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:46.857004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:46.864108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:46.868345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47fb3f-1693-4d82-ab52-5b09978ab2c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:46.869203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47fb3f-1693-4d82-ab52-5b09978ab2c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:46.869836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47fb3f-1693-4d82-ab52-5b09978ab2c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:46.870879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47fb3f-1693-4d82-ab52-5b09978ab2c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:46.871545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47fb3f-1693-4d82-ab52-5b09978ab2c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:46.872140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f47fb3f-1693-4d82-ab52-5b09978ab2c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:46.884103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:46.884605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:46.885050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:46.885806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:46.886243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:46.886676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:46.948386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Getting quotas for project cbeac3d8b40a422b97699e81f5ce198f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:33:46.961217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Getting quotas for user 4b3cce7ee28e4f2da7f840c917b893df and project cbeac3d8b40a422b97699e81f5ce198f. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:33:46.991936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:33:47.003024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:33:47.105825 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e4b970f-4441-4019-b8b5-93b5d8e3af0f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.115096 Aug 27 05:33:47.108025 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3233/6462] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:33:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:33:47.124352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-404b32f2-bc29-4bec-8c52-0e45aa535ffa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:47.129425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-404b32f2-bc29-4bec-8c52-0e45aa535ffa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:47.157079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-404b32f2-bc29-4bec-8c52-0e45aa535ffa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:47.163446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-404b32f2-bc29-4bec-8c52-0e45aa535ffa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:47.164515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-404b32f2-bc29-4bec-8c52-0e45aa535ffa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:47.166851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-404b32f2-bc29-4bec-8c52-0e45aa535ffa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:47.169720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-404b32f2-bc29-4bec-8c52-0e45aa535ffa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:47.170542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-404b32f2-bc29-4bec-8c52-0e45aa535ffa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:47.209108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f47fb3f-1693-4d82-ab52-5b09978ab2c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:47.232411 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f47fb3f-1693-4d82-ab52-5b09978ab2c4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1216 microversion: 2.1 time: 0.382060 Aug 27 05:33:47.254104 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3230/6463] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:46 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1216 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:47.559456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-12d1c3da-41fd-44a5-96de-3784ff173ac6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:47.560123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-12d1c3da-41fd-44a5-96de-3784ff173ac6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:47.611933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-404b32f2-bc29-4bec-8c52-0e45aa535ffa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:47.630677 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-404b32f2-bc29-4bec-8c52-0e45aa535ffa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1392 microversion: 2.1 time: 0.515186 Aug 27 05:33:47.644752 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3234/6464] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:47 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1392 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:47.695602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-12d1c3da-41fd-44a5-96de-3784ff173ac6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:47.713844 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-12d1c3da-41fd-44a5-96de-3784ff173ac6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1237 microversion: 2.1 time: 0.455496 Aug 27 05:33:47.715294 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3231/6465] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:47 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1237 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:48.266714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-19a3d101-bc8e-4f93-8edb-e19b7d2699fa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:48.267991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-19a3d101-bc8e-4f93-8edb-e19b7d2699fa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:48.297526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19a3d101-bc8e-4f93-8edb-e19b7d2699fa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:48.300805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19a3d101-bc8e-4f93-8edb-e19b7d2699fa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:48.301269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19a3d101-bc8e-4f93-8edb-e19b7d2699fa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:48.302200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19a3d101-bc8e-4f93-8edb-e19b7d2699fa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:48.307173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19a3d101-bc8e-4f93-8edb-e19b7d2699fa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:48.308232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19a3d101-bc8e-4f93-8edb-e19b7d2699fa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:48.632174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-19a3d101-bc8e-4f93-8edb-e19b7d2699fa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:48.656824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-335ccbdd-0e8b-4cb0-ad1b-b0d905011326 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:48.658322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-335ccbdd-0e8b-4cb0-ad1b-b0d905011326 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:48.659466 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-19a3d101-bc8e-4f93-8edb-e19b7d2699fa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1216 microversion: 2.1 time: 0.404435 Aug 27 05:33:48.664474 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3235/6466] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:48 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1216 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:48.672673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-335ccbdd-0e8b-4cb0-ad1b-b0d905011326 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:48.674312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-335ccbdd-0e8b-4cb0-ad1b-b0d905011326 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:48.674776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-335ccbdd-0e8b-4cb0-ad1b-b0d905011326 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:48.678273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-335ccbdd-0e8b-4cb0-ad1b-b0d905011326 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:48.678953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-335ccbdd-0e8b-4cb0-ad1b-b0d905011326 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:48.687736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-335ccbdd-0e8b-4cb0-ad1b-b0d905011326 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:48.751862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-93277225-8849-4502-b0bf-14e813592780 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:48.755031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-93277225-8849-4502-b0bf-14e813592780 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:48.774634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277225-8849-4502-b0bf-14e813592780 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:48.775944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277225-8849-4502-b0bf-14e813592780 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:48.776689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277225-8849-4502-b0bf-14e813592780 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:48.777895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277225-8849-4502-b0bf-14e813592780 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:48.779263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277225-8849-4502-b0bf-14e813592780 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:48.780073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-93277225-8849-4502-b0bf-14e813592780 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:48.952547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-93277225-8849-4502-b0bf-14e813592780 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:48.967692 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-93277225-8849-4502-b0bf-14e813592780 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1289 microversion: 2.1 time: 0.230666 Aug 27 05:33:48.970979 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3236/6467] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:48 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1289 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:49.041195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-335ccbdd-0e8b-4cb0-ad1b-b0d905011326 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:49.061895 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-335ccbdd-0e8b-4cb0-ad1b-b0d905011326 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1392 microversion: 2.1 time: 0.405985 Aug 27 05:33:49.063663 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3232/6468] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:48 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1392 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:49.702169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-811fedb7-54f0-4ec7-ae65-a2138dc8f286 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:49.705555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-811fedb7-54f0-4ec7-ae65-a2138dc8f286 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:49.726214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-811fedb7-54f0-4ec7-ae65-a2138dc8f286 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:49.727547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-811fedb7-54f0-4ec7-ae65-a2138dc8f286 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:49.728454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-811fedb7-54f0-4ec7-ae65-a2138dc8f286 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:49.730404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-811fedb7-54f0-4ec7-ae65-a2138dc8f286 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:49.731283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-811fedb7-54f0-4ec7-ae65-a2138dc8f286 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:49.732784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-811fedb7-54f0-4ec7-ae65-a2138dc8f286 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:49.948323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-811fedb7-54f0-4ec7-ae65-a2138dc8f286 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:49.969430 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-811fedb7-54f0-4ec7-ae65-a2138dc8f286 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1216 microversion: 2.1 time: 0.283693 Aug 27 05:33:49.971862 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3237/6469] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:49 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1216 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:49.994272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bf2043bb-e778-41f6-b726-26d54381ab6a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:49.996912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bf2043bb-e778-41f6-b726-26d54381ab6a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:50.017253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf2043bb-e778-41f6-b726-26d54381ab6a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:50.018298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf2043bb-e778-41f6-b726-26d54381ab6a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:50.023057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf2043bb-e778-41f6-b726-26d54381ab6a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:50.023057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf2043bb-e778-41f6-b726-26d54381ab6a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:50.032810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf2043bb-e778-41f6-b726-26d54381ab6a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:50.033664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf2043bb-e778-41f6-b726-26d54381ab6a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:50.087076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c813cc48-e1cc-43c6-8c79-f4f2d469eedc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:50.087994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c813cc48-e1cc-43c6-8c79-f4f2d469eedc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:50.099643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c813cc48-e1cc-43c6-8c79-f4f2d469eedc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:50.100157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c813cc48-e1cc-43c6-8c79-f4f2d469eedc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:50.102467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c813cc48-e1cc-43c6-8c79-f4f2d469eedc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:50.105456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c813cc48-e1cc-43c6-8c79-f4f2d469eedc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:50.105976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c813cc48-e1cc-43c6-8c79-f4f2d469eedc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:50.106429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c813cc48-e1cc-43c6-8c79-f4f2d469eedc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:50.169166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bf2043bb-e778-41f6-b726-26d54381ab6a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:50.184200 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bf2043bb-e778-41f6-b726-26d54381ab6a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1295 microversion: 2.1 time: 0.194867 Aug 27 05:33:50.185197 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3233/6470] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:49 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1295 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:50.416024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c813cc48-e1cc-43c6-8c79-f4f2d469eedc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:50.431189 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c813cc48-e1cc-43c6-8c79-f4f2d469eedc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1392 microversion: 2.1 time: 0.346694 Aug 27 05:33:50.433483 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3238/6471] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:50 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1392 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:50.994243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b63d7759-c337-42db-85c5-2af5c8330e4a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:50.995104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b63d7759-c337-42db-85c5-2af5c8330e4a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:51.008007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63d7759-c337-42db-85c5-2af5c8330e4a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:51.009201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63d7759-c337-42db-85c5-2af5c8330e4a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:51.009740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63d7759-c337-42db-85c5-2af5c8330e4a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:51.012090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63d7759-c337-42db-85c5-2af5c8330e4a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:51.013224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63d7759-c337-42db-85c5-2af5c8330e4a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:51.014855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63d7759-c337-42db-85c5-2af5c8330e4a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:51.209997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b63d7759-c337-42db-85c5-2af5c8330e4a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:51.218530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-558d00ba-c425-4ece-8b7f-72b3d50a4afb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:51.219919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-558d00ba-c425-4ece-8b7f-72b3d50a4afb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:51.221076 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b63d7759-c337-42db-85c5-2af5c8330e4a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1216 microversion: 2.1 time: 0.232579 Aug 27 05:33:51.238121 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3234/6472] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:50 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1216 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:51.244179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-558d00ba-c425-4ece-8b7f-72b3d50a4afb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:51.245446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-558d00ba-c425-4ece-8b7f-72b3d50a4afb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:51.253038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-558d00ba-c425-4ece-8b7f-72b3d50a4afb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:51.254394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-558d00ba-c425-4ece-8b7f-72b3d50a4afb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:51.257015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-558d00ba-c425-4ece-8b7f-72b3d50a4afb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:51.258718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-558d00ba-c425-4ece-8b7f-72b3d50a4afb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:51.405443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-558d00ba-c425-4ece-8b7f-72b3d50a4afb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:51.415795 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-558d00ba-c425-4ece-8b7f-72b3d50a4afb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1295 microversion: 2.1 time: 0.201716 Aug 27 05:33:51.416402 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3239/6473] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:51 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1295 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:51.454973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ca7901dd-fe4a-442e-a6fb-042ce83d2dc0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:51.455742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ca7901dd-fe4a-442e-a6fb-042ce83d2dc0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:51.468856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca7901dd-fe4a-442e-a6fb-042ce83d2dc0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:51.469497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca7901dd-fe4a-442e-a6fb-042ce83d2dc0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:51.470739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca7901dd-fe4a-442e-a6fb-042ce83d2dc0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:51.471800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca7901dd-fe4a-442e-a6fb-042ce83d2dc0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:51.472485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca7901dd-fe4a-442e-a6fb-042ce83d2dc0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:51.473111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca7901dd-fe4a-442e-a6fb-042ce83d2dc0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:52.246858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e91c4a93-50c8-4c02-90e2-0a7887dd1a18 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:52.247516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e91c4a93-50c8-4c02-90e2-0a7887dd1a18 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:52.261895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e91c4a93-50c8-4c02-90e2-0a7887dd1a18 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:52.262819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e91c4a93-50c8-4c02-90e2-0a7887dd1a18 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:52.264065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e91c4a93-50c8-4c02-90e2-0a7887dd1a18 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:52.268899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e91c4a93-50c8-4c02-90e2-0a7887dd1a18 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:52.269358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e91c4a93-50c8-4c02-90e2-0a7887dd1a18 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:52.270196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e91c4a93-50c8-4c02-90e2-0a7887dd1a18 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:52.430446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ca7901dd-fe4a-442e-a6fb-042ce83d2dc0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:52.439679 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ca7901dd-fe4a-442e-a6fb-042ce83d2dc0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1392 microversion: 2.1 time: 0.989952 Aug 27 05:33:52.448770 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3235/6474] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:51 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1392 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:52.473476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1e969790-ff85-487c-902d-1cd977901898 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:52.475058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1e969790-ff85-487c-902d-1cd977901898 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:52.489870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e969790-ff85-487c-902d-1cd977901898 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:52.490547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e969790-ff85-487c-902d-1cd977901898 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:52.491102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e969790-ff85-487c-902d-1cd977901898 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:52.491926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e969790-ff85-487c-902d-1cd977901898 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:52.493680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e969790-ff85-487c-902d-1cd977901898 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:52.494654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e969790-ff85-487c-902d-1cd977901898 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:52.605409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e91c4a93-50c8-4c02-90e2-0a7887dd1a18 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:52.632271 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e91c4a93-50c8-4c02-90e2-0a7887dd1a18 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1216 microversion: 2.1 time: 0.389975 Aug 27 05:33:52.647778 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3240/6475] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:52 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1216 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:52.729882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1e969790-ff85-487c-902d-1cd977901898 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:52.738879 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1e969790-ff85-487c-902d-1cd977901898 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1362 microversion: 2.1 time: 0.288767 Aug 27 05:33:52.739500 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3236/6476] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:52 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:52.994804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7c27ae30-57c6-41ac-9300-cd986e2860f9 req-686fcc51-1b20-417c-a4db-a8883b1a411f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22df37d-a283-4e94-a99a-9ef29435d5ae", "tag": "7d558974-411e-49d9-9e68-1c404cca78a2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:53.009366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7c27ae30-57c6-41ac-9300-cd986e2860f9 req-686fcc51-1b20-417c-a4db-a8883b1a411f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:53.010462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7c27ae30-57c6-41ac-9300-cd986e2860f9 req-686fcc51-1b20-417c-a4db-a8883b1a411f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:53.011228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7c27ae30-57c6-41ac-9300-cd986e2860f9 req-686fcc51-1b20-417c-a4db-a8883b1a411f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:53.028479 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7c27ae30-57c6-41ac-9300-cd986e2860f9 req-686fcc51-1b20-417c-a4db-a8883b1a411f service nova] Creating event network-changed:7d558974-411e-49d9-9e68-1c404cca78a2 for instance c22df37d-a283-4e94-a99a-9ef29435d5ae on n-h2-820368-35 Aug 27 05:33:53.035837 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7c27ae30-57c6-41ac-9300-cd986e2860f9 req-686fcc51-1b20-417c-a4db-a8883b1a411f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049849 Aug 27 05:33:53.036787 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3241/6477] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:33:53.480326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a31b43fb-fc6f-45ac-a511-6a9e21cd32d9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:53.481363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a31b43fb-fc6f-45ac-a511-6a9e21cd32d9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:53.489022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a31b43fb-fc6f-45ac-a511-6a9e21cd32d9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:53.489522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a31b43fb-fc6f-45ac-a511-6a9e21cd32d9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:53.489961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a31b43fb-fc6f-45ac-a511-6a9e21cd32d9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:53.490676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a31b43fb-fc6f-45ac-a511-6a9e21cd32d9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:53.491234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a31b43fb-fc6f-45ac-a511-6a9e21cd32d9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:53.491676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a31b43fb-fc6f-45ac-a511-6a9e21cd32d9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:53.607793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-a34d1f5d-1280-48cc-9b4c-e94da80ef4ce req-06be3171-6149-4361-9ca3-897abefe085a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06b8d48-3bfb-4137-bfd0-1619ccff91c9", "name": "network-vif-plugged", "status": "completed", "tag": "b26fae87-aabc-4649-a0ea-bffbb357ae83"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:53.639468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a34d1f5d-1280-48cc-9b4c-e94da80ef4ce req-06be3171-6149-4361-9ca3-897abefe085a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:53.639958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a34d1f5d-1280-48cc-9b4c-e94da80ef4ce req-06be3171-6149-4361-9ca3-897abefe085a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:53.640399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a34d1f5d-1280-48cc-9b4c-e94da80ef4ce req-06be3171-6149-4361-9ca3-897abefe085a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:53.674124 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-a34d1f5d-1280-48cc-9b4c-e94da80ef4ce req-06be3171-6149-4361-9ca3-897abefe085a service nova] Creating event network-vif-plugged:b26fae87-aabc-4649-a0ea-bffbb357ae83 for instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 on n-h1-820368-35 Aug 27 05:33:53.680259 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-a34d1f5d-1280-48cc-9b4c-e94da80ef4ce req-06be3171-6149-4361-9ca3-897abefe085a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084002 Aug 27 05:33:53.681369 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3242/6478] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:33:53.691797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd96d886-7ae7-4515-9584-d479620cd896 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:53.703702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd96d886-7ae7-4515-9584-d479620cd896 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:53.711903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd96d886-7ae7-4515-9584-d479620cd896 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:53.712397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd96d886-7ae7-4515-9584-d479620cd896 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:53.719651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd96d886-7ae7-4515-9584-d479620cd896 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:53.720592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd96d886-7ae7-4515-9584-d479620cd896 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:53.721267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd96d886-7ae7-4515-9584-d479620cd896 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:53.721853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd96d886-7ae7-4515-9584-d479620cd896 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:53.762154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a31b43fb-fc6f-45ac-a511-6a9e21cd32d9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:53.774291 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a31b43fb-fc6f-45ac-a511-6a9e21cd32d9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1392 microversion: 2.1 time: 0.307183 Aug 27 05:33:53.791833 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3237/6479] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:53 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1392 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:53.799264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2aa666b7-ee67-4bdd-b262-b4dc5b72155b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:53.800168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2aa666b7-ee67-4bdd-b262-b4dc5b72155b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:53.823738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2aa666b7-ee67-4bdd-b262-b4dc5b72155b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:53.824246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2aa666b7-ee67-4bdd-b262-b4dc5b72155b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:53.824763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2aa666b7-ee67-4bdd-b262-b4dc5b72155b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:53.825491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2aa666b7-ee67-4bdd-b262-b4dc5b72155b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:53.826064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2aa666b7-ee67-4bdd-b262-b4dc5b72155b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:53.826513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2aa666b7-ee67-4bdd-b262-b4dc5b72155b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:54.026421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dd96d886-7ae7-4515-9584-d479620cd896 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:54.038400 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd96d886-7ae7-4515-9584-d479620cd896 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1216 microversion: 2.1 time: 0.355183 Aug 27 05:33:54.039349 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3243/6480] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:53 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1216 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:54.045873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2aa666b7-ee67-4bdd-b262-b4dc5b72155b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:54.056599 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2aa666b7-ee67-4bdd-b262-b4dc5b72155b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1362 microversion: 2.1 time: 0.263256 Aug 27 05:33:54.057316 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3238/6481] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:53 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:54.798687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-09392fff-2520-438d-8d59-a89a9c4a701a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:54.799334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-09392fff-2520-438d-8d59-a89a9c4a701a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:54.807769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09392fff-2520-438d-8d59-a89a9c4a701a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:54.808273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09392fff-2520-438d-8d59-a89a9c4a701a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:54.810071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09392fff-2520-438d-8d59-a89a9c4a701a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:54.810867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09392fff-2520-438d-8d59-a89a9c4a701a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:54.811608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09392fff-2520-438d-8d59-a89a9c4a701a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:54.812441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09392fff-2520-438d-8d59-a89a9c4a701a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:54.988326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-09392fff-2520-438d-8d59-a89a9c4a701a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:54.997068 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-09392fff-2520-438d-8d59-a89a9c4a701a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1392 microversion: 2.1 time: 0.202800 Aug 27 05:33:54.997757 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3244/6482] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:54 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:55.061657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9729999e-89ff-4db7-900e-9b3e4e1543c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:55.063419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9729999e-89ff-4db7-900e-9b3e4e1543c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:55.072455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9729999e-89ff-4db7-900e-9b3e4e1543c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:55.073246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9729999e-89ff-4db7-900e-9b3e4e1543c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:55.073857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9729999e-89ff-4db7-900e-9b3e4e1543c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:55.082942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec2997eb-5564-4b16-b530-709826197f6e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:55.083630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec2997eb-5564-4b16-b530-709826197f6e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:55.087620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9729999e-89ff-4db7-900e-9b3e4e1543c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:55.088135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9729999e-89ff-4db7-900e-9b3e4e1543c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:55.088580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9729999e-89ff-4db7-900e-9b3e4e1543c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:55.098866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2997eb-5564-4b16-b530-709826197f6e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:55.099552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2997eb-5564-4b16-b530-709826197f6e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:55.100005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2997eb-5564-4b16-b530-709826197f6e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:55.100737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2997eb-5564-4b16-b530-709826197f6e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:55.101195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2997eb-5564-4b16-b530-709826197f6e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:55.101637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec2997eb-5564-4b16-b530-709826197f6e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:55.359514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ec2997eb-5564-4b16-b530-709826197f6e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:55.369176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9729999e-89ff-4db7-900e-9b3e4e1543c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:55.390609 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec2997eb-5564-4b16-b530-709826197f6e tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1362 microversion: 2.1 time: 0.314883 Aug 27 05:33:55.391265 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3245/6483] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:55 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:55.400637 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9729999e-89ff-4db7-900e-9b3e4e1543c9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1216 microversion: 2.1 time: 0.345553 Aug 27 05:33:55.412032 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3239/6484] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:55 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1216 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:56.019162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-30e4627d-2c90-425f-8d36-e91bd133d6bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:56.020060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-30e4627d-2c90-425f-8d36-e91bd133d6bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:56.027591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30e4627d-2c90-425f-8d36-e91bd133d6bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:56.028116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30e4627d-2c90-425f-8d36-e91bd133d6bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:56.028544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30e4627d-2c90-425f-8d36-e91bd133d6bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:56.029553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30e4627d-2c90-425f-8d36-e91bd133d6bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:56.030211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30e4627d-2c90-425f-8d36-e91bd133d6bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:56.030735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30e4627d-2c90-425f-8d36-e91bd133d6bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:56.196523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-30e4627d-2c90-425f-8d36-e91bd133d6bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:56.205770 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-30e4627d-2c90-425f-8d36-e91bd133d6bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1565 microversion: 2.1 time: 0.190663 Aug 27 05:33:56.206398 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3246/6485] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:56 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1565 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:56.229027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f5d04b5-e57c-4697-a92f-d1aa4a834dda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:56.229664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4f5d04b5-e57c-4697-a92f-d1aa4a834dda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:56.236545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f5d04b5-e57c-4697-a92f-d1aa4a834dda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:56.237060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f5d04b5-e57c-4697-a92f-d1aa4a834dda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:56.238017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f5d04b5-e57c-4697-a92f-d1aa4a834dda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:56.246423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f5d04b5-e57c-4697-a92f-d1aa4a834dda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:56.246423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f5d04b5-e57c-4697-a92f-d1aa4a834dda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:56.246423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f5d04b5-e57c-4697-a92f-d1aa4a834dda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:56.414733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf130fc5-35c5-431c-aa71-12700268eca5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:56.415052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf130fc5-35c5-431c-aa71-12700268eca5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:56.422743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf130fc5-35c5-431c-aa71-12700268eca5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:56.424005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf130fc5-35c5-431c-aa71-12700268eca5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:56.424684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf130fc5-35c5-431c-aa71-12700268eca5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:56.425907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf130fc5-35c5-431c-aa71-12700268eca5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:56.426742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf130fc5-35c5-431c-aa71-12700268eca5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:56.427774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf130fc5-35c5-431c-aa71-12700268eca5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:56.429010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f5d04b5-e57c-4697-a92f-d1aa4a834dda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:56.479299 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f5d04b5-e57c-4697-a92f-d1aa4a834dda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1565 microversion: 2.1 time: 0.254901 Aug 27 05:33:56.481203 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3240/6486] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:56 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1565 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:56.486438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-334a6d29-d91c-430f-8161-97ec145ecd81 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:56.487294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-334a6d29-d91c-430f-8161-97ec145ecd81 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:56.495166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334a6d29-d91c-430f-8161-97ec145ecd81 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:56.495833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334a6d29-d91c-430f-8161-97ec145ecd81 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:56.496769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334a6d29-d91c-430f-8161-97ec145ecd81 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:56.497657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334a6d29-d91c-430f-8161-97ec145ecd81 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:56.498271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334a6d29-d91c-430f-8161-97ec145ecd81 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:56.498872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-334a6d29-d91c-430f-8161-97ec145ecd81 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:56.912631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:56.981817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=10 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:57.059039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bf130fc5-35c5-431c-aa71-12700268eca5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:57.068042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:57.115491 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf130fc5-35c5-431c-aa71-12700268eca5 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1362 microversion: 2.1 time: 0.704521 Aug 27 05:33:57.117804 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3247/6487] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:56 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1362 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:57.123578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1137f79a-38b9-43ec-926c-0b08bd7b8630 req-3d6fc858-585f-4ed4-bd56-4fa82f21d685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cc6c27-67cc-4387-86c1-fabed764ee90", "name": "network-vif-plugged", "status": "completed", "tag": "5fa91af8-9c32-4562-b809-01a03545c9dc"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:57.138885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1137f79a-38b9-43ec-926c-0b08bd7b8630 req-3d6fc858-585f-4ed4-bd56-4fa82f21d685 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:57.139655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1137f79a-38b9-43ec-926c-0b08bd7b8630 req-3d6fc858-585f-4ed4-bd56-4fa82f21d685 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:57.140369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1137f79a-38b9-43ec-926c-0b08bd7b8630 req-3d6fc858-585f-4ed4-bd56-4fa82f21d685 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:57.143516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-334a6d29-d91c-430f-8161-97ec145ecd81 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:57.154815 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-334a6d29-d91c-430f-8161-97ec145ecd81 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1216 microversion: 2.1 time: 0.672301 Aug 27 05:33:57.156060 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3241/6488] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:56 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1216 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:57.163024 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1137f79a-38b9-43ec-926c-0b08bd7b8630 req-3d6fc858-585f-4ed4-bd56-4fa82f21d685 service nova] Creating event network-vif-plugged:5fa91af8-9c32-4562-b809-01a03545c9dc for instance 33cc6c27-67cc-4387-86c1-fabed764ee90 on n-h2-820368-35 Aug 27 05:33:57.169133 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1137f79a-38b9-43ec-926c-0b08bd7b8630 req-3d6fc858-585f-4ed4-bd56-4fa82f21d685 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049458 Aug 27 05:33:57.170352 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3248/6489] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:33:58.139041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-94f04e85-8050-47ee-857a-fd8ba87cb23a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:58.140465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-94f04e85-8050-47ee-857a-fd8ba87cb23a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:58.150130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:33:58.152858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94f04e85-8050-47ee-857a-fd8ba87cb23a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:58.153803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94f04e85-8050-47ee-857a-fd8ba87cb23a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:58.154581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94f04e85-8050-47ee-857a-fd8ba87cb23a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:58.156470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94f04e85-8050-47ee-857a-fd8ba87cb23a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:58.157568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94f04e85-8050-47ee-857a-fd8ba87cb23a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:58.159186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94f04e85-8050-47ee-857a-fd8ba87cb23a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:58.185199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-319785de-8bf0-4b4d-ac5c-ffcbdfb84d0c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:58.186709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-319785de-8bf0-4b4d-ac5c-ffcbdfb84d0c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:58.204496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319785de-8bf0-4b4d-ac5c-ffcbdfb84d0c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:58.205027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319785de-8bf0-4b4d-ac5c-ffcbdfb84d0c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:58.205485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319785de-8bf0-4b4d-ac5c-ffcbdfb84d0c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:58.206242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319785de-8bf0-4b4d-ac5c-ffcbdfb84d0c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:58.206714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319785de-8bf0-4b4d-ac5c-ffcbdfb84d0c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:58.207188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-319785de-8bf0-4b4d-ac5c-ffcbdfb84d0c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:58.519476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-94f04e85-8050-47ee-857a-fd8ba87cb23a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:58.537549 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-94f04e85-8050-47ee-857a-fd8ba87cb23a tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1362 microversion: 2.1 time: 0.402787 Aug 27 05:33:58.539499 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3242/6490] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:58 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1362 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:58.600456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-319785de-8bf0-4b4d-ac5c-ffcbdfb84d0c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:58.610100 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-319785de-8bf0-4b4d-ac5c-ffcbdfb84d0c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1216 microversion: 2.1 time: 0.430763 Aug 27 05:33:58.623798 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3249/6491] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:58 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1216 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:33:59.197510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-603df22d-c095-4282-ac50-52ff065f64bf req-61417dbd-eba1-4bfd-be05-9b719fddf1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22df37d-a283-4e94-a99a-9ef29435d5ae", "name": "network-vif-plugged", "status": "completed", "tag": "7d558974-411e-49d9-9e68-1c404cca78a2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:59.211992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-603df22d-c095-4282-ac50-52ff065f64bf req-61417dbd-eba1-4bfd-be05-9b719fddf1de service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:59.212891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-603df22d-c095-4282-ac50-52ff065f64bf req-61417dbd-eba1-4bfd-be05-9b719fddf1de service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:59.213703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-603df22d-c095-4282-ac50-52ff065f64bf req-61417dbd-eba1-4bfd-be05-9b719fddf1de service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:59.229678 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-603df22d-c095-4282-ac50-52ff065f64bf req-61417dbd-eba1-4bfd-be05-9b719fddf1de service nova] Creating event network-vif-plugged:7d558974-411e-49d9-9e68-1c404cca78a2 for instance c22df37d-a283-4e94-a99a-9ef29435d5ae on n-h2-820368-35 Aug 27 05:33:59.235952 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-603df22d-c095-4282-ac50-52ff065f64bf req-61417dbd-eba1-4bfd-be05-9b719fddf1de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041794 Aug 27 05:33:59.242112 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3243/6492] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:33:59.479571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdb7add7-316b-492d-8078-9ecd0870bf63 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:59.480365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cdb7add7-316b-492d-8078-9ecd0870bf63 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:59.486407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-be4b49b3-1471-45b3-b308-c10175d87cb7 req-4143f970-d2a0-4187-976f-2f16bef460a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06b8d48-3bfb-4137-bfd0-1619ccff91c9", "tag": "b26fae87-aabc-4649-a0ea-bffbb357ae83"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:33:59.489344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdb7add7-316b-492d-8078-9ecd0870bf63 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:59.490181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdb7add7-316b-492d-8078-9ecd0870bf63 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:59.492063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdb7add7-316b-492d-8078-9ecd0870bf63 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:59.493167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdb7add7-316b-492d-8078-9ecd0870bf63 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:59.493807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdb7add7-316b-492d-8078-9ecd0870bf63 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:59.495491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdb7add7-316b-492d-8078-9ecd0870bf63 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:59.514624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-be4b49b3-1471-45b3-b308-c10175d87cb7 req-4143f970-d2a0-4187-976f-2f16bef460a3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:59.517875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-be4b49b3-1471-45b3-b308-c10175d87cb7 req-4143f970-d2a0-4187-976f-2f16bef460a3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:59.532463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-be4b49b3-1471-45b3-b308-c10175d87cb7 req-4143f970-d2a0-4187-976f-2f16bef460a3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:59.551282 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-be4b49b3-1471-45b3-b308-c10175d87cb7 req-4143f970-d2a0-4187-976f-2f16bef460a3 service nova] Creating event network-changed:b26fae87-aabc-4649-a0ea-bffbb357ae83 for instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 on n-h1-820368-35 Aug 27 05:33:59.557079 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-be4b49b3-1471-45b3-b308-c10175d87cb7 req-4143f970-d2a0-4187-976f-2f16bef460a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075239 Aug 27 05:33:59.557990 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3244/6493] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:33:59.576057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bc3322d2-a3ba-4c10-be94-166344f606d3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:59.579162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bc3322d2-a3ba-4c10-be94-166344f606d3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:59.587903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc3322d2-a3ba-4c10-be94-166344f606d3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:59.588446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc3322d2-a3ba-4c10-be94-166344f606d3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:59.599433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc3322d2-a3ba-4c10-be94-166344f606d3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:59.600386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc3322d2-a3ba-4c10-be94-166344f606d3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:59.600874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc3322d2-a3ba-4c10-be94-166344f606d3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:59.601367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc3322d2-a3ba-4c10-be94-166344f606d3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:59.918597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdb7add7-316b-492d-8078-9ecd0870bf63 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:33:59.931659 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cdb7add7-316b-492d-8078-9ecd0870bf63 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1565 microversion: 2.1 time: 0.454649 Aug 27 05:33:59.933637 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3250/6494] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:59 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1565 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:33:59.949648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f3dcfe1a-3e81-4c1b-93e1-722011ecae50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:33:59.950530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f3dcfe1a-3e81-4c1b-93e1-722011ecae50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:33:59.963053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3dcfe1a-3e81-4c1b-93e1-722011ecae50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:59.963656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3dcfe1a-3e81-4c1b-93e1-722011ecae50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:59.970152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3dcfe1a-3e81-4c1b-93e1-722011ecae50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:33:59.971661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3dcfe1a-3e81-4c1b-93e1-722011ecae50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:33:59.972154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3dcfe1a-3e81-4c1b-93e1-722011ecae50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:33:59.972603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3dcfe1a-3e81-4c1b-93e1-722011ecae50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:00.254557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bc3322d2-a3ba-4c10-be94-166344f606d3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:00.263754 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bc3322d2-a3ba-4c10-be94-166344f606d3 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1362 microversion: 2.1 time: 0.695622 Aug 27 05:34:00.264441 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3245/6495] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:59 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1362 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:00.508931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f3dcfe1a-3e81-4c1b-93e1-722011ecae50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:00.527967 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f3dcfe1a-3e81-4c1b-93e1-722011ecae50 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1403 microversion: 2.1 time: 0.592903 Aug 27 05:34:00.536552 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3251/6496] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:33:59 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1403 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:00.558435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-74e8a8dc-0b69-41aa-aa3e-3935b60c4554 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:00.559717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-74e8a8dc-0b69-41aa-aa3e-3935b60c4554 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:00.568830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74e8a8dc-0b69-41aa-aa3e-3935b60c4554 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:00.569828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74e8a8dc-0b69-41aa-aa3e-3935b60c4554 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:00.570194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74e8a8dc-0b69-41aa-aa3e-3935b60c4554 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:00.571289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74e8a8dc-0b69-41aa-aa3e-3935b60c4554 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:00.572781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74e8a8dc-0b69-41aa-aa3e-3935b60c4554 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:00.573524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74e8a8dc-0b69-41aa-aa3e-3935b60c4554 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:01.037551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-74e8a8dc-0b69-41aa-aa3e-3935b60c4554 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:01.047630 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-74e8a8dc-0b69-41aa-aa3e-3935b60c4554 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1403 microversion: 2.1 time: 0.496564 Aug 27 05:34:01.053921 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3246/6497] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:00 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1403 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:34:01.088033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-832009552"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:01.090635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:01.110532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:01.111047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:01.111741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:01.112863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:01.113571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:01.114218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:01.274550 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.compute.api [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Attempting to quiesce instance before volume snapshot. Aug 27 05:34:01.294631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d5aca11-fbd0-476b-a46c-7e2d6e726b66 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:01.295556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d5aca11-fbd0-476b-a46c-7e2d6e726b66 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:01.309393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5aca11-fbd0-476b-a46c-7e2d6e726b66 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:01.311446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5aca11-fbd0-476b-a46c-7e2d6e726b66 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:01.316901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5aca11-fbd0-476b-a46c-7e2d6e726b66 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:01.318118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5aca11-fbd0-476b-a46c-7e2d6e726b66 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:01.319866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5aca11-fbd0-476b-a46c-7e2d6e726b66 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:01.322409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5aca11-fbd0-476b-a46c-7e2d6e726b66 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:01.322644 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.compute.api [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 27 05:34:01.506465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Creating snapshot from volume 2f9ac4ba-494f-4f2d-84a6-c74b4e08197e. {{(pid=128547) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 27 05:34:02.265761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8d5aca11-fbd0-476b-a46c-7e2d6e726b66 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:02.278927 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d5aca11-fbd0-476b-a46c-7e2d6e726b66 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1362 microversion: 2.1 time: 0.988529 Aug 27 05:34:02.282362 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3247/6498] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:01 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1362 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:34:02.538396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5824d37-9b4d-42e1-a6f3-88a5d244f762 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:02.540288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f5824d37-9b4d-42e1-a6f3-88a5d244f762 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:02.562002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5824d37-9b4d-42e1-a6f3-88a5d244f762 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:02.563461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5824d37-9b4d-42e1-a6f3-88a5d244f762 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:02.568058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5824d37-9b4d-42e1-a6f3-88a5d244f762 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:02.569104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5824d37-9b4d-42e1-a6f3-88a5d244f762 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:02.569794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5824d37-9b4d-42e1-a6f3-88a5d244f762 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:02.570450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5824d37-9b4d-42e1-a6f3-88a5d244f762 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:02.684620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f5824d37-9b4d-42e1-a6f3-88a5d244f762 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:34:02.697740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:02.891121 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5824d37-9b4d-42e1-a6f3-88a5d244f762 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "DELETE /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 204 len: 0 microversion: 2.1 time: 0.356297 Aug 27 05:34:02.892546 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3248/6499] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:34:02 2022] DELETE /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:34:02.899688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-26a7e611-d6f6-4331-a5c4-7ba10f71a5bb req-c824856b-fa87-425f-9777-122eaf311cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e01a82-da3c-4bdb-b1ba-5412768d1794", "tag": "29a7d263-ffaa-4df1-8cd7-6b0662f519c3"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:02.941714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26a7e611-d6f6-4331-a5c4-7ba10f71a5bb req-c824856b-fa87-425f-9777-122eaf311cb9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:02.949013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26a7e611-d6f6-4331-a5c4-7ba10f71a5bb req-c824856b-fa87-425f-9777-122eaf311cb9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:02.949893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-26a7e611-d6f6-4331-a5c4-7ba10f71a5bb req-c824856b-fa87-425f-9777-122eaf311cb9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:02.978586 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-26a7e611-d6f6-4331-a5c4-7ba10f71a5bb req-c824856b-fa87-425f-9777-122eaf311cb9 service nova] Creating event network-changed:29a7d263-ffaa-4df1-8cd7-6b0662f519c3 for instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 on n-h1-820368-35 Aug 27 05:34:02.995804 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-26a7e611-d6f6-4331-a5c4-7ba10f71a5bb req-c824856b-fa87-425f-9777-122eaf311cb9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101472 Aug 27 05:34:02.997109 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3249/6500] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:34:03.006267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17f2a084-0765-456c-a4c1-b71eadf0252d tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:03.012084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-17f2a084-0765-456c-a4c1-b71eadf0252d tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:03.033566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f2a084-0765-456c-a4c1-b71eadf0252d tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:03.034480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f2a084-0765-456c-a4c1-b71eadf0252d tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:03.035204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f2a084-0765-456c-a4c1-b71eadf0252d tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:03.036175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f2a084-0765-456c-a4c1-b71eadf0252d tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:03.036868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f2a084-0765-456c-a4c1-b71eadf0252d tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:03.037542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17f2a084-0765-456c-a4c1-b71eadf0252d tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:03.144411 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a5183ed-9a31-4873-8af6-f71c5599d192 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "POST /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90/action" status: 202 len: 0 microversion: 2.1 time: 2.060563 Aug 27 05:34:03.145289 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3252/6501] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:34:01 2022] POST /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90/action => generated 0 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 05:34:03.305198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d5887ad-4f25-477e-9ebc-8ea4eb121bdd tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:03.306094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3d5887ad-4f25-477e-9ebc-8ea4eb121bdd tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:03.329695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5887ad-4f25-477e-9ebc-8ea4eb121bdd tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:03.331619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5887ad-4f25-477e-9ebc-8ea4eb121bdd tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:03.332415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5887ad-4f25-477e-9ebc-8ea4eb121bdd tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:03.336370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5887ad-4f25-477e-9ebc-8ea4eb121bdd tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:03.338635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5887ad-4f25-477e-9ebc-8ea4eb121bdd tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:03.340952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d5887ad-4f25-477e-9ebc-8ea4eb121bdd tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:03.574566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-17f2a084-0765-456c-a4c1-b71eadf0252d tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:03.587459 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-17f2a084-0765-456c-a4c1-b71eadf0252d tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1584 microversion: 2.1 time: 0.588789 Aug 27 05:34:03.591460 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3250/6502] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:02 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1584 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:03.753782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d5887ad-4f25-477e-9ebc-8ea4eb121bdd tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:03.771778 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d5887ad-4f25-477e-9ebc-8ea4eb121bdd tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1547 microversion: 2.1 time: 0.472839 Aug 27 05:34:03.775547 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3253/6503] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:03 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1547 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:34:03.817302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88ba5e34-86a1-4caa-b944-2027bc2d4597 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:03.817827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-88ba5e34-86a1-4caa-b944-2027bc2d4597 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:03.826966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88ba5e34-86a1-4caa-b944-2027bc2d4597 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:03.829868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88ba5e34-86a1-4caa-b944-2027bc2d4597 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:03.832673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88ba5e34-86a1-4caa-b944-2027bc2d4597 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:03.835959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88ba5e34-86a1-4caa-b944-2027bc2d4597 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:03.836654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88ba5e34-86a1-4caa-b944-2027bc2d4597 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:03.839374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88ba5e34-86a1-4caa-b944-2027bc2d4597 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:04.004466 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88ba5e34-86a1-4caa-b944-2027bc2d4597 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207994 Aug 27 05:34:04.005083 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3251/6504] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:34:03 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:34:04.643703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-97031faa-0752-4098-b7bf-4456789c877f tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:04.647641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-97031faa-0752-4098-b7bf-4456789c877f tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:04.677789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97031faa-0752-4098-b7bf-4456789c877f tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:04.680280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97031faa-0752-4098-b7bf-4456789c877f tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:04.681801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97031faa-0752-4098-b7bf-4456789c877f tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:04.682891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97031faa-0752-4098-b7bf-4456789c877f tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:04.690058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97031faa-0752-4098-b7bf-4456789c877f tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:04.690908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-97031faa-0752-4098-b7bf-4456789c877f tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:05.206084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-97031faa-0752-4098-b7bf-4456789c877f tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:05.230880 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-97031faa-0752-4098-b7bf-4456789c877f tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1584 microversion: 2.1 time: 0.585923 Aug 27 05:34:05.234040 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3254/6505] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:04 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1584 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:05.574030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-256917603", "imageRef": "dbafddd2-e165-4898-a841-d66f09d302b2", "flavorRef": "452", "networks": [{"uuid": "58a22fcb-5b07-4d83-8df1-2b6fed6fe046"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:05.652285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] validate_networks() for [('58a22fcb-5b07-4d83-8df1-2b6fed6fe046', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:34:06.261337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-305286c3-0ca0-40ee-9003-c632ad06ba60 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:06.263874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-305286c3-0ca0-40ee-9003-c632ad06ba60 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:06.273410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-305286c3-0ca0-40ee-9003-c632ad06ba60 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:06.274373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-305286c3-0ca0-40ee-9003-c632ad06ba60 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:06.275443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-305286c3-0ca0-40ee-9003-c632ad06ba60 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:06.276573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-305286c3-0ca0-40ee-9003-c632ad06ba60 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:06.277236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-305286c3-0ca0-40ee-9003-c632ad06ba60 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:06.277851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-305286c3-0ca0-40ee-9003-c632ad06ba60 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:06.471227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-305286c3-0ca0-40ee-9003-c632ad06ba60 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:06.540412 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-305286c3-0ca0-40ee-9003-c632ad06ba60 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1397 microversion: 2.1 time: 0.286065 Aug 27 05:34:06.542959 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3255/6506] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:06 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1397 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:06.552711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-cc6181f4-b4eb-4c78-946f-0d1f0009b353 req-e623d655-6fd8-4ddb-8318-f87d57cca397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e01a82-da3c-4bdb-b1ba-5412768d1794", "name": "network-vif-deleted", "tag": "29a7d263-ffaa-4df1-8cd7-6b0662f519c3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:06.566004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cc6181f4-b4eb-4c78-946f-0d1f0009b353 req-e623d655-6fd8-4ddb-8318-f87d57cca397 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:06.566900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cc6181f4-b4eb-4c78-946f-0d1f0009b353 req-e623d655-6fd8-4ddb-8318-f87d57cca397 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:06.567618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cc6181f4-b4eb-4c78-946f-0d1f0009b353 req-e623d655-6fd8-4ddb-8318-f87d57cca397 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:06.610355 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-cc6181f4-b4eb-4c78-946f-0d1f0009b353 req-e623d655-6fd8-4ddb-8318-f87d57cca397 service nova] Creating event network-vif-deleted:29a7d263-ffaa-4df1-8cd7-6b0662f519c3 for instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 on n-h1-820368-35 Aug 27 05:34:06.629398 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-cc6181f4-b4eb-4c78-946f-0d1f0009b353 req-e623d655-6fd8-4ddb-8318-f87d57cca397 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083638 Aug 27 05:34:06.632215 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3256/6507] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:34:06.730256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:34:06.730816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:34:06.731623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:34:06.732045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:34:06.732470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:34:06.745260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:06.746174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:06.746773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:06.747718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:06.748548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:06.749162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:06.785327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:34:06.796117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for user 007b4762bf8c436fb783d84380c01932 and project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:34:06.818797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:34:06.822177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2eddcbd7-10b0-4ede-a2e3-7297ccb7dc48',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:34:06.963537 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1651d792-5600-4c43-b520-2ec099eb0981 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392724 Aug 27 05:34:06.967449 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3252/6508] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:34:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:34:06.984090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5fa9c1e0-8f32-4ff0-8fc4-6ba97bc6e4da tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:06.986222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5fa9c1e0-8f32-4ff0-8fc4-6ba97bc6e4da tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:07.155515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5fa9c1e0-8f32-4ff0-8fc4-6ba97bc6e4da tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:07.165011 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5fa9c1e0-8f32-4ff0-8fc4-6ba97bc6e4da tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1229 microversion: 2.1 time: 0.186811 Aug 27 05:34:07.165587 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3257/6509] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:06 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1229 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:07.577824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fc4bda43-6559-429f-b1f2-94d291a43a25 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:07.578839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fc4bda43-6559-429f-b1f2-94d291a43a25 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:07.585742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc4bda43-6559-429f-b1f2-94d291a43a25 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:07.586794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc4bda43-6559-429f-b1f2-94d291a43a25 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:07.587753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc4bda43-6559-429f-b1f2-94d291a43a25 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:07.589018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc4bda43-6559-429f-b1f2-94d291a43a25 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:07.589873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc4bda43-6559-429f-b1f2-94d291a43a25 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:07.590597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc4bda43-6559-429f-b1f2-94d291a43a25 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:07.733419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fc4bda43-6559-429f-b1f2-94d291a43a25 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:07.751022 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fc4bda43-6559-429f-b1f2-94d291a43a25 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1229 microversion: 2.1 time: 0.177223 Aug 27 05:34:07.773162 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3253/6510] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:07 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1229 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:08.302140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed1f3e80-7b5a-4fc4-a44b-8b408b3d8a7f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:08.303196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed1f3e80-7b5a-4fc4-a44b-8b408b3d8a7f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:08.311469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed1f3e80-7b5a-4fc4-a44b-8b408b3d8a7f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:08.321710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed1f3e80-7b5a-4fc4-a44b-8b408b3d8a7f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:08.322308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed1f3e80-7b5a-4fc4-a44b-8b408b3d8a7f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:08.323421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed1f3e80-7b5a-4fc4-a44b-8b408b3d8a7f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:08.324032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed1f3e80-7b5a-4fc4-a44b-8b408b3d8a7f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:08.324597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed1f3e80-7b5a-4fc4-a44b-8b408b3d8a7f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:08.416400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ed1f3e80-7b5a-4fc4-a44b-8b408b3d8a7f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:08.444856 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed1f3e80-7b5a-4fc4-a44b-8b408b3d8a7f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1281 microversion: 2.1 time: 0.262191 Aug 27 05:34:08.459891 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3258/6511] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:08 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1281 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:08.739831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c4647a39-a0d0-43d8-8ba9-cf18c2e61856 req-1b13e450-b170-4cdd-883b-fb4a798037fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22df37d-a283-4e94-a99a-9ef29435d5ae", "tag": "7d558974-411e-49d9-9e68-1c404cca78a2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:08.755782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c4647a39-a0d0-43d8-8ba9-cf18c2e61856 req-1b13e450-b170-4cdd-883b-fb4a798037fe service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:08.756657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c4647a39-a0d0-43d8-8ba9-cf18c2e61856 req-1b13e450-b170-4cdd-883b-fb4a798037fe service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:08.763797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c4647a39-a0d0-43d8-8ba9-cf18c2e61856 req-1b13e450-b170-4cdd-883b-fb4a798037fe service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:08.780033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e373099-37c9-4e04-866b-5a78013c010b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:08.780875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e373099-37c9-4e04-866b-5a78013c010b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:08.792174 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c4647a39-a0d0-43d8-8ba9-cf18c2e61856 req-1b13e450-b170-4cdd-883b-fb4a798037fe service nova] Creating event network-changed:7d558974-411e-49d9-9e68-1c404cca78a2 for instance c22df37d-a283-4e94-a99a-9ef29435d5ae on n-h2-820368-35 Aug 27 05:34:08.799894 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c4647a39-a0d0-43d8-8ba9-cf18c2e61856 req-1b13e450-b170-4cdd-883b-fb4a798037fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063972 Aug 27 05:34:08.800101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e373099-37c9-4e04-866b-5a78013c010b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:08.800467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e373099-37c9-4e04-866b-5a78013c010b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:08.800936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e373099-37c9-4e04-866b-5a78013c010b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:08.801582 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3254/6512] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:34:08.801719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e373099-37c9-4e04-866b-5a78013c010b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:08.802138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e373099-37c9-4e04-866b-5a78013c010b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:08.802590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e373099-37c9-4e04-866b-5a78013c010b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:08.926204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e373099-37c9-4e04-866b-5a78013c010b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:08.941878 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e373099-37c9-4e04-866b-5a78013c010b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1229 microversion: 2.1 time: 0.165760 Aug 27 05:34:08.942477 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3259/6513] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:08 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1229 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:34:09.473377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8703154-4fda-44b5-ba9d-c9f22a659cfa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:09.474435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8703154-4fda-44b5-ba9d-c9f22a659cfa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:09.493519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8703154-4fda-44b5-ba9d-c9f22a659cfa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:09.494039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8703154-4fda-44b5-ba9d-c9f22a659cfa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:09.494489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8703154-4fda-44b5-ba9d-c9f22a659cfa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:09.497502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8703154-4fda-44b5-ba9d-c9f22a659cfa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:09.498249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8703154-4fda-44b5-ba9d-c9f22a659cfa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:09.498786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8703154-4fda-44b5-ba9d-c9f22a659cfa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:09.655057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d8703154-4fda-44b5-ba9d-c9f22a659cfa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:09.668032 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8703154-4fda-44b5-ba9d-c9f22a659cfa tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1299 microversion: 2.1 time: 0.201189 Aug 27 05:34:09.669248 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3255/6514] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:09 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:09.969673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed5f8250-776a-45b9-b396-cb16f442ae9b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:09.969673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed5f8250-776a-45b9-b396-cb16f442ae9b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:09.991923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5f8250-776a-45b9-b396-cb16f442ae9b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:09.995545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5f8250-776a-45b9-b396-cb16f442ae9b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:09.996306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5f8250-776a-45b9-b396-cb16f442ae9b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:09.999419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5f8250-776a-45b9-b396-cb16f442ae9b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:10.001668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5f8250-776a-45b9-b396-cb16f442ae9b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:10.005456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed5f8250-776a-45b9-b396-cb16f442ae9b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:10.204815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ed5f8250-776a-45b9-b396-cb16f442ae9b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:10.222031 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed5f8250-776a-45b9-b396-cb16f442ae9b tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1229 microversion: 2.1 time: 0.261845 Aug 27 05:34:10.224071 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3260/6515] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:09 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1229 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:10.707786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5aafd88-d45e-4287-a6bf-ad74b54a6534 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:10.709420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f5aafd88-d45e-4287-a6bf-ad74b54a6534 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:10.721779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5aafd88-d45e-4287-a6bf-ad74b54a6534 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:10.722418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5aafd88-d45e-4287-a6bf-ad74b54a6534 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:10.723274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5aafd88-d45e-4287-a6bf-ad74b54a6534 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:10.724098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5aafd88-d45e-4287-a6bf-ad74b54a6534 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:10.724667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5aafd88-d45e-4287-a6bf-ad74b54a6534 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:10.725280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5aafd88-d45e-4287-a6bf-ad74b54a6534 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:11.000925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f5aafd88-d45e-4287-a6bf-ad74b54a6534 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:11.018686 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5aafd88-d45e-4287-a6bf-ad74b54a6534 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.317350 Aug 27 05:34:11.020249 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3256/6516] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:10 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:11.253339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de5c108f-1e8c-43a7-aec7-b0aa5b5d77fc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:11.254594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de5c108f-1e8c-43a7-aec7-b0aa5b5d77fc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:11.277456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de5c108f-1e8c-43a7-aec7-b0aa5b5d77fc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:11.279853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de5c108f-1e8c-43a7-aec7-b0aa5b5d77fc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:11.285300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de5c108f-1e8c-43a7-aec7-b0aa5b5d77fc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:11.286372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de5c108f-1e8c-43a7-aec7-b0aa5b5d77fc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:11.287029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de5c108f-1e8c-43a7-aec7-b0aa5b5d77fc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:11.287656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de5c108f-1e8c-43a7-aec7-b0aa5b5d77fc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:11.424677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de5c108f-1e8c-43a7-aec7-b0aa5b5d77fc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:11.437625 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de5c108f-1e8c-43a7-aec7-b0aa5b5d77fc tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1229 microversion: 2.1 time: 0.188948 Aug 27 05:34:11.440737 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3261/6517] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:11 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1229 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:12.046747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d9c2ee9-e4f9-40b0-8704-70029cc9cab9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:12.047462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d9c2ee9-e4f9-40b0-8704-70029cc9cab9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:12.068821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9c2ee9-e4f9-40b0-8704-70029cc9cab9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:12.069879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9c2ee9-e4f9-40b0-8704-70029cc9cab9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:12.073368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9c2ee9-e4f9-40b0-8704-70029cc9cab9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:12.075335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9c2ee9-e4f9-40b0-8704-70029cc9cab9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:12.077810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9c2ee9-e4f9-40b0-8704-70029cc9cab9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:12.085007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9c2ee9-e4f9-40b0-8704-70029cc9cab9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:12.165976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-60b4c4fa-90fe-41be-a09e-fa41388819cd req-e415f36c-f501-4606-aad8-78bb1a0770b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d133c5-1c20-4bf0-ba04-afd40baf9d9a", "tag": "bdbbe3d0-0ea7-456c-9be6-8daeeaad0dec"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:12.181594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-60b4c4fa-90fe-41be-a09e-fa41388819cd req-e415f36c-f501-4606-aad8-78bb1a0770b4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:12.182563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-60b4c4fa-90fe-41be-a09e-fa41388819cd req-e415f36c-f501-4606-aad8-78bb1a0770b4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:12.183367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-60b4c4fa-90fe-41be-a09e-fa41388819cd req-e415f36c-f501-4606-aad8-78bb1a0770b4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:12.210941 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-60b4c4fa-90fe-41be-a09e-fa41388819cd req-e415f36c-f501-4606-aad8-78bb1a0770b4 service nova] Creating event network-changed:bdbbe3d0-0ea7-456c-9be6-8daeeaad0dec for instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a on n-h2-820368-35 Aug 27 05:34:12.225006 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-60b4c4fa-90fe-41be-a09e-fa41388819cd req-e415f36c-f501-4606-aad8-78bb1a0770b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.465500 Aug 27 05:34:12.227498 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3257/6518] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:34:12.377564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d9c2ee9-e4f9-40b0-8704-70029cc9cab9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:12.390326 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d9c2ee9-e4f9-40b0-8704-70029cc9cab9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.349142 Aug 27 05:34:12.392140 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3262/6519] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:12 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:12.474572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c3ce4e2d-e571-4f1a-9450-468e665b3b17 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:12.477930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c3ce4e2d-e571-4f1a-9450-468e665b3b17 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:12.503688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ce4e2d-e571-4f1a-9450-468e665b3b17 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:12.508574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ce4e2d-e571-4f1a-9450-468e665b3b17 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:12.509589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ce4e2d-e571-4f1a-9450-468e665b3b17 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:12.510719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ce4e2d-e571-4f1a-9450-468e665b3b17 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:12.513569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ce4e2d-e571-4f1a-9450-468e665b3b17 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:12.520160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3ce4e2d-e571-4f1a-9450-468e665b3b17 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:12.660731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c3ce4e2d-e571-4f1a-9450-468e665b3b17 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:12.679253 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c3ce4e2d-e571-4f1a-9450-468e665b3b17 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1229 microversion: 2.1 time: 0.221657 Aug 27 05:34:12.681909 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3258/6520] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:12 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1229 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:13.413032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22e6e51c-8d0d-4ae6-99c6-db0cafbd964d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:13.414210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22e6e51c-8d0d-4ae6-99c6-db0cafbd964d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:13.439655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22e6e51c-8d0d-4ae6-99c6-db0cafbd964d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:13.440791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22e6e51c-8d0d-4ae6-99c6-db0cafbd964d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:13.441798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22e6e51c-8d0d-4ae6-99c6-db0cafbd964d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:13.443279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22e6e51c-8d0d-4ae6-99c6-db0cafbd964d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:13.444325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22e6e51c-8d0d-4ae6-99c6-db0cafbd964d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:13.452208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22e6e51c-8d0d-4ae6-99c6-db0cafbd964d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:13.714021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-38378896-a61c-41e6-9052-993b00c20963 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:13.718988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-38378896-a61c-41e6-9052-993b00c20963 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:13.737075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38378896-a61c-41e6-9052-993b00c20963 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:13.742927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38378896-a61c-41e6-9052-993b00c20963 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:13.744117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38378896-a61c-41e6-9052-993b00c20963 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:13.748934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38378896-a61c-41e6-9052-993b00c20963 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:13.750448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38378896-a61c-41e6-9052-993b00c20963 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:13.751176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38378896-a61c-41e6-9052-993b00c20963 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:14.512895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-38378896-a61c-41e6-9052-993b00c20963 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383b51103d4047a7a76cedfd05806c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980e6bf120f3490bbda7d9754366febc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:14.533881 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-38378896-a61c-41e6-9052-993b00c20963 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 200 len: 1229 microversion: 2.1 time: 0.826780 Aug 27 05:34:14.537204 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3259/6521] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:13 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 1229 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:14.619620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-22e6e51c-8d0d-4ae6-99c6-db0cafbd964d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:14.634302 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22e6e51c-8d0d-4ae6-99c6-db0cafbd964d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 1.224618 Aug 27 05:34:14.637179 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3263/6522] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:13 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:15.569961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:15.570593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] [instance: 69e01a82-da3c-4bdb-b1ba-5412768d1794] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:15.580169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:15.580982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:15.581853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:15.583048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:15.583830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:15.584444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:15.616212 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] HTTP exception thrown: Instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 could not be found. Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Request method failure captured: Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 HTTP/1.1 Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaur_WSqjgnBBhSfbLbm3yknPtwj0cHQ6-ZkT2yRc6-QekT2obxEay02mHevtf0-PRPqvHPFZW3pNddmMqPFUcHgbP2HBASk0eXOr0nWzO9BtAnmziWbQaV1cQFnOXB9Nieo127FT7qXk0tQqxaK7VUWBx-CaIrUkoUAirkSQQP8TOw Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 980e6bf120f3490bbda7d9754366febc Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestVolumeBackupRestore-1094387064 Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_980e6bf120f3490bbda7d9754366febc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/980e6bf120f3490bbda7d9754366febc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/980e6bf120f3490bbda7d9754366febc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/980e6bf120f3490bbda7d9754366febc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestVolumeBackupRestore-1094387064 Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 980e6bf120f3490bbda7d9754366febc Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1094387064 Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestVolumeBackupRestore-1094387064-project Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 383b51103d4047a7a76cedfd05806c82 Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestVolumeBackupRestore-1094387064-project Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 could not be found. Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '69e01a82-da3c-4bdb-b1ba-5412768d1794'} Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 could not be found. Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 could not be found. Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:34:15.618379 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:34:15.623338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:34:15.623338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:34:15.623338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:34:15.623338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:34:15.623338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:34:15.623338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 could not be found. Aug 27 05:34:15.623338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:34:15.623868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Returning 404 to user: Instance 69e01a82-da3c-4bdb-b1ba-5412768d1794 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:34:15.624720 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d189db20-af32-404a-8414-ed4e5280f4c1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794" status: 404 len: 111 microversion: 2.1 time: 0.058790 Aug 27 05:34:15.625613 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3260/6523] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:15 2022] GET /compute/v2.1/servers/69e01a82-da3c-4bdb-b1ba-5412768d1794 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:34:15.664403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0d40ffc4-87d9-4f82-af96-1960d8d018ec tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:15.665381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0d40ffc4-87d9-4f82-af96-1960d8d018ec tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:15.691385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d40ffc4-87d9-4f82-af96-1960d8d018ec tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:15.707466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d40ffc4-87d9-4f82-af96-1960d8d018ec tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:15.710626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d40ffc4-87d9-4f82-af96-1960d8d018ec tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:15.712571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d40ffc4-87d9-4f82-af96-1960d8d018ec tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:15.714942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d40ffc4-87d9-4f82-af96-1960d8d018ec tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:15.722643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d40ffc4-87d9-4f82-af96-1960d8d018ec tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:15.786030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:16.218366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0d40ffc4-87d9-4f82-af96-1960d8d018ec tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:16.242814 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0d40ffc4-87d9-4f82-af96-1960d8d018ec tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.580550 Aug 27 05:34:16.244651 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3264/6524] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:15 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:16.268471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f52d3d0c-4a49-4817-afcd-1dcdb0f777a1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] Calling method '.version_select at 0x7fb564b27670>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:16.306948 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f52d3d0c-4a49-4817-afcd-1dcdb0f777a1 tempest-TestVolumeBackupRestore-1094387064 tempest-TestVolumeBackupRestore-1094387064-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-339607465" status: 202 len: 0 microversion: 2.1 time: 0.044945 Aug 27 05:34:16.311546 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3261/6525] 10.222.0.58 () {58 vars in 1266 bytes} [Sat Aug 27 05:34:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-339607465 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:34:17.277223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-87a654fc-c32a-47f2-ae63-8d977361935b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:17.278480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-87a654fc-c32a-47f2-ae63-8d977361935b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:17.303922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:17.305316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:17.307833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87a654fc-c32a-47f2-ae63-8d977361935b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:17.308869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87a654fc-c32a-47f2-ae63-8d977361935b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:17.309598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87a654fc-c32a-47f2-ae63-8d977361935b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:17.310741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87a654fc-c32a-47f2-ae63-8d977361935b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:17.323926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87a654fc-c32a-47f2-ae63-8d977361935b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:17.330719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-87a654fc-c32a-47f2-ae63-8d977361935b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:17.776559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-87a654fc-c32a-47f2-ae63-8d977361935b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:17.808726 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-87a654fc-c32a-47f2-ae63-8d977361935b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.540189 Aug 27 05:34:17.823369 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3265/6526] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:17 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:18.828788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:18.830612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:18.840630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-93bf972a-4a34-4199-8ab2-7e1ef5b7182a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:18.841842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-93bf972a-4a34-4199-8ab2-7e1ef5b7182a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:18.858052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:18.885496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93bf972a-4a34-4199-8ab2-7e1ef5b7182a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:18.886336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93bf972a-4a34-4199-8ab2-7e1ef5b7182a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:18.887033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93bf972a-4a34-4199-8ab2-7e1ef5b7182a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:18.891338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93bf972a-4a34-4199-8ab2-7e1ef5b7182a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:18.894065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93bf972a-4a34-4199-8ab2-7e1ef5b7182a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:18.894871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93bf972a-4a34-4199-8ab2-7e1ef5b7182a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:19.255030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-93bf972a-4a34-4199-8ab2-7e1ef5b7182a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:19.290794 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-93bf972a-4a34-4199-8ab2-7e1ef5b7182a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.463680 Aug 27 05:34:19.292593 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3262/6527] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:18 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:34:20.318708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-969484b8-99b8-41db-b808-3e54974bac87 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:20.319428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-969484b8-99b8-41db-b808-3e54974bac87 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:20.334141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969484b8-99b8-41db-b808-3e54974bac87 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:20.335119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969484b8-99b8-41db-b808-3e54974bac87 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:20.335854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969484b8-99b8-41db-b808-3e54974bac87 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:20.338168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969484b8-99b8-41db-b808-3e54974bac87 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:20.338988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969484b8-99b8-41db-b808-3e54974bac87 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:20.349716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969484b8-99b8-41db-b808-3e54974bac87 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:20.923195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-969484b8-99b8-41db-b808-3e54974bac87 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:20.932603 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-969484b8-99b8-41db-b808-3e54974bac87 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.620272 Aug 27 05:34:20.947739 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3266/6528] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:20 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:21.993204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0eaf33f8-badd-4a2f-a4a9-580b959aeec4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:21.996781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0eaf33f8-badd-4a2f-a4a9-580b959aeec4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:22.072558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0eaf33f8-badd-4a2f-a4a9-580b959aeec4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:22.075479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0eaf33f8-badd-4a2f-a4a9-580b959aeec4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:22.077860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0eaf33f8-badd-4a2f-a4a9-580b959aeec4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:22.080095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0eaf33f8-badd-4a2f-a4a9-580b959aeec4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:22.081217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0eaf33f8-badd-4a2f-a4a9-580b959aeec4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:22.082301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0eaf33f8-badd-4a2f-a4a9-580b959aeec4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:22.544975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0eaf33f8-badd-4a2f-a4a9-580b959aeec4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:22.576564 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0eaf33f8-badd-4a2f-a4a9-580b959aeec4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.616159 Aug 27 05:34:22.578749 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3263/6529] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:21 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:23.611945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b6dcf1cd-97c2-49eb-9ea4-e4410c64970f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:23.613098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b6dcf1cd-97c2-49eb-9ea4-e4410c64970f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:23.627082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6dcf1cd-97c2-49eb-9ea4-e4410c64970f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:23.631687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6dcf1cd-97c2-49eb-9ea4-e4410c64970f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:23.637551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6dcf1cd-97c2-49eb-9ea4-e4410c64970f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:23.638608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6dcf1cd-97c2-49eb-9ea4-e4410c64970f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:23.639412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6dcf1cd-97c2-49eb-9ea4-e4410c64970f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:23.640656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6dcf1cd-97c2-49eb-9ea4-e4410c64970f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:24.043016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6dcf1cd-97c2-49eb-9ea4-e4410c64970f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:24.060730 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b6dcf1cd-97c2-49eb-9ea4-e4410c64970f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.454936 Aug 27 05:34:24.067238 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3267/6530] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:23 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:34:25.097714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24b3ce9a-621f-4ea3-a447-4728e789dd0e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:25.106191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-24b3ce9a-621f-4ea3-a447-4728e789dd0e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:25.149114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24b3ce9a-621f-4ea3-a447-4728e789dd0e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:25.151599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24b3ce9a-621f-4ea3-a447-4728e789dd0e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:25.154414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24b3ce9a-621f-4ea3-a447-4728e789dd0e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:25.159542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24b3ce9a-621f-4ea3-a447-4728e789dd0e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:25.160775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24b3ce9a-621f-4ea3-a447-4728e789dd0e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:25.163038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24b3ce9a-621f-4ea3-a447-4728e789dd0e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:25.644075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-24b3ce9a-621f-4ea3-a447-4728e789dd0e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:25.697411 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-24b3ce9a-621f-4ea3-a447-4728e789dd0e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.613393 Aug 27 05:34:25.699235 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3264/6531] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:25 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:26.723590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4b19a3fe-947f-4fa7-a0e5-ab88ed954e2b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:26.724357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4b19a3fe-947f-4fa7-a0e5-ab88ed954e2b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:26.739603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b19a3fe-947f-4fa7-a0e5-ab88ed954e2b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:26.740228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b19a3fe-947f-4fa7-a0e5-ab88ed954e2b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:26.742728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b19a3fe-947f-4fa7-a0e5-ab88ed954e2b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:26.743567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b19a3fe-947f-4fa7-a0e5-ab88ed954e2b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:26.746181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b19a3fe-947f-4fa7-a0e5-ab88ed954e2b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:26.747420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4b19a3fe-947f-4fa7-a0e5-ab88ed954e2b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:27.010354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4b19a3fe-947f-4fa7-a0e5-ab88ed954e2b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:27.042561 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4b19a3fe-947f-4fa7-a0e5-ab88ed954e2b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.323325 Aug 27 05:34:27.044201 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3268/6532] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:26 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:28.074604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-124ac762-4f14-4b94-bec7-e6fe3df28950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:28.075408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-124ac762-4f14-4b94-bec7-e6fe3df28950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:28.090900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-124ac762-4f14-4b94-bec7-e6fe3df28950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:28.094528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-124ac762-4f14-4b94-bec7-e6fe3df28950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:28.095138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-124ac762-4f14-4b94-bec7-e6fe3df28950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:28.097073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-124ac762-4f14-4b94-bec7-e6fe3df28950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:28.099311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-124ac762-4f14-4b94-bec7-e6fe3df28950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:28.099909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-124ac762-4f14-4b94-bec7-e6fe3df28950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:28.406815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-124ac762-4f14-4b94-bec7-e6fe3df28950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:28.432422 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-124ac762-4f14-4b94-bec7-e6fe3df28950 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.362023 Aug 27 05:34:28.433477 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3265/6533] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:28 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:34:29.472977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-95593d92-9ea9-472f-a7c1-99e5d8e61cf0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:29.473914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-95593d92-9ea9-472f-a7c1-99e5d8e61cf0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:29.491561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95593d92-9ea9-472f-a7c1-99e5d8e61cf0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:29.493967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95593d92-9ea9-472f-a7c1-99e5d8e61cf0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:29.495577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95593d92-9ea9-472f-a7c1-99e5d8e61cf0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:29.499857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95593d92-9ea9-472f-a7c1-99e5d8e61cf0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:29.500666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95593d92-9ea9-472f-a7c1-99e5d8e61cf0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:29.501363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-95593d92-9ea9-472f-a7c1-99e5d8e61cf0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:30.076941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-95593d92-9ea9-472f-a7c1-99e5d8e61cf0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:30.133024 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-95593d92-9ea9-472f-a7c1-99e5d8e61cf0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.664863 Aug 27 05:34:30.142549 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3269/6534] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:29 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:31.167532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-da6ce6df-e5bc-48fd-81cc-10b351483017 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:31.169673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-da6ce6df-e5bc-48fd-81cc-10b351483017 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:31.195524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da6ce6df-e5bc-48fd-81cc-10b351483017 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:31.196038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da6ce6df-e5bc-48fd-81cc-10b351483017 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:31.196501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da6ce6df-e5bc-48fd-81cc-10b351483017 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:31.197215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da6ce6df-e5bc-48fd-81cc-10b351483017 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:31.197783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da6ce6df-e5bc-48fd-81cc-10b351483017 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:31.198101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da6ce6df-e5bc-48fd-81cc-10b351483017 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:31.770571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-da6ce6df-e5bc-48fd-81cc-10b351483017 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:31.793912 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-da6ce6df-e5bc-48fd-81cc-10b351483017 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.631554 Aug 27 05:34:31.811379 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3266/6535] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:31 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:32.822470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7935e75-73c2-4665-ab36-20778dbaeb2c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:32.823705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7935e75-73c2-4665-ab36-20778dbaeb2c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:32.835387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7935e75-73c2-4665-ab36-20778dbaeb2c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:32.836641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7935e75-73c2-4665-ab36-20778dbaeb2c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:32.838612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7935e75-73c2-4665-ab36-20778dbaeb2c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:32.840345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7935e75-73c2-4665-ab36-20778dbaeb2c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:32.841822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7935e75-73c2-4665-ab36-20778dbaeb2c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:32.843505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7935e75-73c2-4665-ab36-20778dbaeb2c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:33.407868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a7935e75-73c2-4665-ab36-20778dbaeb2c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:33.450822 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7935e75-73c2-4665-ab36-20778dbaeb2c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.630610 Aug 27 05:34:33.454197 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3270/6536] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:32 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:34.485578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1411bca3-3723-4bb2-81cf-1594f78dcdf2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:34.487205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1411bca3-3723-4bb2-81cf-1594f78dcdf2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:34.516235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1411bca3-3723-4bb2-81cf-1594f78dcdf2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:34.518239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1411bca3-3723-4bb2-81cf-1594f78dcdf2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:34.519713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1411bca3-3723-4bb2-81cf-1594f78dcdf2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:34.523058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1411bca3-3723-4bb2-81cf-1594f78dcdf2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:34.524658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1411bca3-3723-4bb2-81cf-1594f78dcdf2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:34.526360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1411bca3-3723-4bb2-81cf-1594f78dcdf2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:34.543668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:35.040942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1411bca3-3723-4bb2-81cf-1594f78dcdf2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:35.061477 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1411bca3-3723-4bb2-81cf-1594f78dcdf2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.582185 Aug 27 05:34:35.078563 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3267/6537] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:34 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:36.091080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c6605fa-1867-4aad-b154-94b2be616c6d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:36.092172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c6605fa-1867-4aad-b154-94b2be616c6d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:36.108753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6605fa-1867-4aad-b154-94b2be616c6d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:36.113419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6605fa-1867-4aad-b154-94b2be616c6d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:36.114173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6605fa-1867-4aad-b154-94b2be616c6d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:36.115455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6605fa-1867-4aad-b154-94b2be616c6d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:36.115963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6605fa-1867-4aad-b154-94b2be616c6d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:36.116413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c6605fa-1867-4aad-b154-94b2be616c6d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:36.389819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c6605fa-1867-4aad-b154-94b2be616c6d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:36.411008 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c6605fa-1867-4aad-b154-94b2be616c6d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1341 microversion: 2.1 time: 0.322881 Aug 27 05:34:36.418649 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3271/6538] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:36 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1341 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:36.861995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fb4540f2-2322-4d4a-955a-e6b840641924 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:36.866919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fb4540f2-2322-4d4a-955a-e6b840641924 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:36.880328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4540f2-2322-4d4a-955a-e6b840641924 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:36.885677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4540f2-2322-4d4a-955a-e6b840641924 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:36.887829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4540f2-2322-4d4a-955a-e6b840641924 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:36.889449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4540f2-2322-4d4a-955a-e6b840641924 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:36.890823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4540f2-2322-4d4a-955a-e6b840641924 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:36.891835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4540f2-2322-4d4a-955a-e6b840641924 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:37.027747 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fb4540f2-2322-4d4a-955a-e6b840641924 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9/action" status: 200 len: 24573 microversion: 2.1 time: 0.168269 Aug 27 05:34:37.044042 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3268/6539] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:34:36 2022] POST /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9/action => generated 24573 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:34:37.461804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ce5c8ab-5f7e-4ac3-8b88-dd7501d5f4b5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:37.464269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ce5c8ab-5f7e-4ac3-8b88-dd7501d5f4b5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:37.478900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce5c8ab-5f7e-4ac3-8b88-dd7501d5f4b5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:37.480487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce5c8ab-5f7e-4ac3-8b88-dd7501d5f4b5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:37.481525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce5c8ab-5f7e-4ac3-8b88-dd7501d5f4b5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:37.483070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce5c8ab-5f7e-4ac3-8b88-dd7501d5f4b5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:37.484958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce5c8ab-5f7e-4ac3-8b88-dd7501d5f4b5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:37.486342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ce5c8ab-5f7e-4ac3-8b88-dd7501d5f4b5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:37.803030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1ce5c8ab-5f7e-4ac3-8b88-dd7501d5f4b5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:37.815814 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ce5c8ab-5f7e-4ac3-8b88-dd7501d5f4b5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1375 microversion: 2.1 time: 0.361976 Aug 27 05:34:37.817185 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3272/6540] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:37 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1375 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:38.855971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e072fdfd-57d6-40ed-beb1-300285e33b43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:38.863211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e072fdfd-57d6-40ed-beb1-300285e33b43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:38.910536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e072fdfd-57d6-40ed-beb1-300285e33b43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:38.911397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e072fdfd-57d6-40ed-beb1-300285e33b43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:38.912289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e072fdfd-57d6-40ed-beb1-300285e33b43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:38.913755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e072fdfd-57d6-40ed-beb1-300285e33b43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:38.914467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e072fdfd-57d6-40ed-beb1-300285e33b43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:38.929012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e072fdfd-57d6-40ed-beb1-300285e33b43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:39.493856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e072fdfd-57d6-40ed-beb1-300285e33b43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:39.510842 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e072fdfd-57d6-40ed-beb1-300285e33b43 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1375 microversion: 2.1 time: 0.668896 Aug 27 05:34:39.515171 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3269/6541] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:38 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1375 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:40.546533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65f377e0-c316-480e-96f7-37519474eb6b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:40.547237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-65f377e0-c316-480e-96f7-37519474eb6b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:40.555425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f377e0-c316-480e-96f7-37519474eb6b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:40.556318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f377e0-c316-480e-96f7-37519474eb6b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:40.556939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f377e0-c316-480e-96f7-37519474eb6b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:40.571064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f377e0-c316-480e-96f7-37519474eb6b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:40.572072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f377e0-c316-480e-96f7-37519474eb6b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:40.572764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65f377e0-c316-480e-96f7-37519474eb6b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:41.009975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-65f377e0-c316-480e-96f7-37519474eb6b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:41.035741 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-65f377e0-c316-480e-96f7-37519474eb6b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1375 microversion: 2.1 time: 0.493069 Aug 27 05:34:41.056980 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3273/6542] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:40 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1375 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:42.097484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-db4fff0b-bd20-4cec-9c97-84d666eaf9e0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:42.111404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-db4fff0b-bd20-4cec-9c97-84d666eaf9e0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:42.128860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4fff0b-bd20-4cec-9c97-84d666eaf9e0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:42.129924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4fff0b-bd20-4cec-9c97-84d666eaf9e0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:42.130703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4fff0b-bd20-4cec-9c97-84d666eaf9e0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:42.132641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4fff0b-bd20-4cec-9c97-84d666eaf9e0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:42.134023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4fff0b-bd20-4cec-9c97-84d666eaf9e0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:42.135467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-db4fff0b-bd20-4cec-9c97-84d666eaf9e0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:42.657529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-db4fff0b-bd20-4cec-9c97-84d666eaf9e0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:42.671180 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-db4fff0b-bd20-4cec-9c97-84d666eaf9e0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1375 microversion: 2.1 time: 0.581351 Aug 27 05:34:42.687118 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3270/6543] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:42 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1375 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:43.745531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65d4b519-e3b2-4ac6-bcdd-6422f1ca9d15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:43.761233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-65d4b519-e3b2-4ac6-bcdd-6422f1ca9d15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:43.787620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d4b519-e3b2-4ac6-bcdd-6422f1ca9d15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:43.792670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d4b519-e3b2-4ac6-bcdd-6422f1ca9d15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:43.793404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d4b519-e3b2-4ac6-bcdd-6422f1ca9d15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:43.794781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d4b519-e3b2-4ac6-bcdd-6422f1ca9d15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:43.795812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d4b519-e3b2-4ac6-bcdd-6422f1ca9d15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:43.807177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65d4b519-e3b2-4ac6-bcdd-6422f1ca9d15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:44.224297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-65d4b519-e3b2-4ac6-bcdd-6422f1ca9d15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:44.244020 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-65d4b519-e3b2-4ac6-bcdd-6422f1ca9d15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1375 microversion: 2.1 time: 0.533792 Aug 27 05:34:44.244954 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3274/6544] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:43 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1375 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:45.281760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-28a2a1e3-463c-4689-a959-460261ed653c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:45.285408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-28a2a1e3-463c-4689-a959-460261ed653c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:45.313673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a2a1e3-463c-4689-a959-460261ed653c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:45.314868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a2a1e3-463c-4689-a959-460261ed653c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:45.316145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a2a1e3-463c-4689-a959-460261ed653c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:45.318022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a2a1e3-463c-4689-a959-460261ed653c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:45.319512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a2a1e3-463c-4689-a959-460261ed653c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:45.321855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28a2a1e3-463c-4689-a959-460261ed653c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:45.735760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-28a2a1e3-463c-4689-a959-460261ed653c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:45.752351 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-28a2a1e3-463c-4689-a959-460261ed653c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1375 microversion: 2.1 time: 0.480022 Aug 27 05:34:45.760358 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3271/6545] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:45 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1375 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:46.815157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-310c4ced-fc3b-4989-89b2-63dc5eb3404c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:46.816044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-310c4ced-fc3b-4989-89b2-63dc5eb3404c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:46.840634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310c4ced-fc3b-4989-89b2-63dc5eb3404c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:46.841706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310c4ced-fc3b-4989-89b2-63dc5eb3404c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:46.842476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310c4ced-fc3b-4989-89b2-63dc5eb3404c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:46.843801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310c4ced-fc3b-4989-89b2-63dc5eb3404c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:46.845337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310c4ced-fc3b-4989-89b2-63dc5eb3404c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:46.846120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-310c4ced-fc3b-4989-89b2-63dc5eb3404c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:46.897708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=63 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:47.026486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5510af84-eb62-4812-b133-094d013e4ff1 req-2489d9d2-a906-4aab-b6fe-eac63532499a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d133c5-1c20-4bf0-ba04-afd40baf9d9a", "name": "network-vif-plugged", "status": "completed", "tag": "bdbbe3d0-0ea7-456c-9be6-8daeeaad0dec"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:47.042371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5510af84-eb62-4812-b133-094d013e4ff1 req-2489d9d2-a906-4aab-b6fe-eac63532499a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:47.043323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5510af84-eb62-4812-b133-094d013e4ff1 req-2489d9d2-a906-4aab-b6fe-eac63532499a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:47.044284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5510af84-eb62-4812-b133-094d013e4ff1 req-2489d9d2-a906-4aab-b6fe-eac63532499a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:47.061282 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-5510af84-eb62-4812-b133-094d013e4ff1 req-2489d9d2-a906-4aab-b6fe-eac63532499a service nova] Creating event network-vif-plugged:bdbbe3d0-0ea7-456c-9be6-8daeeaad0dec for instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a on n-h2-820368-35 Aug 27 05:34:47.079230 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5510af84-eb62-4812-b133-094d013e4ff1 req-2489d9d2-a906-4aab-b6fe-eac63532499a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056780 Aug 27 05:34:47.082006 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3272/6546] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:34:47.155027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-310c4ced-fc3b-4989-89b2-63dc5eb3404c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:47.176212 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-310c4ced-fc3b-4989-89b2-63dc5eb3404c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1375 microversion: 2.1 time: 0.378961 Aug 27 05:34:47.191127 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3275/6547] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:46 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1375 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:48.202037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b8baf3dd-ace7-4622-8bd3-3ce94b969dd1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:48.202902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b8baf3dd-ace7-4622-8bd3-3ce94b969dd1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:48.210698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8baf3dd-ace7-4622-8bd3-3ce94b969dd1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:48.211262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8baf3dd-ace7-4622-8bd3-3ce94b969dd1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:48.211704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8baf3dd-ace7-4622-8bd3-3ce94b969dd1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:48.212417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8baf3dd-ace7-4622-8bd3-3ce94b969dd1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:48.212860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8baf3dd-ace7-4622-8bd3-3ce94b969dd1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:48.213308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8baf3dd-ace7-4622-8bd3-3ce94b969dd1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:48.372188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b8baf3dd-ace7-4622-8bd3-3ce94b969dd1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:48.381311 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b8baf3dd-ace7-4622-8bd3-3ce94b969dd1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1375 microversion: 2.1 time: 0.184115 Aug 27 05:34:48.381916 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3273/6548] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:48 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:49.403634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14fbb280-3a87-49f0-90ab-347d5f870a08 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:49.404330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14fbb280-3a87-49f0-90ab-347d5f870a08 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:49.410356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=22 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:49.416662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fbb280-3a87-49f0-90ab-347d5f870a08 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:49.417184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fbb280-3a87-49f0-90ab-347d5f870a08 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:49.417639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fbb280-3a87-49f0-90ab-347d5f870a08 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:49.418382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fbb280-3a87-49f0-90ab-347d5f870a08 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:49.423868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fbb280-3a87-49f0-90ab-347d5f870a08 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:49.424352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14fbb280-3a87-49f0-90ab-347d5f870a08 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:49.629071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14fbb280-3a87-49f0-90ab-347d5f870a08 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:49.639464 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14fbb280-3a87-49f0-90ab-347d5f870a08 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1563 microversion: 2.1 time: 0.239837 Aug 27 05:34:49.640511 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3276/6549] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:49 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:49.662254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eecd721f-eab5-40a7-8a57-97225a85385e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:49.662886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eecd721f-eab5-40a7-8a57-97225a85385e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:49.666150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=24 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:49.671824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eecd721f-eab5-40a7-8a57-97225a85385e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:49.673186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eecd721f-eab5-40a7-8a57-97225a85385e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:49.673855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eecd721f-eab5-40a7-8a57-97225a85385e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:49.674817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eecd721f-eab5-40a7-8a57-97225a85385e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:49.675320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eecd721f-eab5-40a7-8a57-97225a85385e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:49.675763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eecd721f-eab5-40a7-8a57-97225a85385e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:49.850046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eecd721f-eab5-40a7-8a57-97225a85385e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:49.861573 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eecd721f-eab5-40a7-8a57-97225a85385e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1563 microversion: 2.1 time: 0.203217 Aug 27 05:34:49.863754 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3274/6550] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:49 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1563 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:49.964155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-02af11b1-597e-4ff3-bb6b-cca6e805f29c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:49.964755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-02af11b1-597e-4ff3-bb6b-cca6e805f29c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:49.975606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02af11b1-597e-4ff3-bb6b-cca6e805f29c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:49.976154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02af11b1-597e-4ff3-bb6b-cca6e805f29c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:49.976857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02af11b1-597e-4ff3-bb6b-cca6e805f29c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:49.977993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02af11b1-597e-4ff3-bb6b-cca6e805f29c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:49.978634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02af11b1-597e-4ff3-bb6b-cca6e805f29c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:49.978909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02af11b1-597e-4ff3-bb6b-cca6e805f29c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:50.007525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-02af11b1-597e-4ff3-bb6b-cca6e805f29c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:34:50.098955 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-02af11b1-597e-4ff3-bb6b-cca6e805f29c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 204 len: 0 microversion: 2.1 time: 0.139180 Aug 27 05:34:50.099956 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3277/6551] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:34:49 2022] DELETE /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:34:50.108636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-20ba0cc3-fc35-4913-8fb1-3d623517a118 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:50.110132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-20ba0cc3-fc35-4913-8fb1-3d623517a118 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:50.120505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20ba0cc3-fc35-4913-8fb1-3d623517a118 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:50.121372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20ba0cc3-fc35-4913-8fb1-3d623517a118 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:50.121821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20ba0cc3-fc35-4913-8fb1-3d623517a118 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:50.122544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20ba0cc3-fc35-4913-8fb1-3d623517a118 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:50.123042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20ba0cc3-fc35-4913-8fb1-3d623517a118 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:50.123527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-20ba0cc3-fc35-4913-8fb1-3d623517a118 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:50.327822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-20ba0cc3-fc35-4913-8fb1-3d623517a118 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:50.340440 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-20ba0cc3-fc35-4913-8fb1-3d623517a118 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1569 microversion: 2.1 time: 0.236192 Aug 27 05:34:50.355883 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3275/6552] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:50 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:34:51.368310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-94f98696-162e-45f4-b217-e826a39e18a6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:51.369424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-94f98696-162e-45f4-b217-e826a39e18a6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:51.380235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f98696-162e-45f4-b217-e826a39e18a6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:51.380859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f98696-162e-45f4-b217-e826a39e18a6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:51.381359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f98696-162e-45f4-b217-e826a39e18a6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:51.382296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f98696-162e-45f4-b217-e826a39e18a6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:51.382768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f98696-162e-45f4-b217-e826a39e18a6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:51.383452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-94f98696-162e-45f4-b217-e826a39e18a6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:51.569794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-94f98696-162e-45f4-b217-e826a39e18a6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:51.582013 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-94f98696-162e-45f4-b217-e826a39e18a6 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1569 microversion: 2.1 time: 0.219216 Aug 27 05:34:51.583921 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3278/6553] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:51 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:52.604836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ce47dd6-3677-47db-ac20-d01654f2e1fb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:52.605640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0ce47dd6-3677-47db-ac20-d01654f2e1fb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:52.622933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ce47dd6-3677-47db-ac20-d01654f2e1fb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:52.623483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ce47dd6-3677-47db-ac20-d01654f2e1fb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:52.623932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ce47dd6-3677-47db-ac20-d01654f2e1fb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:52.624662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ce47dd6-3677-47db-ac20-d01654f2e1fb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:52.625127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ce47dd6-3677-47db-ac20-d01654f2e1fb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:52.625617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ce47dd6-3677-47db-ac20-d01654f2e1fb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:52.822413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0ce47dd6-3677-47db-ac20-d01654f2e1fb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:52.831671 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ce47dd6-3677-47db-ac20-d01654f2e1fb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1569 microversion: 2.1 time: 0.231451 Aug 27 05:34:52.832282 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3276/6554] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:52 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:52.859146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1a413947-1c1d-4037-9ab1-90c4f0a9293e req-fae05f3f-ec3f-4b05-b909-84cab2c8c511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d133c5-1c20-4bf0-ba04-afd40baf9d9a", "name": "network-vif-deleted", "tag": "bdbbe3d0-0ea7-456c-9be6-8daeeaad0dec"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:52.889078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1a413947-1c1d-4037-9ab1-90c4f0a9293e req-fae05f3f-ec3f-4b05-b909-84cab2c8c511 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:52.889078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1a413947-1c1d-4037-9ab1-90c4f0a9293e req-fae05f3f-ec3f-4b05-b909-84cab2c8c511 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:52.889078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1a413947-1c1d-4037-9ab1-90c4f0a9293e req-fae05f3f-ec3f-4b05-b909-84cab2c8c511 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:52.910845 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1a413947-1c1d-4037-9ab1-90c4f0a9293e req-fae05f3f-ec3f-4b05-b909-84cab2c8c511 service nova] Creating event network-vif-deleted:bdbbe3d0-0ea7-456c-9be6-8daeeaad0dec for instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a on n-h2-820368-35 Aug 27 05:34:52.922950 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1a413947-1c1d-4037-9ab1-90c4f0a9293e req-fae05f3f-ec3f-4b05-b909-84cab2c8c511 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071275 Aug 27 05:34:52.930758 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3279/6555] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:34:53.855507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-845b5cd6-aa1c-45f7-b9d2-ed7539beb331 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:53.856538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-845b5cd6-aa1c-45f7-b9d2-ed7539beb331 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:53.870468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-845b5cd6-aa1c-45f7-b9d2-ed7539beb331 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:53.871273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-845b5cd6-aa1c-45f7-b9d2-ed7539beb331 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:53.871991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-845b5cd6-aa1c-45f7-b9d2-ed7539beb331 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:53.873106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-845b5cd6-aa1c-45f7-b9d2-ed7539beb331 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:53.873917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-845b5cd6-aa1c-45f7-b9d2-ed7539beb331 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:53.874700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-845b5cd6-aa1c-45f7-b9d2-ed7539beb331 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:53.962712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-845b5cd6-aa1c-45f7-b9d2-ed7539beb331 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:53.972941 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-845b5cd6-aa1c-45f7-b9d2-ed7539beb331 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1360 microversion: 2.1 time: 0.122511 Aug 27 05:34:53.974173 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3277/6556] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:53 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1360 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:55.002142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-99d8f729-13f7-476b-85f3-bbd198a1d05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:55.004380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-99d8f729-13f7-476b-85f3-bbd198a1d05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:55.012471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99d8f729-13f7-476b-85f3-bbd198a1d05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:55.013620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99d8f729-13f7-476b-85f3-bbd198a1d05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:55.014462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99d8f729-13f7-476b-85f3-bbd198a1d05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:55.015623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99d8f729-13f7-476b-85f3-bbd198a1d05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:55.016534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99d8f729-13f7-476b-85f3-bbd198a1d05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:55.017316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99d8f729-13f7-476b-85f3-bbd198a1d05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:55.098643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-99d8f729-13f7-476b-85f3-bbd198a1d05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:55.108943 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-99d8f729-13f7-476b-85f3-bbd198a1d05e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1360 microversion: 2.1 time: 0.111838 Aug 27 05:34:55.112343 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3280/6557] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:54 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1360 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:56.135562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4e1ca759-03b3-4f65-aebf-ead3fd1a125e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:56.137751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4e1ca759-03b3-4f65-aebf-ead3fd1a125e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:56.147848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e1ca759-03b3-4f65-aebf-ead3fd1a125e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:56.148826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e1ca759-03b3-4f65-aebf-ead3fd1a125e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:56.149526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e1ca759-03b3-4f65-aebf-ead3fd1a125e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:56.150458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e1ca759-03b3-4f65-aebf-ead3fd1a125e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:56.152235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e1ca759-03b3-4f65-aebf-ead3fd1a125e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:56.153037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e1ca759-03b3-4f65-aebf-ead3fd1a125e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:56.231649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4e1ca759-03b3-4f65-aebf-ead3fd1a125e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:56.242048 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4e1ca759-03b3-4f65-aebf-ead3fd1a125e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1360 microversion: 2.1 time: 0.114838 Aug 27 05:34:56.242701 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3278/6558] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:56 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1360 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:57.269664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2486a542-5107-46ba-b73c-bafe7183b184 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:57.271042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2486a542-5107-46ba-b73c-bafe7183b184 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:57.280797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2486a542-5107-46ba-b73c-bafe7183b184 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:57.281317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2486a542-5107-46ba-b73c-bafe7183b184 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:57.282291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2486a542-5107-46ba-b73c-bafe7183b184 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:57.283142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2486a542-5107-46ba-b73c-bafe7183b184 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:57.283609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2486a542-5107-46ba-b73c-bafe7183b184 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:57.284031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2486a542-5107-46ba-b73c-bafe7183b184 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:57.370063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2486a542-5107-46ba-b73c-bafe7183b184 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:57.378293 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2486a542-5107-46ba-b73c-bafe7183b184 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1360 microversion: 2.1 time: 0.114674 Aug 27 05:34:57.391994 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3281/6559] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:57 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1360 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:58.405221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:58.407326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:58.423621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:58.425268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:58.429367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:58.431156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:58.432200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:58.433202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:58.503438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:58.504548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:58.505271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:58.506235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lazy-loading 'fault' on Instance uuid 40d133c5-1c20-4bf0-ba04-afd40baf9d9a {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:34:59.110423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:59.131004 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ee54294-37ad-476b-9a4d-db787e464bb0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 200 len: 1319 microversion: 2.1 time: 0.732472 Aug 27 05:34:59.135299 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3279/6560] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:58 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 1319 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:00.159666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:00.160903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:00.169155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:00.170088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:00.170787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:00.171760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:00.172488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:00.173616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:00.203262 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a HTTP/1.1 Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '40d133c5-1c20-4bf0-ba04-afd40baf9d9a'} Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:00.205068 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:00.209738 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:00.209738 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:00.209738 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:00.209738 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:00.209738 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:00.209738 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:00.209738 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:00.209738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:00.209738 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aa366e2f-424d-4138-bd4b-2f97a1d8c622 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 404 len: 111 microversion: 2.1 time: 0.051800 Aug 27 05:35:00.209738 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3282/6561] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:00 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:04.596916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1af66608-82b7-4675-ae88-8f6d47e1e515 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:04.597481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1af66608-82b7-4675-ae88-8f6d47e1e515 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:04.610071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1af66608-82b7-4675-ae88-8f6d47e1e515 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:04.611530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1af66608-82b7-4675-ae88-8f6d47e1e515 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:04.612512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1af66608-82b7-4675-ae88-8f6d47e1e515 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:04.614646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1af66608-82b7-4675-ae88-8f6d47e1e515 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:04.615328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1af66608-82b7-4675-ae88-8f6d47e1e515 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:04.616348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1af66608-82b7-4675-ae88-8f6d47e1e515 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:04.623445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=74 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:04.660917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1af66608-82b7-4675-ae88-8f6d47e1e515 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:35:04.768402 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1af66608-82b7-4675-ae88-8f6d47e1e515 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 204 len: 0 microversion: 2.1 time: 0.175831 Aug 27 05:35:04.769146 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3280/6562] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:35:04 2022] DELETE /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:35:04.779510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b791bcc9-6652-4417-8bf6-cc0b69d95eed tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:04.780148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b791bcc9-6652-4417-8bf6-cc0b69d95eed tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:04.793044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b791bcc9-6652-4417-8bf6-cc0b69d95eed tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:04.793609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b791bcc9-6652-4417-8bf6-cc0b69d95eed tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:04.794169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b791bcc9-6652-4417-8bf6-cc0b69d95eed tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:04.794721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b791bcc9-6652-4417-8bf6-cc0b69d95eed tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:04.795281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b791bcc9-6652-4417-8bf6-cc0b69d95eed tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:04.795659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b791bcc9-6652-4417-8bf6-cc0b69d95eed tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:04.995511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b791bcc9-6652-4417-8bf6-cc0b69d95eed tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:05.005551 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b791bcc9-6652-4417-8bf6-cc0b69d95eed tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1409 microversion: 2.1 time: 0.231499 Aug 27 05:35:05.006053 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3283/6563] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:04 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1409 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:35:06.028941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e6693074-c932-4ff3-8373-e272b587149f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:06.029562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e6693074-c932-4ff3-8373-e272b587149f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:06.037348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6693074-c932-4ff3-8373-e272b587149f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:06.037847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6693074-c932-4ff3-8373-e272b587149f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:06.038480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6693074-c932-4ff3-8373-e272b587149f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:06.039225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6693074-c932-4ff3-8373-e272b587149f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:06.039684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6693074-c932-4ff3-8373-e272b587149f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:06.040118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6693074-c932-4ff3-8373-e272b587149f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:06.208513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e6693074-c932-4ff3-8373-e272b587149f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:06.217331 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e6693074-c932-4ff3-8373-e272b587149f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1409 microversion: 2.1 time: 0.193100 Aug 27 05:35:06.217923 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3281/6564] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:06 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1409 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:35:07.178143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-23211e5d-dca0-4176-904c-59ce5ab8e774 req-aa3c1da2-582e-4e1b-acdb-ec817bf04c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cc6c27-67cc-4387-86c1-fabed764ee90", "name": "network-vif-deleted", "tag": "5fa91af8-9c32-4562-b809-01a03545c9dc"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:07.213964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-23211e5d-dca0-4176-904c-59ce5ab8e774 req-aa3c1da2-582e-4e1b-acdb-ec817bf04c8f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:07.215611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-23211e5d-dca0-4176-904c-59ce5ab8e774 req-aa3c1da2-582e-4e1b-acdb-ec817bf04c8f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:07.217151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-23211e5d-dca0-4176-904c-59ce5ab8e774 req-aa3c1da2-582e-4e1b-acdb-ec817bf04c8f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:07.238603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-980aa125-47f8-40fd-9045-458494513ee1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:07.240709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-980aa125-47f8-40fd-9045-458494513ee1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:07.241620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-23211e5d-dca0-4176-904c-59ce5ab8e774 req-aa3c1da2-582e-4e1b-acdb-ec817bf04c8f service nova] Creating event network-vif-deleted:5fa91af8-9c32-4562-b809-01a03545c9dc for instance 33cc6c27-67cc-4387-86c1-fabed764ee90 on n-h2-820368-35 Aug 27 05:35:07.253237 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-23211e5d-dca0-4176-904c-59ce5ab8e774 req-aa3c1da2-582e-4e1b-acdb-ec817bf04c8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085320 Aug 27 05:35:07.253854 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3284/6565] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:07.262490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-980aa125-47f8-40fd-9045-458494513ee1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:07.265120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-980aa125-47f8-40fd-9045-458494513ee1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:07.265883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-980aa125-47f8-40fd-9045-458494513ee1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:07.267065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-980aa125-47f8-40fd-9045-458494513ee1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:07.268114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-980aa125-47f8-40fd-9045-458494513ee1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:07.271276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-980aa125-47f8-40fd-9045-458494513ee1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:07.421098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-980aa125-47f8-40fd-9045-458494513ee1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:07.444418 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-980aa125-47f8-40fd-9045-458494513ee1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1201 microversion: 2.1 time: 0.210411 Aug 27 05:35:07.445040 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3282/6566] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:07 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1201 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:08.479047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d5f102f9-b6fd-45a5-be84-0e3eb6b6d412 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:08.483673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d5f102f9-b6fd-45a5-be84-0e3eb6b6d412 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:08.501698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5f102f9-b6fd-45a5-be84-0e3eb6b6d412 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:08.503265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5f102f9-b6fd-45a5-be84-0e3eb6b6d412 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:08.504831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5f102f9-b6fd-45a5-be84-0e3eb6b6d412 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:08.506995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5f102f9-b6fd-45a5-be84-0e3eb6b6d412 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:08.508603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5f102f9-b6fd-45a5-be84-0e3eb6b6d412 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:08.510059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5f102f9-b6fd-45a5-be84-0e3eb6b6d412 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:08.598476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d5f102f9-b6fd-45a5-be84-0e3eb6b6d412 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:08.611707 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d5f102f9-b6fd-45a5-be84-0e3eb6b6d412 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1201 microversion: 2.1 time: 0.139521 Aug 27 05:35:08.613106 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3285/6567] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:08 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1201 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:09.635136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-870abd61-2fc0-4a65-ae12-1e7d704e3995 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:09.636458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-870abd61-2fc0-4a65-ae12-1e7d704e3995 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:09.645630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-870abd61-2fc0-4a65-ae12-1e7d704e3995 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:09.646446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-870abd61-2fc0-4a65-ae12-1e7d704e3995 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:09.663236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-870abd61-2fc0-4a65-ae12-1e7d704e3995 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:09.664269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-870abd61-2fc0-4a65-ae12-1e7d704e3995 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:09.664779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-870abd61-2fc0-4a65-ae12-1e7d704e3995 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:09.665436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-870abd61-2fc0-4a65-ae12-1e7d704e3995 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:09.754758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-870abd61-2fc0-4a65-ae12-1e7d704e3995 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:09.766125 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-870abd61-2fc0-4a65-ae12-1e7d704e3995 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1201 microversion: 2.1 time: 0.135763 Aug 27 05:35:09.767801 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3283/6568] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:09 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1201 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:10.787493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29aa43bc-b5d6-4777-95d6-7a5150b84c1e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:10.788775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-29aa43bc-b5d6-4777-95d6-7a5150b84c1e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:10.798009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29aa43bc-b5d6-4777-95d6-7a5150b84c1e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:10.798524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29aa43bc-b5d6-4777-95d6-7a5150b84c1e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:10.798981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29aa43bc-b5d6-4777-95d6-7a5150b84c1e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:10.799752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29aa43bc-b5d6-4777-95d6-7a5150b84c1e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:10.800224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29aa43bc-b5d6-4777-95d6-7a5150b84c1e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:10.800669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29aa43bc-b5d6-4777-95d6-7a5150b84c1e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:10.846771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70eea6f5-0487-43ba-941e-7a16c9918dc2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:10.847986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-70eea6f5-0487-43ba-941e-7a16c9918dc2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:10.861198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70eea6f5-0487-43ba-941e-7a16c9918dc2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:10.861947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70eea6f5-0487-43ba-941e-7a16c9918dc2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:10.862547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70eea6f5-0487-43ba-941e-7a16c9918dc2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:10.864032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70eea6f5-0487-43ba-941e-7a16c9918dc2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:10.864655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70eea6f5-0487-43ba-941e-7a16c9918dc2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:10.865243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70eea6f5-0487-43ba-941e-7a16c9918dc2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:10.893751 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70eea6f5-0487-43ba-941e-7a16c9918dc2 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/ips" status: 200 len: 144 microversion: 2.1 time: 0.051773 Aug 27 05:35:10.897344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-29aa43bc-b5d6-4777-95d6-7a5150b84c1e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:10.911485 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-29aa43bc-b5d6-4777-95d6-7a5150b84c1e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1201 microversion: 2.1 time: 0.126803 Aug 27 05:35:10.911930 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3284/6569] 10.222.0.58 () {58 vars in 1248 bytes} [Sat Aug 27 05:35:10 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/ips => generated 144 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:10.913211 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3286/6570] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:10 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1201 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:11.933590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fdb210e3-b5bf-434e-96d9-b545b17f4d48 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:11.934217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fdb210e3-b5bf-434e-96d9-b545b17f4d48 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:11.941312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdb210e3-b5bf-434e-96d9-b545b17f4d48 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:11.942037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdb210e3-b5bf-434e-96d9-b545b17f4d48 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:11.942643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdb210e3-b5bf-434e-96d9-b545b17f4d48 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:11.943548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdb210e3-b5bf-434e-96d9-b545b17f4d48 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:11.944163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdb210e3-b5bf-434e-96d9-b545b17f4d48 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:11.944759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fdb210e3-b5bf-434e-96d9-b545b17f4d48 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:12.079975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fdb210e3-b5bf-434e-96d9-b545b17f4d48 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:12.096477 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fdb210e3-b5bf-434e-96d9-b545b17f4d48 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1201 microversion: 2.1 time: 0.166650 Aug 27 05:35:12.101392 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3285/6571] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:11 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1201 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:13.122996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:13.124066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:13.139262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:13.140714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:13.140714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:13.141144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:13.147134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:13.147714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:13.188635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:13.189740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:13.190193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:13.190704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lazy-loading 'fault' on Instance uuid 33cc6c27-67cc-4387-86c1-fabed764ee90 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:35:13.245066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:13.260163 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed775f08-cf24-4901-ab27-0212918ad76a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 200 len: 1206 microversion: 2.1 time: 0.140728 Aug 27 05:35:13.261389 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3287/6572] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:13 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 1206 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:35:13.569390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b361f8b-bdda-4200-9d46-a7a8f9d33578 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f17aaf1-a365-4eea-a040-8380be89bb41"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:13.572564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9b361f8b-bdda-4200-9d46-a7a8f9d33578 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:13.581297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b361f8b-bdda-4200-9d46-a7a8f9d33578 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:13.582334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b361f8b-bdda-4200-9d46-a7a8f9d33578 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:13.583440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b361f8b-bdda-4200-9d46-a7a8f9d33578 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:13.584802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b361f8b-bdda-4200-9d46-a7a8f9d33578 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:13.585438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b361f8b-bdda-4200-9d46-a7a8f9d33578 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:13.586413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b361f8b-bdda-4200-9d46-a7a8f9d33578 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:14.090507 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9b361f8b-bdda-4200-9d46-a7a8f9d33578 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "POST /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.519169 Aug 27 05:35:14.092518 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3286/6573] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:35:13 2022] POST /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:14.284230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:14.285351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:14.305576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:14.306150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:14.309718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:14.312894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:14.314527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:14.315137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:14.372397 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 HTTP/1.1 Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '33cc6c27-67cc-4387-86c1-fabed764ee90'} Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:14.379054 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:14.383429 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:14.383429 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:14.383429 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:14.383429 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:14.383429 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:14.383429 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:14.383429 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:14.388583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:14.394203 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-969f44fe-3da5-40f2-bd1d-c23bdc6a23d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 404 len: 111 microversion: 2.1 time: 0.113178 Aug 27 05:35:14.395905 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3288/6574] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:14 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:16.042771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c82189f5-33aa-4766-82e7-7c73a52d7b63 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:16.043982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c82189f5-33aa-4766-82e7-7c73a52d7b63 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:16.058820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82189f5-33aa-4766-82e7-7c73a52d7b63 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:16.059363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82189f5-33aa-4766-82e7-7c73a52d7b63 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:16.059817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82189f5-33aa-4766-82e7-7c73a52d7b63 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:16.063708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82189f5-33aa-4766-82e7-7c73a52d7b63 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:16.065322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82189f5-33aa-4766-82e7-7c73a52d7b63 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:16.065785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c82189f5-33aa-4766-82e7-7c73a52d7b63 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:16.442602 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c82189f5-33aa-4766-82e7-7c73a52d7b63 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1837 microversion: 2.1 time: 0.406488 Aug 27 05:35:16.458304 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3287/6575] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:16 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1837 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:16.469436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6fec48eb-4400-4c4a-b84d-12d6127adb35 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:16.470117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6fec48eb-4400-4c4a-b84d-12d6127adb35 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:16.485296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fec48eb-4400-4c4a-b84d-12d6127adb35 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:16.486616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fec48eb-4400-4c4a-b84d-12d6127adb35 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:16.487322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fec48eb-4400-4c4a-b84d-12d6127adb35 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:16.488242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fec48eb-4400-4c4a-b84d-12d6127adb35 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:16.488946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fec48eb-4400-4c4a-b84d-12d6127adb35 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:16.493317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6fec48eb-4400-4c4a-b84d-12d6127adb35 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:16.742921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6fec48eb-4400-4c4a-b84d-12d6127adb35 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:16.756297 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6fec48eb-4400-4c4a-b84d-12d6127adb35 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1684 microversion: 2.1 time: 0.290441 Aug 27 05:35:16.756900 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3289/6576] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:16 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1684 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:16.915219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-afc4aacb-bcc3-4ff2-87dc-b0cfa80ff6e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:16.918324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-afc4aacb-bcc3-4ff2-87dc-b0cfa80ff6e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:16.927997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc4aacb-bcc3-4ff2-87dc-b0cfa80ff6e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:16.929170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc4aacb-bcc3-4ff2-87dc-b0cfa80ff6e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:16.930256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc4aacb-bcc3-4ff2-87dc-b0cfa80ff6e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:16.931699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc4aacb-bcc3-4ff2-87dc-b0cfa80ff6e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:16.932366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc4aacb-bcc3-4ff2-87dc-b0cfa80ff6e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:16.933705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-afc4aacb-bcc3-4ff2-87dc-b0cfa80ff6e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:17.023264 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-afc4aacb-bcc3-4ff2-87dc-b0cfa80ff6e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9/action" status: 200 len: 32645 microversion: 2.1 time: 0.117053 Aug 27 05:35:17.030654 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3288/6577] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:35:16 2022] POST /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9/action => generated 32645 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:35:17.205096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:17.205706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:17.223636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:17.224164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:17.224627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:17.225372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:17.225846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:17.226471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:17.280964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:17.319442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '41b36433164f48588273f1635154d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ae45642d84797b71e182d6ee53053', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:17.320444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] flavor_id is None. Assuming migration. {{(pid=128547) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 05:35:17.321122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128547) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:35:17.892256 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ca028bbb-f9e6-4e0b-9d7a-a2b7490c73af tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9/action" status: 202 len: 0 microversion: 2.1 time: 0.690848 Aug 27 05:35:17.898293 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3290/6578] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:35:17 2022] POST /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9/action => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:35:17.927612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2bde0b1a-c39e-4203-8bec-edc6abb6ae0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:17.929295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2bde0b1a-c39e-4203-8bec-edc6abb6ae0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:17.956757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bde0b1a-c39e-4203-8bec-edc6abb6ae0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:17.959682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bde0b1a-c39e-4203-8bec-edc6abb6ae0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:17.960442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bde0b1a-c39e-4203-8bec-edc6abb6ae0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:17.962721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bde0b1a-c39e-4203-8bec-edc6abb6ae0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:17.969024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bde0b1a-c39e-4203-8bec-edc6abb6ae0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:17.970272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2bde0b1a-c39e-4203-8bec-edc6abb6ae0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:18.408212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2bde0b1a-c39e-4203-8bec-edc6abb6ae0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:18.419692 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2bde0b1a-c39e-4203-8bec-edc6abb6ae0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1693 microversion: 2.1 time: 0.512034 Aug 27 05:35:18.421749 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3289/6579] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:17 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1693 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:18.916698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:18.917219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:18.927442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:18.927963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:18.928437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:18.930243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:18.932038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:18.932948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:18.957722 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a HTTP/1.1 Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '40d133c5-1c20-4bf0-ba04-afd40baf9d9a'} Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:18.960477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:18.965667 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:18.965667 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:18.965667 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:18.965667 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:18.965667 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:18.965667 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:18.965667 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:18.965667 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:18.965667 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:18.965667 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:18.965667 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:18.967914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:18.969440 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d67d3cfa-4326-4d0b-bd92-3ef3e270c4a5 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 404 len: 111 microversion: 2.1 time: 0.056533 Aug 27 05:35:18.975193 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3291/6580] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:35:18 2022] DELETE /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:18.980262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:18.980888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 40d133c5-1c20-4bf0-ba04-afd40baf9d9a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:18.990660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:18.991354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:18.992003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:18.993052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:18.993672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:18.994420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:19.011478 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a HTTP/1.1 Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '40d133c5-1c20-4bf0-ba04-afd40baf9d9a'} Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:19.013838 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:35:19.021211 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:19.021211 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:19.021211 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:19.021211 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:19.021211 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:19.021211 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. Aug 27 05:35:19.021211 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:35:19.021211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 40d133c5-1c20-4bf0-ba04-afd40baf9d9a could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:19.021211 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-17fa2e18-909f-40c5-a930-1e7b18be9389 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a" status: 404 len: 111 microversion: 2.1 time: 0.040474 Aug 27 05:35:19.021211 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3290/6581] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:18 2022] GET /compute/v2.1/servers/40d133c5-1c20-4bf0-ba04-afd40baf9d9a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:19.445707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fe545bd3-68b2-4177-9fee-eac2b347e0bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:19.446592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fe545bd3-68b2-4177-9fee-eac2b347e0bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:19.456410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:19.458183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe545bd3-68b2-4177-9fee-eac2b347e0bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:19.460092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe545bd3-68b2-4177-9fee-eac2b347e0bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:19.464476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe545bd3-68b2-4177-9fee-eac2b347e0bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:19.465468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe545bd3-68b2-4177-9fee-eac2b347e0bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:19.466123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe545bd3-68b2-4177-9fee-eac2b347e0bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:19.467103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe545bd3-68b2-4177-9fee-eac2b347e0bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:19.960332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fe545bd3-68b2-4177-9fee-eac2b347e0bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:19.973334 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fe545bd3-68b2-4177-9fee-eac2b347e0bc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1693 microversion: 2.1 time: 0.531614 Aug 27 05:35:19.975081 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3292/6582] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:19 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1693 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:20.634831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:20.636193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:20.645560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:20.651061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:20.651962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:20.653067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:20.653969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:20.654594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:20.655236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:20.701815 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 HTTP/1.1 Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '33cc6c27-67cc-4387-86c1-fabed764ee90'} Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:20.705059 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b55deafc-569e-485b-9766-fdbbfe9a8064 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 404 len: 111 microversion: 2.1 time: 0.077183 Aug 27 05:35:20.712782 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3291/6583] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:35:20 2022] DELETE /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:20.720314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:20.722082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 33cc6c27-67cc-4387-86c1-fabed764ee90] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:20.730585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:20.731141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:20.731747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:20.732491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:20.733025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:20.733475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:20.770752 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 HTTP/1.1 Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '33cc6c27-67cc-4387-86c1-fabed764ee90'} Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:20.773090 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:20.777097 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:20.777097 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:20.777097 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:20.777097 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:20.777097 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:20.777097 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. Aug 27 05:35:20.777097 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:35:20.780253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 33cc6c27-67cc-4387-86c1-fabed764ee90 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:20.781842 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-05895879-a4fc-457b-a0b3-b71a54ae4414 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90" status: 404 len: 111 microversion: 2.1 time: 0.067762 Aug 27 05:35:20.782969 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3293/6584] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:20 2022] GET /compute/v2.1/servers/33cc6c27-67cc-4387-86c1-fabed764ee90 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:21.011117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5cc3de1c-0f8d-450b-a88c-58d73587ba97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:21.018022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5cc3de1c-0f8d-450b-a88c-58d73587ba97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:21.064911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc3de1c-0f8d-450b-a88c-58d73587ba97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:21.067444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc3de1c-0f8d-450b-a88c-58d73587ba97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:21.068873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc3de1c-0f8d-450b-a88c-58d73587ba97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:21.070510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc3de1c-0f8d-450b-a88c-58d73587ba97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:21.071468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc3de1c-0f8d-450b-a88c-58d73587ba97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:21.072007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc3de1c-0f8d-450b-a88c-58d73587ba97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:21.508275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-700e2dad-4ac6-416f-91f8-043844d7a723 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Action: 'create', calling method: .version_select at 0x7fb56440c820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1417438862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuVZqrX8eMLMD9zy/ObbHqERZIk/Uyy+RjtYKEQMJ0Dbift4RISIlGqGrLacnJKCxisrLo5D6NKcNUfIUOX5N0dLPut4bYCLxNGl+PVL5M3kN9WDyayW+yz1xOq42nWWA=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:21.512609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5cc3de1c-0f8d-450b-a88c-58d73587ba97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:21.526230 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5cc3de1c-0f8d-450b-a88c-58d73587ba97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1693 microversion: 2.1 time: 0.527938 Aug 27 05:35:21.527787 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3292/6585] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:20 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1693 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:21.551736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-700e2dad-4ac6-416f-91f8-043844d7a723 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for project e4b05abd53e947b38c809fa546091e9e. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:35:21.559739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-700e2dad-4ac6-416f-91f8-043844d7a723 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for user 007b4762bf8c436fb783d84380c01932 and project e4b05abd53e947b38c809fa546091e9e. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:35:21.597692 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-700e2dad-4ac6-416f-91f8-043844d7a723 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.093965 Aug 27 05:35:21.598782 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3294/6586] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:35:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:35:22.550488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-66954a84-5221-411b-95ed-35e71fd05f57 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:22.560825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-66954a84-5221-411b-95ed-35e71fd05f57 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:22.575664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66954a84-5221-411b-95ed-35e71fd05f57 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:22.576528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66954a84-5221-411b-95ed-35e71fd05f57 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:22.577143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66954a84-5221-411b-95ed-35e71fd05f57 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:22.578466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66954a84-5221-411b-95ed-35e71fd05f57 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:22.581880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66954a84-5221-411b-95ed-35e71fd05f57 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:22.582336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66954a84-5221-411b-95ed-35e71fd05f57 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:22.850306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66954a84-5221-411b-95ed-35e71fd05f57 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:22.859776 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-66954a84-5221-411b-95ed-35e71fd05f57 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1698 microversion: 2.1 time: 0.313618 Aug 27 05:35:22.867278 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3293/6587] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:22 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1698 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:23.885259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4aa83ce2-772a-416d-bc9d-464d61d86981 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:23.886008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4aa83ce2-772a-416d-bc9d-464d61d86981 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:23.894743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa83ce2-772a-416d-bc9d-464d61d86981 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:23.895545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa83ce2-772a-416d-bc9d-464d61d86981 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:23.896154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa83ce2-772a-416d-bc9d-464d61d86981 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:23.896992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa83ce2-772a-416d-bc9d-464d61d86981 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:23.897828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa83ce2-772a-416d-bc9d-464d61d86981 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:23.898411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4aa83ce2-772a-416d-bc9d-464d61d86981 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:24.110017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4aa83ce2-772a-416d-bc9d-464d61d86981 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:24.121694 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4aa83ce2-772a-416d-bc9d-464d61d86981 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1698 microversion: 2.1 time: 0.242332 Aug 27 05:35:24.122705 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3295/6588] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:23 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1698 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:25.149303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-474819c4-1bf3-4bbc-bf48-9a76c53aca95 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:25.149303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-474819c4-1bf3-4bbc-bf48-9a76c53aca95 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:25.156851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474819c4-1bf3-4bbc-bf48-9a76c53aca95 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:25.157695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474819c4-1bf3-4bbc-bf48-9a76c53aca95 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:25.157876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474819c4-1bf3-4bbc-bf48-9a76c53aca95 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:25.158482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474819c4-1bf3-4bbc-bf48-9a76c53aca95 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:25.158953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474819c4-1bf3-4bbc-bf48-9a76c53aca95 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:25.159419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-474819c4-1bf3-4bbc-bf48-9a76c53aca95 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:25.362016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-474819c4-1bf3-4bbc-bf48-9a76c53aca95 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:25.375270 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-474819c4-1bf3-4bbc-bf48-9a76c53aca95 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1698 microversion: 2.1 time: 0.233344 Aug 27 05:35:25.376462 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3294/6589] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:25 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1698 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:26.399362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c76865d9-d437-4332-b735-9fe14077cc97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:26.400106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c76865d9-d437-4332-b735-9fe14077cc97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:26.410157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c76865d9-d437-4332-b735-9fe14077cc97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:26.410667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c76865d9-d437-4332-b735-9fe14077cc97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:26.411156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c76865d9-d437-4332-b735-9fe14077cc97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:26.412083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c76865d9-d437-4332-b735-9fe14077cc97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:26.412960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c76865d9-d437-4332-b735-9fe14077cc97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:26.414318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c76865d9-d437-4332-b735-9fe14077cc97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:26.632211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c76865d9-d437-4332-b735-9fe14077cc97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:26.645345 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c76865d9-d437-4332-b735-9fe14077cc97 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1698 microversion: 2.1 time: 0.251149 Aug 27 05:35:26.646653 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3296/6590] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:26 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1698 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:27.667937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-619236b1-4bf1-42bc-90f2-122ee4386138 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:27.671506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-619236b1-4bf1-42bc-90f2-122ee4386138 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:27.686876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-619236b1-4bf1-42bc-90f2-122ee4386138 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.687492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-619236b1-4bf1-42bc-90f2-122ee4386138 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.689318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-619236b1-4bf1-42bc-90f2-122ee4386138 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.690806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-619236b1-4bf1-42bc-90f2-122ee4386138 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.691478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-619236b1-4bf1-42bc-90f2-122ee4386138 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.692284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-619236b1-4bf1-42bc-90f2-122ee4386138 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.909289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-619236b1-4bf1-42bc-90f2-122ee4386138 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:27.911733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:27.925211 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-619236b1-4bf1-42bc-90f2-122ee4386138 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1698 microversion: 2.1 time: 0.260547 Aug 27 05:35:27.943507 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3295/6591] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:27 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1698 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:27.998258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6884ef8e-634a-42a4-9ba9-eaa25d320efe tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:28.004337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6884ef8e-634a-42a4-9ba9-eaa25d320efe tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:28.024546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6884ef8e-634a-42a4-9ba9-eaa25d320efe tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:28.025067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6884ef8e-634a-42a4-9ba9-eaa25d320efe tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:28.035165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6884ef8e-634a-42a4-9ba9-eaa25d320efe tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:28.035165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6884ef8e-634a-42a4-9ba9-eaa25d320efe tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:28.035165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6884ef8e-634a-42a4-9ba9-eaa25d320efe tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:28.035165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6884ef8e-634a-42a4-9ba9-eaa25d320efe tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:28.082134 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6884ef8e-634a-42a4-9ba9-eaa25d320efe tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092402 Aug 27 05:35:28.082896 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3297/6592] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:35:27 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:28.098584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e71d0e2-2c45-418b-9282-686c4bde8936 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:28.099664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e71d0e2-2c45-418b-9282-686c4bde8936 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:28.113241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e71d0e2-2c45-418b-9282-686c4bde8936 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:28.114833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e71d0e2-2c45-418b-9282-686c4bde8936 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:28.115837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e71d0e2-2c45-418b-9282-686c4bde8936 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:28.117215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e71d0e2-2c45-418b-9282-686c4bde8936 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:28.118153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e71d0e2-2c45-418b-9282-686c4bde8936 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:28.119106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e71d0e2-2c45-418b-9282-686c4bde8936 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:28.166057 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e71d0e2-2c45-418b-9282-686c4bde8936 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments/1f17aaf1-a365-4eea-a040-8380be89bb41" status: 200 len: 194 microversion: 2.1 time: 0.075254 Aug 27 05:35:28.167270 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3296/6593] 10.222.0.58 () {58 vars in 1413 bytes} [Sat Aug 27 05:35:28 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments/1f17aaf1-a365-4eea-a040-8380be89bb41 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:28.949352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8adb2888-8c88-4348-8ce9-86f845f0fbf9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:28.951699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8adb2888-8c88-4348-8ce9-86f845f0fbf9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:28.961887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8adb2888-8c88-4348-8ce9-86f845f0fbf9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:28.963612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8adb2888-8c88-4348-8ce9-86f845f0fbf9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:28.964853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8adb2888-8c88-4348-8ce9-86f845f0fbf9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:28.966566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8adb2888-8c88-4348-8ce9-86f845f0fbf9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:28.978589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8adb2888-8c88-4348-8ce9-86f845f0fbf9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:28.979748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8adb2888-8c88-4348-8ce9-86f845f0fbf9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:29.251799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8adb2888-8c88-4348-8ce9-86f845f0fbf9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:29.263332 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8adb2888-8c88-4348-8ce9-86f845f0fbf9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1698 microversion: 2.1 time: 0.317546 Aug 27 05:35:29.267196 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3298/6594] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:28 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1698 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:30.292716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7c401c47-2353-46e9-ba76-aea8c7bc2b82 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:30.294418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7c401c47-2353-46e9-ba76-aea8c7bc2b82 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:30.309120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c401c47-2353-46e9-ba76-aea8c7bc2b82 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:30.310450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c401c47-2353-46e9-ba76-aea8c7bc2b82 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:30.311789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c401c47-2353-46e9-ba76-aea8c7bc2b82 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:30.313995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c401c47-2353-46e9-ba76-aea8c7bc2b82 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:30.315044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c401c47-2353-46e9-ba76-aea8c7bc2b82 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:30.315562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7c401c47-2353-46e9-ba76-aea8c7bc2b82 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:30.578936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7c401c47-2353-46e9-ba76-aea8c7bc2b82 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:30.590086 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7c401c47-2353-46e9-ba76-aea8c7bc2b82 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1698 microversion: 2.1 time: 0.305025 Aug 27 05:35:30.590944 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3297/6595] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:30 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1698 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:30.876476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0ad74993-9b90-4d36-b599-56c04e0846a7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b6f8def-7890-43a5-b50d-97ef7b90d511"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:30.880136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0ad74993-9b90-4d36-b599-56c04e0846a7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:30.887966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ad74993-9b90-4d36-b599-56c04e0846a7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:30.888709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ad74993-9b90-4d36-b599-56c04e0846a7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:30.889361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ad74993-9b90-4d36-b599-56c04e0846a7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:30.890097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ad74993-9b90-4d36-b599-56c04e0846a7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:30.890567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ad74993-9b90-4d36-b599-56c04e0846a7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:30.891007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ad74993-9b90-4d36-b599-56c04e0846a7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:31.219827 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0ad74993-9b90-4d36-b599-56c04e0846a7 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "POST /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347091 Aug 27 05:35:31.220446 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3299/6596] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:35:30 2022] POST /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:31.612534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ff34b24c-cc58-4e02-9e3d-96467083c2db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:31.613159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ff34b24c-cc58-4e02-9e3d-96467083c2db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:31.627809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff34b24c-cc58-4e02-9e3d-96467083c2db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:31.629100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff34b24c-cc58-4e02-9e3d-96467083c2db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:31.629555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff34b24c-cc58-4e02-9e3d-96467083c2db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:31.631589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff34b24c-cc58-4e02-9e3d-96467083c2db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:31.634063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff34b24c-cc58-4e02-9e3d-96467083c2db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:31.634498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff34b24c-cc58-4e02-9e3d-96467083c2db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:31.922234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ff34b24c-cc58-4e02-9e3d-96467083c2db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:31.943270 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ff34b24c-cc58-4e02-9e3d-96467083c2db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1698 microversion: 2.1 time: 0.334476 Aug 27 05:35:31.944183 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3298/6597] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:31 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1698 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:35:32.965075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:32.974413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-45681e1a-9032-410a-8458-db9d07d9d43a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:32.975171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-45681e1a-9032-410a-8458-db9d07d9d43a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:32.992710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45681e1a-9032-410a-8458-db9d07d9d43a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:32.993567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45681e1a-9032-410a-8458-db9d07d9d43a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:32.994208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45681e1a-9032-410a-8458-db9d07d9d43a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:32.995481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45681e1a-9032-410a-8458-db9d07d9d43a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:32.996209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45681e1a-9032-410a-8458-db9d07d9d43a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:32.996919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45681e1a-9032-410a-8458-db9d07d9d43a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:33.247401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-45681e1a-9032-410a-8458-db9d07d9d43a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:33.277665 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-45681e1a-9032-410a-8458-db9d07d9d43a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1698 microversion: 2.1 time: 0.313904 Aug 27 05:35:33.320209 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3300/6598] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:32 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1698 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:34.335566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9fc34a6e-ee00-41e1-a136-c0cb63b6dd2c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:34.336380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9fc34a6e-ee00-41e1-a136-c0cb63b6dd2c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:34.345105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc34a6e-ee00-41e1-a136-c0cb63b6dd2c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:34.346048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc34a6e-ee00-41e1-a136-c0cb63b6dd2c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:34.346676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc34a6e-ee00-41e1-a136-c0cb63b6dd2c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:34.347919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc34a6e-ee00-41e1-a136-c0cb63b6dd2c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:34.348826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc34a6e-ee00-41e1-a136-c0cb63b6dd2c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:34.349467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9fc34a6e-ee00-41e1-a136-c0cb63b6dd2c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:34.692206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9fc34a6e-ee00-41e1-a136-c0cb63b6dd2c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:34.720834 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9fc34a6e-ee00-41e1-a136-c0cb63b6dd2c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1698 microversion: 2.1 time: 0.392795 Aug 27 05:35:34.727151 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3299/6599] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:34 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1698 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:35.757856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa591e11-8cb1-4005-9aaf-b39409d567aa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:35.767597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fa591e11-8cb1-4005-9aaf-b39409d567aa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:35.788169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa591e11-8cb1-4005-9aaf-b39409d567aa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:35.788985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa591e11-8cb1-4005-9aaf-b39409d567aa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:35.791681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa591e11-8cb1-4005-9aaf-b39409d567aa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:35.798270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa591e11-8cb1-4005-9aaf-b39409d567aa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:35.802008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa591e11-8cb1-4005-9aaf-b39409d567aa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:35.804909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa591e11-8cb1-4005-9aaf-b39409d567aa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:35.853662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-80387ff1-b400-4417-8073-591f3b2c7d84 req-f98f8173-bd53-442c-a181-ba00aa193cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06b8d48-3bfb-4137-bfd0-1619ccff91c9", "name": "network-vif-unplugged", "status": "completed", "tag": "b26fae87-aabc-4649-a0ea-bffbb357ae83"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:35.899643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-80387ff1-b400-4417-8073-591f3b2c7d84 req-f98f8173-bd53-442c-a181-ba00aa193cfb service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:35.900752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-80387ff1-b400-4417-8073-591f3b2c7d84 req-f98f8173-bd53-442c-a181-ba00aa193cfb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:35.901332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-80387ff1-b400-4417-8073-591f3b2c7d84 req-f98f8173-bd53-442c-a181-ba00aa193cfb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:35.979132 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-80387ff1-b400-4417-8073-591f3b2c7d84 req-f98f8173-bd53-442c-a181-ba00aa193cfb service nova] Creating event network-vif-unplugged:b26fae87-aabc-4649-a0ea-bffbb357ae83 for instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 on n-h2-820368-35 Aug 27 05:35:36.000356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-80387ff1-b400-4417-8073-591f3b2c7d84 req-f98f8173-bd53-442c-a181-ba00aa193cfb service nova] Instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:35:36.054425 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-80387ff1-b400-4417-8073-591f3b2c7d84 req-f98f8173-bd53-442c-a181-ba00aa193cfb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.209234 Aug 27 05:35:36.062037 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3300/6600] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:35:36.177694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fa591e11-8cb1-4005-9aaf-b39409d567aa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:36.190347 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa591e11-8cb1-4005-9aaf-b39409d567aa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1697 microversion: 2.1 time: 0.441090 Aug 27 05:35:36.191799 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3301/6601] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:35 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1697 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:37.221600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e6396714-0021-49a5-adac-36b70fb4b71c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:37.223284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e6396714-0021-49a5-adac-36b70fb4b71c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:37.238071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6396714-0021-49a5-adac-36b70fb4b71c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:37.238947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6396714-0021-49a5-adac-36b70fb4b71c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:37.242680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6396714-0021-49a5-adac-36b70fb4b71c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:37.246916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6396714-0021-49a5-adac-36b70fb4b71c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:37.247733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6396714-0021-49a5-adac-36b70fb4b71c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:37.250319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6396714-0021-49a5-adac-36b70fb4b71c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:37.522102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e6396714-0021-49a5-adac-36b70fb4b71c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:37.540732 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e6396714-0021-49a5-adac-36b70fb4b71c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1697 microversion: 2.1 time: 0.326577 Aug 27 05:35:37.543709 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3301/6602] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:37 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1697 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:38.086288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-28a4ffef-8c82-4e7a-99ce-ffbf7c4687b0 req-8098d10f-53ee-4fd7-83c3-811988fb788c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06b8d48-3bfb-4137-bfd0-1619ccff91c9", "tag": "b26fae87-aabc-4649-a0ea-bffbb357ae83"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:38.139565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-28a4ffef-8c82-4e7a-99ce-ffbf7c4687b0 req-8098d10f-53ee-4fd7-83c3-811988fb788c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:38.141171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-28a4ffef-8c82-4e7a-99ce-ffbf7c4687b0 req-8098d10f-53ee-4fd7-83c3-811988fb788c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:38.144249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-28a4ffef-8c82-4e7a-99ce-ffbf7c4687b0 req-8098d10f-53ee-4fd7-83c3-811988fb788c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:38.185763 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-28a4ffef-8c82-4e7a-99ce-ffbf7c4687b0 req-8098d10f-53ee-4fd7-83c3-811988fb788c service nova] Creating event network-changed:b26fae87-aabc-4649-a0ea-bffbb357ae83 for instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 on n-h2-820368-35 Aug 27 05:35:38.209332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-28a4ffef-8c82-4e7a-99ce-ffbf7c4687b0 req-8098d10f-53ee-4fd7-83c3-811988fb788c service nova] Instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:35:38.251326 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-28a4ffef-8c82-4e7a-99ce-ffbf7c4687b0 req-8098d10f-53ee-4fd7-83c3-811988fb788c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164100 Aug 27 05:35:38.256356 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3302/6603] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:38.577907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ae1ec56-167a-4d65-aed7-378111e7a606 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:38.578642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5ae1ec56-167a-4d65-aed7-378111e7a606 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:38.593907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae1ec56-167a-4d65-aed7-378111e7a606 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:38.602852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae1ec56-167a-4d65-aed7-378111e7a606 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:38.604240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae1ec56-167a-4d65-aed7-378111e7a606 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:38.610501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae1ec56-167a-4d65-aed7-378111e7a606 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:38.611422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae1ec56-167a-4d65-aed7-378111e7a606 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:38.612933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae1ec56-167a-4d65-aed7-378111e7a606 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:39.073114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5ae1ec56-167a-4d65-aed7-378111e7a606 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:39.095523 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5ae1ec56-167a-4d65-aed7-378111e7a606 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1695 microversion: 2.1 time: 0.521450 Aug 27 05:35:39.096146 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3302/6604] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:38 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1695 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:40.120473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0e713ce7-b320-45a5-96fe-55ba5ee67947 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:40.121794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0e713ce7-b320-45a5-96fe-55ba5ee67947 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:40.128775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e713ce7-b320-45a5-96fe-55ba5ee67947 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:40.129560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e713ce7-b320-45a5-96fe-55ba5ee67947 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:40.130196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e713ce7-b320-45a5-96fe-55ba5ee67947 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:40.131103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e713ce7-b320-45a5-96fe-55ba5ee67947 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:40.131742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e713ce7-b320-45a5-96fe-55ba5ee67947 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:40.132183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e713ce7-b320-45a5-96fe-55ba5ee67947 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:40.330262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0e713ce7-b320-45a5-96fe-55ba5ee67947 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:40.352249 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0e713ce7-b320-45a5-96fe-55ba5ee67947 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1695 microversion: 2.1 time: 0.237235 Aug 27 05:35:40.352970 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3303/6605] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:40 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1695 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:41.375165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-168e337e-9bcd-4914-a7c3-099bd5f87fc2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:41.375895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-168e337e-9bcd-4914-a7c3-099bd5f87fc2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:41.391458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-168e337e-9bcd-4914-a7c3-099bd5f87fc2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:41.393025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-168e337e-9bcd-4914-a7c3-099bd5f87fc2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:41.393798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-168e337e-9bcd-4914-a7c3-099bd5f87fc2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:41.398022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-168e337e-9bcd-4914-a7c3-099bd5f87fc2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:41.400016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-168e337e-9bcd-4914-a7c3-099bd5f87fc2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:41.400712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-168e337e-9bcd-4914-a7c3-099bd5f87fc2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:41.693824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-168e337e-9bcd-4914-a7c3-099bd5f87fc2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:41.704249 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-168e337e-9bcd-4914-a7c3-099bd5f87fc2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1692 microversion: 2.1 time: 0.332323 Aug 27 05:35:41.705370 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3303/6606] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:41 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1692 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:41.725488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-35c6bdb9-a862-4f4a-8a1a-2fa50432bfda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:41.727181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-35c6bdb9-a862-4f4a-8a1a-2fa50432bfda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:41.735570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c6bdb9-a862-4f4a-8a1a-2fa50432bfda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:41.737490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c6bdb9-a862-4f4a-8a1a-2fa50432bfda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:41.738087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c6bdb9-a862-4f4a-8a1a-2fa50432bfda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:41.739235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c6bdb9-a862-4f4a-8a1a-2fa50432bfda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:41.739920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c6bdb9-a862-4f4a-8a1a-2fa50432bfda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:41.740603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35c6bdb9-a862-4f4a-8a1a-2fa50432bfda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:41.839992 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-35c6bdb9-a862-4f4a-8a1a-2fa50432bfda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9/action" status: 204 len: 0 microversion: 2.1 time: 0.118396 Aug 27 05:35:41.841020 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3304/6607] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:35:41 2022] POST /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9/action => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:35:41.849980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a8dcaf4e-d264-45b7-97c9-22d2fe1a3b9d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:41.850814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a8dcaf4e-d264-45b7-97c9-22d2fe1a3b9d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:41.858879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8dcaf4e-d264-45b7-97c9-22d2fe1a3b9d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:41.860304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8dcaf4e-d264-45b7-97c9-22d2fe1a3b9d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:41.862994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8dcaf4e-d264-45b7-97c9-22d2fe1a3b9d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:41.864779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8dcaf4e-d264-45b7-97c9-22d2fe1a3b9d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:41.866340 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8dcaf4e-d264-45b7-97c9-22d2fe1a3b9d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:41.867808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8dcaf4e-d264-45b7-97c9-22d2fe1a3b9d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:42.228327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a8dcaf4e-d264-45b7-97c9-22d2fe1a3b9d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:42.237860 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a8dcaf4e-d264-45b7-97c9-22d2fe1a3b9d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1692 microversion: 2.1 time: 0.392297 Aug 27 05:35:42.241337 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3304/6608] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:41 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1692 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:43.270962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d7abb02-cf2b-42bb-a29d-d4a1562d490a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:43.272671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d7abb02-cf2b-42bb-a29d-d4a1562d490a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:43.311238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d7abb02-cf2b-42bb-a29d-d4a1562d490a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:43.324181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d7abb02-cf2b-42bb-a29d-d4a1562d490a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:43.325149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d7abb02-cf2b-42bb-a29d-d4a1562d490a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:43.326588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d7abb02-cf2b-42bb-a29d-d4a1562d490a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:43.327436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d7abb02-cf2b-42bb-a29d-d4a1562d490a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:43.328074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d7abb02-cf2b-42bb-a29d-d4a1562d490a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:43.335552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:43.496780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c522a2cd-bcbb-4ab3-9a20-f15bf1def758 req-3e764045-66b2-451f-b1bb-0ed429504f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06b8d48-3bfb-4137-bfd0-1619ccff91c9", "name": "network-vif-plugged", "status": "completed", "tag": "b26fae87-aabc-4649-a0ea-bffbb357ae83"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:43.536980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c522a2cd-bcbb-4ab3-9a20-f15bf1def758 req-3e764045-66b2-451f-b1bb-0ed429504f2d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:43.537472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c522a2cd-bcbb-4ab3-9a20-f15bf1def758 req-3e764045-66b2-451f-b1bb-0ed429504f2d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:43.540169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c522a2cd-bcbb-4ab3-9a20-f15bf1def758 req-3e764045-66b2-451f-b1bb-0ed429504f2d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:43.568152 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c522a2cd-bcbb-4ab3-9a20-f15bf1def758 req-3e764045-66b2-451f-b1bb-0ed429504f2d service nova] Creating event network-vif-plugged:b26fae87-aabc-4649-a0ea-bffbb357ae83 for instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 on n-h2-820368-35 Aug 27 05:35:43.589662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-c522a2cd-bcbb-4ab3-9a20-f15bf1def758 req-3e764045-66b2-451f-b1bb-0ed429504f2d service nova] Instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:35:43.623046 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c522a2cd-bcbb-4ab3-9a20-f15bf1def758 req-3e764045-66b2-451f-b1bb-0ed429504f2d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133070 Aug 27 05:35:43.624041 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3305/6609] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:35:43.715043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d7abb02-cf2b-42bb-a29d-d4a1562d490a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:43.725038 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d7abb02-cf2b-42bb-a29d-d4a1562d490a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1692 microversion: 2.1 time: 0.460368 Aug 27 05:35:43.726055 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3305/6610] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:43 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1692 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:44.761434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-531095e7-eb23-4cc0-9088-89372c22a8e9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:44.762152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-531095e7-eb23-4cc0-9088-89372c22a8e9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:44.770676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-531095e7-eb23-4cc0-9088-89372c22a8e9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:44.771381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-531095e7-eb23-4cc0-9088-89372c22a8e9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:44.772010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-531095e7-eb23-4cc0-9088-89372c22a8e9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:44.773044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-531095e7-eb23-4cc0-9088-89372c22a8e9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:44.773662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-531095e7-eb23-4cc0-9088-89372c22a8e9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:44.774272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-531095e7-eb23-4cc0-9088-89372c22a8e9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:45.040819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-531095e7-eb23-4cc0-9088-89372c22a8e9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:45.051607 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-531095e7-eb23-4cc0-9088-89372c22a8e9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1684 microversion: 2.1 time: 0.298923 Aug 27 05:35:45.053171 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3306/6611] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:44 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1684 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:47.224077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-242f4a7f-2824-4ee1-97ca-bbbbc073e23d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:47.226366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-242f4a7f-2824-4ee1-97ca-bbbbc073e23d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:47.233930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-242f4a7f-2824-4ee1-97ca-bbbbc073e23d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:47.234701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-242f4a7f-2824-4ee1-97ca-bbbbc073e23d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:47.235345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-242f4a7f-2824-4ee1-97ca-bbbbc073e23d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:47.236216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-242f4a7f-2824-4ee1-97ca-bbbbc073e23d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:47.237405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-242f4a7f-2824-4ee1-97ca-bbbbc073e23d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:47.238774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-242f4a7f-2824-4ee1-97ca-bbbbc073e23d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:47.291621 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-242f4a7f-2824-4ee1-97ca-bbbbc073e23d tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.079153 Aug 27 05:35:47.298512 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3306/6612] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:35:47 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:47.435918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b9a8c5f-f67d-4467-930f-dfbef236d59c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:47.436961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2b9a8c5f-f67d-4467-930f-dfbef236d59c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:47.444972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b9a8c5f-f67d-4467-930f-dfbef236d59c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:47.445772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b9a8c5f-f67d-4467-930f-dfbef236d59c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:47.446372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b9a8c5f-f67d-4467-930f-dfbef236d59c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:47.447301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b9a8c5f-f67d-4467-930f-dfbef236d59c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:47.447929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b9a8c5f-f67d-4467-930f-dfbef236d59c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:47.448525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b9a8c5f-f67d-4467-930f-dfbef236d59c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:47.483490 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2b9a8c5f-f67d-4467-930f-dfbef236d59c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments/1f17aaf1-a365-4eea-a040-8380be89bb41" status: 200 len: 194 microversion: 2.1 time: 0.051725 Aug 27 05:35:47.484376 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3307/6613] 10.222.0.58 () {58 vars in 1413 bytes} [Sat Aug 27 05:35:47 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments/1f17aaf1-a365-4eea-a040-8380be89bb41 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:47.495640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-855a7aa5-4994-49a6-8504-e612090a52c6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:47.496399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-855a7aa5-4994-49a6-8504-e612090a52c6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:47.503121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-855a7aa5-4994-49a6-8504-e612090a52c6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:47.503858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-855a7aa5-4994-49a6-8504-e612090a52c6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:47.504500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-855a7aa5-4994-49a6-8504-e612090a52c6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:47.505384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-855a7aa5-4994-49a6-8504-e612090a52c6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:47.506017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-855a7aa5-4994-49a6-8504-e612090a52c6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:47.506619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-855a7aa5-4994-49a6-8504-e612090a52c6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:47.607534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-855a7aa5-4994-49a6-8504-e612090a52c6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lazy-loading 'services' on Instance uuid c22df37d-a283-4e94-a99a-9ef29435d5ae {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:35:47.708160 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-855a7aa5-4994-49a6-8504-e612090a52c6 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments/1f17aaf1-a365-4eea-a040-8380be89bb41" status: 202 len: 0 microversion: 2.1 time: 0.216495 Aug 27 05:35:47.725615 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3307/6614] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:35:47 2022] DELETE /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments/1f17aaf1-a365-4eea-a040-8380be89bb41 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:35:50.496536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1452045593", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1417438862", "security_groups": [{"name": "tempest-secgroup-smoke-747049925"}], "block_device_mapping_v2": [{"uuid": "651a1f36-4975-4fe1-beaf-5d5b155e1787", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "58a22fcb-5b07-4d83-8df1-2b6fed6fe046"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:50.696274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] validate_networks() for [('58a22fcb-5b07-4d83-8df1-2b6fed6fe046', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:35:50.954223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=36 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:51.308556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:35:51.311876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:35:51.312740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:35:51.317600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:35:51.318033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:35:51.349753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:51.354490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:51.355566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:51.356552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:51.357399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:51.359450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:51.391541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:35:51.400463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for user 007b4762bf8c436fb783d84380c01932 and project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:35:51.515039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:35:51.519247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='651a1f36-4975-4fe1-beaf-5d5b155e1787',volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:35:51.749414 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0adbb790-60a8-4898-8f38-03b075e09c63 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.260298 Aug 27 05:35:51.750138 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3308/6615] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:35:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:35:51.769535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6ecc922b-4af3-40cd-820a-bcc5a076eae3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:51.773931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6ecc922b-4af3-40cd-820a-bcc5a076eae3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:51.780896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:51.876910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6ecc922b-4af3-40cd-820a-bcc5a076eae3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:51.885482 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6ecc922b-4af3-40cd-820a-bcc5a076eae3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1095 microversion: 2.1 time: 0.125742 Aug 27 05:35:51.886385 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3308/6616] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:51 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1095 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:52.908537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-434e8ff5-6e33-4b89-afe8-d6dd289f81fe tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:52.909686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-434e8ff5-6e33-4b89-afe8-d6dd289f81fe tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:52.917806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-434e8ff5-6e33-4b89-afe8-d6dd289f81fe tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:52.918316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-434e8ff5-6e33-4b89-afe8-d6dd289f81fe tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:52.918765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-434e8ff5-6e33-4b89-afe8-d6dd289f81fe tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:52.919584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-434e8ff5-6e33-4b89-afe8-d6dd289f81fe tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:52.920084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-434e8ff5-6e33-4b89-afe8-d6dd289f81fe tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:52.920534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-434e8ff5-6e33-4b89-afe8-d6dd289f81fe tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:52.991029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-434e8ff5-6e33-4b89-afe8-d6dd289f81fe tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:53.011055 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-434e8ff5-6e33-4b89-afe8-d6dd289f81fe tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1193 microversion: 2.1 time: 0.105580 Aug 27 05:35:53.015732 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3309/6617] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:52 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1193 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:54.035195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0aabcec6-1cb7-4c29-ba47-9a952d940bce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:54.036325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0aabcec6-1cb7-4c29-ba47-9a952d940bce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:54.081344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aabcec6-1cb7-4c29-ba47-9a952d940bce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:54.082164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aabcec6-1cb7-4c29-ba47-9a952d940bce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:54.082784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aabcec6-1cb7-4c29-ba47-9a952d940bce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:54.083730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aabcec6-1cb7-4c29-ba47-9a952d940bce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:54.084381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aabcec6-1cb7-4c29-ba47-9a952d940bce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:54.084990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0aabcec6-1cb7-4c29-ba47-9a952d940bce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:54.386174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-91257745-7680-46d7-b43f-f6c4fdeebd88 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:54.386908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-91257745-7680-46d7-b43f-f6c4fdeebd88 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:54.404687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91257745-7680-46d7-b43f-f6c4fdeebd88 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:54.405251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91257745-7680-46d7-b43f-f6c4fdeebd88 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:54.407433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91257745-7680-46d7-b43f-f6c4fdeebd88 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:54.408201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91257745-7680-46d7-b43f-f6c4fdeebd88 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:54.408673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91257745-7680-46d7-b43f-f6c4fdeebd88 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:54.409144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91257745-7680-46d7-b43f-f6c4fdeebd88 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:54.504709 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-91257745-7680-46d7-b43f-f6c4fdeebd88 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments/7b6f8def-7890-43a5-b50d-97ef7b90d511" status: 200 len: 194 microversion: 2.1 time: 0.123843 Aug 27 05:35:54.511157 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3310/6618] 10.222.0.58 () {58 vars in 1413 bytes} [Sat Aug 27 05:35:54 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments/7b6f8def-7890-43a5-b50d-97ef7b90d511 => generated 194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:54.516732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-312a7c97-bc10-48fe-a0cd-db65aff1a01c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:54.517231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-312a7c97-bc10-48fe-a0cd-db65aff1a01c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:54.525148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-312a7c97-bc10-48fe-a0cd-db65aff1a01c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:54.525922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-312a7c97-bc10-48fe-a0cd-db65aff1a01c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:54.526535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-312a7c97-bc10-48fe-a0cd-db65aff1a01c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:54.527495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-312a7c97-bc10-48fe-a0cd-db65aff1a01c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:54.528116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-312a7c97-bc10-48fe-a0cd-db65aff1a01c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:54.528772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-312a7c97-bc10-48fe-a0cd-db65aff1a01c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:54.663999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0aabcec6-1cb7-4c29-ba47-9a952d940bce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:54.683968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-312a7c97-bc10-48fe-a0cd-db65aff1a01c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lazy-loading 'services' on Instance uuid c22df37d-a283-4e94-a99a-9ef29435d5ae {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:35:54.688194 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0aabcec6-1cb7-4c29-ba47-9a952d940bce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1211 microversion: 2.1 time: 0.658807 Aug 27 05:35:54.692731 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3309/6619] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:54 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1211 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:54.817228 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-312a7c97-bc10-48fe-a0cd-db65aff1a01c tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments/7b6f8def-7890-43a5-b50d-97ef7b90d511" status: 202 len: 0 microversion: 2.1 time: 0.304217 Aug 27 05:35:54.821323 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3311/6620] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:35:54 2022] DELETE /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments/7b6f8def-7890-43a5-b50d-97ef7b90d511 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:35:55.730621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c88b8e78-0f48-4544-87b2-57742aa10bf1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:55.732083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c88b8e78-0f48-4544-87b2-57742aa10bf1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:55.754795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c88b8e78-0f48-4544-87b2-57742aa10bf1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:55.755785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c88b8e78-0f48-4544-87b2-57742aa10bf1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:55.756414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c88b8e78-0f48-4544-87b2-57742aa10bf1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:55.757357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c88b8e78-0f48-4544-87b2-57742aa10bf1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:55.758029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c88b8e78-0f48-4544-87b2-57742aa10bf1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:55.760327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c88b8e78-0f48-4544-87b2-57742aa10bf1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:56.079518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c88b8e78-0f48-4544-87b2-57742aa10bf1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:56.102825 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c88b8e78-0f48-4544-87b2-57742aa10bf1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1278 microversion: 2.1 time: 0.375498 Aug 27 05:35:56.104282 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3310/6621] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:55 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1278 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:35:56.443260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-dd7242d3-3e2d-4090-9530-fcd0e7d27cf0 req-eb32eb0f-f286-4301-86c4-b117cdadc090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983b3540-9f17-4b6d-9d21-9f36f77f6bf5", "tag": "ef3a0152-817b-41bc-aa52-5eefa2ac790a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:56.458772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dd7242d3-3e2d-4090-9530-fcd0e7d27cf0 req-eb32eb0f-f286-4301-86c4-b117cdadc090 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:56.459562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dd7242d3-3e2d-4090-9530-fcd0e7d27cf0 req-eb32eb0f-f286-4301-86c4-b117cdadc090 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:56.460204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dd7242d3-3e2d-4090-9530-fcd0e7d27cf0 req-eb32eb0f-f286-4301-86c4-b117cdadc090 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:56.479811 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-dd7242d3-3e2d-4090-9530-fcd0e7d27cf0 req-eb32eb0f-f286-4301-86c4-b117cdadc090 service nova] Creating event network-changed:ef3a0152-817b-41bc-aa52-5eefa2ac790a for instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 on n-h1-820368-35 Aug 27 05:35:56.495342 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-dd7242d3-3e2d-4090-9530-fcd0e7d27cf0 req-eb32eb0f-f286-4301-86c4-b117cdadc090 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283616 Aug 27 05:35:56.495342 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3312/6622] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:57.127067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dafc431b-38b0-4b0d-9615-34a33bd2e31d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:57.128714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dafc431b-38b0-4b0d-9615-34a33bd2e31d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:57.139234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dafc431b-38b0-4b0d-9615-34a33bd2e31d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:57.140143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dafc431b-38b0-4b0d-9615-34a33bd2e31d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:57.141436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dafc431b-38b0-4b0d-9615-34a33bd2e31d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:57.142432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dafc431b-38b0-4b0d-9615-34a33bd2e31d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:57.143425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dafc431b-38b0-4b0d-9615-34a33bd2e31d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:57.144102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dafc431b-38b0-4b0d-9615-34a33bd2e31d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:57.370995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dafc431b-38b0-4b0d-9615-34a33bd2e31d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:57.381086 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dafc431b-38b0-4b0d-9615-34a33bd2e31d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1278 microversion: 2.1 time: 0.260068 Aug 27 05:35:57.381906 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3311/6623] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:57 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:58.405469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ffae9e5e-ca40-4aa3-b914-f448bb426ecb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:58.406753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ffae9e5e-ca40-4aa3-b914-f448bb426ecb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:58.413037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffae9e5e-ca40-4aa3-b914-f448bb426ecb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:58.413519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffae9e5e-ca40-4aa3-b914-f448bb426ecb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:58.414044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffae9e5e-ca40-4aa3-b914-f448bb426ecb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:58.414925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffae9e5e-ca40-4aa3-b914-f448bb426ecb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:58.415504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffae9e5e-ca40-4aa3-b914-f448bb426ecb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:58.415941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffae9e5e-ca40-4aa3-b914-f448bb426ecb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:58.418619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:58.593889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ffae9e5e-ca40-4aa3-b914-f448bb426ecb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:58.602464 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ffae9e5e-ca40-4aa3-b914-f448bb426ecb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1278 microversion: 2.1 time: 0.202857 Aug 27 05:35:58.603164 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3313/6624] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:58 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:59.624821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e6b769f6-34aa-4284-8426-d39d1550d21a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:59.625484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e6b769f6-34aa-4284-8426-d39d1550d21a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:59.632993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6b769f6-34aa-4284-8426-d39d1550d21a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:59.633546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6b769f6-34aa-4284-8426-d39d1550d21a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:59.634269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6b769f6-34aa-4284-8426-d39d1550d21a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:59.635055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6b769f6-34aa-4284-8426-d39d1550d21a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:59.635606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6b769f6-34aa-4284-8426-d39d1550d21a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:59.636244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6b769f6-34aa-4284-8426-d39d1550d21a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:59.798927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e6b769f6-34aa-4284-8426-d39d1550d21a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:59.808136 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e6b769f6-34aa-4284-8426-d39d1550d21a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1278 microversion: 2.1 time: 0.187312 Aug 27 05:35:59.811591 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3312/6625] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:59 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:00.829996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b37bce77-05c8-4fc8-916d-6049bc836b45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:00.830614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b37bce77-05c8-4fc8-916d-6049bc836b45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:00.839507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37bce77-05c8-4fc8-916d-6049bc836b45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:00.841711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37bce77-05c8-4fc8-916d-6049bc836b45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:00.841711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37bce77-05c8-4fc8-916d-6049bc836b45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:00.841711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37bce77-05c8-4fc8-916d-6049bc836b45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:00.842044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37bce77-05c8-4fc8-916d-6049bc836b45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:00.842644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b37bce77-05c8-4fc8-916d-6049bc836b45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:01.002906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b37bce77-05c8-4fc8-916d-6049bc836b45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:01.016748 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b37bce77-05c8-4fc8-916d-6049bc836b45 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1278 microversion: 2.1 time: 0.190531 Aug 27 05:36:01.016748 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3314/6626] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:00 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:02.037606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f2b309d9-1164-4c74-ba30-1ce6a0a891f9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:02.038530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f2b309d9-1164-4c74-ba30-1ce6a0a891f9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:02.041620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:02.047761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b309d9-1164-4c74-ba30-1ce6a0a891f9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.049002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b309d9-1164-4c74-ba30-1ce6a0a891f9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.049133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b309d9-1164-4c74-ba30-1ce6a0a891f9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:02.050551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b309d9-1164-4c74-ba30-1ce6a0a891f9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.051308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b309d9-1164-4c74-ba30-1ce6a0a891f9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.051862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f2b309d9-1164-4c74-ba30-1ce6a0a891f9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:02.225175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f2b309d9-1164-4c74-ba30-1ce6a0a891f9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:02.233652 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f2b309d9-1164-4c74-ba30-1ce6a0a891f9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1278 microversion: 2.1 time: 0.200174 Aug 27 05:36:02.234253 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3313/6627] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:02 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:02.591688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc50f74d-0298-4fc5-a66c-45e09565754f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:02.594062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cc50f74d-0298-4fc5-a66c-45e09565754f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:02.596110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:02.598939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:02.610850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc50f74d-0298-4fc5-a66c-45e09565754f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.617484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc50f74d-0298-4fc5-a66c-45e09565754f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.618031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc50f74d-0298-4fc5-a66c-45e09565754f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:02.618857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc50f74d-0298-4fc5-a66c-45e09565754f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.619562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc50f74d-0298-4fc5-a66c-45e09565754f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.620220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc50f74d-0298-4fc5-a66c-45e09565754f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:02.671872 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cc50f74d-0298-4fc5-a66c-45e09565754f tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084665 Aug 27 05:36:02.672464 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3315/6628] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:36:02 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:36:02.830636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2aaff0e3-9d00-49ba-bdd2-238f34d1f423 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:02.834478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2aaff0e3-9d00-49ba-bdd2-238f34d1f423 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:02.841556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aaff0e3-9d00-49ba-bdd2-238f34d1f423 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.842322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aaff0e3-9d00-49ba-bdd2-238f34d1f423 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.842943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aaff0e3-9d00-49ba-bdd2-238f34d1f423 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:02.844622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aaff0e3-9d00-49ba-bdd2-238f34d1f423 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.845269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aaff0e3-9d00-49ba-bdd2-238f34d1f423 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.845872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2aaff0e3-9d00-49ba-bdd2-238f34d1f423 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:02.891139 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2aaff0e3-9d00-49ba-bdd2-238f34d1f423 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064311 Aug 27 05:36:02.903492 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3314/6629] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:36:02 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:36:02.980757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-50f968a2-cf1a-4a9b-9fd9-2eaefb04dc31 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:02.981522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-50f968a2-cf1a-4a9b-9fd9-2eaefb04dc31 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:02.989290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50f968a2-cf1a-4a9b-9fd9-2eaefb04dc31 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.990053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50f968a2-cf1a-4a9b-9fd9-2eaefb04dc31 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.990917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50f968a2-cf1a-4a9b-9fd9-2eaefb04dc31 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:02.992058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50f968a2-cf1a-4a9b-9fd9-2eaefb04dc31 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.992691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50f968a2-cf1a-4a9b-9fd9-2eaefb04dc31 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.993397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50f968a2-cf1a-4a9b-9fd9-2eaefb04dc31 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:03.028330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-50f968a2-cf1a-4a9b-9fd9-2eaefb04dc31 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:36:03.140779 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-50f968a2-cf1a-4a9b-9fd9-2eaefb04dc31 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 204 len: 0 microversion: 2.1 time: 0.164813 Aug 27 05:36:03.141612 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3316/6630] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:36:02 2022] DELETE /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:36:03.151347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-63aebdbd-0a79-4699-9165-ac6a1e290eeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:03.152038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-63aebdbd-0a79-4699-9165-ac6a1e290eeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:03.160225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63aebdbd-0a79-4699-9165-ac6a1e290eeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:03.161182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63aebdbd-0a79-4699-9165-ac6a1e290eeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:03.162045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63aebdbd-0a79-4699-9165-ac6a1e290eeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:03.163248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63aebdbd-0a79-4699-9165-ac6a1e290eeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:03.164934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63aebdbd-0a79-4699-9165-ac6a1e290eeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:03.165386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-63aebdbd-0a79-4699-9165-ac6a1e290eeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:03.258330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-14d75472-5918-4931-b7a9-22ab73af53d3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:03.259276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-14d75472-5918-4931-b7a9-22ab73af53d3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:03.274013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d75472-5918-4931-b7a9-22ab73af53d3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:03.274523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d75472-5918-4931-b7a9-22ab73af53d3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:03.274972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d75472-5918-4931-b7a9-22ab73af53d3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:03.275747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d75472-5918-4931-b7a9-22ab73af53d3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:03.276224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d75472-5918-4931-b7a9-22ab73af53d3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:03.276670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14d75472-5918-4931-b7a9-22ab73af53d3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:03.473551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-63aebdbd-0a79-4699-9165-ac6a1e290eeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:03.493982 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-63aebdbd-0a79-4699-9165-ac6a1e290eeb tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1671 microversion: 2.1 time: 0.346042 Aug 27 05:36:03.504027 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3315/6631] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:03 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1671 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:03.551737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-14d75472-5918-4931-b7a9-22ab73af53d3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:03.565559 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-14d75472-5918-4931-b7a9-22ab73af53d3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1278 microversion: 2.1 time: 0.312484 Aug 27 05:36:03.595171 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3317/6632] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:03 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1278 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:04.532200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5856cbba-8af2-48d4-9a0d-231332203045 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:04.532836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5856cbba-8af2-48d4-9a0d-231332203045 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:04.546433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5856cbba-8af2-48d4-9a0d-231332203045 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.547259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5856cbba-8af2-48d4-9a0d-231332203045 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.547735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5856cbba-8af2-48d4-9a0d-231332203045 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.548649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5856cbba-8af2-48d4-9a0d-231332203045 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.549124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5856cbba-8af2-48d4-9a0d-231332203045 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.549728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5856cbba-8af2-48d4-9a0d-231332203045 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.603001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4d4a3420-eae3-4ed1-a14e-74d1b86fbd61 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:04.603718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4d4a3420-eae3-4ed1-a14e-74d1b86fbd61 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:04.612592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d4a3420-eae3-4ed1-a14e-74d1b86fbd61 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.613257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d4a3420-eae3-4ed1-a14e-74d1b86fbd61 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.613850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d4a3420-eae3-4ed1-a14e-74d1b86fbd61 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.615724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d4a3420-eae3-4ed1-a14e-74d1b86fbd61 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.616434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d4a3420-eae3-4ed1-a14e-74d1b86fbd61 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.617261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4d4a3420-eae3-4ed1-a14e-74d1b86fbd61 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.854474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5856cbba-8af2-48d4-9a0d-231332203045 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:04.865492 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5856cbba-8af2-48d4-9a0d-231332203045 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1671 microversion: 2.1 time: 0.336936 Aug 27 05:36:04.878942 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3316/6633] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:04 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1671 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:04.879302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4d4a3420-eae3-4ed1-a14e-74d1b86fbd61 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:04.883445 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4d4a3420-eae3-4ed1-a14e-74d1b86fbd61 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1278 microversion: 2.1 time: 0.285188 Aug 27 05:36:04.891749 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3318/6634] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:04 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1278 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:05.887435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f66dd2a7-5cc0-4f3a-888e-852ef12c5b8b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:05.888067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f66dd2a7-5cc0-4f3a-888e-852ef12c5b8b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:05.900997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f66dd2a7-5cc0-4f3a-888e-852ef12c5b8b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:05.901898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f66dd2a7-5cc0-4f3a-888e-852ef12c5b8b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:05.902373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f66dd2a7-5cc0-4f3a-888e-852ef12c5b8b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:05.903150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f66dd2a7-5cc0-4f3a-888e-852ef12c5b8b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:05.903634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f66dd2a7-5cc0-4f3a-888e-852ef12c5b8b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:05.904077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f66dd2a7-5cc0-4f3a-888e-852ef12c5b8b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:05.908024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2027e3be-ebad-4f43-9e4a-698ac06a7720 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:05.909539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2027e3be-ebad-4f43-9e4a-698ac06a7720 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:05.920710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2027e3be-ebad-4f43-9e4a-698ac06a7720 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:05.921628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2027e3be-ebad-4f43-9e4a-698ac06a7720 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:05.922433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2027e3be-ebad-4f43-9e4a-698ac06a7720 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:05.923406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2027e3be-ebad-4f43-9e4a-698ac06a7720 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:05.924110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2027e3be-ebad-4f43-9e4a-698ac06a7720 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:05.925370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2027e3be-ebad-4f43-9e4a-698ac06a7720 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:06.067691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f66dd2a7-5cc0-4f3a-888e-852ef12c5b8b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:06.079970 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f66dd2a7-5cc0-4f3a-888e-852ef12c5b8b tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1604 microversion: 2.1 time: 0.197330 Aug 27 05:36:06.081158 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3317/6635] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:05 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1604 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:06.173382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2027e3be-ebad-4f43-9e4a-698ac06a7720 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:06.190160 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2027e3be-ebad-4f43-9e4a-698ac06a7720 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1266 microversion: 2.1 time: 0.285256 Aug 27 05:36:06.192496 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3319/6636] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:05 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:06.669786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-360bbb6b-7820-472f-abe0-17f6b2e5f19e req-3ed40c8d-0882-4edf-90e7-987a07e41f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22df37d-a283-4e94-a99a-9ef29435d5ae", "name": "network-vif-deleted", "tag": "7d558974-411e-49d9-9e68-1c404cca78a2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:06.704910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-360bbb6b-7820-472f-abe0-17f6b2e5f19e req-3ed40c8d-0882-4edf-90e7-987a07e41f8f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:06.705355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-360bbb6b-7820-472f-abe0-17f6b2e5f19e req-3ed40c8d-0882-4edf-90e7-987a07e41f8f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:06.705811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-360bbb6b-7820-472f-abe0-17f6b2e5f19e req-3ed40c8d-0882-4edf-90e7-987a07e41f8f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:06.726095 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-360bbb6b-7820-472f-abe0-17f6b2e5f19e req-3ed40c8d-0882-4edf-90e7-987a07e41f8f service nova] Creating event network-vif-deleted:7d558974-411e-49d9-9e68-1c404cca78a2 for instance c22df37d-a283-4e94-a99a-9ef29435d5ae on n-h2-820368-35 Aug 27 05:36:06.731710 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-360bbb6b-7820-472f-abe0-17f6b2e5f19e req-3ed40c8d-0882-4edf-90e7-987a07e41f8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066009 Aug 27 05:36:06.732979 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3318/6637] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:36:07.103611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:07.104885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:07.116675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:07.120157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:07.125089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:07.126406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:07.128726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:07.130885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:07.196629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:07.197486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:07.198187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:07.199442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lazy-loading 'fault' on Instance uuid c22df37d-a283-4e94-a99a-9ef29435d5ae {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:36:07.213110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-142b0b07-be08-43c2-83ef-fb9d5766e721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:07.214380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-142b0b07-be08-43c2-83ef-fb9d5766e721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:07.227236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-142b0b07-be08-43c2-83ef-fb9d5766e721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:07.229993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-142b0b07-be08-43c2-83ef-fb9d5766e721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:07.233620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-142b0b07-be08-43c2-83ef-fb9d5766e721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:07.234839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-142b0b07-be08-43c2-83ef-fb9d5766e721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:07.238054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-142b0b07-be08-43c2-83ef-fb9d5766e721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:07.256707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-142b0b07-be08-43c2-83ef-fb9d5766e721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:07.276674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3cce7ee28e4f2da7f840c917b893df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeac3d8b40a422b97699e81f5ce198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:07.296341 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-18325c3e-a102-40da-afba-cdcdddfc5717 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 200 len: 1327 microversion: 2.1 time: 0.197317 Aug 27 05:36:07.304078 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3320/6638] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:07 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 1327 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:07.591516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-142b0b07-be08-43c2-83ef-fb9d5766e721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:07.629438 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-142b0b07-be08-43c2-83ef-fb9d5766e721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1266 microversion: 2.1 time: 0.420301 Aug 27 05:36:07.631517 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3319/6639] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:07 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1266 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:08.328374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:08.328998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:08.337474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:08.338360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:08.338966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:08.340068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:08.340913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:08.341607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:08.359474 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] HTTP exception thrown: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Request method failure captured: Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae HTTP/1.1 Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauPZ_8MmWes7gl6tV_JRf9QA_aspbvSANYihradzXzjtw0hbkTfuWAjZsRSRcaon5Hq9AyDBopuISwteUa5JA2u1YCrg6N4UhDWXjSSqemlFni_CkbNutlZkTZXRGUxc3-mhEYXqq4e-ANoMhAqEmJqeQLKLBeLDGTv3BMP7Y5xGCA Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cbeac3d8b40a422b97699e81f5ce198f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 4b3cce7ee28e4f2da7f840c917b893df Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'c22df37d-a283-4e94-a99a-9ef29435d5ae'} Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:08.361571 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:08.367391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:08.367391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:08.367391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:08.367391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:08.367391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:08.367391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:08.367391 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:08.367391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Returning 404 to user: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:08.367391 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-61d94517-0052-4943-b93e-c825f98b6980 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 404 len: 111 microversion: 2.1 time: 0.039305 Aug 27 05:36:08.368158 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3321/6640] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:08 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:36:08.373440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-857654fd-73b8-47e5-a741-8525316ad8e1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '.version_select at 0x7fb55ff34160>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:08.407355 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-857654fd-73b8-47e5-a741-8525316ad8e1 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-531044678" status: 202 len: 0 microversion: 2.1 time: 0.037796 Aug 27 05:36:08.407955 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3320/6641] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 05:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-531044678 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:36:08.653244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-92d43a07-c064-4393-be5c-dc8570f8b845 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:08.653930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-92d43a07-c064-4393-be5c-dc8570f8b845 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:08.677785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d43a07-c064-4393-be5c-dc8570f8b845 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:08.678293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d43a07-c064-4393-be5c-dc8570f8b845 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:08.678768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d43a07-c064-4393-be5c-dc8570f8b845 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:08.679517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d43a07-c064-4393-be5c-dc8570f8b845 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:08.679976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d43a07-c064-4393-be5c-dc8570f8b845 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:08.680406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-92d43a07-c064-4393-be5c-dc8570f8b845 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:08.902394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-92d43a07-c064-4393-be5c-dc8570f8b845 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:08.913219 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-92d43a07-c064-4393-be5c-dc8570f8b845 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1266 microversion: 2.1 time: 0.264243 Aug 27 05:36:08.914361 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3322/6642] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:08 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:09.933855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-34dd5760-e56a-46cd-a37c-34a1e3480852 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:09.934936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-34dd5760-e56a-46cd-a37c-34a1e3480852 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:09.943008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34dd5760-e56a-46cd-a37c-34a1e3480852 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:09.943830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34dd5760-e56a-46cd-a37c-34a1e3480852 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:09.944447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34dd5760-e56a-46cd-a37c-34a1e3480852 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:09.945205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34dd5760-e56a-46cd-a37c-34a1e3480852 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:09.945675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34dd5760-e56a-46cd-a37c-34a1e3480852 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:09.946110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-34dd5760-e56a-46cd-a37c-34a1e3480852 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:10.101604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-34dd5760-e56a-46cd-a37c-34a1e3480852 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:10.111709 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-34dd5760-e56a-46cd-a37c-34a1e3480852 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1266 microversion: 2.1 time: 0.181222 Aug 27 05:36:10.112280 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3321/6643] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:09 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:11.138321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c98b6733-a2a7-4f35-b687-ced13895f0f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:11.139753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c98b6733-a2a7-4f35-b687-ced13895f0f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:11.148990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c98b6733-a2a7-4f35-b687-ced13895f0f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:11.149880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c98b6733-a2a7-4f35-b687-ced13895f0f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:11.150576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c98b6733-a2a7-4f35-b687-ced13895f0f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:11.151580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c98b6733-a2a7-4f35-b687-ced13895f0f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:11.152270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c98b6733-a2a7-4f35-b687-ced13895f0f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:11.152931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c98b6733-a2a7-4f35-b687-ced13895f0f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:11.325154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c98b6733-a2a7-4f35-b687-ced13895f0f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:11.338218 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c98b6733-a2a7-4f35-b687-ced13895f0f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1266 microversion: 2.1 time: 0.204811 Aug 27 05:36:11.339280 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3323/6644] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:11 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:12.359650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8ddc184d-8c64-4a46-8bb8-0254e9288ca3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:12.360209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8ddc184d-8c64-4a46-8bb8-0254e9288ca3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:12.369321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ddc184d-8c64-4a46-8bb8-0254e9288ca3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:12.369923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ddc184d-8c64-4a46-8bb8-0254e9288ca3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:12.370448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ddc184d-8c64-4a46-8bb8-0254e9288ca3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:12.371298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ddc184d-8c64-4a46-8bb8-0254e9288ca3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:12.371844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ddc184d-8c64-4a46-8bb8-0254e9288ca3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:12.372360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8ddc184d-8c64-4a46-8bb8-0254e9288ca3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:12.542449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8ddc184d-8c64-4a46-8bb8-0254e9288ca3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:12.551626 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8ddc184d-8c64-4a46-8bb8-0254e9288ca3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1266 microversion: 2.1 time: 0.196332 Aug 27 05:36:12.552214 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3322/6645] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:12 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:13.574695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-74ba0839-7921-4291-8013-7ef7323c33f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:13.575345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-74ba0839-7921-4291-8013-7ef7323c33f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:13.584767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74ba0839-7921-4291-8013-7ef7323c33f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:13.585489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74ba0839-7921-4291-8013-7ef7323c33f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:13.585959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74ba0839-7921-4291-8013-7ef7323c33f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:13.586834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74ba0839-7921-4291-8013-7ef7323c33f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:13.591521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74ba0839-7921-4291-8013-7ef7323c33f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:13.592575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-74ba0839-7921-4291-8013-7ef7323c33f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:13.778112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-74ba0839-7921-4291-8013-7ef7323c33f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:13.813078 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-74ba0839-7921-4291-8013-7ef7323c33f4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1266 microversion: 2.1 time: 0.243059 Aug 27 05:36:13.813875 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3324/6646] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:13 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:14.834297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-574d2bb0-8037-4c35-a6a9-298b3709e99f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:14.838880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-574d2bb0-8037-4c35-a6a9-298b3709e99f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:14.847668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574d2bb0-8037-4c35-a6a9-298b3709e99f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:14.849490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574d2bb0-8037-4c35-a6a9-298b3709e99f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:14.850126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574d2bb0-8037-4c35-a6a9-298b3709e99f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:14.851045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574d2bb0-8037-4c35-a6a9-298b3709e99f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:14.851695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574d2bb0-8037-4c35-a6a9-298b3709e99f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:14.852565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-574d2bb0-8037-4c35-a6a9-298b3709e99f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:14.858555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:15.083589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-574d2bb0-8037-4c35-a6a9-298b3709e99f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:15.092814 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-574d2bb0-8037-4c35-a6a9-298b3709e99f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1266 microversion: 2.1 time: 0.262364 Aug 27 05:36:15.107951 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3323/6647] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:14 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:15.316877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1e6318fa-2aaa-4fea-b961-a175b49da756 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:15.319485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1e6318fa-2aaa-4fea-b961-a175b49da756 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:15.332987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e6318fa-2aaa-4fea-b961-a175b49da756 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:15.333496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e6318fa-2aaa-4fea-b961-a175b49da756 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:15.334151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e6318fa-2aaa-4fea-b961-a175b49da756 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:15.335082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e6318fa-2aaa-4fea-b961-a175b49da756 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:15.335568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e6318fa-2aaa-4fea-b961-a175b49da756 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:15.335994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e6318fa-2aaa-4fea-b961-a175b49da756 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:15.403878 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1e6318fa-2aaa-4fea-b961-a175b49da756 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9/action" status: 200 len: 24569 microversion: 2.1 time: 0.091999 Aug 27 05:36:15.404949 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3325/6648] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:36:15 2022] POST /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9/action => generated 24569 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:36:16.115155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b8dfa7e-0519-4855-a595-a0bdf939a488 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:16.115812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b8dfa7e-0519-4855-a595-a0bdf939a488 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:16.135563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b8dfa7e-0519-4855-a595-a0bdf939a488 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:16.136188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b8dfa7e-0519-4855-a595-a0bdf939a488 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:16.136656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b8dfa7e-0519-4855-a595-a0bdf939a488 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:16.137403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b8dfa7e-0519-4855-a595-a0bdf939a488 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:16.137877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b8dfa7e-0519-4855-a595-a0bdf939a488 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:16.138317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b8dfa7e-0519-4855-a595-a0bdf939a488 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:16.323758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b8dfa7e-0519-4855-a595-a0bdf939a488 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:16.340621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-de5700a1-ebb0-41a1-a978-6c1ed02f8e5e req-7850cca0-6186-471e-8c39-6e0765383966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983b3540-9f17-4b6d-9d21-9f36f77f6bf5", "name": "network-vif-plugged", "status": "completed", "tag": "ef3a0152-817b-41bc-aa52-5eefa2ac790a"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:16.350981 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b8dfa7e-0519-4855-a595-a0bdf939a488 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1266 microversion: 2.1 time: 0.239628 Aug 27 05:36:16.353554 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3324/6649] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:16 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:16.363393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-de5700a1-ebb0-41a1-a978-6c1ed02f8e5e req-7850cca0-6186-471e-8c39-6e0765383966 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:16.364198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-de5700a1-ebb0-41a1-a978-6c1ed02f8e5e req-7850cca0-6186-471e-8c39-6e0765383966 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:16.364988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-de5700a1-ebb0-41a1-a978-6c1ed02f8e5e req-7850cca0-6186-471e-8c39-6e0765383966 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:16.397308 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-de5700a1-ebb0-41a1-a978-6c1ed02f8e5e req-7850cca0-6186-471e-8c39-6e0765383966 service nova] Creating event network-vif-plugged:ef3a0152-817b-41bc-aa52-5eefa2ac790a for instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 on n-h1-820368-35 Aug 27 05:36:16.408613 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-de5700a1-ebb0-41a1-a978-6c1ed02f8e5e req-7850cca0-6186-471e-8c39-6e0765383966 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073163 Aug 27 05:36:16.411083 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3326/6650] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:36:17.379876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14535bd9-8fb7-4958-a1a9-25015040bb3b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:17.380512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14535bd9-8fb7-4958-a1a9-25015040bb3b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:17.395426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14535bd9-8fb7-4958-a1a9-25015040bb3b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:17.395877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14535bd9-8fb7-4958-a1a9-25015040bb3b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:17.396342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14535bd9-8fb7-4958-a1a9-25015040bb3b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:17.398642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14535bd9-8fb7-4958-a1a9-25015040bb3b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:17.399183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14535bd9-8fb7-4958-a1a9-25015040bb3b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:17.399644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14535bd9-8fb7-4958-a1a9-25015040bb3b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:17.592846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14535bd9-8fb7-4958-a1a9-25015040bb3b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:17.608727 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14535bd9-8fb7-4958-a1a9-25015040bb3b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1266 microversion: 2.1 time: 0.233343 Aug 27 05:36:17.610785 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3325/6651] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:17 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:18.632815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90378fa2-dc48-4b5a-a556-1f497db304c1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:18.633540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-90378fa2-dc48-4b5a-a556-1f497db304c1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:18.641715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90378fa2-dc48-4b5a-a556-1f497db304c1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:18.642275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90378fa2-dc48-4b5a-a556-1f497db304c1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:18.642877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90378fa2-dc48-4b5a-a556-1f497db304c1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:18.643959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90378fa2-dc48-4b5a-a556-1f497db304c1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:18.644297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90378fa2-dc48-4b5a-a556-1f497db304c1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:18.644751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90378fa2-dc48-4b5a-a556-1f497db304c1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:18.854148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-90378fa2-dc48-4b5a-a556-1f497db304c1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:18.864432 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90378fa2-dc48-4b5a-a556-1f497db304c1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1454 microversion: 2.1 time: 0.236140 Aug 27 05:36:18.867636 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3327/6652] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:18 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1454 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:18.887920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f0176ade-e719-4360-a91b-4acc63471dbb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:18.888689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f0176ade-e719-4360-a91b-4acc63471dbb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:18.898346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0176ade-e719-4360-a91b-4acc63471dbb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:18.898972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0176ade-e719-4360-a91b-4acc63471dbb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:18.900090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0176ade-e719-4360-a91b-4acc63471dbb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:18.900680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0176ade-e719-4360-a91b-4acc63471dbb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:18.901286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0176ade-e719-4360-a91b-4acc63471dbb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:18.901843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0176ade-e719-4360-a91b-4acc63471dbb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:19.092244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:19.092735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:19.114145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:19.115693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:19.116271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:19.117303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:19.117872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:19.119943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:19.151256 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] HTTP exception thrown: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Request method failure captured: Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae HTTP/1.1 Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauPZ_8MmWes7gl6tV_JRf9QA_aspbvSANYihradzXzjtw0hbkTfuWAjZsRSRcaon5Hq9AyDBopuISwteUa5JA2u1YCrg6N4UhDWXjSSqemlFni_CkbNutlZkTZXRGUxc3-mhEYXqq4e-ANoMhAqEmJqeQLKLBeLDGTv3BMP7Y5xGCA Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cbeac3d8b40a422b97699e81f5ce198f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 4b3cce7ee28e4f2da7f840c917b893df Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'c22df37d-a283-4e94-a99a-9ef29435d5ae'} Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:36:19.156840 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:36:19.165096 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:19.165096 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:19.165096 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:19.165096 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:19.165096 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:19.165096 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:19.165096 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:19.165096 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:19.165096 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:19.165096 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:19.165096 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:19.168931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f0176ade-e719-4360-a91b-4acc63471dbb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:19.174289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Returning 404 to user: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:19.177066 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f7ad5516-a87a-4ed7-bf11-46059b3fee43 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 404 len: 111 microversion: 2.1 time: 0.089294 Aug 27 05:36:19.178983 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f0176ade-e719-4360-a91b-4acc63471dbb tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1454 microversion: 2.1 time: 0.296318 Aug 27 05:36:19.180090 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3328/6653] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:36:19 2022] DELETE /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:36:19.201198 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3326/6654] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:18 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1454 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:19.203576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:19.204400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: c22df37d-a283-4e94-a99a-9ef29435d5ae] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:19.231530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:19.232938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:19.233637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:19.234655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:19.236828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:19.238684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:19.261521 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] HTTP exception thrown: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Request method failure captured: Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae HTTP/1.1 Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauPZ_8MmWes7gl6tV_JRf9QA_aspbvSANYihradzXzjtw0hbkTfuWAjZsRSRcaon5Hq9AyDBopuISwteUa5JA2u1YCrg6N4UhDWXjSSqemlFni_CkbNutlZkTZXRGUxc3-mhEYXqq4e-ANoMhAqEmJqeQLKLBeLDGTv3BMP7Y5xGCA Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cbeac3d8b40a422b97699e81f5ce198f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 4b3cce7ee28e4f2da7f840c917b893df Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'c22df37d-a283-4e94-a99a-9ef29435d5ae'} Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:19.269362 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:19.273325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:19.273325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:19.273325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:19.273325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:19.273325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:19.273325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. Aug 27 05:36:19.273325 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:19.273325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Returning 404 to user: Instance c22df37d-a283-4e94-a99a-9ef29435d5ae could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:19.273325 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b100d591-957c-41fa-9afb-7e0c822f7196 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae" status: 404 len: 111 microversion: 2.1 time: 0.079615 Aug 27 05:36:19.273905 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3329/6655] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:19 2022] GET /compute/v2.1/servers/c22df37d-a283-4e94-a99a-9ef29435d5ae => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:36:21.938164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-d6d984db-44d2-489f-b319-bcd2143beeee req-e73b54ab-c645-4639-a534-c799974109f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983b3540-9f17-4b6d-9d21-9f36f77f6bf5", "tag": "ef3a0152-817b-41bc-aa52-5eefa2ac790a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:21.955366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:21.961503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d6d984db-44d2-489f-b319-bcd2143beeee req-e73b54ab-c645-4639-a534-c799974109f9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:21.961999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d6d984db-44d2-489f-b319-bcd2143beeee req-e73b54ab-c645-4639-a534-c799974109f9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:21.962461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d6d984db-44d2-489f-b319-bcd2143beeee req-e73b54ab-c645-4639-a534-c799974109f9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:21.982933 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-d6d984db-44d2-489f-b319-bcd2143beeee req-e73b54ab-c645-4639-a534-c799974109f9 service nova] Creating event network-changed:ef3a0152-817b-41bc-aa52-5eefa2ac790a for instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 on n-h1-820368-35 Aug 27 05:36:21.996966 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-d6d984db-44d2-489f-b319-bcd2143beeee req-e73b54ab-c645-4639-a534-c799974109f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063889 Aug 27 05:36:21.999952 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3327/6656] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:36:23.789196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:23.790607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:23.809689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:23.811607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:23.812557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:23.813196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:23.814566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:23.815265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:23.819310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:23.864179 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] HTTP exception thrown: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Request method failure captured: Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 HTTP/1.1 Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauPZ_8MmWes7gl6tV_JRf9QA_aspbvSANYihradzXzjtw0hbkTfuWAjZsRSRcaon5Hq9AyDBopuISwteUa5JA2u1YCrg6N4UhDWXjSSqemlFni_CkbNutlZkTZXRGUxc3-mhEYXqq4e-ANoMhAqEmJqeQLKLBeLDGTv3BMP7Y5xGCA Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cbeac3d8b40a422b97699e81f5ce198f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 4b3cce7ee28e4f2da7f840c917b893df Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e6a68fe3-998d-48a4-bb1b-38b743a81bd2'} Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:36:23.868653 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:36:23.872497 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:36:23.872497 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:23.872497 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:23.872497 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:23.872497 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:23.872497 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:23.872497 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:23.872497 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:23.872497 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:23.872497 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:36:23.872497 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:23.873251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Returning 404 to user: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:23.877249 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9b79a458-a5bc-4315-8de9-28e630eb5197 tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 404 len: 111 microversion: 2.1 time: 0.101515 Aug 27 05:36:23.879973 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3330/6657] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:36:23 2022] DELETE /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:36:23.887269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:23.888694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] [instance: e6a68fe3-998d-48a4-bb1b-38b743a81bd2] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:23.914452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:23.915381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:23.916153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:23.924120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:23.925324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:23.926564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:23.966189 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] HTTP exception thrown: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Request method failure captured: Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 HTTP/1.1 Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCauPZ_8MmWes7gl6tV_JRf9QA_aspbvSANYihradzXzjtw0hbkTfuWAjZsRSRcaon5Hq9AyDBopuISwteUa5JA2u1YCrg6N4UhDWXjSSqemlFni_CkbNutlZkTZXRGUxc3-mhEYXqq4e-ANoMhAqEmJqeQLKLBeLDGTv3BMP7Y5xGCA Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cbeac3d8b40a422b97699e81f5ce198f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cbeac3d8b40a422b97699e81f5ce198f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: cbeac3d8b40a422b97699e81f5ce198f Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-AttachVolumeTestJSON-237195323 Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 4b3cce7ee28e4f2da7f840c917b893df Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-AttachVolumeTestJSON-237195323-project Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e6a68fe3-998d-48a4-bb1b-38b743a81bd2'} Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:23.968123 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:36:23.979156 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:23.979156 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:23.979156 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:23.979156 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:23.979156 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:23.979156 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. Aug 27 05:36:23.979156 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:36:23.979156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] Returning 404 to user: Instance e6a68fe3-998d-48a4-bb1b-38b743a81bd2 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:23.979156 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a74cd72d-ca9c-4d87-b40a-cf0c8a53a4af tempest-AttachVolumeTestJSON-237195323 tempest-AttachVolumeTestJSON-237195323-project] 10.222.0.58 "GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2" status: 404 len: 111 microversion: 2.1 time: 0.089630 Aug 27 05:36:23.979156 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3328/6658] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:23 2022] GET /compute/v2.1/servers/e6a68fe3-998d-48a4-bb1b-38b743a81bd2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:36:31.798696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f305cfb6-9c97-4d63-bb2d-1f1d183e2bbf tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:31.800052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f305cfb6-9c97-4d63-bb2d-1f1d183e2bbf tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:31.809943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f305cfb6-9c97-4d63-bb2d-1f1d183e2bbf tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:31.810508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f305cfb6-9c97-4d63-bb2d-1f1d183e2bbf tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:31.810945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f305cfb6-9c97-4d63-bb2d-1f1d183e2bbf tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:31.811696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f305cfb6-9c97-4d63-bb2d-1f1d183e2bbf tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:31.812147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f305cfb6-9c97-4d63-bb2d-1f1d183e2bbf tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:31.813257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f305cfb6-9c97-4d63-bb2d-1f1d183e2bbf tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:31.817563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:31.987855 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f305cfb6-9c97-4d63-bb2d-1f1d183e2bbf tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1837 microversion: 2.1 time: 0.194618 Aug 27 05:36:31.989309 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3331/6659] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:31 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1837 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:33.048599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1734a38b-115c-4b75-b8f3-da27fab72b79 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:33.049308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1734a38b-115c-4b75-b8f3-da27fab72b79 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:33.063389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1734a38b-115c-4b75-b8f3-da27fab72b79 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:33.063389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1734a38b-115c-4b75-b8f3-da27fab72b79 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:33.063389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1734a38b-115c-4b75-b8f3-da27fab72b79 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:33.063726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f90848a2-4db4-44e2-9c73-29009a8b8d65 req-b879865d-dca5-464b-8587-6376a8cf166d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06b8d48-3bfb-4137-bfd0-1619ccff91c9", "tag": "b26fae87-aabc-4649-a0ea-bffbb357ae83"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:33.064182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1734a38b-115c-4b75-b8f3-da27fab72b79 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:33.064396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1734a38b-115c-4b75-b8f3-da27fab72b79 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:33.065040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1734a38b-115c-4b75-b8f3-da27fab72b79 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:33.081001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f90848a2-4db4-44e2-9c73-29009a8b8d65 req-b879865d-dca5-464b-8587-6376a8cf166d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:33.081490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f90848a2-4db4-44e2-9c73-29009a8b8d65 req-b879865d-dca5-464b-8587-6376a8cf166d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:33.081960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f90848a2-4db4-44e2-9c73-29009a8b8d65 req-b879865d-dca5-464b-8587-6376a8cf166d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:33.097000 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f90848a2-4db4-44e2-9c73-29009a8b8d65 req-b879865d-dca5-464b-8587-6376a8cf166d service nova] Creating event network-changed:b26fae87-aabc-4649-a0ea-bffbb357ae83 for instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 on n-h2-820368-35 Aug 27 05:36:33.099479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1734a38b-115c-4b75-b8f3-da27fab72b79 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:36:33.105297 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f90848a2-4db4-44e2-9c73-29009a8b8d65 req-b879865d-dca5-464b-8587-6376a8cf166d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045947 Aug 27 05:36:33.107018 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3332/6660] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:36:33.217572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1734a38b-115c-4b75-b8f3-da27fab72b79 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 204 len: 0 microversion: 2.1 time: 0.172756 Aug 27 05:36:33.218556 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3329/6661] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:36:33 2022] DELETE /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:36:33.230224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-453d2a7d-c3b7-42b3-9a43-33cbc02a61da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:33.231049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-453d2a7d-c3b7-42b3-9a43-33cbc02a61da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:33.245984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453d2a7d-c3b7-42b3-9a43-33cbc02a61da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:33.246714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453d2a7d-c3b7-42b3-9a43-33cbc02a61da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:33.248778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453d2a7d-c3b7-42b3-9a43-33cbc02a61da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:33.249523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453d2a7d-c3b7-42b3-9a43-33cbc02a61da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:33.249988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453d2a7d-c3b7-42b3-9a43-33cbc02a61da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:33.250426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-453d2a7d-c3b7-42b3-9a43-33cbc02a61da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:33.464843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-453d2a7d-c3b7-42b3-9a43-33cbc02a61da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:33.483723 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-453d2a7d-c3b7-42b3-9a43-33cbc02a61da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1690 microversion: 2.1 time: 0.257890 Aug 27 05:36:33.484712 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3333/6662] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:33 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1690 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:34.514094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cdbbac3a-c975-46f1-a222-703af277849c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:34.514750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cdbbac3a-c975-46f1-a222-703af277849c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:34.526590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbbac3a-c975-46f1-a222-703af277849c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:34.529090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbbac3a-c975-46f1-a222-703af277849c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:34.529532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbbac3a-c975-46f1-a222-703af277849c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:34.530276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbbac3a-c975-46f1-a222-703af277849c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:34.533273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbbac3a-c975-46f1-a222-703af277849c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:34.533739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cdbbac3a-c975-46f1-a222-703af277849c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:34.726038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cdbbac3a-c975-46f1-a222-703af277849c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:34.734951 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cdbbac3a-c975-46f1-a222-703af277849c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1690 microversion: 2.1 time: 0.226844 Aug 27 05:36:34.749590 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3330/6663] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:34 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1690 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:35.605264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-035c5801-ca35-46b8-b0b7-06c4513db961 req-4bebd10e-ad53-4636-b094-7375c7f8a97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06b8d48-3bfb-4137-bfd0-1619ccff91c9", "name": "network-vif-deleted", "tag": "b26fae87-aabc-4649-a0ea-bffbb357ae83"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:35.625247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-035c5801-ca35-46b8-b0b7-06c4513db961 req-4bebd10e-ad53-4636-b094-7375c7f8a97b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:35.629909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-035c5801-ca35-46b8-b0b7-06c4513db961 req-4bebd10e-ad53-4636-b094-7375c7f8a97b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:35.630688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-035c5801-ca35-46b8-b0b7-06c4513db961 req-4bebd10e-ad53-4636-b094-7375c7f8a97b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:35.648434 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-035c5801-ca35-46b8-b0b7-06c4513db961 req-4bebd10e-ad53-4636-b094-7375c7f8a97b service nova] Creating event network-vif-deleted:b26fae87-aabc-4649-a0ea-bffbb357ae83 for instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 on n-h2-820368-35 Aug 27 05:36:35.656043 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-035c5801-ca35-46b8-b0b7-06c4513db961 req-4bebd10e-ad53-4636-b094-7375c7f8a97b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055836 Aug 27 05:36:35.656703 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3334/6664] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:36:35.758411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:35.759360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:35.766518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:35.767331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:35.767972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:35.769021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:35.770331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:35.770942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:35.813477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:35.813829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:35.814471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:35.814948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lazy-loading 'fault' on Instance uuid b06b8d48-3bfb-4137-bfd0-1619ccff91c9 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:36:35.910215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:35.924992 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1b83c283-57e2-40af-996c-759f9ee11f0f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 200 len: 1356 microversion: 2.1 time: 0.172528 Aug 27 05:36:35.931243 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3331/6665] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:35 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:36.950445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:36.951192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: b06b8d48-3bfb-4137-bfd0-1619ccff91c9] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:36.961875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:36.964737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:36.965943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:36.968729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:36.971190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:36.972527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:37.001719 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] HTTP exception thrown: Instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 could not be found. Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Request method failure captured: Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 HTTP/1.1 Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaycezwqVmI0SZtPDV6qQlpX2VkCFbV20Ge8JYrlntpSze_Q6CtDAirS7DSwwi9Bx81jXYcj_axSxQQoQpi7cI0bbJzLcATyBPqL779ERfMVzfXIEoodWpuViXpjJreCVt3Fb6SMBw2DwmxmRkxPcLcOBSVTt0BDw_-4gekJ_BBO45k Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: de208d7d0c4d4da1aff858285e6a08ea Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de208d7d0c4d4da1aff858285e6a08ea", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: de208d7d0c4d4da1aff858285e6a08ea Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestNetworkAdvancedServerOps-1874342116-project Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9d30f8e6a45046dfb2a9325ebd45e99a Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1874342116-project Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 could not be found. Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'b06b8d48-3bfb-4137-bfd0-1619ccff91c9'} Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 could not be found. Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 could not be found. Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:37.004090 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:37.008498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:37.008498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:37.008498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:37.008498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:37.008498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:37.008498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:37.008498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 could not be found. Aug 27 05:36:37.008498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:36:37.008498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Returning 404 to user: Instance b06b8d48-3bfb-4137-bfd0-1619ccff91c9 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:37.008498 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-51f3a9a2-2ef8-4582-a108-cf36e274a7ef tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9" status: 404 len: 111 microversion: 2.1 time: 0.061853 Aug 27 05:36:37.009595 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3335/6666] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:36 2022] GET /compute/v2.1/servers/b06b8d48-3bfb-4137-bfd0-1619ccff91c9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:36:41.534539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f5538c55-23bc-4b56-b7d1-7b6a5b552e71 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '.version_select at 0x7fb564927550>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:41.576149 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f5538c55-23bc-4b56-b7d1-7b6a5b552e71 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-343815109" status: 202 len: 0 microversion: 2.1 time: 0.047729 Aug 27 05:36:41.577128 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3332/6667] 10.222.0.58 () {58 vars in 1281 bytes} [Sat Aug 27 05:36:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-343815109 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:36:41.614093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-543cce09-545f-46b7-afb3-e9ca994976bb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'create', calling method: .version_select at 0x7fb56953d820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-510757875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWIomZ7Eiy+wQLHFmzkCouElvfijvTISNB+2IQ5J2Ya24eZmVl1qhUTvVaZxbSyo4zcMi5hrt2/sfmxL6xlDVLvGLA6WTK3sotfQoOv7LQzrrjLUAB1Vupi6ZSb5vI0WA=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:41.641201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-543cce09-545f-46b7-afb3-e9ca994976bb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:36:41.648521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-543cce09-545f-46b7-afb3-e9ca994976bb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for user 9d30f8e6a45046dfb2a9325ebd45e99a and project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:36:41.679394 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-543cce09-545f-46b7-afb3-e9ca994976bb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.071487 Aug 27 05:36:41.680023 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3336/6668] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:36:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:36:51.817005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2111596609", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "5f82a3ca-24a7-42e1-9b64-00a43dc057ae"}], "key_name": "tempest-TestNetworkAdvancedServerOps-510757875", "security_groups": [{"name": "tempest-secgroup-smoke-820449280"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:51.831922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:51.833587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:52.722603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] validate_networks() for [('5f82a3ca-24a7-42e1-9b64-00a43dc057ae', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:36:53.509103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:36:53.509103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:36:53.509103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:36:53.509103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:36:53.509103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:36:53.518167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:53.518681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:53.519173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:53.521830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:53.522511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:53.522979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:53.569630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:36:53.576569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for user 9d30f8e6a45046dfb2a9325ebd45e99a and project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:36:53.591900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:36:53.596463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:36:53.683449 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-73c63829-f0e2-4ece-8721-0efe9396aa32 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.868345 Aug 27 05:36:53.684908 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3333/6669] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:36:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:36:53.695199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=17 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:53.695948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:53.696910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:53.702728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bb7ae149-05bd-46a3-b63f-0c7c0b6faeb8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:53.703666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bb7ae149-05bd-46a3-b63f-0c7c0b6faeb8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:54.353720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bb7ae149-05bd-46a3-b63f-0c7c0b6faeb8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:54.363880 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bb7ae149-05bd-46a3-b63f-0c7c0b6faeb8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1266 microversion: 2.1 time: 0.671997 Aug 27 05:36:54.391499 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3337/6670] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:53 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1266 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:36:55.388576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a9c85d51-2c65-43cb-8b81-e74f5e596150 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:55.389248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a9c85d51-2c65-43cb-8b81-e74f5e596150 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:55.403125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9c85d51-2c65-43cb-8b81-e74f5e596150 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:55.403979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9c85d51-2c65-43cb-8b81-e74f5e596150 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:55.404666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9c85d51-2c65-43cb-8b81-e74f5e596150 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:55.405602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9c85d51-2c65-43cb-8b81-e74f5e596150 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:55.406254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9c85d51-2c65-43cb-8b81-e74f5e596150 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:55.408217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9c85d51-2c65-43cb-8b81-e74f5e596150 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:55.534057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a9c85d51-2c65-43cb-8b81-e74f5e596150 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:55.548590 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a9c85d51-2c65-43cb-8b81-e74f5e596150 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1318 microversion: 2.1 time: 0.165231 Aug 27 05:36:55.549211 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3334/6671] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:55 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:56.572101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-611e0bda-2cd7-4b06-bc5c-4638cf6a01fc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:56.573307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-611e0bda-2cd7-4b06-bc5c-4638cf6a01fc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:56.591010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-611e0bda-2cd7-4b06-bc5c-4638cf6a01fc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:56.592581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-611e0bda-2cd7-4b06-bc5c-4638cf6a01fc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:56.594874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-611e0bda-2cd7-4b06-bc5c-4638cf6a01fc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:56.596618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-611e0bda-2cd7-4b06-bc5c-4638cf6a01fc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:56.597461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-611e0bda-2cd7-4b06-bc5c-4638cf6a01fc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:56.599732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-611e0bda-2cd7-4b06-bc5c-4638cf6a01fc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:56.719392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-611e0bda-2cd7-4b06-bc5c-4638cf6a01fc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:56.728243 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-611e0bda-2cd7-4b06-bc5c-4638cf6a01fc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1324 microversion: 2.1 time: 0.161726 Aug 27 05:36:56.748533 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3338/6672] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:56 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1324 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:36:57.755051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29794f76-32e9-4500-bf53-4f0fe7c90a36 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:57.755720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-29794f76-32e9-4500-bf53-4f0fe7c90a36 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:57.773368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29794f76-32e9-4500-bf53-4f0fe7c90a36 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:57.774140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29794f76-32e9-4500-bf53-4f0fe7c90a36 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:57.774758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29794f76-32e9-4500-bf53-4f0fe7c90a36 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:57.775749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29794f76-32e9-4500-bf53-4f0fe7c90a36 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:57.776782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29794f76-32e9-4500-bf53-4f0fe7c90a36 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:57.777239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29794f76-32e9-4500-bf53-4f0fe7c90a36 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:57.875615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-0191ee3e-f974-4fb6-bba9-04ab7a8f1194 req-4e929a44-fa85-4299-a1fc-8a2d52ede971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a861091e-e236-4038-916e-474e77bf6435", "tag": "d8cb1fd4-5dff-4920-aca4-525f1ec4f880"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:57.894738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0191ee3e-f974-4fb6-bba9-04ab7a8f1194 req-4e929a44-fa85-4299-a1fc-8a2d52ede971 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:57.895276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0191ee3e-f974-4fb6-bba9-04ab7a8f1194 req-4e929a44-fa85-4299-a1fc-8a2d52ede971 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:57.895716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0191ee3e-f974-4fb6-bba9-04ab7a8f1194 req-4e929a44-fa85-4299-a1fc-8a2d52ede971 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:57.933177 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-0191ee3e-f974-4fb6-bba9-04ab7a8f1194 req-4e929a44-fa85-4299-a1fc-8a2d52ede971 service nova] Creating event network-changed:d8cb1fd4-5dff-4920-aca4-525f1ec4f880 for instance a861091e-e236-4038-916e-474e77bf6435 on n-h2-820368-35 Aug 27 05:36:57.948264 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-0191ee3e-f974-4fb6-bba9-04ab7a8f1194 req-4e929a44-fa85-4299-a1fc-8a2d52ede971 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077010 Aug 27 05:36:57.948971 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3339/6673] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:36:58.130341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-29794f76-32e9-4500-bf53-4f0fe7c90a36 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:58.143750 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-29794f76-32e9-4500-bf53-4f0fe7c90a36 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1391 microversion: 2.1 time: 0.392499 Aug 27 05:36:58.144605 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3335/6674] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:57 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1391 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:36:59.182303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae7a29bc-e062-4312-a604-78f36c749e48 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:59.183664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae7a29bc-e062-4312-a604-78f36c749e48 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:59.190295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7a29bc-e062-4312-a604-78f36c749e48 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:59.190791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7a29bc-e062-4312-a604-78f36c749e48 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:59.191339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7a29bc-e062-4312-a604-78f36c749e48 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:59.192086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7a29bc-e062-4312-a604-78f36c749e48 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:59.192827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7a29bc-e062-4312-a604-78f36c749e48 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:59.193388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae7a29bc-e062-4312-a604-78f36c749e48 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:59.919538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae7a29bc-e062-4312-a604-78f36c749e48 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:59.934501 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae7a29bc-e062-4312-a604-78f36c749e48 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1391 microversion: 2.1 time: 0.758928 Aug 27 05:36:59.949452 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3340/6675] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:59 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1391 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:00.960469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-073bf7ae-3319-4d28-8433-79a9275a99f4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:00.961809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-073bf7ae-3319-4d28-8433-79a9275a99f4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:00.971808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-073bf7ae-3319-4d28-8433-79a9275a99f4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:00.972847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-073bf7ae-3319-4d28-8433-79a9275a99f4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:00.973551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-073bf7ae-3319-4d28-8433-79a9275a99f4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:00.974489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-073bf7ae-3319-4d28-8433-79a9275a99f4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:00.975542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-073bf7ae-3319-4d28-8433-79a9275a99f4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:00.976216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-073bf7ae-3319-4d28-8433-79a9275a99f4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:01.278430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-073bf7ae-3319-4d28-8433-79a9275a99f4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:01.289082 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-073bf7ae-3319-4d28-8433-79a9275a99f4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1391 microversion: 2.1 time: 0.334972 Aug 27 05:37:01.306542 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3336/6676] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:00 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1391 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:02.314491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-180b39cb-0556-4949-a96f-bdc32344bba2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:02.315568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-180b39cb-0556-4949-a96f-bdc32344bba2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:02.356035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-180b39cb-0556-4949-a96f-bdc32344bba2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:02.360263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-180b39cb-0556-4949-a96f-bdc32344bba2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:02.361076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-180b39cb-0556-4949-a96f-bdc32344bba2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:02.362383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-180b39cb-0556-4949-a96f-bdc32344bba2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:02.363363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-180b39cb-0556-4949-a96f-bdc32344bba2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:02.364198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-180b39cb-0556-4949-a96f-bdc32344bba2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:02.641976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-180b39cb-0556-4949-a96f-bdc32344bba2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:02.659420 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-180b39cb-0556-4949-a96f-bdc32344bba2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1391 microversion: 2.1 time: 0.349158 Aug 27 05:37:02.660156 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3341/6677] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:02 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1391 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:03.693174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d6e93d0d-c306-4963-b3c4-ea5a1253506d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:03.696135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d6e93d0d-c306-4963-b3c4-ea5a1253506d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:03.710241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:03.712623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:03.716256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e93d0d-c306-4963-b3c4-ea5a1253506d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:03.717464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e93d0d-c306-4963-b3c4-ea5a1253506d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:03.718586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e93d0d-c306-4963-b3c4-ea5a1253506d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:03.720279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e93d0d-c306-4963-b3c4-ea5a1253506d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:03.721388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e93d0d-c306-4963-b3c4-ea5a1253506d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:03.722744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d6e93d0d-c306-4963-b3c4-ea5a1253506d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:03.789048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-869cc2ef-0e97-4f8a-a0f2-ca420562e691 req-386a2ae8-c66a-4753-9375-1391b6bc40c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a861091e-e236-4038-916e-474e77bf6435", "name": "network-vif-plugged", "status": "completed", "tag": "d8cb1fd4-5dff-4920-aca4-525f1ec4f880"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:03.816506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-869cc2ef-0e97-4f8a-a0f2-ca420562e691 req-386a2ae8-c66a-4753-9375-1391b6bc40c2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:03.817998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-869cc2ef-0e97-4f8a-a0f2-ca420562e691 req-386a2ae8-c66a-4753-9375-1391b6bc40c2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:03.818461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-869cc2ef-0e97-4f8a-a0f2-ca420562e691 req-386a2ae8-c66a-4753-9375-1391b6bc40c2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:03.840483 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-869cc2ef-0e97-4f8a-a0f2-ca420562e691 req-386a2ae8-c66a-4753-9375-1391b6bc40c2 service nova] Creating event network-vif-plugged:d8cb1fd4-5dff-4920-aca4-525f1ec4f880 for instance a861091e-e236-4038-916e-474e77bf6435 on n-h2-820368-35 Aug 27 05:37:03.860661 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-869cc2ef-0e97-4f8a-a0f2-ca420562e691 req-386a2ae8-c66a-4753-9375-1391b6bc40c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075924 Aug 27 05:37:03.861561 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3342/6678] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:37:03.969718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d6e93d0d-c306-4963-b3c4-ea5a1253506d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:03.980284 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d6e93d0d-c306-4963-b3c4-ea5a1253506d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1391 microversion: 2.1 time: 0.296886 Aug 27 05:37:03.981099 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3337/6679] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:03 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1391 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:37:04.999232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:05.008898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-30f0e95a-3ad1-4e96-8781-09e9cbe20cd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:05.010491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-30f0e95a-3ad1-4e96-8781-09e9cbe20cd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:05.018352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30f0e95a-3ad1-4e96-8781-09e9cbe20cd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:05.019135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30f0e95a-3ad1-4e96-8781-09e9cbe20cd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:05.019772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30f0e95a-3ad1-4e96-8781-09e9cbe20cd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:05.020693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30f0e95a-3ad1-4e96-8781-09e9cbe20cd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:05.021323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30f0e95a-3ad1-4e96-8781-09e9cbe20cd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:05.021983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-30f0e95a-3ad1-4e96-8781-09e9cbe20cd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:05.371884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-30f0e95a-3ad1-4e96-8781-09e9cbe20cd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:05.398004 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-30f0e95a-3ad1-4e96-8781-09e9cbe20cd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1391 microversion: 2.1 time: 0.399715 Aug 27 05:37:05.402646 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3343/6680] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:04 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1391 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:06.428115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4afc9151-36dc-4e54-b5aa-8fe09052e008 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:06.428726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4afc9151-36dc-4e54-b5aa-8fe09052e008 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:06.460371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4afc9151-36dc-4e54-b5aa-8fe09052e008 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:06.461178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4afc9151-36dc-4e54-b5aa-8fe09052e008 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:06.461813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4afc9151-36dc-4e54-b5aa-8fe09052e008 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:06.462717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4afc9151-36dc-4e54-b5aa-8fe09052e008 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:06.471988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4afc9151-36dc-4e54-b5aa-8fe09052e008 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:06.472736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4afc9151-36dc-4e54-b5aa-8fe09052e008 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:06.846652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4afc9151-36dc-4e54-b5aa-8fe09052e008 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:06.860724 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4afc9151-36dc-4e54-b5aa-8fe09052e008 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1563 microversion: 2.1 time: 0.436320 Aug 27 05:37:06.861936 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3338/6681] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:06 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1563 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:06.882528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aca0ac19-dbcf-4e05-880b-80de087dcc9a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:06.883782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aca0ac19-dbcf-4e05-880b-80de087dcc9a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:06.891551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aca0ac19-dbcf-4e05-880b-80de087dcc9a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:06.892037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aca0ac19-dbcf-4e05-880b-80de087dcc9a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:06.892731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aca0ac19-dbcf-4e05-880b-80de087dcc9a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:06.893444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aca0ac19-dbcf-4e05-880b-80de087dcc9a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:06.893898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aca0ac19-dbcf-4e05-880b-80de087dcc9a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:06.894324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aca0ac19-dbcf-4e05-880b-80de087dcc9a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:07.070553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aca0ac19-dbcf-4e05-880b-80de087dcc9a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:07.080174 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aca0ac19-dbcf-4e05-880b-80de087dcc9a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1563 microversion: 2.1 time: 0.201425 Aug 27 05:37:07.081031 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3344/6682] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:06 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1563 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:09.840331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0c65cccd-9eec-45d4-9c41-b98f8e74c5ad tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:09.841060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0c65cccd-9eec-45d4-9c41-b98f8e74c5ad tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:09.850784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-017edb46-df3c-4a34-a19b-e380e964e232 req-dd558acd-3e79-4301-9465-180377fa1b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a861091e-e236-4038-916e-474e77bf6435", "tag": "d8cb1fd4-5dff-4920-aca4-525f1ec4f880"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:09.851649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c65cccd-9eec-45d4-9c41-b98f8e74c5ad tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:09.852347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c65cccd-9eec-45d4-9c41-b98f8e74c5ad tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:09.853069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c65cccd-9eec-45d4-9c41-b98f8e74c5ad tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:09.854067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c65cccd-9eec-45d4-9c41-b98f8e74c5ad tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:09.854783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c65cccd-9eec-45d4-9c41-b98f8e74c5ad tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:09.856251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c65cccd-9eec-45d4-9c41-b98f8e74c5ad tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:09.878947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-017edb46-df3c-4a34-a19b-e380e964e232 req-dd558acd-3e79-4301-9465-180377fa1b8e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:09.879660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-017edb46-df3c-4a34-a19b-e380e964e232 req-dd558acd-3e79-4301-9465-180377fa1b8e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:09.880296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-017edb46-df3c-4a34-a19b-e380e964e232 req-dd558acd-3e79-4301-9465-180377fa1b8e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:09.898699 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-017edb46-df3c-4a34-a19b-e380e964e232 req-dd558acd-3e79-4301-9465-180377fa1b8e service nova] Creating event network-changed:d8cb1fd4-5dff-4920-aca4-525f1ec4f880 for instance a861091e-e236-4038-916e-474e77bf6435 on n-h2-820368-35 Aug 27 05:37:09.913348 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-017edb46-df3c-4a34-a19b-e380e964e232 req-dd558acd-3e79-4301-9465-180377fa1b8e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066736 Aug 27 05:37:09.913987 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3345/6683] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:37:10.140491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0c65cccd-9eec-45d4-9c41-b98f8e74c5ad tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:10.173229 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0c65cccd-9eec-45d4-9c41-b98f8e74c5ad tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1563 microversion: 2.1 time: 0.338100 Aug 27 05:37:10.175469 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3339/6684] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:09 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1563 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:39.601355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=20 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:39.602564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=36 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:39.607311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1724859207", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:39.693983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] validate_networks() for None {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:37:40.122662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:37:40.123392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:37:40.124418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:37:40.125285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:37:40.126422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:37:40.138502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:40.139196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:40.140988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:40.142341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:40.143072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:40.143771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:40.168517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Getting quotas for project 0457f266e9fb4569b7685130d9a7bf64. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:37:40.175150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Getting quotas for user af7f0a273d584543930e02bc5767a0d2 and project 0457f266e9fb4569b7685130d9a7bf64. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:37:40.191904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:37:40.194758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:37:40.250209 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bd27ecd9-b3fc-4fab-a28b-41e51e46a006 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650962 Aug 27 05:37:40.257896 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3346/6685] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:37:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:37:40.263191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-10d9d35d-9ff5-4e7a-b5d6-167cf581e558 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:40.264114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-10d9d35d-9ff5-4e7a-b5d6-167cf581e558 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:40.284508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:40.285665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=38 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:40.480837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-10d9d35d-9ff5-4e7a-b5d6-167cf581e558 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:40.495370 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-10d9d35d-9ff5-4e7a-b5d6-167cf581e558 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1215 microversion: 2.1 time: 0.236688 Aug 27 05:37:40.496304 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3340/6686] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:40 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:40.619816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33ed9856-81d3-4540-aa3f-270e49480986 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:40.626538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-33ed9856-81d3-4540-aa3f-270e49480986 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:40.648126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ed9856-81d3-4540-aa3f-270e49480986 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:40.648868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ed9856-81d3-4540-aa3f-270e49480986 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:40.649375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ed9856-81d3-4540-aa3f-270e49480986 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:40.651067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ed9856-81d3-4540-aa3f-270e49480986 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:40.651676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ed9856-81d3-4540-aa3f-270e49480986 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:40.652039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33ed9856-81d3-4540-aa3f-270e49480986 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:40.732718 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-33ed9856-81d3-4540-aa3f-270e49480986 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435/action" status: 200 len: 24573 microversion: 2.1 time: 0.119041 Aug 27 05:37:40.733664 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3347/6687] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:37:40 2022] POST /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435/action => generated 24573 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:37:41.532381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-968e492d-7ae4-4662-8265-40317614b2c9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:41.533034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-968e492d-7ae4-4662-8265-40317614b2c9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:41.540929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968e492d-7ae4-4662-8265-40317614b2c9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:41.541439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968e492d-7ae4-4662-8265-40317614b2c9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:41.542530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968e492d-7ae4-4662-8265-40317614b2c9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:41.543311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968e492d-7ae4-4662-8265-40317614b2c9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:41.543790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968e492d-7ae4-4662-8265-40317614b2c9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:41.544257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-968e492d-7ae4-4662-8265-40317614b2c9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:41.616077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-968e492d-7ae4-4662-8265-40317614b2c9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:41.628922 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-968e492d-7ae4-4662-8265-40317614b2c9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1267 microversion: 2.1 time: 0.100552 Aug 27 05:37:41.629776 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3341/6688] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:41 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:42.651761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-28633f92-43b0-4b1c-960f-7c5946fc945c tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:42.652790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-28633f92-43b0-4b1c-960f-7c5946fc945c tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:42.665501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28633f92-43b0-4b1c-960f-7c5946fc945c tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:42.673904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28633f92-43b0-4b1c-960f-7c5946fc945c tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:42.674645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28633f92-43b0-4b1c-960f-7c5946fc945c tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:42.675835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28633f92-43b0-4b1c-960f-7c5946fc945c tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:42.677970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28633f92-43b0-4b1c-960f-7c5946fc945c tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:42.678596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28633f92-43b0-4b1c-960f-7c5946fc945c tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:42.845256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-28633f92-43b0-4b1c-960f-7c5946fc945c tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:42.857570 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-28633f92-43b0-4b1c-960f-7c5946fc945c tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1273 microversion: 2.1 time: 0.210609 Aug 27 05:37:42.859333 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3348/6689] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:42 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:43.881924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-390c530d-4d79-4841-bacd-c10159505772 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:43.882716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-390c530d-4d79-4841-bacd-c10159505772 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:43.892419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-390c530d-4d79-4841-bacd-c10159505772 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:43.893180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-390c530d-4d79-4841-bacd-c10159505772 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:43.895131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-390c530d-4d79-4841-bacd-c10159505772 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:43.897033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-390c530d-4d79-4841-bacd-c10159505772 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:43.897712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-390c530d-4d79-4841-bacd-c10159505772 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:43.898580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-390c530d-4d79-4841-bacd-c10159505772 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:44.219270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-390c530d-4d79-4841-bacd-c10159505772 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:44.228078 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-390c530d-4d79-4841-bacd-c10159505772 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1315 microversion: 2.1 time: 0.351238 Aug 27 05:37:44.228697 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3342/6690] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:43 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:44.974891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-3e47cc44-922a-4d10-8f9a-7fe16a2f7965 req-5a4a92ba-203b-4710-b429-e5a9e506ecd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eb4e1da-70c5-4dbf-b564-1dfec80683ce", "tag": "436a699b-5496-4f72-9777-84a5a82918f9"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:44.988705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3e47cc44-922a-4d10-8f9a-7fe16a2f7965 req-5a4a92ba-203b-4710-b429-e5a9e506ecd9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:44.989185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3e47cc44-922a-4d10-8f9a-7fe16a2f7965 req-5a4a92ba-203b-4710-b429-e5a9e506ecd9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:44.989618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3e47cc44-922a-4d10-8f9a-7fe16a2f7965 req-5a4a92ba-203b-4710-b429-e5a9e506ecd9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:45.018828 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-3e47cc44-922a-4d10-8f9a-7fe16a2f7965 req-5a4a92ba-203b-4710-b429-e5a9e506ecd9 service nova] Creating event network-changed:436a699b-5496-4f72-9777-84a5a82918f9 for instance 6eb4e1da-70c5-4dbf-b564-1dfec80683ce on n-h1-820368-35 Aug 27 05:37:45.026594 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-3e47cc44-922a-4d10-8f9a-7fe16a2f7965 req-5a4a92ba-203b-4710-b429-e5a9e506ecd9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055254 Aug 27 05:37:45.027562 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3349/6691] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:45.263007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-039894e5-ecac-4e54-b447-88a040021d22 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:45.264161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-039894e5-ecac-4e54-b447-88a040021d22 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:45.270952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-039894e5-ecac-4e54-b447-88a040021d22 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:45.271498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-039894e5-ecac-4e54-b447-88a040021d22 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:45.272013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-039894e5-ecac-4e54-b447-88a040021d22 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:45.272744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-039894e5-ecac-4e54-b447-88a040021d22 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:45.273220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-039894e5-ecac-4e54-b447-88a040021d22 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:45.273685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-039894e5-ecac-4e54-b447-88a040021d22 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:45.635594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-039894e5-ecac-4e54-b447-88a040021d22 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:45.644478 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-039894e5-ecac-4e54-b447-88a040021d22 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1315 microversion: 2.1 time: 0.386410 Aug 27 05:37:45.645280 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3343/6692] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:45 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:46.665819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3fbe9e90-c262-4a2c-889f-38d54091554b tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:46.666526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3fbe9e90-c262-4a2c-889f-38d54091554b tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:46.677586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fbe9e90-c262-4a2c-889f-38d54091554b tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:46.678083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fbe9e90-c262-4a2c-889f-38d54091554b tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:46.678527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fbe9e90-c262-4a2c-889f-38d54091554b tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:46.679284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fbe9e90-c262-4a2c-889f-38d54091554b tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:46.679751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fbe9e90-c262-4a2c-889f-38d54091554b tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:46.680182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3fbe9e90-c262-4a2c-889f-38d54091554b tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:46.840014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3fbe9e90-c262-4a2c-889f-38d54091554b tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:46.850441 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3fbe9e90-c262-4a2c-889f-38d54091554b tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1315 microversion: 2.1 time: 0.188891 Aug 27 05:37:46.851717 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3350/6693] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:46 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:47.874211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b96b2597-f276-45c9-aa7d-0740e6bf4a4a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:47.874781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b96b2597-f276-45c9-aa7d-0740e6bf4a4a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:47.881985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b96b2597-f276-45c9-aa7d-0740e6bf4a4a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:47.882500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b96b2597-f276-45c9-aa7d-0740e6bf4a4a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:47.882961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b96b2597-f276-45c9-aa7d-0740e6bf4a4a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:47.883727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b96b2597-f276-45c9-aa7d-0740e6bf4a4a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:47.884200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b96b2597-f276-45c9-aa7d-0740e6bf4a4a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:47.884648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b96b2597-f276-45c9-aa7d-0740e6bf4a4a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:48.034678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b96b2597-f276-45c9-aa7d-0740e6bf4a4a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:48.043407 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b96b2597-f276-45c9-aa7d-0740e6bf4a4a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1315 microversion: 2.1 time: 0.173177 Aug 27 05:37:48.044004 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3344/6694] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:47 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:49.066305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-84ab3b5e-fab1-4643-ba28-c1792ef1e52d tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:49.067101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-84ab3b5e-fab1-4643-ba28-c1792ef1e52d tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:49.074591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ab3b5e-fab1-4643-ba28-c1792ef1e52d tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:49.075122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ab3b5e-fab1-4643-ba28-c1792ef1e52d tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:49.075565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ab3b5e-fab1-4643-ba28-c1792ef1e52d tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:49.076304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ab3b5e-fab1-4643-ba28-c1792ef1e52d tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:49.076769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ab3b5e-fab1-4643-ba28-c1792ef1e52d tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:49.077205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84ab3b5e-fab1-4643-ba28-c1792ef1e52d tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:49.231688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-84ab3b5e-fab1-4643-ba28-c1792ef1e52d tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:49.240716 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-84ab3b5e-fab1-4643-ba28-c1792ef1e52d tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1315 microversion: 2.1 time: 0.177710 Aug 27 05:37:49.241496 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3351/6695] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:49 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:50.264397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9eeba7c5-d349-415d-8c0c-6959a3cf0702 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:50.265098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9eeba7c5-d349-415d-8c0c-6959a3cf0702 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:50.273505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9eeba7c5-d349-415d-8c0c-6959a3cf0702 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:50.274052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9eeba7c5-d349-415d-8c0c-6959a3cf0702 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:50.274525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9eeba7c5-d349-415d-8c0c-6959a3cf0702 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:50.275289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9eeba7c5-d349-415d-8c0c-6959a3cf0702 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:50.275763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9eeba7c5-d349-415d-8c0c-6959a3cf0702 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:50.276208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9eeba7c5-d349-415d-8c0c-6959a3cf0702 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:50.433240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9eeba7c5-d349-415d-8c0c-6959a3cf0702 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:50.443754 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9eeba7c5-d349-415d-8c0c-6959a3cf0702 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1315 microversion: 2.1 time: 0.182663 Aug 27 05:37:50.444276 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3345/6696] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:50 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:51.468463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f4a35e91-8162-4902-b3c0-6aa2d85924f1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:51.469229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f4a35e91-8162-4902-b3c0-6aa2d85924f1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:51.472538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:51.473263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:51.480186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4a35e91-8162-4902-b3c0-6aa2d85924f1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:51.480692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4a35e91-8162-4902-b3c0-6aa2d85924f1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:51.481147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4a35e91-8162-4902-b3c0-6aa2d85924f1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:51.481879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4a35e91-8162-4902-b3c0-6aa2d85924f1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:51.482345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4a35e91-8162-4902-b3c0-6aa2d85924f1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:51.482779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4a35e91-8162-4902-b3c0-6aa2d85924f1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:51.743770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f4a35e91-8162-4902-b3c0-6aa2d85924f1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:51.752510 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f4a35e91-8162-4902-b3c0-6aa2d85924f1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1315 microversion: 2.1 time: 0.287667 Aug 27 05:37:51.759343 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3352/6697] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:51 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:52.778392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-362bc855-ebb5-4d6a-b58d-980b9e30aea1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:52.779028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-362bc855-ebb5-4d6a-b58d-980b9e30aea1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:52.787954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:52.794216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-362bc855-ebb5-4d6a-b58d-980b9e30aea1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:52.795013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-362bc855-ebb5-4d6a-b58d-980b9e30aea1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:52.796821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-362bc855-ebb5-4d6a-b58d-980b9e30aea1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:52.798771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-362bc855-ebb5-4d6a-b58d-980b9e30aea1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:52.800056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-362bc855-ebb5-4d6a-b58d-980b9e30aea1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:52.801544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-362bc855-ebb5-4d6a-b58d-980b9e30aea1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:52.894104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7cac8941-7c26-4341-a547-8c35278f33fb req-32234c31-f555-4783-a8e9-7cf2f128f306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb4e1da-70c5-4dbf-b564-1dfec80683ce", "name": "network-vif-plugged", "status": "completed", "tag": "436a699b-5496-4f72-9777-84a5a82918f9"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:52.908120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7cac8941-7c26-4341-a547-8c35278f33fb req-32234c31-f555-4783-a8e9-7cf2f128f306 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:52.909571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7cac8941-7c26-4341-a547-8c35278f33fb req-32234c31-f555-4783-a8e9-7cf2f128f306 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:52.910253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7cac8941-7c26-4341-a547-8c35278f33fb req-32234c31-f555-4783-a8e9-7cf2f128f306 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:52.925024 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7cac8941-7c26-4341-a547-8c35278f33fb req-32234c31-f555-4783-a8e9-7cf2f128f306 service nova] Creating event network-vif-plugged:436a699b-5496-4f72-9777-84a5a82918f9 for instance 6eb4e1da-70c5-4dbf-b564-1dfec80683ce on n-h1-820368-35 Aug 27 05:37:52.930529 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7cac8941-7c26-4341-a547-8c35278f33fb req-32234c31-f555-4783-a8e9-7cf2f128f306 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040433 Aug 27 05:37:52.931840 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3353/6698] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:37:52.983939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-362bc855-ebb5-4d6a-b58d-980b9e30aea1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:52.993569 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-362bc855-ebb5-4d6a-b58d-980b9e30aea1 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1315 microversion: 2.1 time: 0.220023 Aug 27 05:37:52.994094 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3346/6699] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:52 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:54.015715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1b5ea066-e963-4a8e-ab07-42daad3235a9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:54.016729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1b5ea066-e963-4a8e-ab07-42daad3235a9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:54.023533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5ea066-e963-4a8e-ab07-42daad3235a9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:54.025703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5ea066-e963-4a8e-ab07-42daad3235a9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:54.025703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5ea066-e963-4a8e-ab07-42daad3235a9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:54.025703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5ea066-e963-4a8e-ab07-42daad3235a9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:54.025703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5ea066-e963-4a8e-ab07-42daad3235a9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:54.026121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5ea066-e963-4a8e-ab07-42daad3235a9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:54.172741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1b5ea066-e963-4a8e-ab07-42daad3235a9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:54.181761 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1b5ea066-e963-4a8e-ab07-42daad3235a9 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1315 microversion: 2.1 time: 0.171046 Aug 27 05:37:54.182342 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3354/6700] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:54 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:55.206113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c4eb00ae-d003-4407-bddc-e9eb64474659 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:55.208105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c4eb00ae-d003-4407-bddc-e9eb64474659 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:55.233844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4eb00ae-d003-4407-bddc-e9eb64474659 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:55.234568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4eb00ae-d003-4407-bddc-e9eb64474659 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:55.235470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4eb00ae-d003-4407-bddc-e9eb64474659 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:55.237167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4eb00ae-d003-4407-bddc-e9eb64474659 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:55.238056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4eb00ae-d003-4407-bddc-e9eb64474659 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:55.238890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c4eb00ae-d003-4407-bddc-e9eb64474659 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:55.664667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c4eb00ae-d003-4407-bddc-e9eb64474659 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:55.677448 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c4eb00ae-d003-4407-bddc-e9eb64474659 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1465 microversion: 2.1 time: 0.476027 Aug 27 05:37:55.691005 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3347/6701] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:55 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1465 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:55.741934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f9cc4ae-9c69-4565-be60-cac9031d0704 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:55.743110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f9cc4ae-9c69-4565-be60-cac9031d0704 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:55.758594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f9cc4ae-9c69-4565-be60-cac9031d0704 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:55.759970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f9cc4ae-9c69-4565-be60-cac9031d0704 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:55.760862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f9cc4ae-9c69-4565-be60-cac9031d0704 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:55.762279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f9cc4ae-9c69-4565-be60-cac9031d0704 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:55.763247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f9cc4ae-9c69-4565-be60-cac9031d0704 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:55.764310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f9cc4ae-9c69-4565-be60-cac9031d0704 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:55.810775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f9cc4ae-9c69-4565-be60-cac9031d0704 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:37:55.940212 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f9cc4ae-9c69-4565-be60-cac9031d0704 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 204 len: 0 microversion: 2.1 time: 0.203364 Aug 27 05:37:55.941099 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3355/6702] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:37:55 2022] DELETE /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:37:55.952239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7ec25f4-17cc-468b-9110-02da61953e6a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:55.953261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7ec25f4-17cc-468b-9110-02da61953e6a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:55.961502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7ec25f4-17cc-468b-9110-02da61953e6a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:55.962144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7ec25f4-17cc-468b-9110-02da61953e6a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:55.962648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7ec25f4-17cc-468b-9110-02da61953e6a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:55.964763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7ec25f4-17cc-468b-9110-02da61953e6a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:55.965463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7ec25f4-17cc-468b-9110-02da61953e6a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:55.966161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7ec25f4-17cc-468b-9110-02da61953e6a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:56.156241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a7ec25f4-17cc-468b-9110-02da61953e6a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:56.167227 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7ec25f4-17cc-468b-9110-02da61953e6a tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1471 microversion: 2.1 time: 0.219684 Aug 27 05:37:56.167529 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3348/6703] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:55 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:57.206986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ff4881d1-a162-4bb4-9ffb-64a6826fb3df tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:57.208433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ff4881d1-a162-4bb4-9ffb-64a6826fb3df tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:57.222603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4881d1-a162-4bb4-9ffb-64a6826fb3df tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:57.223483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4881d1-a162-4bb4-9ffb-64a6826fb3df tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:57.224857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4881d1-a162-4bb4-9ffb-64a6826fb3df tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:57.226204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4881d1-a162-4bb4-9ffb-64a6826fb3df tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:57.227190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4881d1-a162-4bb4-9ffb-64a6826fb3df tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:57.227787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ff4881d1-a162-4bb4-9ffb-64a6826fb3df tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:57.421341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ff4881d1-a162-4bb4-9ffb-64a6826fb3df tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:57.430063 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ff4881d1-a162-4bb4-9ffb-64a6826fb3df tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1471 microversion: 2.1 time: 0.241459 Aug 27 05:37:57.431002 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3356/6704] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:57 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:58.204080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-d23a165f-b6df-4b49-a5ad-430b387c5f74 req-7857aed6-6814-4366-9735-f30a42b49760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb4e1da-70c5-4dbf-b564-1dfec80683ce", "name": "network-vif-deleted", "tag": "436a699b-5496-4f72-9777-84a5a82918f9"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:58.235894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d23a165f-b6df-4b49-a5ad-430b387c5f74 req-7857aed6-6814-4366-9735-f30a42b49760 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:58.236484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d23a165f-b6df-4b49-a5ad-430b387c5f74 req-7857aed6-6814-4366-9735-f30a42b49760 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:58.236941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-d23a165f-b6df-4b49-a5ad-430b387c5f74 req-7857aed6-6814-4366-9735-f30a42b49760 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:58.266658 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-d23a165f-b6df-4b49-a5ad-430b387c5f74 req-7857aed6-6814-4366-9735-f30a42b49760 service nova] Creating event network-vif-deleted:436a699b-5496-4f72-9777-84a5a82918f9 for instance 6eb4e1da-70c5-4dbf-b564-1dfec80683ce on n-h1-820368-35 Aug 27 05:37:58.281158 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-d23a165f-b6df-4b49-a5ad-430b387c5f74 req-7857aed6-6814-4366-9735-f30a42b49760 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083500 Aug 27 05:37:58.282247 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3349/6705] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:58.457983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:58.460216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:58.489050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:58.494886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:58.500483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:58.503053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:58.510187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:58.516864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:58.654090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:58.656062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:58.656804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:58.658065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lazy-loading 'fault' on Instance uuid 6eb4e1da-70c5-4dbf-b564-1dfec80683ce {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:37:58.739256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f0a273d584543930e02bc5767a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0457f266e9fb4569b7685130d9a7bf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:58.751646 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6461fc91-e457-4e8d-a1eb-fe553237cb55 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 200 len: 1305 microversion: 2.1 time: 0.302716 Aug 27 05:37:58.752610 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3357/6706] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:58 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 1305 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:59.775176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:59.776602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] [instance: 6eb4e1da-70c5-4dbf-b564-1dfec80683ce] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:59.785509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:59.786263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:59.786937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:59.787941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:59.788417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:59.788861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:59.811809 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] HTTP exception thrown: Instance 6eb4e1da-70c5-4dbf-b564-1dfec80683ce could not be found. Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Request method failure captured: Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce HTTP/1.1 Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCa2gquAHdTMtvTXXW23Hi_dVvaNAI3BXRx2UeDkaqyDV28SBozRKT60budSNx8MMcOct2lRTs2SI63xAGzB_WNJE1B2FDkRKEFnCgTT29UBTvpmP4-V94YESEVAqb1mR-anw9S8rRz3_LT_6zyU2_iBSqm_5--BrI0LeAQSmv5ghZ_k Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 0457f266e9fb4569b7685130d9a7bf64 Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-VolumesNegativeTest-1699767150 Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0457f266e9fb4569b7685130d9a7bf64", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0457f266e9fb4569b7685130d9a7bf64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0457f266e9fb4569b7685130d9a7bf64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0457f266e9fb4569b7685130d9a7bf64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-VolumesNegativeTest-1699767150 Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 0457f266e9fb4569b7685130d9a7bf64 Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-VolumesNegativeTest-1699767150 Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-VolumesNegativeTest-1699767150-project Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: af7f0a273d584543930e02bc5767a0d2 Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-VolumesNegativeTest-1699767150-project Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 6eb4e1da-70c5-4dbf-b564-1dfec80683ce could not be found. Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '6eb4e1da-70c5-4dbf-b564-1dfec80683ce'} Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eb4e1da-70c5-4dbf-b564-1dfec80683ce could not be found. Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eb4e1da-70c5-4dbf-b564-1dfec80683ce could not be found. Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:37:59.813808 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:37:59.819600 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:59.819600 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:37:59.819600 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:37:59.819600 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:37:59.819600 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:37:59.819600 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eb4e1da-70c5-4dbf-b564-1dfec80683ce could not be found. Aug 27 05:37:59.819600 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:37:59.819600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] Returning 404 to user: Instance 6eb4e1da-70c5-4dbf-b564-1dfec80683ce could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:37:59.821626 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14b9b549-89f8-4646-8869-57ffdf014922 tempest-VolumesNegativeTest-1699767150 tempest-VolumesNegativeTest-1699767150-project] 10.222.0.58 "GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce" status: 404 len: 111 microversion: 2.1 time: 0.051100 Aug 27 05:37:59.828631 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3350/6707] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:59 2022] GET /compute/v2.1/servers/6eb4e1da-70c5-4dbf-b564-1dfec80683ce => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:38:19.785496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c78b2ef7-5dec-4c5f-9c8e-7fe582af0d83 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:19.786728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c78b2ef7-5dec-4c5f-9c8e-7fe582af0d83 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:19.790140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:19.791734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:19.806743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c78b2ef7-5dec-4c5f-9c8e-7fe582af0d83 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:19.807559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c78b2ef7-5dec-4c5f-9c8e-7fe582af0d83 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:19.809257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c78b2ef7-5dec-4c5f-9c8e-7fe582af0d83 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:19.810209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c78b2ef7-5dec-4c5f-9c8e-7fe582af0d83 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:19.810823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c78b2ef7-5dec-4c5f-9c8e-7fe582af0d83 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:19.813191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c78b2ef7-5dec-4c5f-9c8e-7fe582af0d83 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:19.985039 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c78b2ef7-5dec-4c5f-9c8e-7fe582af0d83 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1834 microversion: 2.1 time: 0.204177 Aug 27 05:38:19.986647 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3358/6708] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:19 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1834 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:20.011421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=24 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:20.013041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=52 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:20.303940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f3b9cf7-df4b-457d-8d35-cb4f21f026f3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:20.304865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0f3b9cf7-df4b-457d-8d35-cb4f21f026f3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:20.321490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f3b9cf7-df4b-457d-8d35-cb4f21f026f3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.322232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f3b9cf7-df4b-457d-8d35-cb4f21f026f3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.322880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f3b9cf7-df4b-457d-8d35-cb4f21f026f3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.323819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f3b9cf7-df4b-457d-8d35-cb4f21f026f3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.324457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f3b9cf7-df4b-457d-8d35-cb4f21f026f3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.325091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f3b9cf7-df4b-457d-8d35-cb4f21f026f3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.497145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0f3b9cf7-df4b-457d-8d35-cb4f21f026f3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:20.506760 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f3b9cf7-df4b-457d-8d35-cb4f21f026f3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1681 microversion: 2.1 time: 0.501598 Aug 27 05:38:20.507397 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3351/6709] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:20 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1681 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:20.618881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e4b66611-7c61-4544-984f-023be848ffd3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:20.620586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e4b66611-7c61-4544-984f-023be848ffd3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:20.628566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4b66611-7c61-4544-984f-023be848ffd3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.629308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4b66611-7c61-4544-984f-023be848ffd3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.630470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4b66611-7c61-4544-984f-023be848ffd3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.631406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4b66611-7c61-4544-984f-023be848ffd3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.632158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4b66611-7c61-4544-984f-023be848ffd3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.632741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e4b66611-7c61-4544-984f-023be848ffd3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.633363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0d9192a4-1dbd-4d99-8a05-806332422d38 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:20.636074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0d9192a4-1dbd-4d99-8a05-806332422d38 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:20.644030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d9192a4-1dbd-4d99-8a05-806332422d38 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.644712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d9192a4-1dbd-4d99-8a05-806332422d38 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.645326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d9192a4-1dbd-4d99-8a05-806332422d38 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.646057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d9192a4-1dbd-4d99-8a05-806332422d38 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.647387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d9192a4-1dbd-4d99-8a05-806332422d38 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.647777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d9192a4-1dbd-4d99-8a05-806332422d38 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.664371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e4b66611-7c61-4544-984f-023be848ffd3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:38:20.720017 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0d9192a4-1dbd-4d99-8a05-806332422d38 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435/action" status: 200 len: 32640 microversion: 2.1 time: 0.097740 Aug 27 05:38:20.725097 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3352/6710] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:38:20 2022] POST /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435/action => generated 32640 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 05:38:20.789865 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e4b66611-7c61-4544-984f-023be848ffd3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 204 len: 0 microversion: 2.1 time: 0.178233 Aug 27 05:38:20.791413 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3359/6711] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:38:20 2022] DELETE /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:38:20.811386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b071dcd7-8ce6-433b-9a4a-01f6f1672e10 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:20.812189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b071dcd7-8ce6-433b-9a4a-01f6f1672e10 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:20.821008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b071dcd7-8ce6-433b-9a4a-01f6f1672e10 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.821008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b071dcd7-8ce6-433b-9a4a-01f6f1672e10 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.821545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b071dcd7-8ce6-433b-9a4a-01f6f1672e10 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.822367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b071dcd7-8ce6-433b-9a4a-01f6f1672e10 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.822898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b071dcd7-8ce6-433b-9a4a-01f6f1672e10 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.823372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b071dcd7-8ce6-433b-9a4a-01f6f1672e10 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.888351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:20.889477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:20.910631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.911173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.911841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.912877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.913240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.913847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:21.064098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '41b36433164f48588273f1635154d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ae45642d84797b71e182d6ee53053', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:21.064626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: a861091e-e236-4038-916e-474e77bf6435] flavor_id is None. Assuming migration. {{(pid=128548) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 05:38:21.065538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: a861091e-e236-4038-916e-474e77bf6435] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128548) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:38:21.118227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b071dcd7-8ce6-433b-9a4a-01f6f1672e10 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:21.127841 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b071dcd7-8ce6-433b-9a4a-01f6f1672e10 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1579 microversion: 2.1 time: 0.326535 Aug 27 05:38:21.131058 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3353/6712] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:20 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1579 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:21.491516 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7908c27d-d83e-4e4b-974a-9ed2627acdcb tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435/action" status: 202 len: 0 microversion: 2.1 time: 0.606983 Aug 27 05:38:21.493012 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3360/6713] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:38:20 2022] POST /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:38:21.512745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f5c5e47f-ce0d-4f71-87a7-8c0346b30da8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:21.517310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f5c5e47f-ce0d-4f71-87a7-8c0346b30da8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:21.533266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c5e47f-ce0d-4f71-87a7-8c0346b30da8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:21.534639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c5e47f-ce0d-4f71-87a7-8c0346b30da8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:21.535819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c5e47f-ce0d-4f71-87a7-8c0346b30da8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:21.538791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c5e47f-ce0d-4f71-87a7-8c0346b30da8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:21.540400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c5e47f-ce0d-4f71-87a7-8c0346b30da8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:21.541164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f5c5e47f-ce0d-4f71-87a7-8c0346b30da8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:21.832204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f5c5e47f-ce0d-4f71-87a7-8c0346b30da8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:21.846348 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f5c5e47f-ce0d-4f71-87a7-8c0346b30da8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1690 microversion: 2.1 time: 0.342632 Aug 27 05:38:21.848220 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3354/6714] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:21 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1690 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:22.157214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5537d9b8-2d94-4871-a006-2aa92ab3116c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:22.157960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5537d9b8-2d94-4871-a006-2aa92ab3116c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:22.172941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5537d9b8-2d94-4871-a006-2aa92ab3116c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:22.173713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5537d9b8-2d94-4871-a006-2aa92ab3116c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:22.175411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5537d9b8-2d94-4871-a006-2aa92ab3116c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:22.176337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5537d9b8-2d94-4871-a006-2aa92ab3116c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:22.176957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5537d9b8-2d94-4871-a006-2aa92ab3116c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:22.177568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5537d9b8-2d94-4871-a006-2aa92ab3116c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:22.404084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5537d9b8-2d94-4871-a006-2aa92ab3116c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:22.416481 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5537d9b8-2d94-4871-a006-2aa92ab3116c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1579 microversion: 2.1 time: 0.264482 Aug 27 05:38:22.417345 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3361/6715] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:22 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1579 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:22.874873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8eb6f8ca-dfe7-4a55-b530-862d12b211e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:22.875741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8eb6f8ca-dfe7-4a55-b530-862d12b211e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:22.885914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8eb6f8ca-dfe7-4a55-b530-862d12b211e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:22.886432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8eb6f8ca-dfe7-4a55-b530-862d12b211e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:22.887185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8eb6f8ca-dfe7-4a55-b530-862d12b211e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:22.888123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8eb6f8ca-dfe7-4a55-b530-862d12b211e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:22.888755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8eb6f8ca-dfe7-4a55-b530-862d12b211e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:22.889379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8eb6f8ca-dfe7-4a55-b530-862d12b211e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:23.291487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8eb6f8ca-dfe7-4a55-b530-862d12b211e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:23.309360 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8eb6f8ca-dfe7-4a55-b530-862d12b211e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1690 microversion: 2.1 time: 0.440498 Aug 27 05:38:23.309878 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3355/6716] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:22 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1690 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:23.445950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-94314c05-df29-4615-a07c-ccafb55a4a65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:23.447662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-94314c05-df29-4615-a07c-ccafb55a4a65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:23.472070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94314c05-df29-4615-a07c-ccafb55a4a65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:23.472070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94314c05-df29-4615-a07c-ccafb55a4a65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:23.472070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94314c05-df29-4615-a07c-ccafb55a4a65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:23.472070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94314c05-df29-4615-a07c-ccafb55a4a65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:23.472070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94314c05-df29-4615-a07c-ccafb55a4a65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:23.472070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-94314c05-df29-4615-a07c-ccafb55a4a65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:23.748818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-94314c05-df29-4615-a07c-ccafb55a4a65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:23.760843 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-94314c05-df29-4615-a07c-ccafb55a4a65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1512 microversion: 2.1 time: 0.320107 Aug 27 05:38:23.761770 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3362/6717] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:23 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:24.171349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-253a2e3b-6ae7-4771-b276-f20861520387 req-6b4ae2fb-1301-4d98-b92c-6a73d4b9087f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983b3540-9f17-4b6d-9d21-9f36f77f6bf5", "name": "network-vif-deleted", "tag": "ef3a0152-817b-41bc-aa52-5eefa2ac790a"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:24.189328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-253a2e3b-6ae7-4771-b276-f20861520387 req-6b4ae2fb-1301-4d98-b92c-6a73d4b9087f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:24.190225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-253a2e3b-6ae7-4771-b276-f20861520387 req-6b4ae2fb-1301-4d98-b92c-6a73d4b9087f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:24.190799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-253a2e3b-6ae7-4771-b276-f20861520387 req-6b4ae2fb-1301-4d98-b92c-6a73d4b9087f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:24.207952 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-253a2e3b-6ae7-4771-b276-f20861520387 req-6b4ae2fb-1301-4d98-b92c-6a73d4b9087f service nova] Creating event network-vif-deleted:ef3a0152-817b-41bc-aa52-5eefa2ac790a for instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 on n-h1-820368-35 Aug 27 05:38:24.214123 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-253a2e3b-6ae7-4771-b276-f20861520387 req-6b4ae2fb-1301-4d98-b92c-6a73d4b9087f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047077 Aug 27 05:38:24.222786 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3356/6718] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:24.330723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aeaa2b07-5f68-42d5-bd89-b28857cc457b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:24.332395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aeaa2b07-5f68-42d5-bd89-b28857cc457b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:24.344976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeaa2b07-5f68-42d5-bd89-b28857cc457b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:24.347342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeaa2b07-5f68-42d5-bd89-b28857cc457b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:24.348130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeaa2b07-5f68-42d5-bd89-b28857cc457b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:24.349116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeaa2b07-5f68-42d5-bd89-b28857cc457b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:24.355321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeaa2b07-5f68-42d5-bd89-b28857cc457b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:24.359213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aeaa2b07-5f68-42d5-bd89-b28857cc457b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:24.622851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aeaa2b07-5f68-42d5-bd89-b28857cc457b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:24.633316 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aeaa2b07-5f68-42d5-bd89-b28857cc457b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1690 microversion: 2.1 time: 0.306668 Aug 27 05:38:24.657438 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3363/6719] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:24 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1690 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:24.787359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5be4bd58-e61c-46ef-b760-0cfc0db3d721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:24.787359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5be4bd58-e61c-46ef-b760-0cfc0db3d721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:24.798857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be4bd58-e61c-46ef-b760-0cfc0db3d721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:24.799421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be4bd58-e61c-46ef-b760-0cfc0db3d721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:24.799892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be4bd58-e61c-46ef-b760-0cfc0db3d721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:24.800634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be4bd58-e61c-46ef-b760-0cfc0db3d721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:24.801112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be4bd58-e61c-46ef-b760-0cfc0db3d721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:24.801563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5be4bd58-e61c-46ef-b760-0cfc0db3d721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:24.959155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5be4bd58-e61c-46ef-b760-0cfc0db3d721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:24.981264 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5be4bd58-e61c-46ef-b760-0cfc0db3d721 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1226 microversion: 2.1 time: 0.200596 Aug 27 05:38:24.984763 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3357/6720] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:24 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1226 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:25.668963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2ee07ad7-666d-4e48-b77f-e6b2a5d07d59 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:25.670558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2ee07ad7-666d-4e48-b77f-e6b2a5d07d59 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:25.679254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ee07ad7-666d-4e48-b77f-e6b2a5d07d59 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:25.680938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ee07ad7-666d-4e48-b77f-e6b2a5d07d59 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:25.681652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ee07ad7-666d-4e48-b77f-e6b2a5d07d59 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:25.682708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ee07ad7-666d-4e48-b77f-e6b2a5d07d59 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:25.683543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ee07ad7-666d-4e48-b77f-e6b2a5d07d59 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:25.684163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ee07ad7-666d-4e48-b77f-e6b2a5d07d59 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:25.960592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2ee07ad7-666d-4e48-b77f-e6b2a5d07d59 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:25.976473 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2ee07ad7-666d-4e48-b77f-e6b2a5d07d59 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.313926 Aug 27 05:38:25.984138 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3364/6721] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:25 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:26.008224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c7bedb36-a178-4b0b-81c8-31513cce619b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:26.009784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c7bedb36-a178-4b0b-81c8-31513cce619b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:26.019973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7bedb36-a178-4b0b-81c8-31513cce619b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:26.020879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7bedb36-a178-4b0b-81c8-31513cce619b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:26.021585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7bedb36-a178-4b0b-81c8-31513cce619b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:26.023235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7bedb36-a178-4b0b-81c8-31513cce619b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:26.023961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7bedb36-a178-4b0b-81c8-31513cce619b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:26.024641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7bedb36-a178-4b0b-81c8-31513cce619b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:26.134810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c7bedb36-a178-4b0b-81c8-31513cce619b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:26.150646 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c7bedb36-a178-4b0b-81c8-31513cce619b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1226 microversion: 2.1 time: 0.148012 Aug 27 05:38:26.151699 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3358/6722] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:26 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1226 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:27.010494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4c8167df-a9fe-4a65-892a-066525b6cbdb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:27.010494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4c8167df-a9fe-4a65-892a-066525b6cbdb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:27.017961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c8167df-a9fe-4a65-892a-066525b6cbdb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:27.018661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c8167df-a9fe-4a65-892a-066525b6cbdb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:27.019565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c8167df-a9fe-4a65-892a-066525b6cbdb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:27.020387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c8167df-a9fe-4a65-892a-066525b6cbdb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:27.021050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c8167df-a9fe-4a65-892a-066525b6cbdb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:27.022651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c8167df-a9fe-4a65-892a-066525b6cbdb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:27.180908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ea7abb81-1cb4-4594-8936-015ff6fa9f13 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:27.182051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ea7abb81-1cb4-4594-8936-015ff6fa9f13 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:27.196445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea7abb81-1cb4-4594-8936-015ff6fa9f13 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:27.197345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea7abb81-1cb4-4594-8936-015ff6fa9f13 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:27.198426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea7abb81-1cb4-4594-8936-015ff6fa9f13 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:27.199725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea7abb81-1cb4-4594-8936-015ff6fa9f13 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:27.200551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea7abb81-1cb4-4594-8936-015ff6fa9f13 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:27.202267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea7abb81-1cb4-4594-8936-015ff6fa9f13 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:27.330243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ea7abb81-1cb4-4594-8936-015ff6fa9f13 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:27.344390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4c8167df-a9fe-4a65-892a-066525b6cbdb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:27.346666 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ea7abb81-1cb4-4594-8936-015ff6fa9f13 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1226 microversion: 2.1 time: 0.173086 Aug 27 05:38:27.347498 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3359/6723] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:27 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:27.374154 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4c8167df-a9fe-4a65-892a-066525b6cbdb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.369779 Aug 27 05:38:27.391574 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3365/6724] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:27 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:28.369114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-430eabf8-582e-4525-bd7d-7cd12354116a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:28.369994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-430eabf8-582e-4525-bd7d-7cd12354116a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:28.378285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-430eabf8-582e-4525-bd7d-7cd12354116a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:28.378944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-430eabf8-582e-4525-bd7d-7cd12354116a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:28.379494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-430eabf8-582e-4525-bd7d-7cd12354116a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:28.380318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-430eabf8-582e-4525-bd7d-7cd12354116a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:28.380859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-430eabf8-582e-4525-bd7d-7cd12354116a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:28.381954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-430eabf8-582e-4525-bd7d-7cd12354116a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:28.411435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-acd7a1aa-a40b-4f41-bfe8-3d33eade73a4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:28.413477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-acd7a1aa-a40b-4f41-bfe8-3d33eade73a4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:28.423333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acd7a1aa-a40b-4f41-bfe8-3d33eade73a4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:28.425175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acd7a1aa-a40b-4f41-bfe8-3d33eade73a4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:28.426167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acd7a1aa-a40b-4f41-bfe8-3d33eade73a4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:28.429432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acd7a1aa-a40b-4f41-bfe8-3d33eade73a4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:28.429432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acd7a1aa-a40b-4f41-bfe8-3d33eade73a4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:28.429834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acd7a1aa-a40b-4f41-bfe8-3d33eade73a4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:28.464832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-430eabf8-582e-4525-bd7d-7cd12354116a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:28.474962 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-430eabf8-582e-4525-bd7d-7cd12354116a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1226 microversion: 2.1 time: 0.110245 Aug 27 05:38:28.475802 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3360/6725] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:28 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:28.603163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-acd7a1aa-a40b-4f41-bfe8-3d33eade73a4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:28.613710 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-acd7a1aa-a40b-4f41-bfe8-3d33eade73a4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.207220 Aug 27 05:38:28.614456 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3366/6726] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:28 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:29.497366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:29.498082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:29.505431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:29.506022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:29.507080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:29.507900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:29.508436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:29.508989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:29.544398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:29.544872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:29.545402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:29.546025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lazy-loading 'fault' on Instance uuid 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:38:29.618490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:29.627729 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a780745-ecaa-4eb6-9882-b15f9a6d4f46 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 200 len: 1231 microversion: 2.1 time: 0.134593 Aug 27 05:38:29.641987 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3361/6727] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:29 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 1231 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:29.646489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-54b95891-c73a-4f25-9057-cebcdcaec534 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:29.647740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-54b95891-c73a-4f25-9057-cebcdcaec534 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:29.654705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54b95891-c73a-4f25-9057-cebcdcaec534 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:29.655699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54b95891-c73a-4f25-9057-cebcdcaec534 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:29.656142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54b95891-c73a-4f25-9057-cebcdcaec534 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:29.657007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54b95891-c73a-4f25-9057-cebcdcaec534 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:29.657470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54b95891-c73a-4f25-9057-cebcdcaec534 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:29.658262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54b95891-c73a-4f25-9057-cebcdcaec534 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:29.854794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-54b95891-c73a-4f25-9057-cebcdcaec534 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:29.870591 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-54b95891-c73a-4f25-9057-cebcdcaec534 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.236203 Aug 27 05:38:29.871875 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3367/6728] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:29 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:30.650328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:30.650979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:30.659225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:30.660147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:30.660786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:30.661736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:30.663776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:30.664619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:30.681485 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 HTTP/1.1 Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '983b3540-9f17-4b6d-9d21-9f36f77f6bf5'} Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:38:30.683523 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:38:30.688614 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:38:30.688614 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:38:30.688614 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:38:30.688614 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:38:30.688614 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:38:30.688614 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:38:30.688614 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:38:30.690301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:38:30.691550 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aeaa44cc-42c1-49c5-be65-bddbb3f07849 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 404 len: 111 microversion: 2.1 time: 0.045322 Aug 27 05:38:30.692601 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3362/6729] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:30 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:38:30.865264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-262793489", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1417438862", "security_groups": [{"name": "tempest-secgroup-smoke-747049925"}], "block_device_mapping_v2": [{"uuid": "651a1f36-4975-4fe1-beaf-5d5b155e1787", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "58a22fcb-5b07-4d83-8df1-2b6fed6fe046"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:30.896568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-250071b3-fe98-41da-9867-e20e7bc2d086 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:30.897236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-250071b3-fe98-41da-9867-e20e7bc2d086 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:30.915461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-250071b3-fe98-41da-9867-e20e7bc2d086 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:30.916621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-250071b3-fe98-41da-9867-e20e7bc2d086 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:30.917346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-250071b3-fe98-41da-9867-e20e7bc2d086 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:30.918374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-250071b3-fe98-41da-9867-e20e7bc2d086 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:30.919149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-250071b3-fe98-41da-9867-e20e7bc2d086 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:30.920318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-250071b3-fe98-41da-9867-e20e7bc2d086 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:31.081212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] validate_networks() for [('58a22fcb-5b07-4d83-8df1-2b6fed6fe046', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:38:31.230861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-250071b3-fe98-41da-9867-e20e7bc2d086 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:31.255257 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-250071b3-fe98-41da-9867-e20e7bc2d086 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.358143 Aug 27 05:38:31.255257 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3363/6730] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:30 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:31.669132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:38:31.670539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:38:31.671193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:38:31.671621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:38:31.672073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:38:31.683165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:31.683664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:31.684106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:31.684862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:31.685526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:31.685994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:31.710634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:38:31.716818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for user 007b4762bf8c436fb783d84380c01932 and project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:38:31.797005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:38:31.805913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='651a1f36-4975-4fe1-beaf-5d5b155e1787',volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:38:31.979660 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-609d6073-02df-4cd2-9ef5-bfabca76eaef tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.118383 Aug 27 05:38:31.981101 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3368/6731] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:38:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:38:31.997430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2f8a355a-b26c-4089-9a73-0d60219f46b4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:31.998429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2f8a355a-b26c-4089-9a73-0d60219f46b4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:32.091192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2f8a355a-b26c-4089-9a73-0d60219f46b4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:32.098543 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2f8a355a-b26c-4089-9a73-0d60219f46b4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1094 microversion: 2.1 time: 0.109290 Aug 27 05:38:32.100420 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3364/6732] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:31 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1094 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:32.279317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-833ade7b-46cb-49c5-91bd-cbe734cfae05 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:32.280246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-833ade7b-46cb-49c5-91bd-cbe734cfae05 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:32.286885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-833ade7b-46cb-49c5-91bd-cbe734cfae05 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:32.287409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-833ade7b-46cb-49c5-91bd-cbe734cfae05 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:32.288447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-833ade7b-46cb-49c5-91bd-cbe734cfae05 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:32.289418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-833ade7b-46cb-49c5-91bd-cbe734cfae05 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:32.290041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-833ade7b-46cb-49c5-91bd-cbe734cfae05 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:32.290807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-833ade7b-46cb-49c5-91bd-cbe734cfae05 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:32.492560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-833ade7b-46cb-49c5-91bd-cbe734cfae05 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:32.505922 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-833ade7b-46cb-49c5-91bd-cbe734cfae05 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.231241 Aug 27 05:38:32.507223 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3369/6733] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:32 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:33.125018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b08603cc-9352-4d61-91e3-1b74c5e318ac tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:33.126168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b08603cc-9352-4d61-91e3-1b74c5e318ac tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:33.134213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b08603cc-9352-4d61-91e3-1b74c5e318ac tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:33.134736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b08603cc-9352-4d61-91e3-1b74c5e318ac tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:33.135225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b08603cc-9352-4d61-91e3-1b74c5e318ac tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:33.135970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b08603cc-9352-4d61-91e3-1b74c5e318ac tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:33.136464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b08603cc-9352-4d61-91e3-1b74c5e318ac tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:33.136894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b08603cc-9352-4d61-91e3-1b74c5e318ac tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:33.217748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b08603cc-9352-4d61-91e3-1b74c5e318ac tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:33.226110 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b08603cc-9352-4d61-91e3-1b74c5e318ac tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1192 microversion: 2.1 time: 0.105048 Aug 27 05:38:33.227114 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3365/6734] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:33 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:33.531152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a580dd23-bf15-4aaf-b7e4-820622097411 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:33.531910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a580dd23-bf15-4aaf-b7e4-820622097411 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:33.543781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a580dd23-bf15-4aaf-b7e4-820622097411 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:33.544584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a580dd23-bf15-4aaf-b7e4-820622097411 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:33.545212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a580dd23-bf15-4aaf-b7e4-820622097411 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:33.546247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a580dd23-bf15-4aaf-b7e4-820622097411 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:33.546878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a580dd23-bf15-4aaf-b7e4-820622097411 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:33.547511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a580dd23-bf15-4aaf-b7e4-820622097411 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:34.249664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0c9be55b-c96d-465e-ba06-dd55a6b682f8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:34.251134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0c9be55b-c96d-465e-ba06-dd55a6b682f8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:34.271325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c9be55b-c96d-465e-ba06-dd55a6b682f8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:34.272366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c9be55b-c96d-465e-ba06-dd55a6b682f8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:34.273101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c9be55b-c96d-465e-ba06-dd55a6b682f8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:34.275626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c9be55b-c96d-465e-ba06-dd55a6b682f8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:34.276530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c9be55b-c96d-465e-ba06-dd55a6b682f8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:34.277614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0c9be55b-c96d-465e-ba06-dd55a6b682f8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:34.332193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a580dd23-bf15-4aaf-b7e4-820622097411 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:34.352566 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a580dd23-bf15-4aaf-b7e4-820622097411 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.826470 Aug 27 05:38:34.354443 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3370/6735] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:33 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:34.408277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0c9be55b-c96d-465e-ba06-dd55a6b682f8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:34.423475 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0c9be55b-c96d-465e-ba06-dd55a6b682f8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1210 microversion: 2.1 time: 0.178151 Aug 27 05:38:34.424085 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3366/6736] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:34 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1210 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:35.377307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f494805-659f-46bf-86d0-351643d04d56 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:35.378039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4f494805-659f-46bf-86d0-351643d04d56 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:35.388431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f494805-659f-46bf-86d0-351643d04d56 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:35.389126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f494805-659f-46bf-86d0-351643d04d56 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:35.389746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f494805-659f-46bf-86d0-351643d04d56 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:35.390637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f494805-659f-46bf-86d0-351643d04d56 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:35.391298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f494805-659f-46bf-86d0-351643d04d56 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:35.391897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f494805-659f-46bf-86d0-351643d04d56 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:35.448486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23ca1b25-0122-4037-b566-ec7b9dbc6540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:35.450466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-23ca1b25-0122-4037-b566-ec7b9dbc6540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:35.462524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ca1b25-0122-4037-b566-ec7b9dbc6540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:35.463397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ca1b25-0122-4037-b566-ec7b9dbc6540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:35.464186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ca1b25-0122-4037-b566-ec7b9dbc6540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:35.465086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ca1b25-0122-4037-b566-ec7b9dbc6540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:35.465932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ca1b25-0122-4037-b566-ec7b9dbc6540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:35.466931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23ca1b25-0122-4037-b566-ec7b9dbc6540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:35.716915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f494805-659f-46bf-86d0-351643d04d56 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:35.725544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:35.731299 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f494805-659f-46bf-86d0-351643d04d56 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.358651 Aug 27 05:38:35.736242 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3371/6737] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:35 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:35.784297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23ca1b25-0122-4037-b566-ec7b9dbc6540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:35.793431 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-23ca1b25-0122-4037-b566-ec7b9dbc6540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1277 microversion: 2.1 time: 0.350978 Aug 27 05:38:35.795028 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3367/6738] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:35 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1277 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:36.261636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-fb9f2bd0-0131-4398-93ef-2c7840e90c4e req-68b6617c-a44c-4237-a442-71116078e926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50491414-dbda-4377-aa35-053da472571d", "tag": "d12f37c0-6d8a-4826-b0e6-1541625ef9bb"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:36.275677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fb9f2bd0-0131-4398-93ef-2c7840e90c4e req-68b6617c-a44c-4237-a442-71116078e926 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:36.276500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fb9f2bd0-0131-4398-93ef-2c7840e90c4e req-68b6617c-a44c-4237-a442-71116078e926 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:36.277256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fb9f2bd0-0131-4398-93ef-2c7840e90c4e req-68b6617c-a44c-4237-a442-71116078e926 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:36.291067 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-fb9f2bd0-0131-4398-93ef-2c7840e90c4e req-68b6617c-a44c-4237-a442-71116078e926 service nova] Creating event network-changed:d12f37c0-6d8a-4826-b0e6-1541625ef9bb for instance 50491414-dbda-4377-aa35-053da472571d on n-h1-820368-35 Aug 27 05:38:36.299509 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-fb9f2bd0-0131-4398-93ef-2c7840e90c4e req-68b6617c-a44c-4237-a442-71116078e926 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045733 Aug 27 05:38:36.300623 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3372/6739] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:36.764073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b39ec692-fce3-4c21-99d8-e89f1bd20c67 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:36.766123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b39ec692-fce3-4c21-99d8-e89f1bd20c67 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:36.792213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b39ec692-fce3-4c21-99d8-e89f1bd20c67 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:36.793019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b39ec692-fce3-4c21-99d8-e89f1bd20c67 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:36.793662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b39ec692-fce3-4c21-99d8-e89f1bd20c67 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:36.795359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b39ec692-fce3-4c21-99d8-e89f1bd20c67 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:36.796027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b39ec692-fce3-4c21-99d8-e89f1bd20c67 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:36.796653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b39ec692-fce3-4c21-99d8-e89f1bd20c67 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:36.833473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7160311b-106e-42d2-9af9-896ab1f98b4d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:36.834424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7160311b-106e-42d2-9af9-896ab1f98b4d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:36.846620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7160311b-106e-42d2-9af9-896ab1f98b4d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:36.849094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7160311b-106e-42d2-9af9-896ab1f98b4d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:36.850075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7160311b-106e-42d2-9af9-896ab1f98b4d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:36.853629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7160311b-106e-42d2-9af9-896ab1f98b4d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:36.855577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7160311b-106e-42d2-9af9-896ab1f98b4d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:36.857379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7160311b-106e-42d2-9af9-896ab1f98b4d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:37.401974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7160311b-106e-42d2-9af9-896ab1f98b4d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:37.415016 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7160311b-106e-42d2-9af9-896ab1f98b4d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1277 microversion: 2.1 time: 0.594774 Aug 27 05:38:37.427823 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3373/6740] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:36 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1277 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:37.603354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b39ec692-fce3-4c21-99d8-e89f1bd20c67 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:37.615406 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b39ec692-fce3-4c21-99d8-e89f1bd20c67 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.857484 Aug 27 05:38:37.631118 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3368/6741] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:36 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:37.757051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1566320930", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "f97560fb-6221-4401-b605-5b76bec7b759"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:37.856976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] validate_networks() for [('f97560fb-6221-4401-b605-5b76bec7b759', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:38:38.391470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:38:38.392242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:38:38.392718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:38:38.393127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:38:38.393805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:38:38.403382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:38.403870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:38.404308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:38.405040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:38.405492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:38.405919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:38.425916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Getting quotas for project 8f998af974224d48a456cec52d80089d. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:38:38.432382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Getting quotas for user 359b51ca820c44d2b5c976c466ac3aed and project 8f998af974224d48a456cec52d80089d. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:38:38.440388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2974e234-fd38-489e-9ba2-95071daea053 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:38.441596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2974e234-fd38-489e-9ba2-95071daea053 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:38.456759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:38:38.459423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:38:38.462171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2974e234-fd38-489e-9ba2-95071daea053 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:38.463693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2974e234-fd38-489e-9ba2-95071daea053 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:38.470561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2974e234-fd38-489e-9ba2-95071daea053 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:38.471723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2974e234-fd38-489e-9ba2-95071daea053 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:38.472379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2974e234-fd38-489e-9ba2-95071daea053 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:38.473002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2974e234-fd38-489e-9ba2-95071daea053 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:38.531364 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b391b50d-eb7c-497b-a648-c310f20914d3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.027276 Aug 27 05:38:38.532751 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3374/6742] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:38:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:38:38.543698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b7f28937-a630-48ef-a8bc-8f69fb9cd8bc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:38.545303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b7f28937-a630-48ef-a8bc-8f69fb9cd8bc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:38.671867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2974e234-fd38-489e-9ba2-95071daea053 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:38.674253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b7f28937-a630-48ef-a8bc-8f69fb9cd8bc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:38.676682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:38.684676 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2974e234-fd38-489e-9ba2-95071daea053 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1277 microversion: 2.1 time: 0.248020 Aug 27 05:38:38.685110 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b7f28937-a630-48ef-a8bc-8f69fb9cd8bc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1215 microversion: 2.1 time: 0.145277 Aug 27 05:38:38.688419 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3375/6743] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:38 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:38.689922 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3369/6744] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:38 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:38.708678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-270870c9-6bdd-4acf-a6af-66db205a22c4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:38.709236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-270870c9-6bdd-4acf-a6af-66db205a22c4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:38.718890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-270870c9-6bdd-4acf-a6af-66db205a22c4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:38.719617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-270870c9-6bdd-4acf-a6af-66db205a22c4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:38.720236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-270870c9-6bdd-4acf-a6af-66db205a22c4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:38.721118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-270870c9-6bdd-4acf-a6af-66db205a22c4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:38.721765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-270870c9-6bdd-4acf-a6af-66db205a22c4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:38.722424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-270870c9-6bdd-4acf-a6af-66db205a22c4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:38.945557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-270870c9-6bdd-4acf-a6af-66db205a22c4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:38.953661 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-270870c9-6bdd-4acf-a6af-66db205a22c4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.264384 Aug 27 05:38:38.954458 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3376/6745] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:38 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:39.719282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f23cea3f-3afb-4c95-a9ca-d14a44dee772 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:39.723864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f23cea3f-3afb-4c95-a9ca-d14a44dee772 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:39.727207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-798352b8-edb5-4425-8989-8edff60c5400 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:39.731825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-798352b8-edb5-4425-8989-8edff60c5400 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:39.741684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-798352b8-edb5-4425-8989-8edff60c5400 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:39.742444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23cea3f-3afb-4c95-a9ca-d14a44dee772 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:39.742634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-798352b8-edb5-4425-8989-8edff60c5400 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:39.742997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23cea3f-3afb-4c95-a9ca-d14a44dee772 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:39.743319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-798352b8-edb5-4425-8989-8edff60c5400 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:39.743447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23cea3f-3afb-4c95-a9ca-d14a44dee772 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:39.744112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23cea3f-3afb-4c95-a9ca-d14a44dee772 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:39.744634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23cea3f-3afb-4c95-a9ca-d14a44dee772 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:39.744774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-798352b8-edb5-4425-8989-8edff60c5400 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:39.745310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-798352b8-edb5-4425-8989-8edff60c5400 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:39.745446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23cea3f-3afb-4c95-a9ca-d14a44dee772 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:39.746123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-798352b8-edb5-4425-8989-8edff60c5400 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:39.839991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f23cea3f-3afb-4c95-a9ca-d14a44dee772 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:39.857568 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f23cea3f-3afb-4c95-a9ca-d14a44dee772 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1267 microversion: 2.1 time: 0.142782 Aug 27 05:38:39.859152 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3377/6746] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:39 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:39.970966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-798352b8-edb5-4425-8989-8edff60c5400 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:39.975869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5feb3fbc-318c-4625-80ba-32b70d54ffc5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:39.976494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5feb3fbc-318c-4625-80ba-32b70d54ffc5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:39.984951 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-798352b8-edb5-4425-8989-8edff60c5400 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1277 microversion: 2.1 time: 0.278607 Aug 27 05:38:39.998739 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3370/6747] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:39 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1277 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:40.001126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5feb3fbc-318c-4625-80ba-32b70d54ffc5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:40.003823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5feb3fbc-318c-4625-80ba-32b70d54ffc5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:40.006553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5feb3fbc-318c-4625-80ba-32b70d54ffc5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:40.009067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5feb3fbc-318c-4625-80ba-32b70d54ffc5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:40.011750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5feb3fbc-318c-4625-80ba-32b70d54ffc5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:40.012407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5feb3fbc-318c-4625-80ba-32b70d54ffc5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:40.210844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5feb3fbc-318c-4625-80ba-32b70d54ffc5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:40.218755 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5feb3fbc-318c-4625-80ba-32b70d54ffc5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.247407 Aug 27 05:38:40.219545 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3378/6748] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:39 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:40.882117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-35856413-601f-4b0c-991f-1880c82a9008 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:40.883001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-35856413-601f-4b0c-991f-1880c82a9008 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:40.891565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35856413-601f-4b0c-991f-1880c82a9008 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:40.892080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35856413-601f-4b0c-991f-1880c82a9008 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:40.893109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35856413-601f-4b0c-991f-1880c82a9008 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:40.893785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35856413-601f-4b0c-991f-1880c82a9008 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:40.894257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35856413-601f-4b0c-991f-1880c82a9008 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:40.894698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35856413-601f-4b0c-991f-1880c82a9008 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:41.008085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b20de27b-22d5-4714-bd38-1201ca716717 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:41.015872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b20de27b-22d5-4714-bd38-1201ca716717 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:41.026300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b20de27b-22d5-4714-bd38-1201ca716717 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:41.026790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b20de27b-22d5-4714-bd38-1201ca716717 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:41.027259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b20de27b-22d5-4714-bd38-1201ca716717 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:41.028671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b20de27b-22d5-4714-bd38-1201ca716717 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:41.029334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b20de27b-22d5-4714-bd38-1201ca716717 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:41.029868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b20de27b-22d5-4714-bd38-1201ca716717 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:41.065142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-35856413-601f-4b0c-991f-1880c82a9008 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:41.083831 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-35856413-601f-4b0c-991f-1880c82a9008 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1315 microversion: 2.1 time: 0.205483 Aug 27 05:38:41.085637 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3371/6749] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:40 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:41.185784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b20de27b-22d5-4714-bd38-1201ca716717 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:41.193741 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b20de27b-22d5-4714-bd38-1201ca716717 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.191488 Aug 27 05:38:41.194888 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3379/6750] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:41 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:41.244869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-62f32eb8-9582-4577-b936-c7999c24393c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:41.245643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-62f32eb8-9582-4577-b936-c7999c24393c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:41.258485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f32eb8-9582-4577-b936-c7999c24393c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:41.259556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f32eb8-9582-4577-b936-c7999c24393c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:41.260725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f32eb8-9582-4577-b936-c7999c24393c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:41.262009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f32eb8-9582-4577-b936-c7999c24393c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:41.263273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f32eb8-9582-4577-b936-c7999c24393c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:41.264452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62f32eb8-9582-4577-b936-c7999c24393c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:41.436637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-62f32eb8-9582-4577-b936-c7999c24393c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:41.443824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-682cba94-ef7c-4a51-90cc-32b6e304de81 req-70094cab-5436-4e9e-98e9-dc5c645c1f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef71c5f9-b745-4590-acfc-8b8e5a5c5c26", "tag": "01ad1035-d29b-4e22-92c7-60526bee1868"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:41.444761 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-62f32eb8-9582-4577-b936-c7999c24393c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.207673 Aug 27 05:38:41.453311 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3372/6751] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:41 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:41.457188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-682cba94-ef7c-4a51-90cc-32b6e304de81 req-70094cab-5436-4e9e-98e9-dc5c645c1f1d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:41.457842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-682cba94-ef7c-4a51-90cc-32b6e304de81 req-70094cab-5436-4e9e-98e9-dc5c645c1f1d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:41.458478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-682cba94-ef7c-4a51-90cc-32b6e304de81 req-70094cab-5436-4e9e-98e9-dc5c645c1f1d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:41.470483 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-682cba94-ef7c-4a51-90cc-32b6e304de81 req-70094cab-5436-4e9e-98e9-dc5c645c1f1d service nova] Creating event network-changed:01ad1035-d29b-4e22-92c7-60526bee1868 for instance ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 on n-h2-820368-35 Aug 27 05:38:41.476202 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-682cba94-ef7c-4a51-90cc-32b6e304de81 req-70094cab-5436-4e9e-98e9-dc5c645c1f1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037312 Aug 27 05:38:41.476985 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3380/6752] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:38:42.106533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-800fe76f-e82a-4eaa-982f-203628a430b3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:42.107256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-800fe76f-e82a-4eaa-982f-203628a430b3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:42.109964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:42.115138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-800fe76f-e82a-4eaa-982f-203628a430b3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:42.115649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-800fe76f-e82a-4eaa-982f-203628a430b3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:42.116697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-800fe76f-e82a-4eaa-982f-203628a430b3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:42.117419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-800fe76f-e82a-4eaa-982f-203628a430b3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:42.117983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-800fe76f-e82a-4eaa-982f-203628a430b3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:42.118423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-800fe76f-e82a-4eaa-982f-203628a430b3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:42.216859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-15a79f2a-1e75-4b08-99b4-fc2b1deccd0d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:42.217563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-15a79f2a-1e75-4b08-99b4-fc2b1deccd0d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:42.224006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15a79f2a-1e75-4b08-99b4-fc2b1deccd0d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:42.224493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15a79f2a-1e75-4b08-99b4-fc2b1deccd0d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:42.224930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15a79f2a-1e75-4b08-99b4-fc2b1deccd0d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:42.226180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15a79f2a-1e75-4b08-99b4-fc2b1deccd0d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:42.226639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15a79f2a-1e75-4b08-99b4-fc2b1deccd0d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:42.227076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15a79f2a-1e75-4b08-99b4-fc2b1deccd0d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:42.260346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-800fe76f-e82a-4eaa-982f-203628a430b3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:42.269710 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-800fe76f-e82a-4eaa-982f-203628a430b3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1315 microversion: 2.1 time: 0.167075 Aug 27 05:38:42.270799 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3373/6753] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:42 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:42.390611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15a79f2a-1e75-4b08-99b4-fc2b1deccd0d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:42.399548 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-15a79f2a-1e75-4b08-99b4-fc2b1deccd0d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.187792 Aug 27 05:38:42.400503 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3381/6754] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:42 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:42.468319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-168736a0-2704-4c8e-b9e2-d7405826cc3b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:42.469065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-168736a0-2704-4c8e-b9e2-d7405826cc3b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:42.476233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-168736a0-2704-4c8e-b9e2-d7405826cc3b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:42.476818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-168736a0-2704-4c8e-b9e2-d7405826cc3b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:42.477393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-168736a0-2704-4c8e-b9e2-d7405826cc3b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:42.478184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-168736a0-2704-4c8e-b9e2-d7405826cc3b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:42.478715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-168736a0-2704-4c8e-b9e2-d7405826cc3b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:42.479273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-168736a0-2704-4c8e-b9e2-d7405826cc3b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:42.639570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-168736a0-2704-4c8e-b9e2-d7405826cc3b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:42.649149 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-168736a0-2704-4c8e-b9e2-d7405826cc3b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1695 microversion: 2.1 time: 0.185394 Aug 27 05:38:42.665095 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3374/6755] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:42 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:43.243717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-674c3d67-e21c-4ed8-9dce-f8b0db746e20 req-72fa6080-eec8-439d-8bce-6dde8b732f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a861091e-e236-4038-916e-474e77bf6435", "name": "network-vif-unplugged", "status": "completed", "tag": "d8cb1fd4-5dff-4920-aca4-525f1ec4f880"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:43.258114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-674c3d67-e21c-4ed8-9dce-f8b0db746e20 req-72fa6080-eec8-439d-8bce-6dde8b732f38 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:43.258592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-674c3d67-e21c-4ed8-9dce-f8b0db746e20 req-72fa6080-eec8-439d-8bce-6dde8b732f38 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:43.259266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-674c3d67-e21c-4ed8-9dce-f8b0db746e20 req-72fa6080-eec8-439d-8bce-6dde8b732f38 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:43.275392 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-674c3d67-e21c-4ed8-9dce-f8b0db746e20 req-72fa6080-eec8-439d-8bce-6dde8b732f38 service nova] Creating event network-vif-unplugged:d8cb1fd4-5dff-4920-aca4-525f1ec4f880 for instance a861091e-e236-4038-916e-474e77bf6435 on n-h1-820368-35 Aug 27 05:38:43.281262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-674c3d67-e21c-4ed8-9dce-f8b0db746e20 req-72fa6080-eec8-439d-8bce-6dde8b732f38 service nova] Instance a861091e-e236-4038-916e-474e77bf6435 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:38:43.291880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f983fc40-a0cd-4c1f-8983-4b9ce70f7628 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:43.293150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f983fc40-a0cd-4c1f-8983-4b9ce70f7628 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:43.300415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f983fc40-a0cd-4c1f-8983-4b9ce70f7628 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:43.301245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f983fc40-a0cd-4c1f-8983-4b9ce70f7628 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:43.301699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f983fc40-a0cd-4c1f-8983-4b9ce70f7628 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:43.302433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f983fc40-a0cd-4c1f-8983-4b9ce70f7628 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:43.302891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f983fc40-a0cd-4c1f-8983-4b9ce70f7628 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:43.304067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f983fc40-a0cd-4c1f-8983-4b9ce70f7628 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:43.320561 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-674c3d67-e21c-4ed8-9dce-f8b0db746e20 req-72fa6080-eec8-439d-8bce-6dde8b732f38 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082797 Aug 27 05:38:43.321707 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3382/6756] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:43.422085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f04bb6c-4f61-4c22-8f44-3fbfce274528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:43.423275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f04bb6c-4f61-4c22-8f44-3fbfce274528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:43.430457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f04bb6c-4f61-4c22-8f44-3fbfce274528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:43.431396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f04bb6c-4f61-4c22-8f44-3fbfce274528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:43.432060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f04bb6c-4f61-4c22-8f44-3fbfce274528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:43.432841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f04bb6c-4f61-4c22-8f44-3fbfce274528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:43.433546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f04bb6c-4f61-4c22-8f44-3fbfce274528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:43.434049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f04bb6c-4f61-4c22-8f44-3fbfce274528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:43.649315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f983fc40-a0cd-4c1f-8983-4b9ce70f7628 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:43.658027 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f983fc40-a0cd-4c1f-8983-4b9ce70f7628 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1315 microversion: 2.1 time: 0.370909 Aug 27 05:38:43.659460 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3375/6757] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:43 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:43.675746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c5e74ddf-60b0-4673-a8e7-4ed01bad7c92 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:43.676660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c5e74ddf-60b0-4673-a8e7-4ed01bad7c92 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:43.685462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e74ddf-60b0-4673-a8e7-4ed01bad7c92 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:43.685971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e74ddf-60b0-4673-a8e7-4ed01bad7c92 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:43.686420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e74ddf-60b0-4673-a8e7-4ed01bad7c92 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:43.687463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e74ddf-60b0-4673-a8e7-4ed01bad7c92 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:43.688021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e74ddf-60b0-4673-a8e7-4ed01bad7c92 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:43.688586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5e74ddf-60b0-4673-a8e7-4ed01bad7c92 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:44.038350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f04bb6c-4f61-4c22-8f44-3fbfce274528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:44.054673 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f04bb6c-4f61-4c22-8f44-3fbfce274528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.636956 Aug 27 05:38:44.055485 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3383/6758] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:43 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:44.153112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c5e74ddf-60b0-4673-a8e7-4ed01bad7c92 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:44.161897 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c5e74ddf-60b0-4673-a8e7-4ed01bad7c92 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1694 microversion: 2.1 time: 0.491449 Aug 27 05:38:44.162593 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3376/6759] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:43 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1694 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:44.680860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-630e16c6-88d5-44e4-9b75-bcaa7e51a0de tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:44.681861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-630e16c6-88d5-44e4-9b75-bcaa7e51a0de tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:44.689419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-630e16c6-88d5-44e4-9b75-bcaa7e51a0de tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:44.689914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-630e16c6-88d5-44e4-9b75-bcaa7e51a0de tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:44.690357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-630e16c6-88d5-44e4-9b75-bcaa7e51a0de tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:44.691529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-630e16c6-88d5-44e4-9b75-bcaa7e51a0de tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:44.692022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-630e16c6-88d5-44e4-9b75-bcaa7e51a0de tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:44.692278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-630e16c6-88d5-44e4-9b75-bcaa7e51a0de tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:44.888077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-630e16c6-88d5-44e4-9b75-bcaa7e51a0de tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:44.899322 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-630e16c6-88d5-44e4-9b75-bcaa7e51a0de tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1315 microversion: 2.1 time: 0.222880 Aug 27 05:38:44.899923 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3384/6760] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:44 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:45.076467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c48108d1-75d5-4989-abe0-3e31d4394c28 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:45.076467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c48108d1-75d5-4989-abe0-3e31d4394c28 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:45.083553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c48108d1-75d5-4989-abe0-3e31d4394c28 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:45.084136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c48108d1-75d5-4989-abe0-3e31d4394c28 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:45.084805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c48108d1-75d5-4989-abe0-3e31d4394c28 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:45.085527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c48108d1-75d5-4989-abe0-3e31d4394c28 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:45.086006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c48108d1-75d5-4989-abe0-3e31d4394c28 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:45.086450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c48108d1-75d5-4989-abe0-3e31d4394c28 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:45.186245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-56970fff-9b1c-44e2-96cf-5386c64b7935 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:45.186926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-56970fff-9b1c-44e2-96cf-5386c64b7935 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:45.193109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56970fff-9b1c-44e2-96cf-5386c64b7935 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:45.193602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56970fff-9b1c-44e2-96cf-5386c64b7935 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:45.195038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56970fff-9b1c-44e2-96cf-5386c64b7935 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:45.195299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56970fff-9b1c-44e2-96cf-5386c64b7935 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:45.195754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56970fff-9b1c-44e2-96cf-5386c64b7935 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:45.196214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56970fff-9b1c-44e2-96cf-5386c64b7935 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:45.229733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c48108d1-75d5-4989-abe0-3e31d4394c28 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:45.248167 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c48108d1-75d5-4989-abe0-3e31d4394c28 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.175416 Aug 27 05:38:45.251397 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3377/6761] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:45 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:45.350776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-56970fff-9b1c-44e2-96cf-5386c64b7935 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:45.358900 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-56970fff-9b1c-44e2-96cf-5386c64b7935 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1692 microversion: 2.1 time: 0.179399 Aug 27 05:38:45.359681 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3385/6762] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:45 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:45.377746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-019c42ed-a97c-4afa-9610-ce570dca6466 req-73609af4-4485-4ea5-8f48-7359b817b0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a861091e-e236-4038-916e-474e77bf6435", "tag": "d8cb1fd4-5dff-4920-aca4-525f1ec4f880"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:45.387866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-019c42ed-a97c-4afa-9610-ce570dca6466 req-73609af4-4485-4ea5-8f48-7359b817b0b3 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:45.388363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-019c42ed-a97c-4afa-9610-ce570dca6466 req-73609af4-4485-4ea5-8f48-7359b817b0b3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:45.388838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-019c42ed-a97c-4afa-9610-ce570dca6466 req-73609af4-4485-4ea5-8f48-7359b817b0b3 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:45.401318 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-019c42ed-a97c-4afa-9610-ce570dca6466 req-73609af4-4485-4ea5-8f48-7359b817b0b3 service nova] Creating event network-changed:d8cb1fd4-5dff-4920-aca4-525f1ec4f880 for instance a861091e-e236-4038-916e-474e77bf6435 on n-h1-820368-35 Aug 27 05:38:45.407753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-019c42ed-a97c-4afa-9610-ce570dca6466 req-73609af4-4485-4ea5-8f48-7359b817b0b3 service nova] Instance a861091e-e236-4038-916e-474e77bf6435 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:38:45.418698 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-019c42ed-a97c-4afa-9610-ce570dca6466 req-73609af4-4485-4ea5-8f48-7359b817b0b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044631 Aug 27 05:38:45.419497 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3378/6763] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:45.920643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c357389-c495-4437-b26d-a7bdc233ae1e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:45.921513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c357389-c495-4437-b26d-a7bdc233ae1e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:45.941162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c357389-c495-4437-b26d-a7bdc233ae1e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:45.941574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c357389-c495-4437-b26d-a7bdc233ae1e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:45.942013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c357389-c495-4437-b26d-a7bdc233ae1e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:45.942731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c357389-c495-4437-b26d-a7bdc233ae1e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:45.943221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c357389-c495-4437-b26d-a7bdc233ae1e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:45.943649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c357389-c495-4437-b26d-a7bdc233ae1e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:46.085408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6c357389-c495-4437-b26d-a7bdc233ae1e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:46.100154 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c357389-c495-4437-b26d-a7bdc233ae1e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1315 microversion: 2.1 time: 0.183474 Aug 27 05:38:46.101290 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3386/6764] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:45 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:46.274410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ffddc181-4ecc-4c2f-a9dc-645f4873c693 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:46.275289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ffddc181-4ecc-4c2f-a9dc-645f4873c693 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:46.281456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ffddc181-4ecc-4c2f-a9dc-645f4873c693 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:46.281964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ffddc181-4ecc-4c2f-a9dc-645f4873c693 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:46.282418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ffddc181-4ecc-4c2f-a9dc-645f4873c693 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:46.283151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ffddc181-4ecc-4c2f-a9dc-645f4873c693 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:46.283624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ffddc181-4ecc-4c2f-a9dc-645f4873c693 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:46.284069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ffddc181-4ecc-4c2f-a9dc-645f4873c693 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:46.379939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-42b727d2-01c3-447b-855f-259743f42726 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:46.380859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-42b727d2-01c3-447b-855f-259743f42726 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:46.384945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:46.389703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42b727d2-01c3-447b-855f-259743f42726 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:46.390452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42b727d2-01c3-447b-855f-259743f42726 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:46.391127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42b727d2-01c3-447b-855f-259743f42726 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:46.391884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42b727d2-01c3-447b-855f-259743f42726 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:46.392336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42b727d2-01c3-447b-855f-259743f42726 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:46.392769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-42b727d2-01c3-447b-855f-259743f42726 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:46.448127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ffddc181-4ecc-4c2f-a9dc-645f4873c693 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:46.456663 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ffddc181-4ecc-4c2f-a9dc-645f4873c693 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.188111 Aug 27 05:38:46.457703 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3379/6765] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:46 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:46.544795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-42b727d2-01c3-447b-855f-259743f42726 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:46.552636 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-42b727d2-01c3-447b-855f-259743f42726 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1692 microversion: 2.1 time: 0.176558 Aug 27 05:38:46.553217 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3387/6766] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:46 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:47.121874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-50ef00a5-f0f9-447f-b065-5ce1acaeab75 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:47.122518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-50ef00a5-f0f9-447f-b065-5ce1acaeab75 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:47.128729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50ef00a5-f0f9-447f-b065-5ce1acaeab75 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:47.129232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50ef00a5-f0f9-447f-b065-5ce1acaeab75 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:47.129685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50ef00a5-f0f9-447f-b065-5ce1acaeab75 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:47.130399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50ef00a5-f0f9-447f-b065-5ce1acaeab75 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:47.130865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50ef00a5-f0f9-447f-b065-5ce1acaeab75 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:47.131349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50ef00a5-f0f9-447f-b065-5ce1acaeab75 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:47.280119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-50ef00a5-f0f9-447f-b065-5ce1acaeab75 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:47.290735 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-50ef00a5-f0f9-447f-b065-5ce1acaeab75 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1315 microversion: 2.1 time: 0.172733 Aug 27 05:38:47.291701 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3380/6767] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:47 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:47.479783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b7fc0e2a-7dff-42d1-aece-138481de8540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:47.480438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b7fc0e2a-7dff-42d1-aece-138481de8540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:47.502680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7fc0e2a-7dff-42d1-aece-138481de8540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:47.504529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7fc0e2a-7dff-42d1-aece-138481de8540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:47.504529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7fc0e2a-7dff-42d1-aece-138481de8540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:47.504773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7fc0e2a-7dff-42d1-aece-138481de8540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:47.505111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7fc0e2a-7dff-42d1-aece-138481de8540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:47.505589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7fc0e2a-7dff-42d1-aece-138481de8540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:47.575118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-482cace5-777c-46f7-9732-796ab04daaa7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:47.575738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-482cace5-777c-46f7-9732-796ab04daaa7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:47.581752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482cace5-777c-46f7-9732-796ab04daaa7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:47.582254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482cace5-777c-46f7-9732-796ab04daaa7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:47.582702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482cace5-777c-46f7-9732-796ab04daaa7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:47.583432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482cace5-777c-46f7-9732-796ab04daaa7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:47.584192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482cace5-777c-46f7-9732-796ab04daaa7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:47.584633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-482cace5-777c-46f7-9732-796ab04daaa7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:47.679313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b7fc0e2a-7dff-42d1-aece-138481de8540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:47.688159 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b7fc0e2a-7dff-42d1-aece-138481de8540 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.213262 Aug 27 05:38:47.689178 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3388/6768] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:47 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:47.757490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-482cace5-777c-46f7-9732-796ab04daaa7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:47.766032 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-482cace5-777c-46f7-9732-796ab04daaa7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1692 microversion: 2.1 time: 0.195615 Aug 27 05:38:47.766608 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3381/6769] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:47 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1692 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:48.312898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b03f4c0b-0def-428e-98b0-2ded48c2adc7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:48.313766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b03f4c0b-0def-428e-98b0-2ded48c2adc7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:48.320668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b03f4c0b-0def-428e-98b0-2ded48c2adc7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:48.321184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b03f4c0b-0def-428e-98b0-2ded48c2adc7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:48.321671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b03f4c0b-0def-428e-98b0-2ded48c2adc7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:48.322380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b03f4c0b-0def-428e-98b0-2ded48c2adc7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:48.322831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b03f4c0b-0def-428e-98b0-2ded48c2adc7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:48.323281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b03f4c0b-0def-428e-98b0-2ded48c2adc7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:48.414943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:48.457887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b03f4c0b-0def-428e-98b0-2ded48c2adc7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:48.466209 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b03f4c0b-0def-428e-98b0-2ded48c2adc7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1315 microversion: 2.1 time: 0.157779 Aug 27 05:38:48.466800 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3389/6770] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:48 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:48.715143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-84f4106b-ea7f-4e77-8e4f-e0af2d4b1d67 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:48.716122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-84f4106b-ea7f-4e77-8e4f-e0af2d4b1d67 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:48.724565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84f4106b-ea7f-4e77-8e4f-e0af2d4b1d67 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:48.725218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84f4106b-ea7f-4e77-8e4f-e0af2d4b1d67 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:48.726564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84f4106b-ea7f-4e77-8e4f-e0af2d4b1d67 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:48.727526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84f4106b-ea7f-4e77-8e4f-e0af2d4b1d67 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:48.728156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84f4106b-ea7f-4e77-8e4f-e0af2d4b1d67 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:48.728757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84f4106b-ea7f-4e77-8e4f-e0af2d4b1d67 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:48.789121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-310a3a8d-bcce-4378-b4d4-e16e39aa6822 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:48.790446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-310a3a8d-bcce-4378-b4d4-e16e39aa6822 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:48.794666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=14 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:48.802465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-310a3a8d-bcce-4378-b4d4-e16e39aa6822 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:48.805419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-310a3a8d-bcce-4378-b4d4-e16e39aa6822 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:48.808040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-310a3a8d-bcce-4378-b4d4-e16e39aa6822 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:48.809010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-310a3a8d-bcce-4378-b4d4-e16e39aa6822 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:48.809652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-310a3a8d-bcce-4378-b4d4-e16e39aa6822 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:48.810798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-310a3a8d-bcce-4378-b4d4-e16e39aa6822 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:48.957171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-84f4106b-ea7f-4e77-8e4f-e0af2d4b1d67 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:48.969651 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-84f4106b-ea7f-4e77-8e4f-e0af2d4b1d67 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.258065 Aug 27 05:38:48.970805 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3382/6771] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:48 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:48.995379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-310a3a8d-bcce-4378-b4d4-e16e39aa6822 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:49.004557 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-310a3a8d-bcce-4378-b4d4-e16e39aa6822 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1692 microversion: 2.1 time: 0.220142 Aug 27 05:38:49.005247 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3390/6772] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:48 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1692 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:49.489917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b80b60c4-0f61-4c6f-a504-dcd7506a0e7a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:49.490838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b80b60c4-0f61-4c6f-a504-dcd7506a0e7a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:49.498585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b80b60c4-0f61-4c6f-a504-dcd7506a0e7a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:49.499131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b80b60c4-0f61-4c6f-a504-dcd7506a0e7a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:49.499588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b80b60c4-0f61-4c6f-a504-dcd7506a0e7a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:49.500322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b80b60c4-0f61-4c6f-a504-dcd7506a0e7a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:49.500841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b80b60c4-0f61-4c6f-a504-dcd7506a0e7a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:49.511807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b80b60c4-0f61-4c6f-a504-dcd7506a0e7a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:49.727794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b80b60c4-0f61-4c6f-a504-dcd7506a0e7a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:49.736038 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b80b60c4-0f61-4c6f-a504-dcd7506a0e7a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1315 microversion: 2.1 time: 0.250069 Aug 27 05:38:49.736806 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3383/6773] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:49 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:49.992904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90692520-c9cd-4ec4-a9c7-53cadf06d333 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:49.993466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-90692520-c9cd-4ec4-a9c7-53cadf06d333 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:50.000474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90692520-c9cd-4ec4-a9c7-53cadf06d333 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:50.000969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90692520-c9cd-4ec4-a9c7-53cadf06d333 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:50.001417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90692520-c9cd-4ec4-a9c7-53cadf06d333 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:50.002128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90692520-c9cd-4ec4-a9c7-53cadf06d333 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:50.002594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90692520-c9cd-4ec4-a9c7-53cadf06d333 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:50.003034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-90692520-c9cd-4ec4-a9c7-53cadf06d333 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:50.026678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-123b1746-500c-4dc8-81ed-b55f2dde647e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:50.027853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-123b1746-500c-4dc8-81ed-b55f2dde647e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:50.031259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=71 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:50.040208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123b1746-500c-4dc8-81ed-b55f2dde647e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:50.045767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123b1746-500c-4dc8-81ed-b55f2dde647e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:50.046330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123b1746-500c-4dc8-81ed-b55f2dde647e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:50.047403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123b1746-500c-4dc8-81ed-b55f2dde647e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:50.047978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123b1746-500c-4dc8-81ed-b55f2dde647e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:50.048492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-123b1746-500c-4dc8-81ed-b55f2dde647e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:50.222028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-90692520-c9cd-4ec4-a9c7-53cadf06d333 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:50.225559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:50.236607 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90692520-c9cd-4ec4-a9c7-53cadf06d333 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.247775 Aug 27 05:38:50.247649 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3391/6774] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:49 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:50.266599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-123b1746-500c-4dc8-81ed-b55f2dde647e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:50.277465 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-123b1746-500c-4dc8-81ed-b55f2dde647e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1689 microversion: 2.1 time: 0.255089 Aug 27 05:38:50.279429 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3384/6775] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:50 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1689 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:50.303074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1d1ca9d2-e56f-48ec-8a0c-b341ef475a4c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:50.304434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1d1ca9d2-e56f-48ec-8a0c-b341ef475a4c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:50.313002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d1ca9d2-e56f-48ec-8a0c-b341ef475a4c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:50.313284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d1ca9d2-e56f-48ec-8a0c-b341ef475a4c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:50.318532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d1ca9d2-e56f-48ec-8a0c-b341ef475a4c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:50.319918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d1ca9d2-e56f-48ec-8a0c-b341ef475a4c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:50.325510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d1ca9d2-e56f-48ec-8a0c-b341ef475a4c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:50.326051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d1ca9d2-e56f-48ec-8a0c-b341ef475a4c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:50.352882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7a2c5007-1e2c-4f97-aecd-9769b8e75e93 req-2387eea6-bcf9-42a9-8712-a5d89b506b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef71c5f9-b745-4590-acfc-8b8e5a5c5c26", "name": "network-vif-plugged", "status": "completed", "tag": "01ad1035-d29b-4e22-92c7-60526bee1868"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:50.363742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7a2c5007-1e2c-4f97-aecd-9769b8e75e93 req-2387eea6-bcf9-42a9-8712-a5d89b506b8d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:50.364593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7a2c5007-1e2c-4f97-aecd-9769b8e75e93 req-2387eea6-bcf9-42a9-8712-a5d89b506b8d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:50.365344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7a2c5007-1e2c-4f97-aecd-9769b8e75e93 req-2387eea6-bcf9-42a9-8712-a5d89b506b8d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:50.377645 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7a2c5007-1e2c-4f97-aecd-9769b8e75e93 req-2387eea6-bcf9-42a9-8712-a5d89b506b8d service nova] Creating event network-vif-plugged:01ad1035-d29b-4e22-92c7-60526bee1868 for instance ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 on n-h2-820368-35 Aug 27 05:38:50.383911 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7a2c5007-1e2c-4f97-aecd-9769b8e75e93 req-2387eea6-bcf9-42a9-8712-a5d89b506b8d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144104 Aug 27 05:38:50.384749 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3392/6776] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:50.413116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:50.463213 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1d1ca9d2-e56f-48ec-8a0c-b341ef475a4c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435/action" status: 202 len: 0 microversion: 2.1 time: 0.167060 Aug 27 05:38:50.463907 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3385/6777] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:38:50 2022] POST /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:38:50.482119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13e23f8a-82b0-4b13-9c20-0b8667a85c80 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:50.483965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-13e23f8a-82b0-4b13-9c20-0b8667a85c80 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:50.496631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13e23f8a-82b0-4b13-9c20-0b8667a85c80 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:50.499660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13e23f8a-82b0-4b13-9c20-0b8667a85c80 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:50.500752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13e23f8a-82b0-4b13-9c20-0b8667a85c80 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:50.502033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13e23f8a-82b0-4b13-9c20-0b8667a85c80 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:50.502534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13e23f8a-82b0-4b13-9c20-0b8667a85c80 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:50.502961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-13e23f8a-82b0-4b13-9c20-0b8667a85c80 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:50.736385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-13e23f8a-82b0-4b13-9c20-0b8667a85c80 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:50.746159 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-13e23f8a-82b0-4b13-9c20-0b8667a85c80 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1688 microversion: 2.1 time: 0.277264 Aug 27 05:38:50.746755 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3393/6778] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:50 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1688 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:50.759578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2efce469-5993-4720-a83e-c1da8ae503a3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:50.760913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2efce469-5993-4720-a83e-c1da8ae503a3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:50.770276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2efce469-5993-4720-a83e-c1da8ae503a3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:50.771060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2efce469-5993-4720-a83e-c1da8ae503a3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:50.771747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2efce469-5993-4720-a83e-c1da8ae503a3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:50.772494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2efce469-5993-4720-a83e-c1da8ae503a3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:50.773133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2efce469-5993-4720-a83e-c1da8ae503a3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:50.773766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2efce469-5993-4720-a83e-c1da8ae503a3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:51.022930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2efce469-5993-4720-a83e-c1da8ae503a3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:51.031286 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2efce469-5993-4720-a83e-c1da8ae503a3 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1315 microversion: 2.1 time: 0.276993 Aug 27 05:38:51.035431 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3386/6779] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:50 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:51.263887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a0ebf342-9afe-4240-accd-9adb8eae2ca0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:51.264511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a0ebf342-9afe-4240-accd-9adb8eae2ca0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:51.279537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0ebf342-9afe-4240-accd-9adb8eae2ca0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:51.280830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0ebf342-9afe-4240-accd-9adb8eae2ca0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:51.281486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0ebf342-9afe-4240-accd-9adb8eae2ca0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:51.282917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0ebf342-9afe-4240-accd-9adb8eae2ca0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:51.283629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0ebf342-9afe-4240-accd-9adb8eae2ca0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:51.284275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0ebf342-9afe-4240-accd-9adb8eae2ca0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:51.527242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a0ebf342-9afe-4240-accd-9adb8eae2ca0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:51.536552 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a0ebf342-9afe-4240-accd-9adb8eae2ca0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.282493 Aug 27 05:38:51.537138 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3394/6780] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:51 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:51.771218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3768a5b0-6918-4d2a-90ca-03a8625b1121 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:51.771882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3768a5b0-6918-4d2a-90ca-03a8625b1121 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:51.780789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3768a5b0-6918-4d2a-90ca-03a8625b1121 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:51.781816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3768a5b0-6918-4d2a-90ca-03a8625b1121 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:51.782567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3768a5b0-6918-4d2a-90ca-03a8625b1121 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:51.783455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3768a5b0-6918-4d2a-90ca-03a8625b1121 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:51.783929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3768a5b0-6918-4d2a-90ca-03a8625b1121 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:51.784437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3768a5b0-6918-4d2a-90ca-03a8625b1121 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:51.943266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3768a5b0-6918-4d2a-90ca-03a8625b1121 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:51.951560 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3768a5b0-6918-4d2a-90ca-03a8625b1121 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1688 microversion: 2.1 time: 0.186579 Aug 27 05:38:51.952241 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3387/6781] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:51 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:52.052730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-740016ca-a4e8-40c1-a120-d295a58e5b07 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:52.053410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-740016ca-a4e8-40c1-a120-d295a58e5b07 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:52.060141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-740016ca-a4e8-40c1-a120-d295a58e5b07 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.060631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-740016ca-a4e8-40c1-a120-d295a58e5b07 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.061110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-740016ca-a4e8-40c1-a120-d295a58e5b07 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.061842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-740016ca-a4e8-40c1-a120-d295a58e5b07 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.062303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-740016ca-a4e8-40c1-a120-d295a58e5b07 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.062863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-740016ca-a4e8-40c1-a120-d295a58e5b07 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.198339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-740016ca-a4e8-40c1-a120-d295a58e5b07 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:52.206016 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-740016ca-a4e8-40c1-a120-d295a58e5b07 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1502 microversion: 2.1 time: 0.157513 Aug 27 05:38:52.206593 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3395/6782] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:52 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:52.227293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0a851bd8-718e-42ad-b8e4-a91fa0f3950e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:52.227929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0a851bd8-718e-42ad-b8e4-a91fa0f3950e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:52.234068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a851bd8-718e-42ad-b8e4-a91fa0f3950e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.234568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a851bd8-718e-42ad-b8e4-a91fa0f3950e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.235067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a851bd8-718e-42ad-b8e4-a91fa0f3950e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.235846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a851bd8-718e-42ad-b8e4-a91fa0f3950e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.236317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a851bd8-718e-42ad-b8e4-a91fa0f3950e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.236759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a851bd8-718e-42ad-b8e4-a91fa0f3950e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.376079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0a851bd8-718e-42ad-b8e4-a91fa0f3950e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:52.384151 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0a851bd8-718e-42ad-b8e4-a91fa0f3950e tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1502 microversion: 2.1 time: 0.161321 Aug 27 05:38:52.384728 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3388/6783] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:52 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:52.401446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-a8fcf6a2-d237-461b-a5f6-2470363772bd req-94977208-c569-4a45-9225-2b30650e9901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a861091e-e236-4038-916e-474e77bf6435", "name": "network-vif-plugged", "status": "completed", "tag": "d8cb1fd4-5dff-4920-aca4-525f1ec4f880"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:52.406810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c35cb8d9-f749-485c-b0ed-bfd314e67987 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:52.407573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c35cb8d9-f749-485c-b0ed-bfd314e67987 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:52.414313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c35cb8d9-f749-485c-b0ed-bfd314e67987 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.414834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c35cb8d9-f749-485c-b0ed-bfd314e67987 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.415000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a8fcf6a2-d237-461b-a5f6-2470363772bd req-94977208-c569-4a45-9225-2b30650e9901 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.415337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c35cb8d9-f749-485c-b0ed-bfd314e67987 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.415998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a8fcf6a2-d237-461b-a5f6-2470363772bd req-94977208-c569-4a45-9225-2b30650e9901 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.416120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c35cb8d9-f749-485c-b0ed-bfd314e67987 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.416442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a8fcf6a2-d237-461b-a5f6-2470363772bd req-94977208-c569-4a45-9225-2b30650e9901 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.416559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c35cb8d9-f749-485c-b0ed-bfd314e67987 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.416946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c35cb8d9-f749-485c-b0ed-bfd314e67987 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.431388 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-a8fcf6a2-d237-461b-a5f6-2470363772bd req-94977208-c569-4a45-9225-2b30650e9901 service nova] Creating event network-vif-plugged:d8cb1fd4-5dff-4920-aca4-525f1ec4f880 for instance a861091e-e236-4038-916e-474e77bf6435 on n-h1-820368-35 Aug 27 05:38:52.437212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-a8fcf6a2-d237-461b-a5f6-2470363772bd req-94977208-c569-4a45-9225-2b30650e9901 service nova] Instance a861091e-e236-4038-916e-474e77bf6435 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:38:52.442466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-c35cb8d9-f749-485c-b0ed-bfd314e67987 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lazy-loading 'flavor' on Instance uuid ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:38:52.449196 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-a8fcf6a2-d237-461b-a5f6-2470363772bd req-94977208-c569-4a45-9225-2b30650e9901 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053741 Aug 27 05:38:52.450001 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3396/6784] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:52.512173 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c35cb8d9-f749-485c-b0ed-bfd314e67987 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "POST /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26/action" status: 202 len: 0 microversion: 2.1 time: 0.109085 Aug 27 05:38:52.512988 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3389/6785] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:38:52 2022] POST /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:38:52.521803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8fdabfb8-e6a9-4fea-83aa-34d5197bfaf2 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:52.523216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8fdabfb8-e6a9-4fea-83aa-34d5197bfaf2 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:52.529948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fdabfb8-e6a9-4fea-83aa-34d5197bfaf2 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.530585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fdabfb8-e6a9-4fea-83aa-34d5197bfaf2 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.531195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fdabfb8-e6a9-4fea-83aa-34d5197bfaf2 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.531913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fdabfb8-e6a9-4fea-83aa-34d5197bfaf2 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.532673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fdabfb8-e6a9-4fea-83aa-34d5197bfaf2 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.533272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fdabfb8-e6a9-4fea-83aa-34d5197bfaf2 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.559310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-446dbdf3-0c84-48e0-9bd4-e50b7f4b5631 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:52.559967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-446dbdf3-0c84-48e0-9bd4-e50b7f4b5631 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:52.566309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-446dbdf3-0c84-48e0-9bd4-e50b7f4b5631 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.566816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-446dbdf3-0c84-48e0-9bd4-e50b7f4b5631 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.567301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-446dbdf3-0c84-48e0-9bd4-e50b7f4b5631 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.568280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-446dbdf3-0c84-48e0-9bd4-e50b7f4b5631 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.568759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-446dbdf3-0c84-48e0-9bd4-e50b7f4b5631 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.569736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-446dbdf3-0c84-48e0-9bd4-e50b7f4b5631 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.744348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8fdabfb8-e6a9-4fea-83aa-34d5197bfaf2 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:52.754012 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8fdabfb8-e6a9-4fea-83aa-34d5197bfaf2 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1510 microversion: 2.1 time: 0.236416 Aug 27 05:38:52.754601 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3397/6786] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:52 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:52.775016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-446dbdf3-0c84-48e0-9bd4-e50b7f4b5631 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:52.784266 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-446dbdf3-0c84-48e0-9bd4-e50b7f4b5631 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.230091 Aug 27 05:38:52.785767 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3390/6787] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:52 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:52.974117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c1ef1c7-be4f-4831-b7bb-126c12e95d25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:52.975200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c1ef1c7-be4f-4831-b7bb-126c12e95d25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:52.983503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c1ef1c7-be4f-4831-b7bb-126c12e95d25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.984014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c1ef1c7-be4f-4831-b7bb-126c12e95d25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.984462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c1ef1c7-be4f-4831-b7bb-126c12e95d25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:52.985353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c1ef1c7-be4f-4831-b7bb-126c12e95d25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:52.985823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c1ef1c7-be4f-4831-b7bb-126c12e95d25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:52.986290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c1ef1c7-be4f-4831-b7bb-126c12e95d25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:53.144760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6c1ef1c7-be4f-4831-b7bb-126c12e95d25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:53.154036 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c1ef1c7-be4f-4831-b7bb-126c12e95d25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1688 microversion: 2.1 time: 0.184914 Aug 27 05:38:53.155133 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3398/6788] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:52 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:53.776530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e443cf2-4273-491a-a281-bac5dfca709f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:53.777373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1e443cf2-4273-491a-a281-bac5dfca709f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:53.783997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e443cf2-4273-491a-a281-bac5dfca709f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:53.784748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e443cf2-4273-491a-a281-bac5dfca709f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:53.785343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e443cf2-4273-491a-a281-bac5dfca709f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:53.786492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e443cf2-4273-491a-a281-bac5dfca709f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:53.787373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e443cf2-4273-491a-a281-bac5dfca709f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:53.788122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e443cf2-4273-491a-a281-bac5dfca709f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:53.810314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fc7c9397-16a9-4405-b2b0-f962b382ffc2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:53.810931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fc7c9397-16a9-4405-b2b0-f962b382ffc2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:53.818403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc7c9397-16a9-4405-b2b0-f962b382ffc2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:53.819238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc7c9397-16a9-4405-b2b0-f962b382ffc2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:53.820343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc7c9397-16a9-4405-b2b0-f962b382ffc2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:53.821421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc7c9397-16a9-4405-b2b0-f962b382ffc2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:53.822096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc7c9397-16a9-4405-b2b0-f962b382ffc2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:53.822695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc7c9397-16a9-4405-b2b0-f962b382ffc2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:54.039653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1e443cf2-4273-491a-a281-bac5dfca709f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:54.049071 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e443cf2-4273-491a-a281-bac5dfca709f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1493 microversion: 2.1 time: 0.276349 Aug 27 05:38:54.049930 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3391/6789] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:53 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1493 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:54.065956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fc7c9397-16a9-4405-b2b0-f962b382ffc2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:54.067352 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fc7c9397-16a9-4405-b2b0-f962b382ffc2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.260671 Aug 27 05:38:54.072228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-18b8b3e2-2b1f-471f-86e4-a1bdc42d943c tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:54.072852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-18b8b3e2-2b1f-471f-86e4-a1bdc42d943c tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:54.081582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18b8b3e2-2b1f-471f-86e4-a1bdc42d943c tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:54.082189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18b8b3e2-2b1f-471f-86e4-a1bdc42d943c tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:54.082414 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3399/6790] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:53 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:54.083043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18b8b3e2-2b1f-471f-86e4-a1bdc42d943c tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:54.083852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18b8b3e2-2b1f-471f-86e4-a1bdc42d943c tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:54.084400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18b8b3e2-2b1f-471f-86e4-a1bdc42d943c tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:54.084942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-18b8b3e2-2b1f-471f-86e4-a1bdc42d943c tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:54.174671 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-18b8b3e2-2b1f-471f-86e4-a1bdc42d943c tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "POST /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26/action" status: 202 len: 0 microversion: 2.1 time: 0.106926 Aug 27 05:38:54.175760 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3392/6791] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:38:54 2022] POST /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:38:54.182062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a40dce23-ba9a-4296-b49c-0a8ed160f37d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:54.183033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a40dce23-ba9a-4296-b49c-0a8ed160f37d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:54.191299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6e0517e0-0c5e-4092-b845-84d2f32323c6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:54.193157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6e0517e0-0c5e-4092-b845-84d2f32323c6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:54.195182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40dce23-ba9a-4296-b49c-0a8ed160f37d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:54.196001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40dce23-ba9a-4296-b49c-0a8ed160f37d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:54.197072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40dce23-ba9a-4296-b49c-0a8ed160f37d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:54.198317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40dce23-ba9a-4296-b49c-0a8ed160f37d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:54.199855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40dce23-ba9a-4296-b49c-0a8ed160f37d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:54.200794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a40dce23-ba9a-4296-b49c-0a8ed160f37d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:54.204066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e0517e0-0c5e-4092-b845-84d2f32323c6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:54.205153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e0517e0-0c5e-4092-b845-84d2f32323c6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:54.206107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e0517e0-0c5e-4092-b845-84d2f32323c6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:54.207892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e0517e0-0c5e-4092-b845-84d2f32323c6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:54.208554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e0517e0-0c5e-4092-b845-84d2f32323c6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:54.209112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6e0517e0-0c5e-4092-b845-84d2f32323c6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:54.513640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a40dce23-ba9a-4296-b49c-0a8ed160f37d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:54.516300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6e0517e0-0c5e-4092-b845-84d2f32323c6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:54.526808 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6e0517e0-0c5e-4092-b845-84d2f32323c6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1499 microversion: 2.1 time: 0.340477 Aug 27 05:38:54.531836 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a40dce23-ba9a-4296-b49c-0a8ed160f37d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1688 microversion: 2.1 time: 0.356086 Aug 27 05:38:54.532433 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3400/6792] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:54 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1688 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:54.533147 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3393/6793] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:54 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1499 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:54.540528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-11a2de54-1135-46cc-874c-051740ff688d req-d78ecc11-ded8-4517-bd4c-9ec7bd6f2810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50491414-dbda-4377-aa35-053da472571d", "name": "network-vif-plugged", "status": "completed", "tag": "d12f37c0-6d8a-4826-b0e6-1541625ef9bb"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:54.547064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-0e95e4d8-862c-4e8e-ab82-40439ab904d9 req-4f7a62d3-f68d-4e91-844f-5059326dd139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a861091e-e236-4038-916e-474e77bf6435", "name": "network-vif-unplugged", "status": "completed", "tag": "d8cb1fd4-5dff-4920-aca4-525f1ec4f880"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:54.571014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0e95e4d8-862c-4e8e-ab82-40439ab904d9 req-4f7a62d3-f68d-4e91-844f-5059326dd139 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:54.571819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-11a2de54-1135-46cc-874c-051740ff688d req-d78ecc11-ded8-4517-bd4c-9ec7bd6f2810 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:54.572382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-11a2de54-1135-46cc-874c-051740ff688d req-d78ecc11-ded8-4517-bd4c-9ec7bd6f2810 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:54.572885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0e95e4d8-862c-4e8e-ab82-40439ab904d9 req-4f7a62d3-f68d-4e91-844f-5059326dd139 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:54.573392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-11a2de54-1135-46cc-874c-051740ff688d req-d78ecc11-ded8-4517-bd4c-9ec7bd6f2810 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:54.573908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0e95e4d8-862c-4e8e-ab82-40439ab904d9 req-4f7a62d3-f68d-4e91-844f-5059326dd139 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:54.589751 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-11a2de54-1135-46cc-874c-051740ff688d req-d78ecc11-ded8-4517-bd4c-9ec7bd6f2810 service nova] Creating event network-vif-plugged:d12f37c0-6d8a-4826-b0e6-1541625ef9bb for instance 50491414-dbda-4377-aa35-053da472571d on n-h1-820368-35 Aug 27 05:38:54.613684 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-11a2de54-1135-46cc-874c-051740ff688d req-d78ecc11-ded8-4517-bd4c-9ec7bd6f2810 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077219 Aug 27 05:38:54.614682 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3394/6794] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:54.617053 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-0e95e4d8-862c-4e8e-ab82-40439ab904d9 req-4f7a62d3-f68d-4e91-844f-5059326dd139 service nova] Creating event network-vif-unplugged:d8cb1fd4-5dff-4920-aca4-525f1ec4f880 for instance a861091e-e236-4038-916e-474e77bf6435 on n-h2-820368-35 Aug 27 05:38:54.624932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-0e95e4d8-862c-4e8e-ab82-40439ab904d9 req-4f7a62d3-f68d-4e91-844f-5059326dd139 service nova] Instance a861091e-e236-4038-916e-474e77bf6435 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:38:54.648408 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-0e95e4d8-862c-4e8e-ab82-40439ab904d9 req-4f7a62d3-f68d-4e91-844f-5059326dd139 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113356 Aug 27 05:38:54.649355 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3401/6795] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:55.096987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c2d2b42d-725d-4c32-8d43-61e6450fd742 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:55.098801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c2d2b42d-725d-4c32-8d43-61e6450fd742 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:55.106472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2d2b42d-725d-4c32-8d43-61e6450fd742 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:55.106985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2d2b42d-725d-4c32-8d43-61e6450fd742 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:55.107683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2d2b42d-725d-4c32-8d43-61e6450fd742 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:55.108386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2d2b42d-725d-4c32-8d43-61e6450fd742 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:55.108859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2d2b42d-725d-4c32-8d43-61e6450fd742 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:55.109333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2d2b42d-725d-4c32-8d43-61e6450fd742 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:55.285042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c2d2b42d-725d-4c32-8d43-61e6450fd742 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:55.301395 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c2d2b42d-725d-4c32-8d43-61e6450fd742 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1265 microversion: 2.1 time: 0.214273 Aug 27 05:38:55.302002 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3395/6796] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:55 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:55.555908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-402d6377-3aae-4c11-b0b2-115bcbc8f1f7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:55.556698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-402d6377-3aae-4c11-b0b2-115bcbc8f1f7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:55.560641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-272efc49-4b2e-4660-80fa-36c763c719df tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:55.561290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-272efc49-4b2e-4660-80fa-36c763c719df tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:55.564215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-402d6377-3aae-4c11-b0b2-115bcbc8f1f7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:55.564799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-402d6377-3aae-4c11-b0b2-115bcbc8f1f7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:55.565598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-402d6377-3aae-4c11-b0b2-115bcbc8f1f7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:55.566586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-402d6377-3aae-4c11-b0b2-115bcbc8f1f7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:55.567277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-402d6377-3aae-4c11-b0b2-115bcbc8f1f7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:55.568060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-402d6377-3aae-4c11-b0b2-115bcbc8f1f7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:55.568394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-272efc49-4b2e-4660-80fa-36c763c719df tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:55.568907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-272efc49-4b2e-4660-80fa-36c763c719df tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:55.570432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-272efc49-4b2e-4660-80fa-36c763c719df tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:55.571306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-272efc49-4b2e-4660-80fa-36c763c719df tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:55.571892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-272efc49-4b2e-4660-80fa-36c763c719df tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:55.572521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-272efc49-4b2e-4660-80fa-36c763c719df tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:55.823454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-272efc49-4b2e-4660-80fa-36c763c719df tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:55.834280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-402d6377-3aae-4c11-b0b2-115bcbc8f1f7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:55.838607 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-272efc49-4b2e-4660-80fa-36c763c719df tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1499 microversion: 2.1 time: 0.281886 Aug 27 05:38:55.839577 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3396/6797] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:55 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1499 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:38:55.843178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-402d6377-3aae-4c11-b0b2-115bcbc8f1f7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1688 microversion: 2.1 time: 0.292914 Aug 27 05:38:55.843782 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3402/6798] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:55 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1688 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:56.327149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-71261825-1e99-498a-bd4d-d09e9316228f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:56.328646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-71261825-1e99-498a-bd4d-d09e9316228f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:56.336223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71261825-1e99-498a-bd4d-d09e9316228f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:56.336940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71261825-1e99-498a-bd4d-d09e9316228f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:56.337391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71261825-1e99-498a-bd4d-d09e9316228f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:56.338123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71261825-1e99-498a-bd4d-d09e9316228f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:56.338781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71261825-1e99-498a-bd4d-d09e9316228f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:56.339441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71261825-1e99-498a-bd4d-d09e9316228f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:56.488502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71261825-1e99-498a-bd4d-d09e9316228f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:56.497379 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-71261825-1e99-498a-bd4d-d09e9316228f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1453 microversion: 2.1 time: 0.176423 Aug 27 05:38:56.497961 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3397/6799] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:56 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:56.517730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f956a242-d354-45fe-831f-3a4f464732ab tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:56.518346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f956a242-d354-45fe-831f-3a4f464732ab tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:56.524841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f956a242-d354-45fe-831f-3a4f464732ab tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:56.525336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f956a242-d354-45fe-831f-3a4f464732ab tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:56.525776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f956a242-d354-45fe-831f-3a4f464732ab tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:56.526678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f956a242-d354-45fe-831f-3a4f464732ab tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:56.527164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f956a242-d354-45fe-831f-3a4f464732ab tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:56.527797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f956a242-d354-45fe-831f-3a4f464732ab tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:56.676546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f956a242-d354-45fe-831f-3a4f464732ab tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:56.678448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-6e586803-3f1f-45f2-8296-11f59689a277 req-e2ad435b-b746-4730-a26d-12cd06f4422c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a861091e-e236-4038-916e-474e77bf6435", "tag": "d8cb1fd4-5dff-4920-aca4-525f1ec4f880"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:56.686629 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f956a242-d354-45fe-831f-3a4f464732ab tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1453 microversion: 2.1 time: 0.172369 Aug 27 05:38:56.687331 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3403/6800] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:56 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:56.688807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6e586803-3f1f-45f2-8296-11f59689a277 req-e2ad435b-b746-4730-a26d-12cd06f4422c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:56.689308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6e586803-3f1f-45f2-8296-11f59689a277 req-e2ad435b-b746-4730-a26d-12cd06f4422c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:56.689763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-6e586803-3f1f-45f2-8296-11f59689a277 req-e2ad435b-b746-4730-a26d-12cd06f4422c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:56.702629 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-6e586803-3f1f-45f2-8296-11f59689a277 req-e2ad435b-b746-4730-a26d-12cd06f4422c service nova] Creating event network-changed:d8cb1fd4-5dff-4920-aca4-525f1ec4f880 for instance a861091e-e236-4038-916e-474e77bf6435 on n-h2-820368-35 Aug 27 05:38:56.708650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-6e586803-3f1f-45f2-8296-11f59689a277 req-e2ad435b-b746-4730-a26d-12cd06f4422c service nova] Instance a861091e-e236-4038-916e-474e77bf6435 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:38:56.729201 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-6e586803-3f1f-45f2-8296-11f59689a277 req-e2ad435b-b746-4730-a26d-12cd06f4422c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055304 Aug 27 05:38:56.729831 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3398/6801] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:56.871483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b1ffa07-0762-4361-b7e3-89af689c20b8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:56.872029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2b1ffa07-0762-4361-b7e3-89af689c20b8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:56.874686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ce6f80ef-df17-44c5-b44d-dd8a8bf21fce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:56.876932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ce6f80ef-df17-44c5-b44d-dd8a8bf21fce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:56.888255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b1ffa07-0762-4361-b7e3-89af689c20b8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:56.888961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b1ffa07-0762-4361-b7e3-89af689c20b8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:56.889491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b1ffa07-0762-4361-b7e3-89af689c20b8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:56.889740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce6f80ef-df17-44c5-b44d-dd8a8bf21fce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:56.890243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b1ffa07-0762-4361-b7e3-89af689c20b8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:56.890716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b1ffa07-0762-4361-b7e3-89af689c20b8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:56.891064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce6f80ef-df17-44c5-b44d-dd8a8bf21fce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:56.891319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b1ffa07-0762-4361-b7e3-89af689c20b8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:56.892552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce6f80ef-df17-44c5-b44d-dd8a8bf21fce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:56.893840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce6f80ef-df17-44c5-b44d-dd8a8bf21fce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:56.895413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce6f80ef-df17-44c5-b44d-dd8a8bf21fce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:56.896905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce6f80ef-df17-44c5-b44d-dd8a8bf21fce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:57.277239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ce6f80ef-df17-44c5-b44d-dd8a8bf21fce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:57.279768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2b1ffa07-0762-4361-b7e3-89af689c20b8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:57.289611 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2b1ffa07-0762-4361-b7e3-89af689c20b8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1499 microversion: 2.1 time: 0.422972 Aug 27 05:38:57.291019 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3404/6802] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:56 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1499 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:57.298094 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ce6f80ef-df17-44c5-b44d-dd8a8bf21fce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1688 microversion: 2.1 time: 0.429588 Aug 27 05:38:57.299081 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3399/6803] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:56 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1688 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:58.311874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3844d352-bf2d-4baf-b37a-73c94f47a6be tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:58.312657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3844d352-bf2d-4baf-b37a-73c94f47a6be tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:58.323335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53a8c4fe-84da-42dc-88c1-a306799791c9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:58.324086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-53a8c4fe-84da-42dc-88c1-a306799791c9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:58.335911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a8c4fe-84da-42dc-88c1-a306799791c9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:58.336232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3844d352-bf2d-4baf-b37a-73c94f47a6be tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:58.336815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3844d352-bf2d-4baf-b37a-73c94f47a6be tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:58.337326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3844d352-bf2d-4baf-b37a-73c94f47a6be tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:58.337890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a8c4fe-84da-42dc-88c1-a306799791c9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:58.338737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3844d352-bf2d-4baf-b37a-73c94f47a6be tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:58.339320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a8c4fe-84da-42dc-88c1-a306799791c9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:58.339886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3844d352-bf2d-4baf-b37a-73c94f47a6be tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:58.341431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a8c4fe-84da-42dc-88c1-a306799791c9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:58.342014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3844d352-bf2d-4baf-b37a-73c94f47a6be tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:58.347069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a8c4fe-84da-42dc-88c1-a306799791c9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:58.347997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53a8c4fe-84da-42dc-88c1-a306799791c9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:58.352681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:58.611845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-53a8c4fe-84da-42dc-88c1-a306799791c9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:58.627526 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-53a8c4fe-84da-42dc-88c1-a306799791c9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1688 microversion: 2.1 time: 0.308814 Aug 27 05:38:58.649240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3844d352-bf2d-4baf-b37a-73c94f47a6be tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:58.649802 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3400/6804] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:58 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1688 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:58.661525 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3844d352-bf2d-4baf-b37a-73c94f47a6be tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1499 microversion: 2.1 time: 0.354060 Aug 27 05:38:58.663239 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3405/6805] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:58 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1499 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:59.203802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4e8fa3c2-036e-4cfc-85d6-3e4096bc3866 req-d3c6c311-7cf4-4793-a0ca-eab63e5c7538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50491414-dbda-4377-aa35-053da472571d", "tag": "d12f37c0-6d8a-4826-b0e6-1541625ef9bb"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:59.217659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4e8fa3c2-036e-4cfc-85d6-3e4096bc3866 req-d3c6c311-7cf4-4793-a0ca-eab63e5c7538 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:59.218158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4e8fa3c2-036e-4cfc-85d6-3e4096bc3866 req-d3c6c311-7cf4-4793-a0ca-eab63e5c7538 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:59.218613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4e8fa3c2-036e-4cfc-85d6-3e4096bc3866 req-d3c6c311-7cf4-4793-a0ca-eab63e5c7538 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:59.233954 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4e8fa3c2-036e-4cfc-85d6-3e4096bc3866 req-d3c6c311-7cf4-4793-a0ca-eab63e5c7538 service nova] Creating event network-changed:d12f37c0-6d8a-4826-b0e6-1541625ef9bb for instance 50491414-dbda-4377-aa35-053da472571d on n-h1-820368-35 Aug 27 05:38:59.239294 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4e8fa3c2-036e-4cfc-85d6-3e4096bc3866 req-d3c6c311-7cf4-4793-a0ca-eab63e5c7538 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039295 Aug 27 05:38:59.240500 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3401/6806] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:59.657495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f3cd1e2e-f3cf-4d65-80b3-3cb106cc7afd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:59.658793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f3cd1e2e-f3cf-4d65-80b3-3cb106cc7afd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:59.666435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e2e-f3cf-4d65-80b3-3cb106cc7afd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:59.667249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e2e-f3cf-4d65-80b3-3cb106cc7afd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:59.667871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e2e-f3cf-4d65-80b3-3cb106cc7afd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:59.668858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e2e-f3cf-4d65-80b3-3cb106cc7afd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:59.669569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e2e-f3cf-4d65-80b3-3cb106cc7afd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:59.670193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e2e-f3cf-4d65-80b3-3cb106cc7afd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:59.686045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6bacb866-9eb8-4ee5-b1c1-2019dd7937bb tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:59.687106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6bacb866-9eb8-4ee5-b1c1-2019dd7937bb tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:59.694215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bacb866-9eb8-4ee5-b1c1-2019dd7937bb tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:59.695738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bacb866-9eb8-4ee5-b1c1-2019dd7937bb tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:59.696438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bacb866-9eb8-4ee5-b1c1-2019dd7937bb tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:59.697559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bacb866-9eb8-4ee5-b1c1-2019dd7937bb tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:59.698279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bacb866-9eb8-4ee5-b1c1-2019dd7937bb tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:59.699019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bacb866-9eb8-4ee5-b1c1-2019dd7937bb tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:00.144282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f3cd1e2e-f3cf-4d65-80b3-3cb106cc7afd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:00.154383 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f3cd1e2e-f3cf-4d65-80b3-3cb106cc7afd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1681 microversion: 2.1 time: 0.500679 Aug 27 05:39:00.155451 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3406/6807] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:59 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1681 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:00.178695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6bacb866-9eb8-4ee5-b1c1-2019dd7937bb tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:00.189089 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6bacb866-9eb8-4ee5-b1c1-2019dd7937bb tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1502 microversion: 2.1 time: 0.508275 Aug 27 05:39:00.202389 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3402/6808] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:59 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1502 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:00.211926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e47c3b3c-8a34-46dd-be82-15cb2d23f0e8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:00.212486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e47c3b3c-8a34-46dd-be82-15cb2d23f0e8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:00.220034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e47c3b3c-8a34-46dd-be82-15cb2d23f0e8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:00.220840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e47c3b3c-8a34-46dd-be82-15cb2d23f0e8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:00.222074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e47c3b3c-8a34-46dd-be82-15cb2d23f0e8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:00.223012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e47c3b3c-8a34-46dd-be82-15cb2d23f0e8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:00.223686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e47c3b3c-8a34-46dd-be82-15cb2d23f0e8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:00.224921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e47c3b3c-8a34-46dd-be82-15cb2d23f0e8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:00.265867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-e47c3b3c-8a34-46dd-be82-15cb2d23f0e8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lazy-loading 'flavor' on Instance uuid ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:39:00.359446 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e47c3b3c-8a34-46dd-be82-15cb2d23f0e8 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "POST /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26/action" status: 202 len: 0 microversion: 2.1 time: 0.152115 Aug 27 05:39:00.360838 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3407/6809] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:39:00 2022] POST /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:39:00.375807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-28f79ba6-d9eb-4a91-aeaf-93fe7c08996f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:00.376962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-28f79ba6-d9eb-4a91-aeaf-93fe7c08996f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:00.390461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28f79ba6-d9eb-4a91-aeaf-93fe7c08996f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:00.393970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28f79ba6-d9eb-4a91-aeaf-93fe7c08996f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:00.396222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28f79ba6-d9eb-4a91-aeaf-93fe7c08996f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:00.398167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28f79ba6-d9eb-4a91-aeaf-93fe7c08996f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:00.401278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28f79ba6-d9eb-4a91-aeaf-93fe7c08996f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:00.402071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28f79ba6-d9eb-4a91-aeaf-93fe7c08996f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:00.616861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-28f79ba6-d9eb-4a91-aeaf-93fe7c08996f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:00.638762 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-28f79ba6-d9eb-4a91-aeaf-93fe7c08996f tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1510 microversion: 2.1 time: 0.258606 Aug 27 05:39:00.639791 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3403/6810] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:00 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:01.663628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ef8bd416-cf35-4045-b26a-f4a6b95eaff4 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:01.664353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ef8bd416-cf35-4045-b26a-f4a6b95eaff4 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:01.671076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef8bd416-cf35-4045-b26a-f4a6b95eaff4 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:01.671610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef8bd416-cf35-4045-b26a-f4a6b95eaff4 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:01.672064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef8bd416-cf35-4045-b26a-f4a6b95eaff4 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:01.672784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef8bd416-cf35-4045-b26a-f4a6b95eaff4 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:01.673249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef8bd416-cf35-4045-b26a-f4a6b95eaff4 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:01.673684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ef8bd416-cf35-4045-b26a-f4a6b95eaff4 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:01.678564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:01.835429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ef8bd416-cf35-4045-b26a-f4a6b95eaff4 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:01.843840 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ef8bd416-cf35-4045-b26a-f4a6b95eaff4 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1493 microversion: 2.1 time: 0.185942 Aug 27 05:39:01.844426 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3408/6811] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:01 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1493 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:39:01.866052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-758e270f-27a2-43a5-adff-46c40a4e5d05 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:01.867215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-758e270f-27a2-43a5-adff-46c40a4e5d05 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:01.874294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-758e270f-27a2-43a5-adff-46c40a4e5d05 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:01.874803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-758e270f-27a2-43a5-adff-46c40a4e5d05 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:01.875306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-758e270f-27a2-43a5-adff-46c40a4e5d05 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:01.876032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-758e270f-27a2-43a5-adff-46c40a4e5d05 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:01.876506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-758e270f-27a2-43a5-adff-46c40a4e5d05 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:01.876952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-758e270f-27a2-43a5-adff-46c40a4e5d05 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:01.948455 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-758e270f-27a2-43a5-adff-46c40a4e5d05 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "POST /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26/action" status: 202 len: 0 microversion: 2.1 time: 0.086272 Aug 27 05:39:01.949110 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3404/6812] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:39:01 2022] POST /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:39:01.957403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fc1c69b8-bae8-438d-be4b-8d7229d88ab7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:01.958128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fc1c69b8-bae8-438d-be4b-8d7229d88ab7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:01.969855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc1c69b8-bae8-438d-be4b-8d7229d88ab7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:01.970656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc1c69b8-bae8-438d-be4b-8d7229d88ab7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:01.971315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc1c69b8-bae8-438d-be4b-8d7229d88ab7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:01.972669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc1c69b8-bae8-438d-be4b-8d7229d88ab7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:01.972939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc1c69b8-bae8-438d-be4b-8d7229d88ab7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:01.973425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc1c69b8-bae8-438d-be4b-8d7229d88ab7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:02.167623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fc1c69b8-bae8-438d-be4b-8d7229d88ab7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:02.177632 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fc1c69b8-bae8-438d-be4b-8d7229d88ab7 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1499 microversion: 2.1 time: 0.224005 Aug 27 05:39:02.178225 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3409/6813] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:01 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1499 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:02.348352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-df55d134-8d36-4050-83cc-8e5c5e00d38f req-743fbb67-eea9-46ee-8597-5c954c8bb7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a861091e-e236-4038-916e-474e77bf6435", "name": "network-vif-plugged", "status": "completed", "tag": "d8cb1fd4-5dff-4920-aca4-525f1ec4f880"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:02.367657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-df55d134-8d36-4050-83cc-8e5c5e00d38f req-743fbb67-eea9-46ee-8597-5c954c8bb7c5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:02.368617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-df55d134-8d36-4050-83cc-8e5c5e00d38f req-743fbb67-eea9-46ee-8597-5c954c8bb7c5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:02.370183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-df55d134-8d36-4050-83cc-8e5c5e00d38f req-743fbb67-eea9-46ee-8597-5c954c8bb7c5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:02.383434 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-df55d134-8d36-4050-83cc-8e5c5e00d38f req-743fbb67-eea9-46ee-8597-5c954c8bb7c5 service nova] Creating event network-vif-plugged:d8cb1fd4-5dff-4920-aca4-525f1ec4f880 for instance a861091e-e236-4038-916e-474e77bf6435 on n-h2-820368-35 Aug 27 05:39:02.388920 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-df55d134-8d36-4050-83cc-8e5c5e00d38f req-743fbb67-eea9-46ee-8597-5c954c8bb7c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046650 Aug 27 05:39:02.390179 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3405/6814] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:03.209542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-254b0982-cb7d-4997-815d-c2169aa4c4fc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:03.210393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-254b0982-cb7d-4997-815d-c2169aa4c4fc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:03.218755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-254b0982-cb7d-4997-815d-c2169aa4c4fc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:03.219376 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-254b0982-cb7d-4997-815d-c2169aa4c4fc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:03.219821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-254b0982-cb7d-4997-815d-c2169aa4c4fc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:03.220572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-254b0982-cb7d-4997-815d-c2169aa4c4fc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:03.221033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-254b0982-cb7d-4997-815d-c2169aa4c4fc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:03.221464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-254b0982-cb7d-4997-815d-c2169aa4c4fc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:03.367456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-254b0982-cb7d-4997-815d-c2169aa4c4fc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:03.376894 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-254b0982-cb7d-4997-815d-c2169aa4c4fc tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1499 microversion: 2.1 time: 0.173082 Aug 27 05:39:03.377690 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3410/6815] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:03 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1499 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:04.401215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22d1e1f0-7062-43d6-ba93-4eb59853020a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:04.401923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22d1e1f0-7062-43d6-ba93-4eb59853020a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:04.408488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d1e1f0-7062-43d6-ba93-4eb59853020a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:04.408983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d1e1f0-7062-43d6-ba93-4eb59853020a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:04.409433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d1e1f0-7062-43d6-ba93-4eb59853020a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:04.410295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d1e1f0-7062-43d6-ba93-4eb59853020a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:04.411005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d1e1f0-7062-43d6-ba93-4eb59853020a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:04.411893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22d1e1f0-7062-43d6-ba93-4eb59853020a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:04.563251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-22d1e1f0-7062-43d6-ba93-4eb59853020a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:04.572245 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22d1e1f0-7062-43d6-ba93-4eb59853020a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1502 microversion: 2.1 time: 0.176193 Aug 27 05:39:04.572848 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3406/6816] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:04 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:04.595719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-897962dd-8c5e-4069-a913-45b4872d39d9 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:04.596280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-897962dd-8c5e-4069-a913-45b4872d39d9 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:04.602649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-897962dd-8c5e-4069-a913-45b4872d39d9 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:04.603239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-897962dd-8c5e-4069-a913-45b4872d39d9 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:04.603678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-897962dd-8c5e-4069-a913-45b4872d39d9 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:04.604372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-897962dd-8c5e-4069-a913-45b4872d39d9 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:04.604822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-897962dd-8c5e-4069-a913-45b4872d39d9 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:04.605245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-897962dd-8c5e-4069-a913-45b4872d39d9 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:04.635389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-897962dd-8c5e-4069-a913-45b4872d39d9 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:39:04.729111 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-897962dd-8c5e-4069-a913-45b4872d39d9 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 204 len: 0 microversion: 2.1 time: 0.137090 Aug 27 05:39:04.730112 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3411/6817] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:39:04 2022] DELETE /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:39:04.738538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eafe2030-425e-4767-a559-937081b47844 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:04.739218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eafe2030-425e-4767-a559-937081b47844 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:04.746362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eafe2030-425e-4767-a559-937081b47844 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:04.746900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eafe2030-425e-4767-a559-937081b47844 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:04.747726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eafe2030-425e-4767-a559-937081b47844 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:04.748511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eafe2030-425e-4767-a559-937081b47844 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:04.748996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eafe2030-425e-4767-a559-937081b47844 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:04.749445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eafe2030-425e-4767-a559-937081b47844 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:04.898519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eafe2030-425e-4767-a559-937081b47844 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:04.906751 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eafe2030-425e-4767-a559-937081b47844 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1508 microversion: 2.1 time: 0.171946 Aug 27 05:39:04.907034 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3407/6818] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:04 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:05.936549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5765ea6-2de5-4d09-8f3d-2fe3c5423961 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:05.937275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c5765ea6-2de5-4d09-8f3d-2fe3c5423961 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:05.945060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5765ea6-2de5-4d09-8f3d-2fe3c5423961 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:05.945549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5765ea6-2de5-4d09-8f3d-2fe3c5423961 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:05.945988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5765ea6-2de5-4d09-8f3d-2fe3c5423961 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:05.946700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5765ea6-2de5-4d09-8f3d-2fe3c5423961 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:05.947222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5765ea6-2de5-4d09-8f3d-2fe3c5423961 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:05.947609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5765ea6-2de5-4d09-8f3d-2fe3c5423961 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:06.092251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c5765ea6-2de5-4d09-8f3d-2fe3c5423961 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:06.101809 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5765ea6-2de5-4d09-8f3d-2fe3c5423961 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1508 microversion: 2.1 time: 0.175804 Aug 27 05:39:06.102505 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3412/6819] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:05 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:07.124202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0b5b8fa4-d473-4b44-ba00-e89cd56bdfb6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:07.125514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0b5b8fa4-d473-4b44-ba00-e89cd56bdfb6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:07.134865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b5b8fa4-d473-4b44-ba00-e89cd56bdfb6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:07.135003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b5b8fa4-d473-4b44-ba00-e89cd56bdfb6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:07.135446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b5b8fa4-d473-4b44-ba00-e89cd56bdfb6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:07.136369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b5b8fa4-d473-4b44-ba00-e89cd56bdfb6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:07.136874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b5b8fa4-d473-4b44-ba00-e89cd56bdfb6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:07.137522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b5b8fa4-d473-4b44-ba00-e89cd56bdfb6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:07.317283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0b5b8fa4-d473-4b44-ba00-e89cd56bdfb6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359b51ca820c44d2b5c976c466ac3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f998af974224d48a456cec52d80089d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:07.327967 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0b5b8fa4-d473-4b44-ba00-e89cd56bdfb6 tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 200 len: 1508 microversion: 2.1 time: 0.208262 Aug 27 05:39:07.329550 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3408/6820] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:07 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:07.610363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b92db240-596c-441e-9b8c-4fab50643db0 req-40fba6f4-a165-4e53-b45c-7a680bc53e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef71c5f9-b745-4590-acfc-8b8e5a5c5c26", "name": "network-vif-deleted", "tag": "01ad1035-d29b-4e22-92c7-60526bee1868"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:07.624292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b92db240-596c-441e-9b8c-4fab50643db0 req-40fba6f4-a165-4e53-b45c-7a680bc53e60 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:07.625419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b92db240-596c-441e-9b8c-4fab50643db0 req-40fba6f4-a165-4e53-b45c-7a680bc53e60 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:07.626430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b92db240-596c-441e-9b8c-4fab50643db0 req-40fba6f4-a165-4e53-b45c-7a680bc53e60 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:07.638899 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b92db240-596c-441e-9b8c-4fab50643db0 req-40fba6f4-a165-4e53-b45c-7a680bc53e60 service nova] Creating event network-vif-deleted:01ad1035-d29b-4e22-92c7-60526bee1868 for instance ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 on n-h2-820368-35 Aug 27 05:39:07.646017 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b92db240-596c-441e-9b8c-4fab50643db0 req-40fba6f4-a165-4e53-b45c-7a680bc53e60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041338 Aug 27 05:39:07.646996 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3413/6821] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:39:08.352638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:08.353270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] [instance: ef71c5f9-b745-4590-acfc-8b8e5a5c5c26] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:08.362467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:08.362891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:08.363365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:08.364099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:08.364554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:08.364990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:08.381626 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] HTTP exception thrown: Instance ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 could not be found. Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Request method failure captured: Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 HTTP/1.1 Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCa3arJ3NlXgRaw_TmjhJT2JEpsC8tOmQOIlbRjyB9_K8UnAN_WFW2Z-2RER0Wtyy7Rm7uVvmsSPZMAPFsxO4V1Hsl7DLNayrVOw7Y_AmusjLKCtyFQP5kUOCyLzML5vxyzKP1fz85pCxXlWYbD1w8yNKESa1h-3lAg9oZZYqJGPcyMQ Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 8f998af974224d48a456cec52d80089d Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestServerAdvancedOps-72846304 Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8f998af974224d48a456cec52d80089d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8f998af974224d48a456cec52d80089d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f998af974224d48a456cec52d80089d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8f998af974224d48a456cec52d80089d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestServerAdvancedOps-72846304 Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 8f998af974224d48a456cec52d80089d Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestServerAdvancedOps-72846304 Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestServerAdvancedOps-72846304-project Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 359b51ca820c44d2b5c976c466ac3aed Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestServerAdvancedOps-72846304-project Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 could not be found. Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'ef71c5f9-b745-4590-acfc-8b8e5a5c5c26'} Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 could not be found. Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 could not be found. Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:39:08.383986 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:39:08.391503 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:39:08.391503 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:39:08.391503 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:39:08.391503 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:39:08.391503 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:39:08.391503 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 could not be found. Aug 27 05:39:08.391503 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:39:08.391503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] Returning 404 to user: Instance ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:39:08.391503 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fcfbf2bb-f4c2-40e2-995e-d0a59169d80a tempest-TestServerAdvancedOps-72846304 tempest-TestServerAdvancedOps-72846304-project] 10.222.0.58 "GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26" status: 404 len: 111 microversion: 2.1 time: 0.036810 Aug 27 05:39:08.391503 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3409/6822] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:08 2022] GET /compute/v2.1/servers/ef71c5f9-b745-4590-acfc-8b8e5a5c5c26 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:39:17.886243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:17.887356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:17.896919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1378069908", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "6d5e9429-0a21-400b-9a95-82012cbc0d28"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:17.970853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] validate_networks() for [('6d5e9429-0a21-400b-9a95-82012cbc0d28', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:39:18.568136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:39:18.568765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:39:18.569416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:39:18.570520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:39:18.571008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:39:18.584164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:18.586957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:18.588587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:18.589917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:18.590537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:18.591317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:18.618585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Getting quotas for project 90ce936a1cd74ee68c1a8fc64d466774. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:39:18.626203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Getting quotas for user 7a51b3c1aa404f6b91581571626af555 and project 90ce936a1cd74ee68c1a8fc64d466774. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:39:18.643294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:39:18.647237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:39:18.736475 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-35aa923b-5a6e-4f98-827e-c09aa4b9c3dc tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852311 Aug 27 05:39:18.737921 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3414/6823] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:39:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:39:18.756818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22b09e26-49f1-413d-ace7-5fa822b62138 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:18.759674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22b09e26-49f1-413d-ace7-5fa822b62138 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:18.764104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=55 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:18.776027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:18.898570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-22b09e26-49f1-413d-ace7-5fa822b62138 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:18.920581 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22b09e26-49f1-413d-ace7-5fa822b62138 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1219 microversion: 2.1 time: 0.171156 Aug 27 05:39:18.934592 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3410/6824] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:18 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1219 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:19.957039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5cc8a912-c7ad-499b-9223-bdc2812d01f3 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:19.958516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5cc8a912-c7ad-499b-9223-bdc2812d01f3 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:19.969395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc8a912-c7ad-499b-9223-bdc2812d01f3 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:19.969906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc8a912-c7ad-499b-9223-bdc2812d01f3 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:19.970355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc8a912-c7ad-499b-9223-bdc2812d01f3 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:19.971189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc8a912-c7ad-499b-9223-bdc2812d01f3 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:19.971548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc8a912-c7ad-499b-9223-bdc2812d01f3 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:19.972319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5cc8a912-c7ad-499b-9223-bdc2812d01f3 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:20.060238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5cc8a912-c7ad-499b-9223-bdc2812d01f3 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:20.068380 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5cc8a912-c7ad-499b-9223-bdc2812d01f3 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1271 microversion: 2.1 time: 0.115236 Aug 27 05:39:20.068970 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3415/6825] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:19 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:21.094114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-485375c6-caf5-47f1-bc5b-94fdd8623758 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:21.095135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-485375c6-caf5-47f1-bc5b-94fdd8623758 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:21.111559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-485375c6-caf5-47f1-bc5b-94fdd8623758 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:21.112467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-485375c6-caf5-47f1-bc5b-94fdd8623758 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:21.113331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-485375c6-caf5-47f1-bc5b-94fdd8623758 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:21.114485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-485375c6-caf5-47f1-bc5b-94fdd8623758 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:21.115621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-485375c6-caf5-47f1-bc5b-94fdd8623758 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:21.116506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-485375c6-caf5-47f1-bc5b-94fdd8623758 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:21.486663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-485375c6-caf5-47f1-bc5b-94fdd8623758 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:21.510442 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-485375c6-caf5-47f1-bc5b-94fdd8623758 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1277 microversion: 2.1 time: 0.419464 Aug 27 05:39:21.532689 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3411/6826] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:21 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1277 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:22.540171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1c0ead5b-eb7e-474b-83c9-4889b22d6a58 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:22.540763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1c0ead5b-eb7e-474b-83c9-4889b22d6a58 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:22.562122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c0ead5b-eb7e-474b-83c9-4889b22d6a58 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:22.562984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c0ead5b-eb7e-474b-83c9-4889b22d6a58 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:22.563711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c0ead5b-eb7e-474b-83c9-4889b22d6a58 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:22.564738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c0ead5b-eb7e-474b-83c9-4889b22d6a58 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:22.565457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c0ead5b-eb7e-474b-83c9-4889b22d6a58 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:22.566137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c0ead5b-eb7e-474b-83c9-4889b22d6a58 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:22.948231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1c0ead5b-eb7e-474b-83c9-4889b22d6a58 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:22.984018 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1c0ead5b-eb7e-474b-83c9-4889b22d6a58 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1319 microversion: 2.1 time: 0.448797 Aug 27 05:39:23.002973 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3416/6827] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:22 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:23.628028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-29e71380-84c5-4297-ac9f-9ae35557ae79 req-04721f54-cf69-4d3e-a0c6-6ed835d453f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84321304-9113-4e3a-90b4-fd0da1abb7ef", "tag": "b9aaa289-4b88-42f6-966d-12863cc36859"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:23.650712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-29e71380-84c5-4297-ac9f-9ae35557ae79 req-04721f54-cf69-4d3e-a0c6-6ed835d453f8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:23.651412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-29e71380-84c5-4297-ac9f-9ae35557ae79 req-04721f54-cf69-4d3e-a0c6-6ed835d453f8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:23.651967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-29e71380-84c5-4297-ac9f-9ae35557ae79 req-04721f54-cf69-4d3e-a0c6-6ed835d453f8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:23.679824 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-29e71380-84c5-4297-ac9f-9ae35557ae79 req-04721f54-cf69-4d3e-a0c6-6ed835d453f8 service nova] Creating event network-changed:b9aaa289-4b88-42f6-966d-12863cc36859 for instance 84321304-9113-4e3a-90b4-fd0da1abb7ef on n-h2-820368-35 Aug 27 05:39:23.691037 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-29e71380-84c5-4297-ac9f-9ae35557ae79 req-04721f54-cf69-4d3e-a0c6-6ed835d453f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.405465 Aug 27 05:39:23.693076 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3412/6828] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:24.009824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0011c646-c448-4b7e-bd23-8669b50896ed tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:24.010454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0011c646-c448-4b7e-bd23-8669b50896ed tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:24.022477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0011c646-c448-4b7e-bd23-8669b50896ed tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:24.025642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0011c646-c448-4b7e-bd23-8669b50896ed tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:24.026114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0011c646-c448-4b7e-bd23-8669b50896ed tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:24.026966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0011c646-c448-4b7e-bd23-8669b50896ed tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:24.027348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0011c646-c448-4b7e-bd23-8669b50896ed tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:24.027789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0011c646-c448-4b7e-bd23-8669b50896ed tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:24.151451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-300e4849-8019-4213-8552-13858ed65e07 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:24.156697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-300e4849-8019-4213-8552-13858ed65e07 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:24.157344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-300e4849-8019-4213-8552-13858ed65e07 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:24.158113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-300e4849-8019-4213-8552-13858ed65e07 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:24.159824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-300e4849-8019-4213-8552-13858ed65e07 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:24.161381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-300e4849-8019-4213-8552-13858ed65e07 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:24.162183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-300e4849-8019-4213-8552-13858ed65e07 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:24.197671 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-300e4849-8019-4213-8552-13858ed65e07 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.161064 Aug 27 05:39:24.200968 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3413/6829] 10.222.0.58 () {58 vars in 1185 bytes} [Sat Aug 27 05:39:24 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:24.256222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0011c646-c448-4b7e-bd23-8669b50896ed tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:24.265291 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0011c646-c448-4b7e-bd23-8669b50896ed tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1319 microversion: 2.1 time: 0.258983 Aug 27 05:39:24.266730 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3417/6830] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:24 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:24.329477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-955991663", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "availability_zone": "nova:n-h1-820368-35", "networks": [{"uuid": "6b5a6694-f28e-443c-b898-bd3616b8912d"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:24.399513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] validate_networks() for [('6b5a6694-f28e-443c-b898-bd3616b8912d', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:39:25.086843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:39:25.087505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:39:25.087986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:39:25.088513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:39:25.089031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:39:25.099039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:25.099683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:25.100133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:25.101404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:25.101873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:25.102311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:25.121546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Getting quotas for project 298db9acf2ea4fc19a565bce516391ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:39:25.136694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Getting quotas for user 19eb95af6e0f4c46abccfa218c65690d and project 298db9acf2ea4fc19a565bce516391ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:39:25.157997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:39:25.161745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:39:25.219108 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [6103e528-015b-4e02-a557-6b8e58910c8a] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:39:25.287941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d53e074-627b-4078-a771-9dd99f981e71 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:25.288779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d53e074-627b-4078-a771-9dd99f981e71 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:25.299576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d53e074-627b-4078-a771-9dd99f981e71 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:25.300632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d53e074-627b-4078-a771-9dd99f981e71 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:25.301391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d53e074-627b-4078-a771-9dd99f981e71 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:25.302691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d53e074-627b-4078-a771-9dd99f981e71 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:25.303625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d53e074-627b-4078-a771-9dd99f981e71 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:25.304993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d53e074-627b-4078-a771-9dd99f981e71 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:25.589533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8d53e074-627b-4078-a771-9dd99f981e71 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:25.600746 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d53e074-627b-4078-a771-9dd99f981e71 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1319 microversion: 2.1 time: 0.316334 Aug 27 05:39:25.605255 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3418/6831] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:25 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:39:26.227932 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [6103e528-015b-4e02-a557-6b8e58910c8a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 41740. Aug 27 05:39:26.243517 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-526a88d9-6d63-4949-825c-b1daae9bebbc tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.918274 Aug 27 05:39:26.251971 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3414/6832] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:39:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:39:26.260652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-853f7500-8b1f-4009-b6ba-9c2858c4812b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:26.275995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-853f7500-8b1f-4009-b6ba-9c2858c4812b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:26.375692 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-853f7500-8b1f-4009-b6ba-9c2858c4812b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1328 microversion: 2.1 time: 0.122459 Aug 27 05:39:26.383201 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3419/6833] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:26 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:26.630608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e82f492e-5706-4c4f-aad9-58c5752567b6 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:26.649136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e82f492e-5706-4c4f-aad9-58c5752567b6 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:26.671425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82f492e-5706-4c4f-aad9-58c5752567b6 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:26.672236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82f492e-5706-4c4f-aad9-58c5752567b6 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:26.673031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82f492e-5706-4c4f-aad9-58c5752567b6 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:26.674130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82f492e-5706-4c4f-aad9-58c5752567b6 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:26.675585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82f492e-5706-4c4f-aad9-58c5752567b6 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:26.675779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82f492e-5706-4c4f-aad9-58c5752567b6 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:26.943972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e82f492e-5706-4c4f-aad9-58c5752567b6 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:26.952645 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e82f492e-5706-4c4f-aad9-58c5752567b6 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1319 microversion: 2.1 time: 0.330776 Aug 27 05:39:26.953293 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3415/6834] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:26 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:27.413410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-57045e91-ad80-46a1-ac1d-79b5bd6045e9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:27.414608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-57045e91-ad80-46a1-ac1d-79b5bd6045e9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:27.425695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57045e91-ad80-46a1-ac1d-79b5bd6045e9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:27.426269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57045e91-ad80-46a1-ac1d-79b5bd6045e9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:27.426789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57045e91-ad80-46a1-ac1d-79b5bd6045e9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:27.427600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57045e91-ad80-46a1-ac1d-79b5bd6045e9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:27.428134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57045e91-ad80-46a1-ac1d-79b5bd6045e9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:27.428653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-57045e91-ad80-46a1-ac1d-79b5bd6045e9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:27.541143 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-57045e91-ad80-46a1-ac1d-79b5bd6045e9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1417 microversion: 2.1 time: 0.134206 Aug 27 05:39:27.542167 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3420/6835] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:27 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1417 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:27.974897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-51cffe95-143b-41c3-acef-2075174a0d33 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:27.977493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-51cffe95-143b-41c3-acef-2075174a0d33 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:27.989103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51cffe95-143b-41c3-acef-2075174a0d33 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:27.989889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51cffe95-143b-41c3-acef-2075174a0d33 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:27.990682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51cffe95-143b-41c3-acef-2075174a0d33 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:27.992428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51cffe95-143b-41c3-acef-2075174a0d33 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:27.993758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51cffe95-143b-41c3-acef-2075174a0d33 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:27.994675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-51cffe95-143b-41c3-acef-2075174a0d33 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:28.211758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-51cffe95-143b-41c3-acef-2075174a0d33 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:28.220846 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-51cffe95-143b-41c3-acef-2075174a0d33 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1319 microversion: 2.1 time: 0.250681 Aug 27 05:39:28.221792 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3416/6836] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:27 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:28.566183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5a4fa1dc-0bf3-4b97-a47d-3f2021216b2a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:28.567200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5a4fa1dc-0bf3-4b97-a47d-3f2021216b2a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:28.584887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a4fa1dc-0bf3-4b97-a47d-3f2021216b2a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:28.586268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a4fa1dc-0bf3-4b97-a47d-3f2021216b2a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:28.586984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a4fa1dc-0bf3-4b97-a47d-3f2021216b2a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:28.588213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a4fa1dc-0bf3-4b97-a47d-3f2021216b2a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:28.589230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a4fa1dc-0bf3-4b97-a47d-3f2021216b2a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:28.589984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a4fa1dc-0bf3-4b97-a47d-3f2021216b2a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:28.627114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:28.827568 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5a4fa1dc-0bf3-4b97-a47d-3f2021216b2a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1465 microversion: 2.1 time: 0.268550 Aug 27 05:39:28.836056 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3421/6837] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:28 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1465 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:29.242650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-99fddbda-471b-483b-ab68-3fd6b7ba0199 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:29.243463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-99fddbda-471b-483b-ab68-3fd6b7ba0199 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:29.250716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99fddbda-471b-483b-ab68-3fd6b7ba0199 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:29.251273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99fddbda-471b-483b-ab68-3fd6b7ba0199 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:29.251740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99fddbda-471b-483b-ab68-3fd6b7ba0199 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:29.252477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99fddbda-471b-483b-ab68-3fd6b7ba0199 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:29.252947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99fddbda-471b-483b-ab68-3fd6b7ba0199 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:29.253400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-99fddbda-471b-483b-ab68-3fd6b7ba0199 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:29.425270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-52c4c6f6-5cde-4867-b6bf-4c46f112c6ee req-089897eb-0e69-482e-bd14-a75b93c437a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce497dc-6abe-4319-ba55-862dd11ef15c", "tag": "d4cb2dde-35a2-44fb-b423-07c50b7aeba1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:29.442099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52c4c6f6-5cde-4867-b6bf-4c46f112c6ee req-089897eb-0e69-482e-bd14-a75b93c437a0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:29.442714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52c4c6f6-5cde-4867-b6bf-4c46f112c6ee req-089897eb-0e69-482e-bd14-a75b93c437a0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:29.443048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52c4c6f6-5cde-4867-b6bf-4c46f112c6ee req-089897eb-0e69-482e-bd14-a75b93c437a0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:29.461947 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-52c4c6f6-5cde-4867-b6bf-4c46f112c6ee req-089897eb-0e69-482e-bd14-a75b93c437a0 service nova] Creating event network-changed:d4cb2dde-35a2-44fb-b423-07c50b7aeba1 for instance bce497dc-6abe-4319-ba55-862dd11ef15c on n-h1-820368-35 Aug 27 05:39:29.468604 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-52c4c6f6-5cde-4867-b6bf-4c46f112c6ee req-089897eb-0e69-482e-bd14-a75b93c437a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053373 Aug 27 05:39:29.469576 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3422/6838] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:39:29.557306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-99fddbda-471b-483b-ab68-3fd6b7ba0199 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:29.586295 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-99fddbda-471b-483b-ab68-3fd6b7ba0199 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1319 microversion: 2.1 time: 0.347250 Aug 27 05:39:29.587493 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3417/6839] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:29 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:29.852145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4af0aa37-38b0-4ea4-a1f9-e476e889f59b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:29.852880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4af0aa37-38b0-4ea4-a1f9-e476e889f59b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:29.859607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4af0aa37-38b0-4ea4-a1f9-e476e889f59b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:29.860103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4af0aa37-38b0-4ea4-a1f9-e476e889f59b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:29.860548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4af0aa37-38b0-4ea4-a1f9-e476e889f59b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:29.862050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4af0aa37-38b0-4ea4-a1f9-e476e889f59b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:29.862673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4af0aa37-38b0-4ea4-a1f9-e476e889f59b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:29.863257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4af0aa37-38b0-4ea4-a1f9-e476e889f59b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:30.069793 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4af0aa37-38b0-4ea4-a1f9-e476e889f59b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1465 microversion: 2.1 time: 0.222221 Aug 27 05:39:30.070375 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3423/6840] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:29 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1465 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:30.434614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f5836cec-cc1f-4a4e-9dde-3b06feb801b9 req-e144e415-a102-4b89-906c-bfc457e5cf0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84321304-9113-4e3a-90b4-fd0da1abb7ef", "name": "network-vif-plugged", "status": "completed", "tag": "b9aaa289-4b88-42f6-966d-12863cc36859"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:30.450704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f5836cec-cc1f-4a4e-9dde-3b06feb801b9 req-e144e415-a102-4b89-906c-bfc457e5cf0d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:30.451426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f5836cec-cc1f-4a4e-9dde-3b06feb801b9 req-e144e415-a102-4b89-906c-bfc457e5cf0d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:30.452286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f5836cec-cc1f-4a4e-9dde-3b06feb801b9 req-e144e415-a102-4b89-906c-bfc457e5cf0d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:30.467515 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f5836cec-cc1f-4a4e-9dde-3b06feb801b9 req-e144e415-a102-4b89-906c-bfc457e5cf0d service nova] Creating event network-vif-plugged:b9aaa289-4b88-42f6-966d-12863cc36859 for instance 84321304-9113-4e3a-90b4-fd0da1abb7ef on n-h2-820368-35 Aug 27 05:39:30.474650 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f5836cec-cc1f-4a4e-9dde-3b06feb801b9 req-e144e415-a102-4b89-906c-bfc457e5cf0d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043021 Aug 27 05:39:30.475578 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3418/6841] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:30.622154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ac8f852f-c203-4c73-b388-f5aec3b40ea1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:30.622777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ac8f852f-c203-4c73-b388-f5aec3b40ea1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:30.629325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac8f852f-c203-4c73-b388-f5aec3b40ea1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:30.629811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac8f852f-c203-4c73-b388-f5aec3b40ea1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:30.630276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac8f852f-c203-4c73-b388-f5aec3b40ea1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:30.630986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac8f852f-c203-4c73-b388-f5aec3b40ea1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:30.631469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac8f852f-c203-4c73-b388-f5aec3b40ea1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:30.631899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac8f852f-c203-4c73-b388-f5aec3b40ea1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:30.787282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ac8f852f-c203-4c73-b388-f5aec3b40ea1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:30.795760 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ac8f852f-c203-4c73-b388-f5aec3b40ea1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1319 microversion: 2.1 time: 0.177900 Aug 27 05:39:30.796379 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3424/6842] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:30 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:39:31.094966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f3d3b616-7504-4fd6-8c17-935bb3fc38f1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:31.095987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f3d3b616-7504-4fd6-8c17-935bb3fc38f1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:31.106267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3d3b616-7504-4fd6-8c17-935bb3fc38f1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:31.107072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3d3b616-7504-4fd6-8c17-935bb3fc38f1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:31.107857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3d3b616-7504-4fd6-8c17-935bb3fc38f1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:31.108997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3d3b616-7504-4fd6-8c17-935bb3fc38f1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:31.109764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3d3b616-7504-4fd6-8c17-935bb3fc38f1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:31.110498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f3d3b616-7504-4fd6-8c17-935bb3fc38f1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:31.241317 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f3d3b616-7504-4fd6-8c17-935bb3fc38f1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1465 microversion: 2.1 time: 0.153345 Aug 27 05:39:31.241936 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3419/6843] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:31 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:31.817842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fc3e8d9d-ea8e-4bc0-8e4c-515633cd38d8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:31.818740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fc3e8d9d-ea8e-4bc0-8e4c-515633cd38d8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:31.826205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc3e8d9d-ea8e-4bc0-8e4c-515633cd38d8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:31.826700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc3e8d9d-ea8e-4bc0-8e4c-515633cd38d8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:31.827183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc3e8d9d-ea8e-4bc0-8e4c-515633cd38d8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:31.827911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc3e8d9d-ea8e-4bc0-8e4c-515633cd38d8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:31.828372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc3e8d9d-ea8e-4bc0-8e4c-515633cd38d8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:31.828799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc3e8d9d-ea8e-4bc0-8e4c-515633cd38d8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:32.006920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fc3e8d9d-ea8e-4bc0-8e4c-515633cd38d8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:32.015178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fc3e8d9d-ea8e-4bc0-8e4c-515633cd38d8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1319 microversion: 2.1 time: 0.201377 Aug 27 05:39:32.015769 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3425/6844] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:31 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:32.263434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7e03b321-e6f8-44fa-9ab0-08be085d72ca tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:32.264382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7e03b321-e6f8-44fa-9ab0-08be085d72ca tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:32.271460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e03b321-e6f8-44fa-9ab0-08be085d72ca tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:32.271961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e03b321-e6f8-44fa-9ab0-08be085d72ca tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:32.272646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e03b321-e6f8-44fa-9ab0-08be085d72ca tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:32.273361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e03b321-e6f8-44fa-9ab0-08be085d72ca tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:32.273853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e03b321-e6f8-44fa-9ab0-08be085d72ca tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:32.274310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7e03b321-e6f8-44fa-9ab0-08be085d72ca tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:32.541893 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7e03b321-e6f8-44fa-9ab0-08be085d72ca tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1465 microversion: 2.1 time: 0.282134 Aug 27 05:39:32.542990 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3420/6845] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:32 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1465 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:33.037920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6242434-fa25-4059-a9b2-02f192662df8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:33.039156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6242434-fa25-4059-a9b2-02f192662df8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:33.047141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6242434-fa25-4059-a9b2-02f192662df8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:33.047642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6242434-fa25-4059-a9b2-02f192662df8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:33.048160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6242434-fa25-4059-a9b2-02f192662df8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:33.048888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6242434-fa25-4059-a9b2-02f192662df8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:33.049352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6242434-fa25-4059-a9b2-02f192662df8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:33.049790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6242434-fa25-4059-a9b2-02f192662df8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:33.190346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6242434-fa25-4059-a9b2-02f192662df8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:33.198736 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6242434-fa25-4059-a9b2-02f192662df8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1508 microversion: 2.1 time: 0.164984 Aug 27 05:39:33.199340 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3426/6846] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:33 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:33.566278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-05463be0-701f-45f8-9cc7-78a3f0bf3115 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:33.566848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-05463be0-701f-45f8-9cc7-78a3f0bf3115 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:33.575685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05463be0-701f-45f8-9cc7-78a3f0bf3115 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:33.576653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05463be0-701f-45f8-9cc7-78a3f0bf3115 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:33.577481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05463be0-701f-45f8-9cc7-78a3f0bf3115 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:33.578212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05463be0-701f-45f8-9cc7-78a3f0bf3115 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:33.578686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05463be0-701f-45f8-9cc7-78a3f0bf3115 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:33.579157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-05463be0-701f-45f8-9cc7-78a3f0bf3115 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:33.762582 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-05463be0-701f-45f8-9cc7-78a3f0bf3115 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1465 microversion: 2.1 time: 0.201914 Aug 27 05:39:33.763797 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3421/6847] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:33 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1465 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:34.413089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5be292d9-8999-4a09-ae74-503be45d4b91 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:34.415332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5be292d9-8999-4a09-ae74-503be45d4b91 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:34.422507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be292d9-8999-4a09-ae74-503be45d4b91 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:34.422996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be292d9-8999-4a09-ae74-503be45d4b91 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:34.423491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be292d9-8999-4a09-ae74-503be45d4b91 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:34.424198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be292d9-8999-4a09-ae74-503be45d4b91 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:34.424660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be292d9-8999-4a09-ae74-503be45d4b91 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:34.425084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5be292d9-8999-4a09-ae74-503be45d4b91 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:34.505542 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5be292d9-8999-4a09-ae74-503be45d4b91 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435/action" status: 200 len: 62920 microversion: 2.1 time: 0.096220 Aug 27 05:39:34.518096 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3427/6848] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:39:34 2022] POST /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435/action => generated 62920 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:39:34.790786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2c0df3a5-5eca-4381-a859-1d41951c3261 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:34.793014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2c0df3a5-5eca-4381-a859-1d41951c3261 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:34.805459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c0df3a5-5eca-4381-a859-1d41951c3261 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:34.805956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c0df3a5-5eca-4381-a859-1d41951c3261 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:34.806493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c0df3a5-5eca-4381-a859-1d41951c3261 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:34.807388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c0df3a5-5eca-4381-a859-1d41951c3261 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:34.808150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c0df3a5-5eca-4381-a859-1d41951c3261 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:34.808806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c0df3a5-5eca-4381-a859-1d41951c3261 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:34.954759 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2c0df3a5-5eca-4381-a859-1d41951c3261 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1465 microversion: 2.1 time: 0.171883 Aug 27 05:39:34.956689 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3422/6849] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:34 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1465 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:35.978941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a8401fcc-ece8-46a4-ad76-d00e898d0c13 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:35.979765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a8401fcc-ece8-46a4-ad76-d00e898d0c13 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:35.988083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8401fcc-ece8-46a4-ad76-d00e898d0c13 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:35.988586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8401fcc-ece8-46a4-ad76-d00e898d0c13 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:35.989034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8401fcc-ece8-46a4-ad76-d00e898d0c13 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:35.989762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8401fcc-ece8-46a4-ad76-d00e898d0c13 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:35.990234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8401fcc-ece8-46a4-ad76-d00e898d0c13 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:35.990668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8401fcc-ece8-46a4-ad76-d00e898d0c13 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:36.131585 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a8401fcc-ece8-46a4-ad76-d00e898d0c13 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1465 microversion: 2.1 time: 0.156940 Aug 27 05:39:36.132178 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3428/6850] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:35 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:37.157393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f316314c-f4fa-47d7-813f-2b5df48af533 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:37.158564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f316314c-f4fa-47d7-813f-2b5df48af533 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:37.161345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:37.163061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:37.176752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f316314c-f4fa-47d7-813f-2b5df48af533 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:37.177961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f316314c-f4fa-47d7-813f-2b5df48af533 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:37.178958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f316314c-f4fa-47d7-813f-2b5df48af533 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:37.180998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f316314c-f4fa-47d7-813f-2b5df48af533 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:37.182092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f316314c-f4fa-47d7-813f-2b5df48af533 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:37.183152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f316314c-f4fa-47d7-813f-2b5df48af533 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:37.274483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-904cba82-31cf-4984-99e6-7fbf05b9316b req-377ab397-f8e0-4fc5-966b-08df1e5bff2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce497dc-6abe-4319-ba55-862dd11ef15c", "name": "network-vif-plugged", "status": "completed", "tag": "d4cb2dde-35a2-44fb-b423-07c50b7aeba1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:37.293578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:37.298139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-904cba82-31cf-4984-99e6-7fbf05b9316b req-377ab397-f8e0-4fc5-966b-08df1e5bff2d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:37.299361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-904cba82-31cf-4984-99e6-7fbf05b9316b req-377ab397-f8e0-4fc5-966b-08df1e5bff2d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:37.300395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-904cba82-31cf-4984-99e6-7fbf05b9316b req-377ab397-f8e0-4fc5-966b-08df1e5bff2d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:37.327529 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-904cba82-31cf-4984-99e6-7fbf05b9316b req-377ab397-f8e0-4fc5-966b-08df1e5bff2d service nova] Creating event network-vif-plugged:d4cb2dde-35a2-44fb-b423-07c50b7aeba1 for instance bce497dc-6abe-4319-ba55-862dd11ef15c on n-h1-820368-35 Aug 27 05:39:37.339737 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-904cba82-31cf-4984-99e6-7fbf05b9316b req-377ab397-f8e0-4fc5-966b-08df1e5bff2d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072621 Aug 27 05:39:37.341650 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3429/6851] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:37.433872 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f316314c-f4fa-47d7-813f-2b5df48af533 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1465 microversion: 2.1 time: 0.281956 Aug 27 05:39:37.437872 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3423/6852] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:37 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1465 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:39:38.464154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-944b98cc-8774-459d-94bd-d6c8476c2e8f tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:38.464963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-944b98cc-8774-459d-94bd-d6c8476c2e8f tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:38.472943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-944b98cc-8774-459d-94bd-d6c8476c2e8f tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:38.473693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-944b98cc-8774-459d-94bd-d6c8476c2e8f tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:38.474231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-944b98cc-8774-459d-94bd-d6c8476c2e8f tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:38.475068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-944b98cc-8774-459d-94bd-d6c8476c2e8f tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:38.475572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-944b98cc-8774-459d-94bd-d6c8476c2e8f tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:38.476544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-944b98cc-8774-459d-94bd-d6c8476c2e8f tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:38.639936 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-944b98cc-8774-459d-94bd-d6c8476c2e8f tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1465 microversion: 2.1 time: 0.183305 Aug 27 05:39:38.640706 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3430/6853] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:38 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:39.666342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9ab20280-601c-4f93-8e66-9a1c6d789307 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:39.667171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9ab20280-601c-4f93-8e66-9a1c6d789307 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:39.676338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ab20280-601c-4f93-8e66-9a1c6d789307 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:39.677226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ab20280-601c-4f93-8e66-9a1c6d789307 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:39.677975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ab20280-601c-4f93-8e66-9a1c6d789307 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:39.679444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ab20280-601c-4f93-8e66-9a1c6d789307 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:39.680236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ab20280-601c-4f93-8e66-9a1c6d789307 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:39.680976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ab20280-601c-4f93-8e66-9a1c6d789307 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:39.856228 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9ab20280-601c-4f93-8e66-9a1c6d789307 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1649 microversion: 2.1 time: 0.194757 Aug 27 05:39:39.856832 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3424/6854] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:39 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1649 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:39.879182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f004676-2ea4-4873-91d2-fcd8025759ad tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:39.880027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1f004676-2ea4-4873-91d2-fcd8025759ad tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:39.887201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f004676-2ea4-4873-91d2-fcd8025759ad tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:39.887700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f004676-2ea4-4873-91d2-fcd8025759ad tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:39.888175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f004676-2ea4-4873-91d2-fcd8025759ad tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:39.888904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f004676-2ea4-4873-91d2-fcd8025759ad tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:39.889360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f004676-2ea4-4873-91d2-fcd8025759ad tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:39.889791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f004676-2ea4-4873-91d2-fcd8025759ad tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:40.368327 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1f004676-2ea4-4873-91d2-fcd8025759ad tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1649 microversion: 2.1 time: 0.493447 Aug 27 05:39:40.384899 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3431/6855] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:39 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1649 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:40.392104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e5daf06b-9719-4c8b-a2f3-353abf224f9a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:40.393086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e5daf06b-9719-4c8b-a2f3-353abf224f9a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:40.401420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5daf06b-9719-4c8b-a2f3-353abf224f9a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:40.402705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5daf06b-9719-4c8b-a2f3-353abf224f9a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:40.403597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5daf06b-9719-4c8b-a2f3-353abf224f9a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:40.405493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5daf06b-9719-4c8b-a2f3-353abf224f9a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:40.406041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5daf06b-9719-4c8b-a2f3-353abf224f9a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:40.406561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5daf06b-9719-4c8b-a2f3-353abf224f9a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:40.549122 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e5daf06b-9719-4c8b-a2f3-353abf224f9a tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1649 microversion: 2.1 time: 0.161873 Aug 27 05:39:40.549710 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3425/6856] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:40 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1649 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:40.616034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-456014951", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "availability_zone": "nova:n-h2-820368-35", "networks": [{"uuid": "6b5a6694-f28e-443c-b898-bd3616b8912d"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:40.692623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] validate_networks() for [('6b5a6694-f28e-443c-b898-bd3616b8912d', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:39:41.124772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:39:41.125389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:39:41.125684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:39:41.126093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:39:41.126502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:39:41.136211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:41.136700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:41.137129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:41.137858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:41.138533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:41.139388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:41.183062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Getting quotas for project 298db9acf2ea4fc19a565bce516391ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:39:41.190820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Getting quotas for user 19eb95af6e0f4c46abccfa218c65690d and project 298db9acf2ea4fc19a565bce516391ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:39:41.210219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:39:41.213150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:39:41.265974 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e176b589-5d0b-432d-b044-6903314f8348 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654149 Aug 27 05:39:41.266667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3432/6857] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:39:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:39:41.278499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a83aeb1f-13d8-4b53-a98b-2b06f672865e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:41.283273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a83aeb1f-13d8-4b53-a98b-2b06f672865e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:41.385924 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a83aeb1f-13d8-4b53-a98b-2b06f672865e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1328 microversion: 2.1 time: 0.110859 Aug 27 05:39:41.386277 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3426/6858] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:41 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:42.415355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-603c3ff2-90e5-41d4-9cef-106228b17010 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:42.416093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-603c3ff2-90e5-41d4-9cef-106228b17010 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:42.426903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-603c3ff2-90e5-41d4-9cef-106228b17010 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:42.427770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-603c3ff2-90e5-41d4-9cef-106228b17010 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:42.428305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-603c3ff2-90e5-41d4-9cef-106228b17010 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:42.429124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-603c3ff2-90e5-41d4-9cef-106228b17010 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:42.429662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-603c3ff2-90e5-41d4-9cef-106228b17010 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:42.430430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-603c3ff2-90e5-41d4-9cef-106228b17010 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:42.549071 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-603c3ff2-90e5-41d4-9cef-106228b17010 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1417 microversion: 2.1 time: 0.138188 Aug 27 05:39:42.563507 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3433/6859] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:42 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1417 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:43.572723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a1a83b19-90f2-4552-a8c7-b548eeb04d5b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:43.573368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a1a83b19-90f2-4552-a8c7-b548eeb04d5b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:43.582059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1a83b19-90f2-4552-a8c7-b548eeb04d5b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:43.582419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1a83b19-90f2-4552-a8c7-b548eeb04d5b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:43.583070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1a83b19-90f2-4552-a8c7-b548eeb04d5b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:43.584153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1a83b19-90f2-4552-a8c7-b548eeb04d5b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:43.584806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1a83b19-90f2-4552-a8c7-b548eeb04d5b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:43.585365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a1a83b19-90f2-4552-a8c7-b548eeb04d5b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:43.759950 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a1a83b19-90f2-4552-a8c7-b548eeb04d5b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1465 microversion: 2.1 time: 0.191990 Aug 27 05:39:43.760768 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3427/6860] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:43 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1465 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:44.039506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-cc520cb0-db6a-4bf3-9c3f-25a586b8ee06 req-23571e58-dd1a-49cd-a4cd-a6f48b4f7f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb7a348-dc71-4c27-8fa4-5646bf8a5858", "tag": "43fb2b37-c1e9-403e-9b8c-2ee7f2dafe89"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:44.068771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cc520cb0-db6a-4bf3-9c3f-25a586b8ee06 req-23571e58-dd1a-49cd-a4cd-a6f48b4f7f83 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:44.071324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cc520cb0-db6a-4bf3-9c3f-25a586b8ee06 req-23571e58-dd1a-49cd-a4cd-a6f48b4f7f83 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:44.076292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-cc520cb0-db6a-4bf3-9c3f-25a586b8ee06 req-23571e58-dd1a-49cd-a4cd-a6f48b4f7f83 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:44.102974 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-cc520cb0-db6a-4bf3-9c3f-25a586b8ee06 req-23571e58-dd1a-49cd-a4cd-a6f48b4f7f83 service nova] Creating event network-changed:43fb2b37-c1e9-403e-9b8c-2ee7f2dafe89 for instance 7bb7a348-dc71-4c27-8fa4-5646bf8a5858 on n-h2-820368-35 Aug 27 05:39:44.113822 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-cc520cb0-db6a-4bf3-9c3f-25a586b8ee06 req-23571e58-dd1a-49cd-a4cd-a6f48b4f7f83 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082711 Aug 27 05:39:44.115692 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3434/6861] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:44.783882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6b7393ec-a898-4e02-b3e3-97dc9a20ba9b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:44.784669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6b7393ec-a898-4e02-b3e3-97dc9a20ba9b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:44.793811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b7393ec-a898-4e02-b3e3-97dc9a20ba9b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:44.794781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b7393ec-a898-4e02-b3e3-97dc9a20ba9b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:44.795423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b7393ec-a898-4e02-b3e3-97dc9a20ba9b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:44.796170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b7393ec-a898-4e02-b3e3-97dc9a20ba9b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:44.796706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b7393ec-a898-4e02-b3e3-97dc9a20ba9b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:44.797152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6b7393ec-a898-4e02-b3e3-97dc9a20ba9b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:44.946763 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6b7393ec-a898-4e02-b3e3-97dc9a20ba9b tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1465 microversion: 2.1 time: 0.166570 Aug 27 05:39:44.960333 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3428/6862] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:44 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1465 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:39:45.981095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b8ac9d1-d220-4611-943c-c6ba876c6c27 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:45.982271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b8ac9d1-d220-4611-943c-c6ba876c6c27 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:45.991310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8ac9d1-d220-4611-943c-c6ba876c6c27 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:45.992416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8ac9d1-d220-4611-943c-c6ba876c6c27 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:45.992842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8ac9d1-d220-4611-943c-c6ba876c6c27 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:45.993561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8ac9d1-d220-4611-943c-c6ba876c6c27 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:45.994027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8ac9d1-d220-4611-943c-c6ba876c6c27 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:45.994454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b8ac9d1-d220-4611-943c-c6ba876c6c27 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:45.998766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=100 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:46.142068 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b8ac9d1-d220-4611-943c-c6ba876c6c27 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1465 microversion: 2.1 time: 0.177298 Aug 27 05:39:46.142837 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3435/6863] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:45 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1465 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:47.165259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-735e2c9b-f5f5-4421-b868-1110a6cc662c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:47.166019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-735e2c9b-f5f5-4421-b868-1110a6cc662c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:47.173727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735e2c9b-f5f5-4421-b868-1110a6cc662c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:47.174430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735e2c9b-f5f5-4421-b868-1110a6cc662c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:47.174894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735e2c9b-f5f5-4421-b868-1110a6cc662c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:47.178507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735e2c9b-f5f5-4421-b868-1110a6cc662c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:47.179047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735e2c9b-f5f5-4421-b868-1110a6cc662c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:47.179681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-735e2c9b-f5f5-4421-b868-1110a6cc662c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:47.371429 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-735e2c9b-f5f5-4421-b868-1110a6cc662c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1465 microversion: 2.1 time: 0.210709 Aug 27 05:39:47.372384 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3429/6864] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:47 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1465 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:48.395290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c152c636-5c3b-4283-a809-c605f14e79ff tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:48.396028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c152c636-5c3b-4283-a809-c605f14e79ff tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:48.399928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:48.409972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c152c636-5c3b-4283-a809-c605f14e79ff tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:48.410503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c152c636-5c3b-4283-a809-c605f14e79ff tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:48.410941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c152c636-5c3b-4283-a809-c605f14e79ff tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:48.412209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c152c636-5c3b-4283-a809-c605f14e79ff tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:48.412665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c152c636-5c3b-4283-a809-c605f14e79ff tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:48.413086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c152c636-5c3b-4283-a809-c605f14e79ff tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:48.573321 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c152c636-5c3b-4283-a809-c605f14e79ff tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1465 microversion: 2.1 time: 0.182879 Aug 27 05:39:48.582453 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3436/6865] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:48 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1465 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:49.596719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2c469fd5-0e2f-471a-b9f1-a39b6bee4099 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:49.597948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2c469fd5-0e2f-471a-b9f1-a39b6bee4099 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:49.601335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:49.609472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c469fd5-0e2f-471a-b9f1-a39b6bee4099 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:49.610128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c469fd5-0e2f-471a-b9f1-a39b6bee4099 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:49.610679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c469fd5-0e2f-471a-b9f1-a39b6bee4099 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:49.611586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c469fd5-0e2f-471a-b9f1-a39b6bee4099 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:49.612153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c469fd5-0e2f-471a-b9f1-a39b6bee4099 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:49.612700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2c469fd5-0e2f-471a-b9f1-a39b6bee4099 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:49.618069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=93 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:49.767880 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2c469fd5-0e2f-471a-b9f1-a39b6bee4099 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1465 microversion: 2.1 time: 0.176675 Aug 27 05:39:49.768542 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3430/6866] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:49 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1465 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:50.558643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-07357261-33d6-46f1-a094-1fae7f700435 req-da339fb6-feb1-43ad-b48a-14e6efcc99b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb7a348-dc71-4c27-8fa4-5646bf8a5858", "name": "network-vif-plugged", "status": "completed", "tag": "43fb2b37-c1e9-403e-9b8c-2ee7f2dafe89"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:50.576217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-07357261-33d6-46f1-a094-1fae7f700435 req-da339fb6-feb1-43ad-b48a-14e6efcc99b4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:50.576731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-07357261-33d6-46f1-a094-1fae7f700435 req-da339fb6-feb1-43ad-b48a-14e6efcc99b4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:50.577173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-07357261-33d6-46f1-a094-1fae7f700435 req-da339fb6-feb1-43ad-b48a-14e6efcc99b4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:50.590926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-07357261-33d6-46f1-a094-1fae7f700435 req-da339fb6-feb1-43ad-b48a-14e6efcc99b4 service nova] Creating event network-vif-plugged:43fb2b37-c1e9-403e-9b8c-2ee7f2dafe89 for instance 7bb7a348-dc71-4c27-8fa4-5646bf8a5858 on n-h2-820368-35 Aug 27 05:39:50.597050 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-07357261-33d6-46f1-a094-1fae7f700435 req-da339fb6-feb1-43ad-b48a-14e6efcc99b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044119 Aug 27 05:39:50.598472 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3437/6867] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:50.793133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53d37615-e2c8-4a41-bd10-63bf337014f9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:50.794044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-53d37615-e2c8-4a41-bd10-63bf337014f9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:50.802665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53d37615-e2c8-4a41-bd10-63bf337014f9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:50.810475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53d37615-e2c8-4a41-bd10-63bf337014f9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:50.811426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53d37615-e2c8-4a41-bd10-63bf337014f9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:50.812322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53d37615-e2c8-4a41-bd10-63bf337014f9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:50.812962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53d37615-e2c8-4a41-bd10-63bf337014f9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:50.813511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53d37615-e2c8-4a41-bd10-63bf337014f9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:50.982308 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-53d37615-e2c8-4a41-bd10-63bf337014f9 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1465 microversion: 2.1 time: 0.194946 Aug 27 05:39:50.983418 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3431/6868] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:50 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1465 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:51.899552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:51.900343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:51.906495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-51a15898-4d24-43cc-a9af-baf09a920a02 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "536c79da-bfe8-43a9-9f32-41e27231d6f8", "device": "/dev/sdb"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:51.909014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-51a15898-4d24-43cc-a9af-baf09a920a02 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:51.916134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51a15898-4d24-43cc-a9af-baf09a920a02 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:51.916635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51a15898-4d24-43cc-a9af-baf09a920a02 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:51.917073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51a15898-4d24-43cc-a9af-baf09a920a02 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:51.917788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51a15898-4d24-43cc-a9af-baf09a920a02 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:51.918247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51a15898-4d24-43cc-a9af-baf09a920a02 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:51.918683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51a15898-4d24-43cc-a9af-baf09a920a02 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:52.004760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f30b7dfc-9802-441b-9bab-02b7dee991f2 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:52.005325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f30b7dfc-9802-441b-9bab-02b7dee991f2 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:52.007230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:52.013837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f30b7dfc-9802-441b-9bab-02b7dee991f2 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:52.014332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f30b7dfc-9802-441b-9bab-02b7dee991f2 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:52.014780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f30b7dfc-9802-441b-9bab-02b7dee991f2 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:52.015532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f30b7dfc-9802-441b-9bab-02b7dee991f2 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:52.015997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f30b7dfc-9802-441b-9bab-02b7dee991f2 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:52.016438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f30b7dfc-9802-441b-9bab-02b7dee991f2 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:52.147942 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f30b7dfc-9802-441b-9bab-02b7dee991f2 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1465 microversion: 2.1 time: 0.146828 Aug 27 05:39:52.149069 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3432/6869] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:51 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1465 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:52.472924 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-51a15898-4d24-43cc-a9af-baf09a920a02 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "POST /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.574729 Aug 27 05:39:52.473546 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3438/6870] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:39:51 2022] POST /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef/os-volume_attachments => generated 194 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:53.171898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bdc76179-21dc-4e24-b150-2a51fb78100c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:53.172558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bdc76179-21dc-4e24-b150-2a51fb78100c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:53.180013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc76179-21dc-4e24-b150-2a51fb78100c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:53.180505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc76179-21dc-4e24-b150-2a51fb78100c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:53.180952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc76179-21dc-4e24-b150-2a51fb78100c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:53.181661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc76179-21dc-4e24-b150-2a51fb78100c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:53.182124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc76179-21dc-4e24-b150-2a51fb78100c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:53.182565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdc76179-21dc-4e24-b150-2a51fb78100c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:53.330226 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bdc76179-21dc-4e24-b150-2a51fb78100c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1649 microversion: 2.1 time: 0.161977 Aug 27 05:39:53.330821 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3433/6871] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:53 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1649 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:53.352761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8392df26-f50c-406a-8871-52295df02ff8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:53.353674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8392df26-f50c-406a-8871-52295df02ff8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:53.360239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8392df26-f50c-406a-8871-52295df02ff8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:53.360724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8392df26-f50c-406a-8871-52295df02ff8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:53.361153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8392df26-f50c-406a-8871-52295df02ff8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:53.361852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8392df26-f50c-406a-8871-52295df02ff8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:53.362303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8392df26-f50c-406a-8871-52295df02ff8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:53.362881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8392df26-f50c-406a-8871-52295df02ff8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:53.504312 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8392df26-f50c-406a-8871-52295df02ff8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1649 microversion: 2.1 time: 0.157013 Aug 27 05:39:53.504928 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3439/6872] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:53 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1649 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:53.525952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c2e1b747-264f-47b1-802b-352bb72684a1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:53.526499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c2e1b747-264f-47b1-802b-352bb72684a1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:53.533151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2e1b747-264f-47b1-802b-352bb72684a1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:53.533662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2e1b747-264f-47b1-802b-352bb72684a1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:53.534117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2e1b747-264f-47b1-802b-352bb72684a1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:53.534848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2e1b747-264f-47b1-802b-352bb72684a1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:53.535390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2e1b747-264f-47b1-802b-352bb72684a1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:53.535828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2e1b747-264f-47b1-802b-352bb72684a1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:53.678565 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c2e1b747-264f-47b1-802b-352bb72684a1 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1649 microversion: 2.1 time: 0.157160 Aug 27 05:39:53.679170 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3434/6873] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:53 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1649 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:53.699423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9914ee51-3195-4a32-ae12-3500b93f81c8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:53.699928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9914ee51-3195-4a32-ae12-3500b93f81c8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:53.706208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9914ee51-3195-4a32-ae12-3500b93f81c8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:53.706788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9914ee51-3195-4a32-ae12-3500b93f81c8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:53.707309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9914ee51-3195-4a32-ae12-3500b93f81c8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:53.708010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9914ee51-3195-4a32-ae12-3500b93f81c8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:53.708518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9914ee51-3195-4a32-ae12-3500b93f81c8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:53.708948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9914ee51-3195-4a32-ae12-3500b93f81c8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:53.990649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9914ee51-3195-4a32-ae12-3500b93f81c8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:39:54.085197 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9914ee51-3195-4a32-ae12-3500b93f81c8 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 204 len: 0 microversion: 2.1 time: 0.389150 Aug 27 05:39:54.085987 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3440/6874] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:39:53 2022] DELETE /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:39:54.098166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1948d5dc-7ea0-4a92-bf71-d6a1704e43ac tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:54.098808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1948d5dc-7ea0-4a92-bf71-d6a1704e43ac tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:54.105754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1948d5dc-7ea0-4a92-bf71-d6a1704e43ac tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:54.106267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1948d5dc-7ea0-4a92-bf71-d6a1704e43ac tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:54.106721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1948d5dc-7ea0-4a92-bf71-d6a1704e43ac tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:54.107480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1948d5dc-7ea0-4a92-bf71-d6a1704e43ac tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:54.107948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1948d5dc-7ea0-4a92-bf71-d6a1704e43ac tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:54.108391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1948d5dc-7ea0-4a92-bf71-d6a1704e43ac tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:54.248342 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1948d5dc-7ea0-4a92-bf71-d6a1704e43ac tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1655 microversion: 2.1 time: 0.156898 Aug 27 05:39:54.249260 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3435/6875] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:54 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:55.270241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3b06abe4-e581-438c-bba2-f951c9c1c23c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:55.271302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3b06abe4-e581-438c-bba2-f951c9c1c23c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:55.279481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b06abe4-e581-438c-bba2-f951c9c1c23c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:55.279974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b06abe4-e581-438c-bba2-f951c9c1c23c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:55.280419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b06abe4-e581-438c-bba2-f951c9c1c23c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:55.281157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b06abe4-e581-438c-bba2-f951c9c1c23c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:55.281631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b06abe4-e581-438c-bba2-f951c9c1c23c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:55.282053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3b06abe4-e581-438c-bba2-f951c9c1c23c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:55.428148 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3b06abe4-e581-438c-bba2-f951c9c1c23c tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1655 microversion: 2.1 time: 0.162210 Aug 27 05:39:55.428758 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3441/6876] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:55 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:56.393293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b7790a29-75fb-4f2a-9395-0bc644e93a03 req-d312734a-025b-44c9-aba1-449ef182c778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb7a348-dc71-4c27-8fa4-5646bf8a5858", "name": "network-vif-deleted", "tag": "43fb2b37-c1e9-403e-9b8c-2ee7f2dafe89"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:56.410288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b7790a29-75fb-4f2a-9395-0bc644e93a03 req-d312734a-025b-44c9-aba1-449ef182c778 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:56.411028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b7790a29-75fb-4f2a-9395-0bc644e93a03 req-d312734a-025b-44c9-aba1-449ef182c778 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:56.411668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b7790a29-75fb-4f2a-9395-0bc644e93a03 req-d312734a-025b-44c9-aba1-449ef182c778 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:56.427844 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b7790a29-75fb-4f2a-9395-0bc644e93a03 req-d312734a-025b-44c9-aba1-449ef182c778 service nova] Creating event network-vif-deleted:43fb2b37-c1e9-403e-9b8c-2ee7f2dafe89 for instance 7bb7a348-dc71-4c27-8fa4-5646bf8a5858 on n-h2-820368-35 Aug 27 05:39:56.436597 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b7790a29-75fb-4f2a-9395-0bc644e93a03 req-d312734a-025b-44c9-aba1-449ef182c778 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047150 Aug 27 05:39:56.444545 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3436/6877] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:56.450879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f3d1f7f8-f9d0-42d1-a4c9-898ca3ea8dae tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:56.451566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f3d1f7f8-f9d0-42d1-a4c9-898ca3ea8dae tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:56.462543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3d1f7f8-f9d0-42d1-a4c9-898ca3ea8dae tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:56.463121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3d1f7f8-f9d0-42d1-a4c9-898ca3ea8dae tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:56.467030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3d1f7f8-f9d0-42d1-a4c9-898ca3ea8dae tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:56.467871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3d1f7f8-f9d0-42d1-a4c9-898ca3ea8dae tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:56.468358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3d1f7f8-f9d0-42d1-a4c9-898ca3ea8dae tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:56.468803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3d1f7f8-f9d0-42d1-a4c9-898ca3ea8dae tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:56.568440 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f3d1f7f8-f9d0-42d1-a4c9-898ca3ea8dae tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 200 len: 1450 microversion: 2.1 time: 0.121336 Aug 27 05:39:56.570828 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3442/6878] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:56 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 1450 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:39:57.395261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-85a64d91-29dd-474e-84b4-010aee719e57 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:57.395987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-85a64d91-29dd-474e-84b4-010aee719e57 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:57.404088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a64d91-29dd-474e-84b4-010aee719e57 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:57.404088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a64d91-29dd-474e-84b4-010aee719e57 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:57.404570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a64d91-29dd-474e-84b4-010aee719e57 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:57.405135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a64d91-29dd-474e-84b4-010aee719e57 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:57.405611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a64d91-29dd-474e-84b4-010aee719e57 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:57.406046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-85a64d91-29dd-474e-84b4-010aee719e57 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:57.561649 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-85a64d91-29dd-474e-84b4-010aee719e57 tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1834 microversion: 2.1 time: 0.347240 Aug 27 05:39:57.562518 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3437/6879] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:57 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1834 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:39:57.590976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:57.592549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: 7bb7a348-dc71-4c27-8fa4-5646bf8a5858] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:57.600180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:57.601074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:57.601468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:57.602366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:57.602861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:57.603316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:57.619557 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] HTTP exception thrown: Instance 7bb7a348-dc71-4c27-8fa4-5646bf8a5858 could not be found. Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Request method failure captured: Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 HTTP/1.1 Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCa4Lln-gf1DCwrJi1eenGgdlVBsa_E5Cl0B1zYzIPL910Cfyt7X6RiRTRwQeCfwnQw16OHDK74Mbh5Sgp_SJmXbWXrwxgbK-tzfy_ykfDoVdDEMtZmh4MAsuPwNwDkeLvgPuehz3o9Zq9DVcQpihn3cum5a59rO00e2f7bI9NKLT9_k Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 298db9acf2ea4fc19a565bce516391ac Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestServerMultinode-257625492 Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_298db9acf2ea4fc19a565bce516391ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/298db9acf2ea4fc19a565bce516391ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/298db9acf2ea4fc19a565bce516391ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/298db9acf2ea4fc19a565bce516391ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestServerMultinode-257625492 Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 298db9acf2ea4fc19a565bce516391ac Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestServerMultinode-257625492 Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestServerMultinode-257625492-project-admin Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 19eb95af6e0f4c46abccfa218c65690d Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestServerMultinode-257625492-project-admin Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 7bb7a348-dc71-4c27-8fa4-5646bf8a5858 could not be found. Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '7bb7a348-dc71-4c27-8fa4-5646bf8a5858'} Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb7a348-dc71-4c27-8fa4-5646bf8a5858 could not be found. Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb7a348-dc71-4c27-8fa4-5646bf8a5858 could not be found. Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:39:57.621292 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:39:57.626286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:39:57.626286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:39:57.626286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:39:57.626286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:39:57.626286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:39:57.626286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb7a348-dc71-4c27-8fa4-5646bf8a5858 could not be found. Aug 27 05:39:57.626286 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:39:57.626286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Returning 404 to user: Instance 7bb7a348-dc71-4c27-8fa4-5646bf8a5858 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:39:57.626286 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fa2d2fd7-f89d-4bad-90cd-1ad821d67883 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858" status: 404 len: 111 microversion: 2.1 time: 0.035931 Aug 27 05:39:57.628490 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3443/6880] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:57 2022] GET /compute/v2.1/servers/7bb7a348-dc71-4c27-8fa4-5646bf8a5858 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:39:57.634271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-716f8cd7-7424-4849-8b85-00cb3d89ee70 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:57.634797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-716f8cd7-7424-4849-8b85-00cb3d89ee70 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:57.641901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-716f8cd7-7424-4849-8b85-00cb3d89ee70 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:57.642604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-716f8cd7-7424-4849-8b85-00cb3d89ee70 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:57.643072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-716f8cd7-7424-4849-8b85-00cb3d89ee70 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:57.643941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-716f8cd7-7424-4849-8b85-00cb3d89ee70 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:57.644420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-716f8cd7-7424-4849-8b85-00cb3d89ee70 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:57.644874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-716f8cd7-7424-4849-8b85-00cb3d89ee70 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:57.673091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-716f8cd7-7424-4849-8b85-00cb3d89ee70 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:39:57.757969 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-716f8cd7-7424-4849-8b85-00cb3d89ee70 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 204 len: 0 microversion: 2.1 time: 0.127561 Aug 27 05:39:57.759236 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3438/6881] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:39:57 2022] DELETE /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:39:57.770004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae93800d-3ecd-4b7d-8a4a-38473330712e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:57.771065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae93800d-3ecd-4b7d-8a4a-38473330712e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:57.778099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae93800d-3ecd-4b7d-8a4a-38473330712e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:57.778400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae93800d-3ecd-4b7d-8a4a-38473330712e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:57.778838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae93800d-3ecd-4b7d-8a4a-38473330712e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:57.779597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae93800d-3ecd-4b7d-8a4a-38473330712e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:57.780024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae93800d-3ecd-4b7d-8a4a-38473330712e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:57.780497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae93800d-3ecd-4b7d-8a4a-38473330712e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:58.003593 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae93800d-3ecd-4b7d-8a4a-38473330712e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1655 microversion: 2.1 time: 0.238852 Aug 27 05:39:58.004177 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3444/6882] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:57 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1655 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:58.581209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29ef7391-d323-410b-ae74-265f1d8a7dd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:58.581903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-29ef7391-d323-410b-ae74-265f1d8a7dd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:58.584142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-bb629de7-1b92-484f-9ce5-109dc1cd4cb9 req-ff344182-cde6-42dc-8817-53efbf5d3ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a861091e-e236-4038-916e-474e77bf6435", "tag": "d8cb1fd4-5dff-4920-aca4-525f1ec4f880"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:58.591380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ef7391-d323-410b-ae74-265f1d8a7dd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:58.591893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ef7391-d323-410b-ae74-265f1d8a7dd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:58.592346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ef7391-d323-410b-ae74-265f1d8a7dd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:58.593299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ef7391-d323-410b-ae74-265f1d8a7dd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:58.593934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ef7391-d323-410b-ae74-265f1d8a7dd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:58.594390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29ef7391-d323-410b-ae74-265f1d8a7dd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:58.597946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bb629de7-1b92-484f-9ce5-109dc1cd4cb9 req-ff344182-cde6-42dc-8817-53efbf5d3ff7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:58.598750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bb629de7-1b92-484f-9ce5-109dc1cd4cb9 req-ff344182-cde6-42dc-8817-53efbf5d3ff7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:58.599023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bb629de7-1b92-484f-9ce5-109dc1cd4cb9 req-ff344182-cde6-42dc-8817-53efbf5d3ff7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:58.614979 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-bb629de7-1b92-484f-9ce5-109dc1cd4cb9 req-ff344182-cde6-42dc-8817-53efbf5d3ff7 service nova] Creating event network-changed:d8cb1fd4-5dff-4920-aca4-525f1ec4f880 for instance a861091e-e236-4038-916e-474e77bf6435 on n-h2-820368-35 Aug 27 05:39:58.621587 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-bb629de7-1b92-484f-9ce5-109dc1cd4cb9 req-ff344182-cde6-42dc-8817-53efbf5d3ff7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042255 Aug 27 05:39:58.622953 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3445/6883] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:39:58.629852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-29ef7391-d323-410b-ae74-265f1d8a7dd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:39:58.726560 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-29ef7391-d323-410b-ae74-265f1d8a7dd7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 204 len: 0 microversion: 2.1 time: 0.149838 Aug 27 05:39:58.727675 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3439/6884] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:39:58 2022] DELETE /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:39:58.740045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8436b37c-6620-42ca-996b-38c0e2e3ef62 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:58.740901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8436b37c-6620-42ca-996b-38c0e2e3ef62 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:58.747609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8436b37c-6620-42ca-996b-38c0e2e3ef62 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:58.748105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8436b37c-6620-42ca-996b-38c0e2e3ef62 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:58.748555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8436b37c-6620-42ca-996b-38c0e2e3ef62 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:58.749283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8436b37c-6620-42ca-996b-38c0e2e3ef62 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:58.749738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8436b37c-6620-42ca-996b-38c0e2e3ef62 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:58.750171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8436b37c-6620-42ca-996b-38c0e2e3ef62 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:58.919044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8436b37c-6620-42ca-996b-38c0e2e3ef62 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:58.927416 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8436b37c-6620-42ca-996b-38c0e2e3ef62 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1687 microversion: 2.1 time: 0.193075 Aug 27 05:39:58.928266 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3446/6885] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:58 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:59.025612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb9cfa1a-b2c8-4bda-9146-8a438d15e10e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:59.026240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb9cfa1a-b2c8-4bda-9146-8a438d15e10e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:59.033169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb9cfa1a-b2c8-4bda-9146-8a438d15e10e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:59.033749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb9cfa1a-b2c8-4bda-9146-8a438d15e10e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:59.034158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb9cfa1a-b2c8-4bda-9146-8a438d15e10e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:59.034896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb9cfa1a-b2c8-4bda-9146-8a438d15e10e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:59.035412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb9cfa1a-b2c8-4bda-9146-8a438d15e10e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:59.035884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb9cfa1a-b2c8-4bda-9146-8a438d15e10e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:59.208886 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb9cfa1a-b2c8-4bda-9146-8a438d15e10e tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1655 microversion: 2.1 time: 0.187085 Aug 27 05:39:59.209167 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3440/6886] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:59 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1655 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:59.951424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e227ae99-a63d-45bc-9109-d105443d9dd4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:59.952180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e227ae99-a63d-45bc-9109-d105443d9dd4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:59.959691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e227ae99-a63d-45bc-9109-d105443d9dd4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:59.960216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e227ae99-a63d-45bc-9109-d105443d9dd4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:59.961222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e227ae99-a63d-45bc-9109-d105443d9dd4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:59.962259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e227ae99-a63d-45bc-9109-d105443d9dd4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:59.962995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e227ae99-a63d-45bc-9109-d105443d9dd4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:59.963711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e227ae99-a63d-45bc-9109-d105443d9dd4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:00.140088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e227ae99-a63d-45bc-9109-d105443d9dd4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:00.153650 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e227ae99-a63d-45bc-9109-d105443d9dd4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1687 microversion: 2.1 time: 0.206250 Aug 27 05:40:00.154863 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3447/6887] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:59 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1687 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:00.229532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:00.230185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:00.238084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:00.238640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:00.239117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:00.239841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:00.240492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:00.241128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:00.277244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:00.277745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:00.278199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:00.278664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lazy-loading 'fault' on Instance uuid bce497dc-6abe-4319-ba55-862dd11ef15c {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:40:00.332622 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4479a879-a39b-421b-a4de-2120886828fd tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 200 len: 1455 microversion: 2.1 time: 0.106740 Aug 27 05:40:00.333624 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3441/6888] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:00 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:00.638468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7a947821-3e1d-4c0f-a10c-e61d4fdd8ef8 req-2b33c592-1320-4d50-9242-499be053a5ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce497dc-6abe-4319-ba55-862dd11ef15c", "name": "network-vif-deleted", "tag": "d4cb2dde-35a2-44fb-b423-07c50b7aeba1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:00.649413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7a947821-3e1d-4c0f-a10c-e61d4fdd8ef8 req-2b33c592-1320-4d50-9242-499be053a5ed service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:00.649899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7a947821-3e1d-4c0f-a10c-e61d4fdd8ef8 req-2b33c592-1320-4d50-9242-499be053a5ed service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:00.650346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7a947821-3e1d-4c0f-a10c-e61d4fdd8ef8 req-2b33c592-1320-4d50-9242-499be053a5ed service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:00.662367 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7a947821-3e1d-4c0f-a10c-e61d4fdd8ef8 req-2b33c592-1320-4d50-9242-499be053a5ed service nova] Creating event network-vif-deleted:d4cb2dde-35a2-44fb-b423-07c50b7aeba1 for instance bce497dc-6abe-4319-ba55-862dd11ef15c on n-h1-820368-35 Aug 27 05:40:00.667468 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7a947821-3e1d-4c0f-a10c-e61d4fdd8ef8 req-2b33c592-1320-4d50-9242-499be053a5ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032697 Aug 27 05:40:00.668067 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3448/6889] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:40:00.988806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1add9a80-0860-4ab6-bd71-c7429590ba1e req-47618119-5dc8-4b29-8ffd-c58231d9ab85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a861091e-e236-4038-916e-474e77bf6435", "name": "network-vif-deleted", "tag": "d8cb1fd4-5dff-4920-aca4-525f1ec4f880"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:01.000957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1add9a80-0860-4ab6-bd71-c7429590ba1e req-47618119-5dc8-4b29-8ffd-c58231d9ab85 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:01.001692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1add9a80-0860-4ab6-bd71-c7429590ba1e req-47618119-5dc8-4b29-8ffd-c58231d9ab85 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:01.002279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1add9a80-0860-4ab6-bd71-c7429590ba1e req-47618119-5dc8-4b29-8ffd-c58231d9ab85 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:01.014672 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1add9a80-0860-4ab6-bd71-c7429590ba1e req-47618119-5dc8-4b29-8ffd-c58231d9ab85 service nova] Creating event network-vif-deleted:d8cb1fd4-5dff-4920-aca4-525f1ec4f880 for instance a861091e-e236-4038-916e-474e77bf6435 on n-h2-820368-35 Aug 27 05:40:01.020447 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1add9a80-0860-4ab6-bd71-c7429590ba1e req-47618119-5dc8-4b29-8ffd-c58231d9ab85 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042792 Aug 27 05:40:01.021065 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3442/6890] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:40:01.179778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:01.180483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:01.196451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:01.196879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:01.197444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:01.198675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:01.199172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:01.199606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:01.233498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:01.233993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:01.234436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:01.234882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lazy-loading 'fault' on Instance uuid a861091e-e236-4038-916e-474e77bf6435 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:40:01.278970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:01.287229 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0d0b68ff-f344-4676-a98b-c666d4391280 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 200 len: 1356 microversion: 2.1 time: 0.113890 Aug 27 05:40:01.287829 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3449/6891] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:01 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 1356 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:01.358444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:01.359333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] [instance: bce497dc-6abe-4319-ba55-862dd11ef15c] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:01.366002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:01.366706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:01.367681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:01.368386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:01.368849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:01.369287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:01.384595 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] HTTP exception thrown: Instance bce497dc-6abe-4319-ba55-862dd11ef15c could not be found. Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Request method failure captured: Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c HTTP/1.1 Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCa4Lln-gf1DCwrJi1eenGgdlVBsa_E5Cl0B1zYzIPL910Cfyt7X6RiRTRwQeCfwnQw16OHDK74Mbh5Sgp_SJmXbWXrwxgbK-tzfy_ykfDoVdDEMtZmh4MAsuPwNwDkeLvgPuehz3o9Zq9DVcQpihn3cum5a59rO00e2f7bI9NKLT9_k Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 298db9acf2ea4fc19a565bce516391ac Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestServerMultinode-257625492 Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_298db9acf2ea4fc19a565bce516391ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/298db9acf2ea4fc19a565bce516391ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/298db9acf2ea4fc19a565bce516391ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/298db9acf2ea4fc19a565bce516391ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestServerMultinode-257625492 Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 298db9acf2ea4fc19a565bce516391ac Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestServerMultinode-257625492 Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestServerMultinode-257625492-project-admin Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 19eb95af6e0f4c46abccfa218c65690d Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestServerMultinode-257625492-project-admin Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance bce497dc-6abe-4319-ba55-862dd11ef15c could not be found. Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'bce497dc-6abe-4319-ba55-862dd11ef15c'} Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce497dc-6abe-4319-ba55-862dd11ef15c could not be found. Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce497dc-6abe-4319-ba55-862dd11ef15c could not be found. Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:40:01.386272 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:40:01.391898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:40:01.391898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:40:01.391898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:40:01.391898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:40:01.391898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:40:01.391898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce497dc-6abe-4319-ba55-862dd11ef15c could not be found. Aug 27 05:40:01.391898 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:40:01.391898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] Returning 404 to user: Instance bce497dc-6abe-4319-ba55-862dd11ef15c could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:40:01.391898 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4101ba16-f814-417b-a073-8e6f830e8539 tempest-TestServerMultinode-257625492 tempest-TestServerMultinode-257625492-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c" status: 404 len: 111 microversion: 2.1 time: 0.035310 Aug 27 05:40:01.391898 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3443/6892] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:01 2022] GET /compute/v2.1/servers/bce497dc-6abe-4319-ba55-862dd11ef15c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:40:02.309960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:02.310619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a861091e-e236-4038-916e-474e77bf6435] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:02.313114 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:40:02.313272 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 05:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 (ip 10.222.0.58) !!! Aug 27 05:40:02.321804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:02.322334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:02.322664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:02.327795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:02.328238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:02.328693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:02.345309 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] HTTP exception thrown: Instance a861091e-e236-4038-916e-474e77bf6435 could not be found. Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Request method failure captured: Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 HTTP/1.1 Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCaycezwqVmI0SZtPDV6qQlpX2VkCFbV20Ge8JYrlntpSze_Q6CtDAirS7DSwwi9Bx81jXYcj_axSxQQoQpi7cI0bbJzLcATyBPqL779ERfMVzfXIEoodWpuViXpjJreCVt3Fb6SMBw2DwmxmRkxPcLcOBSVTt0BDw_-4gekJ_BBO45k Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: de208d7d0c4d4da1aff858285e6a08ea Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de208d7d0c4d4da1aff858285e6a08ea", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: de208d7d0c4d4da1aff858285e6a08ea Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestNetworkAdvancedServerOps-1874342116-project Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9d30f8e6a45046dfb2a9325ebd45e99a Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1874342116-project Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance a861091e-e236-4038-916e-474e77bf6435 could not be found. Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'a861091e-e236-4038-916e-474e77bf6435'} Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a861091e-e236-4038-916e-474e77bf6435 could not be found. Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a861091e-e236-4038-916e-474e77bf6435 could not be found. Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:40:02.347338 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:40:02.358020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:40:02.358020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:40:02.358020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:40:02.358020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:40:02.358020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:40:02.358020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:40:02.358020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a861091e-e236-4038-916e-474e77bf6435 could not be found. Aug 27 05:40:02.358020 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:40:02.358020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Returning 404 to user: Instance a861091e-e236-4038-916e-474e77bf6435 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:40:02.358020 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cf63982d-f2a0-4164-8641-3ce6f358c608 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435" status: 404 len: 111 microversion: 2.1 time: 0.042693 Aug 27 05:40:02.358020 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3450/6893] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:02 2022] GET /compute/v2.1/servers/a861091e-e236-4038-916e-474e77bf6435 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:40:07.338091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-63505df8-e655-4a44-bc1c-3c3c7c26c49a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '.version_select at 0x7fb55ffd0d30>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:07.419224 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-63505df8-e655-4a44-bc1c-3c3c7c26c49a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-510757875" status: 202 len: 0 microversion: 2.1 time: 0.094859 Aug 27 05:40:07.420130 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3444/6894] 10.222.0.58 () {58 vars in 1281 bytes} [Sat Aug 27 05:40:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-510757875 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:40:07.493788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4c094d5f-e832-440d-8f0e-5f948a5a2dbe tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'create', calling method: .version_select at 0x7fb56407b670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1903632464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfYSj3SU/l1K7IiQSz8wRPZz1sLU0eRtf9LYn19RvIK5nuurbkt8Y0pEsHw+1DTDge98Qt7Gz3m49HeYmO/rkQZlrv/tfB0VfX2KKRCBDfEPoRg17CZYRoXhc8hMLsaBQ=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:07.559331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4c094d5f-e832-440d-8f0e-5f948a5a2dbe tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:40:07.576306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4c094d5f-e832-440d-8f0e-5f948a5a2dbe tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for user 9d30f8e6a45046dfb2a9325ebd45e99a and project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:40:07.616504 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4c094d5f-e832-440d-8f0e-5f948a5a2dbe tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.134851 Aug 27 05:40:07.617180 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3451/6895] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:40:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:40:16.231637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:16.234106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1270808703", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "70bf4dc4-7c47-4e1b-97ba-23a365c4f1eb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1903632464", "security_groups": [{"name": "tempest-secgroup-smoke-1295963191"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:16.431677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] validate_networks() for [('70bf4dc4-7c47-4e1b-97ba-23a365c4f1eb', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:40:16.913065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:40:16.913277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:40:16.914493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:40:16.914999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:40:16.915499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:40:16.926095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:16.926692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:16.927264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:16.928477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:16.929020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:16.929575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:16.948374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:40:16.954990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for user 9d30f8e6a45046dfb2a9325ebd45e99a and project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:40:16.970825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:40:16.973589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:40:17.026980 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6c8450bd-f513-48db-aa62-44a6a29dfb43 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.799256 Aug 27 05:40:17.028042 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3445/6896] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:40:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:40:17.040394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fe989600-3ddd-4b7d-ab37-fac92b2d6f7f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:17.041013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fe989600-3ddd-4b7d-ab37-fac92b2d6f7f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:17.044073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:17.135124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fe989600-3ddd-4b7d-ab37-fac92b2d6f7f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:17.151829 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fe989600-3ddd-4b7d-ab37-fac92b2d6f7f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1267 microversion: 2.1 time: 0.115918 Aug 27 05:40:17.153239 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3452/6897] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:17 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:18.176611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5698a457-38cd-4ef6-a11f-d0def2d2095d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:18.177249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5698a457-38cd-4ef6-a11f-d0def2d2095d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:18.197112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5698a457-38cd-4ef6-a11f-d0def2d2095d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:18.197632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5698a457-38cd-4ef6-a11f-d0def2d2095d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:18.198282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5698a457-38cd-4ef6-a11f-d0def2d2095d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:18.199256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5698a457-38cd-4ef6-a11f-d0def2d2095d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:18.199760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5698a457-38cd-4ef6-a11f-d0def2d2095d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:18.200208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5698a457-38cd-4ef6-a11f-d0def2d2095d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:18.307525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5698a457-38cd-4ef6-a11f-d0def2d2095d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:18.317214 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5698a457-38cd-4ef6-a11f-d0def2d2095d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1319 microversion: 2.1 time: 0.146256 Aug 27 05:40:18.317858 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3446/6898] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:18 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:18.979301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e89d1323-930a-45bd-a220-d1876c0cc920 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:18.979857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e89d1323-930a-45bd-a220-d1876c0cc920 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:18.982512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:18.988721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e89d1323-930a-45bd-a220-d1876c0cc920 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:18.989219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e89d1323-930a-45bd-a220-d1876c0cc920 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:18.989679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e89d1323-930a-45bd-a220-d1876c0cc920 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:18.990365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e89d1323-930a-45bd-a220-d1876c0cc920 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:18.990821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e89d1323-930a-45bd-a220-d1876c0cc920 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:18.991581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e89d1323-930a-45bd-a220-d1876c0cc920 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:19.086986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-e89d1323-930a-45bd-a220-d1876c0cc920 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lazy-loading 'services' on Instance uuid 84321304-9113-4e3a-90b4-fd0da1abb7ef {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:40:19.183895 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e89d1323-930a-45bd-a220-d1876c0cc920 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "DELETE /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef/os-volume_attachments/536c79da-bfe8-43a9-9f32-41e27231d6f8" status: 202 len: 0 microversion: 2.1 time: 0.208873 Aug 27 05:40:19.184530 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3453/6899] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:40:18 2022] DELETE /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef/os-volume_attachments/536c79da-bfe8-43a9-9f32-41e27231d6f8 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:40:19.339403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c56e795-41dc-498d-bb43-bffc9a610ec0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:19.340328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c56e795-41dc-498d-bb43-bffc9a610ec0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:19.347816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c56e795-41dc-498d-bb43-bffc9a610ec0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:19.348331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c56e795-41dc-498d-bb43-bffc9a610ec0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:19.348784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c56e795-41dc-498d-bb43-bffc9a610ec0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:19.349789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c56e795-41dc-498d-bb43-bffc9a610ec0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:19.349992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c56e795-41dc-498d-bb43-bffc9a610ec0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:19.350939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c56e795-41dc-498d-bb43-bffc9a610ec0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:19.653742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c56e795-41dc-498d-bb43-bffc9a610ec0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:19.662384 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c56e795-41dc-498d-bb43-bffc9a610ec0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1393 microversion: 2.1 time: 0.327257 Aug 27 05:40:19.662977 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3447/6900] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:19 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1393 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:20.335021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-840f37cb-db05-43ce-a753-0328ce91c6ee req-7c37d0de-a988-49ec-ad69-434f588589d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f99dfee6-3e10-44a1-a50b-c5d86a49329e", "tag": "ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:20.352857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-840f37cb-db05-43ce-a753-0328ce91c6ee req-7c37d0de-a988-49ec-ad69-434f588589d2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:20.353705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-840f37cb-db05-43ce-a753-0328ce91c6ee req-7c37d0de-a988-49ec-ad69-434f588589d2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:20.354204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-840f37cb-db05-43ce-a753-0328ce91c6ee req-7c37d0de-a988-49ec-ad69-434f588589d2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:20.374606 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-840f37cb-db05-43ce-a753-0328ce91c6ee req-7c37d0de-a988-49ec-ad69-434f588589d2 service nova] Creating event network-changed:ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1 for instance f99dfee6-3e10-44a1-a50b-c5d86a49329e on n-h1-820368-35 Aug 27 05:40:20.379811 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-840f37cb-db05-43ce-a753-0328ce91c6ee req-7c37d0de-a988-49ec-ad69-434f588589d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057470 Aug 27 05:40:20.381061 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3454/6901] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:40:20.688754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3afea2bb-71f3-47e3-8263-25b21978a4bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:20.689565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3afea2bb-71f3-47e3-8263-25b21978a4bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:20.692336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:20.700821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3afea2bb-71f3-47e3-8263-25b21978a4bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:20.701353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3afea2bb-71f3-47e3-8263-25b21978a4bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:20.701838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3afea2bb-71f3-47e3-8263-25b21978a4bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:20.702726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3afea2bb-71f3-47e3-8263-25b21978a4bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:20.703268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3afea2bb-71f3-47e3-8263-25b21978a4bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:20.703712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3afea2bb-71f3-47e3-8263-25b21978a4bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:20.925488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3afea2bb-71f3-47e3-8263-25b21978a4bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:20.935010 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3afea2bb-71f3-47e3-8263-25b21978a4bf tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1393 microversion: 2.1 time: 0.252034 Aug 27 05:40:20.936504 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3448/6902] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:20 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1393 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:21.958928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-07cba57b-9ddd-4e12-92a7-f760e9853ecd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:21.960336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-07cba57b-9ddd-4e12-92a7-f760e9853ecd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:21.967507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07cba57b-9ddd-4e12-92a7-f760e9853ecd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:21.968005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07cba57b-9ddd-4e12-92a7-f760e9853ecd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:21.968638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07cba57b-9ddd-4e12-92a7-f760e9853ecd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:21.969477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07cba57b-9ddd-4e12-92a7-f760e9853ecd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:21.969933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07cba57b-9ddd-4e12-92a7-f760e9853ecd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:21.970538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-07cba57b-9ddd-4e12-92a7-f760e9853ecd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:22.116409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-07cba57b-9ddd-4e12-92a7-f760e9853ecd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:22.126062 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-07cba57b-9ddd-4e12-92a7-f760e9853ecd tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1393 microversion: 2.1 time: 0.172550 Aug 27 05:40:22.139480 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3455/6903] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:21 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1393 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:23.147994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4be1f795-8679-4971-a5be-84aaa8276df6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:23.149300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4be1f795-8679-4971-a5be-84aaa8276df6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:23.157067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be1f795-8679-4971-a5be-84aaa8276df6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:23.157573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be1f795-8679-4971-a5be-84aaa8276df6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:23.158029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be1f795-8679-4971-a5be-84aaa8276df6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:23.158759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be1f795-8679-4971-a5be-84aaa8276df6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:23.159297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be1f795-8679-4971-a5be-84aaa8276df6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:23.159743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4be1f795-8679-4971-a5be-84aaa8276df6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:23.346972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4be1f795-8679-4971-a5be-84aaa8276df6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:23.355458 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4be1f795-8679-4971-a5be-84aaa8276df6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1393 microversion: 2.1 time: 0.211350 Aug 27 05:40:23.356059 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3449/6904] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:23 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1393 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:24.376130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2ce154ec-3876-41b5-8507-d695ad75043e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:24.376749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2ce154ec-3876-41b5-8507-d695ad75043e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:24.384078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce154ec-3876-41b5-8507-d695ad75043e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:24.384593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce154ec-3876-41b5-8507-d695ad75043e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:24.385040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce154ec-3876-41b5-8507-d695ad75043e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:24.385743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce154ec-3876-41b5-8507-d695ad75043e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:24.386204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce154ec-3876-41b5-8507-d695ad75043e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:24.386639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ce154ec-3876-41b5-8507-d695ad75043e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:24.519716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2ce154ec-3876-41b5-8507-d695ad75043e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:24.527815 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2ce154ec-3876-41b5-8507-d695ad75043e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1393 microversion: 2.1 time: 0.155633 Aug 27 05:40:24.528386 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3456/6905] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:24 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:24.569913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e362705e-2843-487c-ae6e-8b833975ffaf tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:24.571413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e362705e-2843-487c-ae6e-8b833975ffaf tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:24.577999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e362705e-2843-487c-ae6e-8b833975ffaf tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:24.578493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e362705e-2843-487c-ae6e-8b833975ffaf tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:24.578943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e362705e-2843-487c-ae6e-8b833975ffaf tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:24.579672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e362705e-2843-487c-ae6e-8b833975ffaf tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:24.580138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e362705e-2843-487c-ae6e-8b833975ffaf tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:24.580577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e362705e-2843-487c-ae6e-8b833975ffaf tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:24.608207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e362705e-2843-487c-ae6e-8b833975ffaf tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:40:24.685903 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e362705e-2843-487c-ae6e-8b833975ffaf tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "DELETE /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 204 len: 0 microversion: 2.1 time: 0.119667 Aug 27 05:40:24.686656 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3450/6906] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:40:24 2022] DELETE /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:40:24.697103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4a784675-6467-40e3-8276-c495168df89a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:24.697722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4a784675-6467-40e3-8276-c495168df89a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:24.704020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a784675-6467-40e3-8276-c495168df89a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:24.704502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a784675-6467-40e3-8276-c495168df89a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:24.704936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a784675-6467-40e3-8276-c495168df89a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:24.705630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a784675-6467-40e3-8276-c495168df89a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:24.706081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a784675-6467-40e3-8276-c495168df89a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:24.706503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a784675-6467-40e3-8276-c495168df89a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:24.834293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4a784675-6467-40e3-8276-c495168df89a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:24.842330 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4a784675-6467-40e3-8276-c495168df89a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1514 microversion: 2.1 time: 0.151154 Aug 27 05:40:24.843055 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3457/6907] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:24 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:25.549283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7305025d-de6e-4dd2-ba78-b7456686b5c7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:25.550000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7305025d-de6e-4dd2-ba78-b7456686b5c7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:25.556021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7305025d-de6e-4dd2-ba78-b7456686b5c7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:25.556527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7305025d-de6e-4dd2-ba78-b7456686b5c7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:25.556984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7305025d-de6e-4dd2-ba78-b7456686b5c7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:25.557693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7305025d-de6e-4dd2-ba78-b7456686b5c7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:25.558165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7305025d-de6e-4dd2-ba78-b7456686b5c7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:25.558608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7305025d-de6e-4dd2-ba78-b7456686b5c7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:25.692652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7305025d-de6e-4dd2-ba78-b7456686b5c7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:25.701040 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7305025d-de6e-4dd2-ba78-b7456686b5c7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1393 microversion: 2.1 time: 0.155940 Aug 27 05:40:25.701624 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3451/6908] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:25 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:25.864288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae6e363d-9cd1-4a4e-a999-5925fea752ca tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:25.864916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae6e363d-9cd1-4a4e-a999-5925fea752ca tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:25.872512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e363d-9cd1-4a4e-a999-5925fea752ca tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:25.873008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e363d-9cd1-4a4e-a999-5925fea752ca tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:25.873604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e363d-9cd1-4a4e-a999-5925fea752ca tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:25.874339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e363d-9cd1-4a4e-a999-5925fea752ca tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:25.874799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e363d-9cd1-4a4e-a999-5925fea752ca tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:25.875252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e363d-9cd1-4a4e-a999-5925fea752ca tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:26.029587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae6e363d-9cd1-4a4e-a999-5925fea752ca tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:26.038051 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae6e363d-9cd1-4a4e-a999-5925fea752ca tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1514 microversion: 2.1 time: 0.177614 Aug 27 05:40:26.038634 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3458/6909] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:25 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:26.725838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9224ec8-9071-46b5-bf3c-86a4ff7f2639 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:26.726840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9224ec8-9071-46b5-bf3c-86a4ff7f2639 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:26.734691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9224ec8-9071-46b5-bf3c-86a4ff7f2639 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:26.735301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9224ec8-9071-46b5-bf3c-86a4ff7f2639 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:26.735820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9224ec8-9071-46b5-bf3c-86a4ff7f2639 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:26.736716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9224ec8-9071-46b5-bf3c-86a4ff7f2639 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:26.737252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9224ec8-9071-46b5-bf3c-86a4ff7f2639 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:26.737771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9224ec8-9071-46b5-bf3c-86a4ff7f2639 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:26.885053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f9224ec8-9071-46b5-bf3c-86a4ff7f2639 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:26.898085 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9224ec8-9071-46b5-bf3c-86a4ff7f2639 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1393 microversion: 2.1 time: 0.178417 Aug 27 05:40:26.899184 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3452/6910] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:26 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:27.028977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-02dd9def-9ce3-4df0-8cf9-c8b2cc528976 req-e94abdbf-2cbb-466e-b08b-cfcbb354f3ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84321304-9113-4e3a-90b4-fd0da1abb7ef", "name": "network-vif-deleted", "tag": "b9aaa289-4b88-42f6-966d-12863cc36859"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:27.042951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-02dd9def-9ce3-4df0-8cf9-c8b2cc528976 req-e94abdbf-2cbb-466e-b08b-cfcbb354f3ed service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:27.044273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-02dd9def-9ce3-4df0-8cf9-c8b2cc528976 req-e94abdbf-2cbb-466e-b08b-cfcbb354f3ed service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:27.045057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-02dd9def-9ce3-4df0-8cf9-c8b2cc528976 req-e94abdbf-2cbb-466e-b08b-cfcbb354f3ed service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:27.058354 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-02dd9def-9ce3-4df0-8cf9-c8b2cc528976 req-e94abdbf-2cbb-466e-b08b-cfcbb354f3ed service nova] Creating event network-vif-deleted:b9aaa289-4b88-42f6-966d-12863cc36859 for instance 84321304-9113-4e3a-90b4-fd0da1abb7ef on n-h2-820368-35 Aug 27 05:40:27.061375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b7ea9458-c10f-4844-b864-2210a5797204 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:27.062341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b7ea9458-c10f-4844-b864-2210a5797204 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:27.064684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:27.065770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:27.065975 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-02dd9def-9ce3-4df0-8cf9-c8b2cc528976 req-e94abdbf-2cbb-466e-b08b-cfcbb354f3ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039200 Aug 27 05:40:27.067145 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3459/6911] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:40:27.073934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7ea9458-c10f-4844-b864-2210a5797204 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:27.074447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7ea9458-c10f-4844-b864-2210a5797204 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:27.074930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7ea9458-c10f-4844-b864-2210a5797204 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:27.075697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7ea9458-c10f-4844-b864-2210a5797204 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:27.076184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7ea9458-c10f-4844-b864-2210a5797204 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:27.077457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7ea9458-c10f-4844-b864-2210a5797204 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:27.154062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b7ea9458-c10f-4844-b864-2210a5797204 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:27.165098 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b7ea9458-c10f-4844-b864-2210a5797204 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 200 len: 1304 microversion: 2.1 time: 0.107612 Aug 27 05:40:27.165708 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3453/6912] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:27 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:27.490909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d7fb049c-6ba8-48f4-99e0-02abcfc81463 req-8bfbfe9e-c4e9-4eda-93e3-ce423aa17556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99dfee6-3e10-44a1-a50b-c5d86a49329e", "name": "network-vif-plugged", "status": "completed", "tag": "ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:27.498278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:27.511403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d7fb049c-6ba8-48f4-99e0-02abcfc81463 req-8bfbfe9e-c4e9-4eda-93e3-ce423aa17556 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:27.511889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d7fb049c-6ba8-48f4-99e0-02abcfc81463 req-8bfbfe9e-c4e9-4eda-93e3-ce423aa17556 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:27.512329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d7fb049c-6ba8-48f4-99e0-02abcfc81463 req-8bfbfe9e-c4e9-4eda-93e3-ce423aa17556 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:27.525019 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d7fb049c-6ba8-48f4-99e0-02abcfc81463 req-8bfbfe9e-c4e9-4eda-93e3-ce423aa17556 service nova] Creating event network-vif-plugged:ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1 for instance f99dfee6-3e10-44a1-a50b-c5d86a49329e on n-h1-820368-35 Aug 27 05:40:27.530489 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d7fb049c-6ba8-48f4-99e0-02abcfc81463 req-8bfbfe9e-c4e9-4eda-93e3-ce423aa17556 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057503 Aug 27 05:40:27.531130 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3460/6913] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:40:27.922399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b821715e-0157-4312-b035-f12c92bb91ca tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:27.923023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b821715e-0157-4312-b035-f12c92bb91ca tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:27.930947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b821715e-0157-4312-b035-f12c92bb91ca tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:27.931486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b821715e-0157-4312-b035-f12c92bb91ca tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:27.931939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b821715e-0157-4312-b035-f12c92bb91ca tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:27.932661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b821715e-0157-4312-b035-f12c92bb91ca tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:27.933130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b821715e-0157-4312-b035-f12c92bb91ca tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:27.933567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b821715e-0157-4312-b035-f12c92bb91ca tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:28.121998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b821715e-0157-4312-b035-f12c92bb91ca tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:28.129637 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b821715e-0157-4312-b035-f12c92bb91ca tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1393 microversion: 2.1 time: 0.211224 Aug 27 05:40:28.130217 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3454/6914] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:27 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1393 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:28.187455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:28.188192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: 84321304-9113-4e3a-90b4-fd0da1abb7ef] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:28.194375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:28.194858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:28.195351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:28.196043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:28.196497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:28.196918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:28.210254 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] HTTP exception thrown: Instance 84321304-9113-4e3a-90b4-fd0da1abb7ef could not be found. Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Request method failure captured: Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef HTTP/1.1 Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCa3C5opkSAdZG7D2K0mIK-NqaBT5FU_7weJz1vkeD8xImy_j8Y_MNa5pUGgSTXBMbhXRDaMrDlq9cDOThjYTJ--gQzRA7KKOUjeghxmLcnSNqpPiUmzYFRqupzAYBKLEpCbqoYZa-p9eL5_-sotNVXG3upuvWFVfh_9LPgIP2-2aJug Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 90ce936a1cd74ee68c1a8fc64d466774 Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1243303456 Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ce936a1cd74ee68c1a8fc64d466774", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ce936a1cd74ee68c1a8fc64d466774"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ce936a1cd74ee68c1a8fc64d466774"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ce936a1cd74ee68c1a8fc64d466774"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesSnapshotTestJSON-1243303456 Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 90ce936a1cd74ee68c1a8fc64d466774 Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1243303456 Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesSnapshotTestJSON-1243303456-project Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 7a51b3c1aa404f6b91581571626af555 Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesSnapshotTestJSON-1243303456-project Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 84321304-9113-4e3a-90b4-fd0da1abb7ef could not be found. Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '84321304-9113-4e3a-90b4-fd0da1abb7ef'} Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84321304-9113-4e3a-90b4-fd0da1abb7ef could not be found. Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84321304-9113-4e3a-90b4-fd0da1abb7ef could not be found. Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:40:28.213003 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:40:28.218515 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:40:28.218515 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:40:28.218515 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:40:28.218515 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:40:28.218515 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:40:28.218515 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84321304-9113-4e3a-90b4-fd0da1abb7ef could not be found. Aug 27 05:40:28.218515 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:40:28.218515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Returning 404 to user: Instance 84321304-9113-4e3a-90b4-fd0da1abb7ef could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:40:28.218515 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-33923d97-bbd7-48bc-af1f-ac55236482f5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef" status: 404 len: 111 microversion: 2.1 time: 0.032433 Aug 27 05:40:28.218515 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3461/6915] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:28 2022] GET /compute/v2.1/servers/84321304-9113-4e3a-90b4-fd0da1abb7ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:40:29.152150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-707c0ab5-60d4-4950-bb0e-6770819ac968 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:29.152705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-707c0ab5-60d4-4950-bb0e-6770819ac968 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:29.159849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-707c0ab5-60d4-4950-bb0e-6770819ac968 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:29.160353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-707c0ab5-60d4-4950-bb0e-6770819ac968 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:29.160812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-707c0ab5-60d4-4950-bb0e-6770819ac968 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:29.161532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-707c0ab5-60d4-4950-bb0e-6770819ac968 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:29.162007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-707c0ab5-60d4-4950-bb0e-6770819ac968 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:29.162451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-707c0ab5-60d4-4950-bb0e-6770819ac968 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:29.308204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-707c0ab5-60d4-4950-bb0e-6770819ac968 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:29.316315 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-707c0ab5-60d4-4950-bb0e-6770819ac968 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1393 microversion: 2.1 time: 0.169652 Aug 27 05:40:29.316893 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3455/6916] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:29 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:40:30.337600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-77b205ee-1d49-4556-a4d2-9ef78486c732 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:30.338224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-77b205ee-1d49-4556-a4d2-9ef78486c732 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:30.345490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77b205ee-1d49-4556-a4d2-9ef78486c732 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:30.345917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77b205ee-1d49-4556-a4d2-9ef78486c732 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:30.346359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77b205ee-1d49-4556-a4d2-9ef78486c732 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:30.347074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77b205ee-1d49-4556-a4d2-9ef78486c732 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:30.347551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77b205ee-1d49-4556-a4d2-9ef78486c732 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:30.347981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77b205ee-1d49-4556-a4d2-9ef78486c732 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:30.484903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-77b205ee-1d49-4556-a4d2-9ef78486c732 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:30.493232 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-77b205ee-1d49-4556-a4d2-9ef78486c732 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1564 microversion: 2.1 time: 0.159532 Aug 27 05:40:30.493896 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3462/6917] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:30 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:30.513522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8849cdc1-61c8-4b57-8382-b2f3576fdb23 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:30.514428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8849cdc1-61c8-4b57-8382-b2f3576fdb23 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:30.521849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8849cdc1-61c8-4b57-8382-b2f3576fdb23 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:30.522354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8849cdc1-61c8-4b57-8382-b2f3576fdb23 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:30.522807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8849cdc1-61c8-4b57-8382-b2f3576fdb23 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:30.524354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8849cdc1-61c8-4b57-8382-b2f3576fdb23 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:30.524819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8849cdc1-61c8-4b57-8382-b2f3576fdb23 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:30.525257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8849cdc1-61c8-4b57-8382-b2f3576fdb23 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:30.676413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8849cdc1-61c8-4b57-8382-b2f3576fdb23 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:30.684579 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8849cdc1-61c8-4b57-8382-b2f3576fdb23 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1564 microversion: 2.1 time: 0.174835 Aug 27 05:40:30.685201 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3456/6918] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:30 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:32.602442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5a929d40-74e8-42f0-9d5f-22ccfaf2118b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:32.604837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5a929d40-74e8-42f0-9d5f-22ccfaf2118b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:32.608344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-de51b612-2dce-4ac9-8500-f176792ecfcc req-5aa1dd08-438e-4129-af02-73434ad5412e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f99dfee6-3e10-44a1-a50b-c5d86a49329e", "tag": "ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:32.612475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a929d40-74e8-42f0-9d5f-22ccfaf2118b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:32.613257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a929d40-74e8-42f0-9d5f-22ccfaf2118b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:32.613906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a929d40-74e8-42f0-9d5f-22ccfaf2118b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:32.614820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a929d40-74e8-42f0-9d5f-22ccfaf2118b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:32.615543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a929d40-74e8-42f0-9d5f-22ccfaf2118b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:32.616170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a929d40-74e8-42f0-9d5f-22ccfaf2118b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:32.628745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-de51b612-2dce-4ac9-8500-f176792ecfcc req-5aa1dd08-438e-4129-af02-73434ad5412e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:32.629757 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-de51b612-2dce-4ac9-8500-f176792ecfcc req-5aa1dd08-438e-4129-af02-73434ad5412e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:32.631794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-de51b612-2dce-4ac9-8500-f176792ecfcc req-5aa1dd08-438e-4129-af02-73434ad5412e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:32.647135 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-de51b612-2dce-4ac9-8500-f176792ecfcc req-5aa1dd08-438e-4129-af02-73434ad5412e service nova] Creating event network-changed:ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1 for instance f99dfee6-3e10-44a1-a50b-c5d86a49329e on n-h1-820368-35 Aug 27 05:40:32.653421 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-de51b612-2dce-4ac9-8500-f176792ecfcc req-5aa1dd08-438e-4129-af02-73434ad5412e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053489 Aug 27 05:40:32.655986 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3457/6919] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:40:32.934276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5a929d40-74e8-42f0-9d5f-22ccfaf2118b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:32.948038 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5a929d40-74e8-42f0-9d5f-22ccfaf2118b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1564 microversion: 2.1 time: 0.350504 Aug 27 05:40:32.964123 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3463/6920] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:32 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1564 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:35.293074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-251312549", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "6d5e9429-0a21-400b-9a95-82012cbc0d28"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:35.349544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] validate_networks() for [('6d5e9429-0a21-400b-9a95-82012cbc0d28', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:40:35.710329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:40:35.710767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:40:35.711292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:40:35.711713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:40:35.712135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:40:35.721428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:35.721932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:35.722381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:35.723176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:35.723645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:35.724086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:35.740794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Getting quotas for project 90ce936a1cd74ee68c1a8fc64d466774. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:40:35.746930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Getting quotas for user 7a51b3c1aa404f6b91581571626af555 and project 90ce936a1cd74ee68c1a8fc64d466774. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:40:35.759776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:40:35.762410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:40:35.822358 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7bc3c20-ce65-43ed-a9be-72623144741a tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534966 Aug 27 05:40:35.827292 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3458/6921] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:40:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:40:35.836755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-08460169-72e9-4d7c-8622-1c36b46ef9a5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:35.840542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-08460169-72e9-4d7c-8622-1c36b46ef9a5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:35.911802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-08460169-72e9-4d7c-8622-1c36b46ef9a5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:35.919433 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-08460169-72e9-4d7c-8622-1c36b46ef9a5 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1218 microversion: 2.1 time: 0.088902 Aug 27 05:40:35.930895 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3464/6922] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:35 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:40:36.958639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0e331648-27da-4fa8-9a7c-59f9652a505d tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:36.964683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0e331648-27da-4fa8-9a7c-59f9652a505d tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:36.977925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e331648-27da-4fa8-9a7c-59f9652a505d tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:36.979263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e331648-27da-4fa8-9a7c-59f9652a505d tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:36.979943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e331648-27da-4fa8-9a7c-59f9652a505d tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:36.980853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e331648-27da-4fa8-9a7c-59f9652a505d tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:36.981495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e331648-27da-4fa8-9a7c-59f9652a505d tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:36.982120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e331648-27da-4fa8-9a7c-59f9652a505d tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:37.094280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0e331648-27da-4fa8-9a7c-59f9652a505d tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:37.111445 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0e331648-27da-4fa8-9a7c-59f9652a505d tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1278 microversion: 2.1 time: 0.171851 Aug 27 05:40:37.121534 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3459/6923] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:36 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:38.158663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5d070939-5e9f-42b0-a7a8-d7d55cf1c8e0 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:38.159557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5d070939-5e9f-42b0-a7a8-d7d55cf1c8e0 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:38.186479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d070939-5e9f-42b0-a7a8-d7d55cf1c8e0 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:38.186997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d070939-5e9f-42b0-a7a8-d7d55cf1c8e0 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:38.187482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d070939-5e9f-42b0-a7a8-d7d55cf1c8e0 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:38.188498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d070939-5e9f-42b0-a7a8-d7d55cf1c8e0 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:38.195303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d070939-5e9f-42b0-a7a8-d7d55cf1c8e0 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:38.196004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d070939-5e9f-42b0-a7a8-d7d55cf1c8e0 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:38.400645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d070939-5e9f-42b0-a7a8-d7d55cf1c8e0 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:38.410445 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5d070939-5e9f-42b0-a7a8-d7d55cf1c8e0 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1318 microversion: 2.1 time: 0.256887 Aug 27 05:40:38.411253 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3465/6924] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:38 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:38.849058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-84d53a8c-5c1a-4c59-8943-57f5e1e8f428 req-f8064982-2327-4540-81bf-46e428f45597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c33d93-a67f-407f-9852-8af6bd8ebb6e", "tag": "2c6edc6e-1134-4cc7-abe8-88e4437258ad"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:38.862431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-84d53a8c-5c1a-4c59-8943-57f5e1e8f428 req-f8064982-2327-4540-81bf-46e428f45597 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:38.862994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-84d53a8c-5c1a-4c59-8943-57f5e1e8f428 req-f8064982-2327-4540-81bf-46e428f45597 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:38.863479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-84d53a8c-5c1a-4c59-8943-57f5e1e8f428 req-f8064982-2327-4540-81bf-46e428f45597 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:38.877142 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-84d53a8c-5c1a-4c59-8943-57f5e1e8f428 req-f8064982-2327-4540-81bf-46e428f45597 service nova] Creating event network-changed:2c6edc6e-1134-4cc7-abe8-88e4437258ad for instance d4c33d93-a67f-407f-9852-8af6bd8ebb6e on n-h2-820368-35 Aug 27 05:40:38.892911 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-84d53a8c-5c1a-4c59-8943-57f5e1e8f428 req-f8064982-2327-4540-81bf-46e428f45597 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048416 Aug 27 05:40:38.893684 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3460/6925] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:40:39.440713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5ac3764-8519-4b06-ba99-b0c6950eb741 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:39.441445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e5ac3764-8519-4b06-ba99-b0c6950eb741 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:39.458674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5ac3764-8519-4b06-ba99-b0c6950eb741 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:39.459700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5ac3764-8519-4b06-ba99-b0c6950eb741 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:39.462378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5ac3764-8519-4b06-ba99-b0c6950eb741 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:39.463686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5ac3764-8519-4b06-ba99-b0c6950eb741 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:39.465131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5ac3764-8519-4b06-ba99-b0c6950eb741 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:39.467143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5ac3764-8519-4b06-ba99-b0c6950eb741 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:39.691521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e5ac3764-8519-4b06-ba99-b0c6950eb741 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:39.707861 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e5ac3764-8519-4b06-ba99-b0c6950eb741 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1318 microversion: 2.1 time: 0.272991 Aug 27 05:40:39.709566 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3466/6926] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:39 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:40.736281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8504edc9-e1f6-4a4e-8efd-aee718c8dd37 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:40.737709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8504edc9-e1f6-4a4e-8efd-aee718c8dd37 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:40.745337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8504edc9-e1f6-4a4e-8efd-aee718c8dd37 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:40.745848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8504edc9-e1f6-4a4e-8efd-aee718c8dd37 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:40.746298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8504edc9-e1f6-4a4e-8efd-aee718c8dd37 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:40.747118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8504edc9-e1f6-4a4e-8efd-aee718c8dd37 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:40.747580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8504edc9-e1f6-4a4e-8efd-aee718c8dd37 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:40.748054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8504edc9-e1f6-4a4e-8efd-aee718c8dd37 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:41.200184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8504edc9-e1f6-4a4e-8efd-aee718c8dd37 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:41.208462 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8504edc9-e1f6-4a4e-8efd-aee718c8dd37 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1318 microversion: 2.1 time: 0.477047 Aug 27 05:40:41.209333 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3461/6927] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:40 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:42.238510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fcfc05e2-d456-4da5-b5de-c8bd545e5b20 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:42.239143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fcfc05e2-d456-4da5-b5de-c8bd545e5b20 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:42.245346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcfc05e2-d456-4da5-b5de-c8bd545e5b20 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:42.245844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcfc05e2-d456-4da5-b5de-c8bd545e5b20 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:42.246322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcfc05e2-d456-4da5-b5de-c8bd545e5b20 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:42.247033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcfc05e2-d456-4da5-b5de-c8bd545e5b20 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:42.248501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcfc05e2-d456-4da5-b5de-c8bd545e5b20 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:42.248945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fcfc05e2-d456-4da5-b5de-c8bd545e5b20 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:42.394214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fcfc05e2-d456-4da5-b5de-c8bd545e5b20 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:42.403804 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fcfc05e2-d456-4da5-b5de-c8bd545e5b20 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1318 microversion: 2.1 time: 0.171354 Aug 27 05:40:42.404511 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3467/6928] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:42 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:40:42.569501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1153871745", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1417438862", "security_groups": [{"name": "tempest-secgroup-smoke-747049925"}], "block_device_mapping_v2": [{"uuid": "2faed35f-1649-405f-bc23-82f6d055a4ca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "58a22fcb-5b07-4d83-8df1-2b6fed6fe046"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:42.684764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] validate_networks() for [('58a22fcb-5b07-4d83-8df1-2b6fed6fe046', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:40:43.071728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:40:43.072175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:40:43.072674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:40:43.073106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:40:43.073565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:40:43.083045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:43.083571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:43.084020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:43.084763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:43.085232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:43.085668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:43.103605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:40:43.109012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Getting quotas for user 007b4762bf8c436fb783d84380c01932 and project e4b05abd53e947b38c809fa546091e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:40:43.169413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:40:43.171633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2faed35f-1649-405f-bc23-82f6d055a4ca',volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:40:43.311302 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0a733152-0a08-4c60-9ada-bf57f488beba tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.745764 Aug 27 05:40:43.311986 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3462/6929] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:40:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:40:43.323724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a7d0efe7-3ac8-42b9-b2bc-6ce35504f427 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:43.324418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a7d0efe7-3ac8-42b9-b2bc-6ce35504f427 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:43.380645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a7d0efe7-3ac8-42b9-b2bc-6ce35504f427 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:43.388762 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a7d0efe7-3ac8-42b9-b2bc-6ce35504f427 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1095 microversion: 2.1 time: 0.069710 Aug 27 05:40:43.389428 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3468/6930] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:43 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:40:43.424233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9370771-bedc-4150-91d0-af712069318c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:43.424886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9370771-bedc-4150-91d0-af712069318c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:43.431901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9370771-bedc-4150-91d0-af712069318c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:43.432411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9370771-bedc-4150-91d0-af712069318c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:43.432866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9370771-bedc-4150-91d0-af712069318c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:43.433654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9370771-bedc-4150-91d0-af712069318c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:43.434152 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9370771-bedc-4150-91d0-af712069318c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:43.434707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9370771-bedc-4150-91d0-af712069318c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:43.438966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:43.573810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f9370771-bedc-4150-91d0-af712069318c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:43.582363 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9370771-bedc-4150-91d0-af712069318c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1318 microversion: 2.1 time: 0.161955 Aug 27 05:40:43.582946 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3463/6931] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:43 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:44.410728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6f488d9-14bc-43dc-bd24-e658484f6e8f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:44.412303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6f488d9-14bc-43dc-bd24-e658484f6e8f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:44.422256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6f488d9-14bc-43dc-bd24-e658484f6e8f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:44.423069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6f488d9-14bc-43dc-bd24-e658484f6e8f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:44.423580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6f488d9-14bc-43dc-bd24-e658484f6e8f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:44.424298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6f488d9-14bc-43dc-bd24-e658484f6e8f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:44.424783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6f488d9-14bc-43dc-bd24-e658484f6e8f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:44.425408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6f488d9-14bc-43dc-bd24-e658484f6e8f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:44.515794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6f488d9-14bc-43dc-bd24-e658484f6e8f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:44.527055 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6f488d9-14bc-43dc-bd24-e658484f6e8f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1201 microversion: 2.1 time: 0.120054 Aug 27 05:40:44.528121 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3469/6932] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:44 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1201 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:44.603703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-017639f0-a7a6-4347-95a8-79566d0ecde1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:44.604619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-017639f0-a7a6-4347-95a8-79566d0ecde1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:44.612731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-017639f0-a7a6-4347-95a8-79566d0ecde1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:44.613464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-017639f0-a7a6-4347-95a8-79566d0ecde1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:44.614492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-017639f0-a7a6-4347-95a8-79566d0ecde1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:44.615242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-017639f0-a7a6-4347-95a8-79566d0ecde1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:44.615869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-017639f0-a7a6-4347-95a8-79566d0ecde1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:44.617859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-017639f0-a7a6-4347-95a8-79566d0ecde1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:44.800254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-017639f0-a7a6-4347-95a8-79566d0ecde1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:44.813540 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-017639f0-a7a6-4347-95a8-79566d0ecde1 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1318 microversion: 2.1 time: 0.214380 Aug 27 05:40:44.815611 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3464/6933] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:44 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:44.834431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-9f4d6a2c-c0be-4608-aea0-dc338b47e8b8 req-19e3b79c-0156-4fe0-9843-80c8cba219bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c33d93-a67f-407f-9852-8af6bd8ebb6e", "name": "network-vif-plugged", "status": "completed", "tag": "2c6edc6e-1134-4cc7-abe8-88e4437258ad"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:44.845699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9f4d6a2c-c0be-4608-aea0-dc338b47e8b8 req-19e3b79c-0156-4fe0-9843-80c8cba219bd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:44.846512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9f4d6a2c-c0be-4608-aea0-dc338b47e8b8 req-19e3b79c-0156-4fe0-9843-80c8cba219bd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:44.847204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9f4d6a2c-c0be-4608-aea0-dc338b47e8b8 req-19e3b79c-0156-4fe0-9843-80c8cba219bd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:44.862302 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-9f4d6a2c-c0be-4608-aea0-dc338b47e8b8 req-19e3b79c-0156-4fe0-9843-80c8cba219bd service nova] Creating event network-vif-plugged:2c6edc6e-1134-4cc7-abe8-88e4437258ad for instance d4c33d93-a67f-407f-9852-8af6bd8ebb6e on n-h2-820368-35 Aug 27 05:40:44.868685 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-9f4d6a2c-c0be-4608-aea0-dc338b47e8b8 req-19e3b79c-0156-4fe0-9843-80c8cba219bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039429 Aug 27 05:40:44.869861 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3470/6934] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:40:45.549085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a0877f7e-6122-4ff1-841f-cd2157157864 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:45.550367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a0877f7e-6122-4ff1-841f-cd2157157864 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:45.558916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0877f7e-6122-4ff1-841f-cd2157157864 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:45.559804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0877f7e-6122-4ff1-841f-cd2157157864 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:45.560856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0877f7e-6122-4ff1-841f-cd2157157864 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:45.561830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0877f7e-6122-4ff1-841f-cd2157157864 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:45.562542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0877f7e-6122-4ff1-841f-cd2157157864 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:45.563380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a0877f7e-6122-4ff1-841f-cd2157157864 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:45.711574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a0877f7e-6122-4ff1-841f-cd2157157864 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:45.720636 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a0877f7e-6122-4ff1-841f-cd2157157864 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1278 microversion: 2.1 time: 0.175473 Aug 27 05:40:45.726420 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3465/6935] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:45 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:45.841609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-200812dd-7f07-4ec7-8d3c-e78c648009f8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:45.843020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-200812dd-7f07-4ec7-8d3c-e78c648009f8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:45.849562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200812dd-7f07-4ec7-8d3c-e78c648009f8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:45.850134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200812dd-7f07-4ec7-8d3c-e78c648009f8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:45.850673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200812dd-7f07-4ec7-8d3c-e78c648009f8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:45.852149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200812dd-7f07-4ec7-8d3c-e78c648009f8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:45.852809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200812dd-7f07-4ec7-8d3c-e78c648009f8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:45.853341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-200812dd-7f07-4ec7-8d3c-e78c648009f8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:46.009054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-200812dd-7f07-4ec7-8d3c-e78c648009f8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:46.017981 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-200812dd-7f07-4ec7-8d3c-e78c648009f8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1318 microversion: 2.1 time: 0.181481 Aug 27 05:40:46.018983 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3471/6936] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:45 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:46.121044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-00112477-79b6-494f-b981-babe4ff86ca2 req-709317e5-0b05-42be-83f8-daf0f7c8c405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "093591b5-f82e-4462-a476-235a523ca98a", "tag": "e37ef846-1487-4665-845f-a7e7a47454c1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:46.134289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-00112477-79b6-494f-b981-babe4ff86ca2 req-709317e5-0b05-42be-83f8-daf0f7c8c405 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:46.135185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-00112477-79b6-494f-b981-babe4ff86ca2 req-709317e5-0b05-42be-83f8-daf0f7c8c405 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:46.135887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-00112477-79b6-494f-b981-babe4ff86ca2 req-709317e5-0b05-42be-83f8-daf0f7c8c405 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:46.152810 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-00112477-79b6-494f-b981-babe4ff86ca2 req-709317e5-0b05-42be-83f8-daf0f7c8c405 service nova] Creating event network-changed:e37ef846-1487-4665-845f-a7e7a47454c1 for instance 093591b5-f82e-4462-a476-235a523ca98a on n-h2-820368-35 Aug 27 05:40:46.158872 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-00112477-79b6-494f-b981-babe4ff86ca2 req-709317e5-0b05-42be-83f8-daf0f7c8c405 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042976 Aug 27 05:40:46.159704 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3466/6937] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:40:46.743943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2a45c787-b08a-417b-ab49-f586625c94e8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:46.744654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2a45c787-b08a-417b-ab49-f586625c94e8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:46.751180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a45c787-b08a-417b-ab49-f586625c94e8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:46.752117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a45c787-b08a-417b-ab49-f586625c94e8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:46.752688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a45c787-b08a-417b-ab49-f586625c94e8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:46.753500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a45c787-b08a-417b-ab49-f586625c94e8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:46.754197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a45c787-b08a-417b-ab49-f586625c94e8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:46.754818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a45c787-b08a-417b-ab49-f586625c94e8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:46.904945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2a45c787-b08a-417b-ab49-f586625c94e8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:46.915143 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2a45c787-b08a-417b-ab49-f586625c94e8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1278 microversion: 2.1 time: 0.176262 Aug 27 05:40:46.915774 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3472/6938] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:46 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:47.042255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-668ec656-4d90-450a-8322-da0c9bbb8a2f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:47.043277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-668ec656-4d90-450a-8322-da0c9bbb8a2f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:47.050369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-668ec656-4d90-450a-8322-da0c9bbb8a2f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:47.051043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-668ec656-4d90-450a-8322-da0c9bbb8a2f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:47.051638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-668ec656-4d90-450a-8322-da0c9bbb8a2f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:47.052523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-668ec656-4d90-450a-8322-da0c9bbb8a2f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:47.053237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-668ec656-4d90-450a-8322-da0c9bbb8a2f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:47.053834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-668ec656-4d90-450a-8322-da0c9bbb8a2f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:47.208715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-668ec656-4d90-450a-8322-da0c9bbb8a2f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:47.217554 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-668ec656-4d90-450a-8322-da0c9bbb8a2f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1508 microversion: 2.1 time: 0.181257 Aug 27 05:40:47.218699 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3467/6939] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:47 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:47.238746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1799b641-f05e-476d-ac3a-58d96480056f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c25ccd65-4d5b-43dc-af84-e12fa815b66b", "device": "/dev/sdb"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:40:47.242622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1799b641-f05e-476d-ac3a-58d96480056f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:47.249353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1799b641-f05e-476d-ac3a-58d96480056f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:47.250178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1799b641-f05e-476d-ac3a-58d96480056f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:47.250856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1799b641-f05e-476d-ac3a-58d96480056f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:47.251855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1799b641-f05e-476d-ac3a-58d96480056f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:47.252377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1799b641-f05e-476d-ac3a-58d96480056f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:47.252884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1799b641-f05e-476d-ac3a-58d96480056f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:47.255781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:47.544522 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1799b641-f05e-476d-ac3a-58d96480056f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "POST /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309853 Aug 27 05:40:47.545485 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3473/6940] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:40:47 2022] POST /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:40:47.935935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b3812b85-6984-437f-afb4-255b66febe65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:47.936686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b3812b85-6984-437f-afb4-255b66febe65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:47.944741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3812b85-6984-437f-afb4-255b66febe65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:47.946003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3812b85-6984-437f-afb4-255b66febe65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:47.946534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3812b85-6984-437f-afb4-255b66febe65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:47.947376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3812b85-6984-437f-afb4-255b66febe65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:47.947938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3812b85-6984-437f-afb4-255b66febe65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:47.948453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b3812b85-6984-437f-afb4-255b66febe65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:48.090098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b3812b85-6984-437f-afb4-255b66febe65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:48.098796 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b3812b85-6984-437f-afb4-255b66febe65 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1278 microversion: 2.1 time: 0.166701 Aug 27 05:40:48.099870 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3468/6941] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:47 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:49.123595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a847a86a-e366-4412-a855-65d75c54773b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:49.124410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a847a86a-e366-4412-a855-65d75c54773b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:49.130539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=46 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:49.132890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a847a86a-e366-4412-a855-65d75c54773b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:49.133671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a847a86a-e366-4412-a855-65d75c54773b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:49.134245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a847a86a-e366-4412-a855-65d75c54773b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:49.135081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a847a86a-e366-4412-a855-65d75c54773b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:49.135848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a847a86a-e366-4412-a855-65d75c54773b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:49.137489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a847a86a-e366-4412-a855-65d75c54773b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:49.295197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a847a86a-e366-4412-a855-65d75c54773b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:49.303857 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a847a86a-e366-4412-a855-65d75c54773b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1278 microversion: 2.1 time: 0.186290 Aug 27 05:40:49.304443 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3474/6942] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:49 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:50.326874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e87658e1-16ad-4583-95fa-a21ed18ce6a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:50.327602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e87658e1-16ad-4583-95fa-a21ed18ce6a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:50.335493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e87658e1-16ad-4583-95fa-a21ed18ce6a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:50.336765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e87658e1-16ad-4583-95fa-a21ed18ce6a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:50.336765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e87658e1-16ad-4583-95fa-a21ed18ce6a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:50.337405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e87658e1-16ad-4583-95fa-a21ed18ce6a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:50.337966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e87658e1-16ad-4583-95fa-a21ed18ce6a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:50.338412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e87658e1-16ad-4583-95fa-a21ed18ce6a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:50.503306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e87658e1-16ad-4583-95fa-a21ed18ce6a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:50.514095 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e87658e1-16ad-4583-95fa-a21ed18ce6a9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1266 microversion: 2.1 time: 0.191395 Aug 27 05:40:50.514852 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3469/6943] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:50 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:51.535947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01f7ec34-9a64-43a5-bf4d-7db7cfcad4b1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:51.536669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-01f7ec34-9a64-43a5-bf4d-7db7cfcad4b1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:51.544860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f7ec34-9a64-43a5-bf4d-7db7cfcad4b1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:51.545446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f7ec34-9a64-43a5-bf4d-7db7cfcad4b1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:51.545899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f7ec34-9a64-43a5-bf4d-7db7cfcad4b1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:51.546612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f7ec34-9a64-43a5-bf4d-7db7cfcad4b1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:51.547077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f7ec34-9a64-43a5-bf4d-7db7cfcad4b1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:51.548050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01f7ec34-9a64-43a5-bf4d-7db7cfcad4b1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:51.703110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-01f7ec34-9a64-43a5-bf4d-7db7cfcad4b1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:51.711893 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01f7ec34-9a64-43a5-bf4d-7db7cfcad4b1 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1266 microversion: 2.1 time: 0.179853 Aug 27 05:40:51.712603 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3475/6944] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:51 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:52.733170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a15f1f89-e0d3-437d-bc8b-c834fbbd66b2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:52.733820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a15f1f89-e0d3-437d-bc8b-c834fbbd66b2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:52.736970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:52.743458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15f1f89-e0d3-437d-bc8b-c834fbbd66b2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:52.744435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15f1f89-e0d3-437d-bc8b-c834fbbd66b2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:52.744893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15f1f89-e0d3-437d-bc8b-c834fbbd66b2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:52.745693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15f1f89-e0d3-437d-bc8b-c834fbbd66b2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:52.746094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15f1f89-e0d3-437d-bc8b-c834fbbd66b2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:52.746532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a15f1f89-e0d3-437d-bc8b-c834fbbd66b2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:52.887373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a15f1f89-e0d3-437d-bc8b-c834fbbd66b2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:52.895364 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a15f1f89-e0d3-437d-bc8b-c834fbbd66b2 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1266 microversion: 2.1 time: 0.166278 Aug 27 05:40:52.895940 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3470/6945] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:52 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:53.917281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5dc660ca-515b-4acd-9d14-7d75a5e70f2e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:53.917906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5dc660ca-515b-4acd-9d14-7d75a5e70f2e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:53.920780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:53.927318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc660ca-515b-4acd-9d14-7d75a5e70f2e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:53.927815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc660ca-515b-4acd-9d14-7d75a5e70f2e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:53.928272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc660ca-515b-4acd-9d14-7d75a5e70f2e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:53.928973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc660ca-515b-4acd-9d14-7d75a5e70f2e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:53.929436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc660ca-515b-4acd-9d14-7d75a5e70f2e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:53.930388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dc660ca-515b-4acd-9d14-7d75a5e70f2e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:54.067279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5dc660ca-515b-4acd-9d14-7d75a5e70f2e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:54.075630 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5dc660ca-515b-4acd-9d14-7d75a5e70f2e tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1266 microversion: 2.1 time: 0.162199 Aug 27 05:40:54.076217 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3476/6946] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:53 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:40:55.096387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b28af3a6-0b3f-4986-865d-f9845d5a6ce0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:55.097039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b28af3a6-0b3f-4986-865d-f9845d5a6ce0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:55.098904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:55.099598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=12 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:40:55.106824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b28af3a6-0b3f-4986-865d-f9845d5a6ce0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:55.107355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b28af3a6-0b3f-4986-865d-f9845d5a6ce0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:55.107812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b28af3a6-0b3f-4986-865d-f9845d5a6ce0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:55.108524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b28af3a6-0b3f-4986-865d-f9845d5a6ce0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:55.108996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b28af3a6-0b3f-4986-865d-f9845d5a6ce0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:55.109438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b28af3a6-0b3f-4986-865d-f9845d5a6ce0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:55.241791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b28af3a6-0b3f-4986-865d-f9845d5a6ce0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:55.251678 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b28af3a6-0b3f-4986-865d-f9845d5a6ce0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1266 microversion: 2.1 time: 0.158804 Aug 27 05:40:55.252437 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3471/6947] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:55 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:56.273510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-96973815-b985-4c5a-acd5-636561246a03 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:56.274168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-96973815-b985-4c5a-acd5-636561246a03 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:56.281554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96973815-b985-4c5a-acd5-636561246a03 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:56.282039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96973815-b985-4c5a-acd5-636561246a03 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:56.282476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96973815-b985-4c5a-acd5-636561246a03 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:56.283230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96973815-b985-4c5a-acd5-636561246a03 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:56.283686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96973815-b985-4c5a-acd5-636561246a03 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:56.284159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-96973815-b985-4c5a-acd5-636561246a03 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:56.424721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-96973815-b985-4c5a-acd5-636561246a03 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:56.433322 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-96973815-b985-4c5a-acd5-636561246a03 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1266 microversion: 2.1 time: 0.163727 Aug 27 05:40:56.433916 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3477/6948] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:56 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:57.453665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a434174d-099b-4ef4-921b-62f4e1f1c15d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:57.454316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a434174d-099b-4ef4-921b-62f4e1f1c15d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:57.461177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a434174d-099b-4ef4-921b-62f4e1f1c15d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:57.461675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a434174d-099b-4ef4-921b-62f4e1f1c15d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:57.462119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a434174d-099b-4ef4-921b-62f4e1f1c15d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:57.462821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a434174d-099b-4ef4-921b-62f4e1f1c15d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:57.463322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a434174d-099b-4ef4-921b-62f4e1f1c15d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:57.463761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a434174d-099b-4ef4-921b-62f4e1f1c15d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:57.600146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a434174d-099b-4ef4-921b-62f4e1f1c15d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:57.608073 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a434174d-099b-4ef4-921b-62f4e1f1c15d tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1266 microversion: 2.1 time: 0.158283 Aug 27 05:40:57.608652 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3472/6949] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:57 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:58.629425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-25f27a85-2e04-464a-ba0c-970be58d3093 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:58.630108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-25f27a85-2e04-464a-ba0c-970be58d3093 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:58.637432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25f27a85-2e04-464a-ba0c-970be58d3093 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:58.637928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25f27a85-2e04-464a-ba0c-970be58d3093 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:58.638375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25f27a85-2e04-464a-ba0c-970be58d3093 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:58.639413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25f27a85-2e04-464a-ba0c-970be58d3093 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:58.639882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25f27a85-2e04-464a-ba0c-970be58d3093 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:58.640319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25f27a85-2e04-464a-ba0c-970be58d3093 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:58.777500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-25f27a85-2e04-464a-ba0c-970be58d3093 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:58.785778 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-25f27a85-2e04-464a-ba0c-970be58d3093 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1266 microversion: 2.1 time: 0.160169 Aug 27 05:40:58.786666 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3478/6950] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:58 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:40:59.809132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1eb7ceb2-8e95-48eb-abb0-3a695682e747 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:40:59.809776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1eb7ceb2-8e95-48eb-abb0-3a695682e747 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:40:59.817150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb7ceb2-8e95-48eb-abb0-3a695682e747 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:59.817651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb7ceb2-8e95-48eb-abb0-3a695682e747 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:59.818104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb7ceb2-8e95-48eb-abb0-3a695682e747 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:59.818847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb7ceb2-8e95-48eb-abb0-3a695682e747 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:40:59.819385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb7ceb2-8e95-48eb-abb0-3a695682e747 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:40:59.819827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eb7ceb2-8e95-48eb-abb0-3a695682e747 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:40:59.955010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1eb7ceb2-8e95-48eb-abb0-3a695682e747 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:40:59.963324 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1eb7ceb2-8e95-48eb-abb0-3a695682e747 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1266 microversion: 2.1 time: 0.159306 Aug 27 05:40:59.963895 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3473/6951] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:40:59 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:00.871967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d9fb6c6a-ce92-4c28-948c-0fca7cdcfc2f req-ce9d2d5e-09aa-451c-ab79-19067a5474e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "093591b5-f82e-4462-a476-235a523ca98a", "name": "network-vif-plugged", "status": "completed", "tag": "e37ef846-1487-4665-845f-a7e7a47454c1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:41:00.884967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d9fb6c6a-ce92-4c28-948c-0fca7cdcfc2f req-ce9d2d5e-09aa-451c-ab79-19067a5474e9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:00.885467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d9fb6c6a-ce92-4c28-948c-0fca7cdcfc2f req-ce9d2d5e-09aa-451c-ab79-19067a5474e9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:00.885942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d9fb6c6a-ce92-4c28-948c-0fca7cdcfc2f req-ce9d2d5e-09aa-451c-ab79-19067a5474e9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:00.898964 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d9fb6c6a-ce92-4c28-948c-0fca7cdcfc2f req-ce9d2d5e-09aa-451c-ab79-19067a5474e9 service nova] Creating event network-vif-plugged:e37ef846-1487-4665-845f-a7e7a47454c1 for instance 093591b5-f82e-4462-a476-235a523ca98a on n-h2-820368-35 Aug 27 05:41:00.905261 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d9fb6c6a-ce92-4c28-948c-0fca7cdcfc2f req-ce9d2d5e-09aa-451c-ab79-19067a5474e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037491 Aug 27 05:41:00.906045 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3479/6952] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:41:00.988908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eef9cf4e-42e7-4c47-94ed-3e4ac8ae5bb4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:00.990262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eef9cf4e-42e7-4c47-94ed-3e4ac8ae5bb4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:01.017729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eef9cf4e-42e7-4c47-94ed-3e4ac8ae5bb4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:01.019561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eef9cf4e-42e7-4c47-94ed-3e4ac8ae5bb4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:01.021843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eef9cf4e-42e7-4c47-94ed-3e4ac8ae5bb4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:01.024264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eef9cf4e-42e7-4c47-94ed-3e4ac8ae5bb4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:01.025664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eef9cf4e-42e7-4c47-94ed-3e4ac8ae5bb4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:01.026658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eef9cf4e-42e7-4c47-94ed-3e4ac8ae5bb4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:01.221650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eef9cf4e-42e7-4c47-94ed-3e4ac8ae5bb4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:01.229908 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eef9cf4e-42e7-4c47-94ed-3e4ac8ae5bb4 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1266 microversion: 2.1 time: 0.248857 Aug 27 05:41:01.230493 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3474/6953] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:00 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:02.255867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-16ee4c18-715b-4833-8cf8-0a7675a8bf6f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:02.256651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-16ee4c18-715b-4833-8cf8-0a7675a8bf6f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:02.264694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16ee4c18-715b-4833-8cf8-0a7675a8bf6f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:02.265193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16ee4c18-715b-4833-8cf8-0a7675a8bf6f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:02.265636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16ee4c18-715b-4833-8cf8-0a7675a8bf6f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:02.268979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16ee4c18-715b-4833-8cf8-0a7675a8bf6f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:02.268979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16ee4c18-715b-4833-8cf8-0a7675a8bf6f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:02.268979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16ee4c18-715b-4833-8cf8-0a7675a8bf6f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:02.408334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-16ee4c18-715b-4833-8cf8-0a7675a8bf6f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:02.416733 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-16ee4c18-715b-4833-8cf8-0a7675a8bf6f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1266 microversion: 2.1 time: 0.165305 Aug 27 05:41:02.417300 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3480/6954] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:02 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:03.437715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-78057d94-7a53-4ff2-bc9d-d5188ebf205b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:03.438348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-78057d94-7a53-4ff2-bc9d-d5188ebf205b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:03.445244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78057d94-7a53-4ff2-bc9d-d5188ebf205b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:03.445739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78057d94-7a53-4ff2-bc9d-d5188ebf205b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:03.446835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78057d94-7a53-4ff2-bc9d-d5188ebf205b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:03.447616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78057d94-7a53-4ff2-bc9d-d5188ebf205b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:03.448719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78057d94-7a53-4ff2-bc9d-d5188ebf205b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:03.449800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-78057d94-7a53-4ff2-bc9d-d5188ebf205b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:03.584916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-78057d94-7a53-4ff2-bc9d-d5188ebf205b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:03.593434 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-78057d94-7a53-4ff2-bc9d-d5188ebf205b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1453 microversion: 2.1 time: 0.159669 Aug 27 05:41:03.594036 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3475/6955] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:03 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:03.613630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-599c186c-c4c7-4152-b321-40d43f2e1ed9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:03.614467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-599c186c-c4c7-4152-b321-40d43f2e1ed9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:03.622537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-599c186c-c4c7-4152-b321-40d43f2e1ed9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:03.623257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-599c186c-c4c7-4152-b321-40d43f2e1ed9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:03.623901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-599c186c-c4c7-4152-b321-40d43f2e1ed9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:03.624598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-599c186c-c4c7-4152-b321-40d43f2e1ed9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:03.625128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-599c186c-c4c7-4152-b321-40d43f2e1ed9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:03.625570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-599c186c-c4c7-4152-b321-40d43f2e1ed9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:03.763685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-599c186c-c4c7-4152-b321-40d43f2e1ed9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:03.772112 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-599c186c-c4c7-4152-b321-40d43f2e1ed9 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1453 microversion: 2.1 time: 0.162373 Aug 27 05:41:03.772685 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3481/6956] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:03 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:05.496374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b7902e7d-933f-4e76-b072-32718e441af0 req-e51426de-3a9d-4ed4-b41e-5dad2456e843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "093591b5-f82e-4462-a476-235a523ca98a", "tag": "e37ef846-1487-4665-845f-a7e7a47454c1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:41:05.510214 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b7902e7d-933f-4e76-b072-32718e441af0 req-e51426de-3a9d-4ed4-b41e-5dad2456e843 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:05.510843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b7902e7d-933f-4e76-b072-32718e441af0 req-e51426de-3a9d-4ed4-b41e-5dad2456e843 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:05.511395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b7902e7d-933f-4e76-b072-32718e441af0 req-e51426de-3a9d-4ed4-b41e-5dad2456e843 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:05.523399 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b7902e7d-933f-4e76-b072-32718e441af0 req-e51426de-3a9d-4ed4-b41e-5dad2456e843 service nova] Creating event network-changed:e37ef846-1487-4665-845f-a7e7a47454c1 for instance 093591b5-f82e-4462-a476-235a523ca98a on n-h2-820368-35 Aug 27 05:41:05.529828 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b7902e7d-933f-4e76-b072-32718e441af0 req-e51426de-3a9d-4ed4-b41e-5dad2456e843 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037916 Aug 27 05:41:05.530950 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3476/6957] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:41:09.449251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-68b832dc-7e8b-44a0-b859-3c4098904e00 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:41:09.451594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68b832dc-7e8b-44a0-b859-3c4098904e00 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:09.462813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68b832dc-7e8b-44a0-b859-3c4098904e00 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:09.463406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68b832dc-7e8b-44a0-b859-3c4098904e00 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:09.463776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68b832dc-7e8b-44a0-b859-3c4098904e00 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:09.464500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68b832dc-7e8b-44a0-b859-3c4098904e00 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:09.464966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68b832dc-7e8b-44a0-b859-3c4098904e00 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:09.465395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68b832dc-7e8b-44a0-b859-3c4098904e00 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:09.533546 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-68b832dc-7e8b-44a0-b859-3c4098904e00 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e/action" status: 200 len: 24563 microversion: 2.1 time: 0.088623 Aug 27 05:41:09.541150 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3482/6958] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:41:09 2022] POST /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e/action => generated 24563 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:41:11.522418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-aef3347d-9d56-44b5-8e14-ee338d7cda4c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:11.523011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-aef3347d-9d56-44b5-8e14-ee338d7cda4c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:11.530015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aef3347d-9d56-44b5-8e14-ee338d7cda4c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:11.530504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aef3347d-9d56-44b5-8e14-ee338d7cda4c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:11.530950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aef3347d-9d56-44b5-8e14-ee338d7cda4c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:11.531681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aef3347d-9d56-44b5-8e14-ee338d7cda4c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:11.532148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aef3347d-9d56-44b5-8e14-ee338d7cda4c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:11.532586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-aef3347d-9d56-44b5-8e14-ee338d7cda4c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:11.623845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-aef3347d-9d56-44b5-8e14-ee338d7cda4c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lazy-loading 'services' on Instance uuid d4c33d93-a67f-407f-9852-8af6bd8ebb6e {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:41:11.697764 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-aef3347d-9d56-44b5-8e14-ee338d7cda4c tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e/os-volume_attachments/c25ccd65-4d5b-43dc-af84-e12fa815b66b" status: 202 len: 0 microversion: 2.1 time: 0.180324 Aug 27 05:41:11.698360 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3477/6959] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:41:11 2022] DELETE /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e/os-volume_attachments/c25ccd65-4d5b-43dc-af84-e12fa815b66b => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:41:17.099735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-172987be-44a0-48c5-937a-55bd0de0630f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:17.100324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-172987be-44a0-48c5-937a-55bd0de0630f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:17.108528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172987be-44a0-48c5-937a-55bd0de0630f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:17.109071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172987be-44a0-48c5-937a-55bd0de0630f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:17.109448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172987be-44a0-48c5-937a-55bd0de0630f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:17.110137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172987be-44a0-48c5-937a-55bd0de0630f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:17.110591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172987be-44a0-48c5-937a-55bd0de0630f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:17.111016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-172987be-44a0-48c5-937a-55bd0de0630f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:17.138372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-172987be-44a0-48c5-937a-55bd0de0630f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:41:17.220578 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-172987be-44a0-48c5-937a-55bd0de0630f tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 204 len: 0 microversion: 2.1 time: 0.124835 Aug 27 05:41:17.221142 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3483/6960] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:41:17 2022] DELETE /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:41:17.231588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bffbf6f8-4e8e-44a2-9ef1-37f3f451cf7b tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:17.232328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bffbf6f8-4e8e-44a2-9ef1-37f3f451cf7b tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:17.238853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bffbf6f8-4e8e-44a2-9ef1-37f3f451cf7b tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:17.239384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bffbf6f8-4e8e-44a2-9ef1-37f3f451cf7b tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:17.239830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bffbf6f8-4e8e-44a2-9ef1-37f3f451cf7b tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:17.240546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bffbf6f8-4e8e-44a2-9ef1-37f3f451cf7b tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:17.241004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bffbf6f8-4e8e-44a2-9ef1-37f3f451cf7b tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:17.241436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bffbf6f8-4e8e-44a2-9ef1-37f3f451cf7b tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:17.244627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:41:17.374340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bffbf6f8-4e8e-44a2-9ef1-37f3f451cf7b tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:17.382006 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bffbf6f8-4e8e-44a2-9ef1-37f3f451cf7b tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1514 microversion: 2.1 time: 0.155831 Aug 27 05:41:17.382576 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3478/6961] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:17 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:41:18.404810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fb4e6f07-ff72-4b2c-a52d-60f43fa91541 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:18.405517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fb4e6f07-ff72-4b2c-a52d-60f43fa91541 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:18.413217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4e6f07-ff72-4b2c-a52d-60f43fa91541 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:18.413708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4e6f07-ff72-4b2c-a52d-60f43fa91541 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:18.414150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4e6f07-ff72-4b2c-a52d-60f43fa91541 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:18.414887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4e6f07-ff72-4b2c-a52d-60f43fa91541 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:18.415387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4e6f07-ff72-4b2c-a52d-60f43fa91541 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:18.415817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fb4e6f07-ff72-4b2c-a52d-60f43fa91541 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:18.418466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:41:18.552393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fb4e6f07-ff72-4b2c-a52d-60f43fa91541 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:18.560286 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fb4e6f07-ff72-4b2c-a52d-60f43fa91541 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1514 microversion: 2.1 time: 0.160011 Aug 27 05:41:18.560965 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3484/6962] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:18 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:19.585130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-886bf674-bcc8-4a01-9ffc-8a987ee2fdfa tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:19.587827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-886bf674-bcc8-4a01-9ffc-8a987ee2fdfa tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:19.600537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-886bf674-bcc8-4a01-9ffc-8a987ee2fdfa tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:19.601055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-886bf674-bcc8-4a01-9ffc-8a987ee2fdfa tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:19.601514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-886bf674-bcc8-4a01-9ffc-8a987ee2fdfa tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:19.602760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-886bf674-bcc8-4a01-9ffc-8a987ee2fdfa tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:19.603525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-886bf674-bcc8-4a01-9ffc-8a987ee2fdfa tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:19.604228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-886bf674-bcc8-4a01-9ffc-8a987ee2fdfa tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:19.611070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-47b2f77f-9c9e-4744-95f4-229cdaf807de req-cbd0f536-f802-44b5-a502-5e16ef85af66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c33d93-a67f-407f-9852-8af6bd8ebb6e", "name": "network-vif-deleted", "tag": "2c6edc6e-1134-4cc7-abe8-88e4437258ad"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:41:19.619795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:41:19.629641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-47b2f77f-9c9e-4744-95f4-229cdaf807de req-cbd0f536-f802-44b5-a502-5e16ef85af66 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:19.630465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-47b2f77f-9c9e-4744-95f4-229cdaf807de req-cbd0f536-f802-44b5-a502-5e16ef85af66 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:19.631218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-47b2f77f-9c9e-4744-95f4-229cdaf807de req-cbd0f536-f802-44b5-a502-5e16ef85af66 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:19.646940 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-47b2f77f-9c9e-4744-95f4-229cdaf807de req-cbd0f536-f802-44b5-a502-5e16ef85af66 service nova] Creating event network-vif-deleted:2c6edc6e-1134-4cc7-abe8-88e4437258ad for instance d4c33d93-a67f-407f-9852-8af6bd8ebb6e on n-h2-820368-35 Aug 27 05:41:19.652712 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-47b2f77f-9c9e-4744-95f4-229cdaf807de req-cbd0f536-f802-44b5-a502-5e16ef85af66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050734 Aug 27 05:41:19.653556 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3485/6963] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:41:19.683609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-886bf674-bcc8-4a01-9ffc-8a987ee2fdfa tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a51b3c1aa404f6b91581571626af555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ce936a1cd74ee68c1a8fc64d466774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:19.692810 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-886bf674-bcc8-4a01-9ffc-8a987ee2fdfa tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 200 len: 1472 microversion: 2.1 time: 0.114900 Aug 27 05:41:19.693438 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3479/6964] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:19 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 1472 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:20.716166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:20.716937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] [instance: d4c33d93-a67f-407f-9852-8af6bd8ebb6e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:20.723208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:20.723696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:20.724133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:20.724838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:20.725292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:20.725720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:20.741781 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] HTTP exception thrown: Instance d4c33d93-a67f-407f-9852-8af6bd8ebb6e could not be found. Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Request method failure captured: Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e HTTP/1.1 Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCa3C5opkSAdZG7D2K0mIK-NqaBT5FU_7weJz1vkeD8xImy_j8Y_MNa5pUGgSTXBMbhXRDaMrDlq9cDOThjYTJ--gQzRA7KKOUjeghxmLcnSNqpPiUmzYFRqupzAYBKLEpCbqoYZa-p9eL5_-sotNVXG3upuvWFVfh_9LPgIP2-2aJug Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 90ce936a1cd74ee68c1a8fc64d466774 Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1243303456 Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ce936a1cd74ee68c1a8fc64d466774", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ce936a1cd74ee68c1a8fc64d466774"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ce936a1cd74ee68c1a8fc64d466774"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ce936a1cd74ee68c1a8fc64d466774"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-VolumesSnapshotTestJSON-1243303456 Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 90ce936a1cd74ee68c1a8fc64d466774 Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1243303456 Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-VolumesSnapshotTestJSON-1243303456-project Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 7a51b3c1aa404f6b91581571626af555 Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-VolumesSnapshotTestJSON-1243303456-project Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance d4c33d93-a67f-407f-9852-8af6bd8ebb6e could not be found. Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd4c33d93-a67f-407f-9852-8af6bd8ebb6e'} Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c33d93-a67f-407f-9852-8af6bd8ebb6e could not be found. Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c33d93-a67f-407f-9852-8af6bd8ebb6e could not be found. Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:41:20.744215 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:41:20.750464 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:41:20.750464 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:41:20.750464 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:41:20.750464 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:41:20.750464 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:41:20.750464 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c33d93-a67f-407f-9852-8af6bd8ebb6e could not be found. Aug 27 05:41:20.750464 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:41:20.750464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] Returning 404 to user: Instance d4c33d93-a67f-407f-9852-8af6bd8ebb6e could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:41:20.750464 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-332b1e90-149d-469f-be2c-281d3e39dce8 tempest-VolumesSnapshotTestJSON-1243303456 tempest-VolumesSnapshotTestJSON-1243303456-project] 10.222.0.58 "GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e" status: 404 len: 111 microversion: 2.1 time: 0.035176 Aug 27 05:41:20.750464 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3486/6965] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:20 2022] GET /compute/v2.1/servers/d4c33d93-a67f-407f-9852-8af6bd8ebb6e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:41:48.291687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-298eb7a2-f6a2-438d-8d16-ec8393ddcdc1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:48.292644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-298eb7a2-f6a2-438d-8d16-ec8393ddcdc1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:48.294216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=19 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:41:48.294914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=11 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:41:48.300934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-298eb7a2-f6a2-438d-8d16-ec8393ddcdc1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:48.301433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-298eb7a2-f6a2-438d-8d16-ec8393ddcdc1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:48.301886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-298eb7a2-f6a2-438d-8d16-ec8393ddcdc1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:48.302617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-298eb7a2-f6a2-438d-8d16-ec8393ddcdc1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:48.303109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-298eb7a2-f6a2-438d-8d16-ec8393ddcdc1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:48.303553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-298eb7a2-f6a2-438d-8d16-ec8393ddcdc1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:48.457371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-298eb7a2-f6a2-438d-8d16-ec8393ddcdc1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:48.466405 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-298eb7a2-f6a2-438d-8d16-ec8393ddcdc1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1682 microversion: 2.1 time: 0.179223 Aug 27 05:41:48.467145 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3480/6966] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:48 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:48.587638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b781af46-257b-4832-a087-d2dc4eabdc18 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:41:48.590996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b781af46-257b-4832-a087-d2dc4eabdc18 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:48.595803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:41:48.596686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=9 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:41:48.609934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b781af46-257b-4832-a087-d2dc4eabdc18 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:48.610684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b781af46-257b-4832-a087-d2dc4eabdc18 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:48.611527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b781af46-257b-4832-a087-d2dc4eabdc18 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:48.612430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b781af46-257b-4832-a087-d2dc4eabdc18 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:48.613154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b781af46-257b-4832-a087-d2dc4eabdc18 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:48.613702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b781af46-257b-4832-a087-d2dc4eabdc18 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:48.695285 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b781af46-257b-4832-a087-d2dc4eabdc18 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e/action" status: 200 len: 32634 microversion: 2.1 time: 0.114339 Aug 27 05:41:48.705570 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3487/6967] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:41:48 2022] POST /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e/action => generated 32634 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:41:48.850602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6abcad71-860b-496f-ae9c-59fc9e30db6f tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:48.851564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6abcad71-860b-496f-ae9c-59fc9e30db6f tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:48.858572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abcad71-860b-496f-ae9c-59fc9e30db6f tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:48.859222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abcad71-860b-496f-ae9c-59fc9e30db6f tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:48.859965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abcad71-860b-496f-ae9c-59fc9e30db6f tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:48.860754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abcad71-860b-496f-ae9c-59fc9e30db6f tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:48.861294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abcad71-860b-496f-ae9c-59fc9e30db6f tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:48.861805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6abcad71-860b-496f-ae9c-59fc9e30db6f tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:49.003062 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6abcad71-860b-496f-ae9c-59fc9e30db6f tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1835 microversion: 2.1 time: 0.156136 Aug 27 05:41:49.003672 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3481/6968] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:48 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1835 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:41:49.033825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-431836d3-4a49-4e16-914d-3af9d16446dd tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:41:49.036682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-431836d3-4a49-4e16-914d-3af9d16446dd tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:49.045105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-431836d3-4a49-4e16-914d-3af9d16446dd tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:49.045617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-431836d3-4a49-4e16-914d-3af9d16446dd tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:49.046072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-431836d3-4a49-4e16-914d-3af9d16446dd tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:49.046830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-431836d3-4a49-4e16-914d-3af9d16446dd tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:49.047492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-431836d3-4a49-4e16-914d-3af9d16446dd tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:49.047791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-431836d3-4a49-4e16-914d-3af9d16446dd tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:49.078353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-431836d3-4a49-4e16-914d-3af9d16446dd tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lazy-loading 'flavor' on Instance uuid f99dfee6-3e10-44a1-a50b-c5d86a49329e {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:41:49.094132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-431836d3-4a49-4e16-914d-3af9d16446dd tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Going to try to live migrate instance to another host {{(pid=128548) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 05:41:50.987854 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-431836d3-4a49-4e16-914d-3af9d16446dd tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e/action" status: 202 len: 0 microversion: 2.1 time: 1.958495 Aug 27 05:41:50.988613 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3488/6969] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:41:49 2022] POST /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e/action => generated 0 bytes in 1960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:41:51.000484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22ddfa30-d32d-4294-b34c-a925f6c56cb2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:51.001236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22ddfa30-d32d-4294-b34c-a925f6c56cb2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:51.009902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ddfa30-d32d-4294-b34c-a925f6c56cb2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:51.010410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ddfa30-d32d-4294-b34c-a925f6c56cb2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:51.010858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ddfa30-d32d-4294-b34c-a925f6c56cb2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:51.011787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ddfa30-d32d-4294-b34c-a925f6c56cb2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:51.012460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ddfa30-d32d-4294-b34c-a925f6c56cb2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:51.013365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22ddfa30-d32d-4294-b34c-a925f6c56cb2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:51.174686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-22ddfa30-d32d-4294-b34c-a925f6c56cb2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:51.187194 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22ddfa30-d32d-4294-b34c-a925f6c56cb2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1692 microversion: 2.1 time: 0.190943 Aug 27 05:41:51.187784 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3482/6970] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:50 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1692 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:52.153194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7188a20f-4647-48ad-a0a0-6e6dcb687d4f req-8c728e1e-7d11-4438-80e2-2efd348be007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99dfee6-3e10-44a1-a50b-c5d86a49329e", "name": "network-vif-unplugged", "status": "completed", "tag": "ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:41:52.166057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7188a20f-4647-48ad-a0a0-6e6dcb687d4f req-8c728e1e-7d11-4438-80e2-2efd348be007 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:52.166697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7188a20f-4647-48ad-a0a0-6e6dcb687d4f req-8c728e1e-7d11-4438-80e2-2efd348be007 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:52.167281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7188a20f-4647-48ad-a0a0-6e6dcb687d4f req-8c728e1e-7d11-4438-80e2-2efd348be007 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:52.184085 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7188a20f-4647-48ad-a0a0-6e6dcb687d4f req-8c728e1e-7d11-4438-80e2-2efd348be007 service nova] Creating event network-vif-unplugged:ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1 for instance f99dfee6-3e10-44a1-a50b-c5d86a49329e on n-h1-820368-35 Aug 27 05:41:52.189999 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7188a20f-4647-48ad-a0a0-6e6dcb687d4f req-8c728e1e-7d11-4438-80e2-2efd348be007 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042936 Aug 27 05:41:52.190991 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3489/6971] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:41:52.209336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c54dfe53-3049-46e7-b3f7-48c6130d18d7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:52.210036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c54dfe53-3049-46e7-b3f7-48c6130d18d7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:52.218318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54dfe53-3049-46e7-b3f7-48c6130d18d7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:52.218914 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54dfe53-3049-46e7-b3f7-48c6130d18d7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:52.219475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54dfe53-3049-46e7-b3f7-48c6130d18d7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:52.220299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54dfe53-3049-46e7-b3f7-48c6130d18d7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:52.221033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54dfe53-3049-46e7-b3f7-48c6130d18d7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:52.221544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c54dfe53-3049-46e7-b3f7-48c6130d18d7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:52.450560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c54dfe53-3049-46e7-b3f7-48c6130d18d7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:52.466662 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c54dfe53-3049-46e7-b3f7-48c6130d18d7 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1692 microversion: 2.1 time: 0.260644 Aug 27 05:41:52.467371 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3483/6972] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:52 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1692 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:53.490143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2c614ba0-3e0f-49c5-a507-25a14e5f355b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:53.491533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2c614ba0-3e0f-49c5-a507-25a14e5f355b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:53.498521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c614ba0-3e0f-49c5-a507-25a14e5f355b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:53.499017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c614ba0-3e0f-49c5-a507-25a14e5f355b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:53.499515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c614ba0-3e0f-49c5-a507-25a14e5f355b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:53.500228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c614ba0-3e0f-49c5-a507-25a14e5f355b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:53.500690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c614ba0-3e0f-49c5-a507-25a14e5f355b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:53.501125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c614ba0-3e0f-49c5-a507-25a14e5f355b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:53.703665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2c614ba0-3e0f-49c5-a507-25a14e5f355b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:53.712774 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2c614ba0-3e0f-49c5-a507-25a14e5f355b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1692 microversion: 2.1 time: 0.227714 Aug 27 05:41:53.713416 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3490/6973] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:53 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1692 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:54.228587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-892fb55a-9f5a-4ef4-8bd7-26119ddef80e req-44fbe32e-b7ff-423e-8f41-74f2f9cb0f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f99dfee6-3e10-44a1-a50b-c5d86a49329e", "tag": "ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:41:54.239654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-892fb55a-9f5a-4ef4-8bd7-26119ddef80e req-44fbe32e-b7ff-423e-8f41-74f2f9cb0f26 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:54.240154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-892fb55a-9f5a-4ef4-8bd7-26119ddef80e req-44fbe32e-b7ff-423e-8f41-74f2f9cb0f26 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:54.240607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-892fb55a-9f5a-4ef4-8bd7-26119ddef80e req-44fbe32e-b7ff-423e-8f41-74f2f9cb0f26 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:54.253104 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-892fb55a-9f5a-4ef4-8bd7-26119ddef80e req-44fbe32e-b7ff-423e-8f41-74f2f9cb0f26 service nova] Creating event network-changed:ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1 for instance f99dfee6-3e10-44a1-a50b-c5d86a49329e on n-h1-820368-35 Aug 27 05:41:54.258352 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-892fb55a-9f5a-4ef4-8bd7-26119ddef80e req-44fbe32e-b7ff-423e-8f41-74f2f9cb0f26 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033598 Aug 27 05:41:54.259562 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3484/6974] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:41:54.737503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c9c7000b-fdb6-44c1-89e4-554a5fe03bed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:54.738922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c9c7000b-fdb6-44c1-89e4-554a5fe03bed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:54.749776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9c7000b-fdb6-44c1-89e4-554a5fe03bed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:54.750731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9c7000b-fdb6-44c1-89e4-554a5fe03bed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:54.752103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9c7000b-fdb6-44c1-89e4-554a5fe03bed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:54.753256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9c7000b-fdb6-44c1-89e4-554a5fe03bed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:54.754473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9c7000b-fdb6-44c1-89e4-554a5fe03bed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:54.754473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c9c7000b-fdb6-44c1-89e4-554a5fe03bed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:55.015398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c9c7000b-fdb6-44c1-89e4-554a5fe03bed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:55.027267 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c9c7000b-fdb6-44c1-89e4-554a5fe03bed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1692 microversion: 2.1 time: 0.296128 Aug 27 05:41:55.031411 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3491/6975] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:54 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1692 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:56.053358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bab7311d-828f-425b-97f8-11a636997b74 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:56.054067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bab7311d-828f-425b-97f8-11a636997b74 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:56.061984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab7311d-828f-425b-97f8-11a636997b74 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:56.062411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab7311d-828f-425b-97f8-11a636997b74 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:56.062863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab7311d-828f-425b-97f8-11a636997b74 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:56.063616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab7311d-828f-425b-97f8-11a636997b74 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:56.064081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab7311d-828f-425b-97f8-11a636997b74 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:56.064834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bab7311d-828f-425b-97f8-11a636997b74 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:56.213190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bab7311d-828f-425b-97f8-11a636997b74 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:56.221900 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bab7311d-828f-425b-97f8-11a636997b74 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1692 microversion: 2.1 time: 0.174156 Aug 27 05:41:56.222491 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3485/6976] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:56 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:57.244529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b0f28e57-2549-446b-adf6-a94ba2d2fa3e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:57.245065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b0f28e57-2549-446b-adf6-a94ba2d2fa3e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:57.252349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f28e57-2549-446b-adf6-a94ba2d2fa3e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:57.252979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f28e57-2549-446b-adf6-a94ba2d2fa3e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:57.253432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f28e57-2549-446b-adf6-a94ba2d2fa3e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:57.254160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f28e57-2549-446b-adf6-a94ba2d2fa3e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:57.254649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f28e57-2549-446b-adf6-a94ba2d2fa3e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:57.255116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0f28e57-2549-446b-adf6-a94ba2d2fa3e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:57.399925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b0f28e57-2549-446b-adf6-a94ba2d2fa3e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:57.408832 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b0f28e57-2549-446b-adf6-a94ba2d2fa3e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1692 microversion: 2.1 time: 0.168993 Aug 27 05:41:57.409673 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3492/6977] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:57 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:41:58.430687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4a1077c1-59c0-402a-9261-fa4b6b3fc664 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:58.431551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4a1077c1-59c0-402a-9261-fa4b6b3fc664 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:58.441308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a1077c1-59c0-402a-9261-fa4b6b3fc664 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:58.441982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a1077c1-59c0-402a-9261-fa4b6b3fc664 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:58.442754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a1077c1-59c0-402a-9261-fa4b6b3fc664 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:58.443688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a1077c1-59c0-402a-9261-fa4b6b3fc664 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:58.444569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a1077c1-59c0-402a-9261-fa4b6b3fc664 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:58.445251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a1077c1-59c0-402a-9261-fa4b6b3fc664 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:58.606079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4a1077c1-59c0-402a-9261-fa4b6b3fc664 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:58.615006 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4a1077c1-59c0-402a-9261-fa4b6b3fc664 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1692 microversion: 2.1 time: 0.188742 Aug 27 05:41:58.615726 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3486/6978] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:58 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:41:59.636495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b089dee6-3d27-4f6f-b879-3b0acfd6cf9f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:41:59.637028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b089dee6-3d27-4f6f-b879-3b0acfd6cf9f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:41:59.644040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b089dee6-3d27-4f6f-b879-3b0acfd6cf9f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:59.644530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b089dee6-3d27-4f6f-b879-3b0acfd6cf9f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:59.644975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b089dee6-3d27-4f6f-b879-3b0acfd6cf9f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:59.645677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b089dee6-3d27-4f6f-b879-3b0acfd6cf9f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:41:59.646169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b089dee6-3d27-4f6f-b879-3b0acfd6cf9f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:41:59.646602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b089dee6-3d27-4f6f-b879-3b0acfd6cf9f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:41:59.783357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b089dee6-3d27-4f6f-b879-3b0acfd6cf9f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:41:59.791723 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b089dee6-3d27-4f6f-b879-3b0acfd6cf9f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1692 microversion: 2.1 time: 0.159275 Aug 27 05:41:59.792392 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3493/6979] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:41:59 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:00.815106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e4e2b906-fd2f-402d-8952-4ab527aa4b0a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:00.815733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e4e2b906-fd2f-402d-8952-4ab527aa4b0a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:00.823490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4e2b906-fd2f-402d-8952-4ab527aa4b0a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:00.824401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4e2b906-fd2f-402d-8952-4ab527aa4b0a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:00.825513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4e2b906-fd2f-402d-8952-4ab527aa4b0a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:00.826243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4e2b906-fd2f-402d-8952-4ab527aa4b0a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:00.826816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4e2b906-fd2f-402d-8952-4ab527aa4b0a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:00.827205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4e2b906-fd2f-402d-8952-4ab527aa4b0a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:01.329453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e4e2b906-fd2f-402d-8952-4ab527aa4b0a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:01.338218 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e4e2b906-fd2f-402d-8952-4ab527aa4b0a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1692 microversion: 2.1 time: 0.527514 Aug 27 05:42:01.339632 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3487/6980] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:00 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1692 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:02.363714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-febc2c61-ef47-4631-8507-a6c9cd9ee4db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:02.364440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-febc2c61-ef47-4631-8507-a6c9cd9ee4db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:02.372228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc2c61-ef47-4631-8507-a6c9cd9ee4db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:02.372826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc2c61-ef47-4631-8507-a6c9cd9ee4db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:02.373341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc2c61-ef47-4631-8507-a6c9cd9ee4db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:02.374315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc2c61-ef47-4631-8507-a6c9cd9ee4db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:02.374855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc2c61-ef47-4631-8507-a6c9cd9ee4db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:02.375390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febc2c61-ef47-4631-8507-a6c9cd9ee4db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:02.528304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-febc2c61-ef47-4631-8507-a6c9cd9ee4db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:02.536717 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-febc2c61-ef47-4631-8507-a6c9cd9ee4db tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1692 microversion: 2.1 time: 0.176907 Aug 27 05:42:02.537311 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3494/6981] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:02 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:42:03.558531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2f63bd59-d746-4c1b-9269-503835b8b5b4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:03.559190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2f63bd59-d746-4c1b-9269-503835b8b5b4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:03.565972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f63bd59-d746-4c1b-9269-503835b8b5b4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:03.566473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f63bd59-d746-4c1b-9269-503835b8b5b4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:03.566925 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f63bd59-d746-4c1b-9269-503835b8b5b4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:03.567673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f63bd59-d746-4c1b-9269-503835b8b5b4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:03.568143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f63bd59-d746-4c1b-9269-503835b8b5b4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:03.568582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f63bd59-d746-4c1b-9269-503835b8b5b4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:03.718421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2f63bd59-d746-4c1b-9269-503835b8b5b4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:03.729560 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2f63bd59-d746-4c1b-9269-503835b8b5b4 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1682 microversion: 2.1 time: 0.175278 Aug 27 05:42:03.730649 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3488/6982] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:03 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:03.752472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e6005756-c155-4860-a9bc-fd3773685d7d tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:03.753102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e6005756-c155-4860-a9bc-fd3773685d7d tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:03.762520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6005756-c155-4860-a9bc-fd3773685d7d tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:03.763018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6005756-c155-4860-a9bc-fd3773685d7d tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:03.763488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6005756-c155-4860-a9bc-fd3773685d7d tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:03.768619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6005756-c155-4860-a9bc-fd3773685d7d tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:03.769165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6005756-c155-4860-a9bc-fd3773685d7d tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:03.769602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e6005756-c155-4860-a9bc-fd3773685d7d tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:03.923602 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e6005756-c155-4860-a9bc-fd3773685d7d tempest-TestNetworkAdvancedServerOps-490461786 tempest-TestNetworkAdvancedServerOps-490461786-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1835 microversion: 2.1 time: 0.176270 Aug 27 05:42:03.924334 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3495/6983] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:03 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1835 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:03.946101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-586d70ac-5859-414b-8e4e-9940ad6b6dbb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:03.946744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-586d70ac-5859-414b-8e4e-9940ad6b6dbb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:03.953231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-586d70ac-5859-414b-8e4e-9940ad6b6dbb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:03.953872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-586d70ac-5859-414b-8e4e-9940ad6b6dbb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:03.954345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-586d70ac-5859-414b-8e4e-9940ad6b6dbb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:03.955281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-586d70ac-5859-414b-8e4e-9940ad6b6dbb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:03.955768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-586d70ac-5859-414b-8e4e-9940ad6b6dbb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:03.956222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-586d70ac-5859-414b-8e4e-9940ad6b6dbb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:04.099426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-586d70ac-5859-414b-8e4e-9940ad6b6dbb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:04.108563 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-586d70ac-5859-414b-8e4e-9940ad6b6dbb tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1682 microversion: 2.1 time: 0.166352 Aug 27 05:42:04.109152 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3489/6984] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:03 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:04.211348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ec12f424-c0a3-4023-ab9c-7bf63f7622da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:04.214383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ec12f424-c0a3-4023-ab9c-7bf63f7622da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:04.220573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec12f424-c0a3-4023-ab9c-7bf63f7622da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:04.221135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec12f424-c0a3-4023-ab9c-7bf63f7622da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:04.221531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec12f424-c0a3-4023-ab9c-7bf63f7622da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:04.222275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec12f424-c0a3-4023-ab9c-7bf63f7622da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:04.222739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec12f424-c0a3-4023-ab9c-7bf63f7622da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:04.223217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec12f424-c0a3-4023-ab9c-7bf63f7622da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:04.278601 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ec12f424-c0a3-4023-ab9c-7bf63f7622da tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e/action" status: 200 len: 38605 microversion: 2.1 time: 0.071011 Aug 27 05:42:04.286034 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3496/6985] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:42:04 2022] POST /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e/action => generated 38605 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:42:05.303697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a5662ef8-0938-41f8-9589-b76d9bcc8926 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:05.304346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a5662ef8-0938-41f8-9589-b76d9bcc8926 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:05.307349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-ce7576e4-8da6-4fb7-9490-ca8ba9a9ace5 req-97456090-63e0-4eea-97a8-235947f54c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f99dfee6-3e10-44a1-a50b-c5d86a49329e", "tag": "ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:05.314146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5662ef8-0938-41f8-9589-b76d9bcc8926 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:05.321092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ce7576e4-8da6-4fb7-9490-ca8ba9a9ace5 req-97456090-63e0-4eea-97a8-235947f54c56 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:05.321668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5662ef8-0938-41f8-9589-b76d9bcc8926 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:05.322027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ce7576e4-8da6-4fb7-9490-ca8ba9a9ace5 req-97456090-63e0-4eea-97a8-235947f54c56 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:05.322289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5662ef8-0938-41f8-9589-b76d9bcc8926 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:05.322653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-ce7576e4-8da6-4fb7-9490-ca8ba9a9ace5 req-97456090-63e0-4eea-97a8-235947f54c56 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:05.323201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5662ef8-0938-41f8-9589-b76d9bcc8926 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:05.323752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5662ef8-0938-41f8-9589-b76d9bcc8926 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:05.324282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5662ef8-0938-41f8-9589-b76d9bcc8926 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:05.336352 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-ce7576e4-8da6-4fb7-9490-ca8ba9a9ace5 req-97456090-63e0-4eea-97a8-235947f54c56 service nova] Creating event network-changed:ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1 for instance f99dfee6-3e10-44a1-a50b-c5d86a49329e on n-h2-820368-35 Aug 27 05:42:05.344030 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-ce7576e4-8da6-4fb7-9490-ca8ba9a9ace5 req-97456090-63e0-4eea-97a8-235947f54c56 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040614 Aug 27 05:42:05.348614 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3497/6986] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:05.366582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a5662ef8-0938-41f8-9589-b76d9bcc8926 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:42:05.514858 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a5662ef8-0938-41f8-9589-b76d9bcc8926 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 204 len: 0 microversion: 2.1 time: 0.214643 Aug 27 05:42:05.516591 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3490/6987] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:42:05 2022] DELETE /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:42:05.527267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-93ed5938-b040-4270-96ee-a19ffef1b03f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:05.528231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-93ed5938-b040-4270-96ee-a19ffef1b03f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:05.543732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93ed5938-b040-4270-96ee-a19ffef1b03f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:05.544241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93ed5938-b040-4270-96ee-a19ffef1b03f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:05.544689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93ed5938-b040-4270-96ee-a19ffef1b03f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:05.550805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93ed5938-b040-4270-96ee-a19ffef1b03f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:05.551408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93ed5938-b040-4270-96ee-a19ffef1b03f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:05.551853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93ed5938-b040-4270-96ee-a19ffef1b03f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:05.758256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-93ed5938-b040-4270-96ee-a19ffef1b03f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:05.767756 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-93ed5938-b040-4270-96ee-a19ffef1b03f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1688 microversion: 2.1 time: 0.245889 Aug 27 05:42:05.775153 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3498/6988] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:05 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:06.792533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-443165a6-ff91-47a1-bb61-063bbefc16f6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:06.793155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-443165a6-ff91-47a1-bb61-063bbefc16f6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:06.805019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443165a6-ff91-47a1-bb61-063bbefc16f6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:06.809833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443165a6-ff91-47a1-bb61-063bbefc16f6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:06.810445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443165a6-ff91-47a1-bb61-063bbefc16f6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:06.811513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443165a6-ff91-47a1-bb61-063bbefc16f6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:06.812108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443165a6-ff91-47a1-bb61-063bbefc16f6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:06.812661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-443165a6-ff91-47a1-bb61-063bbefc16f6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:06.885043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-443165a6-ff91-47a1-bb61-063bbefc16f6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:06.894994 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-443165a6-ff91-47a1-bb61-063bbefc16f6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 200 len: 1352 microversion: 2.1 time: 0.107163 Aug 27 05:42:06.895893 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3491/6989] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:06 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:42:07.371756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-80f8290e-e872-41b0-9d14-9bddb1eb3acc req-cb40316b-d069-49fe-bab8-8ec7629a2842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99dfee6-3e10-44a1-a50b-c5d86a49329e", "name": "network-vif-deleted", "tag": "ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:07.385003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-80f8290e-e872-41b0-9d14-9bddb1eb3acc req-cb40316b-d069-49fe-bab8-8ec7629a2842 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:07.385495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-80f8290e-e872-41b0-9d14-9bddb1eb3acc req-cb40316b-d069-49fe-bab8-8ec7629a2842 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:07.385942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-80f8290e-e872-41b0-9d14-9bddb1eb3acc req-cb40316b-d069-49fe-bab8-8ec7629a2842 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:07.399526 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-80f8290e-e872-41b0-9d14-9bddb1eb3acc req-cb40316b-d069-49fe-bab8-8ec7629a2842 service nova] Creating event network-vif-deleted:ebfd43f3-5e07-46b9-9c75-fe2e3a5c85c1 for instance f99dfee6-3e10-44a1-a50b-c5d86a49329e on n-h2-820368-35 Aug 27 05:42:07.404886 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-80f8290e-e872-41b0-9d14-9bddb1eb3acc req-cb40316b-d069-49fe-bab8-8ec7629a2842 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037393 Aug 27 05:42:07.405814 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3499/6990] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:07.919783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:07.920571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: f99dfee6-3e10-44a1-a50b-c5d86a49329e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:07.928601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:07.929370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:07.929931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:07.930814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:07.931418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:07.931969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:07.950535 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] HTTP exception thrown: Instance f99dfee6-3e10-44a1-a50b-c5d86a49329e could not be found. Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Request method failure captured: Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e HTTP/1.1 Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaycezwqVmI0SZtPDV6qQlpX2VkCFbV20Ge8JYrlntpSze_Q6CtDAirS7DSwwi9Bx81jXYcj_axSxQQoQpi7cI0bbJzLcATyBPqL779ERfMVzfXIEoodWpuViXpjJreCVt3Fb6SMBw2DwmxmRkxPcLcOBSVTt0BDw_-4gekJ_BBO45k Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: de208d7d0c4d4da1aff858285e6a08ea Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de208d7d0c4d4da1aff858285e6a08ea", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: de208d7d0c4d4da1aff858285e6a08ea Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestNetworkAdvancedServerOps-1874342116-project Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 9d30f8e6a45046dfb2a9325ebd45e99a Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1874342116-project Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance f99dfee6-3e10-44a1-a50b-c5d86a49329e could not be found. Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'f99dfee6-3e10-44a1-a50b-c5d86a49329e'} Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f99dfee6-3e10-44a1-a50b-c5d86a49329e could not be found. Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f99dfee6-3e10-44a1-a50b-c5d86a49329e could not be found. Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:42:07.953474 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:42:07.962957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:42:07.962957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:42:07.962957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:42:07.962957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:42:07.962957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:42:07.962957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:42:07.962957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f99dfee6-3e10-44a1-a50b-c5d86a49329e could not be found. Aug 27 05:42:07.962957 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:42:07.962957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Returning 404 to user: Instance f99dfee6-3e10-44a1-a50b-c5d86a49329e could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:42:07.962957 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1bb45e17-b2d0-4a9a-8acf-d0fafb20ac3a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e" status: 404 len: 111 microversion: 2.1 time: 0.043467 Aug 27 05:42:07.962957 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3492/6991] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:07 2022] GET /compute/v2.1/servers/f99dfee6-3e10-44a1-a50b-c5d86a49329e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:42:13.209232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-25602272-feae-4a95-a118-e185b090ef41 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '.version_select at 0x7fb56407b790>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:13.243799 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-25602272-feae-4a95-a118-e185b090ef41 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1903632464" status: 202 len: 0 microversion: 2.1 time: 0.042718 Aug 27 05:42:13.244663 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3500/6992] 10.222.0.58 () {58 vars in 1284 bytes} [Sat Aug 27 05:42:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1903632464 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:42:13.295257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e6158bc2-7d43-41f7-a107-0577d370888d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'create', calling method: .version_select at 0x7fb564074790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-344784418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNyIr6jBR3gIkGZuNx+u+AGs3ia3ZkOd8pI6Dp9etUi8juM2EinopnXkbUzGXGhg+Pp8XtdVRk8ikJdO683YNVq6EfJGbQC6doZeecIv80AnwzveX7Q5LWkxBZlYT0KKw=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:13.313975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-e6158bc2-7d43-41f7-a107-0577d370888d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:42:13.319706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-e6158bc2-7d43-41f7-a107-0577d370888d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for user 9d30f8e6a45046dfb2a9325ebd45e99a and project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:42:13.346305 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e6158bc2-7d43-41f7-a107-0577d370888d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055074 Aug 27 05:42:13.347574 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3493/6993] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:42:13 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:42:22.415039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:22.419411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1383708021", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "da5820fb-01cc-4391-80de-07637106bc21"}], "key_name": "tempest-TestNetworkAdvancedServerOps-344784418", "security_groups": [{"name": "tempest-secgroup-smoke-967984668"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:22.429189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:22.649150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] validate_networks() for [('da5820fb-01cc-4391-80de-07637106bc21', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:42:23.311361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:42:23.313592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:42:23.314304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:42:23.314981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:42:23.316457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:42:23.326644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:23.327674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:23.328308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:23.330218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:23.330878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:23.331599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:23.354847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:42:23.366076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Getting quotas for user 9d30f8e6a45046dfb2a9325ebd45e99a and project de208d7d0c4d4da1aff858285e6a08ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:42:23.382225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:42:23.384874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:42:23.451230 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-597a42f4-20b9-4925-b9ac-ce0c50f826f2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.038058 Aug 27 05:42:23.451889 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3501/6994] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:42:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:42:23.461030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:23.462492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:23.463167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:23.468553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3df5bde6-094a-4958-9634-30819f33809d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:23.469511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3df5bde6-094a-4958-9634-30819f33809d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:23.619042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3df5bde6-094a-4958-9634-30819f33809d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:23.630829 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3df5bde6-094a-4958-9634-30819f33809d tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1266 microversion: 2.1 time: 0.171580 Aug 27 05:42:23.636572 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3494/6995] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:23 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:24.656515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7e8e49fd-495f-4948-b50b-123875eb01a5 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1178669985", "availability_zone": "foo_zone"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:24.658129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d074fadd-dc90-4b5b-ba5e-569215019105 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:24.658990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d074fadd-dc90-4b5b-ba5e-569215019105 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:24.665203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.aggregate [None req-7e8e49fd-495f-4948-b50b-123875eb01a5 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Generated uuid 304e8f94-f6f0-461b-81ae-77b51c1a9146 for aggregate {{(pid=128548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 05:42:24.677255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d074fadd-dc90-4b5b-ba5e-569215019105 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:24.678000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d074fadd-dc90-4b5b-ba5e-569215019105 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:24.678543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d074fadd-dc90-4b5b-ba5e-569215019105 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:24.681653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d074fadd-dc90-4b5b-ba5e-569215019105 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:24.683301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d074fadd-dc90-4b5b-ba5e-569215019105 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:24.683839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d074fadd-dc90-4b5b-ba5e-569215019105 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:24.757477 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7e8e49fd-495f-4948-b50b-123875eb01a5 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.287182 Aug 27 05:42:24.758144 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3502/6996] 10.222.0.58 () {60 vars in 1164 bytes} [Sat Aug 27 05:42:24 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:24.776725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d074fadd-dc90-4b5b-ba5e-569215019105 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:24.787656 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d074fadd-dc90-4b5b-ba5e-569215019105 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1318 microversion: 2.1 time: 0.135312 Aug 27 05:42:24.789338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-27d7e03a-9745-48e0-b520-95681b85e2fd tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:24.789469 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3495/6997] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:24 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:42:24.831500 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-27d7e03a-9745-48e0-b520-95681b85e2fd tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.060990 Aug 27 05:42:24.832837 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3503/6998] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 05:42:24 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:24.845477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-accd34e4-f797-4aad-a7df-942d4fd2ee4a tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:24.849125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-accd34e4-f797-4aad-a7df-942d4fd2ee4a tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:24.849632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-accd34e4-f797-4aad-a7df-942d4fd2ee4a tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:24.850092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-accd34e4-f797-4aad-a7df-942d4fd2ee4a tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:24.851730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-accd34e4-f797-4aad-a7df-942d4fd2ee4a tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:24.852766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-accd34e4-f797-4aad-a7df-942d4fd2ee4a tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:24.853215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-accd34e4-f797-4aad-a7df-942d4fd2ee4a tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:24.880323 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-accd34e4-f797-4aad-a7df-942d4fd2ee4a tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.038945 Aug 27 05:42:24.881473 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3496/6999] 10.222.0.58 () {58 vars in 1176 bytes} [Sat Aug 27 05:42:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:24.893424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b92bf508-3e17-4360-a43d-034965475147 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:24.909581 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b92bf508-3e17-4360-a43d-034965475147 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.019900 Aug 27 05:42:24.916120 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3504/7000] 10.222.0.58 () {58 vars in 1143 bytes} [Sat Aug 27 05:42:24 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:24.922873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f1eca2a5-3f29-4eb4-8b20-e6d77a1e3485 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-820368-35"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:24.934220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1eca2a5-3f29-4eb4-8b20-e6d77a1e3485 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:24.934745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1eca2a5-3f29-4eb4-8b20-e6d77a1e3485 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:24.935386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1eca2a5-3f29-4eb4-8b20-e6d77a1e3485 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:25.346994 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f1eca2a5-3f29-4eb4-8b20-e6d77a1e3485 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.429432 Aug 27 05:42:25.347861 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3497/7001] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 05:42:24 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:25.361075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b941b493-8274-41e5-99e5-a549c453ffc1 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:25.370316 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b941b493-8274-41e5-99e5-a549c453ffc1 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.015256 Aug 27 05:42:25.370984 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3505/7002] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 05:42:25 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:25.382455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a88206c-e1e7-482c-bde1-bfdd143c3f6a tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-518695262", "availability_zone": "foo_zone"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:25.436905 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a88206c-e1e7-482c-bde1-bfdd143c3f6a tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.058237 Aug 27 05:42:25.437538 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3498/7003] 10.222.0.58 () {60 vars in 1173 bytes} [Sat Aug 27 05:42:25 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:42:25.450587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3e98973c-2772-4a78-b29a-c9dacb0df025 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:25.487941 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3e98973c-2772-4a78-b29a-c9dacb0df025 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.042639 Aug 27 05:42:25.489217 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3506/7004] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 05:42:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:42:25.501428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c5b84d63-8b9e-499d-87d4-7d7fe3dd2aed tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:25.512589 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c5b84d63-8b9e-499d-87d4-7d7fe3dd2aed tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.015180 Aug 27 05:42:25.519850 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3499/7005] 10.222.0.58 () {58 vars in 1152 bytes} [Sat Aug 27 05:42:25 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:42:25.529975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ac238810-0a40-43e7-8748-fb309f0ba4b1 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-820368-35"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:25.543052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac238810-0a40-43e7-8748-fb309f0ba4b1 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:25.544174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac238810-0a40-43e7-8748-fb309f0ba4b1 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:25.544845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac238810-0a40-43e7-8748-fb309f0ba4b1 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:25.757655 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ac238810-0a40-43e7-8748-fb309f0ba4b1 tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.234991 Aug 27 05:42:25.759022 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3507/7006] 10.222.0.58 () {60 vars in 1194 bytes} [Sat Aug 27 05:42:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:25.771344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-be2cb3b6-fbfc-4c0c-a81c-44daa6cd91de tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:25.811507 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-be2cb3b6-fbfc-4c0c-a81c-44daa6cd91de tempest-TestAggregatesBasicOps-1939646095 tempest-TestAggregatesBasicOps-1939646095-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.044505 Aug 27 05:42:25.812131 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3500/7007] 10.222.0.58 () {58 vars in 1155 bytes} [Sat Aug 27 05:42:25 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 05:42:25.819914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f940c961-3686-4dcc-8c2f-2f5ccaec9bda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:25.820703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f940c961-3686-4dcc-8c2f-2f5ccaec9bda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:25.828626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f940c961-3686-4dcc-8c2f-2f5ccaec9bda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:25.830576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f940c961-3686-4dcc-8c2f-2f5ccaec9bda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:25.830837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f940c961-3686-4dcc-8c2f-2f5ccaec9bda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:25.831787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f940c961-3686-4dcc-8c2f-2f5ccaec9bda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:25.832390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f940c961-3686-4dcc-8c2f-2f5ccaec9bda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:25.832979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f940c961-3686-4dcc-8c2f-2f5ccaec9bda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:25.952971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f940c961-3686-4dcc-8c2f-2f5ccaec9bda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:25.963986 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f940c961-3686-4dcc-8c2f-2f5ccaec9bda tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1324 microversion: 2.1 time: 0.155731 Aug 27 05:42:25.965204 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3508/7008] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:25 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1324 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:26.986988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b1ee560f-fd8b-4c86-84d4-7a9ac34af17e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:26.987816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b1ee560f-fd8b-4c86-84d4-7a9ac34af17e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:26.997794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ee560f-fd8b-4c86-84d4-7a9ac34af17e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:27.001462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ee560f-fd8b-4c86-84d4-7a9ac34af17e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:27.003410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ee560f-fd8b-4c86-84d4-7a9ac34af17e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:27.006660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ee560f-fd8b-4c86-84d4-7a9ac34af17e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:27.007195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ee560f-fd8b-4c86-84d4-7a9ac34af17e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:27.007756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b1ee560f-fd8b-4c86-84d4-7a9ac34af17e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:27.209000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-9bb1ab67-be70-4e44-951c-2b72847b0b67 req-a228e66d-1bb9-4c83-b06f-76f4b51de442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94d64d3-3692-46df-ad2e-1e1628f9aa14", "tag": "be539f15-a561-4327-bc5e-80a93bb5ba56"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:27.258025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9bb1ab67-be70-4e44-951c-2b72847b0b67 req-a228e66d-1bb9-4c83-b06f-76f4b51de442 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:27.268451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9bb1ab67-be70-4e44-951c-2b72847b0b67 req-a228e66d-1bb9-4c83-b06f-76f4b51de442 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:27.269023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9bb1ab67-be70-4e44-951c-2b72847b0b67 req-a228e66d-1bb9-4c83-b06f-76f4b51de442 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:27.307978 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-9bb1ab67-be70-4e44-951c-2b72847b0b67 req-a228e66d-1bb9-4c83-b06f-76f4b51de442 service nova] Creating event network-changed:be539f15-a561-4327-bc5e-80a93bb5ba56 for instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 on n-h1-820368-35 Aug 27 05:42:27.317576 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-9bb1ab67-be70-4e44-951c-2b72847b0b67 req-a228e66d-1bb9-4c83-b06f-76f4b51de442 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248956 Aug 27 05:42:27.319908 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3509/7009] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:42:27.415575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b1ee560f-fd8b-4c86-84d4-7a9ac34af17e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:27.429327 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b1ee560f-fd8b-4c86-84d4-7a9ac34af17e tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1391 microversion: 2.1 time: 0.444883 Aug 27 05:42:27.432231 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3501/7010] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:26 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1391 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:28.452442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c70d6fbe-405d-4ada-aa23-1a93fd324a25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:28.453908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c70d6fbe-405d-4ada-aa23-1a93fd324a25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:28.462093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70d6fbe-405d-4ada-aa23-1a93fd324a25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:28.462862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70d6fbe-405d-4ada-aa23-1a93fd324a25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:28.463357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70d6fbe-405d-4ada-aa23-1a93fd324a25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:28.464411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70d6fbe-405d-4ada-aa23-1a93fd324a25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:28.465010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70d6fbe-405d-4ada-aa23-1a93fd324a25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:28.465663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c70d6fbe-405d-4ada-aa23-1a93fd324a25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:28.710253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c70d6fbe-405d-4ada-aa23-1a93fd324a25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:28.720414 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c70d6fbe-405d-4ada-aa23-1a93fd324a25 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1391 microversion: 2.1 time: 0.272978 Aug 27 05:42:28.721030 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3510/7011] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:28 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1391 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:29.742887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-be4f8fae-10ef-4f71-8be6-02b0bf5677e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:29.743570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-be4f8fae-10ef-4f71-8be6-02b0bf5677e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:29.760032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4f8fae-10ef-4f71-8be6-02b0bf5677e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:29.760646 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4f8fae-10ef-4f71-8be6-02b0bf5677e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:29.761125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4f8fae-10ef-4f71-8be6-02b0bf5677e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:29.762080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4f8fae-10ef-4f71-8be6-02b0bf5677e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:29.762553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4f8fae-10ef-4f71-8be6-02b0bf5677e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:29.763001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be4f8fae-10ef-4f71-8be6-02b0bf5677e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:29.934347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-be4f8fae-10ef-4f71-8be6-02b0bf5677e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:29.942588 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-be4f8fae-10ef-4f71-8be6-02b0bf5677e0 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1391 microversion: 2.1 time: 0.204722 Aug 27 05:42:29.943290 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3502/7012] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:29 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:30.965694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1c1f78a-cf96-4511-ba20-736ba4b9b12c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:30.966472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a1c1f78a-cf96-4511-ba20-736ba4b9b12c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:30.974312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c1f78a-cf96-4511-ba20-736ba4b9b12c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:30.974819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c1f78a-cf96-4511-ba20-736ba4b9b12c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:30.975308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c1f78a-cf96-4511-ba20-736ba4b9b12c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:30.976036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c1f78a-cf96-4511-ba20-736ba4b9b12c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:30.976653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c1f78a-cf96-4511-ba20-736ba4b9b12c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:30.977112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1c1f78a-cf96-4511-ba20-736ba4b9b12c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:31.137081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a1c1f78a-cf96-4511-ba20-736ba4b9b12c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:31.145155 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a1c1f78a-cf96-4511-ba20-736ba4b9b12c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1391 microversion: 2.1 time: 0.185026 Aug 27 05:42:31.145747 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3511/7013] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:30 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:32.170062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-24fb86ac-ae2a-408e-928f-e2baf74ab281 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:32.172009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-24fb86ac-ae2a-408e-928f-e2baf74ab281 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:32.178843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb86ac-ae2a-408e-928f-e2baf74ab281 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:32.179552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb86ac-ae2a-408e-928f-e2baf74ab281 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:32.180008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb86ac-ae2a-408e-928f-e2baf74ab281 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:32.185410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb86ac-ae2a-408e-928f-e2baf74ab281 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:32.186170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb86ac-ae2a-408e-928f-e2baf74ab281 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:32.186633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb86ac-ae2a-408e-928f-e2baf74ab281 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:32.478280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-24fb86ac-ae2a-408e-928f-e2baf74ab281 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:32.501424 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-24fb86ac-ae2a-408e-928f-e2baf74ab281 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1391 microversion: 2.1 time: 0.335259 Aug 27 05:42:32.506034 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3503/7014] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:32 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1391 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:33.527857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0014e267-599c-40ef-9699-cc7f4462df31 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:33.529363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0014e267-599c-40ef-9699-cc7f4462df31 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:33.533076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:33.534347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:33.540996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0014e267-599c-40ef-9699-cc7f4462df31 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:33.541500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0014e267-599c-40ef-9699-cc7f4462df31 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:33.541961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0014e267-599c-40ef-9699-cc7f4462df31 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:33.542636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0014e267-599c-40ef-9699-cc7f4462df31 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:33.543192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0014e267-599c-40ef-9699-cc7f4462df31 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:33.543561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0014e267-599c-40ef-9699-cc7f4462df31 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:33.708205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0014e267-599c-40ef-9699-cc7f4462df31 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:33.717465 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0014e267-599c-40ef-9699-cc7f4462df31 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1391 microversion: 2.1 time: 0.193587 Aug 27 05:42:33.718074 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3512/7015] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:33 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1391 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:34.027049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-cb6bea19-a93b-44d8-a75e-53c1ec278cdd req-c432410b-d012-49c6-ba04-89103d93c52e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94d64d3-3692-46df-ad2e-1e1628f9aa14", "name": "network-vif-plugged", "status": "completed", "tag": "be539f15-a561-4327-bc5e-80a93bb5ba56"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:34.035292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:34.041692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cb6bea19-a93b-44d8-a75e-53c1ec278cdd req-c432410b-d012-49c6-ba04-89103d93c52e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:34.042440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cb6bea19-a93b-44d8-a75e-53c1ec278cdd req-c432410b-d012-49c6-ba04-89103d93c52e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:34.043146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cb6bea19-a93b-44d8-a75e-53c1ec278cdd req-c432410b-d012-49c6-ba04-89103d93c52e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:34.055962 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-cb6bea19-a93b-44d8-a75e-53c1ec278cdd req-c432410b-d012-49c6-ba04-89103d93c52e service nova] Creating event network-vif-plugged:be539f15-a561-4327-bc5e-80a93bb5ba56 for instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 on n-h1-820368-35 Aug 27 05:42:34.061444 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-cb6bea19-a93b-44d8-a75e-53c1ec278cdd req-c432410b-d012-49c6-ba04-89103d93c52e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038865 Aug 27 05:42:34.062575 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3504/7016] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:34.738220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-52d2b50f-a5a3-4385-954f-2b3c328a3a87 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:34.738840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-52d2b50f-a5a3-4385-954f-2b3c328a3a87 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:34.746683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d2b50f-a5a3-4385-954f-2b3c328a3a87 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:34.747202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d2b50f-a5a3-4385-954f-2b3c328a3a87 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:34.747814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d2b50f-a5a3-4385-954f-2b3c328a3a87 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:34.748961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d2b50f-a5a3-4385-954f-2b3c328a3a87 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:34.749564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d2b50f-a5a3-4385-954f-2b3c328a3a87 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:34.750129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52d2b50f-a5a3-4385-954f-2b3c328a3a87 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:34.920435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-52d2b50f-a5a3-4385-954f-2b3c328a3a87 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:34.940700 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-52d2b50f-a5a3-4385-954f-2b3c328a3a87 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1391 microversion: 2.1 time: 0.206246 Aug 27 05:42:34.941324 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3513/7017] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:34 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1391 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:35.959207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:35.964541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf37df48-2d14-4ec0-bacb-5014fa053961 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:35.965265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf37df48-2d14-4ec0-bacb-5014fa053961 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:35.972138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf37df48-2d14-4ec0-bacb-5014fa053961 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:35.972648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf37df48-2d14-4ec0-bacb-5014fa053961 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:35.973106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf37df48-2d14-4ec0-bacb-5014fa053961 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:35.973833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf37df48-2d14-4ec0-bacb-5014fa053961 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:35.974311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf37df48-2d14-4ec0-bacb-5014fa053961 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:35.974759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf37df48-2d14-4ec0-bacb-5014fa053961 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:36.110790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bf37df48-2d14-4ec0-bacb-5014fa053961 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:36.119269 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf37df48-2d14-4ec0-bacb-5014fa053961 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1563 microversion: 2.1 time: 0.161024 Aug 27 05:42:36.119844 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3505/7018] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:35 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:36.139424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-49899e50-50e7-4060-968f-7eb3e6d53676 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:36.140054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-49899e50-50e7-4060-968f-7eb3e6d53676 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:36.146890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49899e50-50e7-4060-968f-7eb3e6d53676 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:36.147406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49899e50-50e7-4060-968f-7eb3e6d53676 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:36.147853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49899e50-50e7-4060-968f-7eb3e6d53676 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:36.148561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49899e50-50e7-4060-968f-7eb3e6d53676 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:36.149023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49899e50-50e7-4060-968f-7eb3e6d53676 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:36.149460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49899e50-50e7-4060-968f-7eb3e6d53676 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:36.286902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-49899e50-50e7-4060-968f-7eb3e6d53676 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:36.295234 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-49899e50-50e7-4060-968f-7eb3e6d53676 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1563 microversion: 2.1 time: 0.159610 Aug 27 05:42:36.295819 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3514/7019] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:36 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:37.968715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7dde8843-1c1b-491c-86bf-f6dc061d344c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:37.969629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7dde8843-1c1b-491c-86bf-f6dc061d344c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:37.971819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-0d306c41-ca2b-417e-8c4e-4e22dc76b721 req-b40de71c-cfc6-4237-806d-c0683ec5a509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94d64d3-3692-46df-ad2e-1e1628f9aa14", "tag": "be539f15-a561-4327-bc5e-80a93bb5ba56"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:37.977009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dde8843-1c1b-491c-86bf-f6dc061d344c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:37.978262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dde8843-1c1b-491c-86bf-f6dc061d344c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:37.978935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dde8843-1c1b-491c-86bf-f6dc061d344c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:37.979831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dde8843-1c1b-491c-86bf-f6dc061d344c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:37.980469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dde8843-1c1b-491c-86bf-f6dc061d344c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:37.981096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dde8843-1c1b-491c-86bf-f6dc061d344c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:37.986057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0d306c41-ca2b-417e-8c4e-4e22dc76b721 req-b40de71c-cfc6-4237-806d-c0683ec5a509 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:38.003179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0d306c41-ca2b-417e-8c4e-4e22dc76b721 req-b40de71c-cfc6-4237-806d-c0683ec5a509 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:38.008542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0d306c41-ca2b-417e-8c4e-4e22dc76b721 req-b40de71c-cfc6-4237-806d-c0683ec5a509 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:38.032459 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-0d306c41-ca2b-417e-8c4e-4e22dc76b721 req-b40de71c-cfc6-4237-806d-c0683ec5a509 service nova] Creating event network-changed:be539f15-a561-4327-bc5e-80a93bb5ba56 for instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 on n-h1-820368-35 Aug 27 05:42:38.038579 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-0d306c41-ca2b-417e-8c4e-4e22dc76b721 req-b40de71c-cfc6-4237-806d-c0683ec5a509 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071562 Aug 27 05:42:38.041045 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3515/7020] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:38.182282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7dde8843-1c1b-491c-86bf-f6dc061d344c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:38.190803 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7dde8843-1c1b-491c-86bf-f6dc061d344c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1563 microversion: 2.1 time: 0.226375 Aug 27 05:42:38.191639 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3506/7021] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:37 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1563 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:38.317969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0e791c2-35a6-4e66-b021-32add17be70b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:38.319006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c0e791c2-35a6-4e66-b021-32add17be70b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:38.324935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-165f3504-2715-485c-b19f-b6af819ff0e8 req-3ac27625-d707-4741-8c40-c878bf0870a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "093591b5-f82e-4462-a476-235a523ca98a", "tag": "e37ef846-1487-4665-845f-a7e7a47454c1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:38.334163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0e791c2-35a6-4e66-b021-32add17be70b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:38.334773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0e791c2-35a6-4e66-b021-32add17be70b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:38.335383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-165f3504-2715-485c-b19f-b6af819ff0e8 req-3ac27625-d707-4741-8c40-c878bf0870a0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:38.336060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-165f3504-2715-485c-b19f-b6af819ff0e8 req-3ac27625-d707-4741-8c40-c878bf0870a0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:38.336648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0e791c2-35a6-4e66-b021-32add17be70b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:38.336854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-165f3504-2715-485c-b19f-b6af819ff0e8 req-3ac27625-d707-4741-8c40-c878bf0870a0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:38.340516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0e791c2-35a6-4e66-b021-32add17be70b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:38.341649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0e791c2-35a6-4e66-b021-32add17be70b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:38.345189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0e791c2-35a6-4e66-b021-32add17be70b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:38.350937 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-165f3504-2715-485c-b19f-b6af819ff0e8 req-3ac27625-d707-4741-8c40-c878bf0870a0 service nova] Creating event network-changed:e37ef846-1487-4665-845f-a7e7a47454c1 for instance 093591b5-f82e-4462-a476-235a523ca98a on n-h2-820368-35 Aug 27 05:42:38.360229 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-165f3504-2715-485c-b19f-b6af819ff0e8 req-3ac27625-d707-4741-8c40-c878bf0870a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040701 Aug 27 05:42:38.361944 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3507/7022] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:38.394909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c0e791c2-35a6-4e66-b021-32add17be70b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:42:38.501304 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c0e791c2-35a6-4e66-b021-32add17be70b tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 204 len: 0 microversion: 2.1 time: 0.187759 Aug 27 05:42:38.511381 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3516/7023] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:42:38 2022] DELETE /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:42:38.523829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e15d985f-115c-4b37-bbf4-1eb23a65f79a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:38.525740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e15d985f-115c-4b37-bbf4-1eb23a65f79a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:38.536007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e15d985f-115c-4b37-bbf4-1eb23a65f79a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:38.536890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e15d985f-115c-4b37-bbf4-1eb23a65f79a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:38.537537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e15d985f-115c-4b37-bbf4-1eb23a65f79a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:38.540235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e15d985f-115c-4b37-bbf4-1eb23a65f79a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:38.541335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e15d985f-115c-4b37-bbf4-1eb23a65f79a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:38.542117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e15d985f-115c-4b37-bbf4-1eb23a65f79a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:38.853347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e15d985f-115c-4b37-bbf4-1eb23a65f79a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:38.865431 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e15d985f-115c-4b37-bbf4-1eb23a65f79a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1578 microversion: 2.1 time: 0.347583 Aug 27 05:42:38.866249 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3508/7024] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:38 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1578 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:39.887911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-38d31c57-7867-4db3-953f-ec735158fa99 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:39.888694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-38d31c57-7867-4db3-953f-ec735158fa99 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:39.895674 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d31c57-7867-4db3-953f-ec735158fa99 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:39.896181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d31c57-7867-4db3-953f-ec735158fa99 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:39.896621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d31c57-7867-4db3-953f-ec735158fa99 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:39.897324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d31c57-7867-4db3-953f-ec735158fa99 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:39.897842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d31c57-7867-4db3-953f-ec735158fa99 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:39.898271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d31c57-7867-4db3-953f-ec735158fa99 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:40.037637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-38d31c57-7867-4db3-953f-ec735158fa99 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:40.046017 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-38d31c57-7867-4db3-953f-ec735158fa99 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1578 microversion: 2.1 time: 0.162422 Aug 27 05:42:40.046594 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3517/7025] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:39 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:40.709773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ac547848-99f0-408f-a979-44c7c7a4ce0d req-250eff0d-5198-46d1-9c8e-449a2ca28e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "093591b5-f82e-4462-a476-235a523ca98a", "name": "network-vif-deleted", "tag": "e37ef846-1487-4665-845f-a7e7a47454c1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:40.722081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ac547848-99f0-408f-a979-44c7c7a4ce0d req-250eff0d-5198-46d1-9c8e-449a2ca28e64 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:40.722783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ac547848-99f0-408f-a979-44c7c7a4ce0d req-250eff0d-5198-46d1-9c8e-449a2ca28e64 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:40.723425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ac547848-99f0-408f-a979-44c7c7a4ce0d req-250eff0d-5198-46d1-9c8e-449a2ca28e64 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:40.736089 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ac547848-99f0-408f-a979-44c7c7a4ce0d req-250eff0d-5198-46d1-9c8e-449a2ca28e64 service nova] Creating event network-vif-deleted:e37ef846-1487-4665-845f-a7e7a47454c1 for instance 093591b5-f82e-4462-a476-235a523ca98a on n-h2-820368-35 Aug 27 05:42:40.741274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ac547848-99f0-408f-a979-44c7c7a4ce0d req-250eff0d-5198-46d1-9c8e-449a2ca28e64 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037682 Aug 27 05:42:40.741910 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3509/7026] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:41.069363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-100687ec-c543-43f0-a98e-99a381e4cd57 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:41.070149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-100687ec-c543-43f0-a98e-99a381e4cd57 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:41.077095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-100687ec-c543-43f0-a98e-99a381e4cd57 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:41.077826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-100687ec-c543-43f0-a98e-99a381e4cd57 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:41.078269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-100687ec-c543-43f0-a98e-99a381e4cd57 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:41.079069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-100687ec-c543-43f0-a98e-99a381e4cd57 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:41.079551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-100687ec-c543-43f0-a98e-99a381e4cd57 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:41.080014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-100687ec-c543-43f0-a98e-99a381e4cd57 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:41.150556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-100687ec-c543-43f0-a98e-99a381e4cd57 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:41.158979 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-100687ec-c543-43f0-a98e-99a381e4cd57 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1226 microversion: 2.1 time: 0.093580 Aug 27 05:42:41.160012 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3518/7027] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:41 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:42:42.182834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-115e6acb-86c0-4d31-b3b8-8d4a157a79b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:42.183589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-115e6acb-86c0-4d31-b3b8-8d4a157a79b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:42.190117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-115e6acb-86c0-4d31-b3b8-8d4a157a79b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:42.190622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-115e6acb-86c0-4d31-b3b8-8d4a157a79b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:42.191079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-115e6acb-86c0-4d31-b3b8-8d4a157a79b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:42.191823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-115e6acb-86c0-4d31-b3b8-8d4a157a79b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:42.192294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-115e6acb-86c0-4d31-b3b8-8d4a157a79b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:42.192738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-115e6acb-86c0-4d31-b3b8-8d4a157a79b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:42.259560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-115e6acb-86c0-4d31-b3b8-8d4a157a79b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:42.267855 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-115e6acb-86c0-4d31-b3b8-8d4a157a79b3 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1226 microversion: 2.1 time: 0.090716 Aug 27 05:42:42.268435 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3510/7028] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:42 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:43.291910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7496492c-f298-49a7-afc4-0a3efc827a15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:43.292457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7496492c-f298-49a7-afc4-0a3efc827a15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:43.299694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7496492c-f298-49a7-afc4-0a3efc827a15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:43.300186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7496492c-f298-49a7-afc4-0a3efc827a15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:43.300633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7496492c-f298-49a7-afc4-0a3efc827a15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:43.301335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7496492c-f298-49a7-afc4-0a3efc827a15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:43.302171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7496492c-f298-49a7-afc4-0a3efc827a15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:43.302622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7496492c-f298-49a7-afc4-0a3efc827a15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:43.367281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7496492c-f298-49a7-afc4-0a3efc827a15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:43.376189 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7496492c-f298-49a7-afc4-0a3efc827a15 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1226 microversion: 2.1 time: 0.088307 Aug 27 05:42:43.376961 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3519/7029] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:43 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:44.399807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-31c25534-0e2c-4e28-8523-298fb591ff17 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:44.400479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-31c25534-0e2c-4e28-8523-298fb591ff17 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:44.408960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c25534-0e2c-4e28-8523-298fb591ff17 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:44.409400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c25534-0e2c-4e28-8523-298fb591ff17 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:44.409861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c25534-0e2c-4e28-8523-298fb591ff17 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:44.410588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c25534-0e2c-4e28-8523-298fb591ff17 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:44.411110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c25534-0e2c-4e28-8523-298fb591ff17 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:44.411568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31c25534-0e2c-4e28-8523-298fb591ff17 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:44.477786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-31c25534-0e2c-4e28-8523-298fb591ff17 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:44.485685 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-31c25534-0e2c-4e28-8523-298fb591ff17 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 200 len: 1226 microversion: 2.1 time: 0.091044 Aug 27 05:42:44.486266 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3511/7030] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:44 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:45.507758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:45.508312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 093591b5-f82e-4462-a476-235a523ca98a] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:45.515981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:45.516493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:45.516926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:45.517639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:45.518111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:45.518549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:45.532654 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 093591b5-f82e-4462-a476-235a523ca98a could not be found. Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a HTTP/1.1 Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 093591b5-f82e-4462-a476-235a523ca98a could not be found. Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '093591b5-f82e-4462-a476-235a523ca98a'} Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 093591b5-f82e-4462-a476-235a523ca98a could not be found. Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 093591b5-f82e-4462-a476-235a523ca98a could not be found. Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:42:45.534406 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:42:45.541378 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:42:45.541378 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:42:45.541378 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:42:45.541378 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:42:45.541378 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:42:45.541378 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 093591b5-f82e-4462-a476-235a523ca98a could not be found. Aug 27 05:42:45.541378 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:42:45.541378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 093591b5-f82e-4462-a476-235a523ca98a could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:42:45.541378 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-682788a6-ea61-4572-89a4-ddaccaa13e2a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a" status: 404 len: 111 microversion: 2.1 time: 0.032193 Aug 27 05:42:45.541378 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3520/7031] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:45 2022] GET /compute/v2.1/servers/093591b5-f82e-4462-a476-235a523ca98a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:42:51.762273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9ae7b0c3-56e2-4579-9459-820d8638fcc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:51.762795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9ae7b0c3-56e2-4579-9459-820d8638fcc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:51.764531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-af14db3c-4576-4730-8e8c-a0605a6afe71 req-c480b80d-4409-46f9-977e-fc8835ce2227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50491414-dbda-4377-aa35-053da472571d", "tag": "d12f37c0-6d8a-4826-b0e6-1541625ef9bb"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:51.770390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ae7b0c3-56e2-4579-9459-820d8638fcc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:51.771293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ae7b0c3-56e2-4579-9459-820d8638fcc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:51.771747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ae7b0c3-56e2-4579-9459-820d8638fcc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:51.772550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ae7b0c3-56e2-4579-9459-820d8638fcc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:51.773071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ae7b0c3-56e2-4579-9459-820d8638fcc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:51.773602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ae7b0c3-56e2-4579-9459-820d8638fcc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:51.776879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-af14db3c-4576-4730-8e8c-a0605a6afe71 req-c480b80d-4409-46f9-977e-fc8835ce2227 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:51.777369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-af14db3c-4576-4730-8e8c-a0605a6afe71 req-c480b80d-4409-46f9-977e-fc8835ce2227 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:51.777970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-af14db3c-4576-4730-8e8c-a0605a6afe71 req-c480b80d-4409-46f9-977e-fc8835ce2227 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:51.806316 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-af14db3c-4576-4730-8e8c-a0605a6afe71 req-c480b80d-4409-46f9-977e-fc8835ce2227 service nova] Creating event network-changed:d12f37c0-6d8a-4826-b0e6-1541625ef9bb for instance 50491414-dbda-4377-aa35-053da472571d on n-h1-820368-35 Aug 27 05:42:51.811719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9ae7b0c3-56e2-4579-9459-820d8638fcc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:42:51.812262 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-af14db3c-4576-4730-8e8c-a0605a6afe71 req-c480b80d-4409-46f9-977e-fc8835ce2227 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051470 Aug 27 05:42:51.812977 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3521/7032] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:51.904767 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9ae7b0c3-56e2-4579-9459-820d8638fcc0 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 204 len: 0 microversion: 2.1 time: 0.146843 Aug 27 05:42:51.905797 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3512/7033] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:42:51 2022] DELETE /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:42:51.915170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ecce5795-3e6f-497e-88bf-b592eb6c4528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:51.916395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ecce5795-3e6f-497e-88bf-b592eb6c4528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:51.924261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ecce5795-3e6f-497e-88bf-b592eb6c4528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:51.924761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ecce5795-3e6f-497e-88bf-b592eb6c4528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:51.925206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ecce5795-3e6f-497e-88bf-b592eb6c4528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:51.925934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ecce5795-3e6f-497e-88bf-b592eb6c4528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:51.926419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ecce5795-3e6f-497e-88bf-b592eb6c4528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:51.926849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ecce5795-3e6f-497e-88bf-b592eb6c4528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:52.062997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ecce5795-3e6f-497e-88bf-b592eb6c4528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:52.071319 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ecce5795-3e6f-497e-88bf-b592eb6c4528 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1578 microversion: 2.1 time: 0.161155 Aug 27 05:42:52.071903 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3522/7034] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:51 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:42:53.093779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df7c64a5-073f-440d-affb-777094e1f64a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:53.094424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-df7c64a5-073f-440d-affb-777094e1f64a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:53.101377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df7c64a5-073f-440d-affb-777094e1f64a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:53.101886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df7c64a5-073f-440d-affb-777094e1f64a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:53.102348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df7c64a5-073f-440d-affb-777094e1f64a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:53.103073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df7c64a5-073f-440d-affb-777094e1f64a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:53.103578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df7c64a5-073f-440d-affb-777094e1f64a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:53.104027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df7c64a5-073f-440d-affb-777094e1f64a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:53.282493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df7c64a5-073f-440d-affb-777094e1f64a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:53.290881 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df7c64a5-073f-440d-affb-777094e1f64a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1578 microversion: 2.1 time: 0.201674 Aug 27 05:42:53.291481 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3513/7035] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:53 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1578 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:54.312134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-66b84efd-d5d1-416a-916e-f5011e26ee58 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:54.312780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-66b84efd-d5d1-416a-916e-f5011e26ee58 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:54.315595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:54.320387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66b84efd-d5d1-416a-916e-f5011e26ee58 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:54.321447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66b84efd-d5d1-416a-916e-f5011e26ee58 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:54.321894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66b84efd-d5d1-416a-916e-f5011e26ee58 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:54.322602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66b84efd-d5d1-416a-916e-f5011e26ee58 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:54.323064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66b84efd-d5d1-416a-916e-f5011e26ee58 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:54.323530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66b84efd-d5d1-416a-916e-f5011e26ee58 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:54.326917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:54.547069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66b84efd-d5d1-416a-916e-f5011e26ee58 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:54.556255 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-66b84efd-d5d1-416a-916e-f5011e26ee58 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1459 microversion: 2.1 time: 0.247952 Aug 27 05:42:54.556845 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3523/7036] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:54 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1459 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:54.759466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-cede62f1-1dce-4c4e-a288-85a989cb067f req-9663806b-395d-4cce-915c-f4437e9936f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50491414-dbda-4377-aa35-053da472571d", "name": "network-vif-deleted", "tag": "d12f37c0-6d8a-4826-b0e6-1541625ef9bb"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:54.765729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:54.772064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cede62f1-1dce-4c4e-a288-85a989cb067f req-9663806b-395d-4cce-915c-f4437e9936f1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:54.772609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cede62f1-1dce-4c4e-a288-85a989cb067f req-9663806b-395d-4cce-915c-f4437e9936f1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:54.773068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-cede62f1-1dce-4c4e-a288-85a989cb067f req-9663806b-395d-4cce-915c-f4437e9936f1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:54.783394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:54.793654 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-cede62f1-1dce-4c4e-a288-85a989cb067f req-9663806b-395d-4cce-915c-f4437e9936f1 service nova] Creating event network-vif-deleted:d12f37c0-6d8a-4826-b0e6-1541625ef9bb for instance 50491414-dbda-4377-aa35-053da472571d on n-h1-820368-35 Aug 27 05:42:54.799050 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-cede62f1-1dce-4c4e-a288-85a989cb067f req-9663806b-395d-4cce-915c-f4437e9936f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043882 Aug 27 05:42:54.799680 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3514/7037] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:42:55.578530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7291f29a-6458-4580-ac1a-4cff2b3e8af8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:55.579438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7291f29a-6458-4580-ac1a-4cff2b3e8af8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:55.587425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7291f29a-6458-4580-ac1a-4cff2b3e8af8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:55.587929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7291f29a-6458-4580-ac1a-4cff2b3e8af8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:55.588375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7291f29a-6458-4580-ac1a-4cff2b3e8af8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:55.589094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7291f29a-6458-4580-ac1a-4cff2b3e8af8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:55.591417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7291f29a-6458-4580-ac1a-4cff2b3e8af8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:55.591895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7291f29a-6458-4580-ac1a-4cff2b3e8af8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:55.661470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7291f29a-6458-4580-ac1a-4cff2b3e8af8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:55.669600 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7291f29a-6458-4580-ac1a-4cff2b3e8af8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1225 microversion: 2.1 time: 0.095037 Aug 27 05:42:55.670203 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3524/7038] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:55 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:56.692121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-71c2d187-f12b-4e18-9a09-08ddfcd8253f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:56.692741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-71c2d187-f12b-4e18-9a09-08ddfcd8253f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:56.700581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71c2d187-f12b-4e18-9a09-08ddfcd8253f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:56.701080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71c2d187-f12b-4e18-9a09-08ddfcd8253f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:56.701531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71c2d187-f12b-4e18-9a09-08ddfcd8253f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:56.702327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71c2d187-f12b-4e18-9a09-08ddfcd8253f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:56.702794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71c2d187-f12b-4e18-9a09-08ddfcd8253f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:56.703271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71c2d187-f12b-4e18-9a09-08ddfcd8253f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:56.769907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71c2d187-f12b-4e18-9a09-08ddfcd8253f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:56.778131 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-71c2d187-f12b-4e18-9a09-08ddfcd8253f tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1225 microversion: 2.1 time: 0.091637 Aug 27 05:42:56.778716 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3515/7039] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:56 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:57.798941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-18177bf2-ac84-4d4a-a2b8-57a33a72d3a8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:57.799685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-18177bf2-ac84-4d4a-a2b8-57a33a72d3a8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:57.807042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18177bf2-ac84-4d4a-a2b8-57a33a72d3a8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:57.807562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18177bf2-ac84-4d4a-a2b8-57a33a72d3a8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:57.808009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18177bf2-ac84-4d4a-a2b8-57a33a72d3a8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:57.808717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18177bf2-ac84-4d4a-a2b8-57a33a72d3a8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:57.809179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18177bf2-ac84-4d4a-a2b8-57a33a72d3a8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:57.809611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18177bf2-ac84-4d4a-a2b8-57a33a72d3a8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:57.872445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18177bf2-ac84-4d4a-a2b8-57a33a72d3a8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:57.881070 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-18177bf2-ac84-4d4a-a2b8-57a33a72d3a8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1225 microversion: 2.1 time: 0.086014 Aug 27 05:42:57.881659 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3525/7040] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:57 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:58.902796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:58.903407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:58.911062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:58.911594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:58.912049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:58.912761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:58.913231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:58.913676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:58.947871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:58.948386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:58.948849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:58.949660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lazy-loading 'fault' on Instance uuid 50491414-dbda-4377-aa35-053da472571d {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:42:58.989742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007b4762bf8c436fb783d84380c01932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b05abd53e947b38c809fa546091e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:58.998117 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9f50394e-60dc-4f5f-80c4-cb5d0337b3d8 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 200 len: 1230 microversion: 2.1 time: 0.100225 Aug 27 05:42:58.999055 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3516/7041] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:58 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:43:00.020572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:00.021209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 50491414-dbda-4377-aa35-053da472571d] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:00.027631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:00.028114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:00.028553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:00.029719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:00.029970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:00.030397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:00.044125 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 50491414-dbda-4377-aa35-053da472571d could not be found. Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d HTTP/1.1 Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 50491414-dbda-4377-aa35-053da472571d could not be found. Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '50491414-dbda-4377-aa35-053da472571d'} Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50491414-dbda-4377-aa35-053da472571d could not be found. Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50491414-dbda-4377-aa35-053da472571d could not be found. Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:43:00.045824 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.049803 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:00.049803 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:43:00.049803 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:43:00.049803 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:43:00.049803 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:43:00.049803 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50491414-dbda-4377-aa35-053da472571d could not be found. Aug 27 05:43:00.049803 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.049803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 50491414-dbda-4377-aa35-053da472571d could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:43:00.049803 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-02ecf2ec-d11d-4bc4-9b23-a2e4a434a77c tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d" status: 404 len: 111 microversion: 2.1 time: 0.030731 Aug 27 05:43:00.050634 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3526/7042] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:00 2022] GET /compute/v2.1/servers/50491414-dbda-4377-aa35-053da472571d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:43:00.493784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:00.494274 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:00.501345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:00.501838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:00.502292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:00.502999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:00.503497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:00.503936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:00.519806 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 HTTP/1.1 Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '983b3540-9f17-4b6d-9d21-9f36f77f6bf5'} Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:43:00.521493 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6eec3c79-1d55-4864-b2ce-f0601adb970a tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 404 len: 111 microversion: 2.1 time: 0.033166 Aug 27 05:43:00.525620 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3517/7043] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:43:00 2022] DELETE /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:43:00.532543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:00.533156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] [instance: 983b3540-9f17-4b6d-9d21-9f36f77f6bf5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:00.539361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:00.539848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:00.540929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:00.541626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:00.542080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:00.542511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:00.555831 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] HTTP exception thrown: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Request method failure captured: Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 HTTP/1.1 Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCauXdzAmRyGv6m-wyHxJpsRGYT0AbYE8NFf6lC7jpsoRxqroXarlktMd5-2VjpCSsVjYaN_1q4TtLF52Tb7QRpow1AxuSyz1EjUZ7-Z04CRL03FP5TCuUO5kNKhGDt9MQ_fiAHole7sAZe4Dr3Xuv_7PDss8jHJNoZ7He6Wp30ZL0uI Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4b05abd53e947b38c809fa546091e9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4b05abd53e947b38c809fa546091e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestVolumeBootPattern-550156274 Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: e4b05abd53e947b38c809fa546091e9e Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestVolumeBootPattern-550156274 Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 007b4762bf8c436fb783d84380c01932 Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestVolumeBootPattern-550156274-project Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '983b3540-9f17-4b6d-9d21-9f36f77f6bf5'} Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:43:00.557360 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.561552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:00.561552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:43:00.561552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:43:00.561552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:43:00.561552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:43:00.561552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. Aug 27 05:43:00.561552 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:43:00.561552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Returning 404 to user: Instance 983b3540-9f17-4b6d-9d21-9f36f77f6bf5 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:43:00.561552 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-534dd429-9e16-4011-ac35-a5655ffaffce tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5" status: 404 len: 111 microversion: 2.1 time: 0.030503 Aug 27 05:43:00.561552 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3527/7044] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:00 2022] GET /compute/v2.1/servers/983b3540-9f17-4b6d-9d21-9f36f77f6bf5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:43:03.998225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-00726d53-1a09-4683-8ff7-b7715eb09385 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] Calling method '.version_select at 0x7fb56403eca0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:04.021903 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-00726d53-1a09-4683-8ff7-b7715eb09385 tempest-TestVolumeBootPattern-550156274 tempest-TestVolumeBootPattern-550156274-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1417438862" status: 202 len: 0 microversion: 2.1 time: 0.028241 Aug 27 05:43:04.022621 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3518/7045] 10.222.0.58 () {58 vars in 1263 bytes} [Sat Aug 27 05:43:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1417438862 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:43:13.554746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a6acd3a9-d903-49fd-8f6d-289f0989bf44 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:43:13.557591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a6acd3a9-d903-49fd-8f6d-289f0989bf44 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:13.561083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=9 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:13.562045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=21 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:13.568207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6acd3a9-d903-49fd-8f6d-289f0989bf44 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:13.568694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6acd3a9-d903-49fd-8f6d-289f0989bf44 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:13.569136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6acd3a9-d903-49fd-8f6d-289f0989bf44 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:13.569959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6acd3a9-d903-49fd-8f6d-289f0989bf44 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:13.570417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6acd3a9-d903-49fd-8f6d-289f0989bf44 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:13.570844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a6acd3a9-d903-49fd-8f6d-289f0989bf44 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:13.639127 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a6acd3a9-d903-49fd-8f6d-289f0989bf44 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14/action" status: 200 len: 24569 microversion: 2.1 time: 0.089171 Aug 27 05:43:13.639805 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3528/7046] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:43:13 2022] POST /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14/action => generated 24569 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:43:52.413118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=17 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:52.413992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:52.693338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:43:52.696539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:52.706972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:52.707512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:52.707977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:52.708722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:52.709243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:52.709711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:52.805080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:43:52.805517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:43:52.806012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:43:52.806443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:43:52.806876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:43:52.871171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:52.877817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:52.878328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:52.878787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:52.879555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:52.880060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:52.880505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:52.916087 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b7f05cb6-be1b-4c91-8476-ba1e4fb3c62b tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14/action" status: 202 len: 1138 microversion: 2.1 time: 0.505523 Aug 27 05:43:52.917016 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3519/7047] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:43:52 2022] POST /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14/action => generated 1138 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 05:43:52.938236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-28e4705a-db75-4e7c-82af-235fcf0245b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:52.939876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-28e4705a-db75-4e7c-82af-235fcf0245b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:52.946298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:52.946964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:52.949889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28e4705a-db75-4e7c-82af-235fcf0245b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:52.950385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28e4705a-db75-4e7c-82af-235fcf0245b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:52.950847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28e4705a-db75-4e7c-82af-235fcf0245b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:52.951763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28e4705a-db75-4e7c-82af-235fcf0245b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:52.952389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28e4705a-db75-4e7c-82af-235fcf0245b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:52.952848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-28e4705a-db75-4e7c-82af-235fcf0245b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:53.100539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-28e4705a-db75-4e7c-82af-235fcf0245b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:43:53.109254 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-28e4705a-db75-4e7c-82af-235fcf0245b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.176038 Aug 27 05:43:53.109830 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3529/7048] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:52 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:43:54.131753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a9a2f9d3-a4fc-42a6-9db0-f54348f511a9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:54.132310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a9a2f9d3-a4fc-42a6-9db0-f54348f511a9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:54.139949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a2f9d3-a4fc-42a6-9db0-f54348f511a9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:54.140461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a2f9d3-a4fc-42a6-9db0-f54348f511a9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:54.140924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a2f9d3-a4fc-42a6-9db0-f54348f511a9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:54.141653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a2f9d3-a4fc-42a6-9db0-f54348f511a9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:54.142485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a2f9d3-a4fc-42a6-9db0-f54348f511a9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:54.142623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9a2f9d3-a4fc-42a6-9db0-f54348f511a9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:54.284184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a9a2f9d3-a4fc-42a6-9db0-f54348f511a9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:43:54.293049 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a9a2f9d3-a4fc-42a6-9db0-f54348f511a9 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.165335 Aug 27 05:43:54.293620 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3520/7049] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:54 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:43:55.315772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-395b280f-8251-4528-8b12-8ed863ee5a89 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:55.316604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-395b280f-8251-4528-8b12-8ed863ee5a89 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:55.323685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-395b280f-8251-4528-8b12-8ed863ee5a89 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:55.324197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-395b280f-8251-4528-8b12-8ed863ee5a89 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:55.324614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-395b280f-8251-4528-8b12-8ed863ee5a89 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:55.325932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-395b280f-8251-4528-8b12-8ed863ee5a89 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:55.326480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-395b280f-8251-4528-8b12-8ed863ee5a89 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:55.326908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-395b280f-8251-4528-8b12-8ed863ee5a89 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:55.468596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-395b280f-8251-4528-8b12-8ed863ee5a89 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:43:55.476831 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-395b280f-8251-4528-8b12-8ed863ee5a89 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.165072 Aug 27 05:43:55.477480 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3530/7050] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:55 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:43:56.499353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7a32be66-43d7-4b51-b931-7eefb910ba5a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:56.499983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7a32be66-43d7-4b51-b931-7eefb910ba5a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:56.506888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32be66-43d7-4b51-b931-7eefb910ba5a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:56.507420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32be66-43d7-4b51-b931-7eefb910ba5a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:56.507872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32be66-43d7-4b51-b931-7eefb910ba5a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:56.508578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32be66-43d7-4b51-b931-7eefb910ba5a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:56.509046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32be66-43d7-4b51-b931-7eefb910ba5a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:56.509484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7a32be66-43d7-4b51-b931-7eefb910ba5a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:56.648170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7a32be66-43d7-4b51-b931-7eefb910ba5a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:43:56.656830 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7a32be66-43d7-4b51-b931-7eefb910ba5a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.162018 Aug 27 05:43:56.657405 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3521/7051] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:56 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:43:57.678613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b0dbd019-1879-4c97-b892-daac3655d0c6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:57.679253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b0dbd019-1879-4c97-b892-daac3655d0c6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:57.685985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0dbd019-1879-4c97-b892-daac3655d0c6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:57.686466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0dbd019-1879-4c97-b892-daac3655d0c6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:57.686907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0dbd019-1879-4c97-b892-daac3655d0c6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:57.687636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0dbd019-1879-4c97-b892-daac3655d0c6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:57.688368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0dbd019-1879-4c97-b892-daac3655d0c6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:57.688797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0dbd019-1879-4c97-b892-daac3655d0c6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:57.833006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b0dbd019-1879-4c97-b892-daac3655d0c6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:43:57.840961 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b0dbd019-1879-4c97-b892-daac3655d0c6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.166297 Aug 27 05:43:57.841714 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3531/7052] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:57 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:43:58.865246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7995ba38-227a-407e-8365-188ab8ae2094 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:58.865887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7995ba38-227a-407e-8365-188ab8ae2094 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:58.873547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7995ba38-227a-407e-8365-188ab8ae2094 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:58.874109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7995ba38-227a-407e-8365-188ab8ae2094 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:58.874576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7995ba38-227a-407e-8365-188ab8ae2094 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:58.875411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7995ba38-227a-407e-8365-188ab8ae2094 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:58.875836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7995ba38-227a-407e-8365-188ab8ae2094 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:58.876281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7995ba38-227a-407e-8365-188ab8ae2094 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:59.013134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7995ba38-227a-407e-8365-188ab8ae2094 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:43:59.021016 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7995ba38-227a-407e-8365-188ab8ae2094 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.159764 Aug 27 05:43:59.021596 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3522/7053] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:58 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:00.043224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c389bc7b-3fd3-4a8e-af59-7de8bcf0c3ce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:00.043859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c389bc7b-3fd3-4a8e-af59-7de8bcf0c3ce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:00.050581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c389bc7b-3fd3-4a8e-af59-7de8bcf0c3ce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:00.051069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c389bc7b-3fd3-4a8e-af59-7de8bcf0c3ce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:00.051540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c389bc7b-3fd3-4a8e-af59-7de8bcf0c3ce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:00.052289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c389bc7b-3fd3-4a8e-af59-7de8bcf0c3ce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:00.052749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c389bc7b-3fd3-4a8e-af59-7de8bcf0c3ce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:00.053182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c389bc7b-3fd3-4a8e-af59-7de8bcf0c3ce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:00.189908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c389bc7b-3fd3-4a8e-af59-7de8bcf0c3ce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:00.197767 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c389bc7b-3fd3-4a8e-af59-7de8bcf0c3ce tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.158529 Aug 27 05:44:00.198332 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3532/7054] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:00 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:01.219868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b1565ac-3cd6-4c9f-8109-06f1adbe57b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:01.220512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9b1565ac-3cd6-4c9f-8109-06f1adbe57b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:01.228331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1565ac-3cd6-4c9f-8109-06f1adbe57b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:01.228838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1565ac-3cd6-4c9f-8109-06f1adbe57b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:01.229299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1565ac-3cd6-4c9f-8109-06f1adbe57b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:01.230020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1565ac-3cd6-4c9f-8109-06f1adbe57b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:01.230497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1565ac-3cd6-4c9f-8109-06f1adbe57b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:01.230945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b1565ac-3cd6-4c9f-8109-06f1adbe57b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:01.365353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9b1565ac-3cd6-4c9f-8109-06f1adbe57b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:01.373698 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9b1565ac-3cd6-4c9f-8109-06f1adbe57b1 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.157391 Aug 27 05:44:01.374275 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3523/7055] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:01 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:02.395478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a5ec1f17-e453-4702-8876-884fced93be3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:02.396012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a5ec1f17-e453-4702-8876-884fced93be3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:02.402731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ec1f17-e453-4702-8876-884fced93be3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:02.403253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ec1f17-e453-4702-8876-884fced93be3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:02.403701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ec1f17-e453-4702-8876-884fced93be3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:02.404400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ec1f17-e453-4702-8876-884fced93be3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:02.405498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ec1f17-e453-4702-8876-884fced93be3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:02.405928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a5ec1f17-e453-4702-8876-884fced93be3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:02.545002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a5ec1f17-e453-4702-8876-884fced93be3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:02.552862 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a5ec1f17-e453-4702-8876-884fced93be3 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.161445 Aug 27 05:44:02.553431 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3533/7056] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:02 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:03.576487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c3786aa-6778-477a-a82b-bbb570d0b1fa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:03.577228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c3786aa-6778-477a-a82b-bbb570d0b1fa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:03.585728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3786aa-6778-477a-a82b-bbb570d0b1fa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:03.586236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3786aa-6778-477a-a82b-bbb570d0b1fa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:03.586693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3786aa-6778-477a-a82b-bbb570d0b1fa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:03.587450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3786aa-6778-477a-a82b-bbb570d0b1fa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:03.588553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3786aa-6778-477a-a82b-bbb570d0b1fa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:03.588553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c3786aa-6778-477a-a82b-bbb570d0b1fa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:03.730893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c3786aa-6778-477a-a82b-bbb570d0b1fa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:03.741370 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c3786aa-6778-477a-a82b-bbb570d0b1fa tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.169036 Aug 27 05:44:03.741952 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3524/7057] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:03 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:04.764905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fc94e5ea-1f7d-47cb-8fbe-964e0250e840 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:04.765630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fc94e5ea-1f7d-47cb-8fbe-964e0250e840 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:04.772778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc94e5ea-1f7d-47cb-8fbe-964e0250e840 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:04.773270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc94e5ea-1f7d-47cb-8fbe-964e0250e840 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:04.773709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc94e5ea-1f7d-47cb-8fbe-964e0250e840 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:04.774415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc94e5ea-1f7d-47cb-8fbe-964e0250e840 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:04.774876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc94e5ea-1f7d-47cb-8fbe-964e0250e840 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:04.775338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc94e5ea-1f7d-47cb-8fbe-964e0250e840 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:04.913823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fc94e5ea-1f7d-47cb-8fbe-964e0250e840 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:04.923113 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fc94e5ea-1f7d-47cb-8fbe-964e0250e840 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.163001 Aug 27 05:44:04.923683 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3534/7058] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:04 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:05.946433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de2ac873-1cae-40ae-a9fe-6afb3e166a2f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:05.947094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de2ac873-1cae-40ae-a9fe-6afb3e166a2f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:05.955081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ac873-1cae-40ae-a9fe-6afb3e166a2f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:05.955612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ac873-1cae-40ae-a9fe-6afb3e166a2f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:05.956073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ac873-1cae-40ae-a9fe-6afb3e166a2f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:05.956820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ac873-1cae-40ae-a9fe-6afb3e166a2f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:05.957296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ac873-1cae-40ae-a9fe-6afb3e166a2f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:05.957743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de2ac873-1cae-40ae-a9fe-6afb3e166a2f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:06.096662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-de2ac873-1cae-40ae-a9fe-6afb3e166a2f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:06.104665 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de2ac873-1cae-40ae-a9fe-6afb3e166a2f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.162163 Aug 27 05:44:06.105234 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3525/7059] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:05 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:07.126996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-27b82dc8-d06c-4455-bac0-173a9400af51 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:07.127587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-27b82dc8-d06c-4455-bac0-173a9400af51 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:07.134631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27b82dc8-d06c-4455-bac0-173a9400af51 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:07.135146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27b82dc8-d06c-4455-bac0-173a9400af51 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:07.135589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27b82dc8-d06c-4455-bac0-173a9400af51 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:07.136283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27b82dc8-d06c-4455-bac0-173a9400af51 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:07.136768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27b82dc8-d06c-4455-bac0-173a9400af51 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:07.137192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27b82dc8-d06c-4455-bac0-173a9400af51 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:07.273443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-27b82dc8-d06c-4455-bac0-173a9400af51 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:07.281774 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-27b82dc8-d06c-4455-bac0-173a9400af51 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.159220 Aug 27 05:44:07.282348 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3535/7060] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:07 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:44:08.302495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-39826b15-ea24-4630-8e1c-1f969f1eb147 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:08.303193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-39826b15-ea24-4630-8e1c-1f969f1eb147 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:08.310080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39826b15-ea24-4630-8e1c-1f969f1eb147 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:08.310650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39826b15-ea24-4630-8e1c-1f969f1eb147 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:08.311128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39826b15-ea24-4630-8e1c-1f969f1eb147 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:08.311850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39826b15-ea24-4630-8e1c-1f969f1eb147 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:08.312329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39826b15-ea24-4630-8e1c-1f969f1eb147 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:08.312775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-39826b15-ea24-4630-8e1c-1f969f1eb147 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:08.447474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-39826b15-ea24-4630-8e1c-1f969f1eb147 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:08.455949 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-39826b15-ea24-4630-8e1c-1f969f1eb147 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.157426 Aug 27 05:44:08.456525 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3526/7061] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:08 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:09.477957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-de99e418-0457-4fa3-a548-e5eca4a520e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:09.478569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-de99e418-0457-4fa3-a548-e5eca4a520e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:09.486072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de99e418-0457-4fa3-a548-e5eca4a520e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:09.486556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de99e418-0457-4fa3-a548-e5eca4a520e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:09.486996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de99e418-0457-4fa3-a548-e5eca4a520e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:09.487715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de99e418-0457-4fa3-a548-e5eca4a520e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:09.488172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de99e418-0457-4fa3-a548-e5eca4a520e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:09.488597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-de99e418-0457-4fa3-a548-e5eca4a520e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:09.621607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-de99e418-0457-4fa3-a548-e5eca4a520e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:09.630259 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-de99e418-0457-4fa3-a548-e5eca4a520e8 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1691 microversion: 2.1 time: 0.156337 Aug 27 05:44:09.630835 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3536/7062] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:09 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:10.652323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-65b1e314-044d-41ae-87e7-9cd7ce865f8c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:10.652877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-65b1e314-044d-41ae-87e7-9cd7ce865f8c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:10.660664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65b1e314-044d-41ae-87e7-9cd7ce865f8c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:10.661173 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65b1e314-044d-41ae-87e7-9cd7ce865f8c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:10.661641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65b1e314-044d-41ae-87e7-9cd7ce865f8c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:10.662392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65b1e314-044d-41ae-87e7-9cd7ce865f8c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:10.662895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65b1e314-044d-41ae-87e7-9cd7ce865f8c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:10.663374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-65b1e314-044d-41ae-87e7-9cd7ce865f8c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:10.796661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-65b1e314-044d-41ae-87e7-9cd7ce865f8c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:10.804572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-65b1e314-044d-41ae-87e7-9cd7ce865f8c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1697 microversion: 2.1 time: 0.156262 Aug 27 05:44:10.805140 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3527/7063] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:10 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:11.827874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-73d20ddc-93fc-4feb-8aee-a5fc7e68c0a2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:11.828317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-73d20ddc-93fc-4feb-8aee-a5fc7e68c0a2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:11.835058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73d20ddc-93fc-4feb-8aee-a5fc7e68c0a2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:11.835575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73d20ddc-93fc-4feb-8aee-a5fc7e68c0a2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:11.836029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73d20ddc-93fc-4feb-8aee-a5fc7e68c0a2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:11.836722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73d20ddc-93fc-4feb-8aee-a5fc7e68c0a2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:11.837181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73d20ddc-93fc-4feb-8aee-a5fc7e68c0a2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:11.837612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-73d20ddc-93fc-4feb-8aee-a5fc7e68c0a2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:11.970885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-73d20ddc-93fc-4feb-8aee-a5fc7e68c0a2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:11.978592 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-73d20ddc-93fc-4feb-8aee-a5fc7e68c0a2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1697 microversion: 2.1 time: 0.155956 Aug 27 05:44:11.979188 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3537/7064] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:11 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:13.000445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4c3f837-88f3-4fad-8359-67187a61eec5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:13.001079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4c3f837-88f3-4fad-8359-67187a61eec5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:13.007947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c3f837-88f3-4fad-8359-67187a61eec5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:13.008487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c3f837-88f3-4fad-8359-67187a61eec5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:13.008947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c3f837-88f3-4fad-8359-67187a61eec5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:13.009667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c3f837-88f3-4fad-8359-67187a61eec5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:13.010147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c3f837-88f3-4fad-8359-67187a61eec5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:13.010590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c3f837-88f3-4fad-8359-67187a61eec5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:13.146048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b4c3f837-88f3-4fad-8359-67187a61eec5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:13.153935 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4c3f837-88f3-4fad-8359-67187a61eec5 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1697 microversion: 2.1 time: 0.158617 Aug 27 05:44:13.154504 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3528/7065] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:12 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:14.178797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6166b54d-5fb8-495c-b63b-536dc670917a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:14.180209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6166b54d-5fb8-495c-b63b-536dc670917a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:14.189337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6166b54d-5fb8-495c-b63b-536dc670917a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:14.189832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6166b54d-5fb8-495c-b63b-536dc670917a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:14.190268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6166b54d-5fb8-495c-b63b-536dc670917a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:14.190975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6166b54d-5fb8-495c-b63b-536dc670917a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:14.191460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6166b54d-5fb8-495c-b63b-536dc670917a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:14.191892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6166b54d-5fb8-495c-b63b-536dc670917a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:14.331175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6166b54d-5fb8-495c-b63b-536dc670917a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:14.339446 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6166b54d-5fb8-495c-b63b-536dc670917a tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1682 microversion: 2.1 time: 0.165355 Aug 27 05:44:14.340021 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3538/7066] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:14 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:44:14.565742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ff176402-697f-486c-a923-2d15774a0ce8 req-fac836c4-da99-4930-9c15-e569ee5e94bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94d64d3-3692-46df-ad2e-1e1628f9aa14", "name": "network-vif-unplugged", "status": "completed", "tag": "be539f15-a561-4327-bc5e-80a93bb5ba56"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:44:14.575491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ff176402-697f-486c-a923-2d15774a0ce8 req-fac836c4-da99-4930-9c15-e569ee5e94bb service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:14.576394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ff176402-697f-486c-a923-2d15774a0ce8 req-fac836c4-da99-4930-9c15-e569ee5e94bb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:14.576890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ff176402-697f-486c-a923-2d15774a0ce8 req-fac836c4-da99-4930-9c15-e569ee5e94bb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:14.590741 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ff176402-697f-486c-a923-2d15774a0ce8 req-fac836c4-da99-4930-9c15-e569ee5e94bb service nova] Creating event network-vif-unplugged:be539f15-a561-4327-bc5e-80a93bb5ba56 for instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 on n-h1-820368-35 Aug 27 05:44:14.597050 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ff176402-697f-486c-a923-2d15774a0ce8 req-fac836c4-da99-4930-9c15-e569ee5e94bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106306 Aug 27 05:44:14.597867 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3529/7067] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:44:16.613364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-304f0be3-9f1b-4066-a3c5-8247be1d9d0a req-d8af1acd-5345-4fc2-b143-78195d2debaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94d64d3-3692-46df-ad2e-1e1628f9aa14", "name": "network-vif-plugged", "status": "completed", "tag": "be539f15-a561-4327-bc5e-80a93bb5ba56"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:44:16.623865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-304f0be3-9f1b-4066-a3c5-8247be1d9d0a req-d8af1acd-5345-4fc2-b143-78195d2debaa service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:16.624360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-304f0be3-9f1b-4066-a3c5-8247be1d9d0a req-d8af1acd-5345-4fc2-b143-78195d2debaa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:16.624803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-304f0be3-9f1b-4066-a3c5-8247be1d9d0a req-d8af1acd-5345-4fc2-b143-78195d2debaa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:16.636222 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-304f0be3-9f1b-4066-a3c5-8247be1d9d0a req-d8af1acd-5345-4fc2-b143-78195d2debaa service nova] Creating event network-vif-plugged:be539f15-a561-4327-bc5e-80a93bb5ba56 for instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 on n-h1-820368-35 Aug 27 05:44:16.642223 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-304f0be3-9f1b-4066-a3c5-8247be1d9d0a req-d8af1acd-5345-4fc2-b143-78195d2debaa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032578 Aug 27 05:44:16.642868 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3539/7068] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:44:54.599080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3bb3f65a-c36c-4caa-bbb0-909d4adbad0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:44:54.601545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3bb3f65a-c36c-4caa-bbb0-909d4adbad0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:54.604084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=26 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:54.604752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:54.611881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bb3f65a-c36c-4caa-bbb0-909d4adbad0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:54.612394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bb3f65a-c36c-4caa-bbb0-909d4adbad0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:54.612882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bb3f65a-c36c-4caa-bbb0-909d4adbad0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:54.613599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bb3f65a-c36c-4caa-bbb0-909d4adbad0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:54.614068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bb3f65a-c36c-4caa-bbb0-909d4adbad0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:54.614510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3bb3f65a-c36c-4caa-bbb0-909d4adbad0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:54.690364 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3bb3f65a-c36c-4caa-bbb0-909d4adbad0c tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "POST /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14/action" status: 200 len: 24571 microversion: 2.1 time: 0.095885 Aug 27 05:44:54.691492 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3530/7069] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:44:54 2022] POST /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14/action => generated 24571 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:45:35.037765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=22 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:35.042720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=62 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:35.043627 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:45:35.043799 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 05:45:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 (ip 10.222.0.58) !!! Aug 27 05:45:35.044981 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:45:35.046065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2e97907d-ad21-49a6-a97b-bb092753a1a3 req-ac53d4bb-64ea-4d71-9a54-e0e057329011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94d64d3-3692-46df-ad2e-1e1628f9aa14", "tag": "be539f15-a561-4327-bc5e-80a93bb5ba56"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:45:35.047315 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 05:45:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 (ip 10.222.0.58) !!! Aug 27 05:45:35.055233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:35.055233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:35.056193 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:45:35.056337 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 05:45:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Aug 27 05:45:35.069928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2e97907d-ad21-49a6-a97b-bb092753a1a3 req-ac53d4bb-64ea-4d71-9a54-e0e057329011 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:35.070697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2e97907d-ad21-49a6-a97b-bb092753a1a3 req-ac53d4bb-64ea-4d71-9a54-e0e057329011 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:35.071171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2e97907d-ad21-49a6-a97b-bb092753a1a3 req-ac53d4bb-64ea-4d71-9a54-e0e057329011 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:35.071805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-099769d7-0451-4c46-8382-fd161fa987d6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:35.073116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-099769d7-0451-4c46-8382-fd161fa987d6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:35.082990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-099769d7-0451-4c46-8382-fd161fa987d6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:35.083333 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2e97907d-ad21-49a6-a97b-bb092753a1a3 req-ac53d4bb-64ea-4d71-9a54-e0e057329011 service nova] Creating event network-changed:be539f15-a561-4327-bc5e-80a93bb5ba56 for instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 on n-h1-820368-35 Aug 27 05:45:35.083743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-099769d7-0451-4c46-8382-fd161fa987d6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:35.084284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-099769d7-0451-4c46-8382-fd161fa987d6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:35.085080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-099769d7-0451-4c46-8382-fd161fa987d6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:35.085619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-099769d7-0451-4c46-8382-fd161fa987d6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:35.086133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-099769d7-0451-4c46-8382-fd161fa987d6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:35.088778 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2e97907d-ad21-49a6-a97b-bb092753a1a3 req-ac53d4bb-64ea-4d71-9a54-e0e057329011 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053724 Aug 27 05:45:35.089376 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3531/7070] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:45:35.115118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-099769d7-0451-4c46-8382-fd161fa987d6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:45:35.200426 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-099769d7-0451-4c46-8382-fd161fa987d6 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 204 len: 0 microversion: 2.1 time: 0.168309 Aug 27 05:45:35.203211 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3540/7071] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:45:35 2022] DELETE /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:45:35.211403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9a856842-536e-4e95-bf36-46d4f3b9e7ed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:35.212396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9a856842-536e-4e95-bf36-46d4f3b9e7ed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:35.219832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a856842-536e-4e95-bf36-46d4f3b9e7ed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:35.220348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a856842-536e-4e95-bf36-46d4f3b9e7ed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:35.220808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a856842-536e-4e95-bf36-46d4f3b9e7ed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:35.221763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a856842-536e-4e95-bf36-46d4f3b9e7ed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:35.222257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a856842-536e-4e95-bf36-46d4f3b9e7ed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:35.222741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9a856842-536e-4e95-bf36-46d4f3b9e7ed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:35.383032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9a856842-536e-4e95-bf36-46d4f3b9e7ed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:35.391344 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9a856842-536e-4e95-bf36-46d4f3b9e7ed tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1569 microversion: 2.1 time: 0.184951 Aug 27 05:45:35.391922 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3532/7072] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:35 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:36.414471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ac0c94b4-1c39-409d-b421-db37b97f3b34 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:36.415223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ac0c94b4-1c39-409d-b421-db37b97f3b34 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:36.422377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac0c94b4-1c39-409d-b421-db37b97f3b34 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:36.422875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac0c94b4-1c39-409d-b421-db37b97f3b34 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:36.423352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac0c94b4-1c39-409d-b421-db37b97f3b34 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:36.424069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac0c94b4-1c39-409d-b421-db37b97f3b34 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:36.424528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac0c94b4-1c39-409d-b421-db37b97f3b34 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:36.424958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac0c94b4-1c39-409d-b421-db37b97f3b34 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:36.986177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ac0c94b4-1c39-409d-b421-db37b97f3b34 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:36.995312 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ac0c94b4-1c39-409d-b421-db37b97f3b34 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1569 microversion: 2.1 time: 0.585153 Aug 27 05:45:37.007260 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3541/7073] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:36 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1569 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:37.640551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-77ba35ce-0894-4a7e-ba60-cde5cf4e1ab3 req-4068573a-cf98-4b3b-a648-e0858673c5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94d64d3-3692-46df-ad2e-1e1628f9aa14", "name": "network-vif-deleted", "tag": "be539f15-a561-4327-bc5e-80a93bb5ba56"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:45:37.650745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-77ba35ce-0894-4a7e-ba60-cde5cf4e1ab3 req-4068573a-cf98-4b3b-a648-e0858673c5b9 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:37.651306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-77ba35ce-0894-4a7e-ba60-cde5cf4e1ab3 req-4068573a-cf98-4b3b-a648-e0858673c5b9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:37.651711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-77ba35ce-0894-4a7e-ba60-cde5cf4e1ab3 req-4068573a-cf98-4b3b-a648-e0858673c5b9 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:37.663800 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-77ba35ce-0894-4a7e-ba60-cde5cf4e1ab3 req-4068573a-cf98-4b3b-a648-e0858673c5b9 service nova] Creating event network-vif-deleted:be539f15-a561-4327-bc5e-80a93bb5ba56 for instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 on n-h1-820368-35 Aug 27 05:45:37.671410 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-77ba35ce-0894-4a7e-ba60-cde5cf4e1ab3 req-4068573a-cf98-4b3b-a648-e0858673c5b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111596 Aug 27 05:45:37.672257 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3533/7074] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:45:38.016679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:38.017509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:38.029215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:38.033294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:38.034253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:38.035997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:38.036689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:38.037199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:38.077314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:38.078045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:38.078684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:38.079320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lazy-loading 'fault' on Instance uuid a94d64d3-3692-46df-ad2e-1e1628f9aa14 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:45:38.129233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30f8e6a45046dfb2a9325ebd45e99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de208d7d0c4d4da1aff858285e6a08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:38.140081 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a141157c-191f-4559-b6db-0cff3b5de46f tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 200 len: 1356 microversion: 2.1 time: 0.127349 Aug 27 05:45:38.140687 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3542/7075] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:38 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 1356 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:39.163854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:39.164588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] [instance: a94d64d3-3692-46df-ad2e-1e1628f9aa14] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:39.171351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:39.171881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:39.172343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:39.173072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:39.173574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:39.174079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:39.187751 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] HTTP exception thrown: Instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 could not be found. Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Request method failure captured: Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 HTTP/1.1 Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCaycezwqVmI0SZtPDV6qQlpX2VkCFbV20Ge8JYrlntpSze_Q6CtDAirS7DSwwi9Bx81jXYcj_axSxQQoQpi7cI0bbJzLcATyBPqL779ERfMVzfXIEoodWpuViXpjJreCVt3Fb6SMBw2DwmxmRkxPcLcOBSVTt0BDw_-4gekJ_BBO45k Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: de208d7d0c4d4da1aff858285e6a08ea Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de208d7d0c4d4da1aff858285e6a08ea", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de208d7d0c4d4da1aff858285e6a08ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: de208d7d0c4d4da1aff858285e6a08ea Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1874342116 Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestNetworkAdvancedServerOps-1874342116-project Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 9d30f8e6a45046dfb2a9325ebd45e99a Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1874342116-project Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 could not be found. Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'a94d64d3-3692-46df-ad2e-1e1628f9aa14'} Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 could not be found. Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 could not be found. Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:45:39.189416 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:45:39.193979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:45:39.193979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:45:39.193979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:45:39.193979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:45:39.193979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:45:39.193979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:45:39.193979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 could not be found. Aug 27 05:45:39.193979 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:45:39.193979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Returning 404 to user: Instance a94d64d3-3692-46df-ad2e-1e1628f9aa14 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:45:39.193979 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1cffa9df-96c2-4822-a8fc-eaddf04f6dd2 tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14" status: 404 len: 111 microversion: 2.1 time: 0.032594 Aug 27 05:45:39.193979 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3534/7076] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:39 2022] GET /compute/v2.1/servers/a94d64d3-3692-46df-ad2e-1e1628f9aa14 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:45:42.312784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce38f8e3-603a-4899-a97e-7acb199387dc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] Calling method '.version_select at 0x7fb5654ccee0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:42.358020 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce38f8e3-603a-4899-a97e-7acb199387dc tempest-TestNetworkAdvancedServerOps-1874342116 tempest-TestNetworkAdvancedServerOps-1874342116-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-344784418" status: 202 len: 0 microversion: 2.1 time: 0.052094 Aug 27 05:45:42.358657 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3543/7077] 10.222.0.58 () {58 vars in 1281 bytes} [Sat Aug 27 05:45:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-344784418 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:45:54.738240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:54.739187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=12 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:54.865283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1175434673", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:45:54.930789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] validate_networks() for None {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:45:55.123968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:45:55.124415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:45:55.124909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:45:55.125338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:45:55.125772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:45:55.135498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:55.136030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:55.136488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:55.137241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:55.137717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:55.138163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:55.156047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Getting quotas for project 936a88225c474a17adfceba23f42c438. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:45:55.161919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Getting quotas for user 380f19347dd84fb58ee82ea4134d05de and project 936a88225c474a17adfceba23f42c438. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:45:55.175815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:45:55.178166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:45:55.224355 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e89d39cd-cfbb-4203-8e34-4a47696ceb42 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491581 Aug 27 05:45:55.225018 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3535/7078] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:45:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:45:55.237616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b58069b1-9109-4dfd-aaef-8264a95c740f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:55.238898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b58069b1-9109-4dfd-aaef-8264a95c740f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:55.242743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:55.243419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:55.315009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b58069b1-9109-4dfd-aaef-8264a95c740f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:55.318977 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b58069b1-9109-4dfd-aaef-8264a95c740f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1222 microversion: 2.1 time: 0.085217 Aug 27 05:45:55.319598 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3544/7079] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:55 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:56.340979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b9355329-cd08-47b8-b60f-fa53ea2dcc13 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:56.341595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b9355329-cd08-47b8-b60f-fa53ea2dcc13 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:56.349674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9355329-cd08-47b8-b60f-fa53ea2dcc13 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:56.350197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9355329-cd08-47b8-b60f-fa53ea2dcc13 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:56.350659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9355329-cd08-47b8-b60f-fa53ea2dcc13 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:56.351415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9355329-cd08-47b8-b60f-fa53ea2dcc13 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:56.351897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9355329-cd08-47b8-b60f-fa53ea2dcc13 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:56.352344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b9355329-cd08-47b8-b60f-fa53ea2dcc13 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:56.416819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b9355329-cd08-47b8-b60f-fa53ea2dcc13 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:56.425068 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b9355329-cd08-47b8-b60f-fa53ea2dcc13 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1274 microversion: 2.1 time: 0.089127 Aug 27 05:45:56.425776 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3536/7080] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:56 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:57.447879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-50a9b863-6581-4989-a153-da57e2c4b2e4 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:57.448500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-50a9b863-6581-4989-a153-da57e2c4b2e4 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:57.457836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50a9b863-6581-4989-a153-da57e2c4b2e4 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:57.458635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50a9b863-6581-4989-a153-da57e2c4b2e4 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:57.459071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50a9b863-6581-4989-a153-da57e2c4b2e4 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:57.459832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50a9b863-6581-4989-a153-da57e2c4b2e4 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:57.460363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50a9b863-6581-4989-a153-da57e2c4b2e4 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:57.460795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50a9b863-6581-4989-a153-da57e2c4b2e4 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:57.619699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-50a9b863-6581-4989-a153-da57e2c4b2e4 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:57.628451 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-50a9b863-6581-4989-a153-da57e2c4b2e4 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1322 microversion: 2.1 time: 0.184575 Aug 27 05:45:57.629220 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3545/7081] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:57 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:58.169744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-70b05c6f-cbe7-4303-9ef0-df6424823131 req-20fd04e6-b692-439c-b925-349fa5649622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e4bfec-a627-44be-86fe-fa0ec0f09394", "tag": "b7fa41c8-44ff-4b78-906f-3cc11ccfed9e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:45:58.183943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-70b05c6f-cbe7-4303-9ef0-df6424823131 req-20fd04e6-b692-439c-b925-349fa5649622 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:58.184721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-70b05c6f-cbe7-4303-9ef0-df6424823131 req-20fd04e6-b692-439c-b925-349fa5649622 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:58.185378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-70b05c6f-cbe7-4303-9ef0-df6424823131 req-20fd04e6-b692-439c-b925-349fa5649622 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:58.200195 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-70b05c6f-cbe7-4303-9ef0-df6424823131 req-20fd04e6-b692-439c-b925-349fa5649622 service nova] Creating event network-changed:b7fa41c8-44ff-4b78-906f-3cc11ccfed9e for instance 53e4bfec-a627-44be-86fe-fa0ec0f09394 on n-h1-820368-35 Aug 27 05:45:58.205839 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-70b05c6f-cbe7-4303-9ef0-df6424823131 req-20fd04e6-b692-439c-b925-349fa5649622 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039942 Aug 27 05:45:58.207438 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3537/7082] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:45:58.650555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6c325b0d-0fa8-4e59-b1c8-0d78f9d09c08 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:58.651191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6c325b0d-0fa8-4e59-b1c8-0d78f9d09c08 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:58.658025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c325b0d-0fa8-4e59-b1c8-0d78f9d09c08 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:58.658515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c325b0d-0fa8-4e59-b1c8-0d78f9d09c08 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:58.658955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c325b0d-0fa8-4e59-b1c8-0d78f9d09c08 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:58.660035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c325b0d-0fa8-4e59-b1c8-0d78f9d09c08 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:58.660497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c325b0d-0fa8-4e59-b1c8-0d78f9d09c08 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:58.660928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6c325b0d-0fa8-4e59-b1c8-0d78f9d09c08 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:58.803459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6c325b0d-0fa8-4e59-b1c8-0d78f9d09c08 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:58.811361 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6c325b0d-0fa8-4e59-b1c8-0d78f9d09c08 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1322 microversion: 2.1 time: 0.164807 Aug 27 05:45:58.811943 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3546/7083] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:58 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:45:59.834896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e9ab15e3-7535-42bb-a6c6-264e9c526c0a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:59.835648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e9ab15e3-7535-42bb-a6c6-264e9c526c0a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:59.842251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9ab15e3-7535-42bb-a6c6-264e9c526c0a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:59.842771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9ab15e3-7535-42bb-a6c6-264e9c526c0a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:59.843266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9ab15e3-7535-42bb-a6c6-264e9c526c0a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:59.844004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9ab15e3-7535-42bb-a6c6-264e9c526c0a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:59.844479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9ab15e3-7535-42bb-a6c6-264e9c526c0a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:59.844929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e9ab15e3-7535-42bb-a6c6-264e9c526c0a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:59.992256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e9ab15e3-7535-42bb-a6c6-264e9c526c0a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:00.000423 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e9ab15e3-7535-42bb-a6c6-264e9c526c0a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1322 microversion: 2.1 time: 0.171282 Aug 27 05:46:00.001034 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3538/7084] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:59 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:01.021889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1fa1647d-ea8d-43fb-8c70-dec1f6ca819e tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:01.022507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1fa1647d-ea8d-43fb-8c70-dec1f6ca819e tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:01.029681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fa1647d-ea8d-43fb-8c70-dec1f6ca819e tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:01.030180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fa1647d-ea8d-43fb-8c70-dec1f6ca819e tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:01.030625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fa1647d-ea8d-43fb-8c70-dec1f6ca819e tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:01.031540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fa1647d-ea8d-43fb-8c70-dec1f6ca819e tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:01.032350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fa1647d-ea8d-43fb-8c70-dec1f6ca819e tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:01.032350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1fa1647d-ea8d-43fb-8c70-dec1f6ca819e tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:01.176442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1fa1647d-ea8d-43fb-8c70-dec1f6ca819e tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:01.184575 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1fa1647d-ea8d-43fb-8c70-dec1f6ca819e tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1322 microversion: 2.1 time: 0.166595 Aug 27 05:46:01.185387 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3547/7085] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:01 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:02.205634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-24fb9473-0526-4d5a-a28a-49eb988fb555 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:02.206263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-24fb9473-0526-4d5a-a28a-49eb988fb555 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:02.213036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb9473-0526-4d5a-a28a-49eb988fb555 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:02.213526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb9473-0526-4d5a-a28a-49eb988fb555 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:02.213974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb9473-0526-4d5a-a28a-49eb988fb555 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:02.214703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb9473-0526-4d5a-a28a-49eb988fb555 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:02.215201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb9473-0526-4d5a-a28a-49eb988fb555 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:02.215632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-24fb9473-0526-4d5a-a28a-49eb988fb555 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:02.343538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-24fb9473-0526-4d5a-a28a-49eb988fb555 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:02.351655 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-24fb9473-0526-4d5a-a28a-49eb988fb555 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1322 microversion: 2.1 time: 0.149932 Aug 27 05:46:02.352226 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3539/7086] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:02 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:02.967378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-2cf4a003-8072-4ffc-810d-c2ef301597bf req-ca06926d-293e-4b5f-bdf3-b34af0d62e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e4bfec-a627-44be-86fe-fa0ec0f09394", "name": "network-vif-plugged", "status": "completed", "tag": "b7fa41c8-44ff-4b78-906f-3cc11ccfed9e"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:02.979969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2cf4a003-8072-4ffc-810d-c2ef301597bf req-ca06926d-293e-4b5f-bdf3-b34af0d62e7b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:02.980409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2cf4a003-8072-4ffc-810d-c2ef301597bf req-ca06926d-293e-4b5f-bdf3-b34af0d62e7b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:02.981551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2cf4a003-8072-4ffc-810d-c2ef301597bf req-ca06926d-293e-4b5f-bdf3-b34af0d62e7b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:02.992870 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-2cf4a003-8072-4ffc-810d-c2ef301597bf req-ca06926d-293e-4b5f-bdf3-b34af0d62e7b service nova] Creating event network-vif-plugged:b7fa41c8-44ff-4b78-906f-3cc11ccfed9e for instance 53e4bfec-a627-44be-86fe-fa0ec0f09394 on n-h1-820368-35 Aug 27 05:46:02.998584 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-2cf4a003-8072-4ffc-810d-c2ef301597bf req-ca06926d-293e-4b5f-bdf3-b34af0d62e7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034931 Aug 27 05:46:02.999216 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3548/7087] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:46:03.372868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f05683ef-f4dc-40c1-9b6d-21c228b07170 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:03.373426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f05683ef-f4dc-40c1-9b6d-21c228b07170 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:03.380844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f05683ef-f4dc-40c1-9b6d-21c228b07170 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:03.381353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f05683ef-f4dc-40c1-9b6d-21c228b07170 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:03.381813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f05683ef-f4dc-40c1-9b6d-21c228b07170 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:03.382532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f05683ef-f4dc-40c1-9b6d-21c228b07170 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:03.383011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f05683ef-f4dc-40c1-9b6d-21c228b07170 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:03.383487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f05683ef-f4dc-40c1-9b6d-21c228b07170 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:03.523577 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f05683ef-f4dc-40c1-9b6d-21c228b07170 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:03.531252 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f05683ef-f4dc-40c1-9b6d-21c228b07170 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1322 microversion: 2.1 time: 0.162421 Aug 27 05:46:03.531829 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3540/7088] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:03 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:04.552997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-16512e5b-7bd7-467b-b6fe-df311c10d4f9 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:04.553727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-16512e5b-7bd7-467b-b6fe-df311c10d4f9 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:04.560657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16512e5b-7bd7-467b-b6fe-df311c10d4f9 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:04.561145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16512e5b-7bd7-467b-b6fe-df311c10d4f9 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:04.561587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16512e5b-7bd7-467b-b6fe-df311c10d4f9 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:04.562291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16512e5b-7bd7-467b-b6fe-df311c10d4f9 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:04.562780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16512e5b-7bd7-467b-b6fe-df311c10d4f9 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:04.563239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16512e5b-7bd7-467b-b6fe-df311c10d4f9 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:04.703042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-16512e5b-7bd7-467b-b6fe-df311c10d4f9 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:04.711943 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-16512e5b-7bd7-467b-b6fe-df311c10d4f9 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1322 microversion: 2.1 time: 0.163254 Aug 27 05:46:04.712536 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3549/7089] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:04 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:05.732542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d5277a74-49b6-45b2-bdb2-df4e64e7fa15 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:05.733164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d5277a74-49b6-45b2-bdb2-df4e64e7fa15 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:05.736170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:05.736866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:05.743225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5277a74-49b6-45b2-bdb2-df4e64e7fa15 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:05.743765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5277a74-49b6-45b2-bdb2-df4e64e7fa15 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:05.744220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5277a74-49b6-45b2-bdb2-df4e64e7fa15 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:05.744939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5277a74-49b6-45b2-bdb2-df4e64e7fa15 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:05.745405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5277a74-49b6-45b2-bdb2-df4e64e7fa15 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:05.745861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5277a74-49b6-45b2-bdb2-df4e64e7fa15 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:05.881859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d5277a74-49b6-45b2-bdb2-df4e64e7fa15 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:05.889745 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d5277a74-49b6-45b2-bdb2-df4e64e7fa15 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1472 microversion: 2.1 time: 0.161164 Aug 27 05:46:05.890325 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3541/7090] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:05 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:05.913702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:05.971699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d6bd6d4-68da-4f0d-a33c-9e3a3bee8fc8 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Calling method '.version_select at 0x7fb565436d30>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:06.039322 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d6bd6d4-68da-4f0d-a33c-9e3a3bee8fc8 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/167c6b34e726465794af2eddfd2adb6d" status: 200 len: 371 microversion: 2.1 time: 0.130581 Aug 27 05:46:06.039884 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3550/7091] 10.222.0.58 () {58 vars in 1242 bytes} [Sat Aug 27 05:46:05 2022] GET /compute/v2.1/os-quota-sets/167c6b34e726465794af2eddfd2adb6d => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:06.051943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6504d9f0-2f13-4513-a721-c45bb9682483 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-616358551", "id": 654293457, "os-flavor-access:is_public": "True"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:06.072154 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6504d9f0-2f13-4513-a721-c45bb9682483 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.024262 Aug 27 05:46:06.072653 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3542/7092] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:46:06 2022] POST /compute/v2.1/flavors => generated 434 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:06.084560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "654293457"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:06.086924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:06.093113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.093600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.094041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:06.094747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.095242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.095679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:06.279631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8fabb0d6d7e642d9b6b4af12541c791d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167c6b34e726465794af2eddfd2adb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:06.286926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-616358551 {{(pid=128548) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:46:06.293500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.293987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.294429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:06.295189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.295652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.296089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:06.317701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Getting quotas for project 936a88225c474a17adfceba23f42c438. Resources: {'cores', 'ram'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:46:06.322703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Getting quotas for user 380f19347dd84fb58ee82ea4134d05de and project 936a88225c474a17adfceba23f42c438. Resources: {'cores', 'ram'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:46:06.334498 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.compute.api [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] ram quota exceeded for 167c6b34e726465794af2eddfd2adb6d, tried to resize instance. Aug 27 05:46:06.335046 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Request method failure captured: Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394/action HTTP/1.1 Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 38 Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCa-SkYjSIIt08Nq3hK7-OPmtr0qhM5Uu4v9Pm_lLoKr7SDrOEtKXQj_oaRzoofJLULUKTYabWloJiun5j1vtjoZ0Tl6uPDzUisx0-qC416dji1BuL4NrDKdxFjhoM2woFOfxp-9XWaX48dD_q_ZAFroc-XtLVNEcs3hpvFxNw29DKp4 Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 167c6b34e726465794af2eddfd2adb6d Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-158542223 Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader,admin Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader,admin Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_167c6b34e726465794af2eddfd2adb6d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/167c6b34e726465794af2eddfd2adb6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/167c6b34e726465794af2eddfd2adb6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/167c6b34e726465794af2eddfd2adb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersAdminNegativeTestJSON-158542223 Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 167c6b34e726465794af2eddfd2adb6d Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-158542223 Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersAdminNegativeTestJSON-158542223-project-admin Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 8fabb0d6d7e642d9b6b4af12541c791d Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersAdminNegativeTestJSON-158542223-project-admin Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: {"resize": {"flavorRef": "654293457"}} Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '53e4bfec-a627-44be-86fe-fa0ec0f09394', 'body': {'resize': {'flavorRef': '654293457'}}} Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1076, in _resize Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:46:06.350086 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1162, in _action_resize Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1079, in _resize Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9b9054f5-96d1-4382-a822-954afdbd2812 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394/action" status: 403 len: 118 microversion: 2.1 time: 0.271154 Aug 27 05:46:06.354041 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3551/7093] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:46:06 2022] POST /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394/action => generated 118 bytes in 272 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:46:06.361232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-90a94c16-9135-4d6f-872d-ffbf141e0afe tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:06.378279 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-90a94c16-9135-4d6f-872d-ffbf141e0afe tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/654293457" status: 202 len: 0 microversion: 2.1 time: 0.020780 Aug 27 05:46:06.378860 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3543/7094] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 05:46:06 2022] DELETE /compute/v2.1/flavors/654293457 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:46:06.386634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2945c403-fbf6-4835-b4f6-03f1c2827527 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:06.406555 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2945c403-fbf6-4835-b4f6-03f1c2827527 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023542 Aug 27 05:46:06.407380 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3552/7095] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 05:46:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:46:06.427853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9ebd398a-35ae-44fe-8930-d1f5ceb1ebaf tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Calling method '.version_select at 0x7fb5648f4e50>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:06.500941 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9ebd398a-35ae-44fe-8930-d1f5ceb1ebaf tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/167c6b34e726465794af2eddfd2adb6d" status: 200 len: 371 microversion: 2.1 time: 0.077336 Aug 27 05:46:06.501529 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3544/7096] 10.222.0.58 () {58 vars in 1242 bytes} [Sat Aug 27 05:46:06 2022] GET /compute/v2.1/os-quota-sets/167c6b34e726465794af2eddfd2adb6d => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:06.512769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-67c420cb-352a-4417-bd7b-f7100f4e5f61 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-532167424", "id": 589919740, "os-flavor-access:is_public": "True"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:06.530550 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-67c420cb-352a-4417-bd7b-f7100f4e5f61 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021450 Aug 27 05:46:06.531148 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3553/7097] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:46:06 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:06.543625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "589919740"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:06.545997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:06.552127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.552625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.553081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:06.553786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.554254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.554693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:06.688257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8fabb0d6d7e642d9b6b4af12541c791d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167c6b34e726465794af2eddfd2adb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:06.695063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-532167424 {{(pid=128547) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:46:06.701779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.702276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.702733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:06.703506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.703980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.704425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:06.727285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Getting quotas for project 936a88225c474a17adfceba23f42c438. Resources: {'cores', 'ram'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:46:06.732750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Getting quotas for user 380f19347dd84fb58ee82ea4134d05de and project 936a88225c474a17adfceba23f42c438. Resources: {'cores', 'ram'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:46:06.751371 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.compute.api [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] cores quota exceeded for 167c6b34e726465794af2eddfd2adb6d, tried to resize instance. Aug 27 05:46:06.751936 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Request method failure captured: Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394/action HTTP/1.1 Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 38 Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCa-SkYjSIIt08Nq3hK7-OPmtr0qhM5Uu4v9Pm_lLoKr7SDrOEtKXQj_oaRzoofJLULUKTYabWloJiun5j1vtjoZ0Tl6uPDzUisx0-qC416dji1BuL4NrDKdxFjhoM2woFOfxp-9XWaX48dD_q_ZAFroc-XtLVNEcs3hpvFxNw29DKp4 Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 167c6b34e726465794af2eddfd2adb6d Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-158542223 Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader,admin Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader,admin Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_167c6b34e726465794af2eddfd2adb6d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/167c6b34e726465794af2eddfd2adb6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/167c6b34e726465794af2eddfd2adb6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/167c6b34e726465794af2eddfd2adb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersAdminNegativeTestJSON-158542223 Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 167c6b34e726465794af2eddfd2adb6d Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-158542223 Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersAdminNegativeTestJSON-158542223-project-admin Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 8fabb0d6d7e642d9b6b4af12541c791d Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersAdminNegativeTestJSON-158542223-project-admin Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: {"resize": {"flavorRef": "589919740"}} Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '53e4bfec-a627-44be-86fe-fa0ec0f09394', 'body': {'resize': {'flavorRef': '589919740'}}} Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1076, in _resize Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:46:06.754059 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1162, in _action_resize Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1079, in _resize Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3b681c94-6964-453a-8a93-85057d73bd74 tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394/action" status: 403 len: 113 microversion: 2.1 time: 0.215876 Aug 27 05:46:06.758199 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3545/7098] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:46:06 2022] POST /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394/action => generated 113 bytes in 217 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:46:06.764297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-13883c18-7d94-48ef-903c-f0c79c280f6b tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:06.781226 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-13883c18-7d94-48ef-903c-f0c79c280f6b tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/589919740" status: 202 len: 0 microversion: 2.1 time: 0.020704 Aug 27 05:46:06.781792 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3554/7099] 10.222.0.58 () {58 vars in 1158 bytes} [Sat Aug 27 05:46:06 2022] DELETE /compute/v2.1/flavors/589919740 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:46:06.790675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-263116f7-3355-49fc-abbd-13639b3f829b tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:06.811754 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-263116f7-3355-49fc-abbd-13639b3f829b tempest-ServersAdminNegativeTestJSON-158542223 tempest-ServersAdminNegativeTestJSON-158542223-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024747 Aug 27 05:46:06.812336 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3546/7100] 10.222.0.58 () {58 vars in 1146 bytes} [Sat Aug 27 05:46:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:06.832001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c2f2c992-c3e4-4b79-b059-66afa0f7747f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:06.832521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c2f2c992-c3e4-4b79-b059-66afa0f7747f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:06.838593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f2c992-c3e4-4b79-b059-66afa0f7747f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.839075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f2c992-c3e4-4b79-b059-66afa0f7747f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.839541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f2c992-c3e4-4b79-b059-66afa0f7747f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:06.840235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f2c992-c3e4-4b79-b059-66afa0f7747f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.840692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f2c992-c3e4-4b79-b059-66afa0f7747f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.841125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2f2c992-c3e4-4b79-b059-66afa0f7747f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:06.866882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c2f2c992-c3e4-4b79-b059-66afa0f7747f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:46:06.940178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c2f2c992-c3e4-4b79-b059-66afa0f7747f tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "DELETE /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 204 len: 0 microversion: 2.1 time: 0.111827 Aug 27 05:46:06.943845 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3555/7101] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:46:06 2022] DELETE /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:46:06.950426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ba72e9b5-a00c-4e78-acd2-c818bc677a9a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:06.951054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ba72e9b5-a00c-4e78-acd2-c818bc677a9a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:06.957137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba72e9b5-a00c-4e78-acd2-c818bc677a9a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.957711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba72e9b5-a00c-4e78-acd2-c818bc677a9a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.958325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba72e9b5-a00c-4e78-acd2-c818bc677a9a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:06.959365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba72e9b5-a00c-4e78-acd2-c818bc677a9a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:06.960025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba72e9b5-a00c-4e78-acd2-c818bc677a9a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:06.960633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ba72e9b5-a00c-4e78-acd2-c818bc677a9a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:07.095119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ba72e9b5-a00c-4e78-acd2-c818bc677a9a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:07.103267 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ba72e9b5-a00c-4e78-acd2-c818bc677a9a tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1478 microversion: 2.1 time: 0.158219 Aug 27 05:46:07.103828 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3547/7102] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:06 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1478 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:08.124877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d555951-8e48-4627-9488-63ed3b367900 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:08.125494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d555951-8e48-4627-9488-63ed3b367900 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:08.133227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d555951-8e48-4627-9488-63ed3b367900 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:08.133704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d555951-8e48-4627-9488-63ed3b367900 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:08.134180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d555951-8e48-4627-9488-63ed3b367900 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:08.134870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d555951-8e48-4627-9488-63ed3b367900 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:08.135349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d555951-8e48-4627-9488-63ed3b367900 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:08.135775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d555951-8e48-4627-9488-63ed3b367900 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:08.268344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d555951-8e48-4627-9488-63ed3b367900 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:08.276981 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d555951-8e48-4627-9488-63ed3b367900 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1478 microversion: 2.1 time: 0.156391 Aug 27 05:46:08.277727 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3556/7103] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:08 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1478 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:09.011062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3e4b48dc-7760-42da-bc36-32579af558b9 req-639adcc4-2598-41ec-a675-7943fb352a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e4bfec-a627-44be-86fe-fa0ec0f09394", "name": "network-vif-deleted", "tag": "b7fa41c8-44ff-4b78-906f-3cc11ccfed9e"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:09.024958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3e4b48dc-7760-42da-bc36-32579af558b9 req-639adcc4-2598-41ec-a675-7943fb352a2e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:09.025665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3e4b48dc-7760-42da-bc36-32579af558b9 req-639adcc4-2598-41ec-a675-7943fb352a2e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:09.026144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3e4b48dc-7760-42da-bc36-32579af558b9 req-639adcc4-2598-41ec-a675-7943fb352a2e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:09.040002 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-3e4b48dc-7760-42da-bc36-32579af558b9 req-639adcc4-2598-41ec-a675-7943fb352a2e service nova] Creating event network-vif-deleted:b7fa41c8-44ff-4b78-906f-3cc11ccfed9e for instance 53e4bfec-a627-44be-86fe-fa0ec0f09394 on n-h1-820368-35 Aug 27 05:46:09.046427 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3e4b48dc-7760-42da-bc36-32579af558b9 req-639adcc4-2598-41ec-a675-7943fb352a2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038975 Aug 27 05:46:09.047048 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3548/7104] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:09.299312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:09.299928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:09.307470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:09.307956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:09.308396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:09.309085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:09.309539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:09.309965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:09.341197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:09.341677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:09.342114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:09.342570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lazy-loading 'fault' on Instance uuid 53e4bfec-a627-44be-86fe-fa0ec0f09394 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:46:09.383500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '380f19347dd84fb58ee82ea4134d05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936a88225c474a17adfceba23f42c438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:09.391195 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-02985d12-4f01-4142-80a4-4c3c5cc24d89 tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 200 len: 1312 microversion: 2.1 time: 0.096042 Aug 27 05:46:09.391863 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3557/7105] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:09 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:10.413061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:10.413804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] [instance: 53e4bfec-a627-44be-86fe-fa0ec0f09394] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:10.420848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:10.421343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:10.421791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:10.422492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:10.422954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:10.423413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:10.437263 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] HTTP exception thrown: Instance 53e4bfec-a627-44be-86fe-fa0ec0f09394 could not be found. Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Request method failure captured: Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 HTTP/1.1 Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCa-SSANW4QaSKKizvhtx_dWnGMWJm4_OmTdCt4JfWOJcC_L5keApeInDKJJ4Fac6ze2GkD-c2zjPs4oJVNYzPbWnW_dIdcoht1p0ETs_YTGMvRBxmShnTtj1unBLMMMCGZLi_mImzF0KQ9enKLS34YcA1KSjgi5u_VDJZKRXzr8yHIQ Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 936a88225c474a17adfceba23f42c438 Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1674642469 Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_936a88225c474a17adfceba23f42c438", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/936a88225c474a17adfceba23f42c438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/936a88225c474a17adfceba23f42c438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/936a88225c474a17adfceba23f42c438"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1674642469 Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 936a88225c474a17adfceba23f42c438 Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1674642469 Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersAdminNegativeTestJSON-1674642469-project Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 380f19347dd84fb58ee82ea4134d05de Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1674642469-project Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 53e4bfec-a627-44be-86fe-fa0ec0f09394 could not be found. Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '53e4bfec-a627-44be-86fe-fa0ec0f09394'} Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e4bfec-a627-44be-86fe-fa0ec0f09394 could not be found. Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e4bfec-a627-44be-86fe-fa0ec0f09394 could not be found. Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:10.438904 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:10.443775 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:10.443775 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:10.443775 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:46:10.443775 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:46:10.443775 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:46:10.443775 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:46:10.443775 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e4bfec-a627-44be-86fe-fa0ec0f09394 could not be found. Aug 27 05:46:10.443775 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:46:10.443775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] Returning 404 to user: Instance 53e4bfec-a627-44be-86fe-fa0ec0f09394 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:46:10.443775 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd5c6297-6f66-44d4-a048-28a7b67f406b tempest-ServersAdminNegativeTestJSON-1674642469 tempest-ServersAdminNegativeTestJSON-1674642469-project] 10.222.0.58 "GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394" status: 404 len: 111 microversion: 2.1 time: 0.032104 Aug 27 05:46:10.443775 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3549/7106] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:10 2022] GET /compute/v2.1/servers/53e4bfec-a627-44be-86fe-fa0ec0f09394 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:46:16.544962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:16.545747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:16.668999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-429678371", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "663ffdc5-71b5-468d-a2dc-ba0fe80bac3b"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:16.730158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] validate_networks() for [('663ffdc5-71b5-468d-a2dc-ba0fe80bac3b', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:46:17.170087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:46:17.170523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:46:17.171005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:46:17.171619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:46:17.172042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:46:17.181712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:17.182210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:17.182654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:17.183491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:17.183957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:17.184391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:17.204001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Getting quotas for project 75367f1a874a4d79acbfce528b7e157b. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:46:17.209662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Getting quotas for user 6db0b98c3fa845bab761e25a09d285f8 and project 75367f1a874a4d79acbfce528b7e157b. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:46:17.222532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:46:17.224904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:46:17.272575 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d0a52d2-7da7-4b39-a5c6-d920681dbda0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732986 Aug 27 05:46:17.273612 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3558/7107] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:46:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:46:17.284699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-25cd911c-5539-42cc-a137-941be3eb9e2d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:17.285601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25cd911c-5539-42cc-a137-941be3eb9e2d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:17.290750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:17.291690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:17.349709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-25cd911c-5539-42cc-a137-941be3eb9e2d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:17.356767 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-25cd911c-5539-42cc-a137-941be3eb9e2d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1214 microversion: 2.1 time: 0.076059 Aug 27 05:46:17.357479 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3550/7108] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:17 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:18.379355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-728c610e-d0a1-47cf-bfde-e3bf272e80c4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:18.380025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-728c610e-d0a1-47cf-bfde-e3bf272e80c4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:18.386868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-728c610e-d0a1-47cf-bfde-e3bf272e80c4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:18.387452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-728c610e-d0a1-47cf-bfde-e3bf272e80c4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:18.387896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-728c610e-d0a1-47cf-bfde-e3bf272e80c4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:18.388611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-728c610e-d0a1-47cf-bfde-e3bf272e80c4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:18.389068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-728c610e-d0a1-47cf-bfde-e3bf272e80c4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:18.389500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-728c610e-d0a1-47cf-bfde-e3bf272e80c4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:18.454467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-728c610e-d0a1-47cf-bfde-e3bf272e80c4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:18.463641 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-728c610e-d0a1-47cf-bfde-e3bf272e80c4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1218 microversion: 2.1 time: 0.089653 Aug 27 05:46:18.464233 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3559/7109] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:18 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:19.484421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3f712dd8-8595-4e00-b4f4-32260288cd62 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:19.485762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3f712dd8-8595-4e00-b4f4-32260288cd62 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:19.495457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f712dd8-8595-4e00-b4f4-32260288cd62 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:19.497074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f712dd8-8595-4e00-b4f4-32260288cd62 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:19.497542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f712dd8-8595-4e00-b4f4-32260288cd62 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:19.498620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f712dd8-8595-4e00-b4f4-32260288cd62 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:19.499118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f712dd8-8595-4e00-b4f4-32260288cd62 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:19.499556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f712dd8-8595-4e00-b4f4-32260288cd62 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:19.578706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f712dd8-8595-4e00-b4f4-32260288cd62 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:19.588158 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3f712dd8-8595-4e00-b4f4-32260288cd62 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1274 microversion: 2.1 time: 0.107977 Aug 27 05:46:19.601965 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3551/7110] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:19 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:20.612192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-272051e7-6b43-4db1-bcdf-798e4944e62d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:20.612789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-272051e7-6b43-4db1-bcdf-798e4944e62d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:20.620786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-272051e7-6b43-4db1-bcdf-798e4944e62d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:20.621285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-272051e7-6b43-4db1-bcdf-798e4944e62d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:20.621730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-272051e7-6b43-4db1-bcdf-798e4944e62d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:20.622447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-272051e7-6b43-4db1-bcdf-798e4944e62d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:20.622908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-272051e7-6b43-4db1-bcdf-798e4944e62d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:20.623366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-272051e7-6b43-4db1-bcdf-798e4944e62d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:20.755872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-272051e7-6b43-4db1-bcdf-798e4944e62d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:20.776419 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-272051e7-6b43-4db1-bcdf-798e4944e62d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1314 microversion: 2.1 time: 0.170485 Aug 27 05:46:20.777766 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3560/7111] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:20 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:21.224190 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0695abf4-c7ca-47a2-8e64-d7e0ca500fd1 req-b3eaf6b4-7609-4d95-9ea6-c4521526a5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6635a2-16fd-455f-acfb-8885e6646681", "tag": "06094fcf-d724-4f87-96f2-106b3be0f045"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:21.235531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0695abf4-c7ca-47a2-8e64-d7e0ca500fd1 req-b3eaf6b4-7609-4d95-9ea6-c4521526a5d6 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:21.236055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0695abf4-c7ca-47a2-8e64-d7e0ca500fd1 req-b3eaf6b4-7609-4d95-9ea6-c4521526a5d6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:21.236501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0695abf4-c7ca-47a2-8e64-d7e0ca500fd1 req-b3eaf6b4-7609-4d95-9ea6-c4521526a5d6 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:21.247796 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0695abf4-c7ca-47a2-8e64-d7e0ca500fd1 req-b3eaf6b4-7609-4d95-9ea6-c4521526a5d6 service nova] Creating event network-changed:06094fcf-d724-4f87-96f2-106b3be0f045 for instance df6635a2-16fd-455f-acfb-8885e6646681 on n-h1-820368-35 Aug 27 05:46:21.252869 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0695abf4-c7ca-47a2-8e64-d7e0ca500fd1 req-b3eaf6b4-7609-4d95-9ea6-c4521526a5d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032670 Aug 27 05:46:21.253466 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3552/7112] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:21.798500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f8cfc1d5-3b8e-47e8-8089-82939f7ff911 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:21.799047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f8cfc1d5-3b8e-47e8-8089-82939f7ff911 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:21.806558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8cfc1d5-3b8e-47e8-8089-82939f7ff911 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:21.807048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8cfc1d5-3b8e-47e8-8089-82939f7ff911 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:21.807523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8cfc1d5-3b8e-47e8-8089-82939f7ff911 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:21.808242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8cfc1d5-3b8e-47e8-8089-82939f7ff911 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:21.808704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8cfc1d5-3b8e-47e8-8089-82939f7ff911 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:21.809138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f8cfc1d5-3b8e-47e8-8089-82939f7ff911 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:21.939602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f8cfc1d5-3b8e-47e8-8089-82939f7ff911 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:21.947385 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f8cfc1d5-3b8e-47e8-8089-82939f7ff911 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1314 microversion: 2.1 time: 0.152902 Aug 27 05:46:21.947967 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3561/7113] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:21 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:22.969569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-54f4f8af-0778-45a8-a9f5-6e245402c7e7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:22.970292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-54f4f8af-0778-45a8-a9f5-6e245402c7e7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:22.976558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f4f8af-0778-45a8-a9f5-6e245402c7e7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:22.977063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f4f8af-0778-45a8-a9f5-6e245402c7e7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:22.977519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f4f8af-0778-45a8-a9f5-6e245402c7e7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:22.978233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f4f8af-0778-45a8-a9f5-6e245402c7e7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:22.978701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f4f8af-0778-45a8-a9f5-6e245402c7e7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:22.979168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f4f8af-0778-45a8-a9f5-6e245402c7e7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:23.111419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-54f4f8af-0778-45a8-a9f5-6e245402c7e7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:23.119666 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-54f4f8af-0778-45a8-a9f5-6e245402c7e7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1314 microversion: 2.1 time: 0.155272 Aug 27 05:46:23.120248 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3553/7114] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:22 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:24.141890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f989f249-4e87-4d18-ae8c-3c9933e442ec tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:24.142518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f989f249-4e87-4d18-ae8c-3c9933e442ec tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:24.150565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f989f249-4e87-4d18-ae8c-3c9933e442ec tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:24.151060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f989f249-4e87-4d18-ae8c-3c9933e442ec tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:24.151535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f989f249-4e87-4d18-ae8c-3c9933e442ec tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:24.152272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f989f249-4e87-4d18-ae8c-3c9933e442ec tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:24.152730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f989f249-4e87-4d18-ae8c-3c9933e442ec tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:24.153166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f989f249-4e87-4d18-ae8c-3c9933e442ec tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:24.291731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f989f249-4e87-4d18-ae8c-3c9933e442ec tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:24.299816 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f989f249-4e87-4d18-ae8c-3c9933e442ec tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1314 microversion: 2.1 time: 0.162054 Aug 27 05:46:24.300411 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3562/7115] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:24 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:46:25.321711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e179e27-5a39-4830-a36e-4b2f8ef40ba4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:25.322306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e179e27-5a39-4830-a36e-4b2f8ef40ba4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:25.325142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:25.330678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179e27-5a39-4830-a36e-4b2f8ef40ba4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:25.331217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179e27-5a39-4830-a36e-4b2f8ef40ba4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:25.331674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179e27-5a39-4830-a36e-4b2f8ef40ba4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:25.332405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179e27-5a39-4830-a36e-4b2f8ef40ba4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:25.332880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179e27-5a39-4830-a36e-4b2f8ef40ba4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:25.333325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e179e27-5a39-4830-a36e-4b2f8ef40ba4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:25.338715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=72 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:25.474243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e179e27-5a39-4830-a36e-4b2f8ef40ba4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:25.483971 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e179e27-5a39-4830-a36e-4b2f8ef40ba4 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1314 microversion: 2.1 time: 0.166886 Aug 27 05:46:25.492496 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3554/7116] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:25 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:26.505527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-da9fcff2-782c-44c1-8870-2c39c15cb322 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:26.506145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-da9fcff2-782c-44c1-8870-2c39c15cb322 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:26.508846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:26.514206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da9fcff2-782c-44c1-8870-2c39c15cb322 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:26.514694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da9fcff2-782c-44c1-8870-2c39c15cb322 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:26.515167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da9fcff2-782c-44c1-8870-2c39c15cb322 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:26.516414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da9fcff2-782c-44c1-8870-2c39c15cb322 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:26.516414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da9fcff2-782c-44c1-8870-2c39c15cb322 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:26.516741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da9fcff2-782c-44c1-8870-2c39c15cb322 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:26.520284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:26.659213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-da9fcff2-782c-44c1-8870-2c39c15cb322 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:26.667997 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-da9fcff2-782c-44c1-8870-2c39c15cb322 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1314 microversion: 2.1 time: 0.166282 Aug 27 05:46:26.668616 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3563/7117] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:26 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:27.060447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b38dae8c-6a15-4481-b92c-708b159c0fae req-c42b191e-5dbb-49ff-a533-c89d04af4093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6635a2-16fd-455f-acfb-8885e6646681", "name": "network-vif-plugged", "status": "completed", "tag": "06094fcf-d724-4f87-96f2-106b3be0f045"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:27.071601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b38dae8c-6a15-4481-b92c-708b159c0fae req-c42b191e-5dbb-49ff-a533-c89d04af4093 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:27.072102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b38dae8c-6a15-4481-b92c-708b159c0fae req-c42b191e-5dbb-49ff-a533-c89d04af4093 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:27.072736 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b38dae8c-6a15-4481-b92c-708b159c0fae req-c42b191e-5dbb-49ff-a533-c89d04af4093 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:27.087295 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b38dae8c-6a15-4481-b92c-708b159c0fae req-c42b191e-5dbb-49ff-a533-c89d04af4093 service nova] Creating event network-vif-plugged:06094fcf-d724-4f87-96f2-106b3be0f045 for instance df6635a2-16fd-455f-acfb-8885e6646681 on n-h1-820368-35 Aug 27 05:46:27.092595 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b38dae8c-6a15-4481-b92c-708b159c0fae req-c42b191e-5dbb-49ff-a533-c89d04af4093 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036054 Aug 27 05:46:27.093211 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3555/7118] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:27.690109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-37f62d5f-b554-4463-8a22-1e5e2c9a5ade tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:27.690672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-37f62d5f-b554-4463-8a22-1e5e2c9a5ade tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:27.692571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:27.693369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:27.700002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f62d5f-b554-4463-8a22-1e5e2c9a5ade tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:27.700496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f62d5f-b554-4463-8a22-1e5e2c9a5ade tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:27.700939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f62d5f-b554-4463-8a22-1e5e2c9a5ade tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:27.701648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f62d5f-b554-4463-8a22-1e5e2c9a5ade tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:27.702215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f62d5f-b554-4463-8a22-1e5e2c9a5ade tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:27.702652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37f62d5f-b554-4463-8a22-1e5e2c9a5ade tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:27.840500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37f62d5f-b554-4463-8a22-1e5e2c9a5ade tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:27.848139 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-37f62d5f-b554-4463-8a22-1e5e2c9a5ade tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1314 microversion: 2.1 time: 0.162149 Aug 27 05:46:27.848795 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3564/7119] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:27 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:28.867224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:28.872363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3beddd64-2747-4466-9afe-0d6c27b6aa39 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:28.873238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3beddd64-2747-4466-9afe-0d6c27b6aa39 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:28.880130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3beddd64-2747-4466-9afe-0d6c27b6aa39 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:28.880658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3beddd64-2747-4466-9afe-0d6c27b6aa39 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:28.881106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3beddd64-2747-4466-9afe-0d6c27b6aa39 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:28.881831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3beddd64-2747-4466-9afe-0d6c27b6aa39 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:28.882294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3beddd64-2747-4466-9afe-0d6c27b6aa39 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:28.882729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3beddd64-2747-4466-9afe-0d6c27b6aa39 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:29.025647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3beddd64-2747-4466-9afe-0d6c27b6aa39 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:29.033951 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3beddd64-2747-4466-9afe-0d6c27b6aa39 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1501 microversion: 2.1 time: 0.167715 Aug 27 05:46:29.034984 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3556/7120] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:28 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:29.056396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:29.058799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:29.065523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:29.066003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:29.066439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:29.067202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:29.067653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:29.068075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:29.148314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:29.155994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Old instance type m1.heat2, new instance type m1.heat {{(pid=128548) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:46:29.164343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:46:29.164771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:46:29.165254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:46:29.165673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:46:29.166092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:46:29.287969 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-31906f5d-f102-47d5-8a7f-6da6ab4c9aee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "POST /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681/action" status: 202 len: 0 microversion: 2.1 time: 0.236449 Aug 27 05:46:29.288694 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3565/7121] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:46:29 2022] POST /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:46:29.298489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bdeb1c33-d9cf-408c-ab6c-1f3058c03db9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:29.299304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bdeb1c33-d9cf-408c-ab6c-1f3058c03db9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:29.306171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdeb1c33-d9cf-408c-ab6c-1f3058c03db9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:29.306677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdeb1c33-d9cf-408c-ab6c-1f3058c03db9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:29.307155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdeb1c33-d9cf-408c-ab6c-1f3058c03db9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:29.307881 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdeb1c33-d9cf-408c-ab6c-1f3058c03db9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:29.308531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdeb1c33-d9cf-408c-ab6c-1f3058c03db9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:29.308955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bdeb1c33-d9cf-408c-ab6c-1f3058c03db9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:29.486227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bdeb1c33-d9cf-408c-ab6c-1f3058c03db9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:29.496210 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bdeb1c33-d9cf-408c-ab6c-1f3058c03db9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1510 microversion: 2.1 time: 0.202744 Aug 27 05:46:29.497076 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3557/7122] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:29 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:30.517705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fef41168-27c2-4b20-a16a-1f1e35fdc19d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:30.518318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fef41168-27c2-4b20-a16a-1f1e35fdc19d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:30.525425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef41168-27c2-4b20-a16a-1f1e35fdc19d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:30.525910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef41168-27c2-4b20-a16a-1f1e35fdc19d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:30.526347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef41168-27c2-4b20-a16a-1f1e35fdc19d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:30.527035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef41168-27c2-4b20-a16a-1f1e35fdc19d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:30.527606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef41168-27c2-4b20-a16a-1f1e35fdc19d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:30.528031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fef41168-27c2-4b20-a16a-1f1e35fdc19d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:30.657573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fef41168-27c2-4b20-a16a-1f1e35fdc19d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:30.666202 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fef41168-27c2-4b20-a16a-1f1e35fdc19d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1510 microversion: 2.1 time: 0.153189 Aug 27 05:46:30.666795 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3566/7123] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:30 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:31.688029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-321ec956-1ba9-4792-92a7-1a3505f137a7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:31.688702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-321ec956-1ba9-4792-92a7-1a3505f137a7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:31.696135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321ec956-1ba9-4792-92a7-1a3505f137a7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:31.696643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321ec956-1ba9-4792-92a7-1a3505f137a7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:31.697102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321ec956-1ba9-4792-92a7-1a3505f137a7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:31.697815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321ec956-1ba9-4792-92a7-1a3505f137a7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:31.698289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321ec956-1ba9-4792-92a7-1a3505f137a7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:31.698735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-321ec956-1ba9-4792-92a7-1a3505f137a7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:31.829950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-321ec956-1ba9-4792-92a7-1a3505f137a7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:31.838288 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-321ec956-1ba9-4792-92a7-1a3505f137a7 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.154323 Aug 27 05:46:31.838867 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3558/7124] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:31 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:32.858809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-217dad21-d9b0-4abf-bc75-55adb8b18856 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:32.859453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-217dad21-d9b0-4abf-bc75-55adb8b18856 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:32.866758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-217dad21-d9b0-4abf-bc75-55adb8b18856 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:32.867275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-217dad21-d9b0-4abf-bc75-55adb8b18856 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:32.867715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-217dad21-d9b0-4abf-bc75-55adb8b18856 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:32.868414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-217dad21-d9b0-4abf-bc75-55adb8b18856 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:32.868872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-217dad21-d9b0-4abf-bc75-55adb8b18856 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:32.869304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-217dad21-d9b0-4abf-bc75-55adb8b18856 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:33.001914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-217dad21-d9b0-4abf-bc75-55adb8b18856 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:33.010262 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-217dad21-d9b0-4abf-bc75-55adb8b18856 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.155443 Aug 27 05:46:33.010836 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3567/7125] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:32 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:34.031624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8b95702-8ed9-4f1a-9977-76fdbf9863d0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:34.032264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8b95702-8ed9-4f1a-9977-76fdbf9863d0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:34.040046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b95702-8ed9-4f1a-9977-76fdbf9863d0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:34.040556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b95702-8ed9-4f1a-9977-76fdbf9863d0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:34.041019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b95702-8ed9-4f1a-9977-76fdbf9863d0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:34.041738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b95702-8ed9-4f1a-9977-76fdbf9863d0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:34.042215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b95702-8ed9-4f1a-9977-76fdbf9863d0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:34.042665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8b95702-8ed9-4f1a-9977-76fdbf9863d0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:34.170434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8b95702-8ed9-4f1a-9977-76fdbf9863d0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:34.179706 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8b95702-8ed9-4f1a-9977-76fdbf9863d0 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.151967 Aug 27 05:46:34.180333 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3559/7126] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:34 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:35.201470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e9feebcc-d988-4d78-a337-803a62ce4c55 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:35.202142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e9feebcc-d988-4d78-a337-803a62ce4c55 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:35.208957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9feebcc-d988-4d78-a337-803a62ce4c55 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:35.209445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9feebcc-d988-4d78-a337-803a62ce4c55 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:35.209885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9feebcc-d988-4d78-a337-803a62ce4c55 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:35.210585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9feebcc-d988-4d78-a337-803a62ce4c55 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:35.211043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9feebcc-d988-4d78-a337-803a62ce4c55 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:35.211500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9feebcc-d988-4d78-a337-803a62ce4c55 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:35.345229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e9feebcc-d988-4d78-a337-803a62ce4c55 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:35.353523 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e9feebcc-d988-4d78-a337-803a62ce4c55 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.155967 Aug 27 05:46:35.354097 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3568/7127] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:35 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:36.375472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f019443e-43ba-4887-a5c5-5d5638935530 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:36.376756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f019443e-43ba-4887-a5c5-5d5638935530 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:36.384406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f019443e-43ba-4887-a5c5-5d5638935530 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:36.384970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f019443e-43ba-4887-a5c5-5d5638935530 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:36.385372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f019443e-43ba-4887-a5c5-5d5638935530 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:36.386098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f019443e-43ba-4887-a5c5-5d5638935530 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:36.386726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f019443e-43ba-4887-a5c5-5d5638935530 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:36.387338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f019443e-43ba-4887-a5c5-5d5638935530 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:36.522521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f019443e-43ba-4887-a5c5-5d5638935530 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:36.530503 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f019443e-43ba-4887-a5c5-5d5638935530 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.159096 Aug 27 05:46:36.531074 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3560/7128] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:36 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:37.552733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c808b77c-f902-44e3-a5dc-18b580e703af tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:37.553392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c808b77c-f902-44e3-a5dc-18b580e703af tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:37.561347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c808b77c-f902-44e3-a5dc-18b580e703af tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:37.561837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c808b77c-f902-44e3-a5dc-18b580e703af tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:37.562286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c808b77c-f902-44e3-a5dc-18b580e703af tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:37.562992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c808b77c-f902-44e3-a5dc-18b580e703af tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:37.563488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c808b77c-f902-44e3-a5dc-18b580e703af tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:37.563922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c808b77c-f902-44e3-a5dc-18b580e703af tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:37.699656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c808b77c-f902-44e3-a5dc-18b580e703af tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:37.708226 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c808b77c-f902-44e3-a5dc-18b580e703af tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.159401 Aug 27 05:46:37.708848 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3569/7129] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:37 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:38.730441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cbd10478-26ac-449b-ab64-1b370ef00d04 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:38.731078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cbd10478-26ac-449b-ab64-1b370ef00d04 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:38.738055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbd10478-26ac-449b-ab64-1b370ef00d04 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:38.738558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbd10478-26ac-449b-ab64-1b370ef00d04 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:38.739110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbd10478-26ac-449b-ab64-1b370ef00d04 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:38.740191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbd10478-26ac-449b-ab64-1b370ef00d04 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:38.740683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbd10478-26ac-449b-ab64-1b370ef00d04 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:38.741131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbd10478-26ac-449b-ab64-1b370ef00d04 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:38.876297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cbd10478-26ac-449b-ab64-1b370ef00d04 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:38.884188 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cbd10478-26ac-449b-ab64-1b370ef00d04 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.157688 Aug 27 05:46:38.884768 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3561/7130] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:38 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:39.908002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f56a2e2-599b-4fd3-8133-b59e07230f5b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:39.909226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4f56a2e2-599b-4fd3-8133-b59e07230f5b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:39.922202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f56a2e2-599b-4fd3-8133-b59e07230f5b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:39.923133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f56a2e2-599b-4fd3-8133-b59e07230f5b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:39.923882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f56a2e2-599b-4fd3-8133-b59e07230f5b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:39.924607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f56a2e2-599b-4fd3-8133-b59e07230f5b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:39.925073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f56a2e2-599b-4fd3-8133-b59e07230f5b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:39.925511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f56a2e2-599b-4fd3-8133-b59e07230f5b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:40.059691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f56a2e2-599b-4fd3-8133-b59e07230f5b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:40.067624 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f56a2e2-599b-4fd3-8133-b59e07230f5b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.165758 Aug 27 05:46:40.068124 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3570/7131] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:39 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:46:41.089316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7b6af5a5-5cf3-442c-9f9c-82f941452b5e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:41.089955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7b6af5a5-5cf3-442c-9f9c-82f941452b5e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:41.097017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b6af5a5-5cf3-442c-9f9c-82f941452b5e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:41.097523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b6af5a5-5cf3-442c-9f9c-82f941452b5e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:41.097981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b6af5a5-5cf3-442c-9f9c-82f941452b5e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:41.098935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b6af5a5-5cf3-442c-9f9c-82f941452b5e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:41.099688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b6af5a5-5cf3-442c-9f9c-82f941452b5e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:41.100250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7b6af5a5-5cf3-442c-9f9c-82f941452b5e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:41.248367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7b6af5a5-5cf3-442c-9f9c-82f941452b5e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:41.256760 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7b6af5a5-5cf3-442c-9f9c-82f941452b5e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.171380 Aug 27 05:46:41.257337 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3562/7132] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:41 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:46:42.278007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f12910a8-0434-41bf-8eca-65b95bdf3452 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:42.278631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f12910a8-0434-41bf-8eca-65b95bdf3452 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:42.286343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12910a8-0434-41bf-8eca-65b95bdf3452 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:42.286837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12910a8-0434-41bf-8eca-65b95bdf3452 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:42.287335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12910a8-0434-41bf-8eca-65b95bdf3452 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:42.288055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12910a8-0434-41bf-8eca-65b95bdf3452 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:42.288516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12910a8-0434-41bf-8eca-65b95bdf3452 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:42.288978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f12910a8-0434-41bf-8eca-65b95bdf3452 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:42.433580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f12910a8-0434-41bf-8eca-65b95bdf3452 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:42.444466 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f12910a8-0434-41bf-8eca-65b95bdf3452 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.170369 Aug 27 05:46:42.445081 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3571/7133] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:42 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:43.465640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b8dc9987-a3c3-40e6-89b9-eec7443b5d81 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:43.466276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b8dc9987-a3c3-40e6-89b9-eec7443b5d81 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:43.472797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8dc9987-a3c3-40e6-89b9-eec7443b5d81 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:43.473870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8dc9987-a3c3-40e6-89b9-eec7443b5d81 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:43.474326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8dc9987-a3c3-40e6-89b9-eec7443b5d81 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:43.475071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8dc9987-a3c3-40e6-89b9-eec7443b5d81 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:43.475563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8dc9987-a3c3-40e6-89b9-eec7443b5d81 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:43.476008 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b8dc9987-a3c3-40e6-89b9-eec7443b5d81 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:43.609738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b8dc9987-a3c3-40e6-89b9-eec7443b5d81 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:43.617906 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b8dc9987-a3c3-40e6-89b9-eec7443b5d81 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.156383 Aug 27 05:46:43.618489 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3563/7134] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:43 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:44.639556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-95aa1036-fd39-4550-8ad2-67fae798a50e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:44.640163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-95aa1036-fd39-4550-8ad2-67fae798a50e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:44.647610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95aa1036-fd39-4550-8ad2-67fae798a50e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:44.648095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95aa1036-fd39-4550-8ad2-67fae798a50e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:44.648530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95aa1036-fd39-4550-8ad2-67fae798a50e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:44.649225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95aa1036-fd39-4550-8ad2-67fae798a50e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:44.649676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95aa1036-fd39-4550-8ad2-67fae798a50e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:44.650098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95aa1036-fd39-4550-8ad2-67fae798a50e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:45.087538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-95aa1036-fd39-4550-8ad2-67fae798a50e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:45.095274 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-95aa1036-fd39-4550-8ad2-67fae798a50e tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.459590 Aug 27 05:46:45.095838 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3572/7135] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:44 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:46.117087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bd837c75-6ccf-4134-96d2-c69b922ba746 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:46.117638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bd837c75-6ccf-4134-96d2-c69b922ba746 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:46.125083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd837c75-6ccf-4134-96d2-c69b922ba746 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:46.125595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd837c75-6ccf-4134-96d2-c69b922ba746 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:46.126054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd837c75-6ccf-4134-96d2-c69b922ba746 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:46.126786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd837c75-6ccf-4134-96d2-c69b922ba746 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:46.127441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd837c75-6ccf-4134-96d2-c69b922ba746 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:46.127907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd837c75-6ccf-4134-96d2-c69b922ba746 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:46.261394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bd837c75-6ccf-4134-96d2-c69b922ba746 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:46.269232 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bd837c75-6ccf-4134-96d2-c69b922ba746 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.156359 Aug 27 05:46:46.269809 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3564/7136] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:46 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:47.291967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0e63e924-a8e0-458b-b852-8ff653b4e420 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:47.292595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0e63e924-a8e0-458b-b852-8ff653b4e420 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:47.300139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e63e924-a8e0-458b-b852-8ff653b4e420 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:47.300626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e63e924-a8e0-458b-b852-8ff653b4e420 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:47.301065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e63e924-a8e0-458b-b852-8ff653b4e420 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:47.301761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e63e924-a8e0-458b-b852-8ff653b4e420 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:47.302214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e63e924-a8e0-458b-b852-8ff653b4e420 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:47.302639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0e63e924-a8e0-458b-b852-8ff653b4e420 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:47.439377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0e63e924-a8e0-458b-b852-8ff653b4e420 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:47.448253 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0e63e924-a8e0-458b-b852-8ff653b4e420 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.160975 Aug 27 05:46:47.448861 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3573/7137] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:47 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:48.470593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7242c5ee-b0d2-4c02-baca-8c2160e21727 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:48.471262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7242c5ee-b0d2-4c02-baca-8c2160e21727 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:48.477821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7242c5ee-b0d2-4c02-baca-8c2160e21727 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:48.478322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7242c5ee-b0d2-4c02-baca-8c2160e21727 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:48.478776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7242c5ee-b0d2-4c02-baca-8c2160e21727 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:48.479550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7242c5ee-b0d2-4c02-baca-8c2160e21727 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:48.479999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7242c5ee-b0d2-4c02-baca-8c2160e21727 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:48.480443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7242c5ee-b0d2-4c02-baca-8c2160e21727 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:48.612990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7242c5ee-b0d2-4c02-baca-8c2160e21727 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:48.620955 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7242c5ee-b0d2-4c02-baca-8c2160e21727 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.154489 Aug 27 05:46:48.621548 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3565/7138] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:48 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:49.642419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f1255108-a563-402a-9150-3cf6011dbe5a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:49.643046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f1255108-a563-402a-9150-3cf6011dbe5a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:49.650589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1255108-a563-402a-9150-3cf6011dbe5a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:49.651074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1255108-a563-402a-9150-3cf6011dbe5a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:49.651539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1255108-a563-402a-9150-3cf6011dbe5a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:49.652261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1255108-a563-402a-9150-3cf6011dbe5a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:49.652717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1255108-a563-402a-9150-3cf6011dbe5a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:49.653146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1255108-a563-402a-9150-3cf6011dbe5a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:49.798383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f1255108-a563-402a-9150-3cf6011dbe5a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:49.806813 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f1255108-a563-402a-9150-3cf6011dbe5a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.168198 Aug 27 05:46:49.807439 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3574/7139] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:49 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:50.828975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-79e5570b-0ca1-46e8-908c-c03122ff4c6b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:50.829609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-79e5570b-0ca1-46e8-908c-c03122ff4c6b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:50.837147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79e5570b-0ca1-46e8-908c-c03122ff4c6b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:50.837653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79e5570b-0ca1-46e8-908c-c03122ff4c6b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:50.838108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79e5570b-0ca1-46e8-908c-c03122ff4c6b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:50.838825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79e5570b-0ca1-46e8-908c-c03122ff4c6b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:50.839330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79e5570b-0ca1-46e8-908c-c03122ff4c6b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:50.840193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79e5570b-0ca1-46e8-908c-c03122ff4c6b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:50.974849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-79e5570b-0ca1-46e8-908c-c03122ff4c6b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:50.982667 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-79e5570b-0ca1-46e8-908c-c03122ff4c6b tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.157913 Aug 27 05:46:50.983386 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3566/7140] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:50 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:52.003944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-323c65c1-070c-468d-962a-288aad9b75f1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:52.004568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-323c65c1-070c-468d-962a-288aad9b75f1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:52.011991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-323c65c1-070c-468d-962a-288aad9b75f1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:52.012622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-323c65c1-070c-468d-962a-288aad9b75f1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:52.013063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-323c65c1-070c-468d-962a-288aad9b75f1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:52.013771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-323c65c1-070c-468d-962a-288aad9b75f1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:52.014228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-323c65c1-070c-468d-962a-288aad9b75f1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:52.014656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-323c65c1-070c-468d-962a-288aad9b75f1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:52.154474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-323c65c1-070c-468d-962a-288aad9b75f1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:52.163872 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-323c65c1-070c-468d-962a-288aad9b75f1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.163793 Aug 27 05:46:52.164460 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3575/7141] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:51 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:53.185843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c035335b-4494-4a45-bfda-06150baaf18a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:53.186517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c035335b-4494-4a45-bfda-06150baaf18a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:53.193622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c035335b-4494-4a45-bfda-06150baaf18a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:53.194130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c035335b-4494-4a45-bfda-06150baaf18a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:53.194624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c035335b-4494-4a45-bfda-06150baaf18a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:53.195390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c035335b-4494-4a45-bfda-06150baaf18a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:53.195894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c035335b-4494-4a45-bfda-06150baaf18a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:53.196343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c035335b-4494-4a45-bfda-06150baaf18a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:53.402724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c035335b-4494-4a45-bfda-06150baaf18a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:53.410904 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c035335b-4494-4a45-bfda-06150baaf18a tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.228945 Aug 27 05:46:53.411520 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3567/7142] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:53 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:54.432996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-49b37534-a4ca-4f59-bbae-08fa810c8317 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:54.433624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-49b37534-a4ca-4f59-bbae-08fa810c8317 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:54.442394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49b37534-a4ca-4f59-bbae-08fa810c8317 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:54.442974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49b37534-a4ca-4f59-bbae-08fa810c8317 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:54.443365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49b37534-a4ca-4f59-bbae-08fa810c8317 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:54.444074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49b37534-a4ca-4f59-bbae-08fa810c8317 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:54.444531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49b37534-a4ca-4f59-bbae-08fa810c8317 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:54.444958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49b37534-a4ca-4f59-bbae-08fa810c8317 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:54.648707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-49b37534-a4ca-4f59-bbae-08fa810c8317 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:54.657436 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-49b37534-a4ca-4f59-bbae-08fa810c8317 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.229081 Aug 27 05:46:54.658023 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3576/7143] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:54 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:55.680836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a38c51eb-e605-425e-b4a4-17d3768d200f tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:55.681614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a38c51eb-e605-425e-b4a4-17d3768d200f tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:55.684390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=28 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:55.689871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38c51eb-e605-425e-b4a4-17d3768d200f tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:55.690376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38c51eb-e605-425e-b4a4-17d3768d200f tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:55.690859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38c51eb-e605-425e-b4a4-17d3768d200f tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:55.691604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38c51eb-e605-425e-b4a4-17d3768d200f tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:55.692194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38c51eb-e605-425e-b4a4-17d3768d200f tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:55.692640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a38c51eb-e605-425e-b4a4-17d3768d200f tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:55.696212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=80 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:55.843424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a38c51eb-e605-425e-b4a4-17d3768d200f tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:55.851482 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a38c51eb-e605-425e-b4a4-17d3768d200f tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.174672 Aug 27 05:46:55.852078 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3568/7144] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:55 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:46:56.874188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8e2f713d-8ae2-42d9-bedc-22dd7919fa64 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:56.874780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8e2f713d-8ae2-42d9-bedc-22dd7919fa64 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:56.877463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=32 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:56.882734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f713d-8ae2-42d9-bedc-22dd7919fa64 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:56.883241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f713d-8ae2-42d9-bedc-22dd7919fa64 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:56.883675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f713d-8ae2-42d9-bedc-22dd7919fa64 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:56.884366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f713d-8ae2-42d9-bedc-22dd7919fa64 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:56.884820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f713d-8ae2-42d9-bedc-22dd7919fa64 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:56.885243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8e2f713d-8ae2-42d9-bedc-22dd7919fa64 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:56.887959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:57.020950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8e2f713d-8ae2-42d9-bedc-22dd7919fa64 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:57.029280 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8e2f713d-8ae2-42d9-bedc-22dd7919fa64 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.160062 Aug 27 05:46:57.029869 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3577/7145] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:56 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:58.050123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c9044a1c-fec0-4913-910f-b7d6cb69d3ed tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:58.050706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c9044a1c-fec0-4913-910f-b7d6cb69d3ed tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:58.058226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9044a1c-fec0-4913-910f-b7d6cb69d3ed tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:58.058734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9044a1c-fec0-4913-910f-b7d6cb69d3ed tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:58.059216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9044a1c-fec0-4913-910f-b7d6cb69d3ed tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:58.060016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9044a1c-fec0-4913-910f-b7d6cb69d3ed tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:58.060488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9044a1c-fec0-4913-910f-b7d6cb69d3ed tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:58.060932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9044a1c-fec0-4913-910f-b7d6cb69d3ed tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:58.197411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c9044a1c-fec0-4913-910f-b7d6cb69d3ed tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:58.205357 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c9044a1c-fec0-4913-910f-b7d6cb69d3ed tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1515 microversion: 2.1 time: 0.159235 Aug 27 05:46:58.205939 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3569/7146] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:58 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:58.870208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-78d111d2-11ce-42f5-acd5-f099a9819251 req-6302f08c-9fd1-4783-8a94-7aa8a9c545ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6635a2-16fd-455f-acfb-8885e6646681", "name": "network-vif-unplugged", "status": "completed", "tag": "06094fcf-d724-4f87-96f2-106b3be0f045"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:58.880831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-78d111d2-11ce-42f5-acd5-f099a9819251 req-6302f08c-9fd1-4783-8a94-7aa8a9c545ae service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:58.881903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-78d111d2-11ce-42f5-acd5-f099a9819251 req-6302f08c-9fd1-4783-8a94-7aa8a9c545ae service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:58.882484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-78d111d2-11ce-42f5-acd5-f099a9819251 req-6302f08c-9fd1-4783-8a94-7aa8a9c545ae service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:58.895152 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-78d111d2-11ce-42f5-acd5-f099a9819251 req-6302f08c-9fd1-4783-8a94-7aa8a9c545ae service nova] Creating event network-vif-unplugged:06094fcf-d724-4f87-96f2-106b3be0f045 for instance df6635a2-16fd-455f-acfb-8885e6646681 on n-h2-820368-35 Aug 27 05:46:58.901425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-78d111d2-11ce-42f5-acd5-f099a9819251 req-6302f08c-9fd1-4783-8a94-7aa8a9c545ae service nova] Instance df6635a2-16fd-455f-acfb-8885e6646681 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:46:58.913276 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-78d111d2-11ce-42f5-acd5-f099a9819251 req-6302f08c-9fd1-4783-8a94-7aa8a9c545ae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046988 Aug 27 05:46:58.914140 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3578/7147] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:59.226898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4c562391-dc9c-4c3b-8cad-9b47a0273052 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:59.227726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4c562391-dc9c-4c3b-8cad-9b47a0273052 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:59.235201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c562391-dc9c-4c3b-8cad-9b47a0273052 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:59.235711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c562391-dc9c-4c3b-8cad-9b47a0273052 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:59.236162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c562391-dc9c-4c3b-8cad-9b47a0273052 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:59.236884 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c562391-dc9c-4c3b-8cad-9b47a0273052 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:59.237389 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c562391-dc9c-4c3b-8cad-9b47a0273052 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:59.237790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c562391-dc9c-4c3b-8cad-9b47a0273052 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:59.378022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4c562391-dc9c-4c3b-8cad-9b47a0273052 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:59.386678 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4c562391-dc9c-4c3b-8cad-9b47a0273052 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1514 microversion: 2.1 time: 0.163756 Aug 27 05:46:59.387321 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3570/7148] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:59 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:00.410054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-663c10a2-b9e1-447a-96bc-222d1a5ace1c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:00.411082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-663c10a2-b9e1-447a-96bc-222d1a5ace1c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:00.417652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-663c10a2-b9e1-447a-96bc-222d1a5ace1c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:00.418153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-663c10a2-b9e1-447a-96bc-222d1a5ace1c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:00.418599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-663c10a2-b9e1-447a-96bc-222d1a5ace1c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:00.419499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-663c10a2-b9e1-447a-96bc-222d1a5ace1c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:00.419887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-663c10a2-b9e1-447a-96bc-222d1a5ace1c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:00.420316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-663c10a2-b9e1-447a-96bc-222d1a5ace1c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:00.555763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-663c10a2-b9e1-447a-96bc-222d1a5ace1c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:00.563622 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-663c10a2-b9e1-447a-96bc-222d1a5ace1c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1512 microversion: 2.1 time: 0.159010 Aug 27 05:47:00.564218 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3579/7149] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:00 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:00.941048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1f85e85e-812b-4d62-a912-b1cf1f016334 req-f8f67117-4788-4040-be5c-7c7dd4610ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6635a2-16fd-455f-acfb-8885e6646681", "tag": "06094fcf-d724-4f87-96f2-106b3be0f045"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:00.951686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1f85e85e-812b-4d62-a912-b1cf1f016334 req-f8f67117-4788-4040-be5c-7c7dd4610ddf service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:00.952170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1f85e85e-812b-4d62-a912-b1cf1f016334 req-f8f67117-4788-4040-be5c-7c7dd4610ddf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:00.952620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1f85e85e-812b-4d62-a912-b1cf1f016334 req-f8f67117-4788-4040-be5c-7c7dd4610ddf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:00.964442 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1f85e85e-812b-4d62-a912-b1cf1f016334 req-f8f67117-4788-4040-be5c-7c7dd4610ddf service nova] Creating event network-changed:06094fcf-d724-4f87-96f2-106b3be0f045 for instance df6635a2-16fd-455f-acfb-8885e6646681 on n-h2-820368-35 Aug 27 05:47:00.970268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-1f85e85e-812b-4d62-a912-b1cf1f016334 req-f8f67117-4788-4040-be5c-7c7dd4610ddf service nova] Instance df6635a2-16fd-455f-acfb-8885e6646681 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:47:00.981960 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1f85e85e-812b-4d62-a912-b1cf1f016334 req-f8f67117-4788-4040-be5c-7c7dd4610ddf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044592 Aug 27 05:47:00.982600 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3571/7150] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:47:01.585520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-400b394d-b81b-4a9f-ad79-40cc9d45d0d6 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:01.586144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-400b394d-b81b-4a9f-ad79-40cc9d45d0d6 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:01.593198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-400b394d-b81b-4a9f-ad79-40cc9d45d0d6 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:01.593692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-400b394d-b81b-4a9f-ad79-40cc9d45d0d6 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:01.594138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-400b394d-b81b-4a9f-ad79-40cc9d45d0d6 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:01.594876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-400b394d-b81b-4a9f-ad79-40cc9d45d0d6 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:01.595371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-400b394d-b81b-4a9f-ad79-40cc9d45d0d6 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:01.595813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-400b394d-b81b-4a9f-ad79-40cc9d45d0d6 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:01.733201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-400b394d-b81b-4a9f-ad79-40cc9d45d0d6 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:01.741667 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-400b394d-b81b-4a9f-ad79-40cc9d45d0d6 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1512 microversion: 2.1 time: 0.160084 Aug 27 05:47:01.742237 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3580/7151] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:01 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:02.765484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c84f48d9-ced6-4a8a-b81c-d145dec21d6c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:02.766220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c84f48d9-ced6-4a8a-b81c-d145dec21d6c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:02.773331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84f48d9-ced6-4a8a-b81c-d145dec21d6c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:02.773891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84f48d9-ced6-4a8a-b81c-d145dec21d6c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:02.774348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84f48d9-ced6-4a8a-b81c-d145dec21d6c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:02.775121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84f48d9-ced6-4a8a-b81c-d145dec21d6c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:02.775666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84f48d9-ced6-4a8a-b81c-d145dec21d6c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:02.776109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c84f48d9-ced6-4a8a-b81c-d145dec21d6c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:02.928110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c84f48d9-ced6-4a8a-b81c-d145dec21d6c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:02.942389 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c84f48d9-ced6-4a8a-b81c-d145dec21d6c tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1509 microversion: 2.1 time: 0.181911 Aug 27 05:47:02.944048 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3572/7152] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:02 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:02.964011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9e2c190b-bf36-44d2-b379-05371c5972ee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:02.965058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9e2c190b-bf36-44d2-b379-05371c5972ee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:02.972055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e2c190b-bf36-44d2-b379-05371c5972ee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:02.972565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e2c190b-bf36-44d2-b379-05371c5972ee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:02.972984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e2c190b-bf36-44d2-b379-05371c5972ee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:02.973697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e2c190b-bf36-44d2-b379-05371c5972ee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:02.974152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e2c190b-bf36-44d2-b379-05371c5972ee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:02.974626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9e2c190b-bf36-44d2-b379-05371c5972ee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:03.002951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9e2c190b-bf36-44d2-b379-05371c5972ee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:47:03.055273 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.compute.api [None req-9e2c190b-bf36-44d2-b379-05371c5972ee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Found an unconfirmed migration during delete, id: 16, status: finished Aug 27 05:47:04.369610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9d53518d-d879-497a-9e49-dcb15087b4b2 req-926c84fd-ea99-4c0b-ac43-89f4caccc103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6635a2-16fd-455f-acfb-8885e6646681", "name": "network-vif-plugged", "status": "completed", "tag": "06094fcf-d724-4f87-96f2-106b3be0f045"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:04.380231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9d53518d-d879-497a-9e49-dcb15087b4b2 req-926c84fd-ea99-4c0b-ac43-89f4caccc103 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:04.380740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9d53518d-d879-497a-9e49-dcb15087b4b2 req-926c84fd-ea99-4c0b-ac43-89f4caccc103 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:04.381864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9d53518d-d879-497a-9e49-dcb15087b4b2 req-926c84fd-ea99-4c0b-ac43-89f4caccc103 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:04.394816 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9d53518d-d879-497a-9e49-dcb15087b4b2 req-926c84fd-ea99-4c0b-ac43-89f4caccc103 service nova] Creating event network-vif-plugged:06094fcf-d724-4f87-96f2-106b3be0f045 for instance df6635a2-16fd-455f-acfb-8885e6646681 on n-h2-820368-35 Aug 27 05:47:04.400565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-9d53518d-d879-497a-9e49-dcb15087b4b2 req-926c84fd-ea99-4c0b-ac43-89f4caccc103 service nova] Instance df6635a2-16fd-455f-acfb-8885e6646681 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:47:04.412919 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9d53518d-d879-497a-9e49-dcb15087b4b2 req-926c84fd-ea99-4c0b-ac43-89f4caccc103 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047541 Aug 27 05:47:04.413665 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3573/7153] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:47:04.855267 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9e2c190b-bf36-44d2-b379-05371c5972ee tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "DELETE /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 204 len: 0 microversion: 2.1 time: 1.894723 Aug 27 05:47:04.855874 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3581/7154] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:47:02 2022] DELETE /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 0 bytes in 1897 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:47:04.867048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-64c84f05-64a1-4405-87f0-6431bd612f58 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:04.867987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-64c84f05-64a1-4405-87f0-6431bd612f58 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:04.877170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64c84f05-64a1-4405-87f0-6431bd612f58 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:04.877911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64c84f05-64a1-4405-87f0-6431bd612f58 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:04.878371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64c84f05-64a1-4405-87f0-6431bd612f58 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:04.879128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64c84f05-64a1-4405-87f0-6431bd612f58 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:04.879610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64c84f05-64a1-4405-87f0-6431bd612f58 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:04.880194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64c84f05-64a1-4405-87f0-6431bd612f58 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:05.022931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-64c84f05-64a1-4405-87f0-6431bd612f58 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:05.030771 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-64c84f05-64a1-4405-87f0-6431bd612f58 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1501 microversion: 2.1 time: 0.170244 Aug 27 05:47:05.031385 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3574/7155] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:04 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:06.053119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3decdd96-5522-4d97-818c-73898282fde9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:06.053911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3decdd96-5522-4d97-818c-73898282fde9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:06.061260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3decdd96-5522-4d97-818c-73898282fde9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:06.061750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3decdd96-5522-4d97-818c-73898282fde9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:06.062190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3decdd96-5522-4d97-818c-73898282fde9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:06.062902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3decdd96-5522-4d97-818c-73898282fde9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:06.063392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3decdd96-5522-4d97-818c-73898282fde9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:06.063822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3decdd96-5522-4d97-818c-73898282fde9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:06.203821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3decdd96-5522-4d97-818c-73898282fde9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db0b98c3fa845bab761e25a09d285f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75367f1a874a4d79acbfce528b7e157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:06.212404 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3decdd96-5522-4d97-818c-73898282fde9 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 200 len: 1501 microversion: 2.1 time: 0.163541 Aug 27 05:47:06.213007 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3582/7156] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:06 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:06.815251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-66e1b13f-9bc4-4763-b24c-39e28097a38a req-ccbfdcf2-ee4e-4fcf-9619-7cf41eaf8133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6635a2-16fd-455f-acfb-8885e6646681", "name": "network-vif-deleted", "tag": "06094fcf-d724-4f87-96f2-106b3be0f045"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:06.830524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-66e1b13f-9bc4-4763-b24c-39e28097a38a req-ccbfdcf2-ee4e-4fcf-9619-7cf41eaf8133 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:06.831155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-66e1b13f-9bc4-4763-b24c-39e28097a38a req-ccbfdcf2-ee4e-4fcf-9619-7cf41eaf8133 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:06.831680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-66e1b13f-9bc4-4763-b24c-39e28097a38a req-ccbfdcf2-ee4e-4fcf-9619-7cf41eaf8133 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:06.850758 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-66e1b13f-9bc4-4763-b24c-39e28097a38a req-ccbfdcf2-ee4e-4fcf-9619-7cf41eaf8133 service nova] Creating event network-vif-deleted:06094fcf-d724-4f87-96f2-106b3be0f045 for instance df6635a2-16fd-455f-acfb-8885e6646681 on n-h2-820368-35 Aug 27 05:47:06.856359 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-66e1b13f-9bc4-4763-b24c-39e28097a38a req-ccbfdcf2-ee4e-4fcf-9619-7cf41eaf8133 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044987 Aug 27 05:47:06.857255 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3575/7157] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:47:07.234841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:07.235515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:07.243482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:07.243969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:07.244412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:07.245107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:07.245557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:07.245979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:07.263394 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] HTTP exception thrown: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Request method failure captured: Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 HTTP/1.1 Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCa-ohjbIGkmNDF8ULt8frz1K6475a0H9gytc2l1xUeXLpIDQZd6kAVc_nB_03JRCyxSqStFxJgoH5VbWA_MOcEUAkHF4cOEHEB_BQuG0nbJbVGNv_ZumEEfoKciyOaPXiMBq_-um0gDySFxFvKaKhOQAyhEhrS-ZaLVm3xFmkAwu4i0 Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 75367f1a874a4d79acbfce528b7e157b Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-DeleteServersTestJSON-1128870768 Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_75367f1a874a4d79acbfce528b7e157b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/75367f1a874a4d79acbfce528b7e157b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75367f1a874a4d79acbfce528b7e157b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75367f1a874a4d79acbfce528b7e157b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-DeleteServersTestJSON-1128870768 Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 75367f1a874a4d79acbfce528b7e157b Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-DeleteServersTestJSON-1128870768 Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-DeleteServersTestJSON-1128870768-project Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6db0b98c3fa845bab761e25a09d285f8 Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-DeleteServersTestJSON-1128870768-project Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'df6635a2-16fd-455f-acfb-8885e6646681'} Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:47:07.265055 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.269850 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:47:07.269850 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:47:07.269850 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:47:07.269850 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:47:07.269850 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:47:07.269850 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.269850 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.269850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Returning 404 to user: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:47:07.269850 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d60edba7-ca57-4378-82e7-0942ed90018d tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 404 len: 111 microversion: 2.1 time: 0.035670 Aug 27 05:47:07.269850 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3583/7158] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:07 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:47:07.281603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:07.282200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:07.288581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:07.289077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:07.289526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:07.290224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:07.290687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:07.291149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:07.305149 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] HTTP exception thrown: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Request method failure captured: Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 HTTP/1.1 Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCa-ohjbIGkmNDF8ULt8frz1K6475a0H9gytc2l1xUeXLpIDQZd6kAVc_nB_03JRCyxSqStFxJgoH5VbWA_MOcEUAkHF4cOEHEB_BQuG0nbJbVGNv_ZumEEfoKciyOaPXiMBq_-um0gDySFxFvKaKhOQAyhEhrS-ZaLVm3xFmkAwu4i0 Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 75367f1a874a4d79acbfce528b7e157b Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-DeleteServersTestJSON-1128870768 Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_75367f1a874a4d79acbfce528b7e157b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/75367f1a874a4d79acbfce528b7e157b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75367f1a874a4d79acbfce528b7e157b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75367f1a874a4d79acbfce528b7e157b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-DeleteServersTestJSON-1128870768 Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 75367f1a874a4d79acbfce528b7e157b Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-DeleteServersTestJSON-1128870768 Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-DeleteServersTestJSON-1128870768-project Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 6db0b98c3fa845bab761e25a09d285f8 Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-DeleteServersTestJSON-1128870768-project Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'df6635a2-16fd-455f-acfb-8885e6646681'} Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:47:07.306836 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Returning 404 to user: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a6c86ecf-376b-4512-85b0-eeccd8d85088 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "DELETE /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 404 len: 111 microversion: 2.1 time: 0.031024 Aug 27 05:47:07.311267 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3576/7159] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:47:07 2022] DELETE /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:47:07.317163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:07.317816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] [instance: df6635a2-16fd-455f-acfb-8885e6646681] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:07.324782 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:07.325269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:07.325712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:07.326417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:07.326878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:07.327343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:07.340617 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] HTTP exception thrown: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Request method failure captured: Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 HTTP/1.1 Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCa-ohjbIGkmNDF8ULt8frz1K6475a0H9gytc2l1xUeXLpIDQZd6kAVc_nB_03JRCyxSqStFxJgoH5VbWA_MOcEUAkHF4cOEHEB_BQuG0nbJbVGNv_ZumEEfoKciyOaPXiMBq_-um0gDySFxFvKaKhOQAyhEhrS-ZaLVm3xFmkAwu4i0 Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 75367f1a874a4d79acbfce528b7e157b Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-DeleteServersTestJSON-1128870768 Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_75367f1a874a4d79acbfce528b7e157b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/75367f1a874a4d79acbfce528b7e157b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75367f1a874a4d79acbfce528b7e157b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75367f1a874a4d79acbfce528b7e157b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-DeleteServersTestJSON-1128870768 Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 75367f1a874a4d79acbfce528b7e157b Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-DeleteServersTestJSON-1128870768 Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-DeleteServersTestJSON-1128870768-project Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 6db0b98c3fa845bab761e25a09d285f8 Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-DeleteServersTestJSON-1128870768-project Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'df6635a2-16fd-455f-acfb-8885e6646681'} Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:47:07.342139 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.346237 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:47:07.346237 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:47:07.346237 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:47:07.346237 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:47:07.346237 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:47:07.346237 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. Aug 27 05:47:07.346237 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:47:07.346237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] Returning 404 to user: Instance df6635a2-16fd-455f-acfb-8885e6646681 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:47:07.346237 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e5f3c28e-c389-4a93-8111-ae4ebcd491b1 tempest-DeleteServersTestJSON-1128870768 tempest-DeleteServersTestJSON-1128870768-project] 10.222.0.58 "GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681" status: 404 len: 111 microversion: 2.1 time: 0.030403 Aug 27 05:47:07.346237 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3584/7160] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:07 2022] GET /compute/v2.1/servers/df6635a2-16fd-455f-acfb-8885e6646681 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:47:15.726668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1020027147", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "9a26ba47-0326-4c7c-9e57-22930442fe62"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:15.783751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] validate_networks() for [('9a26ba47-0326-4c7c-9e57-22930442fe62', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:47:16.204802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:47:16.205248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:47:16.205745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:47:16.206175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:47:16.206613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:47:16.217647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:16.218080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:16.218546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:16.219331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:16.219810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:16.220256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:16.242627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Getting quotas for project bf0410f354c544919fc369970768b5b6. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:47:16.248132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Getting quotas for user a992fc48c4c141649c2698094d40cbec and project bf0410f354c544919fc369970768b5b6. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:47:16.261513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:47:16.263722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:47:16.311990 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f352681a-35f0-4db5-b17f-5685eabffaf1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716488 Aug 27 05:47:16.318552 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3577/7161] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:47:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:47:16.324345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c6490bb2-19bb-4fe8-b2c9-46fdabe59b07 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:16.325062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c6490bb2-19bb-4fe8-b2c9-46fdabe59b07 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:16.391737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c6490bb2-19bb-4fe8-b2c9-46fdabe59b07 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:16.399934 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c6490bb2-19bb-4fe8-b2c9-46fdabe59b07 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1218 microversion: 2.1 time: 0.079952 Aug 27 05:47:16.400524 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3585/7162] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:16 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:17.424897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-816e0de8-9d58-46ce-8804-2c6bb20574fb tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:17.426541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-816e0de8-9d58-46ce-8804-2c6bb20574fb tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:17.436786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-816e0de8-9d58-46ce-8804-2c6bb20574fb tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:17.437290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-816e0de8-9d58-46ce-8804-2c6bb20574fb tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:17.437743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-816e0de8-9d58-46ce-8804-2c6bb20574fb tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:17.452738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-816e0de8-9d58-46ce-8804-2c6bb20574fb tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:17.453467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-816e0de8-9d58-46ce-8804-2c6bb20574fb tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:17.454188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-816e0de8-9d58-46ce-8804-2c6bb20574fb tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:17.561772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-816e0de8-9d58-46ce-8804-2c6bb20574fb tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:17.572388 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-816e0de8-9d58-46ce-8804-2c6bb20574fb tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1278 microversion: 2.1 time: 0.152660 Aug 27 05:47:17.573154 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3578/7163] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:17 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:18.592859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a105748a-eba9-40d3-bf6a-5a5a50f59823 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:18.594141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a105748a-eba9-40d3-bf6a-5a5a50f59823 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:18.598234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:18.604539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a105748a-eba9-40d3-bf6a-5a5a50f59823 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:18.605381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a105748a-eba9-40d3-bf6a-5a5a50f59823 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:18.605969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a105748a-eba9-40d3-bf6a-5a5a50f59823 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:18.606848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a105748a-eba9-40d3-bf6a-5a5a50f59823 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:18.607475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a105748a-eba9-40d3-bf6a-5a5a50f59823 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:18.608055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a105748a-eba9-40d3-bf6a-5a5a50f59823 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:18.759341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a105748a-eba9-40d3-bf6a-5a5a50f59823 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:18.785625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8e4e94be-d9a6-4f2a-98c5-ac5907ebd245 req-3cdaeb6c-55e1-47d5-a520-53ed6c140425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55f7c3a-232e-448f-8a99-63a2076b8a0e", "tag": "580c23ad-196b-46d9-b66f-634f63655463"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:18.791555 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a105748a-eba9-40d3-bf6a-5a5a50f59823 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1318 microversion: 2.1 time: 0.201715 Aug 27 05:47:18.797588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8e4e94be-d9a6-4f2a-98c5-ac5907ebd245 req-3cdaeb6c-55e1-47d5-a520-53ed6c140425 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:18.798625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8e4e94be-d9a6-4f2a-98c5-ac5907ebd245 req-3cdaeb6c-55e1-47d5-a520-53ed6c140425 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:18.799269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8e4e94be-d9a6-4f2a-98c5-ac5907ebd245 req-3cdaeb6c-55e1-47d5-a520-53ed6c140425 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:18.804328 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3586/7164] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:18 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:18.816508 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8e4e94be-d9a6-4f2a-98c5-ac5907ebd245 req-3cdaeb6c-55e1-47d5-a520-53ed6c140425 service nova] Creating event network-changed:580c23ad-196b-46d9-b66f-634f63655463 for instance d55f7c3a-232e-448f-8a99-63a2076b8a0e on n-h2-820368-35 Aug 27 05:47:18.827660 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8e4e94be-d9a6-4f2a-98c5-ac5907ebd245 req-3cdaeb6c-55e1-47d5-a520-53ed6c140425 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046994 Aug 27 05:47:18.845231 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3579/7165] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:47:19.825844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c062e685-67d5-4d08-8740-c3b6e7aeaa85 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:19.826462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c062e685-67d5-4d08-8740-c3b6e7aeaa85 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:19.834758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c062e685-67d5-4d08-8740-c3b6e7aeaa85 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:19.835312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c062e685-67d5-4d08-8740-c3b6e7aeaa85 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:19.835752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c062e685-67d5-4d08-8740-c3b6e7aeaa85 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:19.836447 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c062e685-67d5-4d08-8740-c3b6e7aeaa85 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:19.836899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c062e685-67d5-4d08-8740-c3b6e7aeaa85 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:19.837323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c062e685-67d5-4d08-8740-c3b6e7aeaa85 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:19.968098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c062e685-67d5-4d08-8740-c3b6e7aeaa85 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:19.975889 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c062e685-67d5-4d08-8740-c3b6e7aeaa85 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1318 microversion: 2.1 time: 0.154516 Aug 27 05:47:19.976462 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3587/7166] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:19 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:20.998565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-22365ad2-6237-4001-ba7c-2083f3356221 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:20.999303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-22365ad2-6237-4001-ba7c-2083f3356221 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:21.005474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22365ad2-6237-4001-ba7c-2083f3356221 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:21.005975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22365ad2-6237-4001-ba7c-2083f3356221 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:21.006427 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22365ad2-6237-4001-ba7c-2083f3356221 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:21.007158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22365ad2-6237-4001-ba7c-2083f3356221 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:21.007624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22365ad2-6237-4001-ba7c-2083f3356221 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:21.008064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-22365ad2-6237-4001-ba7c-2083f3356221 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:21.140593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-22365ad2-6237-4001-ba7c-2083f3356221 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:21.148588 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-22365ad2-6237-4001-ba7c-2083f3356221 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1318 microversion: 2.1 time: 0.155144 Aug 27 05:47:21.149166 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3580/7167] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:20 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:22.169704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a76ed07d-4694-4b98-b530-e8efd84e8821 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:22.170350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a76ed07d-4694-4b98-b530-e8efd84e8821 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:22.177241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76ed07d-4694-4b98-b530-e8efd84e8821 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:22.177725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76ed07d-4694-4b98-b530-e8efd84e8821 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:22.178162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76ed07d-4694-4b98-b530-e8efd84e8821 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:22.178855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76ed07d-4694-4b98-b530-e8efd84e8821 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:22.179867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76ed07d-4694-4b98-b530-e8efd84e8821 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:22.180294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a76ed07d-4694-4b98-b530-e8efd84e8821 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:22.308434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a76ed07d-4694-4b98-b530-e8efd84e8821 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:22.318168 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a76ed07d-4694-4b98-b530-e8efd84e8821 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1318 microversion: 2.1 time: 0.152454 Aug 27 05:47:22.318776 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3588/7168] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:22 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:23.340815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4f3713d0-e342-461a-85e5-aa3343fbc226 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:23.341477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4f3713d0-e342-461a-85e5-aa3343fbc226 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:23.348282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f3713d0-e342-461a-85e5-aa3343fbc226 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:23.348775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f3713d0-e342-461a-85e5-aa3343fbc226 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:23.349225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f3713d0-e342-461a-85e5-aa3343fbc226 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:23.349929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f3713d0-e342-461a-85e5-aa3343fbc226 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:23.350391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f3713d0-e342-461a-85e5-aa3343fbc226 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:23.351367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f3713d0-e342-461a-85e5-aa3343fbc226 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:23.487351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4f3713d0-e342-461a-85e5-aa3343fbc226 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:23.495725 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4f3713d0-e342-461a-85e5-aa3343fbc226 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1318 microversion: 2.1 time: 0.158896 Aug 27 05:47:23.496300 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3581/7169] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:23 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:24.476661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-aca96beb-785e-4d91-8e20-059a7738718f req-263b32ef-87cd-4153-8d52-bb07292a0bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55f7c3a-232e-448f-8a99-63a2076b8a0e", "name": "network-vif-plugged", "status": "completed", "tag": "580c23ad-196b-46d9-b66f-634f63655463"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:24.488057 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aca96beb-785e-4d91-8e20-059a7738718f req-263b32ef-87cd-4153-8d52-bb07292a0bb2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:24.488548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aca96beb-785e-4d91-8e20-059a7738718f req-263b32ef-87cd-4153-8d52-bb07292a0bb2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:24.488990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aca96beb-785e-4d91-8e20-059a7738718f req-263b32ef-87cd-4153-8d52-bb07292a0bb2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:24.501936 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-aca96beb-785e-4d91-8e20-059a7738718f req-263b32ef-87cd-4153-8d52-bb07292a0bb2 service nova] Creating event network-vif-plugged:580c23ad-196b-46d9-b66f-634f63655463 for instance d55f7c3a-232e-448f-8a99-63a2076b8a0e on n-h2-820368-35 Aug 27 05:47:24.511008 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-aca96beb-785e-4d91-8e20-059a7738718f req-263b32ef-87cd-4153-8d52-bb07292a0bb2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038027 Aug 27 05:47:24.512171 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3589/7170] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:47:24.516640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-52125a26-b6d5-42e2-b2d8-e01b7bc54939 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:24.517557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-52125a26-b6d5-42e2-b2d8-e01b7bc54939 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:24.524839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52125a26-b6d5-42e2-b2d8-e01b7bc54939 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:24.525341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52125a26-b6d5-42e2-b2d8-e01b7bc54939 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:24.525799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52125a26-b6d5-42e2-b2d8-e01b7bc54939 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:24.526525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52125a26-b6d5-42e2-b2d8-e01b7bc54939 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:24.526999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52125a26-b6d5-42e2-b2d8-e01b7bc54939 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:24.527470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-52125a26-b6d5-42e2-b2d8-e01b7bc54939 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:24.672836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-52125a26-b6d5-42e2-b2d8-e01b7bc54939 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:24.680906 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-52125a26-b6d5-42e2-b2d8-e01b7bc54939 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1318 microversion: 2.1 time: 0.168436 Aug 27 05:47:24.681520 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3582/7171] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:24 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:25.703025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-995c338b-9b97-4f58-be4f-b12f6c71240b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:25.703772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-995c338b-9b97-4f58-be4f-b12f6c71240b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:25.710036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995c338b-9b97-4f58-be4f-b12f6c71240b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:25.710519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995c338b-9b97-4f58-be4f-b12f6c71240b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:25.710966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995c338b-9b97-4f58-be4f-b12f6c71240b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:25.711691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995c338b-9b97-4f58-be4f-b12f6c71240b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:25.712155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995c338b-9b97-4f58-be4f-b12f6c71240b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:25.712591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-995c338b-9b97-4f58-be4f-b12f6c71240b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:25.857488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-995c338b-9b97-4f58-be4f-b12f6c71240b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:25.865264 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-995c338b-9b97-4f58-be4f-b12f6c71240b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1318 microversion: 2.1 time: 0.167472 Aug 27 05:47:25.865843 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3590/7172] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:25 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:26.886073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a03cd1ed-f93c-4965-bd24-d01279023d8b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:26.886746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a03cd1ed-f93c-4965-bd24-d01279023d8b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:26.889656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:26.890360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:26.891070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:26.897623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a03cd1ed-f93c-4965-bd24-d01279023d8b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:26.898121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a03cd1ed-f93c-4965-bd24-d01279023d8b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:26.898583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a03cd1ed-f93c-4965-bd24-d01279023d8b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:26.899870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a03cd1ed-f93c-4965-bd24-d01279023d8b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:26.900348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a03cd1ed-f93c-4965-bd24-d01279023d8b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:26.900797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a03cd1ed-f93c-4965-bd24-d01279023d8b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:26.904660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=70 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:27.040874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a03cd1ed-f93c-4965-bd24-d01279023d8b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:27.050595 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a03cd1ed-f93c-4965-bd24-d01279023d8b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1508 microversion: 2.1 time: 0.168581 Aug 27 05:47:27.051452 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3583/7173] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:26 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:27.071798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-540979dd-7c71-4dfc-8327-fee37c711d3a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:27.072417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-540979dd-7c71-4dfc-8327-fee37c711d3a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:27.074414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:27.075895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:27.081707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540979dd-7c71-4dfc-8327-fee37c711d3a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.082187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540979dd-7c71-4dfc-8327-fee37c711d3a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.082786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540979dd-7c71-4dfc-8327-fee37c711d3a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.083553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540979dd-7c71-4dfc-8327-fee37c711d3a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.084037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540979dd-7c71-4dfc-8327-fee37c711d3a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.084457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-540979dd-7c71-4dfc-8327-fee37c711d3a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.218775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-540979dd-7c71-4dfc-8327-fee37c711d3a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:27.226923 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-540979dd-7c71-4dfc-8327-fee37c711d3a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1508 microversion: 2.1 time: 0.159396 Aug 27 05:47:27.227646 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3591/7174] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:27 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:27.247312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-384835ae-bfde-4415-9a15-c3539574eb2e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:27.250306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-384835ae-bfde-4415-9a15-c3539574eb2e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:27.256820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-384835ae-bfde-4415-9a15-c3539574eb2e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.257324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-384835ae-bfde-4415-9a15-c3539574eb2e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.257780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-384835ae-bfde-4415-9a15-c3539574eb2e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.259108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-384835ae-bfde-4415-9a15-c3539574eb2e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.259581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-384835ae-bfde-4415-9a15-c3539574eb2e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.260024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-384835ae-bfde-4415-9a15-c3539574eb2e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.325032 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-384835ae-bfde-4415-9a15-c3539574eb2e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "PUT /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1080 microversion: 2.1 time: 0.081916 Aug 27 05:47:27.325657 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3584/7175] 10.222.0.58 () {60 vars in 1256 bytes} [Sat Aug 27 05:47:27 2022] PUT /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1080 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:27.343602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb9834c9-e969-4781-82f5-232aa4532246 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:27.344214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cb9834c9-e969-4781-82f5-232aa4532246 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:27.350163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb9834c9-e969-4781-82f5-232aa4532246 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.350659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb9834c9-e969-4781-82f5-232aa4532246 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.351082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb9834c9-e969-4781-82f5-232aa4532246 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.351806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb9834c9-e969-4781-82f5-232aa4532246 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.352312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb9834c9-e969-4781-82f5-232aa4532246 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.352780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb9834c9-e969-4781-82f5-232aa4532246 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.486069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cb9834c9-e969-4781-82f5-232aa4532246 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:27.494459 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb9834c9-e969-4781-82f5-232aa4532246 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1506 microversion: 2.1 time: 0.154973 Aug 27 05:47:27.495031 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3592/7176] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:27 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:27.514955 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5c24b580-254e-4a79-830c-eb9f689d9987 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:27.515553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5c24b580-254e-4a79-830c-eb9f689d9987 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:27.521603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c24b580-254e-4a79-830c-eb9f689d9987 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.522106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c24b580-254e-4a79-830c-eb9f689d9987 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.522561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c24b580-254e-4a79-830c-eb9f689d9987 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.523303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c24b580-254e-4a79-830c-eb9f689d9987 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.523776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c24b580-254e-4a79-830c-eb9f689d9987 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.524222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5c24b580-254e-4a79-830c-eb9f689d9987 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.655973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5c24b580-254e-4a79-830c-eb9f689d9987 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:27.665496 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5c24b580-254e-4a79-830c-eb9f689d9987 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1506 microversion: 2.1 time: 0.154476 Aug 27 05:47:27.666076 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3585/7177] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:27 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:27.685801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:27.688094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:27.693957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.694438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.694874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.695596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.696706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.697130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.724884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:27.731154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Old instance type m1.heat2, new instance type m1.heat {{(pid=128548) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:47:27.737619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:47:27.738041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:47:27.738517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:47:27.738937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:47:27.739367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:47:27.802451 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a3cceea1-efa6-4b6c-8a02-b17b5cdc98e8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "POST /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e/action" status: 202 len: 0 microversion: 2.1 time: 0.120397 Aug 27 05:47:27.803374 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3593/7178] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:47:27 2022] POST /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:47:27.812715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a85fe92d-41e8-4a5c-a698-b7c265f999a6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:27.813451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a85fe92d-41e8-4a5c-a698-b7c265f999a6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:27.819538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85fe92d-41e8-4a5c-a698-b7c265f999a6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.820048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85fe92d-41e8-4a5c-a698-b7c265f999a6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.820505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85fe92d-41e8-4a5c-a698-b7c265f999a6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.821223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85fe92d-41e8-4a5c-a698-b7c265f999a6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:27.821698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85fe92d-41e8-4a5c-a698-b7c265f999a6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:27.822144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a85fe92d-41e8-4a5c-a698-b7c265f999a6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:27.976831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a85fe92d-41e8-4a5c-a698-b7c265f999a6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:27.985161 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a85fe92d-41e8-4a5c-a698-b7c265f999a6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1517 microversion: 2.1 time: 0.176427 Aug 27 05:47:27.985745 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3586/7179] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:27 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:29.007618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0dbfdb98-3be7-4bca-a453-27b57e220097 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:29.008241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0dbfdb98-3be7-4bca-a453-27b57e220097 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:29.015069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0dbfdb98-3be7-4bca-a453-27b57e220097 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:29.015583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0dbfdb98-3be7-4bca-a453-27b57e220097 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:29.016031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0dbfdb98-3be7-4bca-a453-27b57e220097 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:29.016735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0dbfdb98-3be7-4bca-a453-27b57e220097 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:29.017191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0dbfdb98-3be7-4bca-a453-27b57e220097 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:29.017621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0dbfdb98-3be7-4bca-a453-27b57e220097 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:29.160097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0dbfdb98-3be7-4bca-a453-27b57e220097 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:29.169159 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0dbfdb98-3be7-4bca-a453-27b57e220097 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1517 microversion: 2.1 time: 0.166340 Aug 27 05:47:29.169751 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3594/7180] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:29 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:30.189957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5b39b1b2-b7b7-4bb0-b396-c0ee5f4adab2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:30.190596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5b39b1b2-b7b7-4bb0-b396-c0ee5f4adab2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:30.197942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b39b1b2-b7b7-4bb0-b396-c0ee5f4adab2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:30.198445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b39b1b2-b7b7-4bb0-b396-c0ee5f4adab2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:30.198899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b39b1b2-b7b7-4bb0-b396-c0ee5f4adab2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:30.199651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b39b1b2-b7b7-4bb0-b396-c0ee5f4adab2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:30.200125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b39b1b2-b7b7-4bb0-b396-c0ee5f4adab2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:30.200569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5b39b1b2-b7b7-4bb0-b396-c0ee5f4adab2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:30.340561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5b39b1b2-b7b7-4bb0-b396-c0ee5f4adab2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:30.349335 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5b39b1b2-b7b7-4bb0-b396-c0ee5f4adab2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.163050 Aug 27 05:47:30.349924 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3587/7181] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:30 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:31.371307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2f5d0d52-d638-4396-9fa1-350b21b809af tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:31.371922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2f5d0d52-d638-4396-9fa1-350b21b809af tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:31.378852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f5d0d52-d638-4396-9fa1-350b21b809af tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:31.379372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f5d0d52-d638-4396-9fa1-350b21b809af tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:31.379815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f5d0d52-d638-4396-9fa1-350b21b809af tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:31.380514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f5d0d52-d638-4396-9fa1-350b21b809af tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:31.380973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f5d0d52-d638-4396-9fa1-350b21b809af tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:31.381402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2f5d0d52-d638-4396-9fa1-350b21b809af tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:31.509705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2f5d0d52-d638-4396-9fa1-350b21b809af tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:31.517369 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2f5d0d52-d638-4396-9fa1-350b21b809af tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.150050 Aug 27 05:47:31.517944 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3595/7182] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:31 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:32.539297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f37a0c64-bd9f-4967-998a-8e66051b314c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:32.539926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f37a0c64-bd9f-4967-998a-8e66051b314c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:32.546846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f37a0c64-bd9f-4967-998a-8e66051b314c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:32.547375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f37a0c64-bd9f-4967-998a-8e66051b314c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:32.547832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f37a0c64-bd9f-4967-998a-8e66051b314c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:32.548541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f37a0c64-bd9f-4967-998a-8e66051b314c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:32.549009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f37a0c64-bd9f-4967-998a-8e66051b314c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:32.549454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f37a0c64-bd9f-4967-998a-8e66051b314c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:32.683452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f37a0c64-bd9f-4967-998a-8e66051b314c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:32.691258 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f37a0c64-bd9f-4967-998a-8e66051b314c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.156124 Aug 27 05:47:32.691822 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3588/7183] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:32 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:33.714137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c2ea31d0-a87c-47a6-8f45-fe3ff54089cf tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:33.714750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c2ea31d0-a87c-47a6-8f45-fe3ff54089cf tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:33.721610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2ea31d0-a87c-47a6-8f45-fe3ff54089cf tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:33.722095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2ea31d0-a87c-47a6-8f45-fe3ff54089cf tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:33.722542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2ea31d0-a87c-47a6-8f45-fe3ff54089cf tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:33.723271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2ea31d0-a87c-47a6-8f45-fe3ff54089cf tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:33.723732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2ea31d0-a87c-47a6-8f45-fe3ff54089cf tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:33.724165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c2ea31d0-a87c-47a6-8f45-fe3ff54089cf tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:33.853326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c2ea31d0-a87c-47a6-8f45-fe3ff54089cf tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:33.860849 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c2ea31d0-a87c-47a6-8f45-fe3ff54089cf tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.150859 Aug 27 05:47:33.861428 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3596/7184] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:33 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:34.882424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a40efa01-713a-48b1-979f-552c93c9ea3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:34.883048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a40efa01-713a-48b1-979f-552c93c9ea3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:34.890300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a40efa01-713a-48b1-979f-552c93c9ea3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:34.890794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a40efa01-713a-48b1-979f-552c93c9ea3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:34.891282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a40efa01-713a-48b1-979f-552c93c9ea3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:34.891990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a40efa01-713a-48b1-979f-552c93c9ea3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:34.892460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a40efa01-713a-48b1-979f-552c93c9ea3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:34.892896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a40efa01-713a-48b1-979f-552c93c9ea3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:35.030409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a40efa01-713a-48b1-979f-552c93c9ea3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:35.038622 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a40efa01-713a-48b1-979f-552c93c9ea3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.160060 Aug 27 05:47:35.039231 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3589/7185] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:34 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:36.061111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-057d17e6-5d16-458d-b5fb-0bb80c7af74b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:36.061640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-057d17e6-5d16-458d-b5fb-0bb80c7af74b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:36.068531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-057d17e6-5d16-458d-b5fb-0bb80c7af74b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:36.069018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-057d17e6-5d16-458d-b5fb-0bb80c7af74b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:36.069462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-057d17e6-5d16-458d-b5fb-0bb80c7af74b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:36.070161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-057d17e6-5d16-458d-b5fb-0bb80c7af74b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:36.070621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-057d17e6-5d16-458d-b5fb-0bb80c7af74b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:36.071051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-057d17e6-5d16-458d-b5fb-0bb80c7af74b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:36.202507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-057d17e6-5d16-458d-b5fb-0bb80c7af74b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:36.210216 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-057d17e6-5d16-458d-b5fb-0bb80c7af74b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.153177 Aug 27 05:47:36.210790 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3597/7186] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:36 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:37.231471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5832078c-499d-4063-bc75-c4ad1b030049 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:37.232095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5832078c-499d-4063-bc75-c4ad1b030049 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:37.239109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5832078c-499d-4063-bc75-c4ad1b030049 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:37.239620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5832078c-499d-4063-bc75-c4ad1b030049 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:37.240064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5832078c-499d-4063-bc75-c4ad1b030049 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:37.240770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5832078c-499d-4063-bc75-c4ad1b030049 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:37.241239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5832078c-499d-4063-bc75-c4ad1b030049 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:37.241679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5832078c-499d-4063-bc75-c4ad1b030049 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:37.372457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5832078c-499d-4063-bc75-c4ad1b030049 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:37.380254 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5832078c-499d-4063-bc75-c4ad1b030049 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.152708 Aug 27 05:47:37.380829 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3590/7187] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:37 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:38.402186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9d3e34f5-e34e-400f-822d-7ab10e7a0c81 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:38.402821 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9d3e34f5-e34e-400f-822d-7ab10e7a0c81 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:38.409766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3e34f5-e34e-400f-822d-7ab10e7a0c81 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:38.410244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3e34f5-e34e-400f-822d-7ab10e7a0c81 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:38.410683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3e34f5-e34e-400f-822d-7ab10e7a0c81 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:38.411397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3e34f5-e34e-400f-822d-7ab10e7a0c81 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:38.412113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3e34f5-e34e-400f-822d-7ab10e7a0c81 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:38.412534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9d3e34f5-e34e-400f-822d-7ab10e7a0c81 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:38.863903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9d3e34f5-e34e-400f-822d-7ab10e7a0c81 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:38.872451 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9d3e34f5-e34e-400f-822d-7ab10e7a0c81 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.474797 Aug 27 05:47:38.873028 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3598/7188] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:38 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:39.894048 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ce830706-7b79-4580-9f12-76248e0699f5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:39.894676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ce830706-7b79-4580-9f12-76248e0699f5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:39.901819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce830706-7b79-4580-9f12-76248e0699f5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:39.902326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce830706-7b79-4580-9f12-76248e0699f5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:39.902780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce830706-7b79-4580-9f12-76248e0699f5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:39.903535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce830706-7b79-4580-9f12-76248e0699f5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:39.904005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce830706-7b79-4580-9f12-76248e0699f5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:39.904599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce830706-7b79-4580-9f12-76248e0699f5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:40.034839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ce830706-7b79-4580-9f12-76248e0699f5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:40.043506 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ce830706-7b79-4580-9f12-76248e0699f5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.153456 Aug 27 05:47:40.044077 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3591/7189] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:39 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:41.065162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f29d08e8-80f6-4b44-86da-fcc789290a72 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:41.065700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f29d08e8-80f6-4b44-86da-fcc789290a72 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:41.072873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29d08e8-80f6-4b44-86da-fcc789290a72 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:41.073358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29d08e8-80f6-4b44-86da-fcc789290a72 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:41.073879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29d08e8-80f6-4b44-86da-fcc789290a72 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:41.074581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29d08e8-80f6-4b44-86da-fcc789290a72 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:41.075058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29d08e8-80f6-4b44-86da-fcc789290a72 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:41.075664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f29d08e8-80f6-4b44-86da-fcc789290a72 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:41.211304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f29d08e8-80f6-4b44-86da-fcc789290a72 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:41.219757 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f29d08e8-80f6-4b44-86da-fcc789290a72 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.158735 Aug 27 05:47:41.220343 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3599/7190] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:41 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:42.241017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-02d3ee1c-33e5-4a48-91b7-044a22b9d19f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:42.241653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-02d3ee1c-33e5-4a48-91b7-044a22b9d19f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:42.249499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d3ee1c-33e5-4a48-91b7-044a22b9d19f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:42.250000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d3ee1c-33e5-4a48-91b7-044a22b9d19f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:42.250453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d3ee1c-33e5-4a48-91b7-044a22b9d19f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:42.251197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d3ee1c-33e5-4a48-91b7-044a22b9d19f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:42.251667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d3ee1c-33e5-4a48-91b7-044a22b9d19f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:42.252105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02d3ee1c-33e5-4a48-91b7-044a22b9d19f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:42.387921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02d3ee1c-33e5-4a48-91b7-044a22b9d19f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:42.396036 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-02d3ee1c-33e5-4a48-91b7-044a22b9d19f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.158927 Aug 27 05:47:42.396697 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3592/7191] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:42 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:43.417916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cf99704b-b39f-4b63-96c7-da897c59150c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:43.418539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cf99704b-b39f-4b63-96c7-da897c59150c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:43.425521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf99704b-b39f-4b63-96c7-da897c59150c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:43.426034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf99704b-b39f-4b63-96c7-da897c59150c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:43.426474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf99704b-b39f-4b63-96c7-da897c59150c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:43.427212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf99704b-b39f-4b63-96c7-da897c59150c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:43.427675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf99704b-b39f-4b63-96c7-da897c59150c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:43.428110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cf99704b-b39f-4b63-96c7-da897c59150c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:43.566628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cf99704b-b39f-4b63-96c7-da897c59150c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:43.574973 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cf99704b-b39f-4b63-96c7-da897c59150c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.161031 Aug 27 05:47:43.575578 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3600/7192] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:43 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:44.596887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6882aa0d-5724-4697-ae48-105130c5bdf5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:44.597761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6882aa0d-5724-4697-ae48-105130c5bdf5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:44.605271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6882aa0d-5724-4697-ae48-105130c5bdf5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:44.605777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6882aa0d-5724-4697-ae48-105130c5bdf5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:44.606239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6882aa0d-5724-4697-ae48-105130c5bdf5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:44.606961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6882aa0d-5724-4697-ae48-105130c5bdf5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:44.607465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6882aa0d-5724-4697-ae48-105130c5bdf5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:44.607908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6882aa0d-5724-4697-ae48-105130c5bdf5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:44.737370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6882aa0d-5724-4697-ae48-105130c5bdf5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:44.745163 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6882aa0d-5724-4697-ae48-105130c5bdf5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.152361 Aug 27 05:47:44.745732 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3593/7193] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:44 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:45.766201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1542683-56d6-4745-9673-0316e6325fef tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:45.766823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a1542683-56d6-4745-9673-0316e6325fef tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:45.773693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1542683-56d6-4745-9673-0316e6325fef tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:45.774180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1542683-56d6-4745-9673-0316e6325fef tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:45.774615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1542683-56d6-4745-9673-0316e6325fef tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:45.775338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1542683-56d6-4745-9673-0316e6325fef tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:45.775792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1542683-56d6-4745-9673-0316e6325fef tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:45.776244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1542683-56d6-4745-9673-0316e6325fef tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:45.916188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a1542683-56d6-4745-9673-0316e6325fef tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:45.919867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:45.924868 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a1542683-56d6-4745-9673-0316e6325fef tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.162567 Aug 27 05:47:45.925443 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3601/7194] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:45 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:46.946759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3351498c-726d-43da-99c2-a98cad0ad174 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:46.947415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3351498c-726d-43da-99c2-a98cad0ad174 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:46.954583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3351498c-726d-43da-99c2-a98cad0ad174 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:46.955076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3351498c-726d-43da-99c2-a98cad0ad174 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:46.955556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3351498c-726d-43da-99c2-a98cad0ad174 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:46.956252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3351498c-726d-43da-99c2-a98cad0ad174 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:46.956718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3351498c-726d-43da-99c2-a98cad0ad174 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:46.957154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3351498c-726d-43da-99c2-a98cad0ad174 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:47.088766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3351498c-726d-43da-99c2-a98cad0ad174 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:47.096722 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3351498c-726d-43da-99c2-a98cad0ad174 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.154732 Aug 27 05:47:47.097298 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3594/7195] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:46 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:48.116983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b96ff1db-aff3-4a3c-9c67-475d348d5e10 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:48.118115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b96ff1db-aff3-4a3c-9c67-475d348d5e10 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:48.127025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b96ff1db-aff3-4a3c-9c67-475d348d5e10 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:48.127554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b96ff1db-aff3-4a3c-9c67-475d348d5e10 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:48.128004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b96ff1db-aff3-4a3c-9c67-475d348d5e10 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:48.128714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b96ff1db-aff3-4a3c-9c67-475d348d5e10 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:48.129179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b96ff1db-aff3-4a3c-9c67-475d348d5e10 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:48.129612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b96ff1db-aff3-4a3c-9c67-475d348d5e10 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:48.259023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b96ff1db-aff3-4a3c-9c67-475d348d5e10 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:48.266840 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b96ff1db-aff3-4a3c-9c67-475d348d5e10 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.153902 Aug 27 05:47:48.267447 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3602/7196] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:48 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:49.288249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68c5c690-a95b-44d9-bb6c-2d0c096cfd44 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:49.290737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68c5c690-a95b-44d9-bb6c-2d0c096cfd44 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:49.295996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c5c690-a95b-44d9-bb6c-2d0c096cfd44 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:49.296493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c5c690-a95b-44d9-bb6c-2d0c096cfd44 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:49.296949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c5c690-a95b-44d9-bb6c-2d0c096cfd44 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:49.297669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c5c690-a95b-44d9-bb6c-2d0c096cfd44 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:49.298161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c5c690-a95b-44d9-bb6c-2d0c096cfd44 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:49.298581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c5c690-a95b-44d9-bb6c-2d0c096cfd44 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:49.437108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68c5c690-a95b-44d9-bb6c-2d0c096cfd44 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:49.444926 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68c5c690-a95b-44d9-bb6c-2d0c096cfd44 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.160921 Aug 27 05:47:49.445537 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3595/7197] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:49 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:50.467204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b64f3a16-f584-4a74-86fd-fc25c3947ec0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:50.467831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b64f3a16-f584-4a74-86fd-fc25c3947ec0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:50.474789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b64f3a16-f584-4a74-86fd-fc25c3947ec0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:50.475323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b64f3a16-f584-4a74-86fd-fc25c3947ec0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:50.475788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b64f3a16-f584-4a74-86fd-fc25c3947ec0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:50.477193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b64f3a16-f584-4a74-86fd-fc25c3947ec0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:50.477685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b64f3a16-f584-4a74-86fd-fc25c3947ec0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:50.478097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b64f3a16-f584-4a74-86fd-fc25c3947ec0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:50.611846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b64f3a16-f584-4a74-86fd-fc25c3947ec0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:50.619811 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b64f3a16-f584-4a74-86fd-fc25c3947ec0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.156728 Aug 27 05:47:50.620353 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3603/7198] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:50 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:51.641015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5fca064d-9f31-486a-92ba-80ed0978a2b7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:51.641647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5fca064d-9f31-486a-92ba-80ed0978a2b7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:51.648664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fca064d-9f31-486a-92ba-80ed0978a2b7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:51.649169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fca064d-9f31-486a-92ba-80ed0978a2b7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:51.649627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fca064d-9f31-486a-92ba-80ed0978a2b7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:51.650930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fca064d-9f31-486a-92ba-80ed0978a2b7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:51.651492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fca064d-9f31-486a-92ba-80ed0978a2b7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:51.651936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5fca064d-9f31-486a-92ba-80ed0978a2b7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:51.794452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5fca064d-9f31-486a-92ba-80ed0978a2b7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:51.803210 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5fca064d-9f31-486a-92ba-80ed0978a2b7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.165996 Aug 27 05:47:51.803808 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3596/7199] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:51 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:52.824744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2ff6b1e1-0918-4748-ae71-d388dee1df8a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:52.825367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2ff6b1e1-0918-4748-ae71-d388dee1df8a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:52.832271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff6b1e1-0918-4748-ae71-d388dee1df8a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:52.832767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff6b1e1-0918-4748-ae71-d388dee1df8a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:52.833211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff6b1e1-0918-4748-ae71-d388dee1df8a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:52.833921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff6b1e1-0918-4748-ae71-d388dee1df8a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:52.834381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff6b1e1-0918-4748-ae71-d388dee1df8a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:52.834812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ff6b1e1-0918-4748-ae71-d388dee1df8a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:52.976836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2ff6b1e1-0918-4748-ae71-d388dee1df8a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:52.985232 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2ff6b1e1-0918-4748-ae71-d388dee1df8a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.164462 Aug 27 05:47:52.985811 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3604/7200] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:52 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:54.006138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-395d2075-afa8-4430-b2e5-cfeb2b66b4d4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:54.006791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-395d2075-afa8-4430-b2e5-cfeb2b66b4d4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:54.014134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-395d2075-afa8-4430-b2e5-cfeb2b66b4d4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:54.014638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-395d2075-afa8-4430-b2e5-cfeb2b66b4d4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:54.015110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-395d2075-afa8-4430-b2e5-cfeb2b66b4d4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:54.015874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-395d2075-afa8-4430-b2e5-cfeb2b66b4d4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:54.016348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-395d2075-afa8-4430-b2e5-cfeb2b66b4d4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:54.016835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-395d2075-afa8-4430-b2e5-cfeb2b66b4d4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:54.153083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-395d2075-afa8-4430-b2e5-cfeb2b66b4d4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:54.161502 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-395d2075-afa8-4430-b2e5-cfeb2b66b4d4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.159575 Aug 27 05:47:54.162377 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3597/7201] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:54 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:55.184819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-be4c5aef-c47e-4e20-8cfe-e91b85a01703 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:55.185443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-be4c5aef-c47e-4e20-8cfe-e91b85a01703 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:55.192423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4c5aef-c47e-4e20-8cfe-e91b85a01703 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:55.192916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4c5aef-c47e-4e20-8cfe-e91b85a01703 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:55.193365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4c5aef-c47e-4e20-8cfe-e91b85a01703 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:55.194084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4c5aef-c47e-4e20-8cfe-e91b85a01703 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:55.194544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4c5aef-c47e-4e20-8cfe-e91b85a01703 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:55.194980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4c5aef-c47e-4e20-8cfe-e91b85a01703 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:55.335421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-be4c5aef-c47e-4e20-8cfe-e91b85a01703 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:55.343419 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-be4c5aef-c47e-4e20-8cfe-e91b85a01703 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.163090 Aug 27 05:47:55.343997 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3605/7202] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:55 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:56.364903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e7effdd-0df5-46af-a719-40045c21edad tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:56.365529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1e7effdd-0df5-46af-a719-40045c21edad tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:56.372681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7effdd-0df5-46af-a719-40045c21edad tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:56.373187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7effdd-0df5-46af-a719-40045c21edad tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:56.373647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7effdd-0df5-46af-a719-40045c21edad tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:56.374391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7effdd-0df5-46af-a719-40045c21edad tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:56.374861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7effdd-0df5-46af-a719-40045c21edad tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:56.375404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1e7effdd-0df5-46af-a719-40045c21edad tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:56.522040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1e7effdd-0df5-46af-a719-40045c21edad tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:56.530501 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e7effdd-0df5-46af-a719-40045c21edad tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1522 microversion: 2.1 time: 0.169922 Aug 27 05:47:56.531074 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3598/7203] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:56 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:57.226314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-2f85dea3-ff51-446c-b283-9c584a745574 req-d90aa868-18c6-4b71-9c5b-d56b75521a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55f7c3a-232e-448f-8a99-63a2076b8a0e", "name": "network-vif-unplugged", "status": "completed", "tag": "580c23ad-196b-46d9-b66f-634f63655463"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:57.232959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=34 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:57.239879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2f85dea3-ff51-446c-b283-9c584a745574 req-d90aa868-18c6-4b71-9c5b-d56b75521a86 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:57.242016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2f85dea3-ff51-446c-b283-9c584a745574 req-d90aa868-18c6-4b71-9c5b-d56b75521a86 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:57.242016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2f85dea3-ff51-446c-b283-9c584a745574 req-d90aa868-18c6-4b71-9c5b-d56b75521a86 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:57.254477 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-2f85dea3-ff51-446c-b283-9c584a745574 req-d90aa868-18c6-4b71-9c5b-d56b75521a86 service nova] Creating event network-vif-unplugged:580c23ad-196b-46d9-b66f-634f63655463 for instance d55f7c3a-232e-448f-8a99-63a2076b8a0e on n-h1-820368-35 Aug 27 05:47:57.260467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-2f85dea3-ff51-446c-b283-9c584a745574 req-d90aa868-18c6-4b71-9c5b-d56b75521a86 service nova] Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:47:57.272171 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-2f85dea3-ff51-446c-b283-9c584a745574 req-d90aa868-18c6-4b71-9c5b-d56b75521a86 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049692 Aug 27 05:47:57.272805 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3606/7204] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:47:57.553295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14038e3f-e8d5-4295-a34a-203152757463 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:57.553844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14038e3f-e8d5-4295-a34a-203152757463 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:57.556732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=32 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:57.562584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14038e3f-e8d5-4295-a34a-203152757463 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:57.563108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14038e3f-e8d5-4295-a34a-203152757463 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:57.563569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14038e3f-e8d5-4295-a34a-203152757463 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:57.564307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14038e3f-e8d5-4295-a34a-203152757463 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:57.564776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14038e3f-e8d5-4295-a34a-203152757463 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:57.565221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14038e3f-e8d5-4295-a34a-203152757463 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:57.568205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:57.721176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14038e3f-e8d5-4295-a34a-203152757463 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:57.729442 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14038e3f-e8d5-4295-a34a-203152757463 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1521 microversion: 2.1 time: 0.180155 Aug 27 05:47:57.739429 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3599/7205] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:57 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:58.751189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c5f05ace-272e-4178-b831-7525743a917d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:58.751897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c5f05ace-272e-4178-b831-7525743a917d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:58.758076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5f05ace-272e-4178-b831-7525743a917d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:58.758564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5f05ace-272e-4178-b831-7525743a917d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:58.759008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5f05ace-272e-4178-b831-7525743a917d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:58.760233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5f05ace-272e-4178-b831-7525743a917d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:58.760693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5f05ace-272e-4178-b831-7525743a917d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:58.761121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c5f05ace-272e-4178-b831-7525743a917d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:58.893839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c5f05ace-272e-4178-b831-7525743a917d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:58.901755 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c5f05ace-272e-4178-b831-7525743a917d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1519 microversion: 2.1 time: 0.155588 Aug 27 05:47:58.902344 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3607/7206] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:58 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:59.292311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-080c113f-f372-4471-b750-a17f6b49066f req-3881f96c-5059-4d19-9bb7-35956a4fde9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55f7c3a-232e-448f-8a99-63a2076b8a0e", "tag": "580c23ad-196b-46d9-b66f-634f63655463"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:59.303031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-080c113f-f372-4471-b750-a17f6b49066f req-3881f96c-5059-4d19-9bb7-35956a4fde9f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:59.303574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-080c113f-f372-4471-b750-a17f6b49066f req-3881f96c-5059-4d19-9bb7-35956a4fde9f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:59.304028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-080c113f-f372-4471-b750-a17f6b49066f req-3881f96c-5059-4d19-9bb7-35956a4fde9f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:59.317530 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-080c113f-f372-4471-b750-a17f6b49066f req-3881f96c-5059-4d19-9bb7-35956a4fde9f service nova] Creating event network-changed:580c23ad-196b-46d9-b66f-634f63655463 for instance d55f7c3a-232e-448f-8a99-63a2076b8a0e on n-h1-820368-35 Aug 27 05:47:59.323156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-080c113f-f372-4471-b750-a17f6b49066f req-3881f96c-5059-4d19-9bb7-35956a4fde9f service nova] Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:47:59.334589 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-080c113f-f372-4471-b750-a17f6b49066f req-3881f96c-5059-4d19-9bb7-35956a4fde9f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046459 Aug 27 05:47:59.335448 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3600/7207] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:47:59.924992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-da8379b5-4588-4101-bf64-83f967528f7e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:59.925615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-da8379b5-4588-4101-bf64-83f967528f7e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:59.932347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da8379b5-4588-4101-bf64-83f967528f7e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:59.932866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da8379b5-4588-4101-bf64-83f967528f7e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:59.933318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da8379b5-4588-4101-bf64-83f967528f7e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:59.934053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da8379b5-4588-4101-bf64-83f967528f7e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:59.934514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da8379b5-4588-4101-bf64-83f967528f7e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:59.934946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da8379b5-4588-4101-bf64-83f967528f7e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:00.083454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-da8379b5-4588-4101-bf64-83f967528f7e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:00.098499 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-da8379b5-4588-4101-bf64-83f967528f7e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1519 microversion: 2.1 time: 0.178394 Aug 27 05:48:00.099108 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3608/7208] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:59 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:01.120710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2866fcbf-21b8-42a6-8fa9-8f318effaf9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:01.121384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2866fcbf-21b8-42a6-8fa9-8f318effaf9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:01.128660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2866fcbf-21b8-42a6-8fa9-8f318effaf9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:01.129149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2866fcbf-21b8-42a6-8fa9-8f318effaf9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:01.129598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2866fcbf-21b8-42a6-8fa9-8f318effaf9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:01.130297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2866fcbf-21b8-42a6-8fa9-8f318effaf9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:01.130761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2866fcbf-21b8-42a6-8fa9-8f318effaf9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:01.131221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2866fcbf-21b8-42a6-8fa9-8f318effaf9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:01.265502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2866fcbf-21b8-42a6-8fa9-8f318effaf9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:01.273544 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2866fcbf-21b8-42a6-8fa9-8f318effaf9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1519 microversion: 2.1 time: 0.157176 Aug 27 05:48:01.274121 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3601/7209] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:01 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:02.295244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b8c2c8b5-a609-4a29-8f11-9a95a9c8ff38 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:02.295855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b8c2c8b5-a609-4a29-8f11-9a95a9c8ff38 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:02.302714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8c2c8b5-a609-4a29-8f11-9a95a9c8ff38 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:02.303235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8c2c8b5-a609-4a29-8f11-9a95a9c8ff38 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:02.303671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8c2c8b5-a609-4a29-8f11-9a95a9c8ff38 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:02.304364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8c2c8b5-a609-4a29-8f11-9a95a9c8ff38 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:02.304816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8c2c8b5-a609-4a29-8f11-9a95a9c8ff38 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:02.305238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8c2c8b5-a609-4a29-8f11-9a95a9c8ff38 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:02.437641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b8c2c8b5-a609-4a29-8f11-9a95a9c8ff38 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:02.445586 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b8c2c8b5-a609-4a29-8f11-9a95a9c8ff38 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1516 microversion: 2.1 time: 0.155169 Aug 27 05:48:02.446166 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3609/7210] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:02 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:02.465816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b4825df-5d56-43f1-b2aa-54561feae131 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:02.466367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b4825df-5d56-43f1-b2aa-54561feae131 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:02.473235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4825df-5d56-43f1-b2aa-54561feae131 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:02.473788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4825df-5d56-43f1-b2aa-54561feae131 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:02.474241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4825df-5d56-43f1-b2aa-54561feae131 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:02.474952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4825df-5d56-43f1-b2aa-54561feae131 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:02.475444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4825df-5d56-43f1-b2aa-54561feae131 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:02.475898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4825df-5d56-43f1-b2aa-54561feae131 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:02.547525 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b4825df-5d56-43f1-b2aa-54561feae131 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "POST /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e/action" status: 204 len: 0 microversion: 2.1 time: 0.085543 Aug 27 05:48:02.548199 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3602/7211] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:48:02 2022] POST /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:48:02.556436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dec1d985-fa77-43e9-b0bc-11b98059df50 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:02.557177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dec1d985-fa77-43e9-b0bc-11b98059df50 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:02.564045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dec1d985-fa77-43e9-b0bc-11b98059df50 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:02.564556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dec1d985-fa77-43e9-b0bc-11b98059df50 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:02.564991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dec1d985-fa77-43e9-b0bc-11b98059df50 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:02.565854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dec1d985-fa77-43e9-b0bc-11b98059df50 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:02.566292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dec1d985-fa77-43e9-b0bc-11b98059df50 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:02.566822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dec1d985-fa77-43e9-b0bc-11b98059df50 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:02.726589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dec1d985-fa77-43e9-b0bc-11b98059df50 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:02.735881 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dec1d985-fa77-43e9-b0bc-11b98059df50 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1516 microversion: 2.1 time: 0.183286 Aug 27 05:48:02.736808 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3610/7212] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:02 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:03.758112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5a760783-c5ed-42ad-9e72-77f22fceb130 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:03.758828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5a760783-c5ed-42ad-9e72-77f22fceb130 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:03.766916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a760783-c5ed-42ad-9e72-77f22fceb130 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:03.767660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a760783-c5ed-42ad-9e72-77f22fceb130 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:03.767917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a760783-c5ed-42ad-9e72-77f22fceb130 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:03.768635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a760783-c5ed-42ad-9e72-77f22fceb130 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:03.769106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a760783-c5ed-42ad-9e72-77f22fceb130 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:03.769549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a760783-c5ed-42ad-9e72-77f22fceb130 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:03.913022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5a760783-c5ed-42ad-9e72-77f22fceb130 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:03.923322 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5a760783-c5ed-42ad-9e72-77f22fceb130 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1516 microversion: 2.1 time: 0.169383 Aug 27 05:48:03.937824 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3603/7213] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:03 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:04.945147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e496b71-5510-4247-a6b5-67db8af8e8ae tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:04.945761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2e496b71-5510-4247-a6b5-67db8af8e8ae tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:04.952190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e496b71-5510-4247-a6b5-67db8af8e8ae tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:04.952672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e496b71-5510-4247-a6b5-67db8af8e8ae tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:04.953111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e496b71-5510-4247-a6b5-67db8af8e8ae tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:04.953805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e496b71-5510-4247-a6b5-67db8af8e8ae tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:04.954257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e496b71-5510-4247-a6b5-67db8af8e8ae tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:04.954687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e496b71-5510-4247-a6b5-67db8af8e8ae tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:05.090617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2e496b71-5510-4247-a6b5-67db8af8e8ae tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:05.098403 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2e496b71-5510-4247-a6b5-67db8af8e8ae tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1508 microversion: 2.1 time: 0.157280 Aug 27 05:48:05.098981 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3611/7214] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:04 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:05.118681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-267a89ad-57c7-4066-950a-1bb52b9b49e3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:05.119352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-267a89ad-57c7-4066-950a-1bb52b9b49e3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:05.126238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-267a89ad-57c7-4066-950a-1bb52b9b49e3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:05.126743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-267a89ad-57c7-4066-950a-1bb52b9b49e3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:05.127238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-267a89ad-57c7-4066-950a-1bb52b9b49e3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:05.127957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-267a89ad-57c7-4066-950a-1bb52b9b49e3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:05.128433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-267a89ad-57c7-4066-950a-1bb52b9b49e3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:05.128879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-267a89ad-57c7-4066-950a-1bb52b9b49e3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:05.255656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-267a89ad-57c7-4066-950a-1bb52b9b49e3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:05.263934 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-267a89ad-57c7-4066-950a-1bb52b9b49e3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1508 microversion: 2.1 time: 0.149138 Aug 27 05:48:05.264542 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3604/7215] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:05 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:05.287819 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6061ea9-fda6-44b1-b8f3-4430872e530c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Action: 'create', calling method: .version_select at 0x7fb564ae84c0>, body: {"keypair": {"name": "tempest-keypair-278518209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoH6NbtCsREuodJyR+V1VeokHQ4bU+beMY8t8xZjvksmIQXvi38IujDyFWdGLmIUeip4mzqufr1TZwbWTCHswrbotcb8cDqTMPGLqDQksF+PnRT9uiH3yyCKUH2Jl9Txw=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:05.308518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d6061ea9-fda6-44b1-b8f3-4430872e530c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Getting quotas for project bf0410f354c544919fc369970768b5b6. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:48:05.313667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d6061ea9-fda6-44b1-b8f3-4430872e530c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Getting quotas for user a992fc48c4c141649c2698094d40cbec and project bf0410f354c544919fc369970768b5b6. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:48:05.341975 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6061ea9-fda6-44b1-b8f3-4430872e530c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058238 Aug 27 05:48:05.342592 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3612/7216] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:48:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:05.543842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-fa72c56b-5f06-41c6-86fd-d2286182c376 req-3e37b067-da38-472f-b309-6c41439b3436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55f7c3a-232e-448f-8a99-63a2076b8a0e", "name": "network-vif-plugged", "status": "completed", "tag": "580c23ad-196b-46d9-b66f-634f63655463"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:05.555286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fa72c56b-5f06-41c6-86fd-d2286182c376 req-3e37b067-da38-472f-b309-6c41439b3436 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:05.556074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fa72c56b-5f06-41c6-86fd-d2286182c376 req-3e37b067-da38-472f-b309-6c41439b3436 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:05.557006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-fa72c56b-5f06-41c6-86fd-d2286182c376 req-3e37b067-da38-472f-b309-6c41439b3436 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:05.572218 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-fa72c56b-5f06-41c6-86fd-d2286182c376 req-3e37b067-da38-472f-b309-6c41439b3436 service nova] Creating event network-vif-plugged:580c23ad-196b-46d9-b66f-634f63655463 for instance d55f7c3a-232e-448f-8a99-63a2076b8a0e on n-h1-820368-35 Aug 27 05:48:05.578042 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-fa72c56b-5f06-41c6-86fd-d2286182c376 req-3e37b067-da38-472f-b309-6c41439b3436 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038221 Aug 27 05:48:05.579075 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3605/7217] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:06.582595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e0f46c85-2d07-43ef-8561-5ad1892d7661 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:06.583259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e0f46c85-2d07-43ef-8561-5ad1892d7661 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:06.590110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0f46c85-2d07-43ef-8561-5ad1892d7661 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:06.590604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0f46c85-2d07-43ef-8561-5ad1892d7661 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:06.591048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0f46c85-2d07-43ef-8561-5ad1892d7661 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:06.591787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0f46c85-2d07-43ef-8561-5ad1892d7661 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:06.592248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0f46c85-2d07-43ef-8561-5ad1892d7661 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:06.592681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0f46c85-2d07-43ef-8561-5ad1892d7661 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:06.725009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e0f46c85-2d07-43ef-8561-5ad1892d7661 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:06.733446 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e0f46c85-2d07-43ef-8561-5ad1892d7661 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 200 len: 1508 microversion: 2.1 time: 0.155932 Aug 27 05:48:06.734030 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3613/7218] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:06 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:48:06.755317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-62183db6-0c84-4015-8cf5-6d7b66629746 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:06.755929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-62183db6-0c84-4015-8cf5-6d7b66629746 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:06.762331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62183db6-0c84-4015-8cf5-6d7b66629746 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:06.762836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62183db6-0c84-4015-8cf5-6d7b66629746 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:06.763328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62183db6-0c84-4015-8cf5-6d7b66629746 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:06.764051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62183db6-0c84-4015-8cf5-6d7b66629746 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:06.764530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62183db6-0c84-4015-8cf5-6d7b66629746 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:06.764978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-62183db6-0c84-4015-8cf5-6d7b66629746 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:06.790788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-62183db6-0c84-4015-8cf5-6d7b66629746 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:48:06.873231 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-62183db6-0c84-4015-8cf5-6d7b66629746 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 204 len: 0 microversion: 2.1 time: 0.121517 Aug 27 05:48:06.874829 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3606/7219] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:48:06 2022] DELETE /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:48:06.933817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1161245591", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "9a26ba47-0326-4c7c-9e57-22930442fe62"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:06.986945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] validate_networks() for [('9a26ba47-0326-4c7c-9e57-22930442fe62', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:48:07.369536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:48:07.370645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:48:07.370987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:48:07.371429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:48:07.371879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:48:07.381360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:07.381852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:07.382301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:07.383069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:07.383538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:07.384017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:07.402448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Getting quotas for project bf0410f354c544919fc369970768b5b6. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:48:07.408238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Getting quotas for user a992fc48c4c141649c2698094d40cbec and project bf0410f354c544919fc369970768b5b6. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:48:07.422046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:48:07.424466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:48:07.474178 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-39f26591-779e-4cc0-b2c7-093dbf73e589 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544894 Aug 27 05:48:07.474851 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3614/7220] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:48:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:48:07.487688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e917ecf0-edbc-4769-a4fb-20d395209032 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:07.488690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e917ecf0-edbc-4769-a4fb-20d395209032 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:07.547111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e917ecf0-edbc-4769-a4fb-20d395209032 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:07.555883 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e917ecf0-edbc-4769-a4fb-20d395209032 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1218 microversion: 2.1 time: 0.072604 Aug 27 05:48:07.556549 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3607/7221] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:07 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:48:08.583099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b79abe36-a06a-464a-b1e3-69829f93289c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:08.583903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b79abe36-a06a-464a-b1e3-69829f93289c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:08.591056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b79abe36-a06a-464a-b1e3-69829f93289c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:08.591591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b79abe36-a06a-464a-b1e3-69829f93289c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:08.592241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b79abe36-a06a-464a-b1e3-69829f93289c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:08.592744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b79abe36-a06a-464a-b1e3-69829f93289c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:08.593203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b79abe36-a06a-464a-b1e3-69829f93289c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:08.593639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b79abe36-a06a-464a-b1e3-69829f93289c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:08.666800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b79abe36-a06a-464a-b1e3-69829f93289c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:08.675203 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b79abe36-a06a-464a-b1e3-69829f93289c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1270 microversion: 2.1 time: 0.096711 Aug 27 05:48:08.675807 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3615/7222] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:08 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:08.990460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-963b643c-2fa5-49c7-a22a-c4e483173392 req-badaa40f-1a6e-4da5-9670-0c621f1eb26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55f7c3a-232e-448f-8a99-63a2076b8a0e", "name": "network-vif-deleted", "tag": "580c23ad-196b-46d9-b66f-634f63655463"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:09.005006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-963b643c-2fa5-49c7-a22a-c4e483173392 req-badaa40f-1a6e-4da5-9670-0c621f1eb26e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:09.006316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-963b643c-2fa5-49c7-a22a-c4e483173392 req-badaa40f-1a6e-4da5-9670-0c621f1eb26e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:09.006788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-963b643c-2fa5-49c7-a22a-c4e483173392 req-badaa40f-1a6e-4da5-9670-0c621f1eb26e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:09.019521 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-963b643c-2fa5-49c7-a22a-c4e483173392 req-badaa40f-1a6e-4da5-9670-0c621f1eb26e service nova] Creating event network-vif-deleted:580c23ad-196b-46d9-b66f-634f63655463 for instance d55f7c3a-232e-448f-8a99-63a2076b8a0e on n-h1-820368-35 Aug 27 05:48:09.025337 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-963b643c-2fa5-49c7-a22a-c4e483173392 req-badaa40f-1a6e-4da5-9670-0c621f1eb26e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038525 Aug 27 05:48:09.030130 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3608/7223] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:09.697506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7aa5267d-8ea8-4f97-ad2e-f6a6b996cc39 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:09.699132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7aa5267d-8ea8-4f97-ad2e-f6a6b996cc39 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:09.706707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7aa5267d-8ea8-4f97-ad2e-f6a6b996cc39 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:09.710453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7aa5267d-8ea8-4f97-ad2e-f6a6b996cc39 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:09.710453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7aa5267d-8ea8-4f97-ad2e-f6a6b996cc39 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:09.710453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7aa5267d-8ea8-4f97-ad2e-f6a6b996cc39 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:09.710453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7aa5267d-8ea8-4f97-ad2e-f6a6b996cc39 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:09.710453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7aa5267d-8ea8-4f97-ad2e-f6a6b996cc39 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:09.964814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7aa5267d-8ea8-4f97-ad2e-f6a6b996cc39 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:09.972806 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7aa5267d-8ea8-4f97-ad2e-f6a6b996cc39 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1318 microversion: 2.1 time: 0.279250 Aug 27 05:48:09.973564 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3616/7224] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:09 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:10.491442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e7a50a4a-991a-47cc-b223-aca4450b6a1f req-e75d21a3-f609-4767-9b72-756e759b8571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315e78a8-c36d-499b-be7e-fabfa3b658eb", "tag": "83167976-9249-40a3-abc3-69dbea2febab"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:10.502225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e7a50a4a-991a-47cc-b223-aca4450b6a1f req-e75d21a3-f609-4767-9b72-756e759b8571 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:10.502723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e7a50a4a-991a-47cc-b223-aca4450b6a1f req-e75d21a3-f609-4767-9b72-756e759b8571 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:10.503388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e7a50a4a-991a-47cc-b223-aca4450b6a1f req-e75d21a3-f609-4767-9b72-756e759b8571 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:10.516017 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e7a50a4a-991a-47cc-b223-aca4450b6a1f req-e75d21a3-f609-4767-9b72-756e759b8571 service nova] Creating event network-changed:83167976-9249-40a3-abc3-69dbea2febab for instance 315e78a8-c36d-499b-be7e-fabfa3b658eb on n-h1-820368-35 Aug 27 05:48:10.521630 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e7a50a4a-991a-47cc-b223-aca4450b6a1f req-e75d21a3-f609-4767-9b72-756e759b8571 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106971 Aug 27 05:48:10.522268 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3609/7225] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:10.993669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-046f8029-1434-4bd6-99c1-ea38ec848354 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:10.994293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-046f8029-1434-4bd6-99c1-ea38ec848354 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:11.001677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-046f8029-1434-4bd6-99c1-ea38ec848354 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:11.002163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-046f8029-1434-4bd6-99c1-ea38ec848354 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:11.002605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-046f8029-1434-4bd6-99c1-ea38ec848354 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:11.003337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-046f8029-1434-4bd6-99c1-ea38ec848354 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:11.003798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-046f8029-1434-4bd6-99c1-ea38ec848354 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:11.004231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-046f8029-1434-4bd6-99c1-ea38ec848354 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:11.138764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-046f8029-1434-4bd6-99c1-ea38ec848354 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:11.146432 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-046f8029-1434-4bd6-99c1-ea38ec848354 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1318 microversion: 2.1 time: 0.156852 Aug 27 05:48:11.147335 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3617/7226] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:10 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:12.168699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d782e58c-679f-41b0-9728-43f94937eab6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:12.169535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d782e58c-679f-41b0-9728-43f94937eab6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:12.176483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d782e58c-679f-41b0-9728-43f94937eab6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:12.176982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d782e58c-679f-41b0-9728-43f94937eab6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:12.177437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d782e58c-679f-41b0-9728-43f94937eab6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:12.178147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d782e58c-679f-41b0-9728-43f94937eab6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:12.178615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d782e58c-679f-41b0-9728-43f94937eab6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:12.179470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d782e58c-679f-41b0-9728-43f94937eab6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:12.313491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d782e58c-679f-41b0-9728-43f94937eab6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:12.321916 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d782e58c-679f-41b0-9728-43f94937eab6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1318 microversion: 2.1 time: 0.157986 Aug 27 05:48:12.322508 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3610/7227] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:12 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:13.343196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-198b3eff-9cfc-4814-ae9e-2d6e07d4dc9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:13.344126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-198b3eff-9cfc-4814-ae9e-2d6e07d4dc9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:13.351985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-198b3eff-9cfc-4814-ae9e-2d6e07d4dc9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:13.352479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-198b3eff-9cfc-4814-ae9e-2d6e07d4dc9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:13.352919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-198b3eff-9cfc-4814-ae9e-2d6e07d4dc9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:13.353664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-198b3eff-9cfc-4814-ae9e-2d6e07d4dc9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:13.354104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-198b3eff-9cfc-4814-ae9e-2d6e07d4dc9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:13.354534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-198b3eff-9cfc-4814-ae9e-2d6e07d4dc9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:13.591259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-198b3eff-9cfc-4814-ae9e-2d6e07d4dc9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:13.598904 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-198b3eff-9cfc-4814-ae9e-2d6e07d4dc9e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1318 microversion: 2.1 time: 0.260291 Aug 27 05:48:13.599517 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3618/7228] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:13 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:14.619591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-650fed70-dd40-40c7-ad68-f67d32d605f6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:14.620234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-650fed70-dd40-40c7-ad68-f67d32d605f6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:14.627335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-650fed70-dd40-40c7-ad68-f67d32d605f6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:14.627841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-650fed70-dd40-40c7-ad68-f67d32d605f6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:14.628298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-650fed70-dd40-40c7-ad68-f67d32d605f6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:14.629016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-650fed70-dd40-40c7-ad68-f67d32d605f6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:14.629489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-650fed70-dd40-40c7-ad68-f67d32d605f6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:14.629938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-650fed70-dd40-40c7-ad68-f67d32d605f6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:14.763398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-650fed70-dd40-40c7-ad68-f67d32d605f6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:14.771118 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-650fed70-dd40-40c7-ad68-f67d32d605f6 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1318 microversion: 2.1 time: 0.155624 Aug 27 05:48:14.771683 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3611/7229] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:14 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:15.792034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-da4d0c97-25b9-45e4-870b-dce83a78bf87 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:15.793200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-da4d0c97-25b9-45e4-870b-dce83a78bf87 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:15.800352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da4d0c97-25b9-45e4-870b-dce83a78bf87 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:15.801018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da4d0c97-25b9-45e4-870b-dce83a78bf87 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:15.801300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da4d0c97-25b9-45e4-870b-dce83a78bf87 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:15.802149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da4d0c97-25b9-45e4-870b-dce83a78bf87 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:15.802613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da4d0c97-25b9-45e4-870b-dce83a78bf87 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:15.803136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-da4d0c97-25b9-45e4-870b-dce83a78bf87 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:15.945591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-da4d0c97-25b9-45e4-870b-dce83a78bf87 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:15.955046 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-da4d0c97-25b9-45e4-870b-dce83a78bf87 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1318 microversion: 2.1 time: 0.167109 Aug 27 05:48:15.955766 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3619/7230] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:15 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:16.977015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3b15752-843b-4dc7-a76f-3f4e32a94361 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:16.977650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e3b15752-843b-4dc7-a76f-3f4e32a94361 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:16.984621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3b15752-843b-4dc7-a76f-3f4e32a94361 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:16.985117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3b15752-843b-4dc7-a76f-3f4e32a94361 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:16.985568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3b15752-843b-4dc7-a76f-3f4e32a94361 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:16.986279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3b15752-843b-4dc7-a76f-3f4e32a94361 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:16.986752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3b15752-843b-4dc7-a76f-3f4e32a94361 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:16.987223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3b15752-843b-4dc7-a76f-3f4e32a94361 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:17.118458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e3b15752-843b-4dc7-a76f-3f4e32a94361 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:17.127052 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e3b15752-843b-4dc7-a76f-3f4e32a94361 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1318 microversion: 2.1 time: 0.154031 Aug 27 05:48:17.127651 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3612/7231] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:16 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:17.527050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-80a9d17e-216c-4916-a62f-285203944420 req-8a1a1098-864e-4da5-883e-6720e5d11648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315e78a8-c36d-499b-be7e-fabfa3b658eb", "name": "network-vif-plugged", "status": "completed", "tag": "83167976-9249-40a3-abc3-69dbea2febab"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:17.541395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:17.542589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=10 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:17.552146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-80a9d17e-216c-4916-a62f-285203944420 req-8a1a1098-864e-4da5-883e-6720e5d11648 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:17.552729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-80a9d17e-216c-4916-a62f-285203944420 req-8a1a1098-864e-4da5-883e-6720e5d11648 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:17.553403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-80a9d17e-216c-4916-a62f-285203944420 req-8a1a1098-864e-4da5-883e-6720e5d11648 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:17.566223 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-80a9d17e-216c-4916-a62f-285203944420 req-8a1a1098-864e-4da5-883e-6720e5d11648 service nova] Creating event network-vif-plugged:83167976-9249-40a3-abc3-69dbea2febab for instance 315e78a8-c36d-499b-be7e-fabfa3b658eb on n-h1-820368-35 Aug 27 05:48:17.572984 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-80a9d17e-216c-4916-a62f-285203944420 req-8a1a1098-864e-4da5-883e-6720e5d11648 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049018 Aug 27 05:48:17.572984 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3620/7232] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:18.148091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-15f4e914-71e0-41d8-851f-392e394d39f2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:18.148631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-15f4e914-71e0-41d8-851f-392e394d39f2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:18.150581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:18.156650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15f4e914-71e0-41d8-851f-392e394d39f2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:18.157147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15f4e914-71e0-41d8-851f-392e394d39f2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:18.157594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15f4e914-71e0-41d8-851f-392e394d39f2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:18.158297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15f4e914-71e0-41d8-851f-392e394d39f2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:18.158763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15f4e914-71e0-41d8-851f-392e394d39f2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:18.159235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15f4e914-71e0-41d8-851f-392e394d39f2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:18.288721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-15f4e914-71e0-41d8-851f-392e394d39f2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:18.297396 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-15f4e914-71e0-41d8-851f-392e394d39f2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1318 microversion: 2.1 time: 0.153377 Aug 27 05:48:18.298000 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3613/7233] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:18 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:19.320039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f93fbef-5600-436a-8c8e-b678a230bb1f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:19.320779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f93fbef-5600-436a-8c8e-b678a230bb1f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:19.328120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f93fbef-5600-436a-8c8e-b678a230bb1f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:19.328621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f93fbef-5600-436a-8c8e-b678a230bb1f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:19.329069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f93fbef-5600-436a-8c8e-b678a230bb1f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:19.329785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f93fbef-5600-436a-8c8e-b678a230bb1f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:19.330250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f93fbef-5600-436a-8c8e-b678a230bb1f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:19.330681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f93fbef-5600-436a-8c8e-b678a230bb1f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:19.333572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=99 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:19.472122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f93fbef-5600-436a-8c8e-b678a230bb1f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:19.480173 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f93fbef-5600-436a-8c8e-b678a230bb1f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1507 microversion: 2.1 time: 0.165367 Aug 27 05:48:19.480753 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3621/7234] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:19 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:19.500954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-47dab347-20dc-4411-b3cd-743629be1359 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:19.501544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-47dab347-20dc-4411-b3cd-743629be1359 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:19.509937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47dab347-20dc-4411-b3cd-743629be1359 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:19.510447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47dab347-20dc-4411-b3cd-743629be1359 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:19.510905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47dab347-20dc-4411-b3cd-743629be1359 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:19.511666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47dab347-20dc-4411-b3cd-743629be1359 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:19.512140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47dab347-20dc-4411-b3cd-743629be1359 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:19.512582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-47dab347-20dc-4411-b3cd-743629be1359 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:19.643809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-47dab347-20dc-4411-b3cd-743629be1359 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:19.652023 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-47dab347-20dc-4411-b3cd-743629be1359 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1507 microversion: 2.1 time: 0.155123 Aug 27 05:48:19.652597 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3614/7235] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:19 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:19.672388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:19.674710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:19.680630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:19.681114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:19.681553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:19.682256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:19.682710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:19.683160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:19.712054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:19.717888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Old instance type m1.heat2, new instance type m1.heat {{(pid=128548) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:48:19.724318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:48:19.724751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:48:19.725228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:48:19.725641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:48:19.726056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:48:19.789521 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1dcd9ecb-2772-4149-a82d-53565b951f56 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "POST /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb/action" status: 202 len: 0 microversion: 2.1 time: 0.120930 Aug 27 05:48:19.790059 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3622/7236] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:48:19 2022] POST /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:48:19.798708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9ebc1cb1-5d47-43be-af67-80ea7dc67fc7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:19.799776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9ebc1cb1-5d47-43be-af67-80ea7dc67fc7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:19.809146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ebc1cb1-5d47-43be-af67-80ea7dc67fc7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:19.810165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ebc1cb1-5d47-43be-af67-80ea7dc67fc7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:19.810617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ebc1cb1-5d47-43be-af67-80ea7dc67fc7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:19.811405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ebc1cb1-5d47-43be-af67-80ea7dc67fc7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:19.811863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ebc1cb1-5d47-43be-af67-80ea7dc67fc7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:19.812297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9ebc1cb1-5d47-43be-af67-80ea7dc67fc7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:19.969860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9ebc1cb1-5d47-43be-af67-80ea7dc67fc7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:19.978665 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9ebc1cb1-5d47-43be-af67-80ea7dc67fc7 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1514 microversion: 2.1 time: 0.184205 Aug 27 05:48:19.979501 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3615/7237] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:19 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:21.001834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e66b0817-5a4f-44ee-bb75-7bef383c7850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:21.002759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e66b0817-5a4f-44ee-bb75-7bef383c7850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:21.010464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66b0817-5a4f-44ee-bb75-7bef383c7850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:21.011010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66b0817-5a4f-44ee-bb75-7bef383c7850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:21.011716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66b0817-5a4f-44ee-bb75-7bef383c7850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:21.012692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66b0817-5a4f-44ee-bb75-7bef383c7850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:21.013502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66b0817-5a4f-44ee-bb75-7bef383c7850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:21.013982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e66b0817-5a4f-44ee-bb75-7bef383c7850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:21.228105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e66b0817-5a4f-44ee-bb75-7bef383c7850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:21.236585 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e66b0817-5a4f-44ee-bb75-7bef383c7850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1514 microversion: 2.1 time: 0.239721 Aug 27 05:48:21.237167 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3623/7238] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:20 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:22.260100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-07659537-a478-42f4-9b23-a8b813a84ed0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:22.260727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-07659537-a478-42f4-9b23-a8b813a84ed0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:22.268574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07659537-a478-42f4-9b23-a8b813a84ed0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:22.269076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07659537-a478-42f4-9b23-a8b813a84ed0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:22.269530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07659537-a478-42f4-9b23-a8b813a84ed0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:22.270246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07659537-a478-42f4-9b23-a8b813a84ed0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:22.270718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07659537-a478-42f4-9b23-a8b813a84ed0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:22.271180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-07659537-a478-42f4-9b23-a8b813a84ed0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:22.275468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:22.410296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-07659537-a478-42f4-9b23-a8b813a84ed0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:22.418671 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-07659537-a478-42f4-9b23-a8b813a84ed0 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.163106 Aug 27 05:48:22.419861 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3616/7239] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:22 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:23.440020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c3692346-cd22-4aca-a62f-3ba7e6d0770c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:23.440637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c3692346-cd22-4aca-a62f-3ba7e6d0770c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:23.447984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3692346-cd22-4aca-a62f-3ba7e6d0770c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:23.448962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3692346-cd22-4aca-a62f-3ba7e6d0770c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:23.449596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3692346-cd22-4aca-a62f-3ba7e6d0770c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:23.449935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3692346-cd22-4aca-a62f-3ba7e6d0770c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:23.450982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3692346-cd22-4aca-a62f-3ba7e6d0770c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:23.451435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c3692346-cd22-4aca-a62f-3ba7e6d0770c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:23.583242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c3692346-cd22-4aca-a62f-3ba7e6d0770c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:23.591035 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c3692346-cd22-4aca-a62f-3ba7e6d0770c tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.154898 Aug 27 05:48:23.591639 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3624/7240] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:23 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:24.613440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-71e7a3c2-4ed1-42ab-9b5c-20692737201d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:24.614423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-71e7a3c2-4ed1-42ab-9b5c-20692737201d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:24.623228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e7a3c2-4ed1-42ab-9b5c-20692737201d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:24.623659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e7a3c2-4ed1-42ab-9b5c-20692737201d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:24.624108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e7a3c2-4ed1-42ab-9b5c-20692737201d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:24.624819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e7a3c2-4ed1-42ab-9b5c-20692737201d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:24.625288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e7a3c2-4ed1-42ab-9b5c-20692737201d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:24.625729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-71e7a3c2-4ed1-42ab-9b5c-20692737201d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:24.776317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-71e7a3c2-4ed1-42ab-9b5c-20692737201d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:24.784722 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-71e7a3c2-4ed1-42ab-9b5c-20692737201d tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.175869 Aug 27 05:48:24.785300 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3617/7241] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:24 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:25.806685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1e7558e9-cd35-47ab-827b-ecdeb9b2bde5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:25.807406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1e7558e9-cd35-47ab-827b-ecdeb9b2bde5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:25.814327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e7558e9-cd35-47ab-827b-ecdeb9b2bde5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:25.814827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e7558e9-cd35-47ab-827b-ecdeb9b2bde5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:25.815325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e7558e9-cd35-47ab-827b-ecdeb9b2bde5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:25.816035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e7558e9-cd35-47ab-827b-ecdeb9b2bde5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:25.816493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e7558e9-cd35-47ab-827b-ecdeb9b2bde5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:25.816927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e7558e9-cd35-47ab-827b-ecdeb9b2bde5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:25.944492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1e7558e9-cd35-47ab-827b-ecdeb9b2bde5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:25.952292 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1e7558e9-cd35-47ab-827b-ecdeb9b2bde5 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.150013 Aug 27 05:48:25.952864 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3625/7242] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:25 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:26.974405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8b11f0c-ef84-4a9c-9c06-d834cf0ba5c8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:26.975033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e8b11f0c-ef84-4a9c-9c06-d834cf0ba5c8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:26.983343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8b11f0c-ef84-4a9c-9c06-d834cf0ba5c8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:26.983844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8b11f0c-ef84-4a9c-9c06-d834cf0ba5c8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:26.984299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8b11f0c-ef84-4a9c-9c06-d834cf0ba5c8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:26.985012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8b11f0c-ef84-4a9c-9c06-d834cf0ba5c8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:26.985471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8b11f0c-ef84-4a9c-9c06-d834cf0ba5c8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:26.985907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8b11f0c-ef84-4a9c-9c06-d834cf0ba5c8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:27.120442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e8b11f0c-ef84-4a9c-9c06-d834cf0ba5c8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:27.128868 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e8b11f0c-ef84-4a9c-9c06-d834cf0ba5c8 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.158555 Aug 27 05:48:27.129445 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3618/7243] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:26 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:28.149951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f909ed72-4869-4458-ad11-85ed5d5d0cd1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:28.150507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f909ed72-4869-4458-ad11-85ed5d5d0cd1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:28.153334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:28.158669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f909ed72-4869-4458-ad11-85ed5d5d0cd1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:28.159180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f909ed72-4869-4458-ad11-85ed5d5d0cd1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:28.159618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f909ed72-4869-4458-ad11-85ed5d5d0cd1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:28.160314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f909ed72-4869-4458-ad11-85ed5d5d0cd1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:28.160764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f909ed72-4869-4458-ad11-85ed5d5d0cd1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:28.161187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f909ed72-4869-4458-ad11-85ed5d5d0cd1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:28.294624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f909ed72-4869-4458-ad11-85ed5d5d0cd1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:28.302409 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f909ed72-4869-4458-ad11-85ed5d5d0cd1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.156499 Aug 27 05:48:28.302987 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3626/7244] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:28 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:29.324341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-249d4380-2810-4d2f-aeb9-f70495ee9009 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:29.324981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-249d4380-2810-4d2f-aeb9-f70495ee9009 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:29.327811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:29.334120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-249d4380-2810-4d2f-aeb9-f70495ee9009 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:29.334616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-249d4380-2810-4d2f-aeb9-f70495ee9009 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:29.335066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-249d4380-2810-4d2f-aeb9-f70495ee9009 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:29.335835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-249d4380-2810-4d2f-aeb9-f70495ee9009 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:29.336301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-249d4380-2810-4d2f-aeb9-f70495ee9009 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:29.336770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-249d4380-2810-4d2f-aeb9-f70495ee9009 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:29.470877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-249d4380-2810-4d2f-aeb9-f70495ee9009 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:29.478618 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-249d4380-2810-4d2f-aeb9-f70495ee9009 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.158242 Aug 27 05:48:29.479209 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3619/7245] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:29 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:30.500646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-14df9cee-7636-43ad-b0ea-9ce1d863fb73 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:30.501298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-14df9cee-7636-43ad-b0ea-9ce1d863fb73 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:30.508040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14df9cee-7636-43ad-b0ea-9ce1d863fb73 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:30.508522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14df9cee-7636-43ad-b0ea-9ce1d863fb73 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:30.508964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14df9cee-7636-43ad-b0ea-9ce1d863fb73 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:30.509677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14df9cee-7636-43ad-b0ea-9ce1d863fb73 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:30.510133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14df9cee-7636-43ad-b0ea-9ce1d863fb73 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:30.510561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14df9cee-7636-43ad-b0ea-9ce1d863fb73 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:30.642426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-14df9cee-7636-43ad-b0ea-9ce1d863fb73 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:30.650317 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-14df9cee-7636-43ad-b0ea-9ce1d863fb73 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.154060 Aug 27 05:48:30.650883 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3627/7246] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:30 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:31.671834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3cf6b9cc-793a-49e6-9793-478c9cd42460 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:31.672464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3cf6b9cc-793a-49e6-9793-478c9cd42460 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:31.679381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cf6b9cc-793a-49e6-9793-478c9cd42460 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:31.679879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cf6b9cc-793a-49e6-9793-478c9cd42460 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:31.680331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cf6b9cc-793a-49e6-9793-478c9cd42460 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:31.681040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cf6b9cc-793a-49e6-9793-478c9cd42460 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:31.681516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cf6b9cc-793a-49e6-9793-478c9cd42460 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:31.681959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3cf6b9cc-793a-49e6-9793-478c9cd42460 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:31.816986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3cf6b9cc-793a-49e6-9793-478c9cd42460 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:31.824844 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3cf6b9cc-793a-49e6-9793-478c9cd42460 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.157324 Aug 27 05:48:31.825450 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3620/7247] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:31 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:32.845417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a4a1d0ef-b47c-4049-a1f4-29324179a4ec tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:32.846043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a4a1d0ef-b47c-4049-a1f4-29324179a4ec tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:32.852905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a1d0ef-b47c-4049-a1f4-29324179a4ec tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:32.853393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a1d0ef-b47c-4049-a1f4-29324179a4ec tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:32.853831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a1d0ef-b47c-4049-a1f4-29324179a4ec tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:32.854535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a1d0ef-b47c-4049-a1f4-29324179a4ec tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:32.854989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a1d0ef-b47c-4049-a1f4-29324179a4ec tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:32.855449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a1d0ef-b47c-4049-a1f4-29324179a4ec tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:32.989499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a4a1d0ef-b47c-4049-a1f4-29324179a4ec tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:32.997937 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a4a1d0ef-b47c-4049-a1f4-29324179a4ec tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.156049 Aug 27 05:48:32.998518 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3628/7248] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:32 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:34.019715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3e9284f3-7de5-4a42-879e-1294dd74fc55 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:34.020354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3e9284f3-7de5-4a42-879e-1294dd74fc55 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:34.027399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e9284f3-7de5-4a42-879e-1294dd74fc55 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:34.027896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e9284f3-7de5-4a42-879e-1294dd74fc55 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:34.028352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e9284f3-7de5-4a42-879e-1294dd74fc55 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:34.029057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e9284f3-7de5-4a42-879e-1294dd74fc55 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:34.029522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e9284f3-7de5-4a42-879e-1294dd74fc55 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:34.029959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3e9284f3-7de5-4a42-879e-1294dd74fc55 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:34.158224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3e9284f3-7de5-4a42-879e-1294dd74fc55 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:34.166210 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3e9284f3-7de5-4a42-879e-1294dd74fc55 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.150681 Aug 27 05:48:34.166782 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3621/7249] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:34 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:35.187579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9167fe9f-07b2-46f7-9843-174fe3797fc1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:35.188194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9167fe9f-07b2-46f7-9843-174fe3797fc1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:35.194696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9167fe9f-07b2-46f7-9843-174fe3797fc1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:35.195203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9167fe9f-07b2-46f7-9843-174fe3797fc1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:35.195643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9167fe9f-07b2-46f7-9843-174fe3797fc1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:35.196331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9167fe9f-07b2-46f7-9843-174fe3797fc1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:35.196781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9167fe9f-07b2-46f7-9843-174fe3797fc1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:35.197203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9167fe9f-07b2-46f7-9843-174fe3797fc1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:35.330009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9167fe9f-07b2-46f7-9843-174fe3797fc1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:35.337811 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9167fe9f-07b2-46f7-9843-174fe3797fc1 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.154735 Aug 27 05:48:35.338390 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3629/7250] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:35 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:36.360058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a8830d5f-26af-414c-b4f7-222c733b014a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:36.360680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a8830d5f-26af-414c-b4f7-222c733b014a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:36.367711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8830d5f-26af-414c-b4f7-222c733b014a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:36.368210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8830d5f-26af-414c-b4f7-222c733b014a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:36.368662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8830d5f-26af-414c-b4f7-222c733b014a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:36.369368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8830d5f-26af-414c-b4f7-222c733b014a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:36.369831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8830d5f-26af-414c-b4f7-222c733b014a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:36.370266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8830d5f-26af-414c-b4f7-222c733b014a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:36.506047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a8830d5f-26af-414c-b4f7-222c733b014a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:36.514049 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a8830d5f-26af-414c-b4f7-222c733b014a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.158567 Aug 27 05:48:36.514617 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3622/7251] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:36 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:37.535125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-34552ab7-c358-4937-819f-0549e10f8593 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:37.535748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-34552ab7-c358-4937-819f-0549e10f8593 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:37.543103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34552ab7-c358-4937-819f-0549e10f8593 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:37.543595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34552ab7-c358-4937-819f-0549e10f8593 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:37.545138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34552ab7-c358-4937-819f-0549e10f8593 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:37.546349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34552ab7-c358-4937-819f-0549e10f8593 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:37.547067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34552ab7-c358-4937-819f-0549e10f8593 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:37.547522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-34552ab7-c358-4937-819f-0549e10f8593 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:37.686171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-34552ab7-c358-4937-819f-0549e10f8593 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:37.696715 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-34552ab7-c358-4937-819f-0549e10f8593 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.165554 Aug 27 05:48:37.697666 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3630/7252] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:37 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:38.718250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-33fad88a-3a77-4f81-8836-10ea35e7c427 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:38.718874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-33fad88a-3a77-4f81-8836-10ea35e7c427 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:38.725727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33fad88a-3a77-4f81-8836-10ea35e7c427 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:38.726222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33fad88a-3a77-4f81-8836-10ea35e7c427 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:38.726674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33fad88a-3a77-4f81-8836-10ea35e7c427 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:38.727406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33fad88a-3a77-4f81-8836-10ea35e7c427 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:38.727870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33fad88a-3a77-4f81-8836-10ea35e7c427 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:38.728310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33fad88a-3a77-4f81-8836-10ea35e7c427 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:38.867007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-33fad88a-3a77-4f81-8836-10ea35e7c427 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:38.875848 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-33fad88a-3a77-4f81-8836-10ea35e7c427 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.161608 Aug 27 05:48:38.876439 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3623/7253] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:38 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:39.897695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce835588-ef28-4ae5-82f3-f82e12070713 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:39.898320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ce835588-ef28-4ae5-82f3-f82e12070713 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:39.906184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce835588-ef28-4ae5-82f3-f82e12070713 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:39.906677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce835588-ef28-4ae5-82f3-f82e12070713 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:39.907147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce835588-ef28-4ae5-82f3-f82e12070713 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:39.907862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce835588-ef28-4ae5-82f3-f82e12070713 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:39.908325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce835588-ef28-4ae5-82f3-f82e12070713 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:39.908761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ce835588-ef28-4ae5-82f3-f82e12070713 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:40.045162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce835588-ef28-4ae5-82f3-f82e12070713 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:40.053135 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce835588-ef28-4ae5-82f3-f82e12070713 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.159356 Aug 27 05:48:40.054381 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3631/7254] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:39 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:41.076055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4465eb2a-d152-4a32-8c27-9b140a27fa3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:41.076618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4465eb2a-d152-4a32-8c27-9b140a27fa3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:41.083602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4465eb2a-d152-4a32-8c27-9b140a27fa3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:41.084106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4465eb2a-d152-4a32-8c27-9b140a27fa3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:41.084563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4465eb2a-d152-4a32-8c27-9b140a27fa3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:41.085277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4465eb2a-d152-4a32-8c27-9b140a27fa3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:41.085747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4465eb2a-d152-4a32-8c27-9b140a27fa3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:41.086220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4465eb2a-d152-4a32-8c27-9b140a27fa3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:41.219981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4465eb2a-d152-4a32-8c27-9b140a27fa3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:41.227724 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4465eb2a-d152-4a32-8c27-9b140a27fa3f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.156298 Aug 27 05:48:41.228300 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3624/7255] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:41 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:42.250303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4ebd189b-de09-4710-b960-20aeb2dfa64b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:42.250927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4ebd189b-de09-4710-b960-20aeb2dfa64b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:42.257808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ebd189b-de09-4710-b960-20aeb2dfa64b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:42.258290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ebd189b-de09-4710-b960-20aeb2dfa64b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:42.258727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ebd189b-de09-4710-b960-20aeb2dfa64b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:42.259497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ebd189b-de09-4710-b960-20aeb2dfa64b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:42.259989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ebd189b-de09-4710-b960-20aeb2dfa64b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:42.260416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4ebd189b-de09-4710-b960-20aeb2dfa64b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:42.395297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4ebd189b-de09-4710-b960-20aeb2dfa64b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:42.403728 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4ebd189b-de09-4710-b960-20aeb2dfa64b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.156849 Aug 27 05:48:42.404325 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3632/7256] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:42 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:43.425900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3945eb1b-2424-4ea6-9d74-7a18410be505 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:43.426536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3945eb1b-2424-4ea6-9d74-7a18410be505 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:43.433159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3945eb1b-2424-4ea6-9d74-7a18410be505 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:43.433663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3945eb1b-2424-4ea6-9d74-7a18410be505 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:43.434201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3945eb1b-2424-4ea6-9d74-7a18410be505 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:43.435625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3945eb1b-2424-4ea6-9d74-7a18410be505 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:43.436171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3945eb1b-2424-4ea6-9d74-7a18410be505 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:43.436627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3945eb1b-2424-4ea6-9d74-7a18410be505 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:43.581829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3945eb1b-2424-4ea6-9d74-7a18410be505 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:43.589658 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3945eb1b-2424-4ea6-9d74-7a18410be505 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.167870 Aug 27 05:48:43.590216 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3625/7257] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:43 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:48:44.611508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a1a4e04-bb63-4ae6-bd0d-529c4070c38f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:44.612258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0a1a4e04-bb63-4ae6-bd0d-529c4070c38f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:44.619069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a1a4e04-bb63-4ae6-bd0d-529c4070c38f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:44.619733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a1a4e04-bb63-4ae6-bd0d-529c4070c38f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:44.620165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a1a4e04-bb63-4ae6-bd0d-529c4070c38f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:44.620861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a1a4e04-bb63-4ae6-bd0d-529c4070c38f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:44.621309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a1a4e04-bb63-4ae6-bd0d-529c4070c38f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:44.622264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a1a4e04-bb63-4ae6-bd0d-529c4070c38f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:44.760825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0a1a4e04-bb63-4ae6-bd0d-529c4070c38f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:44.772854 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a1a4e04-bb63-4ae6-bd0d-529c4070c38f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.165165 Aug 27 05:48:44.773704 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3633/7258] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:44 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:45.794873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ef46b3f-c803-41bd-991c-57b5964d7d09 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:45.795475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ef46b3f-c803-41bd-991c-57b5964d7d09 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:45.802618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef46b3f-c803-41bd-991c-57b5964d7d09 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:45.803159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef46b3f-c803-41bd-991c-57b5964d7d09 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:45.803623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef46b3f-c803-41bd-991c-57b5964d7d09 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:45.808142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef46b3f-c803-41bd-991c-57b5964d7d09 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:45.808142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef46b3f-c803-41bd-991c-57b5964d7d09 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:45.808142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ef46b3f-c803-41bd-991c-57b5964d7d09 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:45.948856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1ef46b3f-c803-41bd-991c-57b5964d7d09 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:45.956901 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ef46b3f-c803-41bd-991c-57b5964d7d09 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.166636 Aug 27 05:48:45.957490 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3626/7259] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:45 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:46.978879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b567dcb9-2b9c-4de9-8bff-cd1ad9c74b5b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:46.979530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b567dcb9-2b9c-4de9-8bff-cd1ad9c74b5b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:46.986485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b567dcb9-2b9c-4de9-8bff-cd1ad9c74b5b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:46.986978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b567dcb9-2b9c-4de9-8bff-cd1ad9c74b5b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:46.987451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b567dcb9-2b9c-4de9-8bff-cd1ad9c74b5b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:46.988198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b567dcb9-2b9c-4de9-8bff-cd1ad9c74b5b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:46.988661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b567dcb9-2b9c-4de9-8bff-cd1ad9c74b5b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:46.989096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b567dcb9-2b9c-4de9-8bff-cd1ad9c74b5b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:47.122926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b567dcb9-2b9c-4de9-8bff-cd1ad9c74b5b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:47.130820 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b567dcb9-2b9c-4de9-8bff-cd1ad9c74b5b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.156860 Aug 27 05:48:47.131435 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3634/7260] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:46 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:48.152728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b1dde06-46e1-4d04-81f5-5cb1702f5ec3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:48.153315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b1dde06-46e1-4d04-81f5-5cb1702f5ec3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:48.159957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b1dde06-46e1-4d04-81f5-5cb1702f5ec3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:48.160479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b1dde06-46e1-4d04-81f5-5cb1702f5ec3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:48.160926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b1dde06-46e1-4d04-81f5-5cb1702f5ec3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:48.161644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b1dde06-46e1-4d04-81f5-5cb1702f5ec3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:48.162117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b1dde06-46e1-4d04-81f5-5cb1702f5ec3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:48.162560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b1dde06-46e1-4d04-81f5-5cb1702f5ec3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:48.301622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b1dde06-46e1-4d04-81f5-5cb1702f5ec3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:48.309976 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b1dde06-46e1-4d04-81f5-5cb1702f5ec3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1519 microversion: 2.1 time: 0.161414 Aug 27 05:48:48.310611 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3627/7261] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:48 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:48:49.336773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-71eb3695-2f5e-4e83-9e12-90df0f092e9f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:49.338037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-71eb3695-2f5e-4e83-9e12-90df0f092e9f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:49.348713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71eb3695-2f5e-4e83-9e12-90df0f092e9f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:49.349212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71eb3695-2f5e-4e83-9e12-90df0f092e9f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:49.349658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71eb3695-2f5e-4e83-9e12-90df0f092e9f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:49.350369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71eb3695-2f5e-4e83-9e12-90df0f092e9f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:49.350924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71eb3695-2f5e-4e83-9e12-90df0f092e9f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:49.351395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71eb3695-2f5e-4e83-9e12-90df0f092e9f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:49.354516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:49.495574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-71eb3695-2f5e-4e83-9e12-90df0f092e9f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:49.504264 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-71eb3695-2f5e-4e83-9e12-90df0f092e9f tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1518 microversion: 2.1 time: 0.175126 Aug 27 05:48:49.504854 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3635/7262] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:49 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:49.510418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-db7d14fd-93a5-40a3-b8d7-14c97406cc4a req-e9e10940-ae43-47fe-9f2f-f5f4bdc7d340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315e78a8-c36d-499b-be7e-fabfa3b658eb", "name": "network-vif-unplugged", "status": "completed", "tag": "83167976-9249-40a3-abc3-69dbea2febab"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:49.522548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-db7d14fd-93a5-40a3-b8d7-14c97406cc4a req-e9e10940-ae43-47fe-9f2f-f5f4bdc7d340 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:49.523157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-db7d14fd-93a5-40a3-b8d7-14c97406cc4a req-e9e10940-ae43-47fe-9f2f-f5f4bdc7d340 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:49.523855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-db7d14fd-93a5-40a3-b8d7-14c97406cc4a req-e9e10940-ae43-47fe-9f2f-f5f4bdc7d340 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:49.544504 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-db7d14fd-93a5-40a3-b8d7-14c97406cc4a req-e9e10940-ae43-47fe-9f2f-f5f4bdc7d340 service nova] Creating event network-vif-unplugged:83167976-9249-40a3-abc3-69dbea2febab for instance 315e78a8-c36d-499b-be7e-fabfa3b658eb on n-h2-820368-35 Aug 27 05:48:49.550485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-db7d14fd-93a5-40a3-b8d7-14c97406cc4a req-e9e10940-ae43-47fe-9f2f-f5f4bdc7d340 service nova] Instance 315e78a8-c36d-499b-be7e-fabfa3b658eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:48:49.563995 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-db7d14fd-93a5-40a3-b8d7-14c97406cc4a req-e9e10940-ae43-47fe-9f2f-f5f4bdc7d340 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057199 Aug 27 05:48:49.564617 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3628/7263] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:48:50.527216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-87317bd9-2a26-4f7d-9785-aab83d2c4b99 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:50.527900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-87317bd9-2a26-4f7d-9785-aab83d2c4b99 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:50.535074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87317bd9-2a26-4f7d-9785-aab83d2c4b99 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:50.535631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87317bd9-2a26-4f7d-9785-aab83d2c4b99 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:50.536039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87317bd9-2a26-4f7d-9785-aab83d2c4b99 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:50.536744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87317bd9-2a26-4f7d-9785-aab83d2c4b99 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:50.537203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87317bd9-2a26-4f7d-9785-aab83d2c4b99 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:50.537637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87317bd9-2a26-4f7d-9785-aab83d2c4b99 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:50.679261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-87317bd9-2a26-4f7d-9785-aab83d2c4b99 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:50.688000 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-87317bd9-2a26-4f7d-9785-aab83d2c4b99 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1516 microversion: 2.1 time: 0.164915 Aug 27 05:48:50.688594 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3636/7264] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:50 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:51.593733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-83784281-126d-405c-baf8-62c84f8a0cd7 req-51124587-3f75-48ac-847b-8dee9aff9bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315e78a8-c36d-499b-be7e-fabfa3b658eb", "tag": "83167976-9249-40a3-abc3-69dbea2febab"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:51.603613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-83784281-126d-405c-baf8-62c84f8a0cd7 req-51124587-3f75-48ac-847b-8dee9aff9bc7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:51.604101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-83784281-126d-405c-baf8-62c84f8a0cd7 req-51124587-3f75-48ac-847b-8dee9aff9bc7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:51.604543 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-83784281-126d-405c-baf8-62c84f8a0cd7 req-51124587-3f75-48ac-847b-8dee9aff9bc7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:51.618456 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-83784281-126d-405c-baf8-62c84f8a0cd7 req-51124587-3f75-48ac-847b-8dee9aff9bc7 service nova] Creating event network-changed:83167976-9249-40a3-abc3-69dbea2febab for instance 315e78a8-c36d-499b-be7e-fabfa3b658eb on n-h2-820368-35 Aug 27 05:48:51.625223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-83784281-126d-405c-baf8-62c84f8a0cd7 req-51124587-3f75-48ac-847b-8dee9aff9bc7 service nova] Instance 315e78a8-c36d-499b-be7e-fabfa3b658eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:48:51.636203 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-83784281-126d-405c-baf8-62c84f8a0cd7 req-51124587-3f75-48ac-847b-8dee9aff9bc7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047508 Aug 27 05:48:51.636820 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3629/7265] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:51.711182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-52dd2b3a-890d-4b27-881f-db12c883c58e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:51.714132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-52dd2b3a-890d-4b27-881f-db12c883c58e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:51.718948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52dd2b3a-890d-4b27-881f-db12c883c58e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:51.719502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52dd2b3a-890d-4b27-881f-db12c883c58e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:51.719922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52dd2b3a-890d-4b27-881f-db12c883c58e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:51.720694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52dd2b3a-890d-4b27-881f-db12c883c58e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:51.721083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52dd2b3a-890d-4b27-881f-db12c883c58e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:51.721508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-52dd2b3a-890d-4b27-881f-db12c883c58e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:51.952027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-52dd2b3a-890d-4b27-881f-db12c883c58e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:51.960677 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-52dd2b3a-890d-4b27-881f-db12c883c58e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1516 microversion: 2.1 time: 0.254214 Aug 27 05:48:51.961243 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3637/7266] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:51 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1516 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:52.984555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5a9bdb46-66de-4ce3-9cd0-1ebc1bfcd05a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:52.985295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5a9bdb46-66de-4ce3-9cd0-1ebc1bfcd05a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:52.992957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9bdb46-66de-4ce3-9cd0-1ebc1bfcd05a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:52.993624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9bdb46-66de-4ce3-9cd0-1ebc1bfcd05a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:52.994293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9bdb46-66de-4ce3-9cd0-1ebc1bfcd05a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:52.995193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9bdb46-66de-4ce3-9cd0-1ebc1bfcd05a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:52.995855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9bdb46-66de-4ce3-9cd0-1ebc1bfcd05a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:52.996310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9bdb46-66de-4ce3-9cd0-1ebc1bfcd05a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:53.001619 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=79 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:53.140984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5a9bdb46-66de-4ce3-9cd0-1ebc1bfcd05a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:53.150765 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5a9bdb46-66de-4ce3-9cd0-1ebc1bfcd05a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1516 microversion: 2.1 time: 0.170747 Aug 27 05:48:53.156292 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3630/7267] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:52 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:54.172960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5a1d4e41-e697-4f79-b2a5-5e1827427f67 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:54.173600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5a1d4e41-e697-4f79-b2a5-5e1827427f67 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:54.180810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a1d4e41-e697-4f79-b2a5-5e1827427f67 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:54.181294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a1d4e41-e697-4f79-b2a5-5e1827427f67 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:54.181733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a1d4e41-e697-4f79-b2a5-5e1827427f67 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:54.182501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a1d4e41-e697-4f79-b2a5-5e1827427f67 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:54.182931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a1d4e41-e697-4f79-b2a5-5e1827427f67 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:54.183385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5a1d4e41-e697-4f79-b2a5-5e1827427f67 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:54.319823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5a1d4e41-e697-4f79-b2a5-5e1827427f67 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:54.327450 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5a1d4e41-e697-4f79-b2a5-5e1827427f67 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1513 microversion: 2.1 time: 0.158969 Aug 27 05:48:54.328021 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3638/7268] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:54 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:54.348528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a8a0c74f-df8a-4438-ace9-1a9658349c15 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:54.349075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a8a0c74f-df8a-4438-ace9-1a9658349c15 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:54.357483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8a0c74f-df8a-4438-ace9-1a9658349c15 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:54.357706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8a0c74f-df8a-4438-ace9-1a9658349c15 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:54.358366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8a0c74f-df8a-4438-ace9-1a9658349c15 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:54.359488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8a0c74f-df8a-4438-ace9-1a9658349c15 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:54.360326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8a0c74f-df8a-4438-ace9-1a9658349c15 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:54.360908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8a0c74f-df8a-4438-ace9-1a9658349c15 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:54.420413 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a8a0c74f-df8a-4438-ace9-1a9658349c15 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "POST /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb/action" status: 204 len: 0 microversion: 2.1 time: 0.075619 Aug 27 05:48:54.421069 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3631/7269] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:48:54 2022] POST /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:48:54.429320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-44f88d0a-9f8b-49d3-afb9-4ef172a0e380 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:54.430117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-44f88d0a-9f8b-49d3-afb9-4ef172a0e380 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:54.436481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44f88d0a-9f8b-49d3-afb9-4ef172a0e380 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:54.437114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44f88d0a-9f8b-49d3-afb9-4ef172a0e380 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:54.437641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44f88d0a-9f8b-49d3-afb9-4ef172a0e380 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:54.438379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44f88d0a-9f8b-49d3-afb9-4ef172a0e380 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:54.438838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44f88d0a-9f8b-49d3-afb9-4ef172a0e380 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:54.439310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44f88d0a-9f8b-49d3-afb9-4ef172a0e380 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:54.658256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-44f88d0a-9f8b-49d3-afb9-4ef172a0e380 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:54.667363 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-44f88d0a-9f8b-49d3-afb9-4ef172a0e380 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1513 microversion: 2.1 time: 0.241907 Aug 27 05:48:54.667964 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3639/7270] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:54 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:54.990947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7c485a72-0c63-47c5-b809-2c902c8b4801 req-f14d54c4-33cd-4c3a-8511-5751e450f4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315e78a8-c36d-499b-be7e-fabfa3b658eb", "name": "network-vif-plugged", "status": "completed", "tag": "83167976-9249-40a3-abc3-69dbea2febab"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:55.001877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7c485a72-0c63-47c5-b809-2c902c8b4801 req-f14d54c4-33cd-4c3a-8511-5751e450f4bd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:55.002380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7c485a72-0c63-47c5-b809-2c902c8b4801 req-f14d54c4-33cd-4c3a-8511-5751e450f4bd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:55.002842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7c485a72-0c63-47c5-b809-2c902c8b4801 req-f14d54c4-33cd-4c3a-8511-5751e450f4bd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:55.015801 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7c485a72-0c63-47c5-b809-2c902c8b4801 req-f14d54c4-33cd-4c3a-8511-5751e450f4bd service nova] Creating event network-vif-plugged:83167976-9249-40a3-abc3-69dbea2febab for instance 315e78a8-c36d-499b-be7e-fabfa3b658eb on n-h2-820368-35 Aug 27 05:48:55.021688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-7c485a72-0c63-47c5-b809-2c902c8b4801 req-f14d54c4-33cd-4c3a-8511-5751e450f4bd service nova] Instance 315e78a8-c36d-499b-be7e-fabfa3b658eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:48:55.033294 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7c485a72-0c63-47c5-b809-2c902c8b4801 req-f14d54c4-33cd-4c3a-8511-5751e450f4bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046510 Aug 27 05:48:55.034379 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3632/7271] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:55.688534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-660257cd-d15c-4257-848b-a294653e1850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:55.689147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-660257cd-d15c-4257-848b-a294653e1850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:55.696287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660257cd-d15c-4257-848b-a294653e1850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:55.696778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660257cd-d15c-4257-848b-a294653e1850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:55.697219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660257cd-d15c-4257-848b-a294653e1850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:55.697924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660257cd-d15c-4257-848b-a294653e1850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:55.698373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660257cd-d15c-4257-848b-a294653e1850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:55.698799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-660257cd-d15c-4257-848b-a294653e1850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:55.846468 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-660257cd-d15c-4257-848b-a294653e1850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:55.855851 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-660257cd-d15c-4257-848b-a294653e1850 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1513 microversion: 2.1 time: 0.171963 Aug 27 05:48:55.856441 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3640/7272] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:55 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:56.875796 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:48:56.876338 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 05:48:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb (ip 10.222.0.58) !!! Aug 27 05:48:56.880874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fd568ecc-efaf-4094-9e2e-870df2db4c24 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:56.881595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fd568ecc-efaf-4094-9e2e-870df2db4c24 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:56.889341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd568ecc-efaf-4094-9e2e-870df2db4c24 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:56.889847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd568ecc-efaf-4094-9e2e-870df2db4c24 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:56.890330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd568ecc-efaf-4094-9e2e-870df2db4c24 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:56.891052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd568ecc-efaf-4094-9e2e-870df2db4c24 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:56.891563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd568ecc-efaf-4094-9e2e-870df2db4c24 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:56.892013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd568ecc-efaf-4094-9e2e-870df2db4c24 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:57.022264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fd568ecc-efaf-4094-9e2e-870df2db4c24 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:57.031025 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fd568ecc-efaf-4094-9e2e-870df2db4c24 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1505 microversion: 2.1 time: 0.157320 Aug 27 05:48:57.031640 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3633/7273] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:56 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:57.051248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6a4c042c-9d33-4d96-bde2-18f17a877414 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:57.051871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6a4c042c-9d33-4d96-bde2-18f17a877414 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:57.059305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4c042c-9d33-4d96-bde2-18f17a877414 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:57.059727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4c042c-9d33-4d96-bde2-18f17a877414 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:57.060167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4c042c-9d33-4d96-bde2-18f17a877414 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:57.060865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4c042c-9d33-4d96-bde2-18f17a877414 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:57.061322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4c042c-9d33-4d96-bde2-18f17a877414 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:57.061748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6a4c042c-9d33-4d96-bde2-18f17a877414 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:57.194144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6a4c042c-9d33-4d96-bde2-18f17a877414 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:57.203156 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6a4c042c-9d33-4d96-bde2-18f17a877414 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1505 microversion: 2.1 time: 0.155698 Aug 27 05:48:57.203716 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3641/7274] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:57 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:57.223457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8dfa405-3638-41b7-972d-f5892bf1d702 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:57.223978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f8dfa405-3638-41b7-972d-f5892bf1d702 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:57.230128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8dfa405-3638-41b7-972d-f5892bf1d702 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:57.230631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8dfa405-3638-41b7-972d-f5892bf1d702 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:57.231109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8dfa405-3638-41b7-972d-f5892bf1d702 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:57.231854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8dfa405-3638-41b7-972d-f5892bf1d702 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:57.232321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8dfa405-3638-41b7-972d-f5892bf1d702 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:57.232764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8dfa405-3638-41b7-972d-f5892bf1d702 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:57.366786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f8dfa405-3638-41b7-972d-f5892bf1d702 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:57.374829 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8dfa405-3638-41b7-972d-f5892bf1d702 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1505 microversion: 2.1 time: 0.155388 Aug 27 05:48:57.375459 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3634/7275] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:57 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:57.396825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9a86e81d-f7f2-4804-ac16-441e9948416a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:57.397322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9a86e81d-f7f2-4804-ac16-441e9948416a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:57.403929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a86e81d-f7f2-4804-ac16-441e9948416a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:57.404412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a86e81d-f7f2-4804-ac16-441e9948416a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:57.404847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a86e81d-f7f2-4804-ac16-441e9948416a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:57.405539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a86e81d-f7f2-4804-ac16-441e9948416a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:57.405989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a86e81d-f7f2-4804-ac16-441e9948416a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:57.406414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a86e81d-f7f2-4804-ac16-441e9948416a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:57.435113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9a86e81d-f7f2-4804-ac16-441e9948416a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:48:57.511881 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9a86e81d-f7f2-4804-ac16-441e9948416a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "DELETE /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 204 len: 0 microversion: 2.1 time: 0.118566 Aug 27 05:48:57.512633 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3642/7276] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:48:57 2022] DELETE /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:48:57.530046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d82cc4de-e8fe-457d-9fc9-6b2eb5332dd3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:57.530589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d82cc4de-e8fe-457d-9fc9-6b2eb5332dd3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:57.536605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d82cc4de-e8fe-457d-9fc9-6b2eb5332dd3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:57.537273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d82cc4de-e8fe-457d-9fc9-6b2eb5332dd3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:57.537730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d82cc4de-e8fe-457d-9fc9-6b2eb5332dd3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:57.538685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d82cc4de-e8fe-457d-9fc9-6b2eb5332dd3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:57.539183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d82cc4de-e8fe-457d-9fc9-6b2eb5332dd3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:57.539622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d82cc4de-e8fe-457d-9fc9-6b2eb5332dd3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:57.571457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d82cc4de-e8fe-457d-9fc9-6b2eb5332dd3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:48:57.621331 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.compute.api [None req-d82cc4de-e8fe-457d-9fc9-6b2eb5332dd3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Instance is already in deleting state, ignoring this request Aug 27 05:48:57.622179 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d82cc4de-e8fe-457d-9fc9-6b2eb5332dd3 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "DELETE /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 204 len: 0 microversion: 2.1 time: 0.096915 Aug 27 05:48:57.622756 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3635/7277] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:48:57 2022] DELETE /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:48:57.631668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cddc16e6-a19b-4b8b-88a6-5450fdcaf496 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:57.632400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cddc16e6-a19b-4b8b-88a6-5450fdcaf496 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:57.639274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cddc16e6-a19b-4b8b-88a6-5450fdcaf496 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:57.639794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cddc16e6-a19b-4b8b-88a6-5450fdcaf496 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:57.640236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cddc16e6-a19b-4b8b-88a6-5450fdcaf496 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:57.640932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cddc16e6-a19b-4b8b-88a6-5450fdcaf496 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:57.641381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cddc16e6-a19b-4b8b-88a6-5450fdcaf496 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:57.641804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cddc16e6-a19b-4b8b-88a6-5450fdcaf496 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:57.775983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cddc16e6-a19b-4b8b-88a6-5450fdcaf496 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:57.784482 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cddc16e6-a19b-4b8b-88a6-5450fdcaf496 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1511 microversion: 2.1 time: 0.157104 Aug 27 05:48:57.785062 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3643/7278] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:57 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:58.805900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa4034c2-231b-4ed9-be49-e35054163df4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:58.806572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fa4034c2-231b-4ed9-be49-e35054163df4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:58.816259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa4034c2-231b-4ed9-be49-e35054163df4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:58.816793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa4034c2-231b-4ed9-be49-e35054163df4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:58.817377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa4034c2-231b-4ed9-be49-e35054163df4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:58.818096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa4034c2-231b-4ed9-be49-e35054163df4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:58.818559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa4034c2-231b-4ed9-be49-e35054163df4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:58.818994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa4034c2-231b-4ed9-be49-e35054163df4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:58.957799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fa4034c2-231b-4ed9-be49-e35054163df4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a992fc48c4c141649c2698094d40cbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0410f354c544919fc369970768b5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:58.966105 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa4034c2-231b-4ed9-be49-e35054163df4 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 200 len: 1511 microversion: 2.1 time: 0.163707 Aug 27 05:48:58.966679 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3636/7279] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:58 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:59.551360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-dc61fb52-cb68-4704-9b17-676d848517ce req-ff6dc9b9-21af-434d-9b0b-79bf172810ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315e78a8-c36d-499b-be7e-fabfa3b658eb", "name": "network-vif-deleted", "tag": "83167976-9249-40a3-abc3-69dbea2febab"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:59.558031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:59.569720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dc61fb52-cb68-4704-9b17-676d848517ce req-ff6dc9b9-21af-434d-9b0b-79bf172810ee service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:59.570210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dc61fb52-cb68-4704-9b17-676d848517ce req-ff6dc9b9-21af-434d-9b0b-79bf172810ee service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:59.571023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-dc61fb52-cb68-4704-9b17-676d848517ce req-ff6dc9b9-21af-434d-9b0b-79bf172810ee service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:59.588746 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-dc61fb52-cb68-4704-9b17-676d848517ce req-ff6dc9b9-21af-434d-9b0b-79bf172810ee service nova] Creating event network-vif-deleted:83167976-9249-40a3-abc3-69dbea2febab for instance 315e78a8-c36d-499b-be7e-fabfa3b658eb on n-h2-820368-35 Aug 27 05:48:59.593607 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-dc61fb52-cb68-4704-9b17-676d848517ce req-ff6dc9b9-21af-434d-9b0b-79bf172810ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048388 Aug 27 05:48:59.594758 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3644/7280] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:59.988065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:59.988594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: 315e78a8-c36d-499b-be7e-fabfa3b658eb] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:59.991312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=36 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:59.998258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:59.998938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:59.999537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:00.000381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:00.001023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:00.001561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:00.022496 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] HTTP exception thrown: Instance 315e78a8-c36d-499b-be7e-fabfa3b658eb could not be found. Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Request method failure captured: Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb HTTP/1.1 Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCa_jPEpMynbUjr4CK5gr_f0OPQPlRNz2PImvbnbUYYvhpvnuCPwo3qjfWibvDe-8dKHaUJz_1BG5xUC2MsNxy5xb9HKpeiT5cIzJk-ZBpqVSjmx-FJl3dQB55CGMr9aAH7cx0gsUmm22RUsE8uPbc4PlOVJqPyXD_m91Imub-yFK3Ic Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: bf0410f354c544919fc369970768b5b6 Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1839466746 Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bf0410f354c544919fc369970768b5b6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bf0410f354c544919fc369970768b5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf0410f354c544919fc369970768b5b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf0410f354c544919fc369970768b5b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerDiskConfigTestJSON-1839466746 Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: bf0410f354c544919fc369970768b5b6 Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1839466746 Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerDiskConfigTestJSON-1839466746-project Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: a992fc48c4c141649c2698094d40cbec Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerDiskConfigTestJSON-1839466746-project Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 315e78a8-c36d-499b-be7e-fabfa3b658eb could not be found. Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '315e78a8-c36d-499b-be7e-fabfa3b658eb'} Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 315e78a8-c36d-499b-be7e-fabfa3b658eb could not be found. Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 315e78a8-c36d-499b-be7e-fabfa3b658eb could not be found. Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:49:00.024223 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.028387 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:49:00.028387 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:49:00.028387 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:49:00.028387 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:49:00.028387 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:49:00.028387 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 315e78a8-c36d-499b-be7e-fabfa3b658eb could not be found. Aug 27 05:49:00.028387 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.028387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Returning 404 to user: Instance 315e78a8-c36d-499b-be7e-fabfa3b658eb could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:49:00.028387 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1f34ec04-f5ca-4f3a-9866-431a2913a8c2 tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb" status: 404 len: 111 microversion: 2.1 time: 0.041797 Aug 27 05:49:00.028387 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3637/7281] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:59 2022] GET /compute/v2.1/servers/315e78a8-c36d-499b-be7e-fabfa3b658eb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:49:00.035557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce3a7a83-2c28-4170-a870-be7e600f8c0e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '.version_select at 0x7fb5651b5dc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:00.056983 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce3a7a83-2c28-4170-a870-be7e600f8c0e tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-278518209" status: 202 len: 0 microversion: 2.1 time: 0.025773 Aug 27 05:49:00.057570 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3645/7282] 10.222.0.58 () {58 vars in 1218 bytes} [Sat Aug 27 05:49:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-278518209 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:49:00.686297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:00.686816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:00.692947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:00.693446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:00.693900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:00.694609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:00.695079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:00.695613 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:00.709676 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] HTTP exception thrown: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Request method failure captured: Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e HTTP/1.1 Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCa_jPEpMynbUjr4CK5gr_f0OPQPlRNz2PImvbnbUYYvhpvnuCPwo3qjfWibvDe-8dKHaUJz_1BG5xUC2MsNxy5xb9HKpeiT5cIzJk-ZBpqVSjmx-FJl3dQB55CGMr9aAH7cx0gsUmm22RUsE8uPbc4PlOVJqPyXD_m91Imub-yFK3Ic Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: bf0410f354c544919fc369970768b5b6 Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1839466746 Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bf0410f354c544919fc369970768b5b6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bf0410f354c544919fc369970768b5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf0410f354c544919fc369970768b5b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf0410f354c544919fc369970768b5b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerDiskConfigTestJSON-1839466746 Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: bf0410f354c544919fc369970768b5b6 Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1839466746 Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerDiskConfigTestJSON-1839466746-project Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: a992fc48c4c141649c2698094d40cbec Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerDiskConfigTestJSON-1839466746-project Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'd55f7c3a-232e-448f-8a99-63a2076b8a0e'} Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:49:00.711310 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Returning 404 to user: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2edd8666-2fa4-44f6-ae77-6086e349220b tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 404 len: 111 microversion: 2.1 time: 0.030450 Aug 27 05:49:00.716182 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3638/7283] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:49:00 2022] DELETE /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:49:00.723153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:00.723896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] [instance: d55f7c3a-232e-448f-8a99-63a2076b8a0e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:00.730521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:00.731074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:00.731565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:00.732266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:00.732723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:00.733143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:00.746464 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] HTTP exception thrown: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Request method failure captured: Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e HTTP/1.1 Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCa_jPEpMynbUjr4CK5gr_f0OPQPlRNz2PImvbnbUYYvhpvnuCPwo3qjfWibvDe-8dKHaUJz_1BG5xUC2MsNxy5xb9HKpeiT5cIzJk-ZBpqVSjmx-FJl3dQB55CGMr9aAH7cx0gsUmm22RUsE8uPbc4PlOVJqPyXD_m91Imub-yFK3Ic Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: bf0410f354c544919fc369970768b5b6 Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1839466746 Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bf0410f354c544919fc369970768b5b6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bf0410f354c544919fc369970768b5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf0410f354c544919fc369970768b5b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf0410f354c544919fc369970768b5b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerDiskConfigTestJSON-1839466746 Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: bf0410f354c544919fc369970768b5b6 Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1839466746 Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerDiskConfigTestJSON-1839466746-project Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: a992fc48c4c141649c2698094d40cbec Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerDiskConfigTestJSON-1839466746-project Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'd55f7c3a-232e-448f-8a99-63a2076b8a0e'} Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:49:00.748134 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.752558 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:49:00.752558 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:49:00.752558 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:49:00.752558 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:49:00.752558 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:49:00.752558 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. Aug 27 05:49:00.752558 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:49:00.752558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] Returning 404 to user: Instance d55f7c3a-232e-448f-8a99-63a2076b8a0e could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:49:00.752558 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-86733f33-aa1f-482c-9946-6b9e7004b45a tempest-ServerDiskConfigTestJSON-1839466746 tempest-ServerDiskConfigTestJSON-1839466746-project] 10.222.0.58 "GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e" status: 404 len: 111 microversion: 2.1 time: 0.031413 Aug 27 05:49:00.753410 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3646/7284] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:00 2022] GET /compute/v2.1/servers/d55f7c3a-232e-448f-8a99-63a2076b8a0e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:49:09.433004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-64ab4736-1102-4855-b2a7-12fcf9a7aaa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'create', calling method: .version_select at 0x7fb565962f70>, body: {"keypair": {"name": "tempest-keypair-94422661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0i6dq9Q9JDWCGi9ECpWJlPo1dn1gnMDTcy2qZg6jwqBa9zVzKmSHXjx+D3NtHEDl7GbZPsu+6pPLaqzMtK0jyaREIjJcvGvy+88FAjzs8p2OHioPIJpoyTSzPJRVlSdg=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:49:09.451458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-64ab4736-1102-4855-b2a7-12fcf9a7aaa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:49:09.457810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-64ab4736-1102-4855-b2a7-12fcf9a7aaa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for user ffa36ffb13d74ef5a9cb4385917dcd05 and project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:49:09.489391 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-64ab4736-1102-4855-b2a7-12fcf9a7aaa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.184568 Aug 27 05:49:09.490003 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3639/7285] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:49:09 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:49:10.783828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-599829442", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e601665f-33df-4210-8164-8ee874f4ba24"}], "security_groups": [{"name": "tempest-securitygroup--943770067"}], "key_name": "tempest-keypair-94422661", "user_data": "}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:49:10.793904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:49:10.794954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:49:10.908573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] validate_networks() for [('e601665f-33df-4210-8164-8ee874f4ba24', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:49:11.291504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:49:11.291981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:49:11.292704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:49:11.293131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:49:11.293547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:49:11.302623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:11.303143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:11.303605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:11.304391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:11.304847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:11.305276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:11.323238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:49:11.329527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for user ffa36ffb13d74ef5a9cb4385917dcd05 and project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:49:11.342645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:49:11.345021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:49:11.394637 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-75cec009-4bcb-4713-a330-af11219a2e85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.614930 Aug 27 05:49:11.395616 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3647/7286] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:49:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:49:11.407526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-43e9757f-f69c-412b-8a20-ef0a2855b46c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:11.408169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-43e9757f-f69c-412b-8a20-ef0a2855b46c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:11.410867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:49:11.478056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-43e9757f-f69c-412b-8a20-ef0a2855b46c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:11.486017 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-43e9757f-f69c-412b-8a20-ef0a2855b46c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1236 microversion: 2.1 time: 0.082226 Aug 27 05:49:11.486608 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3640/7287] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:11 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:12.508789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-942e79dd-a50b-4a78-a6a7-7484ec3ffe82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:12.509479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-942e79dd-a50b-4a78-a6a7-7484ec3ffe82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:12.516675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-942e79dd-a50b-4a78-a6a7-7484ec3ffe82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:12.517380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-942e79dd-a50b-4a78-a6a7-7484ec3ffe82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:12.517813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-942e79dd-a50b-4a78-a6a7-7484ec3ffe82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:12.518511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-942e79dd-a50b-4a78-a6a7-7484ec3ffe82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:12.518965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-942e79dd-a50b-4a78-a6a7-7484ec3ffe82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:12.519408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-942e79dd-a50b-4a78-a6a7-7484ec3ffe82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:12.589527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-942e79dd-a50b-4a78-a6a7-7484ec3ffe82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:12.599180 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-942e79dd-a50b-4a78-a6a7-7484ec3ffe82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1288 microversion: 2.1 time: 0.095254 Aug 27 05:49:12.600294 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3648/7288] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:12 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:13.621244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bd546e23-7a62-420f-92e2-181901c2b72e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:13.621967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bd546e23-7a62-420f-92e2-181901c2b72e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:13.629019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd546e23-7a62-420f-92e2-181901c2b72e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:13.629516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd546e23-7a62-420f-92e2-181901c2b72e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:13.629968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd546e23-7a62-420f-92e2-181901c2b72e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:13.630753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd546e23-7a62-420f-92e2-181901c2b72e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:13.631256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd546e23-7a62-420f-92e2-181901c2b72e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:13.631694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bd546e23-7a62-420f-92e2-181901c2b72e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:13.779854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bd546e23-7a62-420f-92e2-181901c2b72e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:13.788152 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bd546e23-7a62-420f-92e2-181901c2b72e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1361 microversion: 2.1 time: 0.171281 Aug 27 05:49:13.789022 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3641/7289] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:13 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:14.300775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-e7e8966b-1be9-4b4e-8528-593553d3278d req-89dd8026-c878-4c0f-be4b-10db5fa9bcea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "995165b1-6d47-4fe1-b892-f0cdaa5dd5de", "tag": "b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:49:14.311920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e7e8966b-1be9-4b4e-8528-593553d3278d req-89dd8026-c878-4c0f-be4b-10db5fa9bcea service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:14.312328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e7e8966b-1be9-4b4e-8528-593553d3278d req-89dd8026-c878-4c0f-be4b-10db5fa9bcea service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:14.312769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-e7e8966b-1be9-4b4e-8528-593553d3278d req-89dd8026-c878-4c0f-be4b-10db5fa9bcea service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:14.325023 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-e7e8966b-1be9-4b4e-8528-593553d3278d req-89dd8026-c878-4c0f-be4b-10db5fa9bcea service nova] Creating event network-changed:b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b for instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de on n-h2-820368-35 Aug 27 05:49:14.330094 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-e7e8966b-1be9-4b4e-8528-593553d3278d req-89dd8026-c878-4c0f-be4b-10db5fa9bcea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033010 Aug 27 05:49:14.330894 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3649/7290] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:49:14.810934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5f85dbe-2bf8-488a-9484-8bcdc5c1aa46 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:14.811658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b5f85dbe-2bf8-488a-9484-8bcdc5c1aa46 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:14.818911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f85dbe-2bf8-488a-9484-8bcdc5c1aa46 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:14.819456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f85dbe-2bf8-488a-9484-8bcdc5c1aa46 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:14.819911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f85dbe-2bf8-488a-9484-8bcdc5c1aa46 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:14.820636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f85dbe-2bf8-488a-9484-8bcdc5c1aa46 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:14.821102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f85dbe-2bf8-488a-9484-8bcdc5c1aa46 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:14.821539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5f85dbe-2bf8-488a-9484-8bcdc5c1aa46 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:14.968838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5f85dbe-2bf8-488a-9484-8bcdc5c1aa46 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:14.976793 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5f85dbe-2bf8-488a-9484-8bcdc5c1aa46 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1361 microversion: 2.1 time: 0.170479 Aug 27 05:49:14.977370 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3642/7291] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:14 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:15.999877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-03f95106-6476-44f0-bef3-e771e183eedf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:16.000619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-03f95106-6476-44f0-bef3-e771e183eedf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:16.006753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03f95106-6476-44f0-bef3-e771e183eedf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:16.007286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03f95106-6476-44f0-bef3-e771e183eedf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:16.007732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03f95106-6476-44f0-bef3-e771e183eedf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:16.008434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03f95106-6476-44f0-bef3-e771e183eedf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:16.008993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03f95106-6476-44f0-bef3-e771e183eedf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:16.009432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03f95106-6476-44f0-bef3-e771e183eedf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:16.145994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-03f95106-6476-44f0-bef3-e771e183eedf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:16.153852 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-03f95106-6476-44f0-bef3-e771e183eedf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1361 microversion: 2.1 time: 0.159592 Aug 27 05:49:16.154431 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3650/7292] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:15 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:17.176335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4cf9b670-8322-4cac-bdb3-c80671399b42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:17.177710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4cf9b670-8322-4cac-bdb3-c80671399b42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:17.189090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4cf9b670-8322-4cac-bdb3-c80671399b42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:17.197431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4cf9b670-8322-4cac-bdb3-c80671399b42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:17.198043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4cf9b670-8322-4cac-bdb3-c80671399b42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:17.198908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4cf9b670-8322-4cac-bdb3-c80671399b42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:17.200024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4cf9b670-8322-4cac-bdb3-c80671399b42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:17.200483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4cf9b670-8322-4cac-bdb3-c80671399b42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:17.348064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4cf9b670-8322-4cac-bdb3-c80671399b42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:17.355882 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4cf9b670-8322-4cac-bdb3-c80671399b42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1361 microversion: 2.1 time: 0.185822 Aug 27 05:49:17.356471 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3643/7293] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:17 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:18.375793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-451dc3d4-c03c-4bb0-a427-a1694729840c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:18.376423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-451dc3d4-c03c-4bb0-a427-a1694729840c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:18.383616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-451dc3d4-c03c-4bb0-a427-a1694729840c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:18.384095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-451dc3d4-c03c-4bb0-a427-a1694729840c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:18.384547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-451dc3d4-c03c-4bb0-a427-a1694729840c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:18.385406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-451dc3d4-c03c-4bb0-a427-a1694729840c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:18.385868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-451dc3d4-c03c-4bb0-a427-a1694729840c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:18.386303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-451dc3d4-c03c-4bb0-a427-a1694729840c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:18.516581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-451dc3d4-c03c-4bb0-a427-a1694729840c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:18.524311 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-451dc3d4-c03c-4bb0-a427-a1694729840c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1361 microversion: 2.1 time: 0.152438 Aug 27 05:49:18.524990 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3651/7294] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:18 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:19.148502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1e153c2f-1480-4b0f-9f38-624e4ef635f2 req-f4448dd3-1754-4c71-95ca-1318c8829b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995165b1-6d47-4fe1-b892-f0cdaa5dd5de", "name": "network-vif-plugged", "status": "completed", "tag": "b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:49:19.158045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1e153c2f-1480-4b0f-9f38-624e4ef635f2 req-f4448dd3-1754-4c71-95ca-1318c8829b19 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:19.158750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1e153c2f-1480-4b0f-9f38-624e4ef635f2 req-f4448dd3-1754-4c71-95ca-1318c8829b19 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:19.158966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1e153c2f-1480-4b0f-9f38-624e4ef635f2 req-f4448dd3-1754-4c71-95ca-1318c8829b19 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:19.172577 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1e153c2f-1480-4b0f-9f38-624e4ef635f2 req-f4448dd3-1754-4c71-95ca-1318c8829b19 service nova] Creating event network-vif-plugged:b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b for instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de on n-h2-820368-35 Aug 27 05:49:19.178122 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1e153c2f-1480-4b0f-9f38-624e4ef635f2 req-f4448dd3-1754-4c71-95ca-1318c8829b19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098710 Aug 27 05:49:19.178722 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3644/7295] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:49:19.545200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-84d272c2-fb71-444b-ac69-f091baaa612b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:19.545817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-84d272c2-fb71-444b-ac69-f091baaa612b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:19.553012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d272c2-fb71-444b-ac69-f091baaa612b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:19.553443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d272c2-fb71-444b-ac69-f091baaa612b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:19.553883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d272c2-fb71-444b-ac69-f091baaa612b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:19.554577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d272c2-fb71-444b-ac69-f091baaa612b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:19.555036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d272c2-fb71-444b-ac69-f091baaa612b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:19.555491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-84d272c2-fb71-444b-ac69-f091baaa612b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:19.691620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-84d272c2-fb71-444b-ac69-f091baaa612b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:19.699999 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-84d272c2-fb71-444b-ac69-f091baaa612b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1361 microversion: 2.1 time: 0.158133 Aug 27 05:49:19.700551 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3652/7296] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:19 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:20.721119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e02b5026-d6cd-47c8-bc77-82168b9d8de5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:20.721832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e02b5026-d6cd-47c8-bc77-82168b9d8de5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:20.728974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e02b5026-d6cd-47c8-bc77-82168b9d8de5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:20.729491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e02b5026-d6cd-47c8-bc77-82168b9d8de5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:20.729919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e02b5026-d6cd-47c8-bc77-82168b9d8de5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:20.730622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e02b5026-d6cd-47c8-bc77-82168b9d8de5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:20.731110 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e02b5026-d6cd-47c8-bc77-82168b9d8de5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:20.731550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e02b5026-d6cd-47c8-bc77-82168b9d8de5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:20.863958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e02b5026-d6cd-47c8-bc77-82168b9d8de5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:20.872285 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e02b5026-d6cd-47c8-bc77-82168b9d8de5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1548 microversion: 2.1 time: 0.155452 Aug 27 05:49:20.872868 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3645/7297] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:20 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:20.892405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2486b273-e17e-4298-9b7c-aff4c2210c0f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:20.892900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2486b273-e17e-4298-9b7c-aff4c2210c0f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:20.899604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486b273-e17e-4298-9b7c-aff4c2210c0f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:20.900141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486b273-e17e-4298-9b7c-aff4c2210c0f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:20.900517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486b273-e17e-4298-9b7c-aff4c2210c0f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:20.901216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486b273-e17e-4298-9b7c-aff4c2210c0f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:20.901656 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486b273-e17e-4298-9b7c-aff4c2210c0f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:20.902083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2486b273-e17e-4298-9b7c-aff4c2210c0f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:20.978166 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2486b273-e17e-4298-9b7c-aff4c2210c0f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089571 Aug 27 05:49:20.978772 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3653/7298] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:49:20 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:49:22.234414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-94ddcb81-4a8b-4ead-9743-589b099e0587 req-b58d7533-4915-47a3-bba2-0be163568ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "995165b1-6d47-4fe1-b892-f0cdaa5dd5de", "tag": "b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:49:22.243163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:49:22.251258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-94ddcb81-4a8b-4ead-9743-589b099e0587 req-b58d7533-4915-47a3-bba2-0be163568ff1 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:22.251765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-94ddcb81-4a8b-4ead-9743-589b099e0587 req-b58d7533-4915-47a3-bba2-0be163568ff1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:22.252216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-94ddcb81-4a8b-4ead-9743-589b099e0587 req-b58d7533-4915-47a3-bba2-0be163568ff1 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:22.267533 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-94ddcb81-4a8b-4ead-9743-589b099e0587 req-b58d7533-4915-47a3-bba2-0be163568ff1 service nova] Creating event network-changed:b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b for instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de on n-h2-820368-35 Aug 27 05:49:22.273038 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-94ddcb81-4a8b-4ead-9743-589b099e0587 req-b58d7533-4915-47a3-bba2-0be163568ff1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042372 Aug 27 05:49:22.274803 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3646/7299] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:50:37.325688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:37.326559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:37.329071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:37.330230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=32 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:37.336582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c7ddea93-99c8-4ec1-8465-29f0cddce3ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:37.337201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c7ddea93-99c8-4ec1-8465-29f0cddce3ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:37.346020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ddea93-99c8-4ec1-8465-29f0cddce3ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:37.346508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ddea93-99c8-4ec1-8465-29f0cddce3ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:37.346952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ddea93-99c8-4ec1-8465-29f0cddce3ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:37.347684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ddea93-99c8-4ec1-8465-29f0cddce3ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:37.348144 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ddea93-99c8-4ec1-8465-29f0cddce3ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:37.348612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c7ddea93-99c8-4ec1-8465-29f0cddce3ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:37.640288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c7ddea93-99c8-4ec1-8465-29f0cddce3ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:37.648705 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c7ddea93-99c8-4ec1-8465-29f0cddce3ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1666 microversion: 2.1 time: 0.324208 Aug 27 05:50:37.649285 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3654/7300] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:37 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1666 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:37.670512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:37.671344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=28 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:37.672703 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:50:37.672829 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 05:50:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de (ip 10.222.0.58) !!! Aug 27 05:50:37.679511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b92dc6b9-12c2-4c3a-8c6e-e2af5aa1b335 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:37.680233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b92dc6b9-12c2-4c3a-8c6e-e2af5aa1b335 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:37.689791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92dc6b9-12c2-4c3a-8c6e-e2af5aa1b335 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:37.690286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92dc6b9-12c2-4c3a-8c6e-e2af5aa1b335 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:37.690737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92dc6b9-12c2-4c3a-8c6e-e2af5aa1b335 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:37.691483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92dc6b9-12c2-4c3a-8c6e-e2af5aa1b335 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:37.691952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92dc6b9-12c2-4c3a-8c6e-e2af5aa1b335 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:37.692393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b92dc6b9-12c2-4c3a-8c6e-e2af5aa1b335 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:37.945049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b92dc6b9-12c2-4c3a-8c6e-e2af5aa1b335 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:37.952881 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b92dc6b9-12c2-4c3a-8c6e-e2af5aa1b335 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1666 microversion: 2.1 time: 0.285239 Aug 27 05:50:37.953463 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3647/7301] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:37 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1666 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:37.972490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-99161dbd-cc4d-47e7-a3a4-652f59f65a79 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:37.973128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-99161dbd-cc4d-47e7-a3a4-652f59f65a79 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:37.979974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99161dbd-cc4d-47e7-a3a4-652f59f65a79 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:37.980474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99161dbd-cc4d-47e7-a3a4-652f59f65a79 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:37.980949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99161dbd-cc4d-47e7-a3a4-652f59f65a79 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:37.981652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99161dbd-cc4d-47e7-a3a4-652f59f65a79 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:37.982111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99161dbd-cc4d-47e7-a3a4-652f59f65a79 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:37.982548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-99161dbd-cc4d-47e7-a3a4-652f59f65a79 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:38.109773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-99161dbd-cc4d-47e7-a3a4-652f59f65a79 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:38.118224 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-99161dbd-cc4d-47e7-a3a4-652f59f65a79 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1666 microversion: 2.1 time: 0.149596 Aug 27 05:50:38.118808 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3655/7302] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:37 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:38.139320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:50:38.141599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:38.147602 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:38.148316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:38.148774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:38.149492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:38.149968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:38.150414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:38.179269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:38.185141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Old instance type m1.heat2, new instance type m1.heat {{(pid=128547) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:50:38.192140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:50:38.192582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:50:38.193077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:50:38.193509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:50:38.193944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:50:38.259562 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3711e094-8cef-4af5-855f-5b9748956b60 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de/action" status: 202 len: 0 microversion: 2.1 time: 0.124149 Aug 27 05:50:38.260174 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3648/7303] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:50:38 2022] POST /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:50:38.268213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-891b104c-e400-4f54-911e-f149ef562cdc tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:38.268831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-891b104c-e400-4f54-911e-f149ef562cdc tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:38.274755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-891b104c-e400-4f54-911e-f149ef562cdc tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:38.275283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-891b104c-e400-4f54-911e-f149ef562cdc tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:38.275719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-891b104c-e400-4f54-911e-f149ef562cdc tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:38.276414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-891b104c-e400-4f54-911e-f149ef562cdc tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:38.276863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-891b104c-e400-4f54-911e-f149ef562cdc tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:38.277287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-891b104c-e400-4f54-911e-f149ef562cdc tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:38.435978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-891b104c-e400-4f54-911e-f149ef562cdc tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:38.444242 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-891b104c-e400-4f54-911e-f149ef562cdc tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1675 microversion: 2.1 time: 0.179897 Aug 27 05:50:38.445003 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3656/7304] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:38 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:39.467463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1d73a4a-a1b1-423a-9d18-856ba69a164e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:39.468043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1d73a4a-a1b1-423a-9d18-856ba69a164e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:39.474635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1d73a4a-a1b1-423a-9d18-856ba69a164e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:39.475155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1d73a4a-a1b1-423a-9d18-856ba69a164e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:39.475610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1d73a4a-a1b1-423a-9d18-856ba69a164e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:39.476317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1d73a4a-a1b1-423a-9d18-856ba69a164e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:39.476790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1d73a4a-a1b1-423a-9d18-856ba69a164e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:39.477233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1d73a4a-a1b1-423a-9d18-856ba69a164e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:39.608761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1d73a4a-a1b1-423a-9d18-856ba69a164e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:39.617260 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1d73a4a-a1b1-423a-9d18-856ba69a164e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1675 microversion: 2.1 time: 0.154692 Aug 27 05:50:39.617942 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3649/7305] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:39 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:40.638335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-54203d07-17e6-4e93-9e32-ed08fea45bff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:40.638955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-54203d07-17e6-4e93-9e32-ed08fea45bff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:40.646472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54203d07-17e6-4e93-9e32-ed08fea45bff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:40.646957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54203d07-17e6-4e93-9e32-ed08fea45bff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:40.647437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54203d07-17e6-4e93-9e32-ed08fea45bff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:40.648163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54203d07-17e6-4e93-9e32-ed08fea45bff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:40.648668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54203d07-17e6-4e93-9e32-ed08fea45bff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:40.649228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-54203d07-17e6-4e93-9e32-ed08fea45bff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:40.782867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-54203d07-17e6-4e93-9e32-ed08fea45bff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:40.791765 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-54203d07-17e6-4e93-9e32-ed08fea45bff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1680 microversion: 2.1 time: 0.157346 Aug 27 05:50:40.792343 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3657/7306] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:40 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:41.813987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0df2b8c1-e4b2-49ab-a569-8e84ed690c03 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:41.814620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0df2b8c1-e4b2-49ab-a569-8e84ed690c03 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:41.822787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0df2b8c1-e4b2-49ab-a569-8e84ed690c03 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:41.823332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0df2b8c1-e4b2-49ab-a569-8e84ed690c03 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:41.823787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0df2b8c1-e4b2-49ab-a569-8e84ed690c03 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:41.824503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0df2b8c1-e4b2-49ab-a569-8e84ed690c03 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:41.824974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0df2b8c1-e4b2-49ab-a569-8e84ed690c03 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:41.825419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0df2b8c1-e4b2-49ab-a569-8e84ed690c03 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:41.953287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0df2b8c1-e4b2-49ab-a569-8e84ed690c03 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:41.960998 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0df2b8c1-e4b2-49ab-a569-8e84ed690c03 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1680 microversion: 2.1 time: 0.151200 Aug 27 05:50:41.961576 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3650/7307] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:41 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:42.982148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af105cc8-bce4-4ff5-9ea1-7dc5a33bf314 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:42.982925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-af105cc8-bce4-4ff5-9ea1-7dc5a33bf314 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:42.990618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af105cc8-bce4-4ff5-9ea1-7dc5a33bf314 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:42.991133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af105cc8-bce4-4ff5-9ea1-7dc5a33bf314 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:42.991578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af105cc8-bce4-4ff5-9ea1-7dc5a33bf314 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:42.992290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af105cc8-bce4-4ff5-9ea1-7dc5a33bf314 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:42.992746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af105cc8-bce4-4ff5-9ea1-7dc5a33bf314 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:42.993233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af105cc8-bce4-4ff5-9ea1-7dc5a33bf314 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:43.154530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af105cc8-bce4-4ff5-9ea1-7dc5a33bf314 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:43.163485 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af105cc8-bce4-4ff5-9ea1-7dc5a33bf314 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1680 microversion: 2.1 time: 0.186053 Aug 27 05:50:43.164084 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3658/7308] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:42 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:50:44.185903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c737bec2-d2b1-423e-b47d-03bde9f645f1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:44.186541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c737bec2-d2b1-423e-b47d-03bde9f645f1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:44.193468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c737bec2-d2b1-423e-b47d-03bde9f645f1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:44.193968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c737bec2-d2b1-423e-b47d-03bde9f645f1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:44.194422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c737bec2-d2b1-423e-b47d-03bde9f645f1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:44.195290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c737bec2-d2b1-423e-b47d-03bde9f645f1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:44.195730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c737bec2-d2b1-423e-b47d-03bde9f645f1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:44.196174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c737bec2-d2b1-423e-b47d-03bde9f645f1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:44.324935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c737bec2-d2b1-423e-b47d-03bde9f645f1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:44.332642 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c737bec2-d2b1-423e-b47d-03bde9f645f1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1680 microversion: 2.1 time: 0.150631 Aug 27 05:50:44.333220 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3651/7309] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:44 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:45.354457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-08bab90a-d4e6-4493-8597-258687769360 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:45.355073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-08bab90a-d4e6-4493-8597-258687769360 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:45.364733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08bab90a-d4e6-4493-8597-258687769360 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:45.365213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08bab90a-d4e6-4493-8597-258687769360 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:45.365653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08bab90a-d4e6-4493-8597-258687769360 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:45.366343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08bab90a-d4e6-4493-8597-258687769360 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:45.366793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08bab90a-d4e6-4493-8597-258687769360 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:45.367249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-08bab90a-d4e6-4493-8597-258687769360 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:45.500083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-08bab90a-d4e6-4493-8597-258687769360 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:45.508218 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-08bab90a-d4e6-4493-8597-258687769360 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1680 microversion: 2.1 time: 0.157956 Aug 27 05:50:45.508806 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3659/7310] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:45 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:46.530051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7cdcf6e-4fa7-4979-bc87-a0b4f29600a3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:46.530687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7cdcf6e-4fa7-4979-bc87-a0b4f29600a3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:46.538108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7cdcf6e-4fa7-4979-bc87-a0b4f29600a3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:46.538610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7cdcf6e-4fa7-4979-bc87-a0b4f29600a3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:46.539066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7cdcf6e-4fa7-4979-bc87-a0b4f29600a3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:46.539807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7cdcf6e-4fa7-4979-bc87-a0b4f29600a3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:46.540536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7cdcf6e-4fa7-4979-bc87-a0b4f29600a3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:46.540986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7cdcf6e-4fa7-4979-bc87-a0b4f29600a3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:46.680816 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a7cdcf6e-4fa7-4979-bc87-a0b4f29600a3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:46.688671 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7cdcf6e-4fa7-4979-bc87-a0b4f29600a3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1680 microversion: 2.1 time: 0.162587 Aug 27 05:50:46.689243 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3652/7311] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:46 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:47.710502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b1d0030a-5cfe-4bc8-b049-1a88feda9aa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:47.711136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b1d0030a-5cfe-4bc8-b049-1a88feda9aa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:47.718038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1d0030a-5cfe-4bc8-b049-1a88feda9aa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:47.718517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1d0030a-5cfe-4bc8-b049-1a88feda9aa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:47.718954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1d0030a-5cfe-4bc8-b049-1a88feda9aa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:47.719681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1d0030a-5cfe-4bc8-b049-1a88feda9aa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:47.720132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1d0030a-5cfe-4bc8-b049-1a88feda9aa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:47.720558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b1d0030a-5cfe-4bc8-b049-1a88feda9aa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:47.852077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b1d0030a-5cfe-4bc8-b049-1a88feda9aa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:47.859754 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b1d0030a-5cfe-4bc8-b049-1a88feda9aa1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1680 microversion: 2.1 time: 0.153186 Aug 27 05:50:47.860305 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3660/7312] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:47 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:48.882635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-14ac95d3-0c5b-4f4d-af03-2c92ecbbee58 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:48.883306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-14ac95d3-0c5b-4f4d-af03-2c92ecbbee58 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:48.893304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14ac95d3-0c5b-4f4d-af03-2c92ecbbee58 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:48.893962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14ac95d3-0c5b-4f4d-af03-2c92ecbbee58 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:48.894286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14ac95d3-0c5b-4f4d-af03-2c92ecbbee58 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:48.895020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14ac95d3-0c5b-4f4d-af03-2c92ecbbee58 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:48.895535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14ac95d3-0c5b-4f4d-af03-2c92ecbbee58 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:48.895986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-14ac95d3-0c5b-4f4d-af03-2c92ecbbee58 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:49.044000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-14ac95d3-0c5b-4f4d-af03-2c92ecbbee58 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:49.052180 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-14ac95d3-0c5b-4f4d-af03-2c92ecbbee58 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1680 microversion: 2.1 time: 0.173321 Aug 27 05:50:49.052779 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3653/7313] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:48 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:50.073783 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-36a88e8b-3dd1-4dc8-bb67-478889bb6399 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:50.074408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-36a88e8b-3dd1-4dc8-bb67-478889bb6399 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:50.081433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36a88e8b-3dd1-4dc8-bb67-478889bb6399 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:50.081924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36a88e8b-3dd1-4dc8-bb67-478889bb6399 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:50.082372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36a88e8b-3dd1-4dc8-bb67-478889bb6399 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:50.083075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36a88e8b-3dd1-4dc8-bb67-478889bb6399 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:50.083589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36a88e8b-3dd1-4dc8-bb67-478889bb6399 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:50.084022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36a88e8b-3dd1-4dc8-bb67-478889bb6399 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:50.218173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-36a88e8b-3dd1-4dc8-bb67-478889bb6399 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:50.227606 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-36a88e8b-3dd1-4dc8-bb67-478889bb6399 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1680 microversion: 2.1 time: 0.157423 Aug 27 05:50:50.228373 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3661/7314] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:50 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:51.249979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-09f4c4b7-0fd3-432f-8c14-42f35e388417 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:51.250608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-09f4c4b7-0fd3-432f-8c14-42f35e388417 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:51.257978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09f4c4b7-0fd3-432f-8c14-42f35e388417 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:51.258482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09f4c4b7-0fd3-432f-8c14-42f35e388417 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:51.258927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09f4c4b7-0fd3-432f-8c14-42f35e388417 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:51.259674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09f4c4b7-0fd3-432f-8c14-42f35e388417 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:51.260140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09f4c4b7-0fd3-432f-8c14-42f35e388417 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:51.260576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-09f4c4b7-0fd3-432f-8c14-42f35e388417 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:51.394711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-09f4c4b7-0fd3-432f-8c14-42f35e388417 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:51.402772 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-09f4c4b7-0fd3-432f-8c14-42f35e388417 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1680 microversion: 2.1 time: 0.156730 Aug 27 05:50:51.403422 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3654/7315] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:51 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:52.425268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f23f930f-e4ba-4e48-b2a6-e64599482f06 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:52.425998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f23f930f-e4ba-4e48-b2a6-e64599482f06 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:52.432976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23f930f-e4ba-4e48-b2a6-e64599482f06 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:52.433549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23f930f-e4ba-4e48-b2a6-e64599482f06 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:52.434062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23f930f-e4ba-4e48-b2a6-e64599482f06 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:52.434863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23f930f-e4ba-4e48-b2a6-e64599482f06 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:52.435454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23f930f-e4ba-4e48-b2a6-e64599482f06 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:52.435962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f23f930f-e4ba-4e48-b2a6-e64599482f06 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:52.650713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f23f930f-e4ba-4e48-b2a6-e64599482f06 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:52.659100 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f23f930f-e4ba-4e48-b2a6-e64599482f06 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1679 microversion: 2.1 time: 0.237144 Aug 27 05:50:52.659700 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3662/7316] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:52 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:52.989081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-07ef3d07-f3b9-4aa0-b2cd-519a475e0a07 req-6f6b921f-3a7e-4bd8-a146-36488944b57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995165b1-6d47-4fe1-b892-f0cdaa5dd5de", "name": "network-vif-unplugged", "status": "completed", "tag": "b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:50:53.003562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-07ef3d07-f3b9-4aa0-b2cd-519a475e0a07 req-6f6b921f-3a7e-4bd8-a146-36488944b57d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:53.004386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-07ef3d07-f3b9-4aa0-b2cd-519a475e0a07 req-6f6b921f-3a7e-4bd8-a146-36488944b57d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:53.005194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-07ef3d07-f3b9-4aa0-b2cd-519a475e0a07 req-6f6b921f-3a7e-4bd8-a146-36488944b57d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:53.022042 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-07ef3d07-f3b9-4aa0-b2cd-519a475e0a07 req-6f6b921f-3a7e-4bd8-a146-36488944b57d service nova] Creating event network-vif-unplugged:b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b for instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de on n-h1-820368-35 Aug 27 05:50:53.027776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-07ef3d07-f3b9-4aa0-b2cd-519a475e0a07 req-6f6b921f-3a7e-4bd8-a146-36488944b57d service nova] Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:50:53.039594 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-07ef3d07-f3b9-4aa0-b2cd-519a475e0a07 req-6f6b921f-3a7e-4bd8-a146-36488944b57d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107642 Aug 27 05:50:53.041530 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3655/7317] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:50:53.680412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-287ac0af-9ca6-456f-8d94-fad06ded5d5e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:53.681053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-287ac0af-9ca6-456f-8d94-fad06ded5d5e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:53.687808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-287ac0af-9ca6-456f-8d94-fad06ded5d5e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:53.688286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-287ac0af-9ca6-456f-8d94-fad06ded5d5e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:53.688723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-287ac0af-9ca6-456f-8d94-fad06ded5d5e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:53.689420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-287ac0af-9ca6-456f-8d94-fad06ded5d5e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:53.689921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-287ac0af-9ca6-456f-8d94-fad06ded5d5e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:53.690563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-287ac0af-9ca6-456f-8d94-fad06ded5d5e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:53.880729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-287ac0af-9ca6-456f-8d94-fad06ded5d5e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:53.888534 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-287ac0af-9ca6-456f-8d94-fad06ded5d5e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1679 microversion: 2.1 time: 0.212064 Aug 27 05:50:53.889107 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3663/7318] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:53 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:54.910847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23c2235b-ad82-4423-9973-e9a7c006e7b2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:54.911594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-23c2235b-ad82-4423-9973-e9a7c006e7b2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:54.919174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23c2235b-ad82-4423-9973-e9a7c006e7b2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:54.919685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23c2235b-ad82-4423-9973-e9a7c006e7b2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:54.920144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23c2235b-ad82-4423-9973-e9a7c006e7b2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:54.920885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23c2235b-ad82-4423-9973-e9a7c006e7b2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:54.921387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23c2235b-ad82-4423-9973-e9a7c006e7b2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:54.921833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23c2235b-ad82-4423-9973-e9a7c006e7b2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:55.055108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-23f04cb5-5653-470a-b31e-eeda03311274 req-07c2ce33-09b1-43c4-8b63-b22a7eca64cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "995165b1-6d47-4fe1-b892-f0cdaa5dd5de", "tag": "b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:50:55.066089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-23f04cb5-5653-470a-b31e-eeda03311274 req-07c2ce33-09b1-43c4-8b63-b22a7eca64cb service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:55.066575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-23f04cb5-5653-470a-b31e-eeda03311274 req-07c2ce33-09b1-43c4-8b63-b22a7eca64cb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:55.066686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-23c2235b-ad82-4423-9973-e9a7c006e7b2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:55.067013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-23f04cb5-5653-470a-b31e-eeda03311274 req-07c2ce33-09b1-43c4-8b63-b22a7eca64cb service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:55.074657 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-23c2235b-ad82-4423-9973-e9a7c006e7b2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1677 microversion: 2.1 time: 0.168562 Aug 27 05:50:55.075264 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3656/7319] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:54 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:55.083203 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-23f04cb5-5653-470a-b31e-eeda03311274 req-07c2ce33-09b1-43c4-8b63-b22a7eca64cb service nova] Creating event network-changed:b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b for instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de on n-h1-820368-35 Aug 27 05:50:55.088969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-23f04cb5-5653-470a-b31e-eeda03311274 req-07c2ce33-09b1-43c4-8b63-b22a7eca64cb service nova] Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:50:55.099698 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-23f04cb5-5653-470a-b31e-eeda03311274 req-07c2ce33-09b1-43c4-8b63-b22a7eca64cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048305 Aug 27 05:50:55.100311 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3664/7320] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:50:56.098124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-17f5bf22-3d39-4bb1-a381-208bf1dc56c3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:56.098681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-17f5bf22-3d39-4bb1-a381-208bf1dc56c3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:56.105624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f5bf22-3d39-4bb1-a381-208bf1dc56c3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:56.106119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f5bf22-3d39-4bb1-a381-208bf1dc56c3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:56.106570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f5bf22-3d39-4bb1-a381-208bf1dc56c3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:56.107307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f5bf22-3d39-4bb1-a381-208bf1dc56c3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:56.107776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f5bf22-3d39-4bb1-a381-208bf1dc56c3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:56.108215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-17f5bf22-3d39-4bb1-a381-208bf1dc56c3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:56.239645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-17f5bf22-3d39-4bb1-a381-208bf1dc56c3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:56.247503 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-17f5bf22-3d39-4bb1-a381-208bf1dc56c3 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1677 microversion: 2.1 time: 0.154553 Aug 27 05:50:56.248072 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3657/7321] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:56 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:57.270784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-50b682dd-abac-4ac9-8d9d-db78c4ae5aff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:57.271521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-50b682dd-abac-4ac9-8d9d-db78c4ae5aff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:57.277712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50b682dd-abac-4ac9-8d9d-db78c4ae5aff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:57.278279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50b682dd-abac-4ac9-8d9d-db78c4ae5aff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:57.278721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50b682dd-abac-4ac9-8d9d-db78c4ae5aff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:57.279451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50b682dd-abac-4ac9-8d9d-db78c4ae5aff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:57.279914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50b682dd-abac-4ac9-8d9d-db78c4ae5aff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:57.280342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50b682dd-abac-4ac9-8d9d-db78c4ae5aff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:57.414676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-50b682dd-abac-4ac9-8d9d-db78c4ae5aff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:57.422722 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-50b682dd-abac-4ac9-8d9d-db78c4ae5aff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1674 microversion: 2.1 time: 0.157643 Aug 27 05:50:57.423388 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3665/7322] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:57 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:57.443341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4f687602-3f38-44e3-bd8a-f9f7ee23a09d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:50:57.443898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4f687602-3f38-44e3-bd8a-f9f7ee23a09d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:57.451021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f687602-3f38-44e3-bd8a-f9f7ee23a09d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:57.451558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f687602-3f38-44e3-bd8a-f9f7ee23a09d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:57.452016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f687602-3f38-44e3-bd8a-f9f7ee23a09d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:57.452731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f687602-3f38-44e3-bd8a-f9f7ee23a09d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:57.453200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f687602-3f38-44e3-bd8a-f9f7ee23a09d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:57.453652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4f687602-3f38-44e3-bd8a-f9f7ee23a09d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:57.514594 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4f687602-3f38-44e3-bd8a-f9f7ee23a09d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de/action" status: 204 len: 0 microversion: 2.1 time: 0.075121 Aug 27 05:50:57.515266 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3658/7323] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:50:57 2022] POST /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:50:57.524531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c0fe09ad-0c70-4a0b-bcb5-61964f52ab59 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:57.524531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c0fe09ad-0c70-4a0b-bcb5-61964f52ab59 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:57.531627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe09ad-0c70-4a0b-bcb5-61964f52ab59 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:57.532280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe09ad-0c70-4a0b-bcb5-61964f52ab59 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:57.532820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe09ad-0c70-4a0b-bcb5-61964f52ab59 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:57.534250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe09ad-0c70-4a0b-bcb5-61964f52ab59 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:57.534857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe09ad-0c70-4a0b-bcb5-61964f52ab59 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:57.535397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c0fe09ad-0c70-4a0b-bcb5-61964f52ab59 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:57.669335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c0fe09ad-0c70-4a0b-bcb5-61964f52ab59 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:57.677854 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c0fe09ad-0c70-4a0b-bcb5-61964f52ab59 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1674 microversion: 2.1 time: 0.157715 Aug 27 05:50:57.678378 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3666/7324] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:57 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:58.700872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c175c45d-080a-4270-825f-1d0d07704cfb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:58.701709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c175c45d-080a-4270-825f-1d0d07704cfb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:58.708640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c175c45d-080a-4270-825f-1d0d07704cfb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:58.709140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c175c45d-080a-4270-825f-1d0d07704cfb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:58.709593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c175c45d-080a-4270-825f-1d0d07704cfb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:58.710329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c175c45d-080a-4270-825f-1d0d07704cfb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:58.710784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c175c45d-080a-4270-825f-1d0d07704cfb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:58.711252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c175c45d-080a-4270-825f-1d0d07704cfb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:58.851565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c175c45d-080a-4270-825f-1d0d07704cfb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:58.859440 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c175c45d-080a-4270-825f-1d0d07704cfb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1666 microversion: 2.1 time: 0.163696 Aug 27 05:50:58.860030 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3659/7325] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:58 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:58.879969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3a073831-ee20-41e3-8930-b049f6530bb9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:58.880597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3a073831-ee20-41e3-8930-b049f6530bb9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:58.887824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a073831-ee20-41e3-8930-b049f6530bb9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:58.888302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a073831-ee20-41e3-8930-b049f6530bb9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:58.888742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a073831-ee20-41e3-8930-b049f6530bb9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:58.889451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a073831-ee20-41e3-8930-b049f6530bb9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:58.889916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a073831-ee20-41e3-8930-b049f6530bb9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:58.890349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3a073831-ee20-41e3-8930-b049f6530bb9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:59.030963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3a073831-ee20-41e3-8930-b049f6530bb9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:59.039503 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3a073831-ee20-41e3-8930-b049f6530bb9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1666 microversion: 2.1 time: 0.163339 Aug 27 05:50:59.040207 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3667/7326] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:58 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:59.065847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-743c2121-b945-407b-8b4c-1cbc72528306 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:59.066493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-743c2121-b945-407b-8b4c-1cbc72528306 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:59.072698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-743c2121-b945-407b-8b4c-1cbc72528306 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:59.073204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-743c2121-b945-407b-8b4c-1cbc72528306 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:59.073666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-743c2121-b945-407b-8b4c-1cbc72528306 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:59.074379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-743c2121-b945-407b-8b4c-1cbc72528306 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:59.074860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-743c2121-b945-407b-8b4c-1cbc72528306 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:59.075338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-743c2121-b945-407b-8b4c-1cbc72528306 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:59.205810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-743c2121-b945-407b-8b4c-1cbc72528306 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:59.213561 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-743c2121-b945-407b-8b4c-1cbc72528306 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1666 microversion: 2.1 time: 0.151634 Aug 27 05:50:59.214134 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3660/7327] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:59 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:59.233996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ba70f798-1ccd-4a89-b6e7-f3df08317b96 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:59.234504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ba70f798-1ccd-4a89-b6e7-f3df08317b96 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:59.241102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba70f798-1ccd-4a89-b6e7-f3df08317b96 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:59.241573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba70f798-1ccd-4a89-b6e7-f3df08317b96 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:59.242016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba70f798-1ccd-4a89-b6e7-f3df08317b96 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:59.242706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba70f798-1ccd-4a89-b6e7-f3df08317b96 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:59.243215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba70f798-1ccd-4a89-b6e7-f3df08317b96 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:59.243675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ba70f798-1ccd-4a89-b6e7-f3df08317b96 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:59.268557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ba70f798-1ccd-4a89-b6e7-f3df08317b96 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:50:59.344688 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ba70f798-1ccd-4a89-b6e7-f3df08317b96 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "DELETE /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 204 len: 0 microversion: 2.1 time: 0.114216 Aug 27 05:50:59.347121 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3668/7328] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:50:59 2022] DELETE /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:50:59.355578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d1ab5dad-ba3a-4158-9593-1c64e7883fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:59.356213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d1ab5dad-ba3a-4158-9593-1c64e7883fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:59.362939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1ab5dad-ba3a-4158-9593-1c64e7883fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:59.363469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1ab5dad-ba3a-4158-9593-1c64e7883fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:59.363917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1ab5dad-ba3a-4158-9593-1c64e7883fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:59.364643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1ab5dad-ba3a-4158-9593-1c64e7883fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:59.365089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1ab5dad-ba3a-4158-9593-1c64e7883fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:59.365604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d1ab5dad-ba3a-4158-9593-1c64e7883fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:59.380730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:59.501099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d1ab5dad-ba3a-4158-9593-1c64e7883fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:59.509333 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d1ab5dad-ba3a-4158-9593-1c64e7883fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1672 microversion: 2.1 time: 0.158773 Aug 27 05:50:59.509907 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3661/7329] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:59 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:00.525620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-534bbf8b-d512-4d7c-bb2c-15b59b3de33c req-63d576ab-5410-4e0d-8851-4d4c193f1e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995165b1-6d47-4fe1-b892-f0cdaa5dd5de", "name": "network-vif-plugged", "status": "completed", "tag": "b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:00.530714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c378593d-a97d-4dfb-8000-c3a28fc9f33a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:00.531415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c378593d-a97d-4dfb-8000-c3a28fc9f33a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:00.536107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-534bbf8b-d512-4d7c-bb2c-15b59b3de33c req-63d576ab-5410-4e0d-8851-4d4c193f1e00 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:00.536587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-534bbf8b-d512-4d7c-bb2c-15b59b3de33c req-63d576ab-5410-4e0d-8851-4d4c193f1e00 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:00.537013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-534bbf8b-d512-4d7c-bb2c-15b59b3de33c req-63d576ab-5410-4e0d-8851-4d4c193f1e00 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:00.538648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c378593d-a97d-4dfb-8000-c3a28fc9f33a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:00.539198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c378593d-a97d-4dfb-8000-c3a28fc9f33a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:00.539659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c378593d-a97d-4dfb-8000-c3a28fc9f33a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:00.540652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c378593d-a97d-4dfb-8000-c3a28fc9f33a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:00.541137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c378593d-a97d-4dfb-8000-c3a28fc9f33a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:00.541402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:00.543531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c378593d-a97d-4dfb-8000-c3a28fc9f33a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:00.549931 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-534bbf8b-d512-4d7c-bb2c-15b59b3de33c req-63d576ab-5410-4e0d-8851-4d4c193f1e00 service nova] Creating event network-vif-plugged:b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b for instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de on n-h1-820368-35 Aug 27 05:51:00.555400 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-534bbf8b-d512-4d7c-bb2c-15b59b3de33c req-63d576ab-5410-4e0d-8851-4d4c193f1e00 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087950 Aug 27 05:51:00.556203 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3669/7330] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:51:00.679211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c378593d-a97d-4dfb-8000-c3a28fc9f33a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:00.687449 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c378593d-a97d-4dfb-8000-c3a28fc9f33a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1672 microversion: 2.1 time: 0.160664 Aug 27 05:51:00.688048 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3662/7331] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:00 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:51:01.712550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0835f5f2-536f-47f3-84be-c39317887037 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:01.713261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0835f5f2-536f-47f3-84be-c39317887037 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:01.720066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835f5f2-536f-47f3-84be-c39317887037 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:01.720892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835f5f2-536f-47f3-84be-c39317887037 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:01.721590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835f5f2-536f-47f3-84be-c39317887037 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:01.722678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835f5f2-536f-47f3-84be-c39317887037 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:01.723288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835f5f2-536f-47f3-84be-c39317887037 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:01.723793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0835f5f2-536f-47f3-84be-c39317887037 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:01.834410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0835f5f2-536f-47f3-84be-c39317887037 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:01.842198 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0835f5f2-536f-47f3-84be-c39317887037 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 200 len: 1605 microversion: 2.1 time: 0.135181 Aug 27 05:51:01.842807 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3670/7332] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:01 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 1605 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:01.946522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-9964f653-1a73-451f-acfc-d1bd06a01ae5 req-ef6f0c69-e24d-469b-a73d-a08417c9df90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995165b1-6d47-4fe1-b892-f0cdaa5dd5de", "name": "network-vif-deleted", "tag": "b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:01.958889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9964f653-1a73-451f-acfc-d1bd06a01ae5 req-ef6f0c69-e24d-469b-a73d-a08417c9df90 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:01.959416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9964f653-1a73-451f-acfc-d1bd06a01ae5 req-ef6f0c69-e24d-469b-a73d-a08417c9df90 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:01.959860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-9964f653-1a73-451f-acfc-d1bd06a01ae5 req-ef6f0c69-e24d-469b-a73d-a08417c9df90 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:01.973497 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-9964f653-1a73-451f-acfc-d1bd06a01ae5 req-ef6f0c69-e24d-469b-a73d-a08417c9df90 service nova] Creating event network-vif-deleted:b6cc2c4d-e7cf-4002-b39f-a8adcd820f5b for instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de on n-h1-820368-35 Aug 27 05:51:01.979616 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-9964f653-1a73-451f-acfc-d1bd06a01ae5 req-ef6f0c69-e24d-469b-a73d-a08417c9df90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037128 Aug 27 05:51:01.980224 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3663/7333] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:51:02.864078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:02.864693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:02.871805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:02.872306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:02.872729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:02.873430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:02.873879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:02.874298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:02.901124 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de HTTP/1.1 Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '995165b1-6d47-4fe1-b892-f0cdaa5dd5de'} Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:51:02.904336 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:51:02.914509 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:51:02.914509 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:51:02.914509 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:51:02.914509 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:51:02.914509 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:51:02.914509 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:51:02.914509 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:51:02.914509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:51:02.914509 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-855a7589-2286-495c-853e-6a42b0aeb344 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 404 len: 111 microversion: 2.1 time: 0.045644 Aug 27 05:51:02.914509 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3671/7334] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:02 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:51:02.922161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:02.922887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:02.929730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:02.930236 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:02.930695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:02.931472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:02.931948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:02.932396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:02.946503 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de HTTP/1.1 Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '995165b1-6d47-4fe1-b892-f0cdaa5dd5de'} Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:51:02.948367 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:51:02.953157 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:51:02.953157 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:51:02.953157 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:51:02.953157 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:51:02.953157 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:51:02.953157 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:51:02.953157 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:51:02.953157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:51:02.953157 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f1f2fa20-e0ab-4c1a-9837-c81b3f60d4b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 404 len: 111 microversion: 2.1 time: 0.032216 Aug 27 05:51:02.953157 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3664/7335] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:02 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:51:02.999209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1591477435", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "e601665f-33df-4210-8164-8ee874f4ba24"}], "security_groups": [{"name": "tempest-securitygroup--943770067"}], "key_name": "tempest-keypair-94422661", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:03.106488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] validate_networks() for [('e601665f-33df-4210-8164-8ee874f4ba24', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:51:03.553725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:51:03.554192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:51:03.554653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:51:03.555061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:51:03.555562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:51:03.567153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:03.567631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:03.568061 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:03.568777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:03.569296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:03.569701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:03.588635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:51:03.593754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for user ffa36ffb13d74ef5a9cb4385917dcd05 and project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:51:03.605920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:51:03.608265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:51:03.654838 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c94118d3-d0ee-4452-9bfa-28f4c6bc740e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.659552 Aug 27 05:51:03.655453 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3672/7336] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:51:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:51:03.668269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d57ec852-dc09-4ed4-84c5-74d93b9ac6b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:03.668848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d57ec852-dc09-4ed4-84c5-74d93b9ac6b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:03.725547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d57ec852-dc09-4ed4-84c5-74d93b9ac6b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:03.736173 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d57ec852-dc09-4ed4-84c5-74d93b9ac6b4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1237 microversion: 2.1 time: 0.073611 Aug 27 05:51:03.737257 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3665/7337] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:03 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:04.759338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-16849eef-9db1-439f-9992-492bad60d3ba tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:04.759904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-16849eef-9db1-439f-9992-492bad60d3ba tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:04.768753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16849eef-9db1-439f-9992-492bad60d3ba tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:04.769286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16849eef-9db1-439f-9992-492bad60d3ba tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:04.769739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16849eef-9db1-439f-9992-492bad60d3ba tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:04.770482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16849eef-9db1-439f-9992-492bad60d3ba tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:04.770964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16849eef-9db1-439f-9992-492bad60d3ba tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:04.771610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-16849eef-9db1-439f-9992-492bad60d3ba tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:04.841769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-16849eef-9db1-439f-9992-492bad60d3ba tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:04.850320 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-16849eef-9db1-439f-9992-492bad60d3ba tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1297 microversion: 2.1 time: 0.095864 Aug 27 05:51:04.850904 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3673/7338] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:04 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:05.873100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd750d80-c5c3-4c3d-ac75-6ed6d2af4f85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:05.873743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd750d80-c5c3-4c3d-ac75-6ed6d2af4f85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:05.881294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd750d80-c5c3-4c3d-ac75-6ed6d2af4f85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:05.881806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd750d80-c5c3-4c3d-ac75-6ed6d2af4f85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:05.882264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd750d80-c5c3-4c3d-ac75-6ed6d2af4f85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:05.882987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd750d80-c5c3-4c3d-ac75-6ed6d2af4f85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:05.883504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd750d80-c5c3-4c3d-ac75-6ed6d2af4f85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:05.883959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd750d80-c5c3-4c3d-ac75-6ed6d2af4f85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:06.026550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dd750d80-c5c3-4c3d-ac75-6ed6d2af4f85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:06.034987 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd750d80-c5c3-4c3d-ac75-6ed6d2af4f85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1362 microversion: 2.1 time: 0.166100 Aug 27 05:51:06.035592 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3666/7339] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:05 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:06.462198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-83db9121-d35b-409e-aae0-10fe1bb9b0e3 req-c9330ff2-bcef-4322-8a90-f0f2c869193c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08bbfd51-80a4-4081-a1db-a37ca98269e7", "tag": "0b41666a-2309-44e3-958d-9e6b888ef4dc"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:06.472484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-83db9121-d35b-409e-aae0-10fe1bb9b0e3 req-c9330ff2-bcef-4322-8a90-f0f2c869193c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:06.472974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-83db9121-d35b-409e-aae0-10fe1bb9b0e3 req-c9330ff2-bcef-4322-8a90-f0f2c869193c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:06.473410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-83db9121-d35b-409e-aae0-10fe1bb9b0e3 req-c9330ff2-bcef-4322-8a90-f0f2c869193c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:06.484584 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-83db9121-d35b-409e-aae0-10fe1bb9b0e3 req-c9330ff2-bcef-4322-8a90-f0f2c869193c service nova] Creating event network-changed:0b41666a-2309-44e3-958d-9e6b888ef4dc for instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 on n-h2-820368-35 Aug 27 05:51:06.489485 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-83db9121-d35b-409e-aae0-10fe1bb9b0e3 req-c9330ff2-bcef-4322-8a90-f0f2c869193c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081834 Aug 27 05:51:06.490257 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3674/7340] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:51:07.057612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d574d34a-1434-4f1f-9a87-7061dfd8539a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:07.058163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d574d34a-1434-4f1f-9a87-7061dfd8539a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:07.065798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d574d34a-1434-4f1f-9a87-7061dfd8539a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:07.066298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d574d34a-1434-4f1f-9a87-7061dfd8539a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:07.066762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d574d34a-1434-4f1f-9a87-7061dfd8539a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:07.067492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d574d34a-1434-4f1f-9a87-7061dfd8539a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:07.067960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d574d34a-1434-4f1f-9a87-7061dfd8539a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:07.068399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d574d34a-1434-4f1f-9a87-7061dfd8539a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:07.201160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d574d34a-1434-4f1f-9a87-7061dfd8539a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:07.209609 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d574d34a-1434-4f1f-9a87-7061dfd8539a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1362 microversion: 2.1 time: 0.156058 Aug 27 05:51:07.210479 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3667/7341] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:07 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:08.232159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ade72be-56cc-410b-bfde-ef2027f5c06d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:08.232896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6ade72be-56cc-410b-bfde-ef2027f5c06d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:08.235749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:08.242751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ade72be-56cc-410b-bfde-ef2027f5c06d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:08.243499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ade72be-56cc-410b-bfde-ef2027f5c06d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:08.243953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ade72be-56cc-410b-bfde-ef2027f5c06d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:08.244660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ade72be-56cc-410b-bfde-ef2027f5c06d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:08.245121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ade72be-56cc-410b-bfde-ef2027f5c06d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:08.245557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ade72be-56cc-410b-bfde-ef2027f5c06d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:08.381746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6ade72be-56cc-410b-bfde-ef2027f5c06d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:08.389393 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6ade72be-56cc-410b-bfde-ef2027f5c06d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1362 microversion: 2.1 time: 0.161499 Aug 27 05:51:08.389965 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3675/7342] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:08 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:09.410323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2dadf722-6c62-4288-a346-b517d0d07250 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:09.411730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2dadf722-6c62-4288-a346-b517d0d07250 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:09.414669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=49 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:09.420368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dadf722-6c62-4288-a346-b517d0d07250 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:09.420901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dadf722-6c62-4288-a346-b517d0d07250 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:09.421351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dadf722-6c62-4288-a346-b517d0d07250 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:09.422070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dadf722-6c62-4288-a346-b517d0d07250 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:09.422523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dadf722-6c62-4288-a346-b517d0d07250 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:09.422961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2dadf722-6c62-4288-a346-b517d0d07250 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:09.554356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2dadf722-6c62-4288-a346-b517d0d07250 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:09.562098 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2dadf722-6c62-4288-a346-b517d0d07250 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1362 microversion: 2.1 time: 0.155761 Aug 27 05:51:09.563399 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3668/7343] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:09 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:10.583576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-139aca6a-a791-4f9f-8078-950de884dd83 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:10.584195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-139aca6a-a791-4f9f-8078-950de884dd83 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:10.591078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-139aca6a-a791-4f9f-8078-950de884dd83 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:10.591585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-139aca6a-a791-4f9f-8078-950de884dd83 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:10.592021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-139aca6a-a791-4f9f-8078-950de884dd83 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:10.592711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-139aca6a-a791-4f9f-8078-950de884dd83 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:10.593161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-139aca6a-a791-4f9f-8078-950de884dd83 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:10.593591 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-139aca6a-a791-4f9f-8078-950de884dd83 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:10.728339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-139aca6a-a791-4f9f-8078-950de884dd83 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:10.736051 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-139aca6a-a791-4f9f-8078-950de884dd83 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1362 microversion: 2.1 time: 0.156555 Aug 27 05:51:10.737565 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3676/7344] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:10 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:11.656847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-07a01949-88e6-4304-915c-16a18711cacb req-ef190bef-2796-4292-852e-7fa9ffafaa67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bbfd51-80a4-4081-a1db-a37ca98269e7", "name": "network-vif-plugged", "status": "completed", "tag": "0b41666a-2309-44e3-958d-9e6b888ef4dc"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:11.667701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-07a01949-88e6-4304-915c-16a18711cacb req-ef190bef-2796-4292-852e-7fa9ffafaa67 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:11.668169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-07a01949-88e6-4304-915c-16a18711cacb req-ef190bef-2796-4292-852e-7fa9ffafaa67 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:11.668616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-07a01949-88e6-4304-915c-16a18711cacb req-ef190bef-2796-4292-852e-7fa9ffafaa67 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:11.680410 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-07a01949-88e6-4304-915c-16a18711cacb req-ef190bef-2796-4292-852e-7fa9ffafaa67 service nova] Creating event network-vif-plugged:0b41666a-2309-44e3-958d-9e6b888ef4dc for instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 on n-h2-820368-35 Aug 27 05:51:11.685355 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-07a01949-88e6-4304-915c-16a18711cacb req-ef190bef-2796-4292-852e-7fa9ffafaa67 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032410 Aug 27 05:51:11.685980 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3669/7345] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:51:11.758614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-556c64bf-da0c-47bf-80dc-3d5a9be1e509 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:11.759814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-556c64bf-da0c-47bf-80dc-3d5a9be1e509 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:11.766365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-556c64bf-da0c-47bf-80dc-3d5a9be1e509 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:11.766852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-556c64bf-da0c-47bf-80dc-3d5a9be1e509 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:11.767336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-556c64bf-da0c-47bf-80dc-3d5a9be1e509 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:11.768066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-556c64bf-da0c-47bf-80dc-3d5a9be1e509 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:11.768524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-556c64bf-da0c-47bf-80dc-3d5a9be1e509 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:11.768950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-556c64bf-da0c-47bf-80dc-3d5a9be1e509 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:11.902114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-556c64bf-da0c-47bf-80dc-3d5a9be1e509 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:11.909703 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-556c64bf-da0c-47bf-80dc-3d5a9be1e509 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1362 microversion: 2.1 time: 0.155112 Aug 27 05:51:11.910263 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3677/7346] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:11 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:51:12.932468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8b6b5081-7e1d-4e17-8d40-2a3b9d41a5c2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:12.933212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8b6b5081-7e1d-4e17-8d40-2a3b9d41a5c2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:12.939376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b6b5081-7e1d-4e17-8d40-2a3b9d41a5c2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:12.939923 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b6b5081-7e1d-4e17-8d40-2a3b9d41a5c2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:12.940373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b6b5081-7e1d-4e17-8d40-2a3b9d41a5c2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:12.941076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b6b5081-7e1d-4e17-8d40-2a3b9d41a5c2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:12.941542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b6b5081-7e1d-4e17-8d40-2a3b9d41a5c2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:12.941980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8b6b5081-7e1d-4e17-8d40-2a3b9d41a5c2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:13.073645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8b6b5081-7e1d-4e17-8d40-2a3b9d41a5c2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:13.082124 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8b6b5081-7e1d-4e17-8d40-2a3b9d41a5c2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1362 microversion: 2.1 time: 0.154890 Aug 27 05:51:13.082701 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3670/7347] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:12 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:14.103762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-49963993-6d43-431a-b423-ff43ad355150 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:14.104385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-49963993-6d43-431a-b423-ff43ad355150 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:14.107112 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:14.107770 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:14.114576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49963993-6d43-431a-b423-ff43ad355150 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:14.115063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49963993-6d43-431a-b423-ff43ad355150 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:14.115530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49963993-6d43-431a-b423-ff43ad355150 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:14.116279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49963993-6d43-431a-b423-ff43ad355150 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:14.116745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49963993-6d43-431a-b423-ff43ad355150 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:14.117179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49963993-6d43-431a-b423-ff43ad355150 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:14.250322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-49963993-6d43-431a-b423-ff43ad355150 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:14.258635 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-49963993-6d43-431a-b423-ff43ad355150 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1549 microversion: 2.1 time: 0.158770 Aug 27 05:51:14.259233 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3678/7348] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:14 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:14.279879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d62ed2ba-20c2-41c6-88a7-bf2918fd8977 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:14.280408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d62ed2ba-20c2-41c6-88a7-bf2918fd8977 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:14.282444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:14.288900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d62ed2ba-20c2-41c6-88a7-bf2918fd8977 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:14.289404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d62ed2ba-20c2-41c6-88a7-bf2918fd8977 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:14.289862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d62ed2ba-20c2-41c6-88a7-bf2918fd8977 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:14.290848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d62ed2ba-20c2-41c6-88a7-bf2918fd8977 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:14.291351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d62ed2ba-20c2-41c6-88a7-bf2918fd8977 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:14.291800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d62ed2ba-20c2-41c6-88a7-bf2918fd8977 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:14.369241 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d62ed2ba-20c2-41c6-88a7-bf2918fd8977 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093240 Aug 27 05:51:14.369848 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3671/7349] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:51:14 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:51:15.609492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-19a41773-80b8-4b6b-b0c4-89fc92c66554 req-a60bdc95-9c0d-4d6c-ba93-a02db29e453b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08bbfd51-80a4-4081-a1db-a37ca98269e7", "tag": "0b41666a-2309-44e3-958d-9e6b888ef4dc"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:15.619663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-19a41773-80b8-4b6b-b0c4-89fc92c66554 req-a60bdc95-9c0d-4d6c-ba93-a02db29e453b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:15.620145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-19a41773-80b8-4b6b-b0c4-89fc92c66554 req-a60bdc95-9c0d-4d6c-ba93-a02db29e453b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:15.620608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-19a41773-80b8-4b6b-b0c4-89fc92c66554 req-a60bdc95-9c0d-4d6c-ba93-a02db29e453b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:15.634931 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-19a41773-80b8-4b6b-b0c4-89fc92c66554 req-a60bdc95-9c0d-4d6c-ba93-a02db29e453b service nova] Creating event network-changed:0b41666a-2309-44e3-958d-9e6b888ef4dc for instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 on n-h2-820368-35 Aug 27 05:51:15.640076 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-19a41773-80b8-4b6b-b0c4-89fc92c66554 req-a60bdc95-9c0d-4d6c-ba93-a02db29e453b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034286 Aug 27 05:51:15.641021 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3679/7350] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:52:27.654253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=7 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:52:27.655282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=43 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:52:27.656213 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:52:27.656352 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 05:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7/action (ip 10.222.0.58) !!! Aug 27 05:52:27.663218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-90629d48-dafe-4182-a24b-aff84a118026 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:27.674840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90629d48-dafe-4182-a24b-aff84a118026 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:27.675957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90629d48-dafe-4182-a24b-aff84a118026 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:27.676410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90629d48-dafe-4182-a24b-aff84a118026 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:27.698352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-90629d48-dafe-4182-a24b-aff84a118026 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Going to try to stop instance {{(pid=128547) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:52:27.739837 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-90629d48-dafe-4182-a24b-aff84a118026 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7/action" status: 202 len: 0 microversion: 2.1 time: 0.087546 Aug 27 05:52:27.740318 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3672/7351] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:52:27 2022] POST /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:52:27.748338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=9 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:52:27.749131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=44 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:52:27.750354 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:52:27.750524 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 05:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 (ip 10.222.0.58) !!! Aug 27 05:52:27.763205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e25ad486-c6be-4d83-b9f6-704a06704d31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:27.763917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e25ad486-c6be-4d83-b9f6-704a06704d31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:27.770544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25ad486-c6be-4d83-b9f6-704a06704d31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:27.770967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25ad486-c6be-4d83-b9f6-704a06704d31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:27.771457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25ad486-c6be-4d83-b9f6-704a06704d31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:27.772150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25ad486-c6be-4d83-b9f6-704a06704d31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:27.772606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25ad486-c6be-4d83-b9f6-704a06704d31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:27.773034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25ad486-c6be-4d83-b9f6-704a06704d31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:27.914885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e25ad486-c6be-4d83-b9f6-704a06704d31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:27.922917 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e25ad486-c6be-4d83-b9f6-704a06704d31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1677 microversion: 2.1 time: 0.177717 Aug 27 05:52:27.923527 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3680/7352] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:27 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:28.946015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8cc328da-fe6b-4ba7-944e-c73d540e1fb8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:28.946742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8cc328da-fe6b-4ba7-944e-c73d540e1fb8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:28.955136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cc328da-fe6b-4ba7-944e-c73d540e1fb8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:28.955639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cc328da-fe6b-4ba7-944e-c73d540e1fb8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:28.956089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cc328da-fe6b-4ba7-944e-c73d540e1fb8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:28.957297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cc328da-fe6b-4ba7-944e-c73d540e1fb8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:28.957764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cc328da-fe6b-4ba7-944e-c73d540e1fb8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:28.958212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8cc328da-fe6b-4ba7-944e-c73d540e1fb8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:29.096610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8cc328da-fe6b-4ba7-944e-c73d540e1fb8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:29.105331 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8cc328da-fe6b-4ba7-944e-c73d540e1fb8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1677 microversion: 2.1 time: 0.164582 Aug 27 05:52:29.105908 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3673/7353] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:28 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:30.127497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8a5aa048-f6e5-49db-845f-db44830dcf76 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:30.128153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8a5aa048-f6e5-49db-845f-db44830dcf76 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:30.137305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a5aa048-f6e5-49db-845f-db44830dcf76 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:30.137800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a5aa048-f6e5-49db-845f-db44830dcf76 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:30.138247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a5aa048-f6e5-49db-845f-db44830dcf76 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:30.138957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a5aa048-f6e5-49db-845f-db44830dcf76 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:30.139445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a5aa048-f6e5-49db-845f-db44830dcf76 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:30.139880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8a5aa048-f6e5-49db-845f-db44830dcf76 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:30.266829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8a5aa048-f6e5-49db-845f-db44830dcf76 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:30.274588 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8a5aa048-f6e5-49db-845f-db44830dcf76 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1677 microversion: 2.1 time: 0.151217 Aug 27 05:52:30.275157 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3681/7354] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:30 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:31.296166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b829dcb1-2402-4f33-9bd5-9e9baaafe16d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:31.296885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b829dcb1-2402-4f33-9bd5-9e9baaafe16d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:31.304285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b829dcb1-2402-4f33-9bd5-9e9baaafe16d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:31.304895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b829dcb1-2402-4f33-9bd5-9e9baaafe16d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:31.305414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b829dcb1-2402-4f33-9bd5-9e9baaafe16d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:31.306216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b829dcb1-2402-4f33-9bd5-9e9baaafe16d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:31.306681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b829dcb1-2402-4f33-9bd5-9e9baaafe16d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:31.307368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b829dcb1-2402-4f33-9bd5-9e9baaafe16d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:31.442870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b829dcb1-2402-4f33-9bd5-9e9baaafe16d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:31.450566 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b829dcb1-2402-4f33-9bd5-9e9baaafe16d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1677 microversion: 2.1 time: 0.158549 Aug 27 05:52:31.451162 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3674/7355] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:31 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:32.472065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-572bea3c-027a-4127-8f38-8de1d1b79426 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:32.472681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-572bea3c-027a-4127-8f38-8de1d1b79426 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:32.479926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-572bea3c-027a-4127-8f38-8de1d1b79426 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:32.480410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-572bea3c-027a-4127-8f38-8de1d1b79426 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:32.480848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-572bea3c-027a-4127-8f38-8de1d1b79426 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:32.481546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-572bea3c-027a-4127-8f38-8de1d1b79426 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:32.481999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-572bea3c-027a-4127-8f38-8de1d1b79426 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:32.482425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-572bea3c-027a-4127-8f38-8de1d1b79426 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:32.612128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-572bea3c-027a-4127-8f38-8de1d1b79426 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:32.620838 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-572bea3c-027a-4127-8f38-8de1d1b79426 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1677 microversion: 2.1 time: 0.152797 Aug 27 05:52:32.621412 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3682/7356] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:32 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:33.642589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa5a8729-5953-4a42-bb5f-769d40313ab6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:33.643250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fa5a8729-5953-4a42-bb5f-769d40313ab6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:33.650622 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a8729-5953-4a42-bb5f-769d40313ab6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:33.651150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a8729-5953-4a42-bb5f-769d40313ab6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:33.651609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a8729-5953-4a42-bb5f-769d40313ab6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:33.652323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a8729-5953-4a42-bb5f-769d40313ab6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:33.652793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a8729-5953-4a42-bb5f-769d40313ab6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:33.653238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa5a8729-5953-4a42-bb5f-769d40313ab6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:33.783151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fa5a8729-5953-4a42-bb5f-769d40313ab6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:33.791193 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa5a8729-5953-4a42-bb5f-769d40313ab6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1677 microversion: 2.1 time: 0.152534 Aug 27 05:52:33.792029 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3675/7357] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:33 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:34.812758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-68384e21-e8af-451a-943f-8ed38e0c855b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:34.813384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-68384e21-e8af-451a-943f-8ed38e0c855b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:34.820053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68384e21-e8af-451a-943f-8ed38e0c855b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:34.820568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68384e21-e8af-451a-943f-8ed38e0c855b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:34.821066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68384e21-e8af-451a-943f-8ed38e0c855b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:34.821771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68384e21-e8af-451a-943f-8ed38e0c855b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:34.822224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68384e21-e8af-451a-943f-8ed38e0c855b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:34.822653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-68384e21-e8af-451a-943f-8ed38e0c855b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:34.955334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-68384e21-e8af-451a-943f-8ed38e0c855b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:34.963528 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-68384e21-e8af-451a-943f-8ed38e0c855b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1677 microversion: 2.1 time: 0.154594 Aug 27 05:52:34.964101 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3683/7358] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:34 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:35.985598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-67fcd6bb-7f7a-436d-a0cd-99b00fde4174 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:35.986234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-67fcd6bb-7f7a-436d-a0cd-99b00fde4174 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:35.993185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67fcd6bb-7f7a-436d-a0cd-99b00fde4174 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:35.993682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67fcd6bb-7f7a-436d-a0cd-99b00fde4174 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:35.994139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67fcd6bb-7f7a-436d-a0cd-99b00fde4174 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:35.994848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67fcd6bb-7f7a-436d-a0cd-99b00fde4174 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:35.995377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67fcd6bb-7f7a-436d-a0cd-99b00fde4174 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:35.995822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67fcd6bb-7f7a-436d-a0cd-99b00fde4174 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:36.133559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-67fcd6bb-7f7a-436d-a0cd-99b00fde4174 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:36.141264 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-67fcd6bb-7f7a-436d-a0cd-99b00fde4174 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1677 microversion: 2.1 time: 0.159666 Aug 27 05:52:36.141832 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3676/7359] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:35 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:37.164224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a45fb02f-99d7-4757-8e83-befa448707b5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:37.164840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a45fb02f-99d7-4757-8e83-befa448707b5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:37.171938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45fb02f-99d7-4757-8e83-befa448707b5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:37.172446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45fb02f-99d7-4757-8e83-befa448707b5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:37.173006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45fb02f-99d7-4757-8e83-befa448707b5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:37.173699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45fb02f-99d7-4757-8e83-befa448707b5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:37.174152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45fb02f-99d7-4757-8e83-befa448707b5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:37.174578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a45fb02f-99d7-4757-8e83-befa448707b5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:37.308682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a45fb02f-99d7-4757-8e83-befa448707b5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:37.316340 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a45fb02f-99d7-4757-8e83-befa448707b5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1677 microversion: 2.1 time: 0.157119 Aug 27 05:52:37.316906 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3684/7360] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:37 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:38.338063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cc3bdf5c-5288-4574-b6e2-b92a67227513 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:38.338594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cc3bdf5c-5288-4574-b6e2-b92a67227513 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:38.345703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf5c-5288-4574-b6e2-b92a67227513 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:38.346202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf5c-5288-4574-b6e2-b92a67227513 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:38.346650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf5c-5288-4574-b6e2-b92a67227513 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:38.347388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf5c-5288-4574-b6e2-b92a67227513 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:38.347853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf5c-5288-4574-b6e2-b92a67227513 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:38.348289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf5c-5288-4574-b6e2-b92a67227513 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:38.475866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cc3bdf5c-5288-4574-b6e2-b92a67227513 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:38.483475 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cc3bdf5c-5288-4574-b6e2-b92a67227513 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1654 microversion: 2.1 time: 0.149334 Aug 27 05:52:38.484036 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3677/7361] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:38 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:38.503500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:38.506415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:38.513635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:38.514121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:38.514558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:38.515301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:38.515763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:38.516193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:38.547767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:38.554365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Old instance type m1.heat2, new instance type m1.heat {{(pid=128548) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:52:38.560812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:52:38.561239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:52:38.561720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:52:38.562136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:52:38.562552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:52:38.626899 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-37d5ea2a-7f33-44c8-8f14-4314bf05a29c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7/action" status: 202 len: 0 microversion: 2.1 time: 0.127182 Aug 27 05:52:38.627478 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3685/7362] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:52:38 2022] POST /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:52:38.635638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2885a8df-3582-441a-8c93-ad8552e84fe5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:38.636300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2885a8df-3582-441a-8c93-ad8552e84fe5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:38.643044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2885a8df-3582-441a-8c93-ad8552e84fe5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:38.643044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2885a8df-3582-441a-8c93-ad8552e84fe5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:38.643365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2885a8df-3582-441a-8c93-ad8552e84fe5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:38.644066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2885a8df-3582-441a-8c93-ad8552e84fe5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:38.644661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2885a8df-3582-441a-8c93-ad8552e84fe5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:38.645738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2885a8df-3582-441a-8c93-ad8552e84fe5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:38.790472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2885a8df-3582-441a-8c93-ad8552e84fe5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:38.798689 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2885a8df-3582-441a-8c93-ad8552e84fe5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1677 microversion: 2.1 time: 0.166991 Aug 27 05:52:38.799532 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3678/7363] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:38 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:39.820840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e300a1ab-6676-4d38-ad68-31a7942fefde tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:39.821462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e300a1ab-6676-4d38-ad68-31a7942fefde tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:39.828142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e300a1ab-6676-4d38-ad68-31a7942fefde tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:39.828873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e300a1ab-6676-4d38-ad68-31a7942fefde tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:39.829463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e300a1ab-6676-4d38-ad68-31a7942fefde tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:39.830337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e300a1ab-6676-4d38-ad68-31a7942fefde tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:39.830837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e300a1ab-6676-4d38-ad68-31a7942fefde tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:39.831315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e300a1ab-6676-4d38-ad68-31a7942fefde tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:39.967503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e300a1ab-6676-4d38-ad68-31a7942fefde tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:39.975849 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e300a1ab-6676-4d38-ad68-31a7942fefde tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1677 microversion: 2.1 time: 0.159697 Aug 27 05:52:39.976435 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3686/7364] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:39 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:40.997758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fd3407be-ceb3-4e35-b897-8989bc88799e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:40.998396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fd3407be-ceb3-4e35-b897-8989bc88799e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:41.005578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd3407be-ceb3-4e35-b897-8989bc88799e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:41.006075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd3407be-ceb3-4e35-b897-8989bc88799e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:41.006534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd3407be-ceb3-4e35-b897-8989bc88799e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:41.007601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd3407be-ceb3-4e35-b897-8989bc88799e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:41.008076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd3407be-ceb3-4e35-b897-8989bc88799e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:41.008525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fd3407be-ceb3-4e35-b897-8989bc88799e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:41.141151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fd3407be-ceb3-4e35-b897-8989bc88799e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:41.150278 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fd3407be-ceb3-4e35-b897-8989bc88799e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1682 microversion: 2.1 time: 0.155974 Aug 27 05:52:41.151127 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3679/7365] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:40 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:42.171169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fa67bbc3-9232-4712-bef7-f9a75b7402fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:42.171813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fa67bbc3-9232-4712-bef7-f9a75b7402fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:42.179290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa67bbc3-9232-4712-bef7-f9a75b7402fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:42.179775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa67bbc3-9232-4712-bef7-f9a75b7402fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:42.180213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa67bbc3-9232-4712-bef7-f9a75b7402fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:42.180904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa67bbc3-9232-4712-bef7-f9a75b7402fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:42.181353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa67bbc3-9232-4712-bef7-f9a75b7402fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:42.181777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fa67bbc3-9232-4712-bef7-f9a75b7402fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:42.315039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fa67bbc3-9232-4712-bef7-f9a75b7402fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:42.322934 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fa67bbc3-9232-4712-bef7-f9a75b7402fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1682 microversion: 2.1 time: 0.155915 Aug 27 05:52:42.323627 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3687/7366] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:42 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:43.343748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3329c45e-2ac8-411d-9205-211009c28705 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:43.344290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3329c45e-2ac8-411d-9205-211009c28705 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:43.352136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3329c45e-2ac8-411d-9205-211009c28705 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:43.352698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3329c45e-2ac8-411d-9205-211009c28705 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:43.353191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3329c45e-2ac8-411d-9205-211009c28705 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:43.353930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3329c45e-2ac8-411d-9205-211009c28705 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:43.354406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3329c45e-2ac8-411d-9205-211009c28705 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:43.354855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3329c45e-2ac8-411d-9205-211009c28705 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:43.471315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-aaa6ebfb-972a-4c2d-abe3-cfd3b0ac5849 req-40581f2b-995f-4915-9199-142ef5fd57db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bbfd51-80a4-4081-a1db-a37ca98269e7", "name": "network-vif-unplugged", "status": "completed", "tag": "0b41666a-2309-44e3-958d-9e6b888ef4dc"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:43.483102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aaa6ebfb-972a-4c2d-abe3-cfd3b0ac5849 req-40581f2b-995f-4915-9199-142ef5fd57db service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:43.483590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aaa6ebfb-972a-4c2d-abe3-cfd3b0ac5849 req-40581f2b-995f-4915-9199-142ef5fd57db service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:43.484026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-aaa6ebfb-972a-4c2d-abe3-cfd3b0ac5849 req-40581f2b-995f-4915-9199-142ef5fd57db service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:43.497136 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-aaa6ebfb-972a-4c2d-abe3-cfd3b0ac5849 req-40581f2b-995f-4915-9199-142ef5fd57db service nova] Creating event network-vif-unplugged:0b41666a-2309-44e3-958d-9e6b888ef4dc for instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 on n-h1-820368-35 Aug 27 05:52:43.502885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-aaa6ebfb-972a-4c2d-abe3-cfd3b0ac5849 req-40581f2b-995f-4915-9199-142ef5fd57db service nova] Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:52:43.515334 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-aaa6ebfb-972a-4c2d-abe3-cfd3b0ac5849 req-40581f2b-995f-4915-9199-142ef5fd57db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047874 Aug 27 05:52:43.515968 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3688/7367] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:52:43.614992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3329c45e-2ac8-411d-9205-211009c28705 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:43.623197 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3329c45e-2ac8-411d-9205-211009c28705 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1681 microversion: 2.1 time: 0.283435 Aug 27 05:52:43.624149 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3680/7368] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:43 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1681 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:44.646587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9b679a5-2b5e-47d2-b312-d31a36cb84c9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:44.647386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9b679a5-2b5e-47d2-b312-d31a36cb84c9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:44.653442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b679a5-2b5e-47d2-b312-d31a36cb84c9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:44.653925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b679a5-2b5e-47d2-b312-d31a36cb84c9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:44.654360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b679a5-2b5e-47d2-b312-d31a36cb84c9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:44.655054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b679a5-2b5e-47d2-b312-d31a36cb84c9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:44.655531 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b679a5-2b5e-47d2-b312-d31a36cb84c9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:44.655959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9b679a5-2b5e-47d2-b312-d31a36cb84c9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:44.791633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f9b679a5-2b5e-47d2-b312-d31a36cb84c9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:44.799633 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9b679a5-2b5e-47d2-b312-d31a36cb84c9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1679 microversion: 2.1 time: 0.158244 Aug 27 05:52:44.800210 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3689/7369] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:44 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:45.549638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0a029396-004c-4627-a935-c14c5d1f9690 req-f03be6f0-bf99-4b0b-93bd-7f0080f66337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08bbfd51-80a4-4081-a1db-a37ca98269e7", "tag": "0b41666a-2309-44e3-958d-9e6b888ef4dc"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:45.560667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0a029396-004c-4627-a935-c14c5d1f9690 req-f03be6f0-bf99-4b0b-93bd-7f0080f66337 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:45.561271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0a029396-004c-4627-a935-c14c5d1f9690 req-f03be6f0-bf99-4b0b-93bd-7f0080f66337 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:45.561716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0a029396-004c-4627-a935-c14c5d1f9690 req-f03be6f0-bf99-4b0b-93bd-7f0080f66337 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:45.576364 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0a029396-004c-4627-a935-c14c5d1f9690 req-f03be6f0-bf99-4b0b-93bd-7f0080f66337 service nova] Creating event network-changed:0b41666a-2309-44e3-958d-9e6b888ef4dc for instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 on n-h1-820368-35 Aug 27 05:52:45.581728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-0a029396-004c-4627-a935-c14c5d1f9690 req-f03be6f0-bf99-4b0b-93bd-7f0080f66337 service nova] Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:52:45.592518 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0a029396-004c-4627-a935-c14c5d1f9690 req-f03be6f0-bf99-4b0b-93bd-7f0080f66337 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046643 Aug 27 05:52:45.593122 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3681/7370] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:52:45.822329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fd5f563c-71e4-46bc-8d37-b893227ed040 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:45.822944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fd5f563c-71e4-46bc-8d37-b893227ed040 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:45.830806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd5f563c-71e4-46bc-8d37-b893227ed040 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:45.831327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd5f563c-71e4-46bc-8d37-b893227ed040 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:45.831762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd5f563c-71e4-46bc-8d37-b893227ed040 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:45.832457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd5f563c-71e4-46bc-8d37-b893227ed040 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:45.833529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd5f563c-71e4-46bc-8d37-b893227ed040 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:45.833957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fd5f563c-71e4-46bc-8d37-b893227ed040 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:45.971735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fd5f563c-71e4-46bc-8d37-b893227ed040 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:45.979574 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fd5f563c-71e4-46bc-8d37-b893227ed040 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1679 microversion: 2.1 time: 0.161116 Aug 27 05:52:45.980432 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3690/7371] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:45 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:47.003002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2eb657e0-799f-49e2-9311-da7dfa017cf6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:47.003755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2eb657e0-799f-49e2-9311-da7dfa017cf6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:47.010744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb657e0-799f-49e2-9311-da7dfa017cf6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:47.011283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb657e0-799f-49e2-9311-da7dfa017cf6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:47.011731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb657e0-799f-49e2-9311-da7dfa017cf6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:47.012433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb657e0-799f-49e2-9311-da7dfa017cf6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:47.012897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb657e0-799f-49e2-9311-da7dfa017cf6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:47.013335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb657e0-799f-49e2-9311-da7dfa017cf6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:47.144919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2eb657e0-799f-49e2-9311-da7dfa017cf6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:47.152665 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2eb657e0-799f-49e2-9311-da7dfa017cf6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1679 microversion: 2.1 time: 0.154916 Aug 27 05:52:47.153237 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3682/7372] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:46 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:48.173917 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a0e27cf1-1789-4884-9920-1c317d4e9f5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:48.174538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a0e27cf1-1789-4884-9920-1c317d4e9f5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:48.181561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0e27cf1-1789-4884-9920-1c317d4e9f5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:48.182049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0e27cf1-1789-4884-9920-1c317d4e9f5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:48.182485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0e27cf1-1789-4884-9920-1c317d4e9f5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:48.191411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0e27cf1-1789-4884-9920-1c317d4e9f5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:48.194729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0e27cf1-1789-4884-9920-1c317d4e9f5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:48.195254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a0e27cf1-1789-4884-9920-1c317d4e9f5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:48.437534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a0e27cf1-1789-4884-9920-1c317d4e9f5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:48.446111 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a0e27cf1-1789-4884-9920-1c317d4e9f5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1675 microversion: 2.1 time: 0.275991 Aug 27 05:52:48.446637 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3691/7373] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:48 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1675 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:48.466998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4abdb2a2-9704-4728-b19d-7f98610ef04a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:48.467916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4abdb2a2-9704-4728-b19d-7f98610ef04a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:48.474944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4abdb2a2-9704-4728-b19d-7f98610ef04a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:48.475535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4abdb2a2-9704-4728-b19d-7f98610ef04a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:48.475990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4abdb2a2-9704-4728-b19d-7f98610ef04a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:48.476704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4abdb2a2-9704-4728-b19d-7f98610ef04a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:48.477168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4abdb2a2-9704-4728-b19d-7f98610ef04a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:48.477664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4abdb2a2-9704-4728-b19d-7f98610ef04a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:48.535585 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4abdb2a2-9704-4728-b19d-7f98610ef04a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7/action" status: 204 len: 0 microversion: 2.1 time: 0.072279 Aug 27 05:52:48.536227 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3683/7374] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:52:48 2022] POST /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:52:48.544942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d395e80-5f2c-47a8-8725-220cd08bfd42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:48.545566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0d395e80-5f2c-47a8-8725-220cd08bfd42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:48.552572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d395e80-5f2c-47a8-8725-220cd08bfd42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:48.553053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d395e80-5f2c-47a8-8725-220cd08bfd42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:48.553529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d395e80-5f2c-47a8-8725-220cd08bfd42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:48.554341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d395e80-5f2c-47a8-8725-220cd08bfd42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:48.554795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d395e80-5f2c-47a8-8725-220cd08bfd42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:48.555258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d395e80-5f2c-47a8-8725-220cd08bfd42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:48.689382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d395e80-5f2c-47a8-8725-220cd08bfd42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:48.697910 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0d395e80-5f2c-47a8-8725-220cd08bfd42 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1675 microversion: 2.1 time: 0.157230 Aug 27 05:52:48.698428 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3692/7375] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:48 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:49.720902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-84d80f58-ff34-4867-a593-7d211fbdccb6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:49.721644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-84d80f58-ff34-4867-a593-7d211fbdccb6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:49.728600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84d80f58-ff34-4867-a593-7d211fbdccb6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:49.729337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84d80f58-ff34-4867-a593-7d211fbdccb6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:49.729801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84d80f58-ff34-4867-a593-7d211fbdccb6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:49.730525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84d80f58-ff34-4867-a593-7d211fbdccb6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:49.731166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84d80f58-ff34-4867-a593-7d211fbdccb6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:49.731747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-84d80f58-ff34-4867-a593-7d211fbdccb6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:49.870921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-84d80f58-ff34-4867-a593-7d211fbdccb6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:49.878647 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-84d80f58-ff34-4867-a593-7d211fbdccb6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1675 microversion: 2.1 time: 0.162955 Aug 27 05:52:49.879380 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3684/7376] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:49 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:50.899116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9b36c902-5f57-4ebc-b49c-acab8c4258d6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:50.899772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9b36c902-5f57-4ebc-b49c-acab8c4258d6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:50.906483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b36c902-5f57-4ebc-b49c-acab8c4258d6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:50.907002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b36c902-5f57-4ebc-b49c-acab8c4258d6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:50.907469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b36c902-5f57-4ebc-b49c-acab8c4258d6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:50.908164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b36c902-5f57-4ebc-b49c-acab8c4258d6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:50.908613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b36c902-5f57-4ebc-b49c-acab8c4258d6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:50.909036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9b36c902-5f57-4ebc-b49c-acab8c4258d6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:51.009798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-bba76991-364e-4229-8f3b-a808dfc9f946 req-8202bbb6-a958-4f0a-a7a5-6d660c0e593c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bbfd51-80a4-4081-a1db-a37ca98269e7", "name": "network-vif-plugged", "status": "completed", "tag": "0b41666a-2309-44e3-958d-9e6b888ef4dc"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:51.021160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bba76991-364e-4229-8f3b-a808dfc9f946 req-8202bbb6-a958-4f0a-a7a5-6d660c0e593c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:51.022104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bba76991-364e-4229-8f3b-a808dfc9f946 req-8202bbb6-a958-4f0a-a7a5-6d660c0e593c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:51.022104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bba76991-364e-4229-8f3b-a808dfc9f946 req-8202bbb6-a958-4f0a-a7a5-6d660c0e593c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:51.036920 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-bba76991-364e-4229-8f3b-a808dfc9f946 req-8202bbb6-a958-4f0a-a7a5-6d660c0e593c service nova] Creating event network-vif-plugged:0b41666a-2309-44e3-958d-9e6b888ef4dc for instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 on n-h1-820368-35 Aug 27 05:52:51.043747 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-bba76991-364e-4229-8f3b-a808dfc9f946 req-8202bbb6-a958-4f0a-a7a5-6d660c0e593c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037690 Aug 27 05:52:51.044759 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3685/7377] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:52:51.047781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9b36c902-5f57-4ebc-b49c-acab8c4258d6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:51.056782 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9b36c902-5f57-4ebc-b49c-acab8c4258d6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1654 microversion: 2.1 time: 0.161576 Aug 27 05:52:51.057376 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3693/7378] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:50 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1654 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:51.077591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-930fb19f-d1c7-4af5-9d40-ca4171890bd8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:51.078444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-930fb19f-d1c7-4af5-9d40-ca4171890bd8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:51.084945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930fb19f-d1c7-4af5-9d40-ca4171890bd8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:51.085443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930fb19f-d1c7-4af5-9d40-ca4171890bd8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:51.085895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930fb19f-d1c7-4af5-9d40-ca4171890bd8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:51.086607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930fb19f-d1c7-4af5-9d40-ca4171890bd8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:51.087078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930fb19f-d1c7-4af5-9d40-ca4171890bd8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:51.087548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-930fb19f-d1c7-4af5-9d40-ca4171890bd8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:51.220749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-930fb19f-d1c7-4af5-9d40-ca4171890bd8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:51.229060 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-930fb19f-d1c7-4af5-9d40-ca4171890bd8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1654 microversion: 2.1 time: 0.155808 Aug 27 05:52:51.229641 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3686/7379] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:51 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:51.249948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-61e1d0c5-43f8-4677-9871-0c80e70ebd69 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:51.256184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61e1d0c5-43f8-4677-9871-0c80e70ebd69 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:51.256668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61e1d0c5-43f8-4677-9871-0c80e70ebd69 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:51.257102 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61e1d0c5-43f8-4677-9871-0c80e70ebd69 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:51.279845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-61e1d0c5-43f8-4677-9871-0c80e70ebd69 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Going to try to start instance {{(pid=128548) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 05:52:51.305554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:52:51.324574 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-61e1d0c5-43f8-4677-9871-0c80e70ebd69 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7/action" status: 202 len: 0 microversion: 2.1 time: 0.078203 Aug 27 05:52:51.325107 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3694/7380] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:52:51 2022] POST /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:52:51.334043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0996f54c-0c29-4edd-a005-9b7987212c19 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:51.334714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0996f54c-0c29-4edd-a005-9b7987212c19 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:51.341084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0996f54c-0c29-4edd-a005-9b7987212c19 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:51.341587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0996f54c-0c29-4edd-a005-9b7987212c19 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:51.342045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0996f54c-0c29-4edd-a005-9b7987212c19 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:51.342947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0996f54c-0c29-4edd-a005-9b7987212c19 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:51.343447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0996f54c-0c29-4edd-a005-9b7987212c19 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:51.343906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0996f54c-0c29-4edd-a005-9b7987212c19 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:51.360175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:52:51.531121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0996f54c-0c29-4edd-a005-9b7987212c19 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:51.540130 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0996f54c-0c29-4edd-a005-9b7987212c19 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1663 microversion: 2.1 time: 0.210165 Aug 27 05:52:51.540372 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3687/7381] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:51 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1663 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:52.562573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ee6b017-0e06-4e6b-a197-1a48bf2bbcc9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:52.563511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ee6b017-0e06-4e6b-a197-1a48bf2bbcc9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:52.569747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee6b017-0e06-4e6b-a197-1a48bf2bbcc9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:52.570227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee6b017-0e06-4e6b-a197-1a48bf2bbcc9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:52.570661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee6b017-0e06-4e6b-a197-1a48bf2bbcc9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:52.571391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee6b017-0e06-4e6b-a197-1a48bf2bbcc9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:52.571846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee6b017-0e06-4e6b-a197-1a48bf2bbcc9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:52.572271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ee6b017-0e06-4e6b-a197-1a48bf2bbcc9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:52.704209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ee6b017-0e06-4e6b-a197-1a48bf2bbcc9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:52.711956 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ee6b017-0e06-4e6b-a197-1a48bf2bbcc9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1667 microversion: 2.1 time: 0.154449 Aug 27 05:52:52.712530 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3695/7382] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:52 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:52.732591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-094c6c36-eeb0-4813-9793-a7559dd59c2e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:52.733117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-094c6c36-eeb0-4813-9793-a7559dd59c2e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:52.740495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-094c6c36-eeb0-4813-9793-a7559dd59c2e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:52.740995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-094c6c36-eeb0-4813-9793-a7559dd59c2e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:52.741452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-094c6c36-eeb0-4813-9793-a7559dd59c2e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:52.742169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-094c6c36-eeb0-4813-9793-a7559dd59c2e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:52.742643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-094c6c36-eeb0-4813-9793-a7559dd59c2e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:52.743107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-094c6c36-eeb0-4813-9793-a7559dd59c2e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:52.768483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-094c6c36-eeb0-4813-9793-a7559dd59c2e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:52:52.846181 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-094c6c36-eeb0-4813-9793-a7559dd59c2e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "DELETE /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 204 len: 0 microversion: 2.1 time: 0.116723 Aug 27 05:52:52.846748 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3688/7383] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:52:52 2022] DELETE /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:52:52.860682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6d984a0-32ff-46ec-9bab-a4737dcbd318 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:52.861308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6d984a0-32ff-46ec-9bab-a4737dcbd318 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:52.867560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6d984a0-32ff-46ec-9bab-a4737dcbd318 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:52.868047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6d984a0-32ff-46ec-9bab-a4737dcbd318 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:52.868493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6d984a0-32ff-46ec-9bab-a4737dcbd318 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:52.869229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6d984a0-32ff-46ec-9bab-a4737dcbd318 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:52.869681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6d984a0-32ff-46ec-9bab-a4737dcbd318 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:52.870185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6d984a0-32ff-46ec-9bab-a4737dcbd318 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:53.008747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6d984a0-32ff-46ec-9bab-a4737dcbd318 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:53.016548 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6d984a0-32ff-46ec-9bab-a4737dcbd318 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1673 microversion: 2.1 time: 0.163355 Aug 27 05:52:53.017128 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3696/7384] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:52 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:54.039650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-50df803d-a3a0-4b63-b2bb-606305adf6b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:54.040407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-50df803d-a3a0-4b63-b2bb-606305adf6b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:54.049502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50df803d-a3a0-4b63-b2bb-606305adf6b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:54.050019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50df803d-a3a0-4b63-b2bb-606305adf6b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:54.050478 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50df803d-a3a0-4b63-b2bb-606305adf6b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:54.051245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50df803d-a3a0-4b63-b2bb-606305adf6b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:54.051726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50df803d-a3a0-4b63-b2bb-606305adf6b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:54.052790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50df803d-a3a0-4b63-b2bb-606305adf6b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:54.182920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-50df803d-a3a0-4b63-b2bb-606305adf6b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:54.190726 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-50df803d-a3a0-4b63-b2bb-606305adf6b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1673 microversion: 2.1 time: 0.156014 Aug 27 05:52:54.191330 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3689/7385] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:54 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:55.223276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c3ae94f6-f162-4181-84b9-1bde5de21145 req-9d990931-5fb9-40f5-a1d2-9778af1d261e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bbfd51-80a4-4081-a1db-a37ca98269e7", "name": "network-vif-deleted", "tag": "0b41666a-2309-44e3-958d-9e6b888ef4dc"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:55.227290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ea094b32-1433-47f0-87d5-3828565995f0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:55.228482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ea094b32-1433-47f0-87d5-3828565995f0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:55.234550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c3ae94f6-f162-4181-84b9-1bde5de21145 req-9d990931-5fb9-40f5-a1d2-9778af1d261e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:55.235138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c3ae94f6-f162-4181-84b9-1bde5de21145 req-9d990931-5fb9-40f5-a1d2-9778af1d261e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:55.235601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c3ae94f6-f162-4181-84b9-1bde5de21145 req-9d990931-5fb9-40f5-a1d2-9778af1d261e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:55.237901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea094b32-1433-47f0-87d5-3828565995f0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:55.238682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea094b32-1433-47f0-87d5-3828565995f0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:55.239230 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea094b32-1433-47f0-87d5-3828565995f0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:55.240188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea094b32-1433-47f0-87d5-3828565995f0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:55.240661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea094b32-1433-47f0-87d5-3828565995f0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:55.241091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea094b32-1433-47f0-87d5-3828565995f0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:55.247861 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c3ae94f6-f162-4181-84b9-1bde5de21145 req-9d990931-5fb9-40f5-a1d2-9778af1d261e service nova] Creating event network-vif-deleted:0b41666a-2309-44e3-958d-9e6b888ef4dc for instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 on n-h1-820368-35 Aug 27 05:52:55.253970 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c3ae94f6-f162-4181-84b9-1bde5de21145 req-9d990931-5fb9-40f5-a1d2-9778af1d261e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034340 Aug 27 05:52:55.255365 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3690/7386] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:52:55.310570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ea094b32-1433-47f0-87d5-3828565995f0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:55.326796 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ea094b32-1433-47f0-87d5-3828565995f0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 200 len: 1606 microversion: 2.1 time: 0.115196 Aug 27 05:52:55.327808 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3697/7387] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:55 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 1606 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:52:56.350289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:56.351180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:56.359256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:56.359769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:56.360224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:56.360953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:56.361423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:56.361932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:56.375976 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 HTTP/1.1 Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '08bbfd51-80a4-4081-a1db-a37ca98269e7'} Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:52:56.377705 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:52:56.382725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:52:56.382725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:52:56.382725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:52:56.382725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:52:56.382725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:52:56.382725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:52:56.382725 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:52:56.382725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:52:56.382725 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-57a82664-d3c4-416b-934e-c6ba038ad9fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 404 len: 111 microversion: 2.1 time: 0.034582 Aug 27 05:52:56.382725 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3691/7388] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:56 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:52:56.397125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:56.398285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:56.405612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:56.406098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:56.406532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:56.407293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:56.407749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:56.408179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:56.421793 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 HTTP/1.1 Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '08bbfd51-80a4-4081-a1db-a37ca98269e7'} Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:52:56.423498 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:52:56.428123 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:52:56.428123 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:52:56.428123 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:52:56.428123 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:52:56.428123 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:52:56.428123 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:52:56.428123 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:52:56.428123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:52:56.428123 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ee83d5ef-3c11-4ee4-b047-5f2161412d93 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 404 len: 111 microversion: 2.1 time: 0.032362 Aug 27 05:52:56.428123 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3698/7389] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:56 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:52:56.473954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2049833867", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "e601665f-33df-4210-8164-8ee874f4ba24"}], "security_groups": [{"name": "tempest-securitygroup--943770067"}], "key_name": "tempest-keypair-94422661", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:56.578412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] validate_networks() for [('e601665f-33df-4210-8164-8ee874f4ba24', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:52:57.346742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:52:57.347240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:52:57.347722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:52:57.348317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:52:57.348623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:52:57.359354 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:57.359966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:57.360301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:57.361051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:57.361525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:57.361973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:57.383835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:52:57.389358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for user ffa36ffb13d74ef5a9cb4385917dcd05 and project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:52:57.402403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:52:57.404833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:52:57.456725 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-48c9dfae-a72b-4d7c-8bf5-d2771169c906 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.986289 Aug 27 05:52:57.457995 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3692/7390] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:52:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:52:57.469820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-822836d3-8c32-4fd5-91b3-9096d0bfad82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:57.470442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-822836d3-8c32-4fd5-91b3-9096d0bfad82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:57.532627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-822836d3-8c32-4fd5-91b3-9096d0bfad82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:57.543118 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-822836d3-8c32-4fd5-91b3-9096d0bfad82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1237 microversion: 2.1 time: 0.077218 Aug 27 05:52:57.543939 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3699/7391] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:57 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:58.566336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f950fef8-dd64-4c57-b943-d985637f362d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:58.567046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f950fef8-dd64-4c57-b943-d985637f362d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:58.569774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:52:58.576251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f950fef8-dd64-4c57-b943-d985637f362d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:58.576961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f950fef8-dd64-4c57-b943-d985637f362d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:58.577562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f950fef8-dd64-4c57-b943-d985637f362d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:58.578417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f950fef8-dd64-4c57-b943-d985637f362d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:58.579056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f950fef8-dd64-4c57-b943-d985637f362d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:58.579958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f950fef8-dd64-4c57-b943-d985637f362d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:58.654809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f950fef8-dd64-4c57-b943-d985637f362d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:58.664986 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f950fef8-dd64-4c57-b943-d985637f362d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1297 microversion: 2.1 time: 0.103626 Aug 27 05:52:58.665587 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3693/7392] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:58 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:59.688640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-25b410be-52a4-4283-b077-fa95d114679c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:59.689258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-25b410be-52a4-4283-b077-fa95d114679c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:59.692165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=47 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:52:59.698632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b410be-52a4-4283-b077-fa95d114679c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:59.699216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b410be-52a4-4283-b077-fa95d114679c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:59.699671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b410be-52a4-4283-b077-fa95d114679c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:59.700549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b410be-52a4-4283-b077-fa95d114679c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:59.701005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b410be-52a4-4283-b077-fa95d114679c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:59.701432 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-25b410be-52a4-4283-b077-fa95d114679c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:59.835897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-25b410be-52a4-4283-b077-fa95d114679c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:59.843624 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-25b410be-52a4-4283-b077-fa95d114679c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1362 microversion: 2.1 time: 0.159370 Aug 27 05:52:59.844235 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3700/7393] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:59 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:59.939770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5236e8d3-7df5-4de3-8fd2-c32d75a467c1 req-ab140865-f389-460d-9100-01b537a16c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b3e81b-d0c4-47a7-ad8a-49fb3f70a787", "tag": "dd06bada-19b4-43b3-9ca3-3b70ba5a2152"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:59.951267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5236e8d3-7df5-4de3-8fd2-c32d75a467c1 req-ab140865-f389-460d-9100-01b537a16c2d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:59.951909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5236e8d3-7df5-4de3-8fd2-c32d75a467c1 req-ab140865-f389-460d-9100-01b537a16c2d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:59.952370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5236e8d3-7df5-4de3-8fd2-c32d75a467c1 req-ab140865-f389-460d-9100-01b537a16c2d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:59.964614 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5236e8d3-7df5-4de3-8fd2-c32d75a467c1 req-ab140865-f389-460d-9100-01b537a16c2d service nova] Creating event network-changed:dd06bada-19b4-43b3-9ca3-3b70ba5a2152 for instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 on n-h2-820368-35 Aug 27 05:52:59.970045 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5236e8d3-7df5-4de3-8fd2-c32d75a467c1 req-ab140865-f389-460d-9100-01b537a16c2d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033894 Aug 27 05:52:59.970734 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3694/7394] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:53:00.865856 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01ae232b-8c6a-4bbd-bddf-dea6bf0fc919 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:00.866478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-01ae232b-8c6a-4bbd-bddf-dea6bf0fc919 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:00.873378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ae232b-8c6a-4bbd-bddf-dea6bf0fc919 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:00.873865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ae232b-8c6a-4bbd-bddf-dea6bf0fc919 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:00.874314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ae232b-8c6a-4bbd-bddf-dea6bf0fc919 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:00.875014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ae232b-8c6a-4bbd-bddf-dea6bf0fc919 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:00.875510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ae232b-8c6a-4bbd-bddf-dea6bf0fc919 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:00.875941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-01ae232b-8c6a-4bbd-bddf-dea6bf0fc919 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:01.004888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-01ae232b-8c6a-4bbd-bddf-dea6bf0fc919 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:01.013193 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01ae232b-8c6a-4bbd-bddf-dea6bf0fc919 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1362 microversion: 2.1 time: 0.151208 Aug 27 05:53:01.013766 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3701/7395] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:00 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:53:02.034806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-594b6cfd-2db0-4ddf-9048-6e7bffd8548c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:02.035559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-594b6cfd-2db0-4ddf-9048-6e7bffd8548c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:02.042831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-594b6cfd-2db0-4ddf-9048-6e7bffd8548c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:02.043373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-594b6cfd-2db0-4ddf-9048-6e7bffd8548c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:02.043830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-594b6cfd-2db0-4ddf-9048-6e7bffd8548c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:02.044545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-594b6cfd-2db0-4ddf-9048-6e7bffd8548c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:02.045013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-594b6cfd-2db0-4ddf-9048-6e7bffd8548c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:02.045455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-594b6cfd-2db0-4ddf-9048-6e7bffd8548c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:02.177028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-594b6cfd-2db0-4ddf-9048-6e7bffd8548c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:02.185235 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-594b6cfd-2db0-4ddf-9048-6e7bffd8548c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1362 microversion: 2.1 time: 0.154779 Aug 27 05:53:02.185808 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3695/7396] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:02 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:03.205942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2ecbbcfd-6ef2-445c-a956-8da42296fa31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:03.206564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2ecbbcfd-6ef2-445c-a956-8da42296fa31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:03.213999 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ecbbcfd-6ef2-445c-a956-8da42296fa31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:03.214480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ecbbcfd-6ef2-445c-a956-8da42296fa31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:03.214915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ecbbcfd-6ef2-445c-a956-8da42296fa31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:03.215640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ecbbcfd-6ef2-445c-a956-8da42296fa31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:03.216095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ecbbcfd-6ef2-445c-a956-8da42296fa31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:03.216517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2ecbbcfd-6ef2-445c-a956-8da42296fa31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:03.346404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2ecbbcfd-6ef2-445c-a956-8da42296fa31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:03.355557 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2ecbbcfd-6ef2-445c-a956-8da42296fa31 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1362 microversion: 2.1 time: 0.153423 Aug 27 05:53:03.356150 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3702/7397] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:03 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:04.377017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab275636-6030-4a86-b324-65517f63bf82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:04.377644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ab275636-6030-4a86-b324-65517f63bf82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:04.384607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab275636-6030-4a86-b324-65517f63bf82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:04.385099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab275636-6030-4a86-b324-65517f63bf82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:04.385558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab275636-6030-4a86-b324-65517f63bf82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:04.386267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab275636-6030-4a86-b324-65517f63bf82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:04.386731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab275636-6030-4a86-b324-65517f63bf82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:04.387200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab275636-6030-4a86-b324-65517f63bf82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:04.531073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ab275636-6030-4a86-b324-65517f63bf82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:04.538945 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ab275636-6030-4a86-b324-65517f63bf82 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1362 microversion: 2.1 time: 0.165801 Aug 27 05:53:04.539556 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3696/7398] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:04 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:05.560795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-95707593-cb3e-4fa7-90df-c3cc3a50b29e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:05.561464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-95707593-cb3e-4fa7-90df-c3cc3a50b29e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:05.568120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95707593-cb3e-4fa7-90df-c3cc3a50b29e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:05.569251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95707593-cb3e-4fa7-90df-c3cc3a50b29e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:05.569687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95707593-cb3e-4fa7-90df-c3cc3a50b29e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:05.570381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95707593-cb3e-4fa7-90df-c3cc3a50b29e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:05.570834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95707593-cb3e-4fa7-90df-c3cc3a50b29e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:05.571293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-95707593-cb3e-4fa7-90df-c3cc3a50b29e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:05.700416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-95707593-cb3e-4fa7-90df-c3cc3a50b29e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:05.708209 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-95707593-cb3e-4fa7-90df-c3cc3a50b29e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1362 microversion: 2.1 time: 0.151447 Aug 27 05:53:05.708792 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3703/7399] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:05 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:06.293822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0947443d-e157-4d73-86c4-cc183e9a9618 req-c61b4e0b-af97-4839-8630-68cb9b322ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b3e81b-d0c4-47a7-ad8a-49fb3f70a787", "name": "network-vif-plugged", "status": "completed", "tag": "dd06bada-19b4-43b3-9ca3-3b70ba5a2152"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:53:06.304402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0947443d-e157-4d73-86c4-cc183e9a9618 req-c61b4e0b-af97-4839-8630-68cb9b322ebc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:06.304902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0947443d-e157-4d73-86c4-cc183e9a9618 req-c61b4e0b-af97-4839-8630-68cb9b322ebc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:06.305350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0947443d-e157-4d73-86c4-cc183e9a9618 req-c61b4e0b-af97-4839-8630-68cb9b322ebc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:06.316472 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0947443d-e157-4d73-86c4-cc183e9a9618 req-c61b4e0b-af97-4839-8630-68cb9b322ebc service nova] Creating event network-vif-plugged:dd06bada-19b4-43b3-9ca3-3b70ba5a2152 for instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 on n-h2-820368-35 Aug 27 05:53:06.321803 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0947443d-e157-4d73-86c4-cc183e9a9618 req-c61b4e0b-af97-4839-8630-68cb9b322ebc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031887 Aug 27 05:53:06.322601 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3697/7400] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:53:06.729744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ac958a7e-0d99-4a3c-985a-717c7298aa1f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:06.730271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ac958a7e-0d99-4a3c-985a-717c7298aa1f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:06.737005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac958a7e-0d99-4a3c-985a-717c7298aa1f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:06.737485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac958a7e-0d99-4a3c-985a-717c7298aa1f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:06.737922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac958a7e-0d99-4a3c-985a-717c7298aa1f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:06.738616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac958a7e-0d99-4a3c-985a-717c7298aa1f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:06.739069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac958a7e-0d99-4a3c-985a-717c7298aa1f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:06.740017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ac958a7e-0d99-4a3c-985a-717c7298aa1f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:06.872772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ac958a7e-0d99-4a3c-985a-717c7298aa1f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:06.880416 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ac958a7e-0d99-4a3c-985a-717c7298aa1f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1362 microversion: 2.1 time: 0.154742 Aug 27 05:53:06.881496 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3704/7401] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:06 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:07.900618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:07.901414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:07.906224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-daa472bc-331f-40b2-82f5-2ab548b5c703 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:07.907141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-daa472bc-331f-40b2-82f5-2ab548b5c703 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:07.915330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-daa472bc-331f-40b2-82f5-2ab548b5c703 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:07.915847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-daa472bc-331f-40b2-82f5-2ab548b5c703 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:07.916311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-daa472bc-331f-40b2-82f5-2ab548b5c703 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:07.917555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-daa472bc-331f-40b2-82f5-2ab548b5c703 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:07.917786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-daa472bc-331f-40b2-82f5-2ab548b5c703 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:07.918238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-daa472bc-331f-40b2-82f5-2ab548b5c703 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:08.050273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-daa472bc-331f-40b2-82f5-2ab548b5c703 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:08.058047 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-daa472bc-331f-40b2-82f5-2ab548b5c703 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1549 microversion: 2.1 time: 0.159348 Aug 27 05:53:08.058554 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3698/7402] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:07 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:08.078710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a454e6c-21d1-4257-917c-2fd281bbdfef tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:08.079250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a454e6c-21d1-4257-917c-2fd281bbdfef tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:08.081109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:08.088332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a454e6c-21d1-4257-917c-2fd281bbdfef tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:08.088830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a454e6c-21d1-4257-917c-2fd281bbdfef tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:08.089277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a454e6c-21d1-4257-917c-2fd281bbdfef tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:08.089989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a454e6c-21d1-4257-917c-2fd281bbdfef tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:08.090451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a454e6c-21d1-4257-917c-2fd281bbdfef tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:08.090886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a454e6c-21d1-4257-917c-2fd281bbdfef tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:08.169448 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a454e6c-21d1-4257-917c-2fd281bbdfef tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094680 Aug 27 05:53:08.170058 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3705/7403] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:53:08 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:53:09.120460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7964d4ce-24d9-4327-bb7d-ef454d3bbe96 req-0ee1e9ae-b418-409b-ba01-2ee8e5412616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b3e81b-d0c4-47a7-ad8a-49fb3f70a787", "tag": "dd06bada-19b4-43b3-9ca3-3b70ba5a2152"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:53:09.130600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7964d4ce-24d9-4327-bb7d-ef454d3bbe96 req-0ee1e9ae-b418-409b-ba01-2ee8e5412616 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:09.131226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7964d4ce-24d9-4327-bb7d-ef454d3bbe96 req-0ee1e9ae-b418-409b-ba01-2ee8e5412616 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:09.131746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7964d4ce-24d9-4327-bb7d-ef454d3bbe96 req-0ee1e9ae-b418-409b-ba01-2ee8e5412616 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:09.142962 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7964d4ce-24d9-4327-bb7d-ef454d3bbe96 req-0ee1e9ae-b418-409b-ba01-2ee8e5412616 service nova] Creating event network-changed:dd06bada-19b4-43b3-9ca3-3b70ba5a2152 for instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 on n-h2-820368-35 Aug 27 05:53:09.148047 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7964d4ce-24d9-4327-bb7d-ef454d3bbe96 req-0ee1e9ae-b418-409b-ba01-2ee8e5412616 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031301 Aug 27 05:53:09.148662 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3699/7404] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:54:21.130910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=11 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:21.131842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:21.186160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:21.188553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:21.197807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:21.198295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:21.198735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:21.199467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:21.199926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:21.200356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:21.227600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:21.233953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Old instance type m1.heat2, new instance type m1.heat {{(pid=128548) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:54:21.240384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:54:21.240810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:54:21.241288 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:54:21.241700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:54:21.242111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:54:21.306664 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ffa78596-2c1f-43ef-a111-02ae44ee3563 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787/action" status: 202 len: 0 microversion: 2.1 time: 0.178142 Aug 27 05:54:21.307330 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3706/7405] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:54:21 2022] POST /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:54:21.314902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=13 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:21.316193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:21.322477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ae9ae0f2-78e3-40f1-9794-49da3b6a0fe0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:21.323231 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ae9ae0f2-78e3-40f1-9794-49da3b6a0fe0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:21.330778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae9ae0f2-78e3-40f1-9794-49da3b6a0fe0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:21.331504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae9ae0f2-78e3-40f1-9794-49da3b6a0fe0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:21.332002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae9ae0f2-78e3-40f1-9794-49da3b6a0fe0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:21.332743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae9ae0f2-78e3-40f1-9794-49da3b6a0fe0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:21.333212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae9ae0f2-78e3-40f1-9794-49da3b6a0fe0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:21.333830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae9ae0f2-78e3-40f1-9794-49da3b6a0fe0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:21.497295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae9ae0f2-78e3-40f1-9794-49da3b6a0fe0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:21.505501 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ae9ae0f2-78e3-40f1-9794-49da3b6a0fe0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1676 microversion: 2.1 time: 0.193542 Aug 27 05:54:21.506102 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3700/7406] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:21 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:22.528201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-62303b98-7ee7-4a2f-b192-38fa2ac86380 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:22.529382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-62303b98-7ee7-4a2f-b192-38fa2ac86380 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:22.535474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62303b98-7ee7-4a2f-b192-38fa2ac86380 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:22.535961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62303b98-7ee7-4a2f-b192-38fa2ac86380 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:22.536400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62303b98-7ee7-4a2f-b192-38fa2ac86380 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:22.537097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62303b98-7ee7-4a2f-b192-38fa2ac86380 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:22.537551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62303b98-7ee7-4a2f-b192-38fa2ac86380 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:22.537976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62303b98-7ee7-4a2f-b192-38fa2ac86380 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:22.678347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-62303b98-7ee7-4a2f-b192-38fa2ac86380 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:22.686893 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-62303b98-7ee7-4a2f-b192-38fa2ac86380 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1676 microversion: 2.1 time: 0.163687 Aug 27 05:54:22.687506 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3707/7407] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:22 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:23.707830 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fce7f221-4b4c-4364-81ba-b7857141479c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:23.708452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fce7f221-4b4c-4364-81ba-b7857141479c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:23.715135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce7f221-4b4c-4364-81ba-b7857141479c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:23.715630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce7f221-4b4c-4364-81ba-b7857141479c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:23.716080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce7f221-4b4c-4364-81ba-b7857141479c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:23.716777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce7f221-4b4c-4364-81ba-b7857141479c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:23.717248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce7f221-4b4c-4364-81ba-b7857141479c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:23.717683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce7f221-4b4c-4364-81ba-b7857141479c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:23.849257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fce7f221-4b4c-4364-81ba-b7857141479c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:23.857791 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fce7f221-4b4c-4364-81ba-b7857141479c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1681 microversion: 2.1 time: 0.153759 Aug 27 05:54:23.858374 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3701/7408] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:23 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:24.880920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f1702867-bae0-42ad-b3ff-28c5ece0fcb7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:24.881547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f1702867-bae0-42ad-b3ff-28c5ece0fcb7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:24.889044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1702867-bae0-42ad-b3ff-28c5ece0fcb7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:24.889537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1702867-bae0-42ad-b3ff-28c5ece0fcb7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:24.889984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1702867-bae0-42ad-b3ff-28c5ece0fcb7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:24.890688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1702867-bae0-42ad-b3ff-28c5ece0fcb7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:24.891180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1702867-bae0-42ad-b3ff-28c5ece0fcb7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:24.891620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1702867-bae0-42ad-b3ff-28c5ece0fcb7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:25.024710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f1702867-bae0-42ad-b3ff-28c5ece0fcb7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:25.032961 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f1702867-bae0-42ad-b3ff-28c5ece0fcb7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1681 microversion: 2.1 time: 0.156018 Aug 27 05:54:25.033535 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3708/7409] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:24 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:26.054963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-88dd1d9a-9ffe-49a7-a3b8-381df86444b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:26.055529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-88dd1d9a-9ffe-49a7-a3b8-381df86444b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:26.063105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88dd1d9a-9ffe-49a7-a3b8-381df86444b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:26.063604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88dd1d9a-9ffe-49a7-a3b8-381df86444b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:26.064060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88dd1d9a-9ffe-49a7-a3b8-381df86444b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:26.064790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88dd1d9a-9ffe-49a7-a3b8-381df86444b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:26.065246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88dd1d9a-9ffe-49a7-a3b8-381df86444b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:26.065690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-88dd1d9a-9ffe-49a7-a3b8-381df86444b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:26.193934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-88dd1d9a-9ffe-49a7-a3b8-381df86444b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:26.201785 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-88dd1d9a-9ffe-49a7-a3b8-381df86444b9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1681 microversion: 2.1 time: 0.150830 Aug 27 05:54:26.202362 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3702/7410] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:26 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:27.223231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8c0d54d2-a4bd-404f-a979-d7663d2620ec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:27.223848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8c0d54d2-a4bd-404f-a979-d7663d2620ec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:27.230601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c0d54d2-a4bd-404f-a979-d7663d2620ec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:27.231105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c0d54d2-a4bd-404f-a979-d7663d2620ec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:27.231571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c0d54d2-a4bd-404f-a979-d7663d2620ec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:27.232252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c0d54d2-a4bd-404f-a979-d7663d2620ec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:27.232707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c0d54d2-a4bd-404f-a979-d7663d2620ec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:27.233709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8c0d54d2-a4bd-404f-a979-d7663d2620ec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:27.368802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8c0d54d2-a4bd-404f-a979-d7663d2620ec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:27.376424 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8c0d54d2-a4bd-404f-a979-d7663d2620ec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1681 microversion: 2.1 time: 0.157145 Aug 27 05:54:27.377171 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3709/7411] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:27 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:28.397879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-67b33ebd-235e-4b1c-99a6-ba4c485082c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:28.398566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-67b33ebd-235e-4b1c-99a6-ba4c485082c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:28.406308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67b33ebd-235e-4b1c-99a6-ba4c485082c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:28.406818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67b33ebd-235e-4b1c-99a6-ba4c485082c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:28.407311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67b33ebd-235e-4b1c-99a6-ba4c485082c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:28.408043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67b33ebd-235e-4b1c-99a6-ba4c485082c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:28.408522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67b33ebd-235e-4b1c-99a6-ba4c485082c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:28.408972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67b33ebd-235e-4b1c-99a6-ba4c485082c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:28.537522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-67b33ebd-235e-4b1c-99a6-ba4c485082c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:28.545774 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-67b33ebd-235e-4b1c-99a6-ba4c485082c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1681 microversion: 2.1 time: 0.151820 Aug 27 05:54:28.546363 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3703/7412] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:28 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:29.568652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f3d93be-35d8-43d2-9724-5afc4fe05b01 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:29.569190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f3d93be-35d8-43d2-9724-5afc4fe05b01 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:29.575586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f3d93be-35d8-43d2-9724-5afc4fe05b01 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:29.576075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f3d93be-35d8-43d2-9724-5afc4fe05b01 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:29.577160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f3d93be-35d8-43d2-9724-5afc4fe05b01 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:29.577865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f3d93be-35d8-43d2-9724-5afc4fe05b01 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:29.578325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f3d93be-35d8-43d2-9724-5afc4fe05b01 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:29.578758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f3d93be-35d8-43d2-9724-5afc4fe05b01 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:29.713542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f3d93be-35d8-43d2-9724-5afc4fe05b01 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:29.721392 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f3d93be-35d8-43d2-9724-5afc4fe05b01 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1681 microversion: 2.1 time: 0.158067 Aug 27 05:54:29.721970 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3710/7413] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:29 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:30.743345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9fd64794-bb42-4a0a-9452-9cfffa880845 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:30.743872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9fd64794-bb42-4a0a-9452-9cfffa880845 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:30.751311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd64794-bb42-4a0a-9452-9cfffa880845 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:30.752840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd64794-bb42-4a0a-9452-9cfffa880845 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:30.752840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd64794-bb42-4a0a-9452-9cfffa880845 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:30.753080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd64794-bb42-4a0a-9452-9cfffa880845 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:30.753446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd64794-bb42-4a0a-9452-9cfffa880845 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:30.753892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9fd64794-bb42-4a0a-9452-9cfffa880845 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:30.884538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9fd64794-bb42-4a0a-9452-9cfffa880845 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:30.892371 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9fd64794-bb42-4a0a-9452-9cfffa880845 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1681 microversion: 2.1 time: 0.153103 Aug 27 05:54:30.892959 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3704/7414] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:30 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:31.913986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f64afad-46ce-42fa-89f2-0a74e1b705c5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:31.914809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f64afad-46ce-42fa-89f2-0a74e1b705c5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:31.922742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f64afad-46ce-42fa-89f2-0a74e1b705c5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:31.923275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f64afad-46ce-42fa-89f2-0a74e1b705c5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:31.923725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f64afad-46ce-42fa-89f2-0a74e1b705c5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:31.924625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f64afad-46ce-42fa-89f2-0a74e1b705c5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:31.925038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f64afad-46ce-42fa-89f2-0a74e1b705c5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:31.925639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f64afad-46ce-42fa-89f2-0a74e1b705c5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:32.060171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9f64afad-46ce-42fa-89f2-0a74e1b705c5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:32.068297 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f64afad-46ce-42fa-89f2-0a74e1b705c5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1681 microversion: 2.1 time: 0.158201 Aug 27 05:54:32.068868 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3711/7415] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:31 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:33.089821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e7cd2fba-9eee-4aa4-b0d6-e7dc8fcd0bd7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:33.090378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e7cd2fba-9eee-4aa4-b0d6-e7dc8fcd0bd7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:33.098828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7cd2fba-9eee-4aa4-b0d6-e7dc8fcd0bd7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:33.099355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7cd2fba-9eee-4aa4-b0d6-e7dc8fcd0bd7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:33.099812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7cd2fba-9eee-4aa4-b0d6-e7dc8fcd0bd7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:33.100528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7cd2fba-9eee-4aa4-b0d6-e7dc8fcd0bd7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:33.100998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7cd2fba-9eee-4aa4-b0d6-e7dc8fcd0bd7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:33.101441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7cd2fba-9eee-4aa4-b0d6-e7dc8fcd0bd7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:33.245024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e7cd2fba-9eee-4aa4-b0d6-e7dc8fcd0bd7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:33.252988 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e7cd2fba-9eee-4aa4-b0d6-e7dc8fcd0bd7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1681 microversion: 2.1 time: 0.167220 Aug 27 05:54:33.253564 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3705/7416] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:33 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:34.275529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b63ad29b-f25f-42aa-9e48-c2832ab8e339 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:34.276145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b63ad29b-f25f-42aa-9e48-c2832ab8e339 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:34.283304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63ad29b-f25f-42aa-9e48-c2832ab8e339 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:34.283797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63ad29b-f25f-42aa-9e48-c2832ab8e339 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:34.284238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63ad29b-f25f-42aa-9e48-c2832ab8e339 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:34.284933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63ad29b-f25f-42aa-9e48-c2832ab8e339 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:34.285389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63ad29b-f25f-42aa-9e48-c2832ab8e339 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:34.285816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b63ad29b-f25f-42aa-9e48-c2832ab8e339 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:34.413597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b63ad29b-f25f-42aa-9e48-c2832ab8e339 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:34.421604 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b63ad29b-f25f-42aa-9e48-c2832ab8e339 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1681 microversion: 2.1 time: 0.150139 Aug 27 05:54:34.422180 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3712/7417] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:34 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:35.442579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-45300cd9-e89e-47ba-a60f-9a4ca47ba8ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:35.443263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-45300cd9-e89e-47ba-a60f-9a4ca47ba8ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:35.450072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45300cd9-e89e-47ba-a60f-9a4ca47ba8ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:35.450575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45300cd9-e89e-47ba-a60f-9a4ca47ba8ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:35.451027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45300cd9-e89e-47ba-a60f-9a4ca47ba8ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:35.451775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45300cd9-e89e-47ba-a60f-9a4ca47ba8ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:35.452243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45300cd9-e89e-47ba-a60f-9a4ca47ba8ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:35.452686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-45300cd9-e89e-47ba-a60f-9a4ca47ba8ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:35.671126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-45300cd9-e89e-47ba-a60f-9a4ca47ba8ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:35.679431 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-45300cd9-e89e-47ba-a60f-9a4ca47ba8ff tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1680 microversion: 2.1 time: 0.240814 Aug 27 05:54:35.680253 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3706/7418] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:35 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:35.757864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5ffe5ff2-5bba-442e-bd89-f85fa41f50a0 req-b9a80c7b-86ee-41c2-8c0d-a9cffe2bfb9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b3e81b-d0c4-47a7-ad8a-49fb3f70a787", "name": "network-vif-unplugged", "status": "completed", "tag": "dd06bada-19b4-43b3-9ca3-3b70ba5a2152"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:35.769176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5ffe5ff2-5bba-442e-bd89-f85fa41f50a0 req-b9a80c7b-86ee-41c2-8c0d-a9cffe2bfb9b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:35.769803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5ffe5ff2-5bba-442e-bd89-f85fa41f50a0 req-b9a80c7b-86ee-41c2-8c0d-a9cffe2bfb9b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:35.770276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5ffe5ff2-5bba-442e-bd89-f85fa41f50a0 req-b9a80c7b-86ee-41c2-8c0d-a9cffe2bfb9b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:35.783895 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-5ffe5ff2-5bba-442e-bd89-f85fa41f50a0 req-b9a80c7b-86ee-41c2-8c0d-a9cffe2bfb9b service nova] Creating event network-vif-unplugged:dd06bada-19b4-43b3-9ca3-3b70ba5a2152 for instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 on n-h1-820368-35 Aug 27 05:54:35.789514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-5ffe5ff2-5bba-442e-bd89-f85fa41f50a0 req-b9a80c7b-86ee-41c2-8c0d-a9cffe2bfb9b service nova] Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:54:35.804572 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5ffe5ff2-5bba-442e-bd89-f85fa41f50a0 req-b9a80c7b-86ee-41c2-8c0d-a9cffe2bfb9b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050277 Aug 27 05:54:35.804909 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3713/7419] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:54:36.701082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46ca8961-5d65-45c9-8030-b8a985c4d2fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:36.701711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-46ca8961-5d65-45c9-8030-b8a985c4d2fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:36.708900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46ca8961-5d65-45c9-8030-b8a985c4d2fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:36.709407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46ca8961-5d65-45c9-8030-b8a985c4d2fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:36.709866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46ca8961-5d65-45c9-8030-b8a985c4d2fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:36.710597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46ca8961-5d65-45c9-8030-b8a985c4d2fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:36.711073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46ca8961-5d65-45c9-8030-b8a985c4d2fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:36.711683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46ca8961-5d65-45c9-8030-b8a985c4d2fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:36.846522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46ca8961-5d65-45c9-8030-b8a985c4d2fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:36.854467 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-46ca8961-5d65-45c9-8030-b8a985c4d2fe tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1680 microversion: 2.1 time: 0.157291 Aug 27 05:54:36.855047 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3707/7420] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:36 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:37.844197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d974db2d-8c23-4913-ab73-4f809fa695d5 req-8e19a286-a70f-4616-b9d7-28dfa413a063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b3e81b-d0c4-47a7-ad8a-49fb3f70a787", "tag": "dd06bada-19b4-43b3-9ca3-3b70ba5a2152"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:37.854570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d974db2d-8c23-4913-ab73-4f809fa695d5 req-8e19a286-a70f-4616-b9d7-28dfa413a063 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:37.855052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d974db2d-8c23-4913-ab73-4f809fa695d5 req-8e19a286-a70f-4616-b9d7-28dfa413a063 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:37.855517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d974db2d-8c23-4913-ab73-4f809fa695d5 req-8e19a286-a70f-4616-b9d7-28dfa413a063 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:37.871017 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d974db2d-8c23-4913-ab73-4f809fa695d5 req-8e19a286-a70f-4616-b9d7-28dfa413a063 service nova] Creating event network-changed:dd06bada-19b4-43b3-9ca3-3b70ba5a2152 for instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 on n-h1-820368-35 Aug 27 05:54:37.876076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b00c2c5b-73a3-4ac1-8dd6-8de9d6894d98 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:37.876713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b00c2c5b-73a3-4ac1-8dd6-8de9d6894d98 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:37.877178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-d974db2d-8c23-4913-ab73-4f809fa695d5 req-8e19a286-a70f-4616-b9d7-28dfa413a063 service nova] Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:54:37.884160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00c2c5b-73a3-4ac1-8dd6-8de9d6894d98 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:37.884668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00c2c5b-73a3-4ac1-8dd6-8de9d6894d98 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:37.885123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00c2c5b-73a3-4ac1-8dd6-8de9d6894d98 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:37.885846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00c2c5b-73a3-4ac1-8dd6-8de9d6894d98 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:37.886316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00c2c5b-73a3-4ac1-8dd6-8de9d6894d98 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:37.886761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b00c2c5b-73a3-4ac1-8dd6-8de9d6894d98 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:37.888682 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d974db2d-8c23-4913-ab73-4f809fa695d5 req-8e19a286-a70f-4616-b9d7-28dfa413a063 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048776 Aug 27 05:54:37.889808 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3714/7421] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:54:38.025251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b00c2c5b-73a3-4ac1-8dd6-8de9d6894d98 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:38.034135 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b00c2c5b-73a3-4ac1-8dd6-8de9d6894d98 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1678 microversion: 2.1 time: 0.162008 Aug 27 05:54:38.034735 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3708/7422] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:37 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:39.056694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-80c5a2d6-4092-44f3-929d-7f49e61a3079 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:39.057386 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-80c5a2d6-4092-44f3-929d-7f49e61a3079 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:39.064373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80c5a2d6-4092-44f3-929d-7f49e61a3079 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:39.064855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80c5a2d6-4092-44f3-929d-7f49e61a3079 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:39.065289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80c5a2d6-4092-44f3-929d-7f49e61a3079 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:39.065978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80c5a2d6-4092-44f3-929d-7f49e61a3079 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:39.066429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80c5a2d6-4092-44f3-929d-7f49e61a3079 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:39.066850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-80c5a2d6-4092-44f3-929d-7f49e61a3079 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:39.198921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-80c5a2d6-4092-44f3-929d-7f49e61a3079 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:39.207355 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-80c5a2d6-4092-44f3-929d-7f49e61a3079 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1678 microversion: 2.1 time: 0.154824 Aug 27 05:54:39.207913 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3715/7423] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:39 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:54:40.228942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2e1e65ea-bf83-4bc5-ace8-3d3569f161dd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:40.229466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2e1e65ea-bf83-4bc5-ace8-3d3569f161dd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:40.236645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1e65ea-bf83-4bc5-ace8-3d3569f161dd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:40.237147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1e65ea-bf83-4bc5-ace8-3d3569f161dd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:40.237607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1e65ea-bf83-4bc5-ace8-3d3569f161dd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:40.238322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1e65ea-bf83-4bc5-ace8-3d3569f161dd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:40.238796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1e65ea-bf83-4bc5-ace8-3d3569f161dd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:40.239272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2e1e65ea-bf83-4bc5-ace8-3d3569f161dd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:40.367166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2e1e65ea-bf83-4bc5-ace8-3d3569f161dd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:40.375479 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2e1e65ea-bf83-4bc5-ace8-3d3569f161dd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1675 microversion: 2.1 time: 0.150598 Aug 27 05:54:40.376063 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3709/7424] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:40 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:40.395810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:40.396344 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:40.402974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:40.403530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:40.404159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:40.404881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:40.405334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:40.405757 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:40.446043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:40.446525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:40.446970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:40.447732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:40.448192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:40.448631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:40.469743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:54:40.476341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for user ffa36ffb13d74ef5a9cb4385917dcd05 and project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:54:40.578987 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b893f663-e2a4-4570-be70-f47d1d605d38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787/action" status: 202 len: 0 microversion: 2.1 time: 0.187066 Aug 27 05:54:40.579560 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3716/7425] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:54:40 2022] POST /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:54:40.587896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d8a2b4a-5ec4-4d8c-b1fa-054b4d5d39df tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:40.588534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d8a2b4a-5ec4-4d8c-b1fa-054b4d5d39df tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:40.595106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d8a2b4a-5ec4-4d8c-b1fa-054b4d5d39df tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:40.595971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d8a2b4a-5ec4-4d8c-b1fa-054b4d5d39df tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:40.596502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d8a2b4a-5ec4-4d8c-b1fa-054b4d5d39df tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:40.597237 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d8a2b4a-5ec4-4d8c-b1fa-054b4d5d39df tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:40.597711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d8a2b4a-5ec4-4d8c-b1fa-054b4d5d39df tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:40.598154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d8a2b4a-5ec4-4d8c-b1fa-054b4d5d39df tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:41.100869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d8a2b4a-5ec4-4d8c-b1fa-054b4d5d39df tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:41.108685 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d8a2b4a-5ec4-4d8c-b1fa-054b4d5d39df tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1674 microversion: 2.1 time: 0.524805 Aug 27 05:54:41.109269 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3710/7426] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:40 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1674 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:42.131880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-477bd5c0-a4e4-477e-9f5b-9c3ecfb73007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:42.132504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-477bd5c0-a4e4-477e-9f5b-9c3ecfb73007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:42.140059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-477bd5c0-a4e4-477e-9f5b-9c3ecfb73007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:42.140546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-477bd5c0-a4e4-477e-9f5b-9c3ecfb73007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:42.140978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-477bd5c0-a4e4-477e-9f5b-9c3ecfb73007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:42.141662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-477bd5c0-a4e4-477e-9f5b-9c3ecfb73007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:42.142141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-477bd5c0-a4e4-477e-9f5b-9c3ecfb73007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:42.142565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-477bd5c0-a4e4-477e-9f5b-9c3ecfb73007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:42.274934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-477bd5c0-a4e4-477e-9f5b-9c3ecfb73007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:42.283771 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-477bd5c0-a4e4-477e-9f5b-9c3ecfb73007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1674 microversion: 2.1 time: 0.157293 Aug 27 05:54:42.284358 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3717/7427] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:42 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:43.305546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-261d930d-e467-4d35-b68e-5885845e7a20 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:43.306176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-261d930d-e467-4d35-b68e-5885845e7a20 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:43.313339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d930d-e467-4d35-b68e-5885845e7a20 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:43.313832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d930d-e467-4d35-b68e-5885845e7a20 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:43.314286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d930d-e467-4d35-b68e-5885845e7a20 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:43.314985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d930d-e467-4d35-b68e-5885845e7a20 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:43.315560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d930d-e467-4d35-b68e-5885845e7a20 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:43.315996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-261d930d-e467-4d35-b68e-5885845e7a20 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:43.444909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-261d930d-e467-4d35-b68e-5885845e7a20 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:43.453003 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-261d930d-e467-4d35-b68e-5885845e7a20 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1674 microversion: 2.1 time: 0.151467 Aug 27 05:54:43.453597 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3711/7428] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:43 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:43.613670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-51951969-0cdd-4b77-bc49-7d5d70217b47 req-602d1591-c7ec-4c89-9540-33474a34da1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b3e81b-d0c4-47a7-ad8a-49fb3f70a787", "name": "network-vif-plugged", "status": "completed", "tag": "dd06bada-19b4-43b3-9ca3-3b70ba5a2152"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:43.624392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-51951969-0cdd-4b77-bc49-7d5d70217b47 req-602d1591-c7ec-4c89-9540-33474a34da1a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:43.624879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-51951969-0cdd-4b77-bc49-7d5d70217b47 req-602d1591-c7ec-4c89-9540-33474a34da1a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:43.626981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-51951969-0cdd-4b77-bc49-7d5d70217b47 req-602d1591-c7ec-4c89-9540-33474a34da1a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:43.640945 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-51951969-0cdd-4b77-bc49-7d5d70217b47 req-602d1591-c7ec-4c89-9540-33474a34da1a service nova] Creating event network-vif-plugged:dd06bada-19b4-43b3-9ca3-3b70ba5a2152 for instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 on n-h1-820368-35 Aug 27 05:54:43.646665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-51951969-0cdd-4b77-bc49-7d5d70217b47 req-602d1591-c7ec-4c89-9540-33474a34da1a service nova] Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:54:43.657923 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-51951969-0cdd-4b77-bc49-7d5d70217b47 req-602d1591-c7ec-4c89-9540-33474a34da1a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048179 Aug 27 05:54:43.658797 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3718/7429] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:54:44.261824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ff356a5f-0b18-4ba2-b93f-dc6db29af4a8 req-b7ca7072-89c5-474d-b3c1-40dec1d77da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b3e81b-d0c4-47a7-ad8a-49fb3f70a787", "name": "network-vif-unplugged", "status": "completed", "tag": "dd06bada-19b4-43b3-9ca3-3b70ba5a2152"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:44.272091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ff356a5f-0b18-4ba2-b93f-dc6db29af4a8 req-b7ca7072-89c5-474d-b3c1-40dec1d77da7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:44.272441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ff356a5f-0b18-4ba2-b93f-dc6db29af4a8 req-b7ca7072-89c5-474d-b3c1-40dec1d77da7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:44.272965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ff356a5f-0b18-4ba2-b93f-dc6db29af4a8 req-b7ca7072-89c5-474d-b3c1-40dec1d77da7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:44.285739 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ff356a5f-0b18-4ba2-b93f-dc6db29af4a8 req-b7ca7072-89c5-474d-b3c1-40dec1d77da7 service nova] Creating event network-vif-unplugged:dd06bada-19b4-43b3-9ca3-3b70ba5a2152 for instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 on n-h2-820368-35 Aug 27 05:54:44.291440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-ff356a5f-0b18-4ba2-b93f-dc6db29af4a8 req-b7ca7072-89c5-474d-b3c1-40dec1d77da7 service nova] Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:54:44.303881 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ff356a5f-0b18-4ba2-b93f-dc6db29af4a8 req-b7ca7072-89c5-474d-b3c1-40dec1d77da7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045995 Aug 27 05:54:44.304586 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3712/7430] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:54:44.474971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a620a4a-413f-4cd8-980d-03b1d8571424 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:44.475692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a620a4a-413f-4cd8-980d-03b1d8571424 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:44.481882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a620a4a-413f-4cd8-980d-03b1d8571424 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:44.482400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a620a4a-413f-4cd8-980d-03b1d8571424 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:44.482889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a620a4a-413f-4cd8-980d-03b1d8571424 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:44.483620 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a620a4a-413f-4cd8-980d-03b1d8571424 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:44.484077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a620a4a-413f-4cd8-980d-03b1d8571424 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:44.484507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a620a4a-413f-4cd8-980d-03b1d8571424 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:44.489025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:44.625334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1a620a4a-413f-4cd8-980d-03b1d8571424 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:44.634225 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a620a4a-413f-4cd8-980d-03b1d8571424 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1674 microversion: 2.1 time: 0.164090 Aug 27 05:54:44.634818 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3719/7431] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:44 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:45.658352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db35e3f5-8b19-462a-8426-20b5a25263c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:45.659072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-db35e3f5-8b19-462a-8426-20b5a25263c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:45.665235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db35e3f5-8b19-462a-8426-20b5a25263c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:45.665725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db35e3f5-8b19-462a-8426-20b5a25263c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:45.666172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db35e3f5-8b19-462a-8426-20b5a25263c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:45.666904 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db35e3f5-8b19-462a-8426-20b5a25263c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:45.667397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db35e3f5-8b19-462a-8426-20b5a25263c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:45.667835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db35e3f5-8b19-462a-8426-20b5a25263c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:45.805245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-db35e3f5-8b19-462a-8426-20b5a25263c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:45.813114 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db35e3f5-8b19-462a-8426-20b5a25263c4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1674 microversion: 2.1 time: 0.160671 Aug 27 05:54:45.813686 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3713/7432] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:45 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:46.341752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5f6e80f2-0144-4e37-ae36-780dd0c78a63 req-9a621093-1ace-4f05-afa8-6299ffe7129d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b3e81b-d0c4-47a7-ad8a-49fb3f70a787", "tag": "dd06bada-19b4-43b3-9ca3-3b70ba5a2152"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:46.351944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5f6e80f2-0144-4e37-ae36-780dd0c78a63 req-9a621093-1ace-4f05-afa8-6299ffe7129d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:46.352420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5f6e80f2-0144-4e37-ae36-780dd0c78a63 req-9a621093-1ace-4f05-afa8-6299ffe7129d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:46.352855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5f6e80f2-0144-4e37-ae36-780dd0c78a63 req-9a621093-1ace-4f05-afa8-6299ffe7129d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:46.365795 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-5f6e80f2-0144-4e37-ae36-780dd0c78a63 req-9a621093-1ace-4f05-afa8-6299ffe7129d service nova] Creating event network-changed:dd06bada-19b4-43b3-9ca3-3b70ba5a2152 for instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 on n-h2-820368-35 Aug 27 05:54:46.371310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-5f6e80f2-0144-4e37-ae36-780dd0c78a63 req-9a621093-1ace-4f05-afa8-6299ffe7129d service nova] Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:54:46.383361 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5f6e80f2-0144-4e37-ae36-780dd0c78a63 req-9a621093-1ace-4f05-afa8-6299ffe7129d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045874 Aug 27 05:54:46.384050 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3720/7433] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:54:46.836004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d04c16e0-fb98-4a78-b6e9-c708085df428 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:46.837251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d04c16e0-fb98-4a78-b6e9-c708085df428 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:46.844199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d04c16e0-fb98-4a78-b6e9-c708085df428 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:46.844698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d04c16e0-fb98-4a78-b6e9-c708085df428 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:46.845304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d04c16e0-fb98-4a78-b6e9-c708085df428 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:46.846021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d04c16e0-fb98-4a78-b6e9-c708085df428 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:46.846488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d04c16e0-fb98-4a78-b6e9-c708085df428 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:46.846924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d04c16e0-fb98-4a78-b6e9-c708085df428 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:47.005680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d04c16e0-fb98-4a78-b6e9-c708085df428 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:47.014143 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d04c16e0-fb98-4a78-b6e9-c708085df428 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1674 microversion: 2.1 time: 0.181867 Aug 27 05:54:47.014717 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3714/7434] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:46 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:48.036224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5b08db0a-e19d-4de9-8289-e6440e5b4a6c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:48.036847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5b08db0a-e19d-4de9-8289-e6440e5b4a6c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:48.044553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b08db0a-e19d-4de9-8289-e6440e5b4a6c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:48.045064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b08db0a-e19d-4de9-8289-e6440e5b4a6c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:48.045503 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b08db0a-e19d-4de9-8289-e6440e5b4a6c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:48.046214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b08db0a-e19d-4de9-8289-e6440e5b4a6c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:48.046670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b08db0a-e19d-4de9-8289-e6440e5b4a6c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:48.047121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b08db0a-e19d-4de9-8289-e6440e5b4a6c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:48.194085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5b08db0a-e19d-4de9-8289-e6440e5b4a6c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:48.203761 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5b08db0a-e19d-4de9-8289-e6440e5b4a6c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1674 microversion: 2.1 time: 0.171982 Aug 27 05:54:48.204362 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3721/7435] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:48 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:49.225267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b4c44782-57e4-446f-b3b8-9803f3276cee tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:49.225802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b4c44782-57e4-446f-b3b8-9803f3276cee tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:49.233154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c44782-57e4-446f-b3b8-9803f3276cee tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:49.233651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c44782-57e4-446f-b3b8-9803f3276cee tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:49.234102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c44782-57e4-446f-b3b8-9803f3276cee tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:49.234814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c44782-57e4-446f-b3b8-9803f3276cee tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:49.235308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c44782-57e4-446f-b3b8-9803f3276cee tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:49.235751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b4c44782-57e4-446f-b3b8-9803f3276cee tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:49.367055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b4c44782-57e4-446f-b3b8-9803f3276cee tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:49.375491 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b4c44782-57e4-446f-b3b8-9803f3276cee tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1667 microversion: 2.1 time: 0.154603 Aug 27 05:54:49.376070 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3715/7436] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:49 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:49.396484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3da91d94-a7a8-4e27-8928-6e18c3f7547c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:49.397136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3da91d94-a7a8-4e27-8928-6e18c3f7547c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:49.403165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3da91d94-a7a8-4e27-8928-6e18c3f7547c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:49.403660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3da91d94-a7a8-4e27-8928-6e18c3f7547c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:49.404109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3da91d94-a7a8-4e27-8928-6e18c3f7547c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:49.404848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3da91d94-a7a8-4e27-8928-6e18c3f7547c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:49.405318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3da91d94-a7a8-4e27-8928-6e18c3f7547c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:49.405752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3da91d94-a7a8-4e27-8928-6e18c3f7547c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:49.537678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3da91d94-a7a8-4e27-8928-6e18c3f7547c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:49.545777 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3da91d94-a7a8-4e27-8928-6e18c3f7547c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1667 microversion: 2.1 time: 0.154103 Aug 27 05:54:49.546344 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3722/7437] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:49 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:49.565938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-269c4fe5-e98a-4798-9f7b-76a5e5997cd6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:49.566579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-269c4fe5-e98a-4798-9f7b-76a5e5997cd6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:49.572561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-269c4fe5-e98a-4798-9f7b-76a5e5997cd6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:49.573090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-269c4fe5-e98a-4798-9f7b-76a5e5997cd6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:49.573549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-269c4fe5-e98a-4798-9f7b-76a5e5997cd6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:49.574264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-269c4fe5-e98a-4798-9f7b-76a5e5997cd6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:49.574735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-269c4fe5-e98a-4798-9f7b-76a5e5997cd6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:49.575466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-269c4fe5-e98a-4798-9f7b-76a5e5997cd6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:49.709829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-269c4fe5-e98a-4798-9f7b-76a5e5997cd6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:49.713401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:49.718701 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-269c4fe5-e98a-4798-9f7b-76a5e5997cd6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1667 microversion: 2.1 time: 0.156721 Aug 27 05:54:49.719302 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3716/7438] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:49 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:49.739479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9afac896-d0ec-4b93-8f13-2d3215bb7110 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:49.739921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9afac896-d0ec-4b93-8f13-2d3215bb7110 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:49.745840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9afac896-d0ec-4b93-8f13-2d3215bb7110 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:49.746329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9afac896-d0ec-4b93-8f13-2d3215bb7110 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:49.746766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9afac896-d0ec-4b93-8f13-2d3215bb7110 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:49.747490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9afac896-d0ec-4b93-8f13-2d3215bb7110 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:49.748476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9afac896-d0ec-4b93-8f13-2d3215bb7110 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:49.748899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9afac896-d0ec-4b93-8f13-2d3215bb7110 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:49.773638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9afac896-d0ec-4b93-8f13-2d3215bb7110 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:54:49.850469 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9afac896-d0ec-4b93-8f13-2d3215bb7110 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 204 len: 0 microversion: 2.1 time: 0.114666 Aug 27 05:54:49.851416 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3723/7439] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:54:49 2022] DELETE /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:54:49.862440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2633c5f2-1131-4315-bf8c-a1ce08f9fa21 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:49.863072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2633c5f2-1131-4315-bf8c-a1ce08f9fa21 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:49.869041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2633c5f2-1131-4315-bf8c-a1ce08f9fa21 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:49.869533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2633c5f2-1131-4315-bf8c-a1ce08f9fa21 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:49.869984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2633c5f2-1131-4315-bf8c-a1ce08f9fa21 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:49.870689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2633c5f2-1131-4315-bf8c-a1ce08f9fa21 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:49.871185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2633c5f2-1131-4315-bf8c-a1ce08f9fa21 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:49.871627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2633c5f2-1131-4315-bf8c-a1ce08f9fa21 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:50.004824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2633c5f2-1131-4315-bf8c-a1ce08f9fa21 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:50.012543 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2633c5f2-1131-4315-bf8c-a1ce08f9fa21 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1673 microversion: 2.1 time: 0.156167 Aug 27 05:54:50.013116 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3717/7440] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:49 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:50.862105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7ee0ff64-ed54-412c-980a-fbb85eb7e363 req-4a158578-9771-414d-932f-1a41c96c8138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b3e81b-d0c4-47a7-ad8a-49fb3f70a787", "name": "network-vif-plugged", "status": "completed", "tag": "dd06bada-19b4-43b3-9ca3-3b70ba5a2152"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:50.868134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:50.875594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7ee0ff64-ed54-412c-980a-fbb85eb7e363 req-4a158578-9771-414d-932f-1a41c96c8138 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:50.876105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7ee0ff64-ed54-412c-980a-fbb85eb7e363 req-4a158578-9771-414d-932f-1a41c96c8138 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:50.876541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7ee0ff64-ed54-412c-980a-fbb85eb7e363 req-4a158578-9771-414d-932f-1a41c96c8138 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:50.887406 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7ee0ff64-ed54-412c-980a-fbb85eb7e363 req-4a158578-9771-414d-932f-1a41c96c8138 service nova] Creating event network-vif-plugged:dd06bada-19b4-43b3-9ca3-3b70ba5a2152 for instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 on n-h2-820368-35 Aug 27 05:54:50.892650 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7ee0ff64-ed54-412c-980a-fbb85eb7e363 req-4a158578-9771-414d-932f-1a41c96c8138 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034985 Aug 27 05:54:50.893011 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3724/7441] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:54:51.034381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a89178d5-50c8-46b4-9d51-3bb9fdb6676f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:51.035016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a89178d5-50c8-46b4-9d51-3bb9fdb6676f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:51.041865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a89178d5-50c8-46b4-9d51-3bb9fdb6676f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:51.042386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a89178d5-50c8-46b4-9d51-3bb9fdb6676f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:51.042838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a89178d5-50c8-46b4-9d51-3bb9fdb6676f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:51.043847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a89178d5-50c8-46b4-9d51-3bb9fdb6676f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:51.044345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a89178d5-50c8-46b4-9d51-3bb9fdb6676f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:51.045439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a89178d5-50c8-46b4-9d51-3bb9fdb6676f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:51.175751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a89178d5-50c8-46b4-9d51-3bb9fdb6676f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:51.183524 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a89178d5-50c8-46b4-9d51-3bb9fdb6676f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1673 microversion: 2.1 time: 0.153078 Aug 27 05:54:51.184103 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3718/7442] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:51 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:52.202550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-3e568bb6-b377-4d42-bdd6-b5fddc2bc219 req-bfecccca-c44b-4b0d-84e2-53e14dcf0a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b3e81b-d0c4-47a7-ad8a-49fb3f70a787", "name": "network-vif-deleted", "tag": "dd06bada-19b4-43b3-9ca3-3b70ba5a2152"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:52.205253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5f6ec943-da84-4271-b589-baad8c2be365 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:52.205896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5f6ec943-da84-4271-b589-baad8c2be365 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:52.210041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:52.216012 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=39 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:52.217067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3e568bb6-b377-4d42-bdd6-b5fddc2bc219 req-bfecccca-c44b-4b0d-84e2-53e14dcf0a8d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:52.218166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3e568bb6-b377-4d42-bdd6-b5fddc2bc219 req-bfecccca-c44b-4b0d-84e2-53e14dcf0a8d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:52.218266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6ec943-da84-4271-b589-baad8c2be365 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:52.218366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3e568bb6-b377-4d42-bdd6-b5fddc2bc219 req-bfecccca-c44b-4b0d-84e2-53e14dcf0a8d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:52.228374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6ec943-da84-4271-b589-baad8c2be365 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:52.228890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6ec943-da84-4271-b589-baad8c2be365 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:52.229663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6ec943-da84-4271-b589-baad8c2be365 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:52.230146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6ec943-da84-4271-b589-baad8c2be365 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:52.230597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5f6ec943-da84-4271-b589-baad8c2be365 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:52.230958 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-3e568bb6-b377-4d42-bdd6-b5fddc2bc219 req-bfecccca-c44b-4b0d-84e2-53e14dcf0a8d service nova] Creating event network-vif-deleted:dd06bada-19b4-43b3-9ca3-3b70ba5a2152 for instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 on n-h2-820368-35 Aug 27 05:54:52.237510 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-3e568bb6-b377-4d42-bdd6-b5fddc2bc219 req-bfecccca-c44b-4b0d-84e2-53e14dcf0a8d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039221 Aug 27 05:54:52.238569 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3725/7443] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:54:52.301601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5f6ec943-da84-4271-b589-baad8c2be365 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:52.310998 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5f6ec943-da84-4271-b589-baad8c2be365 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 200 len: 1322 microversion: 2.1 time: 0.109520 Aug 27 05:54:52.311856 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3719/7444] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:52 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 1322 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:53.333817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:53.334535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:53.340862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:53.341350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:53.341796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:53.342494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:53.342953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:53.343408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:53.356626 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 HTTP/1.1 Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '54b3e81b-d0c4-47a7-ad8a-49fb3f70a787'} Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:54:53.358259 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:54:53.365492 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:54:53.365492 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:54:53.365492 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:54:53.365492 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:54:53.365492 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:54:53.365492 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:54:53.365492 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:54:53.365492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:54:53.365492 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a407a930-bfd5-46e1-b3ce-190f175808cf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 404 len: 111 microversion: 2.1 time: 0.031159 Aug 27 05:54:53.365492 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3726/7445] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:53 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:54:53.377067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:53.377717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:53.384635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:53.385160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:53.385612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:53.386349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:53.386815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:53.387292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:53.404445 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 HTTP/1.1 Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '54b3e81b-d0c4-47a7-ad8a-49fb3f70a787'} Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:54:53.406126 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:54:53.410016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:54:53.410016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:54:53.410016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:54:53.410016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:54:53.410016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:54:53.410016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:54:53.410016 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:54:53.410016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:54:53.410016 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2cc7fbc5-f77e-416c-893a-83ccb07a8a51 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 404 len: 111 microversion: 2.1 time: 0.035025 Aug 27 05:54:53.410016 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3720/7446] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:53 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:54:53.457694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-56764475", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "e601665f-33df-4210-8164-8ee874f4ba24"}], "security_groups": [{"name": "tempest-securitygroup--943770067"}], "key_name": "tempest-keypair-94422661", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:53.561506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] validate_networks() for [('e601665f-33df-4210-8164-8ee874f4ba24', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:54:53.941841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:54:53.942289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:54:53.942800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:54:53.943254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:54:53.943700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:54:53.953420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:53.953976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:53.954408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:53.955229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:53.955691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:53.956122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:53.977920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:54:53.984412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for user ffa36ffb13d74ef5a9cb4385917dcd05 and project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:54:53.996872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:54:53.999744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:54:54.045680 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5aae7a80-bbfe-4469-a3fc-70124324d934 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.591875 Aug 27 05:54:54.046329 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3727/7447] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:54:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:54:54.057509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a3a8aa71-bdde-4b09-ac07-1c58525feb33 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:54.058140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a3a8aa71-bdde-4b09-ac07-1c58525feb33 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:54.116827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a3a8aa71-bdde-4b09-ac07-1c58525feb33 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:54.124610 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a3a8aa71-bdde-4b09-ac07-1c58525feb33 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1235 microversion: 2.1 time: 0.071114 Aug 27 05:54:54.125195 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3721/7448] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:54 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1235 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:55.148597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-50217c3c-66f2-44ae-9e20-9ef2fbc3daa6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:55.149214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-50217c3c-66f2-44ae-9e20-9ef2fbc3daa6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:55.158660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50217c3c-66f2-44ae-9e20-9ef2fbc3daa6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:55.159178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50217c3c-66f2-44ae-9e20-9ef2fbc3daa6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:55.159618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50217c3c-66f2-44ae-9e20-9ef2fbc3daa6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:55.160505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50217c3c-66f2-44ae-9e20-9ef2fbc3daa6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:55.160953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50217c3c-66f2-44ae-9e20-9ef2fbc3daa6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:55.161537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-50217c3c-66f2-44ae-9e20-9ef2fbc3daa6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:55.236069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-50217c3c-66f2-44ae-9e20-9ef2fbc3daa6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:55.243808 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-50217c3c-66f2-44ae-9e20-9ef2fbc3daa6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1305 microversion: 2.1 time: 0.100222 Aug 27 05:54:55.244398 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3728/7449] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:55 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:56.265993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a915c0d-afb9-4051-aedd-efb857c52ee7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:56.266626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a915c0d-afb9-4051-aedd-efb857c52ee7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:56.274438 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a915c0d-afb9-4051-aedd-efb857c52ee7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:56.274944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a915c0d-afb9-4051-aedd-efb857c52ee7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:56.275504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a915c0d-afb9-4051-aedd-efb857c52ee7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:56.276221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a915c0d-afb9-4051-aedd-efb857c52ee7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:56.276695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a915c0d-afb9-4051-aedd-efb857c52ee7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:56.277141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a915c0d-afb9-4051-aedd-efb857c52ee7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:56.449771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2a915c0d-afb9-4051-aedd-efb857c52ee7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:56.462061 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a915c0d-afb9-4051-aedd-efb857c52ee7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1360 microversion: 2.1 time: 0.200015 Aug 27 05:54:56.462645 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3722/7450] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:56 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1360 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:56.523777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-77717823-a563-44d3-9f9b-08a39b622313 req-34d6e242-4f1d-4a28-a71f-fcc246d20761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d68fecc-af78-4f6a-8c43-ccbe07c9d226", "tag": "500581c3-9ffa-417f-b033-c633de3117c2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:56.536106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-77717823-a563-44d3-9f9b-08a39b622313 req-34d6e242-4f1d-4a28-a71f-fcc246d20761 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:56.536590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-77717823-a563-44d3-9f9b-08a39b622313 req-34d6e242-4f1d-4a28-a71f-fcc246d20761 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:56.537031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-77717823-a563-44d3-9f9b-08a39b622313 req-34d6e242-4f1d-4a28-a71f-fcc246d20761 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:56.549297 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-77717823-a563-44d3-9f9b-08a39b622313 req-34d6e242-4f1d-4a28-a71f-fcc246d20761 service nova] Creating event network-changed:500581c3-9ffa-417f-b033-c633de3117c2 for instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 on n-h1-820368-35 Aug 27 05:54:56.554657 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-77717823-a563-44d3-9f9b-08a39b622313 req-34d6e242-4f1d-4a28-a71f-fcc246d20761 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034654 Aug 27 05:54:56.555539 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3729/7451] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:54:57.484936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-04980aac-5106-4b18-8c8b-a240bdaefccd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:57.485980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-04980aac-5106-4b18-8c8b-a240bdaefccd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:57.494316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04980aac-5106-4b18-8c8b-a240bdaefccd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:57.494814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04980aac-5106-4b18-8c8b-a240bdaefccd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:57.495297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04980aac-5106-4b18-8c8b-a240bdaefccd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:57.496020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04980aac-5106-4b18-8c8b-a240bdaefccd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:57.496488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04980aac-5106-4b18-8c8b-a240bdaefccd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:57.496924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-04980aac-5106-4b18-8c8b-a240bdaefccd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:57.639432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-04980aac-5106-4b18-8c8b-a240bdaefccd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:57.647520 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-04980aac-5106-4b18-8c8b-a240bdaefccd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1360 microversion: 2.1 time: 0.166956 Aug 27 05:54:57.648107 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3723/7452] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:57 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:58.671026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a8e4322a-b5f3-435e-b254-f0679e9e4b10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:58.671746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a8e4322a-b5f3-435e-b254-f0679e9e4b10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:58.677834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8e4322a-b5f3-435e-b254-f0679e9e4b10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:58.678316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8e4322a-b5f3-435e-b254-f0679e9e4b10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:58.678752 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8e4322a-b5f3-435e-b254-f0679e9e4b10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:58.679475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8e4322a-b5f3-435e-b254-f0679e9e4b10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:58.679929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8e4322a-b5f3-435e-b254-f0679e9e4b10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:58.680347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8e4322a-b5f3-435e-b254-f0679e9e4b10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:58.812865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a8e4322a-b5f3-435e-b254-f0679e9e4b10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:58.820582 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a8e4322a-b5f3-435e-b254-f0679e9e4b10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1360 microversion: 2.1 time: 0.155488 Aug 27 05:54:58.821156 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3730/7453] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:58 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:59.841857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c1db7a1e-a1df-4ad4-bb78-a3529146cd3d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:59.842485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c1db7a1e-a1df-4ad4-bb78-a3529146cd3d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:59.849421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1db7a1e-a1df-4ad4-bb78-a3529146cd3d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:59.849917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1db7a1e-a1df-4ad4-bb78-a3529146cd3d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:59.850370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1db7a1e-a1df-4ad4-bb78-a3529146cd3d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:59.851078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1db7a1e-a1df-4ad4-bb78-a3529146cd3d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:59.851571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1db7a1e-a1df-4ad4-bb78-a3529146cd3d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:59.852011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1db7a1e-a1df-4ad4-bb78-a3529146cd3d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:59.980035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1db7a1e-a1df-4ad4-bb78-a3529146cd3d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:59.988232 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c1db7a1e-a1df-4ad4-bb78-a3529146cd3d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1360 microversion: 2.1 time: 0.150810 Aug 27 05:54:59.988801 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3724/7454] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:59 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:01.015773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6ac5f6b0-db1c-412f-88bd-a89b77ac58de tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:01.016315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6ac5f6b0-db1c-412f-88bd-a89b77ac58de tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:01.022633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac5f6b0-db1c-412f-88bd-a89b77ac58de tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:01.023150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac5f6b0-db1c-412f-88bd-a89b77ac58de tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:01.023593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac5f6b0-db1c-412f-88bd-a89b77ac58de tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:01.024294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac5f6b0-db1c-412f-88bd-a89b77ac58de tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:01.024754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac5f6b0-db1c-412f-88bd-a89b77ac58de tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:01.025180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6ac5f6b0-db1c-412f-88bd-a89b77ac58de tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:01.157221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6ac5f6b0-db1c-412f-88bd-a89b77ac58de tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:01.164823 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6ac5f6b0-db1c-412f-88bd-a89b77ac58de tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1360 microversion: 2.1 time: 0.158826 Aug 27 05:55:01.165387 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3731/7455] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:01 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:02.186485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1832bc2a-85c7-4554-aca2-96a5d971d860 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:02.187252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1832bc2a-85c7-4554-aca2-96a5d971d860 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:02.194084 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832bc2a-85c7-4554-aca2-96a5d971d860 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:02.194608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832bc2a-85c7-4554-aca2-96a5d971d860 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:02.195051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832bc2a-85c7-4554-aca2-96a5d971d860 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:02.195797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832bc2a-85c7-4554-aca2-96a5d971d860 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:02.196292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832bc2a-85c7-4554-aca2-96a5d971d860 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:02.196738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1832bc2a-85c7-4554-aca2-96a5d971d860 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:02.325751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1832bc2a-85c7-4554-aca2-96a5d971d860 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:02.333611 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1832bc2a-85c7-4554-aca2-96a5d971d860 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1360 microversion: 2.1 time: 0.151670 Aug 27 05:55:02.334176 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3725/7456] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:02 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:03.355198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a857d28b-78cf-4d2d-ae78-3857a38fbf95 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:03.355866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a857d28b-78cf-4d2d-ae78-3857a38fbf95 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:03.362714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a857d28b-78cf-4d2d-ae78-3857a38fbf95 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:03.363161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a857d28b-78cf-4d2d-ae78-3857a38fbf95 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:03.363629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a857d28b-78cf-4d2d-ae78-3857a38fbf95 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:03.364329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a857d28b-78cf-4d2d-ae78-3857a38fbf95 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:03.364786 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a857d28b-78cf-4d2d-ae78-3857a38fbf95 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:03.365216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a857d28b-78cf-4d2d-ae78-3857a38fbf95 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:03.501395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a857d28b-78cf-4d2d-ae78-3857a38fbf95 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:03.509175 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a857d28b-78cf-4d2d-ae78-3857a38fbf95 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1360 microversion: 2.1 time: 0.157981 Aug 27 05:55:03.509742 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3732/7457] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:03 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:03.698240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-38ef654e-fdff-403d-8f07-1a7ccb3f9eb8 req-17bb0150-285f-4a3d-89fc-ce75a299bf0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d68fecc-af78-4f6a-8c43-ccbe07c9d226", "name": "network-vif-plugged", "status": "completed", "tag": "500581c3-9ffa-417f-b033-c633de3117c2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:55:03.709030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-38ef654e-fdff-403d-8f07-1a7ccb3f9eb8 req-17bb0150-285f-4a3d-89fc-ce75a299bf0d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:03.709589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-38ef654e-fdff-403d-8f07-1a7ccb3f9eb8 req-17bb0150-285f-4a3d-89fc-ce75a299bf0d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:03.709973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-38ef654e-fdff-403d-8f07-1a7ccb3f9eb8 req-17bb0150-285f-4a3d-89fc-ce75a299bf0d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:03.721760 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-38ef654e-fdff-403d-8f07-1a7ccb3f9eb8 req-17bb0150-285f-4a3d-89fc-ce75a299bf0d service nova] Creating event network-vif-plugged:500581c3-9ffa-417f-b033-c633de3117c2 for instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 on n-h1-820368-35 Aug 27 05:55:03.726895 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-38ef654e-fdff-403d-8f07-1a7ccb3f9eb8 req-17bb0150-285f-4a3d-89fc-ce75a299bf0d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032444 Aug 27 05:55:03.727553 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3726/7458] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:55:04.531257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-35bdfdb3-f997-43a6-a9ec-6e27f518455a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:04.531878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-35bdfdb3-f997-43a6-a9ec-6e27f518455a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:04.533867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:04.534529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:04.540800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35bdfdb3-f997-43a6-a9ec-6e27f518455a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:04.541287 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35bdfdb3-f997-43a6-a9ec-6e27f518455a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:04.541728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35bdfdb3-f997-43a6-a9ec-6e27f518455a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:04.542431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35bdfdb3-f997-43a6-a9ec-6e27f518455a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:04.542887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35bdfdb3-f997-43a6-a9ec-6e27f518455a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:04.543345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35bdfdb3-f997-43a6-a9ec-6e27f518455a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:04.673660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-35bdfdb3-f997-43a6-a9ec-6e27f518455a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:04.681388 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-35bdfdb3-f997-43a6-a9ec-6e27f518455a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1360 microversion: 2.1 time: 0.154779 Aug 27 05:55:04.681962 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3733/7459] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:04 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:05.699131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:05.704184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-01b8945f-2b90-4344-a929-e247d0b88d81 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:05.704926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-01b8945f-2b90-4344-a929-e247d0b88d81 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:05.711357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01b8945f-2b90-4344-a929-e247d0b88d81 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:05.711847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01b8945f-2b90-4344-a929-e247d0b88d81 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:05.712294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01b8945f-2b90-4344-a929-e247d0b88d81 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:05.712993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01b8945f-2b90-4344-a929-e247d0b88d81 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:05.713459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01b8945f-2b90-4344-a929-e247d0b88d81 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:05.713895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-01b8945f-2b90-4344-a929-e247d0b88d81 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:05.849996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-01b8945f-2b90-4344-a929-e247d0b88d81 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:05.858256 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-01b8945f-2b90-4344-a929-e247d0b88d81 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1547 microversion: 2.1 time: 0.160107 Aug 27 05:55:05.858825 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3727/7460] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:05 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:05.879371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-509f5471-3ec5-4dff-899a-2c9ee902c77d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:05.879880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-509f5471-3ec5-4dff-899a-2c9ee902c77d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:05.886687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-509f5471-3ec5-4dff-899a-2c9ee902c77d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:05.887206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-509f5471-3ec5-4dff-899a-2c9ee902c77d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:05.887651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-509f5471-3ec5-4dff-899a-2c9ee902c77d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:05.888352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-509f5471-3ec5-4dff-899a-2c9ee902c77d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:05.888812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-509f5471-3ec5-4dff-899a-2c9ee902c77d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:05.889246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-509f5471-3ec5-4dff-899a-2c9ee902c77d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:05.965081 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-509f5471-3ec5-4dff-899a-2c9ee902c77d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089780 Aug 27 05:55:05.965689 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3734/7461] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:55:05 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:55:07.213999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b1603067-8f69-4a41-96a5-a0dc2c88e092 req-24b3ac0d-8a28-4fcf-84e7-ee7967b8fde0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d68fecc-af78-4f6a-8c43-ccbe07c9d226", "tag": "500581c3-9ffa-417f-b033-c633de3117c2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:55:07.225038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b1603067-8f69-4a41-96a5-a0dc2c88e092 req-24b3ac0d-8a28-4fcf-84e7-ee7967b8fde0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:07.225528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b1603067-8f69-4a41-96a5-a0dc2c88e092 req-24b3ac0d-8a28-4fcf-84e7-ee7967b8fde0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:07.225975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b1603067-8f69-4a41-96a5-a0dc2c88e092 req-24b3ac0d-8a28-4fcf-84e7-ee7967b8fde0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:07.239926 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b1603067-8f69-4a41-96a5-a0dc2c88e092 req-24b3ac0d-8a28-4fcf-84e7-ee7967b8fde0 service nova] Creating event network-changed:500581c3-9ffa-417f-b033-c633de3117c2 for instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 on n-h1-820368-35 Aug 27 05:55:07.244875 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b1603067-8f69-4a41-96a5-a0dc2c88e092 req-24b3ac0d-8a28-4fcf-84e7-ee7967b8fde0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034639 Aug 27 05:55:07.245503 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3728/7462] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:56:22.534286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:22.535028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:22.536504 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:56:22.536679 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 05:56:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 (ip 10.222.0.58) !!! Aug 27 05:56:22.548446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-efad50bc-27b4-4f37-a971-18b19b75236b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:22.549014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-efad50bc-27b4-4f37-a971-18b19b75236b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:22.557450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efad50bc-27b4-4f37-a971-18b19b75236b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:22.557941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efad50bc-27b4-4f37-a971-18b19b75236b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:22.558384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efad50bc-27b4-4f37-a971-18b19b75236b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:22.559081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efad50bc-27b4-4f37-a971-18b19b75236b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:22.559563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efad50bc-27b4-4f37-a971-18b19b75236b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:22.559993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-efad50bc-27b4-4f37-a971-18b19b75236b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:22.740404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-efad50bc-27b4-4f37-a971-18b19b75236b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:22.748019 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-efad50bc-27b4-4f37-a971-18b19b75236b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1665 microversion: 2.1 time: 0.216808 Aug 27 05:56:22.748609 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3735/7463] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:22 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1665 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:22.768131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=21 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:22.768883 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=54 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:22.770150 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:56:22.770302 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 05:56:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/os-volume_attachments (ip 10.222.0.58) !!! Aug 27 05:56:22.771412 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:56:22.771552 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 05:56:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/os-volume_attachments (ip 10.222.0.58) !!! Aug 27 05:56:22.779064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-80579884-b916-490b-a726-9616de4440d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b614a038-0b0b-4b6f-8e20-4495942fcea6"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:56:22.781643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-80579884-b916-490b-a726-9616de4440d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:22.789387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80579884-b916-490b-a726-9616de4440d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:22.789882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80579884-b916-490b-a726-9616de4440d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:22.790330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80579884-b916-490b-a726-9616de4440d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:22.791044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80579884-b916-490b-a726-9616de4440d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:22.791537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80579884-b916-490b-a726-9616de4440d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:22.791975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-80579884-b916-490b-a726-9616de4440d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:23.243352 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-80579884-b916-490b-a726-9616de4440d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478429 Aug 27 05:56:23.243968 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3729/7464] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:56:22 2022] POST /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:56:35.011054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:56:35.013370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:35.015366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:35.016076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:35.021991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:35.022470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:35.022906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:35.023631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:35.024090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:35.024518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:35.104700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:35.111180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Old instance type m1.heat2, new instance type m1.heat {{(pid=128548) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:56:35.118325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:56:35.118747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:56:35.119267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:56:35.119678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:56:35.120090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:56:35.183021 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6218a102-77e6-4d28-b9f2-c1088b423298 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/action" status: 202 len: 0 microversion: 2.1 time: 0.176198 Aug 27 05:56:35.183667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3736/7465] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:56:35 2022] POST /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:56:35.190238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:35.191673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:35.195800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ce3302d8-d007-4fcf-9943-af045cec0c13 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:35.196566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ce3302d8-d007-4fcf-9943-af045cec0c13 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:35.204615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce3302d8-d007-4fcf-9943-af045cec0c13 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:35.205122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce3302d8-d007-4fcf-9943-af045cec0c13 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:35.205576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce3302d8-d007-4fcf-9943-af045cec0c13 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:35.206930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce3302d8-d007-4fcf-9943-af045cec0c13 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:35.207446 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce3302d8-d007-4fcf-9943-af045cec0c13 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:35.208007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ce3302d8-d007-4fcf-9943-af045cec0c13 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:35.366847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ce3302d8-d007-4fcf-9943-af045cec0c13 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:35.377768 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ce3302d8-d007-4fcf-9943-af045cec0c13 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1720 microversion: 2.1 time: 0.189307 Aug 27 05:56:35.379546 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3730/7466] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:35 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:56:36.401130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d868929b-1399-4d7d-8908-c16a0d56e6d2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:36.401767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d868929b-1399-4d7d-8908-c16a0d56e6d2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:36.408023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d868929b-1399-4d7d-8908-c16a0d56e6d2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:36.408579 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d868929b-1399-4d7d-8908-c16a0d56e6d2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:36.408997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d868929b-1399-4d7d-8908-c16a0d56e6d2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:36.409715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d868929b-1399-4d7d-8908-c16a0d56e6d2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:36.410170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d868929b-1399-4d7d-8908-c16a0d56e6d2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:36.410597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d868929b-1399-4d7d-8908-c16a0d56e6d2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:36.560633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d868929b-1399-4d7d-8908-c16a0d56e6d2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:36.569044 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d868929b-1399-4d7d-8908-c16a0d56e6d2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1720 microversion: 2.1 time: 0.172764 Aug 27 05:56:36.569741 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3737/7467] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:36 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:37.591426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3d689947-2c65-4d1e-bbca-cef993278711 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:37.592055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3d689947-2c65-4d1e-bbca-cef993278711 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:37.599632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d689947-2c65-4d1e-bbca-cef993278711 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:37.600128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d689947-2c65-4d1e-bbca-cef993278711 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:37.600582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d689947-2c65-4d1e-bbca-cef993278711 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:37.601593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d689947-2c65-4d1e-bbca-cef993278711 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:37.602063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d689947-2c65-4d1e-bbca-cef993278711 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:37.602500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3d689947-2c65-4d1e-bbca-cef993278711 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:37.736090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3d689947-2c65-4d1e-bbca-cef993278711 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:37.744990 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3d689947-2c65-4d1e-bbca-cef993278711 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.157476 Aug 27 05:56:37.745564 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3731/7468] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:37 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:38.766589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02d9caf1-d27d-459f-8595-553e2c9476d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:38.767269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-02d9caf1-d27d-459f-8595-553e2c9476d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:38.774520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02d9caf1-d27d-459f-8595-553e2c9476d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:38.774998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02d9caf1-d27d-459f-8595-553e2c9476d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:38.775462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02d9caf1-d27d-459f-8595-553e2c9476d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:38.776153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02d9caf1-d27d-459f-8595-553e2c9476d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:38.776612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02d9caf1-d27d-459f-8595-553e2c9476d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:38.777033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02d9caf1-d27d-459f-8595-553e2c9476d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:38.913247 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02d9caf1-d27d-459f-8595-553e2c9476d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:38.921779 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-02d9caf1-d27d-459f-8595-553e2c9476d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.159233 Aug 27 05:56:38.922349 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3738/7469] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:38 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:39.942495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a21b2bcf-f07d-4e3e-b2e7-244b418d2f8f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:39.943480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a21b2bcf-f07d-4e3e-b2e7-244b418d2f8f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:39.950463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a21b2bcf-f07d-4e3e-b2e7-244b418d2f8f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:39.950953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a21b2bcf-f07d-4e3e-b2e7-244b418d2f8f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:39.951466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a21b2bcf-f07d-4e3e-b2e7-244b418d2f8f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:39.952233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a21b2bcf-f07d-4e3e-b2e7-244b418d2f8f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:39.952701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a21b2bcf-f07d-4e3e-b2e7-244b418d2f8f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:39.953137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a21b2bcf-f07d-4e3e-b2e7-244b418d2f8f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:40.086092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a21b2bcf-f07d-4e3e-b2e7-244b418d2f8f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:40.094433 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a21b2bcf-f07d-4e3e-b2e7-244b418d2f8f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.156003 Aug 27 05:56:40.095023 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3732/7470] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:39 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:41.117023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-00029701-727f-4958-a09b-40d9fe86b3e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:41.117649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-00029701-727f-4958-a09b-40d9fe86b3e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:41.124699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00029701-727f-4958-a09b-40d9fe86b3e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:41.125195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00029701-727f-4958-a09b-40d9fe86b3e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:41.125638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00029701-727f-4958-a09b-40d9fe86b3e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:41.126358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00029701-727f-4958-a09b-40d9fe86b3e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:41.126806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00029701-727f-4958-a09b-40d9fe86b3e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:41.127264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00029701-727f-4958-a09b-40d9fe86b3e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:41.257155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-00029701-727f-4958-a09b-40d9fe86b3e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:41.265698 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-00029701-727f-4958-a09b-40d9fe86b3e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.152648 Aug 27 05:56:41.266279 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3739/7471] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:41 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:42.287897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3924ddf5-a6cb-4bba-94e2-fbc7494481d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:42.288523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3924ddf5-a6cb-4bba-94e2-fbc7494481d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:42.295668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3924ddf5-a6cb-4bba-94e2-fbc7494481d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:42.296163 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3924ddf5-a6cb-4bba-94e2-fbc7494481d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:42.296617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3924ddf5-a6cb-4bba-94e2-fbc7494481d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:42.297321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3924ddf5-a6cb-4bba-94e2-fbc7494481d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:42.297783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3924ddf5-a6cb-4bba-94e2-fbc7494481d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:42.298218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3924ddf5-a6cb-4bba-94e2-fbc7494481d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:42.430893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3924ddf5-a6cb-4bba-94e2-fbc7494481d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:42.439379 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3924ddf5-a6cb-4bba-94e2-fbc7494481d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.156341 Aug 27 05:56:42.439964 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3733/7472] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:42 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:43.461980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dfaefacf-b981-444f-8c14-b55e9371a897 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:43.462603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dfaefacf-b981-444f-8c14-b55e9371a897 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:43.469437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfaefacf-b981-444f-8c14-b55e9371a897 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:43.469929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfaefacf-b981-444f-8c14-b55e9371a897 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:43.470369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfaefacf-b981-444f-8c14-b55e9371a897 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:43.471075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfaefacf-b981-444f-8c14-b55e9371a897 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:43.471572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfaefacf-b981-444f-8c14-b55e9371a897 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:43.472000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfaefacf-b981-444f-8c14-b55e9371a897 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:43.604099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dfaefacf-b981-444f-8c14-b55e9371a897 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:43.612470 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dfaefacf-b981-444f-8c14-b55e9371a897 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.154915 Aug 27 05:56:43.613139 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3740/7473] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:43 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:44.634300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0f4ff72a-86de-44f9-bf0f-1a8fb9b09db2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:44.634934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0f4ff72a-86de-44f9-bf0f-1a8fb9b09db2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:44.641763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f4ff72a-86de-44f9-bf0f-1a8fb9b09db2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:44.642264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f4ff72a-86de-44f9-bf0f-1a8fb9b09db2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:44.642718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f4ff72a-86de-44f9-bf0f-1a8fb9b09db2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:44.643461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f4ff72a-86de-44f9-bf0f-1a8fb9b09db2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:44.643935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f4ff72a-86de-44f9-bf0f-1a8fb9b09db2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:44.644385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0f4ff72a-86de-44f9-bf0f-1a8fb9b09db2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:44.779334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0f4ff72a-86de-44f9-bf0f-1a8fb9b09db2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:44.789418 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0f4ff72a-86de-44f9-bf0f-1a8fb9b09db2 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.159555 Aug 27 05:56:44.790030 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3734/7474] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:44 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:45.810330 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4dfd8c02-b58f-4e32-96f5-ba686d0f8461 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:45.810978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4dfd8c02-b58f-4e32-96f5-ba686d0f8461 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:45.818388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dfd8c02-b58f-4e32-96f5-ba686d0f8461 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:45.818870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dfd8c02-b58f-4e32-96f5-ba686d0f8461 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:45.819338 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dfd8c02-b58f-4e32-96f5-ba686d0f8461 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:45.820029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dfd8c02-b58f-4e32-96f5-ba686d0f8461 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:45.820487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dfd8c02-b58f-4e32-96f5-ba686d0f8461 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:45.820913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4dfd8c02-b58f-4e32-96f5-ba686d0f8461 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:45.955661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4dfd8c02-b58f-4e32-96f5-ba686d0f8461 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:45.963805 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4dfd8c02-b58f-4e32-96f5-ba686d0f8461 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.157348 Aug 27 05:56:45.964380 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3741/7475] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:45 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:46.985135 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7804aea7-447d-4cca-8698-73b3dd95cad6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:46.985752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7804aea7-447d-4cca-8698-73b3dd95cad6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:46.994164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7804aea7-447d-4cca-8698-73b3dd95cad6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:46.994659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7804aea7-447d-4cca-8698-73b3dd95cad6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:46.995145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7804aea7-447d-4cca-8698-73b3dd95cad6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:46.995858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7804aea7-447d-4cca-8698-73b3dd95cad6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:46.996333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7804aea7-447d-4cca-8698-73b3dd95cad6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:46.996769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7804aea7-447d-4cca-8698-73b3dd95cad6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:47.213605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7804aea7-447d-4cca-8698-73b3dd95cad6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:47.222372 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7804aea7-447d-4cca-8698-73b3dd95cad6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.241425 Aug 27 05:56:47.223750 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3735/7476] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:46 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:48.250200 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-91452eeb-47dc-4459-a887-54bf7444ff85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:48.250815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-91452eeb-47dc-4459-a887-54bf7444ff85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:48.257595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91452eeb-47dc-4459-a887-54bf7444ff85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:48.258081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91452eeb-47dc-4459-a887-54bf7444ff85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:48.258522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91452eeb-47dc-4459-a887-54bf7444ff85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:48.259237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91452eeb-47dc-4459-a887-54bf7444ff85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:48.259694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91452eeb-47dc-4459-a887-54bf7444ff85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:48.260121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91452eeb-47dc-4459-a887-54bf7444ff85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:48.393323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-91452eeb-47dc-4459-a887-54bf7444ff85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:48.402144 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-91452eeb-47dc-4459-a887-54bf7444ff85 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.155857 Aug 27 05:56:48.402984 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3742/7477] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:48 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:49.424365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-733c34e7-647a-4689-922c-2d7296e964d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:49.425023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-733c34e7-647a-4689-922c-2d7296e964d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:49.431826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-733c34e7-647a-4689-922c-2d7296e964d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:49.432317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-733c34e7-647a-4689-922c-2d7296e964d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:49.432767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-733c34e7-647a-4689-922c-2d7296e964d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:49.433468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-733c34e7-647a-4689-922c-2d7296e964d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:49.433933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-733c34e7-647a-4689-922c-2d7296e964d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:49.434368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-733c34e7-647a-4689-922c-2d7296e964d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:49.567368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-733c34e7-647a-4689-922c-2d7296e964d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:49.575821 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-733c34e7-647a-4689-922c-2d7296e964d0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.155689 Aug 27 05:56:49.576406 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3736/7478] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:49 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:50.597572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02f23c6b-d73c-4e6a-a023-0b18f200c858 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:50.598186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-02f23c6b-d73c-4e6a-a023-0b18f200c858 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:50.605584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02f23c6b-d73c-4e6a-a023-0b18f200c858 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:50.606063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02f23c6b-d73c-4e6a-a023-0b18f200c858 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:50.606495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02f23c6b-d73c-4e6a-a023-0b18f200c858 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:50.607219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02f23c6b-d73c-4e6a-a023-0b18f200c858 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:50.607707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02f23c6b-d73c-4e6a-a023-0b18f200c858 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:50.608176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02f23c6b-d73c-4e6a-a023-0b18f200c858 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:50.739097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02f23c6b-d73c-4e6a-a023-0b18f200c858 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:50.747452 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-02f23c6b-d73c-4e6a-a023-0b18f200c858 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.153812 Aug 27 05:56:50.748022 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3743/7479] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:50 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:51.769723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bc3a5e88-3ae0-44d4-976e-43478f33a286 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:51.770363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bc3a5e88-3ae0-44d4-976e-43478f33a286 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:51.777211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc3a5e88-3ae0-44d4-976e-43478f33a286 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:51.777715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc3a5e88-3ae0-44d4-976e-43478f33a286 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:51.778168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc3a5e88-3ae0-44d4-976e-43478f33a286 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:51.778887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc3a5e88-3ae0-44d4-976e-43478f33a286 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:51.779582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc3a5e88-3ae0-44d4-976e-43478f33a286 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:51.779880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bc3a5e88-3ae0-44d4-976e-43478f33a286 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:51.911710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bc3a5e88-3ae0-44d4-976e-43478f33a286 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:51.920875 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bc3a5e88-3ae0-44d4-976e-43478f33a286 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.155203 Aug 27 05:56:51.921655 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3737/7480] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:51 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:52.944965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02a53118-0a74-4fe0-b620-4c2d34fc194e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:52.946125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-02a53118-0a74-4fe0-b620-4c2d34fc194e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:52.953703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a53118-0a74-4fe0-b620-4c2d34fc194e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:52.954331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a53118-0a74-4fe0-b620-4c2d34fc194e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:52.954827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a53118-0a74-4fe0-b620-4c2d34fc194e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:52.955842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a53118-0a74-4fe0-b620-4c2d34fc194e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:52.956299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a53118-0a74-4fe0-b620-4c2d34fc194e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:52.956761 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02a53118-0a74-4fe0-b620-4c2d34fc194e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:53.097101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02a53118-0a74-4fe0-b620-4c2d34fc194e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:53.106375 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-02a53118-0a74-4fe0-b620-4c2d34fc194e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.166803 Aug 27 05:56:53.106962 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3744/7481] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:52 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:54.128657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0016a709-10cd-463c-9d00-420564eef007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:54.129209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0016a709-10cd-463c-9d00-420564eef007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:54.136009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0016a709-10cd-463c-9d00-420564eef007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:54.136510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0016a709-10cd-463c-9d00-420564eef007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:54.136956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0016a709-10cd-463c-9d00-420564eef007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:54.137686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0016a709-10cd-463c-9d00-420564eef007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:54.138149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0016a709-10cd-463c-9d00-420564eef007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:54.138583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0016a709-10cd-463c-9d00-420564eef007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:54.266991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0016a709-10cd-463c-9d00-420564eef007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:54.275859 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0016a709-10cd-463c-9d00-420564eef007 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.151304 Aug 27 05:56:54.276435 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3738/7482] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:54 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:55.296971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f3bb399a-47ae-4733-a915-72d50781f9f5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:55.297592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f3bb399a-47ae-4733-a915-72d50781f9f5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:55.305060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bb399a-47ae-4733-a915-72d50781f9f5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:55.305554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bb399a-47ae-4733-a915-72d50781f9f5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:55.305997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bb399a-47ae-4733-a915-72d50781f9f5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:55.306701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bb399a-47ae-4733-a915-72d50781f9f5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:55.307186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bb399a-47ae-4733-a915-72d50781f9f5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:55.307621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bb399a-47ae-4733-a915-72d50781f9f5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:55.437337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f3bb399a-47ae-4733-a915-72d50781f9f5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:55.446947 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f3bb399a-47ae-4733-a915-72d50781f9f5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.154135 Aug 27 05:56:55.447562 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3745/7483] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:55 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:56.468943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b7931087-4757-490a-999f-c3ff6afbb46e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:56.469575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b7931087-4757-490a-999f-c3ff6afbb46e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:56.476425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7931087-4757-490a-999f-c3ff6afbb46e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:56.476929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7931087-4757-490a-999f-c3ff6afbb46e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:56.477384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7931087-4757-490a-999f-c3ff6afbb46e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:56.478097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7931087-4757-490a-999f-c3ff6afbb46e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:56.478571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7931087-4757-490a-999f-c3ff6afbb46e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:56.479014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b7931087-4757-490a-999f-c3ff6afbb46e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:56.609691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b7931087-4757-490a-999f-c3ff6afbb46e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:56.618444 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b7931087-4757-490a-999f-c3ff6afbb46e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.153426 Aug 27 05:56:56.619007 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3739/7484] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:56 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:57.640788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4307a285-9db3-4f57-82c5-efe9ef55f1fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:57.641391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4307a285-9db3-4f57-82c5-efe9ef55f1fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:57.648283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4307a285-9db3-4f57-82c5-efe9ef55f1fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:57.648771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4307a285-9db3-4f57-82c5-efe9ef55f1fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:57.649211 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4307a285-9db3-4f57-82c5-efe9ef55f1fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:57.649907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4307a285-9db3-4f57-82c5-efe9ef55f1fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:57.650366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4307a285-9db3-4f57-82c5-efe9ef55f1fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:57.650793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4307a285-9db3-4f57-82c5-efe9ef55f1fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:57.780194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4307a285-9db3-4f57-82c5-efe9ef55f1fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:57.788659 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4307a285-9db3-4f57-82c5-efe9ef55f1fb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.151731 Aug 27 05:56:57.789250 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3746/7485] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:57 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:58.809860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4eb8fd21-c122-47ef-87ad-1b70ad9f48bb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:58.810495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4eb8fd21-c122-47ef-87ad-1b70ad9f48bb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:58.817825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb8fd21-c122-47ef-87ad-1b70ad9f48bb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:58.819013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb8fd21-c122-47ef-87ad-1b70ad9f48bb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:58.819523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb8fd21-c122-47ef-87ad-1b70ad9f48bb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:58.820240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb8fd21-c122-47ef-87ad-1b70ad9f48bb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:58.820715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb8fd21-c122-47ef-87ad-1b70ad9f48bb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:58.821159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4eb8fd21-c122-47ef-87ad-1b70ad9f48bb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:58.963777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4eb8fd21-c122-47ef-87ad-1b70ad9f48bb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:58.971987 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4eb8fd21-c122-47ef-87ad-1b70ad9f48bb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.166064 Aug 27 05:56:58.972896 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3740/7486] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:58 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:59.993756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae6ca9a2-1fc0-45cc-ab59-ebbf46fa33bd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:59.994304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae6ca9a2-1fc0-45cc-ab59-ebbf46fa33bd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:00.001047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6ca9a2-1fc0-45cc-ab59-ebbf46fa33bd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:00.001534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6ca9a2-1fc0-45cc-ab59-ebbf46fa33bd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:00.001974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6ca9a2-1fc0-45cc-ab59-ebbf46fa33bd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:00.002676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6ca9a2-1fc0-45cc-ab59-ebbf46fa33bd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:00.003166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6ca9a2-1fc0-45cc-ab59-ebbf46fa33bd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:00.003583 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6ca9a2-1fc0-45cc-ab59-ebbf46fa33bd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:00.146231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae6ca9a2-1fc0-45cc-ab59-ebbf46fa33bd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:00.157986 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae6ca9a2-1fc0-45cc-ab59-ebbf46fa33bd tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.168158 Aug 27 05:57:00.158589 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3747/7487] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:59 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:01.180915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2d88d2e0-f05b-4a6d-9c95-b2147880b886 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:01.181553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2d88d2e0-f05b-4a6d-9c95-b2147880b886 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:01.189284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d88d2e0-f05b-4a6d-9c95-b2147880b886 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:01.189799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d88d2e0-f05b-4a6d-9c95-b2147880b886 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:01.190257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d88d2e0-f05b-4a6d-9c95-b2147880b886 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:01.190989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d88d2e0-f05b-4a6d-9c95-b2147880b886 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:01.191496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d88d2e0-f05b-4a6d-9c95-b2147880b886 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:01.191949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d88d2e0-f05b-4a6d-9c95-b2147880b886 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:01.370681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2d88d2e0-f05b-4a6d-9c95-b2147880b886 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:01.378987 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2d88d2e0-f05b-4a6d-9c95-b2147880b886 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1725 microversion: 2.1 time: 0.202136 Aug 27 05:57:01.379600 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3741/7488] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:01 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:02.055631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-538db495-faf8-4f5c-88f6-44f4bf6a270a req-b2da2ed4-b835-458d-be0b-7f63715ae791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d68fecc-af78-4f6a-8c43-ccbe07c9d226", "name": "network-vif-unplugged", "status": "completed", "tag": "500581c3-9ffa-417f-b033-c633de3117c2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:57:02.065485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-538db495-faf8-4f5c-88f6-44f4bf6a270a req-b2da2ed4-b835-458d-be0b-7f63715ae791 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:02.066263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-538db495-faf8-4f5c-88f6-44f4bf6a270a req-b2da2ed4-b835-458d-be0b-7f63715ae791 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:02.066707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-538db495-faf8-4f5c-88f6-44f4bf6a270a req-b2da2ed4-b835-458d-be0b-7f63715ae791 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:02.079524 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-538db495-faf8-4f5c-88f6-44f4bf6a270a req-b2da2ed4-b835-458d-be0b-7f63715ae791 service nova] Creating event network-vif-unplugged:500581c3-9ffa-417f-b033-c633de3117c2 for instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 on n-h2-820368-35 Aug 27 05:57:02.085478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-538db495-faf8-4f5c-88f6-44f4bf6a270a req-b2da2ed4-b835-458d-be0b-7f63715ae791 service nova] Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:57:02.096747 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-538db495-faf8-4f5c-88f6-44f4bf6a270a req-b2da2ed4-b835-458d-be0b-7f63715ae791 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108904 Aug 27 05:57:02.097365 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3748/7489] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:57:02.402072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3f91dae4-e96d-4e6e-b44e-f2b8668553e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:02.402703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3f91dae4-e96d-4e6e-b44e-f2b8668553e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:02.409425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f91dae4-e96d-4e6e-b44e-f2b8668553e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:02.409930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f91dae4-e96d-4e6e-b44e-f2b8668553e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:02.410383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f91dae4-e96d-4e6e-b44e-f2b8668553e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:02.411119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f91dae4-e96d-4e6e-b44e-f2b8668553e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:02.411579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f91dae4-e96d-4e6e-b44e-f2b8668553e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:02.412763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3f91dae4-e96d-4e6e-b44e-f2b8668553e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:02.548746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3f91dae4-e96d-4e6e-b44e-f2b8668553e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:02.557641 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3f91dae4-e96d-4e6e-b44e-f2b8668553e8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1724 microversion: 2.1 time: 0.159882 Aug 27 05:57:02.558257 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3742/7490] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:02 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:03.583266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1ac4d8c7-9f41-424d-9a65-ca805b196b9c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:03.583901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1ac4d8c7-9f41-424d-9a65-ca805b196b9c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:03.590167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ac4d8c7-9f41-424d-9a65-ca805b196b9c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:03.590603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ac4d8c7-9f41-424d-9a65-ca805b196b9c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:03.591041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ac4d8c7-9f41-424d-9a65-ca805b196b9c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:03.591772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ac4d8c7-9f41-424d-9a65-ca805b196b9c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:03.592229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ac4d8c7-9f41-424d-9a65-ca805b196b9c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:03.592652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1ac4d8c7-9f41-424d-9a65-ca805b196b9c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:03.729884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1ac4d8c7-9f41-424d-9a65-ca805b196b9c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:03.738501 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1ac4d8c7-9f41-424d-9a65-ca805b196b9c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.160444 Aug 27 05:57:03.739078 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3749/7491] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:03 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:04.113348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-f9d998c8-b3cf-4c0a-8f8b-61c7e5c90c15 req-9f8d4a3f-4268-4896-8c0d-23c387b36499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d68fecc-af78-4f6a-8c43-ccbe07c9d226", "tag": "500581c3-9ffa-417f-b033-c633de3117c2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:57:04.123865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f9d998c8-b3cf-4c0a-8f8b-61c7e5c90c15 req-9f8d4a3f-4268-4896-8c0d-23c387b36499 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:04.124349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f9d998c8-b3cf-4c0a-8f8b-61c7e5c90c15 req-9f8d4a3f-4268-4896-8c0d-23c387b36499 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:04.125131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-f9d998c8-b3cf-4c0a-8f8b-61c7e5c90c15 req-9f8d4a3f-4268-4896-8c0d-23c387b36499 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:04.136903 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-f9d998c8-b3cf-4c0a-8f8b-61c7e5c90c15 req-9f8d4a3f-4268-4896-8c0d-23c387b36499 service nova] Creating event network-changed:500581c3-9ffa-417f-b033-c633de3117c2 for instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 on n-h2-820368-35 Aug 27 05:57:04.142776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-f9d998c8-b3cf-4c0a-8f8b-61c7e5c90c15 req-9f8d4a3f-4268-4896-8c0d-23c387b36499 service nova] Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:57:04.155034 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-f9d998c8-b3cf-4c0a-8f8b-61c7e5c90c15 req-9f8d4a3f-4268-4896-8c0d-23c387b36499 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045443 Aug 27 05:57:04.155657 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3743/7492] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:57:04.762242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e82cdbe0-3c24-498c-9597-a3d5968aafe8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:04.762662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e82cdbe0-3c24-498c-9597-a3d5968aafe8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:04.770925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e82cdbe0-3c24-498c-9597-a3d5968aafe8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:04.772152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e82cdbe0-3c24-498c-9597-a3d5968aafe8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:04.772693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e82cdbe0-3c24-498c-9597-a3d5968aafe8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:04.773480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e82cdbe0-3c24-498c-9597-a3d5968aafe8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:04.773949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e82cdbe0-3c24-498c-9597-a3d5968aafe8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:04.774387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e82cdbe0-3c24-498c-9597-a3d5968aafe8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:04.908940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e82cdbe0-3c24-498c-9597-a3d5968aafe8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:04.918308 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e82cdbe0-3c24-498c-9597-a3d5968aafe8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.160415 Aug 27 05:57:04.918901 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3750/7493] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:04 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:05.940381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-20ac33e8-3f15-42cf-9954-92db71d213a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:05.941091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-20ac33e8-3f15-42cf-9954-92db71d213a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:05.944511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=29 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:05.949900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20ac33e8-3f15-42cf-9954-92db71d213a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:05.950396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20ac33e8-3f15-42cf-9954-92db71d213a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:05.950847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20ac33e8-3f15-42cf-9954-92db71d213a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:05.951586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20ac33e8-3f15-42cf-9954-92db71d213a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:05.952052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20ac33e8-3f15-42cf-9954-92db71d213a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:05.952488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-20ac33e8-3f15-42cf-9954-92db71d213a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:05.955268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=83 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:06.086498 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-20ac33e8-3f15-42cf-9954-92db71d213a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:06.095007 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-20ac33e8-3f15-42cf-9954-92db71d213a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.158798 Aug 27 05:57:06.095616 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3744/7494] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:05 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:07.116088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0362ac88-0525-492b-8604-ce19b70baa10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:07.116717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0362ac88-0525-492b-8604-ce19b70baa10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:07.119564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=35 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:07.125025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0362ac88-0525-492b-8604-ce19b70baa10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:07.125516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0362ac88-0525-492b-8604-ce19b70baa10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:07.125958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0362ac88-0525-492b-8604-ce19b70baa10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:07.126663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0362ac88-0525-492b-8604-ce19b70baa10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:07.127139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0362ac88-0525-492b-8604-ce19b70baa10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:07.127574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0362ac88-0525-492b-8604-ce19b70baa10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:07.130199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:07.264829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0362ac88-0525-492b-8604-ce19b70baa10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:07.273217 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0362ac88-0525-492b-8604-ce19b70baa10 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.161099 Aug 27 05:57:07.273791 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3751/7495] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:07 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:08.295578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-691aef99-702e-4155-9995-e17cbc9686d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:08.296235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-691aef99-702e-4155-9995-e17cbc9686d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:08.303108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691aef99-702e-4155-9995-e17cbc9686d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:08.303627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691aef99-702e-4155-9995-e17cbc9686d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:08.304077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691aef99-702e-4155-9995-e17cbc9686d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:08.304788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691aef99-702e-4155-9995-e17cbc9686d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:08.305258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691aef99-702e-4155-9995-e17cbc9686d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:08.305695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-691aef99-702e-4155-9995-e17cbc9686d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:08.435912 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-691aef99-702e-4155-9995-e17cbc9686d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:08.444168 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-691aef99-702e-4155-9995-e17cbc9686d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.152959 Aug 27 05:57:08.444740 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3745/7496] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:08 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:09.466178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5dfbf60a-9781-4941-b914-3b3a591fdf24 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:09.466954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5dfbf60a-9781-4941-b914-3b3a591fdf24 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:09.474206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfbf60a-9781-4941-b914-3b3a591fdf24 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:09.474708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfbf60a-9781-4941-b914-3b3a591fdf24 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:09.475175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfbf60a-9781-4941-b914-3b3a591fdf24 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:09.476545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfbf60a-9781-4941-b914-3b3a591fdf24 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:09.477006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfbf60a-9781-4941-b914-3b3a591fdf24 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:09.477436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5dfbf60a-9781-4941-b914-3b3a591fdf24 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:09.612836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5dfbf60a-9781-4941-b914-3b3a591fdf24 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:09.621667 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5dfbf60a-9781-4941-b914-3b3a591fdf24 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.159768 Aug 27 05:57:09.622248 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3752/7497] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:09 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:10.642149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a8f7f16a-0bba-4700-bac8-3dc80b8f7941 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:10.642756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a8f7f16a-0bba-4700-bac8-3dc80b8f7941 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:10.650223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f7f16a-0bba-4700-bac8-3dc80b8f7941 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:10.650714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f7f16a-0bba-4700-bac8-3dc80b8f7941 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:10.651194 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f7f16a-0bba-4700-bac8-3dc80b8f7941 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:10.651893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f7f16a-0bba-4700-bac8-3dc80b8f7941 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:10.652358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f7f16a-0bba-4700-bac8-3dc80b8f7941 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:10.652793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a8f7f16a-0bba-4700-bac8-3dc80b8f7941 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:10.783649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a8f7f16a-0bba-4700-bac8-3dc80b8f7941 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:10.792638 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a8f7f16a-0bba-4700-bac8-3dc80b8f7941 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.154649 Aug 27 05:57:10.793221 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3746/7498] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:10 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:11.814086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af1e9db2-6f8e-4277-867b-55dafff91093 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:11.814698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-af1e9db2-6f8e-4277-867b-55dafff91093 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:11.822015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e9db2-6f8e-4277-867b-55dafff91093 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:11.822490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e9db2-6f8e-4277-867b-55dafff91093 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:11.822955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e9db2-6f8e-4277-867b-55dafff91093 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:11.823665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e9db2-6f8e-4277-867b-55dafff91093 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:11.824116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e9db2-6f8e-4277-867b-55dafff91093 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:11.824544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1e9db2-6f8e-4277-867b-55dafff91093 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:11.953913 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af1e9db2-6f8e-4277-867b-55dafff91093 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:11.962195 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af1e9db2-6f8e-4277-867b-55dafff91093 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.152012 Aug 27 05:57:11.962772 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3753/7499] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:11 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:57:12.984391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf9df855-4512-4be9-917a-1549cb579fec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:12.985009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf9df855-4512-4be9-917a-1549cb579fec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:12.992205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf9df855-4512-4be9-917a-1549cb579fec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:12.992732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf9df855-4512-4be9-917a-1549cb579fec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:12.993181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf9df855-4512-4be9-917a-1549cb579fec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:12.994731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf9df855-4512-4be9-917a-1549cb579fec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:12.995267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf9df855-4512-4be9-917a-1549cb579fec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:12.995706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf9df855-4512-4be9-917a-1549cb579fec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:13.126880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bf9df855-4512-4be9-917a-1549cb579fec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:13.136800 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf9df855-4512-4be9-917a-1549cb579fec tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.156580 Aug 27 05:57:13.137395 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3747/7500] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:12 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:14.158421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b6c9374-2251-4430-870c-49d5493503d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:14.159055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2b6c9374-2251-4430-870c-49d5493503d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:14.166476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b6c9374-2251-4430-870c-49d5493503d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:14.166967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b6c9374-2251-4430-870c-49d5493503d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:14.167449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b6c9374-2251-4430-870c-49d5493503d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:14.168153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b6c9374-2251-4430-870c-49d5493503d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:14.168612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b6c9374-2251-4430-870c-49d5493503d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:14.169044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b6c9374-2251-4430-870c-49d5493503d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:14.299849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2b6c9374-2251-4430-870c-49d5493503d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:14.308137 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2b6c9374-2251-4430-870c-49d5493503d5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.153812 Aug 27 05:57:14.308721 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3754/7501] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:14 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:15.329103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a5eb231a-c910-4ba9-b0ae-e70d208c8b16 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:15.329738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a5eb231a-c910-4ba9-b0ae-e70d208c8b16 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:15.337172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5eb231a-c910-4ba9-b0ae-e70d208c8b16 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:15.337603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5eb231a-c910-4ba9-b0ae-e70d208c8b16 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:15.338064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5eb231a-c910-4ba9-b0ae-e70d208c8b16 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:15.338780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5eb231a-c910-4ba9-b0ae-e70d208c8b16 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:15.339298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5eb231a-c910-4ba9-b0ae-e70d208c8b16 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:15.339740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a5eb231a-c910-4ba9-b0ae-e70d208c8b16 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:15.471868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a5eb231a-c910-4ba9-b0ae-e70d208c8b16 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:15.480740 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a5eb231a-c910-4ba9-b0ae-e70d208c8b16 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.155620 Aug 27 05:57:15.481315 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3748/7502] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:15 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:16.501886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8826eec3-1b24-4043-8f02-644df01cab6e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:16.502501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8826eec3-1b24-4043-8f02-644df01cab6e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:16.509983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8826eec3-1b24-4043-8f02-644df01cab6e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:16.510472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8826eec3-1b24-4043-8f02-644df01cab6e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:16.510910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8826eec3-1b24-4043-8f02-644df01cab6e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:16.511632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8826eec3-1b24-4043-8f02-644df01cab6e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:16.512087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8826eec3-1b24-4043-8f02-644df01cab6e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:16.512514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8826eec3-1b24-4043-8f02-644df01cab6e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:16.642798 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8826eec3-1b24-4043-8f02-644df01cab6e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:16.652966 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8826eec3-1b24-4043-8f02-644df01cab6e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1722 microversion: 2.1 time: 0.154824 Aug 27 05:57:16.653660 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3755/7503] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:16 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:17.675314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ee76bac8-a815-4f89-b560-7ca945658b04 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:17.675957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ee76bac8-a815-4f89-b560-7ca945658b04 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:17.683213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee76bac8-a815-4f89-b560-7ca945658b04 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:17.683721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee76bac8-a815-4f89-b560-7ca945658b04 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:17.685069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee76bac8-a815-4f89-b560-7ca945658b04 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:17.685069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee76bac8-a815-4f89-b560-7ca945658b04 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:17.685347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee76bac8-a815-4f89-b560-7ca945658b04 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:17.685790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ee76bac8-a815-4f89-b560-7ca945658b04 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:17.819611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ee76bac8-a815-4f89-b560-7ca945658b04 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:17.827728 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ee76bac8-a815-4f89-b560-7ca945658b04 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1719 microversion: 2.1 time: 0.156396 Aug 27 05:57:17.828326 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3749/7504] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:17 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:17.848631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:57:17.849300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:17.856065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:17.856547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:17.856990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:17.857684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:17.858132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:17.858557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:17.894929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:17.895423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:17.895851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:17.896559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:17.897010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:17.898109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:17.918062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:57:17.923488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Getting quotas for user ffa36ffb13d74ef5a9cb4385917dcd05 and project ad6afd2bed754b7797850547b3ac6ee7. Resources: {'cores', 'ram'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:57:18.024217 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6fda0107-730d-45c3-8435-f34a13fc74f8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "POST /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/action" status: 202 len: 0 microversion: 2.1 time: 0.179483 Aug 27 05:57:18.024828 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3756/7505] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:57:17 2022] POST /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:57:18.033523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0cd98108-6c69-4106-89af-ad72d2b100b6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:18.034169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0cd98108-6c69-4106-89af-ad72d2b100b6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:18.040698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cd98108-6c69-4106-89af-ad72d2b100b6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:18.041205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cd98108-6c69-4106-89af-ad72d2b100b6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:18.041668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cd98108-6c69-4106-89af-ad72d2b100b6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:18.042391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cd98108-6c69-4106-89af-ad72d2b100b6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:18.042889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cd98108-6c69-4106-89af-ad72d2b100b6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:18.043405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0cd98108-6c69-4106-89af-ad72d2b100b6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:18.178683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0cd98108-6c69-4106-89af-ad72d2b100b6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:18.187003 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0cd98108-6c69-4106-89af-ad72d2b100b6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.157754 Aug 27 05:57:18.187609 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3750/7506] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:18 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:19.211277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3461cf67-d64a-45cd-a295-fa72918a712f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:19.212054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3461cf67-d64a-45cd-a295-fa72918a712f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:19.219566 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3461cf67-d64a-45cd-a295-fa72918a712f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:19.220053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3461cf67-d64a-45cd-a295-fa72918a712f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:19.220493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3461cf67-d64a-45cd-a295-fa72918a712f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:19.221194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3461cf67-d64a-45cd-a295-fa72918a712f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:19.221650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3461cf67-d64a-45cd-a295-fa72918a712f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:19.222079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3461cf67-d64a-45cd-a295-fa72918a712f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:19.356960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3461cf67-d64a-45cd-a295-fa72918a712f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:19.365337 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3461cf67-d64a-45cd-a295-fa72918a712f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.159687 Aug 27 05:57:19.366552 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3757/7507] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:19 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:20.386279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-efd6e428-d7ab-4578-be03-07984766687c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:20.386948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-efd6e428-d7ab-4578-be03-07984766687c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:20.394105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efd6e428-d7ab-4578-be03-07984766687c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:20.394610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efd6e428-d7ab-4578-be03-07984766687c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:20.395072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efd6e428-d7ab-4578-be03-07984766687c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:20.395820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efd6e428-d7ab-4578-be03-07984766687c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:20.396295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efd6e428-d7ab-4578-be03-07984766687c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:20.396741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efd6e428-d7ab-4578-be03-07984766687c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:20.536018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-efd6e428-d7ab-4578-be03-07984766687c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:20.545246 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-efd6e428-d7ab-4578-be03-07984766687c tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.162631 Aug 27 05:57:20.545830 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3751/7508] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:20 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:21.572968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d629b135-d710-4792-b38c-2287177e1ece tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:21.573513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d629b135-d710-4792-b38c-2287177e1ece tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:21.580764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d629b135-d710-4792-b38c-2287177e1ece tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:21.581251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d629b135-d710-4792-b38c-2287177e1ece tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:21.581874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d629b135-d710-4792-b38c-2287177e1ece tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:21.582588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d629b135-d710-4792-b38c-2287177e1ece tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:21.583054 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d629b135-d710-4792-b38c-2287177e1ece tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:21.583508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d629b135-d710-4792-b38c-2287177e1ece tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:21.719325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d629b135-d710-4792-b38c-2287177e1ece tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:21.727867 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d629b135-d710-4792-b38c-2287177e1ece tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.159807 Aug 27 05:57:21.728443 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3758/7509] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:21 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:22.749072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0ee90a21-d38a-48ac-b3bf-f3b369dcb10e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:22.749721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0ee90a21-d38a-48ac-b3bf-f3b369dcb10e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:22.757024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ee90a21-d38a-48ac-b3bf-f3b369dcb10e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:22.757529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ee90a21-d38a-48ac-b3bf-f3b369dcb10e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:22.757987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ee90a21-d38a-48ac-b3bf-f3b369dcb10e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:22.758700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ee90a21-d38a-48ac-b3bf-f3b369dcb10e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:22.759205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ee90a21-d38a-48ac-b3bf-f3b369dcb10e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:22.759650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ee90a21-d38a-48ac-b3bf-f3b369dcb10e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:22.931497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0ee90a21-d38a-48ac-b3bf-f3b369dcb10e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:22.940180 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0ee90a21-d38a-48ac-b3bf-f3b369dcb10e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.195013 Aug 27 05:57:22.940693 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3752/7510] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:22 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:23.961147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a06264f5-14df-41d0-98f7-8b6701cc0d34 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:23.962229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a06264f5-14df-41d0-98f7-8b6701cc0d34 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:23.971391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a06264f5-14df-41d0-98f7-8b6701cc0d34 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:23.972225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a06264f5-14df-41d0-98f7-8b6701cc0d34 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:23.972849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a06264f5-14df-41d0-98f7-8b6701cc0d34 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:23.973638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a06264f5-14df-41d0-98f7-8b6701cc0d34 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:23.974224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a06264f5-14df-41d0-98f7-8b6701cc0d34 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:23.974753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a06264f5-14df-41d0-98f7-8b6701cc0d34 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:24.004589 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-34bd9e75-4666-4bce-9d17-fa7b33dcd9b7 req-0cdcf1d1-80da-43c3-b389-c88413a9bcaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d68fecc-af78-4f6a-8c43-ccbe07c9d226", "tag": "500581c3-9ffa-417f-b033-c633de3117c2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:57:24.015558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-34bd9e75-4666-4bce-9d17-fa7b33dcd9b7 req-0cdcf1d1-80da-43c3-b389-c88413a9bcaa service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:24.016120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-34bd9e75-4666-4bce-9d17-fa7b33dcd9b7 req-0cdcf1d1-80da-43c3-b389-c88413a9bcaa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:24.016630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-34bd9e75-4666-4bce-9d17-fa7b33dcd9b7 req-0cdcf1d1-80da-43c3-b389-c88413a9bcaa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:24.032295 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-34bd9e75-4666-4bce-9d17-fa7b33dcd9b7 req-0cdcf1d1-80da-43c3-b389-c88413a9bcaa service nova] Creating event network-changed:500581c3-9ffa-417f-b033-c633de3117c2 for instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 on n-h1-820368-35 Aug 27 05:57:24.038498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-34bd9e75-4666-4bce-9d17-fa7b33dcd9b7 req-0cdcf1d1-80da-43c3-b389-c88413a9bcaa service nova] Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:57:24.050086 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-34bd9e75-4666-4bce-9d17-fa7b33dcd9b7 req-0cdcf1d1-80da-43c3-b389-c88413a9bcaa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109521 Aug 27 05:57:24.050625 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3759/7511] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:57:24.202036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a06264f5-14df-41d0-98f7-8b6701cc0d34 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:24.211293 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a06264f5-14df-41d0-98f7-8b6701cc0d34 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.254121 Aug 27 05:57:24.212096 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3753/7512] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:23 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:57:25.234842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-45b7841f-41bb-4656-8a08-7e66f0ecf76f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:25.235578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-45b7841f-41bb-4656-8a08-7e66f0ecf76f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:25.242729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b7841f-41bb-4656-8a08-7e66f0ecf76f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:25.243261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b7841f-41bb-4656-8a08-7e66f0ecf76f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:25.243696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b7841f-41bb-4656-8a08-7e66f0ecf76f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:25.244397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b7841f-41bb-4656-8a08-7e66f0ecf76f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:25.244844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b7841f-41bb-4656-8a08-7e66f0ecf76f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:25.245268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b7841f-41bb-4656-8a08-7e66f0ecf76f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:25.392966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45b7841f-41bb-4656-8a08-7e66f0ecf76f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:25.401375 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-45b7841f-41bb-4656-8a08-7e66f0ecf76f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.172184 Aug 27 05:57:25.401950 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3760/7513] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:25 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:26.423852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f4037b0e-bd08-4292-a7bd-8fbaff53118a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:26.424516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f4037b0e-bd08-4292-a7bd-8fbaff53118a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:26.431327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4037b0e-bd08-4292-a7bd-8fbaff53118a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:26.431833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4037b0e-bd08-4292-a7bd-8fbaff53118a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:26.432287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4037b0e-bd08-4292-a7bd-8fbaff53118a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:26.433003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4037b0e-bd08-4292-a7bd-8fbaff53118a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:26.433473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4037b0e-bd08-4292-a7bd-8fbaff53118a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:26.433920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f4037b0e-bd08-4292-a7bd-8fbaff53118a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:26.569004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f4037b0e-bd08-4292-a7bd-8fbaff53118a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:26.577381 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f4037b0e-bd08-4292-a7bd-8fbaff53118a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.157851 Aug 27 05:57:26.577969 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3754/7514] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:26 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:27.599427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3eb0873-799d-49a5-a36a-a692e8aefc5a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:27.600126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a3eb0873-799d-49a5-a36a-a692e8aefc5a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:27.607184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3eb0873-799d-49a5-a36a-a692e8aefc5a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:27.607689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3eb0873-799d-49a5-a36a-a692e8aefc5a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:27.608134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3eb0873-799d-49a5-a36a-a692e8aefc5a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:27.609225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3eb0873-799d-49a5-a36a-a692e8aefc5a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:27.609322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3eb0873-799d-49a5-a36a-a692e8aefc5a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:27.609728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3eb0873-799d-49a5-a36a-a692e8aefc5a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:27.753055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a3eb0873-799d-49a5-a36a-a692e8aefc5a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:27.761944 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a3eb0873-799d-49a5-a36a-a692e8aefc5a tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.166514 Aug 27 05:57:27.762625 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3761/7515] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:27 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:28.784626 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-58345a8d-36cb-488f-a7d3-3b0f5d10c1d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:28.785292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-58345a8d-36cb-488f-a7d3-3b0f5d10c1d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:28.792467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58345a8d-36cb-488f-a7d3-3b0f5d10c1d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:28.792965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58345a8d-36cb-488f-a7d3-3b0f5d10c1d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:28.793421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58345a8d-36cb-488f-a7d3-3b0f5d10c1d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:28.794141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58345a8d-36cb-488f-a7d3-3b0f5d10c1d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:28.794614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58345a8d-36cb-488f-a7d3-3b0f5d10c1d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:28.795054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58345a8d-36cb-488f-a7d3-3b0f5d10c1d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:28.926541 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-58345a8d-36cb-488f-a7d3-3b0f5d10c1d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:28.935594 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-58345a8d-36cb-488f-a7d3-3b0f5d10c1d4 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.154929 Aug 27 05:57:28.936417 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3755/7516] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:28 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:29.958072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2682ee39-9dc7-49c9-bba8-b8c3fb8a4b38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:29.958715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2682ee39-9dc7-49c9-bba8-b8c3fb8a4b38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:29.960769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:29.966411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2682ee39-9dc7-49c9-bba8-b8c3fb8a4b38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:29.966896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2682ee39-9dc7-49c9-bba8-b8c3fb8a4b38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:29.967401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2682ee39-9dc7-49c9-bba8-b8c3fb8a4b38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:29.968098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2682ee39-9dc7-49c9-bba8-b8c3fb8a4b38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:29.968560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2682ee39-9dc7-49c9-bba8-b8c3fb8a4b38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:29.968984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2682ee39-9dc7-49c9-bba8-b8c3fb8a4b38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:30.097038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2682ee39-9dc7-49c9-bba8-b8c3fb8a4b38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:30.105926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2682ee39-9dc7-49c9-bba8-b8c3fb8a4b38 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.151973 Aug 27 05:57:30.106664 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3762/7517] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:29 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:31.127426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68c70382-9e02-446f-b730-8cb114931d07 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:31.128196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68c70382-9e02-446f-b730-8cb114931d07 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:31.134962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c70382-9e02-446f-b730-8cb114931d07 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:31.135501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c70382-9e02-446f-b730-8cb114931d07 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:31.135961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c70382-9e02-446f-b730-8cb114931d07 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:31.136685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c70382-9e02-446f-b730-8cb114931d07 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:31.137161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c70382-9e02-446f-b730-8cb114931d07 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:31.137608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68c70382-9e02-446f-b730-8cb114931d07 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:31.272496 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68c70382-9e02-446f-b730-8cb114931d07 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:31.281116 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68c70382-9e02-446f-b730-8cb114931d07 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.157611 Aug 27 05:57:31.281690 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3756/7518] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:31 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:32.302501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e150b574-6b6c-4532-88c9-5c01bad50647 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:32.303795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e150b574-6b6c-4532-88c9-5c01bad50647 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:32.310692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e150b574-6b6c-4532-88c9-5c01bad50647 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:32.311212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e150b574-6b6c-4532-88c9-5c01bad50647 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:32.311654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e150b574-6b6c-4532-88c9-5c01bad50647 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:32.312352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e150b574-6b6c-4532-88c9-5c01bad50647 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:32.312809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e150b574-6b6c-4532-88c9-5c01bad50647 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:32.313240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e150b574-6b6c-4532-88c9-5c01bad50647 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:32.442360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e150b574-6b6c-4532-88c9-5c01bad50647 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:32.450776 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e150b574-6b6c-4532-88c9-5c01bad50647 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.152194 Aug 27 05:57:32.451387 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3763/7519] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:32 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:33.472698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7ec143f3-885e-4182-a300-aafbaf4578b8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:33.473325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7ec143f3-885e-4182-a300-aafbaf4578b8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:33.480823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ec143f3-885e-4182-a300-aafbaf4578b8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:33.481351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ec143f3-885e-4182-a300-aafbaf4578b8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:33.481843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ec143f3-885e-4182-a300-aafbaf4578b8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:33.482551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ec143f3-885e-4182-a300-aafbaf4578b8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:33.483022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ec143f3-885e-4182-a300-aafbaf4578b8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:33.483504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7ec143f3-885e-4182-a300-aafbaf4578b8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:33.618606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7ec143f3-885e-4182-a300-aafbaf4578b8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:33.626901 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7ec143f3-885e-4182-a300-aafbaf4578b8 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.158160 Aug 27 05:57:33.627501 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3757/7520] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:33 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:34.649065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-38d7235a-0604-4a82-b5f0-39627304da5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:34.649765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-38d7235a-0604-4a82-b5f0-39627304da5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:34.656843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d7235a-0604-4a82-b5f0-39627304da5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:34.657326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d7235a-0604-4a82-b5f0-39627304da5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:34.657762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d7235a-0604-4a82-b5f0-39627304da5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:34.658453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d7235a-0604-4a82-b5f0-39627304da5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:34.658907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d7235a-0604-4a82-b5f0-39627304da5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:34.659364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-38d7235a-0604-4a82-b5f0-39627304da5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:34.790076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-38d7235a-0604-4a82-b5f0-39627304da5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:34.798632 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-38d7235a-0604-4a82-b5f0-39627304da5d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.153918 Aug 27 05:57:34.799249 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3764/7521] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:34 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:35.820313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec6785a4-7c2a-422d-98ec-ab7150ccf97e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:35.820942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec6785a4-7c2a-422d-98ec-ab7150ccf97e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:35.828058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec6785a4-7c2a-422d-98ec-ab7150ccf97e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:35.828552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec6785a4-7c2a-422d-98ec-ab7150ccf97e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:35.828999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec6785a4-7c2a-422d-98ec-ab7150ccf97e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:35.829701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec6785a4-7c2a-422d-98ec-ab7150ccf97e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:35.830169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec6785a4-7c2a-422d-98ec-ab7150ccf97e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:35.830605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec6785a4-7c2a-422d-98ec-ab7150ccf97e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:35.964426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ec6785a4-7c2a-422d-98ec-ab7150ccf97e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:35.966784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=88 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:35.973862 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec6785a4-7c2a-422d-98ec-ab7150ccf97e tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.157495 Aug 27 05:57:35.974438 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3758/7522] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:35 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:36.995434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-768f84d2-922d-4657-a23d-16f5c3e6a640 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:36.996035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-768f84d2-922d-4657-a23d-16f5c3e6a640 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:37.003605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-768f84d2-922d-4657-a23d-16f5c3e6a640 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:37.004106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-768f84d2-922d-4657-a23d-16f5c3e6a640 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:37.004580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-768f84d2-922d-4657-a23d-16f5c3e6a640 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:37.005327 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-768f84d2-922d-4657-a23d-16f5c3e6a640 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:37.005787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-768f84d2-922d-4657-a23d-16f5c3e6a640 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:37.006220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-768f84d2-922d-4657-a23d-16f5c3e6a640 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:37.011483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:37.138680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-768f84d2-922d-4657-a23d-16f5c3e6a640 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:37.147630 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-768f84d2-922d-4657-a23d-16f5c3e6a640 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.156183 Aug 27 05:57:37.148221 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3765/7523] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:36 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:38.169494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b638bfe6-ced9-4918-8b67-31fb24c212a5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:38.170123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b638bfe6-ced9-4918-8b67-31fb24c212a5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:38.173165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=30 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:38.179038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b638bfe6-ced9-4918-8b67-31fb24c212a5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:38.179569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b638bfe6-ced9-4918-8b67-31fb24c212a5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:38.180032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b638bfe6-ced9-4918-8b67-31fb24c212a5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:38.180752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b638bfe6-ced9-4918-8b67-31fb24c212a5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:38.181227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b638bfe6-ced9-4918-8b67-31fb24c212a5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:38.181669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b638bfe6-ced9-4918-8b67-31fb24c212a5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:38.319407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b638bfe6-ced9-4918-8b67-31fb24c212a5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:38.329030 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b638bfe6-ced9-4918-8b67-31fb24c212a5 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1718 microversion: 2.1 time: 0.163396 Aug 27 05:57:38.329844 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3759/7524] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:38 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:39.352453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f829d06-e617-4b8b-8080-1776d2bf25a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:39.353026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f829d06-e617-4b8b-8080-1776d2bf25a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:39.355731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:39.361205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f829d06-e617-4b8b-8080-1776d2bf25a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:39.361692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f829d06-e617-4b8b-8080-1776d2bf25a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:39.362131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f829d06-e617-4b8b-8080-1776d2bf25a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:39.362827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f829d06-e617-4b8b-8080-1776d2bf25a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:39.363317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f829d06-e617-4b8b-8080-1776d2bf25a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:39.363748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f829d06-e617-4b8b-8080-1776d2bf25a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:39.498989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f829d06-e617-4b8b-8080-1776d2bf25a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:39.507822 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f829d06-e617-4b8b-8080-1776d2bf25a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1711 microversion: 2.1 time: 0.160091 Aug 27 05:57:39.508397 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3766/7525] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:39 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:39.528332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2da02ded-e00e-4918-88c3-ca57ccf81255 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:39.528936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2da02ded-e00e-4918-88c3-ca57ccf81255 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:39.535678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da02ded-e00e-4918-88c3-ca57ccf81255 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:39.536175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da02ded-e00e-4918-88c3-ca57ccf81255 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:39.536621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da02ded-e00e-4918-88c3-ca57ccf81255 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:39.537320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da02ded-e00e-4918-88c3-ca57ccf81255 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:39.537784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da02ded-e00e-4918-88c3-ca57ccf81255 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:39.538228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2da02ded-e00e-4918-88c3-ca57ccf81255 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:39.667198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2da02ded-e00e-4918-88c3-ca57ccf81255 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:39.675771 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2da02ded-e00e-4918-88c3-ca57ccf81255 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1711 microversion: 2.1 time: 0.151309 Aug 27 05:57:39.676351 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3760/7526] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:39 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1711 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:39.697229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6eccc893-c92f-4c62-bf22-cffde29b6534 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:39.697841 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6eccc893-c92f-4c62-bf22-cffde29b6534 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:39.704222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6eccc893-c92f-4c62-bf22-cffde29b6534 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:39.704710 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6eccc893-c92f-4c62-bf22-cffde29b6534 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:39.705150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6eccc893-c92f-4c62-bf22-cffde29b6534 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:39.705842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6eccc893-c92f-4c62-bf22-cffde29b6534 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:39.706298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6eccc893-c92f-4c62-bf22-cffde29b6534 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:39.706728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6eccc893-c92f-4c62-bf22-cffde29b6534 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:39.851545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6eccc893-c92f-4c62-bf22-cffde29b6534 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:39.861086 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6eccc893-c92f-4c62-bf22-cffde29b6534 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1711 microversion: 2.1 time: 0.167344 Aug 27 05:57:39.861086 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3767/7527] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:39 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1711 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:39.881155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e82aab83-508b-42ff-828d-ee5a315bbbaf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:39.881607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e82aab83-508b-42ff-828d-ee5a315bbbaf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:39.887804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82aab83-508b-42ff-828d-ee5a315bbbaf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:39.888195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82aab83-508b-42ff-828d-ee5a315bbbaf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:39.888642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82aab83-508b-42ff-828d-ee5a315bbbaf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:39.889348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82aab83-508b-42ff-828d-ee5a315bbbaf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:39.889814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82aab83-508b-42ff-828d-ee5a315bbbaf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:39.890255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e82aab83-508b-42ff-828d-ee5a315bbbaf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:39.915832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e82aab83-508b-42ff-828d-ee5a315bbbaf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:57:39.992789 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e82aab83-508b-42ff-828d-ee5a315bbbaf tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 204 len: 0 microversion: 2.1 time: 0.115310 Aug 27 05:57:39.993390 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3761/7528] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:57:39 2022] DELETE /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:57:40.001758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a1a1fd1d-d419-4abe-870d-49caf2437572 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:40.002385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a1a1fd1d-d419-4abe-870d-49caf2437572 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:40.008545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a1fd1d-d419-4abe-870d-49caf2437572 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:40.009036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a1fd1d-d419-4abe-870d-49caf2437572 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:40.009472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a1fd1d-d419-4abe-870d-49caf2437572 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:40.010171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a1fd1d-d419-4abe-870d-49caf2437572 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:40.010628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a1fd1d-d419-4abe-870d-49caf2437572 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:40.011062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a1a1fd1d-d419-4abe-870d-49caf2437572 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:40.140374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a1a1fd1d-d419-4abe-870d-49caf2437572 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:40.149034 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a1a1fd1d-d419-4abe-870d-49caf2437572 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1717 microversion: 2.1 time: 0.151157 Aug 27 05:57:40.149604 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3768/7529] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:39 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:57:40.657437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b6d1c5fc-a706-4f30-b423-0dafa8d99228 req-1fa9ba7b-43d6-486e-80d7-40dfe2dc329f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d68fecc-af78-4f6a-8c43-ccbe07c9d226", "name": "network-vif-plugged", "status": "completed", "tag": "500581c3-9ffa-417f-b033-c633de3117c2"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:57:40.668548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b6d1c5fc-a706-4f30-b423-0dafa8d99228 req-1fa9ba7b-43d6-486e-80d7-40dfe2dc329f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:40.669042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b6d1c5fc-a706-4f30-b423-0dafa8d99228 req-1fa9ba7b-43d6-486e-80d7-40dfe2dc329f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:40.669487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b6d1c5fc-a706-4f30-b423-0dafa8d99228 req-1fa9ba7b-43d6-486e-80d7-40dfe2dc329f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:40.681335 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b6d1c5fc-a706-4f30-b423-0dafa8d99228 req-1fa9ba7b-43d6-486e-80d7-40dfe2dc329f service nova] Creating event network-vif-plugged:500581c3-9ffa-417f-b033-c633de3117c2 for instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 on n-h1-820368-35 Aug 27 05:57:40.686151 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b6d1c5fc-a706-4f30-b423-0dafa8d99228 req-1fa9ba7b-43d6-486e-80d7-40dfe2dc329f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085696 Aug 27 05:57:40.686751 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3762/7530] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:57:41.172958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-36c7e916-bcf9-4e39-b51e-ee1f13d6db40 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:41.173568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-36c7e916-bcf9-4e39-b51e-ee1f13d6db40 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:41.180908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36c7e916-bcf9-4e39-b51e-ee1f13d6db40 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:41.181391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36c7e916-bcf9-4e39-b51e-ee1f13d6db40 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:41.181826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36c7e916-bcf9-4e39-b51e-ee1f13d6db40 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:41.182521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36c7e916-bcf9-4e39-b51e-ee1f13d6db40 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:41.182975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36c7e916-bcf9-4e39-b51e-ee1f13d6db40 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:41.183424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-36c7e916-bcf9-4e39-b51e-ee1f13d6db40 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:41.314759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-36c7e916-bcf9-4e39-b51e-ee1f13d6db40 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:41.323218 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-36c7e916-bcf9-4e39-b51e-ee1f13d6db40 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1717 microversion: 2.1 time: 0.155569 Aug 27 05:57:41.323791 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3769/7531] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:41 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:42.347038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ff162375-4221-4022-8a10-1c432bff17c6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:42.347785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ff162375-4221-4022-8a10-1c432bff17c6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:42.354593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff162375-4221-4022-8a10-1c432bff17c6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:42.355113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff162375-4221-4022-8a10-1c432bff17c6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:42.355644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff162375-4221-4022-8a10-1c432bff17c6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:42.356369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff162375-4221-4022-8a10-1c432bff17c6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:42.356843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff162375-4221-4022-8a10-1c432bff17c6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:42.357291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ff162375-4221-4022-8a10-1c432bff17c6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:42.571949 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ff162375-4221-4022-8a10-1c432bff17c6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:42.580374 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ff162375-4221-4022-8a10-1c432bff17c6 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1717 microversion: 2.1 time: 0.238538 Aug 27 05:57:42.580959 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3763/7532] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:42 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1717 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:42.907120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-69dce589-ec18-4efb-bf8e-6b14e1f69d60 req-40ccad37-b506-4aeb-9722-46c79a815534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d68fecc-af78-4f6a-8c43-ccbe07c9d226", "name": "network-vif-deleted", "tag": "500581c3-9ffa-417f-b033-c633de3117c2"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:57:42.921960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-69dce589-ec18-4efb-bf8e-6b14e1f69d60 req-40ccad37-b506-4aeb-9722-46c79a815534 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:42.922526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-69dce589-ec18-4efb-bf8e-6b14e1f69d60 req-40ccad37-b506-4aeb-9722-46c79a815534 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:42.922998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-69dce589-ec18-4efb-bf8e-6b14e1f69d60 req-40ccad37-b506-4aeb-9722-46c79a815534 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:42.937024 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-69dce589-ec18-4efb-bf8e-6b14e1f69d60 req-40ccad37-b506-4aeb-9722-46c79a815534 service nova] Creating event network-vif-deleted:500581c3-9ffa-417f-b033-c633de3117c2 for instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 on n-h1-820368-35 Aug 27 05:57:42.944246 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-69dce589-ec18-4efb-bf8e-6b14e1f69d60 req-40ccad37-b506-4aeb-9722-46c79a815534 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040104 Aug 27 05:57:42.944897 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3770/7533] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:57:43.602649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d14c7819-e319-4e92-9dc6-0092ef8d3c91 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:43.603620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d14c7819-e319-4e92-9dc6-0092ef8d3c91 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:43.610774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d14c7819-e319-4e92-9dc6-0092ef8d3c91 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:43.611370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d14c7819-e319-4e92-9dc6-0092ef8d3c91 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:43.611831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d14c7819-e319-4e92-9dc6-0092ef8d3c91 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:43.612560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d14c7819-e319-4e92-9dc6-0092ef8d3c91 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:43.613035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d14c7819-e319-4e92-9dc6-0092ef8d3c91 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:43.613482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d14c7819-e319-4e92-9dc6-0092ef8d3c91 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:43.688212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d14c7819-e319-4e92-9dc6-0092ef8d3c91 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:43.697614 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d14c7819-e319-4e92-9dc6-0092ef8d3c91 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1366 microversion: 2.1 time: 0.099527 Aug 27 05:57:43.698216 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3764/7534] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:43 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:44.719123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-032ec006-05ff-4a5d-9e8e-e22b7d83041f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:44.719859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-032ec006-05ff-4a5d-9e8e-e22b7d83041f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:44.727658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-032ec006-05ff-4a5d-9e8e-e22b7d83041f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:44.728142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-032ec006-05ff-4a5d-9e8e-e22b7d83041f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:44.728577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-032ec006-05ff-4a5d-9e8e-e22b7d83041f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:44.729268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-032ec006-05ff-4a5d-9e8e-e22b7d83041f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:44.729721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-032ec006-05ff-4a5d-9e8e-e22b7d83041f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:44.730151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-032ec006-05ff-4a5d-9e8e-e22b7d83041f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:44.793715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-032ec006-05ff-4a5d-9e8e-e22b7d83041f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:44.802456 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-032ec006-05ff-4a5d-9e8e-e22b7d83041f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1366 microversion: 2.1 time: 0.087566 Aug 27 05:57:44.815109 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3771/7535] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:44 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:45.825948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f433cb60-9872-4116-b3f9-c7d3526aa58b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:45.826584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f433cb60-9872-4116-b3f9-c7d3526aa58b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:45.833554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f433cb60-9872-4116-b3f9-c7d3526aa58b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:45.834065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f433cb60-9872-4116-b3f9-c7d3526aa58b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:45.834520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f433cb60-9872-4116-b3f9-c7d3526aa58b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:45.835800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f433cb60-9872-4116-b3f9-c7d3526aa58b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:45.836279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f433cb60-9872-4116-b3f9-c7d3526aa58b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:45.836727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f433cb60-9872-4116-b3f9-c7d3526aa58b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:45.906094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f433cb60-9872-4116-b3f9-c7d3526aa58b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:45.919521 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f433cb60-9872-4116-b3f9-c7d3526aa58b tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1366 microversion: 2.1 time: 0.097263 Aug 27 05:57:45.920117 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3765/7536] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:45 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:46.941035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af1f9d6e-4527-411a-8a66-59077f122deb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:46.941648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-af1f9d6e-4527-411a-8a66-59077f122deb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:46.949592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1f9d6e-4527-411a-8a66-59077f122deb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:46.950086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1f9d6e-4527-411a-8a66-59077f122deb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:46.950536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1f9d6e-4527-411a-8a66-59077f122deb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:46.951298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1f9d6e-4527-411a-8a66-59077f122deb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:46.951760 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1f9d6e-4527-411a-8a66-59077f122deb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:46.952194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af1f9d6e-4527-411a-8a66-59077f122deb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:47.018002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af1f9d6e-4527-411a-8a66-59077f122deb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa36ffb13d74ef5a9cb4385917dcd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6afd2bed754b7797850547b3ac6ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:47.026277 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af1f9d6e-4527-411a-8a66-59077f122deb tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 200 len: 1366 microversion: 2.1 time: 0.089323 Aug 27 05:57:47.026883 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3772/7537] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:46 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:48.048608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:48.049323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:48.056138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:48.056571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:48.057021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:48.057764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:48.058232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:48.058670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:48.073032 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 HTTP/1.1 Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '3d68fecc-af78-4f6a-8c43-ccbe07c9d226'} Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:48.074711 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:48.079731 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:48.079731 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:48.079731 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:48.079731 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:57:48.079731 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:57:48.079731 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:48.079731 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:48.079731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:57:48.079731 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f933e445-2c6c-4610-924d-ad29d657685f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 404 len: 111 microversion: 2.1 time: 0.032694 Aug 27 05:57:48.079731 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3766/7538] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:48 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:57:48.138892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:48.141086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:48.147903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:48.148389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:48.148830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:48.149561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:48.150017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:48.150444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:48.163451 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/os-volume_attachments HTTP/1.1 Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'server_id': '3d68fecc-af78-4f6a-8c43-ccbe07c9d226'} Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:57:48.165141 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d2f243d1-8ab0-4c8a-a998-0e9ba6c31b8d tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031687 Aug 27 05:57:48.170024 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3773/7539] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:57:48 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:57:51.495843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:51.496351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:51.503277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.503774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.504230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.504935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.505400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.505839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.520129 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 HTTP/1.1 Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '3d68fecc-af78-4f6a-8c43-ccbe07c9d226'} Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:57:51.521687 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-29f5a0c3-b222-4391-b456-beceeb815b4f tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 404 len: 111 microversion: 2.1 time: 0.031897 Aug 27 05:57:51.527728 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3767/7540] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:57:51 2022] DELETE /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:57:51.532466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:51.533088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 3d68fecc-af78-4f6a-8c43-ccbe07c9d226] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:51.540603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.541084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.541527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.542223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.542680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.543191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.557644 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 HTTP/1.1 Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '3d68fecc-af78-4f6a-8c43-ccbe07c9d226'} Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.559130 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.564100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.564100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.564100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.564100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:57:51.564100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:57:51.564100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. Aug 27 05:57:51.564100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.564100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 3d68fecc-af78-4f6a-8c43-ccbe07c9d226 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:57:51.564100 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-277bdaa8-3abd-4e31-8290-a1817a6a4cb1 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226" status: 404 len: 111 microversion: 2.1 time: 0.031981 Aug 27 05:57:51.564100 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3774/7541] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:51 2022] GET /compute/v2.1/servers/3d68fecc-af78-4f6a-8c43-ccbe07c9d226 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:57:51.569076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:51.569683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:51.575886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.576516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.576969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.577675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.578140 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.578578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.592992 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 HTTP/1.1 Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '54b3e81b-d0c4-47a7-ad8a-49fb3f70a787'} Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:57:51.594638 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7346a834-063b-4fa2-b754-61d9b5e3cee9 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 404 len: 111 microversion: 2.1 time: 0.031043 Aug 27 05:57:51.602654 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3768/7542] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:57:51 2022] DELETE /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:57:51.605331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:51.605972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:51.612354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.612844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.613277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.613980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.614456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.614857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.632386 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 HTTP/1.1 Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '54b3e81b-d0c4-47a7-ad8a-49fb3f70a787'} Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.633938 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.638094 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.638094 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.638094 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.638094 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:57:51.638094 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:57:51.638094 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. Aug 27 05:57:51.638094 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.638094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:57:51.638094 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6deb33c8-6eb1-4c37-a496-e6d90647e016 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787" status: 404 len: 111 microversion: 2.1 time: 0.033923 Aug 27 05:57:51.638094 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3775/7543] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:51 2022] GET /compute/v2.1/servers/54b3e81b-d0c4-47a7-ad8a-49fb3f70a787 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:57:51.644155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:51.644669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:51.651033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.651568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.652016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.652733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.653197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.653633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.668843 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 HTTP/1.1 Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '08bbfd51-80a4-4081-a1db-a37ca98269e7'} Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:57:51.670691 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db22fc7a-9405-4909-bccd-dbc73fc1d667 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "DELETE /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 404 len: 111 microversion: 2.1 time: 0.031873 Aug 27 05:57:51.674694 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3769/7544] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:57:51 2022] DELETE /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:57:51.681594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:51.682221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 08bbfd51-80a4-4081-a1db-a37ca98269e7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:51.688651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.689141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.689581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.690310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.690765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.691219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.705277 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 HTTP/1.1 Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '08bbfd51-80a4-4081-a1db-a37ca98269e7'} Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.706902 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.711339 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.711339 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.711339 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.711339 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:57:51.711339 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:57:51.711339 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. Aug 27 05:57:51.711339 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.711339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 08bbfd51-80a4-4081-a1db-a37ca98269e7 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:57:51.711339 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-634f7eb9-196b-4847-9e72-b77f92a45752 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7" status: 404 len: 111 microversion: 2.1 time: 0.031264 Aug 27 05:57:51.712125 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3776/7545] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:51 2022] GET /compute/v2.1/servers/08bbfd51-80a4-4081-a1db-a37ca98269e7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:57:51.717046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:51.717560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:51.723445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.723938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.724383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.725088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.726067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.726515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.739892 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de HTTP/1.1 Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '995165b1-6d47-4fe1-b892-f0cdaa5dd5de'} Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:57:51.742007 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9b480659-3dd0-4387-af45-f4b62a461fab tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "DELETE /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 404 len: 111 microversion: 2.1 time: 0.030345 Aug 27 05:57:51.746772 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3770/7546] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:57:51 2022] DELETE /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:57:51.753240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:51.753866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] [instance: 995165b1-6d47-4fe1-b892-f0cdaa5dd5de] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:51.760140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.760633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.761080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.761788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:51.762252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:51.762693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:51.776256 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] HTTP exception thrown: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Request method failure captured: Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de HTTP/1.1 Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbBV9znx92iFpM5exnYQhenv7PR2Lg7GBS6W4z5cgQXMUdj7jkevpwI4vGluYxYquVsKbNQPrheRT4YP4CBFUyngOYH2CbU4DQLK9IEhNxBrYXMhWgKY-jMaLqp7a3_EdENbbpWnMyDm1fXddwNH4iy_baV_tKsTj3HKmrK8IEkzxUQ Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad6afd2bed754b7797850547b3ac6ee7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad6afd2bed754b7797850547b3ac6ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: ad6afd2bed754b7797850547b3ac6ee7 Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServerActionsTestJSON-2866420 Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: ffa36ffb13d74ef5a9cb4385917dcd05 Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServerActionsTestJSON-2866420-project Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '995165b1-6d47-4fe1-b892-f0cdaa5dd5de'} Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:57:51.777916 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.782052 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:57:51.782052 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:57:51.782052 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:57:51.782052 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:57:51.782052 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:57:51.782052 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. Aug 27 05:57:51.782052 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:57:51.782052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Returning 404 to user: Instance 995165b1-6d47-4fe1-b892-f0cdaa5dd5de could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:57:51.782052 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cbb8b1f9-92ef-48c4-b571-875f43e306c0 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de" status: 404 len: 111 microversion: 2.1 time: 0.029959 Aug 27 05:57:51.782052 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3777/7547] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:51 2022] GET /compute/v2.1/servers/995165b1-6d47-4fe1-b892-f0cdaa5dd5de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:57:51.789060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-445c8770-82c2-4be3-878c-f351cb3201a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] Calling method '.version_select at 0x7fb5696c2b80>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:51.813804 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-445c8770-82c2-4be3-878c-f351cb3201a7 tempest-ServerActionsTestJSON-2866420 tempest-ServerActionsTestJSON-2866420-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-94422661" status: 202 len: 0 microversion: 2.1 time: 0.028978 Aug 27 05:57:51.814416 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3771/7548] 10.222.0.58 () {58 vars in 1215 bytes} [Sat Aug 27 05:57:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-94422661 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:58:01.561526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-205962689", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "a62b3aac-cd4d-44f2-9991-f9b9565d3091"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:58:01.625460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] validate_networks() for [('a62b3aac-cd4d-44f2-9991-f9b9565d3091', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:58:01.767137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=53 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:02.052370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:58:02.052974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:58:02.053701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:58:02.054124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:58:02.054547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:58:02.064257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:02.064744 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:02.065181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:02.065907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:02.066360 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:02.066788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:02.087746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Getting quotas for project 61e2230a6dd84de2a73c6e013aa89a5d. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:58:02.093803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Getting quotas for user 9e0a8c8eae6c4b928531e1d40f0abd6a and project 61e2230a6dd84de2a73c6e013aa89a5d. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:58:02.108453 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:58:02.110842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:58:02.161019 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cdfcc6f6-0570-4462-89bc-9b24bd38e3b8 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746490 Aug 27 05:58:02.161875 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3778/7549] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:58:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:58:02.171787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:02.173125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:02.178115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-79ffb35e-9b12-462f-814a-2bab47287902 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:02.179636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-79ffb35e-9b12-462f-814a-2bab47287902 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:02.263415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-79ffb35e-9b12-462f-814a-2bab47287902 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:02.270594 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-79ffb35e-9b12-462f-814a-2bab47287902 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1216 microversion: 2.1 time: 0.100950 Aug 27 05:58:02.271480 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3772/7550] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:02 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:03.293138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d8d42fb-64e1-42b8-856e-3937b5acd659 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:03.293871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7d8d42fb-64e1-42b8-856e-3937b5acd659 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:03.303947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d8d42fb-64e1-42b8-856e-3937b5acd659 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:03.304680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d8d42fb-64e1-42b8-856e-3937b5acd659 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:03.305315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d8d42fb-64e1-42b8-856e-3937b5acd659 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:03.306696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d8d42fb-64e1-42b8-856e-3937b5acd659 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:03.307382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d8d42fb-64e1-42b8-856e-3937b5acd659 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:03.308002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d8d42fb-64e1-42b8-856e-3937b5acd659 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:03.387371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7d8d42fb-64e1-42b8-856e-3937b5acd659 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:03.401674 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d8d42fb-64e1-42b8-856e-3937b5acd659 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1268 microversion: 2.1 time: 0.112716 Aug 27 05:58:03.422800 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3779/7551] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:03 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1268 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:04.423483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c5c81e35-f0bf-4fdd-b7c5-dff5e2f40a9e tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:04.425078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c5c81e35-f0bf-4fdd-b7c5-dff5e2f40a9e tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:04.433045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5c81e35-f0bf-4fdd-b7c5-dff5e2f40a9e tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:04.433582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5c81e35-f0bf-4fdd-b7c5-dff5e2f40a9e tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:04.434116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5c81e35-f0bf-4fdd-b7c5-dff5e2f40a9e tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:04.434946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5c81e35-f0bf-4fdd-b7c5-dff5e2f40a9e tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:04.435581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5c81e35-f0bf-4fdd-b7c5-dff5e2f40a9e tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:04.436255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5c81e35-f0bf-4fdd-b7c5-dff5e2f40a9e tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:04.640095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c5c81e35-f0bf-4fdd-b7c5-dff5e2f40a9e tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:04.649111 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c5c81e35-f0bf-4fdd-b7c5-dff5e2f40a9e tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1316 microversion: 2.1 time: 0.229897 Aug 27 05:58:04.649708 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3773/7552] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:04 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:04.938013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7e8d5638-5524-4190-9510-8ef409e55448 req-c130b30f-3df6-44d4-be74-a7c59ba457a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b33c9c-6fdd-4a48-9584-c7a94031c269", "tag": "e79a1770-cbd0-4d5d-bf53-0be00be6b044"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:58:04.954472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7e8d5638-5524-4190-9510-8ef409e55448 req-c130b30f-3df6-44d4-be74-a7c59ba457a7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:04.956922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7e8d5638-5524-4190-9510-8ef409e55448 req-c130b30f-3df6-44d4-be74-a7c59ba457a7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:04.957497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7e8d5638-5524-4190-9510-8ef409e55448 req-c130b30f-3df6-44d4-be74-a7c59ba457a7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:04.973991 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7e8d5638-5524-4190-9510-8ef409e55448 req-c130b30f-3df6-44d4-be74-a7c59ba457a7 service nova] Creating event network-changed:e79a1770-cbd0-4d5d-bf53-0be00be6b044 for instance 13b33c9c-6fdd-4a48-9584-c7a94031c269 on n-h1-820368-35 Aug 27 05:58:04.979897 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7e8d5638-5524-4190-9510-8ef409e55448 req-c130b30f-3df6-44d4-be74-a7c59ba457a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052743 Aug 27 05:58:04.980754 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3780/7553] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:58:05.669894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bcd1d72f-562a-4b5f-8b8e-b1163b28afa1 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:05.670814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bcd1d72f-562a-4b5f-8b8e-b1163b28afa1 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:05.677876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bcd1d72f-562a-4b5f-8b8e-b1163b28afa1 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:05.678890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bcd1d72f-562a-4b5f-8b8e-b1163b28afa1 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:05.679375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bcd1d72f-562a-4b5f-8b8e-b1163b28afa1 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:05.680100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bcd1d72f-562a-4b5f-8b8e-b1163b28afa1 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:05.680573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bcd1d72f-562a-4b5f-8b8e-b1163b28afa1 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:05.681019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bcd1d72f-562a-4b5f-8b8e-b1163b28afa1 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:05.812133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bcd1d72f-562a-4b5f-8b8e-b1163b28afa1 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:05.820741 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bcd1d72f-562a-4b5f-8b8e-b1163b28afa1 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1316 microversion: 2.1 time: 0.154727 Aug 27 05:58:05.821316 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3774/7554] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:05 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:06.842411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c846ca32-d552-4cd6-bad9-5a8b0de6ac49 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:06.843143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c846ca32-d552-4cd6-bad9-5a8b0de6ac49 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:06.849555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c846ca32-d552-4cd6-bad9-5a8b0de6ac49 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:06.850067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c846ca32-d552-4cd6-bad9-5a8b0de6ac49 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:06.850505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c846ca32-d552-4cd6-bad9-5a8b0de6ac49 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:06.851320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c846ca32-d552-4cd6-bad9-5a8b0de6ac49 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:06.851848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c846ca32-d552-4cd6-bad9-5a8b0de6ac49 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:06.852366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c846ca32-d552-4cd6-bad9-5a8b0de6ac49 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:06.986010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c846ca32-d552-4cd6-bad9-5a8b0de6ac49 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:06.994731 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c846ca32-d552-4cd6-bad9-5a8b0de6ac49 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1316 microversion: 2.1 time: 0.157417 Aug 27 05:58:06.995331 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3781/7555] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:06 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:08.016657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0d70eb38-d1eb-43e6-afa8-914cb36c2a78 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:08.017300 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0d70eb38-d1eb-43e6-afa8-914cb36c2a78 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:08.024765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d70eb38-d1eb-43e6-afa8-914cb36c2a78 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:08.025272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d70eb38-d1eb-43e6-afa8-914cb36c2a78 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:08.025732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d70eb38-d1eb-43e6-afa8-914cb36c2a78 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:08.026457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d70eb38-d1eb-43e6-afa8-914cb36c2a78 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:08.026932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d70eb38-d1eb-43e6-afa8-914cb36c2a78 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:08.027415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0d70eb38-d1eb-43e6-afa8-914cb36c2a78 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:08.161671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0d70eb38-d1eb-43e6-afa8-914cb36c2a78 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:08.170304 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0d70eb38-d1eb-43e6-afa8-914cb36c2a78 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1316 microversion: 2.1 time: 0.157963 Aug 27 05:58:08.171370 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3775/7556] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:08 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:09.192302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4b3df310-c3ce-4f96-af09-597be288cc97 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:09.192928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4b3df310-c3ce-4f96-af09-597be288cc97 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:09.200353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3df310-c3ce-4f96-af09-597be288cc97 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:09.200845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3df310-c3ce-4f96-af09-597be288cc97 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:09.201286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3df310-c3ce-4f96-af09-597be288cc97 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:09.201991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3df310-c3ce-4f96-af09-597be288cc97 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:09.202445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3df310-c3ce-4f96-af09-597be288cc97 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:09.202874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4b3df310-c3ce-4f96-af09-597be288cc97 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:09.341130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4b3df310-c3ce-4f96-af09-597be288cc97 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:09.348759 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4b3df310-c3ce-4f96-af09-597be288cc97 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1316 microversion: 2.1 time: 0.160433 Aug 27 05:58:09.349329 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3782/7557] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:09 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:58:10.370484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cec3aaa9-470e-4229-a65d-7b3fc344fb93 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:10.371157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cec3aaa9-470e-4229-a65d-7b3fc344fb93 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:10.378079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cec3aaa9-470e-4229-a65d-7b3fc344fb93 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:10.378582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cec3aaa9-470e-4229-a65d-7b3fc344fb93 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:10.379040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cec3aaa9-470e-4229-a65d-7b3fc344fb93 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:10.379776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cec3aaa9-470e-4229-a65d-7b3fc344fb93 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:10.380275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cec3aaa9-470e-4229-a65d-7b3fc344fb93 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:10.380727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cec3aaa9-470e-4229-a65d-7b3fc344fb93 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:10.513004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cec3aaa9-470e-4229-a65d-7b3fc344fb93 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:10.520705 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cec3aaa9-470e-4229-a65d-7b3fc344fb93 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1316 microversion: 2.1 time: 0.154689 Aug 27 05:58:10.521276 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3776/7558] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:10 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:10.762119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-693ba4d1-1652-4b6e-849e-18dfea3af7c5 req-bf686c73-5e71-4a1a-b391-ca6044bb5532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b33c9c-6fdd-4a48-9584-c7a94031c269", "name": "network-vif-plugged", "status": "completed", "tag": "e79a1770-cbd0-4d5d-bf53-0be00be6b044"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:58:10.767892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:10.773974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-693ba4d1-1652-4b6e-849e-18dfea3af7c5 req-bf686c73-5e71-4a1a-b391-ca6044bb5532 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:10.774455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-693ba4d1-1652-4b6e-849e-18dfea3af7c5 req-bf686c73-5e71-4a1a-b391-ca6044bb5532 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:10.774887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-693ba4d1-1652-4b6e-849e-18dfea3af7c5 req-bf686c73-5e71-4a1a-b391-ca6044bb5532 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:10.786616 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-693ba4d1-1652-4b6e-849e-18dfea3af7c5 req-bf686c73-5e71-4a1a-b391-ca6044bb5532 service nova] Creating event network-vif-plugged:e79a1770-cbd0-4d5d-bf53-0be00be6b044 for instance 13b33c9c-6fdd-4a48-9584-c7a94031c269 on n-h1-820368-35 Aug 27 05:58:10.791766 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-693ba4d1-1652-4b6e-849e-18dfea3af7c5 req-bf686c73-5e71-4a1a-b391-ca6044bb5532 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033449 Aug 27 05:58:10.792380 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3783/7559] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:58:11.542068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0a51d62b-0baf-42bd-85e0-32cdb761cd46 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:11.542738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0a51d62b-0baf-42bd-85e0-32cdb761cd46 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:11.549777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a51d62b-0baf-42bd-85e0-32cdb761cd46 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:11.550480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a51d62b-0baf-42bd-85e0-32cdb761cd46 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:11.550753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a51d62b-0baf-42bd-85e0-32cdb761cd46 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:11.551523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a51d62b-0baf-42bd-85e0-32cdb761cd46 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:11.552115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a51d62b-0baf-42bd-85e0-32cdb761cd46 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:11.552548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0a51d62b-0baf-42bd-85e0-32cdb761cd46 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:11.683176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0a51d62b-0baf-42bd-85e0-32cdb761cd46 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:11.691425 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0a51d62b-0baf-42bd-85e0-32cdb761cd46 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1316 microversion: 2.1 time: 0.153283 Aug 27 05:58:11.691996 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3777/7560] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:11 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:12.711795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:12.712585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:12.717565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-19651df8-6401-4205-9f20-38d7039dde82 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:12.718289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-19651df8-6401-4205-9f20-38d7039dde82 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:12.725460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19651df8-6401-4205-9f20-38d7039dde82 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:12.725951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19651df8-6401-4205-9f20-38d7039dde82 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:12.726394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19651df8-6401-4205-9f20-38d7039dde82 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:12.727116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19651df8-6401-4205-9f20-38d7039dde82 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:12.727595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19651df8-6401-4205-9f20-38d7039dde82 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:12.728029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-19651df8-6401-4205-9f20-38d7039dde82 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:12.862018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-19651df8-6401-4205-9f20-38d7039dde82 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:12.869885 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-19651df8-6401-4205-9f20-38d7039dde82 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1504 microversion: 2.1 time: 0.160878 Aug 27 05:58:12.870464 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3784/7561] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:12 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:12.929558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1266277986", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "a62b3aac-cd4d-44f2-9991-f9b9565d3091"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:58:12.938052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:12.985058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] validate_networks() for [('a62b3aac-cd4d-44f2-9991-f9b9565d3091', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:58:13.412871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:58:13.413317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:58:13.413813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:58:13.414244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:58:13.414677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:58:13.424189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:13.424627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:13.425083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:13.425863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:13.426337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:13.426784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:13.444941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Getting quotas for project 61e2230a6dd84de2a73c6e013aa89a5d. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:58:13.450409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Getting quotas for user 9e0a8c8eae6c4b928531e1d40f0abd6a and project 61e2230a6dd84de2a73c6e013aa89a5d. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:58:13.464314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:58:13.466686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:58:13.515201 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8087296f-a56e-417e-b187-c753339037fa tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589397 Aug 27 05:58:13.515860 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3778/7562] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:58:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:58:13.527507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce886733-6384-482f-bbd9-cd10cffe9606 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:13.528146 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ce886733-6384-482f-bbd9-cd10cffe9606 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:13.587063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce886733-6384-482f-bbd9-cd10cffe9606 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:13.594285 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce886733-6384-482f-bbd9-cd10cffe9606 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1217 microversion: 2.1 time: 0.070990 Aug 27 05:58:13.595051 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3785/7563] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:13 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:14.615974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-70590b25-f960-435a-a403-d66ade0ca862 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:14.616625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-70590b25-f960-435a-a403-d66ade0ca862 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:14.623742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70590b25-f960-435a-a403-d66ade0ca862 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:14.624296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70590b25-f960-435a-a403-d66ade0ca862 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:14.624802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70590b25-f960-435a-a403-d66ade0ca862 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:14.625566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70590b25-f960-435a-a403-d66ade0ca862 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:14.626007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70590b25-f960-435a-a403-d66ade0ca862 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:14.626501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-70590b25-f960-435a-a403-d66ade0ca862 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:14.694915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-70590b25-f960-435a-a403-d66ade0ca862 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:14.703455 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-70590b25-f960-435a-a403-d66ade0ca862 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1277 microversion: 2.1 time: 0.092880 Aug 27 05:58:14.704039 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3779/7564] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:14 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:15.724398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-423307ce-551e-4fb3-b856-15ea6a1fb483 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:15.725646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-423307ce-551e-4fb3-b856-15ea6a1fb483 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:15.733333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423307ce-551e-4fb3-b856-15ea6a1fb483 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:15.733858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423307ce-551e-4fb3-b856-15ea6a1fb483 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:15.734307 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423307ce-551e-4fb3-b856-15ea6a1fb483 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:15.735021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423307ce-551e-4fb3-b856-15ea6a1fb483 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:15.735518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423307ce-551e-4fb3-b856-15ea6a1fb483 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:15.735978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-423307ce-551e-4fb3-b856-15ea6a1fb483 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:15.873077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-423307ce-551e-4fb3-b856-15ea6a1fb483 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:15.880886 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-423307ce-551e-4fb3-b856-15ea6a1fb483 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1317 microversion: 2.1 time: 0.160451 Aug 27 05:58:15.881507 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3786/7565] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:15 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:15.934719 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7d4f2c33-d086-4bde-b7fe-780db5ecc632 req-db16cd44-4d41-4211-b2fa-a72ece1ac107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8bcb63e-c813-4756-b483-05888f06161b", "tag": "4412a0e1-28ff-48b0-bf94-c5de7b18334f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:58:15.946641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7d4f2c33-d086-4bde-b7fe-780db5ecc632 req-db16cd44-4d41-4211-b2fa-a72ece1ac107 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:15.947164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7d4f2c33-d086-4bde-b7fe-780db5ecc632 req-db16cd44-4d41-4211-b2fa-a72ece1ac107 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:15.947624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7d4f2c33-d086-4bde-b7fe-780db5ecc632 req-db16cd44-4d41-4211-b2fa-a72ece1ac107 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:15.958921 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7d4f2c33-d086-4bde-b7fe-780db5ecc632 req-db16cd44-4d41-4211-b2fa-a72ece1ac107 service nova] Creating event network-changed:4412a0e1-28ff-48b0-bf94-c5de7b18334f for instance b8bcb63e-c813-4756-b483-05888f06161b on n-h2-820368-35 Aug 27 05:58:15.963778 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7d4f2c33-d086-4bde-b7fe-780db5ecc632 req-db16cd44-4d41-4211-b2fa-a72ece1ac107 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035550 Aug 27 05:58:15.964392 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3780/7566] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:58:16.902497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1f952ae8-e8df-4e7f-9e03-e4524bd5423c tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:16.903176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1f952ae8-e8df-4e7f-9e03-e4524bd5423c tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:16.910077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f952ae8-e8df-4e7f-9e03-e4524bd5423c tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:16.910558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f952ae8-e8df-4e7f-9e03-e4524bd5423c tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:16.910997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f952ae8-e8df-4e7f-9e03-e4524bd5423c tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:16.911722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f952ae8-e8df-4e7f-9e03-e4524bd5423c tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:16.912245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f952ae8-e8df-4e7f-9e03-e4524bd5423c tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:16.913265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1f952ae8-e8df-4e7f-9e03-e4524bd5423c tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:17.048289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1f952ae8-e8df-4e7f-9e03-e4524bd5423c tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:17.056095 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1f952ae8-e8df-4e7f-9e03-e4524bd5423c tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1317 microversion: 2.1 time: 0.157452 Aug 27 05:58:17.056625 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3787/7567] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:16 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:18.079197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-02fcd5f2-2257-4533-8306-c059ae7338de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:18.079850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-02fcd5f2-2257-4533-8306-c059ae7338de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:18.086676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02fcd5f2-2257-4533-8306-c059ae7338de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:18.087212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02fcd5f2-2257-4533-8306-c059ae7338de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:18.087668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02fcd5f2-2257-4533-8306-c059ae7338de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:18.088381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02fcd5f2-2257-4533-8306-c059ae7338de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:18.088851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02fcd5f2-2257-4533-8306-c059ae7338de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:18.089290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-02fcd5f2-2257-4533-8306-c059ae7338de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:18.218696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-02fcd5f2-2257-4533-8306-c059ae7338de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:18.226445 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-02fcd5f2-2257-4533-8306-c059ae7338de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1317 microversion: 2.1 time: 0.152939 Aug 27 05:58:18.227010 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3781/7568] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:18 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:19.247355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9330ef4a-09f4-4ba6-aba4-2ac24c1ab5a7 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:19.247973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9330ef4a-09f4-4ba6-aba4-2ac24c1ab5a7 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:19.255222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330ef4a-09f4-4ba6-aba4-2ac24c1ab5a7 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:19.255703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330ef4a-09f4-4ba6-aba4-2ac24c1ab5a7 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:19.256684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330ef4a-09f4-4ba6-aba4-2ac24c1ab5a7 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:19.257478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330ef4a-09f4-4ba6-aba4-2ac24c1ab5a7 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:19.257869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330ef4a-09f4-4ba6-aba4-2ac24c1ab5a7 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:19.258299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9330ef4a-09f4-4ba6-aba4-2ac24c1ab5a7 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:19.404595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9330ef4a-09f4-4ba6-aba4-2ac24c1ab5a7 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:19.412498 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9330ef4a-09f4-4ba6-aba4-2ac24c1ab5a7 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1317 microversion: 2.1 time: 0.169162 Aug 27 05:58:19.413079 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3788/7569] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:19 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:20.433937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-35f4480c-8dbe-4b6a-96f9-2813bb6c32e6 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:20.434647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-35f4480c-8dbe-4b6a-96f9-2813bb6c32e6 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:20.441571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35f4480c-8dbe-4b6a-96f9-2813bb6c32e6 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:20.442067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35f4480c-8dbe-4b6a-96f9-2813bb6c32e6 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:20.442515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35f4480c-8dbe-4b6a-96f9-2813bb6c32e6 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:20.443247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35f4480c-8dbe-4b6a-96f9-2813bb6c32e6 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:20.443714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35f4480c-8dbe-4b6a-96f9-2813bb6c32e6 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:20.444150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-35f4480c-8dbe-4b6a-96f9-2813bb6c32e6 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:20.575417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-35f4480c-8dbe-4b6a-96f9-2813bb6c32e6 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:20.583117 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-35f4480c-8dbe-4b6a-96f9-2813bb6c32e6 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1317 microversion: 2.1 time: 0.153291 Aug 27 05:58:20.583708 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3782/7570] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:20 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:21.603523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e0b9e262-0d7e-4fb2-a1fc-98c255726c53 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:21.604219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e0b9e262-0d7e-4fb2-a1fc-98c255726c53 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:21.611303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0b9e262-0d7e-4fb2-a1fc-98c255726c53 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:21.611785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0b9e262-0d7e-4fb2-a1fc-98c255726c53 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:21.612226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0b9e262-0d7e-4fb2-a1fc-98c255726c53 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:21.612916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0b9e262-0d7e-4fb2-a1fc-98c255726c53 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:21.613367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0b9e262-0d7e-4fb2-a1fc-98c255726c53 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:21.613793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e0b9e262-0d7e-4fb2-a1fc-98c255726c53 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:21.741662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e0b9e262-0d7e-4fb2-a1fc-98c255726c53 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:21.751132 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e0b9e262-0d7e-4fb2-a1fc-98c255726c53 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1317 microversion: 2.1 time: 0.151570 Aug 27 05:58:21.751849 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3789/7571] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:21 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:22.773758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8545ba8d-a8be-44e6-8335-acab8d144e61 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:22.775007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8545ba8d-a8be-44e6-8335-acab8d144e61 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:22.781917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8545ba8d-a8be-44e6-8335-acab8d144e61 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:22.782411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8545ba8d-a8be-44e6-8335-acab8d144e61 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:22.782863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8545ba8d-a8be-44e6-8335-acab8d144e61 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:22.783600 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8545ba8d-a8be-44e6-8335-acab8d144e61 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:22.784067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8545ba8d-a8be-44e6-8335-acab8d144e61 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:22.784504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8545ba8d-a8be-44e6-8335-acab8d144e61 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:22.919905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8545ba8d-a8be-44e6-8335-acab8d144e61 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:22.927854 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8545ba8d-a8be-44e6-8335-acab8d144e61 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1317 microversion: 2.1 time: 0.159333 Aug 27 05:58:22.928425 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3783/7572] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:22 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:23.939796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7f4b98ad-faef-4e4c-8d74-e2e35db7a379 req-b2728f35-f941-453b-8f7b-0687db61d49d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcb63e-c813-4756-b483-05888f06161b", "name": "network-vif-plugged", "status": "completed", "tag": "4412a0e1-28ff-48b0-bf94-c5de7b18334f"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:58:23.946025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:23.948676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c889ea64-a955-488b-b39a-dc212b92ef26 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:23.949355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c889ea64-a955-488b-b39a-dc212b92ef26 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:23.951867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:23.952854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:23.958415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7f4b98ad-faef-4e4c-8d74-e2e35db7a379 req-b2728f35-f941-453b-8f7b-0687db61d49d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:23.959226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7f4b98ad-faef-4e4c-8d74-e2e35db7a379 req-b2728f35-f941-453b-8f7b-0687db61d49d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:23.959555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c889ea64-a955-488b-b39a-dc212b92ef26 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:23.959700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7f4b98ad-faef-4e4c-8d74-e2e35db7a379 req-b2728f35-f941-453b-8f7b-0687db61d49d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:23.960062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c889ea64-a955-488b-b39a-dc212b92ef26 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:23.960515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c889ea64-a955-488b-b39a-dc212b92ef26 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:23.961272 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c889ea64-a955-488b-b39a-dc212b92ef26 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:23.961915 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c889ea64-a955-488b-b39a-dc212b92ef26 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:23.962355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c889ea64-a955-488b-b39a-dc212b92ef26 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:23.972211 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7f4b98ad-faef-4e4c-8d74-e2e35db7a379 req-b2728f35-f941-453b-8f7b-0687db61d49d service nova] Creating event network-vif-plugged:4412a0e1-28ff-48b0-bf94-c5de7b18334f for instance b8bcb63e-c813-4756-b483-05888f06161b on n-h2-820368-35 Aug 27 05:58:23.980432 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7f4b98ad-faef-4e4c-8d74-e2e35db7a379 req-b2728f35-f941-453b-8f7b-0687db61d49d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044170 Aug 27 05:58:23.981360 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3790/7573] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:58:24.108671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c889ea64-a955-488b-b39a-dc212b92ef26 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:24.116711 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c889ea64-a955-488b-b39a-dc212b92ef26 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1317 microversion: 2.1 time: 0.171995 Aug 27 05:58:24.117345 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3784/7574] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:23 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:58:25.139108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1e4ca274-2279-40d1-93e5-7a34de9509de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:25.139829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1e4ca274-2279-40d1-93e5-7a34de9509de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:25.146898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e4ca274-2279-40d1-93e5-7a34de9509de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:25.147426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e4ca274-2279-40d1-93e5-7a34de9509de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:25.147869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e4ca274-2279-40d1-93e5-7a34de9509de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:25.148568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e4ca274-2279-40d1-93e5-7a34de9509de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:25.149022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e4ca274-2279-40d1-93e5-7a34de9509de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:25.149485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e4ca274-2279-40d1-93e5-7a34de9509de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:25.287141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1e4ca274-2279-40d1-93e5-7a34de9509de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:25.295454 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1e4ca274-2279-40d1-93e5-7a34de9509de tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1317 microversion: 2.1 time: 0.160615 Aug 27 05:58:25.296460 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3791/7575] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:25 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:26.317527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-58cd46fd-047e-41ee-9efb-011b93fccd54 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:26.318153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-58cd46fd-047e-41ee-9efb-011b93fccd54 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:26.325032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58cd46fd-047e-41ee-9efb-011b93fccd54 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:26.325534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58cd46fd-047e-41ee-9efb-011b93fccd54 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:26.325986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58cd46fd-047e-41ee-9efb-011b93fccd54 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:26.326712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58cd46fd-047e-41ee-9efb-011b93fccd54 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:26.327212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58cd46fd-047e-41ee-9efb-011b93fccd54 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:26.327659 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-58cd46fd-047e-41ee-9efb-011b93fccd54 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:26.459712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-58cd46fd-047e-41ee-9efb-011b93fccd54 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:26.467928 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-58cd46fd-047e-41ee-9efb-011b93fccd54 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1506 microversion: 2.1 time: 0.154422 Aug 27 05:58:26.468500 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3785/7576] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:26 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:26.488402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9deb0e2-c423-4760-bd3b-d2eeda3415fe tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:26.488940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9deb0e2-c423-4760-bd3b-d2eeda3415fe tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:26.496794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9deb0e2-c423-4760-bd3b-d2eeda3415fe tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:26.497033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9deb0e2-c423-4760-bd3b-d2eeda3415fe tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:26.497481 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9deb0e2-c423-4760-bd3b-d2eeda3415fe tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:26.498310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9deb0e2-c423-4760-bd3b-d2eeda3415fe tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:26.498772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9deb0e2-c423-4760-bd3b-d2eeda3415fe tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:26.499229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9deb0e2-c423-4760-bd3b-d2eeda3415fe tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:26.525163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9deb0e2-c423-4760-bd3b-d2eeda3415fe tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:58:26.606508 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9deb0e2-c423-4760-bd3b-d2eeda3415fe tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 204 len: 0 microversion: 2.1 time: 0.121358 Aug 27 05:58:26.607413 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3792/7577] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:58:26 2022] DELETE /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:58:26.615240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1c45a111-b49a-4d81-be8d-142be05fac1d tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:26.615872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1c45a111-b49a-4d81-be8d-142be05fac1d tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:26.622485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c45a111-b49a-4d81-be8d-142be05fac1d tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:26.622993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c45a111-b49a-4d81-be8d-142be05fac1d tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:26.623471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c45a111-b49a-4d81-be8d-142be05fac1d tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:26.624187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c45a111-b49a-4d81-be8d-142be05fac1d tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:26.624657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c45a111-b49a-4d81-be8d-142be05fac1d tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:26.625106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1c45a111-b49a-4d81-be8d-142be05fac1d tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:26.756801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1c45a111-b49a-4d81-be8d-142be05fac1d tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:26.765061 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1c45a111-b49a-4d81-be8d-142be05fac1d tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1512 microversion: 2.1 time: 0.153614 Aug 27 05:58:26.765667 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3786/7578] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:26 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:58:27.786672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-14990ff4-21e2-4bb1-a492-a5b0aab73e7f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:27.787433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-14990ff4-21e2-4bb1-a492-a5b0aab73e7f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:27.794791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14990ff4-21e2-4bb1-a492-a5b0aab73e7f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:27.795901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14990ff4-21e2-4bb1-a492-a5b0aab73e7f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:27.796683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14990ff4-21e2-4bb1-a492-a5b0aab73e7f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:27.797122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14990ff4-21e2-4bb1-a492-a5b0aab73e7f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:27.797592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14990ff4-21e2-4bb1-a492-a5b0aab73e7f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:27.798030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14990ff4-21e2-4bb1-a492-a5b0aab73e7f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:27.942567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-14990ff4-21e2-4bb1-a492-a5b0aab73e7f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:27.951999 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-14990ff4-21e2-4bb1-a492-a5b0aab73e7f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1512 microversion: 2.1 time: 0.169629 Aug 27 05:58:27.952587 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3793/7579] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:27 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:58:28.559024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ec6ed039-d4e6-4dd6-8d3a-ccdabf15ad23 req-9e36a75d-1c20-46a5-91b0-471ea1261eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcb63e-c813-4756-b483-05888f06161b", "name": "network-vif-deleted", "tag": "4412a0e1-28ff-48b0-bf94-c5de7b18334f"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:58:28.573448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ec6ed039-d4e6-4dd6-8d3a-ccdabf15ad23 req-9e36a75d-1c20-46a5-91b0-471ea1261eb5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:28.574247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ec6ed039-d4e6-4dd6-8d3a-ccdabf15ad23 req-9e36a75d-1c20-46a5-91b0-471ea1261eb5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:28.575065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ec6ed039-d4e6-4dd6-8d3a-ccdabf15ad23 req-9e36a75d-1c20-46a5-91b0-471ea1261eb5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:28.597740 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ec6ed039-d4e6-4dd6-8d3a-ccdabf15ad23 req-9e36a75d-1c20-46a5-91b0-471ea1261eb5 service nova] Creating event network-vif-deleted:4412a0e1-28ff-48b0-bf94-c5de7b18334f for instance b8bcb63e-c813-4756-b483-05888f06161b on n-h2-820368-35 Aug 27 05:58:28.603420 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ec6ed039-d4e6-4dd6-8d3a-ccdabf15ad23 req-9e36a75d-1c20-46a5-91b0-471ea1261eb5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049924 Aug 27 05:58:28.604500 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3787/7580] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:58:28.973914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:28.974516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:28.981567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:28.982049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:28.982486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:28.983223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:28.983675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:28.984097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:29.016280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:29.016758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:29.017191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:29.017638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lazy-loading 'fault' on Instance uuid b8bcb63e-c813-4756-b483-05888f06161b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:58:29.060487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:29.072589 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-04085578-7792-4e66-b896-8ce227068b08 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 200 len: 1307 microversion: 2.1 time: 0.102670 Aug 27 05:58:29.073163 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3794/7581] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:28 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:30.094815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:30.095563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:30.101927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.102490 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.102944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.103688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.104158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.104601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.118325 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] HTTP exception thrown: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Request method failure captured: Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b HTTP/1.1 Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbJpYZxC89cKlgeY6x_62j9kzJeT4nz0McQnyrDvxGD2SYBQBdthEX3wn8yDF19NXMDUKIBI17m0w8I2p8dg7YcRcJ9N3CYTA2Q44l5SJoBApKZzi24POWqRp17N-HZ9Plsj2KeSnCwFXJJdJOPRz7WM7zjV6Fqr01e_FpO1Iixe6bU Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61e2230a6dd84de2a73c6e013aa89a5d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 9e0a8c8eae6c4b928531e1d40f0abd6a Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'b8bcb63e-c813-4756-b483-05888f06161b'} Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:30.119989 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.124477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:30.124477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:30.124477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:30.124477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:58:30.124477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:58:30.124477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:30.124477 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.124477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Returning 404 to user: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:58:30.124477 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e0ef6af3-dae2-471d-b016-e97bc4dd17b0 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 404 len: 111 microversion: 2.1 time: 0.031883 Aug 27 05:58:30.124477 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3788/7582] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:30 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:58:30.131126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24c60193-be0f-4afd-a168-c48fe6eea53f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:30.131753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-24c60193-be0f-4afd-a168-c48fe6eea53f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:30.139187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c60193-be0f-4afd-a168-c48fe6eea53f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.139669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c60193-be0f-4afd-a168-c48fe6eea53f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.140104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c60193-be0f-4afd-a168-c48fe6eea53f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.140791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c60193-be0f-4afd-a168-c48fe6eea53f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.141245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c60193-be0f-4afd-a168-c48fe6eea53f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.141667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24c60193-be0f-4afd-a168-c48fe6eea53f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.273075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-24c60193-be0f-4afd-a168-c48fe6eea53f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:30.282123 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-24c60193-be0f-4afd-a168-c48fe6eea53f tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1504 microversion: 2.1 time: 0.154421 Aug 27 05:58:30.282744 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3795/7583] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:30 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:30.303782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a13aced7-61f2-46ed-ba2c-f68613e1a110 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:58:30.306069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a13aced7-61f2-46ed-ba2c-f68613e1a110 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: d2b58594-b07b-454c-9d6f-2f2bb566456e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:30.311651 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a13aced7-61f2-46ed-ba2c-f68613e1a110 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] HTTP exception thrown: Instance d2b58594-b07b-454c-9d6f-2f2bb566456e could not be found. Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a13aced7-61f2-46ed-ba2c-f68613e1a110 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Request method failure captured: Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/d2b58594-b07b-454c-9d6f-2f2bb566456e/action HTTP/1.1 Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 32 Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbJpYZxC89cKlgeY6x_62j9kzJeT4nz0McQnyrDvxGD2SYBQBdthEX3wn8yDF19NXMDUKIBI17m0w8I2p8dg7YcRcJ9N3CYTA2Q44l5SJoBApKZzi24POWqRp17N-HZ9Plsj2KeSnCwFXJJdJOPRz7WM7zjV6Fqr01e_FpO1Iixe6bU Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61e2230a6dd84de2a73c6e013aa89a5d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 9e0a8c8eae6c4b928531e1d40f0abd6a Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: {"resize": {"flavorRef": "452"}} Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance d2b58594-b07b-454c-9d6f-2f2bb566456e could not be found. Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'd2b58594-b07b-454c-9d6f-2f2bb566456e', 'body': {'resize': {'flavorRef': '452'}}} Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b58594-b07b-454c-9d6f-2f2bb566456e could not be found. Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1162, in _action_resize Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1069, in _resize Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:58:30.313242 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b58594-b07b-454c-9d6f-2f2bb566456e could not be found. Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b58594-b07b-454c-9d6f-2f2bb566456e could not be found. Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a13aced7-61f2-46ed-ba2c-f68613e1a110 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Returning 404 to user: Instance d2b58594-b07b-454c-9d6f-2f2bb566456e could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a13aced7-61f2-46ed-ba2c-f68613e1a110 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "POST /compute/v2.1/servers/d2b58594-b07b-454c-9d6f-2f2bb566456e/action" status: 404 len: 111 microversion: 2.1 time: 0.015083 Aug 27 05:58:30.318176 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3789/7584] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:58:30 2022] POST /compute/v2.1/servers/d2b58594-b07b-454c-9d6f-2f2bb566456e/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:58:30.323586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0090539e-6f72-4ab3-a5db-6bc5a65394ea tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:30.324209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0090539e-6f72-4ab3-a5db-6bc5a65394ea tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:30.330232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0090539e-6f72-4ab3-a5db-6bc5a65394ea tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.330755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0090539e-6f72-4ab3-a5db-6bc5a65394ea tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.331219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0090539e-6f72-4ab3-a5db-6bc5a65394ea tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.331911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0090539e-6f72-4ab3-a5db-6bc5a65394ea tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.332369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0090539e-6f72-4ab3-a5db-6bc5a65394ea tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.332871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0090539e-6f72-4ab3-a5db-6bc5a65394ea tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.337645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:30.465079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0090539e-6f72-4ab3-a5db-6bc5a65394ea tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:30.472891 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0090539e-6f72-4ab3-a5db-6bc5a65394ea tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1504 microversion: 2.1 time: 0.153299 Aug 27 05:58:30.473470 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3796/7585] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:30 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:30.496975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-192e54f1-7c13-469a-9ef1-3534115e9d77 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:30.498509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-192e54f1-7c13-469a-9ef1-3534115e9d77 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:30.506030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192e54f1-7c13-469a-9ef1-3534115e9d77 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.506614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192e54f1-7c13-469a-9ef1-3534115e9d77 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.507172 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192e54f1-7c13-469a-9ef1-3534115e9d77 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.508032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192e54f1-7c13-469a-9ef1-3534115e9d77 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.509364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192e54f1-7c13-469a-9ef1-3534115e9d77 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.510043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-192e54f1-7c13-469a-9ef1-3534115e9d77 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.649680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-192e54f1-7c13-469a-9ef1-3534115e9d77 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:30.660778 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-192e54f1-7c13-469a-9ef1-3534115e9d77 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1504 microversion: 2.1 time: 0.169238 Aug 27 05:58:30.661360 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3790/7586] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:30 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:30.682598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "473aea15-ce28-45e3-a634-c0f8706417ed"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:58:30.684972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:30.691349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.691860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.692294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.692994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.693477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.693927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.725409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:30.731537 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] HTTP exception thrown: Flavor 473aea15-ce28-45e3-a634-c0f8706417ed could not be found. Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Request method failure captured: Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: request: POST /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269/action HTTP/1.1 Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 65 Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbJpYZxC89cKlgeY6x_62j9kzJeT4nz0McQnyrDvxGD2SYBQBdthEX3wn8yDF19NXMDUKIBI17m0w8I2p8dg7YcRcJ9N3CYTA2Q44l5SJoBApKZzi24POWqRp17N-HZ9Plsj2KeSnCwFXJJdJOPRz7WM7zjV6Fqr01e_FpO1Iixe6bU Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61e2230a6dd84de2a73c6e013aa89a5d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9e0a8c8eae6c4b928531e1d40f0abd6a Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: {"resize": {"flavorRef": "473aea15-ce28-45e3-a634-c0f8706417ed"}} Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: exception: Flavor 473aea15-ce28-45e3-a634-c0f8706417ed could not be found. Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '13b33c9c-6fdd-4a48-9584-c7a94031c269', 'body': {'resize': {'flavorRef': '473aea15-ce28-45e3-a634-c0f8706417ed'}}} Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1076, in _resize Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:58:30.733454 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 473aea15-ce28-45e3-a634-c0f8706417ed could not be found. Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1162, in _action_resize Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1106, in _resize Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 473aea15-ce28-45e3-a634-c0f8706417ed could not be found. Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 473aea15-ce28-45e3-a634-c0f8706417ed could not be found. Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Returning 400 to user: Flavor 473aea15-ce28-45e3-a634-c0f8706417ed could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2b33cc46-8607-4fd3-b37d-ce78cbb1fbc3 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "POST /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269/action" status: 400 len: 107 microversion: 2.1 time: 0.056855 Aug 27 05:58:30.738100 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3797/7587] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:58:30 2022] POST /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269/action => generated 107 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:58:30.744458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2eb1590f-8843-480e-b120-73db02a07120 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:30.745117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2eb1590f-8843-480e-b120-73db02a07120 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:30.751479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb1590f-8843-480e-b120-73db02a07120 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.751984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb1590f-8843-480e-b120-73db02a07120 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.752445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb1590f-8843-480e-b120-73db02a07120 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.753162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb1590f-8843-480e-b120-73db02a07120 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.753634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb1590f-8843-480e-b120-73db02a07120 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.754073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2eb1590f-8843-480e-b120-73db02a07120 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.892358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2eb1590f-8843-480e-b120-73db02a07120 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:30.900242 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2eb1590f-8843-480e-b120-73db02a07120 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1504 microversion: 2.1 time: 0.160340 Aug 27 05:58:30.900827 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3791/7588] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:30 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:30.922240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eccf29ed-2352-4b9b-a88e-9a1588f59cdc tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:30.923009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eccf29ed-2352-4b9b-a88e-9a1588f59cdc tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:30.929089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eccf29ed-2352-4b9b-a88e-9a1588f59cdc tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.929565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eccf29ed-2352-4b9b-a88e-9a1588f59cdc tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.929995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eccf29ed-2352-4b9b-a88e-9a1588f59cdc tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:30.931290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eccf29ed-2352-4b9b-a88e-9a1588f59cdc tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:30.931921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eccf29ed-2352-4b9b-a88e-9a1588f59cdc tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:30.932342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eccf29ed-2352-4b9b-a88e-9a1588f59cdc tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:31.066466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eccf29ed-2352-4b9b-a88e-9a1588f59cdc tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:31.074488 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eccf29ed-2352-4b9b-a88e-9a1588f59cdc tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1504 microversion: 2.1 time: 0.156830 Aug 27 05:58:31.075069 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3798/7589] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:30 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:31.095959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ceae9b74-b01b-4e39-aff3-a8ea05e5c5b5 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ceae9b74-b01b-4e39-aff3-a8ea05e5c5b5 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Request method failure captured: Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: request: POST /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269/action HTTP/1.1 Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 29 Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbJpYZxC89cKlgeY6x_62j9kzJeT4nz0McQnyrDvxGD2SYBQBdthEX3wn8yDF19NXMDUKIBI17m0w8I2p8dg7YcRcJ9N3CYTA2Q44l5SJoBApKZzi24POWqRp17N-HZ9Plsj2KeSnCwFXJJdJOPRz7WM7zjV6Fqr01e_FpO1Iixe6bU Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61e2230a6dd84de2a73c6e013aa89a5d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 9e0a8c8eae6c4b928531e1d40f0abd6a Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: {"resize": {"flavorRef": ""}} Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '13b33c9c-6fdd-4a48-9584-c7a94031c269', 'body': {'resize': {'flavorRef': ''}}} Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi '' Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.099634 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:31.105390 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.105390 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:31.105390 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:31.105390 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:31.105390 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:58:31.105390 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:58:31.105390 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 05:58:31.105390 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.105390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ceae9b74-b01b-4e39-aff3-a8ea05e5c5b5 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:58:31.105390 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ceae9b74-b01b-4e39-aff3-a8ea05e5c5b5 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "POST /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269/action" status: 400 len: 113 microversion: 2.1 time: 0.010085 Aug 27 05:58:31.105390 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3792/7590] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 05:58:31 2022] POST /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:58:31.110419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-53ced73f-7fa1-49c2-9f71-e69e9a596b2a tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:31.111044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-53ced73f-7fa1-49c2-9f71-e69e9a596b2a tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:31.118265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53ced73f-7fa1-49c2-9f71-e69e9a596b2a tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:31.118762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53ced73f-7fa1-49c2-9f71-e69e9a596b2a tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:31.119279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53ced73f-7fa1-49c2-9f71-e69e9a596b2a tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:31.119988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53ced73f-7fa1-49c2-9f71-e69e9a596b2a tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:31.120445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53ced73f-7fa1-49c2-9f71-e69e9a596b2a tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:31.120876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-53ced73f-7fa1-49c2-9f71-e69e9a596b2a tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:31.257160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-53ced73f-7fa1-49c2-9f71-e69e9a596b2a tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:31.265632 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-53ced73f-7fa1-49c2-9f71-e69e9a596b2a tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1504 microversion: 2.1 time: 0.159061 Aug 27 05:58:31.266204 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3799/7591] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:31 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:31.290575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:31.291108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:31.298725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:31.299250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:31.299703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:31.300410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:31.300876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:31.301315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:31.314481 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] HTTP exception thrown: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Request method failure captured: Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b HTTP/1.1 Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbJpYZxC89cKlgeY6x_62j9kzJeT4nz0McQnyrDvxGD2SYBQBdthEX3wn8yDF19NXMDUKIBI17m0w8I2p8dg7YcRcJ9N3CYTA2Q44l5SJoBApKZzi24POWqRp17N-HZ9Plsj2KeSnCwFXJJdJOPRz7WM7zjV6Fqr01e_FpO1Iixe6bU Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61e2230a6dd84de2a73c6e013aa89a5d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 9e0a8c8eae6c4b928531e1d40f0abd6a Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'b8bcb63e-c813-4756-b483-05888f06161b'} Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1118, in delete Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:58:31.316055 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Returning 404 to user: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a7a19440-74b2-40d2-a7f9-3457f4c11b17 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 404 len: 111 microversion: 2.1 time: 0.030833 Aug 27 05:58:31.320516 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3793/7592] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:58:31 2022] DELETE /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:58:31.326393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:31.327006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: b8bcb63e-c813-4756-b483-05888f06161b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:31.333088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:31.333568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:31.334002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:31.334692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:31.335172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:31.335601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:31.349709 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] HTTP exception thrown: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Request method failure captured: Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b HTTP/1.1 Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbJpYZxC89cKlgeY6x_62j9kzJeT4nz0McQnyrDvxGD2SYBQBdthEX3wn8yDF19NXMDUKIBI17m0w8I2p8dg7YcRcJ9N3CYTA2Q44l5SJoBApKZzi24POWqRp17N-HZ9Plsj2KeSnCwFXJJdJOPRz7WM7zjV6Fqr01e_FpO1Iixe6bU Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61e2230a6dd84de2a73c6e013aa89a5d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9e0a8c8eae6c4b928531e1d40f0abd6a Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'b8bcb63e-c813-4756-b483-05888f06161b'} Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:31.351260 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.356035 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:31.356035 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:31.356035 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:31.356035 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:58:31.356035 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:58:31.356035 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. Aug 27 05:58:31.356035 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:31.356035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Returning 404 to user: Instance b8bcb63e-c813-4756-b483-05888f06161b could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:58:31.356035 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-78abcc80-9257-4332-84f5-a7113c8aec76 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b" status: 404 len: 111 microversion: 2.1 time: 0.030216 Aug 27 05:58:31.356035 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3800/7593] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:31 2022] GET /compute/v2.1/servers/b8bcb63e-c813-4756-b483-05888f06161b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:58:31.361845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f8b15c10-a403-4df9-9def-9b65d602a976 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:31.362363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f8b15c10-a403-4df9-9def-9b65d602a976 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:31.368314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b15c10-a403-4df9-9def-9b65d602a976 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:31.368818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b15c10-a403-4df9-9def-9b65d602a976 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:31.369276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b15c10-a403-4df9-9def-9b65d602a976 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:31.369985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b15c10-a403-4df9-9def-9b65d602a976 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:31.370455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b15c10-a403-4df9-9def-9b65d602a976 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:31.370898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f8b15c10-a403-4df9-9def-9b65d602a976 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:31.396605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f8b15c10-a403-4df9-9def-9b65d602a976 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:58:31.400112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=100 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:31.473721 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f8b15c10-a403-4df9-9def-9b65d602a976 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 204 len: 0 microversion: 2.1 time: 0.115363 Aug 27 05:58:31.474352 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3794/7594] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:58:31 2022] DELETE /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:58:31.483500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-27f3f46b-bbe2-4359-b87c-305491f76f02 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:31.484126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-27f3f46b-bbe2-4359-b87c-305491f76f02 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:31.490166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27f3f46b-bbe2-4359-b87c-305491f76f02 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:31.490657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27f3f46b-bbe2-4359-b87c-305491f76f02 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:31.491114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27f3f46b-bbe2-4359-b87c-305491f76f02 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:31.491824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27f3f46b-bbe2-4359-b87c-305491f76f02 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:31.492283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27f3f46b-bbe2-4359-b87c-305491f76f02 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:31.493342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-27f3f46b-bbe2-4359-b87c-305491f76f02 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:31.624688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-27f3f46b-bbe2-4359-b87c-305491f76f02 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:31.632463 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-27f3f46b-bbe2-4359-b87c-305491f76f02 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1510 microversion: 2.1 time: 0.153269 Aug 27 05:58:31.633022 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3801/7595] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:31 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:32.654986 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1287c6c1-798b-443b-ae25-e1c4c4cfb3fb tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:32.655764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1287c6c1-798b-443b-ae25-e1c4c4cfb3fb tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:32.658533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:58:32.665149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1287c6c1-798b-443b-ae25-e1c4c4cfb3fb tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:32.665682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1287c6c1-798b-443b-ae25-e1c4c4cfb3fb tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:32.666134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1287c6c1-798b-443b-ae25-e1c4c4cfb3fb tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:32.666835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1287c6c1-798b-443b-ae25-e1c4c4cfb3fb tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:32.667497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1287c6c1-798b-443b-ae25-e1c4c4cfb3fb tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:32.667934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1287c6c1-798b-443b-ae25-e1c4c4cfb3fb tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:32.800085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1287c6c1-798b-443b-ae25-e1c4c4cfb3fb tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:32.809287 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1287c6c1-798b-443b-ae25-e1c4c4cfb3fb tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1510 microversion: 2.1 time: 0.158616 Aug 27 05:58:32.809871 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3795/7596] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:32 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:58:33.808085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6402f91b-9646-4f8e-8eb2-785f253eec33 req-d1c1d353-1b7b-4c0b-8ca8-a5162079129d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b33c9c-6fdd-4a48-9584-c7a94031c269", "name": "network-vif-deleted", "tag": "e79a1770-cbd0-4d5d-bf53-0be00be6b044"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:58:33.818087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6402f91b-9646-4f8e-8eb2-785f253eec33 req-d1c1d353-1b7b-4c0b-8ca8-a5162079129d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:33.818581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6402f91b-9646-4f8e-8eb2-785f253eec33 req-d1c1d353-1b7b-4c0b-8ca8-a5162079129d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:33.819206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6402f91b-9646-4f8e-8eb2-785f253eec33 req-d1c1d353-1b7b-4c0b-8ca8-a5162079129d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:33.830637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-131bdaf9-e5dd-45ca-a79d-c234052c5479 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:33.831405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-131bdaf9-e5dd-45ca-a79d-c234052c5479 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:33.832356 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6402f91b-9646-4f8e-8eb2-785f253eec33 req-d1c1d353-1b7b-4c0b-8ca8-a5162079129d service nova] Creating event network-vif-deleted:e79a1770-cbd0-4d5d-bf53-0be00be6b044 for instance 13b33c9c-6fdd-4a48-9584-c7a94031c269 on n-h1-820368-35 Aug 27 05:58:33.839012 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6402f91b-9646-4f8e-8eb2-785f253eec33 req-d1c1d353-1b7b-4c0b-8ca8-a5162079129d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034366 Aug 27 05:58:33.840454 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3802/7597] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:58:33.844961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-131bdaf9-e5dd-45ca-a79d-c234052c5479 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:33.845509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-131bdaf9-e5dd-45ca-a79d-c234052c5479 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:33.846015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-131bdaf9-e5dd-45ca-a79d-c234052c5479 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:33.846777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-131bdaf9-e5dd-45ca-a79d-c234052c5479 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:33.847280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-131bdaf9-e5dd-45ca-a79d-c234052c5479 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:33.847724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-131bdaf9-e5dd-45ca-a79d-c234052c5479 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:33.916956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-131bdaf9-e5dd-45ca-a79d-c234052c5479 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0a8c8eae6c4b928531e1d40f0abd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2230a6dd84de2a73c6e013aa89a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:58:33.926726 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-131bdaf9-e5dd-45ca-a79d-c234052c5479 tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 200 len: 1468 microversion: 2.1 time: 0.100303 Aug 27 05:58:33.927675 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3796/7598] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:33 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 1468 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:58:34.949668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:58:34.950416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] [instance: 13b33c9c-6fdd-4a48-9584-c7a94031c269] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:58:34.956836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:34.957317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:34.957753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:34.958451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:58:34.958902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:58:34.959352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:58:34.973307 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] HTTP exception thrown: Instance 13b33c9c-6fdd-4a48-9584-c7a94031c269 could not be found. Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Request method failure captured: Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 HTTP/1.1 Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbJpYZxC89cKlgeY6x_62j9kzJeT4nz0McQnyrDvxGD2SYBQBdthEX3wn8yDF19NXMDUKIBI17m0w8I2p8dg7YcRcJ9N3CYTA2Q44l5SJoBApKZzi24POWqRp17N-HZ9Plsj2KeSnCwFXJJdJOPRz7WM7zjV6Fqr01e_FpO1Iixe6bU Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61e2230a6dd84de2a73c6e013aa89a5d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61e2230a6dd84de2a73c6e013aa89a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 61e2230a6dd84de2a73c6e013aa89a5d Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1910486615 Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 9e0a8c8eae6c4b928531e1d40f0abd6a Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-ServersNegativeTestJSON-1910486615-project Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 13b33c9c-6fdd-4a48-9584-c7a94031c269 could not be found. Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '13b33c9c-6fdd-4a48-9584-c7a94031c269'} Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b33c9c-6fdd-4a48-9584-c7a94031c269 could not be found. Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b33c9c-6fdd-4a48-9584-c7a94031c269 could not be found. Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:58:34.974953 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:34.980222 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:58:34.980222 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:58:34.980222 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:58:34.980222 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:58:34.980222 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:58:34.980222 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b33c9c-6fdd-4a48-9584-c7a94031c269 could not be found. Aug 27 05:58:34.980222 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 05:58:34.980222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] Returning 404 to user: Instance 13b33c9c-6fdd-4a48-9584-c7a94031c269 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:58:34.980222 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cc098938-2156-4251-a94d-9d21568f092b tempest-ServersNegativeTestJSON-1910486615 tempest-ServersNegativeTestJSON-1910486615-project] 10.222.0.58 "GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269" status: 404 len: 111 microversion: 2.1 time: 0.031931 Aug 27 05:58:34.980222 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3803/7599] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:58:34 2022] GET /compute/v2.1/servers/13b33c9c-6fdd-4a48-9584-c7a94031c269 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:59:06.255907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:06.257394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:06.477547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a01f9dc1-6dd7-4efa-8f96-0fe4711c9761 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Action: 'create', calling method: .version_select at 0x7fb55ffb35e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-125437817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuNJ1q+9j7SPBxCeLGs3hrkzGTWVNASOoRxkmVBKVQl4TC6piUBSUS4NCQCZLhRHXA6zQmTg4BA/jTCqMv+ynziZcKa3OkGe5A3s4H2TplVLk+iNTMMx+BZa4zUE+mOLw=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:06.502873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a01f9dc1-6dd7-4efa-8f96-0fe4711c9761 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for project 86b388156db6495982d55edf1d113ca9. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:59:06.509279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a01f9dc1-6dd7-4efa-8f96-0fe4711c9761 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for user feeb15fb481148ac9777214ed6bfa1e6 and project 86b388156db6495982d55edf1d113ca9. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:59:06.538251 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a01f9dc1-6dd7-4efa-8f96-0fe4711c9761 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.287967 Aug 27 05:59:06.538793 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3797/7600] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:59:06 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:06.601647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1354988606", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-125437817", "networks": [{"uuid": "5b3fa187-a93e-4622-b2e5-77a0e0389731"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:06.610923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:06.611623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=32 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:06.662489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] validate_networks() for [('5b3fa187-a93e-4622-b2e5-77a0e0389731', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:59:07.052688 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:59:07.053124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:59:07.053605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:59:07.054025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:59:07.054480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:59:07.064093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:07.064580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:07.065023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:07.065755 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:07.066215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:07.066645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:07.084813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for project 86b388156db6495982d55edf1d113ca9. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:59:07.090738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for user feeb15fb481148ac9777214ed6bfa1e6 and project 86b388156db6495982d55edf1d113ca9. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:59:07.104291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:59:07.106622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:59:07.153854 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d3e25a69-8ee3-4299-8ab5-7359d86ffaf2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556114 Aug 27 05:59:07.154721 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3804/7601] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:59:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:59:07.170454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7168e010-a3f7-4472-ad9b-7bb0cb564d39 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:07.171601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7168e010-a3f7-4472-ad9b-7bb0cb564d39 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:07.243633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7168e010-a3f7-4472-ad9b-7bb0cb564d39 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:07.252915 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7168e010-a3f7-4472-ad9b-7bb0cb564d39 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1262 microversion: 2.1 time: 0.091389 Aug 27 05:59:07.253492 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3798/7602] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:07 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:08.275076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f4cdeee5-4a1e-4a4e-8c44-76f7a74024ac tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:08.275787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f4cdeee5-4a1e-4a4e-8c44-76f7a74024ac tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:08.287701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4cdeee5-4a1e-4a4e-8c44-76f7a74024ac tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:08.288370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4cdeee5-4a1e-4a4e-8c44-76f7a74024ac tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:08.289458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4cdeee5-4a1e-4a4e-8c44-76f7a74024ac tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:08.290201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4cdeee5-4a1e-4a4e-8c44-76f7a74024ac tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:08.290670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4cdeee5-4a1e-4a4e-8c44-76f7a74024ac tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:08.291126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4cdeee5-4a1e-4a4e-8c44-76f7a74024ac tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:08.688617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f4cdeee5-4a1e-4a4e-8c44-76f7a74024ac tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:08.699845 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f4cdeee5-4a1e-4a4e-8c44-76f7a74024ac tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1322 microversion: 2.1 time: 0.430225 Aug 27 05:59:08.700807 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3805/7603] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:08 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:09.721793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed95fe88-c0b9-4d51-b329-139ffeefb2f6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:09.722486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed95fe88-c0b9-4d51-b329-139ffeefb2f6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:09.731552 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed95fe88-c0b9-4d51-b329-139ffeefb2f6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:09.731976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed95fe88-c0b9-4d51-b329-139ffeefb2f6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:09.732430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed95fe88-c0b9-4d51-b329-139ffeefb2f6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:09.733240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed95fe88-c0b9-4d51-b329-139ffeefb2f6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:09.733714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed95fe88-c0b9-4d51-b329-139ffeefb2f6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:09.734177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed95fe88-c0b9-4d51-b329-139ffeefb2f6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:09.977017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ed95fe88-c0b9-4d51-b329-139ffeefb2f6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:09.985982 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed95fe88-c0b9-4d51-b329-139ffeefb2f6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1362 microversion: 2.1 time: 0.268268 Aug 27 05:59:09.986565 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3799/7604] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:09 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:10.125552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-fdc12cfc-659f-4111-ada9-e2afc8432dd1 req-79cd70d0-28ec-4a8a-ae9a-c263754b2225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865144e7-3a6a-4ca9-a64d-0f91050ea6b5", "tag": "eac62ea5-930b-4c59-b458-1f469cab5b86"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:10.142749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fdc12cfc-659f-4111-ada9-e2afc8432dd1 req-79cd70d0-28ec-4a8a-ae9a-c263754b2225 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:10.143853 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fdc12cfc-659f-4111-ada9-e2afc8432dd1 req-79cd70d0-28ec-4a8a-ae9a-c263754b2225 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:10.144500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fdc12cfc-659f-4111-ada9-e2afc8432dd1 req-79cd70d0-28ec-4a8a-ae9a-c263754b2225 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:10.161080 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-fdc12cfc-659f-4111-ada9-e2afc8432dd1 req-79cd70d0-28ec-4a8a-ae9a-c263754b2225 service nova] Creating event network-changed:eac62ea5-930b-4c59-b458-1f469cab5b86 for instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 on n-h1-820368-35 Aug 27 05:59:10.168767 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-fdc12cfc-659f-4111-ada9-e2afc8432dd1 req-79cd70d0-28ec-4a8a-ae9a-c263754b2225 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049442 Aug 27 05:59:10.175033 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3806/7605] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:59:11.008462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-67721e2f-5610-45d4-8328-3a7ff161a68e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:11.009078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-67721e2f-5610-45d4-8328-3a7ff161a68e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:11.016085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67721e2f-5610-45d4-8328-3a7ff161a68e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:11.016579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67721e2f-5610-45d4-8328-3a7ff161a68e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:11.017028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67721e2f-5610-45d4-8328-3a7ff161a68e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:11.017729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67721e2f-5610-45d4-8328-3a7ff161a68e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:11.018196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67721e2f-5610-45d4-8328-3a7ff161a68e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:11.018631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-67721e2f-5610-45d4-8328-3a7ff161a68e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:11.147785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-67721e2f-5610-45d4-8328-3a7ff161a68e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:11.156105 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-67721e2f-5610-45d4-8328-3a7ff161a68e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1362 microversion: 2.1 time: 0.151566 Aug 27 05:59:11.156671 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3800/7606] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:11 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:12.177675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f03c38a-1e91-423a-ac88-9504099abeba tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:12.178588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f03c38a-1e91-423a-ac88-9504099abeba tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:12.186240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f03c38a-1e91-423a-ac88-9504099abeba tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:12.186759 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f03c38a-1e91-423a-ac88-9504099abeba tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:12.187229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f03c38a-1e91-423a-ac88-9504099abeba tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:12.187929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f03c38a-1e91-423a-ac88-9504099abeba tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:12.188415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f03c38a-1e91-423a-ac88-9504099abeba tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:12.188844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f03c38a-1e91-423a-ac88-9504099abeba tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:12.319535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f03c38a-1e91-423a-ac88-9504099abeba tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:12.327512 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f03c38a-1e91-423a-ac88-9504099abeba tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1362 microversion: 2.1 time: 0.154214 Aug 27 05:59:12.328083 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3807/7607] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:12 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:13.348783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5ec4298-5764-4801-8f17-62bcfafc598e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:13.349453 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b5ec4298-5764-4801-8f17-62bcfafc598e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:13.356548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ec4298-5764-4801-8f17-62bcfafc598e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:13.357052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ec4298-5764-4801-8f17-62bcfafc598e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:13.357504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ec4298-5764-4801-8f17-62bcfafc598e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:13.358221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ec4298-5764-4801-8f17-62bcfafc598e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:13.358695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ec4298-5764-4801-8f17-62bcfafc598e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:13.359166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5ec4298-5764-4801-8f17-62bcfafc598e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:13.494046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5ec4298-5764-4801-8f17-62bcfafc598e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:13.501766 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5ec4298-5764-4801-8f17-62bcfafc598e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1362 microversion: 2.1 time: 0.157035 Aug 27 05:59:13.502339 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3801/7608] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:13 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:14.523009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-614c90e9-0e8c-47cd-9370-991860cf8c73 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:14.523699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-614c90e9-0e8c-47cd-9370-991860cf8c73 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:14.531625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-614c90e9-0e8c-47cd-9370-991860cf8c73 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:14.532116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-614c90e9-0e8c-47cd-9370-991860cf8c73 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:14.532560 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-614c90e9-0e8c-47cd-9370-991860cf8c73 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:14.533267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-614c90e9-0e8c-47cd-9370-991860cf8c73 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:14.533726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-614c90e9-0e8c-47cd-9370-991860cf8c73 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:14.534154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-614c90e9-0e8c-47cd-9370-991860cf8c73 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:14.664480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-614c90e9-0e8c-47cd-9370-991860cf8c73 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:14.673052 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-614c90e9-0e8c-47cd-9370-991860cf8c73 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1362 microversion: 2.1 time: 0.153936 Aug 27 05:59:14.673617 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3808/7609] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:14 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:15.693517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a88c9c55-8b4d-435c-82ce-126a08836c4b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:15.694197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a88c9c55-8b4d-435c-82ce-126a08836c4b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:15.702604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a88c9c55-8b4d-435c-82ce-126a08836c4b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:15.703059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a88c9c55-8b4d-435c-82ce-126a08836c4b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:15.703538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a88c9c55-8b4d-435c-82ce-126a08836c4b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:15.704276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a88c9c55-8b4d-435c-82ce-126a08836c4b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:15.704742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a88c9c55-8b4d-435c-82ce-126a08836c4b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:15.705419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a88c9c55-8b4d-435c-82ce-126a08836c4b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:15.835829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a88c9c55-8b4d-435c-82ce-126a08836c4b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:15.844261 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a88c9c55-8b4d-435c-82ce-126a08836c4b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1362 microversion: 2.1 time: 0.154639 Aug 27 05:59:15.845087 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3802/7610] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:15 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:16.866555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b82cf51f-52d8-41f1-8011-3e3435671a10 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:16.867206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b82cf51f-52d8-41f1-8011-3e3435671a10 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:16.874940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82cf51f-52d8-41f1-8011-3e3435671a10 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:16.875486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82cf51f-52d8-41f1-8011-3e3435671a10 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:16.875962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82cf51f-52d8-41f1-8011-3e3435671a10 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:16.876640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82cf51f-52d8-41f1-8011-3e3435671a10 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:16.877104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82cf51f-52d8-41f1-8011-3e3435671a10 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:16.877542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b82cf51f-52d8-41f1-8011-3e3435671a10 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:17.026201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b82cf51f-52d8-41f1-8011-3e3435671a10 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:17.026959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-945d0db5-b5da-4f02-8267-ccc38927a602 req-a978116a-7a42-4c71-9fbc-50c55e9af6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865144e7-3a6a-4ca9-a64d-0f91050ea6b5", "name": "network-vif-plugged", "status": "completed", "tag": "eac62ea5-930b-4c59-b458-1f469cab5b86"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:17.037067 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b82cf51f-52d8-41f1-8011-3e3435671a10 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1362 microversion: 2.1 time: 0.174193 Aug 27 05:59:17.037642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-945d0db5-b5da-4f02-8267-ccc38927a602 req-a978116a-7a42-4c71-9fbc-50c55e9af6f2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:17.038205 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-945d0db5-b5da-4f02-8267-ccc38927a602 req-a978116a-7a42-4c71-9fbc-50c55e9af6f2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:17.038910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-945d0db5-b5da-4f02-8267-ccc38927a602 req-a978116a-7a42-4c71-9fbc-50c55e9af6f2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:17.051629 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3809/7611] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:16 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:17.051840 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-945d0db5-b5da-4f02-8267-ccc38927a602 req-a978116a-7a42-4c71-9fbc-50c55e9af6f2 service nova] Creating event network-vif-plugged:eac62ea5-930b-4c59-b458-1f469cab5b86 for instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 on n-h1-820368-35 Aug 27 05:59:17.057458 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-945d0db5-b5da-4f02-8267-ccc38927a602 req-a978116a-7a42-4c71-9fbc-50c55e9af6f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034864 Aug 27 05:59:17.058515 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3803/7612] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:18.060661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f2df7161-cbb5-4230-a4b8-51d10072720d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:18.061202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f2df7161-cbb5-4230-a4b8-51d10072720d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:18.063137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:18.063818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:18.070471 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2df7161-cbb5-4230-a4b8-51d10072720d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:18.070990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2df7161-cbb5-4230-a4b8-51d10072720d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:18.071466 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2df7161-cbb5-4230-a4b8-51d10072720d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:18.072174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2df7161-cbb5-4230-a4b8-51d10072720d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:18.072634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2df7161-cbb5-4230-a4b8-51d10072720d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:18.073068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f2df7161-cbb5-4230-a4b8-51d10072720d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:18.204006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f2df7161-cbb5-4230-a4b8-51d10072720d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:18.211660 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f2df7161-cbb5-4230-a4b8-51d10072720d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1362 microversion: 2.1 time: 0.155032 Aug 27 05:59:18.212233 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3810/7613] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:18 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:19.228964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:19.234303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8c05a799-daf8-4214-bcef-998853419e63 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:19.235046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8c05a799-daf8-4214-bcef-998853419e63 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:19.241718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c05a799-daf8-4214-bcef-998853419e63 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:19.242225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c05a799-daf8-4214-bcef-998853419e63 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:19.243268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c05a799-daf8-4214-bcef-998853419e63 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:19.244002 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c05a799-daf8-4214-bcef-998853419e63 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:19.244467 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c05a799-daf8-4214-bcef-998853419e63 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:19.244913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8c05a799-daf8-4214-bcef-998853419e63 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:19.398072 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8c05a799-daf8-4214-bcef-998853419e63 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:19.407373 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8c05a799-daf8-4214-bcef-998853419e63 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1554 microversion: 2.1 time: 0.179253 Aug 27 05:59:19.407955 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3804/7614] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:19 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:19.427546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5680cd2a-b953-414c-8764-79868fa2e3d4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:19.428202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5680cd2a-b953-414c-8764-79868fa2e3d4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:19.435559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5680cd2a-b953-414c-8764-79868fa2e3d4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:19.436043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5680cd2a-b953-414c-8764-79868fa2e3d4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:19.436483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5680cd2a-b953-414c-8764-79868fa2e3d4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:19.437177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5680cd2a-b953-414c-8764-79868fa2e3d4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:19.437630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5680cd2a-b953-414c-8764-79868fa2e3d4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:19.438060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5680cd2a-b953-414c-8764-79868fa2e3d4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:19.573483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5680cd2a-b953-414c-8764-79868fa2e3d4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:19.581271 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5680cd2a-b953-414c-8764-79868fa2e3d4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1554 microversion: 2.1 time: 0.157655 Aug 27 05:59:19.581858 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3811/7615] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:19 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:21.190196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-520a222a-9a73-4810-8467-7dcc86b3d7b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "931363e8-1a4c-427d-9de2-dd22dd457d50"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:21.192662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-520a222a-9a73-4810-8467-7dcc86b3d7b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:21.199612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-520a222a-9a73-4810-8467-7dcc86b3d7b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:21.200107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-520a222a-9a73-4810-8467-7dcc86b3d7b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:21.200558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-520a222a-9a73-4810-8467-7dcc86b3d7b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:21.201259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-520a222a-9a73-4810-8467-7dcc86b3d7b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:21.201724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-520a222a-9a73-4810-8467-7dcc86b3d7b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:21.202166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-520a222a-9a73-4810-8467-7dcc86b3d7b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:21.490100 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-520a222a-9a73-4810-8467-7dcc86b3d7b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "POST /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303644 Aug 27 05:59:21.490746 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3805/7616] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:59:21 2022] POST /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:33.294922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-55ebfbe7-6a46-48da-b3ab-2d60ac7e5a76 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:33.295537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-55ebfbe7-6a46-48da-b3ab-2d60ac7e5a76 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:33.298324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:33.298992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=40 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:33.304838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ebfbe7-6a46-48da-b3ab-2d60ac7e5a76 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:33.305336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ebfbe7-6a46-48da-b3ab-2d60ac7e5a76 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:33.305785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ebfbe7-6a46-48da-b3ab-2d60ac7e5a76 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:33.306538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ebfbe7-6a46-48da-b3ab-2d60ac7e5a76 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:33.307002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ebfbe7-6a46-48da-b3ab-2d60ac7e5a76 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:33.307469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55ebfbe7-6a46-48da-b3ab-2d60ac7e5a76 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:33.396632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-55ebfbe7-6a46-48da-b3ab-2d60ac7e5a76 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lazy-loading 'services' on Instance uuid 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:59:33.475752 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-55ebfbe7-6a46-48da-b3ab-2d60ac7e5a76 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments/931363e8-1a4c-427d-9de2-dd22dd457d50" status: 202 len: 0 microversion: 2.1 time: 0.184225 Aug 27 05:59:33.476393 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3812/7617] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:59:33 2022] DELETE /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments/931363e8-1a4c-427d-9de2-dd22dd457d50 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:59:33.485871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:33.486682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:33.491047 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a577319-3077-4b23-9ea8-512cdb308095 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:33.494026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a577319-3077-4b23-9ea8-512cdb308095 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:33.502532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a577319-3077-4b23-9ea8-512cdb308095 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:33.503178 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a577319-3077-4b23-9ea8-512cdb308095 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:33.503561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a577319-3077-4b23-9ea8-512cdb308095 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:33.504312 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a577319-3077-4b23-9ea8-512cdb308095 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:33.504807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a577319-3077-4b23-9ea8-512cdb308095 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:33.505252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a577319-3077-4b23-9ea8-512cdb308095 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:33.545191 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a577319-3077-4b23-9ea8-512cdb308095 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062348 Aug 27 05:59:33.545898 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3806/7618] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:59:33 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:34.559407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7533076a-30e7-477b-8d4e-08184f760621 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:34.562267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7533076a-30e7-477b-8d4e-08184f760621 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:34.569514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7533076a-30e7-477b-8d4e-08184f760621 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:34.570011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7533076a-30e7-477b-8d4e-08184f760621 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:34.570449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7533076a-30e7-477b-8d4e-08184f760621 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:34.571707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7533076a-30e7-477b-8d4e-08184f760621 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:34.572163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7533076a-30e7-477b-8d4e-08184f760621 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:34.572594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7533076a-30e7-477b-8d4e-08184f760621 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:34.612527 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7533076a-30e7-477b-8d4e-08184f760621 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058142 Aug 27 05:59:34.613109 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3813/7619] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:59:34 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:35.625328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e7c1b807-2108-4e01-8325-e32b6283ea6e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:35.627557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e7c1b807-2108-4e01-8325-e32b6283ea6e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:35.634901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c1b807-2108-4e01-8325-e32b6283ea6e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:35.635445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c1b807-2108-4e01-8325-e32b6283ea6e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:35.635953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c1b807-2108-4e01-8325-e32b6283ea6e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:35.636644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c1b807-2108-4e01-8325-e32b6283ea6e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:35.637123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c1b807-2108-4e01-8325-e32b6283ea6e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:35.637578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e7c1b807-2108-4e01-8325-e32b6283ea6e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:35.671498 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e7c1b807-2108-4e01-8325-e32b6283ea6e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049946 Aug 27 05:59:35.672125 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3807/7620] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:59:35 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:36.683101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8fc8b6c7-d7a3-4c9c-98c2-ef54a8f4c49a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:36.685359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8fc8b6c7-d7a3-4c9c-98c2-ef54a8f4c49a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:36.692180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fc8b6c7-d7a3-4c9c-98c2-ef54a8f4c49a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:36.692670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fc8b6c7-d7a3-4c9c-98c2-ef54a8f4c49a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:36.693137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fc8b6c7-d7a3-4c9c-98c2-ef54a8f4c49a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:36.693859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fc8b6c7-d7a3-4c9c-98c2-ef54a8f4c49a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:36.694293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fc8b6c7-d7a3-4c9c-98c2-ef54a8f4c49a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:36.694721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8fc8b6c7-d7a3-4c9c-98c2-ef54a8f4c49a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:36.724857 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8fc8b6c7-d7a3-4c9c-98c2-ef54a8f4c49a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045769 Aug 27 05:59:36.725427 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3814/7621] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:59:36 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:37.739387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a881395f-91d6-4dde-9989-bb9399a7dae0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:37.741871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a881395f-91d6-4dde-9989-bb9399a7dae0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:37.750251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a881395f-91d6-4dde-9989-bb9399a7dae0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:37.750744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a881395f-91d6-4dde-9989-bb9399a7dae0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:37.751227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a881395f-91d6-4dde-9989-bb9399a7dae0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:37.751947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a881395f-91d6-4dde-9989-bb9399a7dae0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:37.752414 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a881395f-91d6-4dde-9989-bb9399a7dae0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:37.752853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a881395f-91d6-4dde-9989-bb9399a7dae0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:37.790906 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a881395f-91d6-4dde-9989-bb9399a7dae0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055538 Aug 27 05:59:37.791852 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3808/7622] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:59:37 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:59:38.803438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cb10c888-c097-45d5-90ab-9251a6656d56 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:38.805713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cb10c888-c097-45d5-90ab-9251a6656d56 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:38.812565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb10c888-c097-45d5-90ab-9251a6656d56 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:38.813050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb10c888-c097-45d5-90ab-9251a6656d56 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:38.813489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb10c888-c097-45d5-90ab-9251a6656d56 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:38.814191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb10c888-c097-45d5-90ab-9251a6656d56 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:38.814647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb10c888-c097-45d5-90ab-9251a6656d56 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:38.815079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cb10c888-c097-45d5-90ab-9251a6656d56 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:38.845214 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cb10c888-c097-45d5-90ab-9251a6656d56 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045839 Aug 27 05:59:38.845786 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3815/7623] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 05:59:38 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:59:38.857357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:38.857902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:38.865262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:38.865758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:38.866206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:38.866909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:38.867406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:38.867839 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:38.943561 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] HTTP exception thrown: Instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 is not attached to volume 931363e8-1a4c-427d-9de2-dd22dd457d50 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Request method failure captured: Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments/931363e8-1a4c-427d-9de2-dd22dd457d50 HTTP/1.1 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbKl5DMlyT0gPmXMYneRB7eRO7xR6P94IkKsvopedoDaFcbJYgZWp6xpyWvpfGiYWpPGMBaqzcqapae5LbFtlBq0nG1PTfnhajdDjm5s-OQ5i-KYsXQgKtmKh1rw7aEmqRlZaqoSSV4rAsIVgzIzY9vMEC5A-w6_zAkeoYUnx20EBLA Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_86b388156db6495982d55edf1d113ca9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/86b388156db6495982d55edf1d113ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: feeb15fb481148ac9777214ed6bfa1e6 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 is not attached to volume 931363e8-1a4c-427d-9de2-dd22dd457d50 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'server_id': '865144e7-3a6a-4ca9-a64d-0f91050ea6b5', 'id': '931363e8-1a4c-427d-9de2-dd22dd457d50'} Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 931363e8-1a4c-427d-9de2-dd22dd457d50. Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 is not attached to volume 931363e8-1a4c-427d-9de2-dd22dd457d50 Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:59:38.953404 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:59:38.958093 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:59:38.958093 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:59:38.958093 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 is not attached to volume 931363e8-1a4c-427d-9de2-dd22dd457d50 Aug 27 05:59:38.958093 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:59:38.958093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Returning 404 to user: Instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 is not attached to volume 931363e8-1a4c-427d-9de2-dd22dd457d50 {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:59:38.958093 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-54f289c2-8909-44e3-9669-128863d9757c tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments/931363e8-1a4c-427d-9de2-dd22dd457d50" status: 404 len: 154 microversion: 2.1 time: 0.101536 Aug 27 05:59:38.958093 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3809/7624] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 05:59:38 2022] DELETE /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5/os-volume_attachments/931363e8-1a4c-427d-9de2-dd22dd457d50 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:59:42.337662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97221882-7e1f-4617-b6fe-0e1ee175f06d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:42.338218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97221882-7e1f-4617-b6fe-0e1ee175f06d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:42.345989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97221882-7e1f-4617-b6fe-0e1ee175f06d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:42.346156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97221882-7e1f-4617-b6fe-0e1ee175f06d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:42.346756 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97221882-7e1f-4617-b6fe-0e1ee175f06d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:42.347197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97221882-7e1f-4617-b6fe-0e1ee175f06d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:42.347652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97221882-7e1f-4617-b6fe-0e1ee175f06d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:42.348080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97221882-7e1f-4617-b6fe-0e1ee175f06d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:42.373946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97221882-7e1f-4617-b6fe-0e1ee175f06d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:59:42.454853 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-97221882-7e1f-4617-b6fe-0e1ee175f06d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 204 len: 0 microversion: 2.1 time: 0.121097 Aug 27 05:59:42.455768 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3816/7625] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 05:59:42 2022] DELETE /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:59:42.464005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c8001458-f8b7-43ed-b8f2-8070b53cd4ad tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:42.464669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c8001458-f8b7-43ed-b8f2-8070b53cd4ad tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:42.472318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8001458-f8b7-43ed-b8f2-8070b53cd4ad tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:42.472822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8001458-f8b7-43ed-b8f2-8070b53cd4ad tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:42.473283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8001458-f8b7-43ed-b8f2-8070b53cd4ad tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:42.474168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8001458-f8b7-43ed-b8f2-8070b53cd4ad tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:42.474644 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8001458-f8b7-43ed-b8f2-8070b53cd4ad tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:42.475106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8001458-f8b7-43ed-b8f2-8070b53cd4ad tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:42.609424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c8001458-f8b7-43ed-b8f2-8070b53cd4ad tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:42.617253 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c8001458-f8b7-43ed-b8f2-8070b53cd4ad tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1560 microversion: 2.1 time: 0.157434 Aug 27 05:59:42.618689 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3810/7626] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:42 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:43.640227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-51ffbc1a-6a0f-4783-9cee-1bef9628c402 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:43.640850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-51ffbc1a-6a0f-4783-9cee-1bef9628c402 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:43.643358 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:59:43.643491 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 05:59:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 (ip 10.222.0.58) !!! Aug 27 05:59:43.653068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51ffbc1a-6a0f-4783-9cee-1bef9628c402 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:43.653562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51ffbc1a-6a0f-4783-9cee-1bef9628c402 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:43.654006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51ffbc1a-6a0f-4783-9cee-1bef9628c402 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:43.654712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51ffbc1a-6a0f-4783-9cee-1bef9628c402 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:43.655196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51ffbc1a-6a0f-4783-9cee-1bef9628c402 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:43.655627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51ffbc1a-6a0f-4783-9cee-1bef9628c402 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:43.790089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-51ffbc1a-6a0f-4783-9cee-1bef9628c402 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:43.798434 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-51ffbc1a-6a0f-4783-9cee-1bef9628c402 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1560 microversion: 2.1 time: 0.162527 Aug 27 05:59:43.799037 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3817/7627] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:43 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:44.699895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0399a941-2565-4c1f-8ad0-2db6e51103c2 req-cac575ba-e5e4-4ee7-8bda-41ea67f22990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865144e7-3a6a-4ca9-a64d-0f91050ea6b5", "name": "network-vif-deleted", "tag": "eac62ea5-930b-4c59-b458-1f469cab5b86"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:44.712618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0399a941-2565-4c1f-8ad0-2db6e51103c2 req-cac575ba-e5e4-4ee7-8bda-41ea67f22990 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:44.713107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0399a941-2565-4c1f-8ad0-2db6e51103c2 req-cac575ba-e5e4-4ee7-8bda-41ea67f22990 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:44.713553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0399a941-2565-4c1f-8ad0-2db6e51103c2 req-cac575ba-e5e4-4ee7-8bda-41ea67f22990 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:44.725771 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0399a941-2565-4c1f-8ad0-2db6e51103c2 req-cac575ba-e5e4-4ee7-8bda-41ea67f22990 service nova] Creating event network-vif-deleted:eac62ea5-930b-4c59-b458-1f469cab5b86 for instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 on n-h1-820368-35 Aug 27 05:59:44.736707 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0399a941-2565-4c1f-8ad0-2db6e51103c2 req-cac575ba-e5e4-4ee7-8bda-41ea67f22990 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041269 Aug 27 05:59:44.737608 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3811/7628] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:44.821361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:44.822005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:44.829233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:44.829839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:44.830143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:44.830844 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:44.831311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:44.831742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:44.869018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:44.869500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:44.870056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:44.870635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lazy-loading 'fault' on Instance uuid 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:59:44.913449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:44.922410 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6ac4af8-8cb6-445f-a8c2-303043a1c11a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 200 len: 1352 microversion: 2.1 time: 0.105949 Aug 27 05:59:44.923006 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3818/7629] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:44 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:45.944979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:45.945704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 865144e7-3a6a-4ca9-a64d-0f91050ea6b5] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:45.951960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:45.952458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:45.952910 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:45.953620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:45.954088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:45.954527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:45.967576 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] HTTP exception thrown: Instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 could not be found. Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Request method failure captured: Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 HTTP/1.1 Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbKl5DMlyT0gPmXMYneRB7eRO7xR6P94IkKsvopedoDaFcbJYgZWp6xpyWvpfGiYWpPGMBaqzcqapae5LbFtlBq0nG1PTfnhajdDjm5s-OQ5i-KYsXQgKtmKh1rw7aEmqRlZaqoSSV4rAsIVgzIzY9vMEC5A-w6_zAkeoYUnx20EBLA Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_86b388156db6495982d55edf1d113ca9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/86b388156db6495982d55edf1d113ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: feeb15fb481148ac9777214ed6bfa1e6 Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 could not be found. Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '865144e7-3a6a-4ca9-a64d-0f91050ea6b5'} Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 could not be found. Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 could not be found. Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:59:45.969212 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:59:45.974458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:59:45.974458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:59:45.974458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:59:45.974458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:59:45.974458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:59:45.974458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:59:45.974458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 could not be found. Aug 27 05:59:45.974458 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 05:59:45.974458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Returning 404 to user: Instance 865144e7-3a6a-4ca9-a64d-0f91050ea6b5 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:59:45.974458 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-46353a1b-e5b8-4904-a165-e2d6eb4a2378 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5" status: 404 len: 111 microversion: 2.1 time: 0.030831 Aug 27 05:59:45.974458 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3812/7630] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:45 2022] GET /compute/v2.1/servers/865144e7-3a6a-4ca9-a64d-0f91050ea6b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:59:45.980697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bb94f628-9490-40a4-84b5-9ccf0fc59e3e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '.version_select at 0x7fb5642f7a60>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:46.005138 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bb94f628-9490-40a4-84b5-9ccf0fc59e3e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-125437817" status: 202 len: 0 microversion: 2.1 time: 0.028978 Aug 27 05:59:46.005748 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3819/7631] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 05:59:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-125437817 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:59:46.023784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0869cc73-d8bb-4242-87ec-df79b8dc99e4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Action: 'create', calling method: .version_select at 0x7fb55ff34160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1866709972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSsSgflZbFqV2tHQ9c/m4qY90pW1422ql7F1Bt2tr8em2ufQ3UwlgSN7NZZWiYdxPvfoNV4I7Um8kN4eR+Mi1zNuvtUN9YQShCI5FqECaZXgrBy838P1aylHNh2uRla5Q=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:46.038975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0869cc73-d8bb-4242-87ec-df79b8dc99e4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for project 86b388156db6495982d55edf1d113ca9. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:59:46.048382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-0869cc73-d8bb-4242-87ec-df79b8dc99e4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for user feeb15fb481148ac9777214ed6bfa1e6 and project 86b388156db6495982d55edf1d113ca9. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:59:46.071731 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0869cc73-d8bb-4242-87ec-df79b8dc99e4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051702 Aug 27 05:59:46.072296 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3813/7632] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 05:59:46 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:46.124723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-168764419", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1866709972", "networks": [{"uuid": "5b3fa187-a93e-4622-b2e5-77a0e0389731"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:46.177868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] validate_networks() for [('5b3fa187-a93e-4622-b2e5-77a0e0389731', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:59:46.540647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:59:46.541124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:59:46.541543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:59:46.542469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:59:46.542893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:59:46.551973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:46.552459 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:46.552896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:46.553632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:46.554091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:46.554529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:46.571500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for project 86b388156db6495982d55edf1d113ca9. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:59:46.576751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for user feeb15fb481148ac9777214ed6bfa1e6 and project 86b388156db6495982d55edf1d113ca9. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:59:46.589930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:59:46.592296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:59:46.640828 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-44747652-ec6e-436e-8314-c9434a72ea49 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519825 Aug 27 05:59:46.641405 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3820/7633] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 05:59:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:59:46.652063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3d2ef19-ffc3-436f-b3b3-73a0879fea52 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:46.652684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e3d2ef19-ffc3-436f-b3b3-73a0879fea52 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:46.715456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e3d2ef19-ffc3-436f-b3b3-73a0879fea52 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:46.722990 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e3d2ef19-ffc3-436f-b3b3-73a0879fea52 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1262 microversion: 2.1 time: 0.074817 Aug 27 05:59:46.724007 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3814/7634] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:46 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1262 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:47.747080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2d57705f-68ee-498f-a310-43904924f6d6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:47.747726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2d57705f-68ee-498f-a310-43904924f6d6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:47.754933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d57705f-68ee-498f-a310-43904924f6d6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:47.755450 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d57705f-68ee-498f-a310-43904924f6d6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:47.756095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d57705f-68ee-498f-a310-43904924f6d6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:47.757056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d57705f-68ee-498f-a310-43904924f6d6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:47.757511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d57705f-68ee-498f-a310-43904924f6d6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:47.758016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2d57705f-68ee-498f-a310-43904924f6d6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:47.839064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2d57705f-68ee-498f-a310-43904924f6d6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:47.846914 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2d57705f-68ee-498f-a310-43904924f6d6 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1332 microversion: 2.1 time: 0.104745 Aug 27 05:59:47.847533 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3821/7635] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:47 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:48.875983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cb0b1998-9cd4-4a36-861f-4f1f6755c40e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:48.876671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cb0b1998-9cd4-4a36-861f-4f1f6755c40e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:48.885087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb0b1998-9cd4-4a36-861f-4f1f6755c40e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:48.885711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb0b1998-9cd4-4a36-861f-4f1f6755c40e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:48.886270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb0b1998-9cd4-4a36-861f-4f1f6755c40e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:48.887138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb0b1998-9cd4-4a36-861f-4f1f6755c40e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:48.887864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb0b1998-9cd4-4a36-861f-4f1f6755c40e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:48.888584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cb0b1998-9cd4-4a36-861f-4f1f6755c40e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:49.028147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-fb870856-0026-456c-83e6-864564f3f59d req-c5b45e8e-1aa1-41dd-862c-5b2443e5347e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4f792a-47b2-4437-a772-8ba5f481f831", "tag": "d6d5f22b-e56e-402a-abcc-2599dc845ca6"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:49.039357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fb870856-0026-456c-83e6-864564f3f59d req-c5b45e8e-1aa1-41dd-862c-5b2443e5347e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:49.039868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fb870856-0026-456c-83e6-864564f3f59d req-c5b45e8e-1aa1-41dd-862c-5b2443e5347e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:49.040305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fb870856-0026-456c-83e6-864564f3f59d req-c5b45e8e-1aa1-41dd-862c-5b2443e5347e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:49.051433 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-fb870856-0026-456c-83e6-864564f3f59d req-c5b45e8e-1aa1-41dd-862c-5b2443e5347e service nova] Creating event network-changed:d6d5f22b-e56e-402a-abcc-2599dc845ca6 for instance ed4f792a-47b2-4437-a772-8ba5f481f831 on n-h1-820368-35 Aug 27 05:59:49.056491 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-fb870856-0026-456c-83e6-864564f3f59d req-c5b45e8e-1aa1-41dd-862c-5b2443e5347e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032721 Aug 27 05:59:49.057349 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3822/7636] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:59:49.126009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cb0b1998-9cd4-4a36-861f-4f1f6755c40e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:49.134467 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cb0b1998-9cd4-4a36-861f-4f1f6755c40e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1362 microversion: 2.1 time: 0.269619 Aug 27 05:59:49.135049 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3815/7637] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:48 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:50.157121 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-56774cbf-e899-4e3c-880a-b0c058b4a01f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:50.157833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-56774cbf-e899-4e3c-880a-b0c058b4a01f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:50.164440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56774cbf-e899-4e3c-880a-b0c058b4a01f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:50.164924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56774cbf-e899-4e3c-880a-b0c058b4a01f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:50.165371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56774cbf-e899-4e3c-880a-b0c058b4a01f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:50.166072 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56774cbf-e899-4e3c-880a-b0c058b4a01f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:50.166629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56774cbf-e899-4e3c-880a-b0c058b4a01f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:50.167065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-56774cbf-e899-4e3c-880a-b0c058b4a01f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:50.304902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-56774cbf-e899-4e3c-880a-b0c058b4a01f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:50.313282 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-56774cbf-e899-4e3c-880a-b0c058b4a01f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1362 microversion: 2.1 time: 0.161158 Aug 27 05:59:50.313878 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3823/7638] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:50 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:51.333852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d2427306-48da-4935-b64c-d65bdfcedcc2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:51.334476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d2427306-48da-4935-b64c-d65bdfcedcc2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:51.342330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2427306-48da-4935-b64c-d65bdfcedcc2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:51.342824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2427306-48da-4935-b64c-d65bdfcedcc2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:51.343307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2427306-48da-4935-b64c-d65bdfcedcc2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:51.344014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2427306-48da-4935-b64c-d65bdfcedcc2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:51.344480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2427306-48da-4935-b64c-d65bdfcedcc2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:51.344918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d2427306-48da-4935-b64c-d65bdfcedcc2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:51.476872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d2427306-48da-4935-b64c-d65bdfcedcc2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:51.484547 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d2427306-48da-4935-b64c-d65bdfcedcc2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1362 microversion: 2.1 time: 0.154591 Aug 27 05:59:51.485120 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3816/7639] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:51 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:52.505826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6fe6145-b155-419f-bb76-f64a48e94c5f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:52.506473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6fe6145-b155-419f-bb76-f64a48e94c5f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:52.514029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fe6145-b155-419f-bb76-f64a48e94c5f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:52.514509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fe6145-b155-419f-bb76-f64a48e94c5f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:52.514950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fe6145-b155-419f-bb76-f64a48e94c5f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:52.515663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fe6145-b155-419f-bb76-f64a48e94c5f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:52.516116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fe6145-b155-419f-bb76-f64a48e94c5f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:52.516567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6fe6145-b155-419f-bb76-f64a48e94c5f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:52.650448 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6fe6145-b155-419f-bb76-f64a48e94c5f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:52.658842 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6fe6145-b155-419f-bb76-f64a48e94c5f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1362 microversion: 2.1 time: 0.156883 Aug 27 05:59:52.659451 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3824/7640] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:52 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:53.679872 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-31d704e7-d01a-463e-a670-0559dd20fa01 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:53.680506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-31d704e7-d01a-463e-a670-0559dd20fa01 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:53.687867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d704e7-d01a-463e-a670-0559dd20fa01 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:53.688350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d704e7-d01a-463e-a670-0559dd20fa01 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:53.688803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d704e7-d01a-463e-a670-0559dd20fa01 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:53.689521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d704e7-d01a-463e-a670-0559dd20fa01 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:53.689990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d704e7-d01a-463e-a670-0559dd20fa01 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:53.690429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31d704e7-d01a-463e-a670-0559dd20fa01 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:53.823649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-31d704e7-d01a-463e-a670-0559dd20fa01 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:53.831377 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-31d704e7-d01a-463e-a670-0559dd20fa01 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1362 microversion: 2.1 time: 0.155438 Aug 27 05:59:53.831981 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3817/7641] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:53 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:54.852834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3e4046b-a62c-4f73-a1c3-4658242a7cb5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:54.853446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a3e4046b-a62c-4f73-a1c3-4658242a7cb5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:54.860406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3e4046b-a62c-4f73-a1c3-4658242a7cb5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:54.860883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3e4046b-a62c-4f73-a1c3-4658242a7cb5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:54.861418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3e4046b-a62c-4f73-a1c3-4658242a7cb5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:54.862173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3e4046b-a62c-4f73-a1c3-4658242a7cb5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:54.862663 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3e4046b-a62c-4f73-a1c3-4658242a7cb5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:54.863194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3e4046b-a62c-4f73-a1c3-4658242a7cb5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:54.995875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a3e4046b-a62c-4f73-a1c3-4658242a7cb5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:55.003569 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a3e4046b-a62c-4f73-a1c3-4658242a7cb5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1362 microversion: 2.1 time: 0.154669 Aug 27 05:59:55.004163 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3825/7642] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:54 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:55.190937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-42e94db1-0de5-4538-a90e-cf9325341de7 req-a1f1bdf8-04c8-455a-ac32-3f30b26953ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4f792a-47b2-4437-a772-8ba5f481f831", "name": "network-vif-plugged", "status": "completed", "tag": "d6d5f22b-e56e-402a-abcc-2599dc845ca6"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:55.202271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-42e94db1-0de5-4538-a90e-cf9325341de7 req-a1f1bdf8-04c8-455a-ac32-3f30b26953ed service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:55.202832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-42e94db1-0de5-4538-a90e-cf9325341de7 req-a1f1bdf8-04c8-455a-ac32-3f30b26953ed service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:55.203392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-42e94db1-0de5-4538-a90e-cf9325341de7 req-a1f1bdf8-04c8-455a-ac32-3f30b26953ed service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:55.217177 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-42e94db1-0de5-4538-a90e-cf9325341de7 req-a1f1bdf8-04c8-455a-ac32-3f30b26953ed service nova] Creating event network-vif-plugged:d6d5f22b-e56e-402a-abcc-2599dc845ca6 for instance ed4f792a-47b2-4437-a772-8ba5f481f831 on n-h1-820368-35 Aug 27 05:59:55.223345 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-42e94db1-0de5-4538-a90e-cf9325341de7 req-a1f1bdf8-04c8-455a-ac32-3f30b26953ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035856 Aug 27 05:59:55.224167 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3818/7643] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 05:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:59:56.024939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-809f514e-9f6d-48be-9f26-bc155e17f36f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:56.025559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-809f514e-9f6d-48be-9f26-bc155e17f36f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:56.032554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809f514e-9f6d-48be-9f26-bc155e17f36f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:56.033049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809f514e-9f6d-48be-9f26-bc155e17f36f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:56.033498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809f514e-9f6d-48be-9f26-bc155e17f36f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:56.034210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809f514e-9f6d-48be-9f26-bc155e17f36f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:56.034671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809f514e-9f6d-48be-9f26-bc155e17f36f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:56.035125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-809f514e-9f6d-48be-9f26-bc155e17f36f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:56.170636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-809f514e-9f6d-48be-9f26-bc155e17f36f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:56.180430 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-809f514e-9f6d-48be-9f26-bc155e17f36f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1362 microversion: 2.1 time: 0.159526 Aug 27 05:59:56.181021 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3826/7644] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:56 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:57.202759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0b267e7e-ee77-43a8-9e66-f5c678fc0aa7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:57.203519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0b267e7e-ee77-43a8-9e66-f5c678fc0aa7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:57.206315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:57.212131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b267e7e-ee77-43a8-9e66-f5c678fc0aa7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:57.212638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b267e7e-ee77-43a8-9e66-f5c678fc0aa7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:57.213089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b267e7e-ee77-43a8-9e66-f5c678fc0aa7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:57.213810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b267e7e-ee77-43a8-9e66-f5c678fc0aa7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:57.214280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b267e7e-ee77-43a8-9e66-f5c678fc0aa7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:57.214729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0b267e7e-ee77-43a8-9e66-f5c678fc0aa7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:57.347944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0b267e7e-ee77-43a8-9e66-f5c678fc0aa7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:57.356129 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0b267e7e-ee77-43a8-9e66-f5c678fc0aa7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1555 microversion: 2.1 time: 0.157522 Aug 27 05:59:57.356712 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3819/7645] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:57 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:57.376662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4408cfc3-3407-4910-906b-5b13b16265e1 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:57.377283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4408cfc3-3407-4910-906b-5b13b16265e1 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:57.379253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:57.379954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:57.387103 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4408cfc3-3407-4910-906b-5b13b16265e1 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:57.387601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4408cfc3-3407-4910-906b-5b13b16265e1 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:57.388043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4408cfc3-3407-4910-906b-5b13b16265e1 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:57.388745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4408cfc3-3407-4910-906b-5b13b16265e1 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:57.389202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4408cfc3-3407-4910-906b-5b13b16265e1 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:57.389632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4408cfc3-3407-4910-906b-5b13b16265e1 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:57.850921 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4408cfc3-3407-4910-906b-5b13b16265e1 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:57.858654 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4408cfc3-3407-4910-906b-5b13b16265e1 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1555 microversion: 2.1 time: 0.485811 Aug 27 05:59:57.859263 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3827/7646] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:57 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1555 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:59.358905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-002d0705-91a4-4388-a4ce-03e9567348b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4097e14a-fc47-457d-bc0b-63220264ff6a"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:59.361310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-002d0705-91a4-4388-a4ce-03e9567348b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:59.369077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002d0705-91a4-4388-a4ce-03e9567348b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:59.369661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002d0705-91a4-4388-a4ce-03e9567348b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:59.370120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002d0705-91a4-4388-a4ce-03e9567348b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:59.370836 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002d0705-91a4-4388-a4ce-03e9567348b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:59.371329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002d0705-91a4-4388-a4ce-03e9567348b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:59.371769 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-002d0705-91a4-4388-a4ce-03e9567348b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:59.647232 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-002d0705-91a4-4388-a4ce-03e9567348b2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "POST /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292202 Aug 27 05:59:59.647903 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3820/7647] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 05:59:59 2022] POST /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:10.368055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8443c31f-f9f7-4c97-b9a7-9a74737c337b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:10.368660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8443c31f-f9f7-4c97-b9a7-9a74737c337b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:10.370886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:00:10.371792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:00:10.378353 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8443c31f-f9f7-4c97-b9a7-9a74737c337b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:10.378851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8443c31f-f9f7-4c97-b9a7-9a74737c337b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:10.379356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8443c31f-f9f7-4c97-b9a7-9a74737c337b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:10.380074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8443c31f-f9f7-4c97-b9a7-9a74737c337b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:10.380536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8443c31f-f9f7-4c97-b9a7-9a74737c337b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:10.380971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8443c31f-f9f7-4c97-b9a7-9a74737c337b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:10.465375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-8443c31f-f9f7-4c97-b9a7-9a74737c337b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lazy-loading 'services' on Instance uuid ed4f792a-47b2-4437-a772-8ba5f481f831 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:00:10.538983 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8443c31f-f9f7-4c97-b9a7-9a74737c337b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments/4097e14a-fc47-457d-bc0b-63220264ff6a" status: 202 len: 0 microversion: 2.1 time: 0.175402 Aug 27 06:00:10.539631 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3828/7648] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 06:00:10 2022] DELETE /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments/4097e14a-fc47-457d-bc0b-63220264ff6a => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:00:10.546334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:00:10.547421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:00:10.551999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b31dc4f8-27e4-4be0-b3af-66ad8796af8f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:10.554620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b31dc4f8-27e4-4be0-b3af-66ad8796af8f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:10.563326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b31dc4f8-27e4-4be0-b3af-66ad8796af8f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:10.563917 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b31dc4f8-27e4-4be0-b3af-66ad8796af8f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:10.564370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b31dc4f8-27e4-4be0-b3af-66ad8796af8f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:10.565089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b31dc4f8-27e4-4be0-b3af-66ad8796af8f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:10.565555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b31dc4f8-27e4-4be0-b3af-66ad8796af8f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:10.565994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b31dc4f8-27e4-4be0-b3af-66ad8796af8f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:10.599614 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b31dc4f8-27e4-4be0-b3af-66ad8796af8f tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055110 Aug 27 06:00:10.600187 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3821/7649] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:10 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:11.614653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c31544d-aedf-4be4-a38b-3d47e8851407 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:11.618681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c31544d-aedf-4be4-a38b-3d47e8851407 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:11.624160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c31544d-aedf-4be4-a38b-3d47e8851407 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:11.624657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c31544d-aedf-4be4-a38b-3d47e8851407 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:11.625096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c31544d-aedf-4be4-a38b-3d47e8851407 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:11.625809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c31544d-aedf-4be4-a38b-3d47e8851407 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:11.626264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c31544d-aedf-4be4-a38b-3d47e8851407 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:11.626695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c31544d-aedf-4be4-a38b-3d47e8851407 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:11.658764 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c31544d-aedf-4be4-a38b-3d47e8851407 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049610 Aug 27 06:00:11.659369 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3829/7650] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:11 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:12.671332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d4525012-29b9-4721-8589-b70f60babd0a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:12.673895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d4525012-29b9-4721-8589-b70f60babd0a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:12.681975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4525012-29b9-4721-8589-b70f60babd0a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:12.682484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4525012-29b9-4721-8589-b70f60babd0a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:12.682975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4525012-29b9-4721-8589-b70f60babd0a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:12.683763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4525012-29b9-4721-8589-b70f60babd0a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:12.684234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4525012-29b9-4721-8589-b70f60babd0a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:12.684676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d4525012-29b9-4721-8589-b70f60babd0a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:12.719109 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d4525012-29b9-4721-8589-b70f60babd0a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051807 Aug 27 06:00:12.719945 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3822/7651] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:12 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:13.732297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-940c0449-9a0e-4e72-b6fc-44b45274548a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:13.734549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-940c0449-9a0e-4e72-b6fc-44b45274548a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:13.741928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-940c0449-9a0e-4e72-b6fc-44b45274548a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:13.742581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-940c0449-9a0e-4e72-b6fc-44b45274548a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:13.742961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-940c0449-9a0e-4e72-b6fc-44b45274548a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:13.743785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-940c0449-9a0e-4e72-b6fc-44b45274548a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:13.744246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-940c0449-9a0e-4e72-b6fc-44b45274548a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:13.744669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-940c0449-9a0e-4e72-b6fc-44b45274548a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:13.778144 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-940c0449-9a0e-4e72-b6fc-44b45274548a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049208 Aug 27 06:00:13.778729 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3830/7652] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:13 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:14.791850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad3c4d17-d58b-4e4a-9d07-dbbf781f3b09 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:14.794514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ad3c4d17-d58b-4e4a-9d07-dbbf781f3b09 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:14.801966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad3c4d17-d58b-4e4a-9d07-dbbf781f3b09 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:14.802461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad3c4d17-d58b-4e4a-9d07-dbbf781f3b09 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:14.803052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad3c4d17-d58b-4e4a-9d07-dbbf781f3b09 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:14.803798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad3c4d17-d58b-4e4a-9d07-dbbf781f3b09 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:14.804267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad3c4d17-d58b-4e4a-9d07-dbbf781f3b09 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:14.804698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad3c4d17-d58b-4e4a-9d07-dbbf781f3b09 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:14.834835 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ad3c4d17-d58b-4e4a-9d07-dbbf781f3b09 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048822 Aug 27 06:00:14.836098 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3823/7653] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:14 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:15.847371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-be4bffe1-e270-43fa-a6d3-0487f6049542 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:15.849540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-be4bffe1-e270-43fa-a6d3-0487f6049542 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:15.856870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4bffe1-e270-43fa-a6d3-0487f6049542 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:15.857355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4bffe1-e270-43fa-a6d3-0487f6049542 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:15.857796 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4bffe1-e270-43fa-a6d3-0487f6049542 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:15.858499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4bffe1-e270-43fa-a6d3-0487f6049542 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:15.858949 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4bffe1-e270-43fa-a6d3-0487f6049542 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:15.859404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-be4bffe1-e270-43fa-a6d3-0487f6049542 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:15.894470 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-be4bffe1-e270-43fa-a6d3-0487f6049542 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051063 Aug 27 06:00:15.895041 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3831/7654] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:15 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 06:00:15.905570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:15.906117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:15.913029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:15.914039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:15.914589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:15.915565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:15.916123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:15.916781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:15.996187 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] HTTP exception thrown: Instance ed4f792a-47b2-4437-a772-8ba5f481f831 is not attached to volume 4097e14a-fc47-457d-bc0b-63220264ff6a Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Request method failure captured: Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments/4097e14a-fc47-457d-bc0b-63220264ff6a HTTP/1.1 Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbKl5DMlyT0gPmXMYneRB7eRO7xR6P94IkKsvopedoDaFcbJYgZWp6xpyWvpfGiYWpPGMBaqzcqapae5LbFtlBq0nG1PTfnhajdDjm5s-OQ5i-KYsXQgKtmKh1rw7aEmqRlZaqoSSV4rAsIVgzIzY9vMEC5A-w6_zAkeoYUnx20EBLA Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_86b388156db6495982d55edf1d113ca9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/86b388156db6495982d55edf1d113ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: feeb15fb481148ac9777214ed6bfa1e6 Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance ed4f792a-47b2-4437-a772-8ba5f481f831 is not attached to volume 4097e14a-fc47-457d-bc0b-63220264ff6a Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'server_id': 'ed4f792a-47b2-4437-a772-8ba5f481f831', 'id': '4097e14a-fc47-457d-bc0b-63220264ff6a'} Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4097e14a-fc47-457d-bc0b-63220264ff6a. Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4f792a-47b2-4437-a772-8ba5f481f831 is not attached to volume 4097e14a-fc47-457d-bc0b-63220264ff6a Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:00:15.997824 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:00:16.002284 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:00:16.002284 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:00:16.002284 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4f792a-47b2-4437-a772-8ba5f481f831 is not attached to volume 4097e14a-fc47-457d-bc0b-63220264ff6a Aug 27 06:00:16.002284 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:16.002284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Returning 404 to user: Instance ed4f792a-47b2-4437-a772-8ba5f481f831 is not attached to volume 4097e14a-fc47-457d-bc0b-63220264ff6a {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:00:16.002284 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-215a2e60-979e-4c48-af03-7e0e8f4c0e00 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments/4097e14a-fc47-457d-bc0b-63220264ff6a" status: 404 len: 154 microversion: 2.1 time: 0.097803 Aug 27 06:00:16.002284 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3824/7655] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 06:00:15 2022] DELETE /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831/os-volume_attachments/4097e14a-fc47-457d-bc0b-63220264ff6a => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:00:19.357754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-066736af-987b-447c-8d61-7402aa841e51 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:19.358347 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-066736af-987b-447c-8d61-7402aa841e51 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:19.366251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-066736af-987b-447c-8d61-7402aa841e51 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:19.366251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-066736af-987b-447c-8d61-7402aa841e51 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:19.367170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-066736af-987b-447c-8d61-7402aa841e51 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:19.368316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-066736af-987b-447c-8d61-7402aa841e51 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:19.369022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-066736af-987b-447c-8d61-7402aa841e51 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:19.369135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-066736af-987b-447c-8d61-7402aa841e51 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:19.401736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-066736af-987b-447c-8d61-7402aa841e51 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:00:19.489138 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-066736af-987b-447c-8d61-7402aa841e51 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 204 len: 0 microversion: 2.1 time: 0.136442 Aug 27 06:00:19.489742 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3832/7656] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:00:19 2022] DELETE /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:00:19.499507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6bc22350-6d76-4588-a1ae-be200b8a7022 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:19.500159 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6bc22350-6d76-4588-a1ae-be200b8a7022 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:19.507578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bc22350-6d76-4588-a1ae-be200b8a7022 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:19.508070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bc22350-6d76-4588-a1ae-be200b8a7022 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:19.508519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bc22350-6d76-4588-a1ae-be200b8a7022 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:19.509256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bc22350-6d76-4588-a1ae-be200b8a7022 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:19.509723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bc22350-6d76-4588-a1ae-be200b8a7022 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:19.510167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6bc22350-6d76-4588-a1ae-be200b8a7022 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:19.651793 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6bc22350-6d76-4588-a1ae-be200b8a7022 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:19.659689 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6bc22350-6d76-4588-a1ae-be200b8a7022 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1561 microversion: 2.1 time: 0.164767 Aug 27 06:00:19.660269 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3825/7657] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:19 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:00:20.682332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ea9357f7-3e68-4b31-a287-dd7a3db8f9c2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:20.683048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ea9357f7-3e68-4b31-a287-dd7a3db8f9c2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:20.690045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea9357f7-3e68-4b31-a287-dd7a3db8f9c2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:20.690542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea9357f7-3e68-4b31-a287-dd7a3db8f9c2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:20.690990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea9357f7-3e68-4b31-a287-dd7a3db8f9c2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:20.691737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea9357f7-3e68-4b31-a287-dd7a3db8f9c2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:20.692201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea9357f7-3e68-4b31-a287-dd7a3db8f9c2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:20.692638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ea9357f7-3e68-4b31-a287-dd7a3db8f9c2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:20.828613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ea9357f7-3e68-4b31-a287-dd7a3db8f9c2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:20.837494 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ea9357f7-3e68-4b31-a287-dd7a3db8f9c2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1561 microversion: 2.1 time: 0.160123 Aug 27 06:00:20.838080 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3833/7658] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:20 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:21.859957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b845dbf5-384a-4758-a77f-6941d0b638aa tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:21.860634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b845dbf5-384a-4758-a77f-6941d0b638aa tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:21.868635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b845dbf5-384a-4758-a77f-6941d0b638aa tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:21.869171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b845dbf5-384a-4758-a77f-6941d0b638aa tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:21.869785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b845dbf5-384a-4758-a77f-6941d0b638aa tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:21.870520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b845dbf5-384a-4758-a77f-6941d0b638aa tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:21.871000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b845dbf5-384a-4758-a77f-6941d0b638aa tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:21.871479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b845dbf5-384a-4758-a77f-6941d0b638aa tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:21.965702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b845dbf5-384a-4758-a77f-6941d0b638aa tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:21.975530 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b845dbf5-384a-4758-a77f-6941d0b638aa tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 200 len: 1519 microversion: 2.1 time: 0.119736 Aug 27 06:00:21.976126 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3826/7659] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:21 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 1519 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:22.016317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-362d1cb5-7659-4d1d-beec-8b2878bf3c68 req-bdb690df-ed40-4c24-ad30-bc3dfb6fb469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4f792a-47b2-4437-a772-8ba5f481f831", "name": "network-vif-deleted", "tag": "d6d5f22b-e56e-402a-abcc-2599dc845ca6"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:00:22.027962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-362d1cb5-7659-4d1d-beec-8b2878bf3c68 req-bdb690df-ed40-4c24-ad30-bc3dfb6fb469 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:22.028452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-362d1cb5-7659-4d1d-beec-8b2878bf3c68 req-bdb690df-ed40-4c24-ad30-bc3dfb6fb469 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:22.028900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-362d1cb5-7659-4d1d-beec-8b2878bf3c68 req-bdb690df-ed40-4c24-ad30-bc3dfb6fb469 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:22.042275 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-362d1cb5-7659-4d1d-beec-8b2878bf3c68 req-bdb690df-ed40-4c24-ad30-bc3dfb6fb469 service nova] Creating event network-vif-deleted:d6d5f22b-e56e-402a-abcc-2599dc845ca6 for instance ed4f792a-47b2-4437-a772-8ba5f481f831 on n-h1-820368-35 Aug 27 06:00:22.048879 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-362d1cb5-7659-4d1d-beec-8b2878bf3c68 req-bdb690df-ed40-4c24-ad30-bc3dfb6fb469 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036025 Aug 27 06:00:22.049787 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3834/7660] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:00:22.997706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:22.998329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: ed4f792a-47b2-4437-a772-8ba5f481f831] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:23.007232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:23.008269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:23.008764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:23.009497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:23.009967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:23.010409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:23.028910 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] HTTP exception thrown: Instance ed4f792a-47b2-4437-a772-8ba5f481f831 could not be found. Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Request method failure captured: Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 HTTP/1.1 Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbKl5DMlyT0gPmXMYneRB7eRO7xR6P94IkKsvopedoDaFcbJYgZWp6xpyWvpfGiYWpPGMBaqzcqapae5LbFtlBq0nG1PTfnhajdDjm5s-OQ5i-KYsXQgKtmKh1rw7aEmqRlZaqoSSV4rAsIVgzIzY9vMEC5A-w6_zAkeoYUnx20EBLA Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_86b388156db6495982d55edf1d113ca9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/86b388156db6495982d55edf1d113ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: feeb15fb481148ac9777214ed6bfa1e6 Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance ed4f792a-47b2-4437-a772-8ba5f481f831 could not be found. Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'ed4f792a-47b2-4437-a772-8ba5f481f831'} Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4f792a-47b2-4437-a772-8ba5f481f831 could not be found. Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4f792a-47b2-4437-a772-8ba5f481f831 could not be found. Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:23.030330 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:00:23.034610 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:23.034610 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:00:23.034610 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:00:23.034610 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:00:23.034610 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:00:23.034610 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:00:23.034610 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4f792a-47b2-4437-a772-8ba5f481f831 could not be found. Aug 27 06:00:23.034610 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:23.034610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Returning 404 to user: Instance ed4f792a-47b2-4437-a772-8ba5f481f831 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:00:23.034610 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fa76b0f4-35ab-457c-9bf9-9752ce60fe7b tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831" status: 404 len: 111 microversion: 2.1 time: 0.038341 Aug 27 06:00:23.034610 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3827/7661] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:22 2022] GET /compute/v2.1/servers/ed4f792a-47b2-4437-a772-8ba5f481f831 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:00:23.042753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-42238eb7-95d3-4f61-9219-dd63a39bcc99 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '.version_select at 0x7fb5640499d0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:23.067744 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-42238eb7-95d3-4f61-9219-dd63a39bcc99 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1866709972" status: 202 len: 0 microversion: 2.1 time: 0.030609 Aug 27 06:00:23.068367 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3835/7662] 10.222.0.58 () {58 vars in 1278 bytes} [Sat Aug 27 06:00:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1866709972 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:00:23.088199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d8b15c6d-2b15-43ca-aa2f-bd22b3d3a124 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Action: 'create', calling method: .version_select at 0x7fb55ff48430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-717294120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2gWu4uL4OjS3gzZDVYUMZEXqewUwdxB8TYI+1jbipX8WwOM+REekDJgn7JyLVLr4mw+l3Abf3v3XKW5VP5goZ2xkTFEsJu9AFhGJPVspiyQnR/5D0RVh/N3zPlD2SS9A=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:00:23.106098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-d8b15c6d-2b15-43ca-aa2f-bd22b3d3a124 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for project 86b388156db6495982d55edf1d113ca9. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:00:23.111678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-d8b15c6d-2b15-43ca-aa2f-bd22b3d3a124 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for user feeb15fb481148ac9777214ed6bfa1e6 and project 86b388156db6495982d55edf1d113ca9. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:00:23.140388 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d8b15c6d-2b15-43ca-aa2f-bd22b3d3a124 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.057199 Aug 27 06:00:23.140992 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3828/7663] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 06:00:23 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:23.200145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1423897323", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-717294120", "networks": [{"uuid": "5b3fa187-a93e-4622-b2e5-77a0e0389731"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:00:23.264270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] validate_networks() for [('5b3fa187-a93e-4622-b2e5-77a0e0389731', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:00:23.684396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:00:23.684825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:00:23.685343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:00:23.685762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:00:23.686183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:00:23.696272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:23.696811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:23.697254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:23.698003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:23.698460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:23.698898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:23.716096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for project 86b388156db6495982d55edf1d113ca9. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:00:23.721346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Getting quotas for user feeb15fb481148ac9777214ed6bfa1e6 and project 86b388156db6495982d55edf1d113ca9. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:00:23.733874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:00:23.736368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:00:23.787667 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-315a95b2-d335-44f6-9270-035f50af7c28 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591600 Aug 27 06:00:23.788903 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3836/7664] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:00:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 06:00:23.800275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1723e301-5274-44b8-bdc2-3089a82d1814 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:23.801201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1723e301-5274-44b8-bdc2-3089a82d1814 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:23.857534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1723e301-5274-44b8-bdc2-3089a82d1814 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:23.867492 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1723e301-5274-44b8-bdc2-3089a82d1814 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1262 microversion: 2.1 time: 0.071306 Aug 27 06:00:23.868105 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3829/7665] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:23 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:24.888728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c90b9ef6-8e79-4829-8337-68fb94d2cbb2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:24.889522 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c90b9ef6-8e79-4829-8337-68fb94d2cbb2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:24.895978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c90b9ef6-8e79-4829-8337-68fb94d2cbb2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:24.896588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c90b9ef6-8e79-4829-8337-68fb94d2cbb2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:24.897125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c90b9ef6-8e79-4829-8337-68fb94d2cbb2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:24.899020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c90b9ef6-8e79-4829-8337-68fb94d2cbb2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:24.899680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c90b9ef6-8e79-4829-8337-68fb94d2cbb2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:24.900220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c90b9ef6-8e79-4829-8337-68fb94d2cbb2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:24.987138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c90b9ef6-8e79-4829-8337-68fb94d2cbb2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:24.997683 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c90b9ef6-8e79-4829-8337-68fb94d2cbb2 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1322 microversion: 2.1 time: 0.113551 Aug 27 06:00:24.998712 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3837/7666] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:24 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1322 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:26.022795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ae54f863-b455-482a-aca5-5d158a06e5f4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:26.023546 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ae54f863-b455-482a-aca5-5d158a06e5f4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:26.031767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae54f863-b455-482a-aca5-5d158a06e5f4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:26.032269 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae54f863-b455-482a-aca5-5d158a06e5f4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:26.032718 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae54f863-b455-482a-aca5-5d158a06e5f4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:26.033436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae54f863-b455-482a-aca5-5d158a06e5f4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:26.033901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae54f863-b455-482a-aca5-5d158a06e5f4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:26.034339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ae54f863-b455-482a-aca5-5d158a06e5f4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:26.243005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ae54f863-b455-482a-aca5-5d158a06e5f4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:26.250871 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ae54f863-b455-482a-aca5-5d158a06e5f4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1362 microversion: 2.1 time: 0.232574 Aug 27 06:00:26.251479 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3830/7667] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:26 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:26.318970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b1de1080-6aa4-4765-88e6-b2dcfc2ea2f7 req-d116c61b-b9de-47cd-9273-5295130dbb5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927f853f-edff-43b9-a845-46d0d2d2f20e", "tag": "4385a75d-53e1-43c6-94c9-8d06b53079a7"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:00:26.331426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b1de1080-6aa4-4765-88e6-b2dcfc2ea2f7 req-d116c61b-b9de-47cd-9273-5295130dbb5f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:26.332045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b1de1080-6aa4-4765-88e6-b2dcfc2ea2f7 req-d116c61b-b9de-47cd-9273-5295130dbb5f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:26.332505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b1de1080-6aa4-4765-88e6-b2dcfc2ea2f7 req-d116c61b-b9de-47cd-9273-5295130dbb5f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:26.345228 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b1de1080-6aa4-4765-88e6-b2dcfc2ea2f7 req-d116c61b-b9de-47cd-9273-5295130dbb5f service nova] Creating event network-changed:4385a75d-53e1-43c6-94c9-8d06b53079a7 for instance 927f853f-edff-43b9-a845-46d0d2d2f20e on n-h1-820368-35 Aug 27 06:00:26.349971 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b1de1080-6aa4-4765-88e6-b2dcfc2ea2f7 req-d116c61b-b9de-47cd-9273-5295130dbb5f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034780 Aug 27 06:00:26.350604 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3838/7668] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:00:27.274440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1e032bf-ae13-45c4-b5ad-2a6a9d2f7948 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:27.275262 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1e032bf-ae13-45c4-b5ad-2a6a9d2f7948 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:27.282640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e032bf-ae13-45c4-b5ad-2a6a9d2f7948 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:27.283176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e032bf-ae13-45c4-b5ad-2a6a9d2f7948 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:27.283639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e032bf-ae13-45c4-b5ad-2a6a9d2f7948 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:27.284368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e032bf-ae13-45c4-b5ad-2a6a9d2f7948 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:27.284846 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e032bf-ae13-45c4-b5ad-2a6a9d2f7948 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:27.285296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e1e032bf-ae13-45c4-b5ad-2a6a9d2f7948 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:27.426623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1e032bf-ae13-45c4-b5ad-2a6a9d2f7948 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:27.434938 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1e032bf-ae13-45c4-b5ad-2a6a9d2f7948 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1362 microversion: 2.1 time: 0.165786 Aug 27 06:00:27.435555 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3831/7669] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:27 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:28.456766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0744e44d-cb29-4169-a4ff-ff5393ec4900 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:28.457473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0744e44d-cb29-4169-a4ff-ff5393ec4900 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:28.464396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0744e44d-cb29-4169-a4ff-ff5393ec4900 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:28.464885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0744e44d-cb29-4169-a4ff-ff5393ec4900 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:28.465324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0744e44d-cb29-4169-a4ff-ff5393ec4900 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:28.466023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0744e44d-cb29-4169-a4ff-ff5393ec4900 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:28.466480 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0744e44d-cb29-4169-a4ff-ff5393ec4900 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:28.466909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0744e44d-cb29-4169-a4ff-ff5393ec4900 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:28.601746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0744e44d-cb29-4169-a4ff-ff5393ec4900 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:28.609566 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0744e44d-cb29-4169-a4ff-ff5393ec4900 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1362 microversion: 2.1 time: 0.157882 Aug 27 06:00:28.610161 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3839/7670] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:28 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:29.631288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-89a7f758-ce1c-4ed8-b8de-c11c5d6f815e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:29.632268 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-89a7f758-ce1c-4ed8-b8de-c11c5d6f815e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:29.639655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a7f758-ce1c-4ed8-b8de-c11c5d6f815e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:29.640195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a7f758-ce1c-4ed8-b8de-c11c5d6f815e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:29.640681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a7f758-ce1c-4ed8-b8de-c11c5d6f815e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:29.641510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a7f758-ce1c-4ed8-b8de-c11c5d6f815e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:29.641979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a7f758-ce1c-4ed8-b8de-c11c5d6f815e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:29.642420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-89a7f758-ce1c-4ed8-b8de-c11c5d6f815e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:29.779241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-89a7f758-ce1c-4ed8-b8de-c11c5d6f815e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:29.787234 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-89a7f758-ce1c-4ed8-b8de-c11c5d6f815e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1362 microversion: 2.1 time: 0.160020 Aug 27 06:00:29.787930 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3832/7671] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:29 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:30.809773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-790833a3-2979-4baa-a1df-172539de4e40 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:30.810394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-790833a3-2979-4baa-a1df-172539de4e40 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:30.817203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-790833a3-2979-4baa-a1df-172539de4e40 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:30.817694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-790833a3-2979-4baa-a1df-172539de4e40 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:30.818135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-790833a3-2979-4baa-a1df-172539de4e40 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:30.818845 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-790833a3-2979-4baa-a1df-172539de4e40 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:30.819348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-790833a3-2979-4baa-a1df-172539de4e40 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:30.819785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-790833a3-2979-4baa-a1df-172539de4e40 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:30.951903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-790833a3-2979-4baa-a1df-172539de4e40 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:30.959589 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-790833a3-2979-4baa-a1df-172539de4e40 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1362 microversion: 2.1 time: 0.153677 Aug 27 06:00:30.960197 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3840/7672] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:30 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:31.980066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-af9693ae-75de-4ad4-9ee1-90b6ac353882 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:31.981418 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-af9693ae-75de-4ad4-9ee1-90b6ac353882 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:31.988471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af9693ae-75de-4ad4-9ee1-90b6ac353882 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:31.988980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af9693ae-75de-4ad4-9ee1-90b6ac353882 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:31.989433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af9693ae-75de-4ad4-9ee1-90b6ac353882 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:31.990160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af9693ae-75de-4ad4-9ee1-90b6ac353882 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:31.990629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af9693ae-75de-4ad4-9ee1-90b6ac353882 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:31.991608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af9693ae-75de-4ad4-9ee1-90b6ac353882 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:32.139701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-af9693ae-75de-4ad4-9ee1-90b6ac353882 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:32.148291 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-af9693ae-75de-4ad4-9ee1-90b6ac353882 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1362 microversion: 2.1 time: 0.172669 Aug 27 06:00:32.148866 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3833/7673] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:31 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:33.169879 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-225efb0b-e6db-4d26-a841-f4e83875f553 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:33.170628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-225efb0b-e6db-4d26-a841-f4e83875f553 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:33.177827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-225efb0b-e6db-4d26-a841-f4e83875f553 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:33.178316 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-225efb0b-e6db-4d26-a841-f4e83875f553 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:33.179368 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-225efb0b-e6db-4d26-a841-f4e83875f553 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:33.180092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-225efb0b-e6db-4d26-a841-f4e83875f553 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:33.180548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-225efb0b-e6db-4d26-a841-f4e83875f553 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:33.181073 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-225efb0b-e6db-4d26-a841-f4e83875f553 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:33.333740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-225efb0b-e6db-4d26-a841-f4e83875f553 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:33.342220 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-225efb0b-e6db-4d26-a841-f4e83875f553 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1362 microversion: 2.1 time: 0.176189 Aug 27 06:00:33.343003 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3841/7674] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:33 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:33.479308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-a28c5e28-b515-496c-9b80-4c029d738f22 req-ebf65f78-0004-4521-8271-1e2c972478f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927f853f-edff-43b9-a845-46d0d2d2f20e", "name": "network-vif-plugged", "status": "completed", "tag": "4385a75d-53e1-43c6-94c9-8d06b53079a7"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:00:33.490486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a28c5e28-b515-496c-9b80-4c029d738f22 req-ebf65f78-0004-4521-8271-1e2c972478f4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:33.491698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a28c5e28-b515-496c-9b80-4c029d738f22 req-ebf65f78-0004-4521-8271-1e2c972478f4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:33.492235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a28c5e28-b515-496c-9b80-4c029d738f22 req-ebf65f78-0004-4521-8271-1e2c972478f4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:33.503648 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-a28c5e28-b515-496c-9b80-4c029d738f22 req-ebf65f78-0004-4521-8271-1e2c972478f4 service nova] Creating event network-vif-plugged:4385a75d-53e1-43c6-94c9-8d06b53079a7 for instance 927f853f-edff-43b9-a845-46d0d2d2f20e on n-h1-820368-35 Aug 27 06:00:33.509449 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-a28c5e28-b515-496c-9b80-4c029d738f22 req-ebf65f78-0004-4521-8271-1e2c972478f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033859 Aug 27 06:00:33.510136 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3834/7675] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:34.363403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4a02cd30-8597-420e-97a9-accf9a2934e0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:34.363935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4a02cd30-8597-420e-97a9-accf9a2934e0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:34.366454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:00:34.367476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:00:34.374140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a02cd30-8597-420e-97a9-accf9a2934e0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:34.374623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a02cd30-8597-420e-97a9-accf9a2934e0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:34.375058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a02cd30-8597-420e-97a9-accf9a2934e0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:34.375784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a02cd30-8597-420e-97a9-accf9a2934e0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:34.376234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a02cd30-8597-420e-97a9-accf9a2934e0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:34.376805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a02cd30-8597-420e-97a9-accf9a2934e0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:34.514653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4a02cd30-8597-420e-97a9-accf9a2934e0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:34.523012 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4a02cd30-8597-420e-97a9-accf9a2934e0 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1362 microversion: 2.1 time: 0.163023 Aug 27 06:00:34.523678 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3842/7676] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:34 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:35.541457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:00:35.547051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2afb9ea1-fe5a-48c7-9991-799106491c6a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:35.547804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2afb9ea1-fe5a-48c7-9991-799106491c6a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:35.554405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2afb9ea1-fe5a-48c7-9991-799106491c6a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:35.554913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2afb9ea1-fe5a-48c7-9991-799106491c6a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:35.555397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2afb9ea1-fe5a-48c7-9991-799106491c6a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:35.556121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2afb9ea1-fe5a-48c7-9991-799106491c6a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:35.556597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2afb9ea1-fe5a-48c7-9991-799106491c6a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:35.557042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2afb9ea1-fe5a-48c7-9991-799106491c6a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:35.694020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2afb9ea1-fe5a-48c7-9991-799106491c6a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:35.702017 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2afb9ea1-fe5a-48c7-9991-799106491c6a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1555 microversion: 2.1 time: 0.161589 Aug 27 06:00:35.702612 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3835/7677] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:35 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:35.722785 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3f1d2649-1ce0-4f2b-89b5-eff244c2c3f3 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:35.723440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3f1d2649-1ce0-4f2b-89b5-eff244c2c3f3 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:35.731252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f1d2649-1ce0-4f2b-89b5-eff244c2c3f3 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:35.731750 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f1d2649-1ce0-4f2b-89b5-eff244c2c3f3 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:35.732198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f1d2649-1ce0-4f2b-89b5-eff244c2c3f3 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:35.732911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f1d2649-1ce0-4f2b-89b5-eff244c2c3f3 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:35.733374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f1d2649-1ce0-4f2b-89b5-eff244c2c3f3 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:35.733809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3f1d2649-1ce0-4f2b-89b5-eff244c2c3f3 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:35.884241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3f1d2649-1ce0-4f2b-89b5-eff244c2c3f3 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:35.892013 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3f1d2649-1ce0-4f2b-89b5-eff244c2c3f3 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1555 microversion: 2.1 time: 0.173110 Aug 27 06:00:35.892583 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3843/7678] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:35 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:37.418286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-79cfae58-b376-4e0e-aa15-c966d1eb9262 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:00:37.420649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-79cfae58-b376-4e0e-aa15-c966d1eb9262 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:37.428061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79cfae58-b376-4e0e-aa15-c966d1eb9262 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:37.429280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79cfae58-b376-4e0e-aa15-c966d1eb9262 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:37.430046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79cfae58-b376-4e0e-aa15-c966d1eb9262 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:37.430891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79cfae58-b376-4e0e-aa15-c966d1eb9262 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:37.431406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79cfae58-b376-4e0e-aa15-c966d1eb9262 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:37.431862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-79cfae58-b376-4e0e-aa15-c966d1eb9262 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:37.721205 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-79cfae58-b376-4e0e-aa15-c966d1eb9262 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "POST /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306872 Aug 27 06:00:37.721847 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3836/7679] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 06:00:37 2022] POST /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:48.571140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7b06fa7a-9c9c-46aa-86cd-f5e6d0280618 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:48.571915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7b06fa7a-9c9c-46aa-86cd-f5e6d0280618 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:48.574580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:00:48.575255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:00:48.581727 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b06fa7a-9c9c-46aa-86cd-f5e6d0280618 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:48.582295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b06fa7a-9c9c-46aa-86cd-f5e6d0280618 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:48.582836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b06fa7a-9c9c-46aa-86cd-f5e6d0280618 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:48.583586 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b06fa7a-9c9c-46aa-86cd-f5e6d0280618 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:48.584030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b06fa7a-9c9c-46aa-86cd-f5e6d0280618 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:48.585088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7b06fa7a-9c9c-46aa-86cd-f5e6d0280618 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:48.672092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-7b06fa7a-9c9c-46aa-86cd-f5e6d0280618 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lazy-loading 'services' on Instance uuid 927f853f-edff-43b9-a845-46d0d2d2f20e {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:00:48.746077 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7b06fa7a-9c9c-46aa-86cd-f5e6d0280618 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments/f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a" status: 202 len: 0 microversion: 2.1 time: 0.179368 Aug 27 06:00:48.746669 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3844/7680] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 06:00:48 2022] DELETE /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments/f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:00:48.754504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:00:48.755430 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:00:48.760087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-50c9cb8f-9831-4c67-82c9-22a970169d85 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:48.762451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-50c9cb8f-9831-4c67-82c9-22a970169d85 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:48.773087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50c9cb8f-9831-4c67-82c9-22a970169d85 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:48.773692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50c9cb8f-9831-4c67-82c9-22a970169d85 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:48.774119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50c9cb8f-9831-4c67-82c9-22a970169d85 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:48.774786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50c9cb8f-9831-4c67-82c9-22a970169d85 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:48.775348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50c9cb8f-9831-4c67-82c9-22a970169d85 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:48.775789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-50c9cb8f-9831-4c67-82c9-22a970169d85 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:48.813838 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-50c9cb8f-9831-4c67-82c9-22a970169d85 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061755 Aug 27 06:00:48.814879 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3837/7681] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:48 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:49.828064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-49c57298-22df-42c2-86d5-8f60739ef25a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:49.830575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-49c57298-22df-42c2-86d5-8f60739ef25a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:49.837555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c57298-22df-42c2-86d5-8f60739ef25a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:49.838151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c57298-22df-42c2-86d5-8f60739ef25a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:49.838604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c57298-22df-42c2-86d5-8f60739ef25a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:49.839354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c57298-22df-42c2-86d5-8f60739ef25a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:49.839820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c57298-22df-42c2-86d5-8f60739ef25a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:49.840255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49c57298-22df-42c2-86d5-8f60739ef25a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:49.875065 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-49c57298-22df-42c2-86d5-8f60739ef25a tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052206 Aug 27 06:00:49.875684 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3845/7682] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:49 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:50.888400 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6285ad1a-1c48-419e-9de3-6a1efae1db97 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:50.890616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6285ad1a-1c48-419e-9de3-6a1efae1db97 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:50.901717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6285ad1a-1c48-419e-9de3-6a1efae1db97 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:50.902232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6285ad1a-1c48-419e-9de3-6a1efae1db97 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:50.902698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6285ad1a-1c48-419e-9de3-6a1efae1db97 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:50.903472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6285ad1a-1c48-419e-9de3-6a1efae1db97 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:50.903946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6285ad1a-1c48-419e-9de3-6a1efae1db97 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:50.904392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6285ad1a-1c48-419e-9de3-6a1efae1db97 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:50.942588 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6285ad1a-1c48-419e-9de3-6a1efae1db97 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057847 Aug 27 06:00:50.943605 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3838/7683] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:50 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:00:51.960315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5fd42b94-8a65-478c-8020-dca0d160fc3d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:51.962804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5fd42b94-8a65-478c-8020-dca0d160fc3d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:51.969668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd42b94-8a65-478c-8020-dca0d160fc3d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:51.970157 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd42b94-8a65-478c-8020-dca0d160fc3d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:51.970597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd42b94-8a65-478c-8020-dca0d160fc3d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:51.971332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd42b94-8a65-478c-8020-dca0d160fc3d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:51.971789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd42b94-8a65-478c-8020-dca0d160fc3d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:51.972218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5fd42b94-8a65-478c-8020-dca0d160fc3d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:52.007836 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5fd42b94-8a65-478c-8020-dca0d160fc3d tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053614 Aug 27 06:00:52.008434 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3846/7684] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:51 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:53.020512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-febdbc7d-5ee7-49f6-a0ee-955e4051396e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:53.023284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-febdbc7d-5ee7-49f6-a0ee-955e4051396e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:53.031034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-febdbc7d-5ee7-49f6-a0ee-955e4051396e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:53.031683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-febdbc7d-5ee7-49f6-a0ee-955e4051396e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:53.032153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-febdbc7d-5ee7-49f6-a0ee-955e4051396e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:53.032941 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-febdbc7d-5ee7-49f6-a0ee-955e4051396e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:53.033464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-febdbc7d-5ee7-49f6-a0ee-955e4051396e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:53.034027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-febdbc7d-5ee7-49f6-a0ee-955e4051396e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:53.067319 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-febdbc7d-5ee7-49f6-a0ee-955e4051396e tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050886 Aug 27 06:00:53.067897 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3839/7685] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:53 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:54.079873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6006a817-edf7-4d06-9a90-143b57fe9a03 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:54.081980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6006a817-edf7-4d06-9a90-143b57fe9a03 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:54.089336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6006a817-edf7-4d06-9a90-143b57fe9a03 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:54.089822 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6006a817-edf7-4d06-9a90-143b57fe9a03 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:54.090942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6006a817-edf7-4d06-9a90-143b57fe9a03 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:54.091722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6006a817-edf7-4d06-9a90-143b57fe9a03 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:54.092198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6006a817-edf7-4d06-9a90-143b57fe9a03 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:54.092637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6006a817-edf7-4d06-9a90-143b57fe9a03 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:54.123275 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6006a817-edf7-4d06-9a90-143b57fe9a03 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047365 Aug 27 06:00:54.123863 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3847/7686] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:00:54 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 06:00:54.135494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:54.136091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:54.142877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:54.143425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:54.143938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:54.144660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:54.145130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:54.145573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:54.222955 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] HTTP exception thrown: Instance 927f853f-edff-43b9-a845-46d0d2d2f20e is not attached to volume f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Request method failure captured: Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments/f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a HTTP/1.1 Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbKl5DMlyT0gPmXMYneRB7eRO7xR6P94IkKsvopedoDaFcbJYgZWp6xpyWvpfGiYWpPGMBaqzcqapae5LbFtlBq0nG1PTfnhajdDjm5s-OQ5i-KYsXQgKtmKh1rw7aEmqRlZaqoSSV4rAsIVgzIzY9vMEC5A-w6_zAkeoYUnx20EBLA Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_86b388156db6495982d55edf1d113ca9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/86b388156db6495982d55edf1d113ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: feeb15fb481148ac9777214ed6bfa1e6 Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 927f853f-edff-43b9-a845-46d0d2d2f20e is not attached to volume f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'server_id': '927f853f-edff-43b9-a845-46d0d2d2f20e', 'id': 'f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a'} Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a. Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 927f853f-edff-43b9-a845-46d0d2d2f20e is not attached to volume f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:00:54.224627 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:00:54.229195 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:00:54.229195 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:00:54.229195 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 927f853f-edff-43b9-a845-46d0d2d2f20e is not attached to volume f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a Aug 27 06:00:54.229195 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:00:54.229195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Returning 404 to user: Instance 927f853f-edff-43b9-a845-46d0d2d2f20e is not attached to volume f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:00:54.229195 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-216986b2-0862-450e-b468-4af0b7695261 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments/f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a" status: 404 len: 154 microversion: 2.1 time: 0.095371 Aug 27 06:00:54.229195 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3840/7687] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 06:00:54 2022] DELETE /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e/os-volume_attachments/f06d85ed-1f59-4b47-b8f6-c2ad3b639f2a => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:00:57.587784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33b4c18e-aec3-40e6-96b2-321d8c0fc7dd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:57.588315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-33b4c18e-aec3-40e6-96b2-321d8c0fc7dd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:57.595050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33b4c18e-aec3-40e6-96b2-321d8c0fc7dd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:57.595581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33b4c18e-aec3-40e6-96b2-321d8c0fc7dd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:57.596023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33b4c18e-aec3-40e6-96b2-321d8c0fc7dd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:57.596725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33b4c18e-aec3-40e6-96b2-321d8c0fc7dd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:57.597186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33b4c18e-aec3-40e6-96b2-321d8c0fc7dd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:57.597615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33b4c18e-aec3-40e6-96b2-321d8c0fc7dd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:57.627437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-33b4c18e-aec3-40e6-96b2-321d8c0fc7dd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:00:57.711433 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-33b4c18e-aec3-40e6-96b2-321d8c0fc7dd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 204 len: 0 microversion: 2.1 time: 0.127993 Aug 27 06:00:57.712046 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3848/7688] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:00:57 2022] DELETE /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:00:57.721095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c9797ae7-8456-4332-aa40-cf3a6b27cea5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:57.721667 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c9797ae7-8456-4332-aa40-cf3a6b27cea5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:57.731649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9797ae7-8456-4332-aa40-cf3a6b27cea5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:57.732156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9797ae7-8456-4332-aa40-cf3a6b27cea5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:57.732608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9797ae7-8456-4332-aa40-cf3a6b27cea5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:57.733334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9797ae7-8456-4332-aa40-cf3a6b27cea5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:57.733806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9797ae7-8456-4332-aa40-cf3a6b27cea5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:57.734255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9797ae7-8456-4332-aa40-cf3a6b27cea5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:57.877661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c9797ae7-8456-4332-aa40-cf3a6b27cea5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:57.886476 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c9797ae7-8456-4332-aa40-cf3a6b27cea5 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1561 microversion: 2.1 time: 0.169403 Aug 27 06:00:57.900331 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3841/7689] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:57 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:58.908220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-39562d42-2ab7-49c2-ae64-6495811837a9 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:58.908932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-39562d42-2ab7-49c2-ae64-6495811837a9 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:58.917236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39562d42-2ab7-49c2-ae64-6495811837a9 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:58.917731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39562d42-2ab7-49c2-ae64-6495811837a9 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:58.918184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39562d42-2ab7-49c2-ae64-6495811837a9 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:58.918894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39562d42-2ab7-49c2-ae64-6495811837a9 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:58.919389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39562d42-2ab7-49c2-ae64-6495811837a9 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:58.919826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-39562d42-2ab7-49c2-ae64-6495811837a9 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:59.056108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-39562d42-2ab7-49c2-ae64-6495811837a9 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:59.064025 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-39562d42-2ab7-49c2-ae64-6495811837a9 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1561 microversion: 2.1 time: 0.160135 Aug 27 06:00:59.064602 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3849/7690] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:58 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:00.088087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-084036fd-dce6-4a05-96f7-f42be83460fd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:00.088650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-084036fd-dce6-4a05-96f7-f42be83460fd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:00.098324 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-084036fd-dce6-4a05-96f7-f42be83460fd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:00.099144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-084036fd-dce6-4a05-96f7-f42be83460fd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:00.101435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-084036fd-dce6-4a05-96f7-f42be83460fd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:00.102649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-084036fd-dce6-4a05-96f7-f42be83460fd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:00.104742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-084036fd-dce6-4a05-96f7-f42be83460fd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:00.105045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-84e9d0f7-00bd-4d86-9c62-79b05313b9a5 req-14126710-0203-4e3e-a511-705a99106bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927f853f-edff-43b9-a845-46d0d2d2f20e", "name": "network-vif-deleted", "tag": "4385a75d-53e1-43c6-94c9-8d06b53079a7"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:01:00.105553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-084036fd-dce6-4a05-96f7-f42be83460fd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:00.118100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-84e9d0f7-00bd-4d86-9c62-79b05313b9a5 req-14126710-0203-4e3e-a511-705a99106bae service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:00.119056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-84e9d0f7-00bd-4d86-9c62-79b05313b9a5 req-14126710-0203-4e3e-a511-705a99106bae service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:00.119842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-84e9d0f7-00bd-4d86-9c62-79b05313b9a5 req-14126710-0203-4e3e-a511-705a99106bae service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:00.134783 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-84e9d0f7-00bd-4d86-9c62-79b05313b9a5 req-14126710-0203-4e3e-a511-705a99106bae service nova] Creating event network-vif-deleted:4385a75d-53e1-43c6-94c9-8d06b53079a7 for instance 927f853f-edff-43b9-a845-46d0d2d2f20e on n-h1-820368-35 Aug 27 06:01:00.139817 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-84e9d0f7-00bd-4d86-9c62-79b05313b9a5 req-14126710-0203-4e3e-a511-705a99106bae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044500 Aug 27 06:01:00.143730 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3850/7691] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:01:00.192860 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-084036fd-dce6-4a05-96f7-f42be83460fd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feeb15fb481148ac9777214ed6bfa1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b388156db6495982d55edf1d113ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:00.201800 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-084036fd-dce6-4a05-96f7-f42be83460fd tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 200 len: 1519 microversion: 2.1 time: 0.120029 Aug 27 06:01:00.202391 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3842/7692] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:00 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 1519 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:01.225091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:01.225852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] [instance: 927f853f-edff-43b9-a845-46d0d2d2f20e] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:01.232012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:01.232587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:01.232943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:01.233648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:01.234100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:01.234533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:01.248578 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] HTTP exception thrown: Instance 927f853f-edff-43b9-a845-46d0d2d2f20e could not be found. Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Request method failure captured: Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e HTTP/1.1 Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbKl5DMlyT0gPmXMYneRB7eRO7xR6P94IkKsvopedoDaFcbJYgZWp6xpyWvpfGiYWpPGMBaqzcqapae5LbFtlBq0nG1PTfnhajdDjm5s-OQ5i-KYsXQgKtmKh1rw7aEmqRlZaqoSSV4rAsIVgzIzY9vMEC5A-w6_zAkeoYUnx20EBLA Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_86b388156db6495982d55edf1d113ca9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/86b388156db6495982d55edf1d113ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/86b388156db6495982d55edf1d113ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 86b388156db6495982d55edf1d113ca9 Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1754186942 Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: feeb15fb481148ac9777214ed6bfa1e6 Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestEncryptedCinderVolumes-1754186942-project Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 927f853f-edff-43b9-a845-46d0d2d2f20e could not be found. Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '927f853f-edff-43b9-a845-46d0d2d2f20e'} Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 927f853f-edff-43b9-a845-46d0d2d2f20e could not be found. Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 927f853f-edff-43b9-a845-46d0d2d2f20e could not be found. Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:01:01.250228 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:01:01.255111 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:01:01.255111 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:01:01.255111 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:01:01.255111 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:01:01.255111 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:01:01.255111 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:01:01.255111 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 927f853f-edff-43b9-a845-46d0d2d2f20e could not be found. Aug 27 06:01:01.255111 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:01:01.255111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Returning 404 to user: Instance 927f853f-edff-43b9-a845-46d0d2d2f20e could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:01:01.255111 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d3fe1b9b-0dc9-43cf-81ca-6c2f5d0deed7 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e" status: 404 len: 111 microversion: 2.1 time: 0.031672 Aug 27 06:01:01.255111 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3851/7693] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:01 2022] GET /compute/v2.1/servers/927f853f-edff-43b9-a845-46d0d2d2f20e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:01:01.261281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-287068bb-2998-4c75-aaae-d8a034a57cb4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] Calling method '.version_select at 0x7fb55feed820>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:01.282394 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-287068bb-2998-4c75-aaae-d8a034a57cb4 tempest-TestEncryptedCinderVolumes-1754186942 tempest-TestEncryptedCinderVolumes-1754186942-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-717294120" status: 202 len: 0 microversion: 2.1 time: 0.025054 Aug 27 06:01:01.282970 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3843/7694] 10.222.0.58 () {58 vars in 1275 bytes} [Sat Aug 27 06:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-717294120 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:01:28.750107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-90ab2642-5574-43df-8e20-294981730e51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'create', calling method: .version_select at 0x7fb5640d0550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1713268166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9dJrH4+QeU0pdDjSdUmcO/amPpB2xRfj73HqJmiruB0EYNuRTXXdySvS8Ytra1BCXltHw/gzBOtE11Zc9f6ececstrx4rL+GxMk0PCSSuUq4hi3dkBjJ/2z5Z07aDTwA=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:01:28.756962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:01:28.757614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:01:28.776789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-90ab2642-5574-43df-8e20-294981730e51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Getting quotas for project 2e97b7c5120f427ea4815163908d7382. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:01:28.781919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-90ab2642-5574-43df-8e20-294981730e51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Getting quotas for user e3a94ad543bf4e70ae34f6bb6620b5ca and project 2e97b7c5120f427ea4815163908d7382. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:01:28.806852 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-90ab2642-5574-43df-8e20-294981730e51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060534 Aug 27 06:01:28.807506 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3852/7695] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 06:01:28 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:01:28.856497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=36 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:01:28.857270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:01:28.858268 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:01:28.858404 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:01:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.58) !!! Aug 27 06:01:28.864966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1226931436", "imageRef": "756444e9-3ea6-4e70-8cba-d8ac63c915c6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1713268166", "networks": [{"uuid": "f288a1ad-1aa5-4520-b60f-64221f2a1544"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:01:29.029423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] validate_networks() for [('f288a1ad-1aa5-4520-b60f-64221f2a1544', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:01:29.402183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:01:29.402625 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:01:29.403211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:01:29.403641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:01:29.404087 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:01:29.413534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:29.413973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:29.414426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:29.415191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:29.415662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:29.416115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:29.434679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Getting quotas for project 2e97b7c5120f427ea4815163908d7382. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:01:29.439973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Getting quotas for user e3a94ad543bf4e70ae34f6bb6620b5ca and project 2e97b7c5120f427ea4815163908d7382. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:01:29.453123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:01:29.455415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='756444e9-3ea6-4e70-8cba-d8ac63c915c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:01:29.502803 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ac2334c9-c795-49de-9869-971248de12d6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648190 Aug 27 06:01:29.503503 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3844/7696] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:01:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:01:29.514661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f81f42b4-e97d-48d4-8f43-0d4b7f2e1143 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:29.515303 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f81f42b4-e97d-48d4-8f43-0d4b7f2e1143 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:29.680828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f81f42b4-e97d-48d4-8f43-0d4b7f2e1143 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:29.688390 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f81f42b4-e97d-48d4-8f43-0d4b7f2e1143 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1259 microversion: 2.1 time: 0.177534 Aug 27 06:01:29.689074 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3853/7697] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:29 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:30.711386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-83047eba-9bcf-4fe0-af71-f28b7ab1defa tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:30.712137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-83047eba-9bcf-4fe0-af71-f28b7ab1defa tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:30.730560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83047eba-9bcf-4fe0-af71-f28b7ab1defa tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:30.731234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83047eba-9bcf-4fe0-af71-f28b7ab1defa tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:30.731768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83047eba-9bcf-4fe0-af71-f28b7ab1defa tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:30.732511 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83047eba-9bcf-4fe0-af71-f28b7ab1defa tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:30.732990 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83047eba-9bcf-4fe0-af71-f28b7ab1defa tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:30.733442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-83047eba-9bcf-4fe0-af71-f28b7ab1defa tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:30.816408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-83047eba-9bcf-4fe0-af71-f28b7ab1defa tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:30.825570 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-83047eba-9bcf-4fe0-af71-f28b7ab1defa tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1317 microversion: 2.1 time: 0.118955 Aug 27 06:01:30.826624 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3845/7698] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:30 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1317 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:31.847584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e099795a-f78b-4f85-ab67-7c4c5b515cd5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:31.848441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e099795a-f78b-4f85-ab67-7c4c5b515cd5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:31.856232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e099795a-f78b-4f85-ab67-7c4c5b515cd5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:31.856799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e099795a-f78b-4f85-ab67-7c4c5b515cd5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:31.857313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e099795a-f78b-4f85-ab67-7c4c5b515cd5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:31.858267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e099795a-f78b-4f85-ab67-7c4c5b515cd5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:31.858952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e099795a-f78b-4f85-ab67-7c4c5b515cd5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:31.859469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e099795a-f78b-4f85-ab67-7c4c5b515cd5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:32.000151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e099795a-f78b-4f85-ab67-7c4c5b515cd5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:32.012652 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e099795a-f78b-4f85-ab67-7c4c5b515cd5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.168675 Aug 27 06:01:32.013818 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3854/7699] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:31 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:33.038720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-76105a09-2f52-42d0-8fa2-87a16fd1e10f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:33.039708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-76105a09-2f52-42d0-8fa2-87a16fd1e10f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:33.051108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76105a09-2f52-42d0-8fa2-87a16fd1e10f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:33.052225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76105a09-2f52-42d0-8fa2-87a16fd1e10f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:33.052824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76105a09-2f52-42d0-8fa2-87a16fd1e10f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:33.053674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76105a09-2f52-42d0-8fa2-87a16fd1e10f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:33.054146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76105a09-2f52-42d0-8fa2-87a16fd1e10f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:33.055082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-76105a09-2f52-42d0-8fa2-87a16fd1e10f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:33.211302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-76105a09-2f52-42d0-8fa2-87a16fd1e10f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:33.227168 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-76105a09-2f52-42d0-8fa2-87a16fd1e10f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.192635 Aug 27 06:01:33.233660 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3846/7700] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:33 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:34.248830 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d6eaa590-11a5-443a-8a98-abd20dc61539 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:34.249449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d6eaa590-11a5-443a-8a98-abd20dc61539 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:34.256617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6eaa590-11a5-443a-8a98-abd20dc61539 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:34.257107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6eaa590-11a5-443a-8a98-abd20dc61539 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:34.257547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6eaa590-11a5-443a-8a98-abd20dc61539 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:34.258254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6eaa590-11a5-443a-8a98-abd20dc61539 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:34.258715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6eaa590-11a5-443a-8a98-abd20dc61539 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:34.259171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d6eaa590-11a5-443a-8a98-abd20dc61539 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:34.401635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d6eaa590-11a5-443a-8a98-abd20dc61539 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:34.410498 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d6eaa590-11a5-443a-8a98-abd20dc61539 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.165751 Aug 27 06:01:34.414051 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3855/7701] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:34 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:35.432669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c8affecf-ad89-4b40-a24a-1d180bf4ee51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:35.433470 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c8affecf-ad89-4b40-a24a-1d180bf4ee51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:35.441588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8affecf-ad89-4b40-a24a-1d180bf4ee51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:35.442088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8affecf-ad89-4b40-a24a-1d180bf4ee51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:35.442540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8affecf-ad89-4b40-a24a-1d180bf4ee51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:35.443299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8affecf-ad89-4b40-a24a-1d180bf4ee51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:35.443831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8affecf-ad89-4b40-a24a-1d180bf4ee51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:35.444264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8affecf-ad89-4b40-a24a-1d180bf4ee51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:35.585029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c8affecf-ad89-4b40-a24a-1d180bf4ee51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:35.592907 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c8affecf-ad89-4b40-a24a-1d180bf4ee51 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.164234 Aug 27 06:01:35.593700 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3847/7702] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:35 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:01:36.614039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-df8c708f-495a-480e-9da6-002094f5a639 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:36.614790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-df8c708f-495a-480e-9da6-002094f5a639 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:36.621961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df8c708f-495a-480e-9da6-002094f5a639 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:36.622456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df8c708f-495a-480e-9da6-002094f5a639 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:36.622896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df8c708f-495a-480e-9da6-002094f5a639 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:36.623684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df8c708f-495a-480e-9da6-002094f5a639 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:36.624182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df8c708f-495a-480e-9da6-002094f5a639 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:36.624749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-df8c708f-495a-480e-9da6-002094f5a639 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:36.786215 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-df8c708f-495a-480e-9da6-002094f5a639 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:36.794276 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-df8c708f-495a-480e-9da6-002094f5a639 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.184665 Aug 27 06:01:36.795054 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3856/7703] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:36 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:37.817800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f6dfa1cd-822f-45ef-a675-002581c17ad2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:37.818760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f6dfa1cd-822f-45ef-a675-002581c17ad2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:37.826944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6dfa1cd-822f-45ef-a675-002581c17ad2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:37.827688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6dfa1cd-822f-45ef-a675-002581c17ad2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:37.828218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6dfa1cd-822f-45ef-a675-002581c17ad2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:37.829022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6dfa1cd-822f-45ef-a675-002581c17ad2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:37.829569 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6dfa1cd-822f-45ef-a675-002581c17ad2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:37.830101 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f6dfa1cd-822f-45ef-a675-002581c17ad2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:37.988455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f6dfa1cd-822f-45ef-a675-002581c17ad2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:37.996245 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f6dfa1cd-822f-45ef-a675-002581c17ad2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.183922 Aug 27 06:01:37.997028 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3848/7704] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:37 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:39.017790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-89a8b975-51fb-4d4a-b8af-f5765bda22c5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:39.018439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-89a8b975-51fb-4d4a-b8af-f5765bda22c5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:39.025967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8b975-51fb-4d4a-b8af-f5765bda22c5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:39.026457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8b975-51fb-4d4a-b8af-f5765bda22c5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:39.026903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8b975-51fb-4d4a-b8af-f5765bda22c5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:39.027636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8b975-51fb-4d4a-b8af-f5765bda22c5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:39.028097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8b975-51fb-4d4a-b8af-f5765bda22c5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:39.028532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-89a8b975-51fb-4d4a-b8af-f5765bda22c5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:39.158267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-89a8b975-51fb-4d4a-b8af-f5765bda22c5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:39.167122 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-89a8b975-51fb-4d4a-b8af-f5765bda22c5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.153240 Aug 27 06:01:39.167711 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3857/7705] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:39 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:40.187959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb0479af-4320-49c5-9854-22d2985c77e9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:40.188623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bb0479af-4320-49c5-9854-22d2985c77e9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:40.191313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:01:40.192127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:01:40.197825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0479af-4320-49c5-9854-22d2985c77e9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:40.198322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0479af-4320-49c5-9854-22d2985c77e9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:40.198776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0479af-4320-49c5-9854-22d2985c77e9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:40.199516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0479af-4320-49c5-9854-22d2985c77e9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:40.199983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0479af-4320-49c5-9854-22d2985c77e9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:40.200423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb0479af-4320-49c5-9854-22d2985c77e9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:40.328849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb0479af-4320-49c5-9854-22d2985c77e9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:40.336495 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb0479af-4320-49c5-9854-22d2985c77e9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.152402 Aug 27 06:01:40.337071 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3849/7706] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:40 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:41.357720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f9806bda-6410-4f5e-8305-d77fca87eb54 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:41.358266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f9806bda-6410-4f5e-8305-d77fca87eb54 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:41.360145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:01:41.366096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9806bda-6410-4f5e-8305-d77fca87eb54 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:41.366585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9806bda-6410-4f5e-8305-d77fca87eb54 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:41.367025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9806bda-6410-4f5e-8305-d77fca87eb54 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:41.367749 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9806bda-6410-4f5e-8305-d77fca87eb54 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:41.368209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9806bda-6410-4f5e-8305-d77fca87eb54 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:41.368638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f9806bda-6410-4f5e-8305-d77fca87eb54 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:41.500151 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f9806bda-6410-4f5e-8305-d77fca87eb54 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:41.507828 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f9806bda-6410-4f5e-8305-d77fca87eb54 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.154047 Aug 27 06:01:41.508405 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3858/7707] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:41 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:42.494668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-0c34a6e0-eed3-405b-ad43-b978f7a25288 req-53722b9e-e5a6-4d52-b7ac-626ebcd9831d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7734304-46c7-4687-8fb2-943a6e232597", "tag": "fc76d769-ebbb-4d1f-9f7c-3fa366bdc064"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:01:42.504753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c34a6e0-eed3-405b-ad43-b978f7a25288 req-53722b9e-e5a6-4d52-b7ac-626ebcd9831d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:42.505243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c34a6e0-eed3-405b-ad43-b978f7a25288 req-53722b9e-e5a6-4d52-b7ac-626ebcd9831d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:42.506243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-0c34a6e0-eed3-405b-ad43-b978f7a25288 req-53722b9e-e5a6-4d52-b7ac-626ebcd9831d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:42.516938 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-0c34a6e0-eed3-405b-ad43-b978f7a25288 req-53722b9e-e5a6-4d52-b7ac-626ebcd9831d service nova] Creating event network-changed:fc76d769-ebbb-4d1f-9f7c-3fa366bdc064 for instance c7734304-46c7-4687-8fb2-943a6e232597 on n-h1-820368-35 Aug 27 06:01:42.522565 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-0c34a6e0-eed3-405b-ad43-b978f7a25288 req-53722b9e-e5a6-4d52-b7ac-626ebcd9831d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031488 Aug 27 06:01:42.523831 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3850/7708] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:01:42.529154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b267a123-ae46-41dd-b838-c44b5fe99571 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:42.530199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b267a123-ae46-41dd-b838-c44b5fe99571 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:42.539172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b267a123-ae46-41dd-b838-c44b5fe99571 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:42.539797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b267a123-ae46-41dd-b838-c44b5fe99571 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:42.540252 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b267a123-ae46-41dd-b838-c44b5fe99571 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:42.540968 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b267a123-ae46-41dd-b838-c44b5fe99571 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:42.541429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b267a123-ae46-41dd-b838-c44b5fe99571 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:42.542357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b267a123-ae46-41dd-b838-c44b5fe99571 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:42.705523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b267a123-ae46-41dd-b838-c44b5fe99571 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:42.713852 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b267a123-ae46-41dd-b838-c44b5fe99571 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.189248 Aug 27 06:01:42.714430 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3859/7709] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:42 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:01:43.735374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4d18a716-a739-4684-b3a9-9e8d8fd52ae6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:43.736138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4d18a716-a739-4684-b3a9-9e8d8fd52ae6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:43.742357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d18a716-a739-4684-b3a9-9e8d8fd52ae6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:43.742717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d18a716-a739-4684-b3a9-9e8d8fd52ae6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:43.743276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d18a716-a739-4684-b3a9-9e8d8fd52ae6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:43.744095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d18a716-a739-4684-b3a9-9e8d8fd52ae6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:43.744587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d18a716-a739-4684-b3a9-9e8d8fd52ae6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:43.745023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4d18a716-a739-4684-b3a9-9e8d8fd52ae6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:43.976186 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4d18a716-a739-4684-b3a9-9e8d8fd52ae6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:43.984051 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4d18a716-a739-4684-b3a9-9e8d8fd52ae6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.253958 Aug 27 06:01:43.984617 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3851/7710] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:43 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:45.004659 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e84053d8-d1ee-4f41-b448-2e69e793af9c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:45.005280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e84053d8-d1ee-4f41-b448-2e69e793af9c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:45.012828 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e84053d8-d1ee-4f41-b448-2e69e793af9c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:45.013320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e84053d8-d1ee-4f41-b448-2e69e793af9c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:45.013765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e84053d8-d1ee-4f41-b448-2e69e793af9c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:45.014472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e84053d8-d1ee-4f41-b448-2e69e793af9c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:45.014933 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e84053d8-d1ee-4f41-b448-2e69e793af9c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:45.015441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e84053d8-d1ee-4f41-b448-2e69e793af9c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:45.149977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e84053d8-d1ee-4f41-b448-2e69e793af9c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:45.157722 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e84053d8-d1ee-4f41-b448-2e69e793af9c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.156979 Aug 27 06:01:45.158288 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3860/7711] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:44 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:46.178445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a4ce2383-364e-4adb-b70b-0f37f8dff21c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:46.179688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a4ce2383-364e-4adb-b70b-0f37f8dff21c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:46.186578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ce2383-364e-4adb-b70b-0f37f8dff21c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:46.187075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ce2383-364e-4adb-b70b-0f37f8dff21c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:46.187553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ce2383-364e-4adb-b70b-0f37f8dff21c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:46.188267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ce2383-364e-4adb-b70b-0f37f8dff21c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:46.188735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ce2383-364e-4adb-b70b-0f37f8dff21c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:46.189176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a4ce2383-364e-4adb-b70b-0f37f8dff21c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:46.321672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a4ce2383-364e-4adb-b70b-0f37f8dff21c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:46.329452 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a4ce2383-364e-4adb-b70b-0f37f8dff21c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.154881 Aug 27 06:01:46.330013 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3852/7712] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:46 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:47.350058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8239e5f5-3252-4298-bee7-655bc773cc0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:47.351326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8239e5f5-3252-4298-bee7-655bc773cc0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:47.358145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8239e5f5-3252-4298-bee7-655bc773cc0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:47.358634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8239e5f5-3252-4298-bee7-655bc773cc0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:47.359081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8239e5f5-3252-4298-bee7-655bc773cc0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:47.359812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8239e5f5-3252-4298-bee7-655bc773cc0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:47.360277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8239e5f5-3252-4298-bee7-655bc773cc0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:47.360712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8239e5f5-3252-4298-bee7-655bc773cc0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:47.486924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8239e5f5-3252-4298-bee7-655bc773cc0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:47.495045 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8239e5f5-3252-4298-bee7-655bc773cc0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.149067 Aug 27 06:01:47.495667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3861/7713] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:47 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:48.515974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2812a8ac-207f-4b88-a3bb-0b405aedfb0a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:48.516599 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2812a8ac-207f-4b88-a3bb-0b405aedfb0a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:48.523588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2812a8ac-207f-4b88-a3bb-0b405aedfb0a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:48.524081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2812a8ac-207f-4b88-a3bb-0b405aedfb0a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:48.524529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2812a8ac-207f-4b88-a3bb-0b405aedfb0a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:48.525235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2812a8ac-207f-4b88-a3bb-0b405aedfb0a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:48.525721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2812a8ac-207f-4b88-a3bb-0b405aedfb0a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:48.526155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2812a8ac-207f-4b88-a3bb-0b405aedfb0a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:48.657774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2812a8ac-207f-4b88-a3bb-0b405aedfb0a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:48.666040 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2812a8ac-207f-4b88-a3bb-0b405aedfb0a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.153948 Aug 27 06:01:48.666613 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3853/7714] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:48 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:49.686901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-535491ff-3545-4ad0-90a3-1819b78c6570 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:49.687549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-535491ff-3545-4ad0-90a3-1819b78c6570 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:49.694356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535491ff-3545-4ad0-90a3-1819b78c6570 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:49.694833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535491ff-3545-4ad0-90a3-1819b78c6570 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:49.695309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535491ff-3545-4ad0-90a3-1819b78c6570 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:49.695995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535491ff-3545-4ad0-90a3-1819b78c6570 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:49.696444 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535491ff-3545-4ad0-90a3-1819b78c6570 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:49.697058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-535491ff-3545-4ad0-90a3-1819b78c6570 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:49.837987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-535491ff-3545-4ad0-90a3-1819b78c6570 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:49.846956 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-535491ff-3545-4ad0-90a3-1819b78c6570 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.163961 Aug 27 06:01:49.847577 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3862/7715] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:49 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:49.892322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7751e1ac-43f0-4e15-a8f2-87a5a60a228a req-086f1774-dbdb-4f56-a5ff-8c4cef82afa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7734304-46c7-4687-8fb2-943a6e232597", "name": "network-vif-plugged", "status": "completed", "tag": "fc76d769-ebbb-4d1f-9f7c-3fa366bdc064"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:01:49.904440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7751e1ac-43f0-4e15-a8f2-87a5a60a228a req-086f1774-dbdb-4f56-a5ff-8c4cef82afa4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:49.905145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7751e1ac-43f0-4e15-a8f2-87a5a60a228a req-086f1774-dbdb-4f56-a5ff-8c4cef82afa4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:49.905778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7751e1ac-43f0-4e15-a8f2-87a5a60a228a req-086f1774-dbdb-4f56-a5ff-8c4cef82afa4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:49.917159 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7751e1ac-43f0-4e15-a8f2-87a5a60a228a req-086f1774-dbdb-4f56-a5ff-8c4cef82afa4 service nova] Creating event network-vif-plugged:fc76d769-ebbb-4d1f-9f7c-3fa366bdc064 for instance c7734304-46c7-4687-8fb2-943a6e232597 on n-h1-820368-35 Aug 27 06:01:49.922238 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7751e1ac-43f0-4e15-a8f2-87a5a60a228a req-086f1774-dbdb-4f56-a5ff-8c4cef82afa4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033661 Aug 27 06:01:49.923124 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3854/7716] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:01:50.869523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-35c5a3ee-056d-4fa1-8282-f78236c6d5da tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:50.870180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-35c5a3ee-056d-4fa1-8282-f78236c6d5da tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:50.877712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c5a3ee-056d-4fa1-8282-f78236c6d5da tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:50.878202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c5a3ee-056d-4fa1-8282-f78236c6d5da tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:50.878651 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c5a3ee-056d-4fa1-8282-f78236c6d5da tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:50.879387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c5a3ee-056d-4fa1-8282-f78236c6d5da tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:50.879851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c5a3ee-056d-4fa1-8282-f78236c6d5da tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:50.880290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-35c5a3ee-056d-4fa1-8282-f78236c6d5da tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:51.009634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-35c5a3ee-056d-4fa1-8282-f78236c6d5da tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:51.018375 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-35c5a3ee-056d-4fa1-8282-f78236c6d5da tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1359 microversion: 2.1 time: 0.153324 Aug 27 06:01:51.018985 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3863/7717] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:50 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:52.042786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e8271223-43ba-42fa-b9b7-6933c09f7d47 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:52.043578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e8271223-43ba-42fa-b9b7-6933c09f7d47 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:52.050519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8271223-43ba-42fa-b9b7-6933c09f7d47 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:52.051022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8271223-43ba-42fa-b9b7-6933c09f7d47 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:52.051500 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8271223-43ba-42fa-b9b7-6933c09f7d47 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:52.052219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8271223-43ba-42fa-b9b7-6933c09f7d47 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:52.052679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8271223-43ba-42fa-b9b7-6933c09f7d47 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:52.053396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e8271223-43ba-42fa-b9b7-6933c09f7d47 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:52.187550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e8271223-43ba-42fa-b9b7-6933c09f7d47 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:52.195406 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e8271223-43ba-42fa-b9b7-6933c09f7d47 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1549 microversion: 2.1 time: 0.158515 Aug 27 06:01:52.195990 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3855/7718] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:52 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:52.215226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9a1024fd-dda7-411a-9b6a-ed27e01b042d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:52.215850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9a1024fd-dda7-411a-9b6a-ed27e01b042d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:52.222638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a1024fd-dda7-411a-9b6a-ed27e01b042d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:52.223188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a1024fd-dda7-411a-9b6a-ed27e01b042d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:52.223640 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a1024fd-dda7-411a-9b6a-ed27e01b042d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:52.224426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a1024fd-dda7-411a-9b6a-ed27e01b042d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:52.224957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a1024fd-dda7-411a-9b6a-ed27e01b042d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:52.225902 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a1024fd-dda7-411a-9b6a-ed27e01b042d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:52.358787 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9a1024fd-dda7-411a-9b6a-ed27e01b042d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:52.367300 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9a1024fd-dda7-411a-9b6a-ed27e01b042d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1549 microversion: 2.1 time: 0.155827 Aug 27 06:01:52.368049 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3864/7719] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:52 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:52.386689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-911260d4-c361-480c-bb9d-b5322ccccce5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:52.391293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-911260d4-c361-480c-bb9d-b5322ccccce5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:52.392067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-911260d4-c361-480c-bb9d-b5322ccccce5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Searching by: {'deleted': False, 'project_id': '2e97b7c5120f427ea4815163908d7382'} {{(pid=128547) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 06:01:52.397479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-911260d4-c361-480c-bb9d-b5322ccccce5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:52.397966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-911260d4-c361-480c-bb9d-b5322ccccce5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:52.398411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-911260d4-c361-480c-bb9d-b5322ccccce5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:52.399170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-911260d4-c361-480c-bb9d-b5322ccccce5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:52.399633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-911260d4-c361-480c-bb9d-b5322ccccce5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:52.400070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-911260d4-c361-480c-bb9d-b5322ccccce5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:52.424346 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.multi_cell_list [None req-911260d4-c361-480c-bb9d-b5322ccccce5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 06:01:52.450650 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-911260d4-c361-480c-bb9d-b5322ccccce5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067725 Aug 27 06:01:52.451263 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3856/7720] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 06:01:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:01:52.462565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d5ebf022-201b-43af-a008-6df40ea70b3e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:52.463218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d5ebf022-201b-43af-a008-6df40ea70b3e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:52.469090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5ebf022-201b-43af-a008-6df40ea70b3e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:52.469572 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5ebf022-201b-43af-a008-6df40ea70b3e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:52.470008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5ebf022-201b-43af-a008-6df40ea70b3e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:52.470707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5ebf022-201b-43af-a008-6df40ea70b3e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:52.471196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5ebf022-201b-43af-a008-6df40ea70b3e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:52.471629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d5ebf022-201b-43af-a008-6df40ea70b3e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:52.603512 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d5ebf022-201b-43af-a008-6df40ea70b3e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:52.611545 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d5ebf022-201b-43af-a008-6df40ea70b3e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1549 microversion: 2.1 time: 0.152857 Aug 27 06:01:52.612161 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3865/7721] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:52 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:54.197059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-90916067-def6-454a-a3a2-8ee5deea4136 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b22f4ff8-25b8-4fda-ad70-d120187321f4"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:01:54.199450 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-90916067-def6-454a-a3a2-8ee5deea4136 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:54.206657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90916067-def6-454a-a3a2-8ee5deea4136 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:54.207197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90916067-def6-454a-a3a2-8ee5deea4136 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:54.207660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90916067-def6-454a-a3a2-8ee5deea4136 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:54.208524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90916067-def6-454a-a3a2-8ee5deea4136 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:54.209021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90916067-def6-454a-a3a2-8ee5deea4136 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:54.209468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-90916067-def6-454a-a3a2-8ee5deea4136 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:54.488186 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-90916067-def6-454a-a3a2-8ee5deea4136 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295522 Aug 27 06:01:54.488849 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3857/7722] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 06:01:54 2022] POST /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:02:07.549868 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8f475ed-cdf4-4431-a3de-87ac455726c4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:07.550488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8f475ed-cdf4-4431-a3de-87ac455726c4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:07.552582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:07.553387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=72 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:07.559224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8f475ed-cdf4-4431-a3de-87ac455726c4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:07.559713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8f475ed-cdf4-4431-a3de-87ac455726c4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:07.560154 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8f475ed-cdf4-4431-a3de-87ac455726c4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:07.560852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8f475ed-cdf4-4431-a3de-87ac455726c4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:07.561305 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8f475ed-cdf4-4431-a3de-87ac455726c4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:07.561733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8f475ed-cdf4-4431-a3de-87ac455726c4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:07.708193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d8f475ed-cdf4-4431-a3de-87ac455726c4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:07.716829 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8f475ed-cdf4-4431-a3de-87ac455726c4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1595 microversion: 2.1 time: 0.171326 Aug 27 06:02:07.717416 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3866/7723] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:07 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1595 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:09.394050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-bfc19ce6-98a0-48cf-99c5-1e6318f2386e req-1499d497-de55-428c-a66c-f1f9d79baf57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7734304-46c7-4687-8fb2-943a6e232597", "tag": "fc76d769-ebbb-4d1f-9f7c-3fa366bdc064"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:02:09.407874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:09.409582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:09.410513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:09.414227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bfc19ce6-98a0-48cf-99c5-1e6318f2386e req-1499d497-de55-428c-a66c-f1f9d79baf57 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:09.415192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bfc19ce6-98a0-48cf-99c5-1e6318f2386e req-1499d497-de55-428c-a66c-f1f9d79baf57 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:09.416223 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-bfc19ce6-98a0-48cf-99c5-1e6318f2386e req-1499d497-de55-428c-a66c-f1f9d79baf57 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:09.433343 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-bfc19ce6-98a0-48cf-99c5-1e6318f2386e req-1499d497-de55-428c-a66c-f1f9d79baf57 service nova] Creating event network-changed:fc76d769-ebbb-4d1f-9f7c-3fa366bdc064 for instance c7734304-46c7-4687-8fb2-943a6e232597 on n-h1-820368-35 Aug 27 06:02:09.440066 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-bfc19ce6-98a0-48cf-99c5-1e6318f2386e req-1499d497-de55-428c-a66c-f1f9d79baf57 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050888 Aug 27 06:02:09.441050 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3858/7724] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:02:10.588766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a4a8d254-a823-437a-9584-39c6b22001b4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-102863849"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:02:10.589381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a4a8d254-a823-437a-9584-39c6b22001b4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:10.596354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a8d254-a823-437a-9584-39c6b22001b4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:10.596855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a8d254-a823-437a-9584-39c6b22001b4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:10.597300 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a8d254-a823-437a-9584-39c6b22001b4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:10.598044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a8d254-a823-437a-9584-39c6b22001b4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:10.598691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a8d254-a823-437a-9584-39c6b22001b4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:10.599142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a4a8d254-a823-437a-9584-39c6b22001b4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:10.736217 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.network.security_group_api [None req-a4a8d254-a823-437a-9584-39c6b22001b4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Adding security group 4d063f36-924e-4068-bbae-c117b6e387f5 to port fc76d769-ebbb-4d1f-9f7c-3fa366bdc064 Aug 27 06:02:11.049420 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a4a8d254-a823-437a-9584-39c6b22001b4 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/action" status: 202 len: 0 microversion: 2.1 time: 0.465340 Aug 27 06:02:11.050050 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3867/7725] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:02:10 2022] POST /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 06:02:11.059332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9782eaf1-1841-4666-8e5c-19d3581580a1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:11.059961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9782eaf1-1841-4666-8e5c-19d3581580a1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:11.067479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9782eaf1-1841-4666-8e5c-19d3581580a1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:11.068247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9782eaf1-1841-4666-8e5c-19d3581580a1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:11.069810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9782eaf1-1841-4666-8e5c-19d3581580a1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:11.070964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9782eaf1-1841-4666-8e5c-19d3581580a1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:11.071690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9782eaf1-1841-4666-8e5c-19d3581580a1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:11.071899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9782eaf1-1841-4666-8e5c-19d3581580a1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:11.232288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9782eaf1-1841-4666-8e5c-19d3581580a1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:11.241654 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9782eaf1-1841-4666-8e5c-19d3581580a1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1760 microversion: 2.1 time: 0.186241 Aug 27 06:02:11.242474 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3859/7726] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:11 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1760 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:11.456765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6670e19f-856a-4f1a-a514-d32aaea06098 req-ec72d1d6-e35f-4a71-ba69-5a4655a79c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7734304-46c7-4687-8fb2-943a6e232597", "tag": "fc76d769-ebbb-4d1f-9f7c-3fa366bdc064"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:02:11.466858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6670e19f-856a-4f1a-a514-d32aaea06098 req-ec72d1d6-e35f-4a71-ba69-5a4655a79c0b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:11.467382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6670e19f-856a-4f1a-a514-d32aaea06098 req-ec72d1d6-e35f-4a71-ba69-5a4655a79c0b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:11.467824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6670e19f-856a-4f1a-a514-d32aaea06098 req-ec72d1d6-e35f-4a71-ba69-5a4655a79c0b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:11.483436 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6670e19f-856a-4f1a-a514-d32aaea06098 req-ec72d1d6-e35f-4a71-ba69-5a4655a79c0b service nova] Creating event network-changed:fc76d769-ebbb-4d1f-9f7c-3fa366bdc064 for instance c7734304-46c7-4687-8fb2-943a6e232597 on n-h1-820368-35 Aug 27 06:02:11.489071 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6670e19f-856a-4f1a-a514-d32aaea06098 req-ec72d1d6-e35f-4a71-ba69-5a4655a79c0b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036603 Aug 27 06:02:11.489710 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3868/7727] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:04:32.920167 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a138aa11-e323-45d1-b35b-6ab4ed1899de] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:04:32.921254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:04:32.922119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:04:32.923834 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:04:32.923985 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:04:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/action (ip 10.222.0.58) !!! Aug 27 06:04:32.925856 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:04:32.926007 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:04:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/action (ip 10.222.0.58) !!! Aug 27 06:04:32.927078 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:04:32.927247 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:04:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/action (ip 10.222.0.58) !!! Aug 27 06:04:32.933025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c6210311-b540-4a9d-8967-55f52d234e0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:04:32.935676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c6210311-b540-4a9d-8967-55f52d234e0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:32.946992 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6210311-b540-4a9d-8967-55f52d234e0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:32.947545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6210311-b540-4a9d-8967-55f52d234e0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:32.948011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6210311-b540-4a9d-8967-55f52d234e0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:32.948739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6210311-b540-4a9d-8967-55f52d234e0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:32.951533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6210311-b540-4a9d-8967-55f52d234e0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:32.953328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6210311-b540-4a9d-8967-55f52d234e0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:33.041119 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c6210311-b540-4a9d-8967-55f52d234e0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/action" status: 202 len: 0 microversion: 2.1 time: 0.122690 Aug 27 06:04:33.041757 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3860/7728] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:04:32 2022] POST /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:04:33.050123 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [15bbca3d-0083-4a69-8bef-16bf0d79b591] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:04:33.051926 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27d957ae-75c0-4884-9be8-b8e627e8ac1a] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:04:33.052527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:04:33.053282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=12 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:04:33.054607 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:04:33.054607 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 (ip 10.222.0.58) !!! Aug 27 06:04:33.056538 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:04:33.056682 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 (ip 10.222.0.58) !!! Aug 27 06:04:33.061334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-002d358f-09a2-475e-9ed0-05b6cdee1a6f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:33.062240 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-002d358f-09a2-475e-9ed0-05b6cdee1a6f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:33.074421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002d358f-09a2-475e-9ed0-05b6cdee1a6f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:33.074920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002d358f-09a2-475e-9ed0-05b6cdee1a6f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:33.075417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002d358f-09a2-475e-9ed0-05b6cdee1a6f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:33.076139 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002d358f-09a2-475e-9ed0-05b6cdee1a6f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:33.076605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002d358f-09a2-475e-9ed0-05b6cdee1a6f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:33.077046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-002d358f-09a2-475e-9ed0-05b6cdee1a6f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:33.323765 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-002d358f-09a2-475e-9ed0-05b6cdee1a6f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:33.333870 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-002d358f-09a2-475e-9ed0-05b6cdee1a6f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1762 microversion: 2.1 time: 0.287241 Aug 27 06:04:33.334729 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3869/7729] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:33 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1762 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:34.356838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-906fada0-97cc-4e87-b4d4-c190344b3f71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:34.357486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-906fada0-97cc-4e87-b4d4-c190344b3f71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:34.366434 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-906fada0-97cc-4e87-b4d4-c190344b3f71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:34.366944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-906fada0-97cc-4e87-b4d4-c190344b3f71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:34.367447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-906fada0-97cc-4e87-b4d4-c190344b3f71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:34.368179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-906fada0-97cc-4e87-b4d4-c190344b3f71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:34.368658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-906fada0-97cc-4e87-b4d4-c190344b3f71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:34.373433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-906fada0-97cc-4e87-b4d4-c190344b3f71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:34.399186 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] [a138aa11-e323-45d1-b35b-6ab4ed1899de] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 46670. Aug 27 06:04:34.536004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-906fada0-97cc-4e87-b4d4-c190344b3f71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:34.544635 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-906fada0-97cc-4e87-b4d4-c190344b3f71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1767 microversion: 2.1 time: 0.192313 Aug 27 06:04:34.545218 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3861/7730] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:34 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1767 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:35.566437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7be1b533-8e2c-4077-8ae1-7b681ff2dc2e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:35.567071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7be1b533-8e2c-4077-8ae1-7b681ff2dc2e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:35.576241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b533-8e2c-4077-8ae1-7b681ff2dc2e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:35.576643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b533-8e2c-4077-8ae1-7b681ff2dc2e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:35.577092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b533-8e2c-4077-8ae1-7b681ff2dc2e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:35.577817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b533-8e2c-4077-8ae1-7b681ff2dc2e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:35.578276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b533-8e2c-4077-8ae1-7b681ff2dc2e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:35.578708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7be1b533-8e2c-4077-8ae1-7b681ff2dc2e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:35.597335 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] [15bbca3d-0083-4a69-8bef-16bf0d79b591] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 46674. Aug 27 06:04:35.598206 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] [27d957ae-75c0-4884-9be8-b8e627e8ac1a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 46676. Aug 27 06:04:35.733430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7be1b533-8e2c-4077-8ae1-7b681ff2dc2e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:35.742531 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7be1b533-8e2c-4077-8ae1-7b681ff2dc2e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1760 microversion: 2.1 time: 0.180593 Aug 27 06:04:35.743130 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3870/7731] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:35 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1760 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:19.833966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:19.834862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:19.919075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-207ef0b3-2dbc-41db-94ea-0615e3cf2e14 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-102863849"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:19.919662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-207ef0b3-2dbc-41db-94ea-0615e3cf2e14 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:19.926559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-207ef0b3-2dbc-41db-94ea-0615e3cf2e14 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:19.927065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-207ef0b3-2dbc-41db-94ea-0615e3cf2e14 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:19.927554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-207ef0b3-2dbc-41db-94ea-0615e3cf2e14 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:19.928273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-207ef0b3-2dbc-41db-94ea-0615e3cf2e14 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:19.929063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-207ef0b3-2dbc-41db-94ea-0615e3cf2e14 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:19.929195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-207ef0b3-2dbc-41db-94ea-0615e3cf2e14 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:20.066604 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.network.security_group_api [None req-207ef0b3-2dbc-41db-94ea-0615e3cf2e14 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Removing security group 4d063f36-924e-4068-bbae-c117b6e387f5 from port fc76d769-ebbb-4d1f-9f7c-3fa366bdc064 Aug 27 06:06:20.380016 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-207ef0b3-2dbc-41db-94ea-0615e3cf2e14 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/action" status: 202 len: 0 microversion: 2.1 time: 0.547992 Aug 27 06:06:20.380749 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3862/7732] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:06:19 2022] POST /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 06:06:20.390799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:20.391578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=12 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:20.392361 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:06:20.392751 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:06:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Aug 27 06:06:20.531371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-1b6e9b7e-4aa1-48b7-9f81-43a49439e65c req-0c1ca419-7889-46a1-b87d-d07161c77dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7734304-46c7-4687-8fb2-943a6e232597", "tag": "fc76d769-ebbb-4d1f-9f7c-3fa366bdc064"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:20.547064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1b6e9b7e-4aa1-48b7-9f81-43a49439e65c req-0c1ca419-7889-46a1-b87d-d07161c77dd0 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:20.547929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1b6e9b7e-4aa1-48b7-9f81-43a49439e65c req-0c1ca419-7889-46a1-b87d-d07161c77dd0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:20.548548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-1b6e9b7e-4aa1-48b7-9f81-43a49439e65c req-0c1ca419-7889-46a1-b87d-d07161c77dd0 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:20.565890 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-1b6e9b7e-4aa1-48b7-9f81-43a49439e65c req-0c1ca419-7889-46a1-b87d-d07161c77dd0 service nova] Creating event network-changed:fc76d769-ebbb-4d1f-9f7c-3fa366bdc064 for instance c7734304-46c7-4687-8fb2-943a6e232597 on n-h1-820368-35 Aug 27 06:06:20.574898 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-1b6e9b7e-4aa1-48b7-9f81-43a49439e65c req-0c1ca419-7889-46a1-b87d-d07161c77dd0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189493 Aug 27 06:06:20.576218 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3871/7733] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:21.611067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d4342791-0edf-4ee3-ae2e-252714c412ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:21.612686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d4342791-0edf-4ee3-ae2e-252714c412ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:21.623195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4342791-0edf-4ee3-ae2e-252714c412ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:21.624132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4342791-0edf-4ee3-ae2e-252714c412ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:21.624780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4342791-0edf-4ee3-ae2e-252714c412ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:21.626593 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4342791-0edf-4ee3-ae2e-252714c412ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:21.627901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4342791-0edf-4ee3-ae2e-252714c412ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:21.628537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d4342791-0edf-4ee3-ae2e-252714c412ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:21.636479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2b145d60-cce2-469c-984b-ab09ee722713 req-7a4d1560-db8f-4808-83b6-db56d1de0924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7734304-46c7-4687-8fb2-943a6e232597", "tag": "fc76d769-ebbb-4d1f-9f7c-3fa366bdc064"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:21.646675 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2b145d60-cce2-469c-984b-ab09ee722713 req-7a4d1560-db8f-4808-83b6-db56d1de0924 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:21.647536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2b145d60-cce2-469c-984b-ab09ee722713 req-7a4d1560-db8f-4808-83b6-db56d1de0924 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:21.648216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2b145d60-cce2-469c-984b-ab09ee722713 req-7a4d1560-db8f-4808-83b6-db56d1de0924 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:21.660918 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2b145d60-cce2-469c-984b-ab09ee722713 req-7a4d1560-db8f-4808-83b6-db56d1de0924 service nova] Creating event network-changed:fc76d769-ebbb-4d1f-9f7c-3fa366bdc064 for instance c7734304-46c7-4687-8fb2-943a6e232597 on n-h1-820368-35 Aug 27 06:06:21.667061 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2b145d60-cce2-469c-984b-ab09ee722713 req-7a4d1560-db8f-4808-83b6-db56d1de0924 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106030 Aug 27 06:06:21.668583 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3863/7734] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:21.743976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-d4342791-0edf-4ee3-ae2e-252714c412ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lazy-loading 'services' on Instance uuid c7734304-46c7-4687-8fb2-943a6e232597 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:06:21.868156 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d4342791-0edf-4ee3-ae2e-252714c412ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments/b22f4ff8-25b8-4fda-ad70-d120187321f4" status: 202 len: 0 microversion: 2.1 time: 0.261405 Aug 27 06:06:21.873107 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3872/7735] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 06:06:21 2022] DELETE /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments/b22f4ff8-25b8-4fda-ad70-d120187321f4 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:06:21.882116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dec45a8f-e07a-45a4-a287-536e30495a31 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:21.884411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dec45a8f-e07a-45a4-a287-536e30495a31 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:21.901352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dec45a8f-e07a-45a4-a287-536e30495a31 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:21.903523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dec45a8f-e07a-45a4-a287-536e30495a31 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:21.906240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dec45a8f-e07a-45a4-a287-536e30495a31 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:21.907482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dec45a8f-e07a-45a4-a287-536e30495a31 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:21.911682 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dec45a8f-e07a-45a4-a287-536e30495a31 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:21.914106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dec45a8f-e07a-45a4-a287-536e30495a31 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:21.979971 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dec45a8f-e07a-45a4-a287-536e30495a31 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104338 Aug 27 06:06:21.981175 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3864/7736] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:06:21 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:22.993946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f92a7ce9-9670-4f3f-addb-5fabd1296dd3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:22.998127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f92a7ce9-9670-4f3f-addb-5fabd1296dd3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:23.005500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92a7ce9-9670-4f3f-addb-5fabd1296dd3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:23.006083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92a7ce9-9670-4f3f-addb-5fabd1296dd3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:23.006721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92a7ce9-9670-4f3f-addb-5fabd1296dd3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:23.007537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92a7ce9-9670-4f3f-addb-5fabd1296dd3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:23.008068 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92a7ce9-9670-4f3f-addb-5fabd1296dd3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:23.008627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f92a7ce9-9670-4f3f-addb-5fabd1296dd3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:23.043768 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f92a7ce9-9670-4f3f-addb-5fabd1296dd3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054123 Aug 27 06:06:23.044644 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3873/7737] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:06:22 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:24.057702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ea04f54c-0b93-4b8f-8548-e20dbbb8e8c6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:24.060570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ea04f54c-0b93-4b8f-8548-e20dbbb8e8c6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:24.066932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea04f54c-0b93-4b8f-8548-e20dbbb8e8c6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:24.067462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea04f54c-0b93-4b8f-8548-e20dbbb8e8c6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:24.067918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea04f54c-0b93-4b8f-8548-e20dbbb8e8c6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:24.068639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea04f54c-0b93-4b8f-8548-e20dbbb8e8c6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:24.069109 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea04f54c-0b93-4b8f-8548-e20dbbb8e8c6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:24.069696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ea04f54c-0b93-4b8f-8548-e20dbbb8e8c6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:24.101965 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ea04f54c-0b93-4b8f-8548-e20dbbb8e8c6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049396 Aug 27 06:06:24.102762 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3865/7738] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:06:24 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:25.114937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-597de33f-1c13-499c-a4d3-4f891086715b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:25.117115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-597de33f-1c13-499c-a4d3-4f891086715b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:25.124328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597de33f-1c13-499c-a4d3-4f891086715b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:25.124817 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597de33f-1c13-499c-a4d3-4f891086715b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:25.125255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597de33f-1c13-499c-a4d3-4f891086715b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:25.125951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597de33f-1c13-499c-a4d3-4f891086715b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:25.126435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597de33f-1c13-499c-a4d3-4f891086715b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:25.126860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-597de33f-1c13-499c-a4d3-4f891086715b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:25.418833 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-597de33f-1c13-499c-a4d3-4f891086715b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.308548 Aug 27 06:06:25.419936 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3874/7739] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:06:25 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments => generated 197 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:26.431468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f166d508-85cc-4d62-acff-fecb258b11ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:26.433665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f166d508-85cc-4d62-acff-fecb258b11ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:26.441314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f166d508-85cc-4d62-acff-fecb258b11ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:26.441813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f166d508-85cc-4d62-acff-fecb258b11ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:26.442263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f166d508-85cc-4d62-acff-fecb258b11ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:26.442979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f166d508-85cc-4d62-acff-fecb258b11ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:26.443475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f166d508-85cc-4d62-acff-fecb258b11ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:26.443963 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f166d508-85cc-4d62-acff-fecb258b11ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:26.478264 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f166d508-85cc-4d62-acff-fecb258b11ff tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050727 Aug 27 06:06:26.479146 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3866/7740] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:06:26 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:27.490234 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-64084f7e-4963-4bce-96f3-ce5897f7008c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:27.492413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-64084f7e-4963-4bce-96f3-ce5897f7008c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:27.499592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64084f7e-4963-4bce-96f3-ce5897f7008c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:27.500085 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64084f7e-4963-4bce-96f3-ce5897f7008c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:27.500529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64084f7e-4963-4bce-96f3-ce5897f7008c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:27.501237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64084f7e-4963-4bce-96f3-ce5897f7008c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:27.502198 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64084f7e-4963-4bce-96f3-ce5897f7008c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:27.502628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64084f7e-4963-4bce-96f3-ce5897f7008c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:27.532806 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-64084f7e-4963-4bce-96f3-ce5897f7008c tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046650 Aug 27 06:06:27.533376 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3875/7741] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:06:27 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 06:06:27.543631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:27.544167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:27.552155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:27.552661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:27.553111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:27.553847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:27.554313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:27.554758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:27.802720 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] HTTP exception thrown: Instance c7734304-46c7-4687-8fb2-943a6e232597 is not attached to volume b22f4ff8-25b8-4fda-ad70-d120187321f4 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Request method failure captured: Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: request: DELETE /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments/b22f4ff8-25b8-4fda-ad70-d120187321f4 HTTP/1.1 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbMp8Y0L-jjAdUoxaOwxU9lhPidg_Ol5RADeH-qgkDKoV2vaSmC2gXGD61tf8NRRK2DaXX1GtM7imeYfxfrsE4hDtFNn-4O9wUkIoLp7Z9fe9yUl8S4EdOb9s1lMhHz_kJe7UKt4NZAUn3cSAjskZZaxi0SpNMy7dR49unGuCwn8lEo Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 2e97b7c5120f427ea4815163908d7382 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e97b7c5120f427ea4815163908d7382", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 2e97b7c5120f427ea4815163908d7382 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestMinimumBasicScenario-102048364-project Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: e3a94ad543bf4e70ae34f6bb6620b5ca Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestMinimumBasicScenario-102048364-project Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance c7734304-46c7-4687-8fb2-943a6e232597 is not attached to volume b22f4ff8-25b8-4fda-ad70-d120187321f4 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'server_id': 'c7734304-46c7-4687-8fb2-943a6e232597', 'id': 'b22f4ff8-25b8-4fda-ad70-d120187321f4'} Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b22f4ff8-25b8-4fda-ad70-d120187321f4. Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7734304-46c7-4687-8fb2-943a6e232597 is not attached to volume b22f4ff8-25b8-4fda-ad70-d120187321f4 Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:06:27.804419 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:06:27.808466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:06:27.808466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:06:27.808466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7734304-46c7-4687-8fb2-943a6e232597 is not attached to volume b22f4ff8-25b8-4fda-ad70-d120187321f4 Aug 27 06:06:27.808466 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:06:27.808466 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Returning 404 to user: Instance c7734304-46c7-4687-8fb2-943a6e232597 is not attached to volume b22f4ff8-25b8-4fda-ad70-d120187321f4 {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:06:27.808466 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b206711-86c9-4fb8-8e2e-b5296a94872a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments/b22f4ff8-25b8-4fda-ad70-d120187321f4" status: 404 len: 154 microversion: 2.1 time: 0.266215 Aug 27 06:06:27.808466 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3867/7742] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 06:06:27 2022] DELETE /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597/os-volume_attachments/b22f4ff8-25b8-4fda-ad70-d120187321f4 => generated 154 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 06:06:31.068850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0c703736-3d4f-4606-975e-9f6497029b88 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:31.069356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c703736-3d4f-4606-975e-9f6497029b88 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:31.076032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c703736-3d4f-4606-975e-9f6497029b88 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:31.076524 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c703736-3d4f-4606-975e-9f6497029b88 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:31.077027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c703736-3d4f-4606-975e-9f6497029b88 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:31.077748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c703736-3d4f-4606-975e-9f6497029b88 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:31.078210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c703736-3d4f-4606-975e-9f6497029b88 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:31.078644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0c703736-3d4f-4606-975e-9f6497029b88 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:31.106672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0c703736-3d4f-4606-975e-9f6497029b88 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:06:31.182978 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0c703736-3d4f-4606-975e-9f6497029b88 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 204 len: 0 microversion: 2.1 time: 0.118129 Aug 27 06:06:31.183787 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3876/7743] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:06:31 2022] DELETE /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:06:31.197044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-36c91204-9103-40a9-8986-d0c2227cacd0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:31.198217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-36c91204-9103-40a9-8986-d0c2227cacd0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:31.206711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36c91204-9103-40a9-8986-d0c2227cacd0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:31.207303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36c91204-9103-40a9-8986-d0c2227cacd0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:31.207766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36c91204-9103-40a9-8986-d0c2227cacd0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:31.208506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36c91204-9103-40a9-8986-d0c2227cacd0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:31.208988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36c91204-9103-40a9-8986-d0c2227cacd0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:31.209440 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-36c91204-9103-40a9-8986-d0c2227cacd0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:31.356843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-36c91204-9103-40a9-8986-d0c2227cacd0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:31.366636 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-36c91204-9103-40a9-8986-d0c2227cacd0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1555 microversion: 2.1 time: 0.178086 Aug 27 06:06:31.371260 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3868/7744] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:31 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:32.388996 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1c68b238-9847-4791-b1f9-287a80e97339 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:32.389666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1c68b238-9847-4791-b1f9-287a80e97339 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:32.397991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c68b238-9847-4791-b1f9-287a80e97339 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:32.399285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c68b238-9847-4791-b1f9-287a80e97339 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:32.399711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c68b238-9847-4791-b1f9-287a80e97339 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:32.400434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c68b238-9847-4791-b1f9-287a80e97339 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:32.400896 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c68b238-9847-4791-b1f9-287a80e97339 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:32.401329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1c68b238-9847-4791-b1f9-287a80e97339 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:32.591486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1c68b238-9847-4791-b1f9-287a80e97339 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:32.600255 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1c68b238-9847-4791-b1f9-287a80e97339 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1555 microversion: 2.1 time: 0.215591 Aug 27 06:06:32.600871 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3877/7745] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:32 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:33.511233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b7cf7999-cf73-4ca2-834b-ae90d9e0d0c1 req-cc2fdb66-68c1-461c-8142-fc1e99367af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7734304-46c7-4687-8fb2-943a6e232597", "name": "network-vif-deleted", "tag": "fc76d769-ebbb-4d1f-9f7c-3fa366bdc064"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:33.527399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b7cf7999-cf73-4ca2-834b-ae90d9e0d0c1 req-cc2fdb66-68c1-461c-8142-fc1e99367af2 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:33.528309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b7cf7999-cf73-4ca2-834b-ae90d9e0d0c1 req-cc2fdb66-68c1-461c-8142-fc1e99367af2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:33.528935 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b7cf7999-cf73-4ca2-834b-ae90d9e0d0c1 req-cc2fdb66-68c1-461c-8142-fc1e99367af2 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:33.544529 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b7cf7999-cf73-4ca2-834b-ae90d9e0d0c1 req-cc2fdb66-68c1-461c-8142-fc1e99367af2 service nova] Creating event network-vif-deleted:fc76d769-ebbb-4d1f-9f7c-3fa366bdc064 for instance c7734304-46c7-4687-8fb2-943a6e232597 on n-h1-820368-35 Aug 27 06:06:33.552547 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b7cf7999-cf73-4ca2-834b-ae90d9e0d0c1 req-cc2fdb66-68c1-461c-8142-fc1e99367af2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044940 Aug 27 06:06:33.553200 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3869/7746] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:33.621413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:33.622084 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:33.630831 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:33.631501 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:33.631945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:33.632665 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:33.633122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:33.633551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:33.672076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:33.672670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:33.673193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:33.673735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lazy-loading 'fault' on Instance uuid c7734304-46c7-4687-8fb2-943a6e232597 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:06:33.727570 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:33.737237 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c633382e-67a5-488f-839e-d7aa4d7f4d22 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 200 len: 1349 microversion: 2.1 time: 0.119772 Aug 27 06:06:33.737852 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3878/7747] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:33 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 1349 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:34.760010 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:34.760771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: c7734304-46c7-4687-8fb2-943a6e232597] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:34.767080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:34.768158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:34.768677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:34.769336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:34.769807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:34.770252 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:34.786360 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] HTTP exception thrown: Instance c7734304-46c7-4687-8fb2-943a6e232597 could not be found. Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Request method failure captured: Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 HTTP/1.1 Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbMp8Y0L-jjAdUoxaOwxU9lhPidg_Ol5RADeH-qgkDKoV2vaSmC2gXGD61tf8NRRK2DaXX1GtM7imeYfxfrsE4hDtFNn-4O9wUkIoLp7Z9fe9yUl8S4EdOb9s1lMhHz_kJe7UKt4NZAUn3cSAjskZZaxi0SpNMy7dR49unGuCwn8lEo Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 2e97b7c5120f427ea4815163908d7382 Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e97b7c5120f427ea4815163908d7382", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 2e97b7c5120f427ea4815163908d7382 Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestMinimumBasicScenario-102048364-project Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: e3a94ad543bf4e70ae34f6bb6620b5ca Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestMinimumBasicScenario-102048364-project Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance c7734304-46c7-4687-8fb2-943a6e232597 could not be found. Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'c7734304-46c7-4687-8fb2-943a6e232597'} Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7734304-46c7-4687-8fb2-943a6e232597 could not be found. Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7734304-46c7-4687-8fb2-943a6e232597 could not be found. Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:06:34.788169 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:06:34.792862 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:06:34.792862 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:06:34.792862 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:06:34.792862 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:06:34.792862 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:06:34.792862 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7734304-46c7-4687-8fb2-943a6e232597 could not be found. Aug 27 06:06:34.792862 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:06:34.792862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Returning 404 to user: Instance c7734304-46c7-4687-8fb2-943a6e232597 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:06:34.792862 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-489fbfa0-6a79-4b20-a129-8c11d99152ab tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597" status: 404 len: 111 microversion: 2.1 time: 0.034825 Aug 27 06:06:34.795126 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3870/7748] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:34 2022] GET /compute/v2.1/servers/c7734304-46c7-4687-8fb2-943a6e232597 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:06:34.798517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bef28713-f8be-416f-84a0-347153a7575e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '.version_select at 0x7fb56429ba60>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:34.825349 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bef28713-f8be-416f-84a0-347153a7575e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1713268166" status: 202 len: 0 microversion: 2.1 time: 0.030800 Aug 27 06:06:34.826408 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3879/7749] 10.222.0.58 () {58 vars in 1272 bytes} [Sat Aug 27 06:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1713268166 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:06:44.411251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a3efb487-e797-444d-8bbd-97c14b68fcb5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'create', calling method: .version_select at 0x7fb5640f2ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-924953269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJOln1+Fwc2Bb35R7Fwonnjx/iYjTTOBz9ehAdIo6/CFtYdYiaoKPmanXgNc+oQxlWVznW89YlqavwsdZHKK8dE3e/UOgXm0VicD/uaqUJQTe1XRqM8Oa6iCeBYRe14Ew=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:44.417195 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8da433e2-1b8b-43e8-8a70-e929fdcdfc0f] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:06:44.429196 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a3efb487-e797-444d-8bbd-97c14b68fcb5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Getting quotas for project 2e97b7c5120f427ea4815163908d7382. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:06:44.434247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a3efb487-e797-444d-8bbd-97c14b68fcb5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Getting quotas for user e3a94ad543bf4e70ae34f6bb6620b5ca and project 2e97b7c5120f427ea4815163908d7382. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:06:44.470997 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a3efb487-e797-444d-8bbd-97c14b68fcb5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.064280 Aug 27 06:06:44.471641 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3871/7750] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 06:06:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:06:44.525804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:44.530536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-812505347", "imageRef": "f76d3f48-b389-4ba2-8991-7b9fc3525863", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-924953269", "networks": [{"uuid": "f288a1ad-1aa5-4520-b60f-64221f2a1544"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:44.587984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] validate_networks() for [('f288a1ad-1aa5-4520-b60f-64221f2a1544', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:06:45.019472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:06:45.019940 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:06:45.020421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:06:45.020837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:06:45.021254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:06:45.030571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:45.031058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:45.031528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:45.032260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:45.033332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:45.033766 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:45.050568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Getting quotas for project 2e97b7c5120f427ea4815163908d7382. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:06:45.055748 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Getting quotas for user e3a94ad543bf4e70ae34f6bb6620b5ca and project 2e97b7c5120f427ea4815163908d7382. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:06:45.067764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:06:45.070101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f76d3f48-b389-4ba2-8991-7b9fc3525863',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:06:45.115982 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-61737935-af25-48e3-9213-39427a62684b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591920 Aug 27 06:06:45.116556 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3880/7751] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 06:06:45.124018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=40 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:45.129875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-31a64314-af26-45b1-a81f-9afcd97c4054 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:45.130612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-31a64314-af26-45b1-a81f-9afcd97c4054 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:45.197331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-31a64314-af26-45b1-a81f-9afcd97c4054 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:45.207097 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-31a64314-af26-45b1-a81f-9afcd97c4054 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1257 microversion: 2.1 time: 0.083759 Aug 27 06:06:45.207942 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3872/7752] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:45 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1257 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:46.229302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-64c7a7c5-456a-4dc5-bdc7-e7e783067408 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:46.229843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-64c7a7c5-456a-4dc5-bdc7-e7e783067408 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:46.236510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64c7a7c5-456a-4dc5-bdc7-e7e783067408 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:46.236997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64c7a7c5-456a-4dc5-bdc7-e7e783067408 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:46.237430 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64c7a7c5-456a-4dc5-bdc7-e7e783067408 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:46.238120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64c7a7c5-456a-4dc5-bdc7-e7e783067408 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:46.238571 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64c7a7c5-456a-4dc5-bdc7-e7e783067408 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:46.238994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64c7a7c5-456a-4dc5-bdc7-e7e783067408 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:46.301159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-64c7a7c5-456a-4dc5-bdc7-e7e783067408 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:46.308904 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-64c7a7c5-456a-4dc5-bdc7-e7e783067408 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1309 microversion: 2.1 time: 0.084974 Aug 27 06:06:46.309458 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3881/7753] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:46 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1309 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:47.332091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5532faf2-8af6-45ff-bbfc-e9e76b63549b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:47.333380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5532faf2-8af6-45ff-bbfc-e9e76b63549b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:47.362415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5532faf2-8af6-45ff-bbfc-e9e76b63549b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:47.363628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5532faf2-8af6-45ff-bbfc-e9e76b63549b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:47.364482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5532faf2-8af6-45ff-bbfc-e9e76b63549b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:47.365484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5532faf2-8af6-45ff-bbfc-e9e76b63549b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:47.366329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5532faf2-8af6-45ff-bbfc-e9e76b63549b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:47.367201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5532faf2-8af6-45ff-bbfc-e9e76b63549b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:47.439331 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] [8da433e2-1b8b-43e8-8a70-e929fdcdfc0f] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 46916. Aug 27 06:06:47.672372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5532faf2-8af6-45ff-bbfc-e9e76b63549b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:47.701898 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5532faf2-8af6-45ff-bbfc-e9e76b63549b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.373631 Aug 27 06:06:47.703066 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3873/7754] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:47 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:48.536673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-0d5f67ad-2a5c-4068-af9c-d5fdd5d2519d req-a0d791b8-1826-426d-bad4-2ef530730b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30779bd-f49c-4804-b06b-8348136dfa39", "tag": "8973ebe6-f758-45ee-939e-66a108647add"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:48.558938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0d5f67ad-2a5c-4068-af9c-d5fdd5d2519d req-a0d791b8-1826-426d-bad4-2ef530730b28 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:48.559753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0d5f67ad-2a5c-4068-af9c-d5fdd5d2519d req-a0d791b8-1826-426d-bad4-2ef530730b28 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:48.560391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0d5f67ad-2a5c-4068-af9c-d5fdd5d2519d req-a0d791b8-1826-426d-bad4-2ef530730b28 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:48.574790 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-0d5f67ad-2a5c-4068-af9c-d5fdd5d2519d req-a0d791b8-1826-426d-bad4-2ef530730b28 service nova] Creating event network-changed:8973ebe6-f758-45ee-939e-66a108647add for instance e30779bd-f49c-4804-b06b-8348136dfa39 on n-h1-820368-35 Aug 27 06:06:48.598051 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-0d5f67ad-2a5c-4068-af9c-d5fdd5d2519d req-a0d791b8-1826-426d-bad4-2ef530730b28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068556 Aug 27 06:06:48.598691 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3882/7755] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:06:48.726399 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d75a2817-b7b6-4b8e-af77-ea8de369c9a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:48.727713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d75a2817-b7b6-4b8e-af77-ea8de369c9a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:48.744401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d75a2817-b7b6-4b8e-af77-ea8de369c9a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:48.748521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d75a2817-b7b6-4b8e-af77-ea8de369c9a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:48.749855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d75a2817-b7b6-4b8e-af77-ea8de369c9a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:48.750885 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d75a2817-b7b6-4b8e-af77-ea8de369c9a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:48.753005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d75a2817-b7b6-4b8e-af77-ea8de369c9a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:48.754534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d75a2817-b7b6-4b8e-af77-ea8de369c9a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:49.028759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d75a2817-b7b6-4b8e-af77-ea8de369c9a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:49.042056 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d75a2817-b7b6-4b8e-af77-ea8de369c9a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.320847 Aug 27 06:06:49.043141 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3874/7756] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:48 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:50.070098 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cfe1994f-9907-47a0-aa4c-39656bcfba6a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:50.071485 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cfe1994f-9907-47a0-aa4c-39656bcfba6a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:50.102721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe1994f-9907-47a0-aa4c-39656bcfba6a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:50.103790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe1994f-9907-47a0-aa4c-39656bcfba6a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:50.104556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe1994f-9907-47a0-aa4c-39656bcfba6a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:50.105839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe1994f-9907-47a0-aa4c-39656bcfba6a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:50.106641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe1994f-9907-47a0-aa4c-39656bcfba6a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:50.107407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cfe1994f-9907-47a0-aa4c-39656bcfba6a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:50.377374 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cfe1994f-9907-47a0-aa4c-39656bcfba6a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:50.391726 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cfe1994f-9907-47a0-aa4c-39656bcfba6a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.329644 Aug 27 06:06:50.393312 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3883/7757] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:50 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:51.429529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7959f50f-820a-4fad-bde1-33469019baf2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:51.430900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7959f50f-820a-4fad-bde1-33469019baf2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:51.439177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:51.441550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7959f50f-820a-4fad-bde1-33469019baf2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:51.442444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7959f50f-820a-4fad-bde1-33469019baf2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:51.443057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7959f50f-820a-4fad-bde1-33469019baf2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:51.444043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7959f50f-820a-4fad-bde1-33469019baf2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:51.444677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7959f50f-820a-4fad-bde1-33469019baf2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:51.445270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7959f50f-820a-4fad-bde1-33469019baf2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:51.638684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7959f50f-820a-4fad-bde1-33469019baf2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:51.649998 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7959f50f-820a-4fad-bde1-33469019baf2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.224658 Aug 27 06:06:51.650849 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3875/7758] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:51 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:52.676544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5b13cb37-8879-4615-b1a4-1104e056ac02 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:52.678096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5b13cb37-8879-4615-b1a4-1104e056ac02 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:52.685000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:52.686872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b13cb37-8879-4615-b1a4-1104e056ac02 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:52.687737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b13cb37-8879-4615-b1a4-1104e056ac02 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:52.688585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b13cb37-8879-4615-b1a4-1104e056ac02 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:52.689545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b13cb37-8879-4615-b1a4-1104e056ac02 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:52.690231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b13cb37-8879-4615-b1a4-1104e056ac02 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:52.690865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5b13cb37-8879-4615-b1a4-1104e056ac02 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:52.883588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5b13cb37-8879-4615-b1a4-1104e056ac02 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:52.896047 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5b13cb37-8879-4615-b1a4-1104e056ac02 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.227619 Aug 27 06:06:52.899294 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3884/7759] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:52 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:53.932451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fc850f8a-6cf0-4001-9b02-4a89ffc004bc tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:53.933428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fc850f8a-6cf0-4001-9b02-4a89ffc004bc tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:53.943603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc850f8a-6cf0-4001-9b02-4a89ffc004bc tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:53.944104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc850f8a-6cf0-4001-9b02-4a89ffc004bc tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:53.944554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc850f8a-6cf0-4001-9b02-4a89ffc004bc tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:53.945278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc850f8a-6cf0-4001-9b02-4a89ffc004bc tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:53.945743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc850f8a-6cf0-4001-9b02-4a89ffc004bc tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:53.946183 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fc850f8a-6cf0-4001-9b02-4a89ffc004bc tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:54.194253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fc850f8a-6cf0-4001-9b02-4a89ffc004bc tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:54.202303 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fc850f8a-6cf0-4001-9b02-4a89ffc004bc tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.287988 Aug 27 06:06:54.203082 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3876/7760] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:53 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:55.223810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c8d350c2-282a-4686-934a-7772988fa05b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:55.224431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c8d350c2-282a-4686-934a-7772988fa05b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:55.227168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:55.227847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:55.234076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8d350c2-282a-4686-934a-7772988fa05b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:55.234575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8d350c2-282a-4686-934a-7772988fa05b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:55.235026 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8d350c2-282a-4686-934a-7772988fa05b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:55.235797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8d350c2-282a-4686-934a-7772988fa05b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:55.236273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8d350c2-282a-4686-934a-7772988fa05b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:55.236706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c8d350c2-282a-4686-934a-7772988fa05b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:55.376790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c8d350c2-282a-4686-934a-7772988fa05b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:55.384776 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c8d350c2-282a-4686-934a-7772988fa05b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.164946 Aug 27 06:06:55.385598 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3885/7761] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:55 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:56.406052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-363d6282-e2c1-4562-a6f7-c00f1026e58e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:56.406705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-363d6282-e2c1-4562-a6f7-c00f1026e58e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:56.409605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:56.415203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-363d6282-e2c1-4562-a6f7-c00f1026e58e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:56.415783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-363d6282-e2c1-4562-a6f7-c00f1026e58e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:56.416243 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-363d6282-e2c1-4562-a6f7-c00f1026e58e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:56.416952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-363d6282-e2c1-4562-a6f7-c00f1026e58e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:56.417422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-363d6282-e2c1-4562-a6f7-c00f1026e58e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:56.417978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-363d6282-e2c1-4562-a6f7-c00f1026e58e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:56.937031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-363d6282-e2c1-4562-a6f7-c00f1026e58e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:56.944965 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-363d6282-e2c1-4562-a6f7-c00f1026e58e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.542956 Aug 27 06:06:56.945755 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3877/7762] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:56 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:57.967679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5c0f0a93-5641-4058-93ce-d6c1ac4377cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:57.968366 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5c0f0a93-5641-4058-93ce-d6c1ac4377cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:57.975478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0f0a93-5641-4058-93ce-d6c1ac4377cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:57.975981 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0f0a93-5641-4058-93ce-d6c1ac4377cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:57.976472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0f0a93-5641-4058-93ce-d6c1ac4377cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:57.977197 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0f0a93-5641-4058-93ce-d6c1ac4377cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:57.977661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0f0a93-5641-4058-93ce-d6c1ac4377cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:57.978099 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5c0f0a93-5641-4058-93ce-d6c1ac4377cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:58.119171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5c0f0a93-5641-4058-93ce-d6c1ac4377cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:58.132083 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5c0f0a93-5641-4058-93ce-d6c1ac4377cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.169720 Aug 27 06:06:58.132682 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3886/7763] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:57 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:59.153983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-373e6de0-d403-4aeb-a223-39adba5b3eb0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:59.154574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-373e6de0-d403-4aeb-a223-39adba5b3eb0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:59.162104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-373e6de0-d403-4aeb-a223-39adba5b3eb0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:59.162604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-373e6de0-d403-4aeb-a223-39adba5b3eb0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:59.163060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-373e6de0-d403-4aeb-a223-39adba5b3eb0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:59.163806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-373e6de0-d403-4aeb-a223-39adba5b3eb0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:59.164391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-373e6de0-d403-4aeb-a223-39adba5b3eb0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:59.164838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-373e6de0-d403-4aeb-a223-39adba5b3eb0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:59.300230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-373e6de0-d403-4aeb-a223-39adba5b3eb0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:59.308154 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-373e6de0-d403-4aeb-a223-39adba5b3eb0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.158112 Aug 27 06:06:59.308747 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3878/7764] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:59 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:00.329100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cd423622-d6e5-4dfa-b7cb-2af956740a0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:00.329763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cd423622-d6e5-4dfa-b7cb-2af956740a0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:00.336699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd423622-d6e5-4dfa-b7cb-2af956740a0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:00.337196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd423622-d6e5-4dfa-b7cb-2af956740a0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:00.337681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd423622-d6e5-4dfa-b7cb-2af956740a0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:00.338399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd423622-d6e5-4dfa-b7cb-2af956740a0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:00.338867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd423622-d6e5-4dfa-b7cb-2af956740a0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:00.339335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd423622-d6e5-4dfa-b7cb-2af956740a0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:00.478022 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cd423622-d6e5-4dfa-b7cb-2af956740a0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:00.486756 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cd423622-d6e5-4dfa-b7cb-2af956740a0e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.161561 Aug 27 06:07:00.487407 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3887/7765] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:00 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:01.508814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-30f1aa38-4b53-4158-81f9-51fa8a6d7f50 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:01.509563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-30f1aa38-4b53-4158-81f9-51fa8a6d7f50 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:01.517755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30f1aa38-4b53-4158-81f9-51fa8a6d7f50 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:01.518261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30f1aa38-4b53-4158-81f9-51fa8a6d7f50 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:01.518714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30f1aa38-4b53-4158-81f9-51fa8a6d7f50 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:01.519519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30f1aa38-4b53-4158-81f9-51fa8a6d7f50 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:01.519989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30f1aa38-4b53-4158-81f9-51fa8a6d7f50 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:01.520428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-30f1aa38-4b53-4158-81f9-51fa8a6d7f50 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:01.660424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-30f1aa38-4b53-4158-81f9-51fa8a6d7f50 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:01.668599 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-30f1aa38-4b53-4158-81f9-51fa8a6d7f50 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.164318 Aug 27 06:07:01.669474 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3879/7766] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:01 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:02.689931 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-62c0f9b2-c184-4525-a462-6ee9a9744c92 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:02.690558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-62c0f9b2-c184-4525-a462-6ee9a9744c92 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:02.697818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62c0f9b2-c184-4525-a462-6ee9a9744c92 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:02.698514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62c0f9b2-c184-4525-a462-6ee9a9744c92 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:02.699975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62c0f9b2-c184-4525-a462-6ee9a9744c92 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:02.699975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62c0f9b2-c184-4525-a462-6ee9a9744c92 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:02.700179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62c0f9b2-c184-4525-a462-6ee9a9744c92 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:02.700425 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-62c0f9b2-c184-4525-a462-6ee9a9744c92 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:02.840047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-62c0f9b2-c184-4525-a462-6ee9a9744c92 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:02.848091 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-62c0f9b2-c184-4525-a462-6ee9a9744c92 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.161983 Aug 27 06:07:02.848909 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3888/7767] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:02 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:03.720108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-caa4218c-20b1-4a57-8d08-1749cfff535e req-df4d984e-b91e-4eb3-8e45-1a3100b2b9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30779bd-f49c-4804-b06b-8348136dfa39", "name": "network-vif-plugged", "status": "completed", "tag": "8973ebe6-f758-45ee-939e-66a108647add"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:07:03.729934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-caa4218c-20b1-4a57-8d08-1749cfff535e req-df4d984e-b91e-4eb3-8e45-1a3100b2b9f5 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:03.730598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-caa4218c-20b1-4a57-8d08-1749cfff535e req-df4d984e-b91e-4eb3-8e45-1a3100b2b9f5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:03.731356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-caa4218c-20b1-4a57-8d08-1749cfff535e req-df4d984e-b91e-4eb3-8e45-1a3100b2b9f5 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:03.744136 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-caa4218c-20b1-4a57-8d08-1749cfff535e req-df4d984e-b91e-4eb3-8e45-1a3100b2b9f5 service nova] Creating event network-vif-plugged:8973ebe6-f758-45ee-939e-66a108647add for instance e30779bd-f49c-4804-b06b-8348136dfa39 on n-h1-820368-35 Aug 27 06:07:03.749497 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-caa4218c-20b1-4a57-8d08-1749cfff535e req-df4d984e-b91e-4eb3-8e45-1a3100b2b9f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106127 Aug 27 06:07:03.750111 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3880/7768] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:07:03.870244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bb58f61c-3ac2-473d-8e8f-9500384810f0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:03.870985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bb58f61c-3ac2-473d-8e8f-9500384810f0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:03.879196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb58f61c-3ac2-473d-8e8f-9500384810f0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:03.879769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb58f61c-3ac2-473d-8e8f-9500384810f0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:03.880457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb58f61c-3ac2-473d-8e8f-9500384810f0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:03.881236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb58f61c-3ac2-473d-8e8f-9500384810f0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:03.881809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb58f61c-3ac2-473d-8e8f-9500384810f0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:03.882306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bb58f61c-3ac2-473d-8e8f-9500384810f0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:04.039283 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bb58f61c-3ac2-473d-8e8f-9500384810f0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:04.047220 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bb58f61c-3ac2-473d-8e8f-9500384810f0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.181111 Aug 27 06:07:04.048375 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3889/7769] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:03 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:05.070700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4ee9c8fd-74a8-4569-a780-759e6525cd13 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:05.071441 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4ee9c8fd-74a8-4569-a780-759e6525cd13 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:05.077717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ee9c8fd-74a8-4569-a780-759e6525cd13 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:05.078220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ee9c8fd-74a8-4569-a780-759e6525cd13 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:05.079221 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ee9c8fd-74a8-4569-a780-759e6525cd13 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:05.079940 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ee9c8fd-74a8-4569-a780-759e6525cd13 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:05.080405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ee9c8fd-74a8-4569-a780-759e6525cd13 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:05.080843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4ee9c8fd-74a8-4569-a780-759e6525cd13 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:05.220161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4ee9c8fd-74a8-4569-a780-759e6525cd13 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:05.228144 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4ee9c8fd-74a8-4569-a780-759e6525cd13 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1357 microversion: 2.1 time: 0.162632 Aug 27 06:07:05.228731 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3881/7770] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:05 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:06.250053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-633c7774-741f-41b1-a173-ea52db4c5767 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:06.250942 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-633c7774-741f-41b1-a173-ea52db4c5767 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:06.258617 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-633c7774-741f-41b1-a173-ea52db4c5767 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:06.259149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-633c7774-741f-41b1-a173-ea52db4c5767 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:06.259596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-633c7774-741f-41b1-a173-ea52db4c5767 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:06.260315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-633c7774-741f-41b1-a173-ea52db4c5767 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:06.260775 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-633c7774-741f-41b1-a173-ea52db4c5767 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:06.261209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-633c7774-741f-41b1-a173-ea52db4c5767 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:06.391800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-633c7774-741f-41b1-a173-ea52db4c5767 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:06.399601 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-633c7774-741f-41b1-a173-ea52db4c5767 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1548 microversion: 2.1 time: 0.153701 Aug 27 06:07:06.400174 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3890/7771] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:06 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:06.420512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0ca5b808-e491-4003-bb6d-810b215f1988 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:06.421151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0ca5b808-e491-4003-bb6d-810b215f1988 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:06.429192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca5b808-e491-4003-bb6d-810b215f1988 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:06.429702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca5b808-e491-4003-bb6d-810b215f1988 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:06.430156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca5b808-e491-4003-bb6d-810b215f1988 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:06.430886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca5b808-e491-4003-bb6d-810b215f1988 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:06.431391 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca5b808-e491-4003-bb6d-810b215f1988 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:06.431841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0ca5b808-e491-4003-bb6d-810b215f1988 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:06.572026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0ca5b808-e491-4003-bb6d-810b215f1988 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:06.580541 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0ca5b808-e491-4003-bb6d-810b215f1988 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1548 microversion: 2.1 time: 0.164094 Aug 27 06:07:06.581140 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3882/7772] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:06 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:06.601616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b2b26cf0-9feb-4bf4-bd92-eb4f6991b3e0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:06.606406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b2b26cf0-9feb-4bf4-bd92-eb4f6991b3e0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:06.607345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b2b26cf0-9feb-4bf4-bd92-eb4f6991b3e0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Searching by: {'deleted': False, 'project_id': '2e97b7c5120f427ea4815163908d7382'} {{(pid=128548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 06:07:06.613210 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2b26cf0-9feb-4bf4-bd92-eb4f6991b3e0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:06.613708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2b26cf0-9feb-4bf4-bd92-eb4f6991b3e0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:06.614153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2b26cf0-9feb-4bf4-bd92-eb4f6991b3e0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:06.614974 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2b26cf0-9feb-4bf4-bd92-eb4f6991b3e0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:06.615467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2b26cf0-9feb-4bf4-bd92-eb4f6991b3e0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:06.615991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b2b26cf0-9feb-4bf4-bd92-eb4f6991b3e0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:06.645317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.multi_cell_list [None req-b2b26cf0-9feb-4bf4-bd92-eb4f6991b3e0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 06:07:06.675288 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b2b26cf0-9feb-4bf4-bd92-eb4f6991b3e0 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.077059 Aug 27 06:07:06.675930 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3891/7773] 10.222.0.58 () {58 vars in 1125 bytes} [Sat Aug 27 06:07:06 2022] GET /compute/v2.1/servers => generated 342 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:07:06.688078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-339409a2-a965-420e-bd91-03cfd2645457 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:06.688820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-339409a2-a965-420e-bd91-03cfd2645457 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:06.695280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339409a2-a965-420e-bd91-03cfd2645457 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:06.695788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339409a2-a965-420e-bd91-03cfd2645457 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:06.696244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339409a2-a965-420e-bd91-03cfd2645457 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:06.696973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339409a2-a965-420e-bd91-03cfd2645457 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:06.697443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339409a2-a965-420e-bd91-03cfd2645457 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:06.697887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-339409a2-a965-420e-bd91-03cfd2645457 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:06.844015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-339409a2-a965-420e-bd91-03cfd2645457 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:06.853285 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-339409a2-a965-420e-bd91-03cfd2645457 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1548 microversion: 2.1 time: 0.169855 Aug 27 06:07:06.853870 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3883/7774] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:06 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:08.404966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-664cf71b-933a-4da6-9827-af2108c972cd tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c9971d7-01f7-4f50-8316-472ff85a046d"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:07:08.407460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-664cf71b-933a-4da6-9827-af2108c972cd tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:08.414370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-664cf71b-933a-4da6-9827-af2108c972cd tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:08.414870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-664cf71b-933a-4da6-9827-af2108c972cd tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:08.415379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-664cf71b-933a-4da6-9827-af2108c972cd tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:08.416094 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-664cf71b-933a-4da6-9827-af2108c972cd tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:08.416559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-664cf71b-933a-4da6-9827-af2108c972cd tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:08.416994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-664cf71b-933a-4da6-9827-af2108c972cd tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:08.705695 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-664cf71b-933a-4da6-9827-af2108c972cd tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304580 Aug 27 06:07:08.706328 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3892/7775] 10.222.0.58 () {60 vars in 1323 bytes} [Sat Aug 27 06:07:08 2022] POST /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:07:19.567538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8190e984-1f54-4944-b64d-3d4b101284de tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:19.568241 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8190e984-1f54-4944-b64d-3d4b101284de tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:19.570755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=17 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:07:19.571645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=62 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:07:19.577585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8190e984-1f54-4944-b64d-3d4b101284de tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:19.578089 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8190e984-1f54-4944-b64d-3d4b101284de tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:19.578573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8190e984-1f54-4944-b64d-3d4b101284de tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:19.579303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8190e984-1f54-4944-b64d-3d4b101284de tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:19.579776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8190e984-1f54-4944-b64d-3d4b101284de tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:19.580215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8190e984-1f54-4944-b64d-3d4b101284de tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:19.726028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8190e984-1f54-4944-b64d-3d4b101284de tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:19.736762 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8190e984-1f54-4944-b64d-3d4b101284de tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1594 microversion: 2.1 time: 0.173788 Aug 27 06:07:19.737432 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3884/7776] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:19 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1594 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:22.071452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:07:22.072273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=17 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:07:22.073537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:07:22.079650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-fd893ed4-1c92-49f0-8e9e-641a3a61aad3 req-ae93c2a6-d920-4347-b244-b47c08183d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30779bd-f49c-4804-b06b-8348136dfa39", "tag": "8973ebe6-f758-45ee-939e-66a108647add"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:07:22.091972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fd893ed4-1c92-49f0-8e9e-641a3a61aad3 req-ae93c2a6-d920-4347-b244-b47c08183d3c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:22.092788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fd893ed4-1c92-49f0-8e9e-641a3a61aad3 req-ae93c2a6-d920-4347-b244-b47c08183d3c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:22.093467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-fd893ed4-1c92-49f0-8e9e-641a3a61aad3 req-ae93c2a6-d920-4347-b244-b47c08183d3c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:22.112654 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-fd893ed4-1c92-49f0-8e9e-641a3a61aad3 req-ae93c2a6-d920-4347-b244-b47c08183d3c service nova] Creating event network-changed:8973ebe6-f758-45ee-939e-66a108647add for instance e30779bd-f49c-4804-b06b-8348136dfa39 on n-h1-820368-35 Aug 27 06:07:22.119015 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-fd893ed4-1c92-49f0-8e9e-641a3a61aad3 req-ae93c2a6-d920-4347-b244-b47c08183d3c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049410 Aug 27 06:07:22.120540 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3893/7777] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:07:23.792743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-032b5fe3-a1f6-44c9-9159-e8b7dfa9b8cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1695900883"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:07:23.793301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-032b5fe3-a1f6-44c9-9159-e8b7dfa9b8cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:23.802550 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-032b5fe3-a1f6-44c9-9159-e8b7dfa9b8cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:23.803061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-032b5fe3-a1f6-44c9-9159-e8b7dfa9b8cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:23.807119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-032b5fe3-a1f6-44c9-9159-e8b7dfa9b8cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:23.807119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-032b5fe3-a1f6-44c9-9159-e8b7dfa9b8cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:23.807119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-032b5fe3-a1f6-44c9-9159-e8b7dfa9b8cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:23.807119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-032b5fe3-a1f6-44c9-9159-e8b7dfa9b8cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:23.958515 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.network.security_group_api [None req-032b5fe3-a1f6-44c9-9159-e8b7dfa9b8cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Adding security group 1f8de62c-f1da-4a47-8de7-85a228e04d1f to port 8973ebe6-f758-45ee-939e-66a108647add Aug 27 06:07:24.314536 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-032b5fe3-a1f6-44c9-9159-e8b7dfa9b8cf tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/action" status: 202 len: 0 microversion: 2.1 time: 0.525744 Aug 27 06:07:24.315197 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3885/7778] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:07:23 2022] POST /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:07:24.325635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-54c52d42-5215-4fc8-9ee7-9fae60a98bbc req-b135e714-64d1-472c-a5e6-c8a3faa268db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30779bd-f49c-4804-b06b-8348136dfa39", "tag": "8973ebe6-f758-45ee-939e-66a108647add"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:07:24.328947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a3506c4c-71a5-4377-8dd8-15eb22e840e6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:24.330393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a3506c4c-71a5-4377-8dd8-15eb22e840e6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:24.337239 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-54c52d42-5215-4fc8-9ee7-9fae60a98bbc req-b135e714-64d1-472c-a5e6-c8a3faa268db service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:24.338524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-54c52d42-5215-4fc8-9ee7-9fae60a98bbc req-b135e714-64d1-472c-a5e6-c8a3faa268db service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:24.339344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-54c52d42-5215-4fc8-9ee7-9fae60a98bbc req-b135e714-64d1-472c-a5e6-c8a3faa268db service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:24.347156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3506c4c-71a5-4377-8dd8-15eb22e840e6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:24.348671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3506c4c-71a5-4377-8dd8-15eb22e840e6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:24.349314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3506c4c-71a5-4377-8dd8-15eb22e840e6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:24.350206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3506c4c-71a5-4377-8dd8-15eb22e840e6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:24.350859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3506c4c-71a5-4377-8dd8-15eb22e840e6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:24.352189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a3506c4c-71a5-4377-8dd8-15eb22e840e6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:24.358731 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-54c52d42-5215-4fc8-9ee7-9fae60a98bbc req-b135e714-64d1-472c-a5e6-c8a3faa268db service nova] Creating event network-changed:8973ebe6-f758-45ee-939e-66a108647add for instance e30779bd-f49c-4804-b06b-8348136dfa39 on n-h1-820368-35 Aug 27 06:07:24.366239 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-54c52d42-5215-4fc8-9ee7-9fae60a98bbc req-b135e714-64d1-472c-a5e6-c8a3faa268db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044482 Aug 27 06:07:24.367801 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3886/7779] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:07:24.645722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a3506c4c-71a5-4377-8dd8-15eb22e840e6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:24.661252 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a3506c4c-71a5-4377-8dd8-15eb22e840e6 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1759 microversion: 2.1 time: 0.338629 Aug 27 06:07:24.662410 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3894/7780] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:24 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1759 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:08:22.132167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:08:22.132875 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=12 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:08:22.133891 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:08:22.134111 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:08:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/action (ip 10.222.0.58) !!! Aug 27 06:08:22.140071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2dc5c08-1f4c-4ad9-8d63-7e77e1f9413b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:08:22.142468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a2dc5c08-1f4c-4ad9-8d63-7e77e1f9413b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:22.154143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2dc5c08-1f4c-4ad9-8d63-7e77e1f9413b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:22.155350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2dc5c08-1f4c-4ad9-8d63-7e77e1f9413b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:22.155803 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2dc5c08-1f4c-4ad9-8d63-7e77e1f9413b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:22.156523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2dc5c08-1f4c-4ad9-8d63-7e77e1f9413b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:22.156996 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2dc5c08-1f4c-4ad9-8d63-7e77e1f9413b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:22.157432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a2dc5c08-1f4c-4ad9-8d63-7e77e1f9413b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:22.237926 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2dc5c08-1f4c-4ad9-8d63-7e77e1f9413b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/action" status: 202 len: 0 microversion: 2.1 time: 0.107641 Aug 27 06:08:22.241529 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3887/7781] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:08:22 2022] POST /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:08:22.247632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1b5288e2-05e3-4fdd-9440-1f6d4d9e9dae tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:08:22.248993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1b5288e2-05e3-4fdd-9440-1f6d4d9e9dae tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:22.255187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:08:22.255991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=8 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:08:22.258521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5288e2-05e3-4fdd-9440-1f6d4d9e9dae tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:22.259180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5288e2-05e3-4fdd-9440-1f6d4d9e9dae tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:22.259773 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5288e2-05e3-4fdd-9440-1f6d4d9e9dae tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:22.260711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5288e2-05e3-4fdd-9440-1f6d4d9e9dae tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:22.261348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5288e2-05e3-4fdd-9440-1f6d4d9e9dae tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:22.261800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1b5288e2-05e3-4fdd-9440-1f6d4d9e9dae tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:22.539847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1b5288e2-05e3-4fdd-9440-1f6d4d9e9dae tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:08:22.549476 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1b5288e2-05e3-4fdd-9440-1f6d4d9e9dae tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1751 microversion: 2.1 time: 0.306495 Aug 27 06:08:22.550526 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3895/7782] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:08:22 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1751 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:08:23.574248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf44b92d-608f-41b8-bb11-5e8685549d97 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:08:23.575054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf44b92d-608f-41b8-bb11-5e8685549d97 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:23.584293 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf44b92d-608f-41b8-bb11-5e8685549d97 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:23.584978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf44b92d-608f-41b8-bb11-5e8685549d97 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:23.585610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf44b92d-608f-41b8-bb11-5e8685549d97 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:23.586742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf44b92d-608f-41b8-bb11-5e8685549d97 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:23.587448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf44b92d-608f-41b8-bb11-5e8685549d97 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:23.588210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf44b92d-608f-41b8-bb11-5e8685549d97 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:23.775255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bf44b92d-608f-41b8-bb11-5e8685549d97 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:08:23.785022 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf44b92d-608f-41b8-bb11-5e8685549d97 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1756 microversion: 2.1 time: 0.216164 Aug 27 06:08:23.799508 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3888/7783] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:08:23 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:08:24.809623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dd151fe3-3492-4d70-90e3-3373e8596fce tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:08:24.810257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dd151fe3-3492-4d70-90e3-3373e8596fce tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:24.817405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd151fe3-3492-4d70-90e3-3373e8596fce tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:24.817920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd151fe3-3492-4d70-90e3-3373e8596fce tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:24.818348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd151fe3-3492-4d70-90e3-3373e8596fce tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:24.819175 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd151fe3-3492-4d70-90e3-3373e8596fce tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:24.819889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd151fe3-3492-4d70-90e3-3373e8596fce tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:24.820318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dd151fe3-3492-4d70-90e3-3373e8596fce tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:24.995951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dd151fe3-3492-4d70-90e3-3373e8596fce tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:08:25.005575 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dd151fe3-3492-4d70-90e3-3373e8596fce tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1756 microversion: 2.1 time: 0.200985 Aug 27 06:08:25.006183 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3896/7784] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:08:24 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:08:26.032071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4c4e5163-a646-4bc7-a919-9790f79b9c6b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:08:26.032720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4c4e5163-a646-4bc7-a919-9790f79b9c6b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:26.041200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c4e5163-a646-4bc7-a919-9790f79b9c6b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:26.041720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c4e5163-a646-4bc7-a919-9790f79b9c6b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:26.042157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c4e5163-a646-4bc7-a919-9790f79b9c6b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:26.043277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c4e5163-a646-4bc7-a919-9790f79b9c6b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:26.043752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c4e5163-a646-4bc7-a919-9790f79b9c6b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:26.044195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4c4e5163-a646-4bc7-a919-9790f79b9c6b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:26.215316 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4c4e5163-a646-4bc7-a919-9790f79b9c6b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:08:26.229789 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4c4e5163-a646-4bc7-a919-9790f79b9c6b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1756 microversion: 2.1 time: 0.202245 Aug 27 06:08:26.230387 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3889/7785] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:08:26 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:08:27.253178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a2cb7df4-a3e6-4da2-83e5-b1870932205d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:08:27.253811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a2cb7df4-a3e6-4da2-83e5-b1870932205d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:27.260959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2cb7df4-a3e6-4da2-83e5-b1870932205d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:27.261502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2cb7df4-a3e6-4da2-83e5-b1870932205d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:27.261954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2cb7df4-a3e6-4da2-83e5-b1870932205d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:27.262687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2cb7df4-a3e6-4da2-83e5-b1870932205d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:27.263187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2cb7df4-a3e6-4da2-83e5-b1870932205d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:27.263662 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a2cb7df4-a3e6-4da2-83e5-b1870932205d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:27.444155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a2cb7df4-a3e6-4da2-83e5-b1870932205d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:08:27.455248 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a2cb7df4-a3e6-4da2-83e5-b1870932205d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1756 microversion: 2.1 time: 0.205715 Aug 27 06:08:27.455845 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3897/7786] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:08:27 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:08:28.477813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-960983ca-8cde-477c-8571-dc9453cae59d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:08:28.479182 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-960983ca-8cde-477c-8571-dc9453cae59d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:28.487103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-960983ca-8cde-477c-8571-dc9453cae59d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:28.487612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-960983ca-8cde-477c-8571-dc9453cae59d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:28.488062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-960983ca-8cde-477c-8571-dc9453cae59d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:28.488779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-960983ca-8cde-477c-8571-dc9453cae59d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:28.489242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-960983ca-8cde-477c-8571-dc9453cae59d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:28.489683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-960983ca-8cde-477c-8571-dc9453cae59d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:28.647425 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-960983ca-8cde-477c-8571-dc9453cae59d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:08:28.656961 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-960983ca-8cde-477c-8571-dc9453cae59d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1756 microversion: 2.1 time: 0.182993 Aug 27 06:08:28.657547 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3890/7787] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:08:28 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:08:29.678737 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4f90adf0-2d44-4725-8407-0a66a5739bc5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:08:29.679373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4f90adf0-2d44-4725-8407-0a66a5739bc5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:29.686925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90adf0-2d44-4725-8407-0a66a5739bc5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:29.687445 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90adf0-2d44-4725-8407-0a66a5739bc5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:29.687890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90adf0-2d44-4725-8407-0a66a5739bc5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:29.688600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90adf0-2d44-4725-8407-0a66a5739bc5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:29.689066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90adf0-2d44-4725-8407-0a66a5739bc5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:29.689498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4f90adf0-2d44-4725-8407-0a66a5739bc5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:29.844143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4f90adf0-2d44-4725-8407-0a66a5739bc5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:08:29.852689 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4f90adf0-2d44-4725-8407-0a66a5739bc5 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1756 microversion: 2.1 time: 0.178083 Aug 27 06:08:29.853277 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3898/7788] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:08:29 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:08:30.874714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-492a7a7d-559a-4071-bc56-d5aab8823ff3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:08:30.875384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-492a7a7d-559a-4071-bc56-d5aab8823ff3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:30.882654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492a7a7d-559a-4071-bc56-d5aab8823ff3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:30.883176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492a7a7d-559a-4071-bc56-d5aab8823ff3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:30.883692 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492a7a7d-559a-4071-bc56-d5aab8823ff3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:30.884355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492a7a7d-559a-4071-bc56-d5aab8823ff3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:30.887054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492a7a7d-559a-4071-bc56-d5aab8823ff3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:30.887054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492a7a7d-559a-4071-bc56-d5aab8823ff3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:31.042092 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-492a7a7d-559a-4071-bc56-d5aab8823ff3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:08:31.051039 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-492a7a7d-559a-4071-bc56-d5aab8823ff3 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1756 microversion: 2.1 time: 0.180937 Aug 27 06:08:31.051669 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3891/7789] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:08:30 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:08:32.073960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a4fe552-33e4-416f-a665-3d4e946890a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:08:32.074499 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7a4fe552-33e4-416f-a665-3d4e946890a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:32.082612 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4fe552-33e4-416f-a665-3d4e946890a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:32.083145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4fe552-33e4-416f-a665-3d4e946890a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:32.083598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4fe552-33e4-416f-a665-3d4e946890a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:32.084322 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4fe552-33e4-416f-a665-3d4e946890a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:32.084804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4fe552-33e4-416f-a665-3d4e946890a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:32.085229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a4fe552-33e4-416f-a665-3d4e946890a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:32.232569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7a4fe552-33e4-416f-a665-3d4e946890a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:08:32.241064 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a4fe552-33e4-416f-a665-3d4e946890a2 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1756 microversion: 2.1 time: 0.171331 Aug 27 06:08:32.241648 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3899/7790] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:08:32 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:08:33.263286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fdcfedd0-9947-4367-9bd8-383d9d7a3c5a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:08:33.264690 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fdcfedd0-9947-4367-9bd8-383d9d7a3c5a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:33.272071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fdcfedd0-9947-4367-9bd8-383d9d7a3c5a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:33.272589 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fdcfedd0-9947-4367-9bd8-383d9d7a3c5a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:33.273018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fdcfedd0-9947-4367-9bd8-383d9d7a3c5a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:33.273734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fdcfedd0-9947-4367-9bd8-383d9d7a3c5a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:33.274195 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fdcfedd0-9947-4367-9bd8-383d9d7a3c5a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:33.274637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fdcfedd0-9947-4367-9bd8-383d9d7a3c5a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:33.432628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fdcfedd0-9947-4367-9bd8-383d9d7a3c5a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:08:33.442471 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fdcfedd0-9947-4367-9bd8-383d9d7a3c5a tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1756 microversion: 2.1 time: 0.183104 Aug 27 06:08:33.443068 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3892/7791] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:08:33 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:08:34.464584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fc5885a4-244b-46f2-9775-e5b8db62427e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:08:34.465297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fc5885a4-244b-46f2-9775-e5b8db62427e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:08:34.472847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc5885a4-244b-46f2-9775-e5b8db62427e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:34.473334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc5885a4-244b-46f2-9775-e5b8db62427e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:34.473774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc5885a4-244b-46f2-9775-e5b8db62427e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:34.474500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc5885a4-244b-46f2-9775-e5b8db62427e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:08:34.474959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc5885a4-244b-46f2-9775-e5b8db62427e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:08:34.475417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fc5885a4-244b-46f2-9775-e5b8db62427e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:08:34.626235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fc5885a4-244b-46f2-9775-e5b8db62427e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:08:34.634857 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fc5885a4-244b-46f2-9775-e5b8db62427e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1759 microversion: 2.1 time: 0.174354 Aug 27 06:08:34.635603 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3900/7792] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:08:34 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:38.042794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=12 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:38.044127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:38.050162 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40968a7a-61f1-4c51-abbb-18b0fbef1086 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1695900883"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:09:38.050994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-40968a7a-61f1-4c51-abbb-18b0fbef1086 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:38.060840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40968a7a-61f1-4c51-abbb-18b0fbef1086 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:38.061930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40968a7a-61f1-4c51-abbb-18b0fbef1086 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:38.062393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40968a7a-61f1-4c51-abbb-18b0fbef1086 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:38.063167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40968a7a-61f1-4c51-abbb-18b0fbef1086 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:38.063643 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40968a7a-61f1-4c51-abbb-18b0fbef1086 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:38.064096 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40968a7a-61f1-4c51-abbb-18b0fbef1086 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:38.202738 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.network.security_group_api [None req-40968a7a-61f1-4c51-abbb-18b0fbef1086 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Removing security group 1f8de62c-f1da-4a47-8de7-85a228e04d1f from port 8973ebe6-f758-45ee-939e-66a108647add Aug 27 06:09:38.510580 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40968a7a-61f1-4c51-abbb-18b0fbef1086 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "POST /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/action" status: 202 len: 0 microversion: 2.1 time: 0.469694 Aug 27 06:09:38.511352 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3893/7793] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:09:38 2022] POST /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:09:38.551725 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [15bbca3d-0083-4a69-8bef-16bf0d79b591] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:09:38.553518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=12 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:38.554518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=36 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:38.559801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c11d75d9-9bf3-4f85-a35e-4bb075a72f41 req-66e9ba43-a6d0-4999-a5bb-690ed75999a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30779bd-f49c-4804-b06b-8348136dfa39", "tag": "8973ebe6-f758-45ee-939e-66a108647add"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:09:38.571895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c11d75d9-9bf3-4f85-a35e-4bb075a72f41 req-66e9ba43-a6d0-4999-a5bb-690ed75999a8 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:38.572804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c11d75d9-9bf3-4f85-a35e-4bb075a72f41 req-66e9ba43-a6d0-4999-a5bb-690ed75999a8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:38.573508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c11d75d9-9bf3-4f85-a35e-4bb075a72f41 req-66e9ba43-a6d0-4999-a5bb-690ed75999a8 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:38.587413 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c11d75d9-9bf3-4f85-a35e-4bb075a72f41 req-66e9ba43-a6d0-4999-a5bb-690ed75999a8 service nova] Creating event network-changed:8973ebe6-f758-45ee-939e-66a108647add for instance e30779bd-f49c-4804-b06b-8348136dfa39 on n-h1-820368-35 Aug 27 06:09:38.595074 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c11d75d9-9bf3-4f85-a35e-4bb075a72f41 req-66e9ba43-a6d0-4999-a5bb-690ed75999a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045849 Aug 27 06:09:38.596165 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3901/7794] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:09:39.661571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a199d7e9-2d27-4c30-a8a9-ccf38fb0fda9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:39.662209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a199d7e9-2d27-4c30-a8a9-ccf38fb0fda9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:39.665945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-8d2a73d3-d065-4e56-8de0-413c5ef07f38 req-98c6cb2f-ec96-45bc-803c-10dd8fd13355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30779bd-f49c-4804-b06b-8348136dfa39", "tag": "8973ebe6-f758-45ee-939e-66a108647add"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:09:39.668959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a199d7e9-2d27-4c30-a8a9-ccf38fb0fda9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:39.669581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a199d7e9-2d27-4c30-a8a9-ccf38fb0fda9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:39.670598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a199d7e9-2d27-4c30-a8a9-ccf38fb0fda9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:39.671429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a199d7e9-2d27-4c30-a8a9-ccf38fb0fda9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:39.672149 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a199d7e9-2d27-4c30-a8a9-ccf38fb0fda9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:39.672821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a199d7e9-2d27-4c30-a8a9-ccf38fb0fda9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:39.687001 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8d2a73d3-d065-4e56-8de0-413c5ef07f38 req-98c6cb2f-ec96-45bc-803c-10dd8fd13355 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:39.687505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8d2a73d3-d065-4e56-8de0-413c5ef07f38 req-98c6cb2f-ec96-45bc-803c-10dd8fd13355 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:39.687944 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8d2a73d3-d065-4e56-8de0-413c5ef07f38 req-98c6cb2f-ec96-45bc-803c-10dd8fd13355 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:39.715939 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-8d2a73d3-d065-4e56-8de0-413c5ef07f38 req-98c6cb2f-ec96-45bc-803c-10dd8fd13355 service nova] Creating event network-changed:8973ebe6-f758-45ee-939e-66a108647add for instance e30779bd-f49c-4804-b06b-8348136dfa39 on n-h1-820368-35 Aug 27 06:09:39.722399 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-8d2a73d3-d065-4e56-8de0-413c5ef07f38 req-98c6cb2f-ec96-45bc-803c-10dd8fd13355 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060338 Aug 27 06:09:39.723028 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3902/7795] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:09:39.776483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-a199d7e9-2d27-4c30-a8a9-ccf38fb0fda9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lazy-loading 'services' on Instance uuid e30779bd-f49c-4804-b06b-8348136dfa39 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:09:39.888795 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a199d7e9-2d27-4c30-a8a9-ccf38fb0fda9 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments/9c9971d7-01f7-4f50-8316-472ff85a046d" status: 202 len: 0 microversion: 2.1 time: 0.232080 Aug 27 06:09:39.889917 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3894/7796] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 06:09:39 2022] DELETE /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments/9c9971d7-01f7-4f50-8316-472ff85a046d => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:09:39.900456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a8d4593c-72d4-4a5b-a689-b33f2fa5982f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:39.903209 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a8d4593c-72d4-4a5b-a689-b33f2fa5982f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:39.914608 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] [15bbca3d-0083-4a69-8bef-16bf0d79b591] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47128. Aug 27 06:09:39.921385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4593c-72d4-4a5b-a689-b33f2fa5982f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:39.922650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4593c-72d4-4a5b-a689-b33f2fa5982f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:39.923476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4593c-72d4-4a5b-a689-b33f2fa5982f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:39.925228 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4593c-72d4-4a5b-a689-b33f2fa5982f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:39.926184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4593c-72d4-4a5b-a689-b33f2fa5982f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:39.927673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a8d4593c-72d4-4a5b-a689-b33f2fa5982f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:40.000289 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a8d4593c-72d4-4a5b-a689-b33f2fa5982f tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105626 Aug 27 06:09:40.001928 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3903/7797] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:09:39 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:09:41.014174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c9295f44-42d8-4d53-bad0-5b46d5a00412 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:41.016504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c9295f44-42d8-4d53-bad0-5b46d5a00412 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:41.022795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9295f44-42d8-4d53-bad0-5b46d5a00412 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:41.023374 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9295f44-42d8-4d53-bad0-5b46d5a00412 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:41.023829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9295f44-42d8-4d53-bad0-5b46d5a00412 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:41.024557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9295f44-42d8-4d53-bad0-5b46d5a00412 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:41.025013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9295f44-42d8-4d53-bad0-5b46d5a00412 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:41.025456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c9295f44-42d8-4d53-bad0-5b46d5a00412 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:41.055833 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c9295f44-42d8-4d53-bad0-5b46d5a00412 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046923 Aug 27 06:09:41.056417 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3895/7798] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:09:41 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:09:42.071700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-49e2ffad-bc55-4fbb-aa50-30e0571c3812 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:42.073920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-49e2ffad-bc55-4fbb-aa50-30e0571c3812 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:42.082083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e2ffad-bc55-4fbb-aa50-30e0571c3812 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:42.082584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e2ffad-bc55-4fbb-aa50-30e0571c3812 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:42.083030 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e2ffad-bc55-4fbb-aa50-30e0571c3812 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:42.083813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e2ffad-bc55-4fbb-aa50-30e0571c3812 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:42.084278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e2ffad-bc55-4fbb-aa50-30e0571c3812 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:42.087357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-49e2ffad-bc55-4fbb-aa50-30e0571c3812 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:42.126680 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-49e2ffad-bc55-4fbb-aa50-30e0571c3812 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061572 Aug 27 06:09:42.127488 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3904/7799] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:09:42 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:09:43.139972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cbee65db-1c39-490c-929a-ca5054348e81 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:43.142333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cbee65db-1c39-490c-929a-ca5054348e81 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:43.153285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbee65db-1c39-490c-929a-ca5054348e81 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:43.154299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbee65db-1c39-490c-929a-ca5054348e81 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:43.154299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbee65db-1c39-490c-929a-ca5054348e81 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:43.155032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbee65db-1c39-490c-929a-ca5054348e81 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:43.155536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbee65db-1c39-490c-929a-ca5054348e81 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:43.155985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cbee65db-1c39-490c-929a-ca5054348e81 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:43.194006 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cbee65db-1c39-490c-929a-ca5054348e81 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058693 Aug 27 06:09:43.194795 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3896/7800] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:09:43 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:09:44.206807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ca862be4-0bfe-4a14-abcf-250e441d395b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:44.209049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ca862be4-0bfe-4a14-abcf-250e441d395b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:44.219834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca862be4-0bfe-4a14-abcf-250e441d395b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:44.220332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca862be4-0bfe-4a14-abcf-250e441d395b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:44.220776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca862be4-0bfe-4a14-abcf-250e441d395b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:44.221493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca862be4-0bfe-4a14-abcf-250e441d395b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:44.222036 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca862be4-0bfe-4a14-abcf-250e441d395b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:44.222381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ca862be4-0bfe-4a14-abcf-250e441d395b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:44.254600 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ca862be4-0bfe-4a14-abcf-250e441d395b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051872 Aug 27 06:09:44.255612 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3905/7801] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:09:44 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:09:45.269256 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-33cc0578-29f9-4e74-97d4-9a9df490da71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:45.271558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-33cc0578-29f9-4e74-97d4-9a9df490da71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:45.278485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cc0578-29f9-4e74-97d4-9a9df490da71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:45.279054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cc0578-29f9-4e74-97d4-9a9df490da71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:45.279594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cc0578-29f9-4e74-97d4-9a9df490da71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:45.280317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cc0578-29f9-4e74-97d4-9a9df490da71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:45.280788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cc0578-29f9-4e74-97d4-9a9df490da71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:45.281230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33cc0578-29f9-4e74-97d4-9a9df490da71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:45.312875 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-33cc0578-29f9-4e74-97d4-9a9df490da71 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049735 Aug 27 06:09:45.319035 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3897/7802] 10.222.0.58 () {58 vars in 1302 bytes} [Sat Aug 27 06:09:45 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 06:09:45.324950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:45.325505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:45.334382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:45.334883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:45.335352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:45.336075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:45.336535 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:45.336966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:45.424492 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] HTTP exception thrown: Instance e30779bd-f49c-4804-b06b-8348136dfa39 is not attached to volume 9c9971d7-01f7-4f50-8316-472ff85a046d Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Request method failure captured: Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: request: DELETE /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments/9c9971d7-01f7-4f50-8316-472ff85a046d HTTP/1.1 Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbMp8Y0L-jjAdUoxaOwxU9lhPidg_Ol5RADeH-qgkDKoV2vaSmC2gXGD61tf8NRRK2DaXX1GtM7imeYfxfrsE4hDtFNn-4O9wUkIoLp7Z9fe9yUl8S4EdOb9s1lMhHz_kJe7UKt4NZAUn3cSAjskZZaxi0SpNMy7dR49unGuCwn8lEo Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 2e97b7c5120f427ea4815163908d7382 Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e97b7c5120f427ea4815163908d7382", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 2e97b7c5120f427ea4815163908d7382 Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestMinimumBasicScenario-102048364-project Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: e3a94ad543bf4e70ae34f6bb6620b5ca Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestMinimumBasicScenario-102048364-project Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance e30779bd-f49c-4804-b06b-8348136dfa39 is not attached to volume 9c9971d7-01f7-4f50-8316-472ff85a046d Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'server_id': 'e30779bd-f49c-4804-b06b-8348136dfa39', 'id': '9c9971d7-01f7-4f50-8316-472ff85a046d'} Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9c9971d7-01f7-4f50-8316-472ff85a046d. Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30779bd-f49c-4804-b06b-8348136dfa39 is not attached to volume 9c9971d7-01f7-4f50-8316-472ff85a046d Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:09:45.426719 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:09:45.431263 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:09:45.431263 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:09:45.431263 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30779bd-f49c-4804-b06b-8348136dfa39 is not attached to volume 9c9971d7-01f7-4f50-8316-472ff85a046d Aug 27 06:09:45.431263 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:09:45.431263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Returning 404 to user: Instance e30779bd-f49c-4804-b06b-8348136dfa39 is not attached to volume 9c9971d7-01f7-4f50-8316-472ff85a046d {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:09:45.431263 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-69890e4c-0686-47e8-a300-7c45025935ee tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments/9c9971d7-01f7-4f50-8316-472ff85a046d" status: 404 len: 154 microversion: 2.1 time: 0.107421 Aug 27 06:09:45.432160 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3906/7803] 10.222.0.58 () {58 vars in 1416 bytes} [Sat Aug 27 06:09:45 2022] DELETE /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39/os-volume_attachments/9c9971d7-01f7-4f50-8316-472ff85a046d => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:09:48.709077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a9dbfcc2-6d7f-4e3e-bff5-58d79b34f43e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:48.709780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a9dbfcc2-6d7f-4e3e-bff5-58d79b34f43e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:48.718819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dbfcc2-6d7f-4e3e-bff5-58d79b34f43e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:48.719382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dbfcc2-6d7f-4e3e-bff5-58d79b34f43e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:48.719852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dbfcc2-6d7f-4e3e-bff5-58d79b34f43e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:48.720997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dbfcc2-6d7f-4e3e-bff5-58d79b34f43e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:48.721473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dbfcc2-6d7f-4e3e-bff5-58d79b34f43e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:48.722099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dbfcc2-6d7f-4e3e-bff5-58d79b34f43e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:48.750302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a9dbfcc2-6d7f-4e3e-bff5-58d79b34f43e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:09:48.847650 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a9dbfcc2-6d7f-4e3e-bff5-58d79b34f43e tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 204 len: 0 microversion: 2.1 time: 0.141304 Aug 27 06:09:48.848288 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3898/7804] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:09:48 2022] DELETE /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:09:48.859042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-906f949e-0a70-4885-b8ff-a646f37b7a11 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:48.860562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-906f949e-0a70-4885-b8ff-a646f37b7a11 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:48.869363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906f949e-0a70-4885-b8ff-a646f37b7a11 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:48.869878 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906f949e-0a70-4885-b8ff-a646f37b7a11 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:48.870326 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906f949e-0a70-4885-b8ff-a646f37b7a11 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:48.871058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906f949e-0a70-4885-b8ff-a646f37b7a11 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:48.871547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906f949e-0a70-4885-b8ff-a646f37b7a11 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:48.871979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-906f949e-0a70-4885-b8ff-a646f37b7a11 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:49.019780 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-906f949e-0a70-4885-b8ff-a646f37b7a11 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:49.027830 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-906f949e-0a70-4885-b8ff-a646f37b7a11 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1554 microversion: 2.1 time: 0.173861 Aug 27 06:09:49.028404 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3907/7805] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:48 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:50.050367 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6beb0ed0-f191-4836-a6a9-ab08893a245d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:50.051343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6beb0ed0-f191-4836-a6a9-ab08893a245d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:50.058879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6beb0ed0-f191-4836-a6a9-ab08893a245d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:50.059345 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6beb0ed0-f191-4836-a6a9-ab08893a245d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:50.059794 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6beb0ed0-f191-4836-a6a9-ab08893a245d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:50.061147 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6beb0ed0-f191-4836-a6a9-ab08893a245d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:50.061615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6beb0ed0-f191-4836-a6a9-ab08893a245d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:50.062052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6beb0ed0-f191-4836-a6a9-ab08893a245d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:50.192449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6beb0ed0-f191-4836-a6a9-ab08893a245d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:50.210307 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6beb0ed0-f191-4836-a6a9-ab08893a245d tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1554 microversion: 2.1 time: 0.164124 Aug 27 06:09:50.210928 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3899/7806] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:50 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:51.231638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-369fc9ff-bf05-4340-83ff-4b8e89dad5b1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:51.233232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-369fc9ff-bf05-4340-83ff-4b8e89dad5b1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:51.247049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-369fc9ff-bf05-4340-83ff-4b8e89dad5b1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:51.247673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-369fc9ff-bf05-4340-83ff-4b8e89dad5b1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:51.248763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-369fc9ff-bf05-4340-83ff-4b8e89dad5b1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:51.254568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-40c02192-9039-4dec-b4e8-97245142d1a5 req-3c1e45b8-481f-4ad6-b1e1-890927330b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30779bd-f49c-4804-b06b-8348136dfa39", "name": "network-vif-deleted", "tag": "8973ebe6-f758-45ee-939e-66a108647add"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:09:51.262381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-369fc9ff-bf05-4340-83ff-4b8e89dad5b1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:51.263130 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-369fc9ff-bf05-4340-83ff-4b8e89dad5b1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:51.264534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-369fc9ff-bf05-4340-83ff-4b8e89dad5b1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:51.276801 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-40c02192-9039-4dec-b4e8-97245142d1a5 req-3c1e45b8-481f-4ad6-b1e1-890927330b02 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:51.277452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-40c02192-9039-4dec-b4e8-97245142d1a5 req-3c1e45b8-481f-4ad6-b1e1-890927330b02 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:51.278007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-40c02192-9039-4dec-b4e8-97245142d1a5 req-3c1e45b8-481f-4ad6-b1e1-890927330b02 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:51.290812 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-40c02192-9039-4dec-b4e8-97245142d1a5 req-3c1e45b8-481f-4ad6-b1e1-890927330b02 service nova] Creating event network-vif-deleted:8973ebe6-f758-45ee-939e-66a108647add for instance e30779bd-f49c-4804-b06b-8348136dfa39 on n-h1-820368-35 Aug 27 06:09:51.295879 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-40c02192-9039-4dec-b4e8-97245142d1a5 req-3c1e45b8-481f-4ad6-b1e1-890927330b02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044976 Aug 27 06:09:51.296688 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3900/7807] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:09:51.338145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-369fc9ff-bf05-4340-83ff-4b8e89dad5b1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a94ad543bf4e70ae34f6bb6620b5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e97b7c5120f427ea4815163908d7382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:51.348121 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-369fc9ff-bf05-4340-83ff-4b8e89dad5b1 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 200 len: 1512 microversion: 2.1 time: 0.120345 Aug 27 06:09:51.349027 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3908/7808] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:51 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 1512 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:52.371139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:52.371870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [instance: e30779bd-f49c-4804-b06b-8348136dfa39] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:52.378752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:52.379304 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:52.379765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:52.380485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:52.380969 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:52.381417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:52.394411 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] HTTP exception thrown: Instance e30779bd-f49c-4804-b06b-8348136dfa39 could not be found. Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Request method failure captured: Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 HTTP/1.1 Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbMp8Y0L-jjAdUoxaOwxU9lhPidg_Ol5RADeH-qgkDKoV2vaSmC2gXGD61tf8NRRK2DaXX1GtM7imeYfxfrsE4hDtFNn-4O9wUkIoLp7Z9fe9yUl8S4EdOb9s1lMhHz_kJe7UKt4NZAUn3cSAjskZZaxi0SpNMy7dR49unGuCwn8lEo Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 2e97b7c5120f427ea4815163908d7382 Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e97b7c5120f427ea4815163908d7382", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e97b7c5120f427ea4815163908d7382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 2e97b7c5120f427ea4815163908d7382 Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestMinimumBasicScenario-102048364 Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestMinimumBasicScenario-102048364-project Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: e3a94ad543bf4e70ae34f6bb6620b5ca Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestMinimumBasicScenario-102048364-project Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance e30779bd-f49c-4804-b06b-8348136dfa39 could not be found. Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'e30779bd-f49c-4804-b06b-8348136dfa39'} Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30779bd-f49c-4804-b06b-8348136dfa39 could not be found. Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30779bd-f49c-4804-b06b-8348136dfa39 could not be found. Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:09:52.396105 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:09:52.400939 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:09:52.400939 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:09:52.400939 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:09:52.400939 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:09:52.400939 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:09:52.400939 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30779bd-f49c-4804-b06b-8348136dfa39 could not be found. Aug 27 06:09:52.400939 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:09:52.400939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Returning 404 to user: Instance e30779bd-f49c-4804-b06b-8348136dfa39 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:09:52.400939 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f9a92dd1-369e-4bc3-b6db-d0703cef9b1b tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39" status: 404 len: 111 microversion: 2.1 time: 0.031915 Aug 27 06:09:52.400939 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3901/7809] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:52 2022] GET /compute/v2.1/servers/e30779bd-f49c-4804-b06b-8348136dfa39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:09:52.406538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01f8347d-fa2d-4eed-8d77-c798a8f52b24 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] Calling method '.version_select at 0x7fb564b655e0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:52.411158 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [None req-01f8347d-fa2d-4eed-8d77-c798a8f52b24 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [29dc6b1e-b247-4504-beea-89ae8c634cd6] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:09:53.422753 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [None req-01f8347d-fa2d-4eed-8d77-c798a8f52b24 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] [29dc6b1e-b247-4504-beea-89ae8c634cd6] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47178. Aug 27 06:09:53.444890 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01f8347d-fa2d-4eed-8d77-c798a8f52b24 tempest-TestMinimumBasicScenario-102048364 tempest-TestMinimumBasicScenario-102048364-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-924953269" status: 202 len: 0 microversion: 2.1 time: 1.042399 Aug 27 06:09:53.445478 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3909/7810] 10.222.0.58 () {58 vars in 1269 bytes} [Sat Aug 27 06:09:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-924953269 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 06:10:02.900465 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:10:02.901028 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:10:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.58) !!! Aug 27 06:10:02.902936 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:10:02.903708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:10:03.079601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a074f13f-0847-4de7-b8d6-0f86de6b8885 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'create', calling method: .version_select at 0x7fb55fff3f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-656947933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTpM9XZzbW8FtExPpWmcxIOpTJOW//5WhHgQQj0FreepdkfSDeMHQpveVrMGD4g6XhK7B7GTCmAVbsTQU4pH3s0jGl5SKKNzANmqpaTETW9Q6JuBiJTQ7+qDCaHcZmEYw=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:10:03.096336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a074f13f-0847-4de7-b8d6-0f86de6b8885 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:10:03.102335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-a074f13f-0847-4de7-b8d6-0f86de6b8885 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for user 52d1f89be8a74799b32e239ff34959c2 and project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:10:03.135437 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a074f13f-0847-4de7-b8d6-0f86de6b8885 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.240948 Aug 27 06:10:03.136036 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3902/7811] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 06:10:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:10:10.021488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-430600147", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "001a4ddd-025f-4fcf-871a-2253f0d11eb5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-656947933", "security_groups": [{"name": "tempest-secgroup-smoke-47749155"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:10:10.036415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=40 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:10:10.038452 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:10:10.038835 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:10:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.58) !!! Aug 27 06:10:10.040169 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:10:10.188256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] validate_networks() for [('001a4ddd-025f-4fcf-871a-2253f0d11eb5', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:10:10.644004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:10:10.644764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:10:10.645254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:10:10.645834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:10:10.646273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:10:10.656263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:10.657042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:10.657661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:10.658568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:10.659284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:10.659901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:10.680601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:10:10.687873 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for user 52d1f89be8a74799b32e239ff34959c2 and project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:10:10.703269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:10:10.706171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:10:10.760547 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0a5abffe-6d93-4c01-903e-3b826f3773d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.743412 Aug 27 06:10:10.768612 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3910/7812] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:10:10 2022] POST /compute/v2.1/servers => generated 404 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:10:10.773780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3079f4ae-9f7e-419d-af51-07f5e8da085b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:10.775339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3079f4ae-9f7e-419d-af51-07f5e8da085b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:10.846789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3079f4ae-9f7e-419d-af51-07f5e8da085b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:10.855194 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3079f4ae-9f7e-419d-af51-07f5e8da085b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1265 microversion: 2.1 time: 0.085734 Aug 27 06:10:10.855776 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3903/7813] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:10 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:10:11.876753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dfa5314e-0594-4730-965f-a8c779a59800 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:11.877394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dfa5314e-0594-4730-965f-a8c779a59800 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:11.956735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dfa5314e-0594-4730-965f-a8c779a59800 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:11.965532 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dfa5314e-0594-4730-965f-a8c779a59800 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1265 microversion: 2.1 time: 0.093198 Aug 27 06:10:11.967201 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3911/7814] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:11 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:12.986813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6d985849-d0d3-47ac-aaea-09dba9d09a91 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:12.987376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6d985849-d0d3-47ac-aaea-09dba9d09a91 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:13.043058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6d985849-d0d3-47ac-aaea-09dba9d09a91 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:13.051000 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6d985849-d0d3-47ac-aaea-09dba9d09a91 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1265 microversion: 2.1 time: 0.068670 Aug 27 06:10:13.051631 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3904/7815] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:12 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1265 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:14.072238 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-07bec25d-622a-4e34-b2d8-1f443459e05e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:14.072751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-07bec25d-622a-4e34-b2d8-1f443459e05e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:14.130422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-07bec25d-622a-4e34-b2d8-1f443459e05e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:14.137660 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-07bec25d-622a-4e34-b2d8-1f443459e05e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1265 microversion: 2.1 time: 0.069473 Aug 27 06:10:14.138761 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3912/7816] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:14 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1265 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:15.159349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5e91a51d-2132-4829-b856-f69a6b2ee45c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:15.159953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5e91a51d-2132-4829-b856-f69a6b2ee45c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:15.167000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e91a51d-2132-4829-b856-f69a6b2ee45c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:15.167533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e91a51d-2132-4829-b856-f69a6b2ee45c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:15.167985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e91a51d-2132-4829-b856-f69a6b2ee45c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:15.168700 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e91a51d-2132-4829-b856-f69a6b2ee45c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:15.169200 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e91a51d-2132-4829-b856-f69a6b2ee45c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:15.169618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5e91a51d-2132-4829-b856-f69a6b2ee45c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:15.233124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5e91a51d-2132-4829-b856-f69a6b2ee45c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:15.241172 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5e91a51d-2132-4829-b856-f69a6b2ee45c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1269 microversion: 2.1 time: 0.086051 Aug 27 06:10:15.241857 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3905/7817] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:15 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:16.261950 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cd8bef5d-a326-449f-9e9a-617db31101da tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:16.262657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cd8bef5d-a326-449f-9e9a-617db31101da tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:16.271134 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd8bef5d-a326-449f-9e9a-617db31101da tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:16.271635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd8bef5d-a326-449f-9e9a-617db31101da tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:16.272082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd8bef5d-a326-449f-9e9a-617db31101da tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:16.272832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd8bef5d-a326-449f-9e9a-617db31101da tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:16.273292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd8bef5d-a326-449f-9e9a-617db31101da tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:16.273729 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cd8bef5d-a326-449f-9e9a-617db31101da tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:16.344156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cd8bef5d-a326-449f-9e9a-617db31101da tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:16.353906 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cd8bef5d-a326-449f-9e9a-617db31101da tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1323 microversion: 2.1 time: 0.095765 Aug 27 06:10:16.354685 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3913/7818] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:16 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1323 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:17.379542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e442ffac-f143-4731-b2e1-6e5907342a09 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:17.380217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e442ffac-f143-4731-b2e1-6e5907342a09 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:17.387103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e442ffac-f143-4731-b2e1-6e5907342a09 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:17.388379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e442ffac-f143-4731-b2e1-6e5907342a09 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:17.389004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e442ffac-f143-4731-b2e1-6e5907342a09 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:17.389833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e442ffac-f143-4731-b2e1-6e5907342a09 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:17.390407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e442ffac-f143-4731-b2e1-6e5907342a09 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:17.390946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e442ffac-f143-4731-b2e1-6e5907342a09 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:17.540674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e442ffac-f143-4731-b2e1-6e5907342a09 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:17.550436 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e442ffac-f143-4731-b2e1-6e5907342a09 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1389 microversion: 2.1 time: 0.174937 Aug 27 06:10:17.551408 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3906/7819] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:17 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1389 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:17.573864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-8bf842d7-0a13-4fee-a450-dc8406bd2287 req-e0dc2e04-e42a-4c86-84b6-786cb49b40da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84925c39-ff74-449b-9002-bf97395a2fa4", "tag": "201578e6-3592-4022-a56f-aae1cc1d2266"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:10:17.586551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8bf842d7-0a13-4fee-a450-dc8406bd2287 req-e0dc2e04-e42a-4c86-84b6-786cb49b40da service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:17.587171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8bf842d7-0a13-4fee-a450-dc8406bd2287 req-e0dc2e04-e42a-4c86-84b6-786cb49b40da service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:17.587632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-8bf842d7-0a13-4fee-a450-dc8406bd2287 req-e0dc2e04-e42a-4c86-84b6-786cb49b40da service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:17.601583 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-8bf842d7-0a13-4fee-a450-dc8406bd2287 req-e0dc2e04-e42a-4c86-84b6-786cb49b40da service nova] Creating event network-changed:201578e6-3592-4022-a56f-aae1cc1d2266 for instance 84925c39-ff74-449b-9002-bf97395a2fa4 on n-h2-820368-35 Aug 27 06:10:17.607589 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-8bf842d7-0a13-4fee-a450-dc8406bd2287 req-e0dc2e04-e42a-4c86-84b6-786cb49b40da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042637 Aug 27 06:10:17.608486 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3914/7820] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:10:18.574786 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-32304086-ae35-4b9b-af94-1128a3e833d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:18.575444 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-32304086-ae35-4b9b-af94-1128a3e833d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:18.582651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32304086-ae35-4b9b-af94-1128a3e833d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:18.583265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32304086-ae35-4b9b-af94-1128a3e833d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:18.583845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32304086-ae35-4b9b-af94-1128a3e833d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:18.584572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32304086-ae35-4b9b-af94-1128a3e833d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:18.585041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32304086-ae35-4b9b-af94-1128a3e833d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:18.585485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-32304086-ae35-4b9b-af94-1128a3e833d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:18.722722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-32304086-ae35-4b9b-af94-1128a3e833d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:18.730579 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-32304086-ae35-4b9b-af94-1128a3e833d9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1389 microversion: 2.1 time: 0.159797 Aug 27 06:10:18.731171 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3907/7821] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:18 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:19.752811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a9fb93d4-0e22-46f8-a1e1-3c316912e82f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:19.753438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a9fb93d4-0e22-46f8-a1e1-3c316912e82f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:19.760116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9fb93d4-0e22-46f8-a1e1-3c316912e82f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:19.760607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9fb93d4-0e22-46f8-a1e1-3c316912e82f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:19.761052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9fb93d4-0e22-46f8-a1e1-3c316912e82f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:19.761754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9fb93d4-0e22-46f8-a1e1-3c316912e82f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:19.762213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9fb93d4-0e22-46f8-a1e1-3c316912e82f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:19.762649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a9fb93d4-0e22-46f8-a1e1-3c316912e82f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:19.905855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a9fb93d4-0e22-46f8-a1e1-3c316912e82f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:19.913811 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a9fb93d4-0e22-46f8-a1e1-3c316912e82f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1389 microversion: 2.1 time: 0.166281 Aug 27 06:10:19.914384 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3915/7822] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:19 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:20.935672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2967959d-19e6-4219-b951-d81d46996190 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:20.936309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2967959d-19e6-4219-b951-d81d46996190 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:20.943475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2967959d-19e6-4219-b951-d81d46996190 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:20.943983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2967959d-19e6-4219-b951-d81d46996190 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:20.944439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2967959d-19e6-4219-b951-d81d46996190 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:20.945165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2967959d-19e6-4219-b951-d81d46996190 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:20.945637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2967959d-19e6-4219-b951-d81d46996190 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:20.946093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2967959d-19e6-4219-b951-d81d46996190 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:21.087918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2967959d-19e6-4219-b951-d81d46996190 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:21.097297 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2967959d-19e6-4219-b951-d81d46996190 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1389 microversion: 2.1 time: 0.165481 Aug 27 06:10:21.097891 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3908/7823] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:20 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:22.117958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e751ea50-b292-48b6-9c5f-6c9d87def53e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:22.118578 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e751ea50-b292-48b6-9c5f-6c9d87def53e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:22.120622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:10:22.128743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e751ea50-b292-48b6-9c5f-6c9d87def53e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:22.129243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e751ea50-b292-48b6-9c5f-6c9d87def53e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:22.129695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e751ea50-b292-48b6-9c5f-6c9d87def53e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:22.130412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e751ea50-b292-48b6-9c5f-6c9d87def53e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:22.130877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e751ea50-b292-48b6-9c5f-6c9d87def53e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:22.131342 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e751ea50-b292-48b6-9c5f-6c9d87def53e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:22.267745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e751ea50-b292-48b6-9c5f-6c9d87def53e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:22.276205 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e751ea50-b292-48b6-9c5f-6c9d87def53e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1389 microversion: 2.1 time: 0.162231 Aug 27 06:10:22.280869 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3916/7824] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:22 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:23.298408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7871e884-98d5-4e4b-9ee2-c6e58f9442b7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:23.299267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7871e884-98d5-4e4b-9ee2-c6e58f9442b7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:23.302422 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:10:23.308146 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7871e884-98d5-4e4b-9ee2-c6e58f9442b7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:23.308651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7871e884-98d5-4e4b-9ee2-c6e58f9442b7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:23.309105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7871e884-98d5-4e4b-9ee2-c6e58f9442b7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:23.310361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7871e884-98d5-4e4b-9ee2-c6e58f9442b7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:23.310831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7871e884-98d5-4e4b-9ee2-c6e58f9442b7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:23.311296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7871e884-98d5-4e4b-9ee2-c6e58f9442b7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:23.419110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-a94d040f-eed7-4d2a-99b8-49e9a5d901df req-7dea3cfc-ed2a-49bd-8744-1ca7252461f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84925c39-ff74-449b-9002-bf97395a2fa4", "name": "network-vif-plugged", "status": "completed", "tag": "201578e6-3592-4022-a56f-aae1cc1d2266"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:10:23.432594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a94d040f-eed7-4d2a-99b8-49e9a5d901df req-7dea3cfc-ed2a-49bd-8744-1ca7252461f7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:23.433108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a94d040f-eed7-4d2a-99b8-49e9a5d901df req-7dea3cfc-ed2a-49bd-8744-1ca7252461f7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:23.433948 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-a94d040f-eed7-4d2a-99b8-49e9a5d901df req-7dea3cfc-ed2a-49bd-8744-1ca7252461f7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:23.457882 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-a94d040f-eed7-4d2a-99b8-49e9a5d901df req-7dea3cfc-ed2a-49bd-8744-1ca7252461f7 service nova] Creating event network-vif-plugged:201578e6-3592-4022-a56f-aae1cc1d2266 for instance 84925c39-ff74-449b-9002-bf97395a2fa4 on n-h2-820368-35 Aug 27 06:10:23.466980 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-a94d040f-eed7-4d2a-99b8-49e9a5d901df req-7dea3cfc-ed2a-49bd-8744-1ca7252461f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057733 Aug 27 06:10:23.468626 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3917/7825] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:10:23.479735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7871e884-98d5-4e4b-9ee2-c6e58f9442b7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:23.489024 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7871e884-98d5-4e4b-9ee2-c6e58f9442b7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1389 microversion: 2.1 time: 0.194902 Aug 27 06:10:23.489810 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3909/7826] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:23 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1389 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:24.509862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=10 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:10:24.515381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9a5cedb4-d645-464c-ab73-f458d218e20f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:24.516092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9a5cedb4-d645-464c-ab73-f458d218e20f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:24.522545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5cedb4-d645-464c-ab73-f458d218e20f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:24.523024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5cedb4-d645-464c-ab73-f458d218e20f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:24.523530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5cedb4-d645-464c-ab73-f458d218e20f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:24.524229 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5cedb4-d645-464c-ab73-f458d218e20f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:24.524693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5cedb4-d645-464c-ab73-f458d218e20f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:24.525116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9a5cedb4-d645-464c-ab73-f458d218e20f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:24.670083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9a5cedb4-d645-464c-ab73-f458d218e20f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:24.678335 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9a5cedb4-d645-464c-ab73-f458d218e20f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1389 microversion: 2.1 time: 0.169415 Aug 27 06:10:24.678959 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3918/7827] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:24 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:10:25.700007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-440eb3ed-ef87-4654-9b16-d4f975dfd506 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:25.700641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-440eb3ed-ef87-4654-9b16-d4f975dfd506 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:25.707740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-440eb3ed-ef87-4654-9b16-d4f975dfd506 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:25.708255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-440eb3ed-ef87-4654-9b16-d4f975dfd506 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:25.708779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-440eb3ed-ef87-4654-9b16-d4f975dfd506 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:25.709504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-440eb3ed-ef87-4654-9b16-d4f975dfd506 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:25.709979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-440eb3ed-ef87-4654-9b16-d4f975dfd506 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:25.710423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-440eb3ed-ef87-4654-9b16-d4f975dfd506 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:25.854283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-440eb3ed-ef87-4654-9b16-d4f975dfd506 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:25.863009 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-440eb3ed-ef87-4654-9b16-d4f975dfd506 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1561 microversion: 2.1 time: 0.166875 Aug 27 06:10:25.863630 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3910/7828] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:25 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:25.884163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d25cf221-1668-4685-9c03-7a6c05a635b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:25.884788 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d25cf221-1668-4685-9c03-7a6c05a635b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:25.892532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cf221-1668-4685-9c03-7a6c05a635b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:25.893105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cf221-1668-4685-9c03-7a6c05a635b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:25.893547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cf221-1668-4685-9c03-7a6c05a635b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:25.894248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cf221-1668-4685-9c03-7a6c05a635b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:25.894712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cf221-1668-4685-9c03-7a6c05a635b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:25.895170 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d25cf221-1668-4685-9c03-7a6c05a635b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:26.049429 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d25cf221-1668-4685-9c03-7a6c05a635b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:26.056504 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d25cf221-1668-4685-9c03-7a6c05a635b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1561 microversion: 2.1 time: 0.176258 Aug 27 06:10:26.057085 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3919/7829] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:25 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:10:27.755580 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df1a6edb-c080-42f6-9b55-2e1542434d99 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:10:27.756227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-df1a6edb-c080-42f6-9b55-2e1542434d99 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:10:27.759932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-4573821b-bae8-49df-8951-5c78c72b3495 req-30930b66-9a38-4e8a-92c6-306084420f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84925c39-ff74-449b-9002-bf97395a2fa4", "tag": "201578e6-3592-4022-a56f-aae1cc1d2266"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:10:27.764547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df1a6edb-c080-42f6-9b55-2e1542434d99 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:27.765340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df1a6edb-c080-42f6-9b55-2e1542434d99 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:27.766031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df1a6edb-c080-42f6-9b55-2e1542434d99 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:27.766988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df1a6edb-c080-42f6-9b55-2e1542434d99 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:27.767702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df1a6edb-c080-42f6-9b55-2e1542434d99 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:27.768359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df1a6edb-c080-42f6-9b55-2e1542434d99 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:27.773281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4573821b-bae8-49df-8951-5c78c72b3495 req-30930b66-9a38-4e8a-92c6-306084420f25 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:10:27.773699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4573821b-bae8-49df-8951-5c78c72b3495 req-30930b66-9a38-4e8a-92c6-306084420f25 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:10:27.774281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-4573821b-bae8-49df-8951-5c78c72b3495 req-30930b66-9a38-4e8a-92c6-306084420f25 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:10:27.788653 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-4573821b-bae8-49df-8951-5c78c72b3495 req-30930b66-9a38-4e8a-92c6-306084420f25 service nova] Creating event network-changed:201578e6-3592-4022-a56f-aae1cc1d2266 for instance 84925c39-ff74-449b-9002-bf97395a2fa4 on n-h2-820368-35 Aug 27 06:10:27.796084 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-4573821b-bae8-49df-8951-5c78c72b3495 req-30930b66-9a38-4e8a-92c6-306084420f25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040353 Aug 27 06:10:27.801408 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3920/7830] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:10:27.943212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df1a6edb-c080-42f6-9b55-2e1542434d99 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:10:27.953384 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df1a6edb-c080-42f6-9b55-2e1542434d99 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1561 microversion: 2.1 time: 0.201646 Aug 27 06:10:27.954508 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3911/7831] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:10:27 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1561 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:11:03.288802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:11:03.289551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=38 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:11:03.295375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-87f01baa-f2fa-4081-8fe2-6580fdeda53c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:11:03.297671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-87f01baa-f2fa-4081-8fe2-6580fdeda53c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:03.305882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f01baa-f2fa-4081-8fe2-6580fdeda53c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:03.306696 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f01baa-f2fa-4081-8fe2-6580fdeda53c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:03.307331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f01baa-f2fa-4081-8fe2-6580fdeda53c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:03.308048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f01baa-f2fa-4081-8fe2-6580fdeda53c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:03.308518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f01baa-f2fa-4081-8fe2-6580fdeda53c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:03.308951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-87f01baa-f2fa-4081-8fe2-6580fdeda53c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:03.368676 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-87f01baa-f2fa-4081-8fe2-6580fdeda53c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4/action" status: 200 len: 24559 microversion: 2.1 time: 0.082103 Aug 27 06:11:03.369708 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3921/7832] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:11:03 2022] POST /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4/action => generated 24559 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:11:42.358976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:11:42.359867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=42 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:11:42.364059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b082f66c-3c5d-4fba-b56f-8858bfc3f575 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:11:42.364604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b082f66c-3c5d-4fba-b56f-8858bfc3f575 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:42.372165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b082f66c-3c5d-4fba-b56f-8858bfc3f575 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:42.372671 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b082f66c-3c5d-4fba-b56f-8858bfc3f575 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:42.373115 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b082f66c-3c5d-4fba-b56f-8858bfc3f575 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:42.373824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b082f66c-3c5d-4fba-b56f-8858bfc3f575 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:42.374287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b082f66c-3c5d-4fba-b56f-8858bfc3f575 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:42.374724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b082f66c-3c5d-4fba-b56f-8858bfc3f575 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:42.444841 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b082f66c-3c5d-4fba-b56f-8858bfc3f575 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4/action" status: 202 len: 0 microversion: 2.1 time: 0.087479 Aug 27 06:11:42.445530 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3912/7833] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:11:42 2022] POST /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:11:42.456235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-616bbb99-71de-4d10-85f9-7ef57b0361b0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:11:42.457557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-616bbb99-71de-4d10-85f9-7ef57b0361b0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:42.460398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:11:42.461132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:11:42.468723 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-616bbb99-71de-4d10-85f9-7ef57b0361b0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:42.469561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-616bbb99-71de-4d10-85f9-7ef57b0361b0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:42.470013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-616bbb99-71de-4d10-85f9-7ef57b0361b0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:42.470724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-616bbb99-71de-4d10-85f9-7ef57b0361b0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:42.471616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-616bbb99-71de-4d10-85f9-7ef57b0361b0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:42.472056 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-616bbb99-71de-4d10-85f9-7ef57b0361b0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:42.736159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-616bbb99-71de-4d10-85f9-7ef57b0361b0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:11:42.744900 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-616bbb99-71de-4d10-85f9-7ef57b0361b0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1685 microversion: 2.1 time: 0.293247 Aug 27 06:11:42.745517 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3922/7834] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:11:42 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1685 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:11:43.763898 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:11:43.764571 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:11:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 (ip 10.222.0.58) !!! Aug 27 06:11:43.769672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-439628d5-b1c7-49a4-b8d8-bb39826cc38d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:11:43.770395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-439628d5-b1c7-49a4-b8d8-bb39826cc38d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:43.779449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-439628d5-b1c7-49a4-b8d8-bb39826cc38d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:43.779961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-439628d5-b1c7-49a4-b8d8-bb39826cc38d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:43.780413 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-439628d5-b1c7-49a4-b8d8-bb39826cc38d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:43.781139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-439628d5-b1c7-49a4-b8d8-bb39826cc38d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:43.781612 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-439628d5-b1c7-49a4-b8d8-bb39826cc38d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:43.782059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-439628d5-b1c7-49a4-b8d8-bb39826cc38d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:43.983024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-439628d5-b1c7-49a4-b8d8-bb39826cc38d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:11:43.991240 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-439628d5-b1c7-49a4-b8d8-bb39826cc38d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1665 microversion: 2.1 time: 0.228787 Aug 27 06:11:43.991890 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3913/7835] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:11:43 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1665 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:11:45.095289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-febe36fa-7e7d-422e-92ed-8b1099e579a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:11:45.097403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-febe36fa-7e7d-422e-92ed-8b1099e579a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:45.105490 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febe36fa-7e7d-422e-92ed-8b1099e579a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:45.105980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febe36fa-7e7d-422e-92ed-8b1099e579a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:45.106424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febe36fa-7e7d-422e-92ed-8b1099e579a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:45.107155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febe36fa-7e7d-422e-92ed-8b1099e579a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:45.107611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febe36fa-7e7d-422e-92ed-8b1099e579a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:45.108038 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-febe36fa-7e7d-422e-92ed-8b1099e579a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:45.166216 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-febe36fa-7e7d-422e-92ed-8b1099e579a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4/action" status: 200 len: 32631 microversion: 2.1 time: 0.074788 Aug 27 06:11:45.166916 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3923/7836] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:11:45 2022] POST /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4/action => generated 32631 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:11:45.180122 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cd8090b5-d848-490b-885a-87bb1ef52459 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:11:45.180687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cd8090b5-d848-490b-885a-87bb1ef52459 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:45.188307 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd8090b5-d848-490b-885a-87bb1ef52459 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:45.188811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd8090b5-d848-490b-885a-87bb1ef52459 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:45.189265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd8090b5-d848-490b-885a-87bb1ef52459 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:45.189998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd8090b5-d848-490b-885a-87bb1ef52459 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:45.190460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd8090b5-d848-490b-885a-87bb1ef52459 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:45.190900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cd8090b5-d848-490b-885a-87bb1ef52459 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:45.261367 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cd8090b5-d848-490b-885a-87bb1ef52459 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4/action" status: 202 len: 0 microversion: 2.1 time: 0.085495 Aug 27 06:11:45.262954 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3914/7837] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:11:45 2022] POST /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:11:45.271218 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c96f2639-aa68-439d-8fc2-7a7901d377aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:11:45.271945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c96f2639-aa68-439d-8fc2-7a7901d377aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:45.279390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96f2639-aa68-439d-8fc2-7a7901d377aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:45.279887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96f2639-aa68-439d-8fc2-7a7901d377aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:45.280331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96f2639-aa68-439d-8fc2-7a7901d377aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:45.281406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96f2639-aa68-439d-8fc2-7a7901d377aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:45.281742 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96f2639-aa68-439d-8fc2-7a7901d377aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:45.282204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c96f2639-aa68-439d-8fc2-7a7901d377aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:45.419484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c96f2639-aa68-439d-8fc2-7a7901d377aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:11:45.430098 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c96f2639-aa68-439d-8fc2-7a7901d377aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1672 microversion: 2.1 time: 0.163427 Aug 27 06:11:45.430889 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3924/7838] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:11:45 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:11:46.454565 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c19c4909-8d77-400e-86a2-f4da77421bc5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:11:46.455321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c19c4909-8d77-400e-86a2-f4da77421bc5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:46.462733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c19c4909-8d77-400e-86a2-f4da77421bc5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:46.463292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c19c4909-8d77-400e-86a2-f4da77421bc5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:46.464052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c19c4909-8d77-400e-86a2-f4da77421bc5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:46.465060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c19c4909-8d77-400e-86a2-f4da77421bc5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:46.465537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c19c4909-8d77-400e-86a2-f4da77421bc5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:46.465982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c19c4909-8d77-400e-86a2-f4da77421bc5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:46.609566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c19c4909-8d77-400e-86a2-f4da77421bc5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:11:46.617951 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c19c4909-8d77-400e-86a2-f4da77421bc5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1680 microversion: 2.1 time: 0.168480 Aug 27 06:11:46.618526 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3915/7839] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:11:46 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:11:46.712477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f1971d84-fef1-4cf6-9320-04067a9dbd0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:11:46.715464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f1971d84-fef1-4cf6-9320-04067a9dbd0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:46.725658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1971d84-fef1-4cf6-9320-04067a9dbd0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:46.726152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1971d84-fef1-4cf6-9320-04067a9dbd0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:46.726592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1971d84-fef1-4cf6-9320-04067a9dbd0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:46.727391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1971d84-fef1-4cf6-9320-04067a9dbd0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:46.727848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1971d84-fef1-4cf6-9320-04067a9dbd0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:46.728277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f1971d84-fef1-4cf6-9320-04067a9dbd0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:46.782370 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f1971d84-fef1-4cf6-9320-04067a9dbd0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4/action" status: 200 len: 38432 microversion: 2.1 time: 0.073808 Aug 27 06:11:46.783079 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3925/7840] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:11:46 2022] POST /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4/action => generated 38432 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:11:47.835590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf8805f4-4b8e-4471-9dea-4f5c2d71a829 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:11:47.836277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf8805f4-4b8e-4471-9dea-4f5c2d71a829 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:47.844051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf8805f4-4b8e-4471-9dea-4f5c2d71a829 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:47.844855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf8805f4-4b8e-4471-9dea-4f5c2d71a829 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:47.845666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf8805f4-4b8e-4471-9dea-4f5c2d71a829 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:47.846927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf8805f4-4b8e-4471-9dea-4f5c2d71a829 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:47.847726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf8805f4-4b8e-4471-9dea-4f5c2d71a829 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:47.848398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf8805f4-4b8e-4471-9dea-4f5c2d71a829 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:47.913050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf8805f4-4b8e-4471-9dea-4f5c2d71a829 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:11:47.971561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-36bde0cd-5a55-4fd7-a119-7c66a91be76b req-cca34dfe-899e-47b9-9e8b-d808d2a5dbdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84925c39-ff74-449b-9002-bf97395a2fa4", "tag": "201578e6-3592-4022-a56f-aae1cc1d2266"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:11:48.007703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-36bde0cd-5a55-4fd7-a119-7c66a91be76b req-cca34dfe-899e-47b9-9e8b-d808d2a5dbdf service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:48.008199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-36bde0cd-5a55-4fd7-a119-7c66a91be76b req-cca34dfe-899e-47b9-9e8b-d808d2a5dbdf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:48.008642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-36bde0cd-5a55-4fd7-a119-7c66a91be76b req-cca34dfe-899e-47b9-9e8b-d808d2a5dbdf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:48.060350 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-36bde0cd-5a55-4fd7-a119-7c66a91be76b req-cca34dfe-899e-47b9-9e8b-d808d2a5dbdf service nova] Creating event network-changed:201578e6-3592-4022-a56f-aae1cc1d2266 for instance 84925c39-ff74-449b-9002-bf97395a2fa4 on n-h2-820368-35 Aug 27 06:11:48.082361 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-36bde0cd-5a55-4fd7-a119-7c66a91be76b req-cca34dfe-899e-47b9-9e8b-d808d2a5dbdf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233710 Aug 27 06:11:48.090791 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3926/7841] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:11:48.100760 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf8805f4-4b8e-4471-9dea-4f5c2d71a829 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "DELETE /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 204 len: 0 microversion: 2.1 time: 0.268486 Aug 27 06:11:48.102646 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3916/7842] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:11:47 2022] DELETE /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:11:48.115173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cbaeb83e-aa04-4185-948a-961cf0f7c475 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:11:48.117652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cbaeb83e-aa04-4185-948a-961cf0f7c475 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:48.128075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbaeb83e-aa04-4185-948a-961cf0f7c475 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:48.128810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbaeb83e-aa04-4185-948a-961cf0f7c475 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:48.129954 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbaeb83e-aa04-4185-948a-961cf0f7c475 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:48.131318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbaeb83e-aa04-4185-948a-961cf0f7c475 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:48.131953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbaeb83e-aa04-4185-948a-961cf0f7c475 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:48.136520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cbaeb83e-aa04-4185-948a-961cf0f7c475 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:48.291357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cbaeb83e-aa04-4185-948a-961cf0f7c475 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:11:48.299531 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cbaeb83e-aa04-4185-948a-961cf0f7c475 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1686 microversion: 2.1 time: 0.189386 Aug 27 06:11:48.300113 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3927/7843] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:11:48 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1686 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:11:49.324259 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7419fdb5-bf33-452c-8715-56975f1c9354 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:11:49.324878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7419fdb5-bf33-452c-8715-56975f1c9354 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:49.332229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7419fdb5-bf33-452c-8715-56975f1c9354 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:49.332727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7419fdb5-bf33-452c-8715-56975f1c9354 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:49.333179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7419fdb5-bf33-452c-8715-56975f1c9354 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:49.333896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7419fdb5-bf33-452c-8715-56975f1c9354 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:49.334366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7419fdb5-bf33-452c-8715-56975f1c9354 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:49.334808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7419fdb5-bf33-452c-8715-56975f1c9354 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:49.474605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7419fdb5-bf33-452c-8715-56975f1c9354 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:11:49.490933 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7419fdb5-bf33-452c-8715-56975f1c9354 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1686 microversion: 2.1 time: 0.170912 Aug 27 06:11:49.491556 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3917/7844] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:11:49 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:11:50.368972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-d55c9022-6531-4195-babb-e99d62921736 req-99e8f921-2bb6-4bef-8150-4a638b648e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84925c39-ff74-449b-9002-bf97395a2fa4", "name": "network-vif-deleted", "tag": "201578e6-3592-4022-a56f-aae1cc1d2266"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:11:50.384392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d55c9022-6531-4195-babb-e99d62921736 req-99e8f921-2bb6-4bef-8150-4a638b648e63 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:50.384884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d55c9022-6531-4195-babb-e99d62921736 req-99e8f921-2bb6-4bef-8150-4a638b648e63 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:50.385357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-d55c9022-6531-4195-babb-e99d62921736 req-99e8f921-2bb6-4bef-8150-4a638b648e63 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:50.398540 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-d55c9022-6531-4195-babb-e99d62921736 req-99e8f921-2bb6-4bef-8150-4a638b648e63 service nova] Creating event network-vif-deleted:201578e6-3592-4022-a56f-aae1cc1d2266 for instance 84925c39-ff74-449b-9002-bf97395a2fa4 on n-h2-820368-35 Aug 27 06:11:50.405354 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-d55c9022-6531-4195-babb-e99d62921736 req-99e8f921-2bb6-4bef-8150-4a638b648e63 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049002 Aug 27 06:11:50.406196 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3928/7845] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:11:50.513242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:11:50.517993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:50.525283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:50.525779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:50.526775 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:50.527728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:50.528199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:50.528674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:50.563747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:50.564245 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:50.564698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:50.565164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lazy-loading 'fault' on Instance uuid 84925c39-ff74-449b-9002-bf97395a2fa4 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:11:50.608869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:11:50.617056 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-adbb7f68-b670-4295-a5f8-b77440c5de7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 200 len: 1355 microversion: 2.1 time: 0.107890 Aug 27 06:11:50.620880 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3918/7846] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:11:50 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 1355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:11:51.640507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:11:51.641214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 84925c39-ff74-449b-9002-bf97395a2fa4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:11:51.647528 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:51.648020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:51.648457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:51.649161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:11:51.649619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:11:51.650046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:11:51.663924 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] HTTP exception thrown: Instance 84925c39-ff74-449b-9002-bf97395a2fa4 could not be found. Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Request method failure captured: Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 HTTP/1.1 Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbU6aB_e75aqp8NqqqVAdR5aTLA1Q6hTA4TQG7g4UP-wugXdWdOQbKYZdiF7Eb_yQ2RNMIFzHOe9xBFRey4TYo5y377lxnb_8a1DEXSy6GAWG-hMmKOxzfz8KSOhJR9A4wcCgVgXBokca2F0ylnOdGjNKOJhU5qnilgI35mBzwauMaI Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: f100645ec41f471bad7489ea8fbcbaf0 Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f100645ec41f471bad7489ea8fbcbaf0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: f100645ec41f471bad7489ea8fbcbaf0 Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestNetworkAdvancedServerOps-38834833-project Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 52d1f89be8a74799b32e239ff34959c2 Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestNetworkAdvancedServerOps-38834833-project Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 84925c39-ff74-449b-9002-bf97395a2fa4 could not be found. Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '84925c39-ff74-449b-9002-bf97395a2fa4'} Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84925c39-ff74-449b-9002-bf97395a2fa4 could not be found. Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84925c39-ff74-449b-9002-bf97395a2fa4 could not be found. Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:11:51.665655 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:11:51.671062 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:11:51.671062 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:11:51.671062 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:11:51.671062 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:11:51.671062 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:11:51.671062 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:11:51.671062 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84925c39-ff74-449b-9002-bf97395a2fa4 could not be found. Aug 27 06:11:51.671062 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:11:51.671062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Returning 404 to user: Instance 84925c39-ff74-449b-9002-bf97395a2fa4 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:11:51.671062 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4de97181-15a1-412b-b8ee-899c4bf56c0d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4" status: 404 len: 111 microversion: 2.1 time: 0.031733 Aug 27 06:11:51.671062 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3929/7847] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:11:51 2022] GET /compute/v2.1/servers/84925c39-ff74-449b-9002-bf97395a2fa4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:11:55.217056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-087422af-f8d0-4471-9c4a-d98707c22c26 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '.version_select at 0x7fb564904700>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:11:55.244907 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-087422af-f8d0-4471-9c4a-d98707c22c26 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-656947933" status: 202 len: 0 microversion: 2.1 time: 0.032311 Aug 27 06:11:55.245790 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3919/7848] 10.222.0.58 () {58 vars in 1281 bytes} [Sat Aug 27 06:11:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-656947933 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:11:55.272509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bbaa71dc-f8f7-4c1e-aca7-cbb1ed971beb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'create', calling method: .version_select at 0x7fb5640e80d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-596386634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbBsoJyJO2bPi+4P0z0yivsLjiOUFOyRYQeUrN1+Cegl2MDk5jLDb3I7cvgwsTesTj83Z/OgacW55fYkGl6UwZu6pGhctWRzEclVmjh+P8fNVcioNrVxFG/X33Cyqs3FQ=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:11:55.292208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bbaa71dc-f8f7-4c1e-aca7-cbb1ed971beb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:11:55.298035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-bbaa71dc-f8f7-4c1e-aca7-cbb1ed971beb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for user 52d1f89be8a74799b32e239ff34959c2 and project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:11:55.324861 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bbaa71dc-f8f7-4c1e-aca7-cbb1ed971beb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056639 Aug 27 06:11:55.325575 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3930/7849] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 06:11:55 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:12:01.223282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:01.228548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1971666131", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "ffde212e-15f7-410f-bdca-58a1cd105858"}], "key_name": "tempest-TestNetworkAdvancedServerOps-596386634", "security_groups": [{"name": "tempest-secgroup-smoke-1288431610"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:01.368684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] validate_networks() for [('ffde212e-15f7-410f-bdca-58a1cd105858', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:12:02.123710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:12:02.124421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:12:02.125076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:12:02.125662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:12:02.126536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:12:02.147187 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:02.148501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:02.149356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:02.153455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:02.154298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:02.154930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:02.197091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:12:02.205011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for user 52d1f89be8a74799b32e239ff34959c2 and project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:12:02.226575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:12:02.236729 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:12:02.318905 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-00a2b29b-7001-4e27-a4de-2e703a943c41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.097251 Aug 27 06:12:02.326114 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3920/7850] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:12:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:12:02.329407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=32 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:02.334010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4962b21c-d19e-4b2c-adfa-58b32e6afc51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:02.334645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4962b21c-d19e-4b2c-adfa-58b32e6afc51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:02.427779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4962b21c-d19e-4b2c-adfa-58b32e6afc51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:02.439800 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4962b21c-d19e-4b2c-adfa-58b32e6afc51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1266 microversion: 2.1 time: 0.111927 Aug 27 06:12:02.441784 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3931/7851] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:02 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:03.465258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-708a1134-5acf-473a-8038-ff95e5d1af41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:03.466167 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-708a1134-5acf-473a-8038-ff95e5d1af41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:03.475366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-708a1134-5acf-473a-8038-ff95e5d1af41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:03.476141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-708a1134-5acf-473a-8038-ff95e5d1af41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:03.476804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-708a1134-5acf-473a-8038-ff95e5d1af41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:03.477702 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-708a1134-5acf-473a-8038-ff95e5d1af41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:03.478326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-708a1134-5acf-473a-8038-ff95e5d1af41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:03.479621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-708a1134-5acf-473a-8038-ff95e5d1af41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:03.564849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-708a1134-5acf-473a-8038-ff95e5d1af41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:03.574439 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-708a1134-5acf-473a-8038-ff95e5d1af41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1318 microversion: 2.1 time: 0.115414 Aug 27 06:12:03.575992 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3921/7852] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:03 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:04.595712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-55c8b79e-3479-47e3-9fb8-76a595a3abfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:04.596343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-55c8b79e-3479-47e3-9fb8-76a595a3abfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:04.611180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55c8b79e-3479-47e3-9fb8-76a595a3abfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:04.612664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55c8b79e-3479-47e3-9fb8-76a595a3abfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:04.613614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55c8b79e-3479-47e3-9fb8-76a595a3abfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:04.628034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55c8b79e-3479-47e3-9fb8-76a595a3abfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:04.628741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55c8b79e-3479-47e3-9fb8-76a595a3abfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:04.630509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-55c8b79e-3479-47e3-9fb8-76a595a3abfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:04.889236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-55c8b79e-3479-47e3-9fb8-76a595a3abfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:04.897666 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-55c8b79e-3479-47e3-9fb8-76a595a3abfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1392 microversion: 2.1 time: 0.305620 Aug 27 06:12:04.911432 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3932/7853] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:04 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1392 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:05.575380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4c95e2d3-fc90-4fc7-94b5-030dadcc696f req-018c4f1e-3cd2-4334-a12a-f0da31be4733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4e57b0-4ecc-4667-bc7e-7b74b45980a6", "tag": "4e50ba6d-fa5f-4ace-b250-4b30c65b2cb3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:05.587151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4c95e2d3-fc90-4fc7-94b5-030dadcc696f req-018c4f1e-3cd2-4334-a12a-f0da31be4733 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:05.587863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4c95e2d3-fc90-4fc7-94b5-030dadcc696f req-018c4f1e-3cd2-4334-a12a-f0da31be4733 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:05.590050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4c95e2d3-fc90-4fc7-94b5-030dadcc696f req-018c4f1e-3cd2-4334-a12a-f0da31be4733 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:05.605395 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4c95e2d3-fc90-4fc7-94b5-030dadcc696f req-018c4f1e-3cd2-4334-a12a-f0da31be4733 service nova] Creating event network-changed:4e50ba6d-fa5f-4ace-b250-4b30c65b2cb3 for instance 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 on n-h1-820368-35 Aug 27 06:12:05.611694 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4c95e2d3-fc90-4fc7-94b5-030dadcc696f req-018c4f1e-3cd2-4334-a12a-f0da31be4733 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132483 Aug 27 06:12:05.612860 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3922/7854] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:12:05.919478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d1d41d1-0e02-4e22-b50e-16478871b423 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:05.920207 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d1d41d1-0e02-4e22-b50e-16478871b423 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:05.928183 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1d41d1-0e02-4e22-b50e-16478871b423 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:05.929097 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1d41d1-0e02-4e22-b50e-16478871b423 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:05.929815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1d41d1-0e02-4e22-b50e-16478871b423 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:05.930912 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1d41d1-0e02-4e22-b50e-16478871b423 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:05.931379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1d41d1-0e02-4e22-b50e-16478871b423 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:05.932035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d1d41d1-0e02-4e22-b50e-16478871b423 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:06.118295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8d1d41d1-0e02-4e22-b50e-16478871b423 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:06.126993 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d1d41d1-0e02-4e22-b50e-16478871b423 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1392 microversion: 2.1 time: 0.211406 Aug 27 06:12:06.127559 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3933/7855] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:05 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:07.149081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e411850e-8d8d-404b-98a5-ead8de578da3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:07.149805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e411850e-8d8d-404b-98a5-ead8de578da3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:07.157545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e411850e-8d8d-404b-98a5-ead8de578da3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:07.158061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e411850e-8d8d-404b-98a5-ead8de578da3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:07.158522 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e411850e-8d8d-404b-98a5-ead8de578da3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:07.159284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e411850e-8d8d-404b-98a5-ead8de578da3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:07.159763 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e411850e-8d8d-404b-98a5-ead8de578da3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:07.160213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e411850e-8d8d-404b-98a5-ead8de578da3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:07.299359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e411850e-8d8d-404b-98a5-ead8de578da3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:07.307595 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e411850e-8d8d-404b-98a5-ead8de578da3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1392 microversion: 2.1 time: 0.162650 Aug 27 06:12:07.308119 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3923/7856] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:07 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:08.330047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-33334a09-0f44-4dea-a0bf-96dc4c16e5fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:08.331534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-33334a09-0f44-4dea-a0bf-96dc4c16e5fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:08.338627 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33334a09-0f44-4dea-a0bf-96dc4c16e5fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:08.339670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33334a09-0f44-4dea-a0bf-96dc4c16e5fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:08.340129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33334a09-0f44-4dea-a0bf-96dc4c16e5fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:08.341029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33334a09-0f44-4dea-a0bf-96dc4c16e5fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:08.341653 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33334a09-0f44-4dea-a0bf-96dc4c16e5fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:08.342289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-33334a09-0f44-4dea-a0bf-96dc4c16e5fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:08.559277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-33334a09-0f44-4dea-a0bf-96dc4c16e5fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:08.567458 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-33334a09-0f44-4dea-a0bf-96dc4c16e5fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1392 microversion: 2.1 time: 0.242318 Aug 27 06:12:08.568063 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3934/7857] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:08 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:09.590968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0dbb8f2d-4a5e-4004-8a61-04f73b79caad tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:09.591651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0dbb8f2d-4a5e-4004-8a61-04f73b79caad tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:09.602050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dbb8f2d-4a5e-4004-8a61-04f73b79caad tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:09.603828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dbb8f2d-4a5e-4004-8a61-04f73b79caad tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:09.604455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dbb8f2d-4a5e-4004-8a61-04f73b79caad tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:09.605184 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dbb8f2d-4a5e-4004-8a61-04f73b79caad tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:09.605649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dbb8f2d-4a5e-4004-8a61-04f73b79caad tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:09.606276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0dbb8f2d-4a5e-4004-8a61-04f73b79caad tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:09.752704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0dbb8f2d-4a5e-4004-8a61-04f73b79caad tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:09.761599 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0dbb8f2d-4a5e-4004-8a61-04f73b79caad tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1392 microversion: 2.1 time: 0.175292 Aug 27 06:12:09.762322 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3924/7858] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:09 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:10.782477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc6add3b-10b7-4692-aaef-22088e2d74b5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:10.783125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cc6add3b-10b7-4692-aaef-22088e2d74b5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:10.790217 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc6add3b-10b7-4692-aaef-22088e2d74b5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:10.790747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc6add3b-10b7-4692-aaef-22088e2d74b5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:10.791265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc6add3b-10b7-4692-aaef-22088e2d74b5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:10.792530 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc6add3b-10b7-4692-aaef-22088e2d74b5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:10.792987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc6add3b-10b7-4692-aaef-22088e2d74b5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:10.793420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc6add3b-10b7-4692-aaef-22088e2d74b5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:10.943892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cc6add3b-10b7-4692-aaef-22088e2d74b5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:10.952677 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cc6add3b-10b7-4692-aaef-22088e2d74b5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1392 microversion: 2.1 time: 0.174049 Aug 27 06:12:10.953269 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3935/7859] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:10 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:11.094007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-1c1783b6-1692-44f8-948f-72bdf7352db8 req-00733e9b-d323-4923-a004-3220025bbe10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4e57b0-4ecc-4667-bc7e-7b74b45980a6", "name": "network-vif-plugged", "status": "completed", "tag": "4e50ba6d-fa5f-4ace-b250-4b30c65b2cb3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:11.104533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1c1783b6-1692-44f8-948f-72bdf7352db8 req-00733e9b-d323-4923-a004-3220025bbe10 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:11.105027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1c1783b6-1692-44f8-948f-72bdf7352db8 req-00733e9b-d323-4923-a004-3220025bbe10 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:11.105472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-1c1783b6-1692-44f8-948f-72bdf7352db8 req-00733e9b-d323-4923-a004-3220025bbe10 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:11.116641 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-1c1783b6-1692-44f8-948f-72bdf7352db8 req-00733e9b-d323-4923-a004-3220025bbe10 service nova] Creating event network-vif-plugged:4e50ba6d-fa5f-4ace-b250-4b30c65b2cb3 for instance 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 on n-h1-820368-35 Aug 27 06:12:11.122339 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-1c1783b6-1692-44f8-948f-72bdf7352db8 req-00733e9b-d323-4923-a004-3220025bbe10 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103792 Aug 27 06:12:11.122938 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3925/7860] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:12:11.973420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7e701ab1-6f1d-4567-8a0c-b1401361964d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:11.974046 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7e701ab1-6f1d-4567-8a0c-b1401361964d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:11.981039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e701ab1-6f1d-4567-8a0c-b1401361964d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:11.981536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e701ab1-6f1d-4567-8a0c-b1401361964d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:11.981980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e701ab1-6f1d-4567-8a0c-b1401361964d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:11.982692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e701ab1-6f1d-4567-8a0c-b1401361964d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:11.983213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e701ab1-6f1d-4567-8a0c-b1401361964d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:11.983657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7e701ab1-6f1d-4567-8a0c-b1401361964d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:12.127689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7e701ab1-6f1d-4567-8a0c-b1401361964d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:12.135836 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7e701ab1-6f1d-4567-8a0c-b1401361964d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1392 microversion: 2.1 time: 0.166509 Aug 27 06:12:12.136418 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3936/7861] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:11 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:13.155638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:13.157013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:13.162314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e3410704-b7a4-4da0-9ce3-be73f2a5a0bd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:13.162965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e3410704-b7a4-4da0-9ce3-be73f2a5a0bd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:13.164856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:13.172364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3410704-b7a4-4da0-9ce3-be73f2a5a0bd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:13.172902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3410704-b7a4-4da0-9ce3-be73f2a5a0bd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:13.173349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3410704-b7a4-4da0-9ce3-be73f2a5a0bd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:13.174062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3410704-b7a4-4da0-9ce3-be73f2a5a0bd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:13.174527 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3410704-b7a4-4da0-9ce3-be73f2a5a0bd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:13.174962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e3410704-b7a4-4da0-9ce3-be73f2a5a0bd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:13.315337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e3410704-b7a4-4da0-9ce3-be73f2a5a0bd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:13.323531 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e3410704-b7a4-4da0-9ce3-be73f2a5a0bd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1562 microversion: 2.1 time: 0.169668 Aug 27 06:12:13.324108 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3926/7862] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:13 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:13.343901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ae6e6b36-5463-42a7-8fb8-0059d337e486 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:13.344564 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ae6e6b36-5463-42a7-8fb8-0059d337e486 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:13.346467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:13.347966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:13.354367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e6b36-5463-42a7-8fb8-0059d337e486 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:13.354864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e6b36-5463-42a7-8fb8-0059d337e486 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:13.355363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e6b36-5463-42a7-8fb8-0059d337e486 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:13.356083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e6b36-5463-42a7-8fb8-0059d337e486 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:13.356544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e6b36-5463-42a7-8fb8-0059d337e486 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:13.356983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ae6e6b36-5463-42a7-8fb8-0059d337e486 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:13.498753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ae6e6b36-5463-42a7-8fb8-0059d337e486 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:13.506930 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ae6e6b36-5463-42a7-8fb8-0059d337e486 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1562 microversion: 2.1 time: 0.167024 Aug 27 06:12:13.507542 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3937/7863] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:13 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:15.444388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-7ae38869-26b7-4986-9930-23ee27eb7a0a req-c6637b84-3fd3-4e04-86d1-c51f5a89373a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4e57b0-4ecc-4667-bc7e-7b74b45980a6", "tag": "4e50ba6d-fa5f-4ace-b250-4b30c65b2cb3"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:15.445058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d90764b-726e-465c-890b-f19f858f62c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:15.445058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7d90764b-726e-465c-890b-f19f858f62c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:15.453603 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d90764b-726e-465c-890b-f19f858f62c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:15.454106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d90764b-726e-465c-890b-f19f858f62c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:15.454568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d90764b-726e-465c-890b-f19f858f62c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:15.456255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d90764b-726e-465c-890b-f19f858f62c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:15.457032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d90764b-726e-465c-890b-f19f858f62c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:15.457493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d90764b-726e-465c-890b-f19f858f62c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:15.459010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7ae38869-26b7-4986-9930-23ee27eb7a0a req-c6637b84-3fd3-4e04-86d1-c51f5a89373a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:15.459730 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7ae38869-26b7-4986-9930-23ee27eb7a0a req-c6637b84-3fd3-4e04-86d1-c51f5a89373a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:15.460588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-7ae38869-26b7-4986-9930-23ee27eb7a0a req-c6637b84-3fd3-4e04-86d1-c51f5a89373a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:15.485196 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-7ae38869-26b7-4986-9930-23ee27eb7a0a req-c6637b84-3fd3-4e04-86d1-c51f5a89373a service nova] Creating event network-changed:4e50ba6d-fa5f-4ace-b250-4b30c65b2cb3 for instance 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 on n-h1-820368-35 Aug 27 06:12:15.490861 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-7ae38869-26b7-4986-9930-23ee27eb7a0a req-c6637b84-3fd3-4e04-86d1-c51f5a89373a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050141 Aug 27 06:12:15.491626 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3938/7864] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:12:15.732412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7d90764b-726e-465c-890b-f19f858f62c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:15.743205 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7d90764b-726e-465c-890b-f19f858f62c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1562 microversion: 2.1 time: 0.302540 Aug 27 06:12:15.745080 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3927/7865] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:15 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1562 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:51.060293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c172f7f-519a-4d43-9211-0526ae81b012 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:51.062630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c172f7f-519a-4d43-9211-0526ae81b012 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:51.065385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:51.066049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=38 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:51.073410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c172f7f-519a-4d43-9211-0526ae81b012 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:51.073915 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c172f7f-519a-4d43-9211-0526ae81b012 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:51.074364 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c172f7f-519a-4d43-9211-0526ae81b012 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:51.075168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c172f7f-519a-4d43-9211-0526ae81b012 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:51.075670 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c172f7f-519a-4d43-9211-0526ae81b012 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:51.076110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c172f7f-519a-4d43-9211-0526ae81b012 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:51.151946 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c172f7f-519a-4d43-9211-0526ae81b012 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6/action" status: 200 len: 24568 microversion: 2.1 time: 0.096734 Aug 27 06:12:51.152715 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3939/7866] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:12:51 2022] POST /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6/action => generated 24568 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:13:29.943713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:13:29.944512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=36 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:13:29.950049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad8193b9-5841-4262-8ebd-ebb69829cc27 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:13:29.952421 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ad8193b9-5841-4262-8ebd-ebb69829cc27 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:29.959462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad8193b9-5841-4262-8ebd-ebb69829cc27 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:29.959967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad8193b9-5841-4262-8ebd-ebb69829cc27 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:29.960426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad8193b9-5841-4262-8ebd-ebb69829cc27 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:29.961148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad8193b9-5841-4262-8ebd-ebb69829cc27 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:29.961621 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad8193b9-5841-4262-8ebd-ebb69829cc27 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:29.962070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad8193b9-5841-4262-8ebd-ebb69829cc27 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:30.036337 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ad8193b9-5841-4262-8ebd-ebb69829cc27 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6/action" status: 202 len: 0 microversion: 2.1 time: 0.094207 Aug 27 06:13:30.039762 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3928/7867] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:13:29 2022] POST /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:13:30.047784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d5de6d7-4518-4e25-bb94-47415c195422 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:30.049260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d5de6d7-4518-4e25-bb94-47415c195422 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:30.054335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:13:30.055251 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:13:30.060901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5de6d7-4518-4e25-bb94-47415c195422 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:30.061396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5de6d7-4518-4e25-bb94-47415c195422 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:30.061835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5de6d7-4518-4e25-bb94-47415c195422 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:30.062550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5de6d7-4518-4e25-bb94-47415c195422 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:30.063345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5de6d7-4518-4e25-bb94-47415c195422 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:30.063781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d5de6d7-4518-4e25-bb94-47415c195422 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:30.290882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8d5de6d7-4518-4e25-bb94-47415c195422 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:30.300063 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d5de6d7-4518-4e25-bb94-47415c195422 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1673 microversion: 2.1 time: 0.257115 Aug 27 06:13:30.300970 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3940/7868] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:30 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:31.324624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e5833109-3e80-4ae1-8a3f-d0d98a79671b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:31.325365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e5833109-3e80-4ae1-8a3f-d0d98a79671b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:31.332126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5833109-3e80-4ae1-8a3f-d0d98a79671b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:31.332624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5833109-3e80-4ae1-8a3f-d0d98a79671b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:31.333069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5833109-3e80-4ae1-8a3f-d0d98a79671b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:31.333779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5833109-3e80-4ae1-8a3f-d0d98a79671b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:31.334247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5833109-3e80-4ae1-8a3f-d0d98a79671b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:31.334688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e5833109-3e80-4ae1-8a3f-d0d98a79671b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:31.470121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e5833109-3e80-4ae1-8a3f-d0d98a79671b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:31.478662 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e5833109-3e80-4ae1-8a3f-d0d98a79671b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.160050 Aug 27 06:13:31.479478 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3929/7869] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:31 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:32.500691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7d13d639-e164-43cf-a2ad-e8f38ba6f91f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:32.501325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7d13d639-e164-43cf-a2ad-e8f38ba6f91f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:32.504209 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:13:32.504341 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:13:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 (ip 10.222.0.58) !!! Aug 27 06:13:32.517441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d13d639-e164-43cf-a2ad-e8f38ba6f91f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:32.517935 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d13d639-e164-43cf-a2ad-e8f38ba6f91f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:32.518384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d13d639-e164-43cf-a2ad-e8f38ba6f91f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:32.519119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d13d639-e164-43cf-a2ad-e8f38ba6f91f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:32.519587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d13d639-e164-43cf-a2ad-e8f38ba6f91f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:32.520028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7d13d639-e164-43cf-a2ad-e8f38ba6f91f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:32.652895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7d13d639-e164-43cf-a2ad-e8f38ba6f91f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:32.660828 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7d13d639-e164-43cf-a2ad-e8f38ba6f91f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.164073 Aug 27 06:13:32.661432 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3941/7870] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:32 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:33.682074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-43783b60-f8db-4a29-8c6f-1f6f5c8d6ca5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:33.682725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-43783b60-f8db-4a29-8c6f-1f6f5c8d6ca5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:33.689709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43783b60-f8db-4a29-8c6f-1f6f5c8d6ca5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:33.690207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43783b60-f8db-4a29-8c6f-1f6f5c8d6ca5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:33.690748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43783b60-f8db-4a29-8c6f-1f6f5c8d6ca5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:33.691509 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43783b60-f8db-4a29-8c6f-1f6f5c8d6ca5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:33.691974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43783b60-f8db-4a29-8c6f-1f6f5c8d6ca5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:33.692412 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-43783b60-f8db-4a29-8c6f-1f6f5c8d6ca5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:33.829974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-43783b60-f8db-4a29-8c6f-1f6f5c8d6ca5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:33.838443 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-43783b60-f8db-4a29-8c6f-1f6f5c8d6ca5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.160248 Aug 27 06:13:33.839010 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3930/7871] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:33 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:34.859904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-316c913e-0e9d-4b0a-89f4-a1b571e16d4c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:34.860556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-316c913e-0e9d-4b0a-89f4-a1b571e16d4c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:34.867416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-316c913e-0e9d-4b0a-89f4-a1b571e16d4c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:34.867901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-316c913e-0e9d-4b0a-89f4-a1b571e16d4c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:34.868346 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-316c913e-0e9d-4b0a-89f4-a1b571e16d4c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:34.869049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-316c913e-0e9d-4b0a-89f4-a1b571e16d4c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:34.869529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-316c913e-0e9d-4b0a-89f4-a1b571e16d4c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:34.869958 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-316c913e-0e9d-4b0a-89f4-a1b571e16d4c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:35.004777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-316c913e-0e9d-4b0a-89f4-a1b571e16d4c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:35.013282 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-316c913e-0e9d-4b0a-89f4-a1b571e16d4c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.157376 Aug 27 06:13:35.013868 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3942/7872] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:34 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:36.034364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-25e25496-83be-4f52-8275-f69e038c1f13 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:36.035062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25e25496-83be-4f52-8275-f69e038c1f13 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:36.041593 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25e25496-83be-4f52-8275-f69e038c1f13 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:36.042082 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25e25496-83be-4f52-8275-f69e038c1f13 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:36.042528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25e25496-83be-4f52-8275-f69e038c1f13 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:36.043257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25e25496-83be-4f52-8275-f69e038c1f13 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:36.043725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25e25496-83be-4f52-8275-f69e038c1f13 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:36.044164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25e25496-83be-4f52-8275-f69e038c1f13 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:36.176225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-25e25496-83be-4f52-8275-f69e038c1f13 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:36.184299 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-25e25496-83be-4f52-8275-f69e038c1f13 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.153807 Aug 27 06:13:36.184900 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3931/7873] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:36 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:37.208028 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e0f6d04-0943-46d7-86f2-018a9ed98754 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:37.208691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2e0f6d04-0943-46d7-86f2-018a9ed98754 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:37.216402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e0f6d04-0943-46d7-86f2-018a9ed98754 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:37.216892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e0f6d04-0943-46d7-86f2-018a9ed98754 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:37.217335 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e0f6d04-0943-46d7-86f2-018a9ed98754 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:37.218064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e0f6d04-0943-46d7-86f2-018a9ed98754 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:37.218541 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e0f6d04-0943-46d7-86f2-018a9ed98754 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:37.218989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e0f6d04-0943-46d7-86f2-018a9ed98754 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:37.361328 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2e0f6d04-0943-46d7-86f2-018a9ed98754 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:37.370579 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2e0f6d04-0943-46d7-86f2-018a9ed98754 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.167219 Aug 27 06:13:37.372111 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3943/7874] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:37 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:38.394376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d56d2c2-55e7-4d03-9bb1-a9a3e721dad4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:38.394376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d56d2c2-55e7-4d03-9bb1-a9a3e721dad4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:38.400279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d56d2c2-55e7-4d03-9bb1-a9a3e721dad4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:38.400812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d56d2c2-55e7-4d03-9bb1-a9a3e721dad4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:38.401248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d56d2c2-55e7-4d03-9bb1-a9a3e721dad4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:38.401995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d56d2c2-55e7-4d03-9bb1-a9a3e721dad4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:38.402445 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d56d2c2-55e7-4d03-9bb1-a9a3e721dad4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:38.402892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d56d2c2-55e7-4d03-9bb1-a9a3e721dad4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:38.537198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d56d2c2-55e7-4d03-9bb1-a9a3e721dad4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:38.545614 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d56d2c2-55e7-4d03-9bb1-a9a3e721dad4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.157372 Aug 27 06:13:38.546240 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3932/7875] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:38 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:39.568291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-93348be2-2213-4e3e-8567-5f366c56a4aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:39.568909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-93348be2-2213-4e3e-8567-5f366c56a4aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:39.575984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93348be2-2213-4e3e-8567-5f366c56a4aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:39.576470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93348be2-2213-4e3e-8567-5f366c56a4aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:39.576907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93348be2-2213-4e3e-8567-5f366c56a4aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:39.577625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93348be2-2213-4e3e-8567-5f366c56a4aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:39.578145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93348be2-2213-4e3e-8567-5f366c56a4aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:39.578577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93348be2-2213-4e3e-8567-5f366c56a4aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:39.722424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-93348be2-2213-4e3e-8567-5f366c56a4aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:39.731114 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-93348be2-2213-4e3e-8567-5f366c56a4aa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.166790 Aug 27 06:13:39.731783 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3944/7876] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:39 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:40.752998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1d4e919f-20aa-4d84-ae57-e3333964f623 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:40.753606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1d4e919f-20aa-4d84-ae57-e3333964f623 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:40.760906 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d4e919f-20aa-4d84-ae57-e3333964f623 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:40.761666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d4e919f-20aa-4d84-ae57-e3333964f623 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:40.762123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d4e919f-20aa-4d84-ae57-e3333964f623 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:40.762852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d4e919f-20aa-4d84-ae57-e3333964f623 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:40.763372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d4e919f-20aa-4d84-ae57-e3333964f623 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:40.763798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1d4e919f-20aa-4d84-ae57-e3333964f623 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:40.902473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1d4e919f-20aa-4d84-ae57-e3333964f623 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:40.910650 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1d4e919f-20aa-4d84-ae57-e3333964f623 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.161471 Aug 27 06:13:40.911278 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3933/7877] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:40 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:41.933694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f40e5c4-c9fb-4ed8-940c-364344b6c3a8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:41.934314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f40e5c4-c9fb-4ed8-940c-364344b6c3a8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:41.942239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f40e5c4-c9fb-4ed8-940c-364344b6c3a8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:41.942728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f40e5c4-c9fb-4ed8-940c-364344b6c3a8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:41.943273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f40e5c4-c9fb-4ed8-940c-364344b6c3a8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:41.943984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f40e5c4-c9fb-4ed8-940c-364344b6c3a8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:41.944437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f40e5c4-c9fb-4ed8-940c-364344b6c3a8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:41.944869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f40e5c4-c9fb-4ed8-940c-364344b6c3a8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:42.084969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9f40e5c4-c9fb-4ed8-940c-364344b6c3a8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:42.092825 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f40e5c4-c9fb-4ed8-940c-364344b6c3a8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.163668 Aug 27 06:13:42.093393 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3945/7878] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:41 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:43.114013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-98a45f75-e9ac-40cc-a45f-3da8b3924614 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:43.114562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-98a45f75-e9ac-40cc-a45f-3da8b3924614 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:43.121481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98a45f75-e9ac-40cc-a45f-3da8b3924614 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:43.121974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98a45f75-e9ac-40cc-a45f-3da8b3924614 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:43.122431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98a45f75-e9ac-40cc-a45f-3da8b3924614 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:43.123203 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98a45f75-e9ac-40cc-a45f-3da8b3924614 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:43.123678 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98a45f75-e9ac-40cc-a45f-3da8b3924614 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:43.124338 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98a45f75-e9ac-40cc-a45f-3da8b3924614 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:43.256403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-98a45f75-e9ac-40cc-a45f-3da8b3924614 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:43.264867 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-98a45f75-e9ac-40cc-a45f-3da8b3924614 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.154918 Aug 27 06:13:43.265449 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3934/7879] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:43 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:44.288235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2818afd4-8981-4bc5-9da6-7fd0a756af0f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:44.288904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2818afd4-8981-4bc5-9da6-7fd0a756af0f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:44.298280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2818afd4-8981-4bc5-9da6-7fd0a756af0f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:44.298797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2818afd4-8981-4bc5-9da6-7fd0a756af0f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:44.299277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2818afd4-8981-4bc5-9da6-7fd0a756af0f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:44.299987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2818afd4-8981-4bc5-9da6-7fd0a756af0f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:44.300440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2818afd4-8981-4bc5-9da6-7fd0a756af0f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:44.300865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2818afd4-8981-4bc5-9da6-7fd0a756af0f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:44.437349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2818afd4-8981-4bc5-9da6-7fd0a756af0f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:44.445416 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2818afd4-8981-4bc5-9da6-7fd0a756af0f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.162467 Aug 27 06:13:44.446007 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3946/7880] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:44 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:45.466341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7d502217-5b78-4d6b-82ec-024c3c90b9b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:45.467039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7d502217-5b78-4d6b-82ec-024c3c90b9b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:45.474018 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d502217-5b78-4d6b-82ec-024c3c90b9b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:45.474520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d502217-5b78-4d6b-82ec-024c3c90b9b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:45.474976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d502217-5b78-4d6b-82ec-024c3c90b9b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:45.475734 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d502217-5b78-4d6b-82ec-024c3c90b9b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:45.476208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d502217-5b78-4d6b-82ec-024c3c90b9b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:45.476654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7d502217-5b78-4d6b-82ec-024c3c90b9b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:45.615364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7d502217-5b78-4d6b-82ec-024c3c90b9b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:45.623112 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7d502217-5b78-4d6b-82ec-024c3c90b9b1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.161218 Aug 27 06:13:45.623793 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3935/7881] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:45 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:46.644350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ad0a4661-c7ca-482b-a852-f0a6b9dea768 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:46.645105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ad0a4661-c7ca-482b-a852-f0a6b9dea768 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:46.653052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad0a4661-c7ca-482b-a852-f0a6b9dea768 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:46.653551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad0a4661-c7ca-482b-a852-f0a6b9dea768 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:46.653978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad0a4661-c7ca-482b-a852-f0a6b9dea768 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:46.654686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad0a4661-c7ca-482b-a852-f0a6b9dea768 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:46.655208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad0a4661-c7ca-482b-a852-f0a6b9dea768 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:46.655635 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ad0a4661-c7ca-482b-a852-f0a6b9dea768 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:46.807983 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ad0a4661-c7ca-482b-a852-f0a6b9dea768 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:46.816259 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ad0a4661-c7ca-482b-a852-f0a6b9dea768 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1678 microversion: 2.1 time: 0.175753 Aug 27 06:13:46.816935 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3947/7882] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:46 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:13:47.838156 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eda15814-738a-4287-b19c-33e934e8bd51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:13:47.838785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eda15814-738a-4287-b19c-33e934e8bd51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:13:47.846611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda15814-738a-4287-b19c-33e934e8bd51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:47.847127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda15814-738a-4287-b19c-33e934e8bd51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:47.847581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda15814-738a-4287-b19c-33e934e8bd51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:47.848298 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda15814-738a-4287-b19c-33e934e8bd51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:13:47.848764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda15814-738a-4287-b19c-33e934e8bd51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:13:47.849202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eda15814-738a-4287-b19c-33e934e8bd51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:13:47.993979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eda15814-738a-4287-b19c-33e934e8bd51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:13:48.002372 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eda15814-738a-4287-b19c-33e934e8bd51 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1681 microversion: 2.1 time: 0.168205 Aug 27 06:13:48.003359 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3936/7883] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:13:47 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:14:22.226319 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cc41558b-330a-4ddd-9640-1a47d9845b35 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:14:22.228642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cc41558b-330a-4ddd-9640-1a47d9845b35 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:14:22.230966 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=16 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:14:22.231646 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=48 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:14:22.237901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc41558b-330a-4ddd-9640-1a47d9845b35 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:22.238398 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc41558b-330a-4ddd-9640-1a47d9845b35 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:22.238837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc41558b-330a-4ddd-9640-1a47d9845b35 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:22.239565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc41558b-330a-4ddd-9640-1a47d9845b35 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:22.240017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc41558b-330a-4ddd-9640-1a47d9845b35 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:22.240443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cc41558b-330a-4ddd-9640-1a47d9845b35 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:22.311938 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cc41558b-330a-4ddd-9640-1a47d9845b35 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6/action" status: 200 len: 69204 microversion: 2.1 time: 0.089509 Aug 27 06:14:22.313012 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3948/7884] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:14:22 2022] POST /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6/action => generated 69204 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:14:46.228240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7aaa8ad1-0617-443e-9ea5-0c5ab929719a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:14:46.228791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7aaa8ad1-0617-443e-9ea5-0c5ab929719a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:14:46.230933 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=18 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:14:46.231301 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-9b276bbf-b32e-4c5e-b8fe-950a86344170 req-2525f415-6398-44ac-9699-e08966a80dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4e57b0-4ecc-4667-bc7e-7b74b45980a6", "tag": "4e50ba6d-fa5f-4ace-b250-4b30c65b2cb3"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:14:46.237033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:14:46.237758 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:14:46.244265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:14:46.249944 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7aaa8ad1-0617-443e-9ea5-0c5ab929719a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:46.250535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7aaa8ad1-0617-443e-9ea5-0c5ab929719a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:46.250999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7aaa8ad1-0617-443e-9ea5-0c5ab929719a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:46.251455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9b276bbf-b32e-4c5e-b8fe-950a86344170 req-2525f415-6398-44ac-9699-e08966a80dbc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:46.251755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7aaa8ad1-0617-443e-9ea5-0c5ab929719a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:46.251936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9b276bbf-b32e-4c5e-b8fe-950a86344170 req-2525f415-6398-44ac-9699-e08966a80dbc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:46.252232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7aaa8ad1-0617-443e-9ea5-0c5ab929719a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:46.252563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-9b276bbf-b32e-4c5e-b8fe-950a86344170 req-2525f415-6398-44ac-9699-e08966a80dbc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:46.252689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7aaa8ad1-0617-443e-9ea5-0c5ab929719a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:46.266940 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-9b276bbf-b32e-4c5e-b8fe-950a86344170 req-2525f415-6398-44ac-9699-e08966a80dbc service nova] Creating event network-changed:4e50ba6d-fa5f-4ace-b250-4b30c65b2cb3 for instance 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 on n-h1-820368-35 Aug 27 06:14:46.272832 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-9b276bbf-b32e-4c5e-b8fe-950a86344170 req-2525f415-6398-44ac-9699-e08966a80dbc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046786 Aug 27 06:14:46.273976 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3949/7885] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:14:46.292624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7aaa8ad1-0617-443e-9ea5-0c5ab929719a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:14:46.390960 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7aaa8ad1-0617-443e-9ea5-0c5ab929719a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 204 len: 0 microversion: 2.1 time: 0.167406 Aug 27 06:14:46.395447 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3937/7886] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:14:46 2022] DELETE /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:14:46.405542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2c534645-0297-47d9-98bc-d494923fe47d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:14:46.406452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2c534645-0297-47d9-98bc-d494923fe47d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:14:46.417628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c534645-0297-47d9-98bc-d494923fe47d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:46.422007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c534645-0297-47d9-98bc-d494923fe47d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:46.422569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c534645-0297-47d9-98bc-d494923fe47d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:46.423575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c534645-0297-47d9-98bc-d494923fe47d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:46.424145 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c534645-0297-47d9-98bc-d494923fe47d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:46.424823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2c534645-0297-47d9-98bc-d494923fe47d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:46.569502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2c534645-0297-47d9-98bc-d494923fe47d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:14:46.579049 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2c534645-0297-47d9-98bc-d494923fe47d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1687 microversion: 2.1 time: 0.181499 Aug 27 06:14:46.583447 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3950/7887] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:14:46 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:14:47.602584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8d94ecb6-11af-4d49-904c-cefadc8145e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:14:47.603255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8d94ecb6-11af-4d49-904c-cefadc8145e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:14:47.610217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d94ecb6-11af-4d49-904c-cefadc8145e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:47.610711 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d94ecb6-11af-4d49-904c-cefadc8145e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:47.611208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d94ecb6-11af-4d49-904c-cefadc8145e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:47.611916 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d94ecb6-11af-4d49-904c-cefadc8145e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:47.612378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d94ecb6-11af-4d49-904c-cefadc8145e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:47.612815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8d94ecb6-11af-4d49-904c-cefadc8145e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:47.844429 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8d94ecb6-11af-4d49-904c-cefadc8145e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:14:47.852244 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8d94ecb6-11af-4d49-904c-cefadc8145e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1687 microversion: 2.1 time: 0.254549 Aug 27 06:14:47.852881 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3938/7888] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:14:47 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1687 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:14:48.873641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f26629f-3372-4edf-9135-2a287f3f87f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:14:48.874268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f26629f-3372-4edf-9135-2a287f3f87f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:14:48.906971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f26629f-3372-4edf-9135-2a287f3f87f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:48.920477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f26629f-3372-4edf-9135-2a287f3f87f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:48.923164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f26629f-3372-4edf-9135-2a287f3f87f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:48.924222 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f26629f-3372-4edf-9135-2a287f3f87f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:48.924837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f26629f-3372-4edf-9135-2a287f3f87f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:48.925412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f26629f-3372-4edf-9135-2a287f3f87f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:48.964491 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8667033f-bd98-4e52-911d-5454e5a0c0f9 req-66ddaf47-e872-463e-a5d5-171365c1fc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4e57b0-4ecc-4667-bc7e-7b74b45980a6", "name": "network-vif-deleted", "tag": "4e50ba6d-fa5f-4ace-b250-4b30c65b2cb3"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:14:48.976978 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8667033f-bd98-4e52-911d-5454e5a0c0f9 req-66ddaf47-e872-463e-a5d5-171365c1fc51 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:48.977754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8667033f-bd98-4e52-911d-5454e5a0c0f9 req-66ddaf47-e872-463e-a5d5-171365c1fc51 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:48.978555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8667033f-bd98-4e52-911d-5454e5a0c0f9 req-66ddaf47-e872-463e-a5d5-171365c1fc51 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:48.991402 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8667033f-bd98-4e52-911d-5454e5a0c0f9 req-66ddaf47-e872-463e-a5d5-171365c1fc51 service nova] Creating event network-vif-deleted:4e50ba6d-fa5f-4ace-b250-4b30c65b2cb3 for instance 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 on n-h1-820368-35 Aug 27 06:14:48.996953 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8667033f-bd98-4e52-911d-5454e5a0c0f9 req-66ddaf47-e872-463e-a5d5-171365c1fc51 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037609 Aug 27 06:14:48.997848 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3939/7889] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:14:49.025903 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f26629f-3372-4edf-9135-2a287f3f87f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:14:49.035275 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f26629f-3372-4edf-9135-2a287f3f87f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 200 len: 1619 microversion: 2.1 time: 0.165430 Aug 27 06:14:49.049289 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3951/7890] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:14:48 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 1619 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:14:50.059797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:14:50.060451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:14:50.066724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:50.067328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:50.067725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:50.068462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:14:50.068929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:14:50.069973 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:14:50.086320 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] HTTP exception thrown: Instance 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 could not be found. Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Request method failure captured: Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 HTTP/1.1 Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbU6aB_e75aqp8NqqqVAdR5aTLA1Q6hTA4TQG7g4UP-wugXdWdOQbKYZdiF7Eb_yQ2RNMIFzHOe9xBFRey4TYo5y377lxnb_8a1DEXSy6GAWG-hMmKOxzfz8KSOhJR9A4wcCgVgXBokca2F0ylnOdGjNKOJhU5qnilgI35mBzwauMaI Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: f100645ec41f471bad7489ea8fbcbaf0 Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f100645ec41f471bad7489ea8fbcbaf0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: f100645ec41f471bad7489ea8fbcbaf0 Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestNetworkAdvancedServerOps-38834833-project Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 52d1f89be8a74799b32e239ff34959c2 Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestNetworkAdvancedServerOps-38834833-project Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 could not be found. Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '7b4e57b0-4ecc-4667-bc7e-7b74b45980a6'} Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 could not be found. Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 could not be found. Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:14:50.088044 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:14:50.092640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:14:50.092640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:14:50.092640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:14:50.092640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:14:50.092640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:14:50.092640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:14:50.092640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 could not be found. Aug 27 06:14:50.092640 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:14:50.092640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Returning 404 to user: Instance 7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:14:50.092640 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ad87bd50-8631-44d7-b469-60c0d8b42847 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6" status: 404 len: 111 microversion: 2.1 time: 0.035050 Aug 27 06:14:50.092640 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3940/7891] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:14:50 2022] GET /compute/v2.1/servers/7b4e57b0-4ecc-4667-bc7e-7b74b45980a6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:14:53.641320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-69526a4c-c108-47f7-8e6b-2b8d1b3171d1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '.version_select at 0x7fb569759790>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:14:53.649746 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [None req-69526a4c-c108-47f7-8e6b-2b8d1b3171d1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [29dc6b1e-b247-4504-beea-89ae8c634cd6] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:14:54.656845 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [None req-69526a4c-c108-47f7-8e6b-2b8d1b3171d1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [29dc6b1e-b247-4504-beea-89ae8c634cd6] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47738. Aug 27 06:14:54.678043 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-69526a4c-c108-47f7-8e6b-2b8d1b3171d1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-596386634" status: 202 len: 0 microversion: 2.1 time: 1.044649 Aug 27 06:14:54.678748 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3952/7892] 10.222.0.58 () {58 vars in 1281 bytes} [Sat Aug 27 06:14:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-596386634 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:14:54.709275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-43f6fe84-b939-498a-8bec-b93849a54011 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'create', calling method: .version_select at 0x7fb55fe61040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-661440352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW4632Jpu5ySov4Hv5QqBOKTwb2xNTaro6l0v9aNVmMhVAuDz01rjtBNBHaishD3AyxUas/DBuf+DMNHYV+R0+OLWZdklvHmIz9yadeooqZD05drO644lUFvHdMtJoETA=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:14:54.727946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-43f6fe84-b939-498a-8bec-b93849a54011 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:14:54.734423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-43f6fe84-b939-498a-8bec-b93849a54011 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for user 52d1f89be8a74799b32e239ff34959c2 and project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:14:54.748752 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43f6fe84-b939-498a-8bec-b93849a54011 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [e806d047-01c0-40ca-9147-cc66deb820f5] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:14:55.756906 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [None req-43f6fe84-b939-498a-8bec-b93849a54011 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [e806d047-01c0-40ca-9147-cc66deb820f5] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47744. Aug 27 06:14:55.772289 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-43f6fe84-b939-498a-8bec-b93849a54011 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.067000 Aug 27 06:14:55.772897 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3941/7893] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 06:14:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:15:01.869877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=14 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:15:01.965820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-327563730", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "70bcde17-2e8e-49e9-a8c6-f9020a9b8e84"}], "key_name": "tempest-TestNetworkAdvancedServerOps-661440352", "security_groups": [{"name": "tempest-secgroup-smoke-61223932"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:15:02.109797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] validate_networks() for [('70bcde17-2e8e-49e9-a8c6-f9020a9b8e84', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:15:02.615553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:15:02.616004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:15:02.617354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:15:02.618017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:15:02.618630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:15:02.629618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:02.631009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:02.631689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:02.632664 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:02.633333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:02.633955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:02.653852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:15:02.660890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for user 52d1f89be8a74799b32e239ff34959c2 and project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:15:02.674876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:15:02.677885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:15:02.732007 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c4d213f7-c03c-4a80-abe1-e6739d554749 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.863774 Aug 27 06:15:02.732673 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3953/7894] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:15:01 2022] POST /compute/v2.1/servers => generated 404 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:15:02.744964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a070c89e-baa6-464d-b54b-a7e30bc09c4e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:02.746297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a070c89e-baa6-464d-b54b-a7e30bc09c4e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:02.749722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:15:02.820650 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a070c89e-baa6-464d-b54b-a7e30bc09c4e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:02.827961 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a070c89e-baa6-464d-b54b-a7e30bc09c4e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1265 microversion: 2.1 time: 0.087655 Aug 27 06:15:02.828770 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3942/7895] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:02 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:03.891291 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-03ab56c3-eb8c-4a7d-af61-7c0e953a3483 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:03.893223 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-03ab56c3-eb8c-4a7d-af61-7c0e953a3483 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:03.984438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-03ab56c3-eb8c-4a7d-af61-7c0e953a3483 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:03.991845 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-03ab56c3-eb8c-4a7d-af61-7c0e953a3483 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1265 microversion: 2.1 time: 0.146111 Aug 27 06:15:03.992773 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3954/7896] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:03 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:05.013629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-662b31ab-0722-44c6-8ed0-3f08abd158b4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:05.014250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-662b31ab-0722-44c6-8ed0-3f08abd158b4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:05.082022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-662b31ab-0722-44c6-8ed0-3f08abd158b4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:05.091208 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-662b31ab-0722-44c6-8ed0-3f08abd158b4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1265 microversion: 2.1 time: 0.081401 Aug 27 06:15:05.091777 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3943/7897] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:05 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:06.115943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-71069853-8c34-4089-8db9-1554b39e1c18 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:06.117190 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-71069853-8c34-4089-8db9-1554b39e1c18 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:06.183693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-71069853-8c34-4089-8db9-1554b39e1c18 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:06.190807 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-71069853-8c34-4089-8db9-1554b39e1c18 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1265 microversion: 2.1 time: 0.081177 Aug 27 06:15:06.192284 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3955/7898] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:06 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:07.212483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-be638e17-a672-4bab-bdd9-56cbc653a079 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:07.213116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-be638e17-a672-4bab-bdd9-56cbc653a079 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:07.219653 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be638e17-a672-4bab-bdd9-56cbc653a079 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:07.220150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be638e17-a672-4bab-bdd9-56cbc653a079 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:07.220610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be638e17-a672-4bab-bdd9-56cbc653a079 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:07.221317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be638e17-a672-4bab-bdd9-56cbc653a079 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:07.221785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be638e17-a672-4bab-bdd9-56cbc653a079 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:07.222225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-be638e17-a672-4bab-bdd9-56cbc653a079 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:07.283850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-be638e17-a672-4bab-bdd9-56cbc653a079 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:07.291738 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-be638e17-a672-4bab-bdd9-56cbc653a079 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1269 microversion: 2.1 time: 0.083087 Aug 27 06:15:07.292318 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3944/7899] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:07 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:08.315393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bff52ecf-4078-48a4-bced-1310b84823a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:08.316294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bff52ecf-4078-48a4-bced-1310b84823a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:08.324070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bff52ecf-4078-48a4-bced-1310b84823a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:08.324707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bff52ecf-4078-48a4-bced-1310b84823a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:08.325298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bff52ecf-4078-48a4-bced-1310b84823a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:08.326152 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bff52ecf-4078-48a4-bced-1310b84823a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:08.326834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bff52ecf-4078-48a4-bced-1310b84823a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:08.327371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bff52ecf-4078-48a4-bced-1310b84823a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:08.409703 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bff52ecf-4078-48a4-bced-1310b84823a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:08.420581 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bff52ecf-4078-48a4-bced-1310b84823a1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1323 microversion: 2.1 time: 0.109074 Aug 27 06:15:08.422271 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3956/7900] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:08 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1323 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:09.446958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-59ea05a0-808c-48e8-8fac-297c26a538fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:09.447686 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-59ea05a0-808c-48e8-8fac-297c26a538fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:09.456771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59ea05a0-808c-48e8-8fac-297c26a538fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:09.457601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59ea05a0-808c-48e8-8fac-297c26a538fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:09.458999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59ea05a0-808c-48e8-8fac-297c26a538fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:09.460366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59ea05a0-808c-48e8-8fac-297c26a538fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:09.461011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59ea05a0-808c-48e8-8fac-297c26a538fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:09.461616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-59ea05a0-808c-48e8-8fac-297c26a538fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:09.462677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6098ae9f-6ecb-4dfb-8f92-847a68124a80 req-0210dd1b-a19a-478d-8838-de358b0f0801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ab0784-2731-4e46-ab77-c6f5b50720f7", "tag": "ef588ddd-48b8-4543-a778-dfe36fb9ba07"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:15:09.475963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6098ae9f-6ecb-4dfb-8f92-847a68124a80 req-0210dd1b-a19a-478d-8838-de358b0f0801 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:09.476855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6098ae9f-6ecb-4dfb-8f92-847a68124a80 req-0210dd1b-a19a-478d-8838-de358b0f0801 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:09.477567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6098ae9f-6ecb-4dfb-8f92-847a68124a80 req-0210dd1b-a19a-478d-8838-de358b0f0801 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:09.495752 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6098ae9f-6ecb-4dfb-8f92-847a68124a80 req-0210dd1b-a19a-478d-8838-de358b0f0801 service nova] Creating event network-changed:ef588ddd-48b8-4543-a778-dfe36fb9ba07 for instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 on n-h1-820368-35 Aug 27 06:15:09.512245 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6098ae9f-6ecb-4dfb-8f92-847a68124a80 req-0210dd1b-a19a-478d-8838-de358b0f0801 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057286 Aug 27 06:15:09.512870 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3957/7901] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:15:09.635642 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-59ea05a0-808c-48e8-8fac-297c26a538fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:09.645702 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-59ea05a0-808c-48e8-8fac-297c26a538fb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1389 microversion: 2.1 time: 0.205196 Aug 27 06:15:09.646418 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3945/7902] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:09 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1389 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:10.666891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e5a04559-7e4b-484e-9a4f-85ab350976d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:10.667625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e5a04559-7e4b-484e-9a4f-85ab350976d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:10.674721 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a04559-7e4b-484e-9a4f-85ab350976d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:10.675236 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a04559-7e4b-484e-9a4f-85ab350976d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:10.675681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a04559-7e4b-484e-9a4f-85ab350976d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:10.676390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a04559-7e4b-484e-9a4f-85ab350976d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:10.676991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a04559-7e4b-484e-9a4f-85ab350976d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:10.677532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e5a04559-7e4b-484e-9a4f-85ab350976d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:10.820652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e5a04559-7e4b-484e-9a4f-85ab350976d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:10.828606 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e5a04559-7e4b-484e-9a4f-85ab350976d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1389 microversion: 2.1 time: 0.166364 Aug 27 06:15:10.829222 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3958/7903] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:10 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:11.850014 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ebc4e707-b292-47d0-a8bb-6996fb2981bf tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:11.850672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ebc4e707-b292-47d0-a8bb-6996fb2981bf tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:11.853210 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:15:11.853351 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:15:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 (ip 10.222.0.58) !!! Aug 27 06:15:11.866672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebc4e707-b292-47d0-a8bb-6996fb2981bf tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:11.867210 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebc4e707-b292-47d0-a8bb-6996fb2981bf tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:11.867669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebc4e707-b292-47d0-a8bb-6996fb2981bf tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:11.868380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebc4e707-b292-47d0-a8bb-6996fb2981bf tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:11.868848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebc4e707-b292-47d0-a8bb-6996fb2981bf tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:11.869285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ebc4e707-b292-47d0-a8bb-6996fb2981bf tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:12.002395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ebc4e707-b292-47d0-a8bb-6996fb2981bf tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:12.010815 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ebc4e707-b292-47d0-a8bb-6996fb2981bf tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1389 microversion: 2.1 time: 0.164750 Aug 27 06:15:12.011413 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3946/7904] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:11 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:13.032607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5d602692-8c63-41e3-b240-5206c7ba0eb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:13.033649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5d602692-8c63-41e3-b240-5206c7ba0eb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:13.037092 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:15:13.043423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d602692-8c63-41e3-b240-5206c7ba0eb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:13.043977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d602692-8c63-41e3-b240-5206c7ba0eb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:13.044455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d602692-8c63-41e3-b240-5206c7ba0eb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:13.045231 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d602692-8c63-41e3-b240-5206c7ba0eb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:13.045740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d602692-8c63-41e3-b240-5206c7ba0eb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:13.046205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d602692-8c63-41e3-b240-5206c7ba0eb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:13.182668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d602692-8c63-41e3-b240-5206c7ba0eb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:13.195925 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5d602692-8c63-41e3-b240-5206c7ba0eb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1389 microversion: 2.1 time: 0.166739 Aug 27 06:15:13.196580 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3959/7905] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:13 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:14.216409 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b35fcfd7-0cf1-4ca9-8efa-e53ec18dbab8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:14.217126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b35fcfd7-0cf1-4ca9-8efa-e53ec18dbab8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:14.223950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b35fcfd7-0cf1-4ca9-8efa-e53ec18dbab8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:14.224456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b35fcfd7-0cf1-4ca9-8efa-e53ec18dbab8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:14.225469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b35fcfd7-0cf1-4ca9-8efa-e53ec18dbab8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:14.226174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b35fcfd7-0cf1-4ca9-8efa-e53ec18dbab8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:14.226635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b35fcfd7-0cf1-4ca9-8efa-e53ec18dbab8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:14.227069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b35fcfd7-0cf1-4ca9-8efa-e53ec18dbab8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:14.367461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b35fcfd7-0cf1-4ca9-8efa-e53ec18dbab8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:14.375534 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b35fcfd7-0cf1-4ca9-8efa-e53ec18dbab8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1389 microversion: 2.1 time: 0.162960 Aug 27 06:15:14.376117 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3947/7906] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:14 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:15.400012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b8103877-fab5-4b92-a731-5b50744135e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:15.400532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b8103877-fab5-4b92-a731-5b50744135e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:15.407851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8103877-fab5-4b92-a731-5b50744135e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:15.408343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8103877-fab5-4b92-a731-5b50744135e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:15.408914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8103877-fab5-4b92-a731-5b50744135e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:15.409484 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8103877-fab5-4b92-a731-5b50744135e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:15.409937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8103877-fab5-4b92-a731-5b50744135e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:15.410363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b8103877-fab5-4b92-a731-5b50744135e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:15.545141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b8103877-fab5-4b92-a731-5b50744135e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:15.555320 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b8103877-fab5-4b92-a731-5b50744135e6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1389 microversion: 2.1 time: 0.159241 Aug 27 06:15:15.555909 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3960/7907] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:15 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:16.029275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-67c00efa-f9ab-4cc1-983a-69f2394020f1 req-5f592721-84a8-4741-a66f-d9451da52a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ab0784-2731-4e46-ab77-c6f5b50720f7", "name": "network-vif-plugged", "status": "completed", "tag": "ef588ddd-48b8-4543-a778-dfe36fb9ba07"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:15:16.035128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:15:16.045035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-67c00efa-f9ab-4cc1-983a-69f2394020f1 req-5f592721-84a8-4741-a66f-d9451da52a42 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:16.045035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-67c00efa-f9ab-4cc1-983a-69f2394020f1 req-5f592721-84a8-4741-a66f-d9451da52a42 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:16.045035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-67c00efa-f9ab-4cc1-983a-69f2394020f1 req-5f592721-84a8-4741-a66f-d9451da52a42 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:16.057537 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-67c00efa-f9ab-4cc1-983a-69f2394020f1 req-5f592721-84a8-4741-a66f-d9451da52a42 service nova] Creating event network-vif-plugged:ef588ddd-48b8-4543-a778-dfe36fb9ba07 for instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 on n-h1-820368-35 Aug 27 06:15:16.063454 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-67c00efa-f9ab-4cc1-983a-69f2394020f1 req-5f592721-84a8-4741-a66f-d9451da52a42 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037502 Aug 27 06:15:16.064243 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3948/7908] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:15:16.576886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0ae6f03d-9169-48d9-a7d4-df34626e7f1d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:16.577489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0ae6f03d-9169-48d9-a7d4-df34626e7f1d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:16.579400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=10 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:15:16.580987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:15:16.587359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ae6f03d-9169-48d9-a7d4-df34626e7f1d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:16.587859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ae6f03d-9169-48d9-a7d4-df34626e7f1d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:16.588310 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ae6f03d-9169-48d9-a7d4-df34626e7f1d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:16.589042 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ae6f03d-9169-48d9-a7d4-df34626e7f1d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:16.589491 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ae6f03d-9169-48d9-a7d4-df34626e7f1d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:16.589925 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0ae6f03d-9169-48d9-a7d4-df34626e7f1d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:16.727926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0ae6f03d-9169-48d9-a7d4-df34626e7f1d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:16.736314 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0ae6f03d-9169-48d9-a7d4-df34626e7f1d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1389 microversion: 2.1 time: 0.163442 Aug 27 06:15:16.737010 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3961/7909] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:16 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:17.758449 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7bc17b69-c2dd-442e-8e0e-27d73ef6289b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:17.759201 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7bc17b69-c2dd-442e-8e0e-27d73ef6289b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:17.761911 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:15:17.767781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc17b69-c2dd-442e-8e0e-27d73ef6289b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:17.768283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc17b69-c2dd-442e-8e0e-27d73ef6289b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:17.768743 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc17b69-c2dd-442e-8e0e-27d73ef6289b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:17.769474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc17b69-c2dd-442e-8e0e-27d73ef6289b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:17.769931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc17b69-c2dd-442e-8e0e-27d73ef6289b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:17.770377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7bc17b69-c2dd-442e-8e0e-27d73ef6289b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:17.908890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7bc17b69-c2dd-442e-8e0e-27d73ef6289b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:17.917917 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7bc17b69-c2dd-442e-8e0e-27d73ef6289b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1560 microversion: 2.1 time: 0.163913 Aug 27 06:15:17.918524 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3949/7910] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:17 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:17.938837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ec22c5af-444b-4542-971b-d04385e9ccb7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:17.939661 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ec22c5af-444b-4542-971b-d04385e9ccb7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:17.947422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec22c5af-444b-4542-971b-d04385e9ccb7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:17.947939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec22c5af-444b-4542-971b-d04385e9ccb7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:17.948382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec22c5af-444b-4542-971b-d04385e9ccb7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:17.949520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec22c5af-444b-4542-971b-d04385e9ccb7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:17.949648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec22c5af-444b-4542-971b-d04385e9ccb7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:17.950081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ec22c5af-444b-4542-971b-d04385e9ccb7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:18.083734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ec22c5af-444b-4542-971b-d04385e9ccb7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:18.092200 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ec22c5af-444b-4542-971b-d04385e9ccb7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1560 microversion: 2.1 time: 0.157426 Aug 27 06:15:18.092775 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3962/7911] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:17 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:20.128706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-dd04eff2-d508-493e-9375-2edb5df51f77 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:15:20.135502 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-f5eaec54-1f6d-4e66-be59-076653da0fe7 req-5b25f5a9-ef06-4143-8877-28200e803042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ab0784-2731-4e46-ab77-c6f5b50720f7", "tag": "ef588ddd-48b8-4543-a778-dfe36fb9ba07"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:15:20.136276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-dd04eff2-d508-493e-9375-2edb5df51f77 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:20.150041 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd04eff2-d508-493e-9375-2edb5df51f77 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:20.154616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f5eaec54-1f6d-4e66-be59-076653da0fe7 req-5b25f5a9-ef06-4143-8877-28200e803042 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:20.155503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd04eff2-d508-493e-9375-2edb5df51f77 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:20.155985 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd04eff2-d508-493e-9375-2edb5df51f77 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:20.157199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd04eff2-d508-493e-9375-2edb5df51f77 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:20.157685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd04eff2-d508-493e-9375-2edb5df51f77 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:20.158123 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-dd04eff2-d508-493e-9375-2edb5df51f77 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:20.163053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f5eaec54-1f6d-4e66-be59-076653da0fe7 req-5b25f5a9-ef06-4143-8877-28200e803042 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:20.163943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-f5eaec54-1f6d-4e66-be59-076653da0fe7 req-5b25f5a9-ef06-4143-8877-28200e803042 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:20.190422 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-f5eaec54-1f6d-4e66-be59-076653da0fe7 req-5b25f5a9-ef06-4143-8877-28200e803042 service nova] Creating event network-changed:ef588ddd-48b8-4543-a778-dfe36fb9ba07 for instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 on n-h1-820368-35 Aug 27 06:15:20.199626 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-f5eaec54-1f6d-4e66-be59-076653da0fe7 req-5b25f5a9-ef06-4143-8877-28200e803042 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068733 Aug 27 06:15:20.200823 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3963/7912] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:15:20.339170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-dd04eff2-d508-493e-9375-2edb5df51f77 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:15:20.348639 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-dd04eff2-d508-493e-9375-2edb5df51f77 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1560 microversion: 2.1 time: 0.224017 Aug 27 06:15:20.349931 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3950/7913] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:15:20 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:15:55.645719 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=5 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:15:55.646465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=42 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:15:55.651907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-410f8cec-8df4-49af-b948-6ea6380185a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:15:55.654263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-410f8cec-8df4-49af-b948-6ea6380185a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:15:55.661551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-410f8cec-8df4-49af-b948-6ea6380185a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:55.662043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-410f8cec-8df4-49af-b948-6ea6380185a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:55.663196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-410f8cec-8df4-49af-b948-6ea6380185a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:55.664020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-410f8cec-8df4-49af-b948-6ea6380185a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:15:55.664525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-410f8cec-8df4-49af-b948-6ea6380185a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:15:55.664975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-410f8cec-8df4-49af-b948-6ea6380185a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:15:55.733287 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-410f8cec-8df4-49af-b948-6ea6380185a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7/action" status: 200 len: 24565 microversion: 2.1 time: 0.089680 Aug 27 06:15:55.734073 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3964/7914] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:15:55 2022] POST /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7/action => generated 24565 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:16:34.846967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:16:34.847770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=38 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:16:34.852411 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:16:34.854665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:34.861750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:34.862257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:34.862714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:34.863472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:34.863942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:34.864387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:34.906181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:34.912693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Old instance type m1.heat2, new instance type m1.heat {{(pid=128547) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 06:16:34.919334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:16:34.919776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:16:34.920297 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:16:34.920722 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:16:34.921148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:16:34.990590 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-efb6bec0-6dba-4103-91db-1702bd37911b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7/action" status: 202 len: 0 microversion: 2.1 time: 0.144912 Aug 27 06:16:34.991208 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3951/7915] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:16:34 2022] POST /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:16:35.000273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-390f9fd7-e9ae-4ee7-855f-b55ec071436b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:35.001039 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-390f9fd7-e9ae-4ee7-855f-b55ec071436b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:35.009675 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:16:35.010362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:16:35.012336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390f9fd7-e9ae-4ee7-855f-b55ec071436b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:35.012880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390f9fd7-e9ae-4ee7-855f-b55ec071436b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:35.013576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390f9fd7-e9ae-4ee7-855f-b55ec071436b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:35.014618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390f9fd7-e9ae-4ee7-855f-b55ec071436b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:35.015106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390f9fd7-e9ae-4ee7-855f-b55ec071436b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:35.015698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-390f9fd7-e9ae-4ee7-855f-b55ec071436b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:35.181818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-390f9fd7-e9ae-4ee7-855f-b55ec071436b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:35.189900 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-390f9fd7-e9ae-4ee7-855f-b55ec071436b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1687 microversion: 2.1 time: 0.193953 Aug 27 06:16:35.190803 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3965/7916] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:34 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:36.214349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-81449032-b30f-4317-bab9-1442c37f04d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:36.215318 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-81449032-b30f-4317-bab9-1442c37f04d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:36.221874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81449032-b30f-4317-bab9-1442c37f04d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:36.222452 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81449032-b30f-4317-bab9-1442c37f04d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:36.223035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81449032-b30f-4317-bab9-1442c37f04d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:36.223810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81449032-b30f-4317-bab9-1442c37f04d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:36.224487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81449032-b30f-4317-bab9-1442c37f04d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:36.225025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81449032-b30f-4317-bab9-1442c37f04d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:36.361879 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-81449032-b30f-4317-bab9-1442c37f04d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:36.370207 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-81449032-b30f-4317-bab9-1442c37f04d4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1687 microversion: 2.1 time: 0.162105 Aug 27 06:16:36.370782 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3952/7917] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:36 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:37.392189 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5af2ca8f-2ad4-4d32-b9fb-f1e2ae84d32b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:37.392918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5af2ca8f-2ad4-4d32-b9fb-f1e2ae84d32b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:37.400614 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af2ca8f-2ad4-4d32-b9fb-f1e2ae84d32b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:37.401138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af2ca8f-2ad4-4d32-b9fb-f1e2ae84d32b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:37.401588 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af2ca8f-2ad4-4d32-b9fb-f1e2ae84d32b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:37.402885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af2ca8f-2ad4-4d32-b9fb-f1e2ae84d32b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:37.403008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af2ca8f-2ad4-4d32-b9fb-f1e2ae84d32b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:37.403412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5af2ca8f-2ad4-4d32-b9fb-f1e2ae84d32b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:37.555698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5af2ca8f-2ad4-4d32-b9fb-f1e2ae84d32b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:37.563601 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5af2ca8f-2ad4-4d32-b9fb-f1e2ae84d32b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1692 microversion: 2.1 time: 0.175464 Aug 27 06:16:37.564413 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3966/7918] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:37 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:38.585853 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b4ee0a6-6f03-4220-831a-0231042d3eca tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:38.586479 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b4ee0a6-6f03-4220-831a-0231042d3eca tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:38.593278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4ee0a6-6f03-4220-831a-0231042d3eca tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:38.593771 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4ee0a6-6f03-4220-831a-0231042d3eca tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:38.594224 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4ee0a6-6f03-4220-831a-0231042d3eca tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:38.594997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4ee0a6-6f03-4220-831a-0231042d3eca tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:38.595512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4ee0a6-6f03-4220-831a-0231042d3eca tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:38.596040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b4ee0a6-6f03-4220-831a-0231042d3eca tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:38.732557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b4ee0a6-6f03-4220-831a-0231042d3eca tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:38.741084 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b4ee0a6-6f03-4220-831a-0231042d3eca tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1692 microversion: 2.1 time: 0.159667 Aug 27 06:16:38.741660 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3953/7919] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:38 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:39.763657 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3960a794-0e37-48b8-901b-67ce1e25a640 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:39.764397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3960a794-0e37-48b8-901b-67ce1e25a640 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:39.772045 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3960a794-0e37-48b8-901b-67ce1e25a640 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:39.772626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3960a794-0e37-48b8-901b-67ce1e25a640 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:39.773141 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3960a794-0e37-48b8-901b-67ce1e25a640 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:39.773926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3960a794-0e37-48b8-901b-67ce1e25a640 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:39.774455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3960a794-0e37-48b8-901b-67ce1e25a640 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:39.775161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3960a794-0e37-48b8-901b-67ce1e25a640 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:39.913536 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3960a794-0e37-48b8-901b-67ce1e25a640 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:39.921975 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3960a794-0e37-48b8-901b-67ce1e25a640 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1692 microversion: 2.1 time: 0.162821 Aug 27 06:16:39.922768 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3967/7920] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:39 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:40.944369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-98bc5445-4836-4010-9043-e5b6052fd34c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:40.945030 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-98bc5445-4836-4010-9043-e5b6052fd34c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:40.952071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98bc5445-4836-4010-9043-e5b6052fd34c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:40.952583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98bc5445-4836-4010-9043-e5b6052fd34c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:40.953085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98bc5445-4836-4010-9043-e5b6052fd34c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:40.953741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98bc5445-4836-4010-9043-e5b6052fd34c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:40.954207 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98bc5445-4836-4010-9043-e5b6052fd34c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:40.954652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-98bc5445-4836-4010-9043-e5b6052fd34c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:41.098525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-98bc5445-4836-4010-9043-e5b6052fd34c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:41.106586 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-98bc5445-4836-4010-9043-e5b6052fd34c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1692 microversion: 2.1 time: 0.166067 Aug 27 06:16:41.107187 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3954/7921] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:40 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:42.130051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9c10dcd4-885b-4728-961d-f15ddf97ce40 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:42.131165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9c10dcd4-885b-4728-961d-f15ddf97ce40 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:42.138311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c10dcd4-885b-4728-961d-f15ddf97ce40 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:42.138805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c10dcd4-885b-4728-961d-f15ddf97ce40 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:42.139279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c10dcd4-885b-4728-961d-f15ddf97ce40 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:42.139988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c10dcd4-885b-4728-961d-f15ddf97ce40 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:42.140442 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c10dcd4-885b-4728-961d-f15ddf97ce40 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:42.140874 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9c10dcd4-885b-4728-961d-f15ddf97ce40 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:42.323493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9c10dcd4-885b-4728-961d-f15ddf97ce40 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:42.331496 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9c10dcd4-885b-4728-961d-f15ddf97ce40 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1692 microversion: 2.1 time: 0.205464 Aug 27 06:16:42.332090 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3968/7922] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:42 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:43.353282 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-68647229-2bd8-4fbe-b519-82b4fe24b2a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:43.353900 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-68647229-2bd8-4fbe-b519-82b4fe24b2a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:43.360861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68647229-2bd8-4fbe-b519-82b4fe24b2a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:43.361355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68647229-2bd8-4fbe-b519-82b4fe24b2a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:43.361802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68647229-2bd8-4fbe-b519-82b4fe24b2a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:43.362504 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68647229-2bd8-4fbe-b519-82b4fe24b2a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:43.362966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68647229-2bd8-4fbe-b519-82b4fe24b2a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:43.363433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-68647229-2bd8-4fbe-b519-82b4fe24b2a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:43.505378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-68647229-2bd8-4fbe-b519-82b4fe24b2a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:43.513549 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-68647229-2bd8-4fbe-b519-82b4fe24b2a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1692 microversion: 2.1 time: 0.164143 Aug 27 06:16:43.514358 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3955/7923] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:43 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:44.534849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-88fa4a2e-40da-4442-9d8b-a0fa74d98a84 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:44.535543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-88fa4a2e-40da-4442-9d8b-a0fa74d98a84 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:44.542548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88fa4a2e-40da-4442-9d8b-a0fa74d98a84 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:44.543043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88fa4a2e-40da-4442-9d8b-a0fa74d98a84 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:44.543553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88fa4a2e-40da-4442-9d8b-a0fa74d98a84 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:44.544272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88fa4a2e-40da-4442-9d8b-a0fa74d98a84 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:44.544740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88fa4a2e-40da-4442-9d8b-a0fa74d98a84 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:44.545191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-88fa4a2e-40da-4442-9d8b-a0fa74d98a84 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:44.679120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-88fa4a2e-40da-4442-9d8b-a0fa74d98a84 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:44.687169 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-88fa4a2e-40da-4442-9d8b-a0fa74d98a84 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1692 microversion: 2.1 time: 0.156264 Aug 27 06:16:44.687743 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3969/7924] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:44 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:45.709683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-621b0dbe-7720-481d-a749-95ba5df98b7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:45.710309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-621b0dbe-7720-481d-a749-95ba5df98b7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:45.717703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-621b0dbe-7720-481d-a749-95ba5df98b7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:45.718209 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-621b0dbe-7720-481d-a749-95ba5df98b7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:45.718662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-621b0dbe-7720-481d-a749-95ba5df98b7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:45.719419 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-621b0dbe-7720-481d-a749-95ba5df98b7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:45.719887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-621b0dbe-7720-481d-a749-95ba5df98b7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:45.720328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-621b0dbe-7720-481d-a749-95ba5df98b7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:45.907856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-621b0dbe-7720-481d-a749-95ba5df98b7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:45.916464 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-621b0dbe-7720-481d-a749-95ba5df98b7b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1692 microversion: 2.1 time: 0.211348 Aug 27 06:16:45.917059 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3956/7925] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:45 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1692 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:46.937953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4c04e272-4e01-41f6-b0a1-434ff982e793 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:46.938690 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4c04e272-4e01-41f6-b0a1-434ff982e793 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:46.945965 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c04e272-4e01-41f6-b0a1-434ff982e793 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:46.946473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c04e272-4e01-41f6-b0a1-434ff982e793 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:46.946946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c04e272-4e01-41f6-b0a1-434ff982e793 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:46.947693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c04e272-4e01-41f6-b0a1-434ff982e793 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:46.948161 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c04e272-4e01-41f6-b0a1-434ff982e793 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:46.948601 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c04e272-4e01-41f6-b0a1-434ff982e793 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:47.088645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4c04e272-4e01-41f6-b0a1-434ff982e793 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:47.096637 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4c04e272-4e01-41f6-b0a1-434ff982e793 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1692 microversion: 2.1 time: 0.162644 Aug 27 06:16:47.097238 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3970/7926] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:46 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:48.118131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d710180a-f3a4-4d7d-899f-d9edf4d167f8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:48.118687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d710180a-f3a4-4d7d-899f-d9edf4d167f8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:48.125455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d710180a-f3a4-4d7d-899f-d9edf4d167f8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:48.125962 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d710180a-f3a4-4d7d-899f-d9edf4d167f8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:48.126437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d710180a-f3a4-4d7d-899f-d9edf4d167f8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:48.127174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d710180a-f3a4-4d7d-899f-d9edf4d167f8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:48.127641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d710180a-f3a4-4d7d-899f-d9edf4d167f8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:48.128091 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d710180a-f3a4-4d7d-899f-d9edf4d167f8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:48.264842 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d710180a-f3a4-4d7d-899f-d9edf4d167f8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:48.272760 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d710180a-f3a4-4d7d-899f-d9edf4d167f8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1692 microversion: 2.1 time: 0.158719 Aug 27 06:16:48.273341 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3957/7927] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:48 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:49.293986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-803018c7-4ea0-47b5-b3e4-7b4c247f1827 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:49.294745 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-803018c7-4ea0-47b5-b3e4-7b4c247f1827 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:49.302225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803018c7-4ea0-47b5-b3e4-7b4c247f1827 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:49.303128 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803018c7-4ea0-47b5-b3e4-7b4c247f1827 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:49.303587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803018c7-4ea0-47b5-b3e4-7b4c247f1827 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:49.304308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803018c7-4ea0-47b5-b3e4-7b4c247f1827 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:49.305527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803018c7-4ea0-47b5-b3e4-7b4c247f1827 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:49.306351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-803018c7-4ea0-47b5-b3e4-7b4c247f1827 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:49.467289 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-803018c7-4ea0-47b5-b3e4-7b4c247f1827 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:49.478174 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-803018c7-4ea0-47b5-b3e4-7b4c247f1827 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1692 microversion: 2.1 time: 0.187876 Aug 27 06:16:49.479055 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3971/7928] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:49 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1692 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:50.335640 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-21687e8d-335c-4849-8ba2-48aff38d8846 req-380f9f96-ee9e-45ad-ada4-c7365471470d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ab0784-2731-4e46-ab77-c6f5b50720f7", "name": "network-vif-unplugged", "status": "completed", "tag": "ef588ddd-48b8-4543-a778-dfe36fb9ba07"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:16:50.348876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-21687e8d-335c-4849-8ba2-48aff38d8846 req-380f9f96-ee9e-45ad-ada4-c7365471470d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:50.350107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-21687e8d-335c-4849-8ba2-48aff38d8846 req-380f9f96-ee9e-45ad-ada4-c7365471470d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:50.351876 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-21687e8d-335c-4849-8ba2-48aff38d8846 req-380f9f96-ee9e-45ad-ada4-c7365471470d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:50.363467 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-21687e8d-335c-4849-8ba2-48aff38d8846 req-380f9f96-ee9e-45ad-ada4-c7365471470d service nova] Creating event network-vif-unplugged:ef588ddd-48b8-4543-a778-dfe36fb9ba07 for instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 on n-h2-820368-35 Aug 27 06:16:50.371932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [req-21687e8d-335c-4849-8ba2-48aff38d8846 req-380f9f96-ee9e-45ad-ada4-c7365471470d service nova] Instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 06:16:50.386342 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-21687e8d-335c-4849-8ba2-48aff38d8846 req-380f9f96-ee9e-45ad-ada4-c7365471470d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055820 Aug 27 06:16:50.386950 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3958/7929] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:16:50.500676 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-26f59edd-e4f4-42fb-afb5-f99661ea9f9f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:50.501297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-26f59edd-e4f4-42fb-afb5-f99661ea9f9f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:50.512508 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f59edd-e4f4-42fb-afb5-f99661ea9f9f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:50.513263 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f59edd-e4f4-42fb-afb5-f99661ea9f9f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:50.513698 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f59edd-e4f4-42fb-afb5-f99661ea9f9f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:50.514609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f59edd-e4f4-42fb-afb5-f99661ea9f9f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:50.516313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f59edd-e4f4-42fb-afb5-f99661ea9f9f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:50.516751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-26f59edd-e4f4-42fb-afb5-f99661ea9f9f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:50.733296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-26f59edd-e4f4-42fb-afb5-f99661ea9f9f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:50.743411 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-26f59edd-e4f4-42fb-afb5-f99661ea9f9f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1691 microversion: 2.1 time: 0.246484 Aug 27 06:16:50.744363 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3972/7930] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:50 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1691 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:51.766778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7fad47c3-1547-424e-b6e8-81ec4ed83ce3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:51.767524 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7fad47c3-1547-424e-b6e8-81ec4ed83ce3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:51.775113 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7fad47c3-1547-424e-b6e8-81ec4ed83ce3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:51.775615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7fad47c3-1547-424e-b6e8-81ec4ed83ce3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:51.776063 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7fad47c3-1547-424e-b6e8-81ec4ed83ce3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:51.776798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7fad47c3-1547-424e-b6e8-81ec4ed83ce3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:51.777266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7fad47c3-1547-424e-b6e8-81ec4ed83ce3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:51.777706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7fad47c3-1547-424e-b6e8-81ec4ed83ce3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:51.915555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7fad47c3-1547-424e-b6e8-81ec4ed83ce3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:51.923534 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7fad47c3-1547-424e-b6e8-81ec4ed83ce3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1689 microversion: 2.1 time: 0.160921 Aug 27 06:16:51.924195 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3959/7931] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:51 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:52.422519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-728431c3-c327-4fbd-85dd-dce977e3ac86 req-04dccf8c-a9d5-40bb-a258-a545c42c1f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ab0784-2731-4e46-ab77-c6f5b50720f7", "tag": "ef588ddd-48b8-4543-a778-dfe36fb9ba07"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:16:52.433658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-728431c3-c327-4fbd-85dd-dce977e3ac86 req-04dccf8c-a9d5-40bb-a258-a545c42c1f3d service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:52.434137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-728431c3-c327-4fbd-85dd-dce977e3ac86 req-04dccf8c-a9d5-40bb-a258-a545c42c1f3d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:52.434575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-728431c3-c327-4fbd-85dd-dce977e3ac86 req-04dccf8c-a9d5-40bb-a258-a545c42c1f3d service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:52.446913 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-728431c3-c327-4fbd-85dd-dce977e3ac86 req-04dccf8c-a9d5-40bb-a258-a545c42c1f3d service nova] Creating event network-changed:ef588ddd-48b8-4543-a778-dfe36fb9ba07 for instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 on n-h2-820368-35 Aug 27 06:16:52.452311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [req-728431c3-c327-4fbd-85dd-dce977e3ac86 req-04dccf8c-a9d5-40bb-a258-a545c42c1f3d service nova] Instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-35', 'n-h2-820368-35'} {{(pid=128548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 06:16:52.463307 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-728431c3-c327-4fbd-85dd-dce977e3ac86 req-04dccf8c-a9d5-40bb-a258-a545c42c1f3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044457 Aug 27 06:16:52.463924 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3973/7932] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:16:52.947034 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a9dd2ce3-854e-4c90-9478-e62f1bc7e037 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:52.947993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-a9dd2ce3-854e-4c90-9478-e62f1bc7e037 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:52.957088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dd2ce3-854e-4c90-9478-e62f1bc7e037 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:52.958685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dd2ce3-854e-4c90-9478-e62f1bc7e037 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:52.959562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dd2ce3-854e-4c90-9478-e62f1bc7e037 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:52.961232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dd2ce3-854e-4c90-9478-e62f1bc7e037 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:52.961908 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dd2ce3-854e-4c90-9478-e62f1bc7e037 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:52.963051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-a9dd2ce3-854e-4c90-9478-e62f1bc7e037 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:53.111513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-a9dd2ce3-854e-4c90-9478-e62f1bc7e037 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:53.119226 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a9dd2ce3-854e-4c90-9478-e62f1bc7e037 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1689 microversion: 2.1 time: 0.177604 Aug 27 06:16:53.119817 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3960/7933] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:52 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:54.145424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fefbcf6d-2f73-4d9e-b801-98d839f341e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:54.147929 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fefbcf6d-2f73-4d9e-b801-98d839f341e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:54.155111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefbcf6d-2f73-4d9e-b801-98d839f341e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:54.155806 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefbcf6d-2f73-4d9e-b801-98d839f341e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:54.156355 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefbcf6d-2f73-4d9e-b801-98d839f341e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:54.157158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefbcf6d-2f73-4d9e-b801-98d839f341e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:54.157693 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefbcf6d-2f73-4d9e-b801-98d839f341e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:54.158196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fefbcf6d-2f73-4d9e-b801-98d839f341e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:54.497743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fefbcf6d-2f73-4d9e-b801-98d839f341e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:54.507184 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fefbcf6d-2f73-4d9e-b801-98d839f341e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1689 microversion: 2.1 time: 0.368729 Aug 27 06:16:54.507893 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3974/7934] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:54 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1689 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:55.529331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-252283ad-8224-4663-8e5e-86178f000db9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:55.530026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-252283ad-8224-4663-8e5e-86178f000db9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:55.536776 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-252283ad-8224-4663-8e5e-86178f000db9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:55.537275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-252283ad-8224-4663-8e5e-86178f000db9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:55.537921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-252283ad-8224-4663-8e5e-86178f000db9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:55.538770 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-252283ad-8224-4663-8e5e-86178f000db9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:55.539280 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-252283ad-8224-4663-8e5e-86178f000db9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:55.540127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-252283ad-8224-4663-8e5e-86178f000db9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:55.693301 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-252283ad-8224-4663-8e5e-86178f000db9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:55.701798 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-252283ad-8224-4663-8e5e-86178f000db9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1686 microversion: 2.1 time: 0.176780 Aug 27 06:16:55.702387 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3961/7935] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:55 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:55.722895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3e6015cc-19ce-46dd-acc0-94b44730240e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:16:55.723505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3e6015cc-19ce-46dd-acc0-94b44730240e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:55.731421 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e6015cc-19ce-46dd-acc0-94b44730240e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:55.731919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e6015cc-19ce-46dd-acc0-94b44730240e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:55.732369 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e6015cc-19ce-46dd-acc0-94b44730240e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:55.733086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e6015cc-19ce-46dd-acc0-94b44730240e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:55.733547 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e6015cc-19ce-46dd-acc0-94b44730240e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:55.734062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3e6015cc-19ce-46dd-acc0-94b44730240e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:55.804886 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3e6015cc-19ce-46dd-acc0-94b44730240e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7/action" status: 204 len: 0 microversion: 2.1 time: 0.085688 Aug 27 06:16:55.805550 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3975/7936] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:16:55 2022] POST /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:16:55.815055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-afc8824f-7f06-4e66-8b10-791740e49cb6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:55.815717 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-afc8824f-7f06-4e66-8b10-791740e49cb6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:55.821779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-afc8824f-7f06-4e66-8b10-791740e49cb6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:55.822220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-afc8824f-7f06-4e66-8b10-791740e49cb6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:55.822674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-afc8824f-7f06-4e66-8b10-791740e49cb6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:55.823423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-afc8824f-7f06-4e66-8b10-791740e49cb6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:55.823899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-afc8824f-7f06-4e66-8b10-791740e49cb6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:55.824339 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-afc8824f-7f06-4e66-8b10-791740e49cb6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:56.021052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-afc8824f-7f06-4e66-8b10-791740e49cb6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:56.030401 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-afc8824f-7f06-4e66-8b10-791740e49cb6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1686 microversion: 2.1 time: 0.219890 Aug 27 06:16:56.031359 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3962/7937] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:55 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1686 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:56.053494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ae3d47f-eb6b-461a-91f5-6071081c5869 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:56.054848 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5ae3d47f-eb6b-461a-91f5-6071081c5869 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:56.061980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae3d47f-eb6b-461a-91f5-6071081c5869 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:56.062479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae3d47f-eb6b-461a-91f5-6071081c5869 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:56.062930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae3d47f-eb6b-461a-91f5-6071081c5869 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:56.063679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae3d47f-eb6b-461a-91f5-6071081c5869 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:56.064174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae3d47f-eb6b-461a-91f5-6071081c5869 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:56.064608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ae3d47f-eb6b-461a-91f5-6071081c5869 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:56.245329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5ae3d47f-eb6b-461a-91f5-6071081c5869 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:56.254259 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5ae3d47f-eb6b-461a-91f5-6071081c5869 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1686 microversion: 2.1 time: 0.206554 Aug 27 06:16:56.254842 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3976/7938] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:56 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1686 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:57.277727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-19c915d2-2e93-49b1-b8fc-c8299ac8b29a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:16:57.278355 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-19c915d2-2e93-49b1-b8fc-c8299ac8b29a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:16:57.285460 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19c915d2-2e93-49b1-b8fc-c8299ac8b29a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:57.286587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19c915d2-2e93-49b1-b8fc-c8299ac8b29a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:57.287267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19c915d2-2e93-49b1-b8fc-c8299ac8b29a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:57.288377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19c915d2-2e93-49b1-b8fc-c8299ac8b29a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:57.288847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19c915d2-2e93-49b1-b8fc-c8299ac8b29a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:57.290103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-19c915d2-2e93-49b1-b8fc-c8299ac8b29a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:57.456970 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-19c915d2-2e93-49b1-b8fc-c8299ac8b29a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:16:57.468417 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-19c915d2-2e93-49b1-b8fc-c8299ac8b29a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1678 microversion: 2.1 time: 0.194973 Aug 27 06:16:57.469436 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3963/7939] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:16:57 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:16:57.565186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-145794c0-3060-4b30-89aa-c317bc6c77e4 req-23dd6398-da79-4349-bd2b-e7da08791dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ab0784-2731-4e46-ab77-c6f5b50720f7", "name": "network-vif-plugged", "status": "completed", "tag": "ef588ddd-48b8-4543-a778-dfe36fb9ba07"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:16:57.576634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-145794c0-3060-4b30-89aa-c317bc6c77e4 req-23dd6398-da79-4349-bd2b-e7da08791dcc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:16:57.577124 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-145794c0-3060-4b30-89aa-c317bc6c77e4 req-23dd6398-da79-4349-bd2b-e7da08791dcc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:16:57.577740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-145794c0-3060-4b30-89aa-c317bc6c77e4 req-23dd6398-da79-4349-bd2b-e7da08791dcc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:16:57.591136 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-145794c0-3060-4b30-89aa-c317bc6c77e4 req-23dd6398-da79-4349-bd2b-e7da08791dcc service nova] Creating event network-vif-plugged:ef588ddd-48b8-4543-a778-dfe36fb9ba07 for instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 on n-h2-820368-35 Aug 27 06:16:57.596516 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-145794c0-3060-4b30-89aa-c317bc6c77e4 req-23dd6398-da79-4349-bd2b-e7da08791dcc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045806 Aug 27 06:16:57.597339 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3977/7940] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:17:27.694997 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ddf4ea3e-da5f-4a93-b9ce-d58565293ae2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:17:27.697244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ddf4ea3e-da5f-4a93-b9ce-d58565293ae2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:17:27.699742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=30 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:17:27.700597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:17:27.706517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf4ea3e-da5f-4a93-b9ce-d58565293ae2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:27.707017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf4ea3e-da5f-4a93-b9ce-d58565293ae2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:27.707518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf4ea3e-da5f-4a93-b9ce-d58565293ae2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:27.708855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf4ea3e-da5f-4a93-b9ce-d58565293ae2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:27.709362 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf4ea3e-da5f-4a93-b9ce-d58565293ae2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:27.709833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ddf4ea3e-da5f-4a93-b9ce-d58565293ae2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:27.769841 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ddf4ea3e-da5f-4a93-b9ce-d58565293ae2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7/action" status: 200 len: 24579 microversion: 2.1 time: 0.079828 Aug 27 06:17:27.771405 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3964/7941] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:17:27 2022] POST /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7/action => generated 24579 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 06:17:44.857313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-055922d3-53c5-4129-b2af-bb2fd262aaf2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:17:44.859382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-055922d3-53c5-4129-b2af-bb2fd262aaf2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:17:44.860661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:17:44.862006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:17:44.885877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=26 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:17:44.886643 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:17:44.900187 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-055922d3-53c5-4129-b2af-bb2fd262aaf2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:44.901122 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-055922d3-53c5-4129-b2af-bb2fd262aaf2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:44.901810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-055922d3-53c5-4129-b2af-bb2fd262aaf2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:44.902777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-055922d3-53c5-4129-b2af-bb2fd262aaf2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:44.903497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-055922d3-53c5-4129-b2af-bb2fd262aaf2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:44.904159 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-055922d3-53c5-4129-b2af-bb2fd262aaf2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:44.957519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-055922d3-53c5-4129-b2af-bb2fd262aaf2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:17:44.976219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-2bcb556e-2a44-428b-a373-28559c95074e req-3e1106a6-e4c5-4a2a-a0fc-102aeb86485c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ab0784-2731-4e46-ab77-c6f5b50720f7", "tag": "ef588ddd-48b8-4543-a778-dfe36fb9ba07"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:17:44.989471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2bcb556e-2a44-428b-a373-28559c95074e req-3e1106a6-e4c5-4a2a-a0fc-102aeb86485c service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:44.990375 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2bcb556e-2a44-428b-a373-28559c95074e req-3e1106a6-e4c5-4a2a-a0fc-102aeb86485c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:44.991220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-2bcb556e-2a44-428b-a373-28559c95074e req-3e1106a6-e4c5-4a2a-a0fc-102aeb86485c service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:45.003947 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-2bcb556e-2a44-428b-a373-28559c95074e req-3e1106a6-e4c5-4a2a-a0fc-102aeb86485c service nova] Creating event network-changed:ef588ddd-48b8-4543-a778-dfe36fb9ba07 for instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 on n-h2-820368-35 Aug 27 06:17:45.011546 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-2bcb556e-2a44-428b-a373-28559c95074e req-3e1106a6-e4c5-4a2a-a0fc-102aeb86485c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165101 Aug 27 06:17:45.012884 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3965/7942] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:17:45.067352 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-055922d3-53c5-4129-b2af-bb2fd262aaf2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "DELETE /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 204 len: 0 microversion: 2.1 time: 0.221706 Aug 27 06:17:45.068853 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3978/7943] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:17:44 2022] DELETE /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:17:45.082161 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c8c886f8-52dd-463f-9c9a-3005fbcdc5e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:17:45.084343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c8c886f8-52dd-463f-9c9a-3005fbcdc5e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:17:45.094068 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8c886f8-52dd-463f-9c9a-3005fbcdc5e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:45.095385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8c886f8-52dd-463f-9c9a-3005fbcdc5e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:45.096153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8c886f8-52dd-463f-9c9a-3005fbcdc5e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:45.097442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8c886f8-52dd-463f-9c9a-3005fbcdc5e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:45.099000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8c886f8-52dd-463f-9c9a-3005fbcdc5e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:45.099698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c8c886f8-52dd-463f-9c9a-3005fbcdc5e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:45.277111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c8c886f8-52dd-463f-9c9a-3005fbcdc5e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:17:45.286537 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c8c886f8-52dd-463f-9c9a-3005fbcdc5e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1684 microversion: 2.1 time: 0.210338 Aug 27 06:17:45.291195 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3966/7944] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:17:45 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1684 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:17:46.310731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2cadb068-fe59-435b-b370-109bc5fafc62 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:17:46.311464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2cadb068-fe59-435b-b370-109bc5fafc62 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:17:46.319040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cadb068-fe59-435b-b370-109bc5fafc62 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:46.319567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cadb068-fe59-435b-b370-109bc5fafc62 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:46.320011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cadb068-fe59-435b-b370-109bc5fafc62 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:46.320716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cadb068-fe59-435b-b370-109bc5fafc62 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:46.321172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cadb068-fe59-435b-b370-109bc5fafc62 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:46.321599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2cadb068-fe59-435b-b370-109bc5fafc62 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:46.507163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2cadb068-fe59-435b-b370-109bc5fafc62 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:17:46.516804 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2cadb068-fe59-435b-b370-109bc5fafc62 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1684 microversion: 2.1 time: 0.210318 Aug 27 06:17:46.523402 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3979/7945] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:17:46 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1684 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:17:47.363804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-442a24eb-b4e6-4c7d-994c-2cbd4a18965e req-dc7f3521-d9bd-4cf1-a636-47d99db0fedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ab0784-2731-4e46-ab77-c6f5b50720f7", "name": "network-vif-deleted", "tag": "ef588ddd-48b8-4543-a778-dfe36fb9ba07"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:17:47.373394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-442a24eb-b4e6-4c7d-994c-2cbd4a18965e req-dc7f3521-d9bd-4cf1-a636-47d99db0fedf service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:47.373898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-442a24eb-b4e6-4c7d-994c-2cbd4a18965e req-dc7f3521-d9bd-4cf1-a636-47d99db0fedf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:47.374350 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-442a24eb-b4e6-4c7d-994c-2cbd4a18965e req-dc7f3521-d9bd-4cf1-a636-47d99db0fedf service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:47.386509 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-442a24eb-b4e6-4c7d-994c-2cbd4a18965e req-dc7f3521-d9bd-4cf1-a636-47d99db0fedf service nova] Creating event network-vif-deleted:ef588ddd-48b8-4543-a778-dfe36fb9ba07 for instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 on n-h2-820368-35 Aug 27 06:17:47.392207 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-442a24eb-b4e6-4c7d-994c-2cbd4a18965e req-dc7f3521-d9bd-4cf1-a636-47d99db0fedf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088698 Aug 27 06:17:47.392995 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3967/7946] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:17:47.538423 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:17:47.539052 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:17:47.547561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:47.548059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:47.548538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:47.549256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:47.549718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:47.550193 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:47.584778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:47.585269 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:47.585714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:47.586177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lazy-loading 'fault' on Instance uuid 29ab0784-2731-4e46-ab77-c6f5b50720f7 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:17:47.629545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:17:47.637784 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-48330301-b481-4f6d-845c-31c1e16426f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 200 len: 1355 microversion: 2.1 time: 0.103682 Aug 27 06:17:47.638703 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3980/7947] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:17:47 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:17:48.661658 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:17:48.662380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 29ab0784-2731-4e46-ab77-c6f5b50720f7] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:17:48.669893 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:48.670392 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:48.670844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:48.671751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:17:48.672217 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:17:48.672656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:17:48.694611 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] HTTP exception thrown: Instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 could not be found. Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Request method failure captured: Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 HTTP/1.1 Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbU6aB_e75aqp8NqqqVAdR5aTLA1Q6hTA4TQG7g4UP-wugXdWdOQbKYZdiF7Eb_yQ2RNMIFzHOe9xBFRey4TYo5y377lxnb_8a1DEXSy6GAWG-hMmKOxzfz8KSOhJR9A4wcCgVgXBokca2F0ylnOdGjNKOJhU5qnilgI35mBzwauMaI Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: f100645ec41f471bad7489ea8fbcbaf0 Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f100645ec41f471bad7489ea8fbcbaf0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: f100645ec41f471bad7489ea8fbcbaf0 Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestNetworkAdvancedServerOps-38834833-project Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 52d1f89be8a74799b32e239ff34959c2 Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestNetworkAdvancedServerOps-38834833-project Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 could not be found. Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '29ab0784-2731-4e46-ab77-c6f5b50720f7'} Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 could not be found. Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 could not be found. Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:17:48.696998 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:17:48.703447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:17:48.703447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:17:48.703447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:17:48.703447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:17:48.703447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:17:48.703447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:17:48.703447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 could not be found. Aug 27 06:17:48.703447 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:17:48.703447 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Returning 404 to user: Instance 29ab0784-2731-4e46-ab77-c6f5b50720f7 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:17:48.703447 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-23a71ace-5830-4f1c-b08c-18a082e62ebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7" status: 404 len: 111 microversion: 2.1 time: 0.041676 Aug 27 06:17:48.703447 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3968/7948] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:17:48 2022] GET /compute/v2.1/servers/29ab0784-2731-4e46-ab77-c6f5b50720f7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:17:53.318876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2623cbf3-262d-4475-8a49-cffd7174df01 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '.version_select at 0x7fb564104940>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:17:53.355580 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2623cbf3-262d-4475-8a49-cffd7174df01 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-661440352" status: 202 len: 0 microversion: 2.1 time: 0.041074 Aug 27 06:17:53.356567 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3981/7949] 10.222.0.58 () {58 vars in 1281 bytes} [Sat Aug 27 06:17:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-661440352 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:17:53.387847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1e222ec8-d46d-4b99-9538-d7a96220fa68 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'create', calling method: .version_select at 0x7fb55fe4f820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2094295916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6Wlcbp5eCr19I2YfaBUMbjYtz2b3TAlBtSICTbGGT34orTf5DjqQ2gP81It0YQB3HpsbAlVXFFCu02yWMsLHBnFiYvDiB0a+eiGASIdfYNQnD8ebBuuGvV92Rz1Uvigg=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:17:53.407563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-1e222ec8-d46d-4b99-9538-d7a96220fa68 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:17:53.414222 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-1e222ec8-d46d-4b99-9538-d7a96220fa68 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for user 52d1f89be8a74799b32e239ff34959c2 and project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:17:53.447599 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1e222ec8-d46d-4b99-9538-d7a96220fa68 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.066942 Aug 27 06:17:53.458281 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3969/7950] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 06:17:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:17:59.559426 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-302274543", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "b9340c0a-be80-4a19-a296-33705a37a642"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2094295916", "security_groups": [{"name": "tempest-secgroup-smoke-1922985202"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:17:59.574408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:17:59.704083 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] validate_networks() for [('b9340c0a-be80-4a19-a296-33705a37a642', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:18:00.329156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:18:00.330075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:18:00.330777 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:18:00.331467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:18:00.332784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:18:00.346166 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:00.347176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:00.348553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:00.349575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:00.351911 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:00.352634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:00.380540 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:18:00.392970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for user 52d1f89be8a74799b32e239ff34959c2 and project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:18:00.414718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:18:00.417606 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:18:00.484462 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4bc5edf7-4ee5-4afa-9b5c-5051c034827b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.928847 Aug 27 06:18:00.486465 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3982/7951] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:17:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:18:00.498095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec0c26cd-2314-47ef-8f7d-1aa830b0223e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:00.499521 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec0c26cd-2314-47ef-8f7d-1aa830b0223e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:00.510691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=12 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:18:00.638980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ec0c26cd-2314-47ef-8f7d-1aa830b0223e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:00.648843 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec0c26cd-2314-47ef-8f7d-1aa830b0223e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1266 microversion: 2.1 time: 0.154758 Aug 27 06:18:00.650207 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3970/7952] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:00 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:01.670111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-367e82cc-a3f4-4867-9dac-6872c64d552b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:01.670769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-367e82cc-a3f4-4867-9dac-6872c64d552b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:01.679147 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-367e82cc-a3f4-4867-9dac-6872c64d552b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:01.679604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-367e82cc-a3f4-4867-9dac-6872c64d552b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:01.680074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-367e82cc-a3f4-4867-9dac-6872c64d552b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:01.680850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-367e82cc-a3f4-4867-9dac-6872c64d552b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:01.681311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-367e82cc-a3f4-4867-9dac-6872c64d552b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:01.681747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-367e82cc-a3f4-4867-9dac-6872c64d552b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:01.773980 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-367e82cc-a3f4-4867-9dac-6872c64d552b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:01.785457 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-367e82cc-a3f4-4867-9dac-6872c64d552b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1318 microversion: 2.1 time: 0.119181 Aug 27 06:18:01.799604 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3983/7953] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:01 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1318 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:02.807677 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c09ca80d-93e5-4905-a2c5-aefd9f935ee0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:02.808840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c09ca80d-93e5-4905-a2c5-aefd9f935ee0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:02.821837 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c09ca80d-93e5-4905-a2c5-aefd9f935ee0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:02.822359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c09ca80d-93e5-4905-a2c5-aefd9f935ee0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:02.822827 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c09ca80d-93e5-4905-a2c5-aefd9f935ee0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:02.823594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c09ca80d-93e5-4905-a2c5-aefd9f935ee0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:02.824064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c09ca80d-93e5-4905-a2c5-aefd9f935ee0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:02.824507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c09ca80d-93e5-4905-a2c5-aefd9f935ee0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:03.091821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c09ca80d-93e5-4905-a2c5-aefd9f935ee0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:03.100362 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c09ca80d-93e5-4905-a2c5-aefd9f935ee0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1392 microversion: 2.1 time: 0.296900 Aug 27 06:18:03.101062 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3971/7954] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:02 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1392 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:03.600850 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-249d1476-53d9-46fb-abde-1e8f0313c29d req-685639e6-bc3a-4a19-8c25-5bfd29602286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ea6777-3639-410c-9959-57b239d8a1bf", "tag": "a4d7ab03-3fc5-445a-9bd8-3a72ee9c25e1"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:18:03.619391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-249d1476-53d9-46fb-abde-1e8f0313c29d req-685639e6-bc3a-4a19-8c25-5bfd29602286 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:03.620120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-249d1476-53d9-46fb-abde-1e8f0313c29d req-685639e6-bc3a-4a19-8c25-5bfd29602286 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:03.621812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-249d1476-53d9-46fb-abde-1e8f0313c29d req-685639e6-bc3a-4a19-8c25-5bfd29602286 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:03.641253 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-249d1476-53d9-46fb-abde-1e8f0313c29d req-685639e6-bc3a-4a19-8c25-5bfd29602286 service nova] Creating event network-changed:a4d7ab03-3fc5-445a-9bd8-3a72ee9c25e1 for instance 66ea6777-3639-410c-9959-57b239d8a1bf on n-h1-820368-35 Aug 27 06:18:03.647543 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-249d1476-53d9-46fb-abde-1e8f0313c29d req-685639e6-bc3a-4a19-8c25-5bfd29602286 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051244 Aug 27 06:18:03.648682 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3984/7955] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:18:04.121857 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d876d07b-6bd6-4d09-bdad-e13531c76d21 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:04.122785 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d876d07b-6bd6-4d09-bdad-e13531c76d21 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:04.130590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d876d07b-6bd6-4d09-bdad-e13531c76d21 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:04.131428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d876d07b-6bd6-4d09-bdad-e13531c76d21 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:04.131981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d876d07b-6bd6-4d09-bdad-e13531c76d21 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:04.132840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d876d07b-6bd6-4d09-bdad-e13531c76d21 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:04.133407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d876d07b-6bd6-4d09-bdad-e13531c76d21 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:04.133945 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d876d07b-6bd6-4d09-bdad-e13531c76d21 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:04.277999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d876d07b-6bd6-4d09-bdad-e13531c76d21 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:04.286722 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d876d07b-6bd6-4d09-bdad-e13531c76d21 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1392 microversion: 2.1 time: 0.168871 Aug 27 06:18:04.287431 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3972/7956] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:04 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:05.309476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-cea8168c-1998-49cc-b22b-5b24b0f32212 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:05.310186 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-cea8168c-1998-49cc-b22b-5b24b0f32212 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:05.317065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cea8168c-1998-49cc-b22b-5b24b0f32212 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:05.317551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cea8168c-1998-49cc-b22b-5b24b0f32212 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:05.318202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cea8168c-1998-49cc-b22b-5b24b0f32212 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:05.318920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cea8168c-1998-49cc-b22b-5b24b0f32212 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:05.319401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cea8168c-1998-49cc-b22b-5b24b0f32212 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:05.319835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-cea8168c-1998-49cc-b22b-5b24b0f32212 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:05.453647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-cea8168c-1998-49cc-b22b-5b24b0f32212 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:05.461763 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-cea8168c-1998-49cc-b22b-5b24b0f32212 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1392 microversion: 2.1 time: 0.157323 Aug 27 06:18:05.462771 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3985/7957] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:05 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:06.483766 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-378ac15e-c236-4847-b4fd-61dd2af4d9f4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:06.484858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-378ac15e-c236-4847-b4fd-61dd2af4d9f4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:06.493795 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-378ac15e-c236-4847-b4fd-61dd2af4d9f4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:06.494376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-378ac15e-c236-4847-b4fd-61dd2af4d9f4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:06.495050 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-378ac15e-c236-4847-b4fd-61dd2af4d9f4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:06.495817 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-378ac15e-c236-4847-b4fd-61dd2af4d9f4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:06.496559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-378ac15e-c236-4847-b4fd-61dd2af4d9f4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:06.497615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-378ac15e-c236-4847-b4fd-61dd2af4d9f4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:06.654225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-378ac15e-c236-4847-b4fd-61dd2af4d9f4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:06.663755 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-378ac15e-c236-4847-b4fd-61dd2af4d9f4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1392 microversion: 2.1 time: 0.184880 Aug 27 06:18:06.664361 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3973/7958] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:06 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:07.685596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b9dc834b-92fb-4d64-a622-c431f87baa56 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:07.686233 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b9dc834b-92fb-4d64-a622-c431f87baa56 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:07.692513 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9dc834b-92fb-4d64-a622-c431f87baa56 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:07.693010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9dc834b-92fb-4d64-a622-c431f87baa56 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:07.693461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9dc834b-92fb-4d64-a622-c431f87baa56 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:07.694173 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9dc834b-92fb-4d64-a622-c431f87baa56 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:07.694638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9dc834b-92fb-4d64-a622-c431f87baa56 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:07.695075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b9dc834b-92fb-4d64-a622-c431f87baa56 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:07.840909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b9dc834b-92fb-4d64-a622-c431f87baa56 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:07.849382 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b9dc834b-92fb-4d64-a622-c431f87baa56 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1392 microversion: 2.1 time: 0.167926 Aug 27 06:18:07.850030 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3986/7959] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:07 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:08.870623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-37942d50-7bc1-4e5e-9ae3-0fef4969a8a0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:08.871351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-37942d50-7bc1-4e5e-9ae3-0fef4969a8a0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:08.879796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37942d50-7bc1-4e5e-9ae3-0fef4969a8a0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:08.880202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37942d50-7bc1-4e5e-9ae3-0fef4969a8a0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:08.880663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37942d50-7bc1-4e5e-9ae3-0fef4969a8a0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:08.881403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37942d50-7bc1-4e5e-9ae3-0fef4969a8a0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:08.881878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37942d50-7bc1-4e5e-9ae3-0fef4969a8a0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:08.882325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-37942d50-7bc1-4e5e-9ae3-0fef4969a8a0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:09.031559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-37942d50-7bc1-4e5e-9ae3-0fef4969a8a0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:09.041807 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-37942d50-7bc1-4e5e-9ae3-0fef4969a8a0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1392 microversion: 2.1 time: 0.175455 Aug 27 06:18:09.042398 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3974/7960] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:08 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:10.063869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d7a94076-91e5-4303-9bd8-197c64f85a7a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:10.064556 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d7a94076-91e5-4303-9bd8-197c64f85a7a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:10.071811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7a94076-91e5-4303-9bd8-197c64f85a7a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:10.072315 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7a94076-91e5-4303-9bd8-197c64f85a7a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:10.072764 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7a94076-91e5-4303-9bd8-197c64f85a7a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:10.073474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7a94076-91e5-4303-9bd8-197c64f85a7a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:10.073934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7a94076-91e5-4303-9bd8-197c64f85a7a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:10.074365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d7a94076-91e5-4303-9bd8-197c64f85a7a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:10.213414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d7a94076-91e5-4303-9bd8-197c64f85a7a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:10.221381 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d7a94076-91e5-4303-9bd8-197c64f85a7a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1392 microversion: 2.1 time: 0.161632 Aug 27 06:18:10.222192 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3987/7961] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:10 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:10.977614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:18:11.033826 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b2922282-ab3f-45e5-999a-1b6ed559250e req-28cdd02a-9c99-452e-8a03-250c656dee70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ea6777-3639-410c-9959-57b239d8a1bf", "name": "network-vif-plugged", "status": "completed", "tag": "a4d7ab03-3fc5-445a-9bd8-3a72ee9c25e1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:18:11.043891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b2922282-ab3f-45e5-999a-1b6ed559250e req-28cdd02a-9c99-452e-8a03-250c656dee70 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:11.044483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b2922282-ab3f-45e5-999a-1b6ed559250e req-28cdd02a-9c99-452e-8a03-250c656dee70 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:11.045547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b2922282-ab3f-45e5-999a-1b6ed559250e req-28cdd02a-9c99-452e-8a03-250c656dee70 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:11.057039 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b2922282-ab3f-45e5-999a-1b6ed559250e req-28cdd02a-9c99-452e-8a03-250c656dee70 service nova] Creating event network-vif-plugged:a4d7ab03-3fc5-445a-9bd8-3a72ee9c25e1 for instance 66ea6777-3639-410c-9959-57b239d8a1bf on n-h1-820368-35 Aug 27 06:18:11.062026 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b2922282-ab3f-45e5-999a-1b6ed559250e req-28cdd02a-9c99-452e-8a03-250c656dee70 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094073 Aug 27 06:18:11.062941 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3975/7962] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:18:11.243309 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-11fb2f6c-687d-4466-9a18-a6de9b5d67d7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:11.243937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-11fb2f6c-687d-4466-9a18-a6de9b5d67d7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:11.246250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:18:11.247194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:18:11.255140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11fb2f6c-687d-4466-9a18-a6de9b5d67d7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:11.255739 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11fb2f6c-687d-4466-9a18-a6de9b5d67d7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:11.256202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11fb2f6c-687d-4466-9a18-a6de9b5d67d7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:11.256918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11fb2f6c-687d-4466-9a18-a6de9b5d67d7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:11.257381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11fb2f6c-687d-4466-9a18-a6de9b5d67d7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:11.257812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-11fb2f6c-687d-4466-9a18-a6de9b5d67d7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:11.393318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-11fb2f6c-687d-4466-9a18-a6de9b5d67d7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:11.402009 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-11fb2f6c-687d-4466-9a18-a6de9b5d67d7 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1392 microversion: 2.1 time: 0.162622 Aug 27 06:18:11.402805 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3988/7963] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:11 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:18:12.424554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-53b094e8-7a0c-4bff-9a35-54fb086f4aaa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:12.425800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-53b094e8-7a0c-4bff-9a35-54fb086f4aaa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:12.432598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53b094e8-7a0c-4bff-9a35-54fb086f4aaa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:12.433485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53b094e8-7a0c-4bff-9a35-54fb086f4aaa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:12.434197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53b094e8-7a0c-4bff-9a35-54fb086f4aaa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:12.434337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53b094e8-7a0c-4bff-9a35-54fb086f4aaa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:12.434782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53b094e8-7a0c-4bff-9a35-54fb086f4aaa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:12.435247 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-53b094e8-7a0c-4bff-9a35-54fb086f4aaa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:12.580559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-53b094e8-7a0c-4bff-9a35-54fb086f4aaa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:12.589964 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-53b094e8-7a0c-4bff-9a35-54fb086f4aaa tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1392 microversion: 2.1 time: 0.170444 Aug 27 06:18:12.603461 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3976/7964] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:12 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:13.611833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d8665a17-3697-47cf-82c2-f975ba245e46 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:13.612375 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d8665a17-3697-47cf-82c2-f975ba245e46 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:13.619804 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8665a17-3697-47cf-82c2-f975ba245e46 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:13.620311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8665a17-3697-47cf-82c2-f975ba245e46 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:13.620762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8665a17-3697-47cf-82c2-f975ba245e46 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:13.621487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8665a17-3697-47cf-82c2-f975ba245e46 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:13.621951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8665a17-3697-47cf-82c2-f975ba245e46 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:13.622391 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d8665a17-3697-47cf-82c2-f975ba245e46 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:13.763427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d8665a17-3697-47cf-82c2-f975ba245e46 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:13.777140 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d8665a17-3697-47cf-82c2-f975ba245e46 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1565 microversion: 2.1 time: 0.168782 Aug 27 06:18:13.777737 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3989/7965] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:13 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:13.798712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d0619850-425d-4210-be8d-438ec2c3bd52 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:13.799980 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d0619850-425d-4210-be8d-438ec2c3bd52 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:13.807958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0619850-425d-4210-be8d-438ec2c3bd52 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:13.808645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0619850-425d-4210-be8d-438ec2c3bd52 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:13.809100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0619850-425d-4210-be8d-438ec2c3bd52 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:13.809818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0619850-425d-4210-be8d-438ec2c3bd52 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:13.810283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0619850-425d-4210-be8d-438ec2c3bd52 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:13.810723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d0619850-425d-4210-be8d-438ec2c3bd52 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:13.953359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d0619850-425d-4210-be8d-438ec2c3bd52 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:13.962049 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d0619850-425d-4210-be8d-438ec2c3bd52 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1565 microversion: 2.1 time: 0.167472 Aug 27 06:18:13.962757 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3977/7966] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:13 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:15.641801 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ed709171-d63e-4eff-832e-1dec89a0cef0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:18:15.642505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ed709171-d63e-4eff-832e-1dec89a0cef0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:15.645052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b4e86da8-bd7c-4f7b-8364-4d3faf6af27d req-1794609a-a0bd-4813-adc6-3a390c3fd5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ea6777-3639-410c-9959-57b239d8a1bf", "tag": "a4d7ab03-3fc5-445a-9bd8-3a72ee9c25e1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:18:15.648510 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:18:15.654954 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:18:15.662977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed709171-d63e-4eff-832e-1dec89a0cef0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:15.665587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed709171-d63e-4eff-832e-1dec89a0cef0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:15.666244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed709171-d63e-4eff-832e-1dec89a0cef0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:15.668887 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b4e86da8-bd7c-4f7b-8364-4d3faf6af27d req-1794609a-a0bd-4813-adc6-3a390c3fd5ba service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:15.669926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed709171-d63e-4eff-832e-1dec89a0cef0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:15.670397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed709171-d63e-4eff-832e-1dec89a0cef0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:15.670836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ed709171-d63e-4eff-832e-1dec89a0cef0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:15.673596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b4e86da8-bd7c-4f7b-8364-4d3faf6af27d req-1794609a-a0bd-4813-adc6-3a390c3fd5ba service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:15.674046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b4e86da8-bd7c-4f7b-8364-4d3faf6af27d req-1794609a-a0bd-4813-adc6-3a390c3fd5ba service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:15.701338 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b4e86da8-bd7c-4f7b-8364-4d3faf6af27d req-1794609a-a0bd-4813-adc6-3a390c3fd5ba service nova] Creating event network-changed:a4d7ab03-3fc5-445a-9bd8-3a72ee9c25e1 for instance 66ea6777-3639-410c-9959-57b239d8a1bf on n-h1-820368-35 Aug 27 06:18:15.709335 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b4e86da8-bd7c-4f7b-8364-4d3faf6af27d req-1794609a-a0bd-4813-adc6-3a390c3fd5ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071748 Aug 27 06:18:15.716482 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3978/7967] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:18:15.870232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ed709171-d63e-4eff-832e-1dec89a0cef0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:18:15.880651 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ed709171-d63e-4eff-832e-1dec89a0cef0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1565 microversion: 2.1 time: 0.246557 Aug 27 06:18:15.882240 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3990/7968] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:18:15 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1565 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:18:49.213870 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:18:49.214695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=40 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:18:49.219609 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5a9ef86e-c021-44b2-a1b3-2566b0b59d1c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:18:49.222508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5a9ef86e-c021-44b2-a1b3-2566b0b59d1c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:18:49.229777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9ef86e-c021-44b2-a1b3-2566b0b59d1c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:49.230295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9ef86e-c021-44b2-a1b3-2566b0b59d1c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:49.230741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9ef86e-c021-44b2-a1b3-2566b0b59d1c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:49.231469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9ef86e-c021-44b2-a1b3-2566b0b59d1c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:18:49.231931 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9ef86e-c021-44b2-a1b3-2566b0b59d1c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:18:49.232361 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5a9ef86e-c021-44b2-a1b3-2566b0b59d1c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:18:49.301153 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5a9ef86e-c021-44b2-a1b3-2566b0b59d1c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf/action" status: 200 len: 24572 microversion: 2.1 time: 0.089277 Aug 27 06:18:49.309014 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3979/7969] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:18:49 2022] POST /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf/action => generated 24572 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:19:28.384114 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:19:28.385024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=46 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:19:28.389820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1e93d967-3649-466b-a0b9-0232c6c9b072 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:19:28.397631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e93d967-3649-466b-a0b9-0232c6c9b072 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:28.398118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e93d967-3649-466b-a0b9-0232c6c9b072 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:28.398561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1e93d967-3649-466b-a0b9-0232c6c9b072 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:28.423354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1e93d967-3649-466b-a0b9-0232c6c9b072 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Going to try to stop instance {{(pid=128548) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 06:19:28.471631 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1e93d967-3649-466b-a0b9-0232c6c9b072 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf/action" status: 202 len: 0 microversion: 2.1 time: 0.088960 Aug 27 06:19:28.472328 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3991/7970] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:19:28 2022] POST /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:19:28.481468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-91bcea8b-d851-4c1c-9667-4c077e28beab tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:28.482595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-91bcea8b-d851-4c1c-9667-4c077e28beab tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:28.488535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:19:28.489442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:19:28.495583 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91bcea8b-d851-4c1c-9667-4c077e28beab tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:28.497250 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91bcea8b-d851-4c1c-9667-4c077e28beab tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:28.497714 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91bcea8b-d851-4c1c-9667-4c077e28beab tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:28.498464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91bcea8b-d851-4c1c-9667-4c077e28beab tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:28.498950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91bcea8b-d851-4c1c-9667-4c077e28beab tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:28.499435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91bcea8b-d851-4c1c-9667-4c077e28beab tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:28.644276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-91bcea8b-d851-4c1c-9667-4c077e28beab tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:28.652345 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-91bcea8b-d851-4c1c-9667-4c077e28beab tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1694 microversion: 2.1 time: 0.175237 Aug 27 06:19:28.652929 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3980/7971] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:28 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:19:29.676258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-51273272-577a-4c30-9882-5e3e0e5aaebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:29.676977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-51273272-577a-4c30-9882-5e3e0e5aaebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:29.684080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51273272-577a-4c30-9882-5e3e0e5aaebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:29.684587 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51273272-577a-4c30-9882-5e3e0e5aaebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:29.685035 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51273272-577a-4c30-9882-5e3e0e5aaebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:29.685763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51273272-577a-4c30-9882-5e3e0e5aaebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:29.686237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51273272-577a-4c30-9882-5e3e0e5aaebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:29.686667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-51273272-577a-4c30-9882-5e3e0e5aaebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:29.834410 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-51273272-577a-4c30-9882-5e3e0e5aaebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:29.842609 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-51273272-577a-4c30-9882-5e3e0e5aaebd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1694 microversion: 2.1 time: 0.172297 Aug 27 06:19:29.843220 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3992/7972] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:29 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:19:30.864988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4e160181-7bdb-4036-90c0-bd9a548bd65e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:30.865615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4e160181-7bdb-4036-90c0-bd9a548bd65e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:30.872636 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e160181-7bdb-4036-90c0-bd9a548bd65e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:30.873148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e160181-7bdb-4036-90c0-bd9a548bd65e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:30.873610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e160181-7bdb-4036-90c0-bd9a548bd65e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:30.874343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e160181-7bdb-4036-90c0-bd9a548bd65e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:30.874823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e160181-7bdb-4036-90c0-bd9a548bd65e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:30.875402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4e160181-7bdb-4036-90c0-bd9a548bd65e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:31.012523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4e160181-7bdb-4036-90c0-bd9a548bd65e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:31.021273 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4e160181-7bdb-4036-90c0-bd9a548bd65e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1694 microversion: 2.1 time: 0.160859 Aug 27 06:19:31.021856 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3981/7973] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:30 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:19:32.043552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6f5e614c-438f-4bf5-93b4-9e566ce44f98 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:32.044181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6f5e614c-438f-4bf5-93b4-9e566ce44f98 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:32.051025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e614c-438f-4bf5-93b4-9e566ce44f98 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:32.051552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e614c-438f-4bf5-93b4-9e566ce44f98 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:32.051997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e614c-438f-4bf5-93b4-9e566ce44f98 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:32.052706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e614c-438f-4bf5-93b4-9e566ce44f98 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:32.053164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e614c-438f-4bf5-93b4-9e566ce44f98 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:32.053988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6f5e614c-438f-4bf5-93b4-9e566ce44f98 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:32.194006 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6f5e614c-438f-4bf5-93b4-9e566ce44f98 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:32.202045 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6f5e614c-438f-4bf5-93b4-9e566ce44f98 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1694 microversion: 2.1 time: 0.162531 Aug 27 06:19:32.202627 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3993/7974] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:32 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:19:33.224796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df529dbe-3753-4f0e-8604-7853699d4eb3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:33.225417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-df529dbe-3753-4f0e-8604-7853699d4eb3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:33.232212 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df529dbe-3753-4f0e-8604-7853699d4eb3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:33.232701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df529dbe-3753-4f0e-8604-7853699d4eb3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:33.233158 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df529dbe-3753-4f0e-8604-7853699d4eb3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:33.233892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df529dbe-3753-4f0e-8604-7853699d4eb3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:33.234353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df529dbe-3753-4f0e-8604-7853699d4eb3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:33.234789 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df529dbe-3753-4f0e-8604-7853699d4eb3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:33.367811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df529dbe-3753-4f0e-8604-7853699d4eb3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:33.375506 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df529dbe-3753-4f0e-8604-7853699d4eb3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1694 microversion: 2.1 time: 0.155275 Aug 27 06:19:33.376074 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3982/7975] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:33 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:19:34.397259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a69c71a4-4c6e-4da4-9393-e82faa5c52f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:34.397789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a69c71a4-4c6e-4da4-9393-e82faa5c52f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:34.404970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a69c71a4-4c6e-4da4-9393-e82faa5c52f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:34.405464 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a69c71a4-4c6e-4da4-9393-e82faa5c52f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:34.405907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a69c71a4-4c6e-4da4-9393-e82faa5c52f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:34.406619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a69c71a4-4c6e-4da4-9393-e82faa5c52f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:34.407104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a69c71a4-4c6e-4da4-9393-e82faa5c52f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:34.407539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a69c71a4-4c6e-4da4-9393-e82faa5c52f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:34.544891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a69c71a4-4c6e-4da4-9393-e82faa5c52f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:34.553315 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a69c71a4-4c6e-4da4-9393-e82faa5c52f9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1694 microversion: 2.1 time: 0.160787 Aug 27 06:19:34.554159 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3994/7976] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:34 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:19:35.575634 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-48bc9d28-a67a-4fbf-b2f0-779abe0e5004 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:35.576270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-48bc9d28-a67a-4fbf-b2f0-779abe0e5004 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:35.583574 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48bc9d28-a67a-4fbf-b2f0-779abe0e5004 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:35.584077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48bc9d28-a67a-4fbf-b2f0-779abe0e5004 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:35.584534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48bc9d28-a67a-4fbf-b2f0-779abe0e5004 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:35.585258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48bc9d28-a67a-4fbf-b2f0-779abe0e5004 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:35.585733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48bc9d28-a67a-4fbf-b2f0-779abe0e5004 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:35.586174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-48bc9d28-a67a-4fbf-b2f0-779abe0e5004 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:35.725821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-48bc9d28-a67a-4fbf-b2f0-779abe0e5004 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:35.733995 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-48bc9d28-a67a-4fbf-b2f0-779abe0e5004 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1694 microversion: 2.1 time: 0.162264 Aug 27 06:19:35.734737 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3983/7977] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:35 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:19:36.757306 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-af26224c-60cd-43bd-b247-1cc4904c0f75 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:36.757932 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-af26224c-60cd-43bd-b247-1cc4904c0f75 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:36.764684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af26224c-60cd-43bd-b247-1cc4904c0f75 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:36.765171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af26224c-60cd-43bd-b247-1cc4904c0f75 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:36.765616 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af26224c-60cd-43bd-b247-1cc4904c0f75 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:36.766318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af26224c-60cd-43bd-b247-1cc4904c0f75 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:36.766778 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af26224c-60cd-43bd-b247-1cc4904c0f75 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:36.767266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-af26224c-60cd-43bd-b247-1cc4904c0f75 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:36.912202 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-af26224c-60cd-43bd-b247-1cc4904c0f75 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:36.921296 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-af26224c-60cd-43bd-b247-1cc4904c0f75 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1694 microversion: 2.1 time: 0.167977 Aug 27 06:19:36.921881 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3995/7978] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:36 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:19:37.944111 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d9891f0a-d1dd-4a55-b470-e87156f9285d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:37.944747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d9891f0a-d1dd-4a55-b470-e87156f9285d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:37.951749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9891f0a-d1dd-4a55-b470-e87156f9285d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:37.952254 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9891f0a-d1dd-4a55-b470-e87156f9285d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:37.952709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9891f0a-d1dd-4a55-b470-e87156f9285d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:37.953459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9891f0a-d1dd-4a55-b470-e87156f9285d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:37.953932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9891f0a-d1dd-4a55-b470-e87156f9285d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:37.954372 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d9891f0a-d1dd-4a55-b470-e87156f9285d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:38.104632 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d9891f0a-d1dd-4a55-b470-e87156f9285d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:38.112976 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d9891f0a-d1dd-4a55-b470-e87156f9285d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1694 microversion: 2.1 time: 0.173342 Aug 27 06:19:38.113802 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3984/7979] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:37 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:19:39.134320 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f5e4d3e3-c7c2-4f2b-a455-5e2235e84ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:39.134899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f5e4d3e3-c7c2-4f2b-a455-5e2235e84ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:39.141869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5e4d3e3-c7c2-4f2b-a455-5e2235e84ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:39.142354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5e4d3e3-c7c2-4f2b-a455-5e2235e84ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:39.143470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5e4d3e3-c7c2-4f2b-a455-5e2235e84ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:39.144266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5e4d3e3-c7c2-4f2b-a455-5e2235e84ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:39.144637 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5e4d3e3-c7c2-4f2b-a455-5e2235e84ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:39.145063 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f5e4d3e3-c7c2-4f2b-a455-5e2235e84ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:39.285437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f5e4d3e3-c7c2-4f2b-a455-5e2235e84ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:39.296814 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f5e4d3e3-c7c2-4f2b-a455-5e2235e84ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1671 microversion: 2.1 time: 0.166345 Aug 27 06:19:39.297667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3996/7980] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:39 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:19:40.397835 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1eefed50-a7d3-4681-a655-cd737cd2ad47 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:19:40.400081 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1eefed50-a7d3-4681-a655-cd737cd2ad47 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:40.407408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eefed50-a7d3-4681-a655-cd737cd2ad47 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:40.407920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eefed50-a7d3-4681-a655-cd737cd2ad47 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:40.409079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eefed50-a7d3-4681-a655-cd737cd2ad47 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:40.409818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eefed50-a7d3-4681-a655-cd737cd2ad47 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:40.410292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eefed50-a7d3-4681-a655-cd737cd2ad47 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:40.410744 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1eefed50-a7d3-4681-a655-cd737cd2ad47 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:40.481324 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1eefed50-a7d3-4681-a655-cd737cd2ad47 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf/action" status: 200 len: 38390 microversion: 2.1 time: 0.087168 Aug 27 06:19:40.489038 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3985/7981] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:19:40 2022] POST /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf/action => generated 38390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:19:40.495013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ccce4adb-7065-4f4f-a96d-01e60fc4c3cd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:19:40.501405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ccce4adb-7065-4f4f-a96d-01e60fc4c3cd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:40.502407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ccce4adb-7065-4f4f-a96d-01e60fc4c3cd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:40.503064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-ccce4adb-7065-4f4f-a96d-01e60fc4c3cd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:40.527725 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ccce4adb-7065-4f4f-a96d-01e60fc4c3cd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Going to try to start instance {{(pid=128548) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 06:19:40.581319 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ccce4adb-7065-4f4f-a96d-01e60fc4c3cd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf/action" status: 202 len: 0 microversion: 2.1 time: 0.090104 Aug 27 06:19:40.581959 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3997/7982] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:19:40 2022] POST /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:19:40.591060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-492dcb52-6ec9-454c-bf5f-0755589343e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:40.591825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-492dcb52-6ec9-454c-bf5f-0755589343e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:40.599982 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492dcb52-6ec9-454c-bf5f-0755589343e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:40.600493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492dcb52-6ec9-454c-bf5f-0755589343e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:40.600984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492dcb52-6ec9-454c-bf5f-0755589343e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:40.602073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492dcb52-6ec9-454c-bf5f-0755589343e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:40.602724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492dcb52-6ec9-454c-bf5f-0755589343e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:40.603384 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-492dcb52-6ec9-454c-bf5f-0755589343e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:40.790404 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-492dcb52-6ec9-454c-bf5f-0755589343e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:40.799558 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-492dcb52-6ec9-454c-bf5f-0755589343e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1680 microversion: 2.1 time: 0.212151 Aug 27 06:19:40.814794 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3986/7983] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:40 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:19:41.824286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2a1e0602-eb57-4d6d-a0ab-2271268dd9e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:19:41.825133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2a1e0602-eb57-4d6d-a0ab-2271268dd9e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:19:41.833258 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a1e0602-eb57-4d6d-a0ab-2271268dd9e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:41.833407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a1e0602-eb57-4d6d-a0ab-2271268dd9e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:41.833897 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a1e0602-eb57-4d6d-a0ab-2271268dd9e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:41.834732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a1e0602-eb57-4d6d-a0ab-2271268dd9e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:19:41.835318 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a1e0602-eb57-4d6d-a0ab-2271268dd9e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:19:41.836003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2a1e0602-eb57-4d6d-a0ab-2271268dd9e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:19:41.983242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-2a1e0602-eb57-4d6d-a0ab-2271268dd9e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:19:41.991309 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2a1e0602-eb57-4d6d-a0ab-2271268dd9e0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1684 microversion: 2.1 time: 0.172653 Aug 27 06:19:41.991894 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3998/7984] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:19:41 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:20:16.224461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=14 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:20:16.225216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=40 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:20:16.417039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-087916d2-f22e-4c8c-87d5-adc07716ae3e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:20:16.419397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-087916d2-f22e-4c8c-87d5-adc07716ae3e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:20:16.426029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-087916d2-f22e-4c8c-87d5-adc07716ae3e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:16.426526 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-087916d2-f22e-4c8c-87d5-adc07716ae3e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:16.426975 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-087916d2-f22e-4c8c-87d5-adc07716ae3e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:16.427708 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-087916d2-f22e-4c8c-87d5-adc07716ae3e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:16.428171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-087916d2-f22e-4c8c-87d5-adc07716ae3e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:16.428605 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-087916d2-f22e-4c8c-87d5-adc07716ae3e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:16.505701 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-087916d2-f22e-4c8c-87d5-adc07716ae3e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf/action" status: 200 len: 62945 microversion: 2.1 time: 0.286844 Aug 27 06:20:16.506245 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3987/7985] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:20:16 2022] POST /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf/action => generated 62945 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:20:40.098273 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-ab80c672-387d-4138-b725-3ebc14974b64 req-61b4c111-1770-4550-a555-f29a0ef5605e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ea6777-3639-410c-9959-57b239d8a1bf", "tag": "a4d7ab03-3fc5-445a-9bd8-3a72ee9c25e1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:20:40.101285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-61fc1c71-7726-45eb-b9b3-49bc863e29e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:20:40.101799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-61fc1c71-7726-45eb-b9b3-49bc863e29e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:20:40.104359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=16 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:20:40.105158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:20:40.112107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:20:40.113192 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=4 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:20:40.114197 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:20:40.114365 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:20:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Aug 27 06:20:40.117673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61fc1c71-7726-45eb-b9b3-49bc863e29e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:40.118082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61fc1c71-7726-45eb-b9b3-49bc863e29e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:40.118704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61fc1c71-7726-45eb-b9b3-49bc863e29e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:40.119726 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61fc1c71-7726-45eb-b9b3-49bc863e29e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:40.120382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61fc1c71-7726-45eb-b9b3-49bc863e29e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:40.120504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-61fc1c71-7726-45eb-b9b3-49bc863e29e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:40.129568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ab80c672-387d-4138-b725-3ebc14974b64 req-61b4c111-1770-4550-a555-f29a0ef5605e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:40.130069 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ab80c672-387d-4138-b725-3ebc14974b64 req-61b4c111-1770-4550-a555-f29a0ef5605e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:40.130654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-ab80c672-387d-4138-b725-3ebc14974b64 req-61b4c111-1770-4550-a555-f29a0ef5605e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:40.141721 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-ab80c672-387d-4138-b725-3ebc14974b64 req-61b4c111-1770-4550-a555-f29a0ef5605e service nova] Creating event network-changed:a4d7ab03-3fc5-445a-9bd8-3a72ee9c25e1 for instance 66ea6777-3639-410c-9959-57b239d8a1bf on n-h1-820368-35 Aug 27 06:20:40.148132 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-ab80c672-387d-4138-b725-3ebc14974b64 req-61b4c111-1770-4550-a555-f29a0ef5605e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053409 Aug 27 06:20:40.149201 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3988/7986] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:20:40.152074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-61fc1c71-7726-45eb-b9b3-49bc863e29e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:20:40.236843 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-61fc1c71-7726-45eb-b9b3-49bc863e29e5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "DELETE /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 204 len: 0 microversion: 2.1 time: 0.145544 Aug 27 06:20:40.242275 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 3999/7987] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:20:40 2022] DELETE /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:20:40.248897 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-56c8cf6a-c14b-4b19-b332-5e1ab4d8fe1e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:20:40.249799 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-56c8cf6a-c14b-4b19-b332-5e1ab4d8fe1e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:20:40.257957 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56c8cf6a-c14b-4b19-b332-5e1ab4d8fe1e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:40.258617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56c8cf6a-c14b-4b19-b332-5e1ab4d8fe1e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:40.259165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56c8cf6a-c14b-4b19-b332-5e1ab4d8fe1e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:40.260461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56c8cf6a-c14b-4b19-b332-5e1ab4d8fe1e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:40.260461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56c8cf6a-c14b-4b19-b332-5e1ab4d8fe1e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:40.261193 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-56c8cf6a-c14b-4b19-b332-5e1ab4d8fe1e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:40.398176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-56c8cf6a-c14b-4b19-b332-5e1ab4d8fe1e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:20:40.406937 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-56c8cf6a-c14b-4b19-b332-5e1ab4d8fe1e tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1690 microversion: 2.1 time: 0.162518 Aug 27 06:20:40.407621 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3989/7988] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:20:40 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:20:41.429842 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b7113ce1-648b-473c-a0ad-d2002c433bb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:20:41.430548 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b7113ce1-648b-473c-a0ad-d2002c433bb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:20:41.437626 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7113ce1-648b-473c-a0ad-d2002c433bb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:41.438118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7113ce1-648b-473c-a0ad-d2002c433bb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:41.439405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7113ce1-648b-473c-a0ad-d2002c433bb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:41.440131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7113ce1-648b-473c-a0ad-d2002c433bb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:41.440607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7113ce1-648b-473c-a0ad-d2002c433bb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:41.441037 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b7113ce1-648b-473c-a0ad-d2002c433bb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:41.576555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-b7113ce1-648b-473c-a0ad-d2002c433bb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:20:41.585540 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b7113ce1-648b-473c-a0ad-d2002c433bb0 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1690 microversion: 2.1 time: 0.160500 Aug 27 06:20:41.586149 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4000/7989] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:20:41 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:20:42.435139 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-51d59622-ebc4-4872-9a94-20bdab1ebe31 req-0a30dae3-4ca0-466d-aa49-8303b69fb61a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ea6777-3639-410c-9959-57b239d8a1bf", "name": "network-vif-deleted", "tag": "a4d7ab03-3fc5-445a-9bd8-3a72ee9c25e1"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:20:42.450506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-51d59622-ebc4-4872-9a94-20bdab1ebe31 req-0a30dae3-4ca0-466d-aa49-8303b69fb61a service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:42.451013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-51d59622-ebc4-4872-9a94-20bdab1ebe31 req-0a30dae3-4ca0-466d-aa49-8303b69fb61a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:42.451493 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-51d59622-ebc4-4872-9a94-20bdab1ebe31 req-0a30dae3-4ca0-466d-aa49-8303b69fb61a service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:42.463767 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-51d59622-ebc4-4872-9a94-20bdab1ebe31 req-0a30dae3-4ca0-466d-aa49-8303b69fb61a service nova] Creating event network-vif-deleted:a4d7ab03-3fc5-445a-9bd8-3a72ee9c25e1 for instance 66ea6777-3639-410c-9959-57b239d8a1bf on n-h1-820368-35 Aug 27 06:20:42.468646 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-51d59622-ebc4-4872-9a94-20bdab1ebe31 req-0a30dae3-4ca0-466d-aa49-8303b69fb61a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037416 Aug 27 06:20:42.469231 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3990/7990] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:20:42.607304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:20:42.608393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:20:42.615332 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:42.615825 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:42.616279 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:42.616990 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:42.617486 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:42.617924 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:42.651224 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:42.651715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:42.652160 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:42.652615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lazy-loading 'fault' on Instance uuid 66ea6777-3639-410c-9959-57b239d8a1bf {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:20:42.693714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:20:42.701565 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f9ee26a-9735-4ced-8cee-dfc0ccbe4eb1 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 200 len: 1356 microversion: 2.1 time: 0.098159 Aug 27 06:20:42.702147 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4001/7991] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:20:42 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:20:43.724909 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:20:43.725620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: 66ea6777-3639-410c-9959-57b239d8a1bf] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:20:43.731761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:43.732253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:43.732699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:43.733395 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:43.733861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:43.734296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:43.749599 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] HTTP exception thrown: Instance 66ea6777-3639-410c-9959-57b239d8a1bf could not be found. Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Request method failure captured: Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf HTTP/1.1 Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbU6aB_e75aqp8NqqqVAdR5aTLA1Q6hTA4TQG7g4UP-wugXdWdOQbKYZdiF7Eb_yQ2RNMIFzHOe9xBFRey4TYo5y377lxnb_8a1DEXSy6GAWG-hMmKOxzfz8KSOhJR9A4wcCgVgXBokca2F0ylnOdGjNKOJhU5qnilgI35mBzwauMaI Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: f100645ec41f471bad7489ea8fbcbaf0 Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f100645ec41f471bad7489ea8fbcbaf0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: f100645ec41f471bad7489ea8fbcbaf0 Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestNetworkAdvancedServerOps-38834833-project Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 52d1f89be8a74799b32e239ff34959c2 Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestNetworkAdvancedServerOps-38834833-project Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 66ea6777-3639-410c-9959-57b239d8a1bf could not be found. Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '66ea6777-3639-410c-9959-57b239d8a1bf'} Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66ea6777-3639-410c-9959-57b239d8a1bf could not be found. Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66ea6777-3639-410c-9959-57b239d8a1bf could not be found. Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:20:43.751260 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:20:43.756581 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:20:43.756581 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:20:43.756581 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:20:43.756581 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:20:43.756581 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:20:43.756581 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:20:43.756581 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66ea6777-3639-410c-9959-57b239d8a1bf could not be found. Aug 27 06:20:43.756581 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:20:43.756581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Returning 404 to user: Instance 66ea6777-3639-410c-9959-57b239d8a1bf could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:20:43.756581 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d05fe222-4a70-4535-9cc3-3e548275f5ea tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf" status: 404 len: 111 microversion: 2.1 time: 0.033595 Aug 27 06:20:43.756581 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3991/7992] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:20:43 2022] GET /compute/v2.1/servers/66ea6777-3639-410c-9959-57b239d8a1bf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:20:47.409225 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ac03be22-66fd-4a8a-bc3d-65a545fe78de tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '.version_select at 0x7fb5640d0310>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:20:47.414822 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ac03be22-66fd-4a8a-bc3d-65a545fe78de tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [29dc6b1e-b247-4504-beea-89ae8c634cd6] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:20:48.424244 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [None req-ac03be22-66fd-4a8a-bc3d-65a545fe78de tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [29dc6b1e-b247-4504-beea-89ae8c634cd6] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48296. Aug 27 06:20:48.445244 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ac03be22-66fd-4a8a-bc3d-65a545fe78de tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2094295916" status: 202 len: 0 microversion: 2.1 time: 1.040864 Aug 27 06:20:48.446035 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4002/7993] 10.222.0.58 () {58 vars in 1284 bytes} [Sat Aug 27 06:20:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2094295916 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 06:20:48.480556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-db57fc7d-4a04-40e2-8ae9-44d71a3e4ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'create', calling method: .version_select at 0x7fb55ff15040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1047519179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx98TYiQ6iCiG4Nvn1/pmfo82+cLCrmk9hpDD7tqhvK9oS79aqVPrMXRJcHXhTnfmRyq29yUvIFMOvRjTRPUdh+zS1WmrDFQiiWIRIk/6kzF59+9lSR5oXwkwq3NU3S/g=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:20:48.496929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-db57fc7d-4a04-40e2-8ae9-44d71a3e4ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:20:48.502011 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-db57fc7d-4a04-40e2-8ae9-44d71a3e4ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for user 52d1f89be8a74799b32e239ff34959c2 and project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:20:48.528068 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-db57fc7d-4a04-40e2-8ae9-44d71a3e4ee4 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051678 Aug 27 06:20:48.528683 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3992/7994] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 06:20:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:20:54.625274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:20:54.632667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1314138017", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "networks": [{"uuid": "025736c5-e8db-4a3b-be01-b7e8f1fa06d7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1047519179", "security_groups": [{"name": "tempest-secgroup-smoke-1215450041"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:20:54.770888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] validate_networks() for [('025736c5-e8db-4a3b-be01-b7e8f1fa06d7', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:20:55.274488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:20:55.275041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:20:55.275582 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:20:55.276168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:20:55.276602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:20:55.286615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:55.287515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:55.287997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:55.289082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:20:55.289890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:20:55.290668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:20:55.314633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:20:55.320058 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Getting quotas for user 52d1f89be8a74799b32e239ff34959c2 and project f100645ec41f471bad7489ea8fbcbaf0. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:20:55.333140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:20:55.335517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:20:55.395392 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [693e0343-05ea-478d-ad19-0a1608b2f3ff] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:20:56.403015 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [693e0343-05ea-478d-ad19-0a1608b2f3ff] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48350. Aug 27 06:20:56.407817 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-682e0d8f-cffb-435a-9a63-89f31cf4f8a9 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.785241 Aug 27 06:20:56.408504 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4003/7995] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:20:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:20:56.417534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=12 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:20:56.421854 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-97711d32-af00-4eb0-b6f3-5f44d2214b9b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:20:56.422871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-97711d32-af00-4eb0-b6f3-5f44d2214b9b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:20:56.485376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-97711d32-af00-4eb0-b6f3-5f44d2214b9b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:20:56.493274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-97711d32-af00-4eb0-b6f3-5f44d2214b9b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1267 microversion: 2.1 time: 0.077391 Aug 27 06:20:56.493857 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3993/7996] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:20:56 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1267 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:20:57.514641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3e458221-d3b8-4d7a-bdaf-ae4af08e03dd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:20:57.515293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3e458221-d3b8-4d7a-bdaf-ae4af08e03dd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:20:57.571870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3e458221-d3b8-4d7a-bdaf-ae4af08e03dd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:20:57.579534 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3e458221-d3b8-4d7a-bdaf-ae4af08e03dd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1267 microversion: 2.1 time: 0.069567 Aug 27 06:20:57.580084 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4004/7997] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:20:57 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1267 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:20:58.601022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-93225ffb-3c3d-4773-9d16-c8fe02cce309 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:20:58.601663 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-93225ffb-3c3d-4773-9d16-c8fe02cce309 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:20:58.658847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-93225ffb-3c3d-4773-9d16-c8fe02cce309 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:20:58.666258 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-93225ffb-3c3d-4773-9d16-c8fe02cce309 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1267 microversion: 2.1 time: 0.069541 Aug 27 06:20:58.666944 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3994/7998] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:20:58 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1267 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:20:59.688498 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-ce5f333b-4f62-40d7-b81b-effa74c51997 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:20:59.689542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-ce5f333b-4f62-40d7-b81b-effa74c51997 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:20:59.747196 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-ce5f333b-4f62-40d7-b81b-effa74c51997 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:20:59.754080 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-ce5f333b-4f62-40d7-b81b-effa74c51997 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1267 microversion: 2.1 time: 0.070023 Aug 27 06:20:59.754667 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4005/7999] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:20:59 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1267 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:00.775415 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9b8c68fa-df47-481d-a92b-d7c66437718f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:00.776059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9b8c68fa-df47-481d-a92b-d7c66437718f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:00.785154 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b8c68fa-df47-481d-a92b-d7c66437718f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:00.785730 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b8c68fa-df47-481d-a92b-d7c66437718f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:00.786296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b8c68fa-df47-481d-a92b-d7c66437718f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:00.787198 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b8c68fa-df47-481d-a92b-d7c66437718f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:00.787665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b8c68fa-df47-481d-a92b-d7c66437718f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:00.788104 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9b8c68fa-df47-481d-a92b-d7c66437718f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:00.852426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9b8c68fa-df47-481d-a92b-d7c66437718f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:00.860458 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9b8c68fa-df47-481d-a92b-d7c66437718f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1271 microversion: 2.1 time: 0.089245 Aug 27 06:21:00.861022 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3995/8000] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:00 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:01.882865 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-17d420af-38dc-4ebb-bf1e-f55ef7e2cde8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:01.883615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-17d420af-38dc-4ebb-bf1e-f55ef7e2cde8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:01.891060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17d420af-38dc-4ebb-bf1e-f55ef7e2cde8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:01.891515 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17d420af-38dc-4ebb-bf1e-f55ef7e2cde8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:01.891960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17d420af-38dc-4ebb-bf1e-f55ef7e2cde8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:01.892677 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17d420af-38dc-4ebb-bf1e-f55ef7e2cde8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:01.893138 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17d420af-38dc-4ebb-bf1e-f55ef7e2cde8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:01.893569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-17d420af-38dc-4ebb-bf1e-f55ef7e2cde8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:01.972736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-17d420af-38dc-4ebb-bf1e-f55ef7e2cde8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:01.980933 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-17d420af-38dc-4ebb-bf1e-f55ef7e2cde8 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1325 microversion: 2.1 time: 0.102818 Aug 27 06:21:01.981527 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4006/8001] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:01 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1325 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:02.929383 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-df5c026f-02b3-4d0e-91cd-fad5a789affe req-db325312-51e0-481e-a122-c7ff00b48e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1", "tag": "67ad6acf-b0a8-4338-8c02-5c57dc5d089c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:21:02.942787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-df5c026f-02b3-4d0e-91cd-fad5a789affe req-db325312-51e0-481e-a122-c7ff00b48e1b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:02.943584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-df5c026f-02b3-4d0e-91cd-fad5a789affe req-db325312-51e0-481e-a122-c7ff00b48e1b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:02.944266 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-df5c026f-02b3-4d0e-91cd-fad5a789affe req-db325312-51e0-481e-a122-c7ff00b48e1b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:02.956564 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-df5c026f-02b3-4d0e-91cd-fad5a789affe req-db325312-51e0-481e-a122-c7ff00b48e1b service nova] Creating event network-changed:67ad6acf-b0a8-4338-8c02-5c57dc5d089c for instance e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 on n-h1-820368-35 Aug 27 06:21:02.961553 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-df5c026f-02b3-4d0e-91cd-fad5a789affe req-db325312-51e0-481e-a122-c7ff00b48e1b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037098 Aug 27 06:21:02.962159 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3996/8002] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:21:03.004113 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f169ed21-077f-436f-a02e-862a05bbd786 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:03.004849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f169ed21-077f-436f-a02e-862a05bbd786 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:03.011658 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f169ed21-077f-436f-a02e-862a05bbd786 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:03.012153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f169ed21-077f-436f-a02e-862a05bbd786 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:03.012647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f169ed21-077f-436f-a02e-862a05bbd786 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:03.013362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f169ed21-077f-436f-a02e-862a05bbd786 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:03.013851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f169ed21-077f-436f-a02e-862a05bbd786 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:03.014284 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f169ed21-077f-436f-a02e-862a05bbd786 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:03.248021 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f169ed21-077f-436f-a02e-862a05bbd786 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:03.256388 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f169ed21-077f-436f-a02e-862a05bbd786 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1393 microversion: 2.1 time: 0.256363 Aug 27 06:21:03.256968 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4007/8003] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:02 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1393 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:04.278616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-892bbda7-2ff8-43ba-8eea-34980a6ebf4a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:04.279382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-892bbda7-2ff8-43ba-8eea-34980a6ebf4a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:04.286363 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892bbda7-2ff8-43ba-8eea-34980a6ebf4a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:04.286864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892bbda7-2ff8-43ba-8eea-34980a6ebf4a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:04.287351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892bbda7-2ff8-43ba-8eea-34980a6ebf4a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:04.288064 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892bbda7-2ff8-43ba-8eea-34980a6ebf4a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:04.288533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892bbda7-2ff8-43ba-8eea-34980a6ebf4a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:04.289004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-892bbda7-2ff8-43ba-8eea-34980a6ebf4a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:04.424476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-892bbda7-2ff8-43ba-8eea-34980a6ebf4a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:04.432447 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-892bbda7-2ff8-43ba-8eea-34980a6ebf4a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1393 microversion: 2.1 time: 0.158944 Aug 27 06:21:04.433008 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3997/8004] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:04 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:05.456812 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5ad952a4-b9ed-4c26-a9fb-e47e3e7d6911 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:05.457433 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5ad952a4-b9ed-4c26-a9fb-e47e3e7d6911 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:05.460179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:21:05.466324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ad952a4-b9ed-4c26-a9fb-e47e3e7d6911 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:05.466810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ad952a4-b9ed-4c26-a9fb-e47e3e7d6911 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:05.467280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ad952a4-b9ed-4c26-a9fb-e47e3e7d6911 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:05.468014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ad952a4-b9ed-4c26-a9fb-e47e3e7d6911 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:05.468493 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ad952a4-b9ed-4c26-a9fb-e47e3e7d6911 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:05.469914 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5ad952a4-b9ed-4c26-a9fb-e47e3e7d6911 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:05.632636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5ad952a4-b9ed-4c26-a9fb-e47e3e7d6911 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:05.640402 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5ad952a4-b9ed-4c26-a9fb-e47e3e7d6911 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1393 microversion: 2.1 time: 0.188374 Aug 27 06:21:05.641644 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4008/8005] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:05 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1393 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:06.662988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f38a93dd-2e01-495d-b449-46359a730779 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:06.663654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f38a93dd-2e01-495d-b449-46359a730779 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:06.670475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38a93dd-2e01-495d-b449-46359a730779 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:06.670993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38a93dd-2e01-495d-b449-46359a730779 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:06.671464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38a93dd-2e01-495d-b449-46359a730779 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:06.672179 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38a93dd-2e01-495d-b449-46359a730779 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:06.672652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38a93dd-2e01-495d-b449-46359a730779 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:06.673095 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f38a93dd-2e01-495d-b449-46359a730779 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:06.807208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f38a93dd-2e01-495d-b449-46359a730779 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:06.815532 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f38a93dd-2e01-495d-b449-46359a730779 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1393 microversion: 2.1 time: 0.156491 Aug 27 06:21:06.816106 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3998/8006] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:06 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:07.836393 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f4972f1a-063a-4967-ba2b-3dee8e284061 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:07.837023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f4972f1a-063a-4967-ba2b-3dee8e284061 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:07.843976 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4972f1a-063a-4967-ba2b-3dee8e284061 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:07.844644 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4972f1a-063a-4967-ba2b-3dee8e284061 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:07.845116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4972f1a-063a-4967-ba2b-3dee8e284061 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:07.845870 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4972f1a-063a-4967-ba2b-3dee8e284061 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:07.846329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4972f1a-063a-4967-ba2b-3dee8e284061 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:07.846769 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f4972f1a-063a-4967-ba2b-3dee8e284061 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:07.984070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f4972f1a-063a-4967-ba2b-3dee8e284061 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:07.994237 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f4972f1a-063a-4967-ba2b-3dee8e284061 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1393 microversion: 2.1 time: 0.161753 Aug 27 06:21:07.994858 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4009/8007] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:07 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:09.014951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e4b7f7a0-b5e9-4034-a654-56fbc7a779a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:09.015668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e4b7f7a0-b5e9-4034-a654-56fbc7a779a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:09.019061 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:21:09.024529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4b7f7a0-b5e9-4034-a654-56fbc7a779a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:09.025021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4b7f7a0-b5e9-4034-a654-56fbc7a779a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:09.025468 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4b7f7a0-b5e9-4034-a654-56fbc7a779a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:09.026177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4b7f7a0-b5e9-4034-a654-56fbc7a779a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:09.026638 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4b7f7a0-b5e9-4034-a654-56fbc7a779a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:09.027342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e4b7f7a0-b5e9-4034-a654-56fbc7a779a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:09.161568 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e4b7f7a0-b5e9-4034-a654-56fbc7a779a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:09.169376 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e4b7f7a0-b5e9-4034-a654-56fbc7a779a5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1393 microversion: 2.1 time: 0.158282 Aug 27 06:21:09.169948 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 3999/8008] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:09 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:09.950065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-0e09ecef-fc4c-4d19-bea7-55c57a78547f req-06846a73-cb07-4a39-8f93-8793c9706cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1", "name": "network-vif-plugged", "status": "completed", "tag": "67ad6acf-b0a8-4338-8c02-5c57dc5d089c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:21:09.957598 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=10 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:21:09.963970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0e09ecef-fc4c-4d19-bea7-55c57a78547f req-06846a73-cb07-4a39-8f93-8793c9706cee service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:09.964827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0e09ecef-fc4c-4d19-bea7-55c57a78547f req-06846a73-cb07-4a39-8f93-8793c9706cee service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:09.965273 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0e09ecef-fc4c-4d19-bea7-55c57a78547f req-06846a73-cb07-4a39-8f93-8793c9706cee service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:09.977128 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-0e09ecef-fc4c-4d19-bea7-55c57a78547f req-06846a73-cb07-4a39-8f93-8793c9706cee service nova] Creating event network-vif-plugged:67ad6acf-b0a8-4338-8c02-5c57dc5d089c for instance e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 on n-h1-820368-35 Aug 27 06:21:09.982884 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-0e09ecef-fc4c-4d19-bea7-55c57a78547f req-06846a73-cb07-4a39-8f93-8793c9706cee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036783 Aug 27 06:21:09.983796 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4010/8009] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:21:10.190531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8f261d34-2279-4439-831c-92d56a019180 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:10.191284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8f261d34-2279-4439-831c-92d56a019180 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:10.194007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:21:10.199501 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f261d34-2279-4439-831c-92d56a019180 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:10.200296 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f261d34-2279-4439-831c-92d56a019180 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:10.200750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f261d34-2279-4439-831c-92d56a019180 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:10.201458 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f261d34-2279-4439-831c-92d56a019180 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:10.201927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f261d34-2279-4439-831c-92d56a019180 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:10.202365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8f261d34-2279-4439-831c-92d56a019180 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:10.335820 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8f261d34-2279-4439-831c-92d56a019180 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:10.343493 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8f261d34-2279-4439-831c-92d56a019180 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1393 microversion: 2.1 time: 0.157616 Aug 27 06:21:10.344204 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4000/8010] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:10 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:11.365150 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-baf212b8-ba3f-4196-86d4-4309c85d7d41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:11.365859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-baf212b8-ba3f-4196-86d4-4309c85d7d41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:11.368624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:21:11.374415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf212b8-ba3f-4196-86d4-4309c85d7d41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:11.374904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf212b8-ba3f-4196-86d4-4309c85d7d41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:11.375372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf212b8-ba3f-4196-86d4-4309c85d7d41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:11.376285 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf212b8-ba3f-4196-86d4-4309c85d7d41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:11.376840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf212b8-ba3f-4196-86d4-4309c85d7d41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:11.377275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-baf212b8-ba3f-4196-86d4-4309c85d7d41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:11.528296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-baf212b8-ba3f-4196-86d4-4309c85d7d41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:11.537229 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-baf212b8-ba3f-4196-86d4-4309c85d7d41 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1393 microversion: 2.1 time: 0.176267 Aug 27 06:21:11.537846 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4011/8011] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:11 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:12.558611 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ab9fcd9e-782d-488c-9ce9-2740163d393b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:12.559397 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ab9fcd9e-782d-488c-9ce9-2740163d393b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:12.566443 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab9fcd9e-782d-488c-9ce9-2740163d393b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:12.567044 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab9fcd9e-782d-488c-9ce9-2740163d393b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:12.567528 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab9fcd9e-782d-488c-9ce9-2740163d393b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:12.568228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab9fcd9e-782d-488c-9ce9-2740163d393b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:12.568759 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab9fcd9e-782d-488c-9ce9-2740163d393b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:12.569128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ab9fcd9e-782d-488c-9ce9-2740163d393b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:12.699851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ab9fcd9e-782d-488c-9ce9-2740163d393b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:12.707560 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ab9fcd9e-782d-488c-9ce9-2740163d393b tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1564 microversion: 2.1 time: 0.153540 Aug 27 06:21:12.708131 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4001/8012] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:12 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:12.727978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4551bd39-4e00-4fbe-8227-09ee23640d9d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:12.728592 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4551bd39-4e00-4fbe-8227-09ee23640d9d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:12.736164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4551bd39-4e00-4fbe-8227-09ee23640d9d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:12.736647 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4551bd39-4e00-4fbe-8227-09ee23640d9d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:12.737106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4551bd39-4e00-4fbe-8227-09ee23640d9d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:12.737807 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4551bd39-4e00-4fbe-8227-09ee23640d9d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:12.738260 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4551bd39-4e00-4fbe-8227-09ee23640d9d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:12.738685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4551bd39-4e00-4fbe-8227-09ee23640d9d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:12.869409 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4551bd39-4e00-4fbe-8227-09ee23640d9d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:12.877792 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4551bd39-4e00-4fbe-8227-09ee23640d9d tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1564 microversion: 2.1 time: 0.153663 Aug 27 06:21:12.878431 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4012/8013] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:12 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:14.780824 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-7dc5a233-7339-4773-b717-2e534beb95ae tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:21:14.782608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-7dc5a233-7339-4773-b717-2e534beb95ae tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:14.783420 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-abcd9066-10cc-449a-88cf-e858eca19088 req-3fb69e6c-c9ab-46bf-a4e2-fa79b121689b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1", "tag": "67ad6acf-b0a8-4338-8c02-5c57dc5d089c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:21:14.793099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc5a233-7339-4773-b717-2e534beb95ae tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:14.793606 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc5a233-7339-4773-b717-2e534beb95ae tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:14.794062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc5a233-7339-4773-b717-2e534beb95ae tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:14.794304 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-abcd9066-10cc-449a-88cf-e858eca19088 req-3fb69e6c-c9ab-46bf-a4e2-fa79b121689b service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:14.794781 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc5a233-7339-4773-b717-2e534beb95ae tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:14.794894 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-abcd9066-10cc-449a-88cf-e858eca19088 req-3fb69e6c-c9ab-46bf-a4e2-fa79b121689b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:14.795241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-abcd9066-10cc-449a-88cf-e858eca19088 req-3fb69e6c-c9ab-46bf-a4e2-fa79b121689b service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:14.795435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc5a233-7339-4773-b717-2e534beb95ae tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:14.795878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-7dc5a233-7339-4773-b717-2e534beb95ae tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:14.809126 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-abcd9066-10cc-449a-88cf-e858eca19088 req-3fb69e6c-c9ab-46bf-a4e2-fa79b121689b service nova] Creating event network-changed:67ad6acf-b0a8-4338-8c02-5c57dc5d089c for instance e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 on n-h1-820368-35 Aug 27 06:21:14.815066 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-abcd9066-10cc-449a-88cf-e858eca19088 req-3fb69e6c-c9ab-46bf-a4e2-fa79b121689b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035499 Aug 27 06:21:14.815919 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4013/8014] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:21:15.017486 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-7dc5a233-7339-4773-b717-2e534beb95ae tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:21:15.025719 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-7dc5a233-7339-4773-b717-2e534beb95ae tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1564 microversion: 2.1 time: 0.249731 Aug 27 06:21:15.026394 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4002/8015] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:21:14 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1564 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:21:50.328681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-212f1465-ca80-4a06-9c9a-9f744d76fd38 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:21:50.330969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-212f1465-ca80-4a06-9c9a-9f744d76fd38 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:21:50.333909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=5 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:21:50.334550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=42 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:21:50.341013 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212f1465-ca80-4a06-9c9a-9f744d76fd38 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:50.341518 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212f1465-ca80-4a06-9c9a-9f744d76fd38 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:50.341998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212f1465-ca80-4a06-9c9a-9f744d76fd38 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:50.342747 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212f1465-ca80-4a06-9c9a-9f744d76fd38 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:21:50.343256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212f1465-ca80-4a06-9c9a-9f744d76fd38 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:21:50.343720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-212f1465-ca80-4a06-9c9a-9f744d76fd38 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:21:50.411175 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-212f1465-ca80-4a06-9c9a-9f744d76fd38 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1/action" status: 200 len: 24572 microversion: 2.1 time: 0.086670 Aug 27 06:21:50.412693 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4014/8016] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:21:50 2022] POST /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1/action => generated 24572 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:22:29.167094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=5 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:22:29.168015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=44 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:22:29.169283 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:22:29.175998 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:22:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1/action (ip 10.222.0.58) !!! Aug 27 06:22:29.175998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c2a0c87e-d70f-4784-81f1-c354577f174a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:22:29.175998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c2a0c87e-d70f-4784-81f1-c354577f174a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:29.183464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2a0c87e-d70f-4784-81f1-c354577f174a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:29.183976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2a0c87e-d70f-4784-81f1-c354577f174a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:29.184423 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2a0c87e-d70f-4784-81f1-c354577f174a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:29.185132 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2a0c87e-d70f-4784-81f1-c354577f174a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:29.185597 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2a0c87e-d70f-4784-81f1-c354577f174a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:29.186088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c2a0c87e-d70f-4784-81f1-c354577f174a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:29.209764 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-c2a0c87e-d70f-4784-81f1-c354577f174a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lazy-loading 'flavor' on Instance uuid e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:22:29.274481 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c2a0c87e-d70f-4784-81f1-c354577f174a tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1/action" status: 202 len: 0 microversion: 2.1 time: 0.109123 Aug 27 06:22:29.275178 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4003/8017] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:22:29 2022] POST /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:22:29.285652 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-03d2b6a1-2ce7-481a-9938-bcdbbc7fc94f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:29.286361 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-03d2b6a1-2ce7-481a-9938-bcdbbc7fc94f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:29.289449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:22:29.290180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:22:29.297886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03d2b6a1-2ce7-481a-9938-bcdbbc7fc94f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:29.298378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03d2b6a1-2ce7-481a-9938-bcdbbc7fc94f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:29.298816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03d2b6a1-2ce7-481a-9938-bcdbbc7fc94f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:29.299565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03d2b6a1-2ce7-481a-9938-bcdbbc7fc94f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:29.300007 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03d2b6a1-2ce7-481a-9938-bcdbbc7fc94f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:29.300435 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-03d2b6a1-2ce7-481a-9938-bcdbbc7fc94f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:29.536003 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-03d2b6a1-2ce7-481a-9938-bcdbbc7fc94f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:22:29.543818 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-03d2b6a1-2ce7-481a-9938-bcdbbc7fc94f tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1691 microversion: 2.1 time: 0.263367 Aug 27 06:22:29.544799 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4015/8018] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:29 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1691 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:22:30.568181 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-91759c9a-e8aa-4be9-8651-acf1aa87c745 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:30.568956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-91759c9a-e8aa-4be9-8651-acf1aa87c745 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:30.575334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91759c9a-e8aa-4be9-8651-acf1aa87c745 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:30.575833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91759c9a-e8aa-4be9-8651-acf1aa87c745 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:30.576283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91759c9a-e8aa-4be9-8651-acf1aa87c745 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:30.576987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91759c9a-e8aa-4be9-8651-acf1aa87c745 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:30.577456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91759c9a-e8aa-4be9-8651-acf1aa87c745 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:30.577901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-91759c9a-e8aa-4be9-8651-acf1aa87c745 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:30.774571 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-91759c9a-e8aa-4be9-8651-acf1aa87c745 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:22:30.782364 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-91759c9a-e8aa-4be9-8651-acf1aa87c745 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1691 microversion: 2.1 time: 0.219517 Aug 27 06:22:30.783123 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4004/8019] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:30 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1691 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:22:31.807032 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8bfc0c9-b79b-412f-8fee-93759de700d5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:31.807820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e8bfc0c9-b79b-412f-8fee-93759de700d5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:31.814889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0c9-b79b-412f-8fee-93759de700d5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:31.815411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0c9-b79b-412f-8fee-93759de700d5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:31.815855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0c9-b79b-412f-8fee-93759de700d5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:31.816792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0c9-b79b-412f-8fee-93759de700d5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:31.817253 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0c9-b79b-412f-8fee-93759de700d5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:31.817685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0c9-b79b-412f-8fee-93759de700d5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:31.950008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e8bfc0c9-b79b-412f-8fee-93759de700d5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:22:31.958947 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e8bfc0c9-b79b-412f-8fee-93759de700d5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1674 microversion: 2.1 time: 0.156310 Aug 27 06:22:31.960365 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4016/8020] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:31 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:22:33.057670 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-812eedaa-f5d0-483a-8432-c6c9f2ec53a3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:22:33.059993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-812eedaa-f5d0-483a-8432-c6c9f2ec53a3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:33.066833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-812eedaa-f5d0-483a-8432-c6c9f2ec53a3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:33.067356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-812eedaa-f5d0-483a-8432-c6c9f2ec53a3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:33.067813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-812eedaa-f5d0-483a-8432-c6c9f2ec53a3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:33.068537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-812eedaa-f5d0-483a-8432-c6c9f2ec53a3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:33.069706 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-812eedaa-f5d0-483a-8432-c6c9f2ec53a3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:33.070143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-812eedaa-f5d0-483a-8432-c6c9f2ec53a3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:33.130299 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-812eedaa-f5d0-483a-8432-c6c9f2ec53a3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1/action" status: 200 len: 38511 microversion: 2.1 time: 0.077197 Aug 27 06:22:33.130950 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4005/8021] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:22:33 2022] POST /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1/action => generated 38511 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:22:33.144018 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6e2ac2ba-14dd-4589-ac62-b127b19b54c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:22:33.144559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6e2ac2ba-14dd-4589-ac62-b127b19b54c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:33.152388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e2ac2ba-14dd-4589-ac62-b127b19b54c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:33.152877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e2ac2ba-14dd-4589-ac62-b127b19b54c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:33.153367 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e2ac2ba-14dd-4589-ac62-b127b19b54c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:33.154135 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e2ac2ba-14dd-4589-ac62-b127b19b54c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:33.154645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e2ac2ba-14dd-4589-ac62-b127b19b54c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:33.155071 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6e2ac2ba-14dd-4589-ac62-b127b19b54c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:33.224111 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6e2ac2ba-14dd-4589-ac62-b127b19b54c2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1/action" status: 202 len: 0 microversion: 2.1 time: 0.083805 Aug 27 06:22:33.224794 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4017/8022] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:22:33 2022] POST /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 06:22:33.233648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a27de53-2867-477b-9a1b-71284252dbeb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:33.234378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6a27de53-2867-477b-9a1b-71284252dbeb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:33.242951 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a27de53-2867-477b-9a1b-71284252dbeb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:33.243473 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a27de53-2867-477b-9a1b-71284252dbeb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:33.244031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a27de53-2867-477b-9a1b-71284252dbeb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:33.244852 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a27de53-2867-477b-9a1b-71284252dbeb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:33.245327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a27de53-2867-477b-9a1b-71284252dbeb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:33.245779 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a27de53-2867-477b-9a1b-71284252dbeb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:33.430588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6a27de53-2867-477b-9a1b-71284252dbeb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:22:33.440396 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6a27de53-2867-477b-9a1b-71284252dbeb tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1680 microversion: 2.1 time: 0.211010 Aug 27 06:22:33.440978 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4006/8023] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:33 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:22:34.462500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-00acad1f-7fa7-4320-8941-7688cba8a1b2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:34.463248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-00acad1f-7fa7-4320-8941-7688cba8a1b2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:34.470349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00acad1f-7fa7-4320-8941-7688cba8a1b2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:34.470829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00acad1f-7fa7-4320-8941-7688cba8a1b2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:34.471314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00acad1f-7fa7-4320-8941-7688cba8a1b2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:34.472024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00acad1f-7fa7-4320-8941-7688cba8a1b2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:34.472483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00acad1f-7fa7-4320-8941-7688cba8a1b2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:34.472920 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-00acad1f-7fa7-4320-8941-7688cba8a1b2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:34.608768 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-00acad1f-7fa7-4320-8941-7688cba8a1b2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:22:34.616813 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-00acad1f-7fa7-4320-8941-7688cba8a1b2 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1680 microversion: 2.1 time: 0.158688 Aug 27 06:22:34.617385 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4018/8024] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:34 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:22:35.639317 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c7d2cc71-7982-44ef-94e6-95f2583e4406 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:35.640160 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c7d2cc71-7982-44ef-94e6-95f2583e4406 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:35.648166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d2cc71-7982-44ef-94e6-95f2583e4406 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:35.648688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d2cc71-7982-44ef-94e6-95f2583e4406 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:35.649136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d2cc71-7982-44ef-94e6-95f2583e4406 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:35.649856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d2cc71-7982-44ef-94e6-95f2583e4406 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:35.650319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d2cc71-7982-44ef-94e6-95f2583e4406 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:35.650760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7d2cc71-7982-44ef-94e6-95f2583e4406 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:36.061932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c7d2cc71-7982-44ef-94e6-95f2583e4406 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:22:36.069716 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c7d2cc71-7982-44ef-94e6-95f2583e4406 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1683 microversion: 2.1 time: 0.434455 Aug 27 06:22:36.070279 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4007/8025] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:35 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1683 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:22:36.166532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3d1337d1-f69e-4a63-baae-e405d007c1f5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:22:36.168992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3d1337d1-f69e-4a63-baae-e405d007c1f5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:36.175521 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d1337d1-f69e-4a63-baae-e405d007c1f5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:36.176014 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d1337d1-f69e-4a63-baae-e405d007c1f5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:36.176509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d1337d1-f69e-4a63-baae-e405d007c1f5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:36.177162 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d1337d1-f69e-4a63-baae-e405d007c1f5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:36.177623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d1337d1-f69e-4a63-baae-e405d007c1f5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:36.178711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3d1337d1-f69e-4a63-baae-e405d007c1f5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:36.240999 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3d1337d1-f69e-4a63-baae-e405d007c1f5 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "POST /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1/action" status: 200 len: 38511 microversion: 2.1 time: 0.078425 Aug 27 06:22:36.241666 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4019/8026] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:22:36 2022] POST /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1/action => generated 38511 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 06:22:37.228886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-10dfd825-0973-419b-9e2a-be8631b06818 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:37.234836 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-2db42461-949d-46a7-a04a-787a2acd016f req-a56af279-b614-4c88-9d98-d9df62fc779e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1", "tag": "67ad6acf-b0a8-4338-8c02-5c57dc5d089c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:22:37.237585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-10dfd825-0973-419b-9e2a-be8631b06818 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:37.249737 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10dfd825-0973-419b-9e2a-be8631b06818 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:37.253689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10dfd825-0973-419b-9e2a-be8631b06818 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:37.254327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10dfd825-0973-419b-9e2a-be8631b06818 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:37.255285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10dfd825-0973-419b-9e2a-be8631b06818 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:37.257624 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10dfd825-0973-419b-9e2a-be8631b06818 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:37.258436 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-10dfd825-0973-419b-9e2a-be8631b06818 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:37.262701 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2db42461-949d-46a7-a04a-787a2acd016f req-a56af279-b614-4c88-9d98-d9df62fc779e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:37.263214 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2db42461-949d-46a7-a04a-787a2acd016f req-a56af279-b614-4c88-9d98-d9df62fc779e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:37.263732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-2db42461-949d-46a7-a04a-787a2acd016f req-a56af279-b614-4c88-9d98-d9df62fc779e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:37.282747 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-2db42461-949d-46a7-a04a-787a2acd016f req-a56af279-b614-4c88-9d98-d9df62fc779e service nova] Creating event network-changed:67ad6acf-b0a8-4338-8c02-5c57dc5d089c for instance e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 on n-h1-820368-35 Aug 27 06:22:37.290806 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-2db42461-949d-46a7-a04a-787a2acd016f req-a56af279-b614-4c88-9d98-d9df62fc779e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059715 Aug 27 06:22:37.294700 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4020/8027] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:22:37.299540 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-10dfd825-0973-419b-9e2a-be8631b06818 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:22:37.408953 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-10dfd825-0973-419b-9e2a-be8631b06818 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 204 len: 0 microversion: 2.1 time: 0.184191 Aug 27 06:22:37.409914 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4008/8028] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:22:37 2022] DELETE /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:22:37.425973 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8611f4bf-d72f-4c75-88ef-da1543de5fe3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:37.428803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8611f4bf-d72f-4c75-88ef-da1543de5fe3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:37.439488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8611f4bf-d72f-4c75-88ef-da1543de5fe3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:37.441702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8611f4bf-d72f-4c75-88ef-da1543de5fe3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:37.442529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8611f4bf-d72f-4c75-88ef-da1543de5fe3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:37.444414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8611f4bf-d72f-4c75-88ef-da1543de5fe3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:37.445365 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8611f4bf-d72f-4c75-88ef-da1543de5fe3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:37.446004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8611f4bf-d72f-4c75-88ef-da1543de5fe3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:37.634880 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8611f4bf-d72f-4c75-88ef-da1543de5fe3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:22:37.643718 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8611f4bf-d72f-4c75-88ef-da1543de5fe3 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1689 microversion: 2.1 time: 0.228186 Aug 27 06:22:37.644321 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4021/8029] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:37 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:22:38.670164 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2a93e116-622e-4e31-9f0e-238e785cc8f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:38.670895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2a93e116-622e-4e31-9f0e-238e785cc8f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:38.678251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a93e116-622e-4e31-9f0e-238e785cc8f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:38.678753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a93e116-622e-4e31-9f0e-238e785cc8f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:38.679246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a93e116-622e-4e31-9f0e-238e785cc8f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:38.680230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a93e116-622e-4e31-9f0e-238e785cc8f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:38.680705 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a93e116-622e-4e31-9f0e-238e785cc8f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:38.681153 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2a93e116-622e-4e31-9f0e-238e785cc8f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:38.910329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2a93e116-622e-4e31-9f0e-238e785cc8f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:22:38.918782 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2a93e116-622e-4e31-9f0e-238e785cc8f6 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1689 microversion: 2.1 time: 0.253750 Aug 27 06:22:38.919402 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4009/8030] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:38 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1689 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:22:39.681517 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-96d7fc4f-9386-468f-a117-a6e1dc28c8d7 req-d9c09188-a0bd-44da-a0a1-13dd10dc4726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1", "name": "network-vif-deleted", "tag": "67ad6acf-b0a8-4338-8c02-5c57dc5d089c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:22:39.692843 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-96d7fc4f-9386-468f-a117-a6e1dc28c8d7 req-d9c09188-a0bd-44da-a0a1-13dd10dc4726 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:39.693938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-96d7fc4f-9386-468f-a117-a6e1dc28c8d7 req-d9c09188-a0bd-44da-a0a1-13dd10dc4726 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:39.694271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-96d7fc4f-9386-468f-a117-a6e1dc28c8d7 req-d9c09188-a0bd-44da-a0a1-13dd10dc4726 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:39.705879 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-96d7fc4f-9386-468f-a117-a6e1dc28c8d7 req-d9c09188-a0bd-44da-a0a1-13dd10dc4726 service nova] Creating event network-vif-deleted:67ad6acf-b0a8-4338-8c02-5c57dc5d089c for instance e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 on n-h1-820368-35 Aug 27 06:22:39.711870 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-96d7fc4f-9386-468f-a117-a6e1dc28c8d7 req-d9c09188-a0bd-44da-a0a1-13dd10dc4726 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036273 Aug 27 06:22:39.712471 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4022/8031] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:22:39.941106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:39.941741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:39.949590 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:39.950102 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:39.950555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:39.951329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:39.951891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:39.952275 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:39.988518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:39.989021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:39.989499 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:39.989974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lazy-loading 'fault' on Instance uuid e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:22:40.044009 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d1f89be8a74799b32e239ff34959c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100645ec41f471bad7489ea8fbcbaf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:22:40.052925 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-654e395f-9e70-46ff-a407-fec43637bdfd tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 200 len: 1357 microversion: 2.1 time: 0.115904 Aug 27 06:22:40.053520 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4010/8032] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:39 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 1357 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:22:41.076126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:41.076839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] [instance: e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:41.082952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:41.083473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:41.083923 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:41.084621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:41.085713 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:41.086153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:41.099507 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] HTTP exception thrown: Instance e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 could not be found. Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Request method failure captured: Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 HTTP/1.1 Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbU6aB_e75aqp8NqqqVAdR5aTLA1Q6hTA4TQG7g4UP-wugXdWdOQbKYZdiF7Eb_yQ2RNMIFzHOe9xBFRey4TYo5y377lxnb_8a1DEXSy6GAWG-hMmKOxzfz8KSOhJR9A4wcCgVgXBokca2F0ylnOdGjNKOJhU5qnilgI35mBzwauMaI Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: f100645ec41f471bad7489ea8fbcbaf0 Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f100645ec41f471bad7489ea8fbcbaf0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f100645ec41f471bad7489ea8fbcbaf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: f100645ec41f471bad7489ea8fbcbaf0 Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-38834833 Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestNetworkAdvancedServerOps-38834833-project Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 52d1f89be8a74799b32e239ff34959c2 Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestNetworkAdvancedServerOps-38834833-project Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 could not be found. Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': 'e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1'} Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 could not be found. Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 could not be found. Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:22:41.101262 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:22:41.106321 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:22:41.106321 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:22:41.106321 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:22:41.106321 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:22:41.106321 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:22:41.106321 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:22:41.106321 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 could not be found. Aug 27 06:22:41.106321 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:22:41.106321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Returning 404 to user: Instance e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:22:41.106321 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-716c750b-d68a-4f26-a77b-c7db978fd27c tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1" status: 404 len: 111 microversion: 2.1 time: 0.031799 Aug 27 06:22:41.106321 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4023/8033] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:41 2022] GET /compute/v2.1/servers/e0e5b64d-4e47-4bd9-b5f1-51f3ca143ce1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:22:44.887028 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4de4256d-4de7-4133-a889-d5a57cfab217 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] Calling method '.version_select at 0x7fb55ff1c670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:44.910509 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4de4256d-4de7-4133-a889-d5a57cfab217 tempest-TestNetworkAdvancedServerOps-38834833 tempest-TestNetworkAdvancedServerOps-38834833-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1047519179" status: 202 len: 0 microversion: 2.1 time: 0.029047 Aug 27 06:22:44.911197 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4011/8034] 10.222.0.58 () {58 vars in 1284 bytes} [Sat Aug 27 06:22:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1047519179 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:22:56.382294 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=18 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:22:56.383795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:22:56.575504 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b3447e8b-5229-4ff3-ba89-4fe747c69fc8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Action: 'create', calling method: .version_select at 0x7fb564bef3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-176269341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZvqdLtWDhsMRwsPMQH7mvChx0uY/6hDDpdjcISFf6nHZruX9txrg0WrCTLOZRrszoVpOUCVhcVGUBH5tk1dJb3FvGDflcKsej4Yz75R7U2FMGTG8h5E4zq44rUSMtPhA=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:22:56.592946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b3447e8b-5229-4ff3-ba89-4fe747c69fc8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Getting quotas for project 6eee79cf2b484239acf77f2d131a5b75. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:22:56.598465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-b3447e8b-5229-4ff3-ba89-4fe747c69fc8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Getting quotas for user 7349195aae474afaa937305ea067761e and project 6eee79cf2b484239acf77f2d131a5b75. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:22:56.626822 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b3447e8b-5229-4ff3-ba89-4fe747c69fc8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.251287 Aug 27 06:22:56.627669 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4024/8035] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 06:22:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:22:57.730233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:22:57.731461 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:22:57.735495 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1134945831", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-176269341", "security_groups": [{"name": "tempest-secgroup-smoke-941393062"}], "networks": [{"uuid": "d3496ac7-9ff6-46f9-83f4-eb63547e5557"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:22:57.852074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] validate_networks() for [('d3496ac7-9ff6-46f9-83f4-eb63547e5557', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:22:58.378901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:22:58.379376 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:22:58.380049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:22:58.380537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:22:58.380971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:22:58.390822 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:58.391576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:58.392029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:58.392778 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:58.393246 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:58.393685 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:58.414476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Getting quotas for project 6eee79cf2b484239acf77f2d131a5b75. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:22:58.420791 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Getting quotas for user 7349195aae474afaa937305ea067761e and project 6eee79cf2b484239acf77f2d131a5b75. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:22:58.434358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:22:58.436741 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:22:58.486710 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e13f4833-aae7-495f-9f7e-8b2176f50034 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.758205 Aug 27 06:22:58.487674 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4012/8036] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:22:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:22:58.498720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a415fa86-17b0-4ba8-aeef-8524c62abc2b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:58.500031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a415fa86-17b0-4ba8-aeef-8524c62abc2b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:58.566638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a415fa86-17b0-4ba8-aeef-8524c62abc2b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:22:58.575576 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a415fa86-17b0-4ba8-aeef-8524c62abc2b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1246 microversion: 2.1 time: 0.080756 Aug 27 06:22:58.576652 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4025/8037] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:58 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:22:59.597003 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eb7187ba-751b-4b84-af73-7002a6bfbf1e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:22:59.597806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eb7187ba-751b-4b84-af73-7002a6bfbf1e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:22:59.612805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb7187ba-751b-4b84-af73-7002a6bfbf1e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:59.614144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb7187ba-751b-4b84-af73-7002a6bfbf1e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:59.614840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb7187ba-751b-4b84-af73-7002a6bfbf1e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:59.616557 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb7187ba-751b-4b84-af73-7002a6bfbf1e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:22:59.617381 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb7187ba-751b-4b84-af73-7002a6bfbf1e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:22:59.618045 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eb7187ba-751b-4b84-af73-7002a6bfbf1e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:22:59.712098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eb7187ba-751b-4b84-af73-7002a6bfbf1e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:22:59.722589 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eb7187ba-751b-4b84-af73-7002a6bfbf1e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1306 microversion: 2.1 time: 0.129599 Aug 27 06:22:59.723997 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4013/8038] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:22:59 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1306 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:00.746293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-83493bc8-8b1d-48fe-ba8b-3a06875a7127 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:23:00.747683 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-83493bc8-8b1d-48fe-ba8b-3a06875a7127 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:23:00.756892 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83493bc8-8b1d-48fe-ba8b-3a06875a7127 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:00.757516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83493bc8-8b1d-48fe-ba8b-3a06875a7127 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:00.758065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83493bc8-8b1d-48fe-ba8b-3a06875a7127 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:00.758986 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83493bc8-8b1d-48fe-ba8b-3a06875a7127 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:00.759580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83493bc8-8b1d-48fe-ba8b-3a06875a7127 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:00.760125 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-83493bc8-8b1d-48fe-ba8b-3a06875a7127 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:00.965639 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-83493bc8-8b1d-48fe-ba8b-3a06875a7127 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:23:00.973810 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-83493bc8-8b1d-48fe-ba8b-3a06875a7127 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1371 microversion: 2.1 time: 0.231825 Aug 27 06:23:00.974389 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4026/8039] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:23:00 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:01.299390 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-c347ff8b-8290-4803-81f2-261762bf5972 req-c6ed47ba-829e-4fa1-82f8-aa90f02f129e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb86ca9-2c00-4449-9f13-d6ae1d310f9b", "tag": "e4c38bfc-187b-463e-b946-d50ff020a725"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:23:01.310581 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c347ff8b-8290-4803-81f2-261762bf5972 req-c6ed47ba-829e-4fa1-82f8-aa90f02f129e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:01.311340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c347ff8b-8290-4803-81f2-261762bf5972 req-c6ed47ba-829e-4fa1-82f8-aa90f02f129e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:01.311787 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-c347ff8b-8290-4803-81f2-261762bf5972 req-c6ed47ba-829e-4fa1-82f8-aa90f02f129e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:01.323377 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-c347ff8b-8290-4803-81f2-261762bf5972 req-c6ed47ba-829e-4fa1-82f8-aa90f02f129e service nova] Creating event network-changed:e4c38bfc-187b-463e-b946-d50ff020a725 for instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b on n-h1-820368-35 Aug 27 06:23:01.328696 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-c347ff8b-8290-4803-81f2-261762bf5972 req-c6ed47ba-829e-4fa1-82f8-aa90f02f129e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099223 Aug 27 06:23:01.329303 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4014/8040] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:23:01.995634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-454628b2-07a3-4f85-b8f2-1bca77343a2f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:23:01.996411 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-454628b2-07a3-4f85-b8f2-1bca77343a2f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:23:02.003762 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-454628b2-07a3-4f85-b8f2-1bca77343a2f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:02.004250 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-454628b2-07a3-4f85-b8f2-1bca77343a2f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:02.004687 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-454628b2-07a3-4f85-b8f2-1bca77343a2f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:02.005384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-454628b2-07a3-4f85-b8f2-1bca77343a2f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:02.005839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-454628b2-07a3-4f85-b8f2-1bca77343a2f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:02.006270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-454628b2-07a3-4f85-b8f2-1bca77343a2f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:02.142356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-454628b2-07a3-4f85-b8f2-1bca77343a2f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:23:02.150805 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-454628b2-07a3-4f85-b8f2-1bca77343a2f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1371 microversion: 2.1 time: 0.159121 Aug 27 06:23:02.151414 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4027/8041] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:23:01 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:03.172359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c00807c0-9e6c-4849-a737-6cd075860469 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:23:03.173116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c00807c0-9e6c-4849-a737-6cd075860469 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:23:03.181057 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c00807c0-9e6c-4849-a737-6cd075860469 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:03.181562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c00807c0-9e6c-4849-a737-6cd075860469 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:03.182023 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c00807c0-9e6c-4849-a737-6cd075860469 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:03.182745 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c00807c0-9e6c-4849-a737-6cd075860469 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:03.183264 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c00807c0-9e6c-4849-a737-6cd075860469 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:03.183713 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c00807c0-9e6c-4849-a737-6cd075860469 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:03.318661 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c00807c0-9e6c-4849-a737-6cd075860469 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:23:03.326475 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c00807c0-9e6c-4849-a737-6cd075860469 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1371 microversion: 2.1 time: 0.158401 Aug 27 06:23:03.327139 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4015/8042] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:23:03 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:04.347995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7397e2b4-d48e-4bd4-be81-6aa96268ad18 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:23:04.348623 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7397e2b4-d48e-4bd4-be81-6aa96268ad18 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:23:04.356015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7397e2b4-d48e-4bd4-be81-6aa96268ad18 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:04.356514 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7397e2b4-d48e-4bd4-be81-6aa96268ad18 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:04.356960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7397e2b4-d48e-4bd4-be81-6aa96268ad18 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:04.357668 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7397e2b4-d48e-4bd4-be81-6aa96268ad18 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:04.358131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7397e2b4-d48e-4bd4-be81-6aa96268ad18 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:04.358567 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7397e2b4-d48e-4bd4-be81-6aa96268ad18 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:04.493195 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7397e2b4-d48e-4bd4-be81-6aa96268ad18 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:23:04.500975 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7397e2b4-d48e-4bd4-be81-6aa96268ad18 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1371 microversion: 2.1 time: 0.156901 Aug 27 06:23:04.501565 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4028/8043] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:23:04 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:05.521435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6982c15e-1de6-4bf5-a56f-5973e5e76385 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:23:05.522578 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6982c15e-1de6-4bf5-a56f-5973e5e76385 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:23:05.529349 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6982c15e-1de6-4bf5-a56f-5973e5e76385 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:05.529877 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6982c15e-1de6-4bf5-a56f-5973e5e76385 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:05.530333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6982c15e-1de6-4bf5-a56f-5973e5e76385 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:05.531049 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6982c15e-1de6-4bf5-a56f-5973e5e76385 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:05.531556 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6982c15e-1de6-4bf5-a56f-5973e5e76385 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:05.531998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6982c15e-1de6-4bf5-a56f-5973e5e76385 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:05.665483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6982c15e-1de6-4bf5-a56f-5973e5e76385 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:23:05.673572 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6982c15e-1de6-4bf5-a56f-5973e5e76385 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1371 microversion: 2.1 time: 0.156062 Aug 27 06:23:05.674140 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4016/8044] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:23:05 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:06.695377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f3ff57a-f4ff-4ee5-b9cd-464c3ced94e9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:23:06.696016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f3ff57a-f4ff-4ee5-b9cd-464c3ced94e9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:23:06.703034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f3ff57a-f4ff-4ee5-b9cd-464c3ced94e9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:06.703558 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f3ff57a-f4ff-4ee5-b9cd-464c3ced94e9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:06.704010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f3ff57a-f4ff-4ee5-b9cd-464c3ced94e9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:06.704716 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f3ff57a-f4ff-4ee5-b9cd-464c3ced94e9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:06.705181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f3ff57a-f4ff-4ee5-b9cd-464c3ced94e9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:06.705618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f3ff57a-f4ff-4ee5-b9cd-464c3ced94e9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:06.842048 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f3ff57a-f4ff-4ee5-b9cd-464c3ced94e9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:23:06.850151 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f3ff57a-f4ff-4ee5-b9cd-464c3ced94e9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1371 microversion: 2.1 time: 0.159384 Aug 27 06:23:06.850837 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4029/8045] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:23:06 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:07.872097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9d57a949-1fa1-4374-84ab-bccdfe5bc1a7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:23:07.872768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9d57a949-1fa1-4374-84ab-bccdfe5bc1a7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:23:07.879721 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d57a949-1fa1-4374-84ab-bccdfe5bc1a7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:07.880260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d57a949-1fa1-4374-84ab-bccdfe5bc1a7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:07.880747 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d57a949-1fa1-4374-84ab-bccdfe5bc1a7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:07.881462 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d57a949-1fa1-4374-84ab-bccdfe5bc1a7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:07.881939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d57a949-1fa1-4374-84ab-bccdfe5bc1a7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:07.882386 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9d57a949-1fa1-4374-84ab-bccdfe5bc1a7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:08.012665 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9d57a949-1fa1-4374-84ab-bccdfe5bc1a7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:23:08.020593 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9d57a949-1fa1-4374-84ab-bccdfe5bc1a7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1371 microversion: 2.1 time: 0.153116 Aug 27 06:23:08.021029 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4017/8046] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:23:07 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:08.608086 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6493135c-f4f0-468b-9771-01f9fd2772cc req-f0347914-8d51-4156-9a90-882851319093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb86ca9-2c00-4449-9f13-d6ae1d310f9b", "name": "network-vif-plugged", "status": "completed", "tag": "e4c38bfc-187b-463e-b946-d50ff020a725"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:23:08.613834 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:23:08.620497 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6493135c-f4f0-468b-9771-01f9fd2772cc req-f0347914-8d51-4156-9a90-882851319093 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:08.621275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6493135c-f4f0-468b-9771-01f9fd2772cc req-f0347914-8d51-4156-9a90-882851319093 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:08.621794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6493135c-f4f0-468b-9771-01f9fd2772cc req-f0347914-8d51-4156-9a90-882851319093 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:08.633104 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6493135c-f4f0-468b-9771-01f9fd2772cc req-f0347914-8d51-4156-9a90-882851319093 service nova] Creating event network-vif-plugged:e4c38bfc-187b-463e-b946-d50ff020a725 for instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b on n-h1-820368-35 Aug 27 06:23:08.639289 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6493135c-f4f0-468b-9771-01f9fd2772cc req-f0347914-8d51-4156-9a90-882851319093 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034827 Aug 27 06:23:08.640308 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4030/8047] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:23:09.042114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-81bcbc86-3d9e-4ce7-bc83-8e922c829659 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:23:09.042749 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-81bcbc86-3d9e-4ce7-bc83-8e922c829659 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:23:09.044950 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:23:09.045623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:23:09.052728 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81bcbc86-3d9e-4ce7-bc83-8e922c829659 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:09.053229 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81bcbc86-3d9e-4ce7-bc83-8e922c829659 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:09.053680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81bcbc86-3d9e-4ce7-bc83-8e922c829659 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:09.054393 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81bcbc86-3d9e-4ce7-bc83-8e922c829659 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:09.055191 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81bcbc86-3d9e-4ce7-bc83-8e922c829659 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:09.056520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-81bcbc86-3d9e-4ce7-bc83-8e922c829659 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:09.184506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-81bcbc86-3d9e-4ce7-bc83-8e922c829659 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:23:09.192196 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-81bcbc86-3d9e-4ce7-bc83-8e922c829659 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1371 microversion: 2.1 time: 0.154505 Aug 27 06:23:09.192767 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4018/8048] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:23:09 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:10.214212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a968dda3-5271-4f5a-89bc-c7e6a7afea4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:23:10.215354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a968dda3-5271-4f5a-89bc-c7e6a7afea4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:23:10.221609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a968dda3-5271-4f5a-89bc-c7e6a7afea4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:10.222100 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a968dda3-5271-4f5a-89bc-c7e6a7afea4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:10.222539 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a968dda3-5271-4f5a-89bc-c7e6a7afea4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:10.223276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a968dda3-5271-4f5a-89bc-c7e6a7afea4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:10.223733 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a968dda3-5271-4f5a-89bc-c7e6a7afea4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:10.224165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a968dda3-5271-4f5a-89bc-c7e6a7afea4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:10.356887 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a968dda3-5271-4f5a-89bc-c7e6a7afea4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:23:10.364709 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a968dda3-5271-4f5a-89bc-c7e6a7afea4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1371 microversion: 2.1 time: 0.155678 Aug 27 06:23:10.365314 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4031/8049] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:23:10 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:11.386596 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cf0db250-91af-42d7-8dbe-3793b7c33a5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:23:11.387177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cf0db250-91af-42d7-8dbe-3793b7c33a5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:23:11.394145 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf0db250-91af-42d7-8dbe-3793b7c33a5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:11.394647 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf0db250-91af-42d7-8dbe-3793b7c33a5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:11.395125 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf0db250-91af-42d7-8dbe-3793b7c33a5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:11.395851 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf0db250-91af-42d7-8dbe-3793b7c33a5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:11.396326 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf0db250-91af-42d7-8dbe-3793b7c33a5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:11.396773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cf0db250-91af-42d7-8dbe-3793b7c33a5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:11.532965 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cf0db250-91af-42d7-8dbe-3793b7c33a5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:23:11.540582 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cf0db250-91af-42d7-8dbe-3793b7c33a5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1555 microversion: 2.1 time: 0.158662 Aug 27 06:23:11.541171 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4019/8050] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:23:11 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:11.561242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0819de59-27e6-4c15-8bc5-89561e3912cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:23:11.561862 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0819de59-27e6-4c15-8bc5-89561e3912cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:23:11.568603 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0819de59-27e6-4c15-8bc5-89561e3912cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:11.569087 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0819de59-27e6-4c15-8bc5-89561e3912cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:11.569619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0819de59-27e6-4c15-8bc5-89561e3912cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:11.570313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0819de59-27e6-4c15-8bc5-89561e3912cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:11.571406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0819de59-27e6-4c15-8bc5-89561e3912cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:11.571840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0819de59-27e6-4c15-8bc5-89561e3912cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:11.701274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0819de59-27e6-4c15-8bc5-89561e3912cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:23:11.708979 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0819de59-27e6-4c15-8bc5-89561e3912cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1555 microversion: 2.1 time: 0.151585 Aug 27 06:23:11.709543 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4032/8051] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:23:11 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:23:13.655477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-592f905a-7fd8-441e-aabd-181e84bb4974 req-cd1c2f09-7afc-4889-bed7-6b611050ab76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb86ca9-2c00-4449-9f13-d6ae1d310f9b", "tag": "e4c38bfc-187b-463e-b946-d50ff020a725"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:23:13.666370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-592f905a-7fd8-441e-aabd-181e84bb4974 req-cd1c2f09-7afc-4889-bed7-6b611050ab76 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:23:13.666855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-592f905a-7fd8-441e-aabd-181e84bb4974 req-cd1c2f09-7afc-4889-bed7-6b611050ab76 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:23:13.667331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-592f905a-7fd8-441e-aabd-181e84bb4974 req-cd1c2f09-7afc-4889-bed7-6b611050ab76 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:23:13.678443 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-592f905a-7fd8-441e-aabd-181e84bb4974 req-cd1c2f09-7afc-4889-bed7-6b611050ab76 service nova] Creating event network-changed:e4c38bfc-187b-463e-b946-d50ff020a725 for instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b on n-h1-820368-35 Aug 27 06:23:13.683953 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-592f905a-7fd8-441e-aabd-181e84bb4974 req-cd1c2f09-7afc-4889-bed7-6b611050ab76 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032184 Aug 27 06:23:13.684785 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4020/8052] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:25:50.453630 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [15bbca3d-0083-4a69-8bef-16bf0d79b591] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:25:50.454808 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27d957ae-75c0-4884-9be8-b8e627e8ac1a] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:25:50.455380 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:25:50.456119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=38 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:25:50.457015 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:25:50.457158 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b/action (ip 10.222.0.58) !!! Aug 27 06:25:50.458902 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:25:50.459023 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b/action (ip 10.222.0.58) !!! Aug 27 06:25:50.460667 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:25:50.460798 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b/action (ip 10.222.0.58) !!! Aug 27 06:25:50.468604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-673186bc-f74f-418b-bea5-36dc309b7169 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:25:50.469142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-673186bc-f74f-418b-bea5-36dc309b7169 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:25:50.485455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-673186bc-f74f-418b-bea5-36dc309b7169 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:50.485941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-673186bc-f74f-418b-bea5-36dc309b7169 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:50.486382 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-673186bc-f74f-418b-bea5-36dc309b7169 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:50.487082 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-673186bc-f74f-418b-bea5-36dc309b7169 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:50.487577 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-673186bc-f74f-418b-bea5-36dc309b7169 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:50.488004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-673186bc-f74f-418b-bea5-36dc309b7169 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:50.512947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-673186bc-f74f-418b-bea5-36dc309b7169 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lazy-loading 'flavor' on Instance uuid 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:25:50.707796 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-673186bc-f74f-418b-bea5-36dc309b7169 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "POST /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b/action" status: 202 len: 0 microversion: 2.1 time: 0.255707 Aug 27 06:25:50.708345 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4033/8053] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:25:50 2022] POST /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:25:50.714860 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a138aa11-e323-45d1-b35b-6ab4ed1899de] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:25:50.716093 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8da433e2-1b8b-43e8-8a70-e929fdcdfc0f] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:25:50.717263 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:25:50.718013 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=42 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:25:50.718962 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:25:50.719104 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b (ip 10.222.0.58) !!! Aug 27 06:25:50.720464 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:25:50.720606 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b (ip 10.222.0.58) !!! Aug 27 06:25:50.721685 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:25:50.721822 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b (ip 10.222.0.58) !!! Aug 27 06:25:50.727329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c439a674-a81e-4e59-84a4-328f39e86dab tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:25:50.728056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c439a674-a81e-4e59-84a4-328f39e86dab tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:25:50.740587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c439a674-a81e-4e59-84a4-328f39e86dab tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:50.741099 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c439a674-a81e-4e59-84a4-328f39e86dab tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:50.741562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c439a674-a81e-4e59-84a4-328f39e86dab tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:50.742284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c439a674-a81e-4e59-84a4-328f39e86dab tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:50.742754 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c439a674-a81e-4e59-84a4-328f39e86dab tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:50.743227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c439a674-a81e-4e59-84a4-328f39e86dab tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:50.876829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c439a674-a81e-4e59-84a4-328f39e86dab tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:25:50.884906 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c439a674-a81e-4e59-84a4-328f39e86dab tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.171984 Aug 27 06:25:50.885497 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4021/8054] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:25:50 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:25:51.908763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5375c234-f1d8-41ba-a8a5-2e1ec1a32242 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:25:51.909473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5375c234-f1d8-41ba-a8a5-2e1ec1a32242 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:25:51.922460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5375c234-f1d8-41ba-a8a5-2e1ec1a32242 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:51.922952 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5375c234-f1d8-41ba-a8a5-2e1ec1a32242 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:51.923440 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5375c234-f1d8-41ba-a8a5-2e1ec1a32242 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:51.924143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5375c234-f1d8-41ba-a8a5-2e1ec1a32242 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:51.924604 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5375c234-f1d8-41ba-a8a5-2e1ec1a32242 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:51.925034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5375c234-f1d8-41ba-a8a5-2e1ec1a32242 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:51.929006 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] [15bbca3d-0083-4a69-8bef-16bf0d79b591] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48740. Aug 27 06:25:51.929702 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] [27d957ae-75c0-4884-9be8-b8e627e8ac1a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48742. Aug 27 06:25:52.063396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5375c234-f1d8-41ba-a8a5-2e1ec1a32242 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:25:52.071187 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5375c234-f1d8-41ba-a8a5-2e1ec1a32242 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.168758 Aug 27 06:25:52.071771 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4034/8055] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:25:51 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:25:53.093459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-12de0a60-70fe-46e9-bbbb-235835857379 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:25:53.094035 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-12de0a60-70fe-46e9-bbbb-235835857379 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:25:53.101934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12de0a60-70fe-46e9-bbbb-235835857379 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:53.102437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12de0a60-70fe-46e9-bbbb-235835857379 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:53.103175 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12de0a60-70fe-46e9-bbbb-235835857379 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:53.103639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12de0a60-70fe-46e9-bbbb-235835857379 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:53.104112 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12de0a60-70fe-46e9-bbbb-235835857379 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:53.104558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-12de0a60-70fe-46e9-bbbb-235835857379 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:53.129031 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] [8da433e2-1b8b-43e8-8a70-e929fdcdfc0f] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48748. Aug 27 06:25:53.134952 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] [a138aa11-e323-45d1-b35b-6ab4ed1899de] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48746. Aug 27 06:25:53.243806 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-12de0a60-70fe-46e9-bbbb-235835857379 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:25:53.252176 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-12de0a60-70fe-46e9-bbbb-235835857379 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.163327 Aug 27 06:25:53.252780 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4022/8056] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:25:53 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:25:54.273686 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0d6fe48b-963f-43b9-ac91-973c6dbd4c29 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:25:54.274293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0d6fe48b-963f-43b9-ac91-973c6dbd4c29 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:25:54.281711 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6fe48b-963f-43b9-ac91-973c6dbd4c29 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:54.282172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6fe48b-963f-43b9-ac91-973c6dbd4c29 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:54.282609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6fe48b-963f-43b9-ac91-973c6dbd4c29 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:54.283599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6fe48b-963f-43b9-ac91-973c6dbd4c29 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:54.284704 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6fe48b-963f-43b9-ac91-973c6dbd4c29 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:54.285133 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0d6fe48b-963f-43b9-ac91-973c6dbd4c29 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:54.414565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0d6fe48b-963f-43b9-ac91-973c6dbd4c29 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:25:54.423038 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0d6fe48b-963f-43b9-ac91-973c6dbd4c29 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.153289 Aug 27 06:25:54.423651 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4035/8057] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:25:54 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:25:55.444783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6114938f-b543-41d6-841c-a41fc5e3038e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:25:55.445420 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6114938f-b543-41d6-841c-a41fc5e3038e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:25:55.452483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6114938f-b543-41d6-841c-a41fc5e3038e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:55.452993 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6114938f-b543-41d6-841c-a41fc5e3038e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:55.453454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6114938f-b543-41d6-841c-a41fc5e3038e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:55.454177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6114938f-b543-41d6-841c-a41fc5e3038e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:55.454648 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6114938f-b543-41d6-841c-a41fc5e3038e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:55.455120 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6114938f-b543-41d6-841c-a41fc5e3038e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:55.588814 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6114938f-b543-41d6-841c-a41fc5e3038e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:25:55.596625 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6114938f-b543-41d6-841c-a41fc5e3038e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.155828 Aug 27 06:25:55.597205 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4023/8058] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:25:55 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:25:56.619109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f11a73cc-d72e-444a-850b-2e830763ce44 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:25:56.619669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f11a73cc-d72e-444a-850b-2e830763ce44 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:25:56.627177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f11a73cc-d72e-444a-850b-2e830763ce44 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:56.627610 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f11a73cc-d72e-444a-850b-2e830763ce44 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:56.628051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f11a73cc-d72e-444a-850b-2e830763ce44 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:56.628746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f11a73cc-d72e-444a-850b-2e830763ce44 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:56.629204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f11a73cc-d72e-444a-850b-2e830763ce44 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:56.629633 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f11a73cc-d72e-444a-850b-2e830763ce44 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:56.758177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f11a73cc-d72e-444a-850b-2e830763ce44 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:25:56.767591 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f11a73cc-d72e-444a-850b-2e830763ce44 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.152364 Aug 27 06:25:56.768288 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4036/8059] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:25:56 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:25:57.788604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-31cd44a7-3830-4cbd-bab4-44dfde805c9b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:25:57.789230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-31cd44a7-3830-4cbd-bab4-44dfde805c9b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:25:57.796618 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31cd44a7-3830-4cbd-bab4-44dfde805c9b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:57.797117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31cd44a7-3830-4cbd-bab4-44dfde805c9b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:57.797576 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31cd44a7-3830-4cbd-bab4-44dfde805c9b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:57.798292 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31cd44a7-3830-4cbd-bab4-44dfde805c9b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:57.798762 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31cd44a7-3830-4cbd-bab4-44dfde805c9b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:57.799226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-31cd44a7-3830-4cbd-bab4-44dfde805c9b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:57.932934 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-31cd44a7-3830-4cbd-bab4-44dfde805c9b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:25:57.941454 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-31cd44a7-3830-4cbd-bab4-44dfde805c9b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.156845 Aug 27 06:25:57.942027 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4024/8060] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:25:57 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:25:58.962867 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-15c83e01-0bf8-4303-85ee-ac19affe1794 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:25:58.963585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-15c83e01-0bf8-4303-85ee-ac19affe1794 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:25:58.971044 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15c83e01-0bf8-4303-85ee-ac19affe1794 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:58.971575 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15c83e01-0bf8-4303-85ee-ac19affe1794 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:58.972020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15c83e01-0bf8-4303-85ee-ac19affe1794 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:58.972722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15c83e01-0bf8-4303-85ee-ac19affe1794 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:25:58.973216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15c83e01-0bf8-4303-85ee-ac19affe1794 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:25:58.973645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-15c83e01-0bf8-4303-85ee-ac19affe1794 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:25:59.103654 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-15c83e01-0bf8-4303-85ee-ac19affe1794 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:25:59.112061 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-15c83e01-0bf8-4303-85ee-ac19affe1794 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.153271 Aug 27 06:25:59.112638 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4037/8061] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:25:58 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:00.132454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f235f9dc-b636-4621-8c85-056c1ba6d012 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:00.133086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f235f9dc-b636-4621-8c85-056c1ba6d012 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:00.140586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f235f9dc-b636-4621-8c85-056c1ba6d012 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:00.141329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f235f9dc-b636-4621-8c85-056c1ba6d012 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:00.141947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f235f9dc-b636-4621-8c85-056c1ba6d012 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:00.143055 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f235f9dc-b636-4621-8c85-056c1ba6d012 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:00.143838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f235f9dc-b636-4621-8c85-056c1ba6d012 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:00.144286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f235f9dc-b636-4621-8c85-056c1ba6d012 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:00.279322 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f235f9dc-b636-4621-8c85-056c1ba6d012 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:00.290251 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f235f9dc-b636-4621-8c85-056c1ba6d012 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.161685 Aug 27 06:26:00.290832 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4025/8062] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:00 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:01.312255 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-acc3d986-2c8a-4023-a42a-2369e388b97f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:01.312890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-acc3d986-2c8a-4023-a42a-2369e388b97f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:01.319972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acc3d986-2c8a-4023-a42a-2369e388b97f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:01.320462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acc3d986-2c8a-4023-a42a-2369e388b97f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:01.320904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acc3d986-2c8a-4023-a42a-2369e388b97f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:01.321608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acc3d986-2c8a-4023-a42a-2369e388b97f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:01.322067 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acc3d986-2c8a-4023-a42a-2369e388b97f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:01.322507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-acc3d986-2c8a-4023-a42a-2369e388b97f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:01.452855 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-acc3d986-2c8a-4023-a42a-2369e388b97f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:01.460815 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-acc3d986-2c8a-4023-a42a-2369e388b97f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.152460 Aug 27 06:26:01.461390 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4038/8063] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:01 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:02.482308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-cecfe25a-9b37-4c4c-8ec3-cc26dafad5bd tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:02.482938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-cecfe25a-9b37-4c4c-8ec3-cc26dafad5bd tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:02.489890 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cecfe25a-9b37-4c4c-8ec3-cc26dafad5bd tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:02.490388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cecfe25a-9b37-4c4c-8ec3-cc26dafad5bd tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:02.490845 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cecfe25a-9b37-4c4c-8ec3-cc26dafad5bd tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:02.491592 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cecfe25a-9b37-4c4c-8ec3-cc26dafad5bd tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:02.492059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cecfe25a-9b37-4c4c-8ec3-cc26dafad5bd tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:02.492503 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-cecfe25a-9b37-4c4c-8ec3-cc26dafad5bd tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:02.627240 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-cecfe25a-9b37-4c4c-8ec3-cc26dafad5bd tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:02.635027 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-cecfe25a-9b37-4c4c-8ec3-cc26dafad5bd tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1701 microversion: 2.1 time: 0.156614 Aug 27 06:26:02.635568 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4026/8064] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:02 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:03.657906 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bf98d562-22e1-48c1-8a36-067041661d98 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:03.658533 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bf98d562-22e1-48c1-8a36-067041661d98 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:03.665479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf98d562-22e1-48c1-8a36-067041661d98 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:03.665978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf98d562-22e1-48c1-8a36-067041661d98 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:03.666428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf98d562-22e1-48c1-8a36-067041661d98 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:03.667254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf98d562-22e1-48c1-8a36-067041661d98 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:03.667629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf98d562-22e1-48c1-8a36-067041661d98 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:03.668064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bf98d562-22e1-48c1-8a36-067041661d98 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:03.805089 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-bf98d562-22e1-48c1-8a36-067041661d98 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:03.813398 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bf98d562-22e1-48c1-8a36-067041661d98 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1701 microversion: 2.1 time: 0.160392 Aug 27 06:26:03.813972 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4039/8065] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:03 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:04.835270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-653e2ca1-ffa8-44f0-84a7-e8248715ebd7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:04.835903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-653e2ca1-ffa8-44f0-84a7-e8248715ebd7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:04.842765 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-653e2ca1-ffa8-44f0-84a7-e8248715ebd7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:04.843313 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-653e2ca1-ffa8-44f0-84a7-e8248715ebd7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:04.843773 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-653e2ca1-ffa8-44f0-84a7-e8248715ebd7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:04.844727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-653e2ca1-ffa8-44f0-84a7-e8248715ebd7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:04.845206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-653e2ca1-ffa8-44f0-84a7-e8248715ebd7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:04.845654 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-653e2ca1-ffa8-44f0-84a7-e8248715ebd7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:04.976314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-653e2ca1-ffa8-44f0-84a7-e8248715ebd7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:04.984175 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-653e2ca1-ffa8-44f0-84a7-e8248715ebd7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1701 microversion: 2.1 time: 0.152946 Aug 27 06:26:04.984758 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4027/8066] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:04 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:05.458916 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-3259d578-d652-492c-a61e-7276a4cfbec5 req-4490bb4a-57b6-44f2-8a54-182714ee3f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb86ca9-2c00-4449-9f13-d6ae1d310f9b", "name": "network-vif-plugged", "status": "completed", "tag": "e4c38bfc-187b-463e-b946-d50ff020a725"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:26:05.469249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3259d578-d652-492c-a61e-7276a4cfbec5 req-4490bb4a-57b6-44f2-8a54-182714ee3f13 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:05.469943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3259d578-d652-492c-a61e-7276a4cfbec5 req-4490bb4a-57b6-44f2-8a54-182714ee3f13 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:05.470389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-3259d578-d652-492c-a61e-7276a4cfbec5 req-4490bb4a-57b6-44f2-8a54-182714ee3f13 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:05.484816 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-3259d578-d652-492c-a61e-7276a4cfbec5 req-4490bb4a-57b6-44f2-8a54-182714ee3f13 service nova] Creating event network-vif-plugged:e4c38bfc-187b-463e-b946-d50ff020a725 for instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b on n-h1-820368-35 Aug 27 06:26:05.489859 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-3259d578-d652-492c-a61e-7276a4cfbec5 req-4490bb4a-57b6-44f2-8a54-182714ee3f13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092560 Aug 27 06:26:05.490520 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4040/8067] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:26:06.006168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c1d41d30-b43c-43eb-87dd-3f310ea6d1d3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:06.006802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c1d41d30-b43c-43eb-87dd-3f310ea6d1d3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:06.014260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1d41d30-b43c-43eb-87dd-3f310ea6d1d3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:06.014758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1d41d30-b43c-43eb-87dd-3f310ea6d1d3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:06.015257 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1d41d30-b43c-43eb-87dd-3f310ea6d1d3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:06.015998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1d41d30-b43c-43eb-87dd-3f310ea6d1d3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:06.016476 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1d41d30-b43c-43eb-87dd-3f310ea6d1d3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:06.016946 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1d41d30-b43c-43eb-87dd-3f310ea6d1d3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:06.150366 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1d41d30-b43c-43eb-87dd-3f310ea6d1d3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:06.158336 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c1d41d30-b43c-43eb-87dd-3f310ea6d1d3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1701 microversion: 2.1 time: 0.156164 Aug 27 06:26:06.158904 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4028/8068] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:06 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:07.182078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70ace78b-0f38-4f14-904a-8c03ad708789 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:07.182799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-70ace78b-0f38-4f14-904a-8c03ad708789 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:07.189740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70ace78b-0f38-4f14-904a-8c03ad708789 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:07.190235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70ace78b-0f38-4f14-904a-8c03ad708789 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:07.190685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70ace78b-0f38-4f14-904a-8c03ad708789 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:07.191431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70ace78b-0f38-4f14-904a-8c03ad708789 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:07.191895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70ace78b-0f38-4f14-904a-8c03ad708789 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:07.192329 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70ace78b-0f38-4f14-904a-8c03ad708789 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:07.323872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-70ace78b-0f38-4f14-904a-8c03ad708789 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:07.332303 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70ace78b-0f38-4f14-904a-8c03ad708789 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1701 microversion: 2.1 time: 0.155627 Aug 27 06:26:07.332878 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4041/8069] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:07 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:08.353610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bb930cfe-9470-485e-a3a2-dc2d48de181c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:08.354291 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bb930cfe-9470-485e-a3a2-dc2d48de181c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:08.361723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb930cfe-9470-485e-a3a2-dc2d48de181c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:08.362238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb930cfe-9470-485e-a3a2-dc2d48de181c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:08.362701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb930cfe-9470-485e-a3a2-dc2d48de181c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:08.363464 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb930cfe-9470-485e-a3a2-dc2d48de181c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:08.363999 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb930cfe-9470-485e-a3a2-dc2d48de181c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:08.364396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bb930cfe-9470-485e-a3a2-dc2d48de181c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:08.505006 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bb930cfe-9470-485e-a3a2-dc2d48de181c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:08.513448 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bb930cfe-9470-485e-a3a2-dc2d48de181c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1696 microversion: 2.1 time: 0.163953 Aug 27 06:26:08.514027 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4029/8070] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:08 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:09.535802 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6387b1d2-0d4d-42df-bc77-3840faaf83f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:09.536431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6387b1d2-0d4d-42df-bc77-3840faaf83f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:09.546685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6387b1d2-0d4d-42df-bc77-3840faaf83f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:09.547220 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6387b1d2-0d4d-42df-bc77-3840faaf83f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:09.547673 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6387b1d2-0d4d-42df-bc77-3840faaf83f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:09.548399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6387b1d2-0d4d-42df-bc77-3840faaf83f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:09.548871 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6387b1d2-0d4d-42df-bc77-3840faaf83f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:09.549959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6387b1d2-0d4d-42df-bc77-3840faaf83f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:09.707866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6387b1d2-0d4d-42df-bc77-3840faaf83f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:09.717442 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6387b1d2-0d4d-42df-bc77-3840faaf83f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1696 microversion: 2.1 time: 0.185511 Aug 27 06:26:09.719160 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4042/8071] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:09 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:10.739150 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-337d62ac-0673-432b-b76a-2b215f99834d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:10.740880 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-337d62ac-0673-432b-b76a-2b215f99834d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:10.749561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-337d62ac-0673-432b-b76a-2b215f99834d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:10.750157 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-337d62ac-0673-432b-b76a-2b215f99834d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:10.750715 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-337d62ac-0673-432b-b76a-2b215f99834d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:10.751575 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-337d62ac-0673-432b-b76a-2b215f99834d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:10.752295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-337d62ac-0673-432b-b76a-2b215f99834d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:10.752994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-337d62ac-0673-432b-b76a-2b215f99834d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:10.930684 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-337d62ac-0673-432b-b76a-2b215f99834d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:10.941532 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-337d62ac-0673-432b-b76a-2b215f99834d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1696 microversion: 2.1 time: 0.206477 Aug 27 06:26:10.942565 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4030/8072] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:10 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:11.966810 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1db66d40-7264-4e69-8626-97ee8a7e0d37 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:11.967462 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1db66d40-7264-4e69-8626-97ee8a7e0d37 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:11.977714 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1db66d40-7264-4e69-8626-97ee8a7e0d37 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:11.978699 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1db66d40-7264-4e69-8626-97ee8a7e0d37 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:11.979178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1db66d40-7264-4e69-8626-97ee8a7e0d37 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:11.980101 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1db66d40-7264-4e69-8626-97ee8a7e0d37 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:11.980562 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1db66d40-7264-4e69-8626-97ee8a7e0d37 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:11.981004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1db66d40-7264-4e69-8626-97ee8a7e0d37 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:12.129607 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1db66d40-7264-4e69-8626-97ee8a7e0d37 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:12.142866 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1db66d40-7264-4e69-8626-97ee8a7e0d37 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1696 microversion: 2.1 time: 0.180012 Aug 27 06:26:12.144266 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4043/8073] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:11 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:13.169645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-40e2876f-ad2d-4b86-a293-4f581025154e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:13.170378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-40e2876f-ad2d-4b86-a293-4f581025154e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:13.178277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40e2876f-ad2d-4b86-a293-4f581025154e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:13.178783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40e2876f-ad2d-4b86-a293-4f581025154e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:13.179278 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40e2876f-ad2d-4b86-a293-4f581025154e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:13.180020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40e2876f-ad2d-4b86-a293-4f581025154e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:13.180788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40e2876f-ad2d-4b86-a293-4f581025154e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:13.181242 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-40e2876f-ad2d-4b86-a293-4f581025154e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:13.346617 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-40e2876f-ad2d-4b86-a293-4f581025154e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:13.355544 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-40e2876f-ad2d-4b86-a293-4f581025154e tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1696 microversion: 2.1 time: 0.189971 Aug 27 06:26:13.356789 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4031/8074] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:13 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:26:14.378476 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7dd53eb0-f007-4bfc-ac70-d51d5ed3b313 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:14.379051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7dd53eb0-f007-4bfc-ac70-d51d5ed3b313 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:14.387469 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dd53eb0-f007-4bfc-ac70-d51d5ed3b313 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:14.389886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dd53eb0-f007-4bfc-ac70-d51d5ed3b313 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:14.392314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dd53eb0-f007-4bfc-ac70-d51d5ed3b313 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:14.393858 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dd53eb0-f007-4bfc-ac70-d51d5ed3b313 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:14.394985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dd53eb0-f007-4bfc-ac70-d51d5ed3b313 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:14.395851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7dd53eb0-f007-4bfc-ac70-d51d5ed3b313 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:14.563846 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7dd53eb0-f007-4bfc-ac70-d51d5ed3b313 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:14.572394 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7dd53eb0-f007-4bfc-ac70-d51d5ed3b313 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1696 microversion: 2.1 time: 0.198844 Aug 27 06:26:14.583409 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4044/8075] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:14 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:15.604561 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2f469e3e-78e3-4fac-8d5a-9e1cdca1ac4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:15.605834 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2f469e3e-78e3-4fac-8d5a-9e1cdca1ac4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:15.614821 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f469e3e-78e3-4fac-8d5a-9e1cdca1ac4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:15.615591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f469e3e-78e3-4fac-8d5a-9e1cdca1ac4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:15.615987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f469e3e-78e3-4fac-8d5a-9e1cdca1ac4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:15.616680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f469e3e-78e3-4fac-8d5a-9e1cdca1ac4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:15.617171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f469e3e-78e3-4fac-8d5a-9e1cdca1ac4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:15.617645 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2f469e3e-78e3-4fac-8d5a-9e1cdca1ac4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:15.785265 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2f469e3e-78e3-4fac-8d5a-9e1cdca1ac4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:15.793896 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2f469e3e-78e3-4fac-8d5a-9e1cdca1ac4f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1696 microversion: 2.1 time: 0.194919 Aug 27 06:26:15.808494 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4032/8076] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:15 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1696 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:16.815142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d29d2251-bf7c-4e9c-a190-2f7c29d0c5d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:16.815800 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d29d2251-bf7c-4e9c-a190-2f7c29d0c5d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:16.822483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d29d2251-bf7c-4e9c-a190-2f7c29d0c5d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:16.822991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d29d2251-bf7c-4e9c-a190-2f7c29d0c5d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:16.823697 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d29d2251-bf7c-4e9c-a190-2f7c29d0c5d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:16.824397 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d29d2251-bf7c-4e9c-a190-2f7c29d0c5d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:16.824859 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d29d2251-bf7c-4e9c-a190-2f7c29d0c5d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:16.825290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d29d2251-bf7c-4e9c-a190-2f7c29d0c5d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:16.979352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d29d2251-bf7c-4e9c-a190-2f7c29d0c5d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:16.988597 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d29d2251-bf7c-4e9c-a190-2f7c29d0c5d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1696 microversion: 2.1 time: 0.176966 Aug 27 06:26:16.988917 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4045/8077] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:16 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:18.008907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-21f1bca6-0b5b-4cc5-9eba-bb3422c81a25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:18.009535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-21f1bca6-0b5b-4cc5-9eba-bb3422c81a25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:18.016364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21f1bca6-0b5b-4cc5-9eba-bb3422c81a25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:18.016861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21f1bca6-0b5b-4cc5-9eba-bb3422c81a25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:18.017314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21f1bca6-0b5b-4cc5-9eba-bb3422c81a25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:18.018019 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21f1bca6-0b5b-4cc5-9eba-bb3422c81a25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:18.018487 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21f1bca6-0b5b-4cc5-9eba-bb3422c81a25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:18.018928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-21f1bca6-0b5b-4cc5-9eba-bb3422c81a25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:18.237329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-21f1bca6-0b5b-4cc5-9eba-bb3422c81a25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:18.245295 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-21f1bca6-0b5b-4cc5-9eba-bb3422c81a25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1678 microversion: 2.1 time: 0.240577 Aug 27 06:26:18.245879 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4033/8078] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:18 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:19.268070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-45208edc-87b5-4f47-964c-1fb95081b9db tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:19.268619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-45208edc-87b5-4f47-964c-1fb95081b9db tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:19.275707 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45208edc-87b5-4f47-964c-1fb95081b9db tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:19.276191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45208edc-87b5-4f47-964c-1fb95081b9db tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:19.276628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45208edc-87b5-4f47-964c-1fb95081b9db tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:19.277324 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45208edc-87b5-4f47-964c-1fb95081b9db tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:19.277779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45208edc-87b5-4f47-964c-1fb95081b9db tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:19.278208 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45208edc-87b5-4f47-964c-1fb95081b9db tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:19.410297 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45208edc-87b5-4f47-964c-1fb95081b9db tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:19.419621 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-45208edc-87b5-4f47-964c-1fb95081b9db tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1678 microversion: 2.1 time: 0.155082 Aug 27 06:26:19.420214 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4046/8079] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:19 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:20.441015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b6514ff0-d4d8-469f-9dbd-48420bd39a15 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:20.441861 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b6514ff0-d4d8-469f-9dbd-48420bd39a15 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:20.448748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6514ff0-d4d8-469f-9dbd-48420bd39a15 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:20.449459 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6514ff0-d4d8-469f-9dbd-48420bd39a15 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:20.449926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6514ff0-d4d8-469f-9dbd-48420bd39a15 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:20.450656 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6514ff0-d4d8-469f-9dbd-48420bd39a15 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:20.451270 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6514ff0-d4d8-469f-9dbd-48420bd39a15 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:20.451750 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b6514ff0-d4d8-469f-9dbd-48420bd39a15 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:20.584812 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b6514ff0-d4d8-469f-9dbd-48420bd39a15 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:20.593109 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b6514ff0-d4d8-469f-9dbd-48420bd39a15 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1681 microversion: 2.1 time: 0.156036 Aug 27 06:26:20.593689 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4034/8080] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:20 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:20.614679 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-bc4b6f0d-6a11-4813-ae83-9c9f5338372c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:26:20.615458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bc4b6f0d-6a11-4813-ae83-9c9f5338372c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:20.618179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=29 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:26:20.623467 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc4b6f0d-6a11-4813-ae83-9c9f5338372c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:20.623951 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc4b6f0d-6a11-4813-ae83-9c9f5338372c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:20.624388 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc4b6f0d-6a11-4813-ae83-9c9f5338372c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:20.625090 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc4b6f0d-6a11-4813-ae83-9c9f5338372c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:20.625545 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc4b6f0d-6a11-4813-ae83-9c9f5338372c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:20.625970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-bc4b6f0d-6a11-4813-ae83-9c9f5338372c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:20.629982 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:26:20.725516 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-bc4b6f0d-6a11-4813-ae83-9c9f5338372c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128548) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 06:26:20.801547 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-bc4b6f0d-6a11-4813-ae83-9c9f5338372c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "POST /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b/action" status: 202 len: 0 microversion: 2.1 time: 0.190782 Aug 27 06:26:20.802531 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4047/8081] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:26:20 2022] POST /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 06:26:20.810579 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-86a3e9ed-fe3e-49dd-9cf3-5bbdef207301 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:20.811248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-86a3e9ed-fe3e-49dd-9cf3-5bbdef207301 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:20.814558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=29 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:26:20.818204 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a3e9ed-fe3e-49dd-9cf3-5bbdef207301 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:20.818673 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a3e9ed-fe3e-49dd-9cf3-5bbdef207301 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:20.819351 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a3e9ed-fe3e-49dd-9cf3-5bbdef207301 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:20.820075 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a3e9ed-fe3e-49dd-9cf3-5bbdef207301 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:20.820707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a3e9ed-fe3e-49dd-9cf3-5bbdef207301 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:20.821319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-86a3e9ed-fe3e-49dd-9cf3-5bbdef207301 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:20.824689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=85 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:26:20.957723 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-86a3e9ed-fe3e-49dd-9cf3-5bbdef207301 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:20.967071 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-86a3e9ed-fe3e-49dd-9cf3-5bbdef207301 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1629 microversion: 2.1 time: 0.160332 Aug 27 06:26:20.967687 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4035/8082] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:20 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1629 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:21.413349 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-5e49e160-f156-4d0c-aa01-9bf17d21d746 req-6281425f-26bd-41ea-bd7d-8b08f3a042ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb86ca9-2c00-4449-9f13-d6ae1d310f9b", "name": "network-vif-unplugged", "status": "completed", "tag": "e4c38bfc-187b-463e-b946-d50ff020a725"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:26:21.425500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5e49e160-f156-4d0c-aa01-9bf17d21d746 req-6281425f-26bd-41ea-bd7d-8b08f3a042ab service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:21.426179 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5e49e160-f156-4d0c-aa01-9bf17d21d746 req-6281425f-26bd-41ea-bd7d-8b08f3a042ab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:21.426631 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-5e49e160-f156-4d0c-aa01-9bf17d21d746 req-6281425f-26bd-41ea-bd7d-8b08f3a042ab service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:21.438978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.compute.server_external_events [req-5e49e160-f156-4d0c-aa01-9bf17d21d746 req-6281425f-26bd-41ea-bd7d-8b08f3a042ab service nova] Unable to find a host for instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b. Dropping event network-vif-unplugged {{(pid=128548) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 06:26:21.439919 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-5e49e160-f156-4d0c-aa01-9bf17d21d746 req-6281425f-26bd-41ea-bd7d-8b08f3a042ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030614 Aug 27 06:26:21.440522 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4048/8083] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 06:26:21.988475 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d7f6ff58-d2ee-40d6-9ca9-c8158fdd8966 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:21.989106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d7f6ff58-d2ee-40d6-9ca9-c8158fdd8966 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:21.996080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7f6ff58-d2ee-40d6-9ca9-c8158fdd8966 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:21.996594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7f6ff58-d2ee-40d6-9ca9-c8158fdd8966 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:21.997680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7f6ff58-d2ee-40d6-9ca9-c8158fdd8966 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:21.998401 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7f6ff58-d2ee-40d6-9ca9-c8158fdd8966 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:21.998873 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7f6ff58-d2ee-40d6-9ca9-c8158fdd8966 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:21.999343 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d7f6ff58-d2ee-40d6-9ca9-c8158fdd8966 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:22.129961 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d7f6ff58-d2ee-40d6-9ca9-c8158fdd8966 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:22.137833 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d7f6ff58-d2ee-40d6-9ca9-c8158fdd8966 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1629 microversion: 2.1 time: 0.153329 Aug 27 06:26:22.138411 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4036/8084] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:21 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1629 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:23.159790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-6db9fc9c-9d82-4f8a-852e-d43c8016093d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:23.160405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-6db9fc9c-9d82-4f8a-852e-d43c8016093d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:23.166741 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6db9fc9c-9d82-4f8a-852e-d43c8016093d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:23.167272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6db9fc9c-9d82-4f8a-852e-d43c8016093d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:23.167715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6db9fc9c-9d82-4f8a-852e-d43c8016093d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:23.168408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6db9fc9c-9d82-4f8a-852e-d43c8016093d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:23.168891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6db9fc9c-9d82-4f8a-852e-d43c8016093d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:23.169351 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-6db9fc9c-9d82-4f8a-852e-d43c8016093d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:23.298833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-6db9fc9c-9d82-4f8a-852e-d43c8016093d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:23.306857 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-6db9fc9c-9d82-4f8a-852e-d43c8016093d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1629 microversion: 2.1 time: 0.151161 Aug 27 06:26:23.307462 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4049/8085] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:23 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1629 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:24.328542 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2db83d28-5f7f-4cbf-bed6-75e915ae0413 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:24.329180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2db83d28-5f7f-4cbf-bed6-75e915ae0413 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:24.335712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db83d28-5f7f-4cbf-bed6-75e915ae0413 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:24.336215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db83d28-5f7f-4cbf-bed6-75e915ae0413 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:24.336674 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db83d28-5f7f-4cbf-bed6-75e915ae0413 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:24.337388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db83d28-5f7f-4cbf-bed6-75e915ae0413 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:24.337863 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db83d28-5f7f-4cbf-bed6-75e915ae0413 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:24.338327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2db83d28-5f7f-4cbf-bed6-75e915ae0413 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:24.475507 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2db83d28-5f7f-4cbf-bed6-75e915ae0413 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:24.483688 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2db83d28-5f7f-4cbf-bed6-75e915ae0413 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1629 microversion: 2.1 time: 0.159113 Aug 27 06:26:24.484273 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4037/8086] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:24 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1629 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:25.504672 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-91c7ad0a-8054-41de-aca2-a6daca631e7b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:25.505295 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-91c7ad0a-8054-41de-aca2-a6daca631e7b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:25.512241 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c7ad0a-8054-41de-aca2-a6daca631e7b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:25.513242 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c7ad0a-8054-41de-aca2-a6daca631e7b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:25.513680 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c7ad0a-8054-41de-aca2-a6daca631e7b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:25.514379 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c7ad0a-8054-41de-aca2-a6daca631e7b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:25.514838 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c7ad0a-8054-41de-aca2-a6daca631e7b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:25.515298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-91c7ad0a-8054-41de-aca2-a6daca631e7b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:25.646136 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-91c7ad0a-8054-41de-aca2-a6daca631e7b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:25.654659 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-91c7ad0a-8054-41de-aca2-a6daca631e7b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1629 microversion: 2.1 time: 0.153882 Aug 27 06:26:25.658979 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4050/8087] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:25 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1629 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:26.676402 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f18ee8bf-6460-47d1-b548-e87ff1f90da4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:26.677141 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f18ee8bf-6460-47d1-b548-e87ff1f90da4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:26.685039 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18ee8bf-6460-47d1-b548-e87ff1f90da4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:26.685547 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18ee8bf-6460-47d1-b548-e87ff1f90da4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:26.686051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18ee8bf-6460-47d1-b548-e87ff1f90da4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:26.686767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18ee8bf-6460-47d1-b548-e87ff1f90da4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:26.687306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18ee8bf-6460-47d1-b548-e87ff1f90da4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:26.687755 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f18ee8bf-6460-47d1-b548-e87ff1f90da4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:26.827288 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f18ee8bf-6460-47d1-b548-e87ff1f90da4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:26.835244 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f18ee8bf-6460-47d1-b548-e87ff1f90da4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.162807 Aug 27 06:26:26.835934 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4038/8088] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:26 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:27.098813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b779dbd7-e95e-4bbe-99f8-37ba8691e487 req-416a437c-c3f9-48be-a5f6-5e757731a20f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb86ca9-2c00-4449-9f13-d6ae1d310f9b", "tag": "e4c38bfc-187b-463e-b946-d50ff020a725"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:26:27.108509 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b779dbd7-e95e-4bbe-99f8-37ba8691e487 req-416a437c-c3f9-48be-a5f6-5e757731a20f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:27.109080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b779dbd7-e95e-4bbe-99f8-37ba8691e487 req-416a437c-c3f9-48be-a5f6-5e757731a20f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:27.109596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b779dbd7-e95e-4bbe-99f8-37ba8691e487 req-416a437c-c3f9-48be-a5f6-5e757731a20f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:27.124552 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b779dbd7-e95e-4bbe-99f8-37ba8691e487 req-416a437c-c3f9-48be-a5f6-5e757731a20f service nova] Creating event network-changed:e4c38bfc-187b-463e-b946-d50ff020a725 for instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b on n-h2-820368-35 Aug 27 06:26:27.129858 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b779dbd7-e95e-4bbe-99f8-37ba8691e487 req-416a437c-c3f9-48be-a5f6-5e757731a20f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095331 Aug 27 06:26:27.130562 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4051/8089] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:26:27.858314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6452ca03-ad31-45ec-9bd0-71c0e78f41b9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:27.859598 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6452ca03-ad31-45ec-9bd0-71c0e78f41b9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:27.868067 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6452ca03-ad31-45ec-9bd0-71c0e78f41b9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:27.868905 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6452ca03-ad31-45ec-9bd0-71c0e78f41b9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:27.869586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6452ca03-ad31-45ec-9bd0-71c0e78f41b9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:27.870635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6452ca03-ad31-45ec-9bd0-71c0e78f41b9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:27.871387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6452ca03-ad31-45ec-9bd0-71c0e78f41b9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:27.873469 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6452ca03-ad31-45ec-9bd0-71c0e78f41b9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:28.108894 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6452ca03-ad31-45ec-9bd0-71c0e78f41b9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:28.139556 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6452ca03-ad31-45ec-9bd0-71c0e78f41b9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.285540 Aug 27 06:26:28.141395 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4039/8090] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:27 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:29.165472 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f36267f1-7d54-4a7d-b0cd-b6f816bb7894 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:29.166178 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f36267f1-7d54-4a7d-b0cd-b6f816bb7894 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:29.172387 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f36267f1-7d54-4a7d-b0cd-b6f816bb7894 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:29.172979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f36267f1-7d54-4a7d-b0cd-b6f816bb7894 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:29.173422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f36267f1-7d54-4a7d-b0cd-b6f816bb7894 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:29.174275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f36267f1-7d54-4a7d-b0cd-b6f816bb7894 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:29.174790 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f36267f1-7d54-4a7d-b0cd-b6f816bb7894 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:29.175264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f36267f1-7d54-4a7d-b0cd-b6f816bb7894 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:29.323017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f36267f1-7d54-4a7d-b0cd-b6f816bb7894 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:29.332982 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f36267f1-7d54-4a7d-b0cd-b6f816bb7894 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.172443 Aug 27 06:26:29.347387 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4052/8091] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:29 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:30.372379 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ca67448b-41b7-41cb-948e-ef24f4f798ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:30.373054 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ca67448b-41b7-41cb-948e-ef24f4f798ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:30.380407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca67448b-41b7-41cb-948e-ef24f4f798ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:30.381352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca67448b-41b7-41cb-948e-ef24f4f798ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:30.382328 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca67448b-41b7-41cb-948e-ef24f4f798ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:30.383377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca67448b-41b7-41cb-948e-ef24f4f798ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:30.384126 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca67448b-41b7-41cb-948e-ef24f4f798ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:30.384739 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ca67448b-41b7-41cb-948e-ef24f4f798ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:30.554037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ca67448b-41b7-41cb-948e-ef24f4f798ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:30.562188 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ca67448b-41b7-41cb-948e-ef24f4f798ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.193780 Aug 27 06:26:30.562779 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4040/8092] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:30 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:31.584608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c1e51493-f41c-4003-8665-31f1d332ecb5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:31.585191 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c1e51493-f41c-4003-8665-31f1d332ecb5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:31.595127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1e51493-f41c-4003-8665-31f1d332ecb5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:31.600527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1e51493-f41c-4003-8665-31f1d332ecb5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:31.600527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1e51493-f41c-4003-8665-31f1d332ecb5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:31.600527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1e51493-f41c-4003-8665-31f1d332ecb5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:31.600527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1e51493-f41c-4003-8665-31f1d332ecb5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:31.600527 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c1e51493-f41c-4003-8665-31f1d332ecb5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:31.754308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c1e51493-f41c-4003-8665-31f1d332ecb5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:31.762546 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c1e51493-f41c-4003-8665-31f1d332ecb5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.182702 Aug 27 06:26:31.775152 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4053/8093] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:31 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:32.785168 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9dd51a48-91be-4bf0-9d2a-e9b9bf6fd579 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:32.785849 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9dd51a48-91be-4bf0-9d2a-e9b9bf6fd579 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:32.792798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dd51a48-91be-4bf0-9d2a-e9b9bf6fd579 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:32.793359 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dd51a48-91be-4bf0-9d2a-e9b9bf6fd579 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:32.794336 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dd51a48-91be-4bf0-9d2a-e9b9bf6fd579 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:32.795320 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dd51a48-91be-4bf0-9d2a-e9b9bf6fd579 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:32.795843 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dd51a48-91be-4bf0-9d2a-e9b9bf6fd579 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:32.796311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9dd51a48-91be-4bf0-9d2a-e9b9bf6fd579 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:33.310554 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9dd51a48-91be-4bf0-9d2a-e9b9bf6fd579 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:33.319285 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9dd51a48-91be-4bf0-9d2a-e9b9bf6fd579 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.537832 Aug 27 06:26:33.320141 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4041/8094] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:32 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:34.342776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-65819360-fd52-4586-9b5e-307b76c242c1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:34.344119 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-65819360-fd52-4586-9b5e-307b76c242c1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:34.351394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65819360-fd52-4586-9b5e-307b76c242c1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:34.351884 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65819360-fd52-4586-9b5e-307b76c242c1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:34.352323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65819360-fd52-4586-9b5e-307b76c242c1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:34.353027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65819360-fd52-4586-9b5e-307b76c242c1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:34.353655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65819360-fd52-4586-9b5e-307b76c242c1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:34.354245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-65819360-fd52-4586-9b5e-307b76c242c1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:34.521816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-65819360-fd52-4586-9b5e-307b76c242c1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:34.532957 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-65819360-fd52-4586-9b5e-307b76c242c1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.195309 Aug 27 06:26:34.533960 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4054/8095] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:34 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:26:35.555871 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-9de45b2f-624c-4171-9f8e-afd61ea29174 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:35.556535 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-9de45b2f-624c-4171-9f8e-afd61ea29174 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:35.563529 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9de45b2f-624c-4171-9f8e-afd61ea29174 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:35.564036 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9de45b2f-624c-4171-9f8e-afd61ea29174 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:35.564492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9de45b2f-624c-4171-9f8e-afd61ea29174 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:35.565213 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9de45b2f-624c-4171-9f8e-afd61ea29174 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:35.565687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9de45b2f-624c-4171-9f8e-afd61ea29174 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:35.566134 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-9de45b2f-624c-4171-9f8e-afd61ea29174 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:35.701615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-9de45b2f-624c-4171-9f8e-afd61ea29174 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:35.709448 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-9de45b2f-624c-4171-9f8e-afd61ea29174 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.157811 Aug 27 06:26:35.710020 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4042/8096] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:35 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:36.731779 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-9f84fd88-0a5f-4ce4-be17-ba44b059ea5f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:36.732400 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-9f84fd88-0a5f-4ce4-be17-ba44b059ea5f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:36.739192 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f84fd88-0a5f-4ce4-be17-ba44b059ea5f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:36.739839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f84fd88-0a5f-4ce4-be17-ba44b059ea5f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:36.740277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f84fd88-0a5f-4ce4-be17-ba44b059ea5f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:36.740972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f84fd88-0a5f-4ce4-be17-ba44b059ea5f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:36.741428 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f84fd88-0a5f-4ce4-be17-ba44b059ea5f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:36.741854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-9f84fd88-0a5f-4ce4-be17-ba44b059ea5f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:36.873597 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-9f84fd88-0a5f-4ce4-be17-ba44b059ea5f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:36.881478 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-9f84fd88-0a5f-4ce4-be17-ba44b059ea5f tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.154255 Aug 27 06:26:36.882062 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4055/8097] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:36 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:37.904294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-df56ec86-342f-4010-8084-a38f11c6b9f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:37.904967 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-df56ec86-342f-4010-8084-a38f11c6b9f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:37.911960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df56ec86-342f-4010-8084-a38f11c6b9f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:37.912492 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df56ec86-342f-4010-8084-a38f11c6b9f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:37.912947 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df56ec86-342f-4010-8084-a38f11c6b9f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:37.914001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df56ec86-342f-4010-8084-a38f11c6b9f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:37.914103 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df56ec86-342f-4010-8084-a38f11c6b9f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:37.914559 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-df56ec86-342f-4010-8084-a38f11c6b9f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:38.054066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-df56ec86-342f-4010-8084-a38f11c6b9f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:38.063254 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-df56ec86-342f-4010-8084-a38f11c6b9f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.163329 Aug 27 06:26:38.064166 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4043/8098] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:37 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:39.085321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-482a58d2-f217-473b-ba3b-ab1b1fd14cd2 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:39.085898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-482a58d2-f217-473b-ba3b-ab1b1fd14cd2 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:39.092934 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-482a58d2-f217-473b-ba3b-ab1b1fd14cd2 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:39.093424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-482a58d2-f217-473b-ba3b-ab1b1fd14cd2 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:39.093869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-482a58d2-f217-473b-ba3b-ab1b1fd14cd2 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:39.094568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-482a58d2-f217-473b-ba3b-ab1b1fd14cd2 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:39.095029 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-482a58d2-f217-473b-ba3b-ab1b1fd14cd2 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:39.095487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-482a58d2-f217-473b-ba3b-ab1b1fd14cd2 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:39.228080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-482a58d2-f217-473b-ba3b-ab1b1fd14cd2 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:39.236394 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-482a58d2-f217-473b-ba3b-ab1b1fd14cd2 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.155114 Aug 27 06:26:39.236971 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4056/8099] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:39 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:40.257899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1b03a090-3ab6-41f5-b247-fe4c6ed3d88c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:40.258533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1b03a090-3ab6-41f5-b247-fe4c6ed3d88c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:40.266823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b03a090-3ab6-41f5-b247-fe4c6ed3d88c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:40.267348 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b03a090-3ab6-41f5-b247-fe4c6ed3d88c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:40.267802 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b03a090-3ab6-41f5-b247-fe4c6ed3d88c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:40.268513 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b03a090-3ab6-41f5-b247-fe4c6ed3d88c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:40.268979 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b03a090-3ab6-41f5-b247-fe4c6ed3d88c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:40.269417 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b03a090-3ab6-41f5-b247-fe4c6ed3d88c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:40.398327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1b03a090-3ab6-41f5-b247-fe4c6ed3d88c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:40.406122 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1b03a090-3ab6-41f5-b247-fe4c6ed3d88c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.152258 Aug 27 06:26:40.406692 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4044/8100] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:40 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:41.427993 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eed2e9cf-f245-4da8-a649-b218368d7608 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:41.428628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eed2e9cf-f245-4da8-a649-b218368d7608 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:41.436549 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eed2e9cf-f245-4da8-a649-b218368d7608 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:41.436978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eed2e9cf-f245-4da8-a649-b218368d7608 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:41.437413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eed2e9cf-f245-4da8-a649-b218368d7608 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:41.438108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eed2e9cf-f245-4da8-a649-b218368d7608 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:41.438573 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eed2e9cf-f245-4da8-a649-b218368d7608 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:41.439002 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eed2e9cf-f245-4da8-a649-b218368d7608 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:41.572372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eed2e9cf-f245-4da8-a649-b218368d7608 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:41.579999 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eed2e9cf-f245-4da8-a649-b218368d7608 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.156122 Aug 27 06:26:41.580579 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4057/8101] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:41 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:42.601724 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f1d09076-04f3-4741-943f-8a12f95cb974 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:42.602341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f1d09076-04f3-4741-943f-8a12f95cb974 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:42.609805 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1d09076-04f3-4741-943f-8a12f95cb974 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:42.610230 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1d09076-04f3-4741-943f-8a12f95cb974 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:42.610691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1d09076-04f3-4741-943f-8a12f95cb974 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:42.611523 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1d09076-04f3-4741-943f-8a12f95cb974 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:42.612004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1d09076-04f3-4741-943f-8a12f95cb974 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:42.612451 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f1d09076-04f3-4741-943f-8a12f95cb974 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:42.743862 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f1d09076-04f3-4741-943f-8a12f95cb974 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:42.752629 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f1d09076-04f3-4741-943f-8a12f95cb974 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.154954 Aug 27 06:26:42.753204 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4045/8102] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:42 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:43.775245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7ee171fc-944f-4ed9-9e5c-5bfbd702c742 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:43.775889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7ee171fc-944f-4ed9-9e5c-5bfbd702c742 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:43.783313 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee171fc-944f-4ed9-9e5c-5bfbd702c742 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:43.783799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee171fc-944f-4ed9-9e5c-5bfbd702c742 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:43.784237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee171fc-944f-4ed9-9e5c-5bfbd702c742 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:43.784938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee171fc-944f-4ed9-9e5c-5bfbd702c742 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:43.785394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee171fc-944f-4ed9-9e5c-5bfbd702c742 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:43.785820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7ee171fc-944f-4ed9-9e5c-5bfbd702c742 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:43.928565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7ee171fc-944f-4ed9-9e5c-5bfbd702c742 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:43.937391 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7ee171fc-944f-4ed9-9e5c-5bfbd702c742 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.166072 Aug 27 06:26:43.938174 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4058/8103] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:43 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:44.003829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8a508164-7d16-438b-bcc9-26eaabcbbd3e req-03fc7c5f-00b4-4d49-840d-0ecb0c8c8fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb86ca9-2c00-4449-9f13-d6ae1d310f9b", "name": "network-vif-plugged", "status": "completed", "tag": "e4c38bfc-187b-463e-b946-d50ff020a725"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:26:44.015065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8a508164-7d16-438b-bcc9-26eaabcbbd3e req-03fc7c5f-00b4-4d49-840d-0ecb0c8c8fcd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:44.015584 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8a508164-7d16-438b-bcc9-26eaabcbbd3e req-03fc7c5f-00b4-4d49-840d-0ecb0c8c8fcd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:44.016033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8a508164-7d16-438b-bcc9-26eaabcbbd3e req-03fc7c5f-00b4-4d49-840d-0ecb0c8c8fcd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:44.027195 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8a508164-7d16-438b-bcc9-26eaabcbbd3e req-03fc7c5f-00b4-4d49-840d-0ecb0c8c8fcd service nova] Creating event network-vif-plugged:e4c38bfc-187b-463e-b946-d50ff020a725 for instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b on n-h2-820368-35 Aug 27 06:26:44.033107 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8a508164-7d16-438b-bcc9-26eaabcbbd3e req-03fc7c5f-00b4-4d49-840d-0ecb0c8c8fcd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032982 Aug 27 06:26:44.033714 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4046/8104] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:26:44.963000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-02dda0b3-da66-49f9-84cc-b84acc624775 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:44.963650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-02dda0b3-da66-49f9-84cc-b84acc624775 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:44.970249 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02dda0b3-da66-49f9-84cc-b84acc624775 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:44.970740 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02dda0b3-da66-49f9-84cc-b84acc624775 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:44.971219 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02dda0b3-da66-49f9-84cc-b84acc624775 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:44.971918 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02dda0b3-da66-49f9-84cc-b84acc624775 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:44.972378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02dda0b3-da66-49f9-84cc-b84acc624775 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:44.972809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-02dda0b3-da66-49f9-84cc-b84acc624775 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:45.104961 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-02dda0b3-da66-49f9-84cc-b84acc624775 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:45.112855 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-02dda0b3-da66-49f9-84cc-b84acc624775 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.154844 Aug 27 06:26:45.113446 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4059/8105] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:44 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:46.135514 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-4a76401d-7ae2-4294-a130-b46d75710b61 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:46.136234 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-4a76401d-7ae2-4294-a130-b46d75710b61 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:46.142544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a76401d-7ae2-4294-a130-b46d75710b61 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:46.143051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a76401d-7ae2-4294-a130-b46d75710b61 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:46.143518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a76401d-7ae2-4294-a130-b46d75710b61 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:46.144235 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a76401d-7ae2-4294-a130-b46d75710b61 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:46.144710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a76401d-7ae2-4294-a130-b46d75710b61 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:46.145155 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-4a76401d-7ae2-4294-a130-b46d75710b61 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:46.282077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-4a76401d-7ae2-4294-a130-b46d75710b61 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:46.290037 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-4a76401d-7ae2-4294-a130-b46d75710b61 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1687 microversion: 2.1 time: 0.159881 Aug 27 06:26:46.290603 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4047/8106] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:46 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:26:47.312406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7a59133b-a314-4155-98c1-affd8905a6d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:26:47.313024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7a59133b-a314-4155-98c1-affd8905a6d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:26:47.320156 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a59133b-a314-4155-98c1-affd8905a6d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:47.320984 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a59133b-a314-4155-98c1-affd8905a6d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:47.321642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a59133b-a314-4155-98c1-affd8905a6d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:47.322352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a59133b-a314-4155-98c1-affd8905a6d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:26:47.322809 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a59133b-a314-4155-98c1-affd8905a6d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:26:47.323277 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7a59133b-a314-4155-98c1-affd8905a6d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:26:47.457053 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7a59133b-a314-4155-98c1-affd8905a6d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:26:47.464886 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7a59133b-a314-4155-98c1-affd8905a6d0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1674 microversion: 2.1 time: 0.156495 Aug 27 06:26:47.465455 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4060/8107] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:26:47 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:23.907555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=25 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:23.908695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=73 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:23.914392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:23.915124 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-25fec2af-0fb6-4499-b5bc-7c397f424aac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:23.915339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:23.916170 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25fec2af-0fb6-4499-b5bc-7c397f424aac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:23.930408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25fec2af-0fb6-4499-b5bc-7c397f424aac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:23.930919 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25fec2af-0fb6-4499-b5bc-7c397f424aac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:23.931666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25fec2af-0fb6-4499-b5bc-7c397f424aac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:23.932394 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25fec2af-0fb6-4499-b5bc-7c397f424aac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:23.932865 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25fec2af-0fb6-4499-b5bc-7c397f424aac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:23.933306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-25fec2af-0fb6-4499-b5bc-7c397f424aac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:23.964281 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-25fec2af-0fb6-4499-b5bc-7c397f424aac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:28:23.996221 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-52c264c1-20fc-4f1b-9206-3d0d7c49de53 req-7b2832f8-2301-44da-b184-f5b264d0062e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb86ca9-2c00-4449-9f13-d6ae1d310f9b", "tag": "e4c38bfc-187b-463e-b946-d50ff020a725"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:28:24.007172 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52c264c1-20fc-4f1b-9206-3d0d7c49de53 req-7b2832f8-2301-44da-b184-f5b264d0062e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:24.007580 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52c264c1-20fc-4f1b-9206-3d0d7c49de53 req-7b2832f8-2301-44da-b184-f5b264d0062e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:24.008024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-52c264c1-20fc-4f1b-9206-3d0d7c49de53 req-7b2832f8-2301-44da-b184-f5b264d0062e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:24.022103 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-52c264c1-20fc-4f1b-9206-3d0d7c49de53 req-7b2832f8-2301-44da-b184-f5b264d0062e service nova] Creating event network-changed:e4c38bfc-187b-463e-b946-d50ff020a725 for instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b on n-h2-820368-35 Aug 27 06:28:24.028309 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-52c264c1-20fc-4f1b-9206-3d0d7c49de53 req-7b2832f8-2301-44da-b184-f5b264d0062e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120499 Aug 27 06:28:24.029334 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4061/8108] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:28:24.054158 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-25fec2af-0fb6-4499-b5bc-7c397f424aac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 204 len: 0 microversion: 2.1 time: 0.148727 Aug 27 06:28:24.054767 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4048/8109] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:28:23 2022] DELETE /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:28:24.073820 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8ec09f40-2810-4434-9d1f-fb94feb93d70 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:24.074523 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8ec09f40-2810-4434-9d1f-fb94feb93d70 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:24.081463 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ec09f40-2810-4434-9d1f-fb94feb93d70 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:24.081957 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ec09f40-2810-4434-9d1f-fb94feb93d70 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:24.082394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ec09f40-2810-4434-9d1f-fb94feb93d70 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:24.083131 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ec09f40-2810-4434-9d1f-fb94feb93d70 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:24.083596 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ec09f40-2810-4434-9d1f-fb94feb93d70 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:24.084051 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8ec09f40-2810-4434-9d1f-fb94feb93d70 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:24.291649 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8ec09f40-2810-4434-9d1f-fb94feb93d70 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:24.299573 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8ec09f40-2810-4434-9d1f-fb94feb93d70 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.234382 Aug 27 06:28:24.313853 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4062/8110] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:24 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:25.322698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0e43ff7a-aae8-4be4-b2c2-e398f6369dcf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:25.323442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0e43ff7a-aae8-4be4-b2c2-e398f6369dcf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:25.330353 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e43ff7a-aae8-4be4-b2c2-e398f6369dcf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:25.330874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e43ff7a-aae8-4be4-b2c2-e398f6369dcf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:25.331433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e43ff7a-aae8-4be4-b2c2-e398f6369dcf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:25.332151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e43ff7a-aae8-4be4-b2c2-e398f6369dcf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:25.332614 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e43ff7a-aae8-4be4-b2c2-e398f6369dcf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:25.333052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e43ff7a-aae8-4be4-b2c2-e398f6369dcf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:25.518042 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0e43ff7a-aae8-4be4-b2c2-e398f6369dcf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:25.526317 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0e43ff7a-aae8-4be4-b2c2-e398f6369dcf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1680 microversion: 2.1 time: 0.208428 Aug 27 06:28:25.526898 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4049/8111] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:25 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:26.047033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-6478a7e7-9d70-4cc0-bb1a-5fbfd9031b4a req-69523e33-b47e-493a-af1a-b890bf840de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb86ca9-2c00-4449-9f13-d6ae1d310f9b", "name": "network-vif-deleted", "tag": "e4c38bfc-187b-463e-b946-d50ff020a725"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:28:26.058496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6478a7e7-9d70-4cc0-bb1a-5fbfd9031b4a req-69523e33-b47e-493a-af1a-b890bf840de7 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:26.058997 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6478a7e7-9d70-4cc0-bb1a-5fbfd9031b4a req-69523e33-b47e-493a-af1a-b890bf840de7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:26.059454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-6478a7e7-9d70-4cc0-bb1a-5fbfd9031b4a req-69523e33-b47e-493a-af1a-b890bf840de7 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:26.071308 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-6478a7e7-9d70-4cc0-bb1a-5fbfd9031b4a req-69523e33-b47e-493a-af1a-b890bf840de7 service nova] Creating event network-vif-deleted:e4c38bfc-187b-463e-b946-d50ff020a725 for instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b on n-h2-820368-35 Aug 27 06:28:26.076281 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-6478a7e7-9d70-4cc0-bb1a-5fbfd9031b4a req-69523e33-b47e-493a-af1a-b890bf840de7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033089 Aug 27 06:28:26.076889 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4063/8112] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:28:26.547756 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:26.548457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:26.556482 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:26.556991 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:26.557448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:26.558176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:26.558651 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:26.559331 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:26.596225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:26.596683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:26.597143 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:26.597586 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.objects.instance [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lazy-loading 'fault' on Instance uuid 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b {{(pid=128547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:28:26.638901 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:26.646274 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5d9b2725-bc22-49c3-a7da-1578f1d098a0 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 200 len: 1336 microversion: 2.1 time: 0.102411 Aug 27 06:28:26.646864 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4050/8113] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:26 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 1336 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:27.669551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:27.670359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:27.676629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:27.677116 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:27.677559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:27.678261 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:27.678718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:27.679176 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:27.693697 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] HTTP exception thrown: Instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b could not be found. Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Request method failure captured: Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b HTTP/1.1 Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbg6bT7v7-ICOmhOLjoL6mtFQtOiI0dIm9R6kA8KLm7i5B2lv0sHZZtH2LPfxrukysa6bdAzcuDIe3U6ckXFFk88r0VIraNQWEB8SzfdyrQiVgdWUXbN5vFrfcJiEhfdOszOHAMvohTk_SW5lESpHjdze5jyt78d8zjlW_Zs2BI7F7A Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 6eee79cf2b484239acf77f2d131a5b75 Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestShelveInstance-2096476059 Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6eee79cf2b484239acf77f2d131a5b75", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6eee79cf2b484239acf77f2d131a5b75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6eee79cf2b484239acf77f2d131a5b75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6eee79cf2b484239acf77f2d131a5b75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestShelveInstance-2096476059 Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 6eee79cf2b484239acf77f2d131a5b75 Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestShelveInstance-2096476059 Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestShelveInstance-2096476059-project Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 7349195aae474afaa937305ea067761e Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestShelveInstance-2096476059-project Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b could not be found. Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '2bb86ca9-2c00-4449-9f13-d6ae1d310f9b'} Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b could not be found. Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b could not be found. Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:28:27.695383 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:28:27.700554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:28:27.700554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:28:27.700554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:28:27.700554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:28:27.700554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:28:27.700554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b could not be found. Aug 27 06:28:27.700554 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:28:27.700554 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Returning 404 to user: Instance 2bb86ca9-2c00-4449-9f13-d6ae1d310f9b could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:28:27.700554 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-2e31a314-96ce-4879-92dd-8a19ec510c11 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b" status: 404 len: 111 microversion: 2.1 time: 0.032371 Aug 27 06:28:27.700554 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4064/8114] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:27 2022] GET /compute/v2.1/servers/2bb86ca9-2c00-4449-9f13-d6ae1d310f9b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:28:27.859306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-184c067b-b22e-4595-86bc-8398dd309a63 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '.version_select at 0x7fb564a655e0>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:27.885784 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-184c067b-b22e-4595-86bc-8398dd309a63 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-176269341" status: 202 len: 0 microversion: 2.1 time: 0.030382 Aug 27 06:28:27.886377 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4051/8115] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 06:28:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-176269341 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:28:27.910534 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-14fb69f1-c962-40fd-8591-3740f4d8b7cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Action: 'create', calling method: .version_select at 0x7fb564bef1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-359869760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdS5Ky7nEfdMGQgMKzye41FQtIduRPiAWanktMVc6bPDXR+yNEqNgYG7so2K84dKvJwDvB3Q5vRq5Ez5K2jZEq6uWn5aRbYBU9ucI4J5Ueffg+inmdeFM8LxdcBX0HWqQ=="}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:28:27.926431 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-14fb69f1-c962-40fd-8591-3740f4d8b7cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Getting quotas for project 6eee79cf2b484239acf77f2d131a5b75. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:28:27.931781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-14fb69f1-c962-40fd-8591-3740f4d8b7cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Getting quotas for user 7349195aae474afaa937305ea067761e and project 6eee79cf2b484239acf77f2d131a5b75. Resources: {'key_pairs'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:28:27.959757 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-14fb69f1-c962-40fd-8591-3740f4d8b7cf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.053159 Aug 27 06:28:27.960364 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4065/8116] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 06:28:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:28:45.261615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-575516198", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-359869760", "security_groups": [{"name": "tempest-secgroup-smoke-984898150"}], "networks": [{"uuid": "d3496ac7-9ff6-46f9-83f4-eb63547e5557"}], "block_device_mapping_v2": [{"uuid": "7c4f8451-b32a-43d5-9a5a-21c6f40890e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:28:45.274327 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:45.274987 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:45.380539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] validate_networks() for [('d3496ac7-9ff6-46f9-83f4-eb63547e5557', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:28:45.789899 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:28:45.790335 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:28:45.790823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:28:45.791295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:28:45.791733 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:28:45.800760 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:45.801255 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:45.801704 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:45.802442 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:45.802907 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:45.803377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:45.821215 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Getting quotas for project 6eee79cf2b484239acf77f2d131a5b75. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:28:45.826437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Getting quotas for user 7349195aae474afaa937305ea067761e and project 6eee79cf2b484239acf77f2d131a5b75. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:28:45.884926 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:28:45.887066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c4f8451-b32a-43d5-9a5a-21c6f40890e2',volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:28:46.016936 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1428dbfb-0a9e-4459-b750-137aa9241daf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759217 Aug 27 06:28:46.017600 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4052/8117] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:28:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:28:46.029323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a6fc50fa-f4b2-4778-8eb7-b30fbbd4ab5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:46.030016 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a6fc50fa-f4b2-4778-8eb7-b30fbbd4ab5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:46.036075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=12 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:46.037372 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=4 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:46.038143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:46.102590 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a6fc50fa-f4b2-4778-8eb7-b30fbbd4ab5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:46.110073 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a6fc50fa-f4b2-4778-8eb7-b30fbbd4ab5c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1087 microversion: 2.1 time: 0.084686 Aug 27 06:28:46.111042 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4066/8118] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:46 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1087 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:47.132891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-582a06ab-2c85-42b6-985d-a664fdc410c9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:47.134127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-582a06ab-2c85-42b6-985d-a664fdc410c9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:47.141551 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-582a06ab-2c85-42b6-985d-a664fdc410c9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:47.142285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-582a06ab-2c85-42b6-985d-a664fdc410c9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:47.142740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-582a06ab-2c85-42b6-985d-a664fdc410c9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:47.143481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-582a06ab-2c85-42b6-985d-a664fdc410c9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:47.144151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-582a06ab-2c85-42b6-985d-a664fdc410c9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:47.144838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-582a06ab-2c85-42b6-985d-a664fdc410c9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:47.225939 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-582a06ab-2c85-42b6-985d-a664fdc410c9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:47.233913 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-582a06ab-2c85-42b6-985d-a664fdc410c9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1193 microversion: 2.1 time: 0.105945 Aug 27 06:28:47.242851 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4053/8119] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:47 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1193 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:48.256691 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-a7a2d37f-61e9-405d-883b-fa02f6f76701 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:48.257930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-a7a2d37f-61e9-405d-883b-fa02f6f76701 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:48.264080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7a2d37f-61e9-405d-883b-fa02f6f76701 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:48.264574 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7a2d37f-61e9-405d-883b-fa02f6f76701 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:48.265011 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7a2d37f-61e9-405d-883b-fa02f6f76701 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:48.265717 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7a2d37f-61e9-405d-883b-fa02f6f76701 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:48.266439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7a2d37f-61e9-405d-883b-fa02f6f76701 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:48.267065 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-a7a2d37f-61e9-405d-883b-fa02f6f76701 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:48.508312 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-a7a2d37f-61e9-405d-883b-fa02f6f76701 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:48.516997 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-a7a2d37f-61e9-405d-883b-fa02f6f76701 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1270 microversion: 2.1 time: 0.266115 Aug 27 06:28:48.517846 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4067/8120] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:48 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1270 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:48.651595 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-7555adf1-18fd-4e6c-8eb9-f7956ac9362b req-8890942b-7aed-4538-8067-cd098d9d9946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c77144-5882-4c76-8436-31cac39c57b4", "tag": "a4ea1eac-481c-48b5-83e4-3c8753076448"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:28:48.662698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7555adf1-18fd-4e6c-8eb9-f7956ac9362b req-8890942b-7aed-4538-8067-cd098d9d9946 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:48.663329 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7555adf1-18fd-4e6c-8eb9-f7956ac9362b req-8890942b-7aed-4538-8067-cd098d9d9946 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:48.664001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-7555adf1-18fd-4e6c-8eb9-f7956ac9362b req-8890942b-7aed-4538-8067-cd098d9d9946 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:48.675502 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-7555adf1-18fd-4e6c-8eb9-f7956ac9362b req-8890942b-7aed-4538-8067-cd098d9d9946 service nova] Creating event network-changed:a4ea1eac-481c-48b5-83e4-3c8753076448 for instance c1c77144-5882-4c76-8436-31cac39c57b4 on n-h1-820368-35 Aug 27 06:28:48.681132 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-7555adf1-18fd-4e6c-8eb9-f7956ac9362b req-8890942b-7aed-4538-8067-cd098d9d9946 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033260 Aug 27 06:28:48.682096 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4054/8121] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:28:49.538771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-64fa4a77-1ca1-4f3e-a597-c1cacf4b7d05 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:49.539738 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-64fa4a77-1ca1-4f3e-a597-c1cacf4b7d05 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:49.547246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64fa4a77-1ca1-4f3e-a597-c1cacf4b7d05 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:49.547754 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64fa4a77-1ca1-4f3e-a597-c1cacf4b7d05 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:49.548199 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64fa4a77-1ca1-4f3e-a597-c1cacf4b7d05 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:49.548936 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64fa4a77-1ca1-4f3e-a597-c1cacf4b7d05 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:49.549394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64fa4a77-1ca1-4f3e-a597-c1cacf4b7d05 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:49.550023 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-64fa4a77-1ca1-4f3e-a597-c1cacf4b7d05 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:49.736552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-64fa4a77-1ca1-4f3e-a597-c1cacf4b7d05 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:49.745260 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-64fa4a77-1ca1-4f3e-a597-c1cacf4b7d05 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1270 microversion: 2.1 time: 0.211112 Aug 27 06:28:49.745922 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4068/8122] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:49 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:50.767532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-bf28e251-5a99-44ce-a79f-d7e175918520 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:50.768244 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-bf28e251-5a99-44ce-a79f-d7e175918520 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:50.775043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf28e251-5a99-44ce-a79f-d7e175918520 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:50.775570 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf28e251-5a99-44ce-a79f-d7e175918520 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:50.776016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf28e251-5a99-44ce-a79f-d7e175918520 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:50.776726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf28e251-5a99-44ce-a79f-d7e175918520 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:50.777189 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf28e251-5a99-44ce-a79f-d7e175918520 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:50.777655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-bf28e251-5a99-44ce-a79f-d7e175918520 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:50.912051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-bf28e251-5a99-44ce-a79f-d7e175918520 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:50.920101 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-bf28e251-5a99-44ce-a79f-d7e175918520 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1270 microversion: 2.1 time: 0.157691 Aug 27 06:28:50.920683 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4055/8123] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:50 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:51.943239 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3ece5489-1006-45fe-8175-a782c0103d09 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:51.943875 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3ece5489-1006-45fe-8175-a782c0103d09 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:51.950689 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ece5489-1006-45fe-8175-a782c0103d09 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:51.951204 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ece5489-1006-45fe-8175-a782c0103d09 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:51.951684 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ece5489-1006-45fe-8175-a782c0103d09 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:51.952795 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ece5489-1006-45fe-8175-a782c0103d09 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:51.953266 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ece5489-1006-45fe-8175-a782c0103d09 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:51.953708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3ece5489-1006-45fe-8175-a782c0103d09 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:52.092371 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3ece5489-1006-45fe-8175-a782c0103d09 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:52.100813 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3ece5489-1006-45fe-8175-a782c0103d09 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1270 microversion: 2.1 time: 0.162883 Aug 27 06:28:52.101678 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4069/8124] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:51 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:53.122148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6a5120f7-b260-4dd7-8008-cece161be2c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:53.122697 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6a5120f7-b260-4dd7-8008-cece161be2c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:53.130206 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5120f7-b260-4dd7-8008-cece161be2c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:53.131271 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5120f7-b260-4dd7-8008-cece161be2c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:53.131726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5120f7-b260-4dd7-8008-cece161be2c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:53.132437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5120f7-b260-4dd7-8008-cece161be2c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:53.133059 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5120f7-b260-4dd7-8008-cece161be2c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:53.133508 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6a5120f7-b260-4dd7-8008-cece161be2c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:53.267533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6a5120f7-b260-4dd7-8008-cece161be2c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:53.275994 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6a5120f7-b260-4dd7-8008-cece161be2c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1258 microversion: 2.1 time: 0.157859 Aug 27 06:28:53.276567 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4056/8125] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:53 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:54.297055 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4c7aeacd-7712-45d4-aead-63b1daf49da1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:54.297700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4c7aeacd-7712-45d4-aead-63b1daf49da1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:54.305206 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c7aeacd-7712-45d4-aead-63b1daf49da1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:54.305685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c7aeacd-7712-45d4-aead-63b1daf49da1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:54.306120 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c7aeacd-7712-45d4-aead-63b1daf49da1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:54.307062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c7aeacd-7712-45d4-aead-63b1daf49da1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:54.307538 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c7aeacd-7712-45d4-aead-63b1daf49da1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:54.307962 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4c7aeacd-7712-45d4-aead-63b1daf49da1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:54.437392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4c7aeacd-7712-45d4-aead-63b1daf49da1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:54.445362 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4c7aeacd-7712-45d4-aead-63b1daf49da1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1258 microversion: 2.1 time: 0.152213 Aug 27 06:28:54.445966 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4070/8126] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:54 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:55.465898 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c24f99de-d9f9-48ca-a32f-bcb6d2240c87 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:55.466533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c24f99de-d9f9-48ca-a32f-bcb6d2240c87 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:55.474294 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24f99de-d9f9-48ca-a32f-bcb6d2240c87 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:55.474809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24f99de-d9f9-48ca-a32f-bcb6d2240c87 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:55.475309 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24f99de-d9f9-48ca-a32f-bcb6d2240c87 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:55.476040 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24f99de-d9f9-48ca-a32f-bcb6d2240c87 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:55.476517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24f99de-d9f9-48ca-a32f-bcb6d2240c87 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:55.476966 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c24f99de-d9f9-48ca-a32f-bcb6d2240c87 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:55.614928 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c24f99de-d9f9-48ca-a32f-bcb6d2240c87 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:55.622728 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c24f99de-d9f9-48ca-a32f-bcb6d2240c87 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1258 microversion: 2.1 time: 0.160749 Aug 27 06:28:55.623346 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4057/8127] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:55 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:56.644314 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e105cdd3-0791-45c2-84a6-4d3fbba9daeb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:56.644860 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e105cdd3-0791-45c2-84a6-4d3fbba9daeb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:56.648149 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:56.653520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e105cdd3-0791-45c2-84a6-4d3fbba9daeb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:56.654017 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e105cdd3-0791-45c2-84a6-4d3fbba9daeb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:56.654456 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e105cdd3-0791-45c2-84a6-4d3fbba9daeb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:56.655180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e105cdd3-0791-45c2-84a6-4d3fbba9daeb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:56.655642 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e105cdd3-0791-45c2-84a6-4d3fbba9daeb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:56.656105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e105cdd3-0791-45c2-84a6-4d3fbba9daeb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:56.790474 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e105cdd3-0791-45c2-84a6-4d3fbba9daeb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:56.798969 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e105cdd3-0791-45c2-84a6-4d3fbba9daeb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1258 microversion: 2.1 time: 0.158700 Aug 27 06:28:56.799584 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4071/8128] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:56 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:57.820525 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f97db8dc-8036-45ac-b504-41bf184c5fc5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:57.821148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f97db8dc-8036-45ac-b504-41bf184c5fc5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:57.823116 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:57.823788 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:28:57.830855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f97db8dc-8036-45ac-b504-41bf184c5fc5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:57.831377 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f97db8dc-8036-45ac-b504-41bf184c5fc5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:57.831829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f97db8dc-8036-45ac-b504-41bf184c5fc5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:57.832538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f97db8dc-8036-45ac-b504-41bf184c5fc5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:57.833629 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f97db8dc-8036-45ac-b504-41bf184c5fc5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:57.834071 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f97db8dc-8036-45ac-b504-41bf184c5fc5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:57.962929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f97db8dc-8036-45ac-b504-41bf184c5fc5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:57.971528 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f97db8dc-8036-45ac-b504-41bf184c5fc5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1258 microversion: 2.1 time: 0.155365 Aug 27 06:28:57.972100 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4058/8129] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:57 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:28:58.993650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aac54b0b-46f9-4310-9465-30f721a59b57 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:28:58.994276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aac54b0b-46f9-4310-9465-30f721a59b57 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:28:59.000655 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac54b0b-46f9-4310-9465-30f721a59b57 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:59.001143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac54b0b-46f9-4310-9465-30f721a59b57 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:59.001728 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac54b0b-46f9-4310-9465-30f721a59b57 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:59.002302 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac54b0b-46f9-4310-9465-30f721a59b57 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:28:59.002767 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac54b0b-46f9-4310-9465-30f721a59b57 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:28:59.003232 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aac54b0b-46f9-4310-9465-30f721a59b57 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:28:59.138563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aac54b0b-46f9-4310-9465-30f721a59b57 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:28:59.146809 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aac54b0b-46f9-4310-9465-30f721a59b57 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1258 microversion: 2.1 time: 0.158111 Aug 27 06:28:59.147427 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4072/8130] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:28:58 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:29:00.167920 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8915aca5-d4be-42b6-b5ec-755c3741b49b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:29:00.168560 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8915aca5-d4be-42b6-b5ec-755c3741b49b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:29:00.175505 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8915aca5-d4be-42b6-b5ec-755c3741b49b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:00.176017 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8915aca5-d4be-42b6-b5ec-755c3741b49b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:00.177085 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8915aca5-d4be-42b6-b5ec-755c3741b49b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:00.177808 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8915aca5-d4be-42b6-b5ec-755c3741b49b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:00.178289 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8915aca5-d4be-42b6-b5ec-755c3741b49b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:00.178738 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8915aca5-d4be-42b6-b5ec-755c3741b49b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:00.310435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8915aca5-d4be-42b6-b5ec-755c3741b49b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:29:00.318307 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8915aca5-d4be-42b6-b5ec-755c3741b49b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1258 microversion: 2.1 time: 0.154384 Aug 27 06:29:00.318875 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4059/8131] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:29:00 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:29:01.339771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-24a1d4ed-120b-4d07-b405-b703292f2d0a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:29:01.340457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-24a1d4ed-120b-4d07-b405-b703292f2d0a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:29:01.347414 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24a1d4ed-120b-4d07-b405-b703292f2d0a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:01.347908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24a1d4ed-120b-4d07-b405-b703292f2d0a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:01.348987 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24a1d4ed-120b-4d07-b405-b703292f2d0a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:01.349692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24a1d4ed-120b-4d07-b405-b703292f2d0a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:01.350155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24a1d4ed-120b-4d07-b405-b703292f2d0a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:01.350619 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-24a1d4ed-120b-4d07-b405-b703292f2d0a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:01.485621 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-24a1d4ed-120b-4d07-b405-b703292f2d0a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:29:01.493970 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-24a1d4ed-120b-4d07-b405-b703292f2d0a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1258 microversion: 2.1 time: 0.158210 Aug 27 06:29:01.494546 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4073/8132] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:29:01 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:29:02.513889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-027ebae8-8208-4301-9e9c-0c50273b26ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:29:02.514533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-027ebae8-8208-4301-9e9c-0c50273b26ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:29:02.521539 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027ebae8-8208-4301-9e9c-0c50273b26ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:02.522032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027ebae8-8208-4301-9e9c-0c50273b26ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:02.522483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027ebae8-8208-4301-9e9c-0c50273b26ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:02.523220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027ebae8-8208-4301-9e9c-0c50273b26ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:02.523691 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027ebae8-8208-4301-9e9c-0c50273b26ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:02.524129 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-027ebae8-8208-4301-9e9c-0c50273b26ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:02.657261 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-027ebae8-8208-4301-9e9c-0c50273b26ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:29:02.665197 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-027ebae8-8208-4301-9e9c-0c50273b26ec tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1258 microversion: 2.1 time: 0.155207 Aug 27 06:29:02.665769 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4060/8133] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:29:02 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:29:03.686885 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-948f51be-b0b6-4d53-97d7-6daf10a47e17 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:29:03.687585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-948f51be-b0b6-4d53-97d7-6daf10a47e17 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:29:03.695337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f51be-b0b6-4d53-97d7-6daf10a47e17 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:03.695808 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f51be-b0b6-4d53-97d7-6daf10a47e17 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:03.696245 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f51be-b0b6-4d53-97d7-6daf10a47e17 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:03.696946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f51be-b0b6-4d53-97d7-6daf10a47e17 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:03.697403 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f51be-b0b6-4d53-97d7-6daf10a47e17 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:03.697833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-948f51be-b0b6-4d53-97d7-6daf10a47e17 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:03.830818 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-948f51be-b0b6-4d53-97d7-6daf10a47e17 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:29:03.838757 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-948f51be-b0b6-4d53-97d7-6daf10a47e17 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1258 microversion: 2.1 time: 0.155824 Aug 27 06:29:03.839369 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4074/8134] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:29:03 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:29:04.274277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e5a9c246-6a8a-41b0-9966-53c7a02886b7 req-a77830d0-abf0-4d05-b1b9-8968a2d1ef72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c77144-5882-4c76-8436-31cac39c57b4", "name": "network-vif-plugged", "status": "completed", "tag": "a4ea1eac-481c-48b5-83e4-3c8753076448"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:29:04.286998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e5a9c246-6a8a-41b0-9966-53c7a02886b7 req-a77830d0-abf0-4d05-b1b9-8968a2d1ef72 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:04.287534 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e5a9c246-6a8a-41b0-9966-53c7a02886b7 req-a77830d0-abf0-4d05-b1b9-8968a2d1ef72 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:04.287988 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e5a9c246-6a8a-41b0-9966-53c7a02886b7 req-a77830d0-abf0-4d05-b1b9-8968a2d1ef72 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:04.299483 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e5a9c246-6a8a-41b0-9966-53c7a02886b7 req-a77830d0-abf0-4d05-b1b9-8968a2d1ef72 service nova] Creating event network-vif-plugged:a4ea1eac-481c-48b5-83e4-3c8753076448 for instance c1c77144-5882-4c76-8436-31cac39c57b4 on n-h1-820368-35 Aug 27 06:29:04.305068 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e5a9c246-6a8a-41b0-9966-53c7a02886b7 req-a77830d0-abf0-4d05-b1b9-8968a2d1ef72 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035455 Aug 27 06:29:04.305781 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4061/8135] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:29:04.860194 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-aab0969a-8648-4c6c-a742-e270c390d82d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:29:04.860815 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-aab0969a-8648-4c6c-a742-e270c390d82d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:29:04.868180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0969a-8648-4c6c-a742-e270c390d82d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:04.868666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0969a-8648-4c6c-a742-e270c390d82d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:04.869108 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0969a-8648-4c6c-a742-e270c390d82d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:04.869799 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0969a-8648-4c6c-a742-e270c390d82d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:04.870254 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0969a-8648-4c6c-a742-e270c390d82d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:04.870682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-aab0969a-8648-4c6c-a742-e270c390d82d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:05.002336 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-aab0969a-8648-4c6c-a742-e270c390d82d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:29:05.010676 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-aab0969a-8648-4c6c-a742-e270c390d82d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1258 microversion: 2.1 time: 0.154417 Aug 27 06:29:05.011297 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4075/8136] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:29:04 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:29:06.032588 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-840cdc2f-6db9-4f16-b697-1fe52b0b5790 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:29:06.033228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-840cdc2f-6db9-4f16-b697-1fe52b0b5790 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:29:06.042083 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840cdc2f-6db9-4f16-b697-1fe52b0b5790 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:06.042594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840cdc2f-6db9-4f16-b697-1fe52b0b5790 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:06.043052 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840cdc2f-6db9-4f16-b697-1fe52b0b5790 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:06.043804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840cdc2f-6db9-4f16-b697-1fe52b0b5790 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:06.044277 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840cdc2f-6db9-4f16-b697-1fe52b0b5790 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:06.044725 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-840cdc2f-6db9-4f16-b697-1fe52b0b5790 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:06.180518 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-840cdc2f-6db9-4f16-b697-1fe52b0b5790 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:29:06.188954 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-840cdc2f-6db9-4f16-b697-1fe52b0b5790 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1441 microversion: 2.1 time: 0.160672 Aug 27 06:29:06.189523 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4062/8137] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:29:06 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1441 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:29:06.209576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-76f41f9a-2903-4574-b8ee-ab1e4c095eb9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:29:06.210205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-76f41f9a-2903-4574-b8ee-ab1e4c095eb9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:29:06.217343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f41f9a-2903-4574-b8ee-ab1e4c095eb9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:06.217840 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f41f9a-2903-4574-b8ee-ab1e4c095eb9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:06.218292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f41f9a-2903-4574-b8ee-ab1e4c095eb9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:06.219008 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f41f9a-2903-4574-b8ee-ab1e4c095eb9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:06.219622 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f41f9a-2903-4574-b8ee-ab1e4c095eb9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:06.220041 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-76f41f9a-2903-4574-b8ee-ab1e4c095eb9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:06.351487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-76f41f9a-2903-4574-b8ee-ab1e4c095eb9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:29:06.359337 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-76f41f9a-2903-4574-b8ee-ab1e4c095eb9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1441 microversion: 2.1 time: 0.153706 Aug 27 06:29:06.360073 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4076/8138] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:29:06 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1441 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:29:08.280070 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5e0de22d-4e7d-4951-99b7-e62d5b6b8bf3 req-f6d555ec-78aa-43be-80b9-28e8874aa965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c77144-5882-4c76-8436-31cac39c57b4", "tag": "a4ea1eac-481c-48b5-83e4-3c8753076448"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:29:08.291364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5e0de22d-4e7d-4951-99b7-e62d5b6b8bf3 req-f6d555ec-78aa-43be-80b9-28e8874aa965 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:29:08.291878 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5e0de22d-4e7d-4951-99b7-e62d5b6b8bf3 req-f6d555ec-78aa-43be-80b9-28e8874aa965 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:29:08.292332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5e0de22d-4e7d-4951-99b7-e62d5b6b8bf3 req-f6d555ec-78aa-43be-80b9-28e8874aa965 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:29:08.303727 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5e0de22d-4e7d-4951-99b7-e62d5b6b8bf3 req-f6d555ec-78aa-43be-80b9-28e8874aa965 service nova] Creating event network-changed:a4ea1eac-481c-48b5-83e4-3c8753076448 for instance c1c77144-5882-4c76-8436-31cac39c57b4 on n-h1-820368-35 Aug 27 06:29:08.309082 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5e0de22d-4e7d-4951-99b7-e62d5b6b8bf3 req-f6d555ec-78aa-43be-80b9-28e8874aa965 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033017 Aug 27 06:29:08.309681 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4063/8139] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:31:04.435518 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [15bbca3d-0083-4a69-8bef-16bf0d79b591] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:31:04.437165 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27d957ae-75c0-4884-9be8-b8e627e8ac1a] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:31:04.437731 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=24 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:31:04.438470 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=60 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:31:04.439377 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:31:04.439521 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4/action (ip 10.222.0.58) !!! Aug 27 06:31:04.441159 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:31:04.441298 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4/action (ip 10.222.0.58) !!! Aug 27 06:31:04.443226 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:31:04.443344 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4/action (ip 10.222.0.58) !!! Aug 27 06:31:04.459811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-887276f5-e2d3-4653-b50f-fd9254d2e016 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:31:04.460357 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-887276f5-e2d3-4653-b50f-fd9254d2e016 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:04.468348 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-887276f5-e2d3-4653-b50f-fd9254d2e016 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:04.468835 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-887276f5-e2d3-4653-b50f-fd9254d2e016 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:04.469278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-887276f5-e2d3-4653-b50f-fd9254d2e016 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:04.469978 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-887276f5-e2d3-4653-b50f-fd9254d2e016 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:04.470439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-887276f5-e2d3-4653-b50f-fd9254d2e016 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:04.470872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-887276f5-e2d3-4653-b50f-fd9254d2e016 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:04.493334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-887276f5-e2d3-4653-b50f-fd9254d2e016 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lazy-loading 'flavor' on Instance uuid c1c77144-5882-4c76-8436-31cac39c57b4 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:31:04.569076 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-887276f5-e2d3-4653-b50f-fd9254d2e016 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "POST /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4/action" status: 202 len: 0 microversion: 2.1 time: 0.135076 Aug 27 06:31:04.569652 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4077/8140] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:31:04 2022] POST /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:31:04.576023 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8da433e2-1b8b-43e8-8a70-e929fdcdfc0f] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:31:04.576955 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a138aa11-e323-45d1-b35b-6ab4ed1899de] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:31:04.577562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:31:04.578311 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=56 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:31:04.579239 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:31:04.579388 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 (ip 10.222.0.58) !!! Aug 27 06:31:04.580502 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:31:04.580623 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 (ip 10.222.0.58) !!! Aug 27 06:31:04.587484 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2b04f587-772e-4500-8cba-09ac66f5cfc3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:04.588056 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2b04f587-772e-4500-8cba-09ac66f5cfc3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:04.597929 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b04f587-772e-4500-8cba-09ac66f5cfc3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:04.598437 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b04f587-772e-4500-8cba-09ac66f5cfc3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:04.598888 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b04f587-772e-4500-8cba-09ac66f5cfc3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:04.599627 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b04f587-772e-4500-8cba-09ac66f5cfc3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:04.600094 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b04f587-772e-4500-8cba-09ac66f5cfc3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:04.600531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2b04f587-772e-4500-8cba-09ac66f5cfc3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:04.737545 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2b04f587-772e-4500-8cba-09ac66f5cfc3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:04.745411 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2b04f587-772e-4500-8cba-09ac66f5cfc3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.171338 Aug 27 06:31:04.745995 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4064/8141] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:04 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:05.768789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-77d91fe4-2364-4782-8079-8e03e76c3440 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:05.769553 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-77d91fe4-2364-4782-8079-8e03e76c3440 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:05.783123 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77d91fe4-2364-4782-8079-8e03e76c3440 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:05.783847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77d91fe4-2364-4782-8079-8e03e76c3440 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:05.784424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77d91fe4-2364-4782-8079-8e03e76c3440 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:05.785267 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77d91fe4-2364-4782-8079-8e03e76c3440 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:05.785851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77d91fe4-2364-4782-8079-8e03e76c3440 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:05.786500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77d91fe4-2364-4782-8079-8e03e76c3440 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:05.794212 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] [27d957ae-75c0-4884-9be8-b8e627e8ac1a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49334. Aug 27 06:31:05.795011 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] [15bbca3d-0083-4a69-8bef-16bf0d79b591] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49332. Aug 27 06:31:05.929237 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-77d91fe4-2364-4782-8079-8e03e76c3440 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:05.937859 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-77d91fe4-2364-4782-8079-8e03e76c3440 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.174135 Aug 27 06:31:05.938432 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4078/8142] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:05 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:06.958306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0e921992-d19d-4d38-a7b7-8ceda47fa62d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:06.958937 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0e921992-d19d-4d38-a7b7-8ceda47fa62d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:06.967866 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e921992-d19d-4d38-a7b7-8ceda47fa62d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:06.968368 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e921992-d19d-4d38-a7b7-8ceda47fa62d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:06.968825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e921992-d19d-4d38-a7b7-8ceda47fa62d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:06.969549 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e921992-d19d-4d38-a7b7-8ceda47fa62d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:06.970021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e921992-d19d-4d38-a7b7-8ceda47fa62d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:06.970465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0e921992-d19d-4d38-a7b7-8ceda47fa62d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:06.975132 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] [a138aa11-e323-45d1-b35b-6ab4ed1899de] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49340. Aug 27 06:31:06.978086 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] [8da433e2-1b8b-43e8-8a70-e929fdcdfc0f] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49338. Aug 27 06:31:07.104930 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0e921992-d19d-4d38-a7b7-8ceda47fa62d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:07.113564 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0e921992-d19d-4d38-a7b7-8ceda47fa62d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.159161 Aug 27 06:31:07.114137 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4065/8143] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:06 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:08.135585 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f3bba11b-bc48-49ed-affe-60a700eab0af tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:08.136158 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f3bba11b-bc48-49ed-affe-60a700eab0af tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:08.143550 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bba11b-bc48-49ed-affe-60a700eab0af tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:08.144040 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bba11b-bc48-49ed-affe-60a700eab0af tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:08.144479 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bba11b-bc48-49ed-affe-60a700eab0af tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:08.145181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bba11b-bc48-49ed-affe-60a700eab0af tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:08.145641 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bba11b-bc48-49ed-affe-60a700eab0af tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:08.146070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f3bba11b-bc48-49ed-affe-60a700eab0af tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:08.288483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f3bba11b-bc48-49ed-affe-60a700eab0af tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:08.296926 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f3bba11b-bc48-49ed-affe-60a700eab0af tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.165296 Aug 27 06:31:08.297529 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4079/8144] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:08 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:09.318510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e6e310f2-0fd3-4d5b-a5ef-ac1d4ad4301b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:09.319165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e6e310f2-0fd3-4d5b-a5ef-ac1d4ad4301b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:09.326188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e310f2-0fd3-4d5b-a5ef-ac1d4ad4301b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:09.326687 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e310f2-0fd3-4d5b-a5ef-ac1d4ad4301b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:09.327176 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e310f2-0fd3-4d5b-a5ef-ac1d4ad4301b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:09.327889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e310f2-0fd3-4d5b-a5ef-ac1d4ad4301b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:09.328356 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e310f2-0fd3-4d5b-a5ef-ac1d4ad4301b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:09.328796 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e6e310f2-0fd3-4d5b-a5ef-ac1d4ad4301b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:09.458564 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e6e310f2-0fd3-4d5b-a5ef-ac1d4ad4301b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:09.466375 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e6e310f2-0fd3-4d5b-a5ef-ac1d4ad4301b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.151819 Aug 27 06:31:09.466951 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4066/8145] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:09 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:10.488449 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-edf2a025-c0ab-4da4-a1c1-f7eea84e2d90 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:10.489105 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-edf2a025-c0ab-4da4-a1c1-f7eea84e2d90 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:10.496027 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-edf2a025-c0ab-4da4-a1c1-f7eea84e2d90 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:10.496544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-edf2a025-c0ab-4da4-a1c1-f7eea84e2d90 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:10.496985 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-edf2a025-c0ab-4da4-a1c1-f7eea84e2d90 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:10.497702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-edf2a025-c0ab-4da4-a1c1-f7eea84e2d90 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:10.498163 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-edf2a025-c0ab-4da4-a1c1-f7eea84e2d90 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:10.498594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-edf2a025-c0ab-4da4-a1c1-f7eea84e2d90 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:10.637143 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-edf2a025-c0ab-4da4-a1c1-f7eea84e2d90 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:10.647270 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-edf2a025-c0ab-4da4-a1c1-f7eea84e2d90 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.162414 Aug 27 06:31:10.647787 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4080/8146] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:10 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:11.670136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ec41b55e-15ad-4979-8176-30d5a22261a4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:11.670136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ec41b55e-15ad-4979-8176-30d5a22261a4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:11.678088 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec41b55e-15ad-4979-8176-30d5a22261a4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:11.678572 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec41b55e-15ad-4979-8176-30d5a22261a4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:11.679025 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec41b55e-15ad-4979-8176-30d5a22261a4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:11.679841 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec41b55e-15ad-4979-8176-30d5a22261a4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:11.680302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec41b55e-15ad-4979-8176-30d5a22261a4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:11.680825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ec41b55e-15ad-4979-8176-30d5a22261a4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:11.820202 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ec41b55e-15ad-4979-8176-30d5a22261a4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:11.828487 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ec41b55e-15ad-4979-8176-30d5a22261a4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.163344 Aug 27 06:31:11.829090 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4067/8147] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:11 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:12.850824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-3aeabb47-2c0d-40c3-ba27-8e0757049bac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:12.851507 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-3aeabb47-2c0d-40c3-ba27-8e0757049bac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:12.858811 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3aeabb47-2c0d-40c3-ba27-8e0757049bac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:12.859339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3aeabb47-2c0d-40c3-ba27-8e0757049bac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:12.859781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3aeabb47-2c0d-40c3-ba27-8e0757049bac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:12.860581 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3aeabb47-2c0d-40c3-ba27-8e0757049bac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:12.861062 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3aeabb47-2c0d-40c3-ba27-8e0757049bac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:12.861483 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-3aeabb47-2c0d-40c3-ba27-8e0757049bac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:12.998465 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-3aeabb47-2c0d-40c3-ba27-8e0757049bac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:13.007106 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-3aeabb47-2c0d-40c3-ba27-8e0757049bac tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.160163 Aug 27 06:31:13.007702 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4081/8148] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:12 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:14.029655 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-912a57b8-19d5-430f-a039-026924417d00 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:14.030344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-912a57b8-19d5-430f-a039-026924417d00 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:14.037218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-912a57b8-19d5-430f-a039-026924417d00 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:14.037716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-912a57b8-19d5-430f-a039-026924417d00 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:14.038171 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-912a57b8-19d5-430f-a039-026924417d00 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:14.038913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-912a57b8-19d5-430f-a039-026924417d00 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:14.039406 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-912a57b8-19d5-430f-a039-026924417d00 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:14.039850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-912a57b8-19d5-430f-a039-026924417d00 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:14.175177 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-912a57b8-19d5-430f-a039-026924417d00 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:14.183138 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-912a57b8-19d5-430f-a039-026924417d00 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.157909 Aug 27 06:31:14.183936 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4068/8149] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:14 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:15.204877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-7361c667-2090-46f6-be18-fb5c8ccf0ad9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:15.205628 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-7361c667-2090-46f6-be18-fb5c8ccf0ad9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:15.212669 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7361c667-2090-46f6-be18-fb5c8ccf0ad9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:15.213167 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7361c667-2090-46f6-be18-fb5c8ccf0ad9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:15.213615 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7361c667-2090-46f6-be18-fb5c8ccf0ad9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:15.214325 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7361c667-2090-46f6-be18-fb5c8ccf0ad9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:15.214863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7361c667-2090-46f6-be18-fb5c8ccf0ad9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:15.215262 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-7361c667-2090-46f6-be18-fb5c8ccf0ad9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:15.398994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-7361c667-2090-46f6-be18-fb5c8ccf0ad9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:15.407598 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-7361c667-2090-46f6-be18-fb5c8ccf0ad9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.207057 Aug 27 06:31:15.408276 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4082/8150] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:15 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:16.429558 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6873e960-8881-4e63-bbf7-71c390b10c25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:16.430208 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6873e960-8881-4e63-bbf7-71c390b10c25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:16.437426 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6873e960-8881-4e63-bbf7-71c390b10c25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:16.437921 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6873e960-8881-4e63-bbf7-71c390b10c25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:16.438369 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6873e960-8881-4e63-bbf7-71c390b10c25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:16.439076 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6873e960-8881-4e63-bbf7-71c390b10c25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:16.439567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6873e960-8881-4e63-bbf7-71c390b10c25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:16.440005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6873e960-8881-4e63-bbf7-71c390b10c25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:16.576387 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6873e960-8881-4e63-bbf7-71c390b10c25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:16.584873 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6873e960-8881-4e63-bbf7-71c390b10c25 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.159262 Aug 27 06:31:16.585453 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4069/8151] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:16 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:17.606833 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-0f46eab5-b42a-4dea-b49e-47e1c2021616 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:17.607406 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-0f46eab5-b42a-4dea-b49e-47e1c2021616 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:17.614227 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46eab5-b42a-4dea-b49e-47e1c2021616 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:17.614991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46eab5-b42a-4dea-b49e-47e1c2021616 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:17.615473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46eab5-b42a-4dea-b49e-47e1c2021616 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:17.616181 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46eab5-b42a-4dea-b49e-47e1c2021616 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:17.616638 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46eab5-b42a-4dea-b49e-47e1c2021616 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:17.617064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-0f46eab5-b42a-4dea-b49e-47e1c2021616 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:17.752127 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-0f46eab5-b42a-4dea-b49e-47e1c2021616 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:17.760087 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-0f46eab5-b42a-4dea-b49e-47e1c2021616 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.157398 Aug 27 06:31:17.760671 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4083/8152] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:17 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:18.781896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-8e6d482a-040d-477f-a0e6-0cbf2c72cf52 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:18.782680 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-8e6d482a-040d-477f-a0e6-0cbf2c72cf52 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:18.789731 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6d482a-040d-477f-a0e6-0cbf2c72cf52 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:18.790248 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6d482a-040d-477f-a0e6-0cbf2c72cf52 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:18.790707 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6d482a-040d-477f-a0e6-0cbf2c72cf52 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:18.791472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6d482a-040d-477f-a0e6-0cbf2c72cf52 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:18.791976 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6d482a-040d-477f-a0e6-0cbf2c72cf52 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:18.792454 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-8e6d482a-040d-477f-a0e6-0cbf2c72cf52 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:18.936668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-8e6d482a-040d-477f-a0e6-0cbf2c72cf52 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:18.945640 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-8e6d482a-040d-477f-a0e6-0cbf2c72cf52 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.168382 Aug 27 06:31:18.946439 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4070/8153] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:18 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:19.967625 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f46637ec-0ef0-4402-af85-f3060cc08def tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:19.968244 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f46637ec-0ef0-4402-af85-f3060cc08def tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:19.975613 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f46637ec-0ef0-4402-af85-f3060cc08def tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:19.976106 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f46637ec-0ef0-4402-af85-f3060cc08def tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:19.976552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f46637ec-0ef0-4402-af85-f3060cc08def tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:19.977256 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f46637ec-0ef0-4402-af85-f3060cc08def tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:19.977715 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f46637ec-0ef0-4402-af85-f3060cc08def tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:19.978148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f46637ec-0ef0-4402-af85-f3060cc08def tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:20.107937 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f46637ec-0ef0-4402-af85-f3060cc08def tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:20.116321 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f46637ec-0ef0-4402-af85-f3060cc08def tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1507 microversion: 2.1 time: 0.152690 Aug 27 06:31:20.116903 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4084/8154] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:19 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:20.136683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1ad4b3ef-ff45-492b-b2b6-0c32aa1a78cb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:31:20.137319 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ad4b3ef-ff45-492b-b2b6-0c32aa1a78cb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:20.144130 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ad4b3ef-ff45-492b-b2b6-0c32aa1a78cb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:20.144633 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ad4b3ef-ff45-492b-b2b6-0c32aa1a78cb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:20.145097 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ad4b3ef-ff45-492b-b2b6-0c32aa1a78cb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:20.145813 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ad4b3ef-ff45-492b-b2b6-0c32aa1a78cb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:20.146283 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ad4b3ef-ff45-492b-b2b6-0c32aa1a78cb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:20.146726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1ad4b3ef-ff45-492b-b2b6-0c32aa1a78cb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:20.188216 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1ad4b3ef-ff45-492b-b2b6-0c32aa1a78cb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128547) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 06:31:20.252898 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1ad4b3ef-ff45-492b-b2b6-0c32aa1a78cb tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "POST /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4/action" status: 202 len: 0 microversion: 2.1 time: 0.120137 Aug 27 06:31:20.253506 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4071/8155] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:31:20 2022] POST /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:31:20.261667 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-70a60e4d-bb21-42c5-a88b-eab3ab901a74 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:20.262413 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-70a60e4d-bb21-42c5-a88b-eab3ab901a74 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:20.269259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a60e4d-bb21-42c5-a88b-eab3ab901a74 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:20.269963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a60e4d-bb21-42c5-a88b-eab3ab901a74 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:20.270415 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a60e4d-bb21-42c5-a88b-eab3ab901a74 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:20.271281 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a60e4d-bb21-42c5-a88b-eab3ab901a74 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:20.271751 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a60e4d-bb21-42c5-a88b-eab3ab901a74 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:20.272248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-70a60e4d-bb21-42c5-a88b-eab3ab901a74 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:20.445827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-70a60e4d-bb21-42c5-a88b-eab3ab901a74 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:20.454351 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-70a60e4d-bb21-42c5-a88b-eab3ab901a74 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1515 microversion: 2.1 time: 0.196066 Aug 27 06:31:20.455012 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4085/8156] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:20 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:21.033378 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-3a7d88d6-d925-4575-b94f-605efafb621e req-d4d8774e-f485-4e90-8f8a-2b023f3a878f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c77144-5882-4c76-8436-31cac39c57b4", "name": "network-vif-unplugged", "status": "completed", "tag": "a4ea1eac-481c-48b5-83e4-3c8753076448"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:31:21.044007 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3a7d88d6-d925-4575-b94f-605efafb621e req-d4d8774e-f485-4e90-8f8a-2b023f3a878f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:21.044506 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3a7d88d6-d925-4575-b94f-605efafb621e req-d4d8774e-f485-4e90-8f8a-2b023f3a878f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:21.044959 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-3a7d88d6-d925-4575-b94f-605efafb621e req-d4d8774e-f485-4e90-8f8a-2b023f3a878f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:21.059024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.compute.server_external_events [req-3a7d88d6-d925-4575-b94f-605efafb621e req-d4d8774e-f485-4e90-8f8a-2b023f3a878f service nova] Unable to find a host for instance c1c77144-5882-4c76-8436-31cac39c57b4. Dropping event network-vif-unplugged {{(pid=128547) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 06:31:21.059975 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-3a7d88d6-d925-4575-b94f-605efafb621e req-d4d8774e-f485-4e90-8f8a-2b023f3a878f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086294 Aug 27 06:31:21.060576 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4072/8157] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 27 06:31:21.475439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8d92708a-5011-444c-9033-86ceebed29a1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:21.476059 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8d92708a-5011-444c-9033-86ceebed29a1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:21.482781 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d92708a-5011-444c-9033-86ceebed29a1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:21.483248 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d92708a-5011-444c-9033-86ceebed29a1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:21.483692 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d92708a-5011-444c-9033-86ceebed29a1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:21.484399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d92708a-5011-444c-9033-86ceebed29a1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:21.484854 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d92708a-5011-444c-9033-86ceebed29a1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:21.485286 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8d92708a-5011-444c-9033-86ceebed29a1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:21.618827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8d92708a-5011-444c-9033-86ceebed29a1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:21.627258 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8d92708a-5011-444c-9033-86ceebed29a1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1515 microversion: 2.1 time: 0.155585 Aug 27 06:31:21.627848 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4086/8158] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:21 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:22.648932 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5866835-d4fa-4276-a426-06017204dd3d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:22.649481 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b5866835-d4fa-4276-a426-06017204dd3d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:22.656380 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5866835-d4fa-4276-a426-06017204dd3d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:22.656882 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5866835-d4fa-4276-a426-06017204dd3d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:22.657342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5866835-d4fa-4276-a426-06017204dd3d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:22.658060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5866835-d4fa-4276-a426-06017204dd3d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:22.658538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5866835-d4fa-4276-a426-06017204dd3d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:22.658981 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b5866835-d4fa-4276-a426-06017204dd3d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:22.796972 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5866835-d4fa-4276-a426-06017204dd3d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:22.805683 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5866835-d4fa-4276-a426-06017204dd3d tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1515 microversion: 2.1 time: 0.160728 Aug 27 06:31:22.806279 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4073/8159] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:22 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:23.827542 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-103cf3cf-1294-46be-b756-14075ea689f1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:23.828182 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-103cf3cf-1294-46be-b756-14075ea689f1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:23.841066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-103cf3cf-1294-46be-b756-14075ea689f1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:23.841563 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-103cf3cf-1294-46be-b756-14075ea689f1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:23.842004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-103cf3cf-1294-46be-b756-14075ea689f1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:23.842722 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-103cf3cf-1294-46be-b756-14075ea689f1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:23.843205 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-103cf3cf-1294-46be-b756-14075ea689f1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:23.843636 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-103cf3cf-1294-46be-b756-14075ea689f1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:23.977602 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-103cf3cf-1294-46be-b756-14075ea689f1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:23.986569 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-103cf3cf-1294-46be-b756-14075ea689f1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1515 microversion: 2.1 time: 0.162906 Aug 27 06:31:23.987161 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4087/8160] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:23 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:25.009015 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b0f1bf35-b343-4fc8-8110-fc90507901b1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:25.009637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b0f1bf35-b343-4fc8-8110-fc90507901b1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:25.016601 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0f1bf35-b343-4fc8-8110-fc90507901b1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:25.017106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0f1bf35-b343-4fc8-8110-fc90507901b1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:25.017563 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0f1bf35-b343-4fc8-8110-fc90507901b1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:25.018405 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0f1bf35-b343-4fc8-8110-fc90507901b1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:25.019024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0f1bf35-b343-4fc8-8110-fc90507901b1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:25.019502 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-b0f1bf35-b343-4fc8-8110-fc90507901b1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:25.154046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b0f1bf35-b343-4fc8-8110-fc90507901b1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:25.162826 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b0f1bf35-b343-4fc8-8110-fc90507901b1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1517 microversion: 2.1 time: 0.158807 Aug 27 06:31:25.163454 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4074/8161] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:25 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:26.185180 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-69c4ba2a-781c-434b-b78f-fb7fa0ee51aa tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:26.185890 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-69c4ba2a-781c-434b-b78f-fb7fa0ee51aa tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:26.192877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69c4ba2a-781c-434b-b78f-fb7fa0ee51aa tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:26.193363 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69c4ba2a-781c-434b-b78f-fb7fa0ee51aa tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:26.193805 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69c4ba2a-781c-434b-b78f-fb7fa0ee51aa tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:26.194584 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69c4ba2a-781c-434b-b78f-fb7fa0ee51aa tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:26.195047 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69c4ba2a-781c-434b-b78f-fb7fa0ee51aa tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:26.195492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-69c4ba2a-781c-434b-b78f-fb7fa0ee51aa tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:26.336004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-69c4ba2a-781c-434b-b78f-fb7fa0ee51aa tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:26.344023 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-69c4ba2a-781c-434b-b78f-fb7fa0ee51aa tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1517 microversion: 2.1 time: 0.163095 Aug 27 06:31:26.345285 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4088/8162] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:26 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:27.366683 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-2d15b489-433f-4225-ab60-1ba72604099c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:27.367358 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-2d15b489-433f-4225-ab60-1ba72604099c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:27.374510 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d15b489-433f-4225-ab60-1ba72604099c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:27.375016 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d15b489-433f-4225-ab60-1ba72604099c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:27.375516 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d15b489-433f-4225-ab60-1ba72604099c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:27.376227 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d15b489-433f-4225-ab60-1ba72604099c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:27.376699 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d15b489-433f-4225-ab60-1ba72604099c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:27.377151 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-2d15b489-433f-4225-ab60-1ba72604099c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:27.510066 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-2d15b489-433f-4225-ab60-1ba72604099c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:27.518018 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-2d15b489-433f-4225-ab60-1ba72604099c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1517 microversion: 2.1 time: 0.155305 Aug 27 06:31:27.518626 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4075/8163] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:27 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:28.538532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-05acaf09-2f36-4d1f-b32c-6c1f4028834a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:28.539201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-05acaf09-2f36-4d1f-b32c-6c1f4028834a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:28.546296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05acaf09-2f36-4d1f-b32c-6c1f4028834a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:28.546791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05acaf09-2f36-4d1f-b32c-6c1f4028834a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:28.547813 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05acaf09-2f36-4d1f-b32c-6c1f4028834a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:28.548532 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05acaf09-2f36-4d1f-b32c-6c1f4028834a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:28.548998 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05acaf09-2f36-4d1f-b32c-6c1f4028834a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:28.549437 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-05acaf09-2f36-4d1f-b32c-6c1f4028834a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:28.685446 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-05acaf09-2f36-4d1f-b32c-6c1f4028834a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:28.694134 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-05acaf09-2f36-4d1f-b32c-6c1f4028834a tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1517 microversion: 2.1 time: 0.159568 Aug 27 06:31:28.694714 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4089/8164] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:28 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:29.716767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-0bcf5256-7145-4201-ab40-c7b657320448 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:29.717688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-0bcf5256-7145-4201-ab40-c7b657320448 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:29.724752 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bcf5256-7145-4201-ab40-c7b657320448 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:29.725260 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bcf5256-7145-4201-ab40-c7b657320448 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:29.725746 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bcf5256-7145-4201-ab40-c7b657320448 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:29.726456 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bcf5256-7145-4201-ab40-c7b657320448 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:29.726927 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bcf5256-7145-4201-ab40-c7b657320448 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:29.727403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-0bcf5256-7145-4201-ab40-c7b657320448 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:29.863463 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-0bcf5256-7145-4201-ab40-c7b657320448 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:29.871620 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-0bcf5256-7145-4201-ab40-c7b657320448 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1517 microversion: 2.1 time: 0.159283 Aug 27 06:31:29.872211 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4076/8165] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:29 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:30.893216 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4e482d80-18d2-46c0-91a5-650ac63890ee tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:30.894049 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4e482d80-18d2-46c0-91a5-650ac63890ee tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:30.900904 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e482d80-18d2-46c0-91a5-650ac63890ee tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:30.901395 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e482d80-18d2-46c0-91a5-650ac63890ee tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:30.901839 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e482d80-18d2-46c0-91a5-650ac63890ee tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:30.902694 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e482d80-18d2-46c0-91a5-650ac63890ee tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:30.902994 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e482d80-18d2-46c0-91a5-650ac63890ee tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:30.903438 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4e482d80-18d2-46c0-91a5-650ac63890ee tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:31.039362 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4e482d80-18d2-46c0-91a5-650ac63890ee tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:31.047784 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4e482d80-18d2-46c0-91a5-650ac63890ee tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1573 microversion: 2.1 time: 0.157931 Aug 27 06:31:31.048367 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4090/8166] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:30 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:32.070074 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fb796404-5424-46bc-a9bd-5eed64b9c0a9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:32.070709 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fb796404-5424-46bc-a9bd-5eed64b9c0a9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:32.077641 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb796404-5424-46bc-a9bd-5eed64b9c0a9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:32.078142 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb796404-5424-46bc-a9bd-5eed64b9c0a9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:32.079279 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb796404-5424-46bc-a9bd-5eed64b9c0a9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:32.080001 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb796404-5424-46bc-a9bd-5eed64b9c0a9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:32.080472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb796404-5424-46bc-a9bd-5eed64b9c0a9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:32.080918 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fb796404-5424-46bc-a9bd-5eed64b9c0a9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:32.216276 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fb796404-5424-46bc-a9bd-5eed64b9c0a9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:32.224044 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fb796404-5424-46bc-a9bd-5eed64b9c0a9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1573 microversion: 2.1 time: 0.157928 Aug 27 06:31:32.224630 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4077/8167] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:32 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:33.244895 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-97d78ba3-3cc5-4043-a99d-67686d2d9dc4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:33.245520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-97d78ba3-3cc5-4043-a99d-67686d2d9dc4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:33.252401 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97d78ba3-3cc5-4043-a99d-67686d2d9dc4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:33.252889 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97d78ba3-3cc5-4043-a99d-67686d2d9dc4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:33.253333 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97d78ba3-3cc5-4043-a99d-67686d2d9dc4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:33.254034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97d78ba3-3cc5-4043-a99d-67686d2d9dc4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:33.254495 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97d78ba3-3cc5-4043-a99d-67686d2d9dc4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:33.254928 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-97d78ba3-3cc5-4043-a99d-67686d2d9dc4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:33.273385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:31:33.391876 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-97d78ba3-3cc5-4043-a99d-67686d2d9dc4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:33.399606 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-97d78ba3-3cc5-4043-a99d-67686d2d9dc4 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1573 microversion: 2.1 time: 0.158636 Aug 27 06:31:33.400192 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4091/8168] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:33 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:34.421716 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-46d84c39-3fac-4b21-bf6f-a841dde9df94 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:34.422983 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-46d84c39-3fac-4b21-bf6f-a841dde9df94 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:34.429896 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46d84c39-3fac-4b21-bf6f-a841dde9df94 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:34.430398 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46d84c39-3fac-4b21-bf6f-a841dde9df94 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:34.430867 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46d84c39-3fac-4b21-bf6f-a841dde9df94 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:34.431608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46d84c39-3fac-4b21-bf6f-a841dde9df94 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:34.432337 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46d84c39-3fac-4b21-bf6f-a841dde9df94 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:34.432780 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-46d84c39-3fac-4b21-bf6f-a841dde9df94 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:34.573127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-46d84c39-3fac-4b21-bf6f-a841dde9df94 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:34.580986 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-46d84c39-3fac-4b21-bf6f-a841dde9df94 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1573 microversion: 2.1 time: 0.163232 Aug 27 06:31:34.581566 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4078/8169] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:34 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:35.601886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-77a16e2c-581a-41cb-ae65-bdedd5624947 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:35.602505 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-77a16e2c-581a-41cb-ae65-bdedd5624947 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:35.605460 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=31 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:31:35.610594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77a16e2c-581a-41cb-ae65-bdedd5624947 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:35.611079 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77a16e2c-581a-41cb-ae65-bdedd5624947 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:35.611565 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77a16e2c-581a-41cb-ae65-bdedd5624947 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:35.612265 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77a16e2c-581a-41cb-ae65-bdedd5624947 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:35.612718 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77a16e2c-581a-41cb-ae65-bdedd5624947 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:35.613148 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-77a16e2c-581a-41cb-ae65-bdedd5624947 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:35.745278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-77a16e2c-581a-41cb-ae65-bdedd5624947 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:35.753658 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-77a16e2c-581a-41cb-ae65-bdedd5624947 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1573 microversion: 2.1 time: 0.155715 Aug 27 06:31:35.754236 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4092/8170] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:35 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:36.774818 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fce6f4d1-b01a-4d38-868b-5462eec20ef1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:36.775474 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fce6f4d1-b01a-4d38-868b-5462eec20ef1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:36.778903 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:31:36.785662 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce6f4d1-b01a-4d38-868b-5462eec20ef1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:36.786238 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce6f4d1-b01a-4d38-868b-5462eec20ef1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:36.786623 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce6f4d1-b01a-4d38-868b-5462eec20ef1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:36.787465 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce6f4d1-b01a-4d38-868b-5462eec20ef1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:36.787938 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce6f4d1-b01a-4d38-868b-5462eec20ef1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:36.788373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fce6f4d1-b01a-4d38-868b-5462eec20ef1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:36.792108 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:31:36.927489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fce6f4d1-b01a-4d38-868b-5462eec20ef1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:36.935975 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fce6f4d1-b01a-4d38-868b-5462eec20ef1 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1573 microversion: 2.1 time: 0.165077 Aug 27 06:31:36.936567 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4079/8171] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:36 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:37.957110 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-18222779-2d55-4575-aafe-b02dfd6a79f3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:37.957763 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-18222779-2d55-4575-aafe-b02dfd6a79f3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:37.964066 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18222779-2d55-4575-aafe-b02dfd6a79f3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:37.964555 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18222779-2d55-4575-aafe-b02dfd6a79f3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:37.965005 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18222779-2d55-4575-aafe-b02dfd6a79f3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:37.965706 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18222779-2d55-4575-aafe-b02dfd6a79f3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:37.966165 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18222779-2d55-4575-aafe-b02dfd6a79f3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:37.966600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-18222779-2d55-4575-aafe-b02dfd6a79f3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:38.109226 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-18222779-2d55-4575-aafe-b02dfd6a79f3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:38.116992 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-18222779-2d55-4575-aafe-b02dfd6a79f3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1573 microversion: 2.1 time: 0.164504 Aug 27 06:31:38.117565 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4093/8172] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:37 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:39.138829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5ad86c10-4168-454d-bc91-21c2f5e388f5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:39.139483 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5ad86c10-4168-454d-bc91-21c2f5e388f5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:39.146797 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ad86c10-4168-454d-bc91-21c2f5e388f5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:39.147332 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ad86c10-4168-454d-bc91-21c2f5e388f5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:39.147782 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ad86c10-4168-454d-bc91-21c2f5e388f5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:39.148497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ad86c10-4168-454d-bc91-21c2f5e388f5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:39.148968 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ad86c10-4168-454d-bc91-21c2f5e388f5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:39.149408 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ad86c10-4168-454d-bc91-21c2f5e388f5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:39.284748 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5ad86c10-4168-454d-bc91-21c2f5e388f5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:39.292541 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5ad86c10-4168-454d-bc91-21c2f5e388f5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1573 microversion: 2.1 time: 0.158049 Aug 27 06:31:39.293117 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4080/8173] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:39 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:40.313789 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8266e3e7-ec64-4ce9-9021-c789fe4e27f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:40.314473 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8266e3e7-ec64-4ce9-9021-c789fe4e27f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:40.321345 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8266e3e7-ec64-4ce9-9021-c789fe4e27f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:40.321829 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8266e3e7-ec64-4ce9-9021-c789fe4e27f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:40.322264 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8266e3e7-ec64-4ce9-9021-c789fe4e27f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:40.322956 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8266e3e7-ec64-4ce9-9021-c789fe4e27f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:40.323443 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8266e3e7-ec64-4ce9-9021-c789fe4e27f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:40.324720 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8266e3e7-ec64-4ce9-9021-c789fe4e27f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:40.460682 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8266e3e7-ec64-4ce9-9021-c789fe4e27f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:40.468561 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8266e3e7-ec64-4ce9-9021-c789fe4e27f7 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1573 microversion: 2.1 time: 0.158720 Aug 27 06:31:40.469140 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4094/8174] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:40 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:41.095226 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e8ab0898-f8e9-4a50-915e-22e30d99dd7c req-917ec5a7-1ffe-4e5f-94c4-12906a6b0886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c77144-5882-4c76-8436-31cac39c57b4", "name": "network-vif-plugged", "status": "completed", "tag": "a4ea1eac-481c-48b5-83e4-3c8753076448"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:31:41.105922 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e8ab0898-f8e9-4a50-915e-22e30d99dd7c req-917ec5a7-1ffe-4e5f-94c4-12906a6b0886 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:41.106431 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e8ab0898-f8e9-4a50-915e-22e30d99dd7c req-917ec5a7-1ffe-4e5f-94c4-12906a6b0886 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:41.106886 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e8ab0898-f8e9-4a50-915e-22e30d99dd7c req-917ec5a7-1ffe-4e5f-94c4-12906a6b0886 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:41.122064 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e8ab0898-f8e9-4a50-915e-22e30d99dd7c req-917ec5a7-1ffe-4e5f-94c4-12906a6b0886 service nova] Creating event network-vif-plugged:a4ea1eac-481c-48b5-83e4-3c8753076448 for instance c1c77144-5882-4c76-8436-31cac39c57b4 on n-h1-820368-35 Aug 27 06:31:41.127238 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e8ab0898-f8e9-4a50-915e-22e30d99dd7c req-917ec5a7-1ffe-4e5f-94c4-12906a6b0886 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036872 Aug 27 06:31:41.127849 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4081/8175] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:31:41.490299 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-44cf4fce-feb8-4d56-896b-b7005f5ed499 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:41.490926 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-44cf4fce-feb8-4d56-896b-b7005f5ed499 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:41.497866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44cf4fce-feb8-4d56-896b-b7005f5ed499 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:41.498359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44cf4fce-feb8-4d56-896b-b7005f5ed499 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:41.498803 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44cf4fce-feb8-4d56-896b-b7005f5ed499 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:41.499551 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44cf4fce-feb8-4d56-896b-b7005f5ed499 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:41.500010 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44cf4fce-feb8-4d56-896b-b7005f5ed499 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:41.500439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-44cf4fce-feb8-4d56-896b-b7005f5ed499 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:41.631184 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-44cf4fce-feb8-4d56-896b-b7005f5ed499 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:41.639112 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-44cf4fce-feb8-4d56-896b-b7005f5ed499 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1573 microversion: 2.1 time: 0.152939 Aug 27 06:31:41.639697 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4095/8176] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:41 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:42.662079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6f999118-2baf-45fe-9afc-11577ebadf50 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:42.662868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6f999118-2baf-45fe-9afc-11577ebadf50 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:42.669136 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f999118-2baf-45fe-9afc-11577ebadf50 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:42.669628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f999118-2baf-45fe-9afc-11577ebadf50 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:42.670080 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f999118-2baf-45fe-9afc-11577ebadf50 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:42.670783 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f999118-2baf-45fe-9afc-11577ebadf50 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:42.671285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f999118-2baf-45fe-9afc-11577ebadf50 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:42.671726 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6f999118-2baf-45fe-9afc-11577ebadf50 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:42.808649 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6f999118-2baf-45fe-9afc-11577ebadf50 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:42.817271 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6f999118-2baf-45fe-9afc-11577ebadf50 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1573 microversion: 2.1 time: 0.160790 Aug 27 06:31:42.817887 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4082/8177] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:42 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:31:43.839901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-dfd139bb-e66d-4590-851b-e0a490f8c6d5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:31:43.840552 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-dfd139bb-e66d-4590-851b-e0a490f8c6d5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:31:43.847793 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfd139bb-e66d-4590-851b-e0a490f8c6d5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:43.848275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfd139bb-e66d-4590-851b-e0a490f8c6d5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:43.848709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfd139bb-e66d-4590-851b-e0a490f8c6d5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:43.849407 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfd139bb-e66d-4590-851b-e0a490f8c6d5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:31:43.849864 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfd139bb-e66d-4590-851b-e0a490f8c6d5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:31:43.850292 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-dfd139bb-e66d-4590-851b-e0a490f8c6d5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:31:43.983482 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-dfd139bb-e66d-4590-851b-e0a490f8c6d5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:31:43.991819 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-dfd139bb-e66d-4590-851b-e0a490f8c6d5 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1560 microversion: 2.1 time: 0.155831 Aug 27 06:31:43.992383 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4096/8178] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:31:43 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:32:57.611807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=7 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:32:57.613027 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=19 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:32:57.617908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=9 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:32:57.619050 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=32 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:32:57.619971 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e00e9ec6-9362-4706-adcc-f41b9626c0f8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:32:57.620512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e00e9ec6-9362-4706-adcc-f41b9626c0f8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:32:57.647127 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e00e9ec6-9362-4706-adcc-f41b9626c0f8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:32:57.647639 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e00e9ec6-9362-4706-adcc-f41b9626c0f8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:32:57.648106 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e00e9ec6-9362-4706-adcc-f41b9626c0f8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:32:57.648998 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e00e9ec6-9362-4706-adcc-f41b9626c0f8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:32:57.649424 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e00e9ec6-9362-4706-adcc-f41b9626c0f8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:32:57.649874 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-e00e9ec6-9362-4706-adcc-f41b9626c0f8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:32:57.676357 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e00e9ec6-9362-4706-adcc-f41b9626c0f8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Going to try to terminate instance {{(pid=128547) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:32:57.762759 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e00e9ec6-9362-4706-adcc-f41b9626c0f8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 204 len: 0 microversion: 2.1 time: 0.153091 Aug 27 06:32:57.763749 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4083/8179] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:32:57 2022] DELETE /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:32:57.776742 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c1f7845f-f3ba-4b53-b39d-6cb64e0b0744 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:32:57.777480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c1f7845f-f3ba-4b53-b39d-6cb64e0b0744 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:32:57.787858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1f7845f-f3ba-4b53-b39d-6cb64e0b0744 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:32:57.788382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1f7845f-f3ba-4b53-b39d-6cb64e0b0744 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:32:57.788848 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1f7845f-f3ba-4b53-b39d-6cb64e0b0744 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:32:57.789696 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1f7845f-f3ba-4b53-b39d-6cb64e0b0744 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:32:57.790185 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1f7845f-f3ba-4b53-b39d-6cb64e0b0744 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:32:57.790740 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c1f7845f-f3ba-4b53-b39d-6cb64e0b0744 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:32:57.826404 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-58091b94-5e52-48f1-9a18-43a5ecac5f40 req-3a1fc3fc-8a1f-49b2-92a8-9a6f6f8b7c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c77144-5882-4c76-8436-31cac39c57b4", "tag": "a4ea1eac-481c-48b5-83e4-3c8753076448"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:32:57.836972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-58091b94-5e52-48f1-9a18-43a5ecac5f40 req-3a1fc3fc-8a1f-49b2-92a8-9a6f6f8b7c10 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:32:57.837967 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-58091b94-5e52-48f1-9a18-43a5ecac5f40 req-3a1fc3fc-8a1f-49b2-92a8-9a6f6f8b7c10 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:32:57.838417 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-58091b94-5e52-48f1-9a18-43a5ecac5f40 req-3a1fc3fc-8a1f-49b2-92a8-9a6f6f8b7c10 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:32:57.851162 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-58091b94-5e52-48f1-9a18-43a5ecac5f40 req-3a1fc3fc-8a1f-49b2-92a8-9a6f6f8b7c10 service nova] Creating event network-changed:a4ea1eac-481c-48b5-83e4-3c8753076448 for instance c1c77144-5882-4c76-8436-31cac39c57b4 on n-h1-820368-35 Aug 27 06:32:57.856979 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-58091b94-5e52-48f1-9a18-43a5ecac5f40 req-3a1fc3fc-8a1f-49b2-92a8-9a6f6f8b7c10 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245429 Aug 27 06:32:57.857884 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4097/8180] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:32:57.938299 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c1f7845f-f3ba-4b53-b39d-6cb64e0b0744 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:32:57.946458 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c1f7845f-f3ba-4b53-b39d-6cb64e0b0744 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.174245 Aug 27 06:32:57.947055 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4084/8181] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:32:57 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:32:58.970185 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5d25af9f-e84a-46c0-8191-378dec99a911 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:32:58.970900 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5d25af9f-e84a-46c0-8191-378dec99a911 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:32:58.977129 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d25af9f-e84a-46c0-8191-378dec99a911 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:32:58.977629 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d25af9f-e84a-46c0-8191-378dec99a911 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:32:58.978077 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d25af9f-e84a-46c0-8191-378dec99a911 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:32:58.978784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d25af9f-e84a-46c0-8191-378dec99a911 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:32:58.979275 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d25af9f-e84a-46c0-8191-378dec99a911 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:32:58.979708 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d25af9f-e84a-46c0-8191-378dec99a911 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:32:59.128405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d25af9f-e84a-46c0-8191-378dec99a911 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:32:59.137055 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5d25af9f-e84a-46c0-8191-378dec99a911 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1566 microversion: 2.1 time: 0.172280 Aug 27 06:32:59.137635 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4098/8182] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:32:58 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:00.020676 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4b18582a-f590-428f-a17b-6600f1e83d42 req-21f562d0-4e4b-4bff-9188-ab9bd67fed47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c77144-5882-4c76-8436-31cac39c57b4", "name": "network-vif-deleted", "tag": "a4ea1eac-481c-48b5-83e4-3c8753076448"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:33:00.032373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4b18582a-f590-428f-a17b-6600f1e83d42 req-21f562d0-4e4b-4bff-9188-ab9bd67fed47 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:00.032800 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4b18582a-f590-428f-a17b-6600f1e83d42 req-21f562d0-4e4b-4bff-9188-ab9bd67fed47 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:00.033251 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4b18582a-f590-428f-a17b-6600f1e83d42 req-21f562d0-4e4b-4bff-9188-ab9bd67fed47 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:00.047172 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4b18582a-f590-428f-a17b-6600f1e83d42 req-21f562d0-4e4b-4bff-9188-ab9bd67fed47 service nova] Creating event network-vif-deleted:a4ea1eac-481c-48b5-83e4-3c8753076448 for instance c1c77144-5882-4c76-8436-31cac39c57b4 on n-h1-820368-35 Aug 27 06:33:00.053978 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4b18582a-f590-428f-a17b-6600f1e83d42 req-21f562d0-4e4b-4bff-9188-ab9bd67fed47 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036476 Aug 27 06:33:00.054596 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4085/8183] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:33:00.158107 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-86d5fd97-aa68-4d05-8c74-7f6fb1b532bf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:00.158826 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-86d5fd97-aa68-4d05-8c74-7f6fb1b532bf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:00.166081 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d5fd97-aa68-4d05-8c74-7f6fb1b532bf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:00.166568 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d5fd97-aa68-4d05-8c74-7f6fb1b532bf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:00.167009 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d5fd97-aa68-4d05-8c74-7f6fb1b532bf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:00.167746 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d5fd97-aa68-4d05-8c74-7f6fb1b532bf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:00.168203 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d5fd97-aa68-4d05-8c74-7f6fb1b532bf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:00.168632 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-86d5fd97-aa68-4d05-8c74-7f6fb1b532bf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:00.236784 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-86d5fd97-aa68-4d05-8c74-7f6fb1b532bf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:00.244820 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-86d5fd97-aa68-4d05-8c74-7f6fb1b532bf tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1218 microversion: 2.1 time: 0.090657 Aug 27 06:33:00.245652 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4099/8184] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:00 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:01.266497 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-5ec467e0-6dc2-43c1-ba23-42a0e3f3a3c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:01.267253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-5ec467e0-6dc2-43c1-ba23-42a0e3f3a3c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:01.274810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ec467e0-6dc2-43c1-ba23-42a0e3f3a3c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:01.275370 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ec467e0-6dc2-43c1-ba23-42a0e3f3a3c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:01.275833 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ec467e0-6dc2-43c1-ba23-42a0e3f3a3c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:01.276553 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ec467e0-6dc2-43c1-ba23-42a0e3f3a3c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:01.277029 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ec467e0-6dc2-43c1-ba23-42a0e3f3a3c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:01.277477 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-5ec467e0-6dc2-43c1-ba23-42a0e3f3a3c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:01.339832 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-5ec467e0-6dc2-43c1-ba23-42a0e3f3a3c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:01.347718 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-5ec467e0-6dc2-43c1-ba23-42a0e3f3a3c3 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1218 microversion: 2.1 time: 0.085534 Aug 27 06:33:01.348290 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4086/8185] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:01 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:02.370117 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-eabedcfa-522a-44f3-add6-39e27e6945d9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:02.370753 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-eabedcfa-522a-44f3-add6-39e27e6945d9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:02.377837 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabedcfa-522a-44f3-add6-39e27e6945d9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:02.378334 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabedcfa-522a-44f3-add6-39e27e6945d9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:02.378776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabedcfa-522a-44f3-add6-39e27e6945d9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:02.379557 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabedcfa-522a-44f3-add6-39e27e6945d9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:02.380020 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabedcfa-522a-44f3-add6-39e27e6945d9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:02.380455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-eabedcfa-522a-44f3-add6-39e27e6945d9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:02.453487 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-eabedcfa-522a-44f3-add6-39e27e6945d9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:02.461589 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-eabedcfa-522a-44f3-add6-39e27e6945d9 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1218 microversion: 2.1 time: 0.096213 Aug 27 06:33:02.462185 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4100/8186] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:02 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:03.482435 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-af254fa5-0f8e-4c98-99c5-b2b96cc753a8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:03.483078 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-af254fa5-0f8e-4c98-99c5-b2b96cc753a8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:03.490118 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af254fa5-0f8e-4c98-99c5-b2b96cc753a8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:03.490628 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af254fa5-0f8e-4c98-99c5-b2b96cc753a8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:03.491761 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af254fa5-0f8e-4c98-99c5-b2b96cc753a8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:03.492594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af254fa5-0f8e-4c98-99c5-b2b96cc753a8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:03.493086 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af254fa5-0f8e-4c98-99c5-b2b96cc753a8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:03.493533 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-af254fa5-0f8e-4c98-99c5-b2b96cc753a8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:03.555942 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-af254fa5-0f8e-4c98-99c5-b2b96cc753a8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:03.564285 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-af254fa5-0f8e-4c98-99c5-b2b96cc753a8 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1218 microversion: 2.1 time: 0.085896 Aug 27 06:33:03.564871 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4087/8187] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:03 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:04.584955 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:04.586093 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:04.595259 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:04.595771 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:04.596434 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:04.597177 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:04.597824 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:04.598268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:04.631399 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:04.631861 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:04.633155 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:04.633816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lazy-loading 'fault' on Instance uuid c1c77144-5882-4c76-8436-31cac39c57b4 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:33:04.677624 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349195aae474afaa937305ea067761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee79cf2b484239acf77f2d131a5b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:04.686469 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e25c611f-52ef-4f9f-ae64-c0d0848a066c tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 200 len: 1177 microversion: 2.1 time: 0.105383 Aug 27 06:33:04.687071 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4101/8188] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:04 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 1177 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:05.708604 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:05.709249 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] [instance: c1c77144-5882-4c76-8436-31cac39c57b4] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:05.717026 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:05.717532 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:05.717989 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:05.719360 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:05.719457 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:05.719840 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:05.736635 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] HTTP exception thrown: Instance c1c77144-5882-4c76-8436-31cac39c57b4 could not be found. Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Request method failure captured: Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 HTTP/1.1 Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbg6bT7v7-ICOmhOLjoL6mtFQtOiI0dIm9R6kA8KLm7i5B2lv0sHZZtH2LPfxrukysa6bdAzcuDIe3U6ckXFFk88r0VIraNQWEB8SzfdyrQiVgdWUXbN5vFrfcJiEhfdOszOHAMvohTk_SW5lESpHjdze5jyt78d8zjlW_Zs2BI7F7A Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 6eee79cf2b484239acf77f2d131a5b75 Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestShelveInstance-2096476059 Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6eee79cf2b484239acf77f2d131a5b75", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6eee79cf2b484239acf77f2d131a5b75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6eee79cf2b484239acf77f2d131a5b75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6eee79cf2b484239acf77f2d131a5b75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestShelveInstance-2096476059 Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 6eee79cf2b484239acf77f2d131a5b75 Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestShelveInstance-2096476059 Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestShelveInstance-2096476059-project Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 7349195aae474afaa937305ea067761e Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestShelveInstance-2096476059-project Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance c1c77144-5882-4c76-8436-31cac39c57b4 could not be found. Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': 'c1c77144-5882-4c76-8436-31cac39c57b4'} Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c77144-5882-4c76-8436-31cac39c57b4 could not be found. Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c77144-5882-4c76-8436-31cac39c57b4 could not be found. Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:33:05.738314 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:33:05.743364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:33:05.743364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:33:05.743364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:33:05.743364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:33:05.743364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:33:05.743364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c77144-5882-4c76-8436-31cac39c57b4 could not be found. Aug 27 06:33:05.743364 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:33:05.743364 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Returning 404 to user: Instance c1c77144-5882-4c76-8436-31cac39c57b4 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:33:05.743364 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c7506a25-e8ee-4864-9181-947f4c647212 tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4" status: 404 len: 111 microversion: 2.1 time: 0.035193 Aug 27 06:33:05.743364 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4088/8189] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:05 2022] GET /compute/v2.1/servers/c1c77144-5882-4c76-8436-31cac39c57b4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:33:05.909736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-01b48ae5-2e8e-4ced-8d31-64d9e4d0614b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] Calling method '.version_select at 0x7fb56509ddc0>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:05.947980 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-01b48ae5-2e8e-4ced-8d31-64d9e4d0614b tempest-TestShelveInstance-2096476059 tempest-TestShelveInstance-2096476059-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-359869760" status: 202 len: 0 microversion: 2.1 time: 0.043339 Aug 27 06:33:05.948785 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4102/8190] 10.222.0.58 () {58 vars in 1251 bytes} [Sat Aug 27 06:33:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-359869760 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:33:23.644117 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:33:23.644868 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:33:23.816732 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-358514a0-7d67-4325-87f4-a1dc569d520e tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Action: 'create', calling method: .version_select at 0x7fb564472dc0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2138134931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApLVChyjmSJcYPzgo4uyts5tG3Uvsan9W27Lk+QgL6CDo2s8cZa7zbUWRlFsTx+wooBJXEY3pwXSfwhqUXVwkfFZuE4gm9LijSLK4Z8jPmAk05dYHfbwuY0riehNCl3dw=="}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:33:23.833562 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-358514a0-7d67-4325-87f4-a1dc569d520e tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Getting quotas for project 3217538d5bd04de096c25cb1121188bb. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:33:23.838631 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-358514a0-7d67-4325-87f4-a1dc569d520e tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Getting quotas for user 71620ed860574b01977c54eb0b10ae49 and project 3217538d5bd04de096c25cb1121188bb. Resources: {'key_pairs'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:33:23.868478 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-358514a0-7d67-4325-87f4-a1dc569d520e tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.229442 Aug 27 06:33:23.869084 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4089/8191] 10.222.0.58 () {60 vars in 1159 bytes} [Sat Aug 27 06:33:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:33:24.907078 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=28 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:33:24.907881 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:33:24.912111 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1184464", "imageRef": "596ae1e8-61a9-43bf-be37-48ea5ff9a76f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2138134931", "security_groups": [{"name": "tempest-secgroup-smoke-1854031685"}], "networks": [{"uuid": "b3b4ff57-2714-4ec6-8309-fc62fd3af89e"}]}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:33:25.144847 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.network.neutron [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] validate_networks() for [('b3b4ff57-2714-4ec6-8309-fc62fd3af89e', None, None, None, None, None)] {{(pid=128548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:33:25.637358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Flavor limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:33:25.637791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Image limits 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:33:25.638270 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Flavor pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:33:25.638685 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Image pref 0:0:0 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:33:25.639126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.virt.hardware [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:33:25.648648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:25.649140 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:25.649869 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:25.650358 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:25.650814 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:25.651274 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:25.668458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Getting quotas for project 3217538d5bd04de096c25cb1121188bb. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:33:25.673979 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.quota [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Getting quotas for user 71620ed860574b01977c54eb0b10ae49 and project 3217538d5bd04de096c25cb1121188bb. Resources: {'cores', 'ram', 'instances'} {{(pid=128548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:33:25.686930 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Going to run 1 instances... {{(pid=128548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:33:25.689311 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596ae1e8-61a9-43bf-be37-48ea5ff9a76f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:33:25.740133 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-71056618-cc77-4584-8487-a320264f7fbe tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.835491 Aug 27 06:33:25.741690 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4103/8192] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:33:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:33:25.753021 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-e1e298d5-1f66-49e5-954a-82e282722803 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:25.753825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-e1e298d5-1f66-49e5-954a-82e282722803 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:25.893829 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-e1e298d5-1f66-49e5-954a-82e282722803 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:25.902049 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-e1e298d5-1f66-49e5-954a-82e282722803 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1246 microversion: 2.1 time: 0.153671 Aug 27 06:33:25.903206 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4090/8193] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:25 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1246 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:26.925356 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4fffd6b7-6193-4ce4-a3c5-484dc09cd325 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:26.926024 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4fffd6b7-6193-4ce4-a3c5-484dc09cd325 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:26.936561 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fffd6b7-6193-4ce4-a3c5-484dc09cd325 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:26.937339 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fffd6b7-6193-4ce4-a3c5-484dc09cd325 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:26.937943 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fffd6b7-6193-4ce4-a3c5-484dc09cd325 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:26.938827 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fffd6b7-6193-4ce4-a3c5-484dc09cd325 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:26.939489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fffd6b7-6193-4ce4-a3c5-484dc09cd325 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:26.940080 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4fffd6b7-6193-4ce4-a3c5-484dc09cd325 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:27.019898 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4fffd6b7-6193-4ce4-a3c5-484dc09cd325 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:27.030328 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4fffd6b7-6193-4ce4-a3c5-484dc09cd325 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1306 microversion: 2.1 time: 0.111943 Aug 27 06:33:27.031565 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4104/8194] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:26 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1306 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:28.052488 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-33796624-808e-4b03-a406-aaebab41e1aa tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:28.053024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-33796624-808e-4b03-a406-aaebab41e1aa tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:28.060858 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33796624-808e-4b03-a406-aaebab41e1aa tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:28.061365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33796624-808e-4b03-a406-aaebab41e1aa tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:28.061819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33796624-808e-4b03-a406-aaebab41e1aa tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:28.062537 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33796624-808e-4b03-a406-aaebab41e1aa tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:28.063005 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33796624-808e-4b03-a406-aaebab41e1aa tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:28.063472 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-33796624-808e-4b03-a406-aaebab41e1aa tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:28.198090 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-33796624-808e-4b03-a406-aaebab41e1aa tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:28.206350 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-33796624-808e-4b03-a406-aaebab41e1aa tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1372 microversion: 2.1 time: 0.157828 Aug 27 06:33:28.206962 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4091/8195] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:28 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:28.383461 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-126a0d18-072d-4c11-86d8-bfb73cda0a3c req-c7bdd63a-da7d-4637-8721-f7d5c015083f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a874cbb-dc18-4dda-a791-2340c1e64c98", "tag": "98b120c1-3858-4242-a3e5-c34e7705bdb5"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:33:28.400988 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-126a0d18-072d-4c11-86d8-bfb73cda0a3c req-c7bdd63a-da7d-4637-8721-f7d5c015083f service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:28.401478 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-126a0d18-072d-4c11-86d8-bfb73cda0a3c req-c7bdd63a-da7d-4637-8721-f7d5c015083f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:28.401907 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-126a0d18-072d-4c11-86d8-bfb73cda0a3c req-c7bdd63a-da7d-4637-8721-f7d5c015083f service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:28.433925 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-126a0d18-072d-4c11-86d8-bfb73cda0a3c req-c7bdd63a-da7d-4637-8721-f7d5c015083f service nova] Creating event network-changed:98b120c1-3858-4242-a3e5-c34e7705bdb5 for instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 on n-h1-820368-35 Aug 27 06:33:28.439543 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-126a0d18-072d-4c11-86d8-bfb73cda0a3c req-c7bdd63a-da7d-4637-8721-f7d5c015083f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061367 Aug 27 06:33:28.441247 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4105/8196] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:33:29.228538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-15e5c4e7-bc3d-44d3-8851-c03f62879277 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:29.229180 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-15e5c4e7-bc3d-44d3-8851-c03f62879277 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:29.236344 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15e5c4e7-bc3d-44d3-8851-c03f62879277 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:29.236850 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15e5c4e7-bc3d-44d3-8851-c03f62879277 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:29.237308 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15e5c4e7-bc3d-44d3-8851-c03f62879277 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:29.238031 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15e5c4e7-bc3d-44d3-8851-c03f62879277 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:29.238512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15e5c4e7-bc3d-44d3-8851-c03f62879277 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:29.238958 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-15e5c4e7-bc3d-44d3-8851-c03f62879277 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:29.380895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-15e5c4e7-bc3d-44d3-8851-c03f62879277 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:29.388687 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-15e5c4e7-bc3d-44d3-8851-c03f62879277 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1372 microversion: 2.1 time: 0.164097 Aug 27 06:33:29.389273 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4092/8197] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:29 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:30.411132 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-93d5a907-d1cf-4aab-bc4a-e14e499825a8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:30.411866 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-93d5a907-d1cf-4aab-bc4a-e14e499825a8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:30.420886 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d5a907-d1cf-4aab-bc4a-e14e499825a8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:30.421416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d5a907-d1cf-4aab-bc4a-e14e499825a8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:30.422168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d5a907-d1cf-4aab-bc4a-e14e499825a8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:30.422569 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d5a907-d1cf-4aab-bc4a-e14e499825a8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:30.423031 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d5a907-d1cf-4aab-bc4a-e14e499825a8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:30.423494 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-93d5a907-d1cf-4aab-bc4a-e14e499825a8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:30.558033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-93d5a907-d1cf-4aab-bc4a-e14e499825a8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:30.565726 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-93d5a907-d1cf-4aab-bc4a-e14e499825a8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1372 microversion: 2.1 time: 0.159983 Aug 27 06:33:30.566289 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4106/8198] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:30 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:31.587037 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6c64ce9d-fd09-4f4c-b67e-747a407202da tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:31.587701 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6c64ce9d-fd09-4f4c-b67e-747a407202da tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:31.594664 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c64ce9d-fd09-4f4c-b67e-747a407202da tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:31.595199 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c64ce9d-fd09-4f4c-b67e-747a407202da tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:31.595657 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c64ce9d-fd09-4f4c-b67e-747a407202da tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:31.596385 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c64ce9d-fd09-4f4c-b67e-747a407202da tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:31.596855 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c64ce9d-fd09-4f4c-b67e-747a407202da tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:31.597295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6c64ce9d-fd09-4f4c-b67e-747a407202da tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:31.731530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6c64ce9d-fd09-4f4c-b67e-747a407202da tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:31.739271 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6c64ce9d-fd09-4f4c-b67e-747a407202da tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1372 microversion: 2.1 time: 0.156817 Aug 27 06:33:31.739855 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4093/8199] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:31 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:32.760660 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-4a07d9c4-7c1f-41bd-ae12-e5a27e33b15b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:32.761293 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-4a07d9c4-7c1f-41bd-ae12-e5a27e33b15b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:32.768296 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a07d9c4-7c1f-41bd-ae12-e5a27e33b15b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:32.768792 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a07d9c4-7c1f-41bd-ae12-e5a27e33b15b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:32.769243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a07d9c4-7c1f-41bd-ae12-e5a27e33b15b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:32.769953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a07d9c4-7c1f-41bd-ae12-e5a27e33b15b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:32.770419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a07d9c4-7c1f-41bd-ae12-e5a27e33b15b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:32.770857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-4a07d9c4-7c1f-41bd-ae12-e5a27e33b15b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:32.904776 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-4a07d9c4-7c1f-41bd-ae12-e5a27e33b15b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:32.912858 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-4a07d9c4-7c1f-41bd-ae12-e5a27e33b15b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1372 microversion: 2.1 time: 0.156788 Aug 27 06:33:32.913455 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4107/8200] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:32 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:33.640433 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-a35621c1-dc23-46b6-8929-8b8706e2c891 req-83cb06bc-3a5b-404a-8834-629b444a2daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a874cbb-dc18-4dda-a791-2340c1e64c98", "name": "network-vif-plugged", "status": "completed", "tag": "98b120c1-3858-4242-a3e5-c34e7705bdb5"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:33:33.651859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a35621c1-dc23-46b6-8929-8b8706e2c891 req-83cb06bc-3a5b-404a-8834-629b444a2daa service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:33.652352 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a35621c1-dc23-46b6-8929-8b8706e2c891 req-83cb06bc-3a5b-404a-8834-629b444a2daa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:33.652844 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-a35621c1-dc23-46b6-8929-8b8706e2c891 req-83cb06bc-3a5b-404a-8834-629b444a2daa service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:33.665414 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-a35621c1-dc23-46b6-8929-8b8706e2c891 req-83cb06bc-3a5b-404a-8834-629b444a2daa service nova] Creating event network-vif-plugged:98b120c1-3858-4242-a3e5-c34e7705bdb5 for instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 on n-h1-820368-35 Aug 27 06:33:33.670684 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-a35621c1-dc23-46b6-8929-8b8706e2c891 req-83cb06bc-3a5b-404a-8834-629b444a2daa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033948 Aug 27 06:33:33.671340 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4094/8201] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:33:33.933475 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-d9865681-9d24-4384-8ff0-837536c25a5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:33.934096 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-d9865681-9d24-4384-8ff0-837536c25a5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:33.941852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9865681-9d24-4384-8ff0-837536c25a5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:33.941852 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9865681-9d24-4384-8ff0-837536c25a5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:33.942171 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9865681-9d24-4384-8ff0-837536c25a5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:33.942891 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9865681-9d24-4384-8ff0-837536c25a5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:33.943384 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9865681-9d24-4384-8ff0-837536c25a5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:33.943964 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-d9865681-9d24-4384-8ff0-837536c25a5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:34.086882 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-d9865681-9d24-4384-8ff0-837536c25a5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:34.094682 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-d9865681-9d24-4384-8ff0-837536c25a5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1372 microversion: 2.1 time: 0.165426 Aug 27 06:33:34.095288 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4108/8202] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:33 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:35.117856 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d8615b13-cabd-4e71-9908-b39cf63e6009 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:35.118573 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d8615b13-cabd-4e71-9908-b39cf63e6009 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:35.124811 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8615b13-cabd-4e71-9908-b39cf63e6009 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:35.125315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8615b13-cabd-4e71-9908-b39cf63e6009 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:35.125774 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8615b13-cabd-4e71-9908-b39cf63e6009 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:35.126489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8615b13-cabd-4e71-9908-b39cf63e6009 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:35.126964 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8615b13-cabd-4e71-9908-b39cf63e6009 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:35.127439 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d8615b13-cabd-4e71-9908-b39cf63e6009 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:35.261258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-d8615b13-cabd-4e71-9908-b39cf63e6009 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:35.268985 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d8615b13-cabd-4e71-9908-b39cf63e6009 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1372 microversion: 2.1 time: 0.156772 Aug 27 06:33:35.269587 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4095/8203] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:35 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:36.290709 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-1a5fb960-dc06-4ffc-8903-4df7bf104123 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:36.291377 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-1a5fb960-dc06-4ffc-8903-4df7bf104123 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:36.293678 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:33:36.294337 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=6 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:33:36.300477 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a5fb960-dc06-4ffc-8903-4df7bf104123 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:36.300959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a5fb960-dc06-4ffc-8903-4df7bf104123 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:36.301396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a5fb960-dc06-4ffc-8903-4df7bf104123 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:36.302088 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a5fb960-dc06-4ffc-8903-4df7bf104123 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:36.302546 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a5fb960-dc06-4ffc-8903-4df7bf104123 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:36.302972 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-1a5fb960-dc06-4ffc-8903-4df7bf104123 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:36.436977 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-1a5fb960-dc06-4ffc-8903-4df7bf104123 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:36.444894 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-1a5fb960-dc06-4ffc-8903-4df7bf104123 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1556 microversion: 2.1 time: 0.158627 Aug 27 06:33:36.445461 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4109/8204] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:36 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:36.465060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-1b2e1a04-7d01-4e61-8ad5-407a1946a84c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:33:36.465693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-1b2e1a04-7d01-4e61-8ad5-407a1946a84c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:33:36.467668 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=6 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:33:36.473823 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b2e1a04-7d01-4e61-8ad5-407a1946a84c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:36.474323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b2e1a04-7d01-4e61-8ad5-407a1946a84c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:36.474777 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b2e1a04-7d01-4e61-8ad5-407a1946a84c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:36.476148 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b2e1a04-7d01-4e61-8ad5-407a1946a84c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:36.476616 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b2e1a04-7d01-4e61-8ad5-407a1946a84c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:36.477060 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-1b2e1a04-7d01-4e61-8ad5-407a1946a84c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:36.613093 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-1b2e1a04-7d01-4e61-8ad5-407a1946a84c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:33:36.621307 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-1b2e1a04-7d01-4e61-8ad5-407a1946a84c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1556 microversion: 2.1 time: 0.160097 Aug 27 06:33:36.622010 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4096/8205] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:33:36 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:33:38.568298 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-b62d5a72-efaa-4125-afb3-d80033b04631 req-5d273214-b36b-4c46-955a-a8d33ed76094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a874cbb-dc18-4dda-a791-2340c1e64c98", "tag": "98b120c1-3858-4242-a3e5-c34e7705bdb5"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:33:38.579599 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b62d5a72-efaa-4125-afb3-d80033b04631 req-5d273214-b36b-4c46-955a-a8d33ed76094 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:33:38.580115 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b62d5a72-efaa-4125-afb3-d80033b04631 req-5d273214-b36b-4c46-955a-a8d33ed76094 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:33:38.580816 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-b62d5a72-efaa-4125-afb3-d80033b04631 req-5d273214-b36b-4c46-955a-a8d33ed76094 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:33:38.593395 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-b62d5a72-efaa-4125-afb3-d80033b04631 req-5d273214-b36b-4c46-955a-a8d33ed76094 service nova] Creating event network-changed:98b120c1-3858-4242-a3e5-c34e7705bdb5 for instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 on n-h1-820368-35 Aug 27 06:33:38.598535 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-b62d5a72-efaa-4125-afb3-d80033b04631 req-5d273214-b36b-4c46-955a-a8d33ed76094 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034079 Aug 27 06:33:38.599166 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4110/8206] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:36:15.064375 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a138aa11-e323-45d1-b35b-6ab4ed1899de] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:36:15.065236 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8da433e2-1b8b-43e8-8a70-e929fdcdfc0f] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:36:15.065768 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:36:15.066689 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=32 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:36:15.067584 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:36:15.067871 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:36:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98/action (ip 10.222.0.58) !!! Aug 27 06:36:15.068740 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:36:15.068893 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:36:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98/action (ip 10.222.0.58) !!! Aug 27 06:36:15.069899 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:36:15.070023 n-d-820368-35 devstack@n-api.service[128547]: Sat Aug 27 06:36:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98/action (ip 10.222.0.58) !!! Aug 27 06:36:15.074681 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-64bfa14a-e280-4876-bc3a-d2e2d9f1bc35 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-663764634"}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:36:15.077022 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-64bfa14a-e280-4876-bc3a-d2e2d9f1bc35 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:15.089325 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64bfa14a-e280-4876-bc3a-d2e2d9f1bc35 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:15.089831 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64bfa14a-e280-4876-bc3a-d2e2d9f1bc35 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:15.090290 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64bfa14a-e280-4876-bc3a-d2e2d9f1bc35 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:15.091004 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64bfa14a-e280-4876-bc3a-d2e2d9f1bc35 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:15.091512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64bfa14a-e280-4876-bc3a-d2e2d9f1bc35 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:15.091956 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-64bfa14a-e280-4876-bc3a-d2e2d9f1bc35 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:15.279938 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-64bfa14a-e280-4876-bc3a-d2e2d9f1bc35 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "POST /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98/action" status: 202 len: 0 microversion: 2.1 time: 0.217443 Aug 27 06:36:15.280602 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4097/8207] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:36:15 2022] POST /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 06:36:22.609229 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [15bbca3d-0083-4a69-8bef-16bf0d79b591] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:36:22.610043 n-d-820368-35 devstack@n-api.service[128548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27d957ae-75c0-4884-9be8-b8e627e8ac1a] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:36:22.610645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:36:22.611424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=36 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:36:22.612337 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:36:22.612507 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:36:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Aug 27 06:36:22.613615 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:36:22.613734 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:36:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Aug 27 06:36:22.614792 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:36:22.614919 n-d-820368-35 devstack@n-api.service[128548]: Sat Aug 27 06:36:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Aug 27 06:36:22.691734 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-0f6aadb9-49af-4cc1-8ec1-2bebf66e677d req-c2353815-f080-4db8-8abc-a727c7e71570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a874cbb-dc18-4dda-a791-2340c1e64c98", "name": "network-vif-plugged", "status": "completed", "tag": "98b120c1-3858-4242-a3e5-c34e7705bdb5"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:36:22.701893 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0f6aadb9-49af-4cc1-8ec1-2bebf66e677d req-c2353815-f080-4db8-8abc-a727c7e71570 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:22.702971 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0f6aadb9-49af-4cc1-8ec1-2bebf66e677d req-c2353815-f080-4db8-8abc-a727c7e71570 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:22.703427 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-0f6aadb9-49af-4cc1-8ec1-2bebf66e677d req-c2353815-f080-4db8-8abc-a727c7e71570 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:22.713570 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-0f6aadb9-49af-4cc1-8ec1-2bebf66e677d req-c2353815-f080-4db8-8abc-a727c7e71570 service nova] Creating event network-vif-plugged:98b120c1-3858-4242-a3e5-c34e7705bdb5 for instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 on n-h1-820368-35 Aug 27 06:36:22.719511 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-0f6aadb9-49af-4cc1-8ec1-2bebf66e677d req-c2353815-f080-4db8-8abc-a727c7e71570 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112016 Aug 27 06:36:22.720327 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4111/8208] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:36:34.972519 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:36:34.973310 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:36:34.977952 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-697685654", "imageRef": "24c5609e-0e73-41a9-a302-34a8ba422522", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2138134931", "security_groups": [{"name": "tempest-secgroup-smoke-1854031685"}], "networks": [{"uuid": "b3b4ff57-2714-4ec6-8309-fc62fd3af89e"}]}} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:36:35.004244 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] [a138aa11-e323-45d1-b35b-6ab4ed1899de] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49896. Aug 27 06:36:35.016593 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] [8da433e2-1b8b-43e8-8a70-e929fdcdfc0f] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49898. Aug 27 06:36:35.101710 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.network.neutron [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] validate_networks() for [('b3b4ff57-2714-4ec6-8309-fc62fd3af89e', None, None, None, None, None)] {{(pid=128547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:36:35.542784 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Flavor limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:36:35.543520 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Image limits 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:36:35.544024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Flavor pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:36:35.544607 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Image pref 0:0:0 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:36:35.545051 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.virt.hardware [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:36:35.554637 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:35.555128 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:35.555591 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:35.556340 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:35.556819 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:35.557267 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:35.574286 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Getting quotas for project 3217538d5bd04de096c25cb1121188bb. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:36:35.579790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.quota [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Getting quotas for user 71620ed860574b01977c54eb0b10ae49 and project 3217538d5bd04de096c25cb1121188bb. Resources: {'cores', 'ram', 'instances'} {{(pid=128547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:36:35.592758 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Going to run 1 instances... {{(pid=128547) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:36:35.595341 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24c5609e-0e73-41a9-a302-34a8ba422522',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:36:35.642933 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-de3d5d7d-a4a2-4f28-a778-11857aabe3ec tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.674195 Aug 27 06:36:35.643906 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4098/8209] 10.222.0.58 () {60 vars in 1147 bytes} [Sat Aug 27 06:36:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 06:36:35.653392 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:36:35.654529 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:36:35.659618 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f92dac5d-b841-4ae8-921c-e79a551009db tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:35.660373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f92dac5d-b841-4ae8-921c-e79a551009db tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:35.678593 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] [27d957ae-75c0-4884-9be8-b8e627e8ac1a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49918. Aug 27 06:36:35.681241 n-d-820368-35 devstack@n-api.service[128548]: INFO oslo.messaging._drivers.impl_rabbit [-] [15bbca3d-0083-4a69-8bef-16bf0d79b591] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49916. Aug 27 06:36:35.734511 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f92dac5d-b841-4ae8-921c-e79a551009db tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:35.742280 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f92dac5d-b841-4ae8-921c-e79a551009db tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1248 microversion: 2.1 time: 0.091149 Aug 27 06:36:35.743012 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4112/8210] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:35 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:36:36.764137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-b5561480-f80e-4af7-b883-6405fd8578c8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:36.764720 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-b5561480-f80e-4af7-b883-6405fd8578c8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:36.819410 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-b5561480-f80e-4af7-b883-6405fd8578c8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:36.826454 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-b5561480-f80e-4af7-b883-6405fd8578c8 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1248 microversion: 2.1 time: 0.067174 Aug 27 06:36:36.827033 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4099/8211] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:36 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1248 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:36:37.847681 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e78443b0-5e06-4839-ad65-5a192cb93be1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:37.849343 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e78443b0-5e06-4839-ad65-5a192cb93be1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:37.856922 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e78443b0-5e06-4839-ad65-5a192cb93be1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:37.858282 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e78443b0-5e06-4839-ad65-5a192cb93be1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:37.859271 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e78443b0-5e06-4839-ad65-5a192cb93be1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:37.860418 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e78443b0-5e06-4839-ad65-5a192cb93be1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:37.861126 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e78443b0-5e06-4839-ad65-5a192cb93be1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:37.861797 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e78443b0-5e06-4839-ad65-5a192cb93be1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:37.940278 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e78443b0-5e06-4839-ad65-5a192cb93be1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:37.948547 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e78443b0-5e06-4839-ad65-5a192cb93be1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1318 microversion: 2.1 time: 0.104802 Aug 27 06:36:37.949347 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4113/8212] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:37 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1318 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:38.771323 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-85f3f0cc-88b7-468b-bfb9-020b20d2c892 req-b806e6f5-3239-4949-93bb-fc1cbb42521e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a874cbb-dc18-4dda-a791-2340c1e64c98", "name": "network-vif-unplugged", "status": "completed", "tag": "98b120c1-3858-4242-a3e5-c34e7705bdb5"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:36:38.795895 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-85f3f0cc-88b7-468b-bfb9-020b20d2c892 req-b806e6f5-3239-4949-93bb-fc1cbb42521e service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:38.797536 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-85f3f0cc-88b7-468b-bfb9-020b20d2c892 req-b806e6f5-3239-4949-93bb-fc1cbb42521e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:38.800285 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-85f3f0cc-88b7-468b-bfb9-020b20d2c892 req-b806e6f5-3239-4949-93bb-fc1cbb42521e service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:38.853312 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-85f3f0cc-88b7-468b-bfb9-020b20d2c892 req-b806e6f5-3239-4949-93bb-fc1cbb42521e service nova] Creating event network-vif-unplugged:98b120c1-3858-4242-a3e5-c34e7705bdb5 for instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 on n-h1-820368-35 Aug 27 06:36:38.877892 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-85f3f0cc-88b7-468b-bfb9-020b20d2c892 req-b806e6f5-3239-4949-93bb-fc1cbb42521e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111600 Aug 27 06:36:38.879019 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4100/8213] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:36:38.969823 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-fe8c9632-cdcd-45fd-abd5-c0853c595198 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:38.971496 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-fe8c9632-cdcd-45fd-abd5-c0853c595198 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:38.980015 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe8c9632-cdcd-45fd-abd5-c0853c595198 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:38.980969 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe8c9632-cdcd-45fd-abd5-c0853c595198 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:38.981938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe8c9632-cdcd-45fd-abd5-c0853c595198 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:38.983489 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe8c9632-cdcd-45fd-abd5-c0853c595198 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:38.984188 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe8c9632-cdcd-45fd-abd5-c0853c595198 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:38.984857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-fe8c9632-cdcd-45fd-abd5-c0853c595198 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:39.156970 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-fe8c9632-cdcd-45fd-abd5-c0853c595198 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:39.165248 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-fe8c9632-cdcd-45fd-abd5-c0853c595198 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.199501 Aug 27 06:36:39.165847 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4114/8214] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:38 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:40.189365 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-f0a8ea3b-c5fd-441d-85bc-4ebbcf830dcd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:40.190079 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-f0a8ea3b-c5fd-441d-85bc-4ebbcf830dcd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:40.196825 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0a8ea3b-c5fd-441d-85bc-4ebbcf830dcd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:40.197416 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0a8ea3b-c5fd-441d-85bc-4ebbcf830dcd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:40.197902 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0a8ea3b-c5fd-441d-85bc-4ebbcf830dcd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:40.198635 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0a8ea3b-c5fd-441d-85bc-4ebbcf830dcd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:40.199165 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0a8ea3b-c5fd-441d-85bc-4ebbcf830dcd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:40.199615 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-f0a8ea3b-c5fd-441d-85bc-4ebbcf830dcd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:40.363321 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-f0a8ea3b-c5fd-441d-85bc-4ebbcf830dcd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:40.371646 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-f0a8ea3b-c5fd-441d-85bc-4ebbcf830dcd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.188298 Aug 27 06:36:40.372298 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4101/8215] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:40 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:41.394153 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5d9cc4bc-9385-4681-b6b3-b7aa3371469c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:41.394883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5d9cc4bc-9385-4681-b6b3-b7aa3371469c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:41.405350 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d9cc4bc-9385-4681-b6b3-b7aa3371469c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:41.406012 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d9cc4bc-9385-4681-b6b3-b7aa3371469c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:41.406732 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d9cc4bc-9385-4681-b6b3-b7aa3371469c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:41.407594 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d9cc4bc-9385-4681-b6b3-b7aa3371469c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:41.408290 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d9cc4bc-9385-4681-b6b3-b7aa3371469c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:41.408946 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5d9cc4bc-9385-4681-b6b3-b7aa3371469c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:41.560137 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-5d9cc4bc-9385-4681-b6b3-b7aa3371469c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:41.576030 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5d9cc4bc-9385-4681-b6b3-b7aa3371469c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.185887 Aug 27 06:36:41.577208 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4115/8216] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:41 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:42.598753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-158f12c8-9481-4f3c-95ad-ff7ef13d7726 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:42.599428 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-158f12c8-9481-4f3c-95ad-ff7ef13d7726 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:42.608977 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158f12c8-9481-4f3c-95ad-ff7ef13d7726 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:42.609943 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158f12c8-9481-4f3c-95ad-ff7ef13d7726 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:42.610538 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158f12c8-9481-4f3c-95ad-ff7ef13d7726 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:42.612303 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158f12c8-9481-4f3c-95ad-ff7ef13d7726 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:42.613306 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158f12c8-9481-4f3c-95ad-ff7ef13d7726 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:42.613828 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-158f12c8-9481-4f3c-95ad-ff7ef13d7726 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:42.778471 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-158f12c8-9481-4f3c-95ad-ff7ef13d7726 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:42.788349 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-158f12c8-9481-4f3c-95ad-ff7ef13d7726 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.193247 Aug 27 06:36:42.789264 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4102/8217] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:42 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:36:43.813396 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-45b17dd0-c432-41d1-9530-f7aaae6476ed tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:43.814118 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-45b17dd0-c432-41d1-9530-f7aaae6476ed tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:43.822408 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b17dd0-c432-41d1-9530-f7aaae6476ed tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:43.822910 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b17dd0-c432-41d1-9530-f7aaae6476ed tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:43.823385 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b17dd0-c432-41d1-9530-f7aaae6476ed tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:43.824109 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b17dd0-c432-41d1-9530-f7aaae6476ed tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:43.824576 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b17dd0-c432-41d1-9530-f7aaae6476ed tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:43.825064 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-45b17dd0-c432-41d1-9530-f7aaae6476ed tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:43.973276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-45b17dd0-c432-41d1-9530-f7aaae6476ed tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:43.982760 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-45b17dd0-c432-41d1-9530-f7aaae6476ed tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.173941 Aug 27 06:36:43.997829 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4116/8218] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:43 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:45.004630 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-28434d6a-bcb8-4a58-a9a9-d7f1a4948243 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:45.005974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-28434d6a-bcb8-4a58-a9a9-d7f1a4948243 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:45.014530 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28434d6a-bcb8-4a58-a9a9-d7f1a4948243 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:45.015218 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28434d6a-bcb8-4a58-a9a9-d7f1a4948243 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:45.015892 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28434d6a-bcb8-4a58-a9a9-d7f1a4948243 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:45.016807 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28434d6a-bcb8-4a58-a9a9-d7f1a4948243 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:45.017295 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28434d6a-bcb8-4a58-a9a9-d7f1a4948243 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:45.017751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-28434d6a-bcb8-4a58-a9a9-d7f1a4948243 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:45.167166 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-28434d6a-bcb8-4a58-a9a9-d7f1a4948243 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:45.175366 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-28434d6a-bcb8-4a58-a9a9-d7f1a4948243 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.175203 Aug 27 06:36:45.175958 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4103/8219] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:44 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:46.197992 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e9a86129-1357-4e63-9a24-aa25d33ecee9 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:46.198605 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e9a86129-1357-4e63-9a24-aa25d33ecee9 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:46.201352 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell0:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:36:46.206941 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9a86129-1357-4e63-9a24-aa25d33ecee9 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:46.207455 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9a86129-1357-4e63-9a24-aa25d33ecee9 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:46.207901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9a86129-1357-4e63-9a24-aa25d33ecee9 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:46.208611 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9a86129-1357-4e63-9a24-aa25d33ecee9 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:46.209075 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9a86129-1357-4e63-9a24-aa25d33ecee9 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:46.209506 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e9a86129-1357-4e63-9a24-aa25d33ecee9 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:46.344323 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-e9a86129-1357-4e63-9a24-aa25d33ecee9 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:46.352306 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e9a86129-1357-4e63-9a24-aa25d33ecee9 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.158248 Aug 27 06:36:46.352880 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4117/8220] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:46 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:47.372334 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-fe5e0bb3-3ede-472b-bdd7-a79983a0371c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:47.372924 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-fe5e0bb3-3ede-472b-bdd7-a79983a0371c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:47.375382 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:36:47.377121 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell0:SELECT=8 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:36:47.383024 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5e0bb3-3ede-472b-bdd7-a79983a0371c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:47.383548 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5e0bb3-3ede-472b-bdd7-a79983a0371c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:47.384000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5e0bb3-3ede-472b-bdd7-a79983a0371c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:47.384712 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5e0bb3-3ede-472b-bdd7-a79983a0371c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:47.385174 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5e0bb3-3ede-472b-bdd7-a79983a0371c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:47.385610 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-fe5e0bb3-3ede-472b-bdd7-a79983a0371c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:47.517703 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-fe5e0bb3-3ede-472b-bdd7-a79983a0371c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:47.525482 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-fe5e0bb3-3ede-472b-bdd7-a79983a0371c tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.157120 Aug 27 06:36:47.526065 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4104/8221] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:47 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:48.546872 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-f079191f-9a69-4c03-bc2a-ae0aa74284a1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:48.547519 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-f079191f-9a69-4c03-bc2a-ae0aa74284a1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:48.554422 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f079191f-9a69-4c03-bc2a-ae0aa74284a1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:48.554908 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f079191f-9a69-4c03-bc2a-ae0aa74284a1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:48.555370 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f079191f-9a69-4c03-bc2a-ae0aa74284a1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:48.556069 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f079191f-9a69-4c03-bc2a-ae0aa74284a1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:48.556526 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f079191f-9a69-4c03-bc2a-ae0aa74284a1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:48.556953 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-f079191f-9a69-4c03-bc2a-ae0aa74284a1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:48.690909 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-f079191f-9a69-4c03-bc2a-ae0aa74284a1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:48.698863 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-f079191f-9a69-4c03-bc2a-ae0aa74284a1 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.156446 Aug 27 06:36:48.699478 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4118/8222] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:48 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:49.719544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c6a837d1-5933-4a00-b005-7fb333d23719 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:49.720284 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c6a837d1-5933-4a00-b005-7fb333d23719 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:49.727347 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a837d1-5933-4a00-b005-7fb333d23719 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:49.728138 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a837d1-5933-4a00-b005-7fb333d23719 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:49.728869 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a837d1-5933-4a00-b005-7fb333d23719 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:49.729620 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a837d1-5933-4a00-b005-7fb333d23719 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:49.730100 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a837d1-5933-4a00-b005-7fb333d23719 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:49.730585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c6a837d1-5933-4a00-b005-7fb333d23719 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:49.937688 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c6a837d1-5933-4a00-b005-7fb333d23719 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:49.946255 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c6a837d1-5933-4a00-b005-7fb333d23719 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.231266 Aug 27 06:36:49.946966 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4105/8223] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:49 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:50.056164 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-bde6a2da-d5fc-471e-9d8e-23a4e386da77 req-3714dcb9-3d69-4771-8593-d9ba54b2b3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b64eb1-882f-4a4a-a229-258011a9a116", "tag": "82eeab55-1633-44b7-b907-de202ecf439c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:36:50.066735 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bde6a2da-d5fc-471e-9d8e-23a4e386da77 req-3714dcb9-3d69-4771-8593-d9ba54b2b3fc service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:50.067243 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bde6a2da-d5fc-471e-9d8e-23a4e386da77 req-3714dcb9-3d69-4771-8593-d9ba54b2b3fc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:50.067695 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-bde6a2da-d5fc-471e-9d8e-23a4e386da77 req-3714dcb9-3d69-4771-8593-d9ba54b2b3fc service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:50.078585 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-bde6a2da-d5fc-471e-9d8e-23a4e386da77 req-3714dcb9-3d69-4771-8593-d9ba54b2b3fc service nova] Creating event network-changed:82eeab55-1633-44b7-b907-de202ecf439c for instance 82b64eb1-882f-4a4a-a229-258011a9a116 on n-h2-820368-35 Aug 27 06:36:50.083792 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-bde6a2da-d5fc-471e-9d8e-23a4e386da77 req-3714dcb9-3d69-4771-8593-d9ba54b2b3fc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103013 Aug 27 06:36:50.084466 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4119/8224] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:36:50.969105 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c16de2c5-5f2e-4457-b400-8cc0901d4f17 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:50.969815 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c16de2c5-5f2e-4457-b400-8cc0901d4f17 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:50.976913 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c16de2c5-5f2e-4457-b400-8cc0901d4f17 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:50.977407 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c16de2c5-5f2e-4457-b400-8cc0901d4f17 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:50.977859 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c16de2c5-5f2e-4457-b400-8cc0901d4f17 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:50.978567 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c16de2c5-5f2e-4457-b400-8cc0901d4f17 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:50.979032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c16de2c5-5f2e-4457-b400-8cc0901d4f17 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:50.979494 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c16de2c5-5f2e-4457-b400-8cc0901d4f17 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:51.111695 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c16de2c5-5f2e-4457-b400-8cc0901d4f17 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:51.121068 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c16de2c5-5f2e-4457-b400-8cc0901d4f17 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.156361 Aug 27 06:36:51.121662 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4106/8225] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:50 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:52.143378 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-41504e71-e702-45f8-b29b-05b621c273a0 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:52.144000 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-41504e71-e702-45f8-b29b-05b621c273a0 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:52.150308 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41504e71-e702-45f8-b29b-05b621c273a0 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:52.150791 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41504e71-e702-45f8-b29b-05b621c273a0 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:52.151257 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41504e71-e702-45f8-b29b-05b621c273a0 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:52.151963 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41504e71-e702-45f8-b29b-05b621c273a0 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:52.152416 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41504e71-e702-45f8-b29b-05b621c273a0 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:52.152851 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-41504e71-e702-45f8-b29b-05b621c273a0 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:52.290359 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-41504e71-e702-45f8-b29b-05b621c273a0 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:52.298285 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-41504e71-e702-45f8-b29b-05b621c273a0 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.160146 Aug 27 06:36:52.298868 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4120/8226] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:52 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:53.319062 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-c5ff9e64-8b13-43d0-9a24-a97fc0cd0115 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:53.319669 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-c5ff9e64-8b13-43d0-9a24-a97fc0cd0115 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:53.326489 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5ff9e64-8b13-43d0-9a24-a97fc0cd0115 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:53.326994 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5ff9e64-8b13-43d0-9a24-a97fc0cd0115 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:53.327480 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5ff9e64-8b13-43d0-9a24-a97fc0cd0115 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:53.328188 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5ff9e64-8b13-43d0-9a24-a97fc0cd0115 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:53.328660 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5ff9e64-8b13-43d0-9a24-a97fc0cd0115 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:53.329131 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-c5ff9e64-8b13-43d0-9a24-a97fc0cd0115 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:53.463672 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-c5ff9e64-8b13-43d0-9a24-a97fc0cd0115 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:53.471953 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-c5ff9e64-8b13-43d0-9a24-a97fc0cd0115 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.156951 Aug 27 06:36:53.472524 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4107/8227] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:53 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:54.493272 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-66c28653-a63a-401b-aa80-2f05e326c69f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:54.493945 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-66c28653-a63a-401b-aa80-2f05e326c69f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:54.501436 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66c28653-a63a-401b-aa80-2f05e326c69f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:54.501927 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66c28653-a63a-401b-aa80-2f05e326c69f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:54.502373 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66c28653-a63a-401b-aa80-2f05e326c69f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:54.503076 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66c28653-a63a-401b-aa80-2f05e326c69f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:54.503559 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66c28653-a63a-401b-aa80-2f05e326c69f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:54.503995 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-66c28653-a63a-401b-aa80-2f05e326c69f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:54.636544 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-66c28653-a63a-401b-aa80-2f05e326c69f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:54.646150 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-66c28653-a63a-401b-aa80-2f05e326c69f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.156817 Aug 27 06:36:54.646745 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4121/8228] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:54 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:55.668211 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-3c45b42f-2c8d-491a-af69-9e73ead57ec4 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:55.668847 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-3c45b42f-2c8d-491a-af69-9e73ead57ec4 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:55.676727 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c45b42f-2c8d-491a-af69-9e73ead57ec4 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:55.677228 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c45b42f-2c8d-491a-af69-9e73ead57ec4 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:55.677679 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c45b42f-2c8d-491a-af69-9e73ead57ec4 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:55.678388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c45b42f-2c8d-491a-af69-9e73ead57ec4 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:55.678889 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c45b42f-2c8d-491a-af69-9e73ead57ec4 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:55.679371 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-3c45b42f-2c8d-491a-af69-9e73ead57ec4 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:55.816891 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-3c45b42f-2c8d-491a-af69-9e73ead57ec4 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:55.824671 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-3c45b42f-2c8d-491a-af69-9e73ead57ec4 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.160486 Aug 27 06:36:55.825241 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4108/8229] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:55 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:56.819939 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [req-c35300a0-407a-4c61-9492-781c747dceb5 req-0af11bbd-25be-4d74-bf62-29b57b289713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b64eb1-882f-4a4a-a229-258011a9a116", "name": "network-vif-plugged", "status": "completed", "tag": "82eeab55-1633-44b7-b907-de202ecf439c"}]} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:36:56.830500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c35300a0-407a-4c61-9492-781c747dceb5 req-0af11bbd-25be-4d74-bf62-29b57b289713 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:56.830991 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c35300a0-407a-4c61-9492-781c747dceb5 req-0af11bbd-25be-4d74-bf62-29b57b289713 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:56.831457 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [req-c35300a0-407a-4c61-9492-781c747dceb5 req-0af11bbd-25be-4d74-bf62-29b57b289713 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:56.843023 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.compute.server_external_events [req-c35300a0-407a-4c61-9492-781c747dceb5 req-0af11bbd-25be-4d74-bf62-29b57b289713 service nova] Creating event network-vif-plugged:82eeab55-1633-44b7-b907-de202ecf439c for instance 82b64eb1-882f-4a4a-a229-258011a9a116 on n-h2-820368-35 Aug 27 06:36:56.844693 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-eeed15ee-ddf7-443c-9576-87b8f28f7ae2 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:56.845396 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-eeed15ee-ddf7-443c-9576-87b8f28f7ae2 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:56.848208 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [req-c35300a0-407a-4c61-9492-781c747dceb5 req-0af11bbd-25be-4d74-bf62-29b57b289713 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032061 Aug 27 06:36:56.848827 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4122/8230] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:36:56.854403 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeed15ee-ddf7-443c-9576-87b8f28f7ae2 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:56.854984 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeed15ee-ddf7-443c-9576-87b8f28f7ae2 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:56.855531 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeed15ee-ddf7-443c-9576-87b8f28f7ae2 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:56.856133 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeed15ee-ddf7-443c-9576-87b8f28f7ae2 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:56.856608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeed15ee-ddf7-443c-9576-87b8f28f7ae2 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:56.857053 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-eeed15ee-ddf7-443c-9576-87b8f28f7ae2 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:57.040960 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-eeed15ee-ddf7-443c-9576-87b8f28f7ae2 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:57.049187 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-eeed15ee-ddf7-443c-9576-87b8f28f7ae2 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.208671 Aug 27 06:36:57.049962 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4109/8231] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:56 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:36:58.073025 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-c04f7493-ba0d-4bd8-a925-5459ff2afd98 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:58.073666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-c04f7493-ba0d-4bd8-a925-5459ff2afd98 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:58.079960 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c04f7493-ba0d-4bd8-a925-5459ff2afd98 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:58.080454 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c04f7493-ba0d-4bd8-a925-5459ff2afd98 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:58.080901 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c04f7493-ba0d-4bd8-a925-5459ff2afd98 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:58.081609 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c04f7493-ba0d-4bd8-a925-5459ff2afd98 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:58.082074 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c04f7493-ba0d-4bd8-a925-5459ff2afd98 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:58.082520 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-c04f7493-ba0d-4bd8-a925-5459ff2afd98 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:58.214488 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-c04f7493-ba0d-4bd8-a925-5459ff2afd98 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:58.223072 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-c04f7493-ba0d-4bd8-a925-5459ff2afd98 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1374 microversion: 2.1 time: 0.155239 Aug 27 06:36:58.223685 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4123/8232] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:58 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:59.244333 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-ed0ba87b-e448-4314-840c-ce6a4433e210 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:59.244974 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-ed0ba87b-e448-4314-840c-ce6a4433e210 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:59.252073 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed0ba87b-e448-4314-840c-ce6a4433e210 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:59.252582 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed0ba87b-e448-4314-840c-ce6a4433e210 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:59.253038 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed0ba87b-e448-4314-840c-ce6a4433e210 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:59.253810 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed0ba87b-e448-4314-840c-ce6a4433e210 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:59.254287 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed0ba87b-e448-4314-840c-ce6a4433e210 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:59.254735 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-ed0ba87b-e448-4314-840c-ce6a4433e210 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:59.390995 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-ed0ba87b-e448-4314-840c-ce6a4433e210 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:59.398764 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-ed0ba87b-e448-4314-840c-ce6a4433e210 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1559 microversion: 2.1 time: 0.158390 Aug 27 06:36:59.399383 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4110/8233] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:59 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:36:59.419268 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-72dcfa78-ff98-407b-ac40-aca0e045ff70 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:36:59.419888 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-72dcfa78-ff98-407b-ac40-aca0e045ff70 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:36:59.426877 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dcfa78-ff98-407b-ac40-aca0e045ff70 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:59.427405 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dcfa78-ff98-407b-ac40-aca0e045ff70 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:59.427857 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dcfa78-ff98-407b-ac40-aca0e045ff70 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:59.428543 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dcfa78-ff98-407b-ac40-aca0e045ff70 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:36:59.429043 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dcfa78-ff98-407b-ac40-aca0e045ff70 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:36:59.429424 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-72dcfa78-ff98-407b-ac40-aca0e045ff70 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:36:59.559919 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-72dcfa78-ff98-407b-ac40-aca0e045ff70 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:36:59.568385 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-72dcfa78-ff98-407b-ac40-aca0e045ff70 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1559 microversion: 2.1 time: 0.153137 Aug 27 06:36:59.568964 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4124/8234] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:36:59 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:37:01.141455 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b01ec83e-750c-4d39-8bef-6576181dae91 req-01ac728d-b1c6-4a97-9336-d0d352af23dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b64eb1-882f-4a4a-a229-258011a9a116", "tag": "82eeab55-1633-44b7-b907-de202ecf439c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:37:01.152219 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b01ec83e-750c-4d39-8bef-6576181dae91 req-01ac728d-b1c6-4a97-9336-d0d352af23dd service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:37:01.152790 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b01ec83e-750c-4d39-8bef-6576181dae91 req-01ac728d-b1c6-4a97-9336-d0d352af23dd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:37:01.153302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b01ec83e-750c-4d39-8bef-6576181dae91 req-01ac728d-b1c6-4a97-9336-d0d352af23dd service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:37:01.166723 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b01ec83e-750c-4d39-8bef-6576181dae91 req-01ac728d-b1c6-4a97-9336-d0d352af23dd service nova] Creating event network-changed:82eeab55-1633-44b7-b907-de202ecf439c for instance 82b64eb1-882f-4a4a-a229-258011a9a116 on n-h2-820368-35 Aug 27 06:37:01.172579 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b01ec83e-750c-4d39-8bef-6576181dae91 req-01ac728d-b1c6-4a97-9336-d0d352af23dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035447 Aug 27 06:37:01.173216 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4111/8235] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:39:00.209441 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=28 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:39:00.210201 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=64 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:39:00.272702 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-b0d804b4-8edd-4abd-858b-79e8cd6ebb5b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-502989550"}} {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:39:00.275276 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-b0d804b4-8edd-4abd-858b-79e8cd6ebb5b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:39:00.281492 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0d804b4-8edd-4abd-858b-79e8cd6ebb5b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:00.281989 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0d804b4-8edd-4abd-858b-79e8cd6ebb5b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:00.282439 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0d804b4-8edd-4abd-858b-79e8cd6ebb5b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:00.283174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0d804b4-8edd-4abd-858b-79e8cd6ebb5b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:00.283645 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0d804b4-8edd-4abd-858b-79e8cd6ebb5b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:00.284595 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-b0d804b4-8edd-4abd-858b-79e8cd6ebb5b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:00.594670 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-b0d804b4-8edd-4abd-858b-79e8cd6ebb5b tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "POST /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116/action" status: 202 len: 0 microversion: 2.1 time: 0.386698 Aug 27 06:39:00.595357 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4125/8236] 10.222.0.58 () {60 vars in 1278 bytes} [Sat Aug 27 06:39:00 2022] POST /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 06:39:07.606008 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a138aa11-e323-45d1-b35b-6ab4ed1899de] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 06:39:07.607527 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8da433e2-1b8b-43e8-8a70-e929fdcdfc0f] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 06:39:07.608388 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:39:07.609144 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=66 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:39:07.615666 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-4413624e-240f-4a80-bf9a-9af6a361b4b9 req-6d09a16f-c7f3-49be-8b6f-180534ae7a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b64eb1-882f-4a4a-a229-258011a9a116", "name": "network-vif-plugged", "status": "completed", "tag": "82eeab55-1633-44b7-b907-de202ecf439c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:39:07.631544 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4413624e-240f-4a80-bf9a-9af6a361b4b9 req-6d09a16f-c7f3-49be-8b6f-180534ae7a54 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:07.632058 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4413624e-240f-4a80-bf9a-9af6a361b4b9 req-6d09a16f-c7f3-49be-8b6f-180534ae7a54 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:07.632517 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-4413624e-240f-4a80-bf9a-9af6a361b4b9 req-6d09a16f-c7f3-49be-8b6f-180534ae7a54 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:07.644535 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-4413624e-240f-4a80-bf9a-9af6a361b4b9 req-6d09a16f-c7f3-49be-8b6f-180534ae7a54 service nova] Creating event network-vif-plugged:82eeab55-1633-44b7-b907-de202ecf439c for instance 82b64eb1-882f-4a4a-a229-258011a9a116 on n-h2-820368-35 Aug 27 06:39:07.649867 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-4413624e-240f-4a80-bf9a-9af6a361b4b9 req-6d09a16f-c7f3-49be-8b6f-180534ae7a54 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047336 Aug 27 06:39:07.650504 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4112/8237] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:39:19.310004 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-5355a13e-4d6f-4c2d-9b8b-7de9962e5817 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:39:19.310650 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5355a13e-4d6f-4c2d-9b8b-7de9962e5817 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:39:19.316258 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_cell1:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:39:19.318020 n-d-820368-35 devstack@n-api.service[128547]: DEBUG dbcounter [-] [128547] Writing DB stats nova_api:SELECT=2 {{(pid=128547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:39:19.318849 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_api:SELECT=2 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:39:19.319608 n-d-820368-35 devstack@n-api.service[128548]: DEBUG dbcounter [-] [128548] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:39:19.322331 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5355a13e-4d6f-4c2d-9b8b-7de9962e5817 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:19.323034 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5355a13e-4d6f-4c2d-9b8b-7de9962e5817 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:19.323736 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5355a13e-4d6f-4c2d-9b8b-7de9962e5817 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:19.324700 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5355a13e-4d6f-4c2d-9b8b-7de9962e5817 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:19.325389 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5355a13e-4d6f-4c2d-9b8b-7de9962e5817 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:19.325515 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-b712d343-2d60-415f-b618-e7d174601dcc req-6c9432dd-a75d-4a80-9ac6-ed5ffd9cd927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b64eb1-882f-4a4a-a229-258011a9a116", "tag": "82eeab55-1633-44b7-b907-de202ecf439c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:39:19.326246 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-5355a13e-4d6f-4c2d-9b8b-7de9962e5817 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:19.338065 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b712d343-2d60-415f-b618-e7d174601dcc req-6c9432dd-a75d-4a80-9ac6-ed5ffd9cd927 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:19.338555 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b712d343-2d60-415f-b618-e7d174601dcc req-6c9432dd-a75d-4a80-9ac6-ed5ffd9cd927 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:19.339000 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-b712d343-2d60-415f-b618-e7d174601dcc req-6c9432dd-a75d-4a80-9ac6-ed5ffd9cd927 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:19.355443 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] [a138aa11-e323-45d1-b35b-6ab4ed1899de] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 50258. Aug 27 06:39:19.358419 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-5355a13e-4d6f-4c2d-9b8b-7de9962e5817 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:39:19.359023 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-b712d343-2d60-415f-b618-e7d174601dcc req-6c9432dd-a75d-4a80-9ac6-ed5ffd9cd927 service nova] Creating event network-changed:82eeab55-1633-44b7-b907-de202ecf439c for instance 82b64eb1-882f-4a4a-a229-258011a9a116 on n-h2-820368-35 Aug 27 06:39:19.363575 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [-] [8da433e2-1b8b-43e8-8a70-e929fdcdfc0f] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 50260. Aug 27 06:39:19.365686 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-b712d343-2d60-415f-b618-e7d174601dcc req-6c9432dd-a75d-4a80-9ac6-ed5ffd9cd927 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053045 Aug 27 06:39:19.366270 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4113/8238] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:39:19.451967 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-5355a13e-4d6f-4c2d-9b8b-7de9962e5817 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "DELETE /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 204 len: 0 microversion: 2.1 time: 0.146656 Aug 27 06:39:19.452972 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4126/8239] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:39:19 2022] DELETE /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:39:19.462032 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-070f2733-865b-4d38-8e81-b1b4eacef57a tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:39:19.463077 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-070f2733-865b-4d38-8e81-b1b4eacef57a tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:39:19.471587 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-070f2733-865b-4d38-8e81-b1b4eacef57a tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:19.472342 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-070f2733-865b-4d38-8e81-b1b4eacef57a tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:19.473107 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-070f2733-865b-4d38-8e81-b1b4eacef57a tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:19.473838 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-070f2733-865b-4d38-8e81-b1b4eacef57a tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:19.474315 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-070f2733-865b-4d38-8e81-b1b4eacef57a tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:19.474809 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-070f2733-865b-4d38-8e81-b1b4eacef57a tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:19.722302 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-070f2733-865b-4d38-8e81-b1b4eacef57a tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:39:19.730361 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-070f2733-865b-4d38-8e81-b1b4eacef57a tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1684 microversion: 2.1 time: 0.272860 Aug 27 06:39:19.731292 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4114/8240] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:39:19 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1684 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:39:20.753402 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-067b3168-ba78-4da8-b87a-d71c43724624 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:39:20.754174 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-067b3168-ba78-4da8-b87a-d71c43724624 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:39:20.761959 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-067b3168-ba78-4da8-b87a-d71c43724624 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:20.762451 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-067b3168-ba78-4da8-b87a-d71c43724624 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:20.762899 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-067b3168-ba78-4da8-b87a-d71c43724624 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:20.763634 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-067b3168-ba78-4da8-b87a-d71c43724624 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:20.764095 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-067b3168-ba78-4da8-b87a-d71c43724624 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:20.764525 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-067b3168-ba78-4da8-b87a-d71c43724624 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:20.955104 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-067b3168-ba78-4da8-b87a-d71c43724624 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:39:20.962842 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-067b3168-ba78-4da8-b87a-d71c43724624 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1684 microversion: 2.1 time: 0.213762 Aug 27 06:39:20.963458 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4127/8241] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:39:20 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1684 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:39:21.702119 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-5cfc0549-8102-49e4-9218-c377dcfef196 req-444b01fb-7c59-4b27-8683-0c7a7643b2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b64eb1-882f-4a4a-a229-258011a9a116", "name": "network-vif-deleted", "tag": "82eeab55-1633-44b7-b907-de202ecf439c"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:39:21.712608 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5cfc0549-8102-49e4-9218-c377dcfef196 req-444b01fb-7c59-4b27-8683-0c7a7643b2ce service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:21.713114 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5cfc0549-8102-49e4-9218-c377dcfef196 req-444b01fb-7c59-4b27-8683-0c7a7643b2ce service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:21.713585 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-5cfc0549-8102-49e4-9218-c377dcfef196 req-444b01fb-7c59-4b27-8683-0c7a7643b2ce service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:21.725653 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-5cfc0549-8102-49e4-9218-c377dcfef196 req-444b01fb-7c59-4b27-8683-0c7a7643b2ce service nova] Creating event network-vif-deleted:82eeab55-1633-44b7-b907-de202ecf439c for instance 82b64eb1-882f-4a4a-a229-258011a9a116 on n-h2-820368-35 Aug 27 06:39:21.730835 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-5cfc0549-8102-49e4-9218-c377dcfef196 req-444b01fb-7c59-4b27-8683-0c7a7643b2ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105580 Aug 27 06:39:21.731475 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4115/8242] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:39:21.985280 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:39:21.985905 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:39:21.993712 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:21.994213 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:21.994648 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:21.995390 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:21.995947 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:21.996381 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:22.034975 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:22.035500 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:22.035938 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:22.036394 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.objects.instance [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lazy-loading 'fault' on Instance uuid 82b64eb1-882f-4a4a-a229-258011a9a116 {{(pid=128548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:39:22.080832 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:39:22.088606 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-062682dc-a521-40ff-b129-89db25abc454 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 200 len: 1338 microversion: 2.1 time: 0.107269 Aug 27 06:39:22.089208 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4128/8243] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:39:21 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 1338 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:39:23.111232 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:39:23.111948 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 82b64eb1-882f-4a4a-a229-258011a9a116] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:39:23.118098 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:23.118594 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:23.119043 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:23.119767 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:23.120233 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:23.120753 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:23.134145 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.wsgi [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] HTTP exception thrown: Instance 82b64eb1-882f-4a4a-a229-258011a9a116 could not be found. Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Request method failure captured: Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: request: GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 HTTP/1.1 Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: Accept: application/json Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: Accept-Encoding: identity Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: Connection: close Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: Content-Length: 0 Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: Content-Type: application/json Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: Host: 10.222.0.58 Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: Openstack-System-Scope: None Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: User-Agent: python-urllib3/1.26.11 Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Auth-Token: gAAAAABjCbqu7yyc9eUuBsKkDr2tw4snWyI_d71iZWQbrMQBM1gKCHVW7vXdicxeo6GKI5FggluHLY9ELHVNW86EW3OkB_QcJMhRJZZC2uNV5neo1SSZN2j99DnCphvvWHNGgZ7AfZKHCxmAoOnh_ZDNvRoRxerV_2T-cCh4gqO9uUHiE6uf8EU Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Id: None Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Domain-Name: None Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Identity-Status: Confirmed Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Is-Admin-Project: True Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Id: default Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Domain-Name: Default Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Id: 3217538d5bd04de096c25cb1121188bb Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Project-Name: tempest-TestSnapshotPattern-1628166636 Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Role: member,reader Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Roles: member,reader Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3217538d5bd04de096c25cb1121188bb", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3217538d5bd04de096c25cb1121188bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3217538d5bd04de096c25cb1121188bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3217538d5bd04de096c25cb1121188bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant: tempest-TestSnapshotPattern-1628166636 Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Id: 3217538d5bd04de096c25cb1121188bb Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-Tenant-Name: tempest-TestSnapshotPattern-1628166636 Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-User: tempest-TestSnapshotPattern-1628166636-project Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Id: default Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-User-Domain-Name: Default Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-User-Id: 71620ed860574b01977c54eb0b10ae49 Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: X-User-Name: tempest-TestSnapshotPattern-1628166636-project Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: method: > Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: exception: Instance 82b64eb1-882f-4a4a-a229-258011a9a116 could not be found. Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: action_args: {'id': '82b64eb1-882f-4a4a-a229-258011a9a116'} Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b64eb1-882f-4a4a-a229-258011a9a116 could not be found. Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b64eb1-882f-4a4a-a229-258011a9a116 could not be found. Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:39:23.135804 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:39:23.141220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:39:23.141220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:39:23.141220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:39:23.141220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:39:23.141220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:39:23.141220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b64eb1-882f-4a4a-a229-258011a9a116 could not be found. Aug 27 06:39:23.141220 n-d-820368-35 devstack@n-api.service[128547]: ERROR nova.api.openstack.wsgi Aug 27 06:39:23.141220 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Returning 404 to user: Instance 82b64eb1-882f-4a4a-a229-258011a9a116 could not be found. {{(pid=128547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:39:23.141220 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-d5872182-c051-4282-b623-5a169e5d87bd tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116" status: 404 len: 111 microversion: 2.1 time: 0.031125 Aug 27 06:39:23.141220 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4116/8244] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:39:23 2022] GET /compute/v2.1/servers/82b64eb1-882f-4a4a-a229-258011a9a116 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:39:24.799666 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-14b29943-cd01-4fbc-9f5d-40223e77eef5 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:39:24.800321 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-14b29943-cd01-4fbc-9f5d-40223e77eef5 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:39:24.802046 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-8c31414c-e733-4afc-af94-5e139913cc4c req-a0df709b-9fed-4e37-a979-924344fa1ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a874cbb-dc18-4dda-a791-2340c1e64c98", "tag": "98b120c1-3858-4242-a3e5-c34e7705bdb5"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:39:24.808671 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14b29943-cd01-4fbc-9f5d-40223e77eef5 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:24.809452 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14b29943-cd01-4fbc-9f5d-40223e77eef5 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:24.810091 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14b29943-cd01-4fbc-9f5d-40223e77eef5 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:24.810600 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14b29943-cd01-4fbc-9f5d-40223e77eef5 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:24.811060 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14b29943-cd01-4fbc-9f5d-40223e77eef5 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:24.811537 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-14b29943-cd01-4fbc-9f5d-40223e77eef5 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:24.816253 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8c31414c-e733-4afc-af94-5e139913cc4c req-a0df709b-9fed-4e37-a979-924344fa1ab4 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:24.816751 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8c31414c-e733-4afc-af94-5e139913cc4c req-a0df709b-9fed-4e37-a979-924344fa1ab4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:24.817197 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-8c31414c-e733-4afc-af94-5e139913cc4c req-a0df709b-9fed-4e37-a979-924344fa1ab4 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:24.829146 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-8c31414c-e733-4afc-af94-5e139913cc4c req-a0df709b-9fed-4e37-a979-924344fa1ab4 service nova] Creating event network-changed:98b120c1-3858-4242-a3e5-c34e7705bdb5 for instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 on n-h1-820368-35 Aug 27 06:39:24.834745 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-8c31414c-e733-4afc-af94-5e139913cc4c req-a0df709b-9fed-4e37-a979-924344fa1ab4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036787 Aug 27 06:39:24.835718 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4117/8245] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:39:24.842033 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-14b29943-cd01-4fbc-9f5d-40223e77eef5 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Going to try to terminate instance {{(pid=128548) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:39:24.926940 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-14b29943-cd01-4fbc-9f5d-40223e77eef5 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 204 len: 0 microversion: 2.1 time: 0.131468 Aug 27 06:39:24.927840 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4129/8246] 10.222.0.58 () {58 vars in 1239 bytes} [Sat Aug 27 06:39:24 2022] DELETE /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:39:24.937485 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-6662a731-c1e9-4e23-a87a-e0abcbb30c5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:39:24.938448 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.compute.api [None req-6662a731-c1e9-4e23-a87a-e0abcbb30c5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128547) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:39:24.945432 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6662a731-c1e9-4e23-a87a-e0abcbb30c5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:24.946137 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6662a731-c1e9-4e23-a87a-e0abcbb30c5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:24.946698 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6662a731-c1e9-4e23-a87a-e0abcbb30c5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:24.947566 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6662a731-c1e9-4e23-a87a-e0abcbb30c5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:24.948225 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6662a731-c1e9-4e23-a87a-e0abcbb30c5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:24.948798 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [None req-6662a731-c1e9-4e23-a87a-e0abcbb30c5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:25.090652 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.policy [None req-6662a731-c1e9-4e23-a87a-e0abcbb30c5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128547) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:39:25.098528 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-6662a731-c1e9-4e23-a87a-e0abcbb30c5f tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1681 microversion: 2.1 time: 0.166200 Aug 27 06:39:25.099452 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4118/8247] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:39:24 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:39:26.121883 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-8f02aa69-a61a-4c8b-8e40-cd1588e3f350 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:39:26.122354 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-8f02aa69-a61a-4c8b-8e40-cd1588e3f350 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:39:26.129212 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f02aa69-a61a-4c8b-8e40-cd1588e3f350 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:26.129630 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f02aa69-a61a-4c8b-8e40-cd1588e3f350 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:26.130070 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f02aa69-a61a-4c8b-8e40-cd1588e3f350 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:26.130774 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f02aa69-a61a-4c8b-8e40-cd1588e3f350 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:26.131341 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f02aa69-a61a-4c8b-8e40-cd1588e3f350 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:26.131772 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-8f02aa69-a61a-4c8b-8e40-cd1588e3f350 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:26.334142 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.policy [None req-8f02aa69-a61a-4c8b-8e40-cd1588e3f350 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71620ed860574b01977c54eb0b10ae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217538d5bd04de096c25cb1121188bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128548) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:39:26.342247 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-8f02aa69-a61a-4c8b-8e40-cd1588e3f350 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 200 len: 1562 microversion: 2.1 time: 0.225023 Aug 27 06:39:26.350471 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4130/8248] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:39:26 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:39:26.849512 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [req-e1f9a397-2925-41ce-986b-afa1e2091512 req-1d94fa82-4c0d-42b9-875b-99bc2a7c9542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a874cbb-dc18-4dda-a791-2340c1e64c98", "name": "network-vif-deleted", "tag": "98b120c1-3858-4242-a3e5-c34e7705bdb5"}]} {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:39:26.860373 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e1f9a397-2925-41ce-986b-afa1e2091512 req-1d94fa82-4c0d-42b9-875b-99bc2a7c9542 service nova] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:26.860953 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e1f9a397-2925-41ce-986b-afa1e2091512 req-1d94fa82-4c0d-42b9-875b-99bc2a7c9542 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:26.861864 n-d-820368-35 devstack@n-api.service[128547]: DEBUG oslo_concurrency.lockutils [req-e1f9a397-2925-41ce-986b-afa1e2091512 req-1d94fa82-4c0d-42b9-875b-99bc2a7c9542 service nova] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:26.873324 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.compute.server_external_events [req-e1f9a397-2925-41ce-986b-afa1e2091512 req-1d94fa82-4c0d-42b9-875b-99bc2a7c9542 service nova] Creating event network-vif-deleted:98b120c1-3858-4242-a3e5-c34e7705bdb5 for instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 on n-h1-820368-35 Aug 27 06:39:26.878938 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [req-e1f9a397-2925-41ce-986b-afa1e2091512 req-1d94fa82-4c0d-42b9-875b-99bc2a7c9542 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033729 Aug 27 06:39:26.879707 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4119/8249] 10.222.0.58 () {64 vars in 1317 bytes} [Sat Aug 27 06:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:39:27.364794 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '>' {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:39:27.365412 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.compute.api [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [instance: 5a874cbb-dc18-4dda-a791-2340c1e64c98] Fetching instance by UUID {{(pid=128548) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:39:27.372235 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:27.372724 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:27.373168 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:27.373863 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Acquiring lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:39:27.374317 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:39:27.374743 n-d-820368-35 devstack@n-api.service[128548]: DEBUG oslo_concurrency.lockutils [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Lock "ecb88950-d60d-4522-a7e8-290241d8d9e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:39:27.388068 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.wsgi [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] HTTP exception thrown: Instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 could not be found. Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Request method failure captured: Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: request: GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 HTTP/1.1 Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: Accept: application/json Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: Accept-Encoding: identity Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: Connection: close Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: Content-Length: 0 Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: Content-Type: application/json Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: Host: 10.222.0.58 Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: Openstack-System-Scope: None Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: User-Agent: python-urllib3/1.26.11 Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Auth-Token: gAAAAABjCbqu7yyc9eUuBsKkDr2tw4snWyI_d71iZWQbrMQBM1gKCHVW7vXdicxeo6GKI5FggluHLY9ELHVNW86EW3OkB_QcJMhRJZZC2uNV5neo1SSZN2j99DnCphvvWHNGgZ7AfZKHCxmAoOnh_ZDNvRoRxerV_2T-cCh4gqO9uUHiE6uf8EU Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Id: None Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Domain-Name: None Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Identity-Status: Confirmed Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Is-Admin-Project: True Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Id: default Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Domain-Name: Default Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Id: 3217538d5bd04de096c25cb1121188bb Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Project-Name: tempest-TestSnapshotPattern-1628166636 Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Role: member,reader Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Roles: member,reader Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3217538d5bd04de096c25cb1121188bb", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3217538d5bd04de096c25cb1121188bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3217538d5bd04de096c25cb1121188bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3217538d5bd04de096c25cb1121188bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant: tempest-TestSnapshotPattern-1628166636 Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Id: 3217538d5bd04de096c25cb1121188bb Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-Tenant-Name: tempest-TestSnapshotPattern-1628166636 Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-User: tempest-TestSnapshotPattern-1628166636-project Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Id: default Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-User-Domain-Name: Default Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-User-Id: 71620ed860574b01977c54eb0b10ae49 Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: X-User-Name: tempest-TestSnapshotPattern-1628166636-project Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: method: > Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: exception: Instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 could not be found. Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: action_args: {'id': '5a874cbb-dc18-4dda-a791-2340c1e64c98'} Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: {{(pid=128548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 could not be found. Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 could not be found. Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:39:27.389705 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:39:27.395458 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:39:27.395458 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:39:27.395458 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:39:27.395458 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:39:27.395458 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:39:27.395458 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 could not be found. Aug 27 06:39:27.395458 n-d-820368-35 devstack@n-api.service[128548]: ERROR nova.api.openstack.wsgi Aug 27 06:39:27.395458 n-d-820368-35 devstack@n-api.service[128548]: DEBUG nova.api.openstack.wsgi [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Returning 404 to user: Instance 5a874cbb-dc18-4dda-a791-2340c1e64c98 could not be found. {{(pid=128548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:39:27.395458 n-d-820368-35 devstack@n-api.service[128548]: INFO nova.api.openstack.requestlog [None req-e8bcce7b-9720-4500-947b-43db20381d99 tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98" status: 404 len: 111 microversion: 2.1 time: 0.030910 Aug 27 06:39:27.395458 n-d-820368-35 devstack@n-api.service[128548]: [pid: 128548|app: 0|req: 4131/8250] 10.222.0.58 () {58 vars in 1236 bytes} [Sat Aug 27 06:39:27 2022] GET /compute/v2.1/servers/5a874cbb-dc18-4dda-a791-2340c1e64c98 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:39:27.559033 n-d-820368-35 devstack@n-api.service[128547]: DEBUG nova.api.openstack.wsgi [None req-a2e59956-0271-41d0-bba2-4393cfb14add tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] Calling method '.version_select at 0x7fb56517f670>' {{(pid=128547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:39:27.564041 n-d-820368-35 devstack@n-api.service[128547]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a2e59956-0271-41d0-bba2-4393cfb14add tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [e806d047-01c0-40ca-9147-cc66deb820f5] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:39:28.571658 n-d-820368-35 devstack@n-api.service[128547]: INFO oslo.messaging._drivers.impl_rabbit [None req-a2e59956-0271-41d0-bba2-4393cfb14add tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] [e806d047-01c0-40ca-9147-cc66deb820f5] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 50340. Aug 27 06:39:28.591236 n-d-820368-35 devstack@n-api.service[128547]: INFO nova.api.openstack.requestlog [None req-a2e59956-0271-41d0-bba2-4393cfb14add tempest-TestSnapshotPattern-1628166636 tempest-TestSnapshotPattern-1628166636-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2138134931" status: 202 len: 0 microversion: 2.1 time: 1.036397 Aug 27 06:39:28.591756 n-d-820368-35 devstack@n-api.service[128547]: [pid: 128547|app: 0|req: 4120/8251] 10.222.0.58 () {58 vars in 1257 bytes} [Sat Aug 27 06:39:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2138134931 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)